title: Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-training

abstract: Masked Autoencoders (MAE) have shown promising performance in self-supervised learning for both 2D and 3D computer vision. However, existing MAE-style methods can only learn from the data of a single modality, i.e., either images or point clouds, which neglect the implicit semantic and geometric correlation between 2D and 3D. In this paper, we explore how the 2D modality can benefit 3D masked autoencoding, and propose Joint-MAE, a 2D-3D joint MAE framework for self-supervised 3D point cloud pre-training. Joint-MAE randomly masks an input 3D point cloud and its projected 2D images, and then reconstructs the masked information of the two modalities. For better cross-modal interaction, we construct our JointMAE by two hierarchical 2D-3D embedding modules, a joint encoder, and a joint decoder with modal-shared and model-specific decoders. On top of this, we further introduce two cross-modal strategies to boost the 3D representation learning, which are local-aligned attention mechanisms for 2D-3D semantic cues, and a cross-reconstruction loss for 2D-3D geometric constraints. By our pre-training paradigm, Joint-MAE achieves superior performance on multiple downstream tasks, e.g., 92.4% accuracy for linear SVM on ModelNet40 and 86.07% accuracy on the hardest split of ScanObjectNN.


title: Buoyancy-driven attraction of active droplets

abstract: Active oil droplets in a liquid are believed to repel due to the Marangoni effect, while buoyancy effects caused by the density difference between the droplets, diffusing product, and ambient fluid are usually overlooked. Recent experiments have observed active droplet clustering phenomena due to buoyancy-driven convection (Kruger et al. Eur. Phys. J. E, vol. 39, 2016, pp.1-9). In this study, we numerically analyze the buoyancy effect in addition to Marangoni flow, characterized by Peclet number $Pe$. The buoyancy effects originate from (i) the density difference between the droplet and the ambient liquid, which is characterized by Galileo number $Ga$, and (ii) the density difference between the diffusing product (i.e. filled micelles) and the ambient liquid, characterized by a solutal Rayleigh number $Ra$. We analyze how the attracting and repulsing behavior depends on the control parameters $Pe$, $Ga$, and $Ra$. We find that while Marangoni flow causes repulsion, the buoyancy effect leads to attraction, and even collisions can take place at high Ra. We also observe a delayed collision as $Ga$ increases. Moreover, we derive that the attracting velocity, characterized by a Reynolds number $Re_d$, is proportional to $Ra^{1/4}/(l/R)$, where $l/R$ is the normalized distance by radius between neighboring droplets. Finally, we obtain repulsive velocity, characterized by $Re_{rep}$, as proportional to $PeRa^{-0.38}$. The balance of attractive and repulsive effects results in $Pe \sim Ra^{0.63}$, which agrees with the transition curve between regimes with and without collision.


title: Design and fabrication guide for a new metamaterial as an absorber of visible light with exceptionally high absorption efficiency

abstract: We present a guide for the design and fabrication of a CMOS-compatible metamaterial microstructure as an absorber of visible light with exceptionally high absorption efficiency (~ 98%), for wavelengths 400nm-700nm. The structural parameters of the microstructure have been optimized by using Finite Element method (FEM) based COMSOL multyphysics software simulations. An optimized 2D unit cell of the structure consists of 4um by 160 nm TiN base on glass substrate covered with 70 nm thick silicon dioxide (SiO2). A periodic structure of titanium nitride (TiN) straps (each of 90 nm thick and 2-micron wide) is deposited over SiO2. The straps are capped with 40 nm thick layer of high-temperature dielectric hafnium dioxide (HfO2) with periodicity of 4-micron. This unit is symmetric along the other dimension and repeated periodically along the horizontal direction. Additionally, though this microstructure was optimized for visible light spectrum, it also shows almost similar absorption of ~96% intigrated over wavelenght spectrum from 400 nm to 1200 nm. This investigation shows good agreement between simulation and experimental results.


title: Tuning the bulk behavior and 2D interfacial self-assembly of microgels by Keggin-type polyoxometalate ionic specificity

abstract: Finding new ways to tune the behavior of thermoresponsive microgels in bulk and confined at 2D liquid interfaces is key to achieve a deeper understanding and control of these smart materials. We studied the interaction of positively charged pNIPAM microgels with the Keggin-type polyoxometalate $Na_{3}PW_{12}O_{40}$ (POM). In bulk, we observed charge inversions below and above the volume phase transition temperature (VPTT) at significantly low POM concentrations as $5\cdot10^{-5}$ M. In the presence of POM, the microgels exhibited a deswelling-swelling-deswelling behaviour below the VPTT, and a two-step further deswelling above the VPTT. When microgels were confined at 2D water/air interfaces, adding $10^{-5}$ M of POM below the VPTT was equivalent to heat above the VPTT and compress the monolayer from $5$ to $20\,\text{mN m$^{-1}$}$. Above the VPTT, the diameter at the interface did not change while the portion immersed in the subphase further deswelled, in agreement with the behavior in bulk. Adding more POM did not change the diameter at the interface nor the height of the microgels, showing a saturation effect in 2D. The restructuring of the pNIPAM polymeric network by the POM was characterized by EDS mapping and XPS. The microgel monolayers with POM improved their resistance to plasma etching, which could be useful for soft colloidal lithography.


title: Causal isotonic calibration for heterogeneous treatment effects

abstract: We propose causal isotonic calibration, a novel nonparametric method for calibrating predictors of heterogeneous treatment effects. Furthermore, we introduce cross-calibration, a data-efficient variant of calibration that eliminates the need for hold-out calibration sets. Cross-calibration leverages cross-fitted predictors and generates a single calibrated predictor using all available data. Under weak conditions that do not assume monotonicity, we establish that both causal isotonic calibration and cross-calibration achieve fast doubly-robust calibration rates, as long as either the propensity score or outcome regression is estimated accurately in a suitable sense. The proposed causal isotonic calibrator can be wrapped around any black-box learning algorithm, providing robust and distribution-free calibration guarantees while preserving predictive performance.


title: Drone-based quantum key distribution

abstract: Drone-based quantum link has the potential to realize mobile quantum network, and entanglement distribution has been demonstrated using one and two drones. Here we report the first drone-based quantum key distribution (QKD), with average secure key rate larger than 8 kHz using decoy-state BB84 protocol with polarization coding. Compact acquisition, pointing, and tracking (APT) system and QKD modules are developed and loaded on a home-made octocopter, within takeoff weight of 30 kg. A robust link is established between the flying octocopter and a ground station separated 200 meters away and real-time QKD is performed for 400 seconds. This work shows potential of drone-based quantum communication for the future mobile quantum networks.


title: Revisiting Self-Training with Regularized Pseudo-Labeling for Tabular Data

abstract: Recent progress in semi- and self-supervised learning has caused a rift in the long-held belief about the need for an enormous amount of labeled data for machine learning and the irrelevancy of unlabeled data. Although it has been successful in various data, there is no dominant semi- and self-supervised learning method that can be generalized for tabular data (i.e. most of the existing methods require appropriate tabular datasets and architectures). In this paper, we revisit self-training which can be applied to any kind of algorithm including the most widely used architecture, gradient boosting decision tree, and introduce curriculum pseudo-labeling (a state-of-the-art pseudo-labeling technique in image) for a tabular domain. Furthermore, existing pseudo-labeling techniques do not assure the cluster assumption when computing confidence scores of pseudo-labels generated from unlabeled data. To overcome this issue, we propose a novel pseudo-labeling approach that regularizes the confidence scores based on the likelihoods of the pseudo-labels so that more reliable pseudo-labels which lie in high density regions can be obtained. We exhaustively validate the superiority of our approaches using various models and tabular datasets.


title: The formal theory of relative monads

abstract: We develop the theory of relative monads and relative adjunctions in a virtual equipment, extending the theory of monads and adjunctions in a 2-category. The theory of relative comonads and relative coadjunctions follows by duality. While some aspects of the theory behave analogously to the non-relative setting, others require new insights. In particular, the universal properties that define the algebra object and the opalgebra object for a monad in a virtual equipment are stronger than the classical notions of algebra object and opalgebra object for a monad in a 2-category. Inter alia, we prove a number of representation theorems for relative monads, establishing the unity of several concepts in the literature, including the devices of Walters, the $j$-monads of Diers, and the relative monads of Altenkirch, Chapman, and Uustalu. A motivating setting is the virtual equipment $\mathbb{V}\text{-}\mathbf{Cat}$ of categories enriched in a monoidal category $\mathbb{V}$, though many of our results are new even for $\mathbb{V} = \mathbf{Set}$.


title: CO-BED: Information-Theoretic Contextual Optimization via Bayesian Experimental Design

abstract: We formalize the problem of contextual optimization through the lens of Bayesian experimental design and propose CO-BED -- a general, model-agnostic framework for designing contextual experiments using information-theoretic principles. After formulating a suitable information-based objective, we employ black-box variational methods to simultaneously estimate it and optimize the designs in a single stochastic gradient scheme. In addition, to accommodate discrete actions within our framework, we propose leveraging continuous relaxation schemes, which can naturally be integrated into our variational objective. As a result, CO-BED provides a general and automated solution to a wide range of contextual optimization problems. We illustrate its effectiveness in a number of experiments, where CO-BED demonstrates competitive performance even when compared to bespoke, model-specific alternatives.


title: Regularity of CR maps into uniformly pseudoconvex hypersurfaces and applications to proper holomorphic maps

abstract: We study regularity properties of CR maps in positive codimension valued in pseudoconvex manifolds which carry a nontrivial Levi foliation. We introduce an invariant which can be used to deduce that any sufficiently regular CR map from a minimal manifold into such a foliated target is either generically smooth or geometrically highly constrained, and to show generic smoothness of sufficiently regular CR transversal CR maps between pseudoconvex hypersurfaces. As an application, we discuss boundary regularity of proper holomorphic maps into bounded symmetric domains.


title: Full Stack Optimization of Transformer Inference: a Survey

abstract: Recent advances in state-of-the-art DNN architecture design have been moving toward Transformer models. These models achieve superior accuracy across a wide range of applications. This trend has been consistent over the past several years since Transformer models were originally introduced. However, the amount of compute and bandwidth required for inference of recent Transformer models is growing at a significant rate, and this has made their deployment in latency-sensitive applications challenging. As such, there has been an increased focus on making Transformer models more efficient, with methods that range from changing the architecture design, all the way to developing dedicated domain-specific accelerators. In this work, we survey different approaches for efficient Transformer inference, including: (i) analysis and profiling of the bottlenecks in existing Transformer architectures and their similarities and differences with previous convolutional models; (ii) implications of Transformer architecture on hardware, including the impact of non-linear operations such as Layer Normalization, Softmax, and GELU, as well as linear operations, on hardware design; (iii) approaches for optimizing a fixed Transformer architecture; (iv) challenges in finding the right mapping and scheduling of operations for Transformer models; and (v) approaches for optimizing Transformer models by adapting the architecture using neural architecture search. Finally, we perform a case study by applying the surveyed optimizations on Gemmini, the open-source, full-stack DNN accelerator generator, and we show how each of these approaches can yield improvements, compared to previous benchmark results on Gemmini. Among other things, we find that a full-stack co-design approach with the aforementioned methods can result in up to 88.7x speedup with a minimal performance degradation for Transformer inference.


title: A finite difference method for inhomogeneous incompressible Navier-Stokes equations

abstract: This paper provides mathematical analysis of an elementary fully discrete finite difference method applied to inhomogeneous (non-constant density and viscosity) incompressible Navier-Stokes system on a bounded domain. The proposed method consists of a version of Lax-Friedrichs explicit scheme for the transport equation and a version of Ladyzhenskaya's implicit scheme for the Navier-Stokes equations. Under the condition that the initial density profile is strictly away from $0$, the scheme is proven to be strongly convergent to a weak solution (up to a subsequence) within an arbitrary time interval, which can be seen as a proof of existence of a weak solution to the system. The results contain a new Aubin-Lions-Simon type compactness method with an interpolation inequality between strong norms of the velocity and a weak norm of the product of the density and velocity.


title: $n$-Harmonicity, Minimality, Conformality and Cohomology

abstract: By studying cohomology classes that are related with $n$-harmonic morphisms and $F$-harmonic maps, we augment and extend several results on $F$-harmonic maps, harmonic maps in [1, 3, 14], $p$-harmonic morphisms in [17], and also revisit our previous results in [9, 10, 21] on Riemannian submersions and $n$-harmonic morphisms which are submersions. The results, for example Theorem 3.2 obtained by utilizing the $n$-conservation law (2.6), are sharp.


title: Submodular maximization and its generalization through an intersection cut lens

abstract: We study a mixed-integer set $S:=\{(x,t) \in \{0,1\}^n \times \mathbb{R}: f(x) \ge t\}$ arising in the submodular maximization problem, where $f$ is a submodular function defined over $\{0,1\}^n$. We use intersection cuts to tighten a polyhedral outer approximation of $S$. We construct a continuous extension $F$ of $f$, which is convex and defined over the entire space $\mathbb{R}^n$. We show that the epigraph of $F$ is an $S$-free set, and characterize maximal $S$-free sets including the epigraph. We propose a hybrid discrete Newton algorithm to compute an intersection cut efficiently and exactly. Our results are generalized to the hypograph or the superlevel set of a submodular-supermodular function, which is a model for discrete nonconvexity. A consequence of these results is intersection cuts for Boolean multilinear constraints. We evaluate our techniques on max cut, pseudo Boolean maximization, and Bayesian D-optimal design problems within a MIP solver.


title: Quantifying Valence and Arousal in Text with Multilingual Pre-trained Transformers

abstract: The analysis of emotions expressed in text has numerous applications. In contrast to categorical analysis, focused on classifying emotions according to a pre-defined set of common classes, dimensional approaches can offer a more nuanced way to distinguish between different emotions. Still, dimensional methods have been less studied in the literature. Considering a valence-arousal dimensional space, this work assesses the use of pre-trained Transformers to predict these two dimensions on a continuous scale, with input texts from multiple languages and domains. We specifically combined multiple annotated datasets from previous studies, corresponding to either emotional lexica or short text documents, and evaluated models of multiple sizes and trained under different settings. Our results show that model size can have a significant impact on the quality of predictions, and that by fine-tuning a large model we can confidently predict valence and arousal in multiple languages. We make available the code, models, and supporting data.


title: Diacritic Recognition Performance in Arabic ASR

abstract: We present an analysis of diacritic recognition performance in Arabic Automatic Speech Recognition (ASR) systems. As most existing Arabic speech corpora do not contain all diacritical marks, which represent short vowels and other phonetic information in Arabic script, current state-of-the-art ASR models do not produce full diacritization in their output. Automatic text-based diacritization has previously been employed both as a pre-processing step to train diacritized ASR, or as a post-processing step to diacritize the resulting ASR hypotheses. It is generally believed that input diacritization degrades ASR performance, but no systematic evaluation of ASR diacritization performance, independent of ASR performance, has been conducted to date. In this paper, we attempt to experimentally clarify whether input diacritiztation indeed degrades ASR quality, and to compare the diacritic recognition performance against text-based diacritization as a post-processing step. We start with pre-trained Arabic ASR models and fine-tune them on transcribed speech data with different diacritization conditions: manual, automatic, and no diacritization. We isolate diacritic recognition performance from the overall ASR performance using coverage and precision metrics. We find that ASR diacritization significantly outperforms text-based diacritization in post-processing, particularly when the ASR model is fine-tuned with manually diacritized transcripts.


title: New mechanisms for forming multiple hotspots in radio jets

abstract: Hotspots of radio galaxies are regions of shock-driven particle acceleration. Multiple hotspots have long been identified as potential indicators of jet movement or precession. Two frequent explanations describe a secondary hotspot as either the location of a prior jet termination point, or a deflected backflow-driven shock: the so-called Dentist's Drill and Splatter Spot models. We created high-resolution simulations of precessing jets with a range of parameters. In addition to the existing mechanisms, our results show three additional mechanisms for multiple hotspot formation: (1) the splitting of a large terminal hotspots into passive and active components; (2) jet stream splitting resulting in two active hotspots; (3) dynamic multiple hotspot complexes that form as a result of jet termination in a turbulent cocoon, linked here to rapid precession. We show that these distinct types of multiple hotspots are difficult to differentiate in synthetic radio maps, particularly hotspot complexes which can easily be mistaken for the jet itself. We discuss the implication for hypothesised binary supermassive black hole systems where jet precession is a key component of the morphology, and show a selection of potential precession candidates found using the LOFAR Two-Metre Sky Survey Data Release 2 (LoTSS DR2).


title: The Freshness Game: Timely Communications in the Presence of an Adversary

abstract: We consider a communication system where a base station (BS) transmits update packets to $N$ users, one user at a time, over a wireless channel. We investigate the age of this status updating system with an adversary that jams the update packets in the downlink. We consider two system models: with diversity and without diversity. In the model without diversity, we show that if the BS schedules the users with a stationary randomized policy, then the optimal choice for the adversary is to block the user which has the lowest probability of getting scheduled by the BS, at the middle of the time horizon, consecutively for $\alpha T$ time slots. In the model with diversity, we show that for large $T$, the uniform user scheduling algorithm together with the uniform sub-carrier choosing algorithm is $\frac{2 N_{sub}}{N_{sub}-1}$ optimal. Next, we investigate the game theoretic equilibrium points of this status updating system. For the model without diversity, we show that a Nash equilibrium does not exist, however, a Stackelberg equilibrium exists when the scheduling algorithm of the BS acts as the leader and the adversary acts as the follower. For the model with diversity, we show that a Nash equilibrium exists and identify the Nash equilibrium. Finally, we extend the model without diversity to the case where the BS can serve multiple users and the adversary can jam multiple users, at a time.


title: Measurement of Orbital Angular Momentum of Light using Stokes Parameters and Barnett's Formalism

abstract: We present a formalism for experimental determination of the orbital angular momentum (OAM) of a paraxial optical beam-field by intertwining Barnett's formalism and Stokes parameter measurements. Using Barnett's formalism we calculate the OAM flux density of a suitably general 2-dimensional beam-field; and re-express it in terms of experimentally measurable quantities. Considering a demonstrative optical system, we obtain the OAM flux density profiles, total OAM flux and OAM per photon -- leading towards the experimental characterization of OAM using Barnett's formalism. Our method will find potential applications in nano-optical processes involving the transfer of electromagnetic OAM to particles and across interfaces.


title: Methods for systematic study of nuclear structure in high-energy collisions

abstract: There is increasing interest in using high-energy collisions to probe the structure of nuclei, in particular with the high-precision data made possible by collisions performed with pairs of isobaric species. A systematic study requires a variation of parameters representing nuclear properties such as radius, skin thickness, angular deformation, and short-range correlations, to determine the sensitivity of the various observables on each of these properties. In this work we propose a method for efficiently carrying out such study, based on the shifting of positions of nucleons in Monte-Carlo samples. We show that by using this method, statistical demands can be dramatically reduced -- potentially reducing the required number of simulated events by orders of magnitude -- paving the way for systematic study of nuclear structure in high-energy collisions,


title: Diversity matters: Robustness of bias measurements in Wikidata

abstract: With the widespread use of knowledge graphs (KG) in various automated AI systems and applications, it is very important to ensure that information retrieval algorithms leveraging them are free from societal biases. Previous works have depicted biases that persist in KGs, as well as employed several metrics for measuring the biases. However, such studies lack the systematic exploration of the sensitivity of the bias measurements, through varying sources of data, or the embedding algorithms used. To address this research gap, in this work, we present a holistic analysis of bias measurement on the knowledge graph. First, we attempt to reveal data biases that surface in Wikidata for thirteen different demographics selected from seven continents. Next, we attempt to unfold the variance in the detection of biases by two different knowledge graph embedding algorithms - TransE and ComplEx. We conduct our extensive experiments on a large number of occupations sampled from the thirteen demographics with respect to the sensitive attribute, i.e., gender. Our results show that the inherent data bias that persists in KG can be altered by specific algorithm bias as incorporated by KG embedding learning algorithms. Further, we show that the choice of the state-of-the-art KG embedding algorithm has a strong impact on the ranking of biased occupations irrespective of gender. We observe that the similarity of the biased occupations across demographics is minimal which reflects the socio-cultural differences around the globe. We believe that this full-scale audit of the bias measurement pipeline will raise awareness among the community while deriving insights related to design choices of data and algorithms both and refrain from the popular dogma of ``one-size-fits-all''.


title: Modeling of Interface Loads for EOD Suit Wearers

abstract: Explosive Ordnance Disposal (EOD) suits are widely used to protect human operators to execute emergency tasks such as bomb disposal and neutralization. Current suit designs still need to be improved in terms of wearer comfort, which can be assessed based on the interaction forces at the human-suit contact regions. This paper introduces a simulation-based modeling framework that computes the interaction loads at the human-suit interface based on a wearer's kinematic movement data. The proposed modeling framework consists of three primary components: a) inertial and geometric modeling of the EOD suit, b) state estimation of the wearer's in-suit movement, and c) inverse dynamics analysis to calculate the human-suit interface forces based on the simulated human-suit model and the estimated human movement data. This simulation-based modeling method could be used to complement experimental testing for improving the time and cost efficiency of EOD suit evaluation. The accuracy of the simulated interface load was experimentally benchmarked during three different human tasks (each with three trials), by comparing the predicted interface forces with that measured by commercial pressure sensors.


title: On the weighted inequality between the Gagliardo and Sobolev seminorms

abstract: We prove weighted inequalities between the Gagliardo and Sobolev seminorms and also between the Marcinkiewicz quasi-norm and the Sobolev seminorm. With $A_1$ weights we improve earlier results of Bourgain, Brezis, and Mironescu.


title: Multimodal Speech Recognition for Language-Guided Embodied Agents

abstract: Benchmarks for language-guided embodied agents typically assume text-based instructions, but deployed agents will encounter spoken instructions. While Automatic Speech Recognition (ASR) models can bridge the input gap, erroneous ASR transcripts can hurt the agents' ability to complete tasks. In this work, we propose training a multimodal ASR model to reduce errors in transcribing spoken instructions by considering the accompanying visual context. We train our model on a dataset of spoken instructions, synthesized from the ALFRED task completion dataset, where we simulate acoustic noise by systematically masking spoken words. We find that utilizing visual observations facilitates masked word recovery, with multimodal ASR models recovering up to 30% more masked words than unimodal baselines. We also find that a text-trained embodied agent successfully completes tasks more often by following transcribed instructions from multimodal ASR models. github.com/Cylumn/embodied-multimodal-asr


title: Proof-of-Contribution-Based Design for Collaborative Machine Learning on Blockchain

abstract: We consider a project (model) owner that would like to train a model by utilizing the local private data and compute power of interested data owners, i.e., trainers. Our goal is to design a data marketplace for such decentralized collaborative/federated learning applications that simultaneously provides i) proof-of-contribution based reward allocation so that the trainers are compensated based on their contributions to the trained model; ii) privacy-preserving decentralized model training by avoiding any data movement from data owners; iii) robustness against malicious parties (e.g., trainers aiming to poison the model); iv) verifiability in the sense that the integrity, i.e., correctness, of all computations in the data market protocol including contribution assessment and outlier detection are verifiable through zero-knowledge proofs; and v) efficient and universal design. We propose a blockchain-based marketplace design to achieve all five objectives mentioned above. In our design, we utilize a distributed storage infrastructure and an aggregator aside from the project owner and the trainers. The aggregator is a processing node that performs certain computations, including assessing trainer contributions, removing outliers, and updating hyper-parameters. We execute the proposed data market through a blockchain smart contract. The deployed smart contract ensures that the project owner cannot evade payment, and honest trainers are rewarded based on their contributions at the end of training. Finally, we implement the building blocks of the proposed data market and demonstrate their applicability in practical scenarios through extensive experiments.


title: $L^{2}$-Hodge theory on complete almost K\"{a}hler manifold and its application

abstract: Let $(X,J,\omega)$ be a complete $2n$-dimensional almost K\"{a}hler manifold. First part of this article, we construct some identities of various Laplacians, generalized Hodge and Serre dualities, a generalized hard Lefschetz duality, and a Lefschetz decomposition, all on the space of $\ker{\Delta_{\partial}}\cap\ker{\Delta_{\bar{\partial}}}$ on pure bidegree. In the second part, as some applications of those identities, we establish some vanishing theorems on the spaces of $L^{2}$-harmonic $(p,q)$-forms on $X$ under some growth assumptions on the K\"{a}her form $\omega$. We also give some $L^{2}$-estimates to sharpen the vanishing theorems in two specific cases. At last of the article, as an application, we study the topology of the compact almost K\"{a}hler manifold with negative sectional curvature.


title: Leader-Following Consensus of High-Order Perturbed Multi-agent Systems under Multiple Time-Varying Delays

abstract: Solving an output consensus problem in multi-agent systems is often hindered by multiple time-variant delays. To address such fundamental problems over time, we present a new optimal time-variant distributed control for linearly perturbed multi-agent systems by involving an integral sliding mode controller and a linear consensus scheme with constant wights under directed topology. Lyapunov-Krasovskii functionals along with linear matrix inequalities are jointly employed to demonstrate the associated closed-loop stability and convergence features. Maximum delays for the communicating networks are also estimated by linear matrix inequalities. Synchronizing a network of linear time-variant systems to the associated leader dynamics is additionally taken into account by developing an optimization algorithm to find the constant control gains.


title: Asymptotic theory for quadratic variation of harmonizable fractional stable processes

abstract: In this paper we study the asymptotic theory for quadratic variation of a harmonizable fractional $\al$-stable process. We show a law of large numbers with a non-ergodic limit and obtain weak convergence towards a L\'evy-driven Rosenblatt random variable when the Hurst parameter satisfies $H\in (1/2,1)$ and $\al(1-H)<1/2$. This result complements the asymptotic theory for fractional stable processes investigated in e.g. \cite{BHP19,BLP17,BP17,BPT20,LP18,MOP20}.


title: The ROOTS Search Tool: Data Transparency for LLMs

abstract: ROOTS is a 1.6TB multilingual text corpus developed for the training of BLOOM, currently the largest language model explicitly accompanied by commensurate data governance efforts. In continuation of these efforts, we present the ROOTS Search Tool: a search engine over the entire ROOTS corpus offering both fuzzy and exact search capabilities. ROOTS is the largest corpus to date that can be investigated this way. The ROOTS Search Tool is open-sourced and available on Hugging Face Spaces. We describe our implementation and the possible use cases of our tool.


title: Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generator

abstract: We propose an end-to-end Automatic Speech Recognition (ASR) system that can be trained on transcribed speech data, text-only data, or a mixture of both. The proposed model uses an integrated auxiliary block for text-based training. This block combines a non-autoregressive multi-speaker text-to-mel-spectrogram generator with a GAN-based enhancer to improve the spectrogram quality. The proposed system can generate a mel-spectrogram dynamically during training. It can be used to adapt the ASR model to a new domain by using text-only data from this domain. We demonstrate that the proposed training method significantly improves ASR accuracy compared to the system trained on transcribed speech only. It also surpasses cascade TTS systems with the vocoder in the adaptation quality and training speed.


title: GRB 221009A, The BOAT

abstract: GRB 221009A has been referred to as the Brightest Of All Time (the BOAT). We investigate the veracity of this statement by comparing it with a half century of prompt gamma-ray burst observations. This burst is the brightest ever detected by the measures of peak flux and fluence. Unexpectedly, GRB 221009A has the highest isotropic-equivalent total energy ever identified, while the peak luminosity is at the $\sim99$th percentile of the known distribution. We explore how such a burst can be powered and discuss potential implications for ultra-long and high-redshift gamma-ray bursts. By geometric extrapolation of the total fluence and peak flux distributions GRB 221009A appears to be a once in 10,000 year event. Thus, while it almost certainly not the BOAT over all of cosmic history, it may be the brightest gamma-ray burst since human civilization began.


title: Revisiting Variable Ordering for Real Quantifier Elimination using Machine Learning

abstract: Cylindrical Algebraic Decomposition (CAD) is a key proof technique for formal verification of cyber-physical systems. CAD is computationally expensive, with worst-case doubly-exponential complexity. Selecting an optimal variable ordering is paramount to efficient use of CAD. Prior work has demonstrated that machine learning can be useful in determining efficient variable orderings. Much of this work has been driven by CAD problems extracted from applications of the MetiTarski theorem prover. In this paper, we revisit this prior work and consider issues of bias in existing training and test data. We observe that the classical MetiTarski benchmarks are heavily biased towards particular variable orderings. To address this, we apply symmetries to create a new dataset containing more than 41K MetiTarski challenges designed to remove bias. Furthermore, we evaluate issues of information leakage, and test the generalizability of our models on the new dataset.


title: Image-based Pose Estimation and Shape Reconstruction for Robot Manipulators and Soft, Continuum Robots via Differentiable Rendering

abstract: State estimation from measured data is crucial for robotic applications as autonomous systems rely on sensors to capture the motion and localize in the 3D world. Among sensors that are designed for measuring a robot's pose, or for soft robots, their shape, vision sensors are favorable because they are information-rich, easy to set up, and cost-effective. With recent advancements in computer vision, deep learning-based methods no longer require markers for identifying feature points on the robot. However, learning-based methods are data-hungry and hence not suitable for soft and prototyping robots, as building such bench-marking datasets is usually infeasible. In this work, we achieve image-based robot pose estimation and shape reconstruction from camera images. Our method requires no precise robot meshes, but rather utilizes a differentiable renderer and primitive shapes. It hence can be applied to robots for which CAD models might not be available or are crude. Our parameter estimation pipeline is fully differentiable. The robot shape and pose are estimated iteratively by back-propagating the image loss to update the parameters. We demonstrate that our method of using geometrical shape primitives can achieve high accuracy in shape reconstruction for a soft continuum robot and pose estimation for a robot manipulator.


title: Permutation Equivariant Neural Functionals

abstract: This work studies the design of neural networks that can process the weights or gradients of other neural networks, which we refer to as neural functional networks (NFNs). Despite a wide range of potential applications, including learned optimization, processing implicit neural representations, network editing, and policy evaluation, there are few unifying principles for designing effective architectures that process the weights of other networks. We approach the design of neural functionals through the lens of symmetry, in particular by focusing on the permutation symmetries that arise in the weights of deep feedforward networks because hidden layer neurons have no inherent order. We introduce a framework for building permutation equivariant neural functionals, whose architectures encode these symmetries as an inductive bias. The key building blocks of this framework are NF-Layers (neural functional layers) that we constrain to be permutation equivariant through an appropriate parameter sharing scheme. In our experiments, we find that permutation equivariant neural functionals are effective on a diverse set of tasks that require processing the weights of MLPs and CNNs, such as predicting classifier generalization, producing "winning ticket" sparsity masks for initializations, and classifying or editing implicit neural representations (INRs). In addition, we provide code for our models and experiments at https://github.com/AllanYangZhou/nfn.


title: Emergence of a new band and the Lifshitz transition in kagome metal ScV$_6$Sn$_6$ with charge density wave

abstract: Topological kagome systems have been a topic of great interest in condensed matter physics due totheir unique electronic properties. The vanadium-based kagome materials are particularly intrigu-ing since they exhibit exotic phenomena such as charge density wave (CDW) and unconventionalsuperconductivity. The origin of these electronic instabilities is not fully understood, and the re-cent discovery of a charge density wave in ScV6Sn6provides a new avenue for investigation. In thiswork, we investigate the electronic structure of the novel kagome metal ScV6Sn6using angle resolvedphotoemission spectroscopy (ARPES), scanning tunneling microscopy (STM), and first-principlesdensity functional theory calculations. Our analysis reveals for the first time the temperature-dependent band changes of ScV6Sn6and identifies a new band that exhibits a strong signatureof a structure with CDW below the critical temperature. Further analysis revealed that this newband is due to the surface kagome layer of the CDW structure. In addition, a Lifshitz transition isidentified in the ARPES spectra that is related to the saddle point moving across the Fermi levelat the critical temperature for the CDW formation. This result shows the CDW behavior may alsobe related to nesting of the saddle point, similar to related materials. However, no energy gap is observed at the Fermi level and thus the CDW is not a typical Fermi surface nesting scenario. These results provide new insights into the underlying physics of the CDW in the kagome materials and could have implications for the development of materials with new functionality.


title: Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Images

abstract: While multi-modal foundation models pre-trained on large-scale data have been successful in natural language understanding and vision recognition, their use in medical domains is still limited due to the fine-grained nature of medical tasks and the high demand for domain knowledge. To address this challenge, we propose a novel approach called Knowledge-enhanced Auto Diagnosis (KAD) which leverages existing medical domain knowledge to guide vision-language pre-training using paired chest X-rays and radiology reports. We evaluate KAD on {four} external X-ray datasets and demonstrate that its zero-shot performance is not only comparable to that of fully-supervised models, but also superior to the average of three expert radiologists for three (out of five) pathologies with statistical significance. Moreover, when few-shot annotation is available, KAD outperforms all existing approaches in fine-tuning settings, demonstrating its potential for application in different clinical scenarios.


title: Single-Call Stochastic Extragradient Methods for Structured Non-monotone Variational Inequalities: Improved Analysis under Weaker Conditions

abstract: Single-call stochastic extragradient methods, like stochastic past extragradient (SPEG) and stochastic optimistic gradient (SOG), have gained a lot of interest in recent years and are one of the most efficient algorithms for solving large-scale min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. However, despite their undoubted popularity, current convergence analyses of SPEG and SOG require a bounded variance assumption. In addition, several important questions regarding the convergence properties of these methods are still open, including mini-batching, efficient step-size selection, and convergence guarantees under different sampling strategies. In this work, we address these questions and provide convergence guarantees for two large classes of structured non-monotone VIPs: (i) quasi-strongly monotone problems (a generalization of strongly monotone problems) and (ii) weak Minty variational inequalities (a generalization of monotone and Minty VIPs). We introduce the expected residual condition, explain its benefits, and show how it can be used to obtain a strictly weaker bound than previously used growth conditions, expected co-coercivity, or bounded variance assumptions. Equipped with this condition, we provide theoretical guarantees for the convergence of single-call extragradient methods for different step-size selections, including constant, decreasing, and step-size-switching rules. Furthermore, our convergence analysis holds under the arbitrary sampling paradigm, which includes importance sampling and various mini-batching strategies as special cases.


title: Exponential shortcut to measurement-induced entanglement phase transitions

abstract: Recently discovered measurement-induced entanglement phase transitions in monitored quantum circuits provide a novel example of far-from-equilibrium quantum criticality. Here, we propose a highly efficient strategy for experimentally accessing these transitions through fluctuations. Instead of directly measuring entanglement entropy, which requires an exponential number of measurements in the subsystem size, our method provides a scalable approach to entanglement transitions in the presence of conserved quantities. In analogy to entanglement entropy and mutual information, we illustrate how bipartite and multipartite fluctuations can both be employed to analyze the measurement-induced criticality. Remarkably, the phase transition can be revealed by measuring fluctuations of only a handful of qubits.


title: Language Is Not All You Need: Aligning Perception with Language Models

abstract: A big convergence of language, multimodal perception, action, and world modeling is a key step toward artificial general intelligence. In this work, we introduce Kosmos-1, a Multimodal Large Language Model (MLLM) that can perceive general modalities, learn in context (i.e., few-shot), and follow instructions (i.e., zero-shot). Specifically, we train Kosmos-1 from scratch on web-scale multimodal corpora, including arbitrarily interleaved text and images, image-caption pairs, and text data. We evaluate various settings, including zero-shot, few-shot, and multimodal chain-of-thought prompting, on a wide range of tasks without any gradient updates or finetuning. Experimental results show that Kosmos-1 achieves impressive performance on (i) language understanding, generation, and even OCR-free NLP (directly fed with document images), (ii) perception-language tasks, including multimodal dialogue, image captioning, visual question answering, and (iii) vision tasks, such as image recognition with descriptions (specifying classification via text instructions). We also show that MLLMs can benefit from cross-modal transfer, i.e., transfer knowledge from language to multimodal, and from multimodal to language. In addition, we introduce a dataset of Raven IQ test, which diagnoses the nonverbal reasoning capability of MLLMs.


title: Violation of Bell's Inequality in the Clauser-Horne-Shimony-Holt Form with Entangled Quantum States Revisited

abstract: Scientific imagination and experimental ingenuity are at the heart of physics. One of the most known instances where this interplay between theory (i.e., foundations) and experiments (i.e., technology) occurs is in the discussion of Bell's inequalities. In this paper, we present a revisitation of the violation of Bell's inequality in the Clauser-Horne-Shimony-Holt (CHSH) form with entangled quantum states. First, we begin with a discussion of the 1935 Einstein-Podolski-Rosen (EPR) paradox (i.e., incompleteness of quantum mechanics) that emerges from putting the emphasis on Einstein's locality and the absolute character of physical phenomena. Second, we discuss Bell's 1971 derivation of the 1969 CHSH form of the original 1964 Bell inequality in the context of a realistic local hidden-variable theory (RLHVT). Third, identifying the quantum-mechanical spin correlation coefficient with the RLHVT one, we follow Gisin's 1991 analysis to show that quantum mechanics violates Bell's inequality when systems are in entangled quantum states. For pedagogical purposes, we show how the extent of this violation depends both on the orientation of the polarizers and the degree of entanglement of the quantum states. Fourth, we discuss the basics of the experimental verification of Bell's inequality in an actual laboratory as presented in the original 1982 Aspect-Grangier-Roger (AGR) experiment. Finally, we provide an outline of some essential take home messages from this wonderful example of physics at its best.


title: Third quantization of open quantum systems: new dissipative symmetries and connections to phase-space and Keldysh field theory formulations

abstract: The connections between standard theoretical tools used to study open quantum systems can sometimes seem opaque. Whether it is a Lindblad master equation, the equation of motion for the Wigner function or a dissipative Keldysh action, features evident in one formalism are often masked in another. Here, we reformulate the technique of third quantization in a way that explicitly connects all three methods. We first show that our formulation reveals a fundamental dissipative symmetry present in all quadratic bosonic or fermionic Lindbladians. This symmetry can then be used to easily diagonalize these models, and provides a intuitive way to demonstrate the separation of dissipation and fluctations in linear systems. For bosons, we then show that the Wigner function and the characteristic function can be thought of as ''wavefunctions'' of the density matrix in the eigenbasis of the third-quantized superoperators we introduce. The field-theory representation of the time-evolution operator in this basis is then the Keldysh path integral. To highlight the utility of our approach, we apply our version of third quantization to a dissipative non-linear oscillator, and use it to obtain new exact results.


title: Nuclear and electromagnetic cascades induced by ultrahigh-energy cosmic rays in radio galaxies: implications for Centaurus A

abstract: Very-high-energy (VHE) $\gamma$-rays ($\gtrsim 0.1\rm~TeV$) and neutrinos are crucial for identifying accelerators of ultrahigh-energy cosmic rays (UHECRs), but this is challenging especially for UHECR nuclei. In this work, we develop a numerical code to solve the transport equation for UHECRs and their secondaries, where both nuclear and electromagnetic cascades are taken into account self-consistently, considering steady UHECR accelerators such as radio galaxies. In particular, we focus on Centaurus A, which has been proposed as one of the most promising UHECR sources in the local universe. Motivated by observations of extended VHE $\gamma$-ray emission from its kiloparsec-scale jet by the H.E.S.S. telescope, we study interactions between UHECRs accelerated in the large-scale jet and various target photon fields including blazar-like beamed core emission, and present a quantitative study on VHE $\gamma$-ray signatures of UHECR nuclei, including the photodisintegration and Bethe-Heitler pair-production processes. We show that VHE $\gamma$-rays from UHECR nuclei could be detected by the ground-based $\gamma$-ray telescopes given that the dominant composition of UHECRs consists of intermediate-mass (such as oxygen) nuclei


title: Eternal traversable wormholes in three dimensions

abstract: We consider three-dimensional gravity with negative cosmological constant coupled to a large number of light matter fields dual to relevant operators. By imposing suitable boundary conditions on the matter fields we find eternal traversable wormhole deformations of the BTZ black hole, leading to a three-dimensional analogue of the AdS$_{2}$ eternal traversable wormhole found by Maldacena and Qi. We further identify the field theory of boundary gravitons in this setting, which we then use to compute the spectrum of gravitational fluctuations.


title: Topological Andreev Rectification

abstract: We develop the theory of an Andreev junction, which provides a method to probe the intrinsic topology of the Fermi sea of a two-dimensional electron gas (2DEG). An Andreev junction is a Josephson $\pi$ junction proximitizing a ballistic 2DEG, and exhibits low-energy Andreev bound states that propagate $\textit{along}$ the junction. It has been shown that measuring the nonlocal Landauer conductance due to these Andreev modes in a narrow linear junction leads to a topological Andreev rectification (TAR) effect characterized by a quantized conductance that is sensitive to the Euler characteristic $\chi_F$ of the 2DEG Fermi sea. Here we expand on that analysis and consider more realistic device geometries that go beyond the narrow linear junction and fully adiabatic limits considered earlier. Wider junctions exhibit additional Andreev modes that contribute to the transport and degrade the quantization of the conductance. Nonetheless, we show that an appropriately defined $\textit{rectified conductance}$ remains robustly quantized provided large momentum scattering is suppressed. We verify and demonstrate these predictions by performing extensive numerical simulations of realistic device geometries. We introduce a simple model system that demonstrates the robustness of the rectified conductance for wide linear junctions as well as point contacts, even when the nonlocal conductance is not quantized. Motivated by recent experimental advances, we model devices in specific materials, including InAs quantum wells, as well as monolayer and bilayer graphene. These studies indicate that for sufficiently ballistic samples observation of the TAR effect should be within experimental reach.


title: Internet Explorer: Targeted Representation Learning on the Open Web

abstract: Modern vision models typically rely on fine-tuning general-purpose models pre-trained on large, static datasets. These general-purpose models only capture the knowledge within their pre-training datasets, which are tiny, out-of-date snapshots of the Internet -- where billions of images are uploaded each day. We suggest an alternate approach: rather than hoping our static datasets transfer to our desired tasks after large-scale pre-training, we propose dynamically utilizing the Internet to quickly train a small-scale model that does extremely well on the task at hand. Our approach, called Internet Explorer, explores the web in a self-supervised manner to progressively find relevant examples that improve performance on a desired target dataset. It cycles between searching for images on the Internet with text queries, self-supervised training on downloaded images, determining which images were useful, and prioritizing what to search for next. We evaluate Internet Explorer across several datasets and show that it outperforms or matches CLIP oracle performance by using just a single GPU desktop to actively query the Internet for 30--40 hours. Results, visualizations, and videos at https://internet-explorer-ssl.github.io/


title: LODE: Locally Conditioned Eikonal Implicit Scene Completion from Sparse LiDAR

abstract: Scene completion refers to obtaining dense scene representation from an incomplete perception of complex 3D scenes. This helps robots detect multi-scale obstacles and analyse object occlusions in scenarios such as autonomous driving. Recent advances show that implicit representation learning can be leveraged for continuous scene completion and achieved through physical constraints like Eikonal equations. However, former Eikonal completion methods only demonstrate results on watertight meshes at a scale of tens of meshes. None of them are successfully done for non-watertight LiDAR point clouds of open large scenes at a scale of thousands of scenes. In this paper, we propose a novel Eikonal formulation that conditions the implicit representation on localized shape priors which function as dense boundary value constraints, and demonstrate it works on SemanticKITTI and SemanticPOSS. It can also be extended to semantic Eikonal scene completion with only small modifications to the network architecture. With extensive quantitative and qualitative results, we demonstrate the benefits and drawbacks of existing Eikonal methods, which naturally leads to the new locally conditioned formulation. Notably, we improve IoU from 31.7% to 51.2% on SemanticKITTI and from 40.5% to 48.7% on SemanticPOSS. We extensively ablate our methods and demonstrate that the proposed formulation is robust to a wide spectrum of implementation hyper-parameters. Codes and models are publicly available at https://github.com/AIR-DISCOVER/LODE.


title: Emergent scale and anomalous dynamics in certain quasi-periodic systems

abstract: We study localisation transition in a class of quasi-periodic systems that has two competing periodic scales. We show that such class of systems show a re-entrant localisation transition where the energy scale of transition is set by the periodicities of these two scales. Furthermore we show dynamical properties in these systems, exhibits various kinds critical dynamics including sub-diffusive, super-diffusive and diffusive spread of an initially localised wave-packet. Finally we show that these characteristics of quasi-periodic systems with two periodic scales can be realised within the regime of current experiments.

categories: cond-mat.dis-nn cond-mat.other cond-mat.quant-gas nlin.CD


title: Oxidized organic molecules in the tropical free troposphere over Amazonia

abstract: New particle formation (NPF) in the tropical free troposphere (FT) is a globally important source of cloud condensation nuclei, affecting cloud properties and climate. Oxidized organic molecules (OOMs) produced from biogenic volatile organic compounds are believed to contribute to aerosol formation in the tropical FT, but without direct chemical observations. We performed in-situ molecular-level OOMs measurements at the Bolivian station Chacaltaya at 5240 meters above sea level, on the western edge of Amazonia. For the first time, we demonstrate the presence of OOMs, mainly with 4-5 carbon atoms, simultaneously in both gas and particulate phases in tropical FT air from Amazonia. These observations, combined with air mass history analyses, indicate that the observed OOMs are linked to isoprene emitted from the rainforests hundreds of kilometers away. Based on particle-phase measurements, we find that these compounds can contribute to the growth of newly formed particles, and are potentially crucial for new particle formation in the tropical free troposphere on a continental scale. Our study will thus improve the understanding of aerosol formation process in the tropics.


title: Phone and speaker spatial organization in self-supervised speech representations

abstract: Self-supervised representations of speech are currently being widely used for a large number of applications. Recently, some efforts have been made in trying to analyze the type of information present in each of these representations. Most such work uses downstream models to test whether the representations can be successfully used for a specific task. The downstream models, though, typically perform nonlinear operations on the representation extracting information that may not have been readily available in the original representation. In this work, we analyze the spatial organization of phone and speaker information in several state-of-the-art speech representations using methods that do not require a downstream model. We measure how different layers encode basic acoustic parameters such as formants and pitch using representation similarity analysis. Further, we study the extent to which each representation clusters the speech samples by phone or speaker classes using non-parametric statistical testing. Our results indicate that models represent these speech attributes differently depending on the target task used during pretraining.


title: Online Sparse Streaming Feature Selection Using Adapted Classification

abstract: Traditional feature selections need to know the feature space before learning, and online streaming feature selection (OSFS) is proposed to process streaming features on the fly. Existing methods divide features into relevance or irrelevance without missing data, and deleting irrelevant features may lead to in-formation loss. Motivated by this, we focus on completing the streaming feature matrix and division of feature correlation and propose online sparse streaming feature selection based on adapted classification (OS2FS-AC). This study uses Latent Factor Analysis (LFA) to pre-estimate missed data. Besides, we use the adaptive method to obtain the threshold, divide the features into strongly relevant, weakly relevant, and irrelevant features, and then divide weak relevance with more information. Experimental results on ten real-world data sets demonstrate that OS2FS-AC performs better than state-of-the-art algo-rithms.


title: Cross-modal Contrastive Learning for Multimodal Fake News Detection

abstract: Automatic detection of multimodal fake news has gained a widespread attention recently. Many existing approaches seek to fuse unimodal features to produce multimodal news representations. However, the potential of powerful cross-modal contrastive learning methods for fake news detection has not been well exploited. Besides, how to aggregate features from different modalities to boost the performance of the decision-making process is still an open question. To address that, we propose COOLANT, a cross-modal contrastive learning framework for multimodal fake news detection, aiming to achieve more accurate image-text alignment. To further improve the alignment precision, we leverage an auxiliary task to soften the loss term of negative samples during the contrast process. A cross-modal fusion module is developed to learn the cross-modality correlations. An attention mechanism with an attention guidance module is implemented to help effectively and interpretably aggregate the aligned unimodal representations and the cross-modality correlations. Finally, we evaluate the COOLANT and conduct a comparative study on two widely used datasets, Twitter and Weibo. The experimental results demonstrate that our COOLANT outperforms previous approaches by a large margin and achieves new state-of-the-art results on the two datasets.


title: Identification of pattern mining algorithm for rugby league players positional groups separation based on movement patterns

abstract: The application of pattern mining algorithms to extract movement patterns from sports big data can improve training specificity by facilitating a more granular evaluation of movement. As there are various pattern mining algorithms, this study aimed to validate which algorithm discovers the best set of movement patterns for player movement profiling in professional rugby league and the similarity in extracted movement patterns between the algorithms. Three pattern mining algorithms (l-length Closed Contiguous [LCCspm], Longest Common Subsequence [LCS] and AprioriClose) were used to profile elite rugby football league hookers (n = 22 players) and wingers (n = 28 players) match-games movements across 319 matches. Machine learning classification algorithms were used to identify which algorithm gives the best set of movement patterns to separate playing positions with Jaccard similarity score identifying the extent of similarity between algorithms' movement patterns. LCCspm and LCS movement patterns shared a 0.19 Jaccard similarity score. AprioriClose movement patterns shared no significant similarity with LCCspm and LCS patterns. The closed contiguous movement patterns profiled by LCCspm best-separated players into playing positions. Multi-layered Perceptron algorithm achieved the highest accuracy of 91.02% and precision, recall and F1 scores of 0.91 respectively. Therefore, we recommend the extraction of closed contiguous (consecutive) over non-consecutive movement patterns for separating groups of players.


title: Scalable Attribution of Adversarial Attacks via Multi-Task Learning

abstract: Deep neural networks (DNNs) can be easily fooled by adversarial attacks during inference phase when attackers add imperceptible perturbations to original examples, i.e., adversarial examples. Many works focus on adversarial detection and adversarial training to defend against adversarial attacks. However, few works explore the tool-chains behind adversarial examples, which can help defenders to seize the clues about the originator of the attack, their goals, and provide insight into the most effective defense algorithm against corresponding attacks. With such a gap, it is necessary to develop techniques that can recognize tool-chains that are leveraged to generate the adversarial examples, which is called Adversarial Attribution Problem (AAP). In this paper, AAP is defined as the recognition of three signatures, i.e., {\em attack algorithm}, {\em victim model} and {\em hyperparameter}. Current works transfer AAP into single label classification task and ignore the relationship between these signatures. The former will meet combination explosion problem as the number of signatures is increasing. The latter dictates that we cannot treat AAP simply as a single task problem. We first conduct some experiments to validate the attributability of adversarial examples. Furthermore, we propose a multi-task learning framework named Multi-Task Adversarial Attribution (MTAA) to recognize the three signatures simultaneously. MTAA contains perturbation extraction module, adversarial-only extraction module and classification and regression module. It takes the relationship between attack algorithm and corresponding hyperparameter into account and uses the uncertainty weighted loss to adjust the weights of three recognition tasks. The experimental results on MNIST and ImageNet show the feasibility and scalability of the proposed framework as well as its effectiveness in dealing with false alarms.


title: Semi-supervised Clustering with Two Types of Background Knowledge: Fusing Pairwise Constraints and Monotonicity Constraints

abstract: This study addresses the problem of performing clustering in the presence of two types of background knowledge: pairwise constraints and monotonicity constraints. To achieve this, the formal framework to perform clustering under monotonicity constraints is, firstly, defined, resulting in a specific distance measure. Pairwise constraints are integrated afterwards by designing an objective function which combines the proposed distance measure and a pairwise constraint-based penalty term, in order to fuse both types of information. This objective function can be optimized with an EM optimization scheme. The proposed method serves as the first approach to the problem it addresses, as it is the first method designed to work with the two types of background knowledge mentioned above. Our proposal is tested in a variety of benchmark datasets and in a real-world case of study.


title: Semantic-aware Node Synthesis for Imbalanced Heterogeneous Information Networks

abstract: Heterogeneous graph neural networks (HGNNs) have exhibited exceptional efficacy in modeling the complex heterogeneity in heterogeneous information networks (HINs). The critical advantage of HGNNs is their ability to handle diverse node and edge types in HINs by extracting and utilizing the abundant semantic information for effective representation learning. However, as a widespread phenomenon in many real-world scenarios, the class-imbalance distribution in HINs creates a performance bottleneck for existing HGNNs. Apart from the quantity imbalance of nodes, another more crucial and distinctive challenge in HINs is semantic imbalance. Minority classes in HINs often lack diverse and sufficient neighbor nodes, resulting in biased and incomplete semantic information. This semantic imbalance further compounds the difficulty of accurately classifying minority nodes, leading to the performance degradation of HGNNs. To tackle the imbalance of minority classes and supplement their inadequate semantics, we present the first method for the semantic imbalance problem in imbalanced HINs named Semantic-aware Node Synthesis (SNS). By assessing the influence on minority classes, SNS adaptively selects the heterogeneous neighbor nodes and augments the network with synthetic nodes while preserving the minority semantics. In addition, we introduce two regularization approaches for HGNNs that constrain the representation of synthetic nodes from both semantic and class perspectives to effectively suppress the potential noises from synthetic nodes, facilitating more expressive embeddings for classification. The comprehensive experimental study demonstrates that SNS consistently outperforms existing methods by a large margin in different benchmark datasets.


title: Explanations for Automatic Speech Recognition

abstract: We address quality assessment for neural network based ASR by providing explanations that help increase our understanding of the system and ultimately help build trust in the system. Compared to simple classification labels, explaining transcriptions is more challenging as judging their correctness is not straightforward and transcriptions as a variable-length sequence is not handled by existing interpretable machine learning models. We provide an explanation for an ASR transcription as a subset of audio frames that is both a minimal and sufficient cause of the transcription. To do this, we adapt existing explainable AI (XAI) techniques from image classification-Statistical Fault Localisation(SFL) and Causal. Additionally, we use an adapted version of Local Interpretable Model-Agnostic Explanations (LIME) for ASR as a baseline in our experiments. We evaluate the quality of the explanations generated by the proposed techniques over three different ASR ,Google API, the baseline model of Sphinx, Deepspeech and 100 audio samples from the Commonvoice dataset.


title: How optimal transport can tackle gender biases in multi-class neural-network classifiers for job recommendations?

abstract: Automatic recommendation systems based on deep neural networks have become extremely popular during the last decade. Some of these systems can however be used for applications which are ranked as High Risk by the European Commission in the A.I. act, as for instance for online job candidate recommendation. When used in the European Union, commercial AI systems for this purpose will then be required to have to proper statistical properties with regard to potential discrimination they could engender. This motivated our contribution, where we present a novel optimal transport strategy to mitigate undesirable algorithmic biases in multi-class neural-network classification. Our stratey is model agnostic and can be used on any multi-class classification neural-network model. To anticipate the certification of recommendation systems using textual data, we then used it on the Bios dataset, for which the learning task consists in predicting the occupation of female and male individuals, based on their LinkedIn biography. Results show that it can reduce undesired algorithmic biases in this context to lower levels than a standard strategy.


title: Exploring locust hopper bands emergent patterns using parallel computing

abstract: To date, the mechanisms underlying the diversity of the emergent patterns of collective motion in locust hopper bands remain to be unveiled. This study investigates the role of speed heterogeneity in the emergence of the most common patterns (frontal and columnar), following the Self-Organization framework. To address whether marching activity intermittency and density-dependant hopping individual behaviours could underlie the formation of such patterns, a three-zone Self-Propelled Particles model variant was formulated. In this model, individuals alternated between marching and resting periods, and were more likely to hop when crowded. The model successfully predicted the emergence of both patterns of interest, with the presence of a density-dependent hopping probability being a necessary condition. Short to absent pause periods mostly resulted in columnar shapes, similar to the ones observed in the brown locust (Locustana pardalina) and long pause periods rather resulted in frontal shapes, such as exhibited by the Australian plague locust (Chortoicetes terminifera). Furthermore, the density profiles of simulated frontal formations displayed the same shape as empirical profiles of Australian plague locust hopper bands. Both simulated and experimental paint marking experiments showed that locusts initially located at different positions in the band were find together at its front after a few hours marching; an expected global behavior in hopper bands undergoing activity intermittency. These results represent an important first step towards a cross-species comparison of locust mass migration patterns.


title: Analytical expression of negative differential thermal resistance in a macroscopic heterojunction

abstract: Heat flux ($J$) generally increases with temperature difference in a material. A differential coefficient of $J$ against temperature ($T$) is called differential thermal conductance ($k$), and an inverse of $k$ is differential thermal resistance ($r$). Although $k$ and $r$ are generally positive, they can be negative in a macroscopic heterojunction with positive $T$-dependent interfacial thermal resistance (ITR). The negative differential thermal resistance (NDTR) effect is an important effect that can realize thermal transistor, thermal memory, and thermal logic gate. In this paper, we examine analytical expressions of $J$, $k$, $r$, and other related quantities as a function of parameters related to thermal conductivity ($\kappa$) and ITR in a macroscopic heterojunction to precisely describe the NDTR effect.


title: Query-optimal estimation of unitary channels in diamond distance

abstract: We consider process tomography for unitary quantum channels. Given access to an unknown unitary channel acting on a $\textsf{d}$-dimensional qudit, we aim to output a classical description of a unitary that is $\varepsilon$-close to the unknown unitary in diamond norm. We design an algorithm achieving error $\varepsilon$ using $O(\textsf{d}^2/\varepsilon)$ applications of the unknown channel and only one qudit. This improves over prior results, which use $O(\textsf{d}^3/\varepsilon^2)$ [via standard process tomography] or $O(\textsf{d}^{2.5}/\varepsilon)$ [Yang, Renner, and Chiribella, PRL 2020] applications. To show this result, we introduce a simple technique to "bootstrap" an algorithm that can produce constant-error estimates to one that can produce $\varepsilon$-error estimates with the Heisenberg scaling. Finally, we prove a complementary lower bound showing that estimation requires $\Omega(\textsf{d}^2/\varepsilon)$ applications, even with access to the inverse or controlled versions of the unknown unitary. This shows that our algorithm has both optimal query complexity and optimal space complexity.


title: Variational Quantum Eigensolvers in the Era of Distributed Quantum Computers

abstract: The computational power of a quantum computer is limited by the number of qubits available for information processing. Increasing this number within a single device is difficult; it is widely accepted that distributed modular architectures are the solution to large scale quantum computing. The major challenge in implementing such architectures is the need to exchange quantum information between modules. In this work, we show that a distributed quantum computing architecture with {\it limited} capacity to exchange information between modules can accurately solve quantum computational problems. Using the example of a variational quantum eignesolver with an ansatz designed for a two-module (dual-core) architecture, we show that three inter-module operations provide a significant advantage over no inter-module (or serially executed) operations. These results provide a strong indication that near-term {\it modular} quantum processors can be an effective alternative to their monolithic counterparts.


title: Branes and symmetries for $\mathcal N=3$ S-folds

abstract: We describe the higher-form and non-invertible symmetries of 4d $\mathcal N= 3$ S-folds using the brane dynamics of their holographic duals. In cases with enhancement to $\mathcal N=4$ supersymmetry, our analysis reproduces the known field theory results of Aharony, Seiberg and Tachikawa, and is compatible with the effective action recently given by Bergman and Hirano. Likewise, for two specific $\mathcal N=3$ theories for which Zafrir has conjectured $\mathcal N=1$ Lagrangians our results agree with those implied by the Lagrangian description. In all other cases, our results imply novel predictions about the symmetries of the corresponding $\mathcal N=3$ field theories.


title: Line Defect RG Flows in the $\varepsilon$ Expansion

abstract: A general analysis of line defect renormalisation group (RG) flows in the $\varepsilon$ expansion below $d=4$ dimensions is undertaken. The defect beta function for general scalar-fermion bulk theories is computed to next-to-leading order in the bulk couplings. Scalar models as well as scalar-fermion models with various global symmetries in the bulk are considered at leading non-trivial order. Different types of potential infrared (IR) defect conformal field theories (dCFTs) and their RG stability are discussed. The possibility of multiple IR stable dCFTs is realised in specific examples with hypertetrahedral symmetry in the bulk. The one-point function coefficient of the order parameter in the stable IR dCFT of the cubic model is computed at next-to-leading order and compared with that in the IR dCFT of the Heisenberg model.


title: The Search for Thermonuclear Transients from the Tidal Disruption of a White Dwarf by an Intermediate Mass Black Hole

abstract: The close encounter of a white dwarf (WD) with a black hole (BH) could result in the tidal disruption of the WD. During this encounter, the WD can undergo a thermonuclear explosion due to its tidal compression, resulting in an optical transient similar to a Type Ia supernova (SN Ia), hereafter a Ia-TDE. Nevertheless, this will only be physically observable if the BH is $\lesssim 10^5$M$_\odot$. Finding a Ia-TDE would therefore imply the discovery of an intermediate mass black hole (IMBH) $\lesssim 10^5$ M$_\odot$. Here, we search the entire Zwicky Transient Facility (ZTF) alert stream for the elusive Ia-TDEs. We restrict our search to nuclear transients in dwarf galaxies, the likely sites for IMBHs, and find a total of six possible nuclear Ia-TDE candidates. We find SN\,2020lrt to be the most likely Ia-TDE candidate, thanks to its strong resemblance to light curve and spectroscopic models of Ia-TDEs. We measure the stellar masses of the dwarf galaxies hosting these transients to be $\lesssim 10^{9}$M$_\odot$; if confirmed to harbor BHs, these would prove the existence of IMBHs in some of the lowest-mass galaxies known. Additionally, we searched for off-nuclear Ia-TDEs, but were unable to find more robust candidates in the outskirts of galaxies than in their nuclei. This supports the hypothesis that the nuclear Ia-TDEs candidates are WDs tidally compressed by IMBHs in the cores of galaxies, as opposed to a class of transient that can happen anywhere in a galaxy. We have laid the groundwork to systematically search for Ia-TDE candidates in existing and future time-domain surveys. Rapid characterization of their nature will result in not only the confirmation of a Ia-TDE, but also the unambiguous discovery of bonafide IMBHs.


title: Quiescent and active galactic nuclei as factories of merging compact objects in the era of gravitational-wave astronomy

abstract: Galactic nuclei harbouring a central supermassive black hole (SMBH), possibly surrounded by a dense nuclear cluster (NC), represent extreme environments which house a complex interplay of many physical processes that uniquely affect stellar formation, evolution, and dynamics. The discovery of gravitational waves (GW) emitted by merging black holes (BHs) and neutron stars (NSs), funnelled a huge amount of work focused on understanding how compact object binaries (COBs) can pair-up and merge together. Here, we review from a theoretical standpoint how different mechanisms concur to the formation, evolution, and merger of COBs around quiescent SMBHs and active galactic nuclei (AGNs), summarizing the main predictions for current and future (GW) detections and outlining the possible features that can clearly mark a galactic nuclei origin.


title: Heterogeneous Ta-dichalcogenide bilayer: heavy fermions or doped Mott physics?

abstract: Controlling and understanding electron correlations in quantum matter is one of the most challenging tasks in materials engineering. In the past years a plethora of new puzzling correlated states have been found by carefully stacking and twisting two-dimensional van der Waals materials of different kind. Unique to these stacked structures is the emergence of correlated phases not foreseeable from the single layers alone. In Ta-dichalcogenide heterostructures made of a good metallic 1H- and a Mott-insulating 1T-layer, recent reports have evidenced a cross-breed itinerant and localized nature of the electronic excitations, similar to what is typically found in heavy fermion systems. Here, we put forward a new interpretation based on first-principles calculations which indicates a sizeable charge transfer of electrons (0.4-0.6 e) from 1T to 1H layers at an elevated interlayer distance. We accurately quantify the strength of the interlayer hybridization which allows us to unambiguously determine that the system is much closer to a doped Mott insulator than to a heavy fermion scenario. Ta-based heterolayers provide therefore a new ground for quantum-materials engineering in the regime of heavily doped Mott insulators hybridized with metallic states at a van der Waals distance.


title: Phonon Thermal Hall Effect in a non-Kramers Paramagnet

abstract: With an increasing number of experiments observing phonon thermal Hall effect in magnets, it is theoretically desired to have a minimal model for the phonon thermal Hall effect. In this work, we study a simple model of acoustic phonons and uncorrelated paramagnetic doublets. When the doublets are non-Kramers, a linear pseudospin-phonon coupling is allowed by time-reversal symmetry and yields resonant phonon-pseudospin scattering. We compute the thermal longitudinal and Hall conductivities of the model and found qualitative agreement with recent experiments in $\rm{Pr}_2\rm{Ir}_2\rm{O}_7$ [Uehara et al.,Nat Commun 13, 4604 (2022)].


title: Mass bias and cosmological constraints from Planck cluster clustering

abstract: We analysed the 3D clustering of the Planck sample of Sunyaev-Zeldovich (SZ) selected galaxy clusters, focusing on the redshift-space two-point correlation function (2PCF). We compared our measurements to theoretical predictions of the standard $\Lambda$ cold dark matter ($\Lambda$CDM) cosmological model, deriving an estimate of the Planck mass bias, $b_{\mathrm SZ}$, and cosmological parameters. We measured the 2PCF of the sample in the cluster-centric radial range $r\in[10,150]$ $h^{-1}$Mpc, considering 920 galaxy clusters with redshift $z\leq0.8$. A Markov chain Monte Carlo analysis has been performed to constrain $b_{\mathrm SZ}$, assuming priors on cosmological parameters from Planck Cosmic Microwave Background (CMB) results. We also adopted priors on $b_{\mathrm SZ}$ from external data sets to constrain the cosmological parameters $\Omega_{\mathrm m}$ and $\sigma_8$. We obtained $(1-b_{\mathrm SZ})=0.62^{+0.14}_{-0.11}$, which is in agreement with the value required to reconcile primary CMB and cluster count observations. By adopting priors on $(1-b_{\mathrm SZ})$ from external data sets, we derived results on $\Omega_{\mathrm m}$ that are fully in agreement and competitive, in terms of uncertainties, with those derived from cluster counts. This confirms the importance of including clustering in cosmological studies, in order to fully exploit the information from galaxy cluster statistics. On the other hand, we found that $\sigma_8$ is not constrained.


title: First detection of CO emission from Cepheid Variable stars

abstract: We present IRAM 30~m Telescope observations of the CO(1-0) and CO(2-1) emission lines in a sample of eight Cepheid variable stars. The CO(1-0) line is detected in four of the eight targets at a signal-to-noise of $>$3.5 confirming the presence of CO in Cepheid atmospheres. Two sources show strong absorption in both CO lines; this is likely related to contamination by cold molecular gas clouds along or close to the line of sight. The remaining two targets showed no strong features related to either CO line. These detections represent the first direct evidence for the presence of CO in Cepheid atmospheres, providing strong evidence for the mechanism proposed to explain the observed mid-infrared colour variation seen in Cepheids. Further, these detections support the proposed use of mid-IR colour as a robust photometric metallicity indicator for Cepheids, potentially leading to the elimination of metallicity systematics from the $H_0$ error budget. We discuss the future studies needed in this area and how our observations can be used to inform optimal observing strategies for large-scale dedicated studies.


title: Weiss Oscillations in the Galilean-Invariant Dirac Composite Fermion Theory for Even-Denominator Filling Fractions of the Lowest Landau Level

abstract: Standard field theoretic formulations of composite fermion theories for the anomalous metals that form at or near even-denominator filling fractions of the lowest Landau level do not possess Galilei invariance. To restore Galilei symmetry, these theories must be supplemented by "correction" terms. We study the effect of the leading "correction" term, known as the dipole term, in the Dirac composite fermion theory (a theory that consists of a Dirac fermion coupled to an Abelian Chern-Simons gauge field) on quantum oscillations in the electrical resistivity due to a periodic scalar potential about even-denominator filling fractions. We find the dipole term to be insufficient to resolve the systematic discrepancy, discovered in [Kamburov et. al., Phys. Rev. Lett. 113, 196801 (2014)], between the locations of the oscillation minima predicted by Dirac composite fermion theory without Galilei invariance and those observed in experiment. Further, in contrast to [Hossain et al., Phys. Rev. B 100, 041112 (2019)], we find the quantum oscillations about the half-filled and quarter-filled lowest Landau level to have qualitatively similar behavior. This analysis uses a mean-field approximation, in which gauge field fluctuations are neglected. Based on this and previous analyses, we speculate the discrepancy with experiment may be an indirect signature of the effect of gauge field fluctuations in composite fermion theory.


title: The Lyman $\alpha$ Reference Sample XIV: Lyman $\alpha$ imaging of 45 low redshift star-forming galaxies and inferences on global emission

abstract: We present Ly $\alpha$ imaging of 45 low redshift star-forming galaxies observed with the Hubble Space Telescope. The galaxies have been selected to have moderate to high star formation rates using far-ultraviolet (FUV) luminosity and \ha equivalent width criteria, but no constraints on Ly $\alpha$ luminosity. We employ a pixel stellar continuum fitting code to obtain accurate continuum subtracted Ly $\alpha$, H $\alpha$ and H $\beta$ maps. We find that Ly $\alpha$ is less concentrated than FUV and optical line emission in almost all galaxies with significant Ly $\alpha$ emission. We present global measurements of Ly $\alpha$ and other quantities measured in apertures designed to capture all of the Ly $\alpha$ emission. We then show how the escape fraction of Ly $\alpha$ relates to a number of other measured quantities (mass, metallicity, star formation, ionisation parameter, and extinction). We find that the escape fraction is strongly anti-correlated with nebular and stellar extinction, weakly anti-correlated with stellar mass, but no conclusive evidence for correlations with other quantities. We show that Ly $\alpha$ escape fractions are inconsistent with common dust extinction laws, and discuss how a combination of radiative transfer effects and clumpy dust models can help resolve the discrepancies. We present a star formation rate calibration based on Ly $\alpha$ luminosity, where the equivalent width of Ly $\alpha$ is used to correct for non-unity escape fraction, and show that this relation provides a reasonably accurate SFR estimate. We also show stacked growth curves of Ly $\alpha$ for the galaxies that can be used to find aperture loss fractions at a given physical radius.


title: Analyzing Populations of Neural Networks via Dynamical Model Embedding

abstract: A core challenge in the interpretation of deep neural networks is identifying commonalities between the underlying algorithms implemented by distinct networks trained for the same task. Motivated by this problem, we introduce DYNAMO, an algorithm that constructs low-dimensional manifolds where each point corresponds to a neural network model, and two points are nearby if the corresponding neural networks enact similar high-level computational processes. DYNAMO takes as input a collection of pre-trained neural networks and outputs a meta-model that emulates the dynamics of the hidden states as well as the outputs of any model in the collection. The specific model to be emulated is determined by a model embedding vector that the meta-model takes as input; these model embedding vectors constitute a manifold corresponding to the given population of models. We apply DYNAMO to both RNNs and CNNs, and find that the resulting model embedding spaces enable novel applications: clustering of neural networks on the basis of their high-level computational processes in a manner that is less sensitive to reparameterization; model averaging of several neural networks trained on the same task to arrive at a new, operable neural network with similar task performance; and semi-supervised learning via optimization on the model embedding space. Using a fixed-point analysis of meta-models trained on populations of RNNs, we gain new insights into how similarities of the topology of RNN dynamics correspond to similarities of their high-level computational processes.


title: Effective rheology of immiscible two-phase flow in porous media consisting of random mixtures of grains having two types of wetting properties

abstract: We consider the effective rheology of immiscible two-phase flow in porous media with random mixtures of two types of grains with different wetting properties using a dynamic pore network model under steady-state. Two immiscible fluids A and B flow through the pores between these two types of grains denoted "+" and "-". Fluid A is fully wetting and B is fully non-wetting with respect to "+" grains and opposite with "-" grains. The direction of the capillary forces in the links between two "+" grains is therefore opposite compared to that between two "-" grains, whereas the capillary forces in the links between two opposite types of grains average to zero. For a window of grain occupation probabilities, a percolating regime appears where there is a high probability of having connected paths with zero capillary forces. Due to these paths, no minimum threshold pressure is required to start a flow in this regime. While varying the pressure drop across the porous medium from low to high in this regime, the relation between the volumetric flow rate and the pressure drop goes from being linear to a power law with exponent 2.56 to linear again. Outside the percolation regime, there is a threshold pressure. No linear regime is observed for low pressure drops. When the pressure drop is high enough for there to be flow, we find that the flow rate depends on the excess pressure drop to an exponents around 2.2-2.3. At even higher pressure drops, the relation is linear. We see no change in exponent for the intermediate regime at the percolation critical points where the zero-capillary force paths disappear. We measure the mobility at the percolation threshold at low pressure drops so that the flow rate versus pressure drop is linear. Assuming a power law, the mobility is proportional to the difference between the occupation probability and the critical occupation probability to a power of around 5.7.


title: Primordial-tensor-induced stochastic gravitational waves

abstract: Cosmological stochastic gravitational waves (GWs) induced by a spectator field are usually expected to have an amplitude very small compared with those generated by the curvature perturbation, or equivalently by a field dominating the universe. On the contrary to this expectation, we show that a spectator field that provides a tensor perturbation, on top of the metric tensor perturbation, can generate a significant amount of GWs. The amplitude and frequency of the generated GWs may lie within the sensitivity range of future GW detectors. In particular, if the sound velocities of the two tensor perturbations coincide, the induced GW amplitude may become very large due to resonance by forced oscillation, even in the limit of small coupling between them. A distinct feature of this scenario is that, since tensor modes can hardly lead to the formation of primordial black holes (PBHs), we expect no presence of PBHs, in contrast to the usual scalar-induced case, in which the detection of strong enough induced GWs suggests the existence of PBHs.


title: From the XXZ chain to the integrable Rydberg-blockade ladder via non-invertible duality defects

abstract: Strongly interacting models often possess "dualities" subtler than a one-to-one mapping of energy levels. The maps can be non-invertible, as apparent in the canonical example of Kramers and Wannier. We analyse an algebraic structure common to the XXZ spin chain and three other models: Rydberg-blockade bosons with one particle per square of a ladder, a three-state antiferromagnet, and two Ising chains coupled in a zigzag fashion. The structure yields non-invertible maps between the four models while also guaranteeing all are integrable. We construct these maps explicitly utilising topological defects coming from fusion categories and the lattice version of the orbifold construction, and use them to give explicit conformal-field-theory partition functions describing their critical regions. The Rydberg and Ising ladders also possess interesting non-invertible symmetries, with the spontaneous breaking of one in the former resulting in an unusual ground-state degeneracy.

categories: cond-mat.stat-mech cond-mat.str-el hep-th math-ph math.MP


title: Detecting and Mitigating Mode-Collapse for Flow-based Sampling of Lattice Field Theories

abstract: We study the consequences of mode-collapse of normalizing flows in the context of lattice field theory. Normalizing flows allow for independent sampling. For this reason, it is hoped that they can avoid the tunneling problem of local-update MCMC algorithms for multi-modal distributions. In this work, we first point out that the tunneling problem is also present for normalizing flows but is shifted from the sampling to the training phase of the algorithm. Specifically, normalizing flows often suffer from mode-collapse for which the training process assigns vanishingly low probability mass to relevant modes of the physical distribution. This may result in a significant bias when the flow is used as a sampler in a Markov-Chain or with Importance Sampling. We propose a metric to quantify the degree of mode-collapse and derive a bound on the resulting bias. Furthermore, we propose various mitigation strategies in particular in the context of estimating thermodynamic observables, such as the free energy.


title: Bound states in the continuum and Majorana zero modes in a double quantum dot interferometer: Ghost-Fano Majorana effect

abstract: We investigate the transport properties through a nanostructure composed of parallel double quantum dots coupled to two normal contacts. Additionally, each quantum dot is connected to a topological superconducting nanowire, hosting Majorana zero modes at its ends. A magnetic flux threading across the area enclosed by the interferometer is considered. First, we investigate the physical quantities of the system employing Green's function formalism. We find that the emergence of bound states appears in symmetric configurations of topological superconducting nanowires, i.e., depending on their lengths and coupling energies to the quantum dots. Also, we find a transport suppression anomaly as a function of the magnetic flux in the same symmetric configurations mentioned above. Besides, we find that the magnetic flux controls both the projection of Majorana zero modes and of the bound states in the continuum into the density of states and the linear conductance, suggesting that only by switching this parameter can we manipulate both bound states.


title: Electromagnetic modeling and science reach of DMRadio-m$^3$

abstract: DMRadio-m$^3$ is an experiment that is designed to be sensitive to KSVZ and DFSZ QCD axion models in the 10-200 MHz (41 neV$/c^2$ - 0.83 $\mu$eV/$c^2$) range. The experiment uses a solenoidal dc magnetic field to convert an axion dark-matter signal to an ac electromagnetic response in a coaxial copper pickup. The current induced by this axion signal is measured by dc SQUIDs. In this work, we present the electromagnetic modeling of the response of the experiment to an axion signal over the full frequency range of DMRadio-m$^3$, which extends from the low-frequency, lumped-element limit to a regime where the axion Compton wavelength is only a factor of two larger than the detector size. With these results, we determine the live time and sensitivity of the experiment. The primary science goal of sensitivity to DFSZ axions across 30-200 MHz can be achieved with a $3\sigma$ live scan time of 3.7 years.

categories: hep-ex astro-ph.CO hep-ph physics.ins-det


title: Terminable Transitions in a Topological Fermionic Ladder

abstract: Interacting fermionic ladders are important platforms to study quantum phases of matter, such as different types of Mott insulators. In particular, the D-Mott and S-Mott states hold pre-formed fermion pairs and become paired-fermion liquids upon doping (d-wave and s-wave, respectively). We show that the D-Mott and S-Mott phases are in fact two facets of the same topological phase and that the transition between them is terminable. These results provide a quantum analog of the well-known terminable liquid-to-gas transition. However, the phenomenology we uncover is even richer, as in contrast to the former, the order of the transition can be tuned by the interactions from continuous to first-order. The findings are based on numerical results using the variational uniform matrix-product state (VUMPS) formalism for infinite systems, and the density-matrix renormalization group (DMRG) algorithm for finite systems. This is complemented by analytical field-theoretical explanations. In particular, we present an effective theory to explain the change of transition order, which is potentially applicable to a broad range of other systems. The role of symmetries and edge states are briefly discussed.