title: Orbit evolution in growing stellar bars: Bar-supporting orbits at the vertical ILR region

abstract: We investigate the evolution of orbital shapes at the Inner Lindblad Resonance region of a rotating three-dimensional bar, the mass of which is growing with time. We evaluate in time-dependent models, during a 5 Gyr period, the importance of orbits with initial conditions known to play a significant role in supporting peanut-like structures in autonomous systems. These orbits are the central family of periodic orbits (x1) and vertical perturbations of it, orbits of its standard three-dimensional bifurcations at the region (x1v1 and x1v2), as well as orbits in their neighbourhood. The knowledge of the regular or chaotic character of these orbits is essential as well, because it allows us to estimate their contribution to the support of a rotating bar and, more importantly, the dynamical mechanisms that make it possible. This is calculated by means of the GALI2 index. We find that orbital patterns existing in the autonomous case, persist for longer times in the more massive bar models, and even more so in a model in which the central spheroid component of our adopted galactic potential becomes rather insignificant. The peanut-supporting orbits which we find, have a regular or, in most cases, a weakly chaotic character. There are cases in which orbits starting close to unstable periodic orbits in an autonomous model behave as regular and support the bar when its mass increases with time. An approximation for the orbital dynamics of our non-autonomous models at a certain time, can be considered that of the corresponding frozen system around that time.


title: Heisenberg homology on surface configurations

abstract: Motivated by the Lawrence-Krammer-Bigelow representations of the classical braid groups, we study the homology of unordered configurations in an orientable genus-$g$ surface with one boundary component, over non-commutative local systems defined from representations of the discrete Heisenberg group. For a general representation of the Heisenberg group we obtain a twisted representation of the mapping class group. For the linearisation of the affine translation action of the Heisenberg group we obtain a genuine, untwisted representation of the mapping class group. In the case of the Schr\"odinger representation or its finite-dimensional analogues, by composing with a Stone-von Neumann isomorphism we obtain a representation to the projective unitary group, which lifts to a unitary representation of the stably universal central extension of the mapping class group.


title: Multistage Pruning of CNN Based ECG Classifiers for Edge Devices

abstract: Using smart wearable devices to monitor patients electrocardiogram (ECG) for real-time detection of arrhythmias can significantly improve healthcare outcomes. Convolutional neural network (CNN) based deep learning has been used successfully to detect anomalous beats in ECG. However, the computational complexity of existing CNN models prohibits them from being implemented in low-powered edge devices. Usually, such models are complex with lots of model parameters which results in large number of computations, memory, and power usage in edge devices. Network pruning techniques can reduce model complexity at the expense of performance in CNN models. This paper presents a novel multistage pruning technique that reduces CNN model complexity with negligible loss in performance compared to existing pruning techniques. An existing CNN model for ECG classification is used as a baseline reference. At 60% sparsity, the proposed technique achieves 97.7% accuracy and an F1 score of 93.59% for ECG classification tasks. This is an improvement of 3.3% and 9% for accuracy and F1 Score respectively, compared to traditional pruning with fine-tuning approach. Compared to the baseline model, we also achieve a 60.4% decrease in run-time complexity.


title: Self-normalizing Path Integrals

abstract: The normalization in the path integral approach to quantum field theory, in contrast with statistical field theory, can contain physical information. The main claim of this paper is that the inner product on the space of field configurations, one of the fundamental pieces of data required to be added to quantize a classical field theory, determines the normalization of the path integral. In fact, dimensional analysis shows that the introduction of this structure necessarily introduces a scale that is left unfixed by the classical theory. We study the dependence of the theory on this scale. This allows us to explore mechanisms that can be used to fix the normalization based on cutting and gluing different integrals. "Self-normalizing" path integrals, those independent of the scale, play an important role in this process. Furthermore, we show that the scale dependence encodes other important physical data: we use it to give a conceptually clear derivation of the chiral anomaly. Several explicit examples, including the scalar and compact bosons in different geometries, supplement our discussion.


title: Cross-time functional connectivity analysis

abstract: A large body of literature has shown the substantial inter-regional functional connectivity in the mammal brain. One important property remaining un-studied is the cross-time interareal connection. This paper serves to provide a tool to characterize the cross-time functional connectivity. The method is extended from the temporal embedding based brain temporal coherence analysis. Both synthetic data and in-vivo data were used to evaluate the various properties of the cross-time functional connectivity matrix, which is also called the cross-regional temporal coherence matrix.


title: S-small and S-essential submodules

abstract: This paper is concerned with S-co-m modules which are a generalization of co-m modules. In section 2, we introduce the S-small and S-essential submodules of a unitary $R$-module $M$ over a commutative ring $R$ with $1\neq 0$ such that S is a multiplicatively closed subset of $R$. We prove that if $M$ is an S-co-m module satisfying the S-DAC and $N\leq M$, then $N\leq ^{S}_{e}M$ if and only if there exists $I\ll ^{S}R$ such that $s(0:_{M}I)\leq N\leq (0 :_{M}I)$ for some $s\in S$. Let $M$ be a faithful S-strong co-m $R$-module. We prove that if $N\ll ^{S}M$ then there exists an ideal $I\leq ^{S}_{e}R$ such that $s(0 :_{M}I)\leq N\leq (0 :_{M}I)$. The converse is true if $S=\{1\}$and $M$ is a prime module. In section 3, we introduce the S-quasi-copure submodules $N$ of an $R$-module $M$ and investigate some results related to this class of submodules.


title: The Role of Explainability in Assuring Safety of Machine Learning in Healthcare

abstract: Established approaches to assuring safety-critical systems and software are difficult to apply to systems employing ML where there is no clear, pre-defined specification against which to assess validity. This problem is exacerbated by the "opaque" nature of ML where the learnt model is not amenable to human scrutiny. Explainable AI (XAI) methods have been proposed to tackle this issue by producing human-interpretable representations of ML models which can help users to gain confidence and build trust in the ML system. However, little work explicitly investigates the role of explainability for safety assurance in the context of ML development. This paper identifies ways in which XAI methods can contribute to safety assurance of ML-based systems. It then uses a concrete ML-based clinical decision support system, concerning weaning of patients from mechanical ventilation, to demonstrate how XAI methods can be employed to produce evidence to support safety assurance. The results are also represented in a safety argument to show where, and in what way, XAI methods can contribute to a safety case. Overall, we conclude that XAI methods have a valuable role in safety assurance of ML-based systems in healthcare but that they are not sufficient in themselves to assure safety.


title: Don't Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation Techniques

abstract: Existing techniques for mitigating dataset bias often leverage a biased model to identify biased instances. The role of these biased instances is then reduced during the training of the main model to enhance its robustness to out-of-distribution data. A common core assumption of these techniques is that the main model handles biased instances similarly to the biased model, in that it will resort to biases whenever available. In this paper, we show that this assumption does not hold in general. We carry out a critical investigation on two well-known datasets in the domain, MNLI and FEVER, along with two biased instance detection methods, partial-input and limited-capacity models. Our experiments show that in around a third to a half of instances, the biased model is unable to predict the main model's behavior, highlighted by the significantly different parts of the input on which they base their decisions. Based on a manual validation, we also show that this estimate is highly in line with human interpretation. Our findings suggest that down-weighting of instances detected by bias detection methods, which is a widely-practiced procedure, is an unnecessary waste of training data. We release our code to facilitate reproducibility and future research.


title: Conditional Extreme Value Theory for Open Set Video Domain Adaptation

abstract: With the advent of media streaming, video action recognition has become progressively important for various applications, yet at the high expense of requiring large-scale data labelling. To overcome the problem of expensive data labelling, domain adaptation techniques have been proposed that transfers knowledge from fully labelled data (i.e., source domain) to unlabelled data (i.e., target domain). The majority of video domain adaptation algorithms are proposed for closed-set scenarios in which all the classes are shared among the domains. In this work, we propose an open-set video domain adaptation approach to mitigate the domain discrepancy between the source and target data, allowing the target data to contain additional classes that do not belong to the source domain. Different from previous works, which only focus on improving accuracy for shared classes, we aim to jointly enhance the alignment of shared classes and recognition of unknown samples. Towards this goal, class-conditional extreme value theory is applied to enhance the unknown recognition. Specifically, the entropy values of target samples are modelled as generalised extreme value distributions, which allows separating unknown samples lying in the tail of the distribution. To alleviate the negative transfer issue, weights computed by the distance from the sample entropy to the threshold are leveraged in adversarial learning in the sense that confident source and target samples are aligned, and unconfident samples are pushed away. The proposed method has been thoroughly evaluated on both small-scale and large-scale cross-domain video datasets and achieved the state-of-the-art performance.


title: Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification

abstract: Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the corresponding parameters such as the substitution rate artificially, which require a lot of prior knowledge and are prone to fall into the sub-optimum. Besides, the number of editing operations is limited in the previous methods, which decreases the diversity of the augmented data and thus restricts the performance gain. To overcome the above limitations, we propose a framework named Text AutoAugment (TAA) to establish a compositional and learnable paradigm for data augmentation. We regard a combination of various operations as an augmentation policy and utilize an efficient Bayesian Optimization algorithm to automatically search for the best policy, which substantially improves the generalization capability of models. Experiments on six benchmark datasets show that TAA boosts classification accuracy in low-resource and class-imbalanced regimes by an average of 8.8% and 9.7%, respectively, outperforming strong baselines.


title: On the Limits of Pseudo Ground Truth in Visual Camera Re-localisation

abstract: Benchmark datasets that measure camera pose accuracy have driven progress in visual re-localisation research. To obtain poses for thousands of images, it is common to use a reference algorithm to generate pseudo ground truth. Popular choices include Structure-from-Motion (SfM) and Simultaneous-Localisation-and-Mapping (SLAM) using additional sensors like depth cameras if available. Re-localisation benchmarks thus measure how well each method replicates the results of the reference algorithm. This begs the question whether the choice of the reference algorithm favours a certain family of re-localisation methods. This paper analyzes two widely used re-localisation datasets and shows that evaluation outcomes indeed vary with the choice of the reference algorithm. We thus question common beliefs in the re-localisation literature, namely that learning-based scene coordinate regression outperforms classical feature-based methods, and that RGB-D-based methods outperform RGB-based methods. We argue that any claims on ranking re-localisation methods should take the type of the reference algorithm, and the similarity of the methods to the reference algorithm, into account.


title: Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge Distillation

abstract: The powerful learning ability of deep neural networks enables reinforcement learning agents to learn competent control policies directly from continuous environments. In theory, to achieve stable performance, neural networks assume i.i.d. inputs, which unfortunately does no hold in the general reinforcement learning paradigm where the training data is temporally correlated and non-stationary. This issue may lead to the phenomenon of "catastrophic interference" and the collapse in performance. In this paper, we present IQ, i.e., interference-aware deep Q-learning, to mitigate catastrophic interference in single-task deep reinforcement learning. Specifically, we resort to online clustering to achieve on-the-fly context division, together with a multi-head network and a knowledge distillation regularization term for preserving the policy of learned contexts. Built upon deep Q networks, IQ consistently boosts the stability and performance when compared to existing methods, verified with extensive experiments on classic control and Atari tasks. The code is publicly available at: https://github.com/Sweety-dm/Interference-aware-Deep-Q-learning.


title: Physics-informed Neural Network for Nonlinear Dynamics in Fiber Optics

abstract: A physics-informed neural network (PINN) that combines deep learning with physics is studied to solve the nonlinear Schr\"odinger equation for learning nonlinear dynamics in fiber optics. We carry out a systematic investigation and comprehensive verification on PINN for multiple physical effects in optical fibers, including dispersion, self-phase modulation, and higher-order nonlinear effects. Moreover, both special case (soliton propagation) and general case (multi-pulse propagation) are investigated and realized with PINN. In the previous studies, the PINN was mainly effective for single scenario. To overcome this problem, the physical parameters (pulse peak power and amplitudes of sub-pulses) are hereby embedded as additional input parameter controllers, which allow PINN to learn the physical constraints of different scenarios and perform good generalizability. Furthermore, PINN exhibits better performance than the data-driven neural network using much less data, and its computational complexity (in terms of number of multiplications) is much lower than that of the split-step Fourier method. The results report here show that the PINN is not only an effective partial differential equation solver, but also a prospective technique to advance the scientific computing and automatic modeling in fiber optics.


title: Boosting Search Engines with Interactive Agents

abstract: This paper presents first successful steps in designing search agents that learn meta-strategies for iterative query refinement in information-seeking tasks. Our approach uses machine reading to guide the selection of refinement terms from aggregated search results. Agents are then empowered with simple but effective search operators to exert fine-grained and transparent control over queries and search results. We develop a novel way of generating synthetic search sessions, which leverages the power of transformer-based language models through (self-)supervised learning. We also present a reinforcement learning agent with dynamically constrained actions that learns interactive search strategies from scratch. Our search agents obtain retrieval and answer quality performance comparable to recent neural methods, using only a traditional term-based BM25 ranking function and interpretable discrete reranking and filtering actions.


title: Wasserstein GANs with Gradient Penalty Compute Congested Transport

abstract: Wasserstein GANs with Gradient Penalty (WGAN-GP) are a very popular method for training generative models to produce high quality synthetic data. While WGAN-GP were initially developed to calculate the Wasserstein 1 distance between generated and real data, recent works (e.g. [23]) have provided empirical evidence that this does not occur, and have argued that WGAN-GP perform well not in spite of this issue, but because of it. In this paper we show for the first time that WGAN-GP compute the minimum of a different optimal transport problem, the so-called congested transport [7]. Congested transport determines the cost of moving one distribution to another under a transport model that penalizes congestion. For WGAN-GP, we find that the congestion penalty has a spatially varying component determined by the sampling strategy used in [12] which acts like a local speed limit, making congestion cost less in some regions than others. This aspect of the congested transport problem is new, in that the congestion penalty turns out to be unbounded and depends on the distributions to be transported, and so we provide the necessary mathematical proofs for this setting. One facet of our discovery is a formula connecting the gradient of solutions to the optimization problem in WGAN-GP to the time averaged momentum of the optimal mass flow. This is in contrast to the gradient of Kantorovich potentials for the Wasserstein 1 distance, which is just the normalized direction of flow. Based on this and other considerations, we speculate on how our results explain the observed performance of WGAN-GP. Beyond applications to GANs, our theorems also point to the possibility of approximately solving large scale congested transport problems using neural network techniques.


title: The asymptotic expansion of the Bateman and Havelock functions of large order and argument

abstract: Asymptotic expansions for the Bateman and Havelock functions defined respectively by the integrals \[\frac{2}{\pi}\int_0^{\pi/2} \!\!\!\begin{array}{c} \cos\\\sin\end{array}\!(x\tan u-\nu u)\,du\] are obtained for large real $x$ and large order $\nu>0$ when $\nu=O(|x|)$. The expansions are obtained by application of the method of steepest descents combined with an inversion process to determine the coefficients. Numerical results are presented to illustrate the accuracy of the different expansions obtained.


title: A Gradient Sampling Algorithm for Stratified Maps with Applications to Topological Data Analysis

abstract: We introduce a novel gradient descent algorithm extending the well-known Gradient Sampling methodology to the class of stratifiably smooth objective functions, which are defined as locally Lipschitz functions that are smooth on some regular pieces-called the strata-of the ambient Euclidean space. For this class of functions, our algorithm achieves a sub-linear convergence rate. We then apply our method to objective functions based on the (extended) persistent homology map computed over lower-star filters, which is a central tool of Topological Data Analysis. For this, we propose an efficient exploration of the corresponding stratification by using the Cayley graph of the permutation group. Finally, we provide benchmark and novel topological optimization problems, in order to demonstrate the utility and applicability of our framework.


title: Under-bagging Nearest Neighbors for Imbalanced Classification

abstract: In this paper, we propose an ensemble learning algorithm called \textit{under-bagging $k$-nearest neighbors} (\textit{under-bagging $k$-NN}) for imbalanced classification problems. On the theoretical side, by developing a new learning theory analysis, we show that with properly chosen parameters, i.e., the number of nearest neighbors $k$, the expected sub-sample size $s$, and the bagging rounds $B$, optimal convergence rates for under-bagging $k$-NN can be achieved under mild assumptions w.r.t.~the arithmetic mean (AM) of recalls. Moreover, we show that with a relatively small $B$, the expected sub-sample size $s$ can be much smaller than the number of training data $n$ at each bagging round, and the number of nearest neighbors $k$ can be reduced simultaneously, especially when the data are highly imbalanced, which leads to substantially lower time complexity and roughly the same space complexity. On the practical side, we conduct numerical experiments to verify the theoretical results on the benefits of the under-bagging technique by the promising AM performance and efficiency of our proposed algorithm.


title: TransforMesh: A Transformer Network for Longitudinal modeling of Anatomical Meshes

abstract: The longitudinal modeling of neuroanatomical changes related to Alzheimer's disease (AD) is crucial for studying the progression of the disease. To this end, we introduce TransforMesh, a spatio-temporal network based on transformers that models longitudinal shape changes on 3D anatomical meshes. While transformer and mesh networks have recently shown impressive performances in natural language processing and computer vision, their application to medical image analysis has been very limited. To the best of our knowledge, this is the first work that combines transformer and mesh networks. Our results show that TransforMesh can model shape trajectories better than other baseline architectures that do not capture temporal dependencies. Moreover, we also explore the capabilities of TransforMesh in detecting structural anomalies of the hippocampus in patients developing AD.


title: R-SNN: An Analysis and Design Methodology for Robustifying Spiking Neural Networks against Adversarial Attacks through Noise Filters for Dynamic Vision Sensors

abstract: Spiking Neural Networks (SNNs) aim at providing energy-efficient learning capabilities when implemented on neuromorphic chips with event-based Dynamic Vision Sensors (DVS). This paper studies the robustness of SNNs against adversarial attacks on such DVS-based systems, and proposes R-SNN, a novel methodology for robustifying SNNs through efficient DVS-noise filtering. We are the first to generate adversarial attacks on DVS signals (i.e., frames of events in the spatio-temporal domain) and to apply noise filters for DVS sensors in the quest for defending against adversarial attacks. Our results show that the noise filters effectively prevent the SNNs from being fooled. The SNNs in our experiments provide more than 90% accuracy on the DVS-Gesture and NMNIST datasets under different adversarial threat models.


title: The Minimax Complexity of Distributed Optimization

abstract: In this thesis, I study the minimax oracle complexity of distributed stochastic optimization. First, I present the "graph oracle model", an extension of the classic oracle complexity framework that can be applied to study distributed optimization algorithms. Next, I describe a general approach to proving optimization lower bounds for arbitrary randomized algorithms (as opposed to more restricted classes of algorithms, e.g., deterministic or "zero-respecting" algorithms), which is used extensively throughout the thesis. For the remainder of the thesis, I focus on the specific case of the "intermittent communication setting", where multiple computing devices work in parallel with limited communication amongst themselves. In this setting, I analyze the theoretical properties of the popular Local Stochastic Gradient Descent (SGD) algorithm in convex setting, both for homogeneous and heterogeneous objectives. I provide the first guarantees for Local SGD that improve over simple baseline methods, but show that Local SGD is not optimal in general. In pursuit of optimal methods in the intermittent communication setting, I then show matching upper and lower bounds for the intermittent communication setting with homogeneous convex, heterogeneous convex, and homogeneous non-convex objectives. These upper bounds are attained by simple variants of SGD which are therefore optimal. Finally, I discuss several additional assumptions about the objective or more powerful oracles that might be exploitable in order to develop better intermittent communication algorithms with better guarantees than our lower bounds allow.


title: ASVspoof 2021: Automatic Speaker Verification Spoofing and Countermeasures Challenge Evaluation Plan

abstract: The automatic speaker verification spoofing and countermeasures (ASVspoof) challenge series is a community-led initiative which aims to promote the consideration of spoofing and the development of countermeasures. ASVspoof 2021 is the 4th in a series of bi-annual, competitive challenges where the goal is to develop countermeasures capable of discriminating between bona fide and spoofed or deepfake speech. This document provides a technical description of the ASVspoof 2021 challenge, including details of training, development and evaluation data, metrics, baselines, evaluation rules, submission procedures and the schedule.


title: Beatty primes from fractional powers of almost-primes

abstract: Let $\alpha>1$ be irrational and of finite type, $\beta\in\mathbb{R}$. In this paper, it is proved that for $R\geqslant13$ and any fixed $c\in(1,c_R)$, there exist infinitely many primes in the intersection of Beatty sequence $\mathcal{B}_{\alpha,\beta}$ and $\lfloor n^c\rfloor$, where $c_R$ is an explicit constant depending on $R$ herein, $n$ is a natural number with at most $R$ prime factors, counted with multiplicity.


title: ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection

abstract: ASVspoof 2021 is the forth edition in the series of bi-annual challenges which aim to promote the study of spoofing and the design of countermeasures to protect automatic speaker verification systems from manipulation. In addition to a continued focus upon logical and physical access tasks in which there are a number of advances compared to previous editions, ASVspoof 2021 introduces a new task involving deepfake speech detection. This paper describes all three tasks, the new databases for each of them, the evaluation metrics, four challenge baselines, the evaluation platform and a summary of challenge results. Despite the introduction of channel and compression variability which compound the difficulty, results for the logical access and deepfake tasks are close to those from previous ASVspoof editions. Results for the physical access task show the difficulty in detecting attacks in real, variable physical spaces. With ASVspoof 2021 being the first edition for which participants were not provided with any matched training or development data and with this reflecting real conditions in which the nature of spoofed and deepfake speech can never be predicated with confidence, the results are extremely encouraging and demonstrate the substantial progress made in the field in recent years.


title: Physics-integrated hybrid framework for model form error identification in nonlinear dynamical systems

abstract: For real-life nonlinear systems, the exact form of nonlinearity is often not known and the known governing equations are often based on certain assumptions and approximations. Such representation introduced model-form error into the system. In this paper, we propose a novel gray-box modeling approach that not only identifies the model-form error but also utilizes it to improve the predictive capability of the known but approximate governing equation. The primary idea is to treat the unknown model-form error as a residual force and estimate it using duel Bayesian filter based joint input-state estimation algorithms. For improving the predictive capability of the underlying physics, we first use machine learning algorithm to learn a mapping between the estimated state and the input (model-form error) and then introduce it into the governing equation as an additional term. This helps in improving the predictive capability of the governing physics and allows the model to generalize to unseen environment. Although in theory, any machine learning algorithm can be used within the proposed framework, we use Gaussian process in this work. To test the performance of proposed framework, case studies discussing four different dynamical systems are discussed; results for which indicate that the framework is applicable to a wide variety of systems and can produce reliable estimates of original system's states.


title: Spatially and Robustly Hybrid Mixture Regression Model for Inference of Spatial Dependence

abstract: In this paper, we propose a Spatial Robust Mixture Regression model to investigate the relationship between a response variable and a set of explanatory variables over the spatial domain, assuming that the relationships may exhibit complex spatially dynamic patterns that cannot be captured by constant regression coefficients. Our method integrates the robust finite mixture Gaussian regression model with spatial constraints, to simultaneously handle the spatial nonstationarity, local homogeneity, and outlier contaminations. Compared with existing spatial regression models, our proposed model assumes the existence a few distinct regression models that are estimated based on observations that exhibit similar response-predictor relationships. As such, the proposed model not only accounts for nonstationarity in the spatial trend, but also clusters observations into a few distinct and homogenous groups. This provides an advantage on interpretation with a few stationary sub-processes identified that capture the predominant relationships between response and predictor variables. Moreover, the proposed method incorporates robust procedures to handle contaminations from both regression outliers and spatial outliers. By doing so, we robustly segment the spatial domain into distinct local regions with similar regression coefficients, and sporadic locations that are purely outliers. Rigorous statistical hypothesis testing procedure has been designed to test the significance of such segmentation. Experimental results on many synthetic and real-world datasets demonstrate the robustness, accuracy, and effectiveness of our proposed method, compared with other robust finite mixture regression, spatial regression and spatial segmentation methods.


title: Variational Quantum Reinforcement Learning via Evolutionary Optimization

abstract: Recent advance in classical reinforcement learning (RL) and quantum computation (QC) points to a promising direction of performing RL on a quantum computer. However, potential applications in quantum RL are limited by the number of qubits available in the modern quantum devices. Here we present two frameworks of deep quantum RL tasks using a gradient-free evolution optimization: First, we apply the amplitude encoding scheme to the Cart-Pole problem; Second, we propose a hybrid framework where the quantum RL agents are equipped with hybrid tensor network-variational quantum circuit (TN-VQC) architecture to handle inputs with dimensions exceeding the number of qubits. This allows us to perform quantum RL on the MiniGrid environment with 147-dimensional inputs. We demonstrate the quantum advantage of parameter saving using the amplitude encoding. The hybrid TN-VQC architecture provides a natural way to perform efficient compression of the input dimension, enabling further quantum RL applications on noisy intermediate-scale quantum devices.


title: Active Inference and Epistemic Value in Graphical Models

abstract: The Free Energy Principle (FEP) postulates that biological agents perceive and interact with their environment in order to minimize a Variational Free Energy (VFE) with respect to a generative model of their environment. The inference of a policy (future control sequence) according to the FEP is known as Active Inference (AIF). The AIF literature describes multiple VFE objectives for policy planning that lead to epistemic (information-seeking) behavior. However, most objectives have limited modeling flexibility. This paper approaches epistemic behavior from a constrained Bethe Free Energy (CBFE) perspective. Crucially, variational optimization of the CBFE can be expressed in terms of message passing on free-form generative models. The key intuition behind the CBFE is that we impose a point-mass constraint on predicted outcomes, which explicitly encodes the assumption that the agent will make observations in the future. We interpret the CBFE objective in terms of its constituent behavioral drives. We then illustrate resulting behavior of the CBFE by planning and interacting with a simulated T-maze environment. Simulations for the T-maze task illustrate how the CBFE agent exhibits an epistemic drive, and actively plans ahead to account for the impact of predicted outcomes. Compared to an EFE agent, the CBFE agent incurs expected reward in significantly more environmental scenarios. We conclude that CBFE optimization by message passing suggests a general mechanism for epistemic-aware AIF in free-form generative models.


title: Shared Certificates for Neural Network Verification

abstract: Existing neural network verifiers compute a proof that each input is handled correctly under a given perturbation by propagating a symbolic abstraction of reachable values at each layer. This process is repeated from scratch independently for each input (e.g., image) and perturbation (e.g., rotation), leading to an expensive overall proof effort when handling an entire dataset. In this work, we introduce a new method for reducing this verification cost without losing precision based on a key insight that abstractions obtained at intermediate layers for different inputs and perturbations can overlap or contain each other. Leveraging our insight, we introduce the general concept of shared certificates, enabling proof effort reuse across multiple inputs to reduce overall verification costs. We perform an extensive experimental evaluation to demonstrate the effectiveness of shared certificates in reducing the verification cost on a range of datasets and attack specifications on image classifiers including the popular patch and geometric perturbations. We release our implementation at https://github.com/eth-sri/proof-sharing.


title: Controlled frames in n-Hilbert spaces and their tensor products

abstract: The concepts of controlled frames and it's dual in n-Hilbert spaces and their tensor products have been introduced and then some of their characterizations are given. We further study the relationship between controlled frame and bounded linear operator in tensor product of n-Hilbert spaces. At the end, the direct sum of controlled frames in n-Hilbert space is being considered.


title: Towards Improving Adversarial Training of NLP Models

abstract: Adversarial training, a method for learning robust deep neural networks, constructs adversarial examples during training. However, recent methods for generating NLP adversarial examples involve combinatorial search and expensive sentence encoders for constraining the generated instances. As a result, it remains challenging to use vanilla adversarial training to improve NLP models' performance, and the benefits are mainly uninvestigated. This paper proposes a simple and improved vanilla adversarial training process for NLP models, which we name Attacking to Training (A2T). The core part of A2T is a new and cheaper word substitution attack optimized for vanilla adversarial training. We use A2T to train BERT and RoBERTa models on IMDB, Rotten Tomatoes, Yelp, and SNLI datasets. Our results empirically show that it is possible to train robust NLP models using a much cheaper adversary. We demonstrate that vanilla adversarial training with A2T can improve an NLP model's robustness to the attack it was originally trained with and also defend the model against other types of word substitution attacks. Furthermore, we show that A2T can improve NLP models' standard accuracy, cross-domain generalization, and interpretability. Code is available at https://github.com/QData/Textattack-A2T .


title: Fair Representation: Guaranteeing Approximate Multiple Group Fairness for Unknown Tasks

abstract: Motivated by scenarios where data is used for diverse prediction tasks, we study whether fair representation can be used to guarantee fairness for unknown tasks and for multiple fairness notions simultaneously. We consider seven group fairness notions that cover the concepts of independence, separation, and calibration. Against the backdrop of the fairness impossibility results, we explore approximate fairness. We prove that, although fair representation might not guarantee fairness for all prediction tasks, it does guarantee fairness for an important subset of tasks -- the tasks for which the representation is discriminative. Specifically, all seven group fairness notions are linearly controlled by fairness and discriminativeness of the representation. When an incompatibility exists between different fairness notions, fair and discriminative representation hits the sweet spot that approximately satisfies all notions. Motivated by our theoretical findings, we propose to learn both fair and discriminative representations using pretext loss which self-supervises learning, and Maximum Mean Discrepancy as a fair regularizer. Experiments on tabular, image, and face datasets show that using the learned representation, downstream predictions that we are unaware of when learning the representation indeed become fairer for seven group fairness notions, and the fairness guarantees computed from our theoretical results are all valid.


abstract: We propose a new model-agnostic search strategy for physics beyond the standard model (BSM) at the LHC, based on a novel application of neural density estimation to anomaly detection. Our approach, which we call Classifying Anomalies THrough Outer Density Estimation (CATHODE), assumes the BSM signal is localized in a signal region (defined e.g. using invariant mass). By training a conditional density estimator on a collection of additional features outside the signal region, interpolating it into the signal region, and sampling from it, we produce a collection of events that follow the background model. We can then train a classifier to distinguish the data from the events sampled from the background model, thereby approaching the optimal anomaly detector. Using the LHC Olympics R&D dataset, we demonstrate that CATHODE nearly saturates the best possible performance, and significantly outperforms other approaches that aim to enhance the bump hunt (CWoLa Hunting and ANODE). Finally, we demonstrate that CATHODE is very robust against correlations between the features and maintains nearly-optimal performance even in this more challenging setting.


title: Cosmological Constraints from Weak Lensing Peaks: Can Halo Models Accurately Predict Peak Counts?

abstract: In order to extract full cosmological information from next-generation large and high-precision weak lensing (WL) surveys (e.g. Euclid, Roman, LSST), higher-order statistics that probe the small-scale, non-linear regime of large scale structure (LSS) need to be utilized. WL peak counts, which trace overdensities in the cosmic web, are one promising and simple statistic for constraining cosmological parameters. The physical origin of WL peaks have previously been linked to dark matter halos along the line of sight and this peak-halo connection has been used to develop various semi-analytic halo-based models for predicting peak counts. Here, we study the origin of WL peaks and the effectiveness of halo-based models for WL peak counts using a suite of ray-tracing N-body simulations. We compare WL peaks in convergence maps from the full simulations to those in maps created from only particles associated with halos -- the latter playing the role of a "perfect" halo model. We find that while halo-only contributions are able to replicate peak counts qualitatively well, halos do not explain all WL peaks. Halos particularly underpredict negative peaks, which are associated with local overdensities in large-scale underdense regions along the line of sight. In addition, neglecting non-halo contributions to peaks counts leads to a significant bias on the parameters ($\Omega_{\rm m}$, $\sigma_{8}$) for surveys larger than $\geq$ 100 deg$^{2}$. We conclude that other elements of the cosmic web, outside and far away from dark matter halos, need to be incorporated into models of WL peaks in order to infer unbiased cosmological constraints.


title: Quantum Many-Body Scars and Hilbert Space Fragmentation: A Review of Exact Results

abstract: The discovery of Quantum Many-Body Scars (QMBS) both in Rydberg atom simulators and in the Affleck-Kennedy-Lieb-Tasaki (AKLT) spin-1 chain model, have shown that a weak violation of ergodicity can still lead to rich experimental and theoretical physics. In this review, we provide a pedagogical introduction to and an overview of the exact results on weak ergodicity breaking via QMBS in isolated quantum systems with the help of simple examples such as the fermionic Hubbard model. We also discuss various mechanisms and unifying formalisms that have been proposed to encompass the plethora of systems exhibiting QMBS. We cover examples of equally-spaced towers that lead to exact revivals for particular initial states, as well as isolated examples of QMBS. Finally, we review Hilbert Space Fragmentation, a related phenomenon where systems exhibit a richer variety of ergodic and non-ergodic behaviors, and discuss its connections to QMBS.


title: The Breakdown of Resummed Perturbation Theory at High Energies

abstract: Calculations of high-energy processes involving the production of a large number of particles in weakly-coupled quantum field theories have previously signaled the need for novel non-perturbative behavior or even new physical phenomena. In some scenarios, already tree-level computations may enter the regime of large-order perturbation theory and therefore require a careful investigation. We demonstrate that in scalar quantum field theories with a unique global minimum, where suitably resummed perturbative expansions are expected to capture all relevant physical effects, perturbation theory may still suffer from severe shortcomings in the high-energy regime. As an example, we consider the computation of multiparticle threshold amplitudes of the form $1 \to n$ in $\varphi^6$ theory with a positive mass term, and show that they may violate unitarity of the quantum theory for large $n$, even after the resummation of all leading-$n$ quantum corrections. We further argue that this is a generic feature of scalar field theories with higher-order self-interactions beyond $\varphi^4$, thereby rendering the latter unique with respect to its high-energy behavior.


title: Generalized Design Principles for Hydrodynamic Electron Transport in Anisotropic Metals

abstract: Interactions of charge carriers with lattice vibrations, or phonons, play a critical role in unconventional electronic transport of metals and semimetals. Recent observations of phonon-mediated collective electron flow in bulk semimetals, termed electron hydrodynamics, present new opportunities in the search for strong electron-electron interactions in high carrier density materials. Here we present the general transport signatures of such a second-order scattering mechanism, along with analytical limits at the Eliashberg level of theory. We study electronic transport, using $ab$ $initio$ calculations, in finite-size channels of semimetallic ZrSiS and TaAs$_2$ with and without topological band crossings, respectively. The order of magnitude separation between momentum-relaxing and momentum-conserving scattering length-scales across a wide temperature range make both of them promising candidates for further experimental observation of electron hydrodynamics. More generally, our calculations show that the hydrodynamic transport regime can be realized in a much broader class of anisotropic metals and does not, to first order, rely on the topological nature of the bands. Finally, we discuss general design principles guiding future search for hydrodynamic candidates, based on the analytical formulation and our $ab$ $initio$ predictions. We find that systems with strong electron-phonon interactions, reduced electronic phase space, and suppressed phonon-phonon scattering at temperatures of interest are likely to feature hydrodynamic electron transport. We predict that layered and/or anisotropic semimetals composed of half-filled $d$-shells and light group V/VI elements with lower crystal symmetry are ideal candidates to observe hydrodynamic phenomena in future.


title: A comment on "Discrete time crystals: rigidity, criticality, and realizations"

abstract: The Letter by N. Y. Yao et. al. [1,2] presents three models for realizing a many-body localized discrete time-crystal (MBL DTC): a short-ranged model [1], its revised version [2], as well as a long-range model of a trapped ion experiment [1,3]. We show that none of these realize an MBL DTC for the parameter ranges quoted in Refs. [1,2]. The central phase diagrams in [1] therefore cannot be reproduced. The models show rapid decay of oscillations from generic initial states, in sharp contrast to the robust period doubling dynamics characteristic of an MBL DTC. Long-lived oscillations from special initial states (such as polarized states) can be understood from the familiar low-temperature physics of a static transverse field Ising model, rather than the nonequilibrium physics of an eigenstate-ordered MBL DTC. Our results on the long-range model also demonstrate, by extension, the absence of an MBL DTC in the trapped ion experiment of Ref. [3].

categories: cond-mat.dis-nn cond-mat.str-el hep-th quant-ph


title: Dynamical properties of the Haldane chain with bond disorder

abstract: By using Lanczos exact diagonalization and quantum Monte Carlo combined with stochastic analytic continuation, we study the dynamical properties of the $S=1$ antiferromagnetic Heisenberg chain with different strengths of bond disorder. In the weak disorder region, we find weakly coupled bonds which can induce additional low-energy excitation below the one-magnon mode. As the disorder increases, the average Haldane gap closes at $\delta_{\Delta}\sim 0.5$ with more and more low-energy excitations coming out. After the critical disorder strength $\delta_c\sim 1$, the system reaches a random-singlet phase with prominent sharp peak at $\omega=0$ and broad continuum at $\omega>0$ of the dynamic spin structure factor. In addition, we analyze the distribution of random spin domains and numerically find three kinds of domains hosting effective spin-1/2 quanta or spin-1 sites in between. These "spins" can form the weakly coupled long-range singlets due to quantum fluctuation which contribute to the sharp peak at $\omega=0$.


title: Optical detection of the rapidly spinning white dwarf in V1460 Her

abstract: Accreting magnetic white dwarfs offer an opportunity to understand the interplay between spin-up and spin-down torques in binary systems. Monitoring of the white dwarf spin may reveal whether the white dwarf spin is currently in a state of near-equilibrium, or of uni-directional evolution towards longer or shorter periods, reflecting the recent history of the system and providing constraints for evolutionary models. This makes the monitoring of the spin history of magnetic white dwarfs of high interest. In this paper we report the results of a campaign of follow-up optical photometry to detect and track the 39 sec white dwarf spin pulses recently discovered in Hubble Space Telescope data of the cataclysmic variable V1460 Her. We find the spin pulsations to be present in g-band photometry at a typical amplitude of 0.4%. Under favourable observing conditions, the spin signal is detectable using 2-meter class telescopes. We measured pulse-arrival times for all our observations, which allowed us to derive a precise ephemeris for the white dwarf spin. We have also derived an orbital modulation correction that can be applied to the measurements. With our limited baseline of just over four years, we detect no evidence yet for spin-up or spin-down of the white dwarf, obtaining a lower limit of |P/Pdot|> 4e7 years, which is already 4 to 8 times longer than the timescales measured in two other cataclysmic variable systems containing rapidly rotating white dwarfs, AE Aqr and AR Sco.


title: Comparison of Optical Response from DFT Random Phase Approximation and Low-Energy Effective Model: Strained Phosphorene

abstract: The engineering of the optical response of materials is a paradigm that demands microscopic-level accuracy and reliable predictive theoretical tools. Here we compare and contrast the dispersive permittivity tensor, using both a low-energy effective model and density functional theory (DFT). As a representative material, phosphorene subject to strain is considered. Employing a low-energy model Hamiltonian with a Green's function current-current correlation function, we compute the dynamical optical conductivity and its associated permittivity tensor. For the DFT approach, first-principles calculations make use of the first-order random-phase approximation. Our results reveal that although the two models are generally in agreement within the low-strain and low-frequency regime, the intricate features associated with the fundamental physical properties of the system and optoelectronic device implementation such as band gap, Drude absorption response, vanishing real part, absorptivity, and sign of permittivity over the frequency range show significant discrepancies. Our results suggest that the random-phase approximation employed in widely used DFT packages should be revisited and improved to be able to predict these fundamental electronic characteristics of a given material with confidence. Furthermore, employing the permittivity results from both models, we uncover the pivotal role that phosphorene can play in optoelectronics devices to facilitate highly programable perfect absorption of electromagnetic waves by manipulating the chemical potential and exerting strain and illustrate how reliable predictions for the dielectric response of a given material are crucial to precise device design.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.str-el quant-ph


title: Pulse envelope effects in nonlinear Breit-Wheeler pair-creation

abstract: The effect of the pulse envelope on electron-positron pair creation in a circularly-polarised laser pulse is investigated. Interference on the length scale of the pulse envelope, and smoothness of the pulse edges are found to influence the pair spectrum. A toy model of a flat-top pulse is used to identify pulse envelope effects inaccessible to local approaches. Broadening of channel openings and a widening of the energy and transverse momentum distribution of the pair are found to receive contributions that are below the local harmonic threshold. By comparing pair yields in a flat-top, sine-squared and Gaussian pulse, a link between pulse shape and photon-polarised Breit-Wheeler is found. In the transverse momentum distribution, a signal of pulse envelope interference is found in an azimuthal asymmetry, which appears in intense fields and persists in long pulses.


title: Spontaneous Gully Polarized Quantum Hall States in ABA Trilayer Graphene

abstract: Bernal-stacked multilayer graphene is a versatile platform to explore quantum transport phenomena and interaction physics due to its exceptional tunability via electrostatic gating. For instance, upon applying a perpendicular electric field, its band structure exhibits several off-center Dirac points (so-called Dirac gullies) in each valley. Here, the formation of Dirac gullies and the interaction-induced breakdown of gully coherence is explored via magnetotransport measurements in high-quality Bernal-stacked (ABA) trilayer graphene. In the absence of a magnetic field, multiple Lifshitz transitions as function of electric field and charge carrier density indicating the formation of Dirac gullies are identified. In the quantum Hall regime and high electric fields, the emergence of Dirac gullies is evident as an increase in Landau level degeneracy. When tuning both electric and magnetic fields, electron-electron interactions can be controllably enhanced until the gully degeneracy is eventually lifted. The arising correlated ground state is consistent with a previously predicted nematic phase that spontaneously breaks the rotational gully symmetry.


title: Eigenstate capacity and Page curve in fermionic Gaussian states

abstract: Capacity of entanglement (CoE), an information-theoretic measure of entanglement, defined as the variance of modular Hamiltonian, is known to capture the deviation from the maximal entanglement. We derive an exact expression for the average eigenstate CoE in fermionic Gaussian states as a finite series, valid for arbitrary bi-partition of the total system. Further, we consider the complex SYK$_2$ model in the thermodynamic limit and we obtain a closed-form expression of average CoE. In this limit, the variance of the average CoE becomes independent of the system size. Moreover, when the subsystem size is half of the total system, the leading volume-law coefficient approaches a value of $\pi^{2}/8 - 1$. We identify this as a distinguishing feature between integrable and quantum-chaotic systems. We confirm our analytical results by numerical computations.

categories: quant-ph cond-mat.stat-mech hep-th math-ph math.MP


title: Implementing a Ternary Decomposition of the Toffoli Gate on Fixed-FrequencyTransmon Qutrits

abstract: Quantum computation is conventionally performed using quantum operations acting on two-level quantum bits, or qubits. Qubits in modern quantum computers suffer from inevitable detrimental interactions with the environment that cause errors during computation, with multi-qubit operations often being a primary limitation. Most quantum devices naturally have multiple accessible energy levels beyond the lowest two traditionally used to define a qubit. Qudits offer a larger state space to store and process quantum information, reducing complexity of quantum circuits and improving efficiency of quantum algorithms. Here, we experimentally demonstrate a ternary decomposition of a multi-qubit operation on cloud-enabled fixed-frequency superconducting transmons. Specifically, we realize an order-preserving Toffoli gate consisting of four two-transmon operations, whereas the optimal order-preserving binary decomposition uses eight \texttt{CNOT}s on a linear transmon topology. Both decompositions are benchmarked via truth table fidelity where the ternary approach outperforms on most sets of transmons on \texttt{ibmq\_jakarta}, and is further benchmarked via quantum process tomography on one set of transmons to achieve an average gate fidelity of 78.00\% $\pm$ 1.93\%.


title: Strong-coupling results for $\mathcal{N}=2$ superconformal quivers and holography

abstract: We consider $\mathcal{N}=2$ superconformal quiver gauge theories in four dimensions and evaluate the chiral/anti-chiral correlators of single-trace operators. We show that it is convenient to form particular twisted and untwisted combinations of these operators suggested by the dual holographic description of the theory. The various twisted sectors are orthogonal and the correlators in each sector have always the same structure, as we show at the lowest orders in perturbation theory with Feynman diagrams. Using localization we then map the computation to a matrix model. In this way we are able to obtain formal expressions for the twisted correlators in the planar limit that are valid for all values of the 't Hooft coupling $\lambda$, and find that they are proportional to $1/\lambda$ at strong coupling. We successfully test the correctness of our extrapolation against a direct numerical evaluation of the matrix model and argue that the $1/\lambda$ behavior qualitatively agrees with the holographic description.


title: Synchronous Chip-to-Chip Communication with a Multi-Chip Resonator Clock Distribution Network

abstract: Superconducting digital circuits are a promising approach to build packaged-level integrated systems with high energy-efficiency and computational density. In such systems, performance of the data link between chips mounted on a multi-chip module (MCM) is a critical driver of performance. In this work we report a synchronous data link using Reciprocal Quantum Logic (RQL) enabled by resonant clock distribution on the chip and on the MCM carrier. The simple physical link has only four Josephson junctions and 3 fJ/bit dissipation, including a 300 W/W cooling overhead. The driver produces a signal with 35\,GHz analog bandwidth and connects to a single-ended receiver via 20 $\Omega$ Nb Passive Transmission Line (PTL). To validate this link, we have designed, fabricated and tested two 32$\times$32 mm$^2$ MCMs with eight 5$\times$5 mm$^2$ chips connected serially and powered with a meander clock, and with four 10$\times$10 mm$^2$ chips powered with a 2 GHz resonant clock. The meander clock MCM validates performance of the data link components, and achieved 5.4 dB AC bias margin with no degradation relative to individual chip test. The resonator MCM validates synchronization between chips, with a measured AC bias margin up to 4.8 dB between two chips. The resonator MCM is capable of powering circuits of 4 million Josephson junctions across the four chips with a projected 10 Gbps serial data rate.


title: JexoSim 2.0: End-to-End JWST Simulator for Exoplanet Spectroscopy -- Implementation and Case Studies

abstract: The recently developed JWST Exoplanet Observation Simulator (JexoSim) simulates transit spectroscopic observations of exoplanets by JWST with each of its four instruments using a time-domain approach. Previously we reported the validation of JexoSim against Pandexo and instrument team simulators. In the present study, we report a substantially enhanced version, JexoSim 2.0, which improves on the original version through incorporation of new noise sources, enhanced treatment of stellar and planetary signals and instrumental effects, as well as improved user-operability and optimisations for increased speed and efficiency. A near complete set of instrument modes for exoplanet time-series observations is now included. In this paper we report the implementation of JexoSim 2.0 and assess performance metrics for JWST in end-member scenarios using the hot Jupiter HD 209458 b and the mini-Neptune K2-18 b. We show how JexoSim can be used to compare performance across the different JWST instruments, selecting an optimal combination of instrument and subarray modes, producing synthetic transmission spectra for each planet. These studies indicate that the 1.4 {\mu}m water feature detected in the atmosphere of K2-18 b using the Hubble WFC3 might be observable in just one transit observation with JWST with either NIRISS or NIRSpec. JexoSim 2.0 can be used to investigate the impact of complex noise and systematic effects on the final spectrum, plan observations and test the feasibility of novel science cases for JWST. It can also be customised for other astrophysical applications beyond exoplanet spectroscopy. JexoSim 2.0 is now available for use by the scientific community.


title: Equidistribution Mod $1$ And Normal Numbers

abstract: Let $\alpha=0.a_1a_2a_3\ldots$ be an irrational number in base $b>1$, where $0\leq a_i<b$. The number $\alpha \in (0,1)$ is a \textit{normal number} if every block $(a_{n+1}a_{n+2}\ldots a_{n+k})$ of $k$ digits occurs with probability $1/b^k$. A proof of the normality of the real number $\sqrt{2}$ in base $10$ is presented in this note. Three different proofs based on different methods are given: a conditional proof, and two unconditional proofs.


title: Does Knowledge Help General NLU? An Empirical Study

abstract: It is often observed in knowledge-centric tasks (e.g., common sense question and answering, relation classification) that the integration of external knowledge such as entity representation into language models can help provide useful information to boost the performance. However, it is still unclear whether this benefit can extend to general natural language understanding (NLU) tasks. In this work, we empirically investigated the contribution of external knowledge by measuring the end-to-end performance of language models with various knowledge integration methods. We find that the introduction of knowledge can significantly improve the results on certain tasks while having no adverse effects on other tasks. We then employ mutual information to reflect the difference brought by knowledge and a neural interpretation model to reveal how a language model utilizes external knowledge. Our study provides valuable insights and guidance for practitioners to equip NLP models with knowledge.


title: Curved accretion disks around rotating black holes without reflection symmetry

abstract: Rotating black holes without equatorial reflection symmetry can naturally arise in effective low-energy theories of fundamental quantum gravity, in particular, when parity-violating interactions are introduced. Adopting a theory-agnostic approach and considering a recently proposed Kerr-like black hole model, we investigate the structure and properties of accretion disk around a rotating black hole without reflection symmetry. In the absence of reflection symmetry, the accretion disk is in general a curved surface in shape, rather than a flat disk lying on the equatorial plane. Furthermore, the parameter $\epsilon$ that controls the reflection asymmetry would shrink the size of the prograde innermost stable circular orbits, and enhance the efficiency of the black hole in converting rest-mass energy to radiation during accretion. The retrograde innermost stable circular orbits are stretched but the effects are substantially suppressed. In addition, we find that spin measurements based on the gravitational redshift observations of the disk, assuming a Kerr geometry, may overestimate the true spin values if the central object is actually a Kerr-like black hole with conspicuous equatorial reflection asymmetry. The qualitative results that the accretion disk becomes curved and the prograde innermost stable circular orbits are shrunk turn out to be generic in our model when the reflection asymmetry is small.


title: Estimating outflow masses and velocities in merger simulations: impact of r-process heating and neutrino cooling

abstract: The determination of the mass, composition, and geometry of matter outflows in black hole-neutron star and neutron star-neutron star binaries is crucial to current efforts to model kilonovae, and to understand the role of neutron star merger in r-process nucleosynthesis. In this manuscript, we review the simple criteria currently used in merger simulations to determine whether matter is unbound and what the asymptotic velocity of ejected material will be. We then show that properly accounting for both heating and cooling during r-process nucleosynthesis is important to accurately predict the mass and kinetic energy of the outflows. These processes are also likely to be crucial to predict the fallback timescale of any bound ejecta. We derive a model for the asymptotic veloicity of unbound matter and binding energy of bound matter that accounts for both of these effects and that can easily be implemented in merger simulations. We show, however, that the detailed velocity distribution and geometry of the outflows can currently only be captured by full 3D fluid simulations of the outflows, as non-local effect ignored by the simple criteria used in merger simulations cannot be safely neglected when modeling these effects. Finally, we propose the introduction of simple source terms in the fluid equations to approximately account for heating/cooling from r-process nucleosynthesis in future seconds-long 3D simulations of merger remnants, without the explicit inclusion of out-of-nuclear statistical equilibrium reactions in the simulations.


title: On Anosovity, divergence and bi-contact surgery

abstract: We discuss a metric description of the divergence of a (projectively) Anosov flow in dimension 3, in terms of its associated growth rates and give metric and contact geometric characterizations of when a projectively Anosov flow is Anosov. Then, we study the symmetries that the existence of an invariant volume form yields on the geometry of an Anosov flow, from various viewpoints of the theory of contact hyperbolas, Reeb dynamics and Liouville geometry, and give characterizations of when an Anosov flow is volume preserving in terms of those theories. We finally use our study to show that the bi-contact surgery operations of Salmoiraghi can be applied in an arbitrary small neighborhood of a periodic orbit of any Anosov flow. In particular, we conclude that the Goodman surgery of Anosov flows can be performed using a bi-contact surgery of Salmoiraghi.


title: Large power spectrum and primordial black holes in the effective theory of inflation

abstract: We study the generation of a large power spectrum, necessary for primordial black hole formation, within the effective theory of single-field inflation. The mechanisms we consider include a transition into a ghost-inflation-like phase and scenarios where an exponentially growing mode is temporarily turned on. In the cases we discuss, the enhancement in the power spectrum results from either a swift change in some effective coupling or a modification of the dispersion relation for the perturbations, while the background evolution remains unchanged and approximately de Sitter throughout inflation. The robustness of the results is guaranteed thanks to a weakly broken galileon symmetry, which protects the effective couplings against large quantum corrections. We discuss how the enhancement of the power spectrum is related to the energy scale of the operators with weakly broken galileon invariance, and study the limits imposed by strong coupling and the validity of the perturbative expansion.


title: Bridging the gap between mesoscopic and molecular models of solid/liquid interfaces out-of-equilibrium

abstract: Solid/liquid interfaces control various processes of technological relevance in the process industry and many fundamental physicochemical phenomena. This work examines the link between the atomistic description of mass transfer at solid/liquid interfaces out of equilibrium and the constitutive mass transfer equations typically used to model these processes at the mesoscale. In our analysis, we discuss the microscopic inconsistencies apparent in simplified models of mass transfer whenever non-idealities dominate the liquid phase in the proximity of solid/liquid interfaces. Using C{\mu}MD - a molecular simulation technique to investigate out-of-equilibrium, concentration-driven processes with pseudo open-boundary conditions - we outline a strategy to capture and quantify non-idealities induced by specific interactions between the solid surface and molecules in the fluid phase. We demonstrate our approach by studying electrolyte solutions in technologically important, multi-component systems in which introducing a solid/liquid interface induces substantial deviations in the composition and electrochemical properties compared to the fluid phase bulk. To this aim, we analyse NaCl(aq) solutions in contact with i) the graphite basal surface and ii) {100} NaCl(s) crystalline surfaces. We uncover the tendency of the sodium cation to preferentially adsorb at the surfaces considered, which induces local violations of electroneutrality that leads to the emergence of an electric potential in the fluid phase at the solid/liquid interface.


title: Interpretable Fields in Various Valued Fields

abstract: Let $\mathcal{K}=(K,v,\ldots)$ be a dp-minimal expansion of a non-trivially valued field of characteristic $0$ and $\mathcal{F}$ an infinite field interpretable in $\mathcal{K}$. Assume that $\mathcal{K}$ is one of the following: (i) $V$-minimal, (ii) power bounded $T$-convex, or (iii) $P$-minimal (assuming additionally in (iii) generic differentiability of definable functions). Then $\mathcal{F}$ is definably isomorphic to a finite extension $K$ or, in cases (i) and (ii), its residue field. In particular, every infinite field interpretable in $\mathbb{Q}_p$ is definably isomorphic to a finite extension of $\mathbb{Q}_p$, answering a question of Pillay's. Using Johnson's work on dp-minimal fields and the machinery developed here, we conclude that if $\mathcal{K}$ is an infinite dp-minimal pure field then every field definable in $\mathcal{K}$ is definably isomorphic to a finite extension of $K$. The proof avoids elimination of imaginaries in $\mathcal{K}$ replacing it with a reduction of the problem to certain distinguished quotients of $K$.


title: Process parameter optimization of Friction Stir Welding on 6061AA using Supervised Machine Learning Regression-based Algorithms

abstract: The highest strength-to-weight ratio criterion has fascinated curiosity increasingly in virtually all areas where heft reduction is indispensable. Lightweight materials and their joining processes are also a recent point of research demands in the manufacturing industries. Friction Stir Welding (FSW) is one of the recent advancements for joining materials without adding any third material (filler rod) and joining below the melting point of the parent material. The process is widely used for joining similar and dissimilar metals, especially lightweight non-ferrous materials like aluminum, copper, and magnesium alloys. This paper presents verdicts of optimum process parameters on attaining enhanced mechanical properties of the weld joint. The experiment was conducted on a 5 mm 6061 aluminum alloy sheet. Process parameters; tool material, rotational speed, traverse speed, and axial forces were utilized. Mechanical properties of the weld joint are examined employing a tensile test, and the maximum joint strength efficiency was reached 94.2%. Supervised Machine Learning based Regression algorithms such as Decision Trees, Random Forest, and Gradient Boosting Algorithm were used. The results showed that the Random Forest algorithm yielded highest coefficient of determination value of 0.926 which means it gives a best fit in comparison to other algorithms.


title: DILBERT: Customized Pre-Training for Domain Adaptation withCategory Shift, with an Application to Aspect Extraction

abstract: The rise of pre-trained language models has yielded substantial progress in the vast majority of Natural Language Processing (NLP) tasks. However, a generic approach towards the pre-training procedure can naturally be sub-optimal in some cases. Particularly, fine-tuning a pre-trained language model on a source domain and then applying it to a different target domain, results in a sharp performance decline of the eventual classifier for many source-target domain pairs. Moreover, in some NLP tasks, the output categories substantially differ between domains, making adaptation even more challenging. This, for example, happens in the task of aspect extraction, where the aspects of interest of reviews of, e.g., restaurants or electronic devices may be very different. This paper presents a new fine-tuning scheme for BERT, which aims to address the above challenges. We name this scheme DILBERT: Domain Invariant Learning with BERT, and customize it for aspect extraction in the unsupervised domain adaptation setting. DILBERT harnesses the categorical information of both the source and the target domains to guide the pre-training process towards a more domain and category invariant representation, thus closing the gap between the domains. We show that DILBERT yields substantial improvements over state-of-the-art baselines while using a fraction of the unlabeled data, particularly in more challenging domain adaptation setups.


title: Compton-Thick AGN in the NuSTAR era VII. A joint NuSTAR, Chandra and XMM-Newton analysis of two nearby, heavily obscured sources

abstract: We present the joint Chandra, XMM-Newton and NuSTAR analysis of two nearby Seyfert galaxies, NGC 3081 and ESO 565-G019. These are the only two having Chandra data in a larger sample of ten low redshift ($z \le 0.05$), candidates Compton-thick Active Galactic Nuclei (AGN) selected in the 15-150 keV band with Swift-BAT that were still lacking NuSTAR data. Our spectral analysis, performed using physically-motivated models, provides an estimate of both the line-of-sight (l.o.s.) and average (N$_{H,S}$) column densities of the two torii. NGC 3081 has a Compton-thin l.o.s. column density N$_{H,z}$=[0.58-0.62] $\times 10^{24}$cm$^{-2}$, but the N$_{H,S}$, beyond the Compton-thick threshold (N$_{H,S}$=[1.41-1.78] $\times 10^{24}$cm$^{-2}$), suggests a "patchy" scenario for the distribution of the circumnuclear matter. ESO 565-G019 has both Compton-thick l.o.s. and N$_{H,S}$ column densities (N$_{H,z}>$2.31 $\times 10^{24}$cm$^{-2}$ and N$_{H,S} >$2.57 $\times 10^{24}$cm$^{-2}$, respectively). The use of physically-motivated models, coupled with the broad energy range covered by the data (0.6-70 keV and 0.6-40 keV, for NGC 3081 and ESO 565-G019, respectively) allows us to constrain the covering factor of the obscuring material, which is C$_{TOR}$=[0.63-0.82] for NGC 3081, and C$_{TOR}$=[0.39-0.65] for ESO 565-G019.


title: Pulmonary Disease Classification Using Globally Correlated Maximum Likelihood: an Auxiliary Attention mechanism for Convolutional Neural Networks

abstract: Convolutional neural networks (CNN) are now being widely used for classifying and detecting pulmonary abnormalities in chest radiographs. Two complementary generalization properties of CNNs, translation invariance and equivariance, are particularly useful in detecting manifested abnormalities associated with pulmonary disease, regardless of their spatial locations within the image. However, these properties also come with the loss of exact spatial information and global relative positions of abnormalities detected in local regions. Global relative positions of such abnormalities may help distinguish similar conditions, such as COVID-19 and viral pneumonia. In such instances, a global attention mechanism is needed, which CNNs do not support in their traditional architectures that aim for generalization afforded by translation invariance and equivariance. Vision Transformers provide a global attention mechanism, but lack translation invariance and equivariance, requiring significantly more training data samples to match generalization of CNNs. To address the loss of spatial information and global relations between features, while preserving the inductive biases of CNNs, we present a novel technique that serves as an auxiliary attention mechanism to existing CNN architectures, in order to extract global correlations between salient features.


title: Active label cleaning for improved dataset quality under resource constraints

abstract: Imperfections in data annotation, known as label noise, are detrimental to the training of machine learning models and have an often-overlooked confounding effect on the assessment of model performance. Nevertheless, employing experts to remove label noise by fully re-annotating large datasets is infeasible in resource-constrained settings, such as healthcare. This work advocates for a data-driven approach to prioritising samples for re-annotation - which we term "active label cleaning". We propose to rank instances according to estimated label correctness and labelling difficulty of each sample, and introduce a simulation framework to evaluate relabelling efficacy. Our experiments on natural images and on a new medical imaging benchmark show that cleaning noisy labels mitigates their negative impact on model training, evaluation, and selection. Crucially, the proposed active label cleaning enables correcting labels up to 4 times more effectively than typical random selection in realistic conditions, making better use of experts' valuable time for improving dataset quality.


title: Robust Polarization Gradient Cooling of Trapped Ions

abstract: We implement three-dimensional polarization gradient cooling of trapped ions. Counter-propagating laser beams near $393\,$nm impinge in lin$\,\perp\,$lin configuration, at a frequency below the S$_{1/2}$ to P$_{3/2}$ resonance in $^{40}$Ca$^+$. We demonstrate mean phonon numbers of $5.4(4)$ at a trap frequency of $2\pi \times 285\,$kHz and $3.3(4)$ at $2\pi\times480\,$kHz, in the axial and radial directions, respectively. Our measurements demonstrate that cooling with laser beams detuned to lower frequencies from the resonance is robust against an elevated phonon occupation number, and thus works well for an initial ion motion far out of the Lamb-Dicke regime, for up to four ions, and for a micromotion modulation index $\beta\leq 0.1$. Still, we find that the spectral impurity of the laser field influences both, cooling rates and cooling limits. Thus, a Fabry-P\'{e}rot cavity filter is employed for efficiently suppressing amplified spontaneous emission of the diode laser.


title: Spatially resolved Lyman-$\alpha$ emission around radio bright quasars

abstract: We use Southern African Large Telescope (SALT) to perform long-slit spectroscopic observations of 23 newly discovered radio-loud quasars (RLQs) at $2.7<z<3.3$. The sample consists of powerful AGN brighter than 200 mJy at 1.4 GHz and is selected on the basis of mid-infrared colors i.e., unbiased to the presence of dust. We report 7 confirmed and 5 tentative detections of diffuse Ly$\alpha$ emission in the sample. We present the properties of diffuse Ly$\alpha$ emission and discuss in detail its relationship to different quasar properties. We find strong dependence of Ly$\alpha$ halo detection rate on the extent of radio source, spectral luminosity of RLQ at 420 MHz ($L_{\rm 420MHz}$), presence of associated C IV absorption and nuclear He II emission line equivalent width. As seen in previous surveys, the FWHM of diffuse Ly$\alpha$ emission in the case of confirmed detections are much higher (i.e $>$1000 km/s in all, except one). Using the samples of high-$z$ radio-loud quasars and galaxies from literature, we confirm the correlation between the Ly$\alpha$ halo luminosity and its size with radio power ($L_{\rm 420MHz}$). The same quantities are found to be correlating weakly with the projected linear size of the radio emission. Our sample is the second largest sample of RLQs being studied for the presence of diffuse Ly$\alpha$ emission and fills in a redshift gap between previous such studies. Integral Field Spectroscopy is required to fully understand the relationship between the large scale radio emission and the overall distribution, kinematics and over density of Ly$\alpha$ emission in the field of these RLQs.


title: FaVoA: Face-Voice Association Favours Ambiguous Speaker Detection

abstract: The strong relation between face and voice can aid active speaker detection systems when faces are visible, even in difficult settings, when the face of a speaker is not clear or when there are several people in the same scene. By being capable of estimating the frontal facial representation of a person from his/her speech, it becomes easier to determine whether he/she is a potential candidate for being classified as an active speaker, even in challenging cases in which no mouth movement is detected from any person in that same scene. By incorporating a face-voice association neural network into an existing state-of-the-art active speaker detection model, we introduce FaVoA (Face-Voice Association Ambiguous Speaker Detector), a neural network model that can correctly classify particularly ambiguous scenarios. FaVoA not only finds positive associations, but helps to rule out non-matching face-voice associations, where a face does not match a voice. Its use of a gated-bimodal-unit architecture for the fusion of those models offers a way to quantitatively determine how much each modality contributes to the classification.


title: Short polynomials in determinantal ideals

abstract: We show that a determinantal ideal generated by $t$-minors does not contain any nonzero polynomials with $t!/2$ or fewer terms. Geometrically this means that any nonzero polynomial vanishing on all matrices of rank at most $t-1$ has more than $t!/2$ terms.


title: Moving intervals for packing and covering

abstract: We study several problems on geometric packing and covering with movement. Given a family $\mathcal{I}$ of $n$ intervals of $\kappa$ distinct lengths, and another interval $B$, can we pack the intervals in $\mathcal{I}$ inside $B$ (respectively, cover $B$ by the intervals in $\mathcal{I}$) by moving $\tau$ intervals and keeping the other $\sigma = n - \tau$ intervals unmoved? We show that both packing and covering are W[1]-hard with any one of $\kappa$, $\tau$, and $\sigma$ as single parameter, but are FPT with combined parameters $\kappa$ and $\tau$. We also obtain improved polynomial-time algorithms for packing and covering, including an $O(n\log^2 n)$ time algorithm for covering, when all intervals in $\mathcal{I}$ have the same length.


title: There are no equal opportunity infectors: Epidemiological modelers must rethink our approach to inequality in infection risk

abstract: Mathematical models have come to play a key role in global pandemic preparedness and outbreak response: helping to plan for disease burden, hospital capacity, and inform non-pharmaceutical interventions. Such models have played a pivotal role in the COVID-19 pandemic, with transmission models and, by consequence, modelers guiding global, national, and local responses to SARS-CoV-2. However, these models have systematically failed to account for the social and structural factors which lead to socioeconomic, racial, and geographic health disparities. Why do epidemiologic models of emerging infections ignore known structural drivers of disparate health outcomes? What have been the consequences of this limited framework? What should be done to develop a more holistic approach to modeling-based decision-making during pandemics? In this Perspective, we evaluate potential historical and political explanations for the exclusion of drivers of disparity in infectious disease models for emerging infections, which have often been characterized as "equal opportunity infectors" despite ample evidence to the contrary. We look to examples from other disease systems (HIV, STIs) as a potential blueprint for how social connections, environmental, and structural factors can be integrated into a coherent, rigorous, and interpretable modeling framework. We conclude by outlining principles to guide modeling of emerging infections in ways that represent the causes of inequity in infection as central rather than peripheral mechanisms.


title: Effects of the free evolution in the Arthurs-Kelly model of simultaneous measurement and in the retrodictive predictions of the Heisenberg uncertainty relations

abstract: The simultaneous measurement approach of Arthurs and Kelly has been a significant tool for the better understanding of the measurement process in quantum mechanics. This model considers a strong interaction Hamiltonian by discarding the free evolution part. In this work, we study the effect of the full dynamics -- taking into account the free Hamiltonian -- on the optimal limits of retrodictive and predictive accuracy of the simultaneous measurement process of position and momentum observables. To do that, we consider a minimum uncertainty Gaussian state as the system under inspection, which allows to carry out an optimal simultaneous measurement. We show that the inclusion of the free Hamiltonian induces a spreading on the probability density of the measurement setting, which increases the value of the product of the variances of the so-called retrodictive and predictive error operators, this is equivalent to a reduction in the accuracy of the measurement.


title: Information-theoretic Classification Accuracy: A Criterion that Guides Data-driven Combination of Ambiguous Outcome Labels in Multi-class Classification

abstract: Outcome labeling ambiguity and subjectivity are ubiquitous in real-world datasets. While practitioners commonly combine ambiguous outcome labels for all data points (instances) in an ad hoc way to improve the accuracy of multi-class classification, there lacks a principled approach to guide the label combination for all data points by any optimality criterion. To address this problem, we propose the information-theoretic classification accuracy (ITCA), a criterion that balances the trade-off between prediction accuracy (how well do predicted labels agree with actual labels) and classification resolution (how many labels are predictable), to guide practitioners on how to combine ambiguous outcome labels. To find the optimal label combination indicated by ITCA, we propose two search strategies: greedy search and breadth-first search. Notably, ITCA and the two search strategies are adaptive to all machine-learning classification algorithms. Coupled with a classification algorithm and a search strategy, ITCA has two uses: improving prediction accuracy and identifying ambiguous labels. We first verify that ITCA achieves high accuracy with both search strategies in finding the correct label combinations on synthetic and real data. Then we demonstrate the effectiveness of ITCA in diverse applications including medical prognosis, cancer survival prediction, user demographics prediction, and cell type classification. We also provide theoretical insights into ITCA by studying the oracle and the linear discriminant analysis classification algorithms. Python package itca (available at https://github.com/JSB-UCLA/ITCA) implements ITCA and search strategies.


title: Astrophysical explosions revisited: collisionless coupling of debris to magnetized plasma

abstract: The coupling between a rapidly expanding cloud of ionized debris and an ambient magnetized plasma is revisited with a hybrid (kinetic ion/fluid electron) simulation code that allows a study over a wide range of plasma parameters. Over a specified range of hypothetical conditions, simple scaling laws in terms of the total debris mass and explosion speed are derived and verified for the maximal size of the debris cloud and the fraction of debris that free-streams from the burst along the magnetic field. The amount of debris that escapes from the burst with minimal coupling to the background magnetic field increases with the debris gyroradius. Test cases with two different debris species--including a heavy minority species with a relatively large gyroradius--highlight how the collisionless coupling of the debris depends on the single-particle trajectories as well as the overall conservation of energy and momentum.


title: Small Strong Blocking Sets by Concatenation

abstract: Strong blocking sets and their counterparts, minimal codes, attracted lots of attention in the last years. Combining the concatenating construction of codes with a geometric insight into the minimality condition, we explicitly provide infinite families of small strong blocking sets, whose size is linear in the dimension of the ambient projective spaces. As a byproduct, small saturating sets are obtained.


title: Curing tachyonic tree-level syndrome in NMSSM light-singlet scenarios

abstract: Models with an extended Higgs sector open up the phenomenological possibility of additional scalars, beyond the SM-like boson observed by the LHC, with mass at or below the electroweak scale. Such scenarios are in particular viable in the presence of electroweak-singlet spin-0 fields, as expected for instance in the context of the NMSSM. Given that the size of radiative corrections can substantially affect the Higgs potential, a negative squared mass at the tree level does not necessarily yield a tachyonic spectrum at the physical level, but only indicates a failure of the tree-level description for calculational purposes. We explain how to tackle this technical issue in the example of the NMSSM, in scenarios with light CP-odd or CP-even singlet-dominated states and show how loop corrections to the Higgs masses and decay widths can be derived with the regularized Lagrangian. We further explore how the same flexibility in the definition of tree-level parameters can be exploited to circumvent large deviations of the tree-level spectrum from the kinematical setup in Higgs decays, or to estimate the theoretical uncertainty associated with the discrepancy between tree-level and physical Higgs spectra. The latter is of particular relevance for the properties of the SM-like Higgs boson in supersymmetry-inspired models.


title: Tracing the boron diffusion into a textured silicon solar cell by combining boron diffusion simulation with experimental and simulated scanning transmission electron beam induced current

abstract: The light absorption of [001] grown single-crystalline silicon wafers can be enhanced by chemical etching with potassium hydroxide resulting in a pyramid-like surface texture. Alongside this advantageous property in the context of solar energy conversion, the surface roughness leads to drawbacks as well, e.g. difficulties in measuring diffusion behaviour of dopants in the heterogeneous structure. In this paper, we employ experimental and simulated scanning transmission electron beam induced current in combination with the simulation of boron diffusion to map a sub 0.1 ppm isoconcentration line underneath the textured surface on the nanoscale. In order to account for surface recombination, an effective two-dimensional model projecting the system along the electron beam propagation direction is used in the finite elements EBIC simulation. We find a good agreement to the experimental data and discuss future strategies to eliminate remaining deviations inside the space charge region.


title: Gauss-Manin connection in disguise: Quasi Jacobi forms of index zero

abstract: We consider the moduli space of abelian varieties with two marked points and a frame of the relative de Rham cohomolgy with boundary at these points compatible with its mixed Hodge structure. Such a moduli space gives a natural algebro-geometric framework for higher genus quasi Jacobi forms of index zero and their differential equations which are given as vector fields. In the case of elliptic curves we compute explicitly the Gauss-Manin connection and such vector fields.


title: Bimodule coefficients, Riesz transforms on Coxeter groups and strong solidity

abstract: In deformation-rigidity theory it is often important to know whether certain bimodules are weakly contained in the coarse bimodule. Consider a bimodule $H$ over the group algebra $\mathbb{C}[\Gamma]$, with $\Gamma$ a discrete group. The starting point of this paper is that if a dense set of the so-called coefficients of $H$ is contained in the Schatten $\mathcal{S}_p$ class $p \in [2, \infty)$ then the $n$-fold tensor power $H^{\otimes n}_\Gamma$ for $n \geq p/2$ is quasi-contained in the coarse bimodule. We apply this to gradient bimodules associated with the carr\'e du champ of a symmetric quantum Markov semi-group. For Coxeter groups we give a number of characterizations of having coefficients in $\mathcal{S}_p$ for the gradient bimodule constructed from the word length function. We get equivalence of: (1) the gradient-$\mathcal{S}_p$ property introduced by the second named author, (2) smallness at infinity of a natural compactification of the Coxeter group, and for a large class of Coxeter groups: (3) walks in the Coxeter diagram called parity paths. We derive several strong solidity results. In particular, we extend current strong solidity results for right-angled Hecke von Neumann algebras beyond right-angled Coxeter groups that are small at infinity. Our general methods also yield a concise proof of a result by T. Sinclair for discrete groups admitting a proper cocycle into a $p$-integrable representation.


title: Traced monoidal categories as algebraic structures in $\mathbf{Prof}$

abstract: We define a traced pseudomonoid as a pseudomonoid in a monoidal bicategory equipped with extra structure, giving a new characterisation of Cauchy complete traced monoidal categories as algebraic structures in $\mathbf{Prof}$, the monoidal bicategory of profunctors. This enables reasoning about the trace using the graphical calculus for monoidal bicategories, which we illustrate in detail. We apply our techniques to study traced $*$-autonomous categories, proving a new equivalence result between the left $\otimes$-trace and the right $\unicode{8523}$-trace, and describing a new condition under which traced $*$-autonomous categories become autonomous.


title: WebQA: Multihop and Multimodal QA

abstract: Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce WebQA, a challenging new benchmark that proves difficult for large-scale state-of-the-art models which lack language groundable visual representations for novel objects and the ability to reason, yet trivial for humans. WebQA mirrors the way humans use the web: 1) Ask a question, 2) Choose sources to aggregate, and 3) Produce a fluent language response. This is the behavior we should be expecting from IoT devices and digital assistants. Existing work prefers to assume that a model can either reason about knowledge in images or in text. WebQA includes a secondary text-only QA task to ensure improved visual performance does not come at the cost of language understanding. Our challenge for the community is to create unified multimodal reasoning models that answer questions regardless of the source modality, moving us closer to digital assistants that not only query language knowledge, but also the richer visual online world.


title: Fight Fire with Fire: Fine-tuning Hate Detectors using Large Samples of Generated Hate Speech

abstract: Automatic hate speech detection is hampered by the scarcity of labeled datasetd, leading to poor generalization. We employ pretrained language models (LMs) to alleviate this data bottleneck. We utilize the GPT LM for generating large amounts of synthetic hate speech sequences from available labeled examples, and leverage the generated data in fine-tuning large pretrained LMs on hate detection. An empirical study using the models of BERT, RoBERTa and ALBERT, shows that this approach improves generalization significantly and consistently within and across data distributions. In fact, we find that generating relevant labeled hate speech sequences is preferable to using out-of-domain, and sometimes also within-domain, human-labeled examples.


title: Blowup algebras of determinantal ideals in prime characteristic

abstract: We study when blowup algebras are $F$-split or strongly $F$-regular. Our main focus is on algebras given by symbolic and ordinary powers of ideals of minors of a generic matrix, a symmetric matrix, and a Hankel matrix. We also study ideals of Pfaffians of a skew-symmetric matrix. We use these results to obtain bounds on the degrees of the defining equations for these algebras. We also prove that the limit of the normalized regularity of the symbolic powers of these ideals exists and that their depth stabilizes. Finally, we show that, for determinantal ideals, there exists a monomial order for which taking initial ideals commutes with taking symbolic powers. To obtain these results we develop the notion of $F$-split filtrations and symbolic $F$-split ideals.


title: Discovery of a double radio relic in ZwCl1447.2+2619: A rare testbed for shock acceleration models with a peculiar surface brightness ratio

abstract: We report a discovery of a double radio relic in the cluster merger ZwCl1447.2+2619 ($z=0.376$) with uGMRT observations at $420\rm~MHz$ and $700\rm~MHz$. The linear sizes of the northern and southern relics are $\sim0.3~$Mpc and $\sim1.2~$Mpc, respectively, which is consistent with the theoretical expectation that a larger relic is produced in the less massive subcluster side. However, ZwCl1447.2+2619 is unlike other known double radio relic systems, where the larger relics are much more luminous by several factors. In this merger the higher surface brightness of the smaller northern relic makes its total radio luminosity comparable to that of the much larger southern relic. The surface brightness ratio $\sim0.1$ between the two radio relics differs significantly from the relation observed in other double radio relic systems. From our radio spectral analysis, we find that both relics signify similar weak shocks with Mach numbers of $2.9\pm0.8$ and $2.0\pm0.7$ for the northern and southern relics, respectively. Moreover, the northern relic is connected to a discrete radio source with an optical counterpart, which indicates the possible presence of cosmic ray injection and re-acceleration. Therefore, we propose that this atypical surface brightness ratio can be explained with the particle acceleration efficiency precipitously dropping in the weak shock regime and/or with re-acceleration of fossil cosmic rays. Our multi-wavelength analysis and numerical simulation suggest that ZwCl1447.2+2619 is a post-merger, which has experienced a near head-on collision $\sim0.7\rm~Gyr$ ago.