title: Understanding and Compressing Music with Maximal Transformable Patterns

abstract: We present a polynomial-time algorithm that discovers all maximal patterns in a point set, $D\subset\mathbb{R}^k$, that are related by transformations in a user-specified class, $F$, of bijections over $\mathbb{R}^k$. We also present a second algorithm that discovers the set of occurrences for each of these maximal patterns and then uses compact encodings of these occurrence sets to compute a losslessly compressed encoding of the input point set. This encoding takes the form of a set of pairs, $E=\left\lbrace\left\langle P_1, T_1\right\rangle,\left\langle P_2, T_2\right\rangle,\ldots\left\langle P_{\ell}, T_{\ell}\right\rangle\right\rbrace$, where each $\langle P_i,T_i\rangle$ consists of a maximal pattern, $P_i\subseteq D$, and a set, $T_i\subset F$, of transformations that map $P_i$ onto other subsets of $D$. Each transformation is encoded by a vector of real values that uniquely identifies it within $F$ and the length of this vector is used as a measure of the complexity of $F$. We evaluate the new compression algorithm with three transformation classes of differing complexity, on the task of classifying folk-song melodies into tune families. The most complex of the classes tested includes all combinations of the musical transformations of transposition, inversion, retrograde, augmentation and diminution. We found that broadening the transformation class improved performance on this task. However, it did not, on average, improve compression factor, which may be due to the datasets (in this case, folk-song melodies) being too short and simple to benefit from the potentially greater number of pattern relationships that are discoverable with larger transformation classes.


title: Can Old TREC Collections Reliably Evaluate Modern Neural Retrieval Models?

abstract: Neural retrieval models are generally regarded as fundamentally different from the retrieval techniques used in the late 1990's when the TREC ad hoc test collections were constructed. They thus provide the opportunity to empirically test the claim that pooling-built test collections can reliably evaluate retrieval systems that did not contribute to the construction of the collection (in other words, that such collections can be reusable). To test the reusability claim, we asked TREC assessors to judge new pools created from new search results for the TREC-8 ad hoc collection. These new search results consisted of five new runs (one each from three transformer-based models and two baseline runs that use BM25) plus the set of TREC-8 submissions that did not previously contribute to pools. The new runs did retrieve previously unseen documents, but the vast majority of those documents were not relevant. The ranking of all runs by mean evaluation score when evaluated using the official TREC-8 relevance judgment set and the newly expanded relevance set are almost identical, with Kendall's tau correlations greater than 0.99. Correlations for individual topics are also high. The TREC-8 ad hoc collection was originally constructed using deep pools over a diverse set of runs, including several effective manual runs. Its judgment budget, and hence construction cost, was relatively large. However, it does appear that the expense was well-spent: even with the advent of neural techniques, the collection has stood the test of time and remains a reliable evaluation instrument as retrieval techniques have advanced.


title: R\'enyi entropies of the free Fermi gas in multi-dimensional space at high temperature

abstract: We study the local and (bipartite) entanglement R\'enyi entropies of the free Fermi gas in multi-dimensional Euclidean space $\mathbb{R}^d$ in thermal equilibrium. We prove positivity of the entanglement entropies with R\'enyi index $\gamma\leq1$ for all temperatures $T>0$. Furthermore, for general $\gamma>0$ we establish the asymptotics of the entropies for large $T$ and large scaling parameter $\alpha>0$ for two different regimes $-$ for fixed chemical potential $\mu\in\mathbb{R}$ and also for fixed particle density $\rho>0$. In particular, we thereby provide the last remaining building block for a complete proof of our low- and high-temperature results presented (for $\gamma=1$) in J. Phys. A: Math. Theor. $\textbf{49}$, 30LT04 (2016) [Corrigendum: $\textbf{50}$, 129501 (2017)], but being supported there only by the basic proof ideas.


title: Massive Black Hole Binaries from the TNG50-3 Simulation: I. Coalescence and LISA Detection Rates

abstract: We evaluate the cosmological coalescence and detection rates for massive black hole (MBH) binaries targeted by the gravitational wave observatory Laser Interferometer Space Antenna (LISA). Our calculation starts with a population of gravitationally unbound MBH pairs, drawn from the TNG50-3 cosmological simulation, and follows their orbital evolution from kpc scales all the way to coalescence using a semi-analytic model developed in our previous work. We find that for a majority of MBH pairs that coalesce within a Hubble time dynamical friction is the most important mechanism that determines their coalescence rate. Our model predicts a MBH coalescence rate < 0.45/ yr and a LISA detection rate < 0.34/ yr. Most LISA detections should originate from 10^6 - 10^6.8 solar masses MBHs in gas-rich galaxies at redshifts 1.6 < z < 2.4, and have a characteristic signal to noise ratio SNR ~ 100. We however find a dramatic reduction in the coalescence and detection rates, as well as the average SNR, if the effects of radiative feedback from accreting MBHs are taken into account. In this case, the MBH coalescence rate is reduced by 78% (to < 0.1/ yr), and the LISA detection rate is reduced by 94% (to 0.02/ yr), whereas the average SNR is ~ 10. We emphasize that our model provides a lower limit on the LISA detection rate, consistent with other works in the literature that draw their MBH pairs from cosmological simulations.


title: The art of building a smooth cosmic distance ladder in a perturbed universe

abstract: How does a smooth cosmic distance ladder emerge from observations made from a single location in a lumpy Universe? Distances to Type Ia supernovae in the Hubble flow are anchored on local distance measurements to sources that are very nearby. We described how this configuration could be built in a perturbed universe where lumpiness is described as small perturbations on top of a flat Friedmann-Lema{\i}tre Robertson-Walker spacetime. We show that there is a non-negligible modification (about 11\%) to the background Friedmann-Lema{\i}tre Robertson-Walker area distance due to the presence of inhomogeneities in the immediate neighbourhood of an observer. We find that the modification is sourced by the electric part of the Weyl tensor indicating a tidal deformation of the local spacetime of the observer. We show in detail how it could impact the calibration of the Type Ia supernova absolute magnitude in the Hubble flow. We show that it could potentially resolve the Type Ia supernova absolute magnitude and Hubble tensions simultaneously without the need for early or late dark energy.


title: Dualities from dualities: the sequential deconfinement technique

abstract: It is an interesting question whether a given infra-red duality between quantum field theories can be explained in terms of other more elementary dualities. For example recently it has been shown that mirror dualities can be obtained by iterative applications of Seiberg-like dualities. In this paper we continue this line of investigation focusing on theories with tensor matter. In such cases one can apply the idea of deconfinement, which consists of trading the tensor matter for extra gauge nodes by means of a suitable elementary duality. This gives an auxiliary dual frame which can then be manipulated with further dualizations, in an iterative procedure eventually yielding an interesting dual description of the original theory. The sequential deconfinement technique has avatars in different areas of mathematical physics, such as the study of hypergeometric and elliptic hypergeometric integral identities or of $2d$ free field correlators. We discuss various examples in the context $4d$ $\mathcal{N}=1$ supersymmetric theories, which are related to elliptic hypergeometric integrals. These include a new self-duality involving a quiver theory which exhibits a non-trivial global symmetry enhancement to $E_6$.


title: Momentum Capsule Networks

abstract: Capsule networks are a class of neural networks that achieved promising results on many computer vision tasks. However, baseline capsule networks have failed to reach state-of-the-art results on more complex datasets due to the high computation and memory requirements. We tackle this problem by proposing a new network architecture, called Momentum Capsule Network (MoCapsNet). MoCapsNets are inspired by Momentum ResNets, a type of network that applies reversible residual building blocks. Reversible networks allow for recalculating activations of the forward pass in the backpropagation algorithm, so those memory requirements can be drastically reduced. In this paper, we provide a framework on how invertible residual building blocks can be applied to capsule networks. We will show that MoCapsNet beats the accuracy of baseline capsule networks on MNIST, SVHN, CIFAR-10 and CIFAR-100 while using considerably less memory. The source code is available on https://github.com/moejoe95/MoCapsNet.


title: Self-Attention Neural Bag-of-Features

abstract: In this work, we propose several attention formulations for multivariate sequence data. We build on top of the recently introduced 2D-Attention and reformulate the attention learning methodology by quantifying the relevance of feature/temporal dimensions through latent spaces based on self-attention rather than learning them directly. In addition, we propose a joint feature-temporal attention mechanism that learns a joint 2D attention mask highlighting relevant information without treating feature and temporal representations independently. The proposed approaches can be used in various architectures and we specifically evaluate their application together with Neural Bag of Features feature extraction module. Experiments on several sequence data analysis tasks show the improved performance yielded by our approach compared to standard methods.


title: Diophantine sets and Dirichlet improvability

abstract: This note pushes further the discussion about relations between Dirichlet improvable, badly approximable and singular points held in recent joint work with Beresnevich, Guan, Velani and Ramirez, by considering Diophantine sets extending the notion of badly approximability.


title: SCAI-QReCC Shared Task on Conversational Question Answering

abstract: Search-Oriented Conversational AI (SCAI) is an established venue that regularly puts a spotlight upon the recent work advancing the field of conversational search. SCAI'21 was organised as an independent on-line event and featured a shared task on conversational question answering. Since all of the participant teams experimented with answer generation models for this task, we identified evaluation of answer correctness in this settings as the major challenge and a current research gap. Alongside the automatic evaluation, we conducted two crowdsourcing experiments to collect annotations for answer plausibility and faithfulness. As a result of this shared task, the original conversational QA dataset used for evaluation was further extended with alternative correct answers produced by the participant systems.


title: Self-attention fusion for audiovisual emotion recognition with incomplete data

abstract: In this paper, we consider the problem of multimodal data analysis with a use case of audiovisual emotion recognition. We propose an architecture capable of learning from raw data and describe three variants of it with distinct modality fusion mechanisms. While most of the previous works consider the ideal scenario of presence of both modalities at all times during inference, we evaluate the robustness of the model in the unconstrained settings where one modality is absent or noisy, and propose a method to mitigate these limitations in a form of modality dropout. Most importantly, we find that following this approach not only improves performance drastically under the absence/noisy representations of one modality, but also improves the performance in a standard ideal setting, outperforming the competing methods.


title: Quantum Reservoir Computing for Speckle-Disorder Potentials

abstract: Quantum reservoir computing is a machine-learning approach designed to exploit the dynamics of quantum systems with memory to process information. As an advantage, it presents the possibility to benefit from the quantum resources provided by the reservoir combined with a simple and fast training strategy. In this work, this technique is introduced with a quantum reservoir of spins and it is applied to find the ground-state energy of an additional quantum system. The quantum reservoir computer is trained with a linear model to predict the lowest energy of a particle in the presence of different speckle-disorder potentials. The performance of the task is analyzed with a focus on the observable quantities extracted from the reservoir and it shows to be enhanced when two-qubit correlations are employed.


title: Adaptive Instance Distillation for Object Detection in Autonomous Driving

abstract: In recent years, knowledge distillation (KD) has been widely used to derive efficient models. Through imitating a large teacher model, a lightweight student model can achieve comparable performance with more efficiency. However, most existing knowledge distillation methods are focused on classification tasks. Only a limited number of studies have applied knowledge distillation to object detection, especially in time-sensitive autonomous driving scenarios. In this paper, we propose Adaptive Instance Distillation (AID) to selectively impart teacher's knowledge to the student to improve the performance of knowledge distillation. Unlike previous KD methods that treat all instances equally, our AID can attentively adjust the distillation weights of instances based on the teacher model's prediction loss. We verified the effectiveness of our AID method through experiments on the KITTI and the COCO traffic datasets. The results show that our method improves the performance of state-of-the-art attention-guided and non-local distillation methods and achieves better distillation results on both single-stage and two-stage detectors. Compared to the baseline, our AID led to an average of 2.7% and 2.1% mAP increases for single-stage and two-stage detectors, respectively. Furthermore, our AID is also shown to be useful for self-distillation to improve the teacher model's performance.


title: Non-linear interaction of laser light with vacuum: contributions to the energy density and pressure in presence of an intense magnetic field

abstract: Recent simulations show that very large electric and magnetic fields near the kilo Tesla strength will likely be generated by ultra-intense lasers at existing facilities over distances of hundreds of microns in underdense plasmas. Stronger ones are even expected in the future although some technical dificulties must be overcome. In addition, it has been shown that vacuum exhibits a peculiar non-linear behaviour in presence of high magnetic and electric field strengths. In this work we are interested in the analysis of thermodynamical contributions of vacuum to the energy density and pressure when radiation interacts with it in the presence of an external magnetic field. Using the Euler-Heisenberg formalism in the regime of weak fields i.e. smaller than critical Quantum Electrodynamics field strength values, we evaluate these magnitudes and analyze the highly anisotropic behaviour we find. Our work has implications for photon-photon scattering with lasers and astrophysically magnetized underdense systems far outside their surface where matter effects are increasingly negligible.

categories: physics.plasm-ph astro-ph.SR hep-ph physics.optics


title: On the behavior of multidimensional axisymmetric solutions of the repulsive Euler-Poisson equations

abstract: It is proved that the radially symmetric solutions of the repulsive Euler-Poisson equations with a non-zero background, corresponding to cold plasma oscillations blow up in many spatial dimensions except for $\bd=4$ for almost all initial data. The initial data, for which the solution may not blow up, correspond to simple waves. Moreover, if a solution is globally smooth in time, then it is either affine or tends to affine as $t\to\infty$.


title: Isoperimetric inequalities for the magnetic Neumann and Steklov problems with Aharonov-Bohm magnetic potential

abstract: We discuss isoperimetric inequalities for the magnetic Laplacian on bounded domains of $\mathbb R^2$ endowed with an Aharonov-Bohm potential. When the flux of the potential around the pole is not an integer, the lowest eigenvalue for the Neumann and the Steklov problems is positive. We establish isoperimetric inequalitites for the lowest eigenvalue in the spirit of the classical inequalities of Szeg\"o-Weinberger, Brock and Weinstock, the model domain being a disk with the pole at its center. We consider more generally domains in the plane endowed with a rotationally invariant metric, which include the spherical and the hyperbolic case.


title: Exact Continuum Representation of Long-range Interacting Systems and Emerging Exotic Phases in Unconventional Superconductors

abstract: Continuum limits are a powerful tool in the study of many-body systems, yet their validity is often unclear when long-range interactions are present. In this work, we rigorously address this issue and put forth an exact representation of long-range interacting lattices that separates the model into a term describing its continuous analog, the integral contribution, and a term that fully resolves the microstructure, the lattice contribution. For any system dimension, any lattice, any power-law interaction, and for linear, nonlinear, and multi-atomic lattices, we show that the lattice contribution can be described by a differential operator based on the multidimensional generalization of the Riemann zeta function, namely the Epstein zeta function. We employ our representation in Fourier space to solve the important problem of long-range interacting unconventional superconductors. We derive a generalized Bardeen--Cooper--Schrieffer gap equation and find emerging exotic phases in two-dimensional superconductors with topological phase transitions. Finally, we utilize non-equilibrium Higgs spectroscopy to analyze the impact of long-range interactions on the collective excitations of the condensate. We show that the interactions can be used to fine-tune the Higgs mode's stability, ranging from exponential decay of the oscillation amplitude up to complete stabilization.

categories: cond-mat.str-el math-ph math.MP math.NT physics.comp-ph quant-ph


title: Lorentz gauge-invariant variables in torsion-based theories of gravity

abstract: General relativity dynamics can be derived from different actions -- which depart from the Einstein-Hilbert action in boundary terms -- and for different choices of the dynamical variables. Among them, the teleparallel equivalent of general relativity is a torsion-based theory for the tetrad field. More general torsion-based theories have been built in the last years, intending to supersede general relativity. There are two current ways to formulate such theories; one includes a spin-connection and the other does not. We discuss the notion of Lorentz gauge invariance in such theories, and give a simple but important proof that both formulations are physically equivalent.


title: Auto-Compressing Subset Pruning for Semantic Image Segmentation

abstract: State-of-the-art semantic segmentation models are characterized by high parameter counts and slow inference times, making them unsuitable for deployment in resource-constrained environments. To address this challenge, we propose \textsc{Auto-Compressing Subset Pruning}, \acosp, as a new online compression method. The core of \acosp consists of learning a channel selection mechanism for individual channels of each convolution in the segmentation model based on an effective temperature annealing schedule. We show a crucial interplay between providing a high-capacity model at the beginning of training and the compression pressure forcing the model to compress concepts into retained channels. We apply \acosp to \segnet and \pspnet architectures and show its success when trained on the \camvid, \city, \voc, and \ade datasets. The results are competitive with existing baselines for compression of segmentation models at low compression ratios and outperform them significantly at high compression ratios, yielding acceptable results even when removing more than $93\%$ of the parameters. In addition, \acosp is conceptually simple, easy to implement, and can readily be generalized to other data modalities, tasks, and architectures. Our code is available at \url{https://github.com/merantix/acosp}.


title: Combining Optimal Path Search With Task-Dependent Learning in a Neural Network

abstract: Finding optimal paths in connected graphs requires determining the smallest total cost for traveling along the graph's edges. This problem can be solved by several classical algorithms where, usually, costs are predefined for all edges. Conventional planning methods can, thus, normally not be used when wanting to change costs in an adaptive way following the requirements of some task. Here we show that one can define a neural network representation of path finding problems by transforming cost values into synaptic weights, which allows for online weight adaptation using network learning mechanisms. When starting with an initial activity value of one, activity propagation in this network will lead to solutions, which are identical to those found by the Bellman-Ford algorithm. The neural network has the same algorithmic complexity as Bellman-Ford and, in addition, we can show that network learning mechanisms (such as Hebbian learning) can adapt the weights in the network augmenting the resulting paths according to some task at hand. We demonstrate this by learning to navigate in an environment with obstacles as well as by learning to follow certain sequences of path nodes. Hence, the here-presented novel algorithm may open up a different regime of applications where path-augmentation (by learning) is directly coupled with path finding in a natural way.


title: Do You See What I See? Capabilities and Limits of Automated Multimedia Content Analysis

abstract: The ever-increasing amount of user-generated content online has led, in recent years, to an expansion in research and investment in automated content analysis tools. Scrutiny of automated content analysis has accelerated during the COVID-19 pandemic, as social networking services have placed a greater reliance on these tools due to concerns about health risks to their moderation staff from in-person work. At the same time, there are important policy debates around the world about how to improve content moderation while protecting free expression and privacy. In order to advance these debates, we need to understand the potential role of automated content analysis tools. This paper explains the capabilities and limitations of tools for analyzing online multimedia content and highlights the potential risks of using these tools at scale without accounting for their limitations. It focuses on two main categories of tools: matching models and computer prediction models. Matching models include cryptographic and perceptual hashing, which compare user-generated content with existing and known content. Predictive models (including computer vision and computer audition) are machine learning techniques that aim to identify characteristics of new or previously unknown content.


title: Data-driven and constrained optimization of semi-local exchange and non-local correlation functionals for materials and surface chemistry

abstract: Reliable predictions of surface chemical reaction energetics require an accurate description of both chemisorption and physisorption. Here, we present an empirical approach to simultaneously optimize semi-local exchange and non-local correlation of a density functional approximation to improve these energetics. A combination of reference data for solid bulk, surface, and gas-phase chemistry and physical exchange-correlation model constraints leads to the VCML-rVV10 exchange-correlation functional. Owing to the variety of training data, the applicability of VCML-rVV10 extends beyond surface chemistry simulations. It provides optimized gas phase reaction energetics and an accurate description of bulk lattice constants and elastic properties.


title: Two-dimensional Airy waves and three-wave solitons in quadratic media

abstract: We address the dynamics of two-dimensional (2D) truncated Airy waves and three-component solitons in the system of two fundamental-frequency and second-harmonic fields, coupled by quadratic (chi^(2)) terms. The system models second-harmonic-generating optical media and atomic-molecular mixtures in Bose-Einstein condensates. In addition to stable solitons, the system maintains truncated-Airy-waves states in either one of the fundamental-frequency components, represented by exact solutions, which are stable, unlike the Airy waves in the degenerate (two-component) chi^(2) system. It is also possible to imprint vorticity onto the 2D Airy modes. By means of systematic simulations, we examine interactions between truncated Airy waves originally carried by different fundamental-frequency components which are bending in opposite directions, through the second-harmonic field. The interaction leads to fusion of the input into a pair of narrow solitons. This is opposed to what happens in the 1D system, where the interacting Airy waves split into a large number of solitons. The interaction of truncated Airy waves carrying identical imprinted vorticities creates an additional pair of solitons, while opposite vorticities create a set of small-amplitude "debris" in the output. Slowly moving solitons colliding with a heavy truncated Airy wave bounce back, faster ones are absorbed by it, and collisions are quasi-elastic for fast solitons. Soliton-soliton collisions lead to merger into a single mode, or elastic passage, for lower and higher velocities, respectively.


title: A probabilistic latent variable model for detecting structure in binary data

abstract: We introduce a novel, probabilistic binary latent variable model to detect noisy or approximate repeats of patterns in sparse binary data. The model is based on the "Noisy-OR model" (Heckerman, 1990), used previously for disease and topic modelling. The model's capability is demonstrated by extracting structure in recordings from retinal neurons, but it can be widely applied to discover and model latent structure in noisy binary data. In the context of spiking neural data, the task is to "explain" spikes of individual neurons in terms of groups of neurons, "Cell Assemblies" (CAs), that often fire together, due to mutual interactions or other causes. The model infers sparse activity in a set of binary latent variables, each describing the activity of a cell assembly. When the latent variable of a cell assembly is active, it reduces the probabilities of neurons belonging to this assembly to be inactive. The conditional probability kernels of the latent components are learned from the data in an expectation maximization scheme, involving inference of latent states and parameter adjustments to the model. We thoroughly validate the model on synthesized spike trains constructed to statistically resemble recorded retinal responses to white noise stimulus and natural movie stimulus in data. We also apply our model to spiking responses recorded in retinal ganglion cells (RGCs) during stimulation with a movie and discuss the found structure.


title: Using a Novel COVID-19 Calculator to Measure Positive U.S. Socio-Economic Impact of a COVID-19 Pre-Screening Solution (AI/ML)

abstract: The COVID-19 pandemic has been a scourge upon humanity, claiming the lives of more than 5.1 million people worldwide; the global economy contracted by 3.5% in 2020. This paper presents a COVID-19 calculator, synthesizing existing published calculators and data points, to measure the positive U.S. socio-economic impact of a COVID-19 AI/ML pre-screening solution (algorithm & application).


title: Spin Wave Electromagnetic Nano-Antenna Enabled by Tripartite Phonon-Magnon-Photon Coupling

abstract: We investigate tripartite coupling between phonons, magnons and photons in a periodic array of elliptical magnetostrictive nanomagnets delineated on a piezoelectric substrate to form a two-dimensional two-phase multiferroic crystal. A surface acoustic wave (phonons) of 5 - 35 GHz frequency launched into the substrate causes the magnetizations of the nanomagnets to precess at the frequency of the wave, giving rise to spin waves (magnons). The spin waves, in turn, radiate electromagnetic waves (photons) into the surrounding space at the surface acoustic wave frequency. Here, the phonons couple into magnons, which then couple into photons. This tripartite phonon-magnon-photon coupling is exploited to implement an extreme sub-wavelength electromagnetic antenna whose measured radiation efficiency and antenna gain exceed the theoretical limits for traditional antennas by more than two orders of magnitude at some frequencies. Micro-magnetic simulations are in excellent agreement with experimental observations and provide insight into the spin wave modes that couple into radiating electromagnetic modes to implement the antenna.

categories: cond-mat.mes-hall cs.SY eess.SY physics.app-ph


title: Doers, not Watchers: Intelligent Autonomous Agents are a Path to Cyber Resilience

abstract: Today's cyber defense tools are mostly watchers. They are not active doers. To be sure, watching too is a demanding affair. These tools monitor the traffic and events; they detect malicious signatures, patterns and anomalies; they might classify and characterize what they observe; they issue alerts, and they might even learn while doing all this. But they don't act. They do little to plan and execute responses to attacks, and they don't plan and execute recovery activities. Response and recovery - core elements of cyber resilience are left to the human cyber analysts, incident responders and system administrators. We believe things should change. Cyber defense tools should not be merely watchers. They need to become doers - active fighters in maintaining a system's resilience against cyber threats. This means that their capabilities should include a significant degree of autonomy and intelligence for the purposes of rapid response to a compromise - either incipient or already successful - and rapid recovery that aids the resilience of the overall system. Often, the response and recovery efforts need to be undertaken in absence of any human involvement, and with an intelligent consideration of risks and ramifications of such efforts. Recently an international team published a report that proposes a vision of an autonomous intelligent cyber defense agent (AICA) and offers a high-level reference architecture of such an agent. In this paper we explore this vision.


title: A Number Theoretic Approach to Cycles in LDPC Codes

abstract: LDPC codes constructed from permutation matrices have recently attracted the interest of many researchers. A crucial point when dealing with such codes is trying to avoid cycles of short length in the associated Tanner graph, i.e. obtaining a possibly large girth. In this paper, we provide a framework to obtain constructions of such codes. We relate criteria for the existence of cycles of a certain length with some number-theoretic concepts, in particular with the so-called Sidon sets. In this way we obtain examples of LDPC codes with a certain girth. Finally, we extend our constructions to also obtain irregular LDPC codes.


title: Post-training Quantization for Neural Networks with Provable Guarantees

abstract: While neural networks have been remarkably successful in a wide array of applications, implementing them in resource-constrained hardware remains an area of intense research. By replacing the weights of a neural network with quantized (e.g., 4-bit, or binary) counterparts, massive savings in computation cost, memory, and power consumption are attained. To that end, we generalize a post-training neural-network quantization method, GPFQ, that is based on a greedy path-following mechanism. Among other things, we propose modifications to promote sparsity of the weights, and rigorously analyze the associated error. Additionally, our error analysis expands the results of previous work on GPFQ to handle general quantization alphabets, showing that for quantizing a single-layer network, the relative square error essentially decays linearly in the number of weights -- i.e., level of over-parametrization. Our result holds across a range of input distributions and for both fully-connected and convolutional architectures thereby also extending previous results. To empirically evaluate the method, we quantize several common architectures with few bits per weight, and test them on ImageNet, showing only minor loss of accuracy compared to unquantized models. We also demonstrate that standard modifications, such as bias correction and mixed precision quantization, further improve accuracy.


title: Natural Language Descriptions of Deep Visual Features

abstract: Some neurons in deep networks specialize in recognizing highly specific perceptual, structural, or semantic features of inputs. In computer vision, techniques exist for identifying neurons that respond to individual concept categories like colors, textures, and object classes. But these techniques are limited in scope, labeling only a small subset of neurons and behaviors in any network. Is a richer characterization of neuron-level computation possible? We introduce a procedure (called MILAN, for mutual-information-guided linguistic annotation of neurons) that automatically labels neurons with open-ended, compositional, natural language descriptions. Given a neuron, MILAN generates a description by searching for a natural language string that maximizes pointwise mutual information with the image regions in which the neuron is active. MILAN produces fine-grained descriptions that capture categorical, relational, and logical structure in learned features. These descriptions obtain high agreement with human-generated feature descriptions across a diverse set of model architectures and tasks, and can aid in understanding and controlling learned models. We highlight three applications of natural language neuron descriptions. First, we use MILAN for analysis, characterizing the distribution and importance of neurons selective for attribute, category, and relational information in vision models. Second, we use MILAN for auditing, surfacing neurons sensitive to human faces in datasets designed to obscure them. Finally, we use MILAN for editing, improving robustness in an image classifier by deleting neurons sensitive to text features spuriously correlated with class labels.


title: CsFEVER and CTKFacts: Acquiring Czech data for fact verification

abstract: In this paper, we examine several methods of acquiring Czech data for automated fact-checking, which is a task commonly modeled as a classification of textual claim veracity w.r.t. a corpus of trusted ground truths. We attempt to collect sets of data in form of a factual claim, evidence within the ground truth corpus, and its veracity label (supported, refuted or not enough info). As a first attempt, we generate a Czech version of the large-scale FEVER dataset built on top of Wikipedia corpus. We take a hybrid approach of machine translation and document alignment; the approach and the tools we provide can be easily applied to other languages. We discuss its weaknesses and inaccuracies, propose a future approach for their cleaning and publish the 127k resulting translations, as well as a version of such dataset reliably applicable for the Natural Language Inference task - the CsFEVER-NLI. Furthermore, we collect a novel dataset of 3,097 claims, which is annotated using the corpus of 2.2M articles of Czech News Agency. We present its extended annotation methodology based on the FEVER approach, and, as the underlying corpus is kept a trade secret, we also publish a standalone version of the dataset for the task of Natural Language Inference we call CTKFactsNLI. We analyze both acquired datasets for spurious cues - annotation patterns leading to model overfitting. CTKFacts is further examined for inter-annotator agreement, thoroughly cleaned, and a typology of common annotator errors is extracted. Finally, we provide baseline models for all stages of the fact-checking pipeline and publish the NLI datasets, as well as our annotation platform and other experimental data.


title: Quality assessment of Cadmium Telluride as a detector material for multispectral medical imaging

abstract: Cadmium Telluride (CdTe) is a high-Z material with excellent photon radiation absorption properties, making it a promising material to include in radiation detection technologies. However, the brittleness of CdTe crystals as well as their varying concentration of defects necessitate a thorough quality assessment before the complex detector processing procedure. We present our quality assessment of CdTe as a detector material for multispectral medical imaging, a research which is conducted as part of the Consortium Project Multispectral Photon-counting for Medical Imaging and Beam characterization (MPMIB). The aim of the project is to develop novel CdTe detectors and obtain spectrum-per-pixel information that make the distinction between different radiation types and tissues possible. To evaluate the defect density inside the crystals -- which can deteriorate the detector performance -- we employ infrared microscopy (IRM). Posterior data analysis allows us to visualise the defect distributions as 3D defect maps. Additionally, we investigate front and backside differences of the material with current-voltage (IV) measurements to determine the preferred surface for the pixelisation of the crystal, and perform test measurements with the prototypes to provide feedback for further processing. We present the different parts of our quality assessment chain and will close with first experimental results obtained with one of our prototype PC detectors in a small tomographic setup.


title: Cybertrust: From Explainable to Actionable and Interpretable AI (AI2)

abstract: To benefit from AI advances, users and operators of AI systems must have reason to trust it. Trust arises from multiple interactions, where predictable and desirable behavior is reinforced over time. Providing the system's users with some understanding of AI operations can support predictability, but forcing AI to explain itself risks constraining AI capabilities to only those reconcilable with human cognition. We argue that AI systems should be designed with features that build trust by bringing decision-analytic perspectives and formal tools into AI. Instead of trying to achieve explainable AI, we should develop interpretable and actionable AI. Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. In doing so, it will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making and ensure broad benefits from deploying and advancing its computational capabilities.


title: Approximations of the Quasi-Stationary Distribution of a Logistic SIS Model for Endemic Infections

abstract: Errors of approximations of the quasi-stationary distribution (the QSD) of the logistic SIS model are evaluated numerically. The results are used to derive asymptotic approximations of the approximation errors for large populations. We show in particular that there are two approximations above threshold for which the approximation errors are exponentially small. One of these approximations has been known for some time, while the other one is new. The result that the older one of these two approximations has an exponentially small approximation error is new.


title: The VISCACHA survey -- IV. The SMC West Halo in 8D

abstract: The structure of the Small Magellanic Cloud (SMC) is very complex, in particular in the periphery that suffers more from the interactions with the Large Magellanic Cloud (LMC). A wealth of observational evidence has been accumulated revealing tidal tails and bridges made up of gas, stars and star clusters. Nevertheless, a full picture of the SMC outskirts is only recently starting to emerge with a 6D phase-space map plus age and metallicity using star clusters as tracers. In this work, we continue our analysis of another outer region of the SMC, the so-called West Halo, and combined it with the previously analysed Northern Bridge. We use both structures to define the Bridge and Counter-bridge trailing and leading tidal tails. These two structures are moving away from each other, roughly in the SMC-LMC direction. The West Halo form a ring around the SMC inner regions that goes up to the background of the Northern Bridge shaping an extended layer of the Counter-bridge. Four old Bridge clusters were identified at distances larger than 8 kpc from the SMC centre moving towards the LMC, which is consistent with the SMC-LMC closest distance of 7.5 kpc when the Magellanic Bridge was formed about 150Myr ago; this shows that the Magellanic Bridge was not formed only by pulled gas, but it also removed older stars from the SMC during its formation. We also found age and metallicity radial gradients using projected distances on sky, which are vanished when we use the real 3D distances.


title: A tentative detection of He I in the atmosphere of GJ 1214b

abstract: The $\ion{He}{I}$ 10833\,$\AA$ triplet is a powerful tool for characterising the upper atmosphere of exoplanets and tracing possible mass loss. Here, we analysed one transit of GJ\,1214\,b observed with the CARMENES high-resolution spectrograph to study its atmosphere via transmission spectroscopy around the $\ion{He}{I}$ triplet. Although previous studies using lower resolution instruments have reported non-detections of $\ion{He}{I}$ in the atmosphere of GJ\,1214\,b, we report here the first potential detection. We reconcile the conflicting results arguing that previous transit observations did not present good opportunities for the detection of $\ion{He}{I}$, due to telluric H$_2$O absorption and OH emission contamination.We simulated those earlier observations, and show evidence that the planetary signal was contaminated. From our single non-telluric-contaminated transit, we determined an excess absorption of 2.10$^{+0.45}_{-0.50}$\,\% (4.6\,$\sigma$) with a full width at half maximum (FWHM) of 1.30$^{+0.30}_{-0.25}$\,\AA. The detection of \ion{He}{I} is statistically significant at the 4.6\,$\sigma$ level, but repeatability of the detection could not be confirmed due to the availability of only one transit. By applying a hydrodynamical model and assuming an H/He composition of 98/2, we found that GJ\,1214\,b would undergo hydrodynamic escape in the photon-limited regime, losing its primary atmosphere with a mass-loss rate of (1.5--18)\,$\times$\,10$^{10}$\,g\,s$^{-1}$ and an outflow temperature in the range of 2900--4400\,K. Our $\ion{He}{I}$ excess absorption is the first tentative detection of a chemical species in the atmosphere of this benchmark sub-Neptune planet.


title: Cold and Hot gas distribution around the Milky-Way-M31 system in the HESTIA simulations

abstract: Recent observations have revealed remarkable insights into the gas reservoir in the circumgalactic medium (CGM) of galaxy haloes. In this paper, we characterise the gas in the vicinity of Milky Way and Andromeda analogues in the HESTIA (High resolution Environmental Simulations of The Immediate Area) suite of constrained Local Group (LG) simulations. The HESTIA suite comprise of a set of three high-resolution {\sc arepo}-based simulations of the LG, run using the Auriga galaxy formation model. For this paper, we focus only on the $z = 0$ simulation datasets and generate mock skymaps along with a power spectrum analysis to show that the distributions of ions tracing low-temperature gas (HI and SiIII) are more clumpy in comparison to warmer gas tracers (OVI, OVII and OVIII). We compare to the spectroscopic CGM observations of M31 and low-redshift galaxies. HESTIA under-produces the column densities of the M31 observations, but the simulations are consistent with the observations of low-redshift galaxies. A possible explanation for these findings is that the spectroscopic observations of M31 are contaminated by gas residing in the CGM of the Milky Way.


title: Multivariate matrix-exponential affine mixtures and their applications in risk theory

abstract: In this paper, a class of multivariate matrix-exponential affine mixtures with matrix-exponential marginals is proposed. The class is shown to possess various attractive properties such as closure under size-biased Esscher transform, order statistics, residual lifetime and higher order equilibrium distributions. This allows for explicit calculations of various actuarial quantities of interest. The results are applied in a wide range of actuarial problems including multivariate risk measures, aggregate loss, large claims reinsurance, weighted premium calculations and risk capital allocation. Furthermore, a multiplicative background risk model with dependent risks is considered and its capital allocation rules are provided as well. We finalize by discussing a calibration scheme based on complete data and potential avenues of research.


title: Project Hephaistos I. Upper limits on partial Dyson spheres in the Milky Way

abstract: Dyson spheres are hypothetical megastructures built by advanced extraterrestrial civilizations to harvest radiation energy from stars. Here, we combine optical data from Gaia DR2 with mid-infrared data from AllWISE to set the strongest upper limits to date on the prevalence of partial Dyson spheres within the Milky Way, based on their expected waste-heat signatures. Conservative upper limits are presented on the fraction of stars at G $\leq$ 21 that may potentially host non-reflective Dyson spheres that absorb 1 - 90$\%$ of the bolometric luminosity of their host stars and emit thermal waste-heat in the 100 - 1000 K range. Based on a sample of $\approx$ $2.7\mathrm{e}\,5$ stars within 100 pc, we find that a fraction less than $\approx$ $2\mathrm{e}\,-5$ could potentially host $\sim$300 K Dyson spheres at 90$\%$ completion. These limits become progressively weaker for less complete Dyson spheres due to increased confusion with naturally occurring sources of strong mid-infrared radiation, and also at larger distances, due to the detection limits of WISE. For the $\sim2.9\mathrm{e}\,8$ stars within 5 kpc in our Milky Way sample, the corresponding upper limit on the fraction of stars that could potentially be $\sim$300 K Dyson spheres at 90$\%$ completion is $\leq$ $8\mathrm{e}\,-4$.


title: Using Hybrid Scheduling Algorithms for Solving Blockchain Allocation on Cloud

abstract: Companies are rushing to deliver their services and solutions through the cloud. The scheduling process is very critical in reducing delays. Scheduling also has a role in accessing resources without excessive waiting time. All this in context of modern advances in infrastructure and the emergence of Blockchain-as-a-service. What if integration is done between a hybrid scheduling algorithm and blockchain technology via the cloud. This integration aims to enhance and provide the service uninterruptedly. This method is distinguished, compared to other scheduling algorithms such as shortest-job-first and priority scheduling, that it does not suffer from starvation and it has a balanced load on resources. Based on analytical performance, the proposed hybrid scheduling has the markable result.


title: SQRQuerier: A Visual Querying Framework for Cross-national Survey Data Recycling

abstract: Public opinion surveys constitute a powerful tool to study peoples' attitudes and behaviors in comparative perspectives. However, even worldwide surveys provide only partial geographic and time coverage, which hinders comprehensive knowledge production. To broaden the scope of comparison, social scientists turn to ex-post harmonization of variables from datasets that cover similar topics but in different populations and/or years. The resulting new datasets can be analyzed as a single source, which can be flexibly accessed through many data portals. However, such portals offer little guidance to explore the data in-depth or query data with user-customized needs. As a result, it is still challenging for social scientists to efficiently identify related data for their studies and evaluate their theoretical models based on the sliced data. To overcome them, in the Survey Data Recycling (SDR) international cooperation research project, we propose SDRQuerier and apply it to the harmonized SDR database, which features over two million respondents interviewed in a total of 1,721 national surveys that are part of 22 well-known international projects. We design the SDRQuerier to solve three practical challenges that social scientists routinely face. First, a BERT-based model provides customized data queries through research questions or keywords. Second, we propose a new visual design to showcase the availability of the harmonized data at different levels, thus helping users decide if empirical data exist to address a given research question. Lastly, SDRQuerier discloses the underlying relational patterns among substantive and methodological variables in the database, to help social scientists rigorously evaluate or even improve their regression models. Through case studies with multiple social scientists in solving their daily challenges, we demonstrated the novelty, effectiveness of SDRQuerier.


title: Rapid Mass Parameter Estimation of Binary Black Hole Coalescences Using Deep Learning

abstract: Deep learning can be used to drastically decrease the processing time of parameter estimation for coalescing binaries of compact objects including black holes and neutron stars detected in gravitational waves (GWs). As a first step, we present two neural network models trained to rapidly estimate the posterior distributions of the chirp mass and mass ratio of a detected binary black hole system from the GW strain data of LIGO Hanford and Livingston Observatories. Using these parameters the component masses can be predicted, which has implications for the prediction of the likelihood that a merger contains a neutron star. The results are compared to the 'gold standard' of parameter estimation of gravitational waves used by the LIGO-Virgo Collaboration (LVC), LALInference. Our models predict posterior distributions consistent with that from LALInference while using orders of magnitude less processing time once the models are trained. The median predictions are within the 90% credible intervals of LALInference for all predicted parameters when tested on real binary black hole events detected during the LVC's first and second observing runs. We argue that deep learning has strong potential for low-latency high-accuracy parameter estimation suitable for real-time GW search pipelines.


title: Constant-time one-shot testing of large-scale graph states

abstract: Fault-tolerant measurement-based quantum computation (MBQC) with recent progress on quantum technologies leads to a promising scalable platform for realizing quantum computation, conducted by preparing a large-scale graph state over many qubits and performing single-qubit measurements on the state. With fault-tolerant MBQC, even if the graph-state preparation suffers from errors occurring at an unknown physical error rate, we can suppress the effect of the errors. Verifying graph states is vital to test whether we can conduct MBQC as desired even with such errors. However, problematically, existing state-of-the-art protocols for graph-state verification by fidelity estimation have required measurements on many copies of the entire graph state and hence have been prohibitively costly in terms of the number of qubits and the runtime. We here construct an efficient alternative framework for testing graph states for fault-tolerant MBQC based on the theory of property testing. Our test protocol accepts with high probability when the physical error rate is small enough to make fault-tolerant MBQC feasible and rejects when the rate is above the threshold of fault-tolerant MBQC. The novelty of our protocol is that we use only a single copy of the $N$-qubit graph state and single-qubit Pauli measurements only on a constant-sized subset of the qubits; thus, the protocol has a constant runtime independently of $N$. Furthermore, we can immediately use the rest of the graph state for fault-tolerant MBQC if the protocol accepts. These results achieve a significant advantage over prior art for graph-state verification in the number of qubits and the total runtime. Consequently, our work offers a new route to a fast and practical framework for benchmarking large-scale quantum state preparation.


title: An improved Noether's theorem for spacetime symmetries

abstract: We exploit an ambiguity somewhat hidden in Noether's theorem to derive systematically, for relativistic field theories, the stress-energy tensor's improvement terms that are associated with additional spacetime symmetries beyond translations. We work out explicitly the cases of Lorentz invariance, scale invariance, and full conformal invariance. The main idea is to use, directly in the translation Noether theorem, the fact that these additional symmetries can be thought of as suitably modulated translations. Compared to more standard derivations of the improvement terms, ours (1) unifies all different cases in a single framework, (2) involves no guesswork, (3) yields the desired algebraic properties (symmetry and/or tracelessness) of the stress-energy tensor off-shell, and (4) unifies the translation Noether theorem with those of the additional spacetime symmetries, yielding at the same time both the improved stress-energy tensor and the additional Noether currents.


title: Cosmological perturbations: non-cold relics without the Boltzmann hierarchy

abstract: We present a formulation of cosmological perturbation theory where the Boltzmann hierarchies that evolve the neutrino phase-space distributions are replaced by integrals that can be evaluated easily with fast Fourier transforms. The simultaneous evaluation of these integrals combined with the differential equations for the rest of the system (dark matter, photons, baryons) are then solved with an iterative scheme that converges quickly. The formulation is particularly powerful for massive neutrinos, where the effective phase space is three-dimensional rather than two-dimensional, and even moreso for three different neutrino mass eigenstates. Therefore, it has the potential to significantly speed up the computation times of cosmological-perturbation calculations. This approach should also be applicable to models with other non-cold collisionless relics.


title: Entanglement Harvesting with a Twist

abstract: One consequence of the cosmic censorship conjecture is that any topological structure will ultimately collapse to within the horizons of a set of black holes, and as a result, an external classical observer will be unable to probe it. However a single two-level quantum system (UDW detector) that remains outside of the horizon has been shown to distinguish between a black hole and its associated geon counterpart via its different response rates. Here we extend this investigation of the quantum vacuum outside of an $\mathbb{RP}_2$ geon by considering the entanglement structure of the vacuum state of a quantum scalar field in this spacetime, and how this differs from its BTZ black hole counterpart. Employing the entanglement harvesting protocol, where field entanglement is swapped to a pair of UDW detectors, we find that the classically hidden topology of the geon can have an appreciable difference in the amount of entanglement harvested in the two spacetimes for sufficiently small mass. In this regime, we find that detectors with a small energy gap harvest more entanglement in the BTZ spacetime; however as the energy gap increases, the detectors harvest more entanglement in a geon spacetime. The energy gap at the crossover is dependent on the black hole mass, occurring at a lower values for lower masses. This also impacts the size of the entanglement shadow, the region near the horizon where the detectors cannot harvest entanglement. Small gap detectors experience a larger entanglement shadow in a geon spacetime, whereas for large gap detectors the shadow is larger in a BTZ spacetime.


title: The "Giraffe": Discovery of a stripped red giant in an interacting binary with a ${\sim}2~M_\odot$ lower giant

abstract: We report the discovery of a stripped giant + lower giant binary, 2M04123153+6738486 (2M0412), identified during a search for non-interacting compact object-star binaries. 2M0412 is an evolved ($T_{\rm eff, giant}\simeq4000$ K), luminous ($L_{\rm giant}\simeq150~L_\odot$) red giant in a circular $P=81.2$ day binary. 2M0412 is a known variable star previously classified as a semi-regular variable. The cross-correlation functions of follow-up Keck/HIRES and LBT/PEPSI spectra show an RV-variable second component with implied mass ratio $q=M_{\rm giant}/M_{\rm comp}\simeq0.20\pm0.01$. The ASAS-SN, ATLAS, TESS and ZTF light curves show that the giant is a Roche lobe filling ellipsoidal variable with an inclination of $49.4^\circ{}\pm{0.3^{\circ}}$, and a giant mass of $M_{\rm giant}=0.38\pm0.01~ M_\odot$ for a distance of $\simeq3.7$ kpc. The mass of the giant indicates that its envelope has been stripped. The giant companion on the lower red giant branch has a mass of $M_{\rm comp}=1.91\pm0.03~M_\odot$ with $T_{\rm eff, comp}\simeq5000$ K, $L_{\rm comp}\simeq60~L_\odot$ and $R_{\rm comp}\simeq11~R_\odot$. We also identify an orbital phase dependent, broad $\rm H\alpha$ emission line which could indicate ongoing accretion from the stripped red giant onto the companion.


title: Singularities From Entropy

abstract: Assuming the Bousso bound, we prove a singularity theorem: if the light rays entering a hyperentropic region contract, then at least one light ray must be incomplete. "Hyperentropic" means that the entropy of the region exceeds the Bekenstein-Hawking entropy of its spatial boundary. Our theorem provides a direct link between singularities and quantum information. The hyperentropic condition replaces the noncompactness assumption in Penrose's theorem, so our theorem is applicable even in a closed universe. In an asymptotically de Sitter spacetime, for example, a big bang singularity can be diagnosed from the presence of dilute radiation at arbitrarily late times. In asymptotically flat space, Penrose's theorem can be recovered by adding soft radiation.


title: Inference-optimized AI and high performance computing for gravitational wave detection at scale

abstract: We introduce an ensemble of artificial intelligence models for gravitational wave detection that we trained in the Summit supercomputer using 32 nodes, equivalent to 192 NVIDIA V100 GPUs, within 2 hours. Once fully trained, we optimized these models for accelerated inference using NVIDIA TensorRT. We deployed our inference-optimized AI ensemble in the ThetaGPU supercomputer at Argonne Leadership Computer Facility to conduct distributed inference. Using the entire ThetaGPU supercomputer, consisting of 20 nodes each of which has 8 NVIDIA A100 Tensor Core GPUs and 2 AMD Rome CPUs, our NVIDIA TensorRT-optimized AI ensemble processed an entire month of advanced LIGO data (including Hanford and Livingston data streams) within 50 seconds. Our inference-optimized AI ensemble retains the same sensitivity of traditional AI models, namely, it identifies all known binary black hole mergers previously identified in this advanced LIGO dataset and reports no misclassifications, while also providing a 3X inference speedup compared to traditional artificial intelligence models. We used time slides to quantify the performance of our AI ensemble to process up to 5 years worth of advanced LIGO data. In this synthetically enhanced dataset, our AI ensemble reports an average of one misclassification for every month of searched advanced LIGO data. We also present the receiver operating characteristic curve of our AI ensemble using this 5 year long advanced LIGO dataset. This approach provides the required tools to conduct accelerated, AI-driven gravitational wave detection at scale.


title: Dust and the intrinsic spectral index of quasar variations: hints of finite stress at the innermost stable circular orbit

abstract: We present a study of 9242 spectroscopically-confirmed quasars with multi-epoch ugriz photometry from the SDSS Southern Survey. By fitting a separable linear model to each quasar's spectral variations, we decompose their five-band spectral energy distributions into variable (disc) and non-variable (host galaxy) components. In modelling the disc spectra, we include attenuation by dust on the line of sight through the host galaxy to its nucleus. We consider five commonly used attenuation laws, and find that the best description is by dust similar to that of the Small Magellanic Cloud, inferring a lack of carbonaceous grains from the relatively weak 2175AA absorption feature. We go on to construct a composite spectrum for the quasar variations spanning 700 to 8000AA. By varying the assumed power-law $L_{\nu}\propto\nu^\alpha$ spectral slope, we find a best-fit value $\alpha=0.71\pm0.02$, excluding at high confidence the canonical $L_{\nu}\propto\nu^{1/3}$ prediction for a steady-state accretion disc with a $T\propto r^{-3/4}$ temperature profile. The bluer spectral index of the observed quasar variations instead supports the model of Mummery & Balbus in which a steeper temperature profile, $T\propto r^{-7/8}$, develops as a result of finite magnetically-induced stress at the innermost stable circular orbit extracting energy and angular momentum from the black hole spin.


title: HOLISMOKES. VIII. High-redshift, strong-lens search in the Hyper Suprime-Cam Subaru Strategic Program

abstract: We carry out a search for strong-lens systems containing high-redshift lens galaxies with the goal of extending strong-lensing-assisted galaxy evolutionary studies to earlier cosmic time. Two strong-lens classifiers are constructed from a deep residual network and trained with datasets of different lens-redshift and brightness distributions. We classify a sample of 5,356,628 pre-selected objects from the Wide-layer fields in the second public data release of the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) by applying the two classifiers to their HSC $gri$-filter cutouts. Cutting off at thresholds that correspond to a false positive rate of $10^{-3}$ on our test set, the two classifiers identify 5,468 and 6,119 strong-lens candidates. Visually inspecting the cutouts of those candidates results in 735 grade-A or B strong-lens candidates in total, of which 277 candidates are discovered for the first time. This is the single largest set of galaxy-scale strong-lens candidates discovered with HSC data to date, and nearly half of it (331/735) contains lens galaxies with photometric redshifts above 0.6. Our discoveries will serve as a valuable target list for ongoing and scheduled spectroscopic surveys such as the Dark Energy Spectroscopic Instrument, the Subaru Prime Focus Spectrograph project, and the Maunakea Spectroscopic Explorer.


title: Compact objects formation, retention, and growth through accretion onto gas-embedded white-dwarfs/neutron-stars in gas-enriched globular-clusters

abstract: Observations of pulsars in globular clusters (GCs) give evidence that more >10-20% of neutron stars (NSs) ever formed in GCs were retained there. However, the velocity distribution of field pulsars peaks at 5-10 times the escape velocities of GCs. Consequently, only a small fraction of GC-NSs should have been retained, even accounting for low-velocity NSs formed through electron-capture supernovae. Thus, too few low-velocity NSs should have been retained in GCs, giving rise to the NS retention problem in GCs. Here we suggest a novel solution, in which the progenitors of most GC-NSs were ONe white-dwarfs (WDs) that accreted ambient intra-cluster gas and formed low-velocity NSs through accretion induced collapse (AIC). The existence of an early gas-enriched environment in GCs is supported by observations of GC multiple stellar populations. It is thought that 10s-100s of Myrs after the formation of the first generation of stars, and after ONe-WDs were already formed, GCs were replenished with gas which formed a second generation of stars. Accretion of such replenished gas onto the ONe-WDs catalyzed the AIC processes. The number of AIC-formed NSs is then sufficient to explain the large number of NSs retained in GCs. Similar processes might also drive CO-WDs to produce type-Ia SNe or to merge and form NSs, and similarly drive NSs to AIC and mergers producing BHs. Moreover, the wide variety of gas-catalyzed binary mergers and explosive transients suggest to occur in the gas-rich environments of AGN disk could similarly, and even more efficiently, occur in second-generation gas in GCs.


title: Born-Infeld (BI) for AI: Energy-Conserving Descent (ECD) for Optimization

abstract: We introduce a novel framework for optimization based on energy-conserving Hamiltonian dynamics in a strongly mixing (chaotic) regime and establish its key properties analytically and numerically. The prototype is a discretization of Born-Infeld dynamics, with a squared relativistic speed limit depending on the objective function. This class of frictionless, energy-conserving optimizers proceeds unobstructed until slowing naturally near the minimal loss, which dominates the phase space volume of the system. Building from studies of chaotic systems such as dynamical billiards, we formulate a specific algorithm with good performance on machine learning and PDE-solving tasks, including generalization. It cannot stop at a high local minimum, an advantage in non-convex loss functions, and proceeds faster than GD+momentum in shallow valleys.

categories: cs.LG astro-ph.CO hep-th math.OC stat.ML


title: Extremal Charged Black Holes and Superradiantly Unstable Quasinormal Modes

abstract: It was recently shown that the extremal charged black holes in STU supergravity suffer from superradiant instability owing to the existence of the unstable (low-frequency) quasibound states associated with a charged massive scalar field. In this paper, we show numerically that for some charge configurations, these black holes can also excite the (higher-frequency) superradiantly unstable quasinormal modes. We find empirically that the unstable modes are closely related to having a volcano-shaped effective potential in the Schr\"odinger-like wave equation.


title: Constraints on the X-ray Luminosity Function of AGN at z=5.7-6.4 with the Extragalactic Serendipitous Swift Survey

abstract: X-ray luminosity functions (XLFs) of Active Galactic Nuclei (AGN) trace the growth and evolution of supermassive black hole populations across cosmic time, however, current XLF models are poorly constrained at redshifts of z>6, with a lack of spectroscopic constraints at these high redshifts. In this work we \redit{place limits} on the bright-end of the XLF at z=5.7-6.4 using high-redshift AGN identified within the Extragalactic Serendipitous Swift Survey (ExSeSS) catalogue. Within ExSeSS we find one serendipitously X-ray detected z>6 AGN, ATLAS J025.6821-33.4627, with an X-ray luminosity of $L_\mathrm{X}=8.47^{+3.40}_{-3.13}\times10^{44}\mathrm{erg.s^{-1}}$ and $z=6.31\pm0.03$ making it the highest redshift, spectroscopically confirmed, serendipitously X-ray detected quasar known to date. We also calculate an upper limit on the space density at higher luminosities where no additional sources are found, enabling us to place constraints on the shape of the XLF. Our results are consistent with the rapid decline in the space densities of high-luminosity AGN toward high redshift as predicted by extrapolations of existing parametric models of the XLF. We also find that our X-ray based measurements are consistent with estimates of the bolometric quasar luminosity function based on UV measurements at $z\gtrsim6$, although they require a large X-ray to bolometric correction factor at these high luminosities.


title: Nonlinear quantum interferometric spectroscopy with entangled photon pairs

abstract: We develop closed expressions for a time-resolved photon counting signal induced by an entangled photon pair in an interferometric spectroscopy setup. Superoperator expressions in Liouville-space are derived that can account for relaxation and dephasing induced by coupling to a bath. Interferometric setups mix matter and light variables non-trivially, which complicates their interpretation. We provide an intuitive modular framework for this setup that simplifies its description. Based on separation between the detection stage and the light-matter interaction processes. We show that the pair entanglement time and the interferometric time-variables control the observed physics time-scale. Only a few processes contribute in the limiting case of small entanglement time with respect to the sample response, and specific contributions can be singled out.


title: Non-star-forming molecular gas in the Abell 1367 intra-cluster multiphase orphan cloud

abstract: We report the detection of CO emission in the recently discovered multiphase isolated gas cloud in the nearby galaxy cluster Abell 1367. The cloud is located about 800 kpc in projection from the center of the cluster and at a projected distance of > 80 kpc from any galaxy. It is the first and the only known isolated intra-cluster cloud detected in X-ray, H$\alpha$, and CO emission. We found a total of about $2.2\times 10^8 M_\odot$ of H$_2$ with the IRAM 30-m telescope in two regions, one associated with the peak of H$\alpha$ emission and another with the peak of X-ray emission surrounded by weak H$\alpha$ filaments. The velocity of the molecular gas is offset from the underlying H$\alpha$ emission by > 100 km s$^{-1}$ in the region where the X-ray peaks. The molecular gas may account for about 10% of the total cloud's mass, which is dominated by the hot X-ray component. The previously measured upper limit on the star formation rate in the cloud indicates that the molecular component is in a non-star-forming state, possibly due to a combination of low density of the gas and the observed level of velocity dispersion. The presence of the three gas phases associated with the cloud suggests that gas phase mixing with the surrounding intra-cluster medium is taking place. The possible origin of the orphan cloud is a late evolutionary stage of a ram pressure stripping event. In contrast, the nearby ram pressure stripped galaxy 2MASX J11443212+2006238 is in an early phase of stripping and we detected about $2.4\times 10^9 M_\odot$ of H$_2$ in its main body.


title: The Dark Energy Survey 5-year photometrically identified Type Ia Supernovae

abstract: As part of the cosmology analysis using Type Ia Supernovae (SN Ia) in the Dark Energy Survey (DES), we present photometrically identified SN Ia samples using multi-band light-curves and host galaxy redshifts. For this analysis, we use the photometric classification framework SuperNNova (SNN; M\"oller et al. 2019) trained on realistic DES-like simulations. For reliable classification, we process the DES SN programme (DES-SN) data and introduce improvements to the classifier architecture, obtaining classification accuracies of more than 98 per cent on simulations. This is the first SN classification to make use of ensemble methods, resulting in more robust samples. Using photometry, host galaxy redshifts, and a classification probability requirement, we identify 1,863 SNe Ia from which we select 1,484 cosmology-grade SNe Ia spanning the redshift range of 0.07 < z < 1.14. We find good agreement between the light-curve properties of the photometrically-selected sample and simulations. Additionally, we create similar SN Ia samples using two types of Bayesian Neural Network classifiers that provide uncertainties on the classification probabilities. We test the feasibility of using these uncertainties as indicators for out-of-distribution candidates and model confidence. Finally, we discuss the implications of photometric samples and classification methods for future surveys such as Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST).


title: Taming modeling uncertainties with Mass Unspecific Supervised Tagging

abstract: We address the modeling dependence of jet taggers built using the method of Mass Unspecific Supervised Tagging, by using two different parton showering and hadronisation schemes. We find that the modeling dependence of the results - estimated by using different schemes in the design of the taggers and applying them to the same type of data - is rather small, even if the jet substructure varies significantly between the two schemes. These results add great value to the use of generic supervised taggers for new physics searches.


title: Lineage of the Theory of Invariant Integrals on Groups: Hurwitz, Schur, Weyl, Haar, Neumann, Kakutani, Weil, Kakutani-Kodaira

abstract: This is mainly a translation of Proc. of the 29th Symp. on History of Mathematics, Tsuda University, held Oct. 2018, of my talk. The first occasion when I studied the history of the theory of invariant integrals (or measures) was an unintended opportunity where I was asked to write "Kaisetsu" (explanatory and commentary article) to the new book of Prof. M. Saito, a first translation into Japanese of the famous Weil's book "L'int\'egrations dans les groupes topologiques et...". Personally, for my professional work, it was needed only to read this Weil's original book and several text books on measure theory. For writing the Kaisetsu mentioned above, other than several mathematical papers and also Weil's non-mathematical works, it was sufficient for me to read Haar's original paper roughly and similarly for other historical classics. Thus I felt the necessity of further study and now I make intendedly a historical study. Reading original papers due to Hurwitz, Schur, Weyl and so on in detail, I explain their contents from my point of view, and give the relationships among them. I make intendedly a historical study. Reading original papers due to Hurwitz, Schur, Weyl and so on in detail, I explain their contents from my point of view, and give the relationships among them.


title: On Goldfeld's Proof of Siegel's Theorem

abstract: In this paper, we give a detailed account of Goldfeld's proof of Siegel's theorem. Particularly, we present complete proofs of the nontrivial assumptions made in his paper.


title: Machine-learning of nonlocal kernels for anomalous subsurface transport from breakthrough curves

abstract: Anomalous behavior is ubiquitous in subsurface solute transport due to the presence of high degrees of heterogeneity at different scales in the media. Although fractional models have been extensively used to describe the anomalous transport in various subsurface applications, their application is hindered by computational challenges. Simpler nonlocal models characterized by integrable kernels and finite interaction length represent a computationally feasible alternative to fractional models; yet, the informed choice of their kernel functions still remains an open problem. We propose a general data-driven framework for the discovery of optimal kernels on the basis of very small and sparse data sets in the context of anomalous subsurface transport. Using spatially sparse breakthrough curves recovered from fine-scale particle-density simulations, we learn the best coarse-scale nonlocal model using a nonlocal operator regression technique. Predictions of the breakthrough curves obtained using the optimal nonlocal model show good agreement with fine-scale simulation results even at locations and time intervals different from the ones used to train the kernel, confirming the excellent generalization properties of the proposed algorithm. A comparison with trained classical models and with black-box deep neural networks confirms the superiority of the predictive capability of the proposed model.


title: OntoProtein: Protein Pretraining With Gene Ontology Embedding

abstract: Self-supervised protein language models have proved their effectiveness in learning the proteins representations. With the increasing computational power, current protein language models pre-trained with millions of diverse sequences can advance the parameter scale from million-level to billion-level and achieve remarkable improvement. However, those prevailing approaches rarely consider incorporating knowledge graphs (KGs), which can provide rich structured knowledge facts for better protein representations. We argue that informative biology knowledge in KGs can enhance protein representation with external knowledge. In this work, we propose OntoProtein, the first general framework that makes use of structure in GO (Gene Ontology) into protein pre-training models. We construct a novel large-scale knowledge graph that consists of GO and its related proteins, and gene annotation texts or protein sequences describe all nodes in the graph. We propose novel contrastive learning with knowledge-aware negative sampling to jointly optimize the knowledge graph and protein embedding during pre-training. Experimental results show that OntoProtein can surpass state-of-the-art methods with pre-trained protein language models in TAPE benchmark and yield better performance compared with baselines in protein-protein interaction and protein function prediction. Code and datasets are available in https://github.com/zjunlp/OntoProtein.


title: Autonomous Cyber Defense Introduces Risk: Can We Manage the Risk?

abstract: From denial-of-service attacks to spreading of ransomware or other malware across an organization's network, it is possible that manually operated defenses are not able to respond in real time at the scale required, and when a breach is detected and remediated the damage is already made. Autonomous cyber defenses therefore become essential to mitigate the risk of successful attacks and their damage, especially when the response time, effort and accuracy required in those defenses is impractical or impossible through defenses operated exclusively by humans. Autonomous agents have the potential to use ML with large amounts of data about known cyberattacks as input, in order to learn patterns and predict characteristics of future attacks. Moreover, learning from past and present attacks enable defenses to adapt to new threats that share characteristics with previous attacks. On the other hand, autonomous cyber defenses introduce risks of unintended harm. Actions arising from autonomous defense agents may have harmful consequences of functional, safety, security, ethical, or moral nature. Here we focus on machine learning training, algorithmic feedback, and algorithmic constraints, with the aim of motivating a discussion on achieving trust in autonomous cyber defenses.


title: DoF of a Cooperative X-Channel with an Application to Distributed Computing

abstract: We consider a cooperative X-channel with $\sf K$ transmitters (TXs) and $\sf K$ receivers (Rxs) where Txs and Rxs are gathered into groups of size $\sf r$ respectively. Txs belonging to the same group cooperate to jointly transmit a message to each of the $\sf K- \sf r$ Rxs in all other groups, and each Rx individually decodes all its intended messages. By introducing a new interference alignment (IA) scheme, we prove that when $\sf K/\sf r$ is an integer the sum Degrees of Freedom (SDoF) of this channel is lower bounded by $2\sf r$ if $\sf K/\sf r \in \{2,3\}$ and by $\frac{\sf K(\sf K-\sf r)-\sf r^2}{2\sf K-3\sf r}$ if $\sf K/\sf r \geq 4$. We also prove that the SDoF is upper bounded by $\frac{\sf K(\sf K-\sf r)}{2\sf K-3\sf r}$. The proposed IA scheme finds application in a wireless distributed MapReduce framework, where it improves the normalized data delivery time (NDT) compared to the state of the art.


title: Adversarial Torn-paper Codes

abstract: We study the adversarial torn-paper channel. This problem is motivated by applications in DNA data storage where the DNA strands that carry information may break into smaller pieces which are received out of order. Our model extends the previously researched probabilistic setting to the worst-case. We develop code constructions for any parameters of the channel for which non-vanishing asymptotic rate is possible and show our constructions achieve asymptotically optimal rate while allowing for efficient encoding and decoding. Finally, we extend our results to related settings included multi-strand storage, presence of substitution errors, or incomplete coverage.


title: The t-Graphs Over Finitely-Generated Groups and the Minkowski Metric

abstract: In this paper, we introduce the t-graphs defined on finitely-generate groups. We study some general aspects of the t-graphs on 2-generator groups, emphasising establishing necessary conditions for their connectedness. In particular, we investigate the properties of t-graphs defined on finite dihedral groups.


title: Cyber Resilience: by Design or by Intervention?

abstract: The term "cyber resilience by design" is growing in popularity. Here, by cyber resilience we refer to the ability of the system to resist, minimize and mitigate a degradation caused by a successful cyber-attack on a system or network of computing and communicating devices. Some use the term "by design" when arguing that systems must be designed and implemented in a provable mission assurance fashion, with the system's intrinsic properties ensuring that a cyber-adversary is unable to cause a meaningful degradation. Others recommend that a system should include a built-in autonomous intelligent agent responsible for thinking and acting towards continuous observation, detection, minimization and remediation of a cyber degradation. In all cases, the qualifier "by design" indicates that the source of resilience is somehow inherent in the structure and operation of the system. But what, then, is the other resilience, not by design? Clearly, there has to be another type of resilience, otherwise what's the purpose of the qualifier "by design"? Indeed, while mentioned less frequently, there exists an alternative form of resilience called "resilience by intervention." In this article we explore differences and mutual reliance of resilience by design and resilience by intervention.


title: Addressing Issues of Cross-Linguality in Open-Retrieval Question Answering Systems For Emergent Domains

abstract: Open-retrieval question answering systems are generally trained and tested on large datasets in well-established domains. However, low-resource settings such as new and emerging domains would especially benefit from reliable question answering systems. Furthermore, multilingual and cross-lingual resources in emergent domains are scarce, leading to few or no such systems. In this paper, we demonstrate a cross-lingual open-retrieval question answering system for the emergent domain of COVID-19. Our system adopts a corpus of scientific articles to ensure that retrieved documents are reliable. To address the scarcity of cross-lingual training data in emergent domains, we present a method utilizing automatic translation, alignment, and filtering to produce English-to-all datasets. We show that a deep semantic retriever greatly benefits from training on our English-to-all data and significantly outperforms a BM25 baseline in the cross-lingual setting. We illustrate the capabilities of our system with examples and release all code necessary to train and deploy such a system.


title: Sketching for low-rank nonnegative matrix approximation: Numerical study

abstract: We propose new approximate alternating projection methods, based on randomized sketching, for the low-rank nonnegative matrix approximation problem: find a low-rank approximation of a nonnegative matrix that is nonnegative, but whose factors can be arbitrary. We calculate the computational complexities of the proposed methods and evaluate their performance in numerical experiments. The comparison with the known deterministic alternating projection methods shows that the randomized approaches are faster and exhibit similar convergence properties.


title: Explainable Patterns for Distinction and Prediction of Moral Judgement on Reddit

abstract: The forum r/AmITheAsshole in Reddit hosts discussion on moral issues based on concrete narratives presented by users. Existing analysis of the forum focuses on its comments, and does not make the underlying data publicly available. In this paper we build a new dataset of comments and also investigate the classification of the posts in the forum. Further, we identify textual patterns associated with the provocation of moral judgement by posts, with the expression of moral stance in comments, and with the decisions of trained classifiers of posts and comments.


title: Bootstrap inference for fixed-effect models

abstract: The maximum-likelihood estimator of nonlinear panel data models with fixed effects is consistent but asymptotically-biased under rectangular-array asymptotics. The literature has thus far concentrated its effort on devising methods to correct the maximum-likelihood estimator for its bias as a means to salvage standard inferential procedures. Instead, we show that the parametric bootstrap replicates the distribution of the (uncorrected) maximum-likelihood estimator in large samples. This justifies the use of confidence sets constructed via standard bootstrap percentile methods. No adjustment for the presence of bias needs to be made.


title: Policy Optimization over Submanifolds for Linearly Constrained Feedback Synthesis

abstract: In this paper, we study linearly constrained policy optimization over the manifold of Schur stabilizing controllers, equipped with a Riemannian metric that emerges naturally in the context of optimal control problems. We provide extrinsic analysis of a generic constrained smooth cost function, that subsequently facilitates subsuming any such constrained problem into this framework. By studying the second order geometry of this manifold, we provide a Newton-type algorithm that does not rely on the exponential mapping nor a retraction, while ensuring local convergence guarantees. The algorithm hinges instead upon the developed stability certificate and the linear structure of the constraints. We then apply our methodology to two well-known constrained optimal control problems. Finally, several numerical examples showcase the performance of the proposed algorithm.


title: Stability of the two-dimensional point vortices in Euler flows

abstract: We consider the two-dimensional incompressible Euler equation \[\begin{cases} \partial_t \omega + u\cdot \nabla \omega=0 \\ \omega(0,x)=\omega_0(x). \end{cases}\] We are interested in the cases when the initial vorticity has the form $\omega_0=\omega_{0,\epsilon}+\omega_{0p,\epsilon}$, where $\omega_{0,\epsilon}$ is concentrated near $M$ disjoint points $p_m^0$ and $\omega_{0p,\epsilon}$ is a small perturbation term. First, we prove that for such initial vorticities, the solution $\omega(x,t)$ admits a decomposition $\omega(x,t)=\omega_{\epsilon}(x,t)+\omega_{p,\epsilon}(x,t)$, where $\omega_{\epsilon}(x,t)$ remains concentrated near $M$ points $p_m(t)$ and $\omega_{p,\epsilon}(x,t)$ remains small for $t \in [0,T]$. Second, we give a quantitative description when the initial vorticity has the form $\omega_0(x)=\sum_{m=1}^M \frac{\gamma_m}{\epsilon^2}\eta(\frac{x-p_m^0}{\epsilon})$, where we do not assume $\eta$ to have compact support. Finally, we prove that if $p_m(t)$ remains separated for all $t\in[0,+\infty)$, then $\omega(x,t)$ remains concentrated near $M$ points at least for $t \le c_0 |\log A_{\epsilon}|$, where $A_{\epsilon}$ is small and converges to $0$ as $\epsilon \to 0$.


title: Computer Investigation of Properties of the Gergonne Point of a Triangle

abstract: The incircle of a triangle touches the sides of the triangle in three points. It is well known that the lines from these points to the opposite vertices meet at a point known as the Gergonne point of the triangle. We use a computer to discover and catalog properties of the Gergonne point.


title: Muography in Colombia: simulation framework, instrumentation and data analysis

abstract: We present the Colombo-Argentinian Muography Program for studying inland Latin-American volcanoes. It describes the implementation of a simulation framework covering various factors with different spatial and time scales: the geomagnetic effects at a particular geographic point, the development of extensive air showers in the atmosphere, the propagation through the scanned structure and the detector response. Next, we sketch the criteria adopted for designing, building, and commissioning MuTe: a hybrid Muon Telescope based on a composite detection technique. It combines a hodoscope for particle tracking and a water Cherenkov detector to enhance the muon-to-background-signal separation due to extensive air showers' soft and multiple-particle components. MuTe also discriminates inverse-trajectory and low-momentum muons by using a picosecond Time-of-Flight system. We also characterise the instrument's structural (mechanical and thermal) behaviour, discussing preliminary results from the background composition and the telescope-health monitoring variables. Finally, we discuss the implementations of an optimisation algorithm to improve the volcano internal density distribution estimation and machine learning techniques for background rejection.


title: Co-substituted BiFeO3: electronic, ferroelectric, and thermodynamic properties from first principles

abstract: Bismuth ferrite, BiFeO3, is a multiferroic solid that is attracting increasing attention as a potential photocatalytic material, because the ferroelectric polarisation enhances the separation of photogenerated carriers. With the motivation of finding routes to engineer the band gap and the band alignment, while conserving or enhancing the ferroelectric properties, we have investigated the thermodynamic, electronic and ferroelectric properties of BiCoxFe1 xO3 solid solutions, with 0 < x < 0.13, using density functional theory. We show that the band gap can be reduced from 2.9 eV to 2.1 eV by cobalt substitution, while simultaneously increasing the spontaneous polarisation, which is associated with a notably larger Born effective charge of Co compared to Fe cations. We discuss the interaction between Co impurities, which is strongly attractive and would drive the aggregation of Co, as evidenced by Monte Carlo simulations. Phase separation into a Co-rich phase is therefore predicted to be thermodynamically preferred, and the homogeneous solid solution can only exist in metastable form, protected by slow cation diffusion kinetics. Finally, we discuss the band alignment of pure and Co-substituted BiFeO3 with relevant redox potentials, in the context of its applicability in photocatalysis.


title: Self-Certifying Classification by Linearized Deep Assignment

abstract: We propose a novel class of deep stochastic predictors for classifying metric data on graphs within the PAC-Bayes risk certification paradigm. Classifiers are realized as linearly parametrized deep assignment flows with random initial conditions. Building on the recent PAC-Bayes literature and data-dependent priors, this approach enables (i) to use risk bounds as training objectives for learning posterior distributions on the hypothesis space and (ii) to compute tight out-of-sample risk certificates of randomized classifiers more efficiently than related work. Comparison with empirical test set errors illustrates the performance and practicality of this self-certifying classification method.


title: Sequential Bayesian Inference for Factor Analysis

abstract: We develop an efficient Bayesian sequential inference framework for factor analysis models observed via various data types, such as continuous, binary and ordinal data. In the continuous data case, where it is possible to marginalise over the latent factors, the proposed methodology tailors the Iterated Batch Importance Sampling (IBIS) of Chopin (2002) to handle such models and we incorporate Hamiltonian Markov Chain Monte Carlo. For binary and ordinal data, we develop an efficient IBIS scheme to handle the parameter and latent factors, combining with Laplace or Variational Bayes approximations. The methodology can be used in the context of sequential hypothesis testing via Bayes factors, which are known to have advantages over traditional null hypothesis testing. Moreover, the developed sequential framework offers multiple benefits even in non-sequential cases, by providing posterior distribution, model evidence and scoring rules (under the prequential framework) in one go, and by offering a more robust alternative computational scheme to Markov Chain Monte Carlo that can be useful in problematic target distributions.


title: Focal cortical dysplasia as a cause of epilepsy: the current evidence of associated genes and future therapeutic treatments

abstract: Focal cortical dysplasias (FCDs) are the most common cause of treatment resistant epilepsy affecting the pediatric population. Most individuals with FCD have seizure onset during the first five years of life and the majority will have seizures by the age of sixteen. Many cases of FCD are postulated to be the result of abnormal brain development in utero by germline or somatic gene mutations regulating neuronal growth and migration during corticogenesis. Other cases of FCD are thought to be related to infections during brain development, or even other causes still unable to be fully determined. Typical anti-seizure medications are oftentimes ineffective in FCD as well as surgery is unable to be successfully performed due to the involvement of eloquent areas of the brain or insufficient resection of the epileptogenic focus, posing a challenge for physicians. The genetic nature of FCD provides an avenue for drug development with several genetic and molecular targets undergoing study over the last two decades.


title: First-Order Context-Specific Likelihood Weighting in Hybrid Probabilistic Logic Programs

abstract: Statistical relational AI and probabilistic logic programming have so far mostly focused on discrete probabilistic models. The reasons for this is that one needs to provide constructs to succinctly model the independencies in such models, and also provide efficient inference. Three types of independencies are important to represent and exploit for scalable inference in hybrid models: conditional independencies elegantly modeled in Bayesian networks, context-specific independencies naturally represented by logical rules, and independencies amongst attributes of related objects in relational models succinctly expressed by combining rules. This paper introduces a hybrid probabilistic logic programming language, DC#, which integrates distributional clauses' syntax and semantics principles of Bayesian logic programs. It represents the three types of independencies qualitatively. More importantly, we also introduce the scalable inference algorithm FO-CS-LW for DC#. FO-CS-LW is a first-order extension of the context-specific likelihood weighting algorithm (CS-LW), a novel sampling method that exploits conditional independencies and context-specific independencies in ground models. The FO-CS-LW algorithm upgrades CS-LW with unification and combining rules to the first-order case.


title: Analyzing Ta-Shma's Code via the Expander Mixing Lemma

abstract: Random walks in expander graphs and their various derandomizations (e.g., replacement/zigzag product) are invaluable tools from pseudorandomness. Recently, Ta-Shma used s-wide replacement walks in his breakthrough construction of a binary linear code almost matching the Gilbert-Varshamov bound (STOC 2017). Ta-Shma's original analysis was entirely linear algebraic, and subsequent developments have inherited this viewpoint. In this work, we rederive Ta-Shma's analysis from a combinatorial point of view using repeated application of the expander mixing lemma. We hope that this alternate perspective will yield a better understanding of Ta-Shma's construction. As an additional application of our techniques, we give an alternate proof of the expander hitting set lemma.


title: Artificial Emotional Intelligence in Socially Assistive Robots for Older Adults: A Pilot Study

abstract: This paper presents our recent research on integrating artificial emotional intelligence in a social robot (Ryan) and studies the robot's effectiveness in engaging older adults. Ryan is a socially assistive robot designed to provide companionship for older adults with depression and dementia through conversation. We used two versions of Ryan for our study, empathic and non-empathic. The empathic Ryan utilizes a multimodal emotion recognition algorithm and a multimodal emotion expression system. Using different input modalities for emotion, i.e. facial expression and speech sentiment, the empathic Ryan detects users' emotional state and utilizes an affective dialogue manager to generate a response. On the other hand, the non-empathic Ryan lacks facial expression and uses scripted dialogues that do not factor in the users' emotional state. We studied these two versions of Ryan with 10 older adults living in a senior care facility. The statistically significant improvement in the users' reported face-scale mood measurement indicates an overall positive effect from the interaction with both the empathic and non-empathic versions of Ryan. However, the number of spoken words measurement and the exit survey analysis suggest that the users perceive the empathic Ryan as more engaging and likable.