title: Accuracy Prediction with Non-neural Model for Neural Architecture Search

abstract: Neural architecture search (NAS) with an accuracy predictor that predicts the accuracy of candidate architectures has drawn increasing attention due to its simplicity and effectiveness. Previous works usually employ neural network-based predictors which require more delicate design and are easy to overfit. Considering that most architectures are represented as sequences of discrete symbols which are more like tabular data and preferred by non-neural predictors, in this paper, we study an alternative approach which uses non-neural model for accuracy prediction. Specifically, as decision tree based models can better handle tabular data, we leverage gradient boosting decision tree (GBDT) as the predictor for NAS. We demonstrate that the GBDT predictor can achieve comparable (if not better) prediction accuracy than neural network based predictors. Moreover, considering that a compact search space can ease the search process, we propose to prune the search space gradually according to important features derived from GBDT. In this way, NAS can be performed by first pruning the search space and then searching a neural architecture, which is more efficient and effective. Experiments on NASBench-101 and ImageNet demonstrate the effectiveness of using GBDT as predictor for NAS: (1) On NASBench-101, it is 22x, 8x, and 6x more sample efficient than random search, regularized evolution, and Monte Carlo Tree Search (MCTS) in finding the global optimum; (2) It achieves 24.2% top-1 error rate on ImageNet, and further achieves 23.4% top-1 error rate on ImageNet when enhanced with search space pruning. Code is provided at https://github.com/renqianluo/GBDT-NAS.


title: Microglitches in radio pulsars: the role of strange nuggets

abstract: Strange Nuggets are believed to be among the relics of the early universe. They appear as dark matter due to their low charge-to-mass ratio. Their distribution is believed to be the same as that of dark matter. As such, they could be accreted by high magnetic field objects and their collisions with pulsars are inevitable. Pulsar glitches are commonly seen as sudden spin-ups in pulsar frequency. It is still an open debate with regard to mechanisms giving rise to such a phenomenon. However, there is a class of sudden changes in pulsar spin frequency known as microglitches. These event are characterized by sudden small change in pulsar spin frequency ($ \delta \nu/\nu \approx \pm 10^{-9}$). Clearly, the negative signature seen in some of the events is inconsistent with the known glitch mechanisms. In this analysis, we suggest that accretion of strange nuggets with pulsars could readily give rise to microglitch events. The signature of the events depends on the energy of the strange nuggets and line of interaction.


title: A Novel Heap-based Pilot Assignment for Full Duplex Cell-Free Massive MIMO with Zero-Forcing

abstract: This paper investigates the combined benefits of full-duplex (FD) and cell-free massive multiple-input multipleoutput (CF-mMIMO), where a large number of distributed access points (APs) having FD capability simultaneously serve numerous uplink and downlink user equipments (UEs) on the same time-frequency resources. To enable the incorporation of FD technology in CF-mMIMO systems, we propose a novel heapbased pilot assignment algorithm, which not only can mitigate the effects of pilot contamination but also reduce the involved computational complexity. Then, we formulate a robust design problem for spectral efficiency (SE) maximization in which the power control and AP-UE association are jointly optimized, resulting in a difficult mixed-integer nonconvex programming. To solve this problem, we derive a more tractable problem before developing a very simple iterative algorithm based on inner approximation method with polynomial computational complexity. Numerical results show that our proposed methods with realistic parameters significantly outperform the existing approaches in terms of the quality of channel estimate and SE.


title: Idempotent completion of extriangulated categories

abstract: Extriangulated categories were introduced by Nakaoka and Palu as a simultaneous generalization of exact categories and triangulated categories. In this paper, we show that the idempotent completion of an extriangulated category admits a natural extriangulated structure. As applications, we prove that cotorsion pairs in an extriangulated category induce cotorsion pairs in its idempotent completion under certain condition, and the idempotent completion of a recollement of extriangulated categories is still a recollement.


title: Interacting jammed granular systems

abstract: More than 30 years ago Edwards and co-authors proposed a model to describe the statistics of granular packings by an ensemble of equiprobable jammed states. Experimental tests of this model remained scarce so far. We introduce a simple system to analyze statistical properties of jammed granular ensembles to test Edwards theory. Identical spheres packed in a nearly two-dimensional geometrical confinement were studied in experiments and numerical simulations. When tapped, the system evolves towards a ground state, but due to incompatible domain structures it gets trapped. Analytical calculations reproduce relatively well our simulation results, which allows us to test Edwards theory on a coupled system of two subsystems with different properties. We find that the joint system can only be described by the Edwards theory if considered as a single system due to the constraints in the stresses. The results show counterintuitive effects as in the coupled system the change in the order parameter is opposite to what is expected from the change in the compactivity.


title: MO-PaDGAN: Generating Diverse Designs with Multivariate Performance Enhancement

abstract: Deep generative models have proven useful for automatic design synthesis and design space exploration. However, they face three challenges when applied to engineering design: 1) generated designs lack diversity, 2) it is difficult to explicitly improve all the performance measures of generated designs, and 3) existing models generally do not generate high-performance novel designs, outside the domain of the training data. To address these challenges, we propose MO-PaDGAN, which contains a new Determinantal Point Processes based loss function for probabilistic modeling of diversity and performances. Through a real-world airfoil design example, we demonstrate that MO-PaDGAN expands the existing boundary of the design space towards high-performance regions and generates new designs with high diversity and performances exceeding training data.


title: varTestnlme: an R package for Variance Components Testing in Linear and Nonlinear Mixed-effects Models

abstract: The issue of variance components testing arises naturally when building mixed-effects models, to decide which effects should be modeled as fixed or random. While tests for fixed effects are available in R for models fitted with lme4, tools are missing when it comes to random effects. The varTestnlme package for R aims at filling this gap. It allows to test whether any subset of the variances and covariances corresponding to any subset of the random effects, are equal to zero using asymptotic property of the likelihood ratio test statistic. It also offers the possibility to test simultaneously for fixed effects and variance components. It can be used for linear, generalized linear or nonlinear mixed-effects models fitted via lme4, nlme or saemix. Theoretical properties of the used likelihood ratio test are recalled, numerical methods used to implement the test procedure are detailed and examples based on different real datasets using different mixed models are provided.


title: Targeting the Benchmark: On Methodology in Current Natural Language Processing Research

abstract: It has become a common pattern in our field: One group introduces a language task, exemplified by a dataset, which they argue is challenging enough to serve as a benchmark. They also provide a baseline model for it, which then soon is improved upon by other groups. Often, research efforts then move on, and the pattern repeats itself. What is typically left implicit is the argumentation for why this constitutes progress, and progress towards what. In this paper, we try to step back for a moment from this pattern and work out possible argumentations and their parts.


title: Statistical Shape Analysis of Brain Arterial Networks (BAN)

abstract: Structures of brain arterial networks (BANs) - that are complex arrangements of individual arteries, their branching patterns, and inter-connectivities - play an important role in characterizing and understanding brain physiology. One would like tools for statistically analyzing the shapes of BANs, i.e. quantify shape differences, compare population of subjects, and study the effects of covariates on these shapes. This paper mathematically represents and statistically analyzes BAN shapes as elastic shape graphs. Each elastic shape graph is made up of nodes that are connected by a number of 3D curves, and edges, with arbitrary shapes. We develop a mathematical representation, a Riemannian metric and other geometrical tools, such as computations of geodesics, means and covariances, and PCA for analyzing elastic graphs and BANs. This analysis is applied to BANs after separating them into four components -- top, bottom, left, and right. This framework is then used to generate shape summaries of BANs from 92 subjects, and to study the effects of age and gender on shapes of BAN components. We conclude that while gender effects require further investigation, the age has a clear, quantifiable effect on BAN shapes. Specifically, we find an increased variance in BAN shapes as age increases.


title: On the bimodal nature of the distributions of pulsar glitch sizes

abstract: Pulsar glitches are sudden spin-ups in pulsar spin frequency ($\nu$). The glitch size, $\Delta\nu/\nu$, is a key parameter in any mechanism puts across towards the understanding of the events.However, the distribution of the glitch sizes has persistently been bimodal.This bimodal nature could be intrinsic or otherwise. In this paper, the glitch size distribution is bisected at $\Delta\nu/\nu = 10^{-7}$ with $\Delta\nu/\nu < 10^{-7}$ being regarded as small size glitches (SSG), while those of $\Delta\nu/\nu > 10^{-7}$ are taken as large size glitches (LSG).The magnitude of SSGis scaled to that of LSG and tested for similarity.In pulsars with mixture of glitch sizes, Lilliefore test is used to identify the distribution pattern of SSGs and LSGs in such pulsars. The result indicates that each half of the size distribution is fundamentally different from one another. LSGs are seen to be normally distributed, while the SSGs are lognormal.


title: Monitoring morphological and chemical properties during silver solid-state dewetting

abstract: Solid-state dewetting phenomenon in silver thin films offers a straightforward method to obtain structures having controlled shape or size -this latter in principle spanning several orders of magnitudes -- with potentially strong interest in many applications involving high-tech industry and biomedicine. In this work nanostructured silver is deposited by pulsed electron ablation technique and its surface modified upon thermal treatments in air at increasing temperatures. Surface chemistry and morphology are then monitored simultaneously by X-ray photoemission spectroscopy and atomic force microscopy; in particular, the power spectral density of surface heights is used to analyze the alteration of morphology induced by annealing. It is shown that this approach adds a level of information about the dewetting process since it allows to separate between long- and short-range surface behavior and to retrieve statistical quantities relevant to a description of the features in view of applications. Our results are presented in the framework of a multidisciplinary approach, advantages and limits of which are deepened and discussed.


title: Training of Deep Learning Neuro-Skin Neural Network

abstract: In this brief paper, a learning algorithm is developed for Deep Learning Neuro-Skin Neural Network to improve their learning properties. Neuroskin is a new type of neural network presented recently by the authors. It is comprised of a cellular membrane which has a neuron attached to each cell. The neuron is the cells nucleus. A neuroskin is modelled using finite elements. Each element of the finite element represents a cell. Each cells neuron has dendritic fibers which connects it to the nodes of the cell. On the other hand, its axon is connected to the nodes of a number of different neurons. The neuroskin is trained to contract upon receiving an input. The learning takes place during updating iterations using sensitivity analysis. It is shown that while the neuroskin can not present the desirable response, it improves gradually to the desired level.


title: Particle acceleration in neutron star ultra-strong electromagnetic fields

abstract: In this paper, we discuss the results of a new particle pusher in realistic ultra-strong electromagnetic fields as those encountered around rotating neutron stars. After presenting results of this algorithm in simple fields and comparing them to expected exact analytical solutions, we present new simulations for a rotating magnetic dipole in vacuum for a millisecond pulsar by using Deutsch solution. Particles are injected within the magnetosphere, neglecting radiation reaction, interaction among them and their feedback on the fields. Our simulations are therefore not yet fully self-consistent because Maxwell equations are not solved according to the current produced by these particles. The code highlights the symmetrical behaviour of particles of opposite charge to mass ratio $q/m$ with respect to the north and south hemispheres. The relativistic Lorentz factor of the accelerated particles is proportional to this ratio $q/m$: protons reach up to $\gamma_p \simeq 10^{10.7}$, whereas electrons reach up to $\gamma_e \simeq 10^{14}$. Our simulations show that particles could be either captured by the neutron star, trapped around it, or ejected far from it, well outside the light-cylinder. Actually, for a given charge to mass ratio, particles follow similar trajectories. These particle orbits show some depleted directions, especially at high magnetic inclination with respect to the rotation axis for positive charges and at low inclination for negative charges because of symmetry. Other directions are preferred and loaded with a high density of particles, some directions concentrating the highest or lowest acceleration efficiencies.


title: Growth, Properties, and Applications of Pulsed Laser Deposited Nanolaminate Ti3AlC2 Thin Films

abstract: Recently, nanolaminated ternary carbides have attracted immense interest due to the concomitant presence of both ceramic and metallic properties. Here, we grow nanolaminate Ti3AlC2 thin films by pulsed laser deposition on c-axis-oriented sapphire substrates and, surprisingly, the films are found to be highly oriented along the (103) axis normal to the film plane, rather than the (000l) orientation. Multiple characterization techniques are employed to explore the structural and chemical quality of these films, the electrical and optical properties, and the device functionalities. The 80-nm thick Ti3AlC2 film is highly conducting at room temperature (resistivity of 50 micro ohm-cm), and a very-low-temperature coefficient of resistivity. The ultrathin (2 nm) Ti3AlC2 film has fairly good optical transparency and high conductivity at room temperature (sheet resistance of 735 ohm). Scanning tunneling microscopy reveals the metallic characteristics (with finite density of states at the Fermi level) at room temperature. The metal-semiconductor junction of the p-type Ti3AlC2 film and n-Si show the expected rectification (diode) characteristics, in contrast to the ohmic contact behavior in the case of Ti3AlC2 on p-Si. A triboelectric-nanogenerator-based touch-sensing device, comprising of the Ti3AlC2 film, shows a very impressive peak-to-peak open-circuit output voltage of 80 V. These observations reveal that pulsed laser deposited Ti3AlC2 thin films have excellent potential for applications in multiple domains, such as bottom electrodes, resistors for high-precision measurements, Schottky diodes, ohmic contacts, fairly transparent ultrathin conductors, and next-generation biomechanical touch sensors for energy harvesting.


title: Dissimilarity functions for rank-invariant hierarchical clustering of continuous variables

abstract: A theoretical framework is presented for a (copula-based) notion of dissimilarity between continuous random vectors and its main properties are studied. The proposed dissimilarity assigns the smallest value to a pair of random vectors that are comonotonic. Various properties of this dissimilarity are studied, with special attention to those that are prone to the hierarchical agglomerative methods, such as reducibility. Some insights are provided for the use of such a measure in clustering algorithms and a simulation study is presented. Real case studies illustrate the main features of the whole methodology.


title: A Bandit Model for Human-Machine Decision Making with Private Information and Opacity

abstract: Applications of machine learning inform human decision makers in a broad range of tasks. The resulting problem is usually formulated in terms of a single decision maker. We argue that it should rather be described as a two-player learning problem where one player is the machine and the other the human. While both players try to optimize the final decision, the setup is often characterized by (1) the presence of private information and (2) opacity, that is imperfect understanding between the decision makers. We prove that both properties can complicate decision making considerably. A lower bound quantifies the worst-case hardness of optimally advising a decision maker who is opaque or has access to private information. An upper bound shows that a simple coordination strategy is nearly minimax optimal. More efficient learning is possible under certain assumptions on the problem, for example that both players learn to take actions independently. Such assumptions are implicit in existing literature, for example in medical applications of machine learning, but have not been described or justified theoretically.


title: A linear seesaw model with $A_4$-modular flavor and local $U(1)_{B-L}$ symmetries

abstract: We discuss a linear seesaw model with local $U(1)_{B-L}$ and modular $A_4$ symmetries. The neutrino mass matrix for linear seesaw mechanism is realized by $U(1)_{B-L}$ charge assignment and the nature of modular $A_4$ symmetry. We formulate neutrino mass and carry our numerical analysis showing some predictions for observables in neutrino sector. Remarkably, the case of inverted neutrino mass ordering (IO) is realized by a specific region around $\tau=\omega=e^{2\pi i/3}$, which is favored by a string theory. Thus, our prediction would be very strong in case of IO.


title: Bending of Spaghetti Beams and Columns Exposed to Hot Steam Reveals Several Physical Properties of the Spaghetti

abstract: In this paper, we show that bending of spaghetti beams and columns exposed to hot steam reveals the time evolution of young modulus, the diffusion coefficient of water molecules penetrating the spaghetti, the partial Fickian behavior of water diffusion, and a logistic-like evolution of column bending angle. The bending geometries were timely recorded and the Young moduli were obtained by processing the images. We applied two equations proposed by us previously, one equation was applied for beam bending and the other for column bending, to estimate the Young moduli. The experiment was conducted by exposing the freely-hung cantilever spaghetti beams and columns using hot steam from boiling water so that the images were recorded in realtime while the beam or column bent undisturbedly. Surprisingly, the estimated diffusion coefficient of water molecules matched well the experimental data reported by others. This method may become an alternative for estimating the diffusion coefficient of vapor molecules penetrating the materials.


title: A Global Stochastic Optimization Particle Filter Algorithm

abstract: We introduce a new online algorithm for expected log-likelihood maximization in situations where the objective function is multi-modal and/or has saddle points, that we term G-PFSO. The key element underpinning G-PFSO is a probability distribution which (a) is shown to concentrate on the target parameter value as the sample size increases and (b) can be efficiently estimated by means of a standard particle filter algorithm. This distribution depends on a learning rate, where the faster the learning rate the quicker it concentrates on the desired element of the search space, but the less likely G-PFSO is to escape from a local optimum of the objective function. In order to achieve a fast convergence rate with a slow learning rate, G-PFSO exploits the acceleration property of averaging, well-known in the stochastic gradient literature. Considering several challenging estimation problems, the numerical experiments show that, with high probability, G-PFSO successfully finds the highest mode of the objective function and converges to its global maximizer at the optimal rate. While the focus of this work is expected log-likelihood maximization, the proposed methodology and its theory apply more generally for optimizing a function defined through an expectation.


title: Further results on $\mathbb{A}$-numerical radius inequalities

abstract: Let $A$ be a bounded linear positive operator on a complex Hilbert space $\mathcal{H}.$ Further, let $\mathcal{B}_A\mathcal{(H)}$ denote the set of all bounded linear operators on $\mathcal{H}$ whose $A$-adjoint exists, and $\mathbb{A}$ signify a diagonal operator matrix with diagonal entries are $A.$ Very recently, several $A$-numerical radius inequalities of $2\times 2 $ operator matrices were established by Feki and Sahoo [arXiv:2006.09312; 2020] and Bhunia {\it et al.} [Linear Multilinear Algebra (2020), DOI: 10.1080/03081087.2020.1781037], assuming the conditions "$\mathcal{N}(A)^\perp$ is invariant under different operators in $\mathcal{B}_A(\mathcal{H})$" and "$A$ is strictly positive", respectively. In this paper, we prove a few new $\mathbb{A}$-numerical radius inequalities for $2\times 2$ and $n\times n$ operator matrices. We also provide some new proofs of the existing results by relaxing different sufficient conditions like "$\mathcal{N}(A)^\perp$ is invariant under different operators" and "$A$ is strictly positive". Our proofs show the importance of the theory of the Moore-Penrose inverse of a bounded linear operator in this field of study.


title: Radial Basis Functions and Improved Hyperparameter Optimisation for Gaussian Process Strain Estimation

abstract: Over the past decade, a number of algorithms for full-field elastic strain estimation from neutron and X-ray measurements have been published. Many of the recently published algorithms rely on modelling the unknown strain field as a Gaussian Process (GP) - a probabilistic machine-learning technique. Thus far, GP-based algorithms have assumed a high degree of smoothness and continuity in the unknown strain field. In this paper, we propose three modifications to the GP approach to improve performance, primarily when this is not the case (e.g. for high-gradient or discontinuous fields); hyperparameter optimisation using k-fold cross-validation, a radial basis function approximation scheme, and gradient-based placement of these functions.


title: Client Adaptation improves Federated Learning with Simulated Non-IID Clients

abstract: We present a federated learning approach for learning a client adaptable, robust model when data is non-identically and non-independently distributed (non-IID) across clients. By simulating heterogeneous clients, we show that adding learned client-specific conditioning improves model performance, and the approach is shown to work on balanced and imbalanced data set from both audio and image domains. The client adaptation is implemented by a conditional gated activation unit and is particularly beneficial when there are large differences between the data distribution for each client, a common scenario in federated learning.


title: Medical Instrument Detection in Ultrasound-Guided Interventions: A Review

abstract: Medical instrument detection is essential for computer-assisted interventions since it would facilitate the surgeons to find the instrument efficiently with a better interpretation, which leads to a better outcome. This article reviews medical instrument detection methods in the ultrasound-guided intervention. First, we present a comprehensive review of instrument detection methodologies, which include traditional non-data-driven methods and data-driven methods. The non-data-driven methods were extensively studied prior to the era of machine learning, i.e. data-driven approaches. We discuss the main clinical applications of medical instrument detection in ultrasound, including anesthesia, biopsy, prostate brachytherapy, and cardiac catheterization, which were validated on clinical datasets. Finally, we selected several principal publications to summarize the key issues and potential research directions for the computer-assisted intervention community.


title: Regional fractional Laplacians: Boundary regularity

abstract: We study boundary regularity for solutions to a class of equations involving the so called regional fractional Lapacians $(-\Delta)^s_\Omega $, with $\Omega\subset \mathbb{R}^N$. Recall that the regional fractional Laplacians are generated by symmetric stable processes which are not allowed to jump outside $\Omega$. We consider weak solutions to the equation $(-\Delta)^s_\Omega w(x)=p.v.\int_{\Omega}\frac{w(x)-w(y)}{|x-y|^{N+2s}}\, dy=f(x)$, for $s\in (0,1)$, subject to zero Neumann or Dirichlet boundary conditions. The boundary conditions are defined by considering $w$ as well as the test functions in the fractional Sobolev spaces $H^s(\Omega)$ or $H^s_0(\Omega)$ respectively. While the interior regularity is well understood for these problems, little is known in the boundary regularity, mainly for the Neumann problem. Under optimal regularity assumptions on $\Omega$ and provided $f\in L^p(\Omega)$, we show that $w\in C^{2s-N/p}(\overline \Omega)$ in the case of zero Neumann boundary conditions. As a consequence for $2s-N/p>1$, $w\in C^{1,2s-\frac{N}{p}-1}(\overline{\Omega})$. As what concerned the Dirichlet problem, we obtain ${w}/{\delta^{2s-1}}\in C^{1-N/p}(\overline\Omega)$, provided $p>N$ and $s\in (1/2,1)$, where $\delta(x)=\textrm{dist}(x,\partial\Omega)$. To prove these results, we first classify all solutions having a certain growth at infinity when $\Omega$ is a half-space and the right hand side is zero. We then carry over a fine blow up and some compactness arguments to get the results.


title: Magnetic Immunoassays: A Review of Virus and Pathogen Detection Before and Amidst the Coronavirus Disease-19 (COVID-19)

abstract: The novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes coronavirus disease 2019 (COVID-19), is a threat to the global healthcare system and economic security. As of July 2020, no specific drugs or vaccines are yet available for COVID-19, fast and accurate diagnosis for SARS-CoV-2 is essential in slowing down the spread of COVID-19 and for efficient implementation of control and containment strategies. Magnetic immunoassay is a novel and emerging topic representing the frontiers of current biosensing and magnetics areas. The past decade has seen rapid growth in applying magnetic tools for biological and biomedical applications. Recent advances in magnetic materials and nanotechnologies have transformed current diagnostic methods to nanoscale and pushed the detection limit to early stage disease diagnosis. Herein, this review covers the literatures of magnetic immunoassay platforms for virus and pathogen detections, before COVID-19. We reviewed the popular magnetic immunoassay platforms including magnetoresistance (MR) sensors, magnetic particle spectroscopy (MPS), and nuclear magnetic resonance (NMR). Magnetic Point-of-Care (POC) diagnostic kits are also reviewed aiming at developing plug-and-play diagnostics to manage the SARS-CoV-2 outbreak as well as preventing future epidemics. In addition, other platforms that use magnetic materials as auxiliary tools for enhanced pathogen and virus detections are also covered. The goal of this review is to inform the researchers of diagnostic and surveillance platforms for SARS-CoV-2 and their performances.


title: Client Network: An Interactive Model for Predicting New Clients

abstract: Understanding prospective clients becomes increasingly important as companies aim to enlarge their market bases. Traditional approaches typically treat each client in isolation, either studying its interactions or similarities with existing clients. We propose the Client Network, which considers the entire client ecosystem to predict the success of sale pitches for targeted clients by complex network analysis. It combines a novel ranking algorithm with data visualization and navigation. Based on historical interaction data between companies and clients, the Client Network leverages organizational connectivity to locate the optimal paths to prospective clients. The user interface supports exploring the client ecosystem and performing sales-essential tasks. Our experiments and user interviews demonstrate the effectiveness of the Client Network and its success in supporting sellers' day-to-day tasks.


title: Boundary entropy spectra as finite subsums

abstract: In this paper we provide a concrete construction of Furstenberg entropy values of $\tau$-boundaries of the group $\mathbb{Z}[\frac{1}{p_1},\ldots,\frac{1}{p_{l}}]\rtimes \{p_1^{n_1}\cdots p_{l}^{n_{l}} \, : \, n_i\in\mathbb{Z}\}$ by choosing an appropriate random walk $\tau$. We show that the boundary entropy spectrum can be realized as the subsum-set for any given finite sequence of positive numbers.


title: Some combinatorial properties of Ultimate L and V

abstract: This paper establishes a number of constraints on the structure of large cardinals under strong compactness assumptions. These constraints coincide with those imposed by the Ultrapower Axiom, a principle that is expected to hold in Woodin's hypothesized Ultimate \(L\), providing some evidence for the Ultimate \(L\) Conjecture. We show that every regular cardinal above the first strongly compact that carries an indecomposable ultrafilter is measurable, answering a question of Silver for large enough cardinals. We show that any successor almost strongly compact cardinal of uncountable cofinality is strongly compact, making progress on a question of Boney, Unger, and Brooke-Taylor. We show that if there is a proper class of strongly compact cardinals then there is no nontrivial cardinal preserving elementary embedding from the universe of sets into an inner model, answering a question of Caicedo granting large cardinals. Finally, we show that if \(\kappa\) is strongly compact, then \(V\) is a set forcing extension of the inner model \(\kappa\text{-HOD}\) consisting of sets that are hereditarily ordinal definable from a \(\kappa\)-complete ultrafilter over an ordinal; \(\kappa\text{-HOD}\) seems to be the first nontrivial example of a ground of \(V\) whose definition does not involve forcing.


title: Graph-Based Continual Learning

abstract: Despite significant advances, continual learning models still suffer from catastrophic forgetting when exposed to incrementally available data from non-stationary distributions. Rehearsal approaches alleviate the problem by maintaining and replaying a small episodic memory of previous samples, often implemented as an array of independent memory slots. In this work, we propose to augment such an array with a learnable random graph that captures pairwise similarities between its samples, and use it not only to learn new tasks but also to guard against forgetting. Empirical results on several benchmark datasets show that our model consistently outperforms recently proposed baselines for task-free continual learning.


title: Large magnetoresistance and non-zero Berry phase in the nodal-line semimetal MoO2

abstract: We performed calculations of the electronic band structure and the Fermi surface as well as measured the longitudinal resistivity rhoxx(T,H), Hall resistivity rhoxy(T,H) and quantum oscillations of the magnetization as a function of temperature at various magnetic fields for MoO2 with monoclinic crystal structure. The band structure calculations show that MoO2 is a nodal-line semimetal when spin-orbit coupling is ignored. It was found that a large magnetoresistance reaching 5.03x10^4% at 2 K and 9 T, its nearly quadratic field dependence and a field-induced up-turn behavior of rhoxx(T), the characteristics common for many topologically non-trivial as well as trivial semimetals, emerge also in MoO2. The observed properties are attributed to a perfect charge-carrier compensation, evidenced by both calculations relying on the Fermi surface topology and the Hall resistivity measurements. Both the observation of negative magnetoresistance for magnetic field along the current direction and the non-zero Berry phase in de Haas-van Alphen measurements indicate that pairs of Weyl points appear in MoO2, which may be due to the crystal symmetry breaking. These results highlight MoO2 as a new platform materials for studying the topological properties of oxides.


title: About relative polar varieties and Brasselet numbers

abstract: In this work, we study the consequences of an empty polar variety on the topology of a function-germ with (possibly) nonisolated singularities defined on a singular variety.


title: Effect of Technical and Social Factors on Pull Request Quality for the NPM Ecosystem

abstract: Pull request (PR) based development, which is a norm for the social coding platforms, entails the challenge of evaluating the contributions of, often unfamiliar, developers from across the open source ecosystem and, conversely, submitting a contribution to a project with unfamiliar maintainers. Previous studies suggest that the decision of accepting or rejecting a PR may be influenced by a diverging set of technical and social factors, but often focus on relatively few projects, do not consider ecosystem-wide measures, or the possible non-monotonic relationships between the predictors and PR acceptance probability. We aim to shed light on this important decision making process by testing which measures significantly affect the probability of PR acceptance on a significant fraction of a large ecosystem, rank them by their relative importance in predicting PR acceptance, and determine the shape of the functions that map each predictor to PR acceptance. We proposed seven hypotheses regarding which technical and social factors might affect PR acceptance and created 17 measures based on them. Our dataset consisted of 470,925 PRs from 3349 popular NPM packages and 79,128 GitHub users who created those. We tested which of the measures affect PR acceptance and ranked the significant measures by their importance in a predictive model. Our predictive model had and AUC of 0.94, and 15 of the 17 measures were found to matter, including five novel ecosystem-wide measures. Measures describing the number of PRs submitted to a repository and what fraction of those get accepted, and signals about the PR review phase were most significant. We also discovered that only four predictors have a linear influence on the PR acceptance probability while others showed a more complicated response.


title: Reply to the comment of T. Metcalfe and J. van Saders on the Science report "The Sun is less active than other solar-like stars"

abstract: This is our reply to the comment of T. Metcalfe and J. van Saders on the Science report "The Sun is less active than other solar-like stars" by T. Reinhold, A. I. Shapiro, S. K. Solanki, B. T. Montet, N. A. Krivova, R. H. Cameron, E. M. Amazo-Gomez. We hope that both the comment and our reply lead to fruitful discussions which of the two presented scenarios is more likely.


title: A policy iteration method for Mean Field Games

abstract: The policy iteration method is a classical algorithm for solving optimal control problems. In this paper, we introduce a policy iteration method for Mean Field Games systems, and we study the convergence of this procedure to a solution of the problem. We also introduce suitable discretizations to numerically solve both stationary and evolutive problems. We show the convergence of the policy iteration method for the discrete problem and we study the performance of the proposed algorithm on some examples in dimension one and two.


title: A Piecewise Deterministic Limit for a Multiscale Stochastic Spatial Gene Network

abstract: We consider multiscale stochastic spatial gene networks involving chemical reactions and diffusions. The model is Markovian and the transitions are driven by Poisson random clocks. We consider a case where there are two different spatial scales: a microscopic one with fast dynamic and a macroscopic one with slow dynamic. At the microscopic level, the species are abundant and for the large population limit a partial differential equation (PDE) is obtained. On the contrary at the macroscopic level, the species are not abundant and their dynamic remains governed by jump processes. It results that the PDE governing the fast dynamic contains coefficients which randomly change. The global weak limit is an infinite dimensional continuous piecewise deterministic Markov process (PDMP). Also, we prove convergence in the supremum norm.


title: Novel two-dimensional materials for electronics: computational modelling as a tool to enable the use of phosphorene in real applications

abstract: Two-dimensional and layered materials, such as graphene, have emerged in recent years for their potential use in several applications in technology, for example in electronics, bioelectronics, optoelectronics and related fields. Phosphorene, which can be considered as an analogous of graphene made of phosphorus atoms, is a relatively new two-dimensional system with peculiar structural, electronic, and mechanical properties. Despite the remarkable potential for applications, phosphorene suffers from severe limitations, hampering its use in practical uses. For example, phosphorene undergoes severe degradation phenomena in ordinary environments, leading to a very limited stability. Phosphorene is therefore very difficult to handle in real applications. In this paper, we briefly outline the concepts behind the application of predictive computational approaches to complex systems based on phosphorene, leading to the definition of practical strategies that can be applied to the development of stable, high-performance devices for electronics.


title: On the gamma-ray emission of W44 and its surroundings

abstract: We present the analysis of 9.7 years Fermi-LAT data of the middle-aged supernova remnant W44 and the massive molecular gas complex that surrounds it. We derived a high-quality spectral energy distribution of gamma-radiation of the shell over three decades. The very hard spectrum below 1 GeV supports the earlier claims regarding the hadronic origin of radiation. We also confirm the presence of two extended $\gamma$-ray structures located at two opposite edges of the remnant along its major axis. Based on the high-resolution gas maps, we demonstrate that the gamma-ray structures are caused by the enhanced cosmic-ray density rather than the gradient of the gas distribution. We argue that the revealed cosmic-ray "clouds" suggest an anisotropic character of the escape of high-energy particles from the shell along the magnetic field of the remnant.


title: On fractional-order maps and their synchronization

abstract: We study the stability of linear fractional order maps. We show that in the stable region, the evolution is described by Mittag-Leffler functions and a well defined effective Lyapunov exponent can be obtained in these cases. For one-dimensional systems, this exponent can be related to the corresponding fractional differential equation. A fractional equivalent of map $f(x)=ax$ is stable for $a_c(\alpha)<a<1$ where $\alpha$ is a fractional order parameter and $a_c(\alpha)\approx -\alpha$. For coupled linear fractional maps, we can obtain `normal modes' and reduce the evolution to effectively one-dimensional system. If the eigenvalues are real the stability of the coupled system is dictated by the stability of effectively one-dimensional normal modes. For complex eigenvalues, we obtain a much richer picture. However, in the stable region, the evolution of modulus is dictated by Mittag-Leffler function and the effective Lyapunov exponent is determined by modulus of eigenvalues. We extend these studies to synchronized fixed points of fractional nonlinear maps.


title: Resolving acceleration to very high energies along the Jet of Centaurus A

abstract: The nearby radio galaxy Centaurus A belongs to a class of Active Galaxies that are very luminous at radio wavelengths. The majority of these galaxies show collimated relativistic outflows known as jets, that extend over hundreds of thousands of parsecs for the most powerful sources. Accretion of matter onto the central super-massive black hole is believed to fuel these jets and power their emission, with the radio emission being related to the synchrotron radiation of relativistic electrons in magnetic fields. The origin of the extended X-ray emission seen in the kiloparsec-scale jets from these sources is still a matter of debate, although Cen A's X-ray emission has been suggested to originate in electron synchrotron processes. The other possible explanation is Inverse Compton (IC) scattering with CMB soft photons. Synchrotron radiation needs ultra-relativistic electrons ($\sim50$ TeV), and given their short cooling times, requires some continuous re-acceleration mechanism to be active. IC scattering, on the other hand, does not require very energetic electrons, but requires jets that stay highly relativistic on large scales ($\geq$1 Mpc) and that remain well-aligned with the line of sight. Some recent evidence disfavours inverse Compton-CMB models, although other evidence seems to be compatible with them. In principle, the detection of extended gamma-ray emission, directly probing the presence of ultra-relativistic electrons, could distinguish between these options, but instruments have hitherto been unable to resolve the relevant structures. At GeV energies there is also an unusual spectral hardening in Cen A, whose explanation is unclear. Here we report observations of Cen A at TeV energies that resolve its large-scale jet. We interpret the data as evidence for the acceleration of ultra-relativistic electrons in the jet, and favour the synchrotron explanation for the X-rays.


title: Predicting Court Decisions for Alimony: Avoiding Extra-legal Factors in Decision made by Judges and Not Understandable AI Models

abstract: The advent of machine learning techniques has made it possible to obtain predictive systems that have overturned traditional legal practices. However, rather than leading to systems seeking to replace humans, the search for the determinants in a court decision makes it possible to give a better understanding of the decision mechanisms carried out by the judge. By using a large amount of court decisions in matters of divorce produced by French jurisdictions and by looking at the variables that allow to allocate an alimony or not, and to define its amount, we seek to identify if there may be extra-legal factors in the decisions taken by the judges. From this perspective, we present an explainable AI model designed in this purpose by combining a classification with random forest and a regression model, as a complementary tool to existing decision-making scales or guidelines created by practitioners.


title: Fast Transformers with Clustered Attention

abstract: Transformers have been proven a successful model for a variety of tasks in sequence modeling. However, computing the attention matrix, which is their key component, has quadratic complexity with respect to the sequence length, thus making them prohibitively expensive for large sequences. To address this, we propose clustered attention, which instead of computing the attention for every query, groups queries into clusters and computes attention just for the centroids. To further improve this approximation, we use the computed clusters to identify the keys with the highest attention per query and compute the exact key/query dot products. This results in a model with linear complexity with respect to the sequence length for a fixed number of clusters. We evaluate our approach on two automatic speech recognition datasets and show that our model consistently outperforms vanilla transformers for a given computational budget. Finally, we demonstrate that our model can approximate arbitrarily complex attention distributions with a minimal number of clusters by approximating a pretrained BERT model on GLUE and SQuAD benchmarks with only 25 clusters and no loss in performance.


title: Results of search for magnetized quark-nugget dark matter from radial impacts on Earth

abstract: Magnetized Quark Nuggets (MQNs) are a recently proposed dark-matter candidate consistent with the Standard Model and with Tatsumi's theory of quark-nugget cores in magnetars. Previous publications have covered their formation in the early universe, aggregation into a broad mass distribution before they can decay by the weak force, interaction with normal matter through their magnetopause, and first observation consistent MQNs, i.e. a nearly tangential impact limiting their surface-magnetic-field parameter B_o from Tatsumi's values of 0.1 to 10.0 TT to new value of 1.65 TT +/- 21%. The MQN mass distribution and interaction cross section depend strongly on B_o. Their magnetopause is much larger than their geometric dimensions and can cause sufficient energy deposition to form non-meteorite craters, which are reported approximately annually. We report computer simulations of the MQN energy deposition in water-saturated peat, soft sediments, and granite and report results from excavating such a crater. Five points of agreement between observations and hydrodynamic simulations of an MQN impact support this second observation consistent with MQN dark matter and suggest a method for qualifying additional MQN events. The results also redundantly constrain B_o to greater than 0.4 TT.


title: Optimizing testing policies for detecting COVID-19 outbreaks

abstract: The COVID-19 pandemic poses challenges for continuing economic activity while reducing health risks. While these challenges can be mitigated through testing, testing budget is often limited. Here we study how institutions, such as nursing homes, should utilize a fixed test budget for early detection of an outbreak. Using an extended network-SEIR model, we show that given a certain budget of tests, it is generally better to test smaller subgroups of the population frequently than to test larger groups but less frequently. The numerical results are consistent with an analytical expression we derive for the size of the outbreak at detection in an exponential spread model. Our work provides a simple guideline for institutions: distribute your total tests over several batches instead of using them all at once. We expect that in the appropriate scenarios, this easy-to-implement policy recommendation will lead to earlier detection and better mitigation of local COVID-19 outbreaks.


title: Predictability of real temporal networks

abstract: Links in most real networks often change over time. Such temporality of links encodes the ordering and causality of interactions between nodes and has a profound effect on network dynamics and function. Empirical evidences have shown that the temporal nature of links in many real-world networks is not random. Nonetheless, it is challenging to predict temporal link patterns while considering the entanglement between topological and temporal link patterns. Here we propose an entropy-rate based framework, based on combined topological-temporal regularities, for quantifying the predictability of any temporal network. We apply our framework on various model networks, demonstrating that it indeed captures the intrinsic topological-temporal regularities whereas previous methods considered only temporal aspects. We also apply our framework on 18 real networks of different types and determine their predictability. Interestingly, we find that for most real temporal networks, despite the greater complexity of predictability brought by the increase in dimension the combined topological-temporal predictability is higher than the temporal predictability. Our results demonstrate the necessity of incorporating both temporal and topological aspects of networks in order to improve predictions of dynamical processes.


title: Gintropy: Gini index based generalization of Entropy

abstract: Entropy is being used in physics, mathematics, informatics and in related areas to describe equilibration, dissipation, maximal probability states and optimal compression of information. The Gini index on the other hand is an established measure for social and economical inequalities in a society. In this paper we explore the mathematical similarities and connections in these two quantities and introduce a new measure that is capable to connect these two at an interesting analogy level. This supports the idea that a generalization of the Gibbs--Boltzmann--Shannon entropy, based on a transformation of the Lorenz curve, can properly serve in quantifying different aspects of complexity in socio- and econo-physics.


title: A Vision for Numerical Weather Prediction in 2030

abstract: In this essay, I outline a personal vision of how I think Numerical Weather Prediction (NWP) should evolve in the years leading up to 2030 and hence what it should look like in 2030. By NWP I mean initial-value predictions from timescales of hours to seasons ahead. Here I want to focus on how NWP can better help save lives from increasingly extreme weather in those parts of the world where society is most vulnerable. Whilst we can rightly be proud of many parts of our NWP heritage, its evolution has been influenced by national or institutional politics as well as by underpinning scientific principles. Sometimes these conflict with each other. It is important to be able to separate these issues when discussing how best meteorological science can serve society in 2030; otherwise any disruptive change - no matter how compelling the scientific case for it - becomes impossibly difficult.


title: n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild

abstract: The study of student engagement has attracted growing interests to address problems such as low academic performance, disaffection, and high dropout rates. Existing approaches to measuring student engagement typically rely on survey-based instruments. While effective, those approaches are time-consuming and labour-intensive. Meanwhile, both the response rate and quality of the survey are usually poor. As an alternative, in this paper, we investigate whether we can infer and predict engagement at multiple dimensions, just using sensors. We hypothesize that multidimensional student engagement can be translated into physiological responses and activity changes during the class, and also be affected by the environmental changes. Therefore, we aim to explore the following questions: Can we measure the multiple dimensions of high school student's learning engagement including emotional, behavioural and cognitive engagement with sensing data in the wild? Can we derive the activity, physiological, and environmental factors contributing to the different dimensions of student engagement? If yes, which sensors are the most useful in differentiating each dimension of the engagement? Then, we conduct an in-situ study in a high school from 23 students and 6 teachers in 144 classes over 11 courses for 4 weeks. We present the n-Gage, a student engagement sensing system using a combination of sensors from wearables and environments to automatically detect student in-class multidimensional learning engagement. Experiment results show that n-Gage can accurately predict multidimensional student engagement in real-world scenarios with an average MAE of 0.788 and RMSE of 0.975 using all the sensors. We also show a set of interesting findings of how different factors (e.g., combinations of sensors, school subjects, CO2 level) affect each dimension of the student learning engagement.


title: Bose-Einstein condensate dark matter model with three-particle interaction and two-phase structure

abstract: We explore the consequences of including the repulsive three-particle interaction in the model of Bose-Einstein condensate dark matter model or fuzzy dark matter. Such a model based on properly modified Gross-Pitaevskii equation is intended to describe the distribution of dark matter particles in the highly dense regions, which correspond to the galaxy core and/or to the overlap of colliding galaxies. Specifically, we deal with the $\phi^6$-model in terms of the macroscopic wave function of the condensate, where a locality of interaction is guaranteed by a large correlation length assumed to hold. After calculation of main thermodynamical characteristics, we find strong evidence of the existence of two distinct phases of dark matter, within its core, separated by the instability region lying between two differing special values of the pressure acting in the model. Some implications stemming from the existence of two phases and the related first-order phase transition are discussed.


title: Towards Open-World Recommendation: An Inductive Model-based Collaborative Filtering Approach

abstract: Recommendation models can effectively estimate underlying user interests and predict one's future behaviors by factorizing an observed user-item rating matrix into products of two sets of latent factors. However, the user-specific embedding factors can only be learned in a transductive way, making it difficult to handle new users on-the-fly. In this paper, we propose an inductive collaborative filtering framework that contains two representation models. The first model follows conventional matrix factorization which factorizes a group of key users' rating matrix to obtain meta latents. The second model resorts to attention-based structure learning that estimates hidden relations from query to key users and learns to leverage meta latents to inductively compute embeddings for query users via neural message passing. Our model enables inductive representation learning for users and meanwhile guarantees equivalent representation capacity as matrix factorization. Experiments demonstrate that our model achieves promising results for recommendation on few-shot users with limited training ratings and new unseen users which are commonly encountered in open-world recommender systems.


title: Non-integrality of integrable over K\"ahler differential forms

abstract: We show that for a normal isolated singularity the module of square-integrable regular differential forms of top degree is not integral over the module of K\"ahler differential forms. This is related to the fibre dimension of the Nash transform.


title: Motivic integration and the birational invariance of BCOV invariants

abstract: Bershadsky, Cecotti, Ooguri, and Vafa constructed a real-valued invariant for Calabi--Yau manifolds, which is now called the BCOV torsion. Based on it, a metric-independent invariant, called the BCOV invariant, was constructed by Fang--Lu--Yoshikawa and Eriksson--Freixas i Montplet--Mourougane. The BCOV invariant is conjecturally related to the Gromov--Witten theory via mirror symmetry. Based upon the previous work of the second author, we prove the conjecture that birational Calabi--Yau manifolds have the same BCOV invariant. We also extend the construction of the BCOV invariant to Calabi--Yau varieties with Kawamata log terminal singularities and prove its birational invariance for Calabi--Yau varieties with canonical singularities. We provide an interpretation of our construction using the theory of motivic integration.


title: Order-sharp norm-resolvent homogenisation estimates for Maxwell equations on periodic singular structures: the case of non-zero current and the general system

abstract: For arbitrarily small values of $\varepsilon>0,$ we formulate and analyse the Maxwell system of equations of electromagnetism on $\varepsilon$-periodic sets $S^\varepsilon\subset{\mathbb R}^3.$ Assuming that a family of Borel measures $\mu^\varepsilon,$ such that ${\rm supp}(\mu^\varepsilon)=S^\varepsilon,$ is obtained by $\varepsilon$-contraction of a fixed 1-periodic measure $\mu,$ and for right-hand sides $f^\varepsilon\in L^2({\mathbb R}^3, d\mu^\varepsilon),$ we prove order-sharp norm-resolvent convergence estimates for the solutions of the system. In the resent work we address the case of non-zero current density in the Maxwell system and complete the analysis of the general setup including non-constant permittivity and permeability coefficients.


title: Geometric Bounds for Convergence Rates of Averaging Algorithms

abstract: We develop a generic method for bounding the convergence rate of an averaging algorithm running in a multi-agent system with a time-varying network, where the associated stochastic matrices have a time-independent Perron vector. This method provides bounds on convergence rates that unify and refine most of the previously known bounds. They depend on geometric parameters of the dynamic communication graph such as the normalized diameter or the bottleneck measure. As corollaries of these geometric bounds, we show that the convergence rate of the Metropolis algorithm in a system of $n$ agents is less than $1-1/4n^2$ with any communication graph that may vary in time, but is permanently connected and bidirectional. We prove a similar upper bound for the EqualNeighbor algorithm under the additional assumptions that the number of neighbors of each agent is constant and that the communication graph is not too irregular. Moreover our bounds offer improved convergence rates for several averaging algorithms and specific families of communication graphs. Finally we extend our methodology to a time-varying Perron vector and show how convergence times may dramatically degrade with even limited variations of Perron vectors.


title: Improving the Robustness of Trading Strategy Backtesting with Boltzmann Machines and Generative Adversarial Networks

abstract: This article explores the use of machine learning models to build a market generator. The underlying idea is to simulate artificial multi-dimensional financial time series, whose statistical properties are the same as those observed in the financial markets. In particular, these synthetic data must preserve the probability distribution of asset returns, the stochastic dependence between the different assets and the autocorrelation across time. The article proposes then a new approach for estimating the probability distribution of backtest statistics. The final objective is to develop a framework for improving the risk management of quantitative investment strategies, in particular in the space of smart beta, factor investing and alternative risk premia.


title: Exciton oscillator strength in two-dimensional Dirac materials

abstract: Exciton problem is solved in the two-dimensional Dirac model with allowance for strong electron-hole attraction. The exciton binding energy is assumed smaller than but comparable to the band gap. The exciton wavefunction is found in the momentum space as a superposition of all four two-particle states including electron and hole states with both positive and negative energies. The matrix element of exciton generation is shown to depend on the additional components of the exciton wavefunction. Both the Coulomb and the Rytova-Keldysh potentials are considered. The dependence of the binding energy on the coupling constant is analyzed for the ground and first excited exciton states. The binding energy and the oscillator strength are studied as functions of the environmental-dependent dielectric constant for real transition metal dichalcogenide monolayers. We demonstrate that the multicomponent nature of the exciton wavefunction is crucial for description of resonant optical properties of two-dimensional Dirac systems.


title: Universal Algebra in UniMath

abstract: We present an ongoing effort to implement Universal Algebra in the UniMath system. Our aim is to develop a general framework for formalizing and studying Universal Algebra in a proof assistant. By constituting a formal system for isolating the invariants of the theory we are interested in -- that is, general algebraic structures modulo isomorphism -- Univalent Mathematics seems to provide a suitable environment to carry on our endeavour.


title: Structural identities in the first order formulation of quantum gravity

abstract: We study the self-consistency of the first order formulation of quantum gravity, which may be attained by introducing, apart from the graviton field, another auxiliary quantum field. By comparing the forms of the generating functional $Z$ before and after integrating out the additional field, we derive a set of structural identities which must be satisfied by the Green's functions at all orders. These are distinct from the usual Ward identities, being necessary for the self-consistency of the first order formalism. They relate the Green's functions involving the additional quantum field to those containing a certain composite graviton field, which corresponds to its classical value. Thereby, the structural identities lead to a simple interpretation of the auxiliary field.


title: An Interior Point Method Solving Motion Planning Problems with Narrow Passages

abstract: Algorithmic solutions for the motion planning problem have been investigated for five decades. Since the development of A* in 1969 many approaches have been investigated, traditionally classified as either grid decomposition, potential fields or sampling-based. In this work, we focus on using numerical optimization, which is understudied for solving motion planning problems. This lack of interest in the favor of sampling-based methods is largely due to the non-convexity introduced by narrow passages. We address this shortcoming by grounding the solution in differential geometry. We demonstrate through a series of experiments on 3 Dofs and 6 Dofs narrow passage problems, how modeling explicitly the underlying Riemannian manifold leads to an efficient interior-point non-linear programming solution.


title: Assessing the impact of inertia and reactive power constraints in generation expansion planning

abstract: On the path towards power systems with high renewable penetrations and ultimately carbon-neutral, more and more synchronous generation is being displaced by variable renewable generation that does not currently provide system inertia nor reactive power support. This could create serious issues of power system stability in the near future, and countries with high renewable penetrations such as Ireland are already facing these challenges. Therefore, this paper aims at answering the questions of whether and how explicitly including inertia and reactive power constraints in generation expansion planning would affect the optimal capacity mix of the power system of the future. Towards this end, we propose the novel Low-carbon Expansion Generation Optimization (LEGO) model, which explicitly accounts for: unit commitment constraints, Rate of Change of Frequency (RoCoF) inertia requirements and virtual inertia provision, and, a second-order cone programming (SOCP) approximation of the AC power flow, accounting for reactive power constraints. An illustrative case study underlines that disregarding inertia and reactive power constraints in generation expansion planning can result in additional system cost, system infeasibilities, a distortion of optimal resource allocation and inability to reach established policy goals.


title: Asymptotic behaviour of the Steklov problem on dumbbell domains

abstract: We analyse the asymptotic behaviour of the eigenvalues and eigenvectors of a Steklov problem in a dumbbell domain consisting of two Lipschitz sets connected by a thin tube with vanishing width. All the eigenvalues are collapsing to zero, the speed being driven by some power of the width which multiplies the eigenvalues of a one dimensional problem. In two dimensions of the space, the behaviour is fundamentally different from the third or higher dimensions and the limit problems are of different nature. This phenomenon is due to the fact that only in dimension two the boundary of the tube has not vanishing surface measure.


title: Weakly magnetized, Hall dominated plasma Couette flow

abstract: A novel plasma equilibrium in the high-$\beta$, Hall regime that produces centrally-peaked, high Mach number Couette flow is described. Flow is driven using a weak, uniform magnetic field and large, cross field currents. Large magnetic field amplification (factor 20) due to the Hall effect is observed when electrons are flowing radially inward, and near perfect field expulsion is observed when the flow is reversed. A dynamic equilibrium is reached between the amplified (removed) field and extended density gradients.


title: Multi-objective Optimization by Uncrowded Hypervolume Gradient Ascent

abstract: Evolutionary algorithms (EAs) are the preferred method for solving black-box multi-objective optimization problems, but when gradients of the objective functions are available, it is not straightforward to exploit these efficiently. By contrast, gradient-based optimization is well-established for single-objective optimization. A single-objective reformulation of the multi-objective problem could therefore offer a solution. Of particular interest to this end is the recently introduced uncrowded hypervolume (UHV) indicator, which takes into account dominated solutions. In this work, we show that the gradient of the UHV can often be computed, which allows for a direct application of gradient ascent algorithms. We compare this new approach with two EAs for UHV optimization as well as with one gradient-based algorithm for optimizing the well-established hypervolume. On several bi-objective benchmarks, we find that gradient-based algorithms outperform the tested EAs by obtaining a better hypervolume with fewer evaluations whenever exact gradients of the multiple objective functions are available and in case of small evaluation budgets. For larger budgets, however, EAs perform similarly or better. We further find that, when finite differences are used to approximate the gradients of the multiple objectives, our new gradient-based algorithm is still competitive with EAs in most considered benchmarks. Implementations are available at https://github.com/scmaree/uncrowded-hypervolume.


title: A Consent Model for Blockchain-based Distributed Data Sharing Platforms

abstract: In modern healthcare systems, being able to share electronic health records is crucial for providing quality care and for enabling a larger spectrum of health services. Health data sharing is dependent on obtaining individual consent which, in turn, is hindered by a lack of resources. To this extend, blockchain-based platforms facilitate data sharing by inherently creating a trusted distributed network of users. These users are enabled to share their data without depending on the time and resources of specific players (such as the health services). In blockchain-based platforms, data governance mechanisms become very important due to the need to specify and monitor data sharing and data use conditions. In this paper, we present a blockchain-based data sharing consent model for access control over individual health data. We use smart contracts to dynamically represent the individual consent over health data and to enable data requesters to search and access them. The dynamic consent model extends upon two ontologies: the Data Use Ontology (DUO) which models the individual consent of users and the Automatable Discovery and Access Matrix (ADA-M) which describes queries from data requesters. We deploy the model on Ethereum blockchain and evaluate different data sharing scenarios. The contribution of this paper is to create an individual consent model for health data sharing platforms. Such a model guarantees that individual consent is respected and that there is accountability for all the participants in the data sharing platform. The evaluation of our solution indicates that such a data sharing model provides a flexible approach to decide how the data is used by data requesters. Our experimental evaluation shows that the proposed model is efficient and adapts to personalized access control policies in data sharing.


title: Guru, Partner, or Pencil Sharpener? Understanding Designers' Attitudes Towards Intelligent Creativity Support Tools

abstract: Creativity Support Tools (CST) aim to enhance human creativity, but the deeply personal and subjective nature of creativity makes the design of universal support tools challenging. Individuals develop personal approaches to creativity, particularly in the context of commercial design where signature styles and techniques are valuable commodities. Artificial Intelligence (AI) and Machine Learning (ML) techniques could provide a means of creating 'intelligent' CST which learn and adapt to personal styles of creativity. Identifying what kind of role such tools could play in the design process requires a better understanding of designers' attitudes towards working with AI, and their willingness to include it in their personal creative process. This paper details the results of a survey of professional designers which indicates a positive and pragmatic attitude towards collaborating with AI tools, and a particular opportunity for incorporating them in the research stages of a design project.


title: Physics-inspired forms of the Bayesian Cram\'er-Rao bound

abstract: Using differential geometry, I derive a form of the Bayesian Cram\'er-Rao bound that remains invariant under reparametrization. With the invariant formulation at hand, I find the optimal and naturally invariant bound among the Gill-Levit family of bounds. By assuming that the prior probability density is the square of a wavefunction, I also express the bounds in terms of functionals that are quadratic with respect to the wavefunction and its gradient. The problem of finding an unfavorable prior to tighten the bound for minimax estimation is shown, in a special case, to be equivalent to finding the ground state of a Schr\"odinger equation, with the Fisher information playing the role of the potential. To illustrate the theory, two quantum estimation problems, namely, optomechanical waveform estimation and subdiffraction incoherent optical imaging, are discussed.


title: Exploring the centrality dependence of elliptic and triangular flows

abstract: A detailed study of elliptical and triangular eccentricities in the initial state of relativistic heavy ion collisions is presented. A model of randomly distributed sources of energy density in the transverse plane based on the effective theory of Color Glass Condensate is used. This model describes well the ALICE and ATLAS data for Pb+Pb collisions at center-of-mass energy 5.02 TeV per nucleon pair in a wide range of centralities, if the second $v_2$ and third $v_3$ harmonics of the anisotropic flow are simply implied to be proportional to the eccentricities $\varepsilon_2$ and $\varepsilon_3$ as a reasonable approximation. The eccentricity $\varepsilon_2$ is closely related with the collision geometry and its centrality dependence is mainly determined by the edge diffuseness of the region of the uniform distribution of the saturation pulse of the oncoming nucleus. The eccentricity $\varepsilon_3$ is completely determined by the chaotic fluctuations of the source position in the region of overlapping nuclei and is substantially dependent on the overlap area only.


title: The full angle-dependence of the four-loop cusp anomalous dimension in QED

abstract: The angle-dependent cusp anomalous dimension governs divergences coming from soft gluon exchanges between heavy particles, such as top quarks. We focus on the matter-dependent contributions and compute the first truly non-planar terms. They appear at four loops and are proportional to a quartic Casimir operator in color space. Specializing our general gauge theory result to U(1), we obtain the full QED four-loop angle-dependent cusp anomalous dimension. While more complicated functions appear at intermediate steps, the analytic answer depends only on multiple polylogarithms with singularities at fourth roots of unity. It can be written in terms of four rational structures, and contains functions of up to maximal transcendental weight seven. Despite this complexity, we find that numerically the answer is tantalizingly close to the appropriately rescaled one-loop formula, over most of the kinematic range. We take several limits of our analytic result, which serves as a check and allows us to obtain new, power-suppressed terms. In the anti-parallel lines limit, which corresponds to production of two massive particles at threshold, we find that the subleading power correction vanishes. Finally, we compute the quartic Casimir contribution for scalars in the loop. Taking into account a supersymmetric decomposition, we derive the first non-planar corrections to the quark anti-quark potential in maximally supersymmetric gauge theory.


title: A Velocity Map Imaging apparatus optimized for high-resolution crossed molecular beam experiments

abstract: We present the design of a Velocity Map Imaging apparatus tailored to the demands of high-resolution crossed molecular beam experiments employing Stark or Zeeman decelerators. The key requirements for these experiments consist of the combination of a high relative velocity resolution for large ionization volumes and a broad range of relatively low lab-frame velocities. The SIMION software package was employed to systematically optimize the electrode geometries and electrical configuration. The final design consists of a stack of 16 tubular electrodes, electrically connected with resistors, which is divided into three electric field regions. The resulting apparatus allows for an inherent velocity blurring of less than 1.1 m/s for NO$^+$ ions originating from a 3x3x3 mm ionization volume, which is negligible in a typical crossed beam experiment. The design was recently employed in several state of the art crossed-beam experiments, allowing the observation of fine details in the velocity distributions of the scattered molecules.


title: Identifying efficient controls of complex interaction networks using genetic algorithms

abstract: Control theory has seen recently impactful applications in network science, especially in connections with applications in network medicine. A key topic of research is that of finding minimal external interventions that offer control over the dynamics of a given network, a problem known as network controllability. We propose in this article a new solution for this problem based on genetic algorithms. We tailor our solution for applications in computational drug repurposing, seeking to maximise its use of FDA-approved drug targets in a given disease-specific protein-protein interaction network. We show how our algorithm identifies a number of potentially efficient drugs for breast, ovarian, and pancreatic cancer. We demonstrate our algorithm on several benchmark networks from cancer medicine, social networks, electronic circuits, and several random networks with their edges distributed according to the Erd\H{o}s-R\'{e}nyi, the small-world, and the scale-free properties. Overall, we show that our new algorithm is more efficient in identifying relevant drug targets in a disease network, advancing the computational solutions needed for new therapeutic and drug repurposing approaches.


title: Dependence of Cluster Growth on Coefficient of Restitution in a Cooling Granular Fluid

abstract: Starting from configurations having homogeneous spatial density, we study kinetics in a two-dimensional system of inelastically colliding hard particles, a popular model for cooling granular matter. Following an initial time period, the system exhibits a crossover to an inhomogeneous regime that is characterized by the formation and growth of particle-rich clusters. We present results on the time dependence of average mass of the clusters and that of average kinetic energy, obtained via event driven molecular dynamics simulations, for a wide range of values for the coefficient of restitution ($e$), by fixing the overall density of particles in the system to a constant number. The time of onset of crossover from homogeneous to the inhomogeneous regime, as is well known, strongly increases as one moves towards the elastic limit. Nevertheless, our presented results suggest that the asymptotic growth is independent of $e$, for uniform definition of cluster, onset of which has a different $e$-dependence than the onset of above mentioned crossover. In other words, not only the exponent but also the amplitude of the power-law growth, which is widely believed to be the form of the evolution, is at the most very weakly sensitive to the choice of $e$. While it is tempting to attribute this fact to the similar feature in the decay of energy, we caution that our current understanding is not matured enough to draw such a connection between cluster growth and energy decay in a meaningful manner.


title: Quasicharacters, recoupling calculus and costratifications of lattice quantum gauge theory

abstract: We study the algebra of invariant representative functions over the N-fold Cartesian product of copies of a compact Lie group G modulo the action of conjugation by the diagonal subgroup. We construct a basis of invariant representative functions referred to as quasicharacters. The form of the quasicharacters depends on the choice of a reduction scheme. We determine the multiplication law of quasicharacters and express their structure constants in terms of recoupling coefficients. Via this link, the choice of the reduction scheme acquires an interpretation in terms of binary trees. We show explicitly that the structure constants decompose into products over primitive elements of 9j symbol type. For SU(2), everything boils down to the combinatorics of angular momentum theory. In the final part, we show that the above calculus enables us to calculate the matrix elements of bi-invariant operators occuring in quantum lattice gauge theory. In particular, both the quantum Hamiltonian and the orbit type relations may be dealt with in this way, thus, reducing both the construction of the costratification and the study of the spectral problem to numerical problems in linear algebra. We spell out the spectral problem for G=SU(2) and we present sample calculations of matrix elements of orbit type relations for the gauge groups SU(2) and SU(3). The methods developed may be useful in the study of virtually all quantum models with polynomial constraints related to some symmetry.


title: Computing High-Quality Clutter Removal Solutions for Multiple Robots

abstract: We investigate the task and motion planning problem of clearing clutter from a workspace with limited ingress/egress access for multiple robots. We call the problem multi-robot clutter removal (MRCR). Targeting practical applications where motion planning is non-trivial but is not a bottleneck, we focus on finding high-quality solutions for feasible MRCR instances, which depends on the ability to efficiently compute high-quality object removal sequences. Despite the challenging multi-robot setting, our proposed search algorithms based on A*, dynamic programming, and best-first heuristics all produce solutions for tens of objects that significantly outperform single robot solutions. Realistic simulations with multiple Kuka youBots further confirms the effectiveness of our algorithmic solutions. In contrast, we also show that deciding the optimal object removal sequence for MRCR is computationally intractable.


title: Nonequilibrium Thermodynamics of Quantum Friction

abstract: Thermodynamic principles are often deceptively simple and yet surprisingly powerful. We show how a simple rule, such as the net flow of energy in and out of a moving atom under nonequilibrium steady state condition, can expose the shortcomings of many popular theories of quantum friction. Our thermodynamic approach provides a conceptual framework in guiding atom-optical experiments, thereby highlighting the importance of fluctuation-dissipation relations and long-time correlations between subsystems. Our results introduce consistency conditions for (numerical) models of nonequilibrium dynamics of open quantum systems.


title: Some algorithms for maximum volume and cross approximation of symmetric semidefinite matrices

abstract: Finding the $r\times r$ submatrix of maximum volume of a matrix $A\in\mathbb R^{n\times n}$ is an NP hard problem that arises in a variety of applications. We propose a new greedy algorithm of cost $\mathcal O(n)$, for the case $A$ symmetric positive semidefinite (SPSD) and we discuss its extension to related optimization problems such as the maximum ratio of volumes. In the second part of the paper we prove that any SPSD matrix admits a cross approximation built on a principal submatrix whose approximation error is bounded by $(r+1)$ times the error of the best rank $r$ approximation in the nuclear norm. In the spirit of recent work by Cortinovis and Kressner we derive some deterministic algorithms which are capable to retrieve a quasi optimal cross approximation with cost $\mathcal O(n^3)$.


title: Character sums over affine spaces and applications

abstract: Given a finite field $\mathbb F_q$, a positive integer $n$ and an $\mathbb F_q$-affine space $\mathcal A\subseteq \mathbb F_{q^n}$, we provide a new bound on the sum $\sum_{a\in \mathcal A}\chi(a)$, where $\chi$ a multiplicative character of $\mathbb F_{q^n}$. We focus on the applicability of our estimate to results regarding the existence of special primitive elements in $\mathbb F_{q^n}$. In particular, we obtain substantial improvements on previous works.


title: Active nonreciprocal attraction between motile particles in an elastic medium

abstract: We show from experiments and simulations on vibration-activated granular matter that self-propelled polar rods in an elastic medium on a substrate turn and move towards each other. We account for this effective attraction through a coarse-grained theory of a motile particle as a moving point-force density that creates elastic strains in the medium that reorient other particles. Our measurements confirm qualitatively the predicted features of the distortions created by the rods, including the $|x|^{-1/2}$ tail of the trailing displacement field and non-reciprocal sensing and pursuit. A discrepancy between the magnitudes of displacements along and transverse to the direction of motion remains. Our theory should be of relevance to the interaction of motile cells in the extracellular matrix or in a supported layer of gel or tissue.


title: Thermalisation of a trapped one-dimensional Bose gas via diffusion

abstract: For a decade the fate of a one-dimensional gas of interacting bosons in an external trapping potential remained mysterious. We here show that whenever the underlying integrability of the gas is broken by the presence of the external potential, the inevitable diffusive rearrangements between the quasiparticles, quantified by the diffusion constants of the gas, eventually lead the system to thermalise at late times. We show that the full thermalising dynamics can be described by the generalised hydrodynamics with diffusion and force terms, and we compare these predictions with numerical simulations. Finally, we provide an explanation for the slow thermalisation rates observed in numerical and experimental settings: the hydrodynamics of integrable models is characterised by a continuity of modes, which can have arbitrarily small diffusion coefficients. As a consequence, the approach to thermalisation can display pre-thermal plateau and relaxation dynamics with long polynomial finite-time corrections.


title: Attention or memory? Neurointerpretable agents in space and time

abstract: In neuroscience, attention has been shown to bidirectionally interact with reinforcement learning (RL) processes. This interaction is thought to support dimensionality reduction of task representations, restricting computations to relevant features. However, it remains unclear whether these properties can translate into real algorithmic advantages for artificial agents, especially in dynamic environments. We design a model incorporating a self-attention mechanism that implements task-state representations in semantic feature-space, and test it on a battery of Atari games. To evaluate the agent's selective properties, we add a large volume of task-irrelevant features to observations. In line with neuroscience predictions, self-attention leads to increased robustness to noise compared to benchmark models. Strikingly, this self-attention mechanism is general enough, such that it can be naturally extended to implement a transient working-memory, able to solve a partially observable maze task. Lastly, we highlight the predictive quality of attended stimuli. Because we use semantic observations, we can uncover not only which features the agent elects to base decisions on, but also how it chooses to compile more complex, relational features from simpler ones. These results formally illustrate the benefits of attention in deep RL and provide evidence for the interpretability of self-attention mechanisms.


title: Nucleon clustering at kinetic freezeout of heavy-ion collisions via path-integral Monte Carlo

abstract: Clustering of the four-nucleon system at kinetic freezeout conditions is studied using path-integral Monte Carlo techniques. This method seeks to improve upon previous calculations which relied on approximate semiclassical methods or few-body quantum mechanics. Estimates are given for the decay probabilities of the 4N system into various light nuclei decay channels and the strength of spatial correlations is characterized. Additionally, a simple model is presented to describe the impact of this clustering on nucleon multiplicity distributions. The effects of a possible modification of the inter-nucleon interaction due to the close critical line (and hypothetical QCD critical point) on the clustering are also studied.


title: Multi-quadratic $p$-rational Number Fields

abstract: For each odd prime $p$, we prove the existence of infinitely many real quadratic fields which are $p$-rational. Explicit imaginary and real bi-quadratic $p$-rational fields are also given for each prime $p$. Using a recent method developed by Greenberg, we deduce the existence of Galois extensions of $\mathbf{Q}$ with Galois group isomorphic to an open subgroup of $GL_n(\mathbf{Z_p})$, for $n =4$ and $n =5$ and at least for all the primes $p <192.699.943$.


title: A Deep Joint Sparse Non-negative Matrix Factorization Framework for Identifying the Common and Subject-specific Functional Units of Tongue Motion During Speech

abstract: Intelligible speech is produced by creating varying internal local muscle groupings -- i.e., functional units -- that are generated in a systematic and coordinated manner. There are two major challenges in characterizing and analyzing functional units.~First, due to the complex and convoluted nature of tongue structure and function, it is of great importance to develop a method that can accurately decode complex muscle coordination patterns during speech. Second, it is challenging to keep identified functional units across subjects comparable due to their substantial variability. In this work, to address these challenges, we develop a new deep learning framework to identify common and subject-specific functional units of tongue motion during speech.~Our framework hinges on joint deep graph-regularized sparse non-negative matrix factorization (NMF) using motion quantities derived from displacements by tagged Magnetic Resonance Imaging. More specifically, we transform NMF with sparse and graph regularizations into modular architectures akin to deep neural networks by means of unfolding the Iterative Shrinkage-Thresholding Algorithm to learn interpretable building blocks and associated weighting map. We then apply spectral clustering to common and subject-specific weighting maps from which we jointly determine the common and subject-specific functional units. Experiments carried out with simulated datasets show that the proposed method achieved on par or better clustering performance over the comparison methods. Experiments carried out with in vivo tongue motion data show that the proposed method can determine the common and subject-specific functional units with increased interpretability and decreased size variability.


title: Thermal dissipation as both the strength and weakness of matter. A material failure prediction by monitoring creep

abstract: In any domain involving some stressed solids, that is, from seismology to general engineering, the strength of matter is a paramount feature to understand. We here discuss the ability of a simple thermally activated sub-critical model, that includes the auto-induced thermal evolution of cracks tips, to predict the catastrophic failure of a vast range of materials. It is in particular shown that the intrinsic surface energy barrier, for breaking the atomic bonds of many solids, can be easily deduced from the slow creeping dynamics of a crack. This intrinsic barrier is however higher than the macroscopic load threshold at which brittle matter brutally fails, possibly as a result of thermal activation and of a thermal weakening mechanism. We propose a novel method to compute the macroscopic critical energy release rate of rupture, G_a, solely from monitoring slow creep, and show that this reproduces the experimental values within 50% accuracy over twenty different materials, and over more than four decades of fracture energy.


title: Stable small spatial hairs in a power-law k-inflation model

abstract: In this paper, we extend our investigation of the validity of the cosmic no-hair conjecture within non-canonical anisotropic inflation. As a result, we are able to figure out an exact Bianchi type I solution to a power-law {\it k}-inflation model in the presence of unusual coupling between scalar and electromagnetic fields as $-f^2(\phi)F_{\mu\nu}F^{\mu\nu}/4$. Furthermore, stability analysis based on the dynamical system method indicates that the obtained solution does admit stable and attractive hairs during an inflationary phase and therefore violates the cosmic no-hair conjecture. Finally, we show that the corresponding tensor-to-scalar ratio of this model turns out to be highly consistent with the observational data of the Planck 2018.


title: Performance and energy consumption of HPC workloads on a cluster based on Arm ThunderX2 CPU

abstract: In this paper, we analyze the performance and energy consumption of an Arm-based high-performance computing (HPC) system developed within the European project Mont-Blanc 3. This system, called Dibona, has been integrated by ATOS/Bull, and it is powered by the latest Marvell's CPU, ThunderX2. This CPU is the same one that powers the Astra supercomputer, the first Arm-based supercomputer entering the Top500 in November 2018. We study from micro-benchmarks up to large production codes. We include an interdisciplinary evaluation of three scientific applications (a finite-element fluid dynamics code, a smoothed particle hydrodynamics code, and a lattice Boltzmann code) and the Graph 500 benchmark, focusing on parallel and energy efficiency as well as studying their scalability up to thousands of Armv8 cores. For comparison, we run the same tests on state-of-the-art x86 nodes included in Dibona and the Tier-0 supercomputer MareNostrum4. Our experiments show that the ThunderX2 has a 25% lower performance on average, mainly due to its small vector unit yet somewhat compensated by its 30% wider links between the CPU and the main memory. We found that the software ecosystem of the Armv8 architecture is comparable to the one available for Intel. Our results also show that ThunderX2 delivers similar or better energy-to-solution and scalability, proving that Arm-based chips are legitimate contenders in the market of next-generation HPC systems.


title: Survey of CO$_2$ radiation experimental data

abstract: This paper focuses on a survey of experimental data related to radiation into CO$_2$ plasma flows, which are encountered during Mars and Venus entries. The review emphasizes on VUV and IR radiation, since recent experimental efforts has been devoted to these wavelength ranges. The main objective of the study is to identify the most attractive datasets for future cross-check comparisons with the results obtained during future test campaigns with ESTHER shock-tube. The survey accounts for the results obtained in shock-tubes, expansion tube and plasma arc-jets for Mars and Venus test campaigns. The experimental results obtained for propulsion related studies have also been considered.


title: Decision making via generalized Bajraktarevi\'c means

abstract: We define decision-making functions which arise from studying the multidimensional generalization of the weighted Bajraktarevi\'c means. It allows a nonlinear approach to optimization problems. These functions admit several interesting (from the point of view of decision-making) properties, for example, delegativity (which states that each subgroup of decision-makers can aggregate their decisions and efforts), casuativity (each decision affects the final outcome except two trivial cases) and convexity-type properties. Beyond establishing the most important properties of such means, we solve their equality problem, we introduce a notion of synergy and characterize the null-synergy decision-making functions of this type.


title: Subject-Aware Contrastive Learning for Biosignals

abstract: Datasets for biosignals, such as electroencephalogram (EEG) and electrocardiogram (ECG), often have noisy labels and have limited number of subjects (<100). To handle these challenges, we propose a self-supervised approach based on contrastive learning to model biosignals with a reduced reliance on labeled data and with fewer subjects. In this regime of limited labels and subjects, intersubject variability negatively impacts model performance. Thus, we introduce subject-aware learning through (1) a subject-specific contrastive loss, and (2) an adversarial training to promote subject-invariance during the self-supervised learning. We also develop a number of time-series data augmentation techniques to be used with the contrastive loss for biosignals. Our method is evaluated on publicly available datasets of two different biosignals with different tasks: EEG decoding and ECG anomaly detection. The embeddings learned using self-supervision yield competitive classification results compared to entirely supervised methods. We show that subject-invariance improves representation quality for these tasks, and observe that subject-specific loss increases performance when fine-tuning with supervised labels.


title: Lessons for quantum cosmology from anti-de Sitter black holes

abstract: Gravitational physics is arguably better understood in the presence of a negative cosmological constant than a positive one, yet there exist strong technical similarities between the two settings. These similarities can be exploited to enhance our understanding of the more speculative realm of quantum cosmology, building on robust results regarding anti-de Sitter black holes describing the thermodynamics of holographic quantum field theories. To this end, we study 4-dimensional gravitational path integrals in the presence of a negative cosmological constant, and with minisuperspace metrics. We put a special emphasis on boundary conditions and integration contours. The Hawking-Page transition is recovered and we find that below the minimum temperature required for the existence of black holes the corresponding saddle points become complex. When the asymptotic anti-de Sitter space is cut off at a finite distance, additional saddle points contribute to the partition function, albeit in a very suppressed manner. These findings have direct consequences for the no-boundary proposal in cosmology, because the anti-de Sitter calculation can be brought into one-to-one correspondence with a path integral for de Sitter space with Neumann conditions imposed at the nucleation of the universe. Our results lend support to recent implementations of the no-boundary proposal focusing on momentum conditions at the "big bang".


title: Invertible Zero-Shot Recognition Flows

abstract: Deep generative models have been successfully applied to Zero-Shot Learning (ZSL) recently. However, the underlying drawbacks of GANs and VAEs (e.g., the hardness of training with ZSL-oriented regularizers and the limited generation quality) hinder the existing generative ZSL models from fully bypassing the seen-unseen bias. To tackle the above limitations, for the first time, this work incorporates a new family of generative models (i.e., flow-based models) into ZSL. The proposed Invertible Zero-shot Flow (IZF) learns factorized data embeddings (i.e., the semantic factors and the non-semantic ones) with the forward pass of an invertible flow network, while the reverse pass generates data samples. This procedure theoretically extends conventional generative flows to a factorized conditional scheme. To explicitly solve the bias problem, our model enlarges the seen-unseen distributional discrepancy based on negative sample-based distance measurement. Notably, IZF works flexibly with either a naive Bayesian classifier or a held-out trainable one for zero-shot recognition. Experiments on widely-adopted ZSL benchmarks demonstrate the significant performance gain of IZF over existing methods, in both classic and generalized settings.