title: Retrieval Based Time Series Forecasting

abstract: Time series data appears in a variety of applications such as smart transportation and environmental monitoring. One of the fundamental problems for time series analysis is time series forecasting. Despite the success of recent deep time series forecasting methods, they require sufficient observation of historical values to make accurate forecasting. In other words, the ratio of the output length (or forecasting horizon) to the sum of the input and output lengths should be low enough (e.g., 0.3). As the ratio increases (e.g., to 0.8), the uncertainty for the forecasting accuracy increases significantly. In this paper, we show both theoretically and empirically that the uncertainty could be effectively reduced by retrieving relevant time series as references. In the theoretical analysis, we first quantify the uncertainty and show its connections to the Mean Squared Error (MSE). Then we prove that models with references are easier to learn than models without references since the retrieved references could reduce the uncertainty. To empirically demonstrate the effectiveness of the retrieval based time series forecasting models, we introduce a simple yet effective two-stage method, called ReTime consisting of a relational retrieval and a content synthesis. We also show that ReTime can be easily adapted to the spatial-temporal time series and time series imputation settings. Finally, we evaluate ReTime on real-world datasets to demonstrate its effectiveness.


title: Hypothesis Testing for Detecting Outlier Evaluators

abstract: In epidemiological studies, very often, evaluators obtain measurements of disease outcomes for study participants. In this paper, we propose a two-stage procedure for detecting outlier evaluators. In the first stage, a regression model is fitted to obtain the evaluators' effects. The outlier evaluators are considered as those with different effects compared with the normal evaluators. In the second stage, stepwise hypothesis testings are performed to detect outlier evaluators. The true positive rate and true negative rate of the proposed procedure are assessed in a simulation study. We apply the proposed method to detect potential outlier audiologists among the audiologists who measured hearing threshold levels of the participants in the Audiology Assessment Arm of the Conservation of Hearing Study, which is an epidemiological study for examining risk factors of hearing loss.


title: Molecular Design Based on Integer Programming and Quadratic Descriptors in a Two-layered Model

abstract: A novel framework has recently been proposed for designing the molecular structure of chemical compounds with a desired chemical property, where design of novel drugs is an important topic in bioinformatics and chemo-informatics. The framework infers a desired chemical graph by solving a mixed integer linear program (MILP) that simulates the computation process of a feature function defined by a two-layered model on chemical graphs and a prediction function constructed by a machine learning method. A set of graph theoretical descriptors in the feature function plays a key role to derive a compact formulation of such an MILP. To improve the learning performance of prediction functions in the framework maintaining the compactness of the MILP, this paper utilizes the product of two of those descriptors as a new descriptor and then designs a method of reducing the number of descriptors. The results of our computational experiments suggest that the proposed method improved the learning performance for many chemical properties and can infer a chemical structure with up to 50 non-hydrogen atoms.


title: Pareto Driven Surrogate (ParDen-Sur) Assisted Optimisation of Multi-period Portfolio Backtest Simulations

abstract: Portfolio management is a multi-period multi-objective optimisation problem subject to a wide range of constraints. However, in practice, portfolio management is treated as a single-period problem partly due to the computationally burdensome hyper-parameter search procedure needed to construct a multi-period Pareto frontier. This study presents the \gls{ParDen-Sur} modelling framework to efficiently perform the required hyper-parameter search. \gls{ParDen-Sur} extends previous surrogate frameworks by including a reservoir sampling-based look-ahead mechanism for offspring generation in \glspl{EA} alongside the traditional acceptance sampling scheme. We evaluate this framework against, and in conjunction with, several seminal \gls{MO} \glspl{EA} on two datasets for both the single- and multi-period use cases. Our results show that \gls{ParDen-Sur} can speed up the exploration for optimal hyper-parameters by almost $2\times$ with a statistically significant improvement of the Pareto frontiers, across multiple \glspl{EA}, for both datasets and use cases.


title: Deep Cross-Modality and Resolution Graph Integration for Universal Brain Connectivity Mapping and Augmentation

abstract: The connectional brain template (CBT) captures the shared traits across all individuals of a given population of brain connectomes, thereby acting as a fingerprint. Estimating a CBT from a population where brain graphs are derived from diverse neuroimaging modalities (e.g., functional and structural) and at different resolutions (i.e., number of nodes) remains a formidable challenge to solve. Such network integration task allows for learning a rich and universal representation of the brain connectivity across varying modalities and resolutions. The resulting CBT can be substantially used to generate entirely new multimodal brain connectomes, which can boost the learning of the downs-stream tasks such as brain state classification. Here, we propose the Multimodal Multiresolution Brain Graph Integrator Network (i.e., M2GraphIntegrator), the first multimodal multiresolution graph integration framework that maps a given connectomic population into a well centered CBT. M2GraphIntegrator first unifies brain graph resolutions by utilizing resolution-specific graph autoencoders. Next, it integrates the resulting fixed-size brain graphs into a universal CBT lying at the center of its population. To preserve the population diversity, we further design a novel clustering-based training sample selection strategy which leverages the most heterogeneous training samples. To ensure the biological soundness of the learned CBT, we propose a topological loss that minimizes the topological gap between the ground-truth brain graphs and the learned CBT. Our experiments show that from a single CBT, one can generate realistic connectomic datasets including brain graphs of varying resolutions and modalities. We further demonstrate that our framework significantly outperforms benchmarks in reconstruction quality, augmentation task, centeredness and topological soundness.


title: Meta-RegGNN: Predicting Verbal and Full-Scale Intelligence Scores using Graph Neural Networks and Meta-Learning

abstract: Decrypting intelligence from the human brain construct is vital in the detection of particular neurological disorders. Recently, functional brain connectomes have been used successfully to predict behavioral scores. However, state-of-the-art methods, on one hand, neglect the topological properties of the connectomes and, on the other hand, fail to solve the high inter-subject brain heterogeneity. To address these limitations, we propose a novel regression graph neural network through meta-learning namely Meta-RegGNN for predicting behavioral scores from brain connectomes. The parameters of our proposed regression GNN are explicitly trained so that a small number of gradient steps combined with a small training data amount produces a good generalization to unseen brain connectomes. Our results on verbal and full-scale intelligence quotient (IQ) prediction outperform existing methods in both neurotypical and autism spectrum disorder cohorts. Furthermore, we show that our proposed approach ensures generalizability, particularly for autistic subjects. Our Meta-RegGNN source code is available at https://github.com/basiralab/Meta-RegGNN.


title: Analysis of Reinforcement Learning for determining task replication in workflows

abstract: Executing workflows on volunteer computing resources where individual tasks may be forced to relinquish their resource for the resource's primary use leads to unpredictability and often significantly increases execution time. Task replication is one approach that can ameliorate this challenge. This comes at the expense of a potentially significant increase in system load and energy consumption. We propose the use of Reinforcement Learning (RL) such that a system may `learn' the `best' number of replicas to run to increase the number of workflows which complete promptly whilst minimising the additional workload on the system when replicas are not beneficial. We show, through simulation, that we can save 34% of the energy consumption using RL compared to a fixed number of replicas with only a 4% decrease in workflows achieving a pre-defined overhead bound.


title: Toward Safe and Accelerated Deep Reinforcement Learning for Next-Generation Wireless Networks

abstract: Deep reinforcement learning (DRL) algorithms have recently gained wide attention in the wireless networks domain. They are considered promising approaches for solving dynamic radio resource management (RRM) problems in next-generation networks. Given their capabilities to build an approximate and continuously updated model of the wireless network environments, DRL algorithms can deal with the multifaceted complexity of such environments. Nevertheless, several challenges hinder the practical adoption of DRL in commercial networks. In this article, we first discuss two key practical challenges that are faced but rarely tackled when developing DRL-based RRM solutions. We argue that it is inevitable to address these DRL-related challenges for DRL to find its way to RRM commercial solutions. In particular, we discuss the need to have safe and accelerated DRL-based RRM solutions that mitigate the slow convergence and performance instability exhibited by DRL algorithms. We then review and categorize the main approaches used in the RRM domain to develop safe and accelerated DRL-based solutions. Finally, a case study is conducted to demonstrate the importance of having safe and accelerated DRL-based RRM solutions. We employ multiple variants of transfer learning (TL) techniques to accelerate the convergence of intelligent radio access network (RAN) slicing DRL-based controllers. We also propose a hybrid TL-based approach and sigmoid function-based rewards as examples of safe exploration in DRL-based RAN slicing.


title: Denoising Diffusion Error Correction Codes

abstract: Error correction code (ECC) is an integral part of the physical communication layer, ensuring reliable data transfer over noisy channels. Recently, neural decoders have demonstrated their advantage over classical decoding techniques. However, recent state-of-the-art neural decoders suffer from high complexity and lack the important iterative scheme characteristic of many legacy decoders. In this work, we propose to employ denoising diffusion models for the soft decoding of linear codes at arbitrary block lengths. Our framework models the forward channel corruption as a series of diffusion steps that can be reversed iteratively. Three contributions are made: (i) a diffusion process suitable for the decoding setting is introduced, (ii) the neural diffusion decoder is conditioned on the number of parity errors, which indicates the level of corruption at a given step, (iii) a line search procedure based on the code's syndrome obtains the optimal reverse diffusion step size. The proposed approach demonstrates the power of diffusion models for ECC and is able to achieve state of the art accuracy, outperforming the other neural decoders by sizable margins, even for a single reverse diffusion step.


title: The Zariski topology on the secondary like spectrum of a module

abstract: Let $R$ be a commutative ring with unity and $M$ be a left $R$-module. We define the secondary-like spectrum of $M$ to be the set of all secondary submodules $K$ of $M$ such that $Ann_R(soc(K))=\sqrt{Ann_R(K)}$, and we denote it by $Spec^L(M)$. In this paper, we introduce a topology on $Spec^L(M)$ having the Zariski topology on the second spectrum $Spec^s(M)$ as a subspace topology, and study several topological structures of this topology.


title: Drell-Yan cross-sections with fiducial cuts: impact of linear power corrections and $q_T$-resummation in PDF determination

abstract: Measurement at Hadron colliders of neutral- and charged-current Drell-Yan production provide essential constraints in the determination of parton distribution functions. Experimentally, they have reached percent level precision, challenging the accuracy of the theoretical predictions. In this work we benchmark the novel implementation in $\texttt{DYTurbo}$ of linear fiducial power corrections in the $q_T$-subtraction formalism at NLO and NNLO in QCD. We illustrate how the inclusion of linear fiducial power corrections impacts predictions for precise $W$ and $Z$ measurements from the LHC and affects their description by modern global parton distribution functions. The further inclusion of $q_T$-resummation corrections in the theoretical predictions leads to a better modelling of the lepton $p_T$ distribution and we study how this improve the description of the data.


title: Transmit Power Control for Indoor Small Cells: A Method Based on Federated Reinforcement Learning

abstract: Setting the transmit power setting of 5G cells has been a long-term topic of discussion, as optimized power settings can help reduce interference and improve the quality of service to users. Recently, machine learning (ML)-based, especially reinforcement learning (RL)-based control methods have received much attention. However, there is little discussion about the generalisation ability of the trained RL models. This paper points out that an RL agent trained in a specific indoor environment is room-dependent, and cannot directly serve new heterogeneous environments. Therefore, in the context of Open Radio Access Network (O-RAN), this paper proposes a distributed cell power-control scheme based on Federated Reinforcement Learning (FRL). Models in different indoor environments are aggregated to the global model during the training process, and then the central server broadcasts the updated model back to each client. The model will also be used as the base model for adaptive training in the new environment. The simulation results show that the FRL model has similar performance to a single RL agent, and both are better than the random power allocation method and exhaustive search method. The results of the generalisation test show that using the FRL model as the base model improves the convergence speed of the model in the new environment.


title: Sensing Multi-modal Mobility Patterns: A Case Study of Helsinki using Bluetooth Beacons and a Mobile Application

abstract: Detailed understanding of multi-modal mobility patterns within urban areas is crucial for public infrastructure planning, transportation management, and designing public transport (PT) services centred on users' needs. Yet, even with the rise of ubiquitous computing, sensing urban mobility patterns in a timely fashion remains a challenge. Traditional data sources fail to fully capture door-to-door trajectories and rely on a set of models and assumptions to fill their gaps. This study focuses on a new type of data source that is collected through the mobile ticketing app of HSL, the local PT operator of the Helsinki capital region. HSL's dataset called TravelSense, records anonymized travelers' movements within the Helsinki region by means of Bluetooth beacons, mobile phone GPS, and phone OS activity detection. In this study, TravelSense dataset is processed and analyzed to reveal spatio-temporal mobility patterns as part of investigating its potentials in mobility sensing efforts. The representativeness of the dataset is validated with two external data sources - mobile phone trip data (for demand patterns) and travel survey data (for modal share). Finally, practical perspectives that this dataset can yield are presented through a preliminary analysis of PT transfers in multimodal trips within the study area.


title: Mathematics and Flamenco: An Unexpected Partnership

abstract: In this paper, we present a series of mathematical problems which throw interesting lights on flamenco music. More specifically, these are problems in discrete and computational mathematics suggested by an analytical (not compositional) examination of flamenco ``cante'' (singing). As a consequence, since the problems are taken from a culturally specific context, the examples can make more effective mathematics education.


title: Spiking GATs: Learning Graph Attentions via Spiking Neural Network

abstract: Graph Attention Networks (GATs) have been intensively studied and widely used in graph data learning tasks. Existing GATs generally adopt the self-attention mechanism to conduct graph edge attention learning, requiring expensive computation. It is known that Spiking Neural Networks (SNNs) can perform inexpensive computation by transmitting the input signal data into discrete spike trains and can also return sparse outputs. Inspired by the merits of SNNs, in this work, we propose a novel Graph Spiking Attention Network (GSAT) for graph data representation and learning. In contrast to self-attention mechanism in existing GATs, the proposed GSAT adopts a SNN module architecture which is obvious energy-efficient. Moreover, GSAT can return sparse attention coefficients in natural and thus can perform feature aggregation on the selective neighbors which makes GSAT perform robustly w.r.t graph edge noises. Experimental results on several datasets demonstrate the effectiveness, energy efficiency and robustness of the proposed GSAT model.


title: FORLORN: A Framework for Comparing Offline Methods and Reinforcement Learning for Optimization of RAN Parameters

abstract: The growing complexity and capacity demands for mobile networks necessitate innovative techniques for optimizing resource usage. Meanwhile, recent breakthroughs have brought Reinforcement Learning (RL) into the domain of continuous control of real-world systems. As a step towards RL-based network control, this paper introduces a new framework for benchmarking the performance of an RL agent in network environments simulated with ns-3. Within this framework, we demonstrate that an RL agent without domain-specific knowledge can learn how to efficiently adjust Radio Access Network (RAN) parameters to match offline optimization in static scenarios, while also adapting on the fly in dynamic scenarios, in order to improve the overall user experience. Our proposed framework may serve as a foundation for further work in developing workflows for designing RL-based RAN control algorithms.


title: A Proof for the Collatz Conjecture

abstract: It is well known that the following Collatz Conjecture is one of the unsolved problems in mathematics. Collatz Conjecture: For any positive integer $n>1$, the following recursive algorithm will convergent to 1 by a finite number of steps. A) If $n$ is an even number then $n/2 \to n$, B) If $n$ is an odd number then $3n+1 \to n$. This paper proposes a proof for the Collatz Conjecture by the elementary mathematical induction.


title: EmpathicSchool: A multimodal dataset for real-time facial expressions and physiological data analysis under different stress conditions

abstract: Affective computing has garnered researchers' attention and interest in recent years as there is a need for AI systems to better understand and react to human emotions. However, analyzing human emotions, such as mood or stress, is quite complex. While various stress studies use facial expressions and wearables, most existing datasets rely on processing data from a single modality. This paper presents EmpathicSchool, a novel dataset that captures facial expressions and the associated physiological signals, such as heart rate, electrodermal activity, and skin temperature, under different stress levels. The data was collected from 20 participants at different sessions for 26 hours. The data includes nine different signal types, including both computer vision and physiological features that can be used to detect stress. In addition, various experiments were conducted to validate the signal quality.


title: Collective risk models with FGM dependence

abstract: We study copula-based collective risk models when the dependence structure is defined by a Farlie-Gumbel-Morgenstern (FGM) copula. By leveraging a one-to-one correspondence between the class of FGM copulas and multivariate symmetric Bernoulli distributions, we find convenient representations for the moments and Laplace-Stieltjes transform for the aggregate random variable defined from collective risk models with FGM dependence. We examine different components of this collective risk model, aiming to have a better understanding of the impact of the assumed dependence between the frequency and severity of a claim. Relying on stochastic ordering, we analyze the impact of dependence on the aggregate claim rv $S$. Even if the FGM copula may only induce moderate dependence, we illustrate through numerical examples that the cumulative effect of dependence can generate large ranges of values for the expected value, the standard deviation, the Tail-Value-at-Risk and the entropic risk measure of aggregate claim random variables within these collective risk models. Finally, we leave the theoretical setting to investigate the collective risk model with FGM dependence with observed data.


title: Multi-spacecraft observations of shocklets at an interplanetary shock

abstract: Interplanetary (IP) shocks are fundamental building blocks of the heliosphere, and the possibility to observe them \emph{in-situ} is crucial to address important aspects of energy conversion for a variety of astrophysical systems. Steepened waves known as shocklets are known to be important structures of planetary bow shocks, but they are very rarely observed related to IP shocks. We present here the first multi-spacecraft observations of shocklets observed by upstream of an unusually strong IP shock observed on November 3rd 2021 by several spacecraft at L1 and near-Earth solar wind. The same shock was detected also by radially aligned Solar Orbiter at 0.8 AU from the Sun, but no shocklets were identified from its data, introducing the possibility to study the environment in which shocklets developed. The Wind spacecraft has been used to characterise the shocklets, associated with pre-conditioning of the shock upstream by decelerating incoming plasma in the shock normal direction. Finally, using the Wind observations together with ACE and DSCOVR spacecraft at L1, as well as THEMIS B and THEMIS C in the near-Earth solar wind, the portion of interplanetary space filled with shocklets is addressed, and a lower limit for its extent is estimated to be of about 110 $R_E$ in the shock normal direction and 25 $R_E$ in the directions transverse to the shock normal. Using multiple spacecraft also reveals that for this strong IP shock, shocklets are observed for a large range of local obliquity estimates (9-64 degrees).


title: The Proximal Map of the Weighted Mean Absolute Error

abstract: We investigate the proximal map for the weighted mean absolute error function. An algorithm for its efficient and vectorized evaluation is presented. As a demonstration, this algorithm is applied as part of a checkerboard algorithm to solve a total-variation image denoising (ROF) problem as well as a non-smooth energy minimization problem.


title: Quantitative flow visualization by hidden grid background oriented schlieren

abstract: The paper introduces hidden grid background oriented schlieren for quantitative study and visualization of natural convection heat transfer. In this technique, the refractive index variation, induced by the temperature gradient, is encoded in the recorded signal phase through the distortion of a background pattern. The background (undistorted) pattern is implicit (or hidden) in the light source. Quantitative estimation of the phase map is obtained by windowed Fourier transform. This method offers localized processing of the signal using joint space-frequency representation. The performance of hidden grid background oriented schlieren is practically demonstrated by investigating natural convective flow, a demanding task due to its comparatively small heat transfer.


title: Interactivism in Spoken Dialogue Systems

abstract: The interactivism model introduces a dynamic approach to language, communication and cognition. In this work, we explore this fundamental theory in the context of dialogue modelling for spoken dialogue systems (SDS). To extend such a theoretical framework, we present a set of design principles which adhere to central psycholinguistic and communication theories to achieve interactivism in SDS. From these, key ideas are linked to constitute the basis of our proposed design principles.


title: Dynamical friction of a massive black hole in a turbulent gaseous medium

abstract: The orbital decay of massive black holes in galaxies in the aftermath of mergers is at the heart of whether massive black holes successfully pair and merge, leading to emission of low-frequency gravitational waves. The role of dynamical friction sourced from the gas distribution has been uncertain because many analytical and numerical studies have either focussed on a homogeneous medium or have not reached resolutions below the scales relevant to the problem, namely the Bondi-Hoyle-Lyttleton radius. We performed numerical simulations of a massive black hole moving in a turbulent medium in order to study dynamical friction from turbulent gas. We find that the black hole slows down to the sound speed, rather than the turbulent speed, and that the orbital decay is well captured if the Bondi-Hoyle-Lyttleton radius is resolved with at least five resolution elements. We find that the larger the turbulent eddies, the larger the scatter in dynamical friction magnitude, because of the stochastic nature of the problem, and also because of the larger over- and under-densities encountered by the black hole along its trajectory. Compared to the classic solution in a homogeneous medium, the magnitude of the force depends more weakly on the Mach number, and dynamical friction is overall more efficient for high Mach numbers, but less efficient towards and at the transonic regime.


title: Structural Design of Non-Uniform Linear Arrays for Favorable Propagation in Massive MIMO

abstract: Favorable propagation (FP) for massive multiple-input multiple-output (MIMO) systems with uniform and non-uniform linear arrays is considered. A gap in the existing FP studies of uniform linear arrays is identified, which is related to the existence of grating lobes in the array pattern and which results in the FP condition being violated, even under distinct angles of arrival. A novel analysis and design of \textit{non-uniform} linear arrays are proposed to cancel grating lobes and to restore favorable propagation for \textit{all} distinct angles of arrival. This design is consistent with the popular hybrid beamforming paradigm and extends to multipath channels and arrays of directional elements.


title: Characterising small objects in the regime between the eddy current model and wave propagation

abstract: Being able to characterise objects at low frequencies, but above the limiting frequency of the eddy current approximation of the Maxwell system, is important for improving current metal detection technologies. Importantly, the upper frequency limit of the eddy current model depends on the object topology and on its materials, with the maximum frequency being much smaller for certain geometries compared to others of the same size and materials. Additionally, the eddy current model breaks down at much smaller frequencies for highly magnetic conducting materials compared to non-permeable objects (with similar conductivities, sizes and shapes) and, hence, characterising small magnetic objects made of permeable materials using the eddy current at typical frequencies of operation for a metal detector is not always possible. To address this, we derive a new asymptotic expansion for permeable highly conducting objects that is valid for small objects and holds for frequencies just beyond the eddy current limit. The leading order term we derive leads to new forms of object characterisations in terms of polarizability tensor object descriptions where the coefficients can be obtained from solving vectorial transmission problems. We expect these new characterisations to be important when considering objects at greater stand-off distance from the coils, which is important for safety critical applications, such as the identification of landmines, unexploded ordnance and concealed weapons. We also expect our results to be important when characterising artefacts of archaeological and forensic significance at greater depths than the eddy current model allows and to have further applications parking sensors and improving the detection of hidden, out-of-sight, metallic objects.


title: Reconstructing physical parameters from template gravitational wave spectra at LISA: first order phase transitions

abstract: A gravitational wave background from a first order phase transition in the early universe may be observable at millihertz gravitational wave (GW) detectors such as the Laser Interferometer Space Antenna (LISA). In this paper we introduce and test a method for investigating LISA's sensitivity to gravitational waves from a first order phase transition using parametrised templates as an approximation to a more complete physical model. The motivation for developing the method is to provide a less computationally intensive way to perform Markov Chain Monte Carlo (MCMC) inference on the thermodynamic parameters of a first order phase transition, or on generally computationally intensive models. Starting from a map between the physical parameters and the parameters of an empirical template, we first construct a prior on the empirical parameters that contains the necessary information about the physical parameters; we then use the inverse mapping to reconstruct approximate posteriors on the physical parameters from a fast MCMC on the empirical template. We test the method on a double broken power law approximation to spectra in the sound shell model. The reconstruction method substantially reduces the proposal evaluation time, and despite requiring some precomputing of the mapping, this method is still cost-effective overall. In two test cases, with signal-to-noise $\sim 40$, the method recovers the physical parameters and the spectrum of the injected gravitational wave power spectrum to $95\%$ confidence. In previous Fisher matrix analysis we found the phase boundary speed $v_{\rm w}$ was expected to be the best constrained of the thermodynamic parameters. In this work, for an injected phase transition GW power spectrum with $v_{\rm w} = 0.55$, with a direct sample on the thermodynamic parameters we recover $0.630^{+0.17}_{-0.059}$ and for our reconstructed sample $0.646^{+0.098}_{-0.075}$.


title: A non-existence result for a nonlinear Neumann problem

abstract: In this note we consider a semilinear elliptic equation in $B_R$ with the nonlinear boundary condition, where $B_R$ is a ball of radius $R$. Under certain conditions, we establish a sufficient condition on the non-existence of solutions provided that $R$ is sufficiently large. The main argument is based on applying the asymptotic analysis to the equation with respect to $R\gg1$.


title: Source detection via multi-label classification

abstract: Radio source detection through conventional algorithms has been unreliable when trying to solve for large number of sources in the presence of low SINR and less number of snapshots. We address this by reformulating source detection as a multi-class classification problem solved using deep learning frameworks. Incoming waveforms are sampled using a centrosymmetric linear array with omni-directional elements and the normalized upper triangle of the autocorrelation matrix is extracted as the input feature to a modified convolutional neural network with uni-dimensional filters, trained to detect the sources in the presence of both uncorrelated and correlated signals. Two detection algorithms are introduced and referred to as CNNDetector and RadioNet, and subsequently benchmarked against the conventional source detection algorithms. By including preprocessing in forward backward spatial smoothing, RadioNet can also resolve the number of uncorrelated sources in the presence of correlated paths. Finally, the algorithms are stress tested under challenging operational conditions and extensive evaluations are presented showing the efficacy and contributions of the introduced predictive models.


title: Existence Result For a Model Coupling a Quasi-Linear Parabolic Equation and a Linear Hyperbolic System

abstract: We prove globally-in-time existence of solution for a problem coupling the linear Lam\'e system and the quasi-linear Stokes equation. A solution of this global coupled problem is viewed as the fixed point of some non-linear operator $T$. We construct, using a regularization procedure, a sequence $(T^\epsilon)_\epsilon$ of auxiliary approximating compact operators. Then we establish, using a combination of Banach and Schaeffer fixed point theorems, the existence of fixed points to every operator $T^\epsilon$. Finally we prove that these fixed points converge to the fixed point of $T$


title: Escaping saddle points in zeroth-order optimization: the power of two-point estimators

abstract: Two-point zeroth order methods are important in many applications of zeroth-order optimization, such as robotics, wind farms, power systems, online optimization, and adversarial robustness to black-box attacks in deep neural networks, where the problem may be high-dimensional and/or time-varying. Most problems in these applications are nonconvex and contain saddle points. While existing works have shown that zeroth-order methods utilizing $\Omega(d)$ function valuations per iteration (with $d$ denoting the problem dimension) can escape saddle points efficiently, it remains an open question if zeroth-order methods based on two-point estimators can escape saddle points. In this paper, we show that by adding an appropriate isotropic perturbation at each iteration, a zeroth-order algorithm based on $2m$ (for any $1 \leq m \leq d$) function evaluations per iteration can not only find $\epsilon$-second order stationary points polynomially fast, but do so using only $\tilde{O}\left(\frac{d}{m\epsilon^{2}\bar{\psi}}\right)$ function evaluations, where $\bar{\psi} \geq \tilde{\Omega}\left(\sqrt{\epsilon}\right)$ is a parameter capturing the extent to which the function of interest exhibits the strict saddle property.


title: Contrast Pattern Mining: A Survey

abstract: Contrast pattern mining (CPM) is an important and popular subfield of data mining. Traditional sequential patterns cannot describe the contrast information between different classes of data, while contrast patterns involving the concept of contrast can describe the significant differences between datasets under different contrast conditions. Based on the number of papers published in this field, we find that researchers' interest in CPM is still active. Since CPM has many research questions and research methods. It is difficult for new researchers in the field to understand the general situation of the field in a short period of time. Therefore, the purpose of this article is to provide an up-to-date comprehensive and structured overview of the research direction of contrast pattern mining. First, we present an in-depth understanding of CPM, including basic concepts, types, mining strategies, and metrics for assessing discriminative ability. Then we classify CPM methods according to their characteristics into boundary-based algorithms, tree-based algorithms, evolutionary fuzzy system-based algorithms, decision tree-based algorithms, and other algorithms. In addition, we list the classical algorithms of these methods and discuss their advantages and disadvantages. Advanced topics in CPM are presented. Finally, we conclude our survey with a discussion of the challenges and opportunities in this field.


title: Polymer informatics at-scale with multitask graph neural networks

abstract: Artificial intelligence-based methods are becoming increasingly effective at screening libraries of polymers down to a selection that is manageable for experimental inquiry. The vast majority of presently adopted approaches for polymer screening rely on handcrafted chemostructural features extracted from polymer repeat units -- a burdensome task as polymer libraries, which approximate the polymer chemical search space, progressively grow over time. Here, we demonstrate that directly "machine-learning" important features from a polymer repeat unit is a cheap and viable alternative to extracting expensive features by hand. Our approach -- based on graph neural networks, multitask learning, and other advanced deep learning techniques -- speeds up feature extraction by one to two orders of magnitude relative to presently adopted handcrafted methods without compromising model accuracy for a variety of polymer property prediction tasks. We anticipate that our approach, which unlocks the screening of truly massive polymer libraries at scale, will enable more sophisticated and large scale screening technologies in the field of polymer informatics.


title: FreeSeg: Free Mask from Interpretable Contrastive Language-Image Pretraining for Semantic Segmentation

abstract: Fully supervised semantic segmentation learns from dense masks, which requires heavy annotation cost for closed set. In this paper, we use natural language as supervision without any pixel-level annotation for open world segmentation. We call the proposed framework as FreeSeg, where the mask is freely available from raw feature map of pretraining model. Compared with zero-shot or openset segmentation, FreeSeg doesn't require any annotated masks, and it widely predicts categories beyond class-agnostic unsupervised segmentation. Specifically, FreeSeg obtains free mask from Image-Text Similarity Map (ITSM) of Interpretable Contrastive Language-Image Pretraining (ICLIP). And our core improvements are the smoothed min pooling for dense ICLIP, with the partial label and pixel strategies for segmentation. Furthermore, FreeSeg is very straight forward without complex design like grouping, clustering or retrieval. Besides the simplicity, the performances of FreeSeg surpass previous state-of-the-art at large margins, e.g. 13.4% higher at mIoU on VOC dataset in the same settings.


title: Quantum Criticality of Liquid-Gas Transition in a Binary Bose Mixture

abstract: Quantum liquid, in the form of a self-bound droplet, is stabilized by a subtle balance between the mean-field contribution and quantum fluctuations. While a liquid-gas transition is expected when such a balance is broken, it remains elusive whether liquid-gas critical points exist in the quantum regime. Here we study the quantum criticality in a binary Bose mixture undergoing the liquid-gas transition. We show that, beyond a narrow stability window of the self-bound liquid, a liquid-gas coexistence persists, which eventually transits into a homogeneous mixture. Importantly, we identify two distinct critical points where the liquid-gas coexistence terminates. These critical points are characterized by rich critical behaviors in their vicinity, including divergent susceptibility, unique phonon-mode softening, and enhanced density correlations. The liquid-gas transition and the critical points can be readily explored in ultracold atoms confined to a box potential. Our work highlights the thermodynamic approach as a powerful tool in revealing the quantum liquid-gas criticality, and paves the way for further studies of critical phenomena in quantum liquids.


title: Mutation Effect Generalizability under Selection-Drift

abstract: While Neutral Theory famously describes the number of discrete genetic differences in populations, we consider the number of genetic backgrounds under which such differences are observed - setting limits to the generalizability of their effects. This allow us to determine which population structures and diversity rates have maximal effect generalization across (1) environmental and (2) genetic variation, and to demonstrate that they correspond asymptotically to those of populations under (1) natural selection and (2) drift. At the same time, these results suggest distinct limits to the predictability of fitness and evolution across evolutionary regimes. We employ both broad time, large-scale genome sequencing datasets (including whole-genome autocorrelation calculations), and fine time-scale barcoding experiments.


title: Adapting Brain-Like Neural Networks for Modeling Cortical Visual Prostheses

abstract: Cortical prostheses are devices implanted in the visual cortex that attempt to restore lost vision by electrically stimulating neurons. Currently, the vision provided by these devices is limited, and accurately predicting the visual percepts resulting from stimulation is an open challenge. We propose to address this challenge by utilizing 'brain-like' convolutional neural networks (CNNs), which have emerged as promising models of the visual system. To investigate the feasibility of adapting brain-like CNNs for modeling visual prostheses, we developed a proof-of-concept model to predict the perceptions resulting from electrical stimulation. We show that a neurologically-inspired decoding of CNN activations produces qualitatively accurate phosphenes, comparable to phosphenes reported by real patients. Overall, this is an essential first step towards building brain-like models of electrical stimulation, which may not just improve the quality of vision provided by cortical prostheses but could also further our understanding of the neural code of vision.


title: Loop Quantum Gravity motivated multihorizon rotating black holes

abstract: With a semiclassical polymerization in the loop quantum gravity (LQG), the interior of Schwarzschild black holes provides a captivating single-horizon regular black hole spacetime. The shortage of rotating black hole models in loop quantum gravity (LQG) substantially restrains the progress of testing LQG from observations. Motivated by this, starting with a spherical LQG black hole as a seed metric, we construct a rotating spacetime using the revised Newman-Janis algorithm, namely, the LQG-motivated rotating black holes (LMRBH), which encompasses Kerr ($l=0$) black holes as an exceptional case. We discover that for any random $l>0$, unlike Kerr black hole, an extremal LMRBH refers to a black hole with angular momentum $a>M$. The rotating metric, in parameter space, describes (1) black holes with an event and Cauchy horizons, (2) black holes with three horizons, (3) black holes with only one horizon or (4) no horizon spacetime. We also discuss the horizon and global structure of the LMRBH spacetimes and its dependence on $l/M$ that exhibits rich spacetime structures in the ($M,\;a,\;l$) parameter space.


title: The asymptotic number of score sequences

abstract: A tournament on a graph is an orientation of its edges. The score sequence lists the in-degrees in non-decreasing order. Works by Winston and Kleitman (1983) and Kim and Pittel (2000) showed that the number $S_n$ of score sequences on the complete graph $K_n$ satisfies $S_n=\Theta(4^n/n^{5/2})$. By combining a recent recurrence relation for $S_n$ in terms of the Erd\H{o}s--Ginzburg--Ziv numbers $N_n$ with the limit theory for discrete infinitely divisible distributions, we observe that $n^{5/2}S_n/4^n\to e^\lambda/2\sqrt{\pi}$, where $\lambda=\sum_{k=1}^\infty N_k/k4^k$. This limit agrees numerically with the asymptotics of $S_n$ conjectured by Tak\'acs (1986). We also identify the asymptotic number of strong score sequences, and show that the number of irreducible subscores in a random score sequence converges in distribution to a shifted negative binomial with parameters $r=2$ and $p=e^{-\lambda}$.


title: Partition Functions and Fibering Operators on the Coulomb Branch of 5d SCFTs

abstract: We study 5d $\mathcal{N}=1$ supersymmetric field theories on closed five-manifolds $\mathcal{M}_5$ which are principal circle bundles over simply-connected K\"ahler four-manifolds, $\mathcal{M}_4$, equipped with the Donaldson-Witten twist. We propose a new approach to compute the supersymmetric partition function on $\mathcal{M}_5$ through the insertion of a fibering operator, which introduces a non-trivial fibration over $\mathcal{M}_4$, in the 4d topologically twisted field theory. We determine the so-called Coulomb branch partition function on any such $\mathcal{M}_5$, which is conjectured to be the holomorphic `integrand' of the full partition function. We precisely match the low-energy effective field theory approach to explicit one-loop computations, and we discuss the effect of non-perturbative 5d BPS particles in this context. When $\mathcal{M}_4$ is toric, we also reconstruct our Coulomb branch partition function by appropriately gluing Nekrasov partition functions. As a by-product of our analysis, we provide strong new evidence for the validity of the Lockhart-Vafa formula for the five-sphere partition function.


title: Neural parameter calibration for large-scale multi-agent models

abstract: Computational models have become a powerful tool in the quantitative sciences to understand the behaviour of complex systems that evolve in time. However, they often contain a potentially large number of free parameters whose values cannot be obtained from theory but need to be inferred from data. This is especially the case for models in the social sciences, economics, or computational epidemiology. Yet many current parameter estimation methods are mathematically involved and computationally slow to run. In this paper we present a computationally simple and fast method to retrieve accurate probability densities for model parameters using neural differential equations. We present a pipeline comprising multi-agent models acting as forward solvers for systems of ordinary or stochastic differential equations, and a neural network to then extract parameters from the data generated by the model. The two combined create a powerful tool that can quickly estimate densities on model parameters, even for very large systems. We demonstrate the method on synthetic time series data of the SIR model of the spread of infection, and perform an in-depth analysis of the Harris-Wilson model of economic activity on a network, representing a non-convex problem. For the latter, we apply our method both to synthetic data and to data of economic activity across Greater London. We find that our method calibrates the model orders of magnitude more accurately than a previous study of the same dataset using classical techniques, while running between 195 and 390 times faster.


title: Non-standard neutrino interactions in light mediator models at reactor experiments

abstract: Compared to other neutrino sources, the huge anti-neutrino fluxes at nuclear reactor based experiments empower us to derive stronger bounds on non-standard interactions of neutrinos with electrons mediated by light scalar/vector mediators. At neutrino energy around $200$~keV reactor anti-neutrino flux is at least an order of magnitude larger compared to the solar flux. The atomic and crystal form factors of the detector materials related to the details of the atomic structure becomes relevant at this energy scale as the momentum transfers would be small. Non-standard neutrino-electron interaction mediated by light scalar/vector mediator arises naturally in many low-scale models. We also propose one such new model with a light scalar mediator. Here, we investigate the parameter space of such low-scale models in reactor based neutrino experiments with low threshold Ge and Si detectors, and find the prospect of probing/ruling out the relevant parameter space by finding the projected sensitivity at $90 \%$ confidence level by performing a $\chi^2$-analysis. We find that a detector capable of discriminating between electron recoil and nuclear recoil signal down to a very low threshold such as $5$~eV placed in reactor based experiment would be able to probe a larger region in parameter space compared to the previously explored region. A Ge (Si) detector with $10$~kg-yr exposure and 1 MW reactor anti-neutrino flux would be able to probe the scalar and vector mediators with masses below 1 keV for coupling products $\sqrt{g_\nu g_e}$ $\sim$ $1 \times 10^{-6}~(9.5 \times 10^{-7})$ and $1\times 10^{-7} ~(8\times 10^{-8})$, respectively.


title: Upper level sets of Lelong numbers on Hirzebruch surfaces

abstract: Let $\mathbb F_a$ denote the Hirzebruch surfaces and $\mathcal{T}_{\alpha,\alpha^{\prime}}(\mathbb{F}_{a})$ denotes the set of positive, closed $(1,1)$-currents on $\mathbb{F}_{a}$ whose cohomology class is $\alpha F+\alpha^{\prime} H$ where $F$ and $H$ generates the Picard group of $\mathbb F_a$. $E^+_{\beta}(T)$ denotes the upper level sets of Lelong numbers $\nu(T,x)$ of $T\in \mathcal{T}_{\alpha,\alpha^{\prime}}(\mathbb{F}_{a})$. When $a=0$, ($\mathbb F_a=\mathbb P^1\times \mathbb P^1$), for any current $T\in \mathcal T_{\alpha,\alpha'}(\mathbb P^1\times \mathbb P^1)$, we show that $E^{+}_{(\alpha+\alpha')/3}(T)$ is contained in a curve of total degree $2$, possibly except $1$ point. For any current $T\in \mathcal T_{\alpha,\alpha'}(\mathbb F_a)$, we show that $ E^{+}_{\beta}(T)$ is contained in either in a curve of bidegree $(0,1)$ or in $a+1$ curves of bidegree $(1,0)$ where $\beta\geq (\alpha + (a+1)\alpha^{\prime})/(a+2)$.


title: Hardy-Stein identity for pure-jump Dirichlet forms

abstract: We prove the $L^p$ variant of the Hardy-Stein identity for Sobolev-Bregman forms associated with pure-jump Dirichlet forms, under a rather mild assumptions. Along the way, we obtain a general result in terms of the $p$-form defined in a more abstract way.


title: Exploring Low Rank Training of Deep Neural Networks

abstract: Training deep neural networks in low rank, i.e. with factorised layers, is of particular interest to the community: it offers efficiency over unfactorised training in terms of both memory consumption and training time. Prior work has focused on low rank approximations of pre-trained networks and training in low rank space with additional objectives, offering various ad hoc explanations for chosen practice. We analyse techniques that work well in practice, and through extensive ablations on models such as GPT2 we provide evidence falsifying common beliefs in the field, hinting in the process at exciting research opportunities that still need answering.


title: Hierarchical Sliced Wasserstein Distance

abstract: Sliced Wasserstein (SW) distance has been widely used in different application scenarios since it can be scaled to a large number of supports without suffering from the curse of dimensionality. The value of sliced Wasserstein distance is the average of transportation cost between one-dimensional representations (projections) of original measures that are obtained by Radon Transform (RT). Despite its efficiency in the number of supports, estimating the sliced Wasserstein requires a relatively large number of projections in high-dimensional settings. Therefore, for applications where the number of supports is relatively small compared with the dimension, e.g., several deep learning applications where the mini-batch approaches are utilized, the complexities from matrix multiplication of Radon Transform become the main computational bottleneck. To address this issue, we propose to derive projections by linearly and randomly combining a smaller number of projections which are named bottleneck projections. We explain the usage of these projections by introducing Hierarchical Radon Transform (HRT) which is constructed by applying Radon Transform variants recursively. We then formulate the approach into a new metric between measures, named Hierarchical Sliced Wasserstein (HSW) distance. By proving the injectivity of HRT, we derive the metricity of HSW. Moreover, we investigate the theoretical properties of HSW including its connection to SW variants and its computational and sample complexities. Finally, we compare the computational cost and generative quality of HSW with the conventional SW on the task of deep generative modeling using various benchmark datasets including CIFAR10, CelebA, and Tiny ImageNet.


title: Uniformly Expanding Coupled Maps: Self-Consistent Transfer Operators and Propagation of Chaos

abstract: In this paper we study systems of $N$ uniformly expanding coupled maps when $N$ is finite but large. We introduce self-consistent transfer operators that approximate the evolution of measures under the dynamics, and quantify this approximation explicitly with respect to $N$. Using this result, we prove that uniformly expanding coupled maps satisfy propagation of chaos when $N\rightarrow \infty$, and characterize the absolutely continuous invariant measures for the finite dimensional system. The main working assumption is that the expansion is not too small and the strength of the interactions is not too large, although both can be of order one. In contrast with previous approaches, we do not require the coupled maps and the interactions to be identical. The technical advances that allow us to describe the system are: the introduction of a framework to study the evolution of conditional measures along some non-invariant foliations where the dependence of all estimates on the dimension is explicit; and the characterization of an invariant class of measures close to products that satisfy exponential concentration inequalities.


title: Probing Axions via Light Circular Polarization and Event Horizon Telescope

abstract: The impact of axion-like particles on the light polarization around the horizon of suppermassive black hole (SMBH) is discussed in the light of the latest polarization measurement of the Event Horizon Telescope (EHT). We investigate different sources of the polarization due to axion interaction with photons and the magnetic field of SMBH. These can modify the linear and circular polarization parameters of the emitted light. We have shown that a significant circular polarization can be produced via the photon scattering from the background magnetic field with axions as off-shell particles. This can further constrain the parameter space of ultralight axion-like particles and their couplings with photons. The future precise measurements of circular polarization can probe the features of ultralight axions in the near vicinity of SMBH.


title: Simulating the deposition of angular momentum by jets in common envelope evolution

abstract: We conducted three-dimensional hydrodynamical simulations of common envelope evolution (CEE) of a neutron star (NS) or a black hole (BH) inside a red supergiant (RSG) envelope and find that the jets that we expect the NS/BH to launch during the CEE spin-up the common envelope. We find that when the NS/BH launches jets that are exactly perpendicular to the orbital plane (the jets are aligned with the orbital angular momentum) the jets deposit angular momentum to the envelope that is aligned with the orbital angular momentum. When the jets' axis is inclined to the orbital angular momentum axis so is the angular momentum that the jets deposit to the envelope. Such tilted jets might be launched when the NS/BH has a close companion when it enters the RSG envelope. We did not allow for spiralling-in and could follow the evolution for only three orbits. The first orbit mimics the plunge-in phase of the CEE, when the NS/BH rapidly dives in, while the third orbit mimics the self-regulated phase when spiralling-in is very slow. We find that the jets deposit significant amount of angular momentum only during the plunge-in phase. A post-CEE core collapse supernova explosion will leave two NS/BH, bound or unbound, whose spin might be misaligned to the orbital angular momentum. Our results strengthen an earlier claim that inclined-triple-star CEE might lead to spin-orbit misalignment of NS/BH-NS/BH binary systems.


title: Long-term optical and $\gamma-$ray variability of the blazar PKS~1222+216

abstract: The $\gamma-$ray emission from flat-spectrum radio quasars (FSRQs) is thought to be dominated by the inverse Compton scattering of the external sources of photon fields, e.g., accretion disk, broad-line region (BLR), and torus. FSRQs show strong optical emission lines and hence can be a useful probe of the variability in BLR output, which is the reprocessed disk emission. We study the connection between the optical continuum, H$\gamma$ line, and $\gamma-$ray emissions from the FSRQ PKS~1222+216, using long-term ($\sim$2011-2018) optical spectroscopic data from Steward Observatory and $\gamma-$ray observations from $Fermi$-LAT. We measured the continuum ($F_{C,opt}$) and H$\gamma$ ($F_{H\gamma}$) fluxes by performing a systematic analysis of the 6029-6452 \r{A} optical spectra. We observed stronger variability in $F_{C,opt}$ than $F_{H\gamma}$, an inverse correlation between H$\gamma$ equivalent width and $F_{C,opt}$, and a redder-when-brighter trend. Using discrete cross-correlation analysis, we found a positive correlation (DCF$\sim$0.5) between $F_{\gamma-ray>100MeV}$ and $F_{C,opt}$ (6024-6092 \r{A}) light curves with time-lag consistent with zero at 2$\sigma$ level. We found no correlation between $F_{\gamma-ray>100MeV}$ and $F_{H\gamma}$ light curves, probably dismissing the disk contribution to the optical and $\gamma$-ray variability. The observed strong variability in the $Fermi$-LAT flux and $F_{\gamma-ray>100MeV}-F_{C,opt}$ correlation could be due to the changes in the particle acceleration at various epochs. We derived the optical-to-$\gamma$-ray spectral energy distributions (SEDs) during the $\gamma$-ray flaring and quiescent epochs that show a dominant disk component with no variability. Our study suggests that the $\gamma$-ray emission zone is likely located at the edge of the BLR or in the radiation field of the torus.


title: Efficient Non-Parametric Optimizer Search for Diverse Tasks

abstract: Efficient and automated design of optimizers plays a crucial role in full-stack AutoML systems. However, prior methods in optimizer search are often limited by their scalability, generability, or sample efficiency. With the goal of democratizing research and application of optimizer search, we present the first efficient, scalable and generalizable framework that can directly search on the tasks of interest. We first observe that optimizer updates are fundamentally mathematical expressions applied to the gradient. Inspired by the innate tree structure of the underlying math expressions, we re-arrange the space of optimizers into a super-tree, where each path encodes an optimizer. This way, optimizer search can be naturally formulated as a path-finding problem, allowing a variety of well-established tree traversal methods to be used as the search algorithm. We adopt an adaptation of the Monte Carlo method to tree search, equipped with rejection sampling and equivalent-form detection that leverage the characteristics of optimizer update rules to further boost the sample efficiency. We provide a diverse set of tasks to benchmark our algorithm and demonstrate that, with only 128 evaluations, the proposed framework can discover optimizers that surpass both human-designed counterparts and prior optimizer search methods.


title: Metrical almost periodicity: Levitan and Bebutov concepts

abstract: In this paper, we analyze Levitan and Bebutov metrical approximations of functions $F :\Lambda \times X \rightarrow Y$ by trigonometric polynomials and $\rho$-periodic type functions, where $\emptyset \neq \Lambda \subseteq {\mathbb R}^{n}$, $X$ and $Y$ are complex Banach spaces, and $\rho$ is a general binary relation on $Y$. We also analyze various classes of multi-dimensional Levitan almost periodic functions in general metric and multi-dimensional Bebutov uniformly recurrent functions in general metric. We provide several applications of our theoretical results to the abstract Volterra integro-differential equations and the partial differential equations.


title: The Coupling Effect: Experimental Validation of the Fusion of Fossen and Featherstone to Simulate UVMS Dynamics in Julia

abstract: As Underwater Vehicle Manipulator Systems (UVMSs) have gotten smaller and lighter over the past years, it is becoming increasingly important to consider the coupling forces between the manipulator and the vehicle when planning and controlling the system. A number of different models have been proposed, each using different rigid body dynamics or hydrodynamics algorithms, or purporting to consider different dynamic effects on the system, but most go without experimental validation of the full model, and in particular, of the coupling effect between the two systems. In this work, we return to a model combining Featherstone's rigid body dynamics algorithms with Fossen's equations for underwater dynamics by using the Julia package RigidBodyDynamics.jl. We compare the simulation's output with experimental results from pool trials with a ten degree of freedom UVMS that integrates a Reach Alpha manipulator with a BlueROV2. We validate the model's usefulness and identify its strengths and weaknesses in studying the dynamic coupling effect.


title: Learning When to Advise Human Decision Makers

abstract: Artificial intelligence (AI) systems are increasingly used for providing advice to facilitate human decision making in a wide range of domains, such as healthcare, criminal justice, and finance. Motivated by limitations of the current practice where algorithmic advice is provided to human users as a constant element in the decision-making pipeline, in this paper we raise the question of when should algorithms provide advice? We propose a novel design of AI systems in which the algorithm interacts with the human user in a two-sided manner and aims to provide advice only when it is likely to be beneficial for the user in making their decision. The results of a large-scale experiment show that our advising approach manages to provide advice at times of need and to significantly improve human decision making compared to fixed, non-interactive, advising approaches. This approach has additional advantages in facilitating human learning, preserving complementary strengths of human decision makers, and leading to more positive responsiveness to the advice.


title: Power-saving error terms for the number of $D_4$-quartic extensions over a number field ordered by discriminant

abstract: We study the asymptotic count of dihedral quartic extensions over a fixed number field with bounded norm of the relative discriminant. The main term of this count (including a summation formula for the constant) can be found in the literature (see Cohen--Diaz y Diaz--Olivier for the statement without proof and see Kl\"uners for a proof), but a power-saving for the error term has not been explicitly determined except in the case that the base field is $\mathbb{Q}$. In this article, we describe the argument for obtaining both the explicit main term and a power-saving error term for the number of $D_4$-quartic extensions over a general base number field ordered by the norms of their relative discriminants. We also give an extensive overview of the history and development of number field asymptotics.


title: Different types of weak amenability for Banach algebras

abstract: In this paper, we introduce and investigate the concepts of cyclically weakly amenable and point amenable. Then, we compare these concepts with the concepts of weakly amenable and cyclically amenable and find the relation between them. For example, we prove that a Banach algebra is weakly amenable if and only if it is both cyclically amenable and cyclically weakly amenable. In the case where $A$ is commutative, the weak amenability and cyclically weak amenability of $A$ are equivalent. We also show that if $A$ is a Banach algebra with $\Delta(A)\neq\emptyset$, then $A$ is cyclically weakly amenable if and only if $A$ is point amenable and essential. For a unital, commutative Banach algebra $A$, the notions of weakly amenable, cyclically weakly amenable and point amenable coincide. In this case, these are equivalent to the fact that every maximal ideal of $A$ is essential.


title: Analyzing Prospects for Quantum Advantage in Topological Data Analysis

abstract: Lloyd et al. were first to demonstrate the promise of quantum algorithms for computing Betti numbers, a way to characterize topological features of data sets. Here, we propose, analyze, and optimize an improved quantum algorithm for topological data analysis (TDA) with reduced scaling, including a method for preparing Dicke states based on inequality testing, a more efficient amplitude estimation algorithm using Kaiser windows, and an optimal implementation of eigenvalue projectors based on Chebyshev polynomials. We compile our approach to a fault-tolerant gate set and estimate constant factors in the Toffoli complexity. Our analysis reveals that super-quadratic quantum speedups are only possible for this problem when targeting a multiplicative error approximation and the Betti number grows asymptotically. Further, we propose a dequantization of the quantum TDA algorithm that shows that having exponentially large dimension and Betti number are necessary, but insufficient conditions, for super-polynomial advantage. We then introduce and analyze specific problem examples which have parameters in the regime where super-polynomial advantages may be achieved, and argue that quantum circuits with tens of billions of Toffoli gates can solve seemingly classically intractable instances.


title: Spin-charge separation and quantum spin Hall effect of $\beta$-bismuthene

abstract: Field theory arguments suggest the possibility of $\mathbb{Z}$-classification of quantum spin Hall effect with magnetic flux tubes, that cause separation of spin and charge degrees of freedom, and pumping of spin or Kramers pair. However, the \emph{proof of principle} demonstration of spin-charge separation is yet to be accomplished for realistic, \emph{ab initio} band structures of spin-orbit-coupled materials, lacking spin-conservation law. In this work, we perform thought experiments with magnetic flux tubes on $\beta$-bismuthene to demonstrate spin-charge separation, and quantized pumping of spin for three insulating states that can be accessed by tuning filling fractions. With a combined analysis of momentum-space topology and real-space response, we identify important role of topologically non-trivial bands, supporting even integer winding numbers, which cannot be inferred from symmetry-based indicators. Our work sets a new standard for prediction of two-dimensional, quantum spin-Hall materials, based on precise bulk invariant and universal topological response.

categories: cond-mat.mes-hall cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.str-el


title: Learning State-Aware Visual Representations from Audible Interactions

abstract: We propose a self-supervised algorithm to learn representations from egocentric video data. Recently, significant efforts have been made to capture humans interacting with their own environments as they go about their daily activities. In result, several large egocentric datasets of interaction-rich multi-modal data have emerged. However, learning representations from videos can be challenging. First, given the uncurated nature of long-form continuous videos, learning effective representations require focusing on moments in time when interactions take place. Second, visual representations of daily activities should be sensitive to changes in the state of the environment. However, current successful multi-modal learning frameworks encourage representation invariance over time. To address these challenges, we leverage audio signals to identify moments of likely interactions which are conducive to better learning. We also propose a novel self-supervised objective that learns from audible state changes caused by interactions. We validate these contributions extensively on two large-scale egocentric datasets, EPIC-Kitchens-100 and the recently released Ego4D, and show improvements on several downstream tasks, including action recognition, long-term action anticipation, and object state change classification.


title: Feature detection and hypothesis testing for extremely noisy nanoparticle images using topological data analysis

abstract: We propose a flexible algorithm for feature detection and hypothesis testing in images with ultra low signal-to-noise ratio using cubical persistent homology. Our main application is in the identification of atomic columns and other features in transmission electron microscopy (TEM). Cubical persistent homology is used to identify local minima and their size in subregions in the frames of nanoparticle videos, which are hypothesized to correspond to relevant atomic features. We compare the performance of our algorithm to other employed methods for the detection of columns and their intensity. Additionally, Monte Carlo goodness-of-fit testing using real valued summaries of persistence diagrams derived from smoothed images (generated from pixels residing in the vacuum region of an image) is developed and employed to identify whether or not the proposed atomic features generated by our algorithm are due to noise. Using these summaries derived from the generated persistence diagrams, one can produce univariate time series for the nanoparticle videos, thus providing a means for assessing fluxional behavior. A guarantee on the false discovery rate for multiple Monte Carlo testing of identical hypotheses is also established.


title: Semi-Blind Source Separation with Learned Constraints

abstract: Blind source separation (BSS) algorithms are unsupervised methods, which are the cornerstone of hyperspectral data analysis by allowing for physically meaningful data decompositions. BSS problems being ill-posed, the resolution requires efficient regularization schemes to better distinguish between the sources and yield interpretable solutions. For that purpose, we investigate a semi-supervised source separation approach in which we combine a projected alternating least-square algorithm with a learning-based regularization scheme. In this article, we focus on constraining the mixing matrix to belong to a learned manifold by making use of generative models. Altogether, we show that this allows for an innovative BSS algorithm, with improved accuracy, which provides physically interpretable solutions. The proposed method, coined sGMCA, is tested on realistic hyperspectral astrophysical data in challenging scenarios involving strong noise, highly correlated spectra and unbalanced sources. The results highlight the significant benefit of the learned prior to reduce the leakages between the sources, which allows an overall better disentanglement.


title: Learning-Based Dimensionality Reduction for Computing Compact and Effective Local Feature Descriptors

abstract: A distinctive representation of image patches in form of features is a key component of many computer vision and robotics tasks, such as image matching, image retrieval, and visual localization. State-of-the-art descriptors, from hand-crafted descriptors such as SIFT to learned ones such as HardNet, are usually high dimensional; 128 dimensions or even more. The higher the dimensionality, the larger the memory consumption and computational time for approaches using such descriptors. In this paper, we investigate multi-layer perceptrons (MLPs) to extract low-dimensional but high-quality descriptors. We thoroughly analyze our method in unsupervised, self-supervised, and supervised settings, and evaluate the dimensionality reduction results on four representative descriptors. We consider different applications, including visual localization, patch verification, image matching and retrieval. The experiments show that our lightweight MLPs achieve better dimensionality reduction than PCA. The lower-dimensional descriptors generated by our approach outperform the original higher-dimensional descriptors in downstream tasks, especially for the hand-crafted ones. The code will be available at https://github.com/PRBonn/descriptor-dr.


title: Universal Scaling of the Dynamic BKT Transition in Quenched 2D Bose Gases

abstract: While renormalization group theory is a fully established method to capture equilibrium phase transitions, the applicability of RG theory to universal non-equilibrium behavior remains elusive. Here we address this question by measuring the non-equilibrium dynamics triggered by a quench from superfluid to thermal phase across the Berezinskii-Kosterlitz-Thouless transition in a 2D Bose gas. We quench the system by splitting the 2D gas in two and probe the relaxation dynamics by measuring the phase correlation function and vortex density via matter-wave interferometry. The dynamics occur via a two-step process of rapid phonon thermalization followed by slow dynamic vortex unbinding. We demonstrate universal scaling laws for the algebraic exponents and vortex density, supported by classical-field simulations, and show their agreement with the real-time RG theory.


title: NASDUCK SERF: New constraints on axion-like dark matter from a SERF comagnetometer

abstract: Ultralight axion-like particles are well-motivated relics that might compose the cosmological dark matter and source anomalous time-dependent magnetic fields. We report on new terrestrial bounds on the coupling of axion-like particles to neutrons and protons using the nuclei of noble-gas and alkali-metal atoms in a comagnetometer detector operating in the Spin-Exchange Relaxation-Free~(SERF) regime. Conducting a month-long search, we cover the mass range of $1.4\times 10^{-12}$ eV/$c^2$ to $2\times 10^{-10}$~eV/$c^2$ and provide world-leading limits which supersede robust astrophysical bounds and improve upon previous terrestrial constraints by up to two orders of magnitudes for many masses within this range. These are the first reliable terrestrial bounds reported on the coupling of protons with axion-like dark matter, covering a new and unexplored terrain in its parameter space.


title: SANTOS: Relationship-based Semantic Table Union Search

abstract: Existing techniques for unionable table search define unionability using metadata (tables must have the same or similar schemas) or column-based metrics (for example, the values in a table should be drawn from the same domain). In this work, we introduce the use of semantic relationships between pairs of columns in a table to improve the accuracy of union search. Consequently, we introduce a new notion of unionability that considers relationships between columns, together with the semantics of columns, in a principled way. To do so, we present two new methods to discover semantic relationship between pairs of columns. The first uses an existing knowledge base (KB), the second (which we call a "synthesized KB") uses knowledge from the data lake itself. We adopt an existing Table Union Search benchmark and present new (open) benchmarks that represent small and large real data lakes. We show that our new unionability search algorithm, called SANTOS, outperforms a state-of-the-art union search that uses a wide variety of column-based semantics, including word embeddings and regular expressions. We show empirically that our synthesized KB improves the accuracy of union search by representing relationship semantics that may not be contained in an available KB. This result hints at a promising future of creating a synthesized KBs from data lakes with limited KB coverage and using them for union search.


title: Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruning

abstract: We introduce Sauron, a filter pruning method that eliminates redundant feature maps of convolutional neural networks (CNNs). Sauron optimizes, jointly with the loss function, a regularization term that promotes feature maps clustering at each convolutional layer by reducing the distance between feature maps. Sauron then eliminates the filters corresponding to the redundant feature maps by using automatically adjusted layer-specific thresholds. Unlike most filter pruning methods, Sauron requires minimal changes to typical neural network optimization because it prunes and optimizes CNNs jointly, which, in turn, accelerates the optimization over time. Moreover, unlike with other cluster-based approaches, the user does not need to specify the number of clusters in advance, a hyperparameter that is difficult to tune. We evaluated Sauron and five state-of-the-art filter pruning methods on four medical image segmentation tasks. This is an area where little attention has been paid to filter pruning, but where smaller CNN models are desirable for local deployment, mitigating privacy concerns associated with cloud-based solutions. Sauron was the only method that achieved a reduction in model size of over 90% without deteriorating substantially the performance. Sauron also achieved, overall, the fastest models at inference time in machines with and without GPUs. Finally, we show through experiments that the feature maps of models pruned with Sauron are highly interpretable, which is essential for medical image segmentation.


title: Deep learning forward and reverse primer design to detect SARS-CoV-2 emerging variants

abstract: Surges that have been observed at different periods in the number of COVID-19 cases are associated with the emergence of multiple SARS-CoV-2 (Severe Acute Respiratory Virus) variants. The design of methods to support laboratory detection are crucial in the monitoring of these variants. Hence, in this paper, we develop a semi-automated method to design both forward and reverse primer sets to detect SARS-CoV-2 variants. To proceed, we train deep Convolution Neural Networks (CNNs) to classify labelled SARS-CoV-2 variants and identify partial genomic features needed for the forward and reverse Polymerase Chain Reaction (PCR) primer design. Our proposed approach supplements existing ones while promoting the emerging concept of neural network assisted primer design for PCR. Our CNN model was trained using a database of SARS-CoV-2 full-length genomes from GISAID and tested on a separate dataset from NCBI, with 98\% accuracy for the classification of variants. This result is based on the development of three different methods of feature extraction, and the selected primer sequences for each SARS-CoV-2 variant detection (except Omicron) were present in more than 95 \% of sequences in an independent set of 5000 same variant sequences, and below 5 \% in other independent datasets with 5000 sequences of each variant. In total, we obtain 22 forward and reverse primer pairs with flexible length sizes (18-25 base pairs) with an expected amplicon length ranging between 42 and 3322 nucleotides. Besides the feature appearance, in-silico primer checks confirmed that the identified primer pairs are suitable for accurate SARS-CoV-2 variant detection by means of PCR tests.


title: DVGAN: Stabilize Wasserstein GAN training for time-domain Gravitational Wave physics

abstract: Simulating time-domain observations of gravitational wave (GW) detector environments will allow for a better understanding of GW sources, augment datasets for GW signal detection and help in characterizing the noise of the detectors, leading to better physics. This paper presents a novel approach to simulating fixed-length time-domain signals using a three-player Wasserstein Generative Adversarial Network (WGAN), called DVGAN, that includes an auxiliary discriminator that discriminates on the derivatives of input signals. An ablation study is used to compare the effects of including adversarial feedback from an auxiliary derivative discriminator with a vanilla two-player WGAN. We show that discriminating on derivatives can stabilize the learning of GAN components on 1D continuous signals during their training phase. This results in smoother generated signals that are less distinguishable from real samples and better capture the distributions of the training data. DVGAN is also used to simulate real transient noise events captured in the advanced LIGO GW detector.


title: Total charge changing cross sections measurements for $^{12}$C ion interactions with Al using CR-39 nuclear track detector

abstract: We are investigating the total charge changing cross-section of 12C by using the CR39 nuclear track detector. Target sandwiched with CR39 of 5 cm x 5 cm area was irradiated with $^{12}$C ion at 55 MeV/n and 135 MeV/n at the Wakasa wan Energy Research Center (WERC) and Heavy Ion Medical Accelerator in Chiba (HIMAC), Japan, respectively. Exposed CR39s were etched in $^7$N NaOH solution at 70$^\circ$C to visualize the tracks produced by the primary ion beam and its fragmentations. The etching time was chosen between 15 and 25 hours according to exposed densities of $^{12}$C ions. The SEIKO FSP 1000 imaging microscope was used to get the image of the front and back surface etch pit simultaneously. Then by counting the projectile track before and after the target, the total charge changing cross-section has been measured. Since there are no previous experimental data to compare, PHITS and Glauber model calculated theoretical values were compared with the previous and this experimental result. From that, the measured data were found in good agreement with the previous and calculated value except for two points at energy 95.7 and 98.6 MeV/n. These two points need more analysis which will be done in the next phase. Measured data in this study will be the first experimental TCC data for $^{12}$C+Al interactions in the energy 100 MeV/n. These measured data will be useful to verify the models, optimize shielding in space radiation circumstances, and also to improve treatment planning on therapy, as well.


title: Safety Evaluation of Transit Signal Priority with Bus Speed Volatility as a Surrogate Measure: Case Study in Minnesota

abstract: Previous studies have found correlations between the implementation of transit signal priority (TSP) and the reduction in number of crashes. To further understand how TSP affects traffic safety, a more in-depth evaluation was carried out using detailed bus automatic vehicle location (AVL) data. The data was from Minneapolis-Saint Paul Metro Transit Bus Route 5, where TSP was implemented at 30 signalized intersections in early 2019. A surrogate safety measure, bus speed volatility (BSV), was used to estimate the safety effects of TSP, with a higher BSV indicating more safety risks. A regression analysis was carried out on 23,123 event-level observations, with event defined as a bus traversal of a TSP-equipped intersection. Results indicate that with a TSP request, BSV was significantly lower than without a TSP request, confirming the effectiveness of TSP in smoothing bus trips through intersections, thus reducing risks of bus collisions and passenger fall-overs.


title: What Are You Anxious About? Examining Subjects of Anxiety during the COVID-19 Pandemic

abstract: COVID-19 poses disproportionate mental health consequences to the public during different phases of the pandemic. We use a computational approach to capture the specific aspects that trigger an online community's anxiety about the pandemic and investigate how these aspects change over time. First, we identified nine subjects of anxiety (SOAs) in a sample of Reddit posts ($N$=86) from r/COVID19\_support using thematic analysis. Then, we quantified Reddit users' anxiety by training algorithms on a manually annotated sample ($N$=793) to automatically label the SOAs in a larger chronological sample ($N$=6,535). The nine SOAs align with items in various recently developed pandemic anxiety measurement scales. We observed that Reddit users' concerns about health risks remained high in the first eight months of the pandemic. These concerns diminished dramatically despite the surge of cases occurring later. In general, users' language disclosing the SOAs became less intense as the pandemic progressed. However, worries about mental health and the future increased steadily throughout the period covered in this study. People also tended to use more intense language to describe mental health concerns than health risks or death concerns. Our results suggest that this online group's mental health condition does not necessarily improve despite COVID-19 gradually weakening as a health threat due to appropriate countermeasures. Our system lays the groundwork for population health and epidemiology scholars to examine aspects that provoke pandemic anxiety in a timely fashion.


title: The Impact of Perceptions of Social Media Advertisements on Advertising Value, Brand Awareness and Brand Associations: Research on Generation Y Instagram Users

abstract: The aim of this paper is to examine how consumer perceptions of social media advertisements affect advertising value and brand awareness. With a rapid increase in the number of social media users over the last ten years, a new advertising domain has become available for companies. Brands that manage social media well in their advertising strategies can quickly influence consumer decision-making and create awareness. However, in social media advertising, which is different from traditional advertising, creating content should be produced and this content should be perceived in a short time by consumers. To achieve this, it is necessary to build rapport with consumers and to present correctly what they wish to see in advertisements by creating awareness. In view of the increasing importance of social media advertising, the study examines how consumer perceptions of Instagram advertisements affect advertising value and brand awareness. This study was conducted with Generation Y consumers on the basis of their Instagram habits, a popular social media app. For this purpose, surveys were held with 665 participants who use Instagram. The collected data were analyzed using structural equation modeling. According to the analysis results, Y generations perceptions of Instagram advertisements have both a positive and negative impact on advertising value and brand awareness and brand associations.


title: Linear Dimensionality Reduction

abstract: These notes are an overview of some classical linear methods in Multivariate Data Analysis. This is a good old domain, well established since the 60's, and refreshed timely as a key step in statistical learning. It can be presented as part of statistical learning, or as dimensionality reduction with a geometric flavor. Both approaches are tightly linked: it is easier to learn patterns from data in low dimensional spaces than in high-dimensional spaces. It is shown how a diversity of methods and tools boil down to a single core methods, PCA with SVD, such that the efforts to optimize codes for analyzing massive data sets like distributed memory and task-based programming or to improve the efficiency of the algorithms like Randomised SVD can focus on this shared core method, and benefit to all methods.


title: Computing Melodic Templates in Oral Music Traditions

abstract: The term melodic template or skeleton refers to a basic melody which is subject to variation during a music performance. In many oral music tradition, these templates are implicitly passed throughout generations without ever being formalized in a score. In this work, we introduce a new geometric optimization problem, the spanning tube problem, to approximate a melodic template for a set of labeled performance transcriptions corresponding to an specific style in oral music traditions. Given a set of $n$ piecewise linear functions, we solve the problem of finding a continuous function, $f^*$, and a minimum value, $\varepsilon^*$, such that, the vertical segment of length $2\varepsilon^*$ centered at $(x,f^*(x))$ intersects at least $p$ functions ($p\leq n$). The method explored here also provide a novel tool for quantitatively assess the amount of melodic variation which occurs across performances.


title: A characterization of polynomial time computable functions from the integers to the reals using discrete ordinary differential equations

abstract: In a recent article, the class of functions from the integers to the integers computable in polynomial time has been characterized using discrete ordinary differential equations (ODE), also known as finite differences. Doing so, we pointed out the fundamental role of linear (discrete) ODEs and classical ODE tools such as changes of variables to capture computability and complexity measures, or as a tool for programming. In this article, we extend the approach to a characterization of functions from the integers to the reals computable in polynomial time in the sense of computable analysis. In particular, we provide a characterization of such functions in terms of the smallest class of functions that contains some basic functions, and that is closed by composition, linear length ODEs, and a natural effective limit schema.


title: Medium-enhanced $c\bar{c}$ radiation

abstract: We show that the same QCD formalism that accounts for the suppression of high-$p_T$ hadron and jet spectra in heavy-ion collisions predicts medium-enhanced production of $c\bar{c}$ pairs in jets.


title: Evaporation before disruption: comparing timescales for Jovian planets in star-forming regions

abstract: Simulations show that the orbits of planets are readily disrupted in dense star-forming regions; planets can be exchanged between stars, become free-floating and then be captured by other stars. However, dense star-forming regions also tend to be populous, containing massive stars that emit photoionising radiation, which can evaporate the gas in protoplanetary discs. We analyse N-body simulations of star-forming regions containing Jovian-mass planets and determine the times when their orbits are altered, when they become free-floating, and when they are stolen or captured. Simultaneously, we perform calculations of the evolution of protoplanetary discs when exposed to FUV radiation fields from massive stars in the same star-forming regions. In almost half (44 per cent) of the planetary systems that are disrupted - either altered, captured, stolen or become free-floating, we find that the radius of the protoplanetary disc evolves inwards, or the gas in the disc is completely evaporated, before the planets' orbits are disrupted. This implies that planets that are disrupted in dense, populous star-forming regions are more likely to be super Earths or mini Neptunes, as Jovian mass planets would not be able to form due to mass loss from photoevaporation. Furthermore, the recent discoveries of distant Jovian mass planets around tightly-packed terrestrial planets argue against their formation in populous star-forming regions, as photoevaporation would preclude gas giant planet formation at distances of more than a few au.


title: Black hole microstate counting from the gravitational path integral

abstract: Reproducing the integer count of black hole micro-states from the gravitational path integral is an important problem in quantum gravity. In this paper, we show that, by using supersymmetric localization, the gravitational path integral for $\frac{1}8$-BPS black holes in $\mathcal{N}=8$ supergravity reproduces the index obtained in the string theory construction of such black holes, including all non-perturbatively suppressed geometries. A more refined argument then shows that, not only the black hole index, but also the total number of black hole microstates within an energy window above extremality that is polynomially suppressed in the charges, also matches this string theory index. To achieve such a match we compute the one-loop determinant arising in the localization calculation for all $\mathcal{N}=2$ supergravity supermultiplets in the $\mathcal{N}=8$ gravity supermultiplet. Furthermore, we carefully account for the contribution of boundary zero-modes, that can be seen as arising from the zero-temperature limit of the $\mathcal{N}=4$ super-Schwarzian, and show that performing the exact path integral over such modes provides a critical contribution needed for the match to be achieved. A discussion about the importance of such zero-modes in the wider context of all extremal black holes is presented in a companion paper.


title: Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions

abstract: No existing spherical convolutional neural network (CNN) framework is both computationally scalable and rotationally equivariant. Continuous approaches capture rotational equivariance but are often prohibitively computationally demanding. Discrete approaches offer more favorable computational performance but at the cost of equivariance. We develop a hybrid discrete-continuous (DISCO) group convolution that is simultaneously equivariant and computationally scalable to high-resolution. While our framework can be applied to any compact group, we specialize to the sphere. Our DISCO spherical convolutions exhibit $\text{SO}(3)$ rotational equivariance, where $\text{SO}(n)$ is the special orthogonal group representing rotations in $n$-dimensions. When restricting rotations of the convolution to the quotient space $\text{SO}(3)/\text{SO}(2)$ for further computational enhancements, we recover a form of asymptotic $\text{SO}(3)$ rotational equivariance. Through a sparse tensor implementation we achieve linear scaling in number of pixels on the sphere for both computational cost and memory usage. For 4k spherical images we realize a saving of $10^9$ in computational cost and $10^4$ in memory usage when compared to the most efficient alternative equivariant spherical convolution. We apply the DISCO spherical CNN framework to a number of benchmark dense-prediction problems on the sphere, such as semantic segmentation and depth estimation, on all of which we achieve the state-of-the-art performance.


title: The Three Hundred project: Galaxy groups do not survive cluster infall

abstract: Galaxy clusters grow by accreting galaxies as individual objects, or as members of a galaxy group. These groups can strongly impact galaxy evolution, stripping the gas from galaxies, and enhancing the rate of galaxy mergers. However, it is not clear how the dynamics and structure of groups are affected when they interact with a large cluster, or whether all group members necessarily experience the same evolutionary processes. Using data from TheThreeHundred project, a suite of 324 hydrodynamical resimulations of large galaxy clusters, we study the properties of 1340 groups passing through a cluster. We find that half of group galaxies become gravitationally unbound from the group by the first pericentre, typically just 0.5-1 Gyr after cluster entry. Most groups quickly mix with the cluster satellite population; only 8% of infalling group haloes later leave the cluster, although for nearly half of these, all of their galaxies have become unbound, tidally disrupted or merged into the central by this stage. The position of galaxies in group-centric phase space is also important -- only galaxies near the centre of a group ($r\lesssim0.7R_{200}$) remain bound once a group is inside a cluster, and slow-moving galaxies in the group centre are likely to be tidally disrupted, or merge with another galaxy. This work will help future observational studies to constrain the environmental histories of group galaxies. For instance, groups observed inside or nearby to clusters have likely approached very recently, meaning that their galaxies will not have experienced a cluster environment before.


title: Efficient Recovery Learning using Model Predictive Meta-Reasoning

abstract: Operating under real world conditions is challenging due to the possibility of a wide range of failures induced by execution errors and state uncertainty. In relatively benign settings, such failures can be overcome by retrying or executing one of a small number of hand-engineered recovery strategies. By contrast, contact-rich sequential manipulation tasks, like opening doors and assembling furniture, are not amenable to exhaustive hand-engineering. To address this issue, we present a general approach for robustifying manipulation strategies in a sample-efficient manner. Our approach incrementally improves robustness by first discovering the failure modes of the current strategy via exploration in simulation and then learning additional recovery skills to handle these failures. To ensure efficient learning, we propose an online algorithm called Meta-Reasoning for Skill Learning (MetaReSkill) that monitors the progress of all recovery policies during training and allocates training resources to recoveries that are likely to improve the task performance the most. We use our approach to learn recovery skills for door-opening and evaluate them both in simulation and on a real robot with little fine-tuning. Compared to open-loop execution, our experiments show that even a limited amount of recovery learning improves task success substantially from 71% to 92.4% in simulation and from 75% to 90% on a real robot.


title: On the Adversarial Convex Body Chasing Problem

abstract: In this work, we extend the convex bodies chasing problem (CBC) to an adversarial setting, where an agent (the Player) is tasked with chasing a sequence of convex bodies generated adversarially by another agent (the Opponent). The Player aims to minimize the total cost associated with its own movements, while the Opponent tries to maximize the same cost. The set of feasible convex bodies is finite and known to both agents, which allows us to provide performance guarantees with max-min optimality. Under certain assumptions, we show the continuity of the optimal value function, and propose an algorithm to numerically approximate the optimal policies for both the Player and the Opponent within a guaranteed tolerance. Finally, the theoretical results are verified through numerical examples.