title: Autonomous Fire Fighting with a UAV-UGV Team at MBZIRC 2020

abstract: Every day, burning buildings threaten the lives of occupants and first responders trying to save them. Quick action is of essence, but some areas might not be accessible or too dangerous to enter. Robotic systems have become a promising addition to firefighting, but at this stage, they are mostly manually controlled, which is error-prone and requires specially trained personal. We present two systems for autonomous firefighting from air and ground we developed for the Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2020. The systems use LiDAR for reliable localization within narrow, potentially GNSS-restricted environments while maneuvering close to obstacles. Measurements from LiDAR and thermal cameras are fused to track fires, while relative navigation ensures successful extinguishing. We analyze and discuss our successful participation during the MBZIRC 2020, present further experiments, and provide insights into our lessons learned from the competition.


title: Coded-InvNet for Resilient Prediction Serving Systems

abstract: Inspired by a new coded computation algorithm for invertible functions, we propose Coded-InvNet a new approach to design resilient prediction serving systems that can gracefully handle stragglers or node failures. Coded-InvNet leverages recent findings in the deep learning literature such as invertible neural networks, Manifold Mixup, and domain translation algorithms, identifying interesting research directions that span across machine learning and systems. Our experimental results show that Coded-InvNet can outperform existing approaches, especially when the compute resource overhead is as low as 10%. For instance, without knowing which of the ten workers is going to fail, our algorithm can design a backup task so that it can correctly recover the missing prediction result with an accuracy of 85.9%, significantly outperforming the previous SOTA by 32.5%.


title: Optimal qubit assignment and routing via integer programming

abstract: We consider the problem of mapping a logical quantum circuit onto a given hardware with limited two-qubit connectivity. We model this problem as an integer linear program, using a network flow formulation with binary variables that includes the initial allocation of qubits and their routing. We consider several cost functions: an approximation of the fidelity of the circuit, its total depth, and a measure of cross-talk, all of which can be incorporated in the model. Numerical experiments on synthetic data and different hardware topologies indicate that the error rate and depth can be optimized simultaneously without significant loss. We test our algorithm on a large number of quantum volume circuits, optimizing for error rate and depth; our algorithm significantly reduces the number of CNOTs compared to Qiskit's default transpiler SABRE, and produces circuits that, when executed on hardware, exhibit higher fidelity.


title: A functional central limit theorem for Polaron path measures

abstract: The application of the Feynman-Kac formula to Polaron models of quantum theory leads to the path measure of Brownian motion perturbed by a pair potential that is translation invariant both in space and time. An important problem in this context is the validity of a central limit theorem in infinite volume. We show both the existence of the relevant infinite volume limits and a functional central limit theorem in a generality that includes the Fr\"ohlich polaron for all coupling constants. The proofs are based on an extension of a novel method by Mukherjee and Varadhan.


title: The VST Early-type GAlaxy Survey: Exploring the Outskirts and Intra-cluster Regions of Galaxies in the Low-surface-brightness Regime

abstract: The VST Early-type GAlaxy Survey (VEGAS) is a deep, multi-band (u, g, r, i) imaging survey, carried out with the 2.6-metre VLT Survey Telescope (VST) at ESO's Paranal Observatory in Chile. VEGAS combines the wide (1-square-degree) OmegaCAM imager and long integration times, together with a specially designed observing strategy. It has proven to be a gold mine for studies of features at very low surface brightness, down to levels of mu_g~27-30 magnitudes arcsec^(-2), over 5-8 magnitudes fainter than the dark sky at Paranal. In this article we highlight the main science results obtained with VEGAS observations of galaxies across different environments, from dense clusters of galaxies to unexplored poor groups and in the field.


title: A classification of the finite two-generated cyclic-by-abelian groups of prime power order

abstract: We obtain a classification of the finite two-generated cyclic-by-abelian groups of prime-power order. For that we associate to each such group $G$ a list $\inv(G)$ of numerical group invariants which determines the isomorphism type of $G$. Then we describe the set formed by all the possible values of $\inv(G)$. This allows computer implementations for constructing all the finite-two generated cyclic-by-abelian groups of a given prime-power order, computing the invariants of such a group, and to decide whether two such groups are isomorphic.


title: Synchrotron-Self-Compton radiation from magnetically-dominated turbulent plasmas in relativistic jets

abstract: Relativistic jets launched by rotating black holes are powerful emitters of non-thermal radiation. Extraction of the rotational energy via electromagnetic stresses produces magnetically-dominated jets, which may become turbulent. Studies of magnetically-dominated plasma turbulence from first principles show that most of the accelerated particles have small pitch angles, i.e. the particle velocity is nearly aligned with the local magnetic field. We examine synchrotron-self-Compton radiation from anisotropic particles in the fast cooling regime. The small pitch angles reduce the synchrotron cooling rate and promote the role of inverse Compton (IC) cooling, which can occur in two different regimes. In the Thomson regime, both synchrotron and IC components have soft spectra, $\nu F_\nu\propto\nu^{1/2}$. In the Klein-Nishina regime, synchrotron radiation has a hard spectrum, typically $\nu F_\nu\propto\nu$, over a broad range of frequencies. Our results have implications for the modelling of BL Lacs and Gamma-Ray Bursts (GRBs). BL Lacs produce soft synchrotron and IC spectra, as expected when Klein-Nishina effects are minor. The observed synchrotron and IC luminosities are typically comparable, which indicates a moderate anisotropy with pitch angles $\theta\gtrsim0.1$. Rare orphan gamma-ray flares may be produced when $\theta\ll0.1$. The hard spectra of GRBs may be consistent with synchrotron radiation when the emitting particles are IC cooling in the Klein-Nishina regime, as expected for pitch angles $\theta\sim0.1$. Blazar and GRB spectra can be explained by turbulent jets with a similar electron plasma magnetisation parameter, $\sigma_{\rm e}\sim10^4$, which for electron-proton plasmas corresponds to an overall magnetisation $\sigma=(m_{\rm e}/m_{\rm p})\sigma_{\rm e}\sim10$.


title: Angle-resolved optically detected magnetic resonance as a tool for strain determination in nanostructures

abstract: In this paper, we apply the angle-resolved Optically Detected Magnetic Resonance (ODMR) technique to study series of strained (Cd, Mn)Te/(Cd, Mg)Te quantum wells (QWs) produced by molecular beam epitaxy. By analyzing characteristic features of ODMR angular scans, we determine strain-induced axial-symmetry spin Hamiltonian parameter D with neV precision. Furthermore, we use low-temperature optical reflectivity measurements and X-ray diffraction scans to evaluate the local strain present in QW material. In our analysis, we take into account different thermal expansion coefficients of GaAs substrate and CdTe buffer. The additional deformation due to the thermal expansion effects has the same magnitude as deformation origination from the different compositions of the samples. Based on the evaluated deformations and values of strain-induced axial-symmetry spin Hamiltonian parameter D, we find strain spin-lattice coefficient G11 = (72.2 +- 1.9) neV for Mn2+ in CdTe and shear deformation potential b = (-0.94 +- 0.11) eV for CdTe.


title: Keyframe-Focused Visual Imitation Learning

abstract: Imitation learning trains control policies by mimicking pre-recorded expert demonstrations. In partially observable settings, imitation policies must rely on observation histories, but many seemingly paradoxical results show better performance for policies that only access the most recent observation. Recent solutions ranging from causal graph learning to deep information bottlenecks have shown promising results, but failed to scale to realistic settings such as visual imitation. We propose a solution that outperforms these prior approaches by upweighting demonstration keyframes corresponding to expert action changepoints. This simple approach easily scales to complex visual imitation settings. Our experimental results demonstrate consistent performance improvements over all baselines on image-based Gym MuJoCo continuous control tasks. Finally, on the CARLA photorealistic vision-based urban driving simulator, we resolve a long-standing issue in behavioral cloning for driving by demonstrating effective imitation from observation histories. Supplementary materials and code at: \url{https://tinyurl.com/imitation-keyframes}.


title: Property-Preserving Hash Functions from Standard Assumptions

abstract: Property-preserving hash functions allow for compressing long inputs $x_0$ and $x_1$ into short hashes $h(x_0)$ and $h(x_1)$ in a manner that allows for computing a predicate $P(x_0, x_1)$ given only the two hash values without having access to the original data. Such hash functions are said to be adversarially robust if an adversary that gets to pick $x_0$ and $x_1$ after the hash function has been sampled, cannot find inputs for which the predicate evaluated on the hash values outputs the incorrect result. In this work we construct robust property-preserving hash functions for the hamming-distance predicate which distinguishes inputs with a hamming distance at least some threshold $t$ from those with distance less than $t$. The security of the construction is based on standard lattice hardness assumptions. Our construction has several advantages over the best known previous construction by Fleischhacker and Simkin. Our construction relies on a single well-studied hardness assumption from lattice cryptography whereas the previous work relied on a newly introduced family of computational hardness assumptions. In terms of computational effort, our construction only requires a small number of modular additions per input bit, whereas previously several exponentiations per bit as well as the interpolation and evaluation of high-degree polynomials over large fields were required. An additional benefit of our construction is that the description of the hash function can be compressed to $\lambda$ bits assuming a random oracle. Previous work has descriptions of length $\mathcal{O}(\ell \lambda)$ bits for input bit-length $\ell$, which has a secret structure and thus cannot be compressed. We prove a lower bound on the output size of any property-preserving hash function for the hamming distance predicate. The bound shows that the size of our hash value is not far from optimal.


title: High Probability Complexity Bounds for Adaptive Step Search Based on Stochastic Oracles

abstract: We consider a step search method for continuous optimization under a stochastic setting where the function values and gradients are available only through inexact probabilistic zeroth- and first-order oracles. Unlike the stochastic gradient method and its many variants, the algorithm does not use a pre-specified sequence of step sizes but increases or decreases the step size adaptively according to the estimated progress of the algorithm. These oracles capture multiple standard settings including expected loss minimization and zeroth-order optimization. Moreover, our framework is very general and allows the function and gradient estimates to be biased. The proposed algorithm is simple to describe and easy to implement. Under fairly general conditions on the oracles, we derive a high probability tail bound on the iteration complexity of the algorithm when it is applied to non-convex, convex, and strongly convex (more generally, those satisfying the PL condition) functions. Our analysis strengthens and extends prior results for stochastic step and line search methods.


title: Certifying the LTL Formula p Until q in Hybrid Systems

abstract: In this paper, we propose sufficient conditions to guarantee that a linear temporal logic (LTL) formula of the form p Until q, denoted by $p \mathcal{U} q$, is satisfied for a hybrid system. Roughly speaking, the formula $p \mathcal{U} q$ is satisfied means that the solutions, initially satisfying proposition p, keep satisfying this proposition until proposition q is satisfied. To certify such a formula, connections to invariance notions such as conditional invariance (CI) and eventual conditional invariance (ECI), as well as finite-time attractivity (FTA) are established. As a result, sufficient conditions involving the data of the hybrid system and an appropriate choice of Lyapunov-like functions, such as barrier functions, are derived. The considered hybrid system is given in terms of differential and difference inclusions, which capture the continuous and the discrete dynamics present in the same system, respectively. Examples illustrate the results throughout the paper.


title: Limit Cycle Analysis of 3-D Nonlinear systems

abstract: Considering Limit Cycles as one of the limits of Lienard equation, an analyis analogous to centre manifold analysis has been done for a $3-D$ nonlinear system exhibiting Limit Cycle. A rigorous study on radius of the Limit Cycle orbit has been done by considering $\lambda-\omega$ equations for the particular system and subsequently converting the system equations from cartesian to polar form. It has been shown through an analysis analogous to Centre Manifold Analysis and reduction of the system dynamics on a lower dimensional space, the Limit cycle radius undergoes an increment change. One example is provided to support the theoretical predictions.


title: A New Upper Bound on Cache Hit Probability for Non-anticipative Caching Policies

abstract: Caching systems have long been crucial for improving the performance of a wide variety of network and web based online applications. In such systems, end-to-end application performance heavily depends on the fraction of objects transferred from the cache, also known as the cache hit probability. Many caching policies have been proposed and implemented to improve the hit probability. In this work, we propose a new method to compute an upper bound on hit probability for all non-anticipative caching policies, i.e., for policies that have no knowledge of future requests. Our key insight is to order the objects according to the ratio of their Hazard Rate (HR) function values to their sizes and place in the cache the objects with the largest ratios till the cache capacity is exhausted. Under some statistical assumptions, we prove that our proposed HR to size ratio based ordering model computes the maximum achievable hit probability and serves as an upper bound for all non-anticipative caching policies. We derive closed form expressions for the upper bound under some specific object request arrival processes. We also provide simulation results to validate its correctness and to compare it to the state-of-the-art upper bounds. We find it to be tighter than state-of-the-art upper bounds for a variety of object request arrival processes.


title: Low-level Comments auto-generation for Solidity Smart Contracts

abstract: Context: Decentralized applications on blockchain platforms are realized through smart contracts. However, participants who lack programming knowledge often have difficulties reading the smart contract source codes, which leads to potential security risks and barriers to participation. Objective: Our objective is to translate the smart contract source codes into natural language descriptions to help people better understand, operate, and learn smart contracts. Method: This paper proposes an automated translation tool for Solidity smart contracts, termed SolcTrans, based on an abstract syntax tree and formal grammar. We have investigated 3,000 smart contracts and determined the part of speeches of corresponding blockchain terms. Among them, we further filtered out contract snippets without detailed comments and left 811 snippets to evaluate the translation quality of SolcTrans. Results: Experimental results show that even with a small corpus, SolcTrans can achieve similar performance to the state-of-the-art code comments generation models for other programming languages. In addition, SolcTrans has consistent performance when dealing with code snippets with different lengths and gas consumption. Conclusion: SolcTrans can correctly interpret Solidity codes and automatically convert them into comprehensible English text. We will release our tool and dataset for supporting reproduction and further studies in related fields.


title: Interactions of Ions and Ultracold Neutral Atom Ensembles in Composite Optical Dipole Traps: Developments and Perspectives

abstract: Ion-atom interactions are a comparatively recent field of research that has drawn considerable attention due to its applications in areas including quantum chemistry and quantum simulations. In first experiments, atomic ions and neutral atoms have been successfully overlapped by devising hybrid apparatuses combining established trapping methods, Paul traps for ions and optical or magneto-optical traps for neutral atoms, respectively. Since then, the field has seen considerable progress, but the inherent presence of radiofrequency (rf) fields in such hybrid traps was found to have a limiting impact on the achievable collision energies. Recently, it was shown that suitable combinations of optical dipole traps (ODTs) can be used for trapping both atoms and atomic ions alike, allowing to carry out experiments in absence of any rf fields. Here, we show that the expected cooling in such bichromatic traps is highly sensitive to relative position fluctuations between the two optical trapping beams, suggesting that this is the dominant mechanism limiting the currently observed cooling performance. We discuss strategies for mitigating these effects by using optimized setups featuring adapted ODT configurations. This includes proposed schemes that may mitigate three-body losses expected at very low temperatures, allowing to access the quantum dominated regime of interaction.


title: Twisted Composition Algebras and Arthur Packets for Triality Spin(8)

abstract: Using exceptional theta correspondences we construct a family of Arthur packets for the exceptional group of type D4, and establish the global Arthur multiplicity formula.


title: The role of quantum coherence in energy fluctuations

abstract: We discuss the role of quantum coherence in the energy fluctuations of open quantum systems. To this aim, we introduce a protocol, to which we refer to as the end-point-measurement scheme, allowing to define the statistics of energy changes as a function of energy measurements performed only after the evolution of the initial state. At the price of an additional uncertainty on the initial energies, this approach prevents the loss of initial quantum coherences and enables the estimation of their effects on energy fluctuations. We demonstrate our findings by running an experiment on the IBM Quantum Experience superconducting qubit platform.


title: Semi-Supervised and Unsupervised Sense Annotation via Translations

abstract: Acquisition of multilingual training data continues to be a challenge in word sense disambiguation (WSD). To address this problem, unsupervised approaches have been proposed to automatically generate sense annotations for training supervised WSD systems. We present three new methods for creating sense-annotated corpora which leverage translations, parallel bitexts, lexical resources, as well as contextual and synset embeddings. Our semi-supervised method applies machine translation to transfer existing sense annotations to other languages. Our two unsupervised methods refine sense annotations produced by a knowledge-based WSD system via lexical translations in a parallel corpus. We obtain state-of-the-art results on standard WSD benchmarks.


title: Quantum Chemistry Calculations using Energy Derivatives on Quantum Computers

abstract: Quantum chemistry calculations such as the prediction of molecular properties and modeling of chemical reactions are a few of the critical areas where near-term quantum computers can showcase quantum advantage. We present a method to calculate energy derivatives for both ground state and excited state energies with respect to the parameters of a chemical system based on the framework of the variational quantum eigensolver (VQE). A low-depth implementation of quantum circuits within the hybrid variational paradigm is designed, and their computational costs are analyzed. We showcase the effectiveness of our method by incorporating it in some key quantum chemistry applications of energy derivatives, such as to perform minimum energy configuration search and estimate molecular response properties estimation of H$_2$ molecule, and also to find the transition state of H$_2$ + H $\leftrightarrow$ H + H$_2$ reaction. The obtained results are shown to be in complete agreement with their respective full configuration interaction (FCI) values.


title: A look into the possibility of negative mass

abstract: We investigate the possibility of negative mass particles and whether physics as we know it today allows or excludes their existence and what properties they might have in the light these laws. We show that nothing prohibit their existence, in the contrary, for a more symmetric world their existence is essential. In relativistic quantum mechanics, the negative mass bispinor in the rest frame takes a different form than the positive mass bispinor.


title: Stochastic modelling of blockchain consensus

abstract: Blockchain and general purpose distributed ledgers are foundational technologies which bring significant innovation in the infrastructures and other underpinnings of our socio-economic systems. These P2P technologies are able to securely diffuse information within and across networks, without need for trustees or central authorities to enforce consensus. In this contribution, we propose a minimalistic stochastic model to understand the dynamics of blockchain-based consensus. By leveraging on random-walk theory, we model block propagation delay on different network topologies and provide a classification of blockchain systems in terms of two emergent properties. Firstly, we identify two performing regimes: a functional regime corresponding to an optimal system function; and a non-functional regime characterised by a congested or branched state of sub-optimal blockchains. Secondly, we discover a phase transition during the emergence of consensus and numerically investigate the corresponding critical point. Our results provide important insights into the consensus mechanism and sub-optimal states in decentralised systems.


title: Saturation Numbers for Linear Forests $P_6$ + $tP_2$

abstract: A graph $G$ is $H$-saturated if it contains no $H$ as a subgraph, but does contain $H$ after the addition of any edge in the complement of $G$. The saturation number, $sat (n, H)$, is the minimum number of edges of a graph in the set of all $H$-saturated graphs with order $n$. In this paper, we determine the saturation number $sat (n, P_6 + tP_2)$ for $n \geq 10t/3 + 10$ and characterize the extremal graphs for $n >10t/3 + 20$.


title: A Large-Scale Rich Context Query and Recommendation Dataset in Online Knowledge-Sharing

abstract: Data plays a vital role in machine learning studies. In the research of recommendation, both user behaviors and side information are helpful to model users. So, large-scale real scenario datasets with abundant user behaviors will contribute a lot. However, it is not easy to get such datasets as most of them are only hold and protected by companies. In this paper, a new large-scale dataset collected from a knowledge-sharing platform is presented, which is composed of around 100M interactions collected within 10 days, 798K users, 165K questions, 554K answers, 240K authors, 70K topics, and more than 501K user query keywords. There are also descriptions of users, answers, questions, authors, and topics, which are anonymous. Note that each user's latest query keywords have not been included in previous open datasets, which reveal users' explicit information needs. We characterize the dataset and demonstrate its potential applications for recommendation study. Multiple experiments show the dataset can be used to evaluate algorithms in general top-N recommendation, sequential recommendation, and context-aware recommendation. This dataset can also be used to integrate search and recommendation and recommendation with negative feedback. Besides, tasks beyond recommendation, such as user gender prediction, most valuable answerer identification, and high-quality answer recognition, can also use this dataset. To the best of our knowledge, this is the largest real-world interaction dataset for personalized recommendation.


title: Locally Sparse Neural Networks for Tabular Biomedical Data

abstract: Tabular datasets with low-sample-size or many variables are prevalent in biomedicine. Practitioners in this domain prefer linear or tree-based models over neural networks since the latter are harder to interpret and tend to overfit when applied to tabular datasets. To address these neural networks' shortcomings, we propose an intrinsically interpretable network for heterogeneous biomedical data. We design a locally sparse neural network where the local sparsity is learned to identify the subset of most relevant features for each sample. This sample-specific sparsity is predicted via a \textit{gating} network, which is trained in tandem with the \textit{prediction} network. By forcing the model to select a subset of the most informative features for each sample, we reduce model overfitting in low-sample-size data and obtain an interpretable model. We demonstrate that our method outperforms state-of-the-art models when applied to synthetic or real-world biomedical datasets using extensive experiments. Furthermore, the proposed framework dramatically outperforms existing schemes when evaluating its interpretability capabilities. Finally, we demonstrate the applicability of our model to two important biomedical tasks: survival analysis and marker gene identification.


title: Topological Detection of Trojaned Neural Networks

abstract: Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, which can later be exploited. Guided by basic neuroscientific principles we discover subtle -- yet critical -- structural deviation characterizing Trojaned models. In our analysis we use topological tools. They allow us to model high-order dependencies in the networks, robustly compare different networks, and localize structural abnormalities. One interesting observation is that Trojaned models develop short-cuts from input to output layers. Inspired by these observations, we devise a strategy for robust detection of Trojaned models. Compared to standard baselines it displays better performance on multiple benchmarks.


title: Eigendamage: an Eigendeformation model for the variational approximation of cohesive fracture -- a one-dimensional case study

abstract: We study an approximation scheme for a variational theory of cohesive fracture in a one-dimensional setting. Here, the energy functional is approximated by a family of functionals depending on a small parameter $0 < \varepsilon \ll 1$ and on two fields: the elastic part of the displacement field and an eigendeformation field that describes the inelastic response of the material beyond the elastic regime. We measure the inelastic contributions of the latter in terms of a non-local energy functional. Our main result shows that, as $\varepsilon \to 0$, the approximate functionals $\Gamma$-converge to a cohesive zone model.


title: Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation

abstract: Medical report generation is one of the most challenging tasks in medical image analysis. Although existing approaches have achieved promising results, they either require a predefined template database in order to retrieve sentences or ignore the hierarchical nature of medical report generation. To address these issues, we propose MedWriter that incorporates a novel hierarchical retrieval mechanism to automatically extract both report and sentence-level templates for clinically accurate report generation. MedWriter first employs the Visual-Language Retrieval~(VLR) module to retrieve the most relevant reports for the given images. To guarantee the logical coherence between sentences, the Language-Language Retrieval~(LLR) module is introduced to retrieve relevant sentences based on the previous generated description. At last, a language decoder fuses image features and features from retrieved reports and sentences to generate meaningful medical reports. We verified the effectiveness of our model by automatic evaluation and human evaluation on two datasets, i.e., Open-I and MIMIC-CXR.


title: Non-relativistic and potential non-relativistic effective field theories for scalar mediators

abstract: Yukawa-type interactions between heavy Dirac fermions and a scalar field are a common ingredient in various extensions of the Standard Model. Despite of that, the non-relativistic limit of the scalar Yukawa theory has not yet been studied in full generality in a rigorous and model-independent way. In this paper we intend to fill this gap by initiating a series of investigations that make use of modern effective field theory (EFT) techniques. In particular, we aim at constructing suitable non-relativistic and potential non-relativistic EFTs of Yukawa interactions (denoted as NRY and pNRY respectively) in close analogy to the well known and phenomenologically successful non-relativistic QCD (NRQCD) and potential non-relativistic QCD (pNRQCD). The phenomenological motivation for our study lies in the possibility to explain the existing cosmological observations by introducing heavy fermionic dark matter particles that interact with each other by exchanging a light scalar mediator. A systematic study of this compelling scenario in the framework of non-relativistic EFTs (NREFTs) constitutes the main novelty of our approach as compared to the existing studies.


title: Redox Active Cerium Oxide Nanoparticles: Current Status and Burning Issues

abstract: Research on cerium oxide nanoparticles (nanoceria) has captivated the scientific community due to their unique physical and chemical properties, such as redox activity and oxygen buffering capacity, which made them available for many technical applications, including biomedical applications. The redox mimetic antioxidant properties of nanoceria have been effective in the treatment of many diseases caused by reactive oxygen species (ROS) and reactive nitrogen species. The mechanism of ROS scavenging activity of nanoceria is still elusive, and its redox activity is controversial due to mixed reports in the literature showing pro-oxidant and antioxidant activity. In lieu of its current research interest, it is critical to understand the behaviour of nanoceria in the biological environment and provide answers to some of the critical and open issues. This review critically analyses the status of research on the application of nanoceria to treat diseases caused by ROS. It reviews the proposed mechanism of action and shows the effect of surface coatings on its redox activity. It also discusses some of the crucial issues in deciphering the mechanism and redox activity of nanoceria and suggests areas of future research.


title: A Fubini type theorem for rough integration

abstract: We develop the integration theory of two-parameter controlled paths $Y$ allowing us to define integrals of the form \begin{equation} \int_{[s,t] \times [u,v]} Y_{r,r'} \;d(X_{r}, X_{r'}) \end{equation} where $X$ is the geometric $p$-rough path that controls $Y$. This extends to arbitrary regularity the definition presented for $2\leq p<3$ in the recent paper of Hairer and Gerasimovi\v{c}s where it is used in the proof of a version of H\"{o}rmander's theorem for a class of SPDEs. We extend the Fubini type theorem of the same paper by showing that this two-parameter integral coincides with the two iterated one-parameter integrals \[ \int_{[s,t] \times [u,v]} Y_{r,r'} \;d(X_{r}, X_{r'}) = \int_{s}^{t} \int_{u}^{v} Y_{r,r'} \;dX_{r'} \;dX_{r'} = \int_{u}^{v} \int_{s}^{t} Y_{r,r'} \;dX_{r} \;dX_{r'}. \] A priori these three integrals have distinct definitions, and so this parallels the classical Fubini's theorem for product measures. By extending the two-parameter Young-Towghi inequality in this context, we derive a maximal inequality for the discrete integrals approximating the two-parameter integral. We also extend the analysis to consider integrals of the form \begin{equation*} \int_{[s,t] \times [u,v]} Y_{r,r'} \; d(X_{r}, \tilde{X}_{r'}) \end{equation*} for possibly different rough paths $X$ and $\tilde{X}$, and obtain the corresponding Fubini type theorem. We prove continuity estimates for these integrals in the appropriate rough path topologies. As an application we consider the signature kernel, which has recently emerged as a useful tool in data science, as an example of a two-parameter controlled rough path which also solves a two-parameter rough integral equation.


title: Analyzing the Travel and Charging Behavior of Electric Vehicles -- A Data-driven Approach

abstract: The increasing market penetration of electric vehicles (EVs) may pose significant electricity demand on power systems. This electricity demand is affected by the inherent uncertainties of EVs' travel behavior that makes forecasting the daily charging demand (CD) very challenging. In this project, we use the National House Hold Survey (NHTS) data to form sequences of trips, and develop machine learning models to predict the parameters of the next trip of the drivers, including trip start time, end time, and distance. These parameters are later used to model the temporal charging behavior of EVs. The simulation results show that the proposed modeling can effectively estimate the daily CD pattern based on travel behavior of EVs, and simple machine learning techniques can forecast the travel parameters with acceptable accuracy.


title: The physical states of the Hybrid Formalism

abstract: String theory on ${\rm AdS}_3\times {\rm S}^3 \times\mathbb{T}^4$ with one unit ($k=1$) of NS-NS flux is considered in the hybrid formalism of Berkovits, Vafa & Witten (BVW). Using the free field realisation of the world-sheet theory at $k=1$, we identify explicitly the BRST cohomology classes corresponding to some of the low-lying states of the dual CFT. In particular, we do this for the ${\cal N}=4$ superconformal generators of the symmetric orbifold theory, and we confirm these identifications by showing that the worldsheet correlators reproduce the expected dual CFT answer. Along the way we note that the physical vertex operators on the worldsheet have a simpler form if one works with a different, but equivalent, choice for the BRST operators relative to BVW.


title: Avoiding local minima in multilayer network optimization by incremental training

abstract: Training a large multilayer neural network can present many difficulties due to the large number of useless stationary points. These points usually attract the minimization algorithm used during the training phase, which therefore results inefficient. Extending some results proposed in literature for shallow networks, we propose the mathematical characterization of a class of such stationary points that arise in deep neural networks training. Availing such a description, we are able to define an incremental training algorithm that avoids getting stuck in the region of attraction of these undesirable stationary points.


title: Data-Driven Multiscale Design of Cellular Composites with Multiclass Microstructures for Natural Frequency Maximization

abstract: For natural frequency optimization of engineering structures, cellular composites have been shown to possess an edge over solid. However, existing multiscale design methods for cellular composites are either computationally exhaustive or confined to a single class of microstructures. In this paper, we propose a data-driven topology optimization (TO) approach to enable the multiscale design of cellular structures with various choices of microstructure classes. The key component is a newly proposed latent-variable Gaussian process (LVGP) model through which different classes of microstructures are mapped into a low-dimensional continuous latent space. It provides an interpretable distance metric between classes and captures their effects on the homogenized stiffness tensors. By introducing latent vectors as design variables, a differentiable transition of stiffness matrix between classes can be easily achieved with an analytical gradient. After integrating LVGP with the density-based TO, an efficient data-driven cellular composite optimization process is developed to enable concurrent exploration of microstructure concepts and the associated volume fractions for natural frequency optimization. Examples reveal that the proposed cellular designs with multiclass microstructures achieve higher natural frequencies than both single-scale and single-class designs. This framework can be easily extended to other multi-scale TO problems, such as thermal compliance and dynamic response optimization.


title: Numerical Solution of the $L^1$-Optimal Transport Problem on Surfaces

abstract: In this article we study the numerical solution of the $L^1$-Optimal Transport Problem on 2D surfaces embedded in $R^3$, via the DMK formulation introduced in [FaccaCardinPutti:2018]. We extend from the Euclidean into the Riemannian setting the DMK model and conjecture the equivalence with the solution Monge-Kantorovich equations, a PDE-based formulation of the $L^1$-Optimal Transport Problem. We generalize the numerical method proposed in [FaccaCardinPutti:2018,FaccaDaneriCardinPutti:2020] to 2D surfaces embedded in $\REAL^3$ using the Surface Finite Element Model approach to approximate the Laplace-Beltrami equation arising from the model. We test the accuracy and efficiency of the proposed numerical scheme, comparing our approximate solution with respect to an exact solution on a 2D sphere. The results show that the numerical scheme is efficient, robust, and more accurate with respect to other numerical schemes presented in the literature for the solution of ls$L^1$-Optimal Transport Problem on 2D surfaces.


title: Multi-Receiver Online Bayesian Persuasion

abstract: Bayesian persuasion studies how an informed sender should partially disclose information to influence the behavior of a self-interested receiver. Classical models make the stringent assumption that the sender knows the receiver's utility. This can be relaxed by considering an online learning framework in which the sender repeatedly faces a receiver of an unknown, adversarially selected type. We study, for the first time, an online Bayesian persuasion setting with multiple receivers. We focus on the case with no externalities and binary actions, as customary in offline models. Our goal is to design no-regret algorithms for the sender with polynomial per-iteration running time. First, we prove a negative result: for any $0 < \alpha \leq 1$, there is no polynomial-time no-$\alpha$-regret algorithm when the sender's utility function is supermodular or anonymous. Then, we focus on the case of submodular sender's utility functions and we show that, in this case, it is possible to design a polynomial-time no-$(1 - \frac{1}{e})$-regret algorithm. To do so, we introduce a general online gradient descent scheme to handle online learning problems with a finite number of possible loss functions. This requires the existence of an approximate projection oracle. We show that, in our setting, there exists one such projection oracle which can be implemented in polynomial time.


title: Understanding the Coupling Mechanism of Gold Nanostructures by Finite-Difference Time-Domain Method

abstract: Gold nanoparticle assemblies show a strong plasmonic response due to the combined effects of the individual nanoparticles' plasmon modes. Increasing the number of nanoparticles in structured assemblies leads to significant shifts in the optical and physical properties. We use Finite-Difference Time-Domain (FDTD) simulations to analyze the electromagnetic response of structurally ordered gold nanorods in monomer and dimer configurations. The plasmonic coupling between nanorods in monomers or dimers configurations provides a unique technique for tuning the spectrum intensity, spatial distribution, and polarisation of local electric fields within and surrounding nanostructures. Our study shows an exponential coupling behavior when two gold nanorods are assembled in end-to-end and side-by-side dimer configurations with a small separation distance. The maximum electric field in the gaps between adjacent nanorods in end-to-end dimer configuration describes a more significant enhancement factor than the individual gold nanorod. Our FDTD simulation on dimer in end-to-end assembly for small separation distance up to ~ 40 nm can well explain the observed experimental growth dynamics of gold nanorods.


title: Neural Network Modeling of Probabilities for Coding the Octree Representation of Point Clouds

abstract: This paper describes a novel lossless point cloud compression algorithm that uses a neural network for estimating the coding probabilities for the occupancy status of voxels, depending on wide three dimensional contexts around the voxel to be encoded. The point cloud is represented as an octree, with each resolution layer being sequentially encoded and decoded using arithmetic coding, starting from the lowest resolution, until the final resolution is reached. The occupancy probability of each voxel of the splitting pattern at each node of the octree is modeled by a neural network, having at its input the already encoded occupancy status of several octree nodes (belonging to the past and current resolutions), corresponding to a 3D context surrounding the node to be encoded. The algorithm has a fast and a slow version, the fast version selecting differently several voxels of the context, which allows an increased parallelization by sending larger batches of templates to be estimated by the neural network, at both encoder and decoder. The proposed algorithms yield state-of-the-art results on benchmark datasets. The implementation will be made available at https://github.com/marmus12/nnctx


title: Towards Costless Model Selection in Contextual Bandits: A Bias-Variance Perspective

abstract: Model selection in supervised learning provides costless guarantees as if the model that best balances bias and variance was known a priori. We study the feasibility of similar guarantees for cumulative regret minimization in the stochastic contextual bandit setting. Recent work [Marinov and Zimmert, 2021] identifies instances where no algorithm can guarantee costless regret bounds. Nevertheless, we identify benign conditions where costless model selection is feasible: gradually increasing class complexity, and diminishing marginal returns for best-in-class policy value with increasing class complexity. Our algorithm is based on a novel misspecification test, and our analysis demonstrates the benefits of using model selection for reward estimation. Unlike prior work on model selection in contextual bandits, our algorithm carefully adapts to the evolving bias-variance trade-off as more data is collected. In particular, our algorithm and analysis go beyond adapting to the complexity of the simplest realizable class and instead adapt to the complexity of the simplest class whose estimation variance dominates the bias. For short horizons, this provides improved regret guarantees that depend on the complexity of simpler classes.


title: Excitation of a homogeneous dielectric sphere by a point electric dipole

abstract: Electrically small dielectric antennas are of great interest for modern technologies, since they can significantly reduce the physical size of electronic devices for processing and transmitting information. We investigate the influence of the resonance conditions of an electrically small dielectric spherical antenna with a high refractive index on its directivity and analyze the dependence of these resonances on the effectively excited modes of the dielectric sphere.


title: Pedestrian Attribute Recognition in Video Surveillance Scenarios Based on View-attribute Attention Localization

abstract: Pedestrian attribute recognition in surveillance scenarios is still a challenging task due to the inaccurate localization of specific attributes. In this paper, we propose a novel view-attribute localization method based on attention (VALA), which utilizes view information to guide the recognition process to focus on specific attributes and attention mechanism to localize specific attribute-corresponding areas. Concretely, view information is leveraged by the view prediction branch to generate four view weights that represent the confidences for attributes from different views. View weights are then delivered back to compose specific view-attributes, which will participate and supervise deep feature extraction. In order to explore the spatial location of a view-attribute, regional attention is introduced to aggregate spatial information and encode inter-channel dependencies of the view feature. Subsequently, a fine attentive attribute-specific region is localized, and regional weights for the view-attribute from different spatial locations are gained by the regional attention. The final view-attribute recognition outcome is obtained by combining the view weights with the regional weights. Experiments on three wide datasets (RAP, RAPv2, and PA-100K) demonstrate the effectiveness of our approach compared with state-of-the-art methods.


title: Functional Correlation Bounds and Optimal Iterated Moment Bounds for Slowly-mixing Nonuniformly Hyperbolic Maps

abstract: Consider a nonuniformly hyperbolic map $ T $ modelled by a Young tower with tails of the form $ O(n^{-\beta}) $, $ \beta>2 $. We prove optimal moment bounds for Birkhoff sums $ \sum_{i=0}^{n-1}v\circ T^i $ and iterated sums $ \sum_{0\le i<j<n}v\circ T^i\, w\circ T^j $, where $ v,w:M\to \Bbb{R}$ are (dynamically) H\"older observables. Previously iterated moment bounds were only known for $ \beta>5$. Our method of proof is as follows; (i) prove that $ T $ satisfies an abstract functional correlation bound, (ii) use a weak dependence argument to show that the functional correlation bound implies moment estimates. Such iterated moment bounds arise when using rough path theory to prove deterministic homogenisation results. Indeed, by a recent result of Chevyrev, Friz, Korepanov, Melbourne & Zhang we have convergence an It\^o diffusion for fast-slow systems of the form \[ x^{(n)}_{k+1}=x_k^{(n)}+n^{-1}a(x_k^{(n)},y_k)+n^{-1/2}b(x_k^{(n)},y_k) , \quad y_{k+1}=T y_k \] in the optimal range $ \beta>2. $


title: A dataset of mentorship in science with semantic and demographic estimations

abstract: Mentorship in science is crucial for topic choice, career decisions, and the success of mentees and mentors. Typically, researchers who study mentorship use article co-authorship and doctoral dissertation datasets. However, available datasets of this type focus on narrow selections of fields and miss out on early career and non-publication-related interactions. Here, we describe MENTORSHIP, a crowdsourced dataset of 743176 mentorship relationships among 738989 scientists across 112 fields that avoids these shortcomings. We enrich the scientists' profiles with publication data from the Microsoft Academic Graph and "semantic" representations of research using deep learning content analysis. Because gender and race have become critical dimensions when analyzing mentorship and disparities in science, we also provide estimations of these factors. We perform extensive validations of the profile--publication matching, semantic content, and demographic inferences. We anticipate this dataset will spur the study of mentorship in science and deepen our understanding of its role in scientists' career outcomes.


title: Cosmic-ray electrons released by supernova remnants

abstract: The process that allows cosmic rays to escape from their sources and be released into the Galaxy is still largely unknown. The comparison between cosmic-ray electron and proton spectra measured at Earth suggests that electrons are released with a spectrum steeper than protons by $\Delta s_{\rm ep} \sim 0.3$ for energies above $\sim 10$ GeV and by $\Delta s_{\rm ep} \sim 1.2$ above $\sim 1$ TeV. Assuming that both species are accelerated at supernova remnant shocks, we here explore two possible scenarios that can in principle justify steeper electron spectra: (i) energy losses due to synchrotron radiation in an amplified magnetic field, and (ii) time dependent acceleration efficiency. We account for magnetic field amplification produced by either cosmic-ray induced instabilities or by magneto-hydrodynamics instabilities my means of a parametric description. We show that both mechanisms are required to explain the electron spectrum. In particular synchrotron losses can only produce a significant electron steepening above $\sim 1$~TeV, while a time dependent acceleration can explain the spectrum at lower energies if the electron injection into diffusive shock acceleration is inversely proportional to the shock speed. We discuss observational and theoretical evidences supporting such a behaviour. Furthermore, we predict two additional spectral features: a spectral break below $\sim$ few GeV (as required by existing observations) due to the acceleration efficiency drop during the adiabatic phase, and a spectral hardening above $\sim 20$ TeV (where no data are available yet) resulting from electrons escaping from the shock precursor.


title: Shallow Optical Flow Three-Stream CNN for Macro- and Micro-Expression Spotting from Long Videos

abstract: Facial expressions vary from the visible to the subtle. In recent years, the analysis of micro-expressions $-$ a natural occurrence resulting from the suppression of one's true emotions, has drawn the attention of researchers with a broad range of potential applications. However, spotting microexpressions in long videos becomes increasingly challenging when intertwined with normal or macro-expressions. In this paper, we propose a shallow optical flow three-stream CNN (SOFTNet) model to predict a score that captures the likelihood of a frame being in an expression interval. By fashioning the spotting task as a regression problem, we introduce pseudo-labeling to facilitate the learning process. We demonstrate the efficacy and efficiency of the proposed approach on the recent MEGC 2020 benchmark, where state-of-the-art performance is achieved on CAS(ME)$^{2}$ with equally promising results on SAMM Long Videos.


title: Self-Organized Criticality in Stellar Flares

abstract: Power law size distributions are the hallmarks of nonlinear energy dissipation processes governed by self-organized criticality. Here we analyze 75 data sets of stellar flare size distributions, mostly obtained from the {\sl Extreme Ultra-Violet Explorer (EUVE)} and the {\sl Kepler} mission. We aim to answer the following questions for size distributions of stellar flares: (i) What are the values and uncertainties of power law slopes? (ii) Do power law slopes vary with time ? (iii) Do power law slopes depend on the stellar spectral type? (iv) Are they compatible with solar flares? (v) Are they consistent with self-organized criticality (SOC) models? We find that the observed size distributions of stellar flare fluences (or energies) exhibit power law slopes of $\alpha_E=2.09\pm0.24$ for optical data sets observed with Kepler. The observed power law slopes do not show much time variability and do not depend on the stellar spectral type (M, K, G, F, A, Giants). In solar flares we find that background subtraction lowers the uncorrected value of $\alpha_E=2.20\pm0.22$ to $\alpha_E=1.57\pm0.19$. Furthermore, most of the stellar flares are temporally not resolved in low-cadence (30 min) Kepler data, which causes an additional bias. Taking these two biases into account, the stellar flare data sets are consistent with the theoretical prediction $N(x) \propto x^{-\alpha_x}$ of self-organized criticality models, i.e., $\alpha_E=1.5$. Thus, accurate power law fits require automated detection of the inertial range and background subtraction, which can be modeled with the generalized Pareto distribution, finite-system size effects, and extreme event outliers.


title: Avalanche correlations and stress-strain curves in discrete dislocation plasticity

abstract: The sequence of deformation bursts during plastic deformation exhibits scale-free features. In addition to the burst or avalanche sizes and the rate of avalanches the process is characterized by correlations in the series which become manifest in the resulting shape of the stress-strain curve. We analyze such features of plastic deformation with 2D and 3D simulations of discrete dislocation dynamics models and we show, that only with severe plastic deformation the ensuing memory effects become negligible. The role of past deformation history and dislocation pinning by disorder are studied. In general, the correlations have the effect of reducing the scatter of the individual stress-strain curves around the mean one.


title: Measuring the spins of heavy binary black holes

abstract: An accurate and precise measurement of the spins of individual merging black holes is required to understand their origin. While previous studies have indicated that most of the spin information comes from the inspiral part of the signal, the informative spin measurement of the heavy binary black hole system GW190521 suggests that the merger and ringdown can contribute significantly to the spin constraints for such massive systems. We perform a systematic study into the measurability of the spin parameters of individual heavy binary black hole mergers using a numerical relativity surrogate waveform model including the effects of both spin-induced precession and higher-order modes. We find that the spin measurements are driven by the merger and ringdown parts of the signal for GW190521-like systems, but the uncertainty in the measurement increases with the total mass of the system. We are able to place meaningful constraints on the spin parameters even for systems observed at moderate signal-to-noise ratios, but the measurability depends on the exact six-dimensional spin configuration of the system. Finally, we find that the azimuthal angle between the in-plane projections of the component spin vectors at a given reference frequency cannot be well-measured for most of our simulated configurations even for signals observed with high signal-to-noise ratios.


title: High-resolution Laboratory Measurements of K-shell X-ray Line Polarization and Excitation Cross Sections in Heliumlike S XV Ions

abstract: We report measurements of electron-impact excitation cross sections for the strong K-shell n=2-1 transitions in S XV using the LLNL EBIT-I electron beam ion trap, two crystal spectrometers, and the EBIT Calorimeter Spectrometer. The cross sections are determined by direct normalization to the well known cross sections of radiative electron capture, measured simultaneously. Using contemporaneous polarization measurements with the two crystal spectrometers, whose dispersion planes are oriented parallel and perpendicular to the electron beam direction, the polarization of the direct excitation line emission is determined, and in turn the isotropic total cross sections are extracted. We further experimentally investigate various line-formation mechanisms, finding that radiative cascades and collisional inner-shell ionization dominate the degree of linear polarization and total line-emission cross sections of the forbidden line $z$.

categories: physics.atom-ph astro-ph.HE astro-ph.IM physics.plasm-ph


title: Hidden sectors and a multi-temperature universe

abstract: A variety of supergravity and string based models contain hidden sectors which can play a role in particle physics phenomena and in cosmology. In this note we discuss the possibility that the visible sector and the hidden sectors in general live in different heat baths. Further, it is entirely possible that dark matter resides partially or wholly in hidden sectors in the form of dark Dirac fermions, dark neutralinos or dark photons. A proper analysis of dark matter and of dark forces in this case requires that one deals with a multi-temperature universe. We discuss the basic formalism which includes the multi-temperature nature of visible and hidden sectors in the analysis of phenomena observable in the visible sectors. Specifically we discuss the application of the formalism for explaining the velocity dependence of dark matter cross sections as one extrapolates from galaxy scales to scales of galaxy clusters. Here the dark photon exchange among dark fermions can produce the desired velocity dependent cross sections consistent with existing galactic cross section data indicating the existence of a new fifth (dark) force. We also discuss the possibility that the dark photon may constitute a significant portion of dark matter. We demonstrate a realization of this possibility in a universe with two hidden sectors and with the visible sector and the hidden sectors in different heat baths which allows a satisfaction of the constraints that the dark photon have a lifetime larger than the age of the universe and that its relic density be consistent with Planck data. Future directions for further work are discussed.


title: Geometric properties of certain integral operators involving Hornich operations

abstract: In this article, we investigate some standard geometric properties of the integral operators $$ J_\alpha [f](z)= \int_{0}^{z}\bigg(\frac{f(w)}{w}\bigg)^\alpha dw, \,\,\, \alpha \in \mathbb{C} \text{ and } |z|<1, $$ and $$ I_\beta [g](z)= \int_{0}^{z}\big(g'(w)\big)^\beta dw, \,\,\, \beta \in \mathbb{C} \text{ and } |z|<1, $$ where $f$ and $g$ are elements of certain classical families of normalized analytic functions defined on the unit disk. In particular, preserving properties of the Hornich sum of the operators $J_\alpha$ and $I_\beta$ will be studied. Moreover, we also present sharp pre-Schwarzian norm estimate of such integrals.


title: A geometric model for syzygies over 2-Calabi-Yau tilted algebras

abstract: In this article, we consider the class of 2-Calabi-Yau tilted algebras that are defined by a quiver with potential whose dual graph is a tree. We call these algebras \emph{dimer tree algebras} because they can also be realized as quotients of dimer algebras on a disc. These algebras are wild in general. For every such algebra $B$, we construct a polygon $\mathcal{S}$ with a checkerboard pattern in its interior that gives rise to a category $\text{Diag}(\mathcal{S})$. The indecomposable objects of $\text{Diag}(\mathcal{S})$ are the 2-diagonals in $\mathcal{S}$, and its morphisms are given by certain pivoting moves between the 2-diagonals. We conjecture that the category $\text{Diag}(\mathcal{S})$ is equivalent to the stable syzygy category over the algebra $B$, such that the rotation of the polygon corresponds to the shift functor on the syzygies. In particular, the number of indecomposable syzygies is finite and the projective resolutions are periodic. We prove the conjecture in the special case where every chordless cycle in the quiver is of length three. As a consequence, we obtain an explicit description of the projective resolutions. Moreover, we show that the syzygy category is equivalent to the 2-cluster category of type $\mathbb{A}$, and we introduce a new derived invariant for the algebra $B$ that can be read off easily from the quiver.


title: Charge-Density-Wave-Induced Peak-Dip-Hump Structure and the Multiband Superconductivity in a Kagome Superconductor CsV$_{3}$Sb$_{5}$

abstract: The entanglement of charge density wave (CDW), superconductivity, and topologically nontrivial electronic structure has recently been discovered in the kagome metal $A$V$_3$Sb$_5$ ($A$ = K, Rb, Cs) family. With high-resolution angle-resolved photoemission spectroscopy, we study the electronic properties of CDW and superconductivity in CsV$_3$Sb$_5$. The spectra around $\bar{K}$ is found to exhibit a peak-dip-hump structure associated with two separate branches of dispersion, demonstrating the isotropic CDW gap opening below $E_{\rm F}$. The peak-dip-hump lineshape is contributed by linearly dispersive Dirac bands in the lower branch and a dispersionless flat band close to $E_{\rm F}$ in the upper branch. The electronic instability via Fermi surface nesting could play a role in determining these CDW-related features. The superconducting gap of $\sim$0.4 meV is observed on both the electron band around $\bar{\Gamma}$ and the flat band around $\bar{K}$, implying the multiband superconductivity. The finite density of states (DOS) at $E_{\rm F}$ in the CDW phase are most likely in favor of the emergence of multiband superconductivity, particularly the enhanced DOS associated with the flat band. Our results not only shed light on the controversial origin of the CDW, but also offer insights into the relationship between CDW and superconductivity.


title: An adaptive cognitive sensor node for ECG monitoring in the Internet of Medical Things

abstract: The Internet of Medical Things (IoMT) paradigm is becoming mainstream in multiple clinical trials and healthcare procedures. Cardiovascular diseases monitoring, usually involving electrocardiogram (ECG) traces analysis, is one of the most promising and high-impact applications. Nevertheless, to fully exploit the potential of IoMT in this domain, some steps forward are needed. First, the edge-computing paradigm must be added to the picture. A certain level of near-sensor processing has to be enabled, to improve the scalability, portability, reliability, responsiveness of the IoMT nodes. Second, novel, increasingly accurate, data analysis algorithms, such as those based on artificial intelligence and Deep Learning, must be exploited. To reach these objectives, designers and programmers of IoMT nodes, have to face challenging optimization tasks, in order to execute fairly complex computing tasks on low-power wearable and portable processing systems, with tight power and battery lifetime budgets. In this work, we explore the implementation of a cognitive data analysis algorithm, based on a convolutional neural network trained to classify ECG waveforms, on a resource-constrained microcontroller-based computing platform. To minimize power consumption, we add an adaptivity layer that dynamically manages the hardware and software configuration of the device to adapt it at runtime to the required operating mode. Our experimental results show that adapting the node setup to the workload at runtime can save up to 50% power consumption. Our optimized and quantized neural network reaches an accuracy value higher than 97% for arrhythmia disorders detection on MIT-BIH Arrhythmia dataset.


title: Policy Gradient Bayesian Robust Optimization for Imitation Learning

abstract: The difficulty in specifying rewards for many real-world problems has led to an increased focus on learning rewards from human feedback, such as demonstrations. However, there are often many different reward functions that explain the human feedback, leaving agents with uncertainty over what the true reward function is. While most policy optimization approaches handle this uncertainty by optimizing for expected performance, many applications demand risk-averse behavior. We derive a novel policy gradient-style robust optimization approach, PG-BROIL, that optimizes a soft-robust objective that balances expected performance and risk. To the best of our knowledge, PG-BROIL is the first policy optimization algorithm robust to a distribution of reward hypotheses which can scale to continuous MDPs. Results suggest that PG-BROIL can produce a family of behaviors ranging from risk-neutral to risk-averse and outperforms state-of-the-art imitation learning algorithms when learning from ambiguous demonstrations by hedging against uncertainty, rather than seeking to uniquely identify the demonstrator's reward function.


title: A Benchmark of Dynamical Variational Autoencoders applied to Speech Spectrogram Modeling

abstract: The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model, input data vectors are processed independently. In recent years, a series of papers have presented different extensions of the VAE to process sequential data, that not only model the latent space, but also model the temporal dependencies within a sequence of data vectors and corresponding latent vectors, relying on recurrent neural networks. We recently performed a comprehensive review of those models and unified them into a general class called Dynamical Variational Autoencoders (DVAEs). In the present paper, we present the results of an experimental benchmark comparing six of those DVAE models on the speech analysis-resynthesis task, as an illustration of the high potential of DVAEs for speech modeling.


title: Analytical theory for three wave-mixing processes in a slightly deformed cylinder

abstract: The second order optical response of centrosymmetric materials manifests itself mostly at their surface, being strongly suppressed in their bulk. However, the overall surface response is also suppressed in nanoparticles with a centrosymmetric geometry subjected to homogeneous fields. Nevertheless, nanoparticles with a noncentrosymmetric geometry do exhibit second order optical properties. We develop an analytical theory to investigate the second order optical response of a noncentrosymmetric thin cylinder with a slightly deformed cross-section made up of a centrosymmetric material subjected to two monochromatic fields. We calculate the linear and nonlinear near fields perturbatively using the extent of the deformation away from a circular cross-section as the perturbation parameter. We obtain expressions for the quadratic hyperpolarizabilities in terms of the linear response evaluated at the three frequencies involved. We analyze the spectral features of the nonlinear response functions and explore their resonant structure for a model dielectric cylinder. Furthermore, we evaluate the second order radiated fields, the radiation patterns and efficiency of the different quadratic processes. We obtain a strong competition between electric dipolar, magnetic dipolar and electric quadrupolar contributions even for very small deformations.


title: A generalization of the Bohr-Rogosinski sum

abstract: In this paper, we investigate the Bohr-Rogosinski sum and the classical Bohr sum for analytic functions defined on the unit disk in a general setting. In addition, we discuss a generalization of the Bohr-Rogosinski sum for a class of analytic functions subordinate to the univalent functions in the unit disk. Several well-known results are observed from the consequences of our main results.


title: High order integrators obtained by linear combinations of symmetric-conjugate compositions

abstract: A new family of methods involving complex coefficients for the numerical integration of differential equations is presented and analyzed. They are constructed as linear combinations of symmetric-conjugate compositions obtained from a basic time-symmetric integrator of order 2n (n $\ge$ 1). The new integrators are of order 2(n + k), k = 1, 2, ..., and preserve time-symmetry up to order 4n + 3 when applied to differential equations with real vector fields. If in addition the system is Hamiltonian and the basic scheme is symplectic, then they also preserve symplecticity up to order 4n + 3. We show that these integrators are well suited for a parallel implementation, thus improving their efficiency. Methods up to order 10 based on a 4th-order integrator are built and tested in comparison with other standard procedures to increase the order of a basic scheme.


title: How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus

abstract: Intelligent agents that are confronted with novel concepts in situated environments will need to ask their human teammates questions to learn about the physical world. To better understand this problem, we need data about asking questions in situated task-based interactions. To this end, we present the Human-Robot Dialogue Learning (HuRDL) Corpus - a novel dialogue corpus collected in an online interactive virtual environment in which human participants play the role of a robot performing a collaborative tool-organization task. We describe the corpus data and a corresponding annotation scheme to offer insight into the form and content of questions that humans ask to facilitate learning in a situated environment. We provide the corpus as an empirically-grounded resource for improving question generation in situated intelligent agents.


title: Efficient Deep Learning Architectures for Fast Identification of Bacterial Strains in Resource-Constrained Devices

abstract: This work presents twelve fine-tuned deep learning architectures to solve the bacterial classification problem over the Digital Image of Bacterial Species Dataset. The base architectures were mainly published as mobile or efficient solutions to the ImageNet challenge, and all experiments presented in this work consisted of making several modifications to the original designs, in order to make them able to solve the bacterial classification problem by using fine-tuning and transfer learning techniques. This work also proposes a novel data augmentation technique for this dataset, which is based on the idea of artificial zooming, strongly increasing the performance of every tested architecture, even doubling it in some cases. In order to get robust and complete evaluations, all experiments were performed with 10-fold cross-validation and evaluated with five different metrics: top-1 and top-5 accuracy, precision, recall, and F1 score. This paper presents a complete comparison of the twelve different architectures, cross-validated with the original and the augmented version of the dataset, the results are also compared with several literature methods. Overall, eight of the eleven architectures surpassed the 0.95 scores in top-1 accuracy with our data augmentation method, being 0.9738 the highest top-1 accuracy. The impact of the data augmentation technique is reported with relative improvement scores.


title: Interpretable machine learning applied to on-farm biosecurity and porcine reproductive and respiratory syndrome virus

abstract: Effective biosecurity practices in swine production are key in preventing the introduction and dissemination of infectious pathogens. Ideally, biosecurity practices should be chosen by their impact on bio-containment and bio-exclusion, however quantitative supporting evidence is often unavailable. Therefore, the development of methodologies capable of quantifying and ranking biosecurity practices according to their efficacy in reducing risk have the potential to facilitate better informed choices. Using survey data on biosecurity practices, farm demographics, and previous outbreaks from 139 herds, a set of machine learning algorithms were trained to classify farms by porcine reproductive and respiratory syndrome virus status, depending on their biosecurity practices, to produce a predicted outbreak risk. A novel interpretable machine learning toolkit, MrIML-biosecurity, was developed to benchmark farms and production systems by predicted risk, and quantify the impact of biosecurity practices on disease risk at individual farms. Quantifying the variable impact on predicted risk 50% of 42 variables were associated with fomite spread while 31% were associated with local transmission. Results from machine learning interpretations identified similar results, finding substantial contribution to predicted outbreak risk from biosecurity practices relating to: the turnover and number of employees; the surrounding density of swine premises and pigs; the sharing of trailers; distance from the public road; and production type. In addition, the development of individualized biosecurity assessments provides the opportunity to guide biosecurity implementation on a case-by-case basis. Finally, the flexibility of the MrIML-biosecurity toolkit gives it potential to be applied to wider areas of biosecurity benchmarking, to address weaknesses in other livestock systems and industry relevant diseases.


title: Many-gluon tree amplitudes on modern GPUs: A case study for novel event generators

abstract: The compute efficiency of Monte-Carlo event generators for the Large Hadron Collider is expected to become a major bottleneck for simulations in the high-luminosity phase. Aiming at the development of a full-fledged generator for modern GPUs, we study the performance of various recursive strategies to compute multi-gluon tree-level amplitudes. We investigate the scaling of the algorithms on both CPU and GPU hardware. Finally, we provide practical recommendations as well as baseline implementations for the development of future simulation programs. The GPU implementations can be found at: https://www.gitlab.com/ebothmann/blockgen-archive.


title: Preferential Temporal Difference Learning

abstract: Temporal-Difference (TD) learning is a general and very useful tool for estimating the value function of a given policy, which in turn is required to find good policies. Generally speaking, TD learning updates states whenever they are visited. When the agent lands in a state, its value can be used to compute the TD-error, which is then propagated to other states. However, it may be interesting, when computing updates, to take into account other information than whether a state is visited or not. For example, some states might be more important than others (such as states which are frequently seen in a successful trajectory). Or, some states might have unreliable value estimates (for example, due to partial observability or lack of data), making their values less desirable as targets. We propose an approach to re-weighting states used in TD updates, both when they are the input and when they provide the target for the update. We prove that our approach converges with linear function approximation and illustrate its desirable empirical behaviour compared to other TD-style methods.


title: Step-Wise Hierarchical Alignment Network for Image-Text Matching

abstract: Image-text matching plays a central role in bridging the semantic gap between vision and language. The key point to achieve precise visual-semantic alignment lies in capturing the fine-grained cross-modal correspondence between image and text. Most previous methods rely on single-step reasoning to discover the visual-semantic interactions, which lacks the ability of exploiting the multi-level information to locate the hierarchical fine-grained relevance. Different from them, in this work, we propose a step-wise hierarchical alignment network (SHAN) that decomposes image-text matching into multi-step cross-modal reasoning process. Specifically, we first achieve local-to-local alignment at fragment level, following by performing global-to-local and global-to-global alignment at context level sequentially. This progressive alignment strategy supplies our model with more complementary and sufficient semantic clues to understand the hierarchical correlations between image and text. The experimental results on two benchmark datasets demonstrate the superiority of our proposed method.


title: Measuring the robustness of Gaussian processes to kernel choice

abstract: Gaussian processes (GPs) are used to make medical and scientific decisions, including in cardiac care and monitoring of atmospheric carbon dioxide levels. Notably, the choice of GP kernel is often somewhat arbitrary. In particular, uncountably many kernels typically align with qualitative prior knowledge (e.g.\ function smoothness or stationarity). But in practice, data analysts choose among a handful of convenient standard kernels (e.g.\ squared exponential). In the present work, we ask: Would decisions made with a GP differ under other, qualitatively interchangeable kernels? We show how to answer this question by solving a constrained optimization problem over a finite-dimensional space. We can then use standard optimizers to identify substantive changes in relevant decisions made with a GP. We demonstrate in both synthetic and real-world examples that decisions made with a GP can exhibit non-robustness to kernel choice, even when prior draws are qualitatively interchangeable to a user.


title: Dynamical independence: discovering emergent macroscopic processes in complex dynamical systems

abstract: We introduce a notion of emergence for coarse-grained macroscopic variables associated with highly-multivariate microscopic dynamical processes, in the context of a coupled dynamical environment. Dynamical independence instantiates the intuition of an emergent macroscopic process as one possessing the characteristics of a dynamical system "in its own right", with its own dynamical laws distinct from those of the underlying microscopic dynamics. We quantify (departure from) dynamical independence by a transformation-invariant Shannon information-based measure of dynamical dependence. We emphasise the data-driven discovery of dynamically-independent macroscopic variables, and introduce the idea of a multiscale "emergence portrait" for complex systems. We show how dynamical dependence may be computed explicitly for linear systems via state-space modelling, in both time and frequency domains, facilitating discovery of emergent phenomena at all spatiotemporal scales. We discuss application of the state-space operationalisation to inference of the emergence portrait for neural systems from neurophysiological time-series data. We also examine dynamical independence for discrete- and continuous-time deterministic dynamics, with potential application to Hamiltonian mechanics and classical complex systems such as flocking and cellular automata.


title: Elliptic Ruijsenaars difference operators on bounded partitions

abstract: By means of a truncation condition on the parameters, the elliptic Ruijsenaars difference operators are restricted onto a finite lattice of points encoded by bounded partitions. A corresponding orthogonal basis of joint eigenfunctions is constructed in terms of polynomials on the joint spectrum. In the trigonometric limit, this recovers the diagonalization of the truncated Macdonald difference operators by a finite-dimensional basis of Macdonald polynomials.


title: Learning the optimal Tikhonov regularizer for inverse problems

abstract: In this work, we consider the linear inverse problem $y=Ax+\epsilon$, where $A\colon X\to Y$ is a known linear operator between the separable Hilbert spaces $X$ and $Y$, $x$ is a random variable in $X$ and $\epsilon$ is a zero-mean random process in $Y$. This setting covers several inverse problems in imaging including denoising, deblurring, and X-ray tomography. Within the classical framework of regularization, we focus on the case where the regularization functional is not given a priori but learned from data. Our first result is a characterization of the optimal generalized Tikhonov regularizer, with respect to the mean squared error. We find that it is completely independent of the forward operator $A$ and depends only on the mean and covariance of $x$. Then, we consider the problem of learning the regularizer from a finite training set in two different frameworks: one supervised, based on samples of both $x$ and $y$, and one unsupervised, based only on samples of $x$. In both cases, we prove generalization bounds, under some weak assumptions on the distribution of $x$ and $\epsilon$, including the case of sub-Gaussian variables. Our bounds hold in infinite-dimensional spaces, thereby showing that finer and finer discretizations do not make this learning problem harder. The results are validated through numerical simulations.


title: Steering the current flow in twisted bilayer graphene

abstract: A nanoelectronic device made of twisted bilayer graphene (TBLG) is proposed to steer the direction of the current flow. The ballistic electron current, injected at one edge of the bottom layer, can be guided predominantly to one of the lateral edges of the top layer. The current is steered to the opposite lateral edge, if either the twist angle is reversed or the electrons are injected in the valence band instead of the conduction band, making it possible to control the current flow by electric gates. When both graphene layers are aligned, the current passes straight through the system without changing its initial direction. The observed steering angle exceeds well the twist angle and emerges for a broad range of experimentally accessible parameters. It is explained by the trigonal shape of the energy bands beyond the van Hove singularity due to the Moir\'e interference pattern. As the shape of the energy bands depends on the valley degree of freedom, the steered current is partially valley polarized. Our findings show how to control and manipulate the current flow in TBLG. Technologically, they are of relevance for applications in twistronics and valleytronics.


title: Probability Paths and the Structure of Predictions over Time

abstract: In settings ranging from weather forecasts to political prognostications to financial projections, probability estimates of future binary outcomes often evolve over time. For example, the estimated likelihood of rain on a specific day changes by the hour as new information becomes available. Given a collection of such probability paths, we introduce a Bayesian framework -- which we call the Gaussian latent information martingale, or GLIM -- for modeling the structure of dynamic predictions over time. Suppose, for example, that the likelihood of rain in a week is 50 %, and consider two hypothetical scenarios. In the first, one expects the forecast to be equally likely to become either 25 % or 75 % tomorrow; in the second, one expects the forecast to stay constant for the next several days. A time-sensitive decision-maker might select a course of action immediately in the latter scenario, but may postpone their decision in the former, knowing that new information is imminent. We model these trajectories by assuming predictions update according to a latent process of information flow, which is inferred from historical data. In contrast to general methods for time series analysis, this approach preserves important properties of probability paths such as the martingale structure and appropriate amount of volatility and better quantifies future uncertainties around probability paths. We show that GLIM outperforms three popular baseline methods, producing better estimated posterior probability path distributions measured by three different metrics. By elucidating the dynamic structure of predictions over time, we hope to help individuals make more informed choices.


title: Higgs-boson production in top-quark fragmentation

abstract: We compute the fragmentation functions for the production of a Higgs boson at $\mathcal{O}(y_t^2\alpha_s)$. As part of this calculation, the relevant splitting functions are also derived at the same perturbative order. Our results can be used to compute differential cross sections with arbitrary top-quark and Higgs-boson masses from massless calculations. They can also be used to resum logarithms of the form $\ln(p_T/m)$ at large transverse momentum $p_T$ to next-to-leading-logarithmic accuracy by solving the DGLAP equations.


title: On primitive axial decomposition algebras of Majorana type with degenerate eigenvalues

abstract: A class of axial decomposition algebras with Miyamoto group generated by two Miyamoto automorphisms and three eigenvalues $0,1$ and $\eta$ is introduced and classified in the case with $\eta\notin\{0,1,\frac{1}{2}\}$. This class includes specializations of 2-generated axial algebras of Majorana type $(\xi,\eta)$ to the case with $\xi=\eta$.


title: Forecasting VaR and ES using a joint quantile regression and implications in portfolio allocation

abstract: In this paper we propose a multivariate quantile regression framework to forecast Value at Risk (VaR) and Expected Shortfall (ES) of multiple financial assets simultaneously, extending Taylor (2019). We generalize the Multivariate Asymmetric Laplace (MAL) joint quantile regression of Petrella and Raponi (2019) to a time-varying setting, which allows us to specify a dynamic process for the evolution of both VaR and ES of each asset. The proposed methodology accounts for the dependence structure among asset returns. By exploiting the properties of the MAL distribution, we then propose a new portfolio optimization method that minimizes the portfolio risk and controls for well-known characteristics of financial data. We evaluate the advantages of the proposed approach on both simulated and real data, using weekly returns on three major stock market indices. We show that our method outperforms other existing models and provides more accurate risk measure forecasts compared to univariate ones.


title: N-Best ASR Transformer: Enhancing SLU Performance using Multiple ASR Hypotheses

abstract: Spoken Language Understanding (SLU) systems parse speech into semantic structures like dialog acts and slots. This involves the use of an Automatic Speech Recognizer (ASR) to transcribe speech into multiple text alternatives (hypotheses). Transcription errors, common in ASRs, impact downstream SLU performance negatively. Approaches to mitigate such errors involve using richer information from the ASR, either in form of N-best hypotheses or word-lattices. We hypothesize that transformer models learn better with a simpler utterance representation using the concatenation of the N-best ASR alternatives, where each alternative is separated by a special delimiter [SEP]. In our work, we test our hypothesis by using concatenated N-best ASR alternatives as the input to transformer encoder models, namely BERT and XLM-RoBERTa, and achieve performance equivalent to the prior state-of-the-art model on DSTC2 dataset. We also show that our approach significantly outperforms the prior state-of-the-art when subjected to the low data regime. Additionally, this methodology is accessible to users of third-party ASR APIs which do not provide word-lattice information.


title: Tidal excitation as mixing in thermal CFT

abstract: We use mixed correlators in thermal CFT as clean probes of the strong gravity effects in their holographic duals. The dual interpretation of mixing is an inelastic conversion of one field to another field, induced by gravity: tidal excitation. We find an enhanced mixing at high temperatures, corresponding to large AdS black holes, concentrated to small boundary momenta, dual to the deep bulk, where strong gravitational fields are expected. We also find large $\mathcal{O}(1/G_{N})$ tidal conversion in the low temperature phase of the $U(N)$ vector model, strengthening suspicions that the bulk dual of this phase also houses extremely compact objects.


title: The IMF and multiplicity of stars from gravity, turbulence, magnetic fields, radiation and outflow feedback

abstract: We perform a series of three-dimensional, magnetohydrodynamical (MHD) simulations of star cluster formation including gravity, turbulence, magnetic fields, stellar radiative heating and outflow feedback. We observe that the inclusion of protostellar outflows (1) reduces the star formation rate by a factor of $\sim2$, (2) increases fragmentation, and (3) shifts the initial mass function (IMF) to lower masses by a factor of $2.0\pm0.2$, without significantly affecting the overall shape of the IMF. The form of the sink particle (protostellar objects) mass distribution obtained from our simulations matches the observational IMFs reasonably well. We also show that turbulence-based theoretical models of the IMF agree well with our simulation IMF in the high-mass and low-mass regime, but do not predict any brown dwarfs, whereas our simulations produce a considerable number of sub-stellar objects, which are produced by dynamical interactions (ejections). We find that these dynamical interactions also play a key role for the binary separation distribution and stellar kinematics in general. Our numerical model of star cluster formation also reproduces the observed mass dependence of multiplicity. Our multiplicity fraction estimates generally concur with the observational estimates for different spectral types. We further calculate the specific angular momentum of all the sink particles and find that the average value of $1.5 \times 10^{19}\, \mathrm{cm^2\, s^{-1}}$ is consistent with observational data. The specific angular momentum of our sink particles lies in the range typical of protostellar envelopes and binaries. We conclude that the IMF is controlled by a combination of gravity, turbulence, magnetic fields, radiation and outflow feedback.


title: On the separation of Hall and Ohmic nonlinear responses

abstract: The symmetric and antisymmetric parts of the linear conductivity describe the dissipative (Ohmic) and nondissipative (Hall) parts of the current. The Hall current is always transverse to the applied electric field regardless of its orientation; the Ohmic current is purely longitudinal in cubic crystals, but in lower-symmetry crystals it has a transverse component whenever the field is not aligned with a principal axis. In this work, we extend that analysis beyond the linear regime. We consider all possible ways of partitioning the current at any order in the electric field without taking symmetry into account, and find that the Hall vs Ohmic decomposition is the only one that satisfies certain basic requirements. A general prescription is given for achieving that decomposition, and the case of the quadratic conductivity is analyzed in detail. By performing a symmetry analysis we find that in five of the 122 magnetic point groups the quadratic dc conductivity is purely Ohmic and even under time reversal, a type of response that is entirely disorder mediated.


title: Recovery of Meteorites Using an Autonomous Drone and Machine Learning

abstract: The recovery of freshly fallen meteorites from tracked and triangulated meteors is critical to determining their source asteroid families. However, locating meteorite fragments in strewn fields remains a challenge with very few meteorites being recovered from the meteors triangulated in past and ongoing meteor camera networks. We examined if locating meteorites can be automated using machine learning and an autonomous drone. Drones can be programmed to fly a grid search pattern and take systematic pictures of the ground over a large survey area. Those images can be analyzed using a machine learning classifier to identify meteorites in the field among many other features. Here, we describe a proof-of-concept meteorite classifier that deploys off-line a combination of different convolution neural networks to recognize meteorites from images taken by drones in the field. The system was implemented in a conceptual drone setup and tested in the suspected strewn field of a recent meteorite fall near Walker Lake, Nevada.


title: WAX-ML: A Python library for machine learning and feedback loops on streaming data

abstract: Wax is what you put on a surfboard to avoid slipping. It is an essential tool to go surfing... We introduce WAX-ML a research-oriented Python library providing tools to design powerful machine learning algorithms and feedback loops working on streaming data. It strives to complement JAX with tools dedicated to time series. WAX-ML makes JAX-based programs easy to use for end-users working with pandas and xarray for data manipulation. It provides a simple mechanism for implementing feedback loops, allows the implementation of online learning and reinforcement learning algorithms with functions, and makes them easy to integrate by end-users working with the object-oriented reinforcement learning framework from the Gym library. It is released with an Apache open-source license on GitHub at https://github.com/eserie/wax-ml.


title: ExtendedHyperLogLog: Analysis of a new Cardinality Estimator

abstract: We discuss the problem of counting distinct elements in a stream. A stream is usually considered as a sequence of elements that come one at a time. An exact solution to the problem requires memory space of the size of the stream. For many applications this solution is infeasible due to very large streams. The solution in that case, is to use a probabilistic data structure (also called sketch), from which we can estimate with high accuracy the cardinality of the stream. We present a new algorithm, ExtendedHyperLogLog (EHLL), which is based on the state-of-the-art algorithm, HyperLogLog (HLL). In order to achieve the same accuracy as HLL, EHLL uses 16% less memory. In recent years, a martingale approach has bean developed. In the martingale setting we receive better accuracy at the price of not being able to merge sketches. EHLL also works in the martingale setting. Martingale EHLL achieves the same accuracy as Martingale HLL using 12% less memory.


title: Online Continual Adaptation with Active Self-Training

abstract: Models trained with offline data often suffer from continual distribution shifts and expensive labeling in changing environments. This calls for a new online learning paradigm where the learner can continually adapt to changing environments with limited labels. In this paper, we propose a new online setting -- Online Active Continual Adaptation, where the learner aims to continually adapt to changing distributions using both unlabeled samples and active queries of limited labels. To this end, we propose Online Self-Adaptive Mirror Descent (OSAMD), which adopts an online teacher-student structure to enable online self-training from unlabeled data, and a margin-based criterion that decides whether to query the labels to track changing distributions. Theoretically, we show that, in the separable case, OSAMD has an $O({T}^{2/3})$ dynamic regret bound under mild assumptions, which is aligned with the $\Omega(T^{2/3})$ lower bound of online learning algorithms with full labels. In the general case, we show a regret bound of $O({T}^{2/3} + \alpha^* T)$, where $\alpha^*$ denotes the separability of domains and is usually small. Our theoretical results show that OSAMD can fast adapt to changing environments with active queries. Empirically, we demonstrate that OSAMD achieves favorable regrets under changing environments with limited labels on both simulated and real-world data, which corroborates our theoretical findings.


title: NNNLLA BFKL pomeron eigenvalue in the planar N=4 SYM theory

abstract: We find the eigenvalue of the kernel of BFKL equation in the next-to-next-to-next-to-leading logarithm approximation (NNNLLA) in the planar N=4 SYM theory by using the quantum spectral curve to compute values at fixed spin, and reconstructing the general result using the LLL-algorithm, which also was used for the reconstruction of the general result for the intercept function for arbitrary conformal spin at fourth order, computed earlier in paper 1802.06908 up to the rational part. We have found, that a new type of harmonic sums enter into results. Those sums have the argument multiplied by factor two with compare to usual harmonic sums and contain the last imagine index, what reflect their relations with the multiple polylogarithms, generated by ``fourth root of unity''. The final result contains Catalan number, which did not appear early in the calculations for the anomalous dimension of twist-2 operators.


title: Local Explanation of Dialogue Response Generation

abstract: In comparison to the interpretation of classification models, the explanation of sequence generation models is also an important problem, however it has seen little attention. In this work, we study model-agnostic explanations of a representative text generation task -- dialogue response generation. Dialog response generation is challenging with its open-ended sentences and multiple acceptable responses. To gain insights into the reasoning process of a generation model, we propose a new method, local explanation of response generation (LERG) that regards the explanations as the mutual interaction of segments in input and output sentences. LERG views the sequence prediction as uncertainty estimation of a human response and then creates explanations by perturbing the input and calculating the certainty change over the human response. We show that LERG adheres to desired properties of explanations for text generation including unbiased approximation, consistency and cause identification. Empirically, our results show that our method consistently improves other widely used methods on proposed automatic- and human- evaluation metrics for this new task by 4.4-12.8%. Our analysis demonstrates that LERG can extract both explicit and implicit relations between input and output segments.