title: Group-based Bi-Directional Recurrent Wavelet Neural Networks for Video Super-Resolution

abstract: Video super-resolution (VSR) aims to estimate a high-resolution (HR) frame from a low-resolution (LR) frames. The key challenge for VSR lies in the effective exploitation of spatial correlation in an intra-frame and temporal dependency between consecutive frames. However, most of the previous methods treat different types of the spatial features identically and extract spatial and temporal features from the separated modules. It leads to lack of obtaining meaningful information and enhancing the fine details. In VSR, there are three types of temporal modeling frameworks: 2D convolutional neural networks (CNN), 3D CNN, and recurrent neural networks (RNN). Among them, the RNN-based approach is suitable for sequential data. Thus the SR performance can be greatly improved by using the hidden states of adjacent frames. However, at each of time step in a recurrent structure, the RNN-based previous works utilize the neighboring features restrictively. Since the range of accessible motion per time step is narrow, there are still limitations to restore the missing details for dynamic or large motion. In this paper, we propose a group-based bi-directional recurrent wavelet neural networks (GBR-WNN) to exploit the sequential data and spatio-temporal information effectively for VSR. The proposed group-based bi-directional RNN (GBR) temporal modeling framework is built on the well-structured process with the group of pictures (GOP). We propose a temporal wavelet attention (TWA) module, in which attention is adopted for both spatial and temporal features. Experimental results demonstrate that the proposed method achieves superior performance compared with state-of-the-art methods in both of quantitative and qualitative evaluations.


title: Distributionally Robust Martingale Optimal Transport

abstract: We study the problem of bounding path-dependent expectations (within any finite time horizon $d$) over the class of discrete-time martingales whose marginal distributions lie within a prescribed tolerance of a given collection of benchmark marginal distributions. This problem is a relaxation of the martingale optimal transport (MOT) problem and is motivated by applications to super-hedging in financial markets. We show that the empirical version of our relaxed MOT problem can be approximated within $O\left( n^{-1/2}\right)$ error where $n$ is the number of samples of each of the individual marginal distributions (generated independently) and using a suitably constructed finite-dimensional linear programming problem.

categories: math.PR math.OC math.ST q-fin.CP stat.TH


title: Automatic Document Sketching: Generating Drafts from Analogous Texts

abstract: The advent of large pre-trained language models has made it possible to make high-quality predictions on how to add or change a sentence in a document. However, the high branching factor inherent to text generation impedes the ability of even the strongest language models to offer useful editing suggestions at a more global or document level. We introduce a new task, document sketching, which involves generating entire draft documents for the writer to review and revise. These drafts are built from sets of documents that overlap in form - sharing large segments of potentially reusable text - while diverging in content. To support this task, we introduce a Wikipedia-based dataset of analogous documents and investigate the application of weakly supervised methods, including use of a transformer-based mixture of experts, together with reinforcement learning. We report experiments using automated and human evaluation methods and discuss relative merits of these models.


title: Crowdsourcing via Annotator Co-occurrence Imputation and Provable Symmetric Nonnegative Matrix Factorization

abstract: Unsupervised learning of the Dawid-Skene (D&S) model from noisy, incomplete and crowdsourced annotations has been a long-standing challenge, and is a critical step towards reliably labeling massive data. A recent work takes a coupled nonnegative matrix factorization (CNMF) perspective, and shows appealing features: It ensures the identifiability of the D\&S model and enjoys low sample complexity, as only the estimates of the co-occurrences of annotator labels are involved. However, the identifiability holds only when certain somewhat restrictive conditions are met in the context of crowdsourcing. Optimizing the CNMF criterion is also costly -- and convergence assurances are elusive. This work recasts the pairwise co-occurrence based D&S model learning problem as a symmetric NMF (SymNMF) problem -- which offers enhanced identifiability relative to CNMF. In practice, the SymNMF model is often (largely) incomplete, due to the lack of co-labeled items by some annotators. Two lightweight algorithms are proposed for co-occurrence imputation. Then, a low-complexity shifted rectified linear unit (ReLU)-empowered SymNMF algorithm is proposed to identify the D&S model. Various performance characterizations (e.g., missing co-occurrence recoverability, stability, and convergence) and evaluations are also presented.


title: A note on Fredholm integral equation

abstract: This note gives results on the existence of semi-continuous solutions of a Fredholm integral equation of the second kind using Tarski's fixed point theorem.


title: Extreme mass-ratio inspirals around a spinning horizonless compact object

abstract: Extreme mass-ratio inspirals (EMRIs) detectable by the Laser Interferometer Space Antenna are unique probes of the nature of supermassive compact objects. We compute the gravitational-wave signal emitted by a stellar-mass compact object in a circular equatorial orbit around a Kerr-like horizonless supermassive object defined by an effective radius and a reflectivity coefficient. The Teukolsky equations are solved consistently with suitable (frequency-dependent) boundary conditions, and the modified energy and angular-momentum fluxes are used to evolve the orbital parameters adiabatically. The gravitational fluxes have resonances corresponding to the low-frequency quasinormal modes of the central object, which can contribute significantly to the gravitational-wave phase. Overall, the absence of a classical event horizon in the central object can affect the gravitational-wave signal dramatically, with deviations even larger than those previously estimated by a model-independent analysis of the tidal heating. We estimate that EMRIs could potentially place the most stringent constraint on the reflectivity of supermassive compact objects at the remarkable level of ${\cal O}(10^{-6})\%$ and would allow to constrain various models which are not ruled out by the ergoregion instability. In particular, an EMRI detection could allow one to rule out (or provide evidence for) signatures of quantum black-hole horizons with Boltzmann reflectivity. Our results provide motivation for performing rigorous parameter estimation to assess the detectability of these effects.


title: On the irreducible characters of Suzuki p-groups

abstract: In this paper, we completely determine the irreducible characters of the four families of Suzuki $p$-groups.


title: DAGs with No Curl: An Efficient DAG Structure Learning Approach

abstract: Recently directed acyclic graph (DAG) structure learning is formulated as a constrained continuous optimization problem with continuous acyclicity constraints and was solved iteratively through subproblem optimization. To further improve efficiency, we propose a novel learning framework to model and learn the weighted adjacency matrices in the DAG space directly. Specifically, we first show that the set of weighted adjacency matrices of DAGs are equivalent to the set of weighted gradients of graph potential functions, and one may perform structure learning by searching in this equivalent set of DAGs. To instantiate this idea, we propose a new algorithm, DAG-NoCurl, which solves the optimization problem efficiently with a two-step procedure: 1) first we find an initial cyclic solution to the optimization problem, and 2) then we employ the Hodge decomposition of graphs and learn an acyclic graph by projecting the cyclic graph to the gradient of a potential function. Experimental studies on benchmark datasets demonstrate that our method provides comparable accuracy but better efficiency than baseline DAG structure learning methods on both linear and generalized structural equation models, often by more than one order of magnitude.


title: Classical and Quantum Algorithms for Orthogonal Neural Networks

abstract: Orthogonal neural networks have recently been introduced as a new type of neural networks imposing orthogonality on the weight matrices. They could achieve higher accuracy and avoid evanescent or explosive gradients for deep architectures. Several classical gradient descent methods have been proposed to preserve orthogonality while updating the weight matrices, but these techniques suffer from long running times or provide only approximate orthogonality. In this paper, we introduce a new type of neural network layer called Pyramidal Circuit, which implements an orthogonal matrix multiplication. It allows for gradient descent with perfect orthogonality with the same asymptotic running time as a standard layer. This algorithm is inspired by quantum computing and can therefore be applied on a classical computer as well as on a near term quantum computer. It could become the building block for quantum neural networks and faster orthogonal neural networks.


title: Design and Experimental Assessment of Detection Schemes for Air Interface Attacks in Adverse Scenarios

abstract: In this letter, we propose three schemes designed to detect attacks over the air interface in cellular networks. These decision rules rely on the generalized likelihood ratio test, and are fed by data that can be acquired using common off-the-shelf receivers. In addition to more classical (barrage/smart) noise jamming attacks, we further assess the capability of the proposed schemes to detect the stealthy activation of a rogue base station. The evaluation is carried out through an experimentation of a LTE system concretely reproduced using Software-Defined Radios. Illustrative examples confirm that the proposed schemes can effectively detect air interface threats with high probability.


title: Towards Continuous Safety Assessment in Context of DevOps

abstract: Traditionally, promoted by the internet companies, continuous delivery is more and more appealing to industries which develop systems with safety-critical functions. Since safety-critical systems must meet regulatory requirements and require specific safety assessment processes in addition to the normal development steps, enabling continuous delivery of software in safety-critical systems requires the automation of the safety assessment process in the delivery pipeline. In this paper, we outline a continuous delivery pipeline for realizing continuous safety assessment in software-intensive safety-critical systems based on model-based safety assessment methods.


title: Ab initio study of lattice dynamics of group IV semiconductors using pseudohybrid functionals for extended Hubbard interactions

abstract: We study the lattice dynamics of group IV semiconductors using fully ab-initio extended Hubbard functional. The onsite and intersite Hubbard interactions are determined self-consistently with recently developed pseudohybrid functionals and included in force calculations. We analyze the Pulay forces by the choice of atomic orbital projectors and the force contribution of the onsite and intersite Hubbard terms. The phonon dispersions, Gruneisen parameters, and lattice thermal conductivities of diamond, silicon, and germanium, which are most-representative covalent-bonding semiconductors, are calculated and compared with the results using local, semilocal, and hybrid functionals. The extended Hubbard functional produces increased phonon velocities and lifetimes, and thus lattice thermal conductivities compared to local and semilocal functionals, agreeing with experiments very well. Considering that our computational demand is comparable to simple local functionals, this work thus suggests a way to perform high-throughput electronic and structural calculations with a higher accuracy.


title: Optimal transport in multilayer networks for traffic flow optimization

abstract: Modeling traffic distribution and extracting optimal flows in multilayer networks is of utmost importance to design efficient multi-modal network infrastructures. Recent results based on optimal transport theory provide powerful and computationally efficient methods to address this problem, but they are mainly focused on modeling single-layer networks. Here we adapt these results to study how optimal flows distribute on multilayer networks. We propose a model where optimal flows on different layers contribute differently to the total cost to be minimized. This is done by means of a parameter that varies with layers, which allows to flexibly tune the sensitivity to traffic congestion of the various layers. As an application, we consider transportation networks, where each layer is associated to a different transportation system and show how the traffic distribution varies as we tune this parameter across layers. We show an example of this result on the real 2-layer network of the city of Bordeaux with bus and tram, where we find that in certain regimes the presence of the tram network significantly unburdens the traffic on the road network. Our model paves the way to further analysis of optimal flows and navigability strategies in real multilayer networks.


title: Online Sub-Sampling for Reinforcement Learning with General Function Approximation

abstract: Most of the existing works for reinforcement learning (RL) with general function approximation (FA) focus on understanding the statistical complexity or regret bounds. However, the computation complexity of such approaches is far from being understood -- indeed, a simple optimization problem over the function class might be as well intractable. In this paper, we tackle this problem by establishing an efficient online sub-sampling framework that measures the information gain of data points collected by an RL algorithm and uses the measurement to guide exploration. For a value-based method with complexity-bounded function class, we show that the policy only needs to be updated for $\propto\operatorname{poly}\log(K)$ times for running the RL algorithm for $K$ episodes while still achieving a small near-optimal regret bound. In contrast to existing approaches that update the policy for at least $\Omega(K)$ times, our approach drastically reduces the number of optimization calls in solving for a policy. When applied to settings in \cite{wang2020reinforcement} or \cite{jin2021bellman}, we improve the overall time complexity by at least a factor of $K$. Finally, we show the generality of our online sub-sampling technique by applying it to the reward-free RL setting and multi-agent RL setting.


title: Hard Samples Rectification for Unsupervised Cross-domain Person Re-identification

abstract: Person re-identification (re-ID) has received great success with the supervised learning methods. However, the task of unsupervised cross-domain re-ID is still challenging. In this paper, we propose a Hard Samples Rectification (HSR) learning scheme which resolves the weakness of original clustering-based methods being vulnerable to the hard positive and negative samples in the target unlabelled dataset. Our HSR contains two parts, an inter-camera mining method that helps recognize a person under different views (hard positive) and a part-based homogeneity technique that makes the model discriminate different persons but with similar appearance (hard negative). By rectifying those two hard cases, the re-ID model can learn effectively and achieve promising results on two large-scale benchmarks.


title: Commutators in groups of order $p^7$

abstract: We present a characterisation of groups $G$ of order $p^7$, $p$ prime, in which not all elements of the commutator subgroup $\gamma_2(G)$ of $G$ are commutators in $G$. On the way we obtain several structural results on groups of order $p^7$.


title: Stability and selective extinction in complex mutualistic networks

abstract: We study species abundance in the empirical plant-pollinator mutualistic networks exhibiting broad degree distributions, with uniform intra-group competition assumed, by the Lotka-Volterra equation. The stability of a fixed point is found to be identified by the signs of its non-zero components and those of its neighboring fixed points. Taking the annealed approximation, we derive the non-zero components to be formulated in terms of degrees and the rescaled interaction strengths, which lead us to find different stable fixed points depending on parameters, and we obtain the phase diagram. The selective extinction phase finds small-degree species extinct and effective interaction reduced, maintaining stability and hindering the onset of instability. The non-zero minimum species abundances from different empirical networks show data collapse when rescaled as predicted theoretically.


title: Straight to the Gradient: Learning to Use Novel Tokens for Neural Text Generation

abstract: Advanced large-scale neural language models have led to significant success in many language generation tasks. However, the most commonly used training objective, Maximum Likelihood Estimation (MLE), has been shown problematic, where the trained model prefers using dull and repetitive phrases. In this work, we introduce ScaleGrad, a modification straight to the gradient of the loss function, to remedy the degeneration issue of the standard MLE objective. By directly maneuvering the gradient information, ScaleGrad makes the model learn to use novel tokens. Empirical results show the effectiveness of our method not only in open-ended generation, but also in directed generation tasks. With the simplicity in architecture, our method can serve as a general training objective that is applicable to most of the neural text generation tasks.


title: A reverse ergodic theorem for inhomogeneous killed Markov chains and application to a new uniqueness result for reflecting diffusions

abstract: Bass and Pardoux (1987) deduce from the Krein-Rutman theorem a reverse ergodic theorem for a sub-probability transition function, which turns out to be a key tool in proving uniqueness of reflecting Brownian Motion in cones in Kwon and Williams (1991) and Taylor and Williams (1993). By a different approach, we are able to prove an analogous reverse ergodic theorem for a family of inhomogeneous sub-probability transition functions. This allows us to prove existence and uniqueness for a diffusion process with varying, oblique direction of reflection, in a domain with one singular point that can be approximated, near the singular point, by a smooth cone, under natural, easily verifiable geometric conditions.


title: Heavy particle non-decoupling in flavor-changing gravitational interactions

abstract: The flavor-changing gravitational process d --> s + graviton, is evaluated at the one-loop level in the standard electroweak theory with on-shell renormalization. The results we present in the 't Hooft-Feynman gauge are valid for on- and off-shell quarks and for all external and internal quark masses. We show that there exist non-decoupling effects of the internal heavy top quark in interactions with gravity. A naive argument taking account of the quark Yukawa coupling suggests that the amplitude of the process d --> s + graviton in the large top quark mass limit would possibly acquire an enhancement factor $m_{t}^{2}/M_{W}^{2}$, where $m_{t}$ and $M_{W}$ are the top quark and the W-boson masses, respectively. In practice this leading enhancement is absent in the renormalized amplitude due to cancellation. Thus the non-decoupling of the internal top quark takes place at the $O(1)$ level. The flavor-changing two- and three-point functions are shown to satisfy the Ward-Takahashi identity, which is used for a consistency-check of the aforementioned cancellation of the $O(m_{t}^{2}/M_{W}^{2})$ terms. Among the $O(1)$ non-decoupling terms, we sort out those that can be regarded as due to the effective Lagrangian in which quark bilinear forms are coupled to the scalar curvature.


title: A macro-microscopic coupled constitutive model for fluid-saturated porous media with compressible constituents

abstract: The paper provides a macro-microscopic coupled constitutive model for fluid-saturated porous media with respect to the compressibility of the solid skeleton, the real solid material and the fluid phase. The derivation of the model is carried out based on the porous media theory and is consistent with the second law of thermodynamics. In the present paper, two different sets of independent variables are introduced to implement the coupled behavior between the compressibility of the solid skeleton and the real solid material. Altogether the proposed model exploits five independent variables, i.e. the deviatoric part of the right Cauchy-Green deformation tensor, the partial density of solid phase, the density of the real solid material, the density of the real fluid material and the relative velocity of the fluid phase. Subsequently, the linearized version of the proposed constitutive model is also presented and compared with some models by other authors. It is found that Biot's model can also be derived based on the linearized version of the proposed model, which indicates that the present work bridges the gap between the porous media theory and Biot's model. Compared with Biot's model, the present model can provide the evolution of the porosity by considering the volumetric strain of the solid skeleton and the volumetric strain of the real solid material.


title: Differentiable Neural Architecture Search with Morphism-based Transformable Backbone Architectures

abstract: This study aims at making the architecture search process more adaptive for one-shot or online training. It is extended from the existing study on differentiable neural architecture search, and we made the backbone architecture transformable rather than fixed during the training process. As is known, differentiable neural architecture search (DARTS) requires a pre-defined over-parameterized backbone architecture, while its size is to be determined manually. Also, in DARTS backbone, Hadamard product of two elements is not introduced, which exists in both LSTM and GRU cells for recurrent nets. This study introduces a growing mechanism for differentiable neural architecture search based on network morphism. It enables growing of the cell structures from small size towards large size ones with one-shot training. Two modes can be applied in integrating the growing and original pruning process. We also implement a recently proposed two-input backbone architecture for recurrent neural networks. Initial experimental results indicate that our approach and the two-input backbone structure can be quite effective compared with other baseline architectures including LSTM, in a variety of learning tasks including multi-variate time series forecasting and language modeling. On the other hand, we find that dynamic network transformation is promising in improving the efficiency of differentiable architecture search.


title: Imaging the breaking of electrostatic dams in graphene for ballistic and viscous fluids

abstract: The flow of charge carriers in materials can, under some circumstances, mimic the flow of viscous fluids. In order to visualize the consequences of such effects, new methodologies must be developed that can probe the quasiparticle flow profile with nm-scale resolution as the geometric parameters of the system are continuously evolved. In this work, scanning tunneling potentiometry (STP) is used to image quasiparticle flow around engineered electrostatic barriers in graphene/hBN heterostructures. Measurements are performed as electrostatic dams - defined by lateral pn-junction barriers - are broken within the graphene sheet, and carriers move through conduction channels with physical widths that vary continuously from pinch-off to um-scale. Local, STP measurements of the electrochemical potential allow for direct characterization of the evolving flow profile, which we compare to finite-element simulations of a Stokesian fluid with varying parameters. Our results reveal distinctly non-Ohmic flow profiles, with charge dipoles forming across barriers due to carrier scattering and accumulation on the upstream side, and depletion downstream. Conductance measurements of individual channels, meanwhile, reveal that at low temperatures the quasiparticle flow is ballistic, but as the temperature is raised there is a Knudsen-to-Gurzhi regime crossover where the fluid becomes viscous and the channel conductance exceeds the ballistic limit set by Sharvin conductance. These results provide a clear illustration of how carrier flow in a Fermi fluid evolves as a function of carrier density, channel width, and temperature. They also demonstrate how STP can be used to extract key parameters of quasiparticle transport, with a spatial resolution that exceeds that of other methods by orders of magnitude.


title: TweetPap: A Dataset to Study the Social Media Discourse of Scientific Papers

abstract: Nowadays, researchers have moved to platforms like Twitter to spread information about their ideas and empirical evidence. Recent studies have shown that social media affects the scientific impact of a paper. However, these studies only utilize the tweet counts to represent Twitter activity. In this paper, we propose TweetPap, a large-scale dataset that introduces temporal information of citation/tweets and the metadata of the tweets to quantify and understand the discourse of scientific papers on social media. The dataset is publicly available at https://github.com/lingo-iitgn/TweetPap


title: Backdoor Learning Curves: Explaining Backdoor Poisoning Beyond Influence Functions

abstract: Backdoor attacks inject poisoning samples during training, with the goal of forcing a machine learning model to output an attacker-chosen class when presented a specific trigger at test time. Although backdoor attacks have been demonstrated in a variety of settings and against different models, the factors affecting their effectiveness are still not well understood. In this work, we provide a unifying framework to study the process of backdoor learning under the lens of incremental learning and influence functions. We show that the effectiveness of backdoor attacks depends on: (i) the complexity of the learning algorithm, controlled by its hyperparameters; (ii) the fraction of backdoor samples injected into the training set; and (iii) the size and visibility of the backdoor trigger. These factors affect how fast a model learns to correlate the presence of the backdoor trigger with the target class. Our analysis unveils the intriguing existence of a region in the hyperparameter space in which the accuracy on clean test samples is still high while backdoor attacks are ineffective, thereby suggesting novel criteria to improve existing defenses.


title: Unitriangular basic sets for blocks of the symmetric and alternating groups of small weights

abstract: We study the existence of unitriangular basic sets for the symmetric group which behave nicely with respect to the Mullineux involution. Such sets give a natural labelling for the modular irreducible representations. We show that, for any odd prime p, the p-blocks of the symmetric group with weight 2 have stable unitriangular basic sets which we describe by studying the combinatorics of partitions in these blocks.


title: Propagation of singularities for subelliptic wave equations

abstract: H{\"o}rmander's propagation of singularities theorem does not fully describe the propagation of singularities in subelliptic wave equations, due to the existence of doubly characteristic points. In the present work, building upon a visionary conference paper by R. Melrose \cite{Mel86}, we prove that singularities of subelliptic wave equations only propagate along null-bicharacteristics and abnormal extremals, which are well-known curves in optimal control theory. As a consequence, we characterize the singular support of subelliptic wave kernels outside the diagonal. These results show that abnormal extremals play an important role in the classical-quantum correspondence between sub-Riemannian geometry and sub-Laplacians.


title: Influential Rank: A New Perspective of Post-training for Robust Model against Noisy Labels

abstract: Deep neural network can easily overfit to even noisy labels due to its high capacity, which degrades the generalization performance of a model. To overcome this issue, we propose a new approach for learning from noisy labels (LNL) via post-training, which can significantly improve the generalization performance of any pre-trained model on noisy label data. To this end, we rather exploit the overfitting property of a trained model to identify mislabeled samples. Specifically, our post-training approach gradually removes samples with high influence on the decision boundary and refines the decision boundary to improve generalization performance. Our post-training approach creates great synergies when combined with the existing LNL methods. Experimental results on various real-world and synthetic benchmark datasets demonstrate the validity of our approach in diverse realistic scenarios.


title: Physics-Aware Downsampling with Deep Learning for Scalable Flood Modeling

abstract: Background: Floods are the most common natural disaster in the world, affecting the lives of hundreds of millions. Flood forecasting is therefore a vitally important endeavor, typically achieved using physical water flow simulations, which rely on accurate terrain elevation maps. However, such simulations, based on solving partial differential equations, are computationally prohibitive on a large scale. This scalability issue is commonly alleviated using a coarse grid representation of the elevation map, though this representation may distort crucial terrain details, leading to significant inaccuracies in the simulation. Contributions: We train a deep neural network to perform physics-informed downsampling of the terrain map: we optimize the coarse grid representation of the terrain maps, so that the flood prediction will match the fine grid solution. For the learning process to succeed, we configure a dataset specifically for this task. We demonstrate that with this method, it is possible to achieve a significant reduction in computational cost, while maintaining an accurate solution. A reference implementation accompanies the paper as well as documentation and code for dataset reproduction.


title: Coupling from the past for exponentially ergodic one-dimensional probabilistic cellular automata

abstract: We prove that, for every one-dimendional exponentially ergodic probabilistic cellular automaton with positive rates, there exists a locally defined coupling-from-the-past flow whose coalescence time has a finite exponential moment.


title: Context-Aware Image Inpainting with Learned Semantic Priors

abstract: Recent advances in image inpainting have shown impressive results for generating plausible visual details on rather simple backgrounds. However, for complex scenes, it is still challenging to restore reasonable contents as the contextual information within the missing regions tends to be ambiguous. To tackle this problem, we introduce pretext tasks that are semantically meaningful to estimating the missing contents. In particular, we perform knowledge distillation on pretext models and adapt the features to image inpainting. The learned semantic priors ought to be partially invariant between the high-level pretext task and low-level image inpainting, which not only help to understand the global context but also provide structural guidance for the restoration of local textures. Based on the semantic priors, we further propose a context-aware image inpainting model, which adaptively integrates global semantics and local features in a unified image generator. The semantic learner and the image generator are trained in an end-to-end manner. We name the model SPL to highlight its ability to learn and leverage semantic priors. It achieves the state of the art on Places2, CelebA, and Paris StreetView datasets.


title: Certification of embedded systems based on Machine Learning: A survey

abstract: Advances in machine learning (ML) open the way to innovating functions in the avionic domain, such as navigation/surveillance assistance (e.g. vision-based navigation, obstacle sensing, virtual sensing), speechto-text applications, autonomous flight, predictive maintenance or cockpit assistance. Current certification standards and practices, which were defined and refined decades over decades with classical programming in mind, do not however support this new development paradigm. This article provides an overview of the main challenges raised by the use ML in the demonstration of compliance with regulation requirements, and a survey of literature relevant to these challenges, with particular focus on the issues of robustness and explainability of ML results.


title: Outlier detection in multivariate functional data through a contaminated mixture model

abstract: In an industrial context, the activity of sensors is recorded at a high frequency. A challenge is to automatically detect abnormal measurement behavior. Considering the sensor measures as functional data, the problem can be formulated as the detection of outliers in a multivariate functional data set. Due to the heterogeneity of this data set, the proposed contaminated mixture model both clusters the multivariate functional data into homogeneous groups and detects outliers. The main advantage of this procedure over its competitors is that it does not require to specify the proportion of outliers. Model inference is performed through an Expectation-Conditional Maximization algorithm, and the BIC is used to select the number of clusters. Numerical experiments on simulated data demonstrate the high performance achieved by the inference algorithm. In particular, the proposed model outperforms the competitors. Its application on the real data which motivated this study allows to correctly detect abnormal behaviors.


title: Universal scaling of the specific heat in $S=1/2$ quantum kagome antiferromagnet herbertsmithite

abstract: Despite tremendous investigations, a quantum spin liquid state realized in spin-1/2 kagome Heisenberg antiferromagnet remains largely elusive. In herbertsmithite ZnCu$_3$(OH)$_6$Cl$_2$, a quantum spin liquid candidate on the perfect kagome lattice, precisely characterizing the intrinsic physics of the kagome layers is extremely challenging due to the presence of interlayer Cu/Zn antisite disorder within its crystal structure. Here we measured the specific heat and thermal conductivity of single crystal herbertsmithite in magnetic fields with high resolution. Our results are highlighted by the excellent scaling collapse of the intrinsic magnetic specific heat contribution arising from the kagome layers as a function of $T/H$ (temperature/magnetic field). In addition, no residual linear term in the thermal conductivity $\kappa/T(T\rightarrow 0)$ is observed in zero and applied magnetic fields, indicating the absence of itinerant gapless excitations. These results suggest a new picture for a quantum spin liquid state of the kagome layers of herbertsmithite, wherein localized orphan spins arise and interact with random exchanges in conjunction with a non-itinerant quantum spin liquid.


title: SGE net: Video object detection with squeezed GRU and information entropy map

abstract: Recently, deep learning based video object detection has attracted more and more attention. Compared with object detection of static images, video object detection is more challenging due to the motion of objects, while providing rich temporal information. The RNN-based algorithm is an effective way to enhance detection performance in videos with temporal information. However, most studies in this area only focus on accuracy while ignoring the calculation cost and the number of parameters. In this paper, we propose an efficient method that combines channel-reduced convolutional GRU (Squeezed GRU), and Information Entropy map for video object detection (SGE-Net). The experimental results validate the accuracy improvement, computational savings of the Squeezed GRU, and superiority of the information entropy attention mechanism on the classification performance. The mAP has increased by 3.7 contrasted with the baseline, and the number of parameters has decreased from 6.33 million to 0.67 million compared with the standard GRU.


title: English to Bangla Machine Translation Using Recurrent Neural Network

abstract: The applications of recurrent neural networks in machine translation are increasing in natural language processing. Besides other languages, Bangla language contains a large amount of vocabulary. Improvement of English to Bangla machine translation would be a significant contribution to Bangla Language processing. This paper describes an architecture of English to Bangla machine translation system. The system has been implemented with the encoder-decoder recurrent neural network. The model uses a knowledge-based context vector for the mapping of English and Bangla words. Performances of the model based on activation functions are measured here. The best performance is achieved for the linear activation function in encoder layer and the tanh activation function in decoder layer. From the execution of GRU and LSTM layer, GRU performed better than LSTM. The attention layers are enacted with softmax and sigmoid activation function. The approach of the model outperforms the previous state-of-the-art systems in terms of cross-entropy loss metrics. The reader can easily find out the structure of the machine translation of English to Bangla and the efficient activation functions from the paper.


title: More Real than Real: A Study on Human Visual Perception of Synthetic Faces

abstract: Deep fakes became extremely popular in the last years, also thanks to their increasing realism. Therefore, there is the need to measures human's ability to distinguish between real and synthetic face images when confronted with cutting-edge creation technologies. We describe the design and results of a perceptual experiment we have conducted, where a wide and diverse group of volunteers has been exposed to synthetic face images produced by state-of-the-art Generative Adversarial Networks (namely, PG-GAN, StyleGAN, StyleGAN2). The experiment outcomes reveal how strongly we should call into question our human ability to discriminate real faces from synthetic ones generated through modern AI.


title: Origin of stellar prolate rotation in a cosmologically simulated faint dwarf galaxy

abstract: Stellar prolate rotation in dwarf galaxies is rather uncommon, with only two known galaxies in the Local Group showing such feature (Phoenix and And II). Cosmological simulations show that in massive early-type galaxies prolate rotation likely arises from major mergers. However, the origin of such kinematics in the dwarf galaxies regime has only been explored using idealized simulations. Here we made use of hydrodynamical cosmological simulations of dwarfs galaxies with stellar mass between $3\times10^5$ and $5\times10^8$ M$_{\odot}$ to explore the formation of prolate rotators. Out of $27$ dwarfs, only one system showed clear rotation around the major axis, whose culprit is a major merger at $z=1.64$, which caused the transition from an oblate to a prolate configuration. Interestingly, this galaxy displays a steep metallicity gradient, reminiscent of the one measured in Phoenix and And II: this is the outcome of the merger event that dynamically heats old, metal-poor stars, and of the centrally concentrated residual star formation. Major mergers in dwarf galaxies offer a viable explanation for the formation of such peculiar systems, characterized by steep metallicity gradients and prolate rotation.


title: Automated Parking Space Detection Using Convolutional Neural Networks

abstract: Finding a parking space nowadays becomes an issue that is not to be neglected, it consumes time and energy. We have used computer vision techniques to infer the state of the parking lot given the data collected from the University of The Witwatersrand. This paper presents an approach for a real-time parking space classification based on Convolutional Neural Networks (CNN) using Caffe and Nvidia DiGITS framework. The training process has been done using DiGITS and the output is a caffemodel used for predictions to detect vacant and occupied parking spots. The system checks a defined area whether a parking spot (bounding boxes defined at initialization of the system) is containing a car or not (occupied or vacant). Those bounding box coordinates are saved from a frame of the video of the parking lot in a JSON format, to be later used by the system for sequential prediction on each parking spot. The system has been trained using the LeNet network with the Nesterov Accelerated Gradient as solver and the AlexNet network with the Stochastic Gradient Descent as solver. We were able to get an accuracy on the validation set of 99\% for both networks. The accuracy on a foreign dataset(PKLot) returned as well 99\%. Those are experimental results based on the training set shows how robust the system can be when the prediction has to take place in a different parking space.


title: Privacy-Preserving Machine Learning with Fully Homomorphic Encryption for Deep Neural Network

abstract: Fully homomorphic encryption (FHE) is one of the prospective tools for privacypreserving machine learning (PPML), and several PPML models have been proposed based on various FHE schemes and approaches. Although the FHE schemes are known as suitable tools to implement PPML models, previous PPML models on FHE encrypted data are limited to only simple and non-standard types of machine learning models. These non-standard machine learning models are not proven efficient and accurate with more practical and advanced datasets. Previous PPML schemes replace non-arithmetic activation functions with simple arithmetic functions instead of adopting approximation methods and do not use bootstrapping, which enables continuous homomorphic evaluations. Thus, they could not use standard activation functions and could not employ a large number of layers. The maximum classification accuracy of the existing PPML model with the FHE for the CIFAR-10 dataset was only 77% until now. In this work, we firstly implement the standard ResNet-20 model with the RNS-CKKS FHE with bootstrapping and verify the implemented model with the CIFAR-10 dataset and the plaintext model parameters. Instead of replacing the non-arithmetic functions with the simple arithmetic function, we use state-of-the-art approximation methods to evaluate these non-arithmetic functions, such as the ReLU, with sufficient precision [1]. Further, for the first time, we use the bootstrapping technique of the RNS-CKKS scheme in the proposed model, which enables us to evaluate a deep learning model on the encrypted data. We numerically verify that the proposed model with the CIFAR-10 dataset shows 98.67% identical results to the original ResNet-20 model with non-encrypted data. The classification accuracy of the proposed model is 90.67%, which is pretty close to that of the original ResNet-20 CNN model...


title: Some points on c-K-g-frames and their duals

abstract: In this paper we study some new properties of c-K-g-frames in a Hilbert space H. We study duals of c-K-g-frames and give some characterizations of c-K-g-frames and their duals. Also, we verify the relationships between c-K-g-frames and atomic cg-systems. Precisely, we show that these two concepts are equivalent. Finally, we find some new atomic cg-systems from given ones.


title: Non-isomorphic 2-groups with isomorphic modular group algebras

abstract: We provide non-isomorphic finite 2-groups which have isomorphic group algebras over any field of characteristic 2, thus settling the Modular Isomorphism Problem.


title: Effect of the metallicity on the capacitance of gold - aqueous sodium chloride interfaces

abstract: Electrochemistry experiments have established that the capacitance of electrode-electrolyte interfaces is much larger for good metals such as gold and platinum than for carbon-based materials. Despite the development of elaborate electrode interaction potentials, to date molecular dynamics simulations were not able to capture this effect. Here we show that changing the width of the Gaussian charge distribution used to represent the atomic charges in gold is an effective way to tune its metallicity. Larger Gaussian widths lead to a capacitance of aqueous solutions (pure water and 1 molar NaCl) in good agreement with recent ab initio molecular dynamics results. For pure water, the increase in the capacitance is not accompanied with structural changes, while in the presence of salt the Na$^+$ cations tend to adsorb significantly on the surface. For a strongly metallic gold electrode, these ions can even form inner sphere complexes on hollow sites of the surface.


title: Minimality Notions via Factorization Systems

abstract: For the minimization of state-based systems (i.e. the reduction of the number of states while retaining the system's semantics), there are two obvious aspects: removing unnecessary states of the system and merging redundant states in the system. In the present article, we relate the two aspects on coalgebras by defining an abstract notion of minimality. The abstract notion minimality and minimization live in a general category with a factorization system. We will find criteria on the category that ensure uniqueness, existence, and functoriality of the minimization aspects. The proofs of these results instantiate to those for reachability and observability minimization in the standard coalgebra literature. Finally, we will see how the two aspects of minimization interact and under which criteria they can be sequenced in any order, like in automata minimization.


title: Real-World Evaluation of the Impact of Automated Driving System Technology on Driver Gaze Behavior, Reaction Time and Trust

abstract: Recent developments in advanced driving assistance systems (ADAS) that rely on some level of autonomy have led the automobile industry and research community to investigate the impact they might have on driving performance. However, most of the research performed so far is based on simulated environments. In this study, we investigated the behavior of drivers in a vehicle with automated driving system (ADS) capabilities in a real-life driving scenario. We analyzed their response to a take over request (TOR) at two different driving speeds while being engaged in non-driving-related tasks (NDRT). Results from the performed experiments showed that driver reaction time to a TOR, gaze behavior and self-reported trust in automation were affected by the type of NDRT being concurrently performed and driver reaction time and gaze behavior additionally depended on the driving or vehicle speed at the time of TOR.


title: Cluster-cluster correlations beyond the Laughlin state

abstract: Number of zeros seen by a particle around small clusters of other particles is encoded in the root partition, and partly characterizes the correlations in fractional quantum Hall trial wavefunctions. We explore a generalization wherein we consider the counting of zeros seen by a cluster of particles on another cluster. Numbers of such zeros between clusters in the Laughlin wavefunctions are fully determined by the root partition. However, such a counting is unclear for general Jain states where a polynomial expansion is difficult. Here we consider the simplest state beyond the Laughlin wavefunction, namely a state containing a single quasiparticle of the Laughlin state. We show numerically and analytically that in the trial wavefunction for the quasiparticle of the Laughlin state, counting of zeros seen by a cluster on another cluster depends on the relative dimensions of the two clusters. We further ask if the patterns in the counting of zeros extend, in at least an approximate sense, to wavefunctions beyond the trial states. Using numerical computations in systems up to $N=9$, we present results for the statistical distribution of zeros around particle clusters at the center of an FQH droplet in the ground state of a Hamiltonian that is perturbed away from the $V_1$ interaction (short-range repulsion). Evolution of this distribution with the strength of the perturbation shows that the counting of zeros is altered by even a weak perturbation away from the parent Hamiltonian, though the perturbations do not change the phase of the system.


title: Physical requirements for scaling up network-based biocomputation

abstract: The high energy consumption of electronic data processors, together with physical challenges limiting their further improvement, has triggered intensive interest in alternative computation paradigms. Here we focus on network-based biocomputation (NBC), a massively parallel approach that benefits from the energy efficiency of biological agents, such as molecular motors or bacteria, and their availability in large numbers. We analyse and define the fundamental requirements that need to be fulfilled to scale up NBC computers to become a viable technology that can solve large NP-complete problem instances faster or with less energy consumption than electronic computers. Our work can serve as a guide for further efforts to contribute to elements of future NBC devices, and as the theoretical basis for a detailed NBC roadmap.


title: Is Einstein more agreeable and less neurotic than Hitler? A computational exploration of the emotional and personality profiles of historical persons

abstract: Recent progress in distributed semantic models (DSM) offers new ways to estimate personality traits of both fictive and real people. In this exploratory study we applied an extended version of the algorithm developed in Jacobs (2019) to compute the likeability scores, emotional figure profiles and BIG5 personality traits for 100 historical persons from the arts, politics or science domains whose names are rather unique (e.g., Einstein, Kahlo, Picasso). We compared the results produced by static (word2vec) and dynamic (BERT) language model representations in four studies. The results show both the potential and limitations of such DSM-based computations of personality profiles and point ways to further develop this approach to become a useful tool in data science, psychology or computational and neurocognitive poetics (Jacobs, 2015).


title: Slowing quantum decoherence of oscillators by hybrid processing

abstract: Quantum information encoded into superposition of coherent states is an illustrative representative of practical applications of macroscopic quantum coherence possessing. However, these states are very sensitive to energy loss, losing their non-classical aspects of coherence very rapidly. An available deterministic strategy to slow down this decoherence process is to apply a Gaussian squeezing transformation prior to the loss as a protective step. Here, we propose a deterministic hybrid protection scheme utilizing strong but feasible interactions with two-level ancillas immune to spontaneous emission. We verify robustness of the scheme against dephasing of qubit ancilla. Our scheme is applicable to complex superpositions of coherent states in many oscillators, and remarkably, the robustness to loss is enhanced with the amplitude of the coherent states. This scheme can be realized in experiments with atoms, solid-state systems and superconducting circuits.


title: Fair Clustering Under a Bounded Cost

abstract: Clustering is a fundamental unsupervised learning problem where a dataset is partitioned into clusters that consist of nearby points in a metric space. A recent variant, fair clustering, associates a color with each point representing its group membership and requires that each color has (approximately) equal representation in each cluster to satisfy group fairness. In this model, the cost of the clustering objective increases due to enforcing fairness in the algorithm. The relative increase in the cost, the ''price of fairness,'' can indeed be unbounded. Therefore, in this paper we propose to treat an upper bound on the clustering objective as a constraint on the clustering problem, and to maximize equality of representation subject to it. We consider two fairness objectives: the group utilitarian objective and the group egalitarian objective, as well as the group leximin objective which generalizes the group egalitarian objective. We derive fundamental lower bounds on the approximation of the utilitarian and egalitarian objectives and introduce algorithms with provable guarantees for them. For the leximin objective we introduce an effective heuristic algorithm. We further derive impossibility results for other natural fairness objectives. We conclude with experimental results on real-world datasets that demonstrate the validity of our algorithms.


title: Mitigating Biases in Toxic Language Detection through Invariant Rationalization

abstract: Automatic detection of toxic language plays an essential role in protecting social media users, especially minority groups, from verbal abuse. However, biases toward some attributes, including gender, race, and dialect, exist in most training datasets for toxicity detection. The biases make the learned models unfair and can even exacerbate the marginalization of people. Considering that current debiasing methods for general natural language understanding tasks cannot effectively mitigate the biases in the toxicity detectors, we propose to use invariant rationalization (InvRat), a game-theoretic framework consisting of a rationale generator and a predictor, to rule out the spurious correlation of certain syntactic patterns (e.g., identity mentions, dialect) to toxicity labels. We empirically show that our method yields lower false positive rate in both lexical and dialectal attributes than previous debiasing methods.


title: Contemporary Amharic Corpus: Automatically Morpho-Syntactically Tagged Amharic Corpus

abstract: We introduced the contemporary Amharic corpus, which is automatically tagged for morpho-syntactic information. Texts are collected from 25,199 documents from different domains and about 24 million orthographic words are tokenized. Since it is partly a web corpus, we made some automatic spelling error correction. We have also modified the existing morphological analyzer, HornMorpho, to use it for the automatic tagging.


title: The asymmetric particle population density method for simulation of coupled noisy oscillators

abstract: A wide variety of biological phenomena can be modeled by the collective activity of a population of individual units. A common strategy for simulating such a system, the population density approach, is to take the macroscopic limit and update its population density function. However, in many cases, the coupling between the units and noise gives rise to complex behaviors challenging to existing population density approach methods. To address these challenges, we develop the asymmetric particle population density (APPD) method that efficiently and accurately simulates such populations consist of coupled elements. The APPD is well-suited for a parallel implementation. We compare the performance of the method against direct Monte-Carlo simulation and verify its accuracy by applying it to the well-studied Hodgkin-Huxley model, with a range of challenging scenarios. We find that our method can accurately reproduce complex macroscopic behaviors such as inhibitory coupling-induced clustering and noise-induced firing while being faster than the direct simulation.


title: Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks

abstract: In this paper, we propose two communication efficient decentralized optimization algorithms over a general directed multi-agent network. The first algorithm, termed Compressed Push-Pull (CPP), combines the gradient tracking Push-Pull method with communication compression. We show that CPP is applicable to a general class of unbiased compression operators and achieves linear convergence rate for strongly convex and smooth objective functions. The second algorithm is a broadcast-like version of CPP (B-CPP), and it also achieves linear convergence rate under the same conditions on the objective functions. B-CPP can be applied in an asynchronous broadcast setting and further reduce communication costs compared to CPP. Numerical experiments complement the theoretical analysis and confirm the effectiveness of the proposed methods.


title: Random cones in high dimensions II: Weyl cones

abstract: We consider two models of random cones together with their duals. Let $Y_1,\dots,Y_n$ be independent and identically distributed random vectors in $\mathbb R^d$ whose distribution satisfies some mild condition. The random cones $G_{n,d}^A$ and $G_{n,d}^B$ are defined as the positive hulls $\text{pos}\{Y_1-Y_2,\dots,Y_{n-1}-Y_n\}$, respectively $\text{pos}\{Y_1-Y_2,\dots,Y_{n-1}-Y_n,Y_n\}$, conditioned on the event that the respective positive hull is not equal to $\mathbb R^d$. We prove limit theorems for various expected geometric functionals of these random cones, as $n$ and $d$ tend to infinity in a coordinated way. This includes limit theorems for the expected number of $k$-faces and the $k$-th conic quermassintegrals, as $n$, $d$ and sometimes also $k$ tend to infinity simultaneously. Moreover, we uncover a phase transition in high dimensions for the expected statistical dimension for both models of random cones.


title: Stable cohomology of the moduli space of trigonal curves

abstract: We prove that the rational cohomology $H^i(\mathcal{T}_g;\mathbf{Q})$ of the moduli space of trigonal curves of genus $g$ is independent of $g$ in degree $i<\lfloor g/4\rfloor.$ This makes possible to define the stable cohomology ring as $H^\bullet(\mathcal{T}_g;\mathbf{Q})$ for a sufficiently large $g.$ We also compute the stable cohomology ring, which turns out to be isomorphic to the tautological ring. This is done by studying the embedding of trigonal curves in Hirzebruch surfaces and using Gorinov-Vassiliev's method.


title: Note on a question of Wilf

abstract: Let $S$ be a numerical semigroup with Frobenius number $f$, genus $g$ and embedding dimension $e$. % In 1978 Wilf asked the question, whether $\frac{f+1-g}{f+1}\geq\frac1e$. As is well known, this holds in the cases $e=2$ and $e=3$. For $e\geq4$, we derive from results of Zhai [5] the following (substantially weaker) lower bound \[\frac{f+1-g}{f+1}>\left(\frac{2N+1}{(2N+2)(e-2)}\right)^e\text{ with }\lfloor N\rfloor=104978\,.\] To the best of our knowledge this is the first explicit lower bound for $\frac{f+1-g}{f+1}$ in terms of the embedding dimension.


title: Age of Information for Multiple-Source Multiple-Server Networks

abstract: Having timely and fresh knowledge about the current state of information sources is critical in a variety of applications. In particular, a status update may arrive at the destination later than its generation time due to processing and communication delays. The freshness of the status update at the destination is captured by the notion of age of information. In this study, we analyze a multiple sensing network with multiple sources, multiple servers, and a monitor (destination). Each source corresponds to an independent piece of information and its age is measured individually. Given a particular source, the servers independently sense the source of information and send the status update to the monitor. We assume that updates arrive at the servers according to Poisson random processes. Each server sends its updates to the monitor through a direct link, which is modeled as a queue. The service time to transmit an update is considered to be an exponential random variable. We examine both homogeneous and heterogeneous service and arrival rates for the single-source case, and only homogeneous arrival and service rates for the multiple-source case. We derive a closed-form expression for the average age of information under a last-come-first-serve (LCFS) queue for a single source and arbitrary number of homogeneous servers. Using a recursive method, we derive the explicit average age of information for any number of sources and homogeneous servers. We also investigate heterogeneous servers and a single source, and present algorithms for finding the average age of information.


title: Advanced DFT-NEGF transport techniques for novel 2D-material and device exploration including HfS2/WSe2 van-der-Waals Heterojunction TFET and WTe2/WS2 metal/semiconductor contact

abstract: We present, here, advanced DFT-NEGF techniques that we have implemented in our ATOmistic MOdelling Solver, ATOMOS, to explore transport in novel materials and devices and in particular in van-der-Waals heterojunction transistors. We describe our methodologies using plane-wave DFT, followed by a Wannierization step, and linear combination of atomic orbital DFT, that leads to an orthogonal and non-orthogonal NEGF model, respectively. We then describe in detail our non-orthogonal NEGF implementation including the Sancho-Rubio and electron-phonon scattering within a non-orthogonal framework. We also present our methodology to extract electron-phonon coupling from first principle and include them in our transport simulations. Finally, we apply our methods towards the exploration of novel 2D materials and devices. This includes 2D material selection and the Dynamically-Doped FET for ultimately scaled MOSFETS, the exploration of vdW TFETs, in particular the HfS2/WSe2 TFET that could achieve high on-current levels, and the study of Schottky-barrier height and transport through a metal-semiconducting WTe2/WS2 VDW junction transistor.


title: Automatic winning shifts

abstract: To each one-dimensional subshift $X$, we may associate a winning shift $W(X)$ which arises from a combinatorial game played on the language of $X$. Previously it has been studied what properties of $X$ does $W(X)$ inherit. For example, $X$ and $W(X)$ have the same factor complexity and if $X$ is a sofic subshift, then $W(X)$ is also sofic. In this paper, we develop a notion of automaticity for $W(X)$, that is, we propose what it means that a vector representation of $W(X)$ is accepted by a finite automaton. Let $S$ be an abstract numeration system such that addition with respect to $S$ is a rational relation. Let $X$ be a subshift generated by an $S$-automatic word. We prove that as long as there is a bound on the number of nonzero symbols in configurations of $W(X)$ (which follows from $X$ having sublinear factor complexity), then $W(X)$ is accepted by a finite automaton, which can be effectively constructed from the description of $X$. We provide an explicit automaton when $X$ is generated by certain automatic words such as the Thue-Morse word.


title: Unified Interpretation of Softmax Cross-Entropy and Negative Sampling: With Case Study for Knowledge Graph Embedding

abstract: In knowledge graph embedding, the theoretical relationship between the softmax cross-entropy and negative sampling loss functions has not been investigated. This makes it difficult to fairly compare the results of the two different loss functions. We attempted to solve this problem by using the Bregman divergence to provide a unified interpretation of the softmax cross-entropy and negative sampling loss functions. Under this interpretation, we can derive theoretical findings for fair comparison. Experimental results on the FB15k-237 and WN18RR datasets show that the theoretical findings are valid in practical settings.


title: Observations of large-scale solar flows

abstract: In this dissertation, several components of large-scale solar flows are studied observationally: solar equatorial Rossby waves (waves of radial vorticity), large-scale convection, and surface flows around active regions. Maps of horizontal flows are derived from photospheric observations by the Helioseismic and Magnetic Imager (HMI) aboard the Solar Dynamics Observatory (SDO) using two different techniques: granulation tracking and local helioseismology. First, the eigenfunctions of solar Rossby waves are measured from helioseismic ring-diagram flow maps with a correlation method and a spectral analysis. Down to $9$ Mm below the surface, the dependence of the radial vorticity with radius $r$ is consistent with $r^{m-1}$, for a given longitudinal wavenumber $m$. At the surface, the eigenfunctions are complex-valued. The real part decreases away from the equator and switches sign around $\pm 20-30^\circ$. The imaginary part is small, but nonzero, and may be due to wave attenuation. This may have implications for the transport of angular momentum in the latitudinal direction. Second, we revisit previous measurements of power spectra of longitudinal velocities near the solar surface, obtained from time-distance and ring-diagram helioseismology. Several issues in these past helioseismic analyses are identified and corrected. The corrections are not sufficient to remove the discrepancy between the measurements. I thus present new velocity power spectra from granulation tracking and ring-diagram helioseismology. The two new measurements are close to each other near the solar surface, and the corresponding kinetic energy decreases with increasing spatial scale.


title: Evolutionary Robust Clustering Over Time for Temporal Data

abstract: In many clustering scenes, data samples' attribute values change over time. For such data, we are often interested in obtaining a partition for each time step and tracking the dynamic change of partitions. Normally, a smooth change is assumed for data to have a temporal smooth nature. Existing algorithms consider the temporal smoothness as an a priori preference and bias the search towards the preferred direction. This a priori manner leads to a risk of converging to an unexpected region because it is not always the case that a reasonable preference can be elicited given the little prior knowledge about the data. To address this issue, this paper proposes a new clustering framework called evolutionary robust clustering over time. One significant innovation of the proposed framework is processing the temporal smoothness in an a posteriori manner, which avoids unexpected convergence that occurs in existing algorithms. Furthermore, the proposed framework automatically tunes the weight of smoothness without data's affinity matrix and predefined parameters, which holds better applicability and scalability. The effectiveness and efficiency of the proposed framework are confirmed by comparing with state-of-the-art algorithms on both synthetic and real datasets.


title: Semiclassical WKB Problem for the Non-Self-Adjoint Dirac Operator with a Multi-Humped Decaying Potential

abstract: In this paper we continue the study (initiated in arXiv:2003.13584) of the semiclassical behavior of the scattering data of a non-self-adjoint Dirac operator with a real, positive, fairly smooth but not necessarily analytic potential decaying at infinity; in this paper we allow this potential to have several local maxima and minima. We provide the rigorous semiclassical analysis of the Bohr-Sommerfeld condition for the location of the eigenvalues, the norming constants, and the reflection coefficient.


title: Mean-field selective optimal control via transient leadership

abstract: A mean-field selective optimal control problem of multipopulation dynamics via transient leadership is considered. The agents in the system are described by their spatial position and their probability of belonging to a certain population. The dynamics in the control problem is characterized by the presence of an activation function which tunes the control on each agent according to the membership to a population, which, in turn, evolves according to a Markov-type jump process. This way, a hypothetical policy maker can select a restricted pool of agents to act upon based, for instance, on their time-dependent influence on the rest of the population. A finite-particle control problem is studied and its mean-field limit is identified via $\Gamma$-convergence, ensuring convergence of optimal controls. The dynamics of the mean-field optimal control is governed by a continuity-type equation without diffusion. Specific applications in the context of opinion dynamics are discussed with some numerical experiments.


title: Federated Myopic Community Detection with One-shot Communication

abstract: In this paper, we study the problem of recovering the community structure of a network under federated myopic learning. Under this paradigm, we have several clients, each of them having a myopic view, i.e., observing a small subgraph of the network. Each client sends a censored evidence graph to a central server. We provide an efficient algorithm, which computes a consensus signed weighted graph from clients evidence, and recovers the underlying network structure in the central server. We analyze the topological structure conditions of the network, as well as the signal and noise levels of the clients that allow for recovery of the network structure. Our analysis shows that exact recovery is possible and can be achieved in polynomial time. We also provide information-theoretic limits for the central server to recover the network structure from any single client evidence. Finally, as a byproduct of our analysis, we provide a novel Cheeger-type inequality for general signed weighted graphs.


title: Deterministic Guided LiDAR Depth Map Completion

abstract: Accurate dense depth estimation is crucial for autonomous vehicles to analyze their environment. This paper presents a non-deep learning-based approach to densify a sparse LiDAR-based depth map using a guidance RGB image. To achieve this goal the RGB image is at first cleared from most of the camera-LiDAR misalignment artifacts. Afterward, it is over segmented and a plane for each superpixel is approximated. In the case a superpixel is not well represented by a plane, a plane is approximated for a convex hull of the most inlier. Finally, the pinhole camera model is used for the interpolation process and the remaining areas are interpolated. The evaluation of this work is executed using the KITTI depth completion benchmark, which validates the proposed work and shows that it outperforms the state-of-the-art non-deep learning-based methods, in addition to several deep learning-based methods.


title: Communication is the universal solvent: atreya bot -- an interactive bot for chemical scientists

abstract: Conversational agents are a recent trend in human-computer interaction, deployed in multidisciplinary applications to assist the users. In this paper, we introduce "Atreya", an interactive bot for chemistry enthusiasts, researchers, and students to study the ChEMBL database. Atreya is hosted by Telegram, a popular cloud-based instant messaging application. This user-friendly bot queries the ChEMBL database, retrieves the drug details for a particular disease, targets associated with that drug, etc. This paper explores the potential of using a conversational agent to assist chemistry students and chemical scientist in complex information seeking process.


title: GitTables: A Large-Scale Corpus of Relational Tables

abstract: The success of deep learning has sparked interest in improving relational table tasks, like data preparation and search, with table representation models trained on large table corpora. Existing table corpora primarily contain tables extracted from HTML pages, limiting the capability to represent offline database tables. To train and evaluate high-capacity models for applications beyond the Web, we need resources with tables that resemble relational database tables. Here we introduce GitTables, a corpus of 1M relational tables extracted from GitHub. Our continuing curation aims at growing the corpus to at least 10M tables. Analyses of GitTables show that its structure, content, and topical coverage differ significantly from existing table corpora. We annotate table columns in GitTables with semantic types, hierarchical relations and descriptions from Schema.org and DBpedia. The evaluation of our annotation pipeline on the T2Dv2 benchmark illustrates that our approach provides results on par with human annotations. We present three applications of GitTables, demonstrating its value for learned semantic type detection models, schema completion methods, and benchmarks for table-to-KG matching, data search, and preparation. We make the corpus and code available at https://gittables.github.io.


title: Variation of focusing patterns of laterally migrating particles in a square-tube flow due to non-Newtonian elastic force

abstract: The elasto-inertial effects on particle focusing in a square-tube flow were investigated experimentally and numerically. Microscale experiments using spherical particles in dilute polymer solutions demonstrated that the particles are focused on the midline and/or the diagonal in a downstream cross-section, depending on the polymer concentration. Numerical computations based on the FENE-P model for the viscoelastic flow reproduced these focusing patterns. It was revealed that the transitions among the patterns are accounted for by the elastic forces due to the first normal stress difference and the polymer elongation, which are the essentials of the viscoelastic fluid.


title: RAPTOR: End-to-end Risk-Aware MDP Planning and Policy Learning by Backpropagation

abstract: Planning provides a framework for optimizing sequential decisions in complex environments. Recent advances in efficient planning in deterministic or stochastic high-dimensional domains with continuous action spaces leverage backpropagation through a model of the environment to directly optimize actions. However, existing methods typically not take risk into account when optimizing in stochastic domains, which can be incorporated efficiently in MDPs by optimizing the entropic utility of returns. We bridge this gap by introducing Risk-Aware Planning using PyTorch (RAPTOR), a novel framework for risk-sensitive planning through end-to-end optimization of the entropic utility objective. A key technical difficulty of our approach lies in that direct optimization of the entropic utility by backpropagation is impossible due to the presence of environment stochasticity. The novelty of RAPTOR lies in the reparameterization of the state distribution, which makes it possible to apply stochastic backpropagatation through sufficient statistics of the entropic utility computed from forward-sampled trajectories. The direct optimization of this empirical objective in an end-to-end manner is called the risk-averse straight-line plan, which commits to a sequence of actions in advance and can be sub-optimal in highly stochastic domains. We address this shortcoming by optimizing for risk-aware Deep Reactive Policies (RaDRP) in our framework. We evaluate and compare these two forms of RAPTOR on three highly stochastic do-mains, including nonlinear navigation, HVAC control, and linear reservoir control, demonstrating the ability to manage risk in complex MDPs.


title: Unit group of $\f_{p^k}\SL(3,2),p\geq 11$

abstract: We provide the structure of the unit group of $\f_{p^k}(\SL(3,2))$, where $p\geq 11$ is a prime and $\SL(3,2)$ denotes the $3\times 3$ invertible matrices over $\f_2$.


title: Spatial spread of COVID-19 outbreak in Italy using multiscale kinetic transport equations with uncertainty

abstract: In this paper we introduce a space-dependent multiscale model to describe the spatial spread of an infectious disease under uncertain data with particular interest in simulating the onset of the COVID-19 epidemic in Italy. While virus transmission is ruled by a SEIAR type compartmental model, within our approach the population is given by a sum of commuters moving on a extra-urban scale and non commuters interacting only on the smaller urban scale. A transport dynamic of the commuter population at large spatial scales, based on kinetic equations, is coupled with a diffusion model for non commuters at the urban scale. Thanks to a suitable scaling limit, the kinetic transport model used to describe the dynamics of commuters, within a given urban area coincides with the diffusion equations that characterize the movement of non-commuting individuals. Because of the high uncertainty in the data reported in the early phase of the epidemic, the presence of random inputs in both the initial data and the epidemic parameters is included in the model. A robust numerical method is designed to deal with the presence of multiple scales and the uncertainty quantification process. In our simulations, we considered a realistic geographical domain, describing the Lombardy region, in which the size of the cities, the number of infected individuals, the average number of daily commuters moving from one city to another, and the epidemic aspects are taken into account through a calibration of the model parameters based on the actual available data. The results show that the model is able to describe correctly the main features of the spatial expansion of the first wave of COVID-19 in northern Italy.


title: Machine Learning for Variance Reduction in Online Experiments

abstract: We consider the problem of variance reduction in randomized controlled trials, through the use of covariates correlated with the outcome but independent of the treatment. We propose a machine learning regression-adjusted treatment effect estimator, which we call MLRATE. MLRATE uses machine learning predictors of the outcome to reduce estimator variance. It employs cross-fitting to avoid overfitting biases, and we prove consistency and asymptotic normality under general conditions. MLRATE is robust to poor predictions from the machine learning step: if the predictions are uncorrelated with the outcomes, the estimator performs asymptotically no worse than the standard difference-in-means estimator, while if predictions are highly correlated with outcomes, the efficiency gains are large. In A/A tests, for a set of 48 outcome metrics commonly monitored in Facebook experiments the estimator has over 70% lower variance than the simple difference-in-means estimator, and about 19% lower variance than the common univariate procedure which adjusts only for pre-experiment values of the outcome.


title: Linear unsaturated magnetoresistance in YSi single crystal

abstract: Linear magnetoresistance is a phenomenon that has been observed in a few topological compounds that originate from classical and quantum phenomena. Here, we performed electrical transport measurements, in zero and applied magnetic fields, on the YSi single crystal along all three principal crystallographic directions of the orthorhombic crystal structure. For $I~\parallel~[001]$ and $H~\parallel~[100]$ direction above $\approx 10$~T, mobility fluctuation driven linear magnetoresistance is observed without any sign of saturation up to $14$~T magnetic field. Anisotropy in the Fermi surface is immanent from the angular dependence of the magnetoresistance. Kohler rule violation is observed in this system and Hall data signifies multiple charge carriers in YSi.


title: On self-similar Bernstein functions and corresponding generalized fractional derivatives

abstract: We use the theory of Bernstein functions to analyze power law tail behavior with log-periodic perturbations which corresponds to self-similarity of the Bernstein functions. Such tail behavior appears in the context of semistable L\'evy processes. The Bernstein approach enables us to solve some open questions concerning semi-fractional derivatives recently introduced in {\it Fract. Calc. Appl. Anal.} {\bf 22}(2), pp. 326--357, by means of the generator of certain semistable L\'evy processes. In particular it is shown that semi-fractional derivatives can be seen as generalized fractional derivatives in the sense of Kochubei ({\it Integr. Equ. Oper. Theory} {\bf 71}, pp. 583--600).


title: La-$X$-H hydrides: is hot superconductivity possible?

abstract: Motivated by the recent claim of hot superconductivity with critical temperatures up to 550 K in La + x hydrides (arXiv:2006.03004), we investigate the high-pressure phase diagram of possible compounds that may have formed in the experiment, using first-principles calculations for evolutionary crystal structure prediction and superconductivity. Starting from the hypothesis that the observed T$_c$ may be realized by successive heating upon a pre-formed LaH$_{10}$ phase, we examine plausible ternaries of lanthanum, hydrogen and other elements present in the diamond anvil cell: boron, nitrogen, carbon, platinum, gallium, gold. We find that only boron forms superhydride-like structures that can host high-Tc superconductivity, but the predicted Tc are incompatibe with the experimental reports. Our results indicate that, while the claims of hot superconductivity should be reconsidered, it is very likely that unkwown H-rich ternary or multinary phases containing lanthanum, boron and hydrogen may have formed under the reported experimental conditions, and that these may exhibit superconducting properties comparable, or even superior, to those of currently known hydrides.


title: Nonlinear signal transduction network with multistate

abstract: Signal transduction is an important and basic mechanism to cell life activities. The stochastic state transition of receptor induces the release of signaling molecular, which triggers the state transition of other receptors. It constructs a nonlinear sigaling network, and leads to robust switchlike properties which are critical to biological function. Network architectures and state transitions of receptor affect the performance of this biological network. In this work, we perform a study of nonlinear signaling on biological polymorphic network by analyzing network dynamics of the Ca$^{2+}$ induced Ca$^{2+}$ release mechanism, where fast and slow processes are involved and the receptor has four conformational states. Three types of networks, Erd\"os-R\'enyi network, Watts-Strogatz network and BaraB\'asi-Albert network, are considered with different parameters. The dynamics of the biological networks exhibit different patterns at different time scales. At short time scale, the second open state is essential to reproduce the quasi-bistable regime, which emerges at a critical strength of connection for all three states involved in the fast processes and disappears at another critical point. The pattern at short time scale is not sensitive to the network architecture. At long time scale, only monostable regime is observed, and difference of network architectures affects the results more seriously. Our finding identifies features of nonlinear signaling networks with multistate that may underlie their biological function.


title: FastICARL: Fast Incremental Classifier and Representation Learning with Efficient Budget Allocation in Audio Sensing Applications

abstract: Various incremental learning (IL) approaches have been proposed to help deep learning models learn new tasks/classes continuously without forgetting what was learned previously (i.e., avoid catastrophic forgetting). With the growing number of deployed audio sensing applications that need to dynamically incorporate new tasks and changing input distribution from users, the ability of IL on-device becomes essential for both efficiency and user privacy. However, prior works suffer from high computational costs and storage demands which hinders the deployment of IL on-device. In this work, to overcome these limitations, we develop an end-to-end and on-device IL framework, FastICARL, that incorporates an exemplar-based IL and quantization in the context of audio-based applications. We first employ k-nearest-neighbor to reduce the latency of IL. Then, we jointly utilize a quantization technique to decrease the storage requirements of IL. We implement FastICARL on two types of mobile devices and demonstrate that FastICARL remarkably decreases the IL time up to 78-92% and the storage requirements by 2-4 times without sacrificing its performance. FastICARL enables complete on-device IL, ensuring user privacy as the user data does not need to leave the device.


title: Some instructive mathematical errors

abstract: We describe various errors in the mathematical literature, and consider how some of them might have been avoided, or at least detected at an earlier stage, using tools such as Maple or Sage. Our examples are drawn from three broad categories of errors. First, we consider some significant errors made by highly-regarded mathematicians. In some cases these errors were not detected until many years after their publication. Second, we consider in some detail an error that was recently detected by the author. This error in a refereed journal led to further errors by at least one author who relied on the (incorrect) result. Finally, we mention some instructive errors that have been detected in the author's own published papers.


title: Industry 4.0 and Prospects of Circular Economy: A Survey of Robotic Assembly and Disassembly

abstract: Despite their contributions to the financial efficiency and environmental sustainability of industrial processes, robotic assembly and disassembly have been understudied in the existing literature. This is in contradiction to their importance in realizing the Fourth Industrial Revolution. More specifically, although most of the literature has extensively discussed how to optimally assemble or disassemble given products, the role of other factors has been overlooked. For example, the types of robots involved in implementing the sequence plans, which should ideally be taken into account throughout the whole chain consisting of design, assembly, disassembly and reassembly. Isolating the foregoing operations from the rest of the components of the relevant ecosystems may lead to erroneous inferences toward both the necessity and efficiency of the underlying procedures. In this paper we try to alleviate these shortcomings by comprehensively investigating the state-of-the-art in robotic assembly and disassembly. We consider and review various aspects of manufacturing and remanufacturing frameworks while particularly focusing on their desirability for supporting a circular economy.


title: Optical Fault Injection Attacks against Radiation-Hard Registers

abstract: If devices are physically accessible optical fault injection attacks pose a great threat since the data processed as well as the operation flow can be manipulated. Successful physical attacks may lead not only to leakage of secret information such as cryptographic private keys, but can also cause economic damage especially if as a result of such a manipulation a critical infrastructure is successfully attacked. Laser based attacks exploit the sensitivity of CMOS technologies to electromagnetic radiation in the visible or the infrared spectrum. It can be expected that radiation-hard designs, specially crafted for space applications, are more robust not only against high-energy particles and short electromagnetic waves but also against optical fault injection attacks. In this work we investigated the sensitivity of radiation-hard JICG shift registers to optical fault injection attacks. In our experiments, we were able to trigger bit-set and bit-reset repeatedly changing the data stored in single JICG flip-flops despite their high-radiation fault tolerance.


title: Heavy-strange meson molecules and possible candidates $D^*_{s0}(2317)$, $D_{s1}(2460)$, and $X_0(2900)$

abstract: In this work, we systematically investigate the heavy-strange meson systems, $D^{(*)}K^{(*)}/\bar{B}^{(*)}K^{(*)}$ and $\bar{D}^{(*)}K^{(*)}/B^{(*)}K^{(*)}$, to study possible molecules in a quasipotenial Bethe-Salpter equation approach together with the one-boson exchange model. The potential is achieved with the help of the hidden-gauge Lagrangians. Molecular states are found from all six $S$-wave isoscalar interactions of $D^{(*)}K^{(*)}$ or $\bar{B}^{(*)}K^{(*)}$. The charmed-strange mesons $D^*_{s0}(2317)$ and $D_{s1}(2460)$ can be related to the ${D}K$ and $D^*K$ states with spin parities $0^+$ and $1^+$, respectively. In the current model, the $\bar{B}K^*$ molecular state with $1^+$ is the best candidate of the recent observed $B_{sJ}(6158)$. Four molecular states are produced from the interactions of $\bar{D}^{(*)}K^{(*)}$ or $B^{(*)}K^{(*)}$. The relation between the $\bar{D}^*{K}^*$ molecular state with $0^+$ and the $X_0(2900)$ is also discussed. No isovector molecular states are found from the interactions considered. The current results are helpful to understand the internal structure of $D^*_{s0}(2317)$, $D_{s1}(2460)$, $X_0(2900)$, and new $B_{sJ}$ states. The experimental research for more heavy-strange meson molecules is suggested.


title: Flexible dual-branched message passing neural network for quantum mechanical property prediction with molecular conformation

abstract: A molecule is a complex of heterogeneous components, and the spatial arrangements of these components determine the whole molecular properties and characteristics. With the advent of deep learning in computational chemistry, several studies have focused on how to predict molecular properties based on molecular configurations. Message passing neural network provides an effective framework for capturing molecular geometric features with the perspective of a molecule as a graph. However, most of these studies assumed that all heterogeneous molecular features, such as atomic charge, bond length, or other geometric features always contribute equivalently to the target prediction, regardless of the task type. In this study, we propose a dual-branched neural network for molecular property prediction based on message-passing framework. Our model learns heterogeneous molecular features with different scales, which are trained flexibly according to each prediction target. In addition, we introduce a discrete branch to learn single atom features without local aggregation, apart from message-passing steps. We verify that this novel structure can improve the model performance with faster convergence in most targets. The proposed model outperforms other recent models with sparser representations. Our experimental results indicate that in the chemical property prediction tasks, the diverse chemical nature of targets should be carefully considered for both model performance and generalizability.


title: Entire minimizers of Allen-Cahn systems with sub-quadratic potentials

abstract: We study entire minimizers of the Allen-Cahn systems. The specific feature of our systems are potentials having a finite number of global minima, with sub-quadratic behaviour locally near their minima. The corresponding formal Euler-Lagrange equations are supplemented with free boundaries. We do not study regularity issues but focus on qualitative aspects. We show the existence of entire solutions in an equivariant setting connecting the minima of $ W $ at infinity, thus modeling many coexisting phases, possessing free boundaries and minimizing energy in the symmetry class. We also present a very modest result of existence of free boundaries under no symmetry hypotheses. The existence of a free boundary can be related to the existence of a specific sub-quadratic feature, a dead core, whose size is also quantified.


title: Cascaded Span Extraction and Response Generation for Document-Grounded Dialog

abstract: This paper summarizes our entries to both subtasks of the first DialDoc shared task which focuses on the agent response prediction task in goal-oriented document-grounded dialogs. The task is split into two subtasks: predicting a span in a document that grounds an agent turn and generating an agent response based on a dialog and grounding document. In the first subtask, we restrict the set of valid spans to the ones defined in the dataset, use a biaffine classifier to model spans, and finally use an ensemble of different models. For the second subtask, we use a cascaded model which grounds the response prediction on the predicted span instead of the full document. With these approaches, we obtain significant improvements in both subtasks compared to the baseline.


title: The EBLM project -- VIII. First results for M-dwarf mass, radius and effective temperature measurements using CHEOPS light curves

abstract: The accuracy of theoretical mass, radius and effective temperature values for M-dwarf stars is an active topic of debate. Differences between observed and theoretical values have raised the possibility that current theoretical stellar structure and evolution models are inaccurate towards the low-mass end of the main sequence. To explore this issue we use the CHEOPS satellite to obtain high-precision light curves of eclipsing binaries with low mass stellar companions. We use these light curves combined with the spectroscopic orbit for the solar-type companion to measure the mass, radius and effective temperature of the M-dwarf star. Here we present the analysis of three eclipsing binaries. We use the pycheops data analysis software to fit the observed transit and eclipse events of each system. Two of our systems were also observed by the TESS satellite -- we similarly analyse these light curves for comparison. We find consistent results between CHEOPS and TESS, presenting three stellar radii and two stellar effective temperature values of low-mass stellar objects. These initial results from our on-going observing programme with CHEOPS show that we can expect to have ~24 new mass, radius and effective temperature measurements for very low mass stars within the next few years.


title: Ontological Entities for Planning and Describing Cultural Heritage 3D Models Creation

abstract: In the last decades the rapid development of technologies and methodologies in the field of digitization and 3D modelling has led to an increasing proliferation of 3D technologies in the Cultural Heritage domain. Despite the great potential of 3D digital heritage, the "special effects" of 3D may often overwhelm its importance in research. Projects and consortia of scholars have tried to put order in the different fields of application of these technologies, providing guidelines and proposing workflows. The use of computer graphics as an effective methodology for CH research and communication highlighted the need of transparent provenance data to properly document digital assets and understand the degree of scientific quality and reliability of their outcomes. The building and release of provenance knowledge, consisting in the complete formal documentation of each phase of the process, is therefore of fundamental importance to ensure its repeatability and to guarantee the integration and interoperability of the generated metadata on the Semantic Web. This paper proposes a methodology for documenting the planning and creation of 3D models used in archaeology and Cultural Heritage, by means of an application profile based on the CIDOC CRM ecosystem and other international standards.


title: Which Mutual-Information Representation Learning Objectives are Sufficient for Control?

abstract: Mutual information maximization provides an appealing formalism for learning representations of data. In the context of reinforcement learning (RL), such representations can accelerate learning by discarding irrelevant and redundant information, while retaining the information necessary for control. Much of the prior work on these methods has addressed the practical difficulties of estimating mutual information from samples of high-dimensional observations, while comparatively less is understood about which mutual information objectives yield representations that are sufficient for RL from a theoretical perspective. In this paper, we formalize the sufficiency of a state representation for learning and representing the optimal policy, and study several popular mutual-information based objectives through this lens. Surprisingly, we find that two of these objectives can yield insufficient representations given mild and common assumptions on the structure of the MDP. We corroborate our theoretical results with empirical experiments on a simulated game environment with visual observations.


title: On a nonhierarchical generalization of the Perceptron GREM

abstract: We introduce a nonlinear, nonhierarchical generalization of Derrida's GREM and establish through a Sanov-type large deviation analysis both a Boltzmann-Gibbs principle as well as a Parisi formula for the limiting free energy. In line with the predictions of the Parisi theory, the free energy is given by the minimal value over all Parisi functionals/hierarchical structures in which the original model can be coarse-grained.


title: Self-similar extrapolation of nonlinear problems from small-variable to large-variable limit

abstract: Complicated physical problems usually are solved by resorting to perturbation theory leading to solutions in the form of asymptotic series in powers of small parameters. However, finite, and even large values of the parameters often are of the main physical interest. A method is described for predicting the large-variable behavior of solutions to nonlinear problems from the knowledge of only their small-variable expansions. The method is based on self-similar approximation theory resulting in self-similar factor approximants. The latter can well approximate a large class of functions, rational, irrational, and transcendental. The method is illustrated by several examples from statistical and condensed matter physics, where the self-similar predictions can be compared with the available large-variable behavior. It is shown that the method allows for finding the behavior of solutions at large variables when knowing just a few terms of small-variable expansions. Numerical convergence of approximants is demonstrated.


title: $A_1$ Fefferman-Stein inequality for maximal functions of martingales in uniformly smooth spaces

abstract: Let $f$ be a martingale with values in a uniformly $p$-smooth Banach space and $w$ any positive weight. We show that $\mathbb{E} (f^* \cdot w) \lesssim \mathbb{E}(S_p f \cdot w^*)$, where $\cdot^*$ is the martingale maximal operator and $S_p$ is the $\ell^p$ sum of martingale increments.