title: Multi-Style Transfer with Discriminative Feedback on Disjoint Corpus

abstract: Style transfer has been widely explored in natural language generation with non-parallel corpus by directly or indirectly extracting a notion of style from source and target domain corpus. A common shortcoming of existing approaches is the prerequisite of joint annotations across all the stylistic dimensions under consideration. Availability of such dataset across a combination of styles limits the extension of these setups to multiple style dimensions. While cascading single-dimensional models across multiple styles is a possibility, it suffers from content loss, especially when the style dimensions are not completely independent of each other. In our work, we relax this requirement of jointly annotated data across multiple styles by using independently acquired data across different style dimensions without any additional annotations. We initialize an encoder-decoder setup with transformer-based language model pre-trained on a generic corpus and enhance its re-writing capability to multiple target style dimensions by employing multiple style-aware language models as discriminators. Through quantitative and qualitative evaluation, we show the ability of our model to control styles across multiple style dimensions while preserving content of the input text. We compare it against baselines involving cascaded state-of-the-art uni-dimensional style transfer models.


title: A Dual Yamada-Watanabe Theorem for Levy driven stochastic differential equations

abstract: We prove a dual Yamada-Watanabe theorem for one-dimensional stochastic differential equations driven by quasi-left continuous semimartingales with independent increments. In particular, our result covers stochastic differential equations driven by (time-inhomogeneous) Levy processes. More precisely, we prove that weak uniqueness, i.e. uniqueness in law, implies weak joint uniqueness, i.e. joint uniqueness in law for the solution process and its driver.


title: Survival probability and size of lineages in antibody affinity maturation

abstract: Affinity Maturation (AM) is the process through which the immune system is able to develop potent antibodies against new pathogens it encounters, and is at the base of the efficacy of vaccines. At its core AM is analogous to a Darwinian evolutionary process, where B-cells mutate and are selected on the base of their affinity for an Antigen (Ag), and Ag availability tunes the selective pressure. In cases when this selective pressure is high the number of B-cells might quickly decrease and the population might risk extinction in what is known as a population bottleneck. Here we study the probability for a B-cell lineage to survive this bottleneck scenario as a function of the progenitor affinity for the Ag. Using recursive relations and probability generating functions we derive expressions for the average extinction time and progeny size for lineages that go extinct. We then extend our results to the full population, both in the absence and presence of competition for T-cell help, and quantify the population survival probability as a function of Ag concentration and initial population size. Our study suggests the population bottleneck phenomenology might represent a limit case in the space of biologically plausible maturation scenarios, whose characterization could help guide the process of vaccine development.


title: Extreme kinematic misalignment in IllustrisTNG galaxies: the origin, structure and internal dynamics of galaxies with a large-scale counterrotation

abstract: Modern galaxy formation theory suggests that the misalignment between stellar and gaseous components usually results from an external gas accretion and/or interaction with other galaxies. The extreme case of the kinematic misalignment is demonstrated by so-called galaxies with counterrotation that possess two distinct components rotating in opposite directions with respect to each other. We provide an in-deep analysis of galaxies with counterrotation from IllustrisTNG100 cosmological simulations. We have found $25$ galaxies with substantial stellar counterrotation in the stellar mass range of $2\times10^{9}-3\times10^{10}$~\Msun. In our sample the stellar counterrotation is a result of an external gas infall happened $\approx 2-8$~Gyr ago. The infall leads to the initial removal of pre-existing gas, which is captured and mixed together with the infalling component. The gas mixture ends up in the counterrotating gaseous disc. We show that $\approx 90\%$ of the stellar counterrotation formed in-situ, in the counterrotating gas. During the early phases of the infall, gas can be found in inclined extended and rather thin disc-like structures, and in some galaxies they are similar to (nearly-)~polar disc or ring-like structures. We discuss a possible link between the gas infall, AGN activity and the formation of misaligned components. In particular, we suggest that the AGN activity does not cause the counterrotation, although it is efficiently triggered by the retrograde gas infall, and it correlates well with the misaligned component appearance. We also find evidence of the stellar disc heating visible as an increase of the vertical-to-radial velocity dispersion ratio above unity in both co- and counterrotating components, which implies the importance of the kinematical misalignment in shaping the velocity ellipsoids in disc galaxies.


title: Remark on topological nature of upward planarity

abstract: The notion of an upward plane graph in graph theory and that of a progressive plane graph (or plane string diagram) in category theory are essentially the same thing. In this paper, we combine the ideas in graph theory and category theory to explain why and in what sense upward planarity is a topological property. The main result is that two upward planar drawings of an acyclic directed graph are equivalent (connected by a deformation) if and only if they are connected by a planar isotopy which preserves the orientation and polarization of $G$. This result gives a positive answer to Selinger's conjectue, whose strategy is different from the solution recently given by Delpeuch and Vicary.


title: Talagrand's influence inequality revisited

abstract: Let $\mathscr{C}_n=\{-1,1\}^n$ be the discrete hypercube equipped with the uniform probability measure $\sigma_n$. Talagrand's influence inequality (1994) asserts that there exists $C\in(0,\infty)$ such that for every $n\in\mathbb{N}$, every function $f:\mathscr{C}_n\to\mathbb{C}$ satisfies $$\mathrm{Var}_{\sigma_n}(f) \leq C \sum_{i=1}^n \frac{\|\partial_if\|_{L_2(\sigma_n)}^2}{1+\log\big(\|\partial_if\|_{L_2(\sigma_n)}/\|\partial_i f\|_{L_1(\sigma_n)}\big)}.$$ In this work, we undertake a systematic investigation of this and related inequalities via harmonic analytic and stochastic techniques and derive applications to metric embeddings. We prove that Talagrand's inequality extends, up to an additional doubly logarithmic factor, to Banach space-valued functions under the necessary assumption that the target space has Rademacher type 2 and that this doubly logarithmic term can be omitted if the target space admits an equivalent 2-uniformly smooth norm. These are the first vector-valued extensions of Talagrand's influence inequality. We also obtain a joint strengthening of results of Bakry-Meyer (1982) and Naor-Schechtman (2002) on the action of negative powers of the hypercube Laplacian on functions $f:\mathscr{C}_n\to E$, whose target space $E$ has nontrivial Rademacher type via a new vector-valued version of Meyer's multiplier theorem (1984). Inspired by Talagrand's influence inequality, we introduce a new metric invariant called Talagrand type and estimate it for Banach spaces with prescribed Rademacher or martingale type, Gromov hyperbolic groups and simply connected Riemannian manifolds of pinched negative curvature. Finally, we prove that Talagrand type is an obstruction to the bi-Lipschitz embeddability of nonlinear quotients of the hypercube $\mathscr{C}_n$, thus deriving new nonembeddability results for these finite metrics.


title: Flexibility management with virtual batteries of thermostatically controlled loads: real-time control system and potential in Spain

abstract: Load flexibility management is a promising approach to face the problem of balancing generation and demand in electrical grids. This problem is becoming increasingly difficult due to the variability of renewable energies. Thermostatically controlled loads can be aggregated and managed by a virtual battery, and they provide a cost-effective and efficient alternative to physical storage systems to mitigate the inherent variability of renewable energy sources. But virtual batteries require of an accurate control system being capable of tracking frequency regulation signals with minimal error. A real-time control system allowing virtual batteries to accurately track frequency or power signals is developed. The performance of this controller is validated for a virtual battery composed of 1,000 thermostatically controlled loads. Using virtual batteries equipped with the developed controller, a study focused on residential thermostatically controlled loads in Spain is performed. The results of the study quantify the potential of this technology in a country with different climate areas and provides insight about the feasibility of virtual batteries as enablers of electrical systems with high levels of penetration of renewable energy sources.


title: A simulation-based evaluation of a Cargo-Hitching service for E-commerce using mobility-on-demand vehicles

abstract: Time-sensitive parcel deliveries, shipments requested for delivery in a day or less, are an increasingly important research subject. It is challenging to deal with these deliveries from a carrier perspective since it entails additional planning constraints, preventing an efficient consolidation of deliveries which is possible when demand is well known in advance. Furthermore, such time-sensitive deliveries are requested to a wider spatial scope than retail centers, including homes and offices. Therefore, an increase in such deliveries is considered to exacerbate negative externalities such as congestion and emissions. One of the solutions is to leverage spare capacity in passenger transport modes. This concept is often denominated as cargo-hitching. While there are various possible system designs, it is crucial that such solution does not deteriorate the quality of service of passenger trips. This research aims to evaluate the use of Mobility-On-Demand services to perform same-day parcel deliveries. For this purpose, we use SimMobility, a high-resolution agent-based simulation platform of passenger and freight flows, applied in Singapore. E-commerce demand carrier data are used to characterize simulated parcel delivery demand. Operational scenarios that aim to minimize the adverse effect of fulfilling deliveries with Mobility-On-Demand vehicles on Mobility-On-Demand passenger flows (fulfillment, wait and travel times) are explored. Results indicate that the Mobility-On-Demand services have potential to fulfill a considerable amount of parcel deliveries and decrease freight vehicle traffic and total vehicle-kilometers-travelled without compromising the quality of Mobility On-Demand for passenger travel.


title: A generic classification of exceptional orthogonal X1-polynomials based on Pearson distributions family

abstract: The so-called exceptional orthogonal X1-polynomials arise as eigen functions of a Sturm-Liouville problem. In this paper, a generic classification of these polynomials is presented based on Pearson distributions family. Then, six special differential equations of the aforesaid classification are introduced and their polynomial solutions are studied in detail.


title: Alfv\'enic Thermospheric Upwelling in a Global Geospace Model

abstract: Motivated by low-altitude cusp observations of small-scale (~ 1 km) field-aligned currents (SSFACs) interpreted as ionospheric Alfv\'en resonator modes, we investigated the effects of Alfv\'en wave energy deposition on thermospheric upwelling and the formation of air density enhancements in and near the cusp. Such density enhancements were commonly observed near 400 km altitude by the CHAMP satellite. They are not predicted by empirical thermosphere models, and they are well-correlated with the observed SSFACs. A parameterized model for the altitude dependence of the Alfv\'en wave electric field, constrained by CHAMP data, has been developed and embedded in the Joule heating module of the National Center for Atmospheric Research (NCAR) Coupled Magnetosphere-Ionosphere-Thermosphere (CMIT) model. The CMIT model was then used to simulate the geospace response to an interplanetary stream interaction region (SIR) that swept past Earth on 26-27 March 2003. CMIT diagnostics for the thermospheric mass density at 400 km altitude show: 1) CMIT without Alfv\'enic Joule heating usually underestimates CHAMP's orbit-average density; inclusion of Alfv\'enic heating modestly improves CMIT's orbit-average prediction of the density (by a few %), especially during the more active periods of the SIR event. 2) The improvement in CMIT's instantaneous density prediction with Alfv\'enic heating included is more significant (up to 15%) in the vicinity of the cusp heating region, a feature that the MSIS empirical thermosphere model misses for this event. Thermospheric density changes of 20-30% caused by the cusp-region Alfv\'enic heating sporadically populate the polar region through the action of corotation and neutral winds.


title: Relative humidity in droplet and airborne transmission of disease

abstract: A large number of infectious diseases is transmitted by respiratory droplets. How long these droplets persist in the air, how far they can travel, and how long the pathogens they might carry survive are all decisive factors for the spread of droplet-borne diseases. The subject is extremely multifaceted and its aspects range across different disciplines, yet most of them have only seldom been considered in the physics community. In this review, we discuss the physical principles that govern the fate of respiratory droplets and any viruses trapped inside them, with a focus on the role of relative humidity. Importantly, low relative humidity -- as encountered, for instance, indoors during winter and inside aircraft -- facilitates evaporation and keeps even initially large droplets suspended in air as aerosol for extended periods of time. What is more, relative humidity affects the stability of viruses in aerosol through several physical mechanisms such as efflorescence and inactivation at the air-water interface, whose role in virus inactivation nonetheless remains poorly understood. Elucidating the role of relative humidity in the droplet spread of disease would permit us to design preventive measures that could aid in reducing the chance of transmission, particularly in indoor environment.


title: A dynamic model of Tax Evasion

abstract: In this paper we present a simplified model of a proportional taxation system where citizens decide whether to pay taxes or evade them. We initially derive a dynamic equation for the fraction of evaders and then present both its critical points and equilibrium stable states for a well-mixed population and for a fixed audit probability. Our theoretical predictions consider different possible income distributions (homogeneous and heterogeneous), time-dependent audit probability and different possible social topologies, by means of selected complex network configurations. All derived results are validated and confirmed by extended Monte Carlo simulations. Finally, some policy implications aimed to reduce tax evasion are suggested, with regards to the tax and fine rates and the audit probability.


title: A comment on no-force conditions for black holes and branes

abstract: In the context of the Weak Gravity Conjecture the notion of quasi-extremality for black holes and branes was recently defined as the property of having either vanishing horizon size or surface gravity. It was derived that such objects obey a no-force condition. In this short note I present a simplified derivation that is essentially present in the formalism of timelike reduction pioneered by Breitenlohner, Gibbons and Maison. This formalism also provides the natural definition of quasi-extremality for gravitational instantons (and wormholes) sourced by axion fluxes and strengthens the argument that macroscopic axion wormholes do not contribute in the path integral since they are self-repulsive in a Euclidean sense.


title: Everettian probabilities, the Deutsch-Wallace theorem and the Principal Principle

abstract: This paper is concerned with the nature of probability in physics, and in quantum mechanics in particular. It starts with a brief discussion of the evolution of Itamar Pitowsky's thinking about probability in quantum theory from 1994 to 2008, and the role of Gleason's 1957 theorem in his derivation of the Born Rule. Pitowsky's defence of probability therein as a logic of partial belief leads us into a broader discussion of probability in physics, in which the existence of objective "chances" is questioned, and the status of David Lewis' influential Principal Principle is critically examined. This is followed by a sketch of the work by David Deutsch and David Wallace which resulted in the Deutsch-Wallace (DW) theorem in Everettian quantum mechanics. It is noteworthy that the authors of this important decision-theoretic derivation of the Born Rule have different views concerning the meaning of probability. The theorem, which was the subject of a 2007 critique by Meir Hemmo and Pitowsky, is critically examined, along with recent related work by John Earman. Here our main argument is that the DW theorem does not provide a justification of the Principal Principle, contrary to claims by Wallace and Simon Saunders. A final section analyses recent claims to the effect that that the DW theorem is redundant, a conclusion that seems to be reinforced by consideration of probabilities in "deviant' branches in the Everettian multiverse.


title: Extraction of long k-mers using spaced seeds

abstract: The extraction of k-mers from sequencing reads is an important task in many bioinformatics applications, such as all DNA sequence analysis methods based on de Bruijn graphs. These methods tend to be more accurate when the used k-mers are unique in the analyzed DNA, and thus the use of longer k-mers is preferred. When the read lengths of short read sequencing technologies increase, the error rate will become the determining factor for the largest possible value of k. Here we propose LoMeX which uses spaced seeds to extract long k-mers accurately even in the presence of sequencing errors. Our experiments show that LoMeX can extract long k-mers from current Illumina reads with a higher recall than a standard k-mer counting tool. Furthermore, our experiments on simulated data show that when the read length further increases, the performance of standard k-mer counters declines, whereas LoMeX still extracts long k-mers successfully.


title: A Technical Report: BUT Speech Translation Systems

abstract: The paper describes the BUT's speech translation systems. The systems are English$\longrightarrow$German offline speech translation systems. The systems are based on our previous works \cite{Jointly_trained_transformers}. Though End-to-End and cascade~(ASR-MT) spoken language translation~(SLT) systems are reaching comparable performances, a large degradation is observed when translating ASR hypothesis compared to the oracle input text. To reduce this performance degradation, we have jointly-trained ASR and MT modules with ASR objective as an auxiliary loss. Both the networks are connected through the neural hidden representations. This model has an End-to-End differentiable path with respect to the final objective function and also utilizes the ASR objective for better optimization. During the inference both the modules(i.e., ASR and MT) are connected through the hidden representations corresponding to the n-best hypotheses. Ensembling with independently trained ASR and MT models have further improved the performance of the system.


title: Two-Stream Consensus Network for Weakly-Supervised Temporal Action Localization

abstract: Weakly-supervised Temporal Action Localization (W-TAL) aims to classify and localize all action instances in an untrimmed video under only video-level supervision. However, without frame-level annotations, it is challenging for W-TAL methods to identify false positive action proposals and generate action proposals with precise temporal boundaries. In this paper, we present a Two-Stream Consensus Network (TSCN) to simultaneously address these challenges. The proposed TSCN features an iterative refinement training method, where a frame-level pseudo ground truth is iteratively updated, and used to provide frame-level supervision for improved model training and false positive action proposal elimination. Furthermore, we propose a new attention normalization loss to encourage the predicted attention to act like a binary selection, and promote the precise localization of action instance boundaries. Experiments conducted on the THUMOS14 and ActivityNet datasets show that the proposed TSCN outperforms current state-of-the-art methods, and even achieves comparable results with some recent fully-supervised methods.


title: Early Anomaly Detection in Time Series: A Hierarchical Approach for Predicting Critical Health Episodes

abstract: The early detection of anomalous events in time series data is essential in many domains of application. In this paper we deal with critical health events, which represent a significant cause of mortality in intensive care units of hospitals. The timely prediction of these events is crucial for mitigating their consequences and improving healthcare. One of the most common approaches to tackle early anomaly detection problems is standard classification methods. In this paper we propose a novel method that uses a layered learning architecture to address these tasks. One key contribution of our work is the idea of pre-conditional events, which denote arbitrary but computable relaxed versions of the event of interest. We leverage this idea to break the original problem into two hierarchical layers, which we hypothesize are easier to solve. The results suggest that the proposed approach leads to a better performance relative to state of the art approaches for critical health episode prediction.


title: Two-dimensional Materials with Giant Optical Nonlinearities Near the Theoretical Upper Limit

abstract: Nonlinear optical (NLO) phenomena such as harmonic generation, Kerr, and Pockels effects are of great technological importance for lasers, frequency converters, modulators, switches, etc. Recently, two-dimensional (2D) materials have drawn significant attention due to their strong and unique NLO properties. Here, we describe an efficient first-principles workflow for calculating the quadratic optical response and apply it to 375 non-centrosymmetric semiconductor monolayers from the Computational 2D Materials Database (C2DB). Sorting the non-resonant nonlinearities with respect to bandgap $E_g$ reveals an upper limit proportional to $E_g^{-4}$, which is neatly explained by two distinct generic models. We identify multiple promising candidates with giant nonlinearities and bandgaps ranging from 0.4 to 5 eV, some of which approach the theoretical upper limit and greatly outperform known materials. Our comprehensive library of ab initio NLO spectra for all 375 monolayers is freely available via the C2DB website. We expect this work to pave the way for highly efficient and compact opto-electronic devices based on 2D materials.


title: Descriptive properties of higher Kurepa trees

abstract: We use generalizations of concepts from descriptive set theory to study combinatorial objects of uncountable regular cardinality, focussing on higher Kurepa trees and the representation of the sets of cofinal branches through such trees as continuous images of function spaces. For different types of uncountable regular cardinals $\kappa$, our results provide a complete picture of all consistent scenarios for the representation of sets of cofinal branches through $\kappa$-Kurepa trees as retracts of the generalized Baire space ${}^\kappa\kappa$ of $\kappa$. In addition, these results can be used to determine the consistency of most of the corresponding statements for continuous images of ${}^\kappa\kappa$.


title: An Efficient Adversarial Attack for Tree Ensembles

abstract: We study the problem of efficient adversarial attacks on tree based ensembles such as gradient boosting decision trees (GBDTs) and random forests (RFs). Since these models are non-continuous step functions and gradient does not exist, most existing efficient adversarial attacks are not applicable. Although decision-based black-box attacks can be applied, they cannot utilize the special structure of trees. In our work, we transform the attack problem into a discrete search problem specially designed for tree ensembles, where the goal is to find a valid "leaf tuple" that leads to mis-classification while having the shortest distance to the original input. With this formulation, we show that a simple yet effective greedy algorithm can be applied to iteratively optimize the adversarial example by moving the leaf tuple to its neighborhood within hamming distance 1. Experimental results on several large GBDT and RF models with up to hundreds of trees demonstrate that our method can be thousands of times faster than the previous mixed-integer linear programming (MILP) based approach, while also providing smaller (better) adversarial examples than decision-based black-box attacks on general $\ell_p$ ($p=1, 2, \infty$) norm perturbations. Our code is available at https://github.com/chong-z/tree-ensemble-attack.


title: Low temperature and high magnetic field performance of a commercial piezo-actuator probed $via$ laser interferometry

abstract: The advances in the fields of scanning probe microscopy, scanning tunneling spectroscopy, point contact spectroscopy and point contact Andreev reflection spectroscopy to study the properties of conventional and quantum materials at cryogenic conditions have prompted the development of nanopositioners and nanoscanners with enhanced spatial resolution. Piezoelectric-actuator stacks as nanopositioners with working strokes $>100~\mu\mathrm{m}$ and positioning resolution $\sim$(1-10) nm are desirable for both basic research and industrial applications. However, information on the performance of most commercial piezoelectric-actuators in cryogenic environment and in the presence of magnetic fields in excess of 5\,T is generally not available. In particular, the magnitude, rate and the associated hysteresis of the piezo-displacement at cryogenic temperatures are the most relevant parameters that determine whether a particular piezoelectric-actuator can be used as a nanopositioner. Here, the design and realization of an experimental set-up based on interferometric techniques to characterize a commercial piezoelectric-actuator over a temperature range of $2~\mathrm{K}\leq{T}\leq260~\mathrm{K}$ and magnetic fields up to 6\,T is presented. The studied piezoelectric-actuator has a maximum displacement of $30~\mu\mathrm{m}$ at room temperature for a maximum driving voltage of 75\,V, which reduces to $1.2~\mu\mathrm{m}$ with an absolute hysteresis of $\left(9.1\pm3.3\right)~\mathrm{nm}$ at $T=2\,\mathrm{K}$. The magnetic field is shown to have no substantial effect on the piezo properties of the studied piezoelectric-actuator stack.


title: On the Power of Deep but Naive Partial Label Learning

abstract: Partial label learning (PLL) is a class of weakly supervised learning where each training instance consists of a data and a set of candidate labels containing a unique ground truth label. To tackle this problem, a majority of current state-of-the-art methods employs either label disambiguation or averaging strategies. So far, PLL methods without such techniques have been considered impractical. In this paper, we challenge this view by revealing the hidden power of the oldest and naivest PLL method when it is instantiated with deep neural networks. Specifically, we show that, with deep neural networks, the naive model can achieve competitive performances against the other state-of-the-art methods, suggesting it as a strong baseline for PLL. We also address the question of how and why such a naive model works well with deep neural networks. Our empirical results indicate that deep neural networks trained on partially labeled examples generalize very well even in the over-parametrized regime and without label disambiguations or regularizations. We point out that existing learning theories on PLL are vacuous in the over-parametrized regime. Hence they cannot explain why the deep naive method works. We propose an alternative theory on how deep learning generalize in PLL problems.


title: Revisiting Wireless Internet Connectivity: 5G vs Wi-Fi 6

abstract: In recent years, significant attention has been directed toward the fifth generation of wireless broadband connectivity known as `5G`, currently being deployed by Mobile Network Operators. Surprisingly, there has been considerably less attention paid to `Wi-Fi 6`, the new IEEE 802.1ax standard in the family of Wireless Local Area Network technologies with features targeting private, edge-networks. This paper revisits the suitability of cellular and Wi-Fi in delivering high-speed wireless Internet connectivity. Both technologies aspire to deliver significantly enhanced performance, enabling each to deliver much faster wireless broadband connectivity, and provide further support for the Internet of Things and Machine-to-Machine communications, positioning the two technologies as technical substitutes in many usage scenarios. We conclude that both are likely to play important roles in the future, and simultaneously serve as competitors and complements. We anticipate that 5G will remain the preferred technology for wide-area coverage, while Wi-Fi 6 will remain the preferred technology for indoor use, thanks to its much lower deployment costs. However, the traditional boundaries that differentiated earlier generations of cellular and Wi-Fi are blurring. Proponents of one technology may argue for the benefits of their chosen technology displacing the other, requesting regulatory policies that would serve to tilt the marketplace in their favour. We believe such efforts need to be resisted, and that both technologies have important roles to play in the marketplace, based on the needs of heterogeneous use cases. Both technologies should contribute to achieving the goal of providing affordable, reliable, and ubiquitously available high-capacity wireless broadband connectivity.


title: Access to the kaon radius with kaonic atoms

abstract: We put forward a method for determination of the kaon radius from the spectra of kaonic atoms. We analyze the few lowest transitions and their sensitivity to the size of the kaon for ions in the nuclear charge range Z = 1 - 100, taking into account finite-nuclear-size, finite-kaon-size, recoil and leading-order quantum-electrodynamic effects. Additionally, the opportunities of extracting the kaon mass and nuclear radii are demonstrated by examining the sensitivity of the transition energies in kaonic atoms.


title: On Perturbation Theory and Critical Exponents for Self-Similar Systems

abstract: Gravitational critical collapse in the Einstein-axion-dilaton system is known to lead to continuous self-similar solutions characterized by the Choptuik critical exponent $\gamma$. We complete the existing literature on the subject by computing the linear perturbation equations in the case where the axion-dilaton system assumes a parabolic form. Next, we solve the perturbation equations in a newly discovered self-similar solution in the hyperbolic case, which allows us to extract the Choptuik exponent. Our main result is that this exponent depends not only on the dimensions of spacetime but also the particular ansatz and the critical solutions that one started with.


title: AI-lead Court Debate Case Investigation

abstract: The multi-role judicial debate composed of the plaintiff, defendant, and judge is an important part of the judicial trial. Different from other types of dialogue, questions are raised by the judge, The plaintiff, plaintiff's agent defendant, and defendant's agent would be to debating so that the trial can proceed in an orderly manner. Question generation is an important task in Natural Language Generation. In the judicial trial, it can help the judge raise efficient questions so that the judge has a clearer understanding of the case. In this work, we propose an innovative end-to-end question generation model-Trial Brain Model (TBM) to build a Trial Brain, it can generate the questions the judge wants to ask through the historical dialogue between the plaintiff and the defendant. Unlike prior efforts in natural language generation, our model can learn the judge's questioning intention through predefined knowledge. We do experiments on real-world datasets, the experimental results show that our model can provide a more accurate question in the multi-role court debate scene.


title: Automata and Fixpoints for Asynchronous Hyperproperties

abstract: Hyperproperties have received increasing attention in the last decade due to their importance e.g. for security analyses. Past approaches have focussed on synchronous analyses, i.e. techniques in which different paths are compared lockstepwise. In this paper, we systematically study asynchronous analyses for hyperproperties by introducing both a novel automata model (Alternating Asynchronous Parity Automata) and the temporal fixpoint calculus $\Hmu$, the first fixpoint calculus that can systematically express hyperproperties in an asynchronous manner and at the same time subsumes the existing logic HyperLTL. We show that the expressive power of both models coincides over fixed path assignments. The high expressive power of both models is evidenced by the fact that decision problems of interest are highly undecidable, i.e. not even arithmetical. As a remedy, we propose approximative analyses for both models that also induce natural decidable fragments.


title: 61 ways to measure the height of a building: an introduction to experimental practices

abstract: We created an introductory physics activity for undergrad students consisting in measuring by different methods the same physical quantity. It allows to confront students with questions of uncertainty, precision, and model versus theory. The aim was to measure the height of a building using only a smartphone and everyday low-cost equipment. We designed 61 methods to do so and tested most of them. These methods can be implemented in various pedagogical scenarios, engaging students into a concrete task, outside of the lab, easily set up at almost zero cost.


title: Backdoor Attack against Speaker Verification

abstract: Speaker verification has been widely and successfully adopted in many mission-critical areas for user identification. The training of speaker verification requires a large amount of data, therefore users usually need to adopt third-party data ($e.g.$, data from the Internet or third-party data company). This raises the question of whether adopting untrusted third-party data can pose a security threat. In this paper, we demonstrate that it is possible to inject the hidden backdoor for infecting speaker verification models by poisoning the training data. Specifically, we design a clustering-based attack scheme where poisoned samples from different clusters will contain different triggers ($i.e.$, pre-defined utterances), based on our understanding of verification tasks. The infected models behave normally on benign samples, while attacker-specified unenrolled triggers will successfully pass the verification even if the attacker has no information about the enrolled speaker. We also demonstrate that existing backdoor attacks cannot be directly adopted in attacking speaker verification. Our approach not only provides a new perspective for designing novel attacks, but also serves as a strong baseline for improving the robustness of verification methods. The code for reproducing main results is available at \url{https://github.com/zhaitongqing233/Backdoor-attack-against-speaker-verification}.


title: A nano polymer aggregate on a substrate: A Theoretical study

abstract: We consider the lattice model for an ideal-linear polymer chain to mimic the conformations of the semi-flexible homo-polymer chain. The polymer chain is assumed to confine in the fairly small area, such that the flexible chain conformations are easily polymerized in the nano-area. It has been described using analytical calculations that such a situation may lead to interesting and distinct theoretical findings of the thermodynamics of semi-flexible homo-polymeric macromolecules where the macromolecules are confined in the nano-length scale. We also discuss the characteristics of the persistent length and the elastic force due to the nano scale confinement of an infinitely long ideal polymer chain.


title: Super-resolution of periodic signals from short sequences of samples

abstract: Reconstruction of undersampled periodic signals of unknown period is an important signal processing operation. It is especially difficult operation when the sequences of samples are short and no information on the inter-sequence time distances is given. For such a case, there exist some algorithms that allow for approximation of the sampled signal. However, these algorithms require either bandlimitedness of the signal, or noiseless samples. In this paper, we propose a novel algorithm which does not require the signal to be bandlimited and it can cope with additive noise in the samples. The algorithm is illustrated and validated with real data.


title: Machine Learning in QM/MM Molecular Dynamics Simulations of Condensed-Phase Systems

abstract: Quantum mechanics/molecular mechanics (QM/MM) molecular dynamics (MD) simulations have been developed to simulate molecular systems, where an explicit description of changes in the electronic structure is necessary. However, QM/MM MD simulations are computationally expensive compared to fully classical simulations as all valence electrons are treated explicitly and a self-consistent field (SCF) procedure is required. Recently, approaches have been proposed to replace the QM description with machine learned (ML) models. However, condensed-phase systems pose a challenge for these approaches due to long-range interactions. Here, we establish a workflow, which incorporates the MM environment as an element type in a high-dimensional neural network potential (HDNNP). The fitted HDNNP describes the potential-energy surface of the QM particles with an electrostatic embedding scheme. Thus, the MM particles feel a force from the polarized QM particles. To achieve chemical accuracy, we find that even simple systems require models with a strong gradient regularization, a large number of data points, and a substantial number of parameters. To address this issue, we extend our approach to a delta-learning scheme, where the ML model learns the difference between a reference method (DFT) and a cheaper semi-empirical method (DFTB). We show that such a scheme reaches the accuracy of the DFT reference method, while requiring significantly less parameters. Furthermore, the delta-learning scheme is capable of correctly incorporating long-range interactions within a cutoff of 1.4 nm. It is validated by performing MD simulations of retinoic acid in water and the interaction between S-adenoslymethioniat with cytosine in water. The presented results indicate that delta-learning is a promising approach for (QM)ML/MM MD simulations of condensed-phase systems.


title: A Simple Methodology for Model-Driven Business Innovation and Low Code Implementation

abstract: Low Code platforms, according to Gartner Group, represent one of the more disruptive technologies in the development and maintenance of enterprise applications. The key factor is represented by the central involvement of business people and domain expert, with a substantial disintermediation with respect to technical people. In this paper we propose a methodology conceived to support non-technical people in addressing business process innovation and developing enterprise software application. The proposed methodology, called EasInnova, is solidly rooted in Model-Driven Engineering and adopts a three staged model of an innovation undertaking. The three stages are: AsIs that models the existing business scenario; Transformation that consists in the elaboration of the actual innovation; ToBe that concerns the modeling of new business scenario. The core of EasInnova is represented by a matrix where columns are the three innovation stages and the rows are the three Model-Driven Architecture layers: CIM, PIM, PSM. The cells indicate the steps to be followed in achieving the sought innovation. Finally, the produced models will be transferred onto a BonitaSoft, the Low Code platform selected in our work. The methodology is described by means of a simple example in the domain of home food delivery.


title: Hierarchical Federated Learning through LAN-WAN Orchestration

abstract: Federated learning (FL) was designed to enable mobile phones to collaboratively learn a global model without uploading their private data to a cloud server. However, exiting FL protocols has a critical communication bottleneck in a federated network coupled with privacy concerns, usually powered by a wide-area network (WAN). Such a WAN-driven FL design leads to significantly high cost and much slower model convergence. In this work, we propose an efficient FL protocol, which involves a hierarchical aggregation mechanism in the local-area network (LAN) due to its abundant bandwidth and almost negligible monetary cost than WAN. Our proposed FL can accelerate the learning process and reduce the monetary cost with frequent local aggregation in the same LAN and infrequent global aggregation on a cloud across WAN. We further design a concrete FL platform, namely LanFL, that incorporates several key techniques to handle those challenges introduced by LAN: cloud-device aggregation architecture, intra-LAN peer-to-peer (p2p) topology generation, inter-LAN bandwidth capacity heterogeneity. We evaluate LanFL on 2 typical Non-IID datasets, which reveals that LanFL can significantly accelerate FL training (1.5x-6.0x), save WAN traffic (18.3x-75.6x), and reduce monetary cost (3.8x-27.2x) while preserving the model accuracy.


title: Inequalities for the norms of vector functions in a spherical layer

abstract: We consider the vector functions in a domain homeomorphic to a spherical layer bounded by twice continuously differentiable surfaces. Additional restrictions are imposed on the domain, which allow to conduct proofs using simple methods. On the outer and inner boundaries, the normal and the tangential components of the vector are zero, respectively. For such functions, the integral over the domain of the squared vector is estimated from above via the integral of the sum of squared gradients of its Cartesian components. The last integral is estimated through the integral of the sum of the squared divergence and rotor. These inequalities allow to define two norms equivalent to the sum of the norms of the Cartesian components of vector functions as the elements of the space $W_2^{(1)}(\Omega)$. The integrals over the boundaries of the squared vector are also estimated. The constants in all proved inequalities are determined only by the shape of the domain and do not depend on a specific vector function. The inequalities are necessary for investigating the operator of a mixed elliptic boundary value problem.


title: Quantitative analysis of robot gesticulation behavior

abstract: Social robot capabilities, such as talking gestures, are best produced using data driven approaches to avoid being repetitive and to show trustworthiness. However, there is a lack of robust quantitative methods that allow to compare such methods beyond visual evaluation. In this paper a quantitative analysis is performed that compares two Generative Adversarial Networks based gesture generation approaches. The aim is to measure characteristics such as fidelity to the original training data, but at the same time keep track of the degree of originality of the produced gestures. Principal Coordinate Analysis and procrustes statistics are performed and a new Fr\'echet Gesture Distance is proposed by adapting the Fr\'echet Inception Distance to gestures. These three techniques are taken together to asses the fidelity/originality of the generated gestures.


title: Lipschitz property of bistable or combustion fronts and its applications

abstract: For a class of reaction-diffusion equations describing propagation phenomena, we prove that for any entire solution $u$, the level set $\{u=\lambda\}$ is a Lipschitz graph in the time direction if $\lambda$ is close to $1$. Under a further assumption that $u$ connects $0$ and $1$, it is shown that all level sets are Lipschitz graphs. By a blowing down analysis, the large scale motion law for these level sets and a characterization of the minimal speed for travelling waves are also given.


title: A shell model of eye growth and elasticity

abstract: The eye grows during childhood to position the retina at the correct distance behind the lens to enable focused vision, a process called emmetropization. Animal studies have demonstrated that this growth process is dependent upon visual stimuli, while genetic and environmental factors that affect the likelihood of developing myopia have also been identified. The coupling between growth, remodeling and elastic response in the eye is particularly challenging to understand. To analyse this coupling, we develop a simple model of an eye growing under intraocular pressure in response to visual stimuli. Distinct to existing three-dimensional finite-element models of the eye, we treat the sclera as a thin axisymmetric hyperelastic shell which undergoes local growth in response to external stimulus. This simplified analytic model provides a tractable framework in which to evaluate various emmetropization hypotheses and understand different types of growth feedback, which we exemplify by demonstrating that local growth laws are sufficient to tune the global size and shape of the eye for focused vision across a range of parameter values.


title: Comparison of ARIMA, ETS, NNAR and hybrid models to forecast the second wave of COVID-19 hospitalizations in Italy

abstract: Coronavirus disease (COVID-19) is a severe ongoing novel pandemic that has emerged in Wuhan, China, in December 2019. As of October 13, the outbreak has spread rapidly across the world, affecting over 38 million people, and causing over 1 million deaths. In this article, I analysed several time series forecasting methods to predict the spread of COVID-19 second wave in Italy, over the period after October 13, 2020. I used an autoregressive model (ARIMA), an exponential smoothing state space model (ETS), a neural network autoregression model (NNAR), and the following hybrid combinations of them: ARIMA-ETS, ARIMA-NNAR, ETS-NNAR, and ARIMA-ETS-NNAR. About the data, I forecasted the number of patients hospitalized with mild symptoms, and in intensive care units (ICU). The data refer to the period February 21, 2020-October 13, 2020 and are extracted from the website of the Italian Ministry of Health (www.salute.gov.it). The results show that i) the hybrid models, except for ARIMA-ETS, are better at capturing the linear and non-linear epidemic patterns, by outperforming the respective single models; and ii) the number of COVID-19-related hospitalized with mild symptoms and in ICU will rapidly increase in the next weeks, by reaching the peak in about 50-60 days, i.e. in mid-December 2020, at least. To tackle the upcoming COVID-19 second wave, on one hand, it is necessary to hire healthcare workers and implement sufficient hospital facilities, protective equipment, and ordinary and intensive care beds; and on the other hand, it may be useful to enhance social distancing by improving public transport and adopting the double-shifts schooling system, for example.


title: Analysis of carbon content in direct-write plasmonic Au structures by nanomechanical scanning absorption microscopy

abstract: The determination of the chemical content is crucial for the quality control in high-precision device fabrication and advanced process development. For reliable chemical composition characterization, certain interaction volume of the target material is necessary for conventional techniques such as energy-dispersive X-ray spectroscopy (EDX) and electron energy loss spectroscopy (EELS). This remains however a challenge for nanostructures. We hereby propose an alternative technique for measuring chemical composition of nanostructures with limited volume. By measuring the differences in the optical absorption of the nanostructure due to the differences in the chemical composition with the resonance frequency detuning of a nanomechanical resonator as well as the assistance of the analytical optical modelling, we demonstrate the possibility of characterizing the carbon content in the direct-write focused electron beam induced deposition (FEBID) gold nanostructures.


title: Self-Supervised Shadow Removal

abstract: Shadow removal is an important computer vision task aiming at the detection and successful removal of the shadow produced by an occluded light source and a photo-realistic restoration of the image contents. Decades of re-search produced a multitude of hand-crafted restoration techniques and, more recently, learned solutions from shad-owed and shadow-free training image pairs. In this work,we propose an unsupervised single image shadow removal solution via self-supervised learning by using a conditioned mask. In contrast to existing literature, we do not require paired shadowed and shadow-free images, instead we rely on self-supervision and jointly learn deep models to remove and add shadows to images. We validate our approach on the recently introduced ISTD and USR datasets. We largely improve quantitatively and qualitatively over the compared methods and set a new state-of-the-art performance in single image shadow removal.


title: From trees to barcodes and back again: theoretical and statistical perspectives

abstract: Methods of topological data analysis have been successfully applied in a wide range of fields to provide useful summaries of the structure of complex data sets in terms of topological descriptors, such as persistence diagrams. While there are many powerful techniques for computing topological descriptors, the inverse problem, i.e., recovering the input data from topological descriptors, has proved to be challenging. In this article we study in detail the Topological Morphology Descriptor (TMD), which assigns a persistence diagram to any tree embedded in Euclidean space, and a sort of stochastic inverse to the TMD, the Topological Neuron Synthesis (TNS) algorithm, gaining both theoretical and computational insights into the relation between the two. We propose a new approach to classify barcodes using symmetric groups, which provides a concrete language to formulate our results. We investigate to what extent the TNS recovers a geometric tree from its TMD and describe the effect of different types of noise on the process of tree generation from persistence diagrams. We prove moreover that the TNS algorithm is stable with respect to specific types of noise.


title: Excitonic Effects in the Optical Spectra of Lithium metasilicate (Li2SiO3)

abstract: The Li2SiO3 compound, a ternary electrolyte compound of Lithium-ion based batteries, exhibits unique geometric and band structures, an atom-dominated energy spectrum, charge densities distributions, atom and orbital-projected density of states, and strong optical responses. The state-of-the-art analysis, based on an ab-initio simulation, have successfully confirmed the concise physical/chemical picture and the orbital bonding in Li-O and Si-O bonds. Additionally, the unusual optical response behavior includes a large redshift of the onset frequency due to the extremely strong excitonic effect, the polarization of optical properties along three-directions, 22 optical excitations structures and the most prominent plasmon mode in terms of the dielectric functions, energy loss functions, absorption coefficients, and reflectance spectra. The close connections of electronic and optical properties can identify a specific orbital hybridization for each distinct excitation channel. The developed theoretical framework will be very appropriate for fully comprehending the diverse phenomena of cathode/electrolyte/anode materials in ion-based batteries.


title: Hilbert Scheme of a Pair of Skew Lines on Cubic Threefolds

abstract: A pair of disjoint lines on a smooth cubic threefold determines an irreducible component of the Hilbert scheme. We prove that this component is smooth and isomorphic to the blow-up of the symmetric product of Fano varieties of lines on the diagonal. We also study its relation to the geometry of lines and singularities on the hyperplane sections and its relation to Bridgeland moduli spaces.


title: Performance Analysis and Optimization for the MAC Protocol in UAV-based IoT Network

abstract: Unmanned aerial vehicles (UAVs) have played an important role in air-ground integration network. Especially in Internet of Things (IoT) services, UAV equipped with communication equipments is widely adopted as a mobile base station (BS) for data collection from IoT devices on the ground. In this paper, we consider an air-ground network in which the UAV flies straightly to collect information from the IoT devices in a 2-D plane based on the CSMA/CA protocol. Due to UAV's continuous mobility, the communication durations of devices in different locations with UAV are not only time-limited, but also vary from each other. To analyze the throughput performance of uplink multiple access control (MAC) protocol, we propose a new analysis model to deal with the communications heterogeneity in the network. Firstly, we divide the devices in the coverage into different clusters according to their communication durations. Then, a quitting probability indicating the probability that a device quits the UAV's coverage at each time slot is clarified. A modified three-dimensional Markov chain model adopting the quitting probability and cluster division is developed for the performance analysis. Besides, we also propose a modified CSMA/CA protocol which fully considers the heterogeneity of the access time and adaptively allocates the time resource among the devices in different clusters. Finally, the effects of retry limit, initial contention window size, the density of the devices, UAVs speed and coverage area are discussed in the simulation section.


title: Record statistics of bursts signals the onset of acceleration towards failure

abstract: Forecasting the imminent catastrophic failure has a high importance for a large variety of systems from the collapse of engineering constructions, through the emergence of landslides and earthquakes, to volcanic eruptions. Failure forecast methods predict the lifetime of the system based on the time-to-failure power law of observables describing the final acceleration towards failure. We show that the statistics of records of the event series of breaking bursts, accompanying the failure process, provides a powerful tool to detect the onset of acceleration, as an early warning of the impending catastrophe. We focus on the fracture of heterogeneous materials using a fiber bundle model, which exhibits transitions between perfectly brittle, quasi-brittle, and ductile behaviors as the amount of disorder is increased. Analyzing the lifetime of record size bursts, we demonstrate that the acceleration starts at a characteristic record rank, below which record breaking slows down due to the dominance of disorder in fracturing, while above it stress redistribution gives rise to an enhanced triggering of bursts and acceleration of the dynamics. The emergence of this signal depends on the degree of disorder making both highly brittle fracture of low disorder materials, and ductile fracture of strongly disordered ones, unpredictable.


title: One-shot Distributed Algorithm for Generalized Eigenvalue Problem

abstract: Nowadays, more and more datasets are stored in a distributed way for the sake of memory storage or data privacy. The generalized eigenvalue problem (GEP) plays a vital role in a large family of high-dimensional statistical models. However, the existing distributed method for eigenvalue decomposition cannot be applied in GEP for the divergence of the empirical covariance matrix. Here we propose a general distributed GEP framework with one-shot communication for GEP. If the symmetric data covariance has repeated eigenvalues, e.g., in canonical component analysis, we further modify the method for better convergence. The theoretical analysis on approximation error is conducted and the relation to the divergence of the data covariance, the eigenvalues of the empirical data covariance, and the number of local servers is analyzed. Numerical experiments also show the effectiveness of the proposed algorithms.


title: Derivatives of local times for some Gaussian fields II

abstract: Given a $(2,d)$-Gaussian field \[ Z=\big\{ Z(t,s)= X^{H_1}_t -\tilde{X}^{H_2}_s, s,t \ge 0\big\}, \] where $X^{H_1}$ and $\tilde{X}^{H_2}$ are independent $d$-dimensional centered Gaussian processes satisfying certain properties, we will give the necessary condition for existence of derivatives of the local time of $Z$.


title: Malware Traffic Classification: Evaluation of Algorithms and an Automated Ground-truth Generation Pipeline

abstract: Identifying threats in a network traffic flow which is encrypted is uniquely challenging. On one hand it is extremely difficult to simply decrypt the traffic due to modern encryption algorithms. On the other hand, passing such an encrypted stream through pattern matching algorithms is useless because encryption ensures there aren't any. Moreover, evaluating such models is also difficult due to lack of labeled benign and malware datasets. Other approaches have tried to tackle this problem by employing observable meta-data gathered from the flow. We try to augment this approach by extending it to a semi-supervised malware classification pipeline using these observable meta-data. To this end, we explore and test different kind of clustering approaches which make use of unique and diverse set of features extracted from this observable meta-data. We also, propose an automated packet data-labeling pipeline to generate ground-truth data which can serve as a base-line to evaluate the classifiers mentioned above in particular, or any other detection model in general.


title: A path-following inexact Newton method for PDE-constrained optimal control in BV (extended version)

abstract: We study a PDE-constrained optimal control problem that involves functions of bounded variation as controls and includes the TV seminorm of the control in the objective. We apply a path-following inexact Newton method to the problems that arise from smoothing the TV seminorm and adding an $H^1$ regularization. We prove in an infinite-dimensional setting that, first, the solutions of these auxiliary problems converge to the solution of the original problem and, second, that an inexact Newton method enjoys fast local convergence when applied to a reformulation of the optimality system in which the control appears as implicit function of the adjoint state. We show convergence of a Finite Element approximation, provide a globalized preconditioned inexact Newton method as solver for the discretized auxiliary problems, and embed it into an inexact path-following scheme. We construct a two-dimensional test problem with fully explicit solution and present numerical results to illustrate the accuracy and robustness of the approach. This is an extended version of the corresponding journal article appearing in "Computational Optimization and Applications". It contains some proofs that are omitted in the journal's version.


title: Learning Augmented Energy Minimization via Speed Scaling

abstract: As power management has become a primary concern in modern data centers, computing resources are being scaled dynamically to minimize energy consumption. We initiate the study of a variant of the classic online speed scaling problem, in which machine learning predictions about the future can be integrated naturally. Inspired by recent work on learning-augmented online algorithms, we propose an algorithm which incorporates predictions in a black-box manner and outperforms any online algorithm if the accuracy is high, yet maintains provable guarantees if the prediction is very inaccurate. We provide both theoretical and experimental evidence to support our claims.


title: DeepGalaxy: Deducing the Properties of Galaxy Mergers from Images Using Deep Neural Networks

abstract: Galaxy mergers, the dynamical process during which two galaxies collide, are among the most spectacular phenomena in the Universe. During this process, the two colliding galaxies are tidally disrupted, producing significant visual features that evolve as a function of time. These visual features contain valuable clues for deducing the physical properties of the galaxy mergers. In this work, we propose DeepGalaxy, a visual analysis framework trained to predict the physical properties of galaxy mergers based on their morphology. Based on an encoder-decoder architecture, DeepGalaxy encodes the input images to a compressed latent space $z$, and determines the similarity of images according to the latent-space distance. DeepGalaxy consists of a fully convolutional autoencoder (FCAE) which generates activation maps at its 3D latent-space, and a variational autoencoder (VAE) which compresses the activation maps into a 1D vector, and a classifier that generates labels from the activation maps. The backbone of the FCAE can be fully customized according to the complexity of the images. DeepGalaxy demonstrates excellent scaling performance on parallel machines. On the Endeavour supercomputer, the scaling efficiency exceeds 0.93 when trained on 128 workers, and it maintains above 0.73 when trained with 512 workers. Without having to carry out expensive numerical simulations, DeepGalaxy makes inferences of the physical properties of galaxy mergers directly from images, and thereby achieves a speedup factor of $\sim 10^5$.


title: LaSAFT: Latent Source Attentive Frequency Transformation for Conditioned Source Separation

abstract: Recent deep-learning approaches have shown that Frequency Transformation (FT) blocks can significantly improve spectrogram-based single-source separation models by capturing frequency patterns. The goal of this paper is to extend the FT block to fit the multi-source task. We propose the Latent Source Attentive Frequency Transformation (LaSAFT) block to capture source-dependent frequency patterns. We also propose the Gated Point-wise Convolutional Modulation (GPoCM), an extension of Feature-wise Linear Modulation (FiLM), to modulate internal features. By employing these two novel methods, we extend the Conditioned-U-Net (CUNet) for multi-source separation, and the experimental results indicate that our LaSAFT and GPoCM can improve the CUNet's performance, achieving state-of-the-art SDR performance on several MUSDB18 source separation tasks.


title: The Primal-Dual method for Learning Augmented Algorithms

abstract: The extension of classical online algorithms when provided with predictions is a new and active research area. In this paper, we extend the primal-dual method for online algorithms in order to incorporate predictions that advise the online algorithm about the next action to take. We use this framework to obtain novel algorithms for a variety of online covering problems. We compare our algorithms to the cost of the true and predicted offline optimal solutions and show that these algorithms outperform any online algorithm when the prediction is accurate while maintaining good guarantees when the prediction is misleading.


title: Euclidean wormhole in the SYK model

abstract: We study a two-site Sachdev-Ye-Kitaev (SYK) model with complex couplings, and identify a low temperature transition to a gapped phase characterized by a constant in temperature free energy. This transition is observed without introducing a coupling between the two sites, and only appears after ensemble average over the complex couplings. We propose a gravity interpretation of these results by constructing an explicit solution of Jackiw-Teitelboim (JT) gravity with matter: a two-dimensional Euclidean wormhole whose geometry is the double trumpet. This solution is sustained by imaginary sources for a marginal operator, without the need of a coupling between the two boundaries. As the temperature is decreased, there is a transition from a disconnected phase with two black holes to the connected wormhole phase, in qualitative agreement with the SYK observation. The expectation value of the marginal operator is an order parameter for this transition. This illustrates in a concrete setup how a Euclidean wormhole can arise from an average over field theory couplings.


title: Online Time-Varying Topology Identification via Prediction-Correction Algorithms

abstract: Signal processing and machine learning algorithms for data supported over graphs, require the knowledge of the graph topology. Unless this information is given by the physics of the problem (e.g., water supply networks, power grids), the topology has to be learned from data. Topology identification is a challenging task, as the problem is often ill-posed, and becomes even harder when the graph structure is time-varying. In this paper, we address the problem of dynamic topology identification by building on recent results from time-varying optimization, devising a general-purpose online algorithm operating in non-stationary environments. Because of its iteration-constrained nature, the proposed approach exhibits an intrinsic temporal-regularization of the graph topology without explicitly enforcing it. As a case-study, we specialize our method to the Gaussian graphical model (GGM) problem and corroborate its performance.


title: Continual Learning in Low-rank Orthogonal Subspaces

abstract: In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory, parameter regularization or extensible network structures to reduce interference among tasks, but in the end, all the approaches learn different tasks in a joint vector space. We believe this invariably leads to interference among different tasks. We propose to learn tasks in different (low-rank) vector subspaces that are kept orthogonal to each other in order to minimize interference. Further, to keep the gradients of different tasks coming from these subspaces orthogonal to each other, we learn isometric mappings by posing network training as an optimization problem over the Stiefel manifold. To the best of our understanding, we report, for the first time, strong results over experience-replay baseline with and without memory on standard classification benchmarks in continual learning. The code is made publicly available.


title: A bias in VLBI measurements of the core shift effect in AGN jets

abstract: The Blandford and K\"{o}nigl model of AGN jets predicts that the position of the apparent opaque jet base - the core - changes with frequency. This effect is observed with radio interferometry and is widely used to infer parameters and structure of the innermost jet regions. The position of the radio core is typically estimated by fitting a Gaussian template to the interferometric visibilities. This results in a model approximation error, i.e. a bias that can be detected and evaluated through simulations of observations with a realistic jet model. To assess the bias, we construct an artificial sample of sources based on the AGN jet model evaluated on a grid of the parameters derived from a real VLBI flux-density-limited sample and create simulated VLBI data sets at 2.3, 8.1 and 15.4 GHz. We found that the core position shifts from the true jet apex are generally overestimated. The bias is typically comparable to the core shift random error and can reach a factor of two for jets with large apparent opening angles. This observational bias depends mostly on the ratio between the true core shift and the image resolution. This implies that the magnetic field, the core radial distance and the jet speed inferred from the core shift measurements are overestimated. We present a method to account for the bias.


title: Competitive Control with Delayed Imperfect Information

abstract: This paper studies the impact of imperfect information in online control with adversarial disturbances. In particular, we consider both delayed state feedback and inexact predictions of future disturbances. We introduce a greedy, myopic policy that yields a constant competitive ratio against the offline optimal policy. We also analyze the fundamental limits of online control with limited information by showing that our competitive ratio bounds for the greedy, myopic policy in the adversarial setting match (up to lower-order terms) lower bounds in the stochastic setting.


title: "It is just a flu": Assessing the Effect of Watch History on YouTube's Pseudoscientific Video Recommendations

abstract: The role played by YouTube's recommendation algorithm in unwittingly promoting misinformation and conspiracy theories is not entirely understood. Yet, this can have dire real-world consequences, especially when pseudoscientific content is promoted to users at critical times, such as the COVID-19 pandemic. In this paper, we set out to characterize and detect pseudoscientific misinformation on YouTube. We collect 6.6K videos related to COVID-19, the Flat Earth theory, as well as the anti-vaccination and anti-mask movements. Using crowdsourcing, we annotate them as pseudoscience, legitimate science, or irrelevant and train a deep learning classifier to detect pseudoscientific videos with an accuracy of 0.79. We quantify user exposure to this content on various parts of the platform and how this exposure changes based on the user's watch history. We find that YouTube suggests more pseudoscientific content regarding traditional pseudoscientific topics (e.g., flat earth, anti-vaccination) than for emerging ones (like COVID-19). At the same time, these recommendations are more common on the search results page than on a user's homepage or in the recommendation section when actively watching videos. Finally, we shed light on how a user's watch history substantially affects the type of recommended videos.


title: Towards Fully Bilingual Deep Language Modeling

abstract: Language models based on deep neural networks have facilitated great advances in natural language processing and understanding tasks in recent years. While models covering a large number of languages have been introduced, their multilinguality has come at a cost in terms of monolingual performance, and the best-performing models at most tasks not involving cross-lingual transfer remain monolingual. In this paper, we consider the question of whether it is possible to pre-train a bilingual model for two remotely related languages without compromising performance at either language. We collect pre-training data, create a Finnish-English bilingual BERT model and evaluate its performance on datasets used to evaluate the corresponding monolingual models. Our bilingual model performs on par with Google's original English BERT on GLUE and nearly matches the performance of monolingual Finnish BERT on a range of Finnish NLP tasks, clearly outperforming multilingual BERT. We find that when the model vocabulary size is increased, the BERT-Base architecture has sufficient capacity to learn two remotely related languages to a level where it achieves comparable performance with monolingual models, demonstrating the feasibility of training fully bilingual deep language models. The model and all tools involved in its creation are freely available at https://github.com/TurkuNLP/biBERT


title: Pion gravitational form factors in a relativistic theory of composite particles

abstract: We extend our relativistic theory of electroweak properties of composite systems to describe simultaneously the gravitational form factors of hadrons. The approach is based on a version of the instant-form relativistic quantum mechanics and makes use of the modified impulse approximation. We exploit the general method of the relativistic invariant parametrizaton of local operators to write the energy-momentum tensor of a particle with an arbitrary spin. We use the obtained results to calculate the gravitational form factors of the pion assuming point-like constituent quarks. All but one parameters of our first-principle model were fixed previously in works on electromagnetic form factors. The only free parameter, $D_{q}$, is a characteristic of the gravitational form factor of a constituent quark. The derived form factors of the pion satisfy the constraints given by the general principles of the quantum field theory of hadron structure. The calculated gravitational form factors and gravitational mean-square radius are in a reasonable agreement with known results.


title: Object-Attribute Biclustering for Elimination of Missing Genotypes in Ischemic Stroke Genome-Wide Data

abstract: Missing genotypes can affect the efficacy of machine learning approaches to identify the risk genetic variants of common diseases and traits. The problem occurs when genotypic data are collected from different experiments with different DNA microarrays, each being characterised by its pattern of uncalled (missing) genotypes. This can prevent the machine learning classifier from assigning the classes correctly. To tackle this issue, we used well-developed notions of object-attribute biclusters and formal concepts that correspond to dense subrelations in the binary relation $\textit{patients} \times \textit{SNPs}$. The paper contains experimental results on applying a biclustering algorithm to a large real-world dataset collected for studying the genetic bases of ischemic stroke. The algorithm could identify large dense biclusters in the genotypic matrix for further processing, which in return significantly improved the quality of machine learning classifiers. The proposed algorithm was also able to generate biclusters for the whole dataset without size constraints in comparison to the In-Close4 algorithm for generation of formal concepts.


title: The Role of Mutual Information in Variational Classifiers

abstract: Overfitting data is a well-known phenomenon related with the generation of a model that mimics too closely (or exactly) a particular instance of data, and may therefore fail to predict future observations reliably. In practice, this behaviour is controlled by various--sometimes heuristics--regularization techniques, which are motivated by developing upper bounds to the generalization error. In this work, we study the generalization error of classifiers relying on stochastic encodings trained on the cross-entropy loss, which is often used in deep learning for classification problems. We derive bounds to the generalization error showing that there exists a regime where the generalization error is bounded by the mutual information between input features and the corresponding representations in the latent space, which are randomly generated according to the encoding distribution. Our bounds provide an information-theoretic understanding of generalization in the so-called class of variational classifiers, which are regularized by a Kullback-Leibler (KL) divergence term. These results give theoretical grounds for the highly popular KL term in variational inference methods that was already recognized to act effectively as a regularization penalty. We further observe connections with well studied notions such as Variational Autoencoders, Information Dropout, Information Bottleneck and Boltzmann Machines. Finally, we perform numerical experiments on MNIST and CIFAR datasets and show that mutual information is indeed highly representative of the behaviour of the generalization error.


title: Classical restrictions of generic matrix product states are quasi-locally Gibbsian

abstract: We show that the norm squared amplitudes with respect to a local orthonormal basis (the classical restriction) of finite quantum systems on one-dimensional lattices can be exponentially well approximated by Gibbs states of local Hamiltonians (i.e., are quasi-locally Gibbsian) if the classical conditional mutual information (CMI) of any connected tripartition of the lattice is rapidly decaying in the width of the middle region. For injective matrix product states, we moreover show that the classical CMI decays exponentially, whenever the collection of matrix product operators satisfies a 'purity condition'; a notion previously established in the theory of random matrix products. We furthermore show that violations of the purity condition enables a generalized notion of error correction on the virtual space, thus indicating the non-generic nature of such violations. We make this intuition more concrete by constructing a probabilistic model where purity is a typical property. The proof of our main result makes extensive use of the theory of random matrix products, and may find applications elsewhere.


title: Theory-based residual neural networks: A synergy of discrete choice models and deep neural networks

abstract: Researchers often treat data-driven and theory-driven models as two disparate or even conflicting methods in travel behavior analysis. However, the two methods are highly complementary because data-driven methods are more predictive but less interpretable and robust, while theory-driven methods are more interpretable and robust but less predictive. Using their complementary nature, this study designs a theory-based residual neural network (TB-ResNet) framework, which synergizes discrete choice models (DCMs) and deep neural networks (DNNs) based on their shared utility interpretation. The TB-ResNet framework is simple, as it uses a ($\delta$, 1-$\delta$) weighting to take advantage of DCMs' simplicity and DNNs' richness, and to prevent underfitting from the DCMs and overfitting from the DNNs. This framework is also flexible: three instances of TB-ResNets are designed based on multinomial logit model (MNL-ResNets), prospect theory (PT-ResNets), and hyperbolic discounting (HD-ResNets), which are tested on three data sets. Compared to pure DCMs, the TB-ResNets provide greater prediction accuracy and reveal a richer set of behavioral mechanisms owing to the utility function augmented by the DNN component in the TB-ResNets. Compared to pure DNNs, the TB-ResNets can modestly improve prediction and significantly improve interpretation and robustness, because the DCM component in the TB-ResNets stabilizes the utility functions and input gradients. Overall, this study demonstrates that it is both feasible and desirable to synergize DCMs and DNNs by combining their utility specifications under a TB-ResNet framework. Although some limitations remain, this TB-ResNet framework is an important first step to create mutual benefits between DCMs and DNNs for travel behavior modeling, with joint improvement in prediction, interpretation, and robustness.


title: Enabling certification of verification-agnostic networks via memory-efficient semidefinite programming

abstract: Convex relaxations have emerged as a promising approach for verifying desirable properties of neural networks like robustness to adversarial perturbations. Widely used Linear Programming (LP) relaxations only work well when networks are trained to facilitate verification. This precludes applications that involve verification-agnostic networks, i.e., networks not specially trained for verification. On the other hand, semidefinite programming (SDP) relaxations have successfully be applied to verification-agnostic networks, but do not currently scale beyond small networks due to poor time and space asymptotics. In this work, we propose a first-order dual SDP algorithm that (1) requires memory only linear in the total number of network activations, (2) only requires a fixed number of forward/backward passes through the network per iteration. By exploiting iterative eigenvector methods, we express all solver operations in terms of forward and backward passes through the network, enabling efficient use of hardware like GPUs/TPUs. For two verification-agnostic networks on MNIST and CIFAR-10, we significantly improve L-inf verified robust accuracy from 1% to 88% and 6% to 40% respectively. We also demonstrate tight verification of a quadratic stability specification for the decoder of a variational autoencoder.


title: Towards Low-Resource StarGAN Voice Conversion using Weight Adaptive Instance Normalization

abstract: Many-to-many voice conversion with non-parallel training data has seen significant progress in recent years. StarGAN-based models have been interests of voice conversion. However, most of the StarGAN-based methods only focused on voice conversion experiments for the situations where the number of speakers was small, and the amount of training data was large. In this work, we aim at improving the data efficiency of the model and achieving a many-to-many non-parallel StarGAN-based voice conversion for a relatively large number of speakers with limited training samples. In order to improve data efficiency, the proposed model uses a speaker encoder for extracting speaker embeddings and conducts adaptive instance normalization (AdaIN) on convolutional weights. Experiments are conducted with 109 speakers under two low-resource situations, where the number of training samples is 20 and 5 per speaker. An objective evaluation shows the proposed model is better than the baseline methods. Furthermore, a subjective evaluation shows that, for both naturalness and similarity, the proposed model outperforms the baseline method.


title: A Quaternion-Valued Variational Autoencoder

abstract: Deep probabilistic generative models have achieved incredible success in many fields of application. Among such models, variational autoencoders (VAEs) have proved their ability in modeling a generative process by learning a latent representation of the input. In this paper, we propose a novel VAE defined in the quaternion domain, which exploits the properties of quaternion algebra to improve performance while significantly reducing the number of parameters required by the network. The success of the proposed quaternion VAE with respect to traditional VAEs relies on the ability to leverage the internal relations between quaternion-valued input features and on the properties of second-order statistics which allow to define the latent variables in the augmented quaternion domain. In order to show the advantages due to such properties, we define a plain convolutional VAE in the quaternion domain and we evaluate its performance with respect to its real-valued counterpart on the CelebA face dataset.


title: Distributed-Order Non-Local Optimal Control

abstract: Distributed-order fractional non-local operators have been introduced and studied by Caputo at the end of the 20th century. They generalize fractional order derivatives/integrals in the sense that such operators are defined by a weighted integral of different orders of differentiation over a certain range. The subject of distributed-order non-local derivatives is currently under strong development due to its applications in modeling some complex real world phenomena. Fractional optimal control theory deals with the optimization of a performance index functional subject to a fractional control system. One of the most important results in classical and fractional optimal control is the Pontryagin Maximum Principle, which gives a necessary optimality condition that every solution to the optimization problem must verify. In our work, we extend the fractional optimal control theory by considering dynamical systems constraints depending on distributed-order fractional derivatives. Precisely, we prove a weak version of Pontryagin's maximum principle and a sufficient optimality condition under appropriate convexity assumptions.


title: Learning to Sort Image Sequences via Accumulated Temporal Differences

abstract: Consider a set of n images of a scene with dynamic objects captured with a static or a handheld camera. Let the temporal order in which these images are captured be unknown. There can be n! possibilities for the temporal order in which these images could have been captured. In this work, we tackle the problem of temporally sequencing the unordered set of images of a dynamic scene captured with a hand-held camera. We propose a convolutional block which captures the spatial information through 2D convolution kernel and captures the temporal information by utilizing the differences present among the feature maps extracted from the input images. We evaluate the performance of the proposed approach on the dataset extracted from a standard action recognition dataset, UCF101. We show that the proposed approach outperforms the state-of-the-art methods by a significant margin. We show that the network generalizes well by evaluating it on a dataset extracted from the DAVIS dataset, a dataset meant for video object segmentation, when the same network was trained with a dataset extracted from UCF101, a dataset meant for action recognition.


title: On Dark Matter Explanations of the Gamma-Ray Excesses from the Galactic Center and M31

abstract: The presence of an excess gamma-ray signal toward the Galactic center (GC) has now been well established, and is known as the GC excess. Leading explanations for the signal include mis-modeling of the Galactic diffuse emission along the line of sight, an unresolved population of millisecond pulsars, and/or the annihilation of dark matter (DM). Recently, evidence for another excess gamma-ray signal has been reported toward the outer halo of M31. In this work we interpret the excess signals from both the GC and outer halo of M31 in the framework of DM annihilation, and show that the two spectra are consistent with a DM origin once J-factors are taken into account. We further compare the excesses to models of DM annihilation, and determine the corresponding best-fit parameters. We find good fits to the spectrum both in two body and four body annihilation modes.


title: Methanimine as a key precursor of imines in the interstellar medium: the case of propargylimine

abstract: A gas-phase formation route is proposed for the recently detected propargylimine molecule. In analogy to other imines, such as cyanomethanimine, the addition of a reactive radical (C$_2$H in the present case) to methanimine (CH$_2$NH}) leads to reaction channels open also in the harsh conditions of the interstellar medium. Three possible isomers can be formed in the C$H_2$NH + C$_2$H reaction: Z- and E-propargylimine (Z-,E-PGIM) as well as N-ethynyl-methanimine (N-EMIM). For both PGIM species, the computed global rate coefficient is nearly constant in the 20-300 K temperature range, and of the order of 2-3 $\times$ 10$^{-10}$ cm$^3$ molecule$^{-1}$ s$^{-1}$, while that for N-EMIM is about two orders of magnitude smaller. Assuming equal destruction rates for the two isomers, these results imply an abundance ratio for PGIM of [Z]/[E] $\sim$ 1.5, which is only slightly underestimated with respect to the observational datum.


title: CoinDICE: Off-Policy Confidence Interval Estimation

abstract: We study high-confidence behavior-agnostic off-policy evaluation in reinforcement learning, where the goal is to estimate a confidence interval on a target policy's value, given only access to a static experience dataset collected by unknown behavior policies. Starting from a function space embedding of the linear program formulation of the $Q$-function, we obtain an optimization problem with generalized estimating equation constraints. By applying the generalized empirical likelihood method to the resulting Lagrangian, we propose CoinDICE, a novel and efficient algorithm for computing confidence intervals. Theoretically, we prove the obtained confidence intervals are valid, in both asymptotic and finite-sample regimes. Empirically, we show in a variety of benchmarks that the confidence interval estimates are tighter and more accurate than existing methods.


title: Graph Neural Network for Large-Scale Network Localization

abstract: Graph neural networks (GNNs) are popular to use for classifying structured data in the context of machine learning. But surprisingly, they are rarely applied to regression problems. In this work, we adopt GNN for a classic but challenging nonlinear regression problem, namely the network localization. Our main findings are in order. First, GNN is potentially the best solution to large-scale network localization in terms of accuracy, robustness and computational time. Second, proper thresholding of the communication range is essential to its superior performance. Simulation results corroborate that the proposed GNN based method outperforms all state-of-the-art benchmarks by far. Such inspiring results are theoretically justified in terms of data aggregation, non-line-of-sight (NLOS) noise removal and low-pass filtering effect, all affected by the threshold for neighbor selection. Code is available at https://github.com/Yanzongzi/GNN-For-localization.


title: Time-restricted sensitivity and entropy

abstract: In this paper, we consider measure-theoretical restricted sensitivity and topological restricted sensitivities by restricting the first sensitive time. For a given topological dynamical system, we define measure-theoretical restricted asymptotic rate with respect to sensitivity, and obtain that it equal to the reciprocal of the Brin-Katok local entropy for almost every point. For topological version we have similar definitions and conclusions.


title: Deep Reinforcement Learning with Stacked Hierarchical Attention for Text-based Games

abstract: We study reinforcement learning (RL) for text-based games, which are interactive simulations in the context of natural language. While different methods have been developed to represent the environment information and language actions, existing RL agents are not empowered with any reasoning capabilities to deal with textual games. In this work, we aim to conduct explicit reasoning with knowledge graphs for decision making, so that the actions of an agent are generated and supported by an interpretable inference procedure. We propose a stacked hierarchical attention mechanism to construct an explicit representation of the reasoning process by exploiting the structure of the knowledge graph. We extensively evaluate our method on a number of man-made benchmark games, and the experimental results demonstrate that our method performs better than existing text-based agents.


title: Modified Grover operator for amplitude estimation

abstract: In this paper, we propose a quantum amplitude estimation method that uses a modified Grover operator and quadratically improves the estimation accuracy in the ideal case, as in the conventional one using the standard Grover operator. Under the depolarizing noise, the proposed method can outperform the conventional one in the sense that it can in principle achieve the ultimate estimation accuracy characterized by the quantum Fisher information in the limit of a large number of qubits, while the conventional one cannot achieve the same value of ultimate accuracy. In general this superiority requires a sophisticated adaptive measurement, but we numerically demonstrate that the proposed method can outperform the conventional one and approach to the ultimate accuracy, even with a simple non-adaptive measurement strategy.


title: The HUAWEI Speaker Diarisation System for the VoxCeleb Speaker Diarisation Challenge

abstract: This paper describes system setup of our submission to speaker diarisation track (Track 4) of VoxCeleb Speaker Recognition Challenge 2020. Our diarisation system consists of a well-trained neural network based speech enhancement model as pre-processing front-end of input speech signals. We replace conventional energy-based voice activity detection (VAD) with a neural network based VAD. The neural network based VAD provides more accurate annotation of speech segments containing only background music, noise, and other interference, which is crucial to diarisation performance. We apply agglomerative hierarchical clustering (AHC) of x-vectors and variational Bayesian hidden Markov model (VB-HMM) based iterative clustering for speaker clustering. Experimental results demonstrate that our proposed system achieves substantial improvements over the baseline system, yielding diarisation error rate (DER) of 10.45%, and Jacard error rate (JER) of 22.46% on the evaluation set.


title: On the Compressed-Oracle Technique, and Post-Quantum Security of Proofs of Sequential Work

abstract: We revisit the so-called compressed oracle technique, introduced by Zhandry for analyzing quantum algorithms in the quantum random oracle model (QROM). To start off with, we offer a concise exposition of the technique, which easily extends to the parallel-query QROM, where in each query-round the considered algorithm may make several queries to the QROM in parallel. This variant of the QROM allows for a more fine-grained query-complexity analysis. Our main technical contribution is a framework that simplifies the use of (the parallel-query generalization of) the compressed oracle technique for proving query complexity results. With our framework in place, whenever applicable, it is possible to prove quantum query complexity lower bounds by means of purely classical reasoning. More than that, for typical examples the crucial classical observations that give rise to the classical bounds are sufficient to conclude the corresponding quantum bounds. We demonstrate this on a few examples, recovering known results (like the optimality of parallel Grover), but also obtaining new results (like the optimality of parallel BHT collision search). Our main target is the hardness of finding a $q$-chain with fewer than $q$ parallel queries, i.e., a sequence $x_0, x_1,\ldots, x_q$ with $x_i = H(x_{i-1})$ for all $1 \leq i \leq q$. The above problem of finding a hash chain is of fundamental importance in the context of proofs of sequential work. Indeed, as a concrete cryptographic application of our techniques, we prove that the "Simple Proofs of Sequential Work" proposed by Cohen and Pietrzak remains secure against quantum attacks. Such an analysis is not simply a matter of plugging in our new bound; the entire protocol needs to be analyzed in the light of a quantum attack. Thanks to our framework, this can now be done with purely classical reasoning.


title: Neural Network-based Acoustic Vehicle Counting

abstract: This paper addresses acoustic vehicle counting using one-channel audio. We predict the pass-by instants of vehicles from local minima of clipped vehicle-to-microphone distance. This distance is predicted from audio using a two-stage (coarse-fine) regression, with both stages realised via neural networks (NNs). Experiments show that the NN-based distance regression outperforms by far the previously proposed support vector regression. The $ 95\% $ confidence interval for the mean of vehicle counting error is within $[0.28\%, -0.55\%]$. Besides the minima-based counting, we propose a deep learning counting that operates on the predicted distance without detecting local minima. Although outperformed in accuracy by the former approach, deep counting has a significant advantage in that it does not depend on minima detection parameters. Results also show that removing low frequencies in features improves the counting performance.


title: Detecting Rewards Deterioration in Episodic Reinforcement Learning

abstract: In many RL applications, once training ends, it is vital to detect any deterioration in the agent performance as soon as possible. Furthermore, it often has to be done without modifying the policy and under minimal assumptions regarding the environment. In this paper, we address this problem by focusing directly on the rewards and testing for degradation. We consider an episodic framework, where the rewards within each episode are not independent, nor identically-distributed, nor Markov. We present this problem as a multivariate mean-shift detection problem with possibly partial observations. We define the mean-shift in a way corresponding to deterioration of a temporal signal (such as the rewards), and derive a test for this problem with optimal statistical power. Empirically, on deteriorated rewards in control problems (generated using various environment modifications), the test is demonstrated to be more powerful than standard tests - often by orders of magnitude. We also suggest a novel Bootstrap mechanism for False Alarm Rate control (BFAR), applicable to episodic (non-i.i.d) signal and allowing our test to run sequentially in an online manner. Our method does not rely on a learned model of the environment, is entirely external to the agent, and in fact can be applied to detect changes or drifts in any episodic signal.