title: A novel method to test particle ordering and final state alignment in helicity formalism

abstract: In this article, the importance is demonstrated of a proper choice of reference particles for decay angle definitions, when constructing partial-wave amplitude of multi-body decays using helicity formalism. This issue is often ignored in the standard use case of the helicity formalism. A new technique is proposed to determine the correct particle ordering, and can also be used as a generalized method to calculate the rotation operators used for the final-state alignment between different decay chains. Numerical validations are also performed to support the arguments and new technique proposed in this article.


title: Bayesian model for early dose-finding in phase I trials with multiple treatment courses

abstract: Dose-finding clinical trials in oncology aim to determine the maximum tolerated dose (MTD) of a new drug, generally defined by the proportion of patients with short-term dose-limiting toxicities (DLTs). Model-based approaches for such phase I oncology trials have been widely designed and are mostly restricted to the DLTs occurring during the first cycle of treatment, although patients continue to receive treatment for multiple cycles. We aim to estimate the probability of DLTs over sequences of treatment cycles via a Bayesian cumulative modeling approach, where the probability of DLT is modeled taking into account the cumulative effect of the administered drug and the DLT cycle of occurrence. We propose a design, called DICE (Dose-fInding CumulativE), for dose escalation and de-escalation according to previously observed toxicities, which aims at finding the MTD sequence (MTS). We performed an extensive simulation study comparing this approach to the time-to-event continual reassessment method (TITE-CRM) and to a benchmark. In general, our approach achieved a better or comparable percentage of correct MTS selection. Moreover, we investigated the DICE prediction ability.


title: Group cocycles on the volume-preserving diffeomorphism group

abstract: We construct two kinds of group cocycles on the volume-preserving diffeomorphism group. We show that, for the volume-preserving diffeomorphism group of the sphere, one of the cocycles gives the Euler class of flat sphere bundles.


title: Semi-empirical models of spicule from inversion of Ca II 8542 \AA\ line

abstract: We study a solar spicule observed off-limb using high-resolution imaging spectroscopy in the Ca II 8542 \AA\ line obtained with the CRisp Imaging SpectroPolarimeter (CRISP) on the Swedish 1-m Solar Telescope. Using a new version of the non-LTE code NICOLE specifically developed for this problem we invert the spicule single- and double-peak line profiles. This new version considers off-limb geometry and computes atomic populations by solving the 1D radiative transfer assuming a vertical stratification. The inversion proceeds by fitting the observed spectral profiles at 14 different heights with synthetic profiles computed in the model by solving the radiative transfer problem along its length. Motivated by the appearance of double-peak Ca II 8542 \AA\ spicule profiles, which exhibit two distinct emission features well separated in wavelength, we adopt a double-component scenario. We start from the ansatz that the spicule parameters are practically constant along the spicule axis for each component, except for a density drop. Our results support this ansatz by attaining very good fits to the entire set of 14$\times$4 profiles (14 heights and 4 times). We show that the double-component model with uniform temperature of 9560 K, exponential decrease of density with a height scale of $1000-2000$ km, and the counter-oriented line-of-sight velocities of components reproduce the double-peak line profiles at all spicule segments well. Analyses of the numerical response function reveals the necessity of the inversions of spectra at multiple height positions to obtain height-dependent, degeneracy-free reliable model with a limited number of free parameters.


title: Chemistry at graphene edges in the electron microscope

abstract: Transmission electron microscopy (TEM) and scanning TEM (STEM) are indispensable tools for materials characterization. However, during a typical (S)TEM experiment, the sample is subject to a number of effects that can change its atomic structure. Of these, perhaps the least discussed are chemical modifications due to the non-ideal vacuum around the sample. With single-layer graphene, we show that even at relatively low pressures typical for many instruments, these processes can have a significant impact on the sample structure. For example, pore growth becomes up to two orders of magnitude faster at a pressure of ca. 10^{-6} mbar as compared to ultra-high vacuum (UHV; 10^{-10} mbar). Even more remarkably,the presence of oxygen at the sample also changes the observed atomic structure: When imaged in UHV, nearly 90% of the identifiable graphene edge configurations have the armchair structure, whereas armchair and zigzag structures are nearly equally likely to occur when the oxygen partial pressure in the column is higher. Our results both bring attention to the role of the often neglected vacuum composition of the microscope column, and show that control over it can allow atomic-scale tailoring of the specimen structure.


title: Conversational Browsing

abstract: How can we better understand the mechanisms behind multi-turn information seeking dialogues? How can we use these insights to design a dialogue system that does not require explicit query formulation upfront as in question answering? To answer these questions, we collected observations of human participants performing a similar task to obtain inspiration for the system design. Then, we studied the structure of conversations that occurred in these settings and used the resulting insights to develop a grounded theory, design and evaluate a first system prototype. Evaluation results show that our approach is effective and can complement query-based information retrieval approaches. We contribute new insights about information-seeking behavior by analyzing and providing automated support for a type of information-seeking strategy that is effective when the clarity of the information need and familiarity with the collection content are low.


title: On Primordial Black Holes from Rapid Turns in Two-field Models

abstract: We study rapid-turn trajectories in a class of two-field cosmological models, whose scalar manifold is the Poincar\'e disk. Background solutions in multi-field inflation, with field-space trajectories exhibiting sharp turns, can seed primordial black hole (PBH) formation. We investigate a class of exact solutions with hidden symmetry and show that they exhibit the kind of transient rapid-turn period, needed to induce PBH generation. Furthermore, we relax the symmetry condition and find, in a certain regime, modified solutions with improved behavior of the Hubble $\eta$-parameter, which preserve the desired shape of the turning rate function. Interestingly, the modified solutions describe a brief ultra-slow roll phase, followed by long-term slow roll inflation. It is notable that slow roll occurs near the center (not near the boundary) of the Poincar\'e disk, unlike in the standard $\alpha$-attractor case.


title: Pricing Security in Proof-of-Work Systems

abstract: A key component of security in decentralized blockchains is proof of opportunity cost among block producers. In the case of proof-of-work (PoW), currently used by the most prominent systems, the cost is due to spent computation. In this paper, we characterize the security investment of miners in terms of its cost in fiat money. This enables comparison of security allocations across PoW blockchains that generally use different PoW algorithms and reward miners in different cryptocurrency units. We prove that there exists a unique allocation equilibrium, depending on market prices only, that is achieved by both strategic miners (who contemplate the actions of others) and by miners seeking only short-term profit. In fact, the latter will unknowingly compensate for any attempt to deliberately shift security allocation away from equilibrium. Our conclusions are supported analytically through the development of a Markov decision process, game theoretical analysis, and derivation of no arbitrage conditions. We corroborate those results with empirical evidence from more than two years of blockchain and price data. Overall agreement is strong. We show that between January 1, 2018 and August 1, 2020, market prices predicted security allocation between Bitcoin and Bitcoin Cash with error less than 0.6%. And from the beginning of October 2019, until August 1, 2020, market prices predicted security allocation between Bitcoin and Litecoin with error of 0.45%. These results are further corroborated by our establishment of Granger-causality between change in market prices and change in security allocation. To demonstrate the practicality of our results, we describe a trustless oracle that leverages the equilibrium to estimate the price ratios of PoW cryptocurrencies from on-chain information only.


title: Learning from Experience for Rapid Generation of Local Car Maneuvers

abstract: Being able to rapidly respond to the changing scenes and traffic situations by generating feasible local paths is of pivotal importance for car autonomy. We propose to train a deep neural network (DNN) to plan feasible and nearly-optimal paths for kinematically constrained vehicles in small constant time. Our DNN model is trained using a novel weakly supervised approach and a gradient-based policy search. On real and simulated scenes and a large set of local planning problems, we demonstrate that our approach outperforms the existing planners with respect to the number of successfully completed tasks. While the path generation time is about 40 ms, the generated paths are smooth and comparable to those obtained from conventional path planners.


title: Distortion element in group of diffeomorphisms of the 2-sphere

abstract: We prove that every distortion element in the group of diffeomorphisms of the 2-sphere which has some recurrent point that is not fixed is an irrational pseudo-rotation. Moreover we prove that the differential of a distortion element in the group of diffeomorphisms of the 2-sphere having at least three fixed points at a fixed point has a unique eigenvalue which is 1.


title: Reference Knowledgeable Network for Machine Reading Comprehension

abstract: Multi-choice Machine Reading Comprehension (MRC) as a challenge requires models to select the most appropriate answer from a set of candidates with a given passage and question. Most of the existing researches focus on the modeling of specific tasks or complex networks, without explicitly referring to relevant and credible external knowledge sources, which are supposed to greatly make up for the deficiency of the given passage. Thus we propose a novel reference-based knowledge enhancement model called Reference Knowledgeable Network (RekNet), which simulates human reading strategies to refine critical information from the passage and quote explicit knowledge in necessity. In detail, RekNet refines finegrained critical information and defines it as Reference Span, then quotes explicit knowledge quadruples by the co-occurrence information of Reference Span and candidates. The proposed RekNet is evaluated on three multi-choice MRC benchmarks: RACE, DREAM and Cosmos QA, obtaining consistent and remarkable performance improvement with observable statistical significance level over strong baselines. Our code is available at https://github.com/Yilin1111/RekNet.


title: The gravitational Higgs mechanism and resulting smoking gun effects

abstract: Recently, a toy model was introduced to demonstrate that screening mechanisms in alternative theories of gravitation can hide additional effects. In this model a scalar field is charged under a $U(1)$ symmetry. In sufficiently compact objects the scalar field spontaneously grows, i.e. the object scalarizes, spontaneously breaking the $U(1)$ symmetry. Exactly as in the $U(1)$ Higgs mechanism this leads to the emergence of a mass for the gauge field. The aim of this paper is to provide an example of the physical consequences if we consider this toy model as a prototype of Weak Equivalence Principle (WEP) violations. We model neutron stars with a dipolar magnetic field to compare the magnetic field behaviour of stars in Einstein-Maxwell theory on the one hand and in scalar-tensor theory with the, so-called, gravitational Higgs mechanism on the other hand.


title: Combining Deep Transfer Learning with Signal-image Encoding for Multi-Modal Mental Wellbeing Classification

abstract: The quantification of emotional states is an important step to understanding wellbeing. Time series data from multiple modalities such as physiological and motion sensor data have proven to be integral for measuring and quantifying emotions. Monitoring emotional trajectories over long periods of time inherits some critical limitations in relation to the size of the training data. This shortcoming may hinder the development of reliable and accurate machine learning models. To address this problem, this paper proposes a framework to tackle the limitation in performing emotional state recognition on multiple multimodal datasets: 1) encoding multivariate time series data into coloured images; 2) leveraging pre-trained object recognition models to apply a Transfer Learning (TL) approach using the images from step 1; 3) utilising a 1D Convolutional Neural Network (CNN) to perform emotion classification from physiological data; 4) concatenating the pre-trained TL model with the 1D CNN. Furthermore, the possibility of performing TL to infer stress from physiological data is explored by initially training a 1D CNN using a large physical activity dataset and then applying the learned knowledge to the target dataset. We demonstrate that model performance when inferring real-world wellbeing rated on a 5-point Likert scale can be enhanced using our framework, resulting in up to 98.5% accuracy, outperforming a conventional CNN by 4.5%. Subject-independent models using the same approach resulted in an average of 72.3% accuracy (SD 0.038). The proposed CNN-TL-based methodology may overcome problems with small training datasets, thus improving on the performance of conventional deep learning methods.


title: Representing Molecular Ground and Excited Vibrational Eigenstates with Nuclear Densities obtained from Semiclassical Initial Value Representation Molecular Dynamics

abstract: We present in detail and validate an effective Monte Carlo approach for the calculation of the nuclear vibrational densities via integration of molecular eigenfunctions that we have preliminary employed to calculate the densities of the ground and the excited OH stretch vibrational states in protonated glycine molecule [C. Aieta et. al. Nat. Commun. 11, 4348 (2020)]. Here, we first validate and discuss in detail the features of the method on a benchmark water molecule. Then, we apply it to calculate on-the-fly the ab initio anharmonic nuclear densities in correspondence of the fundamental transitions of NH and CH stretches in protonated glycine. We show how we can gain both qualitative and quantitative physical insight by inspection of different one-nucleus densities and assign a character to spectroscopic absorption peaks using the expansion of vibrational states in terms of harmonic basis functions. The visualization of the nuclear vibrations in a purely quantum picture allows us to observe and quantify the effects of anharmonicity on the molecular structure, and to exploit the effect of IR excitations on specific bonds or functional groups, beyond the harmonic approximation. We also calculate the quantum probability distribution of bond-lengths, angles and dihedrals of the molecule. Notably, we observe how in the case of one type of fundamental NH stretching the typical harmonic nodal pattern is absent in the anharmonic distribution.


title: Exothermic dark mesons in light of electron recoil excess at XENON1T

abstract: We consider a novel mechanism to realize exothermic dark matter with dark mesons in the limit of approximate flavor symmetry in a dark QCD. We introduce a local dark $U(1)'$ symmetry to communicate between dark mesons and the Standard Model via $Z'$ portal by partially gauging the dark flavor symmetry with flavor-dependent charges for cancelling chiral anomalies in the dark sector. After the dark local $U(1)'$ is broken spontaneously by the VEV of a dark Higgs, there appear small mass splittings between dark quarks, consequently, leading to small split masses for dark mesons, required to explain the electron recoil excess in XENON1T by the inelastic scattering between dark mesons and electron. We propose a concrete benchmark model for split dark mesons based on $SU(3)_L\times SU(3)_R/ SU(3)_V$ flavor symmetry and $SU(N_c)$ color group and show that there exists a parameter space making a better fit to the XENON1T data with two correlated peaks from exothermic processes and satisfying the correct relic density, current experimental and theoretical constraints.


title: Quantized dynamics in closed quantum systems

abstract: We propose an approach to process data from interferometric measurements on a closed quantum system at random times. For this purpose a time correlation matrix is introduced which enables us to extract dynamical properties of the quantum system. After defining a generalized expectation value we obtain a distribution of time scales, an average transition time and a correlation time. A classical limit exists which is separated from the quantum fluctuations. The latter are characterized by resonances associated with poles of the generalized expectation value. Its analytic behavior is studied and some generic properties are linked to a quantized Berry phase.


title: Autoencoding Variational Autoencoder

abstract: Does a Variational AutoEncoder (VAE) consistently encode typical samples generated from its decoder? This paper shows that the perhaps surprising answer to this question is `No'; a (nominally trained) VAE does not necessarily amortize inference for typical samples that it is capable of generating. We study the implications of this behaviour on the learned representations and also the consequences of fixing it by introducing a notion of self consistency. Our approach hinges on an alternative construction of the variational approximation distribution to the true posterior of an extended VAE model with a Markov chain alternating between the encoder and the decoder. The method can be used to train a VAE model from scratch or given an already trained VAE, it can be run as a post processing step in an entirely self supervised way without access to the original training data. Our experimental analysis reveals that encoders trained with our self-consistency approach lead to representations that are robust (insensitive) to perturbations in the input introduced by adversarial attacks. We provide experimental results on the ColorMnist and CelebA benchmark datasets that quantify the properties of the learned representations and compare the approach with a baseline that is specifically trained for the desired property.


title: How Successful Are Open Source Contributions From Countries with Different Levels of Human Development?

abstract: Are Brazilian developers less likely to have a contribution accepted than their peers from, say, the United Kingdom? In this paper we studied whether the developers' location relates to the outcome of a pull request. We curated the locations of 14k contributors who performed 44k pull requests to 20 open source projects. Our results indeed suggest that developers from countries with low human development indexes (HDI) not only perform a small fraction of the overall pull requests, but they also are the ones that face rejection the most.


title: Top Fourier coefficients of residual Eisenstein series on symplectic or metaplectic groups induced from Speh representations

abstract: We consider the residues at the poles in the right half plane of Eisenstein series, on symplectic groups, or their double covers, induced from Speh representations. We show that for each such pole, there is a unique maximal nilpotent orbit, attached to Fourier coefficients admitted by the corresponding residual representation. We find this orbit in each case.


title: The simple separating systole for hyperbolic surfaces of large genus

abstract: In this note we show that the expected value of the separating systole of a random surface of genus $g$ with respect to Weil-Petersson volume behaves like $2\log g $ as the genus goes to infinity. This is in strong contrast to the behavior of the expected value of the systole which, by results of Mirzakhani and Petri, is independent of genus.


title: Dimmer: Self-Adaptive Network-Wide Flooding with Reinforcement Learning

abstract: The last decade saw an emergence of Synchronous Transmissions (ST) as an effective communication paradigm in low-power wireless networks. Numerous ST protocols provide high reliability and energy efficiency in normal wireless conditions, for a large variety of traffic requirements. Recently, with the EWSN dependability competitions, the community pushed ST to harsher and highly-interfered environments, improving upon classical ST protocols through the use of custom rules, hand-tailored parameters, and additional retransmissions. The results are sophisticated protocols, that require prior expert knowledge and extensive testing, often tuned for a specific deployment and envisioned scenario. In this paper, we explore how ST protocols can benefit from self-adaptivity; a self-adaptive ST protocol selects itself its best parameters to (1) tackle external environment dynamics and (2) adapt to its topology over time. We introduce Dimmer as a self-adaptive ST protocol. Dimmer builds on LWB and uses Reinforcement Learning to tune its parameters and match the current properties of the wireless medium. By learning how to behave from an unlabeled dataset, Dimmer adapts to different interference types and patterns, and is able to tackle previously unseen interference. With Dimmer, we explore how to efficiently design AI-based systems for constrained devices, and outline the benefits and downfalls of AI-based low-power networking. We evaluate our protocol on two deployments of resource-constrained nodes achieving 95.8% reliability against strong, unknown WiFi interference. Our results outperform baselines such as non-adaptive ST protocols (27%) and PID controllers, and show a performance close to hand-crafted and more sophisticated solutions, such as Crystal (99%).


title: A Keller-Segel model for C elegans L1 aggregation

abstract: We describe a mathematical model for the aggregation of starved first-stage C elegans larvae (L1s). We propose that starved L1s produce and respond chemotactically to two labile diffusible chemical signals, a short-range attractant and a longer range repellent. This model takes the mathematical form of three coupled partial differential equations, one that describes the movement of the worms and one for each of the chemical signals. Numerical solution of these equations produced a pattern of aggregates that resembled that of worm aggregates observed in experiments. We also describe the identification of a sensory receptor gene, srh-2, whose expression is induced under conditions that promote L1 aggregation. Worms whose srh-2 gene has been knocked out form irregularly shaped aggregates. Our model suggests this phenotype may be explained by the mutant worms slowing their movement more quickly than the wild type.


title: Similarity measure for aggregated fuzzy numbers from interval-valued data

abstract: This paper presents a method to compute the degree of similarity between two aggregated fuzzy numbers from intervals using the Interval Agreement Approach (IAA). The similarity measure proposed within this study contains several features and attributes, of which are novel to aggregated fuzzy numbers. The attributes completely redefined or modified within this study include area, perimeter, centroids, quartiles and the agreement ratio. The recommended weighting for each feature has been learned using Principal Component Analysis (PCA). Furthermore, an illustrative example is provided to detail the application and potential future use of the similarity measure.


title: Sintering dilatometry based grain growth assessment

abstract: Volume shrinkage, grain growth, and their interaction are major events occurring during free sintering of ceramics. A high temperature sintering dilatometry curve is influenced by these both phenomena. It is shown that the continuum theory of sintering can be utilized in the format enabling the extraction of the maximum amount of information on the densification and grain growth kinetics based on a simple dilatometry test. We present here the capability of such a fast approach (Dilatometry based Grain growth Assessment DGA) utilized for the modeling of sintering and grain growth of zirconia.


title: Towards explainable message passing networks for predicting carbon dioxide adsorption in metal-organic frameworks

abstract: Metal-organic framework (MOFs) are nanoporous materials that could be used to capture carbon dioxide from the exhaust gas of fossil fuel power plants to mitigate climate change. In this work, we design and train a message passing neural network (MPNN) to predict simulated CO$_2$ adsorption in MOFs. Towards providing insights into what substructures of the MOFs are important for the prediction, we introduce a soft attention mechanism into the readout function that quantifies the contributions of the node representations towards the graph representations. We investigate different mechanisms for sparse attention to ensure only the most relevant substructures are identified.


title: Overcoming Boltzmann's Tyranny in a Transistor via the Topological Quantum Field Effect

abstract: The sub-threshold swing is the fundamental critical parameter determining the operation of a transistor in low-power applications such as switches. It determines the fraction of dissipation due to the gate capacitance used for turning the device on and off, and in a conventional transistor it is limited by Boltzmann's tyranny to kTln(10)/q, or 60 mV per decade. Here, we demonstrate that the sub-threshold swing of a topological transistor, in which conduction is enabled by a topological phase transition via electric field switching, can be sizably reduced in a non-interacting system by modulating the Rashba spin-orbit interaction via a top-gate electric field. We refer to this as the Topological Quantum Field Effect and to the transistor as a Topological Quantum Field Effect transistor (TQFET). By developing a general theoretical framework for quantum spin Hall materials with honeycomb lattices we explicitly show that the Rashba interaction can reduce the sub-threshold swing by more than 25% compared to Boltzmann's limit in currently available materials, but without any fundamental lower bound, a discovery that can guide future materials design and steer the engineering of topological quantum devices.


title: Mixed-SCORE+ for mixed membership community detection

abstract: Mixed-SCORE is a recent approach for mixed membership community detection proposed by Jin et al. (2017) which is an extension of SCORE (Jin, 2015). In the note Jin et al. (2018), the authors propose SCORE+ as an improvement of SCORE to handle with weak signal networks. In this paper, we propose a method called Mixed-SCORE+ designed based on the Mixed-SCORE and SCORE+, therefore Mixed-SCORE+ inherits nice properties of both Mixed-SCORE and SCORE+. In the proposed method, we consider K+1 eigenvectors when there are K communities to detect weak signal networks. And we also construct vertices hunting and membership reconstruction steps to solve the problem of mixed membership community detection. Compared with several benchmark methods, numerical results show that Mixed-SCORE+ provides a significant improvement on the Polblogs network and two weak signal networks Simmons and Caltech, with error rates 54/1222, 125/1137 and 94/590, respectively. Furthermore, Mixed-SCORE+ enjoys excellent performances on the SNAP ego-networks.


title: Modeling of the bending of an electroactive polymer strip

abstract: Ionic electro-active polymer (Nafion for example) can be used as sensor or actuator. To this end, a thin film of the water-saturated material is sandwiched between two electrodes. Water saturation causes a quasi-complete dissociation of the polymer and the release of small cations. The application of an electric field across the thickness results in the bending of the strip. Conversely, a voltage can be detected between the two electrodes when the strip is bent. This phenomenon involves multiphysics couplings of electro-mechanical-chemical type. We have previously modeled this system and determined its constitutive equations using the thermodynamics of linear irreversible processes.We applied this model to the case of a cantilevered PEA strip subjected to a continuous voltage between its two faces (static case). The applied forces and the tip displacement are calculated using a beam model in large displacements. We have also studied the force to be exercised on the free end to prevent its displacement (blocking force).Numerical simulations were performed in the case of Nafion. We have drawn the profiles of cations concentration, pressure, electric field and potential in the thickness of the strip. These quantities, which are almost constant in the central part of the strip, vary drastically near the electrodes. The obtained values of the tip displacement and the blocking force are in good agreement with the experimental data published in the literature. These two quantities are linear functions of the imposed electrical potential ; the tip displacement varies as the length square, and the blocking force is proportional to the width and inversely proportional to the length.


title: Macroscopic Modeling of Anomalously Reflecting Metasurfaces: Angular Response and Far-Field Scattering

abstract: In view of extremely challenging requirements on design and optimization of future mobile communication systems, researchers are considering possibilities of creation intelligent radio environments by using reconfigurable and smart metasurfaces integrated into walls, ceilings, or facades. In this novel communication paradigm, tunable metasurfaces redirect incident waves into the desired directions. In order to design and characterize such smart radio environments in any realistic scenario, it is necessary to know how these metasurfaces behave when illuminated from other directions and how scattering from finite-sized anomalous reflectors can be estimated. We study the angular response of anomalous reflectors for arbitrary illumination angles. Using the surface-impedance model, we explain the dependence of the reflection coefficients of phase-gradient metasurfaces on the illumination angle and present numerical examples for typical structures. We also consider scattering from finite-size metasurfaces and define a route toward including the full-angle response of anomalous reflections into the ray-tracing models of the propagation channel. The developed models apply to other diffraction gratings of finite size.


title: Utilizing Concept Drift for Measuring the Effectiveness of Policy Interventions: The Case of the COVID-19 Pandemic

abstract: As a reaction to the high infectiousness and lethality of the COVID-19 virus, countries around the world have adopted drastic policy measures to contain the pandemic. However, it remains unclear which effect these measures, so-called non-pharmaceutical interventions (NPIs), have on the spread of the virus. In this article, we use machine learning and apply drift detection methods in a novel way to predict the time lag of policy interventions with respect to the development of daily case numbers of COVID-19 across 9 European countries and 28 US states. Our analysis shows that there are, on average, more than two weeks between NPI enactment and a drift in the case numbers.


title: TRACE: Early Detection of Chronic Kidney Disease Onset with Transformer-Enhanced Feature Embedding

abstract: Chronic kidney disease (CKD) has a poor prognosis due to excessive risk factors and comorbidities associated with it. The early detection of CKD faces challenges of insufficient medical histories of positive patients and complicated risk factors. In this paper, we propose the TRACE (Transformer-RNN Autoencoder-enhanced CKD Detector) framework, an end-to-end prediction model using patients' medical history data, to deal with these challenges. TRACE presents a comprehensive medical history representation with a novel key component: a Transformer-RNN autoencoder. The autoencoder jointly learns a medical concept embedding via Transformer for each hospital visit, and a latent representation which summarizes a patient's medical history across all the visits. We compared TRACE with multiple state-of-the-art methods on a dataset derived from real-world medical records. Our model has achieved 0.5708 AUPRC with a 2.31% relative improvement over the best-performing method. We also validated the clinical meaning of the learned embeddings through visualizations and a case study, showing the potential of TRACE to serve as a general disease prediction model.


title: Homogenization of large deforming fluid-saturated porous structures

abstract: The two-scale computational homogenization method is proposed for modelling of locally periodic fluid-saturated media subjected a to large deformation induced by quasistatic loading. The periodic heterogeneities are relevant to the mesoscopic scale at which a double porous medium constituted by hyperelastic skeleton and an incompressible viscous fluid is featured by large contrasts in the permeability. Within the Eulerian framework related to the current deformed configuration, the two-scale homogenization approach is applied to a linearized model discretized in time, being associated with an incremental formulation. For this, the equilibrium equation and the mass conservation expressed in the spatial configuration are differentiated using the material derivative with respect to a convection velocity field. The homogenization procedure of the linearized equations provides effective (homogenized) material properties are computed to constitute the incremental macroscopic problem. The coupled algorithm for the multiscale problem is implemented using the finite element method. Illustrative 2D numerical simulations of a poroelastic medium are presented including a simple validation test.


title: Computing flood probabilities using Twitter: application to the Houston urban area during Harvey

abstract: In this paper, we investigate the conversion of a Twitter corpus into geo-referenced raster cells holding the probability of the associated geographical areas of being flooded. We describe a baseline approach that combines a density ratio function, aggregation using a spatio-temporal Gaussian kernel function, and TFIDF textual features. The features are transformed to probabilities using a logistic regression model. The described method is evaluated on a corpus collected after the floods that followed Hurricane Harvey in the Houston urban area in August-September 2017. The baseline reaches a F1 score of 68%. We highlight research directions likely to improve these initial results.


title: Data-driven Model Predictive Control Method for DFIG-based Wind Farm to Provide Primary Frequency Regulation Service

abstract: As wind power penetration increases, the wind farms are required by newly released grid codes to provide frequency regulation service. The most critical challenge is how to formulate the dynamic model of wind farm for dynamic control, since it is essentially is nonlinear and there are huge amount of parameters to be maintained frequently. This paper proposes a data-driven model predictive control (data-driven MPC) method to make wind farms participate primary frequency regulation. In this method,a specialized dynamic mode decomposition (SDMD) algorithm is developed, which can linearly approximate the dynamics of wind farm from measurements based on Koopman operator theory.Compared with the existing extended dynamic mode decomposition (EDMD) method,this tailored SDMD has two advantages: 1) fully capturing the nonlinear transients of wind turbine dynamics with good accuracy under a wide range of working conditions; 2) much less computational burden with model dimensionality reduction. Based on the recursively updated linear dynamic model, a model predictive control solution is implemented. The simulation results show this model-free solution can dynamically optimize wind turbine generators' active power to track the frequency response requirement from system operator and minimize the rotor speed distortion.


title: Chiral effective Lagrangian for heavy-light mesons from QCD: $1/m_{Q}$ correction

abstract: As a successive work to [Phys.Rev.D 102 (2020), 034034], we derive the $1/m_Q$ corrections to chiral effective Lagrangian for heavy-light mesons from QCD under proper approximations. The low energy constants in the effective Lagrangian are expressed in terms of the light quark self-energy and heavy quark mass $m_Q$. Numerical results of the low energy constants with $1/m_Q$ corrections are given. We find that the results of pion decay constant and the masses of heavy-light mesons are improved coherently compared to that obtained in the heavy quark limit.


title: Sequential Resource Access: Theory and Algorithm

abstract: We formulate and analyze a generic sequential resource access problem arising in a variety of engineering fields, where a user disposes a number of heterogeneous computing, communication, or storage resources, each characterized by the probability of successfully executing the user's task and the related access delay and cost, and seeks an optimal access strategy to maximize her utility within a given time horizon, defined as the expected reward minus the access cost. We develop an algorithmic framework on the (near-)optimal sequential resource access strategy. We first prove that the problem of finding an optimal strategy is NP-hard in general. Given the hardness result, we present a greedy strategy implementable in linear time, and establish the closed-form sufficient condition for its optimality. We then develop a series of polynomial-time approximation algorithms achieving $(\epsilon,\delta)$-optimality, with the key component being a pruning process eliminating dominated strategies and, thus maintaining polynomial time and space overhead.


title: Photon-photon Correlations from a Pair of Strongly Coupled Two-Level Emitters

abstract: We investigate two-color photon correlations in the light emitted by strongly coupled two-level emitters. Spectral filtering allows us to manipulate the collected light statistics and we show that the resonances induced by dipole-dipole interactions give rise to specific correlations, where the time-symmetry of the correlations is broken. Based on the collective dressed states, our study encompasses both the case of real processes, where the photons are associated with specific resonances and classical correlations between each other, and virtual processes, where pairs of photons are emitted with non-classical correlations.


title: Patterns, anticipation and participatory futures

abstract: Patterns embody repeating phenomena, and, as such, they are partly but not fully detachable from their context. 'Design patterns' and 'pattern languages' are established methods for working with patterns. They have been applied in architecture, software engineering, and other design fields, but have so far seen little application in the field of future studies. We reimagine futures discourse and anticipatory practices using pattern methods. We focus specifically on processes for coordinating distributed projects, integrating multiple voices, and on play that builds capability to face what's yet to come. One of the advantages of the method as a whole is that it deals with local knowledge and does not subsume everything within one overall 'global' strategy, while nevertheless offering a way to communicate between contexts and disciplines.


title: Simulations for a low-perveance high-quality beam matching of a high efficiency Ka-band klystron

abstract: Self consistent analytic and numeric design for a set of electron guns with a high beams quality to be used in high power Ka-band klystrons are presented in this paper. The set of electron guns can be used in the high power Ka-band klystrons in order to feed linear accelerating structures at 36 GHz with an estimated 20 MW input power by achieving an effective accelerating electric field in the (100-150) MV/m range. In the framework of the Compact Light XLS project, a short Ka-band linearizer by working at 36 GHz able for providing an integrated voltage of at least 15 MV is proposed for bunch-phase linearization. In order to optimize the Ka-band klystrons efficiency for achieving 20 MW RF output power, different electron guns and beam focusing channel designs are examined and discussed in this paper.


title: Small Changes, Big Impacts: Leveraging Diversity to Improve Energy Efficiency

abstract: In the last few years, a growing body of research has proposed methods, techniques, and tools to support developers in the construction of software that consumes less energy. These solutions leverage diverse approaches such as version history mining, analytical models, identifying energy-efficient color schemes, and optimizing the packaging of HTTP requests. In this chapter, we present a complementary approach. We advocate that developers should leverage software diversity to make software systems more energy-efficient. Our main insight is that non-specialists can build software that consumes less energy by alternating at development time between readily available, diversely-designed pieces of software implemented by third-parties. These pieces of software can vary in nature, granularity, and quality attributes. Examples include data structures and constructs for thread management and synchronization.


title: Exploring the Usage of Online Food Delivery Data for Intra-Urban Job and Housing Mobility Detection and Characterization

abstract: Human mobility plays a critical role in urban planning and policy-making. However, at certain spatial and temporal resolutions, it is very challenging to track, for example, job and housing mobility. In this study, we explore the usage of a new modality of dataset, online food delivery data, to detect job and housing mobility. By leveraging millions of meal orders from a popular online food ordering and delivery service in Beijing, China, we are able to detect job and housing moves at much higher spatial and temporal resolutions than using traditional data sources. Popular moving seasons and origins/destinations can be well identified. More importantly, we match the detected moves to both macro- and micro-level factors so as to characterize job and housing dynamics. Our findings suggest that commuting distance is a major factor for job and housing mobility. We also observe that: (1) For home movers, there is a trade-off between lower housing cost and shorter commuting distance given the urban spatial structure; (2) For job hoppers, those who frequently work overtime are more likely to reduce their working hours by switching jobs. While this new modality of dataset has its limitations, we believe that ensemble approaches would be promising, where a mash-up of multiple datasets with different characteristic limitations can provide a more comprehensive picture of job and housing dynamics. Our work demonstrates the effectiveness of utilizing food delivery data to detect and analyze job and housing mobility, and contributes to realizing the full potential of ensemble-based approaches.


title: Joint Optimization of an Autoencoder for Clustering and Embedding

abstract: Deep embedded clustering has become a dominating approach to unsupervised categorization of objects with deep neural networks. The optimization of the most popular methods alternates between the training of a deep autoencoder and a k-means clustering of the autoencoder's embedding. The diachronic setting, however, prevents the former to benefit from valuable information acquired by the latter. In this paper, we present an alternative where the autoencoder and the clustering are learned simultaneously. This is achieved by providing novel theoretical insight, where we show that the objective function of a certain class of Gaussian mixture models (GMMs) can naturally be rephrased as the loss function of a one-hidden layer autoencoder thus inheriting the built-in clustering capabilities of the GMM. That simple neural network, referred to as the clustering module, can be integrated into a deep autoencoder resulting in a deep clustering model able to jointly learn a clustering and an embedding. Experiments confirm the equivalence between the clustering module and Gaussian mixture models. Further evaluations affirm the empirical relevance of our deep architecture as it outperforms related baselines on several data sets.


title: Stability of discrete-time feed-forward neural networks in NARX configuration

abstract: The idea of using Feed-Forward Neural Networks (FFNNs) as regression functions for Nonlinear AutoRegressive eXogenous (NARX) models, leading to models herein named Neural NARXs (NNARXs), has been quite popular in the early days of machine learning applied to nonlinear system identification, owing to their simple structure and ease of application to control design. Nonetheless, few theoretical results are available concerning the stability properties of these models. In this paper we address this problem, providing a sufficient condition under which NNARX models are guaranteed to enjoy the Input-to-State Stability (ISS) and the Incremental Input-to-State Stability ({\delta}ISS) properties. This condition, which is an inequality on the weights of the underlying FFNN, can be enforced during the training procedure to ensure the stability of the model. The proposed model, along with this stability condition, are tested on the pH neutralization process benchmark, showing satisfactory results.


title: The smallest number of vertices in a 2-arc-strong digraph which has no good pair

abstract: Bang-Jensen, Bessy, Havet and Yeo showed that every digraph of independence number at most 2 and arc-connectivity at least 2 has an out-branching $B^+$ and an in-branching $B^-$ which are arc-disjoint (such two branchings are called a {\it good pair}), which settled a conjecture of Thomassen for digraphs of independence number 2. They also proved that every digraph on at most 6 vertices and arc-connectivity at least 2 has a good pair and gave an example of a 2-arc-strong digraph $D$ on 10 vertices with independence number 4 that has no good pair. They asked for the smallest number $n$ of vertices in a 2-arc-strong digraph which has no good pair. In this paper, we prove that every digraph on at most 9 vertices and arc-connectivity at least 2 has a good pair, which solves this problem.


title: Bringing Cognitive Augmentation to Web Browsing Accessibility

abstract: In this paper we explore the opportunities brought by cognitive augmentation to provide a more natural and accessible web browsing experience. We explore these opportunities through \textit{conversational web browsing}, an emerging interaction paradigm for the Web that enables blind and visually impaired users (BVIP), as well as regular users, to access the contents and features of websites through conversational agents. Informed by the literature, our previous work and prototyping exercises, we derive a conceptual framework for supporting BVIP conversational web browsing needs, to then focus on the challenges of automatically providing this support, describing our early work and prototype that leverage heuristics that consider structural and content features only.


title: Every Corporation Owns Its Image: Corporate Credit Ratings via Convolutional Neural Networks

abstract: Credit rating is an analysis of the credit risks associated with a corporation, which reflect the level of the riskiness and reliability in investing. There have emerged many studies that implement machine learning techniques to deal with corporate credit rating. However, the ability of these models is limited by enormous amounts of data from financial statement reports. In this work, we analyze the performance of traditional machine learning models in predicting corporate credit rating. For utilizing the powerful convolutional neural networks and enormous financial data, we propose a novel end-to-end method, Corporate Credit Ratings via Convolutional Neural Networks, CCR-CNN for brevity. In the proposed model, each corporation is transformed into an image. Based on this image, CNN can capture complex feature interactions of data, which are difficult to be revealed by previous machine learning models. Extensive experiments conducted on the Chinese public-listed corporate rating dataset which we build, prove that CCR-CNN outperforms the state-of-the-art methods consistently.


title: From Requirements to Autonomous Flight: An Overview of the Monitoring ICAROUS Project

abstract: The Independent Configurable Architecture for Reliable Operations of Unmanned Systems (ICAROUS) is a software architecture incorporating a set of algorithms to enable autonomous operations of unmanned aircraft applications. This paper provides an overview of Monitoring ICAROUS, a project whose objective is to provide a formal approach to generating runtime monitors for autonomous systems from requirements written in a structured natural language. This approach integrates FRET, a formal requirement elicitation and authoring tool, and Copilot, a runtime verification framework. FRET is used to specify formal requirements in structured natural language. These requirements are translated into temporal logic formulae. Copilot is then used to generate executable runtime monitors from these temporal logic specifications. The generated monitors are directly integrated into ICAROUS to perform runtime verification during flight.


title: The Impact of a STEM-based Entrepreneurship Program on the Entrepreneurial Intention of Secondary School Female Students

abstract: Despite dedicated effort and research in the last two decades, the entrepreneurship field is still limited by little evidence-based knowledge of the impacts of entrepreneurship programs on the entrepreneurial intention of students in pre-university levels of study. Further, gender equity continues to be an issue in the entrepreneurial sector, particularly in STEM-focused entrepreneurship. In this context, this study was designed to explore the effects of a one-day female-focused STEM-based entrepreneurship program (for brevity, we call it the OzGirlsEntrepreneurship program) on the entrepreneurial intention of secondary school female students. The study collected data from two surveys completed by 193 secondary school female students, aged 14-16 years, who participated in the OzGirlsEntrepreneurship program. This program encouraged girls to develop and implement creative computational solutions to socially relevant problems, with an Internet of Things (IoT) component using the micro:bit device. The findings reveal that a key factor in the development of entrepreneurial attitudes in young female students is associated with soft-skills development, particularly in the areas of creative thinking, risk-taking, problem-solving, and leadership development. The importance of meaningful human connections, including positive role modelling and peer to peer learning were also important factors in fostering entrepreneurial intent. With these factors in mind, our findings highlight that the OzGirlsEntrepreneurship program substantially increased the entrepreneurial intention of secondary school female students. In addition, this study offers actionable implications and recommendations to develop and deliver entrepreneurship education programs for secondary school level students.


title: Accumulated Decoupled Learning: Mitigating Gradient Staleness in Inter-Layer Model Parallelization

abstract: Decoupled learning is a branch of model parallelism which parallelizes the training of a network by splitting it depth-wise into multiple modules. Techniques from decoupled learning usually lead to stale gradient effect because of their asynchronous implementation, thereby causing performance degradation. In this paper, we propose an accumulated decoupled learning (ADL) which incorporates the gradient accumulation technique to mitigate the stale gradient effect. We give both theoretical and empirical evidences regarding how the gradient staleness can be reduced. We prove that the proposed method can converge to critical points, i.e., the gradients converge to 0, in spite of its asynchronous nature. Empirical validation is provided by training deep convolutional neural networks to perform classification tasks on CIFAR-10 and ImageNet datasets. The ADL is shown to outperform several state-of-the-arts in the classification tasks, and is the fastest among the compared methods.


title: Hyperballistic superdiffusion and explosive solutions to the non-linear diffusion equation

abstract: By means of a particle model that includes interactions only via the local particle concentration, we show that hyperballistic diffusion may result. This is done by findng the exact solution of the corresponding non-linear diffusion equation, as well as by particle simulations. The connection between these levels of description is provided by the Fokker-Planck equation describing the particle dynamics.


title: Explainable AI for Interpretable Credit Scoring

abstract: With the ever-growing achievements in Artificial Intelligence (AI) and the recent boosted enthusiasm in Financial Technology (FinTech), applications such as credit scoring have gained substantial academic interest. Credit scoring helps financial experts make better decisions regarding whether or not to accept a loan application, such that loans with a high probability of default are not accepted. Apart from the noisy and highly imbalanced data challenges faced by such credit scoring models, recent regulations such as the `right to explanation' introduced by the General Data Protection Regulation (GDPR) and the Equal Credit Opportunity Act (ECOA) have added the need for model interpretability to ensure that algorithmic decisions are understandable and coherent. An interesting concept that has been recently introduced is eXplainable AI (XAI), which focuses on making black-box models more interpretable. In this work, we present a credit scoring model that is both accurate and interpretable. For classification, state-of-the-art performance on the Home Equity Line of Credit (HELOC) and Lending Club (LC) Datasets is achieved using the Extreme Gradient Boosting (XGBoost) model. The model is then further enhanced with a 360-degree explanation framework, which provides different explanations (i.e. global, local feature-based and local instance-based) that are required by different people in different situations. Evaluation through the use of functionallygrounded, application-grounded and human-grounded analysis show that the explanations provided are simple, consistent as well as satisfy the six predetermined hypotheses testing for correctness, effectiveness, easy understanding, detail sufficiency and trustworthiness.


title: Using Side Channel Information and Artificial Intelligence for Malware Detection

abstract: Cybersecurity continues to be a difficult issue for society especially as the number of networked systems grows. Techniques to protect these systems range from rules-based to artificial intelligence-based intrusion detection systems and anti-virus tools. These systems rely upon the information contained in the network packets and download executables to function. Side channel information leaked from hardware has been shown to reveal secret information in systems such as encryption keys. This work demonstrates that side channel information can be used to detect malware running on a computing platform without access to the code involved.


title: Spectrally multimode integrated SU(1,1) interferometer

abstract: Nonlinear SU(1,1) interferometers are fruitful and promising tools for spectral engineering and precise measurements with phase sensitivity below the classical bound. Such interferometers have been successfully realized in bulk and fiber-based configurations. However, rapidly developing integrated technologies provide higher efficiencies, smaller footprints, and pave the way to quantum-enhanced on-chip interferometry. In this work, we theoretically realised an integrated architecture of the multimode SU(1,1) interferometer which can be applied to various integrated platforms. The presented interferometer includes a polarization converter between two photon sources and utilizes a continuous-wave (CW) pump. Based on the potassium titanyl phosphate (KTP) platform, we show that this configuration results in almost perfect destructive interference at the output and supersensitivity regions below the classical limit. In addition, we discuss the fundamental difference between single-mode and highly multimode SU(1,1) interferometers in the properties of phase sensitivity and its limits. Finally, we explore how to improve the phase sensitivity by filtering the output radiation and using different seeding states in different modes with various detection strategies.


title: Detritiation of the electrostatic spectrometer of Troitsk Nu-mass experiment

abstract: The paper describes methods and presents results of the Troitsk Nu-mass experiment spectrometer cleanup, which inner volume (40 m3) and surfaces (160 m2) was contaminated by 4.4 GBq of tritium. The Troitsk Nu-mass experiment of Institute for Nuclear Research of Russian Academy of Sciences, Moscow, is designed to measure the spectrum of electrons from tritium decays in order to search for hypothetical particles - sterile neutrinos. As a result of equipment failure, the spectrometer internal volume was contaminated with tritium. The contamination made measurements impossible and the research program stopped. The methods of vacuum extraction, hydrogen soaks, and water vapour soaks were used for cleanup. As a result of detritiation, the background level of the main detector of the Troitsk Nu-mass spectrometer decreased by more than 10 times, which made it possible to resume work. The results are consistent with the data obtained earlier for volumes in normal conditions in the air and can be used for planning work on detritiation of similar installations.


title: Unsupervised Pre-training for Person Re-identification

abstract: In this paper, we present a large scale unlabeled person re-identification (Re-ID) dataset "LUPerson" and make the first attempt of performing unsupervised pre-training for improving the generalization ability of the learned person Re-ID feature representation. This is to address the problem that all existing person Re-ID datasets are all of limited scale due to the costly effort required for data annotation. Previous research tries to leverage models pre-trained on ImageNet to mitigate the shortage of person Re-ID data but suffers from the large domain gap between ImageNet and person Re-ID data. LUPerson is an unlabeled dataset of 4M images of over 200K identities, which is 30X larger than the largest existing Re-ID dataset. It also covers a much diverse range of capturing environments (eg, camera settings, scenes, etc.). Based on this dataset, we systematically study the key factors for learning Re-ID features from two perspectives: data augmentation and contrastive loss. Unsupervised pre-training performed on this large-scale dataset effectively leads to a generic Re-ID feature that can benefit all existing person Re-ID methods. Using our pre-trained model in some basic frameworks, our methods achieve state-of-the-art results without bells and whistles on four widely used Re-ID datasets: CUHK03, Market1501, DukeMTMC, and MSMT17. Our results also show that the performance improvement is more significant on small-scale target datasets or under few-shot setting.


title: Deep Learning Methods for Credit Card Fraud Detection

abstract: Credit card frauds are at an ever-increasing rate and have become a major problem in the financial sector. Because of these frauds, card users are hesitant in making purchases and both the merchants and financial institutions bear heavy losses. Some major challenges in credit card frauds involve the availability of public data, high class imbalance in data, changing nature of frauds and the high number of false alarms. Machine learning techniques have been used to detect credit card frauds but no fraud detection systems have been able to offer great efficiency to date. Recent development of deep learning has been applied to solve complex problems in various areas. This paper presents a thorough study of deep learning methods for the credit card fraud detection problem and compare their performance with various machine learning algorithms on three different financial datasets. Experimental results show great performance of the proposed deep learning methods against traditional machine learning models and imply that the proposed approaches can be implemented effectively for real-world credit card fraud detection systems.


title: Foundations for Near-Term Quantum Natural Language Processing

abstract: We provide conceptual and mathematical foundations for near-term quantum natural language processing (QNLP), and do so in quantum computer scientist friendly terms. We opted for an expository presentation style, and provide references for supporting empirical evidence and formal statements concerning mathematical generality. We recall how the quantum model for natural language that we employ canonically combines linguistic meanings with rich linguistic structure, most notably grammar. In particular, the fact that it takes a quantum-like model to combine meaning and structure, establishes QNLP as quantum-native, on par with simulation of quantum systems. Moreover, the now leading Noisy Intermediate-Scale Quantum (NISQ) paradigm for encoding classical data on quantum hardware, variational quantum circuits, makes NISQ exceptionally QNLP-friendly: linguistic structure can be encoded as a free lunch, in contrast to the apparently exponentially expensive classical encoding of grammar. Quantum speed-up for QNLP tasks has already been established in previous work with Will Zeng. Here we provide a broader range of tasks which all enjoy the same advantage. Diagrammatic reasoning is at the heart of QNLP. Firstly, the quantum model interprets language as quantum processes via the diagrammatic formalism of categorical quantum mechanics. Secondly, these diagrams are via ZX-calculus translated into quantum circuits. Parameterisations of meanings then become the circuit variables to be learned. Our encoding of linguistic structure within quantum circuits also embodies a novel approach for establishing word-meanings that goes beyond the current standards in mainstream AI, by placing linguistic structure at the heart of Wittgenstein's meaning-is-context.


title: Grammar-aware sentence classification on quantum computers

abstract: Natural language processing (NLP) is at the forefront of great advances in contemporary AI, and it is arguably one of the most challenging areas of the field. At the same time, in the area of Quantum Computing (QC), with the steady growth of quantum hardware and notable improvements towards implementations of quantum algorithms, we are approaching an era when quantum computers perform tasks that cannot be done on classical computers with a reasonable amount of resources. This provides a new range of opportunities for AI, and for NLP specifically. In this work, we work with the Categorical Distributional Compositional (DisCoCat) model of natural language meaning, whose underlying mathematical underpinnings make it amenable to quantum instantiations. Earlier work on fault-tolerant quantum algorithms has already demonstrated potential quantum advantage for NLP, notably employing DisCoCat. In this work, we focus on the capabilities of noisy intermediate-scale quantum (NISQ) hardware and perform the first implementation of an NLP task on a NISQ processor, using the DisCoCat framework. Sentences are instantiated as parameterised quantum circuits; word-meanings are embedded in quantum states using parameterised quantum-circuits and the sentence's grammatical structure faithfully manifests as a pattern of entangling operations which compose the word-circuits into a sentence-circuit. The circuits' parameters are trained using a classical optimiser in a supervised NLP task of binary classification. Our novel QNLP model shows concrete promise for scalability as the quality of the quantum hardware improves in the near future and solidifies a novel branch of experimental research at the intersection of QC and AI.


title: The Magnetic Environment of a Stealth Coronal Mass Ejection

abstract: Interest in stealth coronal mass ejections (CMEs) is increasing due to their relatively high occurrence rate and space weather impact. However, typical CME signatures such as extreme-ultraviolet dimmings and post-eruptive arcades are hard to identify and require extensive image processing techniques. These weak observational signatures mean that little is currently understood about the physics of these events. We present an extensive study of the magnetic field configuration in which the stealth CME of 3 March 2011 occurred. Three distinct episodes of flare ribbon formation are observed in the stealth CME source active region (AR). Two occurred prior to the eruption and suggest the occurrence of magnetic reconnection that builds the structure which will become eruptive. The third occurs in a time close to the eruption of a cavity that is observed in STEREO-B 171A data; this subsequently becomes part of the propagating CME observed in coronagraph data. We use both local (Cartesian) and global (spherical) models of the coronal magnetic field, which are complemented and verified by the observational analysis. We find evidence of a coronal null point, with field lines computed from its neighbourhood connecting the stealth CME source region to two ARs in the northern hemisphere. We conclude that reconnection at the null point aids the eruption of the stealth CME by removing field that acted to stabilise the pre-eruptive structure. This stealth CME, despite its weak signatures, has the main characteristics of other CMEs, and its eruption is driven by similar mechanisms.


title: Central Limit Theorem and Near classical Berry-Esseen rate for self normalized sums in high dimensions

abstract: In this article, we are interested in the high dimensional normal approximation of $T_n =\Big(\sum_{i=1}^{n}X_{i1}/\Big(\sqrt{\sum_{i=1}^{n}X_{i1}^2}\Big),\dots,$ $\sum_{i=1}^{n}X_{ip}/\Big(\sqrt{\sum_{i=1}^{n}X_{ip}^2}\Big)\Big)$ in $\mathcal{R}^p$ uniformly over the class of hyper-rectangles $\mathcal{A}^{re}=\{\prod_{j=1}^{p}[a_j,b_j]\cap\mathcal{R}:-\infty\leq a_j\leq b_j \leq \infty, j=1,\ldots,p\}$, where $X_1,\dots,X_n$ are non-degenerate independent $p-$dimensional random vectors. We assume that the components of $X_i$ are independent and identically distributed (iid) and investigate the optimal cut-off rate of $\log p$ in the uniform central limit theorem (UCLT) for $T_n$ over $\mathcal{A}^{re}$. The aim is to reduce the exponential moment conditions, generally assumed for exponential growth of the dimension with respect to the sample size in high dimensional CLT, to some polynomial moment conditions. Indeed, we establish that only the existence of some polynomial moment of order $\in [2,4]$ is sufficient for exponential growth of $p$. However the rate of growth of $\log p$ can not further be improved from $o\big(n^{1/2}\big)$ as a power of $n$ even if $X_{ij}$'s are iid across $(i,j)$ and $X_{11}$ is bounded. We also establish near$-n^{-\kappa/2}$ Berry-Esseen rate for $T_n$ in high dimension under the existence of $(2+\kappa)$th absolute moments of $X_{ij}$ for $0< \kappa \leq 1$. When $\kappa =1$, the obtained Berry-Esseen rate is also shown to be optimal. As an application, we find respective versions for component-wise Student's t-statistic, which may be useful in high dimensional statistical inference.


title: Exposing Bugs in JavaScript Engines through Test Transplantation and Differential Testing

abstract: Context. JavaScript is a popular programming language today with several implementations competing for market dominance. Although a specification document and a conformance test suite exist to guide engine development, bugs occur and have important practical consequences. Implementing correct engines is challenging because the spec is intentionally incomplete and evolves frequently. Objective. This paper investigates the use of test transplantation and differential testing for revealing functional bugs in JavaScript engines. The former technique runs the regression test suite of a given engine on another engine. The latter technique fuzzes existing inputs and then compares the output produced by different engines with a differential oracle. Method. We conducted experiments with engines from five major players-Apple, Facebook, Google, Microsoft, and Mozilla-to assess the effectiveness of test transplantation and differential testing. Results. Our results indicate that both techniques revealed several bugs, many of which confirmed by developers. We reported 35 bugs with test transplantation (23 of these bugs confirmed and 19 fixed) and reported 24 bugs with differential testing (17 of these confirmed and 10 fixed). Results indicate that most of these bugs affected two engines-Apple's JSC and Microsoft's ChakraCore (24 and 26 bugs, respectively). To summarize, our results show that test transplantation and differential testing are easy to apply and very effective in finding bugs in complex software, such as JavaScript engines.


title: Curvature squared action in four dimensional $N=2$ supergravity using the dilaton Weyl multiplet

abstract: In this paper we derive the most general curvature squared action coupled to an arbitrary number of vector multiplets in four dimensional $N=2$ supergravity using the dilaton Weyl multiplet. The action that we derive is encoded in a single holomorphic prepotential.


title: Adaptive Sequential SAA for Solving Two-stage Stochastic Linear Programs

abstract: We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations as follows: during each outer iteration, a sample-path problem is implicitly generated using a sample of observations or ``scenarios," and solved only \emph{imprecisely}, to within a tolerance that is chosen \emph{adaptively}, by balancing the estimated statistical error against solution error. The solutions from prior iterations serve as \emph{warm starts} to aid efficient solution of the (piecewise linear convex) sample-path optimization problems generated on subsequent iterations. The generated scenarios can be independent and identically distributed (iid), or dependent, as in Monte Carlo generation using Latin-hypercube sampling, antithetic variates, or randomized quasi-Monte Carlo. We first characterize the almost-sure convergence (and convergence in mean) of the optimality gap and the distance of the generated stochastic iterates to the true solution set. We then characterize the corresponding iteration complexity and work complexity rates as a function of the sample size schedule, demonstrating that the best achievable work complexity rate is Monte Carlo canonical and analogous to the generic $\mathcal{O}(\epsilon^{-2})$ optimal complexity for non-smooth convex optimization. We report extensive numerical tests that indicate favorable performance, due primarily to the use of a sequential framework with an optimal sample size schedule, and the use of warm starts. The proposed algorithm can be stopped in finite-time to return a solution endowed with a probabilistic guarantee on quality.


title: Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion

abstract: LiDAR point cloud analysis is a core task for 3D computer vision, especially for autonomous driving. However, due to the severe sparsity and noise interference in the single sweep LiDAR point cloud, the accurate semantic segmentation is non-trivial to achieve. In this paper, we propose a novel sparse LiDAR point cloud semantic segmentation framework assisted by learned contextual shape priors. In practice, an initial semantic segmentation (SS) of a single sweep point cloud can be achieved by any appealing network and then flows into the semantic scene completion (SSC) module as the input. By merging multiple frames in the LiDAR sequence as supervision, the optimized SSC module has learned the contextual shape priors from sequential LiDAR data, completing the sparse single sweep point cloud to the dense one. Thus, it inherently improves SS optimization through fully end-to-end training. Besides, a Point-Voxel Interaction (PVI) module is proposed to further enhance the knowledge fusion between SS and SSC tasks, i.e., promoting the interaction of incomplete local geometry of point cloud and complete voxel-wise global structure. Furthermore, the auxiliary SSC and PVI modules can be discarded during inference without extra burden for SS. Extensive experiments confirm that our JS3C-Net achieves superior performance on both SemanticKITTI and SemanticPOSS benchmarks, i.e., 4% and 3% improvement correspondingly.


title: Using previous acoustic context to improve Text-to-Speech synthesis

abstract: Many speech synthesis datasets, especially those derived from audiobooks, naturally comprise sequences of utterances. Nevertheless, such data are commonly treated as individual, unordered utterances both when training a model and at inference time. This discards important prosodic phenomena above the utterance level. In this paper, we leverage the sequential nature of the data using an acoustic context encoder that produces an embedding of the previous utterance audio. This is input to the decoder in a Tacotron 2 model. The embedding is also used for a secondary task, providing additional supervision. We compare two secondary tasks: predicting the ordering of utterance pairs, and predicting the embedding of the current utterance audio. Results show that the relation between consecutive utterances is informative: our proposed model significantly improves naturalness over a Tacotron 2 baseline.


title: Topology optimization for quasistatic elastoplasticity

abstract: Topology optimization is concerned with the identification of optimal shapes of deformable bodies with respect to given target functionals. The focus of this paper is on a topology optimization problem for a time-evolving elastoplastic medium under kinematic hardening. We adopt a phase-field approach and argue by subsequent approximations, first by discretizing time and then by regularizing the flow rule. Existence of optimal shapes is proved both at the time-discrete and time-continous level, independently of the regularization. First order optimality conditions are firstly obtained in the regularized time-discrete setting and then proved to pass to the nonregularized time-continuous limit. The phase-field approximation is shown to pass to its sharp-interface limit via an evolutive variational convergence argument.


title: Certified Robustness of Nearest Neighbors against Data Poisoning and Backdoor Attacks

abstract: Data poisoning attacks and backdoor attacks aim to corrupt a machine learning classifier via modifying, adding, and/or removing some carefully selected training examples, such that the corrupted classifier makes incorrect predictions as the attacker desires. The key idea of state-of-the-art certified defenses against data poisoning attacks and backdoor attacks is to create a majority vote mechanism to predict the label of a testing example. Moreover, each voter is a base classifier trained on a subset of the training dataset. Classical simple learning algorithms such as k nearest neighbors (kNN) and radius nearest neighbors (rNN) have intrinsic majority vote mechanisms. In this work, we show that the intrinsic majority vote mechanisms in kNN and rNN already provide certified robustness guarantees against data poisoning attacks and backdoor attacks. Moreover, our evaluation results on MNIST and CIFAR10 show that the intrinsic certified robustness guarantees of kNN and rNN outperform those provided by state-of-the-art certified defenses. Our results serve as standard baselines for future certified defenses against data poisoning attacks and backdoor attacks.


title: Budget-feasible Maximum Nash Social Welfare Allocation is Almost Envy-free

abstract: The Nash social welfare (NSW) is a well-known social welfare measurement that balances individual utilities and the overall efficiency. In the context of fair allocation of indivisible goods, it has been shown by Caragiannis et al. (EC 2016 and TEAC 2019) that an allocation maximizing the NSW is envy-free up to one good (EF1). In this paper, we are interested in the fairness of the NSW in a budget-feasible allocation problem, in which each item has a cost that will be incurred to the agent it is allocated to, and each agent has a budget constraint on the total cost of items she receives. We show that a budget-feasible allocation that maximizes the NSW achieves a 1/4-approximation of EF1 and the approximation ratio is tight. The approximation ratio improves gracefully when the items have small costs compared with the agents' budgets; it converges to 1/2 when the budget-cost ratio approaches infinity.


title: Extensions of Tong-Yang-Ma representation

abstract: In 1996, Tong, Yang and Ma defined a family of representations of the braid group which have the same dimensions as the (unreduced) Burau representations but are not equivalent. The Burau representation was defined homologically and extended to the string links in several ways. In this paper, using the method of Silver and Williams, we extend the family of the Tong-Yang-Ma representations to the string links and welded string links. Moreover, we show that the kernels of these representations may be described using some linking numbers. Finally, we apply the Long-Moody construction to the Tong-Yang-Ma representations and study its first properties.


title: Learning Tactile Models for Factor Graph-based Estimation

abstract: We're interested in the problem of estimating object states from touch during manipulation under occlusions. In this work, we address the problem of estimating object poses from touch during planar pushing. Vision-based tactile sensors provide rich, local image measurements at the point of contact. A single such measurement, however, contains limited information and multiple measurements are needed to infer latent object state. We solve this inference problem using a factor graph. In order to incorporate tactile measurements in the graph, we need local observation models that can map high-dimensional tactile images onto a low-dimensional state space. Prior work has used low-dimensional force measurements or engineered functions to interpret tactile measurements. These methods, however, can be brittle and difficult to scale across objects and sensors. Our key insight is to directly learn tactile observation models that predict the relative pose of the sensor given a pair of tactile images. These relative poses can then be incorporated as factors within a factor graph. We propose a two-stage approach: first we learn local tactile observation models supervised with ground truth data, and then integrate these models along with physics and geometric factors within a factor graph optimizer. We demonstrate reliable object tracking using only tactile feedback for 150 real-world planar pushing sequences with varying trajectories across three object shapes. Supplementary video: https://youtu.be/y1kBfSmi8w0


title: Overcoming Barriers to Data Sharing with Medical Image Generation: A Comprehensive Evaluation

abstract: Privacy concerns around sharing personally identifiable information are a major practical barrier to data sharing in medical research. However, in many cases, researchers have no interest in a particular individual's information but rather aim to derive insights at the level of cohorts. Here, we utilize Generative Adversarial Networks (GANs) to create derived medical imaging datasets consisting entirely of synthetic patient data. The synthetic images ideally have, in aggregate, similar statistical properties to those of a source dataset but do not contain sensitive personal information. We assess the quality of synthetic data generated by two GAN models for chest radiographs with 14 different radiology findings and brain computed tomography (CT) scans with six types of intracranial hemorrhages. We measure the synthetic image quality by the performance difference of predictive models trained on either the synthetic or the real dataset. We find that synthetic data performance disproportionately benefits from a reduced number of unique label combinations. Our open-source benchmark also indicates that at low number of samples per class, label overfitting effects start to dominate GAN training. We additionally conducted a reader study in which trained radiologists do not perform better than random on discriminating between synthetic and real medical images for intermediate levels of resolutions. In accordance with our benchmark results, the classification accuracy of radiologists increases at higher spatial resolution levels. Our study offers valuable guidelines and outlines practical conditions under which insights derived from synthetic medical images are similar to those that would have been derived from real imaging data. Our results indicate that synthetic data sharing may be an attractive and privacy-preserving alternative to sharing real patient-level data in the right settings.


title: The effect of microscopic gap displacement on the correlation of gaps in dimer systems

abstract: In earlier work we showed that in the bulk, the correlation of gaps in dimer systems on the hexagonal lattice is governed, in the fine mesh limit, by Coulomb's law for 2D electrostatics. We also proved that the scaling limit of the discrete field ${\bold F}$ of average tile orientations is, up to a multiplicative constant, the electric field produced by a 2D system of charges corresponding to the gaps. In this paper we show that in the bulk, the relative change $T_{\al,\be}$ in correlation caused by displacing a hole by a fixed vector $(\al,\be)$ is, in the fine mesh limit, the projection on $(\al,\be)$ of a new field ${\bold T}$, which is also equal up to a multiplicative constant to the electric field of the corresponding system of charges. We also discuss the differences between the fields ${\bold T}$ and ${\bold F}$ and present conjectures for their fine mesh limits in the more general case of a dimer system with boundary. The new field ${\bold T}$ can be viewed as capturing the instantaneous pull on each gap in the surrounding fluctuating sea of dimers. From the point of view of the parallel to physics, the electrostatic force emerges then as an entropic force.


title: Combined Sieve Algorithm for Prime Gaps

abstract: A new Combined Sieve algorithm is presented with cost proportional to the number of enumerated factors over a series of intervals. This algorithm achieves a significant speedup, over a traditional sieve, when handling many ([10^4, 10^7]) intervals concurrently. The speedup comes from a space-time tradeoff and a novel solution to a modular equation. In real world tests, this new algorithm regularly runs 10,000x faster. This faster sieve paired with higher sieving limits eliminates more composites and accelerates the search for large prime gaps by 30-70%. During the development and testing of this new algorithm, two top-10 record merit prime gaps were discovered.


title: Continuum Limit of Lipschitz Learning on Graphs

abstract: Tackling semi-supervised learning problems with graph-based methods has become a trend in recent years since graphs can represent all kinds of data and provide a suitable framework for studying continuum limits, e.g., of differential operators. A popular strategy here is $p$-Laplacian learning, which poses a smoothness condition on the sought inference function on the set of unlabeled data. For $p<\infty$ continuum limits of this approach were studied using tools from $\Gamma$-convergence. For the case $p=\infty$, which is referred to as Lipschitz learning, continuum limits of the related infinity-Laplacian equation were studied using the concept of viscosity solutions. In this work, we prove continuum limits of Lipschitz learning using $\Gamma$-convergence. In particular, we define a sequence of functionals which approximate the largest local Lipschitz constant of a graph function and prove $\Gamma$-convergence in the $L^\infty$-topology to the supremum norm of the gradient as the graph becomes denser. Furthermore, we show compactness of the functionals which implies convergence of minimizers. In our analysis we allow a varying set of labeled data which converges to a general closed set in the Hausdorff distance. We apply our results to nonlinear ground states, i.e., minimizers with constrained $L^p$-norm, and, as a by-product, prove convergence of graph distance functions to geodesic distance functions.


title: A characterization of local nilpotence for dimension two polynomial derivations

abstract: Let K be an algebraically closed field. We prove that a polynomial K-derivation $D$ in two variables is locally nilpotent if and only if the subgroup of polynomial K-automorphisms which commute with D admits elements whose degree is arbitrary big.


title: Learning to extrapolate using continued fractions: Predicting the critical temperature of superconductor materials

abstract: In the field of Artificial Intelligence (AI) and Machine Learning (ML), the approximation of unknown target functions $y=f(\mathbf{x})$ using limited instances $S={(\mathbf{x^{(i)}},y^{(i)})}$, where $\mathbf{x^{(i)}} \in D$ and $D$ represents the domain of interest, is a common objective. We refer to $S$ as the training set and aim to identify a low-complexity mathematical model that can effectively approximate this target function for new instances $\mathbf{x}$. Consequently, the model's generalization ability is evaluated on a separate set $T=\{\mathbf{x^{(j)}}\} \subset D$, where $T \neq S$, frequently with $T \cap S = \emptyset$, to assess its performance beyond the training set. However, certain applications require accurate approximation not only within the original domain $D$ but also in an extended domain $D'$ that encompasses $D$. This becomes particularly relevant in scenarios involving the design of new structures, where minimizing errors in approximations is crucial. For example, when developing new materials through data-driven approaches, the AI/ML system can provide valuable insights to guide the design process by serving as a surrogate function. Consequently, the learned model can be employed to facilitate the design of new laboratory experiments. In this paper, we propose a method for multivariate regression based on iterative fitting of a continued fraction, incorporating additive spline models. We compare the performance of our method with established techniques, including AdaBoost, Kernel Ridge, Linear Regression, Lasso Lars, Linear Support Vector Regression, Multi-Layer Perceptrons, Random Forests, Stochastic Gradient Descent, and XGBoost. To evaluate these methods, we focus on an important problem in the field: predicting the critical temperature of superconductors based on physical-chemical characteristics.


title: Triplet Entropy Loss: Improving The Generalisation of Short Speech Language Identification Systems

abstract: We present several methods to improve the generalisation of language identification (LID) systems to new speakers and to new domains. These methods involve Spectral augmentation, where spectrograms are masked in the frequency or time bands during training and CNN architectures that are pre-trained on the Imagenet dataset. The paper also introduces the novel Triplet Entropy Loss training method, which involves training a network simultaneously using Cross Entropy and Triplet loss. It was found that all three methods improved the generalisation of the models, though not significantly. Even though the models trained using Triplet Entropy Loss showed a better understanding of the languages and higher accuracies, it appears as though the models still memorise word patterns present in the spectrograms rather than learning the finer nuances of a language. The research shows that Triplet Entropy Loss has great potential and should be investigated further, not only in language identification tasks but any classification task.


title: SOBA: Session optimal MDP-based network friendly recommendations

abstract: Caching content over CDNs or at the network edge has been solidified as a means to improve network cost and offer better streaming experience to users. Furthermore, nudging the users towards low-cost content has recently gained momentum as a strategy to boost network performance. We focus on the problem of optimal policy design for Network Friendly Recommendations (NFR). We depart from recent modeling attempts, and propose a Markov Decision Process (MDP) formulation. MDPs offer a unified framework that can model a user with random session length. As it turns out, many state-of-the-art approaches can be cast as subcases of our MDP formulation. Moreover, the approach offers flexibility to model users who are reactive to the quality of the received recommendations. In terms of performance, for users consuming an arbitrary number of contents in sequence, we show theoretically and using extensive validation over real traces that the MDP approach outperforms myopic algorithms both in session cost as well as in offered recommendation quality. Finally, even compared to optimal state-of-art algorithms targeting specific subcases, our MDP framework is significantly more efficient, speeding the execution time by a factor of 10, and enjoying better scaling with the content catalog and recommendation batch sizes.


title: Tunable, grating-gated, graphene-on-polyimide terahertz modulators

abstract: We present an electrically switchable graphene terahertz (THz) modulator with a tunable-by-design optical bandwidth and we exploit it to compensate the cavity dispersion of a quantum cascade laser (QCL). Electrostatic gating is achieved by a metal-grating used as a gate electrode, with an HfO2/AlOx gate dielectric on top. This is patterned on a polyimide layer, which acts as a quarter wave resonance cavity, coupled with an Au reflector underneath. We get 90% modulation depth of the intensity, combined with a 20 kHz electrical bandwidth in the 1.9 _ 2.7 THz range. We then integrate our modulator with a multimode THz QCL. By adjusting the modulator operational bandwidth, we demonstrate that the graphene modulator can partially compensates the QCL cavity dispersion, resulting in an integrated laser behaving as a stable frequency comb over 35% of the laser operational range, with 98 equidistant optical modes and with a spectral coverage of ~ 1.2 THz. This has significant potential for frontier applications in the terahertz, as tunable transformation-optics devices, active photonic components, adaptive and quantum optics, and as a metrological tool for spectroscopy at THz frequencies.


title: Identifying Cosmological Information in a Deep Neural Network

abstract: A novel method images to estimate cosmological parameters based on images is presented. In this paper, we demonstrate the use of a convolutional neural network (CNN) for constraining the mass of dark matter particle. For this purpose, we perform a suite of N-body simulations with different dark matter particle masses to train CNN and estimate dark matter mass using a density-contrast map. The proposed method is complementary to the one based on summary statistics, such as two-point correlation function. We compare our CNN classification results with those obtained from the two-point correlation of the distribution of dark matter particles, and find that the CNN offers better performance In addition, we use images made from a random Gauss simulation to train a CNN, which is then compared with the CNN trained by N-body simulation and two-point correlation. The random Gauss-trained CNN has comparable performance to two-point correlation.


title: A new characterization of silting subcategories in the stable category of a Frobenius extriangulated category

abstract: We give a new characterization of silting subcategories in the stable category of a Frobenius extriangulated category, generalizing the result of Di et al. (J. Algebra 525 (2019) 42-63) about the Auslander-Reiten type correspondence for silting subcategories over triangulated categories. More specifically, for any Frobenius extriangulated category $\mathcal{C}$, we establish a bijective correspondence between silting subcategories of the stable category $\underline{\mathcal{C}}$ and certain covariantly finite subcategories of $\mathcal{C}$. As a consequence, a characterization of silting subcategories in the stable category of a Frobenius exact category is given. This result is applied to homotopy categories over abelian categories with enough projectives, derived categories over Grothendieck categories with enough projectives as well as to the stable category of Gorenstein projective modules over a ring $R$.


title: A PAC-Bayesian Perspective on Structured Prediction with Implicit Loss Embeddings

abstract: Many practical machine learning tasks can be framed as Structured prediction problems, where several output variables are predicted and considered interdependent. Recent theoretical advances in structured prediction have focused on obtaining fast rates convergence guarantees, especially in the Implicit Loss Embedding (ILE) framework. PAC-Bayes has gained interest recently for its capacity of producing tight risk bounds for predictor distributions. This work proposes a novel PAC-Bayes perspective on the ILE Structured prediction framework. We present two generalization bounds, on the risk and excess risk, which yield insights into the behavior of ILE predictors. Two learning algorithms are derived from these bounds. The algorithms are implemented and their behavior analyzed, with source code available at \url{https://github.com/theophilec/PAC-Bayes-ILE-Structured-Prediction}.


title: A Novel Hybrid Framework for Hourly PM2.5 Concentration Forecasting Using CEEMDAN and Deep Temporal Convolutional Neural Network

abstract: For hourly PM2.5 concentration prediction, accurately capturing the data patterns of external factors that affect PM2.5 concentration changes, and constructing a forecasting model is one of efficient means to improve forecasting accuracy. In this study, a novel hybrid forecasting model based on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) and deep temporal convolutional neural network (DeepTCN) is developed to predict PM2.5 concentration, by modelling the data patterns of historical pollutant concentrations data, meteorological data, and discrete time variables' data. Taking PM2.5 concentration of Beijing as the sample, experimental results showed that the forecasting accuracy of the proposed CEEMDAN-DeepTCN model is verified to be the highest when compared with the time series model, artificial neural network, and the popular deep learning models. The new model has improved the capability to model the PM2.5-related factor data patterns, and can be used as a promising tool for forecasting PM2.5 concentrations.


title: PCT-TEE: Trajectory-based Private Contact Tracing System with Trusted Execution Environment

abstract: Existing Bluetooth-based Private Contact Tracing (PCT) systems can privately detect whether people have come into direct contact with COVID-19 patients. However, we find that the existing systems lack functionality and flexibility, which may hurt the success of the contact tracing. Specifically, they cannot detect indirect contact (e.g., people may be exposed to coronavirus because of used the same elevator even without direct contact); they also cannot flexibly change the rules of "risky contact", such as how many hours of exposure or how close to a COVID-19 patient that is considered as risk exposure, which may be changed with the environmental situation. In this paper, we propose an efficient and secure contact tracing system that enables both direct contact and indirect contact. To address the above problems, we need to utilize users' trajectory data for private contact tracing, which we call trajectory-based PCT. We formalize this problem as Spatiotemporal Private Set Intersection. By analyzing different approaches such as homomorphic encryption that could be extended to solve this problem, we identify that Trusted Execution Environment (TEE) is a proposing method to achieve our requirements. The major challenge is how to design algorithms for spatiotemporal private set intersection under limited secure memory of TEE. To this end, we design a TEE-based system with flexible trajectory data encoding algorithms. Our experiments on real-world data show that the proposed system can process thousands of queries on tens of million records of trajectory data in a few seconds.