title: DAICS: A Deep Learning Solution for Anomaly Detection in Industrial Control Systems

abstract: Deep Learning is emerging as an effective technique to detect sophisticated cyber-attacks targeting Industrial Control Systems (ICSs). The conventional approach to detection in literature is to learn the "normal" behaviour of the system, to be then able to label noteworthy deviations from it as anomalies. However, during operations, ICSs inevitably and continuously evolve their behaviour, due to e.g., replacement of devices, workflow modifications, or other reasons. As a consequence, the accuracy of the anomaly detection process may be dramatically affected with a considerable amount of false alarms being generated. This paper presents DAICS, a novel deep learning framework with a modular design to fit in large ICSs. The key component of the framework is a 2-branch neural network that learns the changes in the ICS behaviour with a small number of data samples and a few gradient updates. This is supported by an automatic tuning mechanism of the detection threshold that takes into account the changes in the prediction error under normal operating conditions. In this regard, no specialised human intervention is needed to update the other parameters of the system. DAICS has been evaluated using publicly available datasets and shows an increased detection rate and accuracy compared to state of the art approaches, as well as higher robustness to additive noise.


title: Clark measures and de Branges-Rovnyak spaces in several variables

abstract: Let $B_n$ denote the unit ball of $\mathbb{C}^n$, $n\ge 1$, and let $\mathcal{D}$ denote a finite product of $B_{n_j}$, $j\ge 1$. Given a non-constant holomorphic function $b: \mathcal{D} \to B_1$, we study the corresponding family $\sigma_\alpha[b]$, $\alpha\in\partial B_1$, of Clark measures on the distinguished boundary $\partial\mathcal{D}$. We construct a natural unitary operator from the de Branges-Rovnyak space $\mathcal{H}(b)$ onto the Hardy space $H^2(\sigma_\alpha)$. As an application, for $\mathcal{D}= B_n$ and an inner function $I: B_n \to B_1$, we show that the property $\sigma_1[I]\ll\sigma_1[b]$ is directly related to the membership of an appropriate explicit function in $\mathcal{H}(b)$.


title: Feedback Prediction for Proactive HARQ in the Context of Industrial Internet of Things

abstract: In this work, we investigate proactive Hybrid Automatic Repeat reQuest (HARQ) using link-level simulations for multiple packet sizes, modulation orders, BLock Error Rate (BLER) targets and two delay budgets of 1 ms and 2 ms, in the context of Industrial Internet of Things (IIOT) applications. In particular, we propose an enhanced proactive HARQ protocol using a feedback prediction mechanism. We show that the enhanced protocol achieves a significant gain over the classical proactive HARQ in terms of energy efficiency for almost all evaluated BLER targets at least for sufficiently large feedback delays. Furthermore, we demonstrate that the proposed protocol clearly outperforms the classical proactive HARQ in all scenarios when taking a processing delay reduction due to the less complex prediction approach into account, achieving an energy efficiency gain in the range of 11% up to 15% for very stringent latency budgets of 1 ms at $10^{-2}$ BLER and from 4% up to 7.5% for less stringent latency budgets of 2 ms at $10^{-3}$ BLER. Furthermore, we show that power-constrained proactive HARQ with prediction even outperforms unconstrained reactive HARQ for sufficiently large feedback delays.


title: What Is the Temperature? Modern Outlook on the Concept of Temperature

abstract: The meaning and evolution of the notion of "temperature" (which is a key concept for the condensed and gaseous matter theories) are addressed from the different points of view. The concept of temperature turns out to be much more fundamental than it is conventionally thought. In particular, the temperature may be introduced for the systems built of "small" number of particles and particles in rest. The Kelvin temperature scale may be introduced into the quantum and relativistic physics due to the fact, that the efficiency of the quantum and relativistic Carnot cycles coincides with that of the classical one. The relation of the temperature to the metrics of the configurational space describing the behavior of the system built from non-interacting particles is demonstrated. The Landauer principle asserts that the temperature of the system is the only physical value defining the energy cost of isothermal erasing of the single bit of information. The role of the temperature the cosmic microwave background in modern cosmology is discussed.


title: Robustness and Personalization in Federated Learning: A Unified Approach via Regularization

abstract: We present a class of methods for robust, personalized federated learning, called Fed+, that unifies many federated learning algorithms. The principal advantage of this class of methods is to better accommodate the real-world characteristics found in federated training, such as the lack of IID data across parties, the need for robustness to outliers or stragglers, and the requirement to perform well on party-specific datasets. We achieve this through a problem formulation that allows the central server to employ robust ways of aggregating the local models while keeping the structure of local computation intact. Without making any statistical assumption on the degree of heterogeneity of local data across parties, we provide convergence guarantees for Fed+ for convex and non-convex loss functions under different (robust) aggregation methods. The Fed+ theory is also equipped to handle heterogeneous computing environments including stragglers without additional assumptions; specifically, the convergence results cover the general setting where the number of local update steps across parties can vary. We demonstrate the benefits of Fed+ through extensive experiments across standard benchmark datasets.


title: Demystifying Deep Learning in Predictive Spatio-Temporal Analytics: An Information-Theoretic Framework

abstract: Deep learning has achieved incredible success over the past years, especially in various challenging predictive spatio-temporal analytics (PSTA) tasks, such as disease prediction, climate forecast, and traffic prediction, where intrinsic dependency relationships among data exist and generally manifest at multiple spatio-temporal scales. However, given a specific PSTA task and the corresponding dataset, how to appropriately determine the desired configuration of a deep learning model, theoretically analyze the model's learning behavior, and quantitatively characterize the model's learning capacity remains a mystery. In order to demystify the power of deep learning for PSTA, in this paper, we provide a comprehensive framework for deep learning model design and information-theoretic analysis. First, we develop and demonstrate a novel interactively- and integratively-connected deep recurrent neural network (I$^2$DRNN) model. I$^2$DRNN consists of three modules: an Input module that integrates data from heterogeneous sources; a Hidden module that captures the information at different scales while allowing the information to flow interactively between layers; and an Output module that models the integrative effects of information from various hidden layers to generate the output predictions. Second, to theoretically prove that our designed model can learn multi-scale spatio-temporal dependency in PSTA tasks, we provide an information-theoretic analysis to examine the information-based learning capacity (i-CAP) of the proposed model. Third, to validate the I$^2$DRNN model and confirm its i-CAP, we systematically conduct a series of experiments involving both synthetic datasets and real-world PSTA tasks. The experimental results show that the I$^2$DRNN model outperforms both classical and state-of-the-art models, and is able to capture meaningful multi-scale spatio-temporal dependency.


title: Simulation Models for Aggregated Data Meta-Analysis: Evaluation of Pooling Effect Sizes and Publication Biases

abstract: Simulation studies are commonly used to evaluate the performance of newly developed meta-analysis methods. For methodology that is developed for an aggregated data meta-analysis, researchers often resort to simulation of the aggregated data directly, instead of simulating individual participant data from which the aggregated data would be calculated in reality. Clearly, distributional characteristics of the aggregated data statistics may be derived from distributional assumptions of the underlying individual data, but they are often not made explicit in publications. This paper provides the distribution of the aggregated data statistics that were derived from a heteroscedastic mixed effects model for continuous individual data. As a result, we provide a procedure for directly simulating the aggregated data statistics. We also compare our distributional findings with other simulation approaches of aggregated data used in literature by describing their theoretical differences and by conducting a simulation study for three meta-analysis methods: DerSimonian and Laird's pooled estimate and the Trim & Fill and PET-PEESE method for adjustment of publication bias. We demonstrate that the choices of simulation model for aggregated data may have a relevant impact on (the conclusions of) the performance of the meta-analysis method. We recommend the use of multiple aggregated data simulation models for investigation of new methodology to determine sensitivity or otherwise make the individual participant data model explicit that would lead to the distributional choices of the aggregated data statistics used in the simulation.


title: No-go theorem for inflation in Ricci-inverse gravity

abstract: We study a recent proposed Ricci-inverse gravity, which is a very novel type of fourth-order gravity. In particular, we are able to figure out both isotropically and anisotropically inflating universes to this model. More interestingly, these solutions are free from a singularity problem. However, stability analysis based on the dynamical system method shows that both isotropic and anisotropic inflation of this model turn out to be unstable against field perturbations. This result implies a no-go theorem for both isotropic and anisotropic inflation in the Ricci-inverse gravity.


title: Ranking influential nodes in networks from partial information

abstract: Many complex systems exhibit a natural hierarchy in which elements can be ranked according to a notion of "influence". While the complete and accurate knowledge of the interactions between constituents is ordinarily required for the computation of nodes' influence, using a low-rank approximation we show that in a variety of contexts local information about the neighborhoods of nodes is enough to reliably estimate how influential they are, without the need to infer or reconstruct the whole map of interactions. Our framework is successful in approximating with high accuracy different incarnations of influence in systems as diverse as the WWW PageRank, trophic levels of ecosystems, upstreamness of industrial sectors in complex economies, and centrality measures of social networks, as long as the underlying network is not exceedingly sparse. We also discuss the implications of this "emerging locality" on the approximate calculation of non-linear network observables.


title: DeepWriteSYN: On-Line Handwriting Synthesis via Deep Short-Term Representations

abstract: This study proposes DeepWriteSYN, a novel on-line handwriting synthesis approach via deep short-term representations. It comprises two modules: i) an optional and interchangeable temporal segmentation, which divides the handwriting into short-time segments consisting of individual or multiple concatenated strokes; and ii) the on-line synthesis of those short-time handwriting segments, which is based on a sequence-to-sequence Variational Autoencoder (VAE). The main advantages of the proposed approach are that the synthesis is carried out in short-time segments (that can run from a character fraction to full characters) and that the VAE can be trained on a configurable handwriting dataset. These two properties give a lot of flexibility to our synthesiser, e.g., as shown in our experiments, DeepWriteSYN can generate realistic handwriting variations of a given handwritten structure corresponding to the natural variation within a given population or a given subject. These two cases are developed experimentally for individual digits and handwriting signatures, respectively, achieving in both cases remarkable results. Also, we provide experimental results for the task of on-line signature verification showing the high potential of DeepWriteSYN to improve significantly one-shot learning scenarios. To the best of our knowledge, this is the first synthesis approach capable of generating realistic on-line handwriting in the short term (including handwritten signatures) via deep learning. This can be very useful as a module toward long-term realistic handwriting generation either completely synthetic or as natural variation of given handwriting samples.


title: Data-Driven Space-Filling Curves

abstract: We propose a data-driven space-filling curve method for 2D and 3D visualization. Our flexible curve traverses the data elements in the spatial domain in a way that the resulting linearization better preserves features in space compared to existing methods. We achieve such data coherency by calculating a Hamiltonian path that approximately minimizes an objective function that describes the similarity of data values and location coherency in a neighborhood. Our extended variant even supports multiscale data via quadtrees and octrees. Our method is useful in many areas of visualization, including multivariate or comparative visualization, ensemble visualization of 2D and 3D data on regular grids, or multiscale visual analysis of particle simulations. The effectiveness of our method is evaluated with numerical comparisons to existing techniques and through examples of ensemble and multivariate datasets.


title: Sparsity of weighted networks: measures and applications

abstract: A majority of real life networks are weighted and sparse. The present article aims at characterization of weighted networks based on sparsity, as a measure of inherent diversity, of different network parameters. It utilizes sparsity index defined on ordered degree sequence of simple networks and derives further properties of this index. The range of possible values of sparsity index of any connected network, with edge-count in specific intervals, is worked out analytically in terms of node-count; a pattern is uncovered in corresponding degree sequences to produce highest sparsities. Given the edge-weight frequency distribution of a network, we have formulated an expression of the sparsity index of edge-weights. Its properties are analyzed under different distributions of edge-weights. For example, the upper and lower bounds of sparsity index of edge-weights of a network, having all distinct edge-weights, is determined in terms of its node-count and edge density. The article highlights that this summary index with low computational cost, computed on different network parameters, is useful to reveal different structural and organizational aspects of networks for performing analysis. An application of this index has been demonstrated through overlapping community detection of networks. The results validated on artificial and real-world networks show its efficacy.


title: Symmetry restriction and its application to gravity

abstract: In the Hamiltonian formulation, it is not a priori clear whether a symmetric configuration will keep its symmetry during evolution. In this paper, we give precise requirements of when this is the case and propose a symmetry restriction to the phase space of the symmetric variables. This can often ease computation, especially when transcending from the infinite dimensional phase space of a field theory to a possibly finite dimensional subspace. We will demonstrate this in the case of gravity. A prominent example is the restriction of full Hamiltonian general relativity to the cosmological configurations of Robertson-Walker type. We will demonstrate our procedure in this setting and extend it to examples which appear useful in certain approaches to quantum gravity.


title: MIP and Set Covering approaches for Sparse Approximation

abstract: The Sparse Approximation problem asks to find a solution $x$ such that $||y - Hx|| < \alpha$, for a given norm $||\cdot||$, minimizing the size of the support $||x||_0 := \#\{j \ |\ x_j \neq 0 \}$. We present valid inequalities for Mixed Integer Programming (MIP) formulations for this problem and we show that these families are sufficient to describe the set of feasible supports. This leads to a reformulation of the problem as an Integer Programming (IP) model which in turn represents a Minimum Set Covering formulation, thus yielding many families of valid inequalities which may be used to strengthen the models up. We propose algorithms to solve sparse approximation problems including a branch \& cut for the MIP, a two-stages algorithm to tackle the set covering IP and a heuristic approach based on Local Branching type constraints. These methods are compared in a computational experimentation with the goal of testing their practical potential.


title: Finding Acceptable Parameter Regions of Stochastic Hill functions for Multisite Phosphorylation Mechanism

abstract: Multisite phosphorylation plays an important role in regulating switchlike protein activity and has been used widely in mathematical models. With the development of new experimental techniques and more molecular data, molecular phosphorylation processes emerge in many systems with increasing complexity and sizes. These developments call for simple yet valid stochastic models to describe various multisite phosphorylation processes, especially in large and complex biochemical networks. To reduce model complexity, this work aims to simplify the multisite phosphorylation mechanism by a stochastic Hill function model. Further, this work optimizes regions of parameter space to match simulation results from the stochastic Hill function with the distributive multisite phosphorylation process. While traditional parameter optimization methods have been focusing on finding the best parameter vector, in most circumstances modelers would like to find a set of parameter vectors that generate similar system dynamics and results. This paper proposes a general $\alpha$-$\beta$-$\gamma$ rule to return an acceptable parameter region of the stochastic Hill function based on a quasi-Newton stochastic optimization (QNSTOP) algorithm. Different objective functions are investigated characterizing different features of the simulation-based empirical data, among which the approximate maximum log-likelihood method is recommended for general applications. Numerical results demonstrate that with an appropriate parameter vector value, the stochastic Hill function model depicts the multisite phosphorylation process well except the initial (transient) period.


title: Incidence of Quantum Confinement on Dark Triplet Excitons in Carbon Nanotubes

abstract: Photophysics of single-wall carbon nanotubes (SWCNTs) is intensively studied due to their potential application in light harvesting and optoelectronics. Excited states of SWCNTs form strongly bound electron-hole pairs, excitons, of which only singlet excitons participate in application relevant optical transitions. Long-living spin-triplet states hinder applications but they emerge as candidates for quantum information storage. Therefore knowledge of the triplet exciton energy structure, in particular in a SWCNT chirality dependent manner, is greatly desired. We report the observation of light emission from triplet state recombination, i.e. phosphorescence, for several SWCNT chiralities using a purpose-built spectrometer. This yields the singlet-triplet gap as a function of SWCNT diameter and it follows predictions based on quantum confinement effects. Saturation under high microwave power (up to 10 W) irradiation allows to determine the spin-relaxation time for triplet states. Our study sensitively discriminates whether the lowest optically active state is populated from an excited state on the same nanotube or through F\"orster exciton energy transfer from a neighboring nanotube.


title: Effects of domain walls in bilayer graphene in an external magnetic field

abstract: We investigate bilayer graphene systems with layer switching domain walls separating the two energetically equivalent Bernal stackings in the presence of an external magnetic field. To this end we calculate quantum transport and local densities of three microscopic models for a single domain wall: a hard wall, a defect due to shear, and a defect due to tension. The quantum transport calculations are performed with a recursive Green's function method. Technically, we discuss an explicit algorithm for the separation of a system into subsystems for the recursion and we present an optimization of the well known iteration scheme for lead self-energies for sparse chain couplings. We find strong physical differences for the three different types of domain walls in the integer quantum Hall regime. For a domain wall due to shearing of the upper graphene layer there is a plateau formation in the magnetoconductance for sufficiently wide defect regions. For wide domain walls due to tension in the upper graphene layer there is only an approximate plateau formation with fluctuations of the order of the elementary conuctance quantum $\sigma_0$. A direct transition between stacking regions like for the hard wall domain wall shows no plateau formation and is therefore not a good model for either of the previously mentioned extended domain walls.


title: The transformer earthquake alerting model: A new versatile approach to earthquake early warning

abstract: Earthquakes are major hazards to humans, buildings and infrastructure. Early warning methods aim to provide advance notice of incoming strong shaking to enable preventive action and mitigate seismic risk. Their usefulness depends on accuracy, the relation between true, missed and false alerts, and timeliness, the time between a warning and the arrival of strong shaking. Current approaches suffer from apparent aleatoric uncertainties due to simplified modelling or short warning times. Here we propose a novel early warning method, the deep-learning based transformer earthquake alerting model (TEAM), to mitigate these limitations. TEAM analyzes raw, strong motion waveforms of an arbitrary number of stations at arbitrary locations in real-time, making it easily adaptable to changing seismic networks and warning targets. We evaluate TEAM on two regions with high seismic hazard, Japan and Italy, that are complementary in their seismicity. On both datasets TEAM outperforms existing early warning methods considerably, offering accurate and timely warnings. Using domain adaptation, TEAM even provides reliable alerts for events larger than any in the training data, a property of highest importance as records from very large events are rare in many regions.


title: Strong evidence of $\rho(1250)$ from a unitary multichannel reanalysis of elastic scattering data with crossing-symmetry constraints

abstract: An analysis is presented of elastic $P$-wave $\pi\pi$ phase shifts and inelasticities up to 2 GeV, aimed at identifying the corresponding $J^{PC}=1^{--}$ excited $\rho$ resonances and focusing on the $\rho(1250)$ vs. $\rho(1450)$ controversy. The approach employs an improved parametrization in terms of a manifestly unitary and analytic three-channel $S$-matrix with its complex-energy pole positions. The included channels are $\pi\pi$, $\rho2\pi$, and $\rho\rho$, the latter two being effective in the sense that they mimic several experimentally observed decay modes with nearby thresholds. In an alternative fit, the $\rho2\pi$ mode is replaced by $\omega\pi$, which is also an experimentally relevant channel. The improvement with respect to prior work amounts to the enforcement of maximum crossing symmetry through once-subtracted dispersion relations called GKPY equations. A separate analysis concerns the pion electromagnetic form factor, which again demonstrates the enormous importance of guaranteeing unitarity and analyticity when dealing with very broad and highly inelastic resonances. In the case of $\rho(1250)$ vs. $\rho(1450)$, the failure to do so is shown to give rise to an error in the predicted mass of about 170 MeV. A clear picture emerges from these analyses, identifying five vector $\rho$ states below 2 GeV, viz. $\rho(770)$, $\rho(1250)$, $\rho(1450)$, $\rho(1600)$, and $\rho(1800)$, with $\rho(1250)$ being indisputably the most important excited $\rho$ resonance. The stability of the fits as well as the imposition of unitarity, analyticity, and approximate crossing symmetry in the analyses lend very strong support to these assignments. The possibly far-reaching consequences for meson spectroscopy are discussed.


title: Empirical Evaluation of a 28 GHz Antenna Array on a 5G Mobile Phone Using a Body Phantom

abstract: Implementation of an antenna array on a 5G mobile phone chassis is crucial in ensuring the radio link quality especially at millimeter-waves. However, we generally lack the ability to design antennas under practical operational conditions involving body effects of a mobile user in a repeatable manner. We developed numerical and physical phantoms of a human body for evaluation of mobile handset antennas at 28 GHz. While the numerical phantom retains a realistic and accurate body shape, our physical phantom has much simpler hexagonal cross-section to represent a body. Gains of the phased antenna array configuration on a mobile phone chassis, called co-located array is numerically and experimentally evaluated. The array is formed by placing two sets of 4-element dual-polarized patch antenna arrays, called two modules, at two locations of a mobile phone chassis. Modules are intended to collect the maximum amount of energy to the single transceiver chain. Spherical coverage of the realized gain by the array shows that the experimental statistics of the realized gains across entire solid angles agree with numerical simulations. We thereby demonstrate that our antenna evaluation method reproduces the reality and our phantom serves repeatable tests of antenna array prototypes at 28 GHz.


title: Linear dynamics of the semi-geostrophic equations in Eulerian coordinates on $\mathbb{R}^{3}$

abstract: We consider a class of steady solutions of the semi-geostrophic equations on $\mathbb{R}^3$ and derive the linearised dynamics around those solutions. The linear PDE which governs perturbations around those steady states is a transport equation featuring a pseudo-differential operator of order 0. We study well-posedness of this equation in $L^2(\mathbb{R}^3;\mathbb{R}^3)$ introducing a representation formula for the solutions, and extend the result to the space of tempered distributions on $\mathbb{R}^{3}$. We investigate stability of the steady solutions by looking at plane wave solutions of the linearised problem, and discuss differences in the case of the quasi-geostrophic equations.


title: Relativistic hydrodynamics with momentum dependent relaxation time

abstract: A second order relativistic hydrodynamic theory has been derived using momentum dependent relaxation time in the relativistic transport equation. In order to do that, an iterative technique of gradient expansion approach, namely Chapman-Enskog (CE) expansion of the particle distribution function has been employed. The key findings of this work are, (i) momentum dependent relaxation time in collision term results in an extended Landau matching condition for the thermodynamic variables, (ii) the result from numerical solution of Boltzmann equation lies somewhere in between the two popular extreme limits : linear and quadratic ansatz, indicating a fractional power of momentum dependence in relaxation time to be appropriate, (ii) an equivalence has been established between the iterative gradient expansion method like CE and the well known moment approach like Grad's 14-moment method.


title: The RESOLVE project: a multi-physics experiment with a temporary dense seismic array on the Argenti\`ere Glacier, French Alps

abstract: Recent work in the field of cryo-seismology demonstrates that high frequency (>1 Hz) waves provide key constraints on a wide range of glacier processes such as basal friction, surface crevassing or subglacial water flow. Establishing quantitative links between the seismic signal and the processes of interest however requires detailed characterization of the wavefield, which at the high frequencies of interest necessitates the deployment of large and particularly dense seismic arrays. Although dense seismic array monitoring has recently become routine in geophysics, its application to glaciated environments has yet remained limited. Here we present a dense seismic array experiment made of 98 3-component seismic stations continuously recording during 35 days in early spring on the Argenti\`ere Glacier, French Alps. The seismic dataset is supplemented by a wide range of complementary observations obtained from ground penetrating radar, drone imagery, GNSS positioning and in-situ instrumentation of basal glacier sliding velocities and subglacial water discharge. Through applying multiple processing techniques including event detection from template matching and systematic beamforming, we demonstrate that the present dataset provides enhanced spatial resolution on basal stick slip and englacial fracturing sources as well as novel constraints on heterogeneous nature of the noise field generated by subglacial water flow and on the link between crevasse properties and englacial seismic velocities. We finally outline in which ways further work using this dataset could help tackle key remaining questions in the field.


title: The Sobolev approximation for radiation transport with line overlap and continuous opacity

abstract: The radiation transport problem in the plane-parallel medium with the large velocity gradient is considered. The Sobolev approximation is used. The effects of continuum absorption and line overlap are taken into account. The photon loss probability functions are calculated and tabulated. Two calculations are performed - for the Gaussian spectral line profile and for the rectangular profile. It is shown that at particular choice of the rectangular profile width the results of the calculations are very close. The evaluated photon loss probability functions may be used in the calculations of energy level populations of OH molecule in the interstellar gas flows.


title: Hunt's Formula for $SU_q(N)$ and $U_q(N)$

abstract: We provide a Hunt type formula for the infinitesimal generators of L\'evy process on the quantum groups $SU_q(N)$ and $U_q(N)$. In particular, we obtain a decomposition of such generators into a gaussian part and a `jump type' part determined by a linear functional that resembles the functional induced by the L\'evy measure. The jump part on $SU_q(N)$ decomposes further into parts that live on the quantum subgroups $SU_q(n)$, $n\le N$. Like in the classical Hunt formula for locally compact Lie groups, the ingredients become unique once a certain projection is chosen. There are analogous result for $U_q(N)$.


title: Far-field intensity signature of sub-wavelength microscopic objects

abstract: Information about microscopic objects with features smaller than the diffraction limit is almost entirely lost in a far-field diffraction image but could be partly recovered with data completition techniques. Any such approach critically depends on the level of noise. This new path to superresolution has been recently investigated with the use of compressed sensing and machine learning. We demonstrate a two-stage technique based on deconvolution and genetic optimization which enables the recovery of objects with features of 1/10 of the wavelength. We indicate that l1-norm based optimization in the Fourier domain unrelated to sparsity is more robust to noise than its l2-based counterpart. We also introduce an extremely fast general-purpose restricted domain calculation method for Fourier transform based iterative algorithms operating on sparse data.


title: Probabilistic Resistive Switching Device modeling based on Markov Jump processes

abstract: In this work, a versatile mathematical framework for multi-state probabilistic modeling of Resistive Switching (RS) devices is proposed for the first time. The mathematical formulation of memristor and Markov jump processes are combined and, by using the notion of master equations for finite-states, the inherent probabilistic time-evolution of RS devices is sufficiently modeled. In particular, the methodology is generic enough and can be applied for $N$ states; as a proof of concept, the proposed framework is further stressed for both two-state RS paradigm, namely $N=2$, and multi-state devices, namely $N=4$. The presented I-V results demonstrate in a qualitative and quantitative manner, adequate matching with other modeling approaches.


title: Measuring topological descriptors of complex networks under uncertainty

abstract: Revealing the structural features of a complex system from the observed collective dynamics is a fundamental problem in network science. In order to compute the various topological descriptors commonly used to characterize the structure of a complex system (e.g. the degree, the clustering coefficient), it is usually necessary to completely reconstruct the network of relations between the subsystems. Several methods are available to detect the existence of interactions between the nodes of a network. By observing some physical quantities through time, the structural relationships are inferred using various discriminating statistics (e.g. correlations, mutual information, etc.). In this setting, the uncertainty about the existence of the edges is reflected in the uncertainty about the topological descriptors. In this study, we propose a novel methodological framework to evaluate this uncertainty, replacing the topological descriptors, even at the level of a single node, with appropriate probability distributions, eluding the reconstruction phase. Our theoretical framework agrees with the numerical experiments performed on a large set of synthetic and real-world networks. Our results provide a grounded framework for the analysis and the interpretation of widely used topological descriptors, such as degree centrality, clustering and clusters, in scenarios where the existence of network connectivity is statistically inferred or when the probabilities of existence $\pi_{ij}$ of the edges are known. To this purpose we also provide a simple and mathematically grounded process to transform the discriminating statistics into the probabilities $\pi_{ij}$ .


title: Double-Wing Mixture of Experts for Streaming Recommendations

abstract: Streaming Recommender Systems (SRSs) commonly train recommendation models on newly received data only to address user preference drift, i.e., the changing user preferences towards items. However, this practice overlooks the long-term user preferences embedded in historical data. More importantly, the common heterogeneity in data stream greatly reduces the accuracy of streaming recommendations. The reason is that different preferences (or characteristics) of different types of users (or items) cannot be well learned by a unified model. To address these two issues, we propose a Variational and Reservoir-enhanced Sampling based Double-Wing Mixture of Experts framework, called VRS-DWMoE, to improve the accuracy of streaming recommendations. In VRS-DWMoE, we first devise variational and reservoir-enhanced sampling to wisely complement new data with historical data, and thus address the user preference drift issue while capturing long-term user preferences. After that, we propose a Double-Wing Mixture of Experts (DWMoE) model to first effectively learn heterogeneous user preferences and item characteristics, and then make recommendations based on them. Specifically, DWMoE contains two Mixture of Experts (MoE, an effective ensemble learning model) to learn user preferences and item characteristics, respectively. Moreover, the multiple experts in each MoE learn the preferences (or characteristics) of different types of users (or items) where each expert specializes in one underlying type. Extensive experiments demonstrate that VRS-DWMoE consistently outperforms the state-of-the-art SRSs.


title: Radiative control of localized excitons at room temperature with an ultracompact tip-enhanced plasmonic nano-cavity

abstract: In atomically thin semiconductors, localized exciton (X$_L$) coupled to light shows single quantum emitting behaviors through radiative relaxation processes providing a new class of optical sources for potential applications in quantum communication. In most studies, however, X$_L$ photoluminescence (PL) from crystal defects has mainly been observed in cryogenic conditions because of their sub-wavelength emission region and low quantum yield at room temperature. Furthermore, engineering the radiative relaxation properties, e.g., emission region, intensity, and energy, remained challenging. Here, we present a plasmonic antenna with a triple-sharp-tips geometry to induce and control the X$_L$ emission of a WSe$_2$ monolayer (ML) at room temperature. By placing a ML crystal on the two sharp Au tips in a bowtie antenna fabricated through cascade domino lithography with a radius of curvature of <1 nm, we effectively induce tensile strain in the nanoscale region to create robust X$_L$ states. An Au tip with tip-enhanced photoluminescence (TEPL) spectroscopy is then added to the strained region to probe and control the X$_L$ emission. With TEPL enhancement of X$_L$ as high as ~10$^6$ in the triple-sharp-tips device, experimental results demonstrate the controllable X$_L$ emission in <30 nm area with a PL energy shift up to 40 meV, resolved by tip-enhanced PL and Raman imaging with <15 nm spatial resolution. Our approach provides a systematic way to control localized quantum light in 2D semiconductors offering new strategies for active quantum nano-optical devices.


title: Compact geodesic orbit spaces with a simple isotropy group

abstract: Let $M=G/H$ be a compact, simply connected, Riemannian homogeneous space, where $G$ is (almost) effective and $H$ is a simple Lie group. In this paper, we first classify all $G$-naturally reductive metrics on $M$, and then all $G$-geodesic orbit metrics on $M$.


title: Matter accretion versus semiclassical bounce in Schwarzschild interior

abstract: We discuss the properties of the previously constructed model of a Schwarzschild black hole interior where the singularity is replaced by a regular bounce, ultimately leading to a white hole. The model is semiclassical in nature and uses as a source of gravity the effective stress-energy tensor (SET) corresponding to vacuum polarization of quantum fields, and a minimum spherical radius is a few orders of magnitude larger than the Planck length, so that the effects of quantum gravity should be still negligible. We estimate the other quantum contributions to the effective SET, caused by a nontrivial topology of spatial sections and particle production from vacuum due to a nonstationary gravitational field and show that these contributions are negligibly small as compared to the SET due to vacuum polarization. The same is shown for such classical phenomena as accretion of different kinds of matter to the black hole and its further motion to the would-be singularity. Thus, in a clear sense, our model of a semiclassical bounce instead of a Schwarzschild singularity is stable under both quantum and classical perturbations.


title: Proper connection and proper-walk connection of digraphs

abstract: An arc-colored digraph D is properly (properly-walk) connected if, for any ordered pair of vertices $(u, v)$, the digraph $D$ contains a directed path (a directed walk) from $u$ to $v$ such that arcs adjacent on that path (on that walk) have distinct colors. The proper connection number $\overrightarrow{pc}(D)$ (the proper-walk connection number $\overrightarrow{wc}(D)$) of a digraph $D$ is the minimum number of colours to make $D$ properly connected (properly-walk connected). We prove that $\overrightarrow{pc}(C_n(S)) \leq 2$ for every circulant digraph $C_n(S)$ with $S\subseteq\{1,\ldots ,n-1\}, |S|\ge 2$ and $1\in S$. Furthermore, we give some sufficient conditions for a Hamiltonian digraph $D$ to satisfy $\overrightarrow{pc}(D)= \overrightarrow{wc}(D) = 2$.


title: Adaptive Generation Model: A New Ensemble Method

abstract: As a common method in Machine Learning, Ensemble Method is used to train multiple models from a data set and obtain better results through certain combination strategies. Stacking method, as representatives of Ensemble Learning methods, is often used in Machine Learning Competitions such as Kaggle. This paper proposes a variant of Stacking Model based on the idea of gcForest, namely Adaptive Generation Model (AGM). It means that the adaptive generation is performed not only in the horizontal direction to expand the width of each layer model, but also in the vertical direction to expand the depth of the model. For base models of AGM, they all come from preset basic Machine Learning Models. In addition, a feature augmentation method is added between layers to further improve the overall accuracy of the model. Finally, through comparative experiments on 7 data sets, the results show that the accuracy of AGM are better than its previous models.


title: Planck intermediate results. LV. Reliability and thermal properties of high-frequency sources in the Second Planck Catalogue of Compact Sources

abstract: We describe an extension of the most recent version of the Planck Catalogue of Compact Sources (PCCS2), produced using a new multi-band Bayesian Extraction and Estimation Package (BeeP). BeeP assumes that the compact sources present in PCCS2 at 857 GHz have a dust-like spectral energy distribution, which leads to emission at both lower and higher frequencies, and adjusts the parameters of the source and its SED to fit the emission observed in Planck's three highest frequency channels at 353, 545, and 857 GHz, as well as the IRIS map at 3000 GHz. In order to reduce confusion regarding diffuse cirrus emission, BeeP's data model includes a description of the background emission surrounding each source, and it adjusts the confidence in the source parameter extraction based on the statistical properties of the spatial distribution of the background emission. BeeP produces the following three new sets of parameters for each source: (a) fits to a modified blackbody (MBB) thermal emission model of the source; (b) SED-independent source flux densities at each frequency considered; and (c) fits to an MBB model of the background in which the source is embedded. BeeP also calculates, for each source, a reliability parameter, which takes into account confusion due to the surrounding cirrus. We define a high-reliability subset (BeeP/base), containing 26 083 sources (54.1 per cent of the total PCCS2 catalogue), the majority of which have no information on reliability in the PCCS2. The results of the BeeP extension of PCCS2, which are made publicly available via the PLA, will enable the study of the thermal properties of well-defined samples of compact Galactic and extra-galactic dusty sources.


title: Proceedings Applied Category Theory 2019

abstract: Applied Category Theory is a new conference series. All papers are carefully refereed, and the bar for acceptance is high. This 1st occurrence in this format resulted in some 70 submitted papers and 150 attendants. The conference is part of the Compositionally family, a new diamond open access journal.


title: Fluctuation guided search in quantum annealing

abstract: Quantum annealing has great promise in leveraging quantum mechanics to solve combinatorial optimisation problems. However, to realize this promise to it's fullest extent we must appropriately leverage the underlying physics. In this spirit, I examine how the well known tendency of quantum annealers to seek solutions where more quantum fluctuations are allowed can be used to trade off optimality of the solution to a synthetic problem for the ability to have a more flexible solution, where some variables can be changed at little or no cost. I demonstrate this tradeoff experimentally using the reverse annealing feature a D-Wave Systems QPU for both problems composed of all binary variables, and those containing some higher-than-binary discrete variables. I further demonstrate how local controls on the qubits can be used to control the levels of fluctuations and guide the search. I discuss places where leveraging this tradeoff could be practically important, namely in hybrid algorithms where some penalties cannot be directly implemented on the annealer and provide some proof-of-concept evidence of how these algorithms could work.


title: Decidability of the Multiplicative and Order Theory of Numbers

abstract: The ordered structures of natural, integer, rational and real numbers are studied in this thesis. The theories of these numbers in the language of order are decidable and finitely axiomatizable. Also, their theories in the language of order and addition are decidable and infinitely axiomatizable. For the language of order and multiplication, it is known that the theories of $\mathbb{N}$ and $\mathbb{Z}$ are not decidable (and so not axiomatizable by any computably enumerable set of sentences). By Tarski's theorem, the multiplicative ordered structure of $\mathbb{R}$ is decidable also. In this thesis we prove this result directly by quantifier elimination and present an explicit infinite axiomatization. The structure of $\mathbb{Q}$ in the language of order and multiplication seems to be missing in the literature. We show the decidability of its theory by the technique of quantifier elimination and after presenting an infinite axiomatization for this structure, we prove that it is not finitely axiomatizable.


title: Towards an RDF Knowledge Graph of Scholars from Early Modern History

abstract: The use of Semantic Web Technologies supports research in the field of digital humanities. In this paper we focus on the creation of semantic independent online databases such as those of historical prosopography. These databases contain biographical information of historical persons. We focus on this information with an interest in German professorial career patterns from the 16th to the 18th century. In that respect, we describe the process of building an Early Modern Scholarly Career RDF Knowledge Graph from two existing prosopography online databases: the Catalogus Professorum Lipsiensium and the Catalogus Professorum Helmstadiensium. Further, we provide an insight in how to query the information using KBox to answer research questions.


title: 3-D macro/microporous-nanofibrous bacterial cellulose scaffolds seeded with BMP-2 preconditioned mesenchymal stem cells exhibit remarkable potential for bone tissue engineering

abstract: Bone repair using BMP-2 is a promising therapeutic approach in clinical practices, however, high dosages required to be effective pose issues of cost and safety. The present study explores the potential of low dose BMP-2 treatment via tissue engineering approach, which amalgamates 3-D macro/microporous-nanofibrous bacterial cellulose (mNBC) scaffolds and low dose BMP-2 primed murine mesenchymal stem cells (C3H10T1/2 cells). Initial studies on cell-scaffold interaction using unprimed C3H10T1/2 cells confirmed that scaffolds provided a propitious environment for cell adhesion, growth, and infiltration, owing to its ECM-mimicking nano-micro-macro architecture. Osteogenic studies were conducted by preconditioning the cells with 50 ng/mL BMP-2 for 15 minutes, followed by culturing on mNBC scaffolds for up to three weeks. The results showed an early onset and significantly enhanced bone matrix secretion and maturation in the scaffolds seeded with BMP-2 primed cells compared to the unprimed ones. Moreover, mNBC scaffolds alone were able to facilitate the mineralization of cells to some extent. These findings suggest that, with the aid of 'osteoinduction' from low dose BMP-2 priming of stem cells and 'osteoconduction' from nano-macro/micro topography of mNBC scaffolds, a cost-effective bone tissue engineering strategy can be designed for quick and excellent in vivo osseointegration.


title: Lagrangian theory of structure formation in relativistic cosmology. VI. Comparison with Szekeres exact solutions

abstract: We examine the relation between the Szekeres models and relativistic Lagrangian perturbation schemes, in particular the Relativistic Zel'dovich Approximation (RZA). We show that the second class of the Szekeres solutions is exactly contained within the RZA when the latter is restricted to an irrotational dust source with a flow-orthogonal foliation of spacetime. In such a case, the solution is governed by the first principal scalar invariant of the deformation field, proving a direct connection with a class of Newtonian three-dimensional solutions without symmetry. For the second class, a necessary and sufficient condition for the vanishing of cosmological backreaction on a scale of homogeneity is expressed through integral constraints. Domains with no backreaction can be smoothly matched, forming a lattice model, where exact deviations average out at a given scale of homogeneity, and the homogeneous and isotropic background is recovered as an average property of the model. Although the connection with the first class of Szekeres solutions is not straightforward, this class allows for the interpretation in terms of a spatial superposition of nonintersecting fluid lines, where each world line evolves independently and under the RZA model equations, but with different associated `local backgrounds'. This points to the possibility of generalizing the Lagrangian perturbation schemes to structure formation models on evolving backgrounds, including global cosmological backreaction.


title: Continuous dictionaries meet low-rank tensor approximations

abstract: In this short paper we bridge two seemingly unrelated sparse approximation topics: continuous sparse coding and low-rank approximations. We show that for a specific choice of continuous dictionary, linear systems with nuclear-norm regularization have the same solutions as a BLasso problem. Although this fact was already partially understood in the matrix case, we further show that for tensor data, using BLasso solvers for the low-rank approximation problem leads to a new branch of optimization methods yet vastly unexplored. In particular, the proposed Frank-Wolfe algorithm is showcased on an automatic tensor rank selection problem.


title: A Detail Study of Security and Privacy issues of Internet of Things

abstract: The Internet of Things, or IoT, refers to the billions of physical objects around the planet that are now connected to the Internet, many of which store and exchange the data without human interaction. In recent years the Internet of Things (IoT) has incredibly become a groundbreaking technical innovation that has contributed to massive impact in the ways where all the information is handled incorporate companies, computer devices, and even kitchen equipment and appliances, are designed and made. The main focus of this chapter is to systematically review the security and privacy of the Internet of Things in the present world. Most internet users are genuine, yet others are cybercriminals with individual expectations of misusing information. With such possibilities, users should know the potential security and privacy issues of IoT devices. IoT innovations are applied on numerous levels in a system that we use daily in our day-to-day life. Data confidentiality is a significant issue. The interconnection of various networks makes it impossible for users to assert extensive control of their data. Finally, this chapter discusses the IoT Security concerns in the literature and providing a critical review of the current approach and proposed solutions on present issues on the Privacy protection of IoT devices.


title: Reservoir Memory Machines as Neural Computers

abstract: Differentiable neural computers extend artificial neural networks with an explicit memory without interference, thus enabling the model to perform classic computation tasks such as graph traversal. However, such models are difficult to train, requiring long training times and large datasets. In this work, we achieve some of the computational capabilities of differentiable neural computers with a model that can be trained very efficiently, namely an echo state network with an explicit memory without interference. This extension enables echo state networks to recognize all regular languages, including those that contractive echo state networks provably can not recognize. Further, we demonstrate experimentally that our model performs comparably to its fully-trained deep version on several typical benchmark tasks for differentiable neural computers.


title: Short-Term Forecasting COVID-19 Cases In Turkey Using Long Short-Term Memory Network

abstract: COVID-19 has been one of the most severe diseases, causing a harsh pandemic all over the world, since December 2019. The aim of this study is to evaluate the value of Long Short-Term Memory (LSTM) Networks in forecasting the total number of COVID-19 cases in Turkey. The COVID-19 data for 30 days, between March 24 and April 23, 2020, are used to estimate the next fifteen days. The mean absolute error of the LSTM Network for 15 days estimation is 1,69$\pm$1.35%. Whereas, for the same data, the error of the Box-Jenkins method is 3.24$\pm$1.56%, Prophet method is 6.88$\pm$4.96% and Holt-Winters Additive method with Damped Trend is 0.47$\pm$0.28%. Additionally, when the number of deaths data is also provided with the number of total cases to the input of LSTM Network, the mean error reduces to 0.99$\pm$0.51%. Consequently, addition of the number of deaths data to the input, results a lower error in forecasting, compared to using only the number of total cases as the input. However, Holt-Winters Additive method with Damped Trend gives superior results to LSTM Networks in forecasting the total number of COVID-19 cases.


title: A glimpse into Thurston's work

abstract: We present an overview of some significant results of Thurston and their impact on mathematics. The final version of this paper will appear as Chapter 1 of the book "In the tradition of Thurston: Geometry and topology", edited by K. Ohshika and A. Papadopoulos (Springer, 2020).


title: Data fusion strategies for energy efficiency in buildings: Overview, challenges and novel orientations

abstract: Recently, tremendous interest has been devoted to develop data fusion strategies for energy efficiency in buildings, where various kinds of information can be processed. However, applying the appropriate data fusion strategy to design an efficient energy efficiency system is not straightforward; it requires a priori knowledge of existing fusion strategies, their applications and their properties. To this regard, seeking to provide the energy research community with a better understanding of data fusion strategies in building energy saving systems, their principles, advantages, and potential applications, this paper proposes an extensive survey of existing data fusion mechanisms deployed to reduce excessive consumption and promote sustainability. We investigate their conceptualizations, advantages, challenges and drawbacks, as well as performing a taxonomy of existing data fusion strategies and other contributing factors. Following, a comprehensive comparison of the state-of-the-art data fusion based energy efficiency frameworks is conducted using various parameters, including data fusion level, data fusion techniques, behavioral change influencer, behavioral change incentive, recorded data, platform architecture, IoT technology and application scenario. Moreover, a novel method for electrical appliance identification is proposed based on the fusion of 2D local texture descriptors, where 1D power signals are transformed into 2D space and treated as images. The empirical evaluation, conducted on three real datasets, shows promising performance, in which up to 99.68% accuracy and 99.52% F1 score have been attained. In addition, various open research challenges and future orientations to improve data fusion based energy efficiency ecosystems are explored.


title: Representation stability for diagram algebras

abstract: We introduce stability categories for diagram algebras---analogues to Randal-Williams and Wahl's homogeneous categories. We use these to study representation stability properties of the Temperley--Lieb algebras, the Brauer algebras, and the partition algebras.


title: Accelerated Nonlinear Model Predictive Control by Exploiting Saturation

abstract: We present an approach for accelerating nonlinear model predictive control. If the current optimal input signal is saturated, also the optimal signals in subsequent time steps often are. We propose to use the open-loop optimal input signals whenever the first and some subsequent input signals are saturated. We only solve the next optimal control problem, when a non-saturated signal is encountered, or the end of the horizon is reached. In this way, we can save a significant number of NLPs to be solved while on the other hand keep the performance loss small. Furthermore, the NMPC is reactivated in time when it comes to controlling the system safely to its reference.


title: Non-Gaussian Nature and Entanglement of Spontaneous Parametric Nondegenerate Triple-Photon Generation

abstract: How to prepare deterministically non-Gaussian entangled states is a fundamental question for continuous-variable quantum information technology. Here, we theoretically demonstrate through numerical methods that the triple-photon state generated by three-photon spontaneous parametric down-conversion is a pure super-Gaussian resource of non-Gaussian entanglement. Interestingly, the degree of entanglement between the modes of the triple-photon state is stronger than that corresponding to the two-mode squeezed vacuum state produced by a quadratic Hamiltonian with the same parameters. Furthermore, we propose a model to prepare two-mode non-Gaussian entangled states with tunable non-Gaussianity based on quadrature projection measurements.


title: Play MNIST For Me! User Studies on the Effects of Post-Hoc, Example-Based Explanations & Error Rates on Debugging a Deep Learning, Black-Box Classifier

abstract: This paper reports two experiments (N=349) on the impact of post hoc explanations by example and error rates on peoples perceptions of a black box classifier. Both experiments show that when people are given case based explanations, from an implemented ANN CBR twin system, they perceive miss classifications to be more correct. They also show that as error rates increase above 4%, people trust the classifier less and view it as being less correct, less reasonable and less trustworthy. The implications of these results for XAI are discussed.


title: Upstreamness and downstreamness in input-output analysis from local and aggregate information

abstract: Ranking sectors and countries within global value chains is of paramount importance to estimate risks and forecast growth in large economies. However, this task is often non-trivial due to the lack of complete and accurate information on the flows of money and goods between sectors and countries, which are encoded in Input-Output (I-O) tables. In this work, we show that an accurate estimation of the role played by sectors and countries in supply chain networks can be achieved without full knowledge of the I-O tables, but only relying on local and aggregate information, e.g., the total intermediate demand per sector. Our method, based on a rank-$1$ approximation to the I-O table, shows consistently good performance in reconstructing rankings (i.e., upstreamness and downstreamness measures for countries and sectors) when tested on empirical data from the World Input-Output Database. Moreover, we connect the accuracy of our approximate framework with the spectral properties of the I-O tables, which ordinarily exhibit relatively large spectral gaps. Our approach provides a fast and analytical tractable framework to rank constituents of a complex economy without the need of matrix inversions and the knowledge of finer intersectorial details.

categories: physics.soc-ph cond-mat.stat-mech econ.GN q-fin.EC q-fin.GN


title: Inferring the gravitational wave memory for binary coalescence events

abstract: Full, non-linear general relativity predicts a memory effect for gravitational waves. For compact binary coalescence, the total gravitational memory serves as an inferred observable, conceptually on the same footing as the mass and the spin of the final black hole. Given candidate waveforms for any LIGO event, then, one can calculate the posterior probability distribution functions for the total gravitational memory, and use them to compare and contrast the waveforms. In this paper we present these posterior distributions for the binary black hole merger events reported in the first Gravitational Wave Transient Catalog (GWTC-1), using the Phenomenological and Effective-One-Body waveforms. On the whole, the two sets of posterior distributions agree with each other quite well though we find larger discrepancies for the $\ell=2, m=1$ mode of the memory. This signals a possible source of systematic errors that was not captured by the posterior distributions of other inferred observables. Thus, the posterior distributions of various angular modes of total memory can serve as diagnostic tools to further improve the waveforms. Analyses such as this would be valuable especially for future events as the sensitivity of ground based detectors improves, and for LISA which could measure the total gravitational memory directly.


title: An explicit Dobrushin uniqueness region for Gibbs point processes with repulsive interactions

abstract: We present a uniqueness result for Gibbs point processes with interactions that come from a non-negative pair potential; in particular, we provide an explicit uniqueness region in terms of activity $z$ and inverse temperature $\beta$. The technique used relies on applying to the continuous setting the classical Dobrushin criterion. We also present a comparison to the two other uniqueness methods of cluster expansion and disagreement percolation, which can also be applied for this type of interactions.


title: Visualization of the strain-induced topological phase transition in a quasi-one-dimensional superconductor TaSe3

abstract: Control of the phase transition from topological to normal insulators can allow for an on/off switching of spin current. While topological phase transitions have been realized by elemental substitution in semiconducting alloys, such an approach requires the preparation of materials with various compositions, thus it is quite far from a feasible device application, which demands a reversible operation. Here we use angle-resolved photoemission spectroscopy (ARPES) and spin-resolved ARPES to visualize the strain-driven band structure evolution of the quasi-1D superconductor TaSe3. We demonstrate that it undergoes reversible strain-induced topological phase transitions from a strong topological insulator phase with spin-polarized, quasi-1D topological surface states, to topologically trivial semimetal and band insulating phases. The quasi-1D superconductor TaSe3 provides a suitable platform for engineering the topological spintronics, for example as an on/off switch for spin current robust against impurity scattering.


title: QED: A Framework and Dataset for Explanations in Question Answering

abstract: A question answering system that in addition to providing an answer provides an explanation of the reasoning that leads to that answer has potential advantages in terms of debuggability, extensibility and trust. To this end, we propose QED, a linguistically informed, extensible framework for explanations in question answering. A QED explanation specifies the relationship between a question and answer according to formal semantic notions such as referential equality, sentencehood, and entailment. We describe and publicly release an expert-annotated dataset of QED explanations built upon a subset of the Google Natural Questions dataset, and report baseline models on two tasks -- post-hoc explanation generation given an answer, and joint question answering and explanation generation. In the joint setting, a promising result suggests that training on a relatively small amount of QED data can improve question answering. In addition to describing the formal, language-theoretic motivations for the QED approach, we describe a large user study showing that the presence of QED explanations significantly improves the ability of untrained raters to spot errors made by a strong neural QA baseline.


title: Using Graph Convolutional Networks and TD($\lambda$) to play the game of Risk

abstract: Risk is 6 player game with significant randomness and a large game-tree complexity which poses a challenge to creating an agent to play the game effectively. Previous AIs focus on creating high-level handcrafted features determine agent decision making. In this project, I create D.A.D, A Risk agent using temporal difference reinforcement learning to train a Deep Neural Network including a Graph Convolutional Network to evaluate player positions. This is used in a game-tree to select optimal moves. This allows minimal handcrafting of knowledge into the AI, assuring input features are as low-level as possible to allow the network to extract useful and sophisticated features itself, even with the network starting from a random initialisation. I also tackle the issue of non-determinism in Risk by introducing a new method of interpreting attack moves necessary for the search. The result is an AI which wins 35% of the time versus 5 of best inbuilt AIs in Lux Delux, a Risk variant.


title: Exploring Level Blending across Platformers via Paths and Affordances

abstract: Techniques for procedural content generation via machine learning (PCGML) have been shown to be useful for generating novel game content. While used primarily for producing new content in the style of the game domain used for training, recent works have increasingly started to explore methods for discovering and generating content in novel domains via techniques such as level blending and domain transfer. In this paper, we build on these works and introduce a new PCGML approach for producing novel game content spanning multiple domains. We use a new affordance and path vocabulary to encode data from six different platformer games and train variational autoencoders on this data, enabling us to capture the latent level space spanning all the domains and generate new content with varying proportions of the different domains.


title: Automatic elimination of the pectoral muscle in mammograms based on anatomical features

abstract: Digital mammogram inspection is the most popular technique for early detection of abnormalities in human breast tissue. When mammograms are analyzed through a computational method, the presence of the pectoral muscle might affect the results of breast lesions detection. This problem is particularly evident in the mediolateral oblique view (MLO), where pectoral muscle occupies a large part of the mammography. Therefore, identifying and eliminating the pectoral muscle are essential steps for improving the automatic discrimination of breast tissue. In this paper, we propose an approach based on anatomical features to tackle this problem. Our method consists of two steps: (1) a process to remove the noisy elements such as labels, markers, scratches and wedges, and (2) application of an intensity transformation based on the Beta distribution. The novel methodology is tested with 322 digital mammograms from the Mammographic Image Analysis Society (mini-MIAS) database and with a set of 84 mammograms for which the area normalized error was previously calculated. The results show a very good performance of the method.


title: Improving Language Generation with Sentence Coherence Objective

abstract: Conditional story generation and contextual text continuation have become increasingly popular topics in NLP community. Existing models are often prone to output paragraphs of texts that gradually diverge from the given prompt. Although the generated text may have a reasonable perplexity and diversity, it could easily be identified by human as gibberish. The goal of our project is to improve the coherence and consistency across sentences in a language-generation model. We aim to solve this issue by first training a sentence pair coherence classifier with GPT-2 pretrained model, and then co-train the GPT-2 language model with this new coherence objective using a method analogous to the REINFORCE algorithm. This fine-tuned language model is able to generate lengthy paragraph conditioned on a given topic without diverging too much. The simplicity of this model allows it to be applicable to a variety of underlying language model architecture since it only modifies the final layer of the pre-trained model.


title: The solitary wave in advanced nuclear energy system

abstract: The solitary wave naturally arises in many areas of mathematical physics, including in nonlinear optics, plasma physics, quantum field theory, and fluid mechanics. In the past few years, for an advanced nuclear energy system, a particular class of traveling wave reactor called the Constant Axial shape of Neutron flux, nuclide number densities and power shape During Life of Energy production (CANDLE) reactor has been proposed, and an analytical solution has been desired since it could reveal the global characters of the solution. In this study, from the perspective of the solitary wave, the analytical solution of this advanced nuclear energy system is demonstrated through coupling the one-group neutron diffusion equation with the burnup equation. The tanh-function method is applied to solve that nonlinear partial differential equation. The relationship between the velocity of the solitary wave, wave amplitude, or neutron flux and the evolution of the nuclide is revealed by the analytical method. The results demonstrate that the neutron flux is proportional to the wave velocity. The results also imply that the amplitude of the neutron flux is proportional to the square root of the diffusion coefficient but is inversely proportional to the initial 238U density.


title: PRAFlow_RVC: Pyramid Recurrent All-Pairs Field Transforms for Optical Flow Estimation in Robust Vision Challenge 2020

abstract: Optical flow estimation is an important computer vision task, which aims at estimating the dense correspondences between two frames. RAFT (Recurrent All Pairs Field Transforms) currently represents the state-of-the-art in optical flow estimation. It has excellent generalization ability and has obtained outstanding results across several benchmarks. To further improve the robustness and achieve accurate optical flow estimation, we present PRAFlow (Pyramid Recurrent All-Pairs Flow), which builds upon the pyramid network structure. Due to computational limitation, our proposed network structure only uses two pyramid layers. At each layer, the RAFT unit is used to estimate the optical flow at the current resolution. Our model was trained on several simulate and real-image datasets, submitted to multiple leaderboards using the same model and parameters, and won the 2nd place in the optical flow task of ECCV 2020 workshop: Robust Vision Challenge.


title: Phenomenological description of bright domain walls in ferroelectric-antiferroelectric layered chalcogenides

abstract: Recently, a layered ferroelectric CuInP2Se6 was shown to exhibit domain walls with locally enhanced piezoresponse - a striking departure from the observations of nominally zero piezoresponse in most ferroelectrics. Although it was proposed that such "bright" domain walls are phase-boundaries between ferri- and antiferroelectrically ordered regions of the materials, the physical mechanisms behind the existence and response of these boundaries remain to be understood. Here, using Landau-Ginzburg-Devonshire phenomenology combined with four sub-lattices model, we describe quantitatively the bright-contrast and dark-contrast domain boundaries between the antiferroelectric, ferroelectric or ferrielectric long-range ordered phases in a layered ferroelectric-antiferroelectric ferroics, such as CuInP2(S1-ySey)6


title: Local pointwise second derivative estimates for strong solutions to the $\sigma_k$-Yamabe equation on Euclidean domains

abstract: We prove local pointwise second derivative estimates for positive $W^{2,p}$ solutions to the $\sigma_k$-Yamabe equation on Euclidean domains, addressing both the positive and negative cases. Generalisations for augmented Hessian equations are also considered.


title: JXES: JSON Support for the XES Event Log Standard

abstract: Process mining assumes the existence of an event log where each event refers to a case, an activity, and a point in time. XES is an XML based IEEE approved standard format for event logs supported by most of the process mining tools. JSON (JavaScript Object Notation) is a lightweight data interchange format. In this paper, we present JXES, the JSON standard for the event logs and also provide implementation in ProM for importing and exporting event logs in JSON format using 4 different parsers. The evaluation results show notable performance differences between the different parsers (Simple JSON, Jackson, GSON, Jsoninter).


title: 4Seasons: A Cross-Season Dataset for Multi-Weather SLAM in Autonomous Driving

abstract: We present a novel dataset covering seasonal and challenging perceptual conditions for autonomous driving. Among others, it enables research on visual odometry, global place recognition, and map-based re-localization tracking. The data was collected in different scenarios and under a wide variety of weather conditions and illuminations, including day and night. This resulted in more than 350 km of recordings in nine different environments ranging from multi-level parking garage over urban (including tunnels) to countryside and highway. We provide globally consistent reference poses with up-to centimeter accuracy obtained from the fusion of direct stereo visual-inertial odometry with RTK-GNSS. The full dataset is available at https://www.4seasons-dataset.com.


title: Fraud Detection using Data-Driven approach

abstract: The extensive use of the internet is continuously drifting businesses to incorporate their services in the online environment. One of the first spectrums to embrace this evolution was the banking sector. In fact, the first known online banking service came in 1980. It was deployed from a community bank located in Knoxville, called the United American Bank. Since then, internet banking has been offering ease and efficiency to costumers in completing their daily banking tasks. The ever increasing use of internet banking and a large number of online transactions increased fraudulent behavior also. As if fraud increase was not enough, the massive number of online transactions further increased the data complexity. Modern data sources are not only complex but generated at high speed and in real-time as well. This presents a serious problem and a definite reason why more advanced solutions are desired to protect financial service companies and credit cardholders. Therefore, this research paper aims to construct an efficient fraud detection model which is adaptive to customer behavior changes and tends to decrease fraud manipulation, by detecting and filtering fraud in real-time. In order to achieve this aim, a review of various methods is conducted, adding above a personal experience working in the Banking sector, specifically in the Fraud Detection office. Unlike the majority of reviewed methods, the proposed model in this research paper is able to detect fraud in the moment of occurrence using an incremental classifier. The evaluation of synthetic data, based on fraud scenarios selected in collaboration with domain experts that replicate typical, real-world attacks, shows that this approach correctly ranks complex frauds. In particular, our proposal detects fraudulent behavior and anomalies with up to 97\% detection rate while maintaining a satisfyingly low cost.


title: Comparison of Deep Learning and Traditional Machine Learning Techniques for Classification of Pap Smear Images

abstract: A comprehensive study on machine and deep learning techniques for classification of normal and abnormal cervical cells by using pap smear images from Herlev dataset results are presented. This dataset includes 917 images and 7 different classes. All techniques used in this study are modeled by using Google Colab platform with scikit-learn and Keras library inside TensorFlow. In the first study, traditional machine learning methods such as logistic regression, k-Nearest Neighbors (kNN), Support Vector Machine (SVM), Decision Tree, Random Forest and eXtreme Gradient Boosting (XGBoost) are used and compared with each other to find binary classification as normal and abnormal cervical cells. Better results are observed by XGBoost and kNN classifiers among the others with an accuracy of 85%. In the second study, a deep learning model based on Convolutional Neural Network(CNN) is used for the same dataset. Accordingly, accuracies of 99% and 93% are obtained for the training and the test dataset, respectively. In this model, it takes 50 epochs to have these accuracies within 20 minutes of computational time.


title: GeDi: Generative Discriminator Guided Sequence Generation

abstract: While large-scale language models (LMs) are able to imitate the distribution of natural language well enough to generate realistic text, it is difficult to control which regions of the distribution they generate. This is especially problematic because datasets used for training large LMs usually contain significant toxicity, hate, bias, and negativity. We propose GeDi as an efficient method for using smaller LMs as generative discriminators to guide generation from large LMs to make them safer and more controllable. GeDi guides generation at each step by computing classification probabilities for all possible next tokens via Bayes rule by normalizing over two class-conditional distributions; one conditioned on the desired attribute, or control code, and another conditioned on the undesired attribute, or anti control code. We find that GeDi gives stronger controllability than the state of the art method while also achieving generation speeds more than 30 times faster. Additionally, training GeDi on only four topics allows us to controllably generate new topics zero-shot from just a keyword, unlocking a new capability that previous controllable generation methods do not have. Lastly, we show that GeDi can make GPT-2 (1.5B parameters) significantly less toxic without sacrificing linguistic quality, making it by far the most practical existing method for detoxifying large language models while maintaining a fast generation speed.


title: Searching for a Search Method: Benchmarking Search Algorithms for Generating NLP Adversarial Examples

abstract: We study the behavior of several black-box search algorithms used for generating adversarial examples for natural language processing (NLP) tasks. We perform a fine-grained analysis of three elements relevant to search: search algorithm, search space, and search budget. When new search algorithms are proposed in past work, the attack search space is often modified alongside the search algorithm. Without ablation studies benchmarking the search algorithm change with the search space held constant, one cannot tell if an increase in attack success rate is a result of an improved search algorithm or a less restrictive search space. Additionally, many previous studies fail to properly consider the search algorithms' run-time cost, which is essential for downstream tasks like adversarial training. Our experiments provide a reproducible benchmark of search algorithms across a variety of search spaces and query budgets to guide future research in adversarial NLP. Based on our experiments, we recommend greedy attacks with word importance ranking when under a time constraint or attacking long inputs, and either beam search or particle swarm optimization otherwise. Code implementation shared via https://github.com/QData/TextAttack-Search-Benchmark


title: Antipodal identification in the Schwarschild spacetime

abstract: Through a M\"obius transformation, we study aspects like topology, ligth cones, horizons, curvature singularity, lines of constant Schwarzschild coordinates $r$ and $t$, null geodesics, and transformed metric, of the spacetime $(SKS/2)^\prime$ that results from: i) the antipode identification in the Schwarzschild-Kruskal-Szekeres ($SKS$) spacetime, and ii) the suppression of the consequent conical singularity. In particular, one obtains a non simply-connected topology: $(SKS/2)^\prime\cong \mathbb{R}^{2*}\times S^2$ and, as expected, bending light cones.


title: Transparency and granularity in the SP Theory of Intelligence and its realisation in the SP Computer Model

abstract: This chapter describes how the SP System, meaning the SP Theory of Intelligence, and its realisation as the SP Computer Model, may promote transparency and granularity in AI, and some other areas of application. The chapter describes how transparency in the workings and output of the SP Computer Model may be achieved via three routes: 1) the program provides a very full audit trail for such processes as recognition, reasoning, analysis of language, and so on. There is also an explicit audit trail for the unsupervised learning of new knowledge; 2) knowledge from the system is likely to be granular and easy for people to understand; and 3) there are seven principles for the organisation of knowledge which are central in the workings of the SP System and also very familiar to people (eg chunking-with-codes, part-whole hierarchies, and class-inclusion hierarchies), and that kind of familiarity in the way knowledge is structured by the system, is likely to be important in the interpretability, explainability, and transparency of that knowledge. Examples from the SP Computer Model are shown throughout the chapter.


title: SeqROCTM: A Matlab toolbox for the analysis of Sequence of Random Objects driven by Context Tree Models

abstract: In several research problems we deal with probabilistic sequences of inputs (e.g., sequence of stimuli) from which an agent generates a corresponding sequence of responses and it is of interest to model the relation between them. A new class of stochastic processes, namely \textit{sequences of random objects driven by context tree models}, has been introduced to model such relation in the context of auditory statistical learning. This paper introduces a freely available Matlab toolbox (SeqROCTM) that implements this new class of stochastic processes and three model selection procedures to make inference on it. Besides, due to the close relation of the new mathematical framework with context tree models, the toolbox also implements several existing model selection algorithms for context tree models.


title: Not-NUTs at W-NUT 2020 Task 2: A BERT-based System in Identifying Informative COVID-19 English Tweets

abstract: As of 2020 when the COVID-19 pandemic is full-blown on a global scale, people's need to have access to legitimate information regarding COVID-19 is more urgent than ever, especially via online media where the abundance of irrelevant information overshadows the more informative ones. In response to such, we proposed a model that, given an English tweet, automatically identifies whether that tweet bears informative content regarding COVID-19 or not. By ensembling different BERTweet model configurations, we have achieved competitive results that are only shy of those by top performing teams by roughly 1% in terms of F1 score on the informative class. In the post-competition period, we have also experimented with various other approaches that potentially boost generalization to a new dataset.


title: RLCFR: Minimize Counterfactual Regret by Deep Reinforcement Learning

abstract: Counterfactual regret minimization (CFR) is a popular method to deal with decision-making problems of two-player zero-sum games with imperfect information. Unlike existing studies that mostly explore for solving larger scale problems or accelerating solution efficiency, we propose a framework, RLCFR, which aims at improving the generalization ability of the CFR method. In the RLCFR, the game strategy is solved by the CFR in a reinforcement learning framework. And the dynamic procedure of iterative interactive strategy updating is modeled as a Markov decision process (MDP). Our method, RLCFR, then learns a policy to select the appropriate way of regret updating in the process of iteration. In addition, a stepwise reward function is formulated to learn the action policy, which is proportional to how well the iteration strategy is at each step. Extensive experimental results on various games have shown that the generalization ability of our method is significantly improved compared with existing state-of-the-art methods.


title: OneStopTuner: An End to End Architecture for JVM Tuning of Spark Applications

abstract: Java is the backbone of widely used big data frameworks, such as Apache Spark, due to its productivity, portability from JVM-based execution, and support for a rich set of libraries. However, the performance of these applications can widely vary depending on the runtime flags chosen out of all existing JVM flags. Manually tuning these flags is both cumbersome and error-prone. Automated tuning approaches can ease the task, but current solutions either require considerable processing time or target a subset of flags to avoid time and space requirements. In this paper, we present OneStopTuner, a Machine Learning based novel framework for autotuning JVM flags. OneStopTuner controls the amount of data generation by leveraging batch mode active learning to characterize the user application. Based on the user-selected optimization metric, OneStopTuner then discards the irrelevant JVM flags by applying feature selection algorithms on the generated data. Finally, it employs sample efficient methods such as Bayesian optimization and regression guided Bayesian optimization on the shortlisted JVM flags to find the optimal values for the chosen set of flags. We evaluated OneStopTuner on widely used Spark benchmarks and compare its performance with the traditional simulated annealing based autotuning approach. We demonstrate that for optimizing execution time, the flags chosen by OneStopTuner provides a speedup of up to 1.35x over default Spark execution, as compared to 1.15x speedup by using the flag configurations proposed by simulated annealing. OneStopTuner was able to reduce the number of executions for data-generation by 70% and was able to suggest the optimal flag configuration 2.4x faster than the standard simulated annealing based approach, excluding the time for data-generation.


title: EdinburghNLP at WNUT-2020 Task 2: Leveraging Transformers with Generalized Augmentation for Identifying Informativeness in COVID-19 Tweets

abstract: Twitter and, in general, social media has become an indispensable communication channel in times of emergency. The ubiquitousness of smartphone gadgets enables people to declare an emergency observed in real-time. As a result, more agencies are interested in programmatically monitoring Twitter (disaster relief organizations and news agencies). Therefore, recognizing the informativeness of a Tweet can help filter noise from the large volumes of Tweets. In this paper, we present our submission for WNUT-2020 Task 2: Identification of informative COVID-19 English Tweets. Our most successful model is an ensemble of transformers, including RoBERTa, XLNet, and BERTweet trained in a Semi-Supervised Learning (SSL) setting. The proposed system achieves an F1 score of 0.9011 on the test set (ranking 7th on the leaderboard) and shows significant gains in performance compared to a baseline system using FastText embeddings.


title: Analysis and representation of Igbo text document for a text-based system

abstract: The advancement in Information Technology (IT) has assisted in inculcating the three Nigeria major languages in text-based application such as text mining, information retrieval and natural language processing. The interest of this paper is the Igbo language, which uses compounding as a common type of word formation and as well has many vocabularies of compound words. The issues of collocation, word ordering and compounding play high role in Igbo language. The ambiguity in dealing with these compound words has made the representation of Igbo language text document very difficult because this cannot be addressed using the most common and standard approach of the Bag-Of-Words (BOW) model of text representation, which ignores the word order and relation. However, this cause for a concern and the need to develop an improved model to capture this situation. This paper presents the analysis of Igbo language text document, considering its compounding nature and describes its representation with the Word-based N-gram model to properly prepare it for any text-based application. The result shows that Bigram and Trigram n-gram text representation models provide more semantic information as well addresses the issues of compounding, word ordering and collocations which are the major language peculiarities in Igbo. They are likely to give better performance when used in any Igbo text-based system.


title: Interaction of Fermionic Matter and ECSK Black Hole with Torsion

abstract: The interactions between the spin of fermionic matter and torsion in the Einstein-Cartan-Sciama-Kibble (ECSK) theory of gravity provides a repulsive gravitational potential at the very dense states of fermionic matter, which prevents the formation of black hole singularities inside the deeper horizon. While the fermionic matter in the black hole is attracted by the black hole at the beginning, after a critical point it is repelled to bounce at a critical high density and then expand into other side of the horizon as a newly created space, which may be considered as a nonsingular, closed universe. We constructed the action of these fermions in a black hole with torsion in the framework of ECSK theory of gravity from which the free Dirac action is inferred to obtain the interaction potential. The creation of a bouncing universe with the extremely repulsive potential may be related to the running vacuum and the modified Friedmann equations yield the consistent cosmological parameters with present FRW universe. Finally, this scenario naturally solves the flatness and horizon problems of cosmology without introducing finely tuned scalar fields, or more complicated functions of the Ricci Scalar R in the gravitational action.


title: Stability of Einstein and de Sitter Universes in the Quadratic Theory of Modified Gravity

abstract: We consider the Einstein static and the de Sitter universe solutions and examine their instabilities in a subclass of quadratic modified theories for gravity. This modification proposed by Nash is an attempt to generalize general relativity. Interestingly, we discover that the Einstein static universe is unstable in the context of the modified gravity. In contrast to Einstein static universe, the de Sitter universe remains stable under metric perturbation up to the second order.


title: A pragmatic adaptive enrichment design for selecting the right target population for cancer immunotherapies

abstract: One of the challenges in the design of confirmatory trials is to deal with uncertainties regarding the optimal target population for a novel drug. Adaptive enrichment designs (AED) which allow for a data-driven selection of one or more pre-specified biomarker subpopulations at an interim analysis have been proposed in this setting but practical case studies of AEDs are still relatively rare. We present the design of an AED with a binary endpoint in the highly dynamic setting of cancer immunotherapy. The trial was initiated as a conventional trial in early triple-negative breast cancer but amended to an AED based on emerging data external to the trial suggesting that PD-L1 status could be a predictive biomarker. Operating characteristics are discussed including the concept of a minimal detectable difference, that is, the smallest observed treatment effect that would lead to a statistically significant result in at least one of the target populations at the interim or the final analysis, respectively, in the setting of AED.


title: The relativistic dynamics of oppositely charged two fermions interacting with external uniform magnetic field

abstract: We investigated the relativistic dynamics of oppositely charged two fermions interacting with an external uniform magnetic field. We chose the interaction of each fermion with the external magnetic field in the symmetric gauge, and obtained a precise solution of the corresponding fully-covariant two-body Dirac equation that derived from Quantum Electrodynamics via Action principle. The dynamic symmetry of the system we deal with allowed us to determine the relativistic Landau levels of such a spinless composite system, without using any group theoretical method. As a result, we determined the eigenfunctions and eigenvalues of the corresponding two-body Dirac Hamiltonian


title: Refining Student Marks based on Enrolled Modules Assessment Methods using Data Mining Techniques

abstract: Choosing the right and effective way to assess students is one of the most important tasks of higher education. Many studies have shown that students tend to receive higher scores during their studies when assessed by different study methods which include units that are fully assessed by varying the duration of study or a combination of courses and exams than by exams alone. Many Educational Data Mining studies process data in advance through traditional data extraction, including the data preparation process. In this paper, we propose a different data preparation process by investigating more than 230000 student records for the preparation of scores. The data have been processed through diverse stages in order to extract a categorical factor through which students module marks are refined during the data preparation stage. The results of this work show that students final marks should not be isolated from the nature of the enrolled module assessment methods. They must rather be investigated thoroughly and considered during EDM data preprocessing stage. More generally, educational data should not be prepared in the same way normal data are due to the differences in data sources, applications, and error types. The effect of Module Assessment Index on the prediction process using Random Forest and Naive Bayes classification techniques were investigated. It was shown that considering MAI as attribute increases the accuracy of predicting students second year averages based on their first year averages.


title: P-DIFF: Learning Classifier with Noisy Labels based on Probability Difference Distributions

abstract: Learning deep neural network (DNN) classifier with noisy labels is a challenging task because the DNN can easily over-fit on these noisy labels due to its high capability. In this paper, we present a very simple but effective training paradigm called P-DIFF, which can train DNN classifiers but obviously alleviate the adverse impact of noisy labels. Our proposed probability difference distribution implicitly reflects the probability of a training sample to be clean, then this probability is employed to re-weight the corresponding sample during the training process. P-DIFF can also achieve good performance even without prior knowledge on the noise rate of training samples. Experiments on benchmark datasets also demonstrate that P-DIFF is superior to the state-of-the-art sample selection methods.


title: Robust discrete choice models with t-distributed kernel errors

abstract: Outliers in discrete choice response data may result from misclassification and misreporting of the response variable and from choice behaviour that is inconsistent with modelling assumptions (e.g. random utility maximisation). In the presence of outliers, standard discrete choice models produce biased estimates and suffer from compromised predictive accuracy. Robust statistical models are less sensitive to outliers than standard non-robust models. This paper analyses two robust alternatives to the multinomial probit (MNP) model. The two models are robit models whose kernel error distributions are heavy-tailed t-distributions to moderate the influence of outliers. The first model is the multinomial robit (MNR) model, in which a generic degrees of freedom parameter controls the heavy-tailedness of the kernel error distribution. The second model, the generalised multinomial robit (Gen-MNR) model, is more flexible than MNR, as it allows for distinct heavy-tailedness in each dimension of the kernel error distribution. For both models, we derive Gibbs samplers for posterior inference. In a simulation study, we illustrate the excellent finite sample properties of the proposed Bayes estimators and show that MNR and Gen-MNR produce more accurate estimates if the choice data contain outliers through the lens of the non-robust MNP model. In a case study on transport mode choice behaviour, MNR and Gen-MNR outperform MNP by substantial margins in terms of in-sample fit and out-of-sample predictive accuracy. The case study also highlights differences in elasticity estimates across models.