title: Cross-Batch Memory for Embedding Learning

abstract: Mining informative negative instances are of central importance to deep metric learning (DML), however this task is intrinsically limited by mini-batch training, where only a mini-batch of instances is accessible at each iteration. In this paper, we identify a "slow drift" phenomena by observing that the embedding features drift exceptionally slow even as the model parameters are updating throughout the training process. This suggests that the features of instances computed at preceding iterations can be used to considerably approximate their features extracted by the current model. We propose a cross-batch memory (XBM) mechanism that memorizes the embeddings of past iterations, allowing the model to collect sufficient hard negative pairs across multiple mini-batches - even over the whole dataset. Our XBM can be directly integrated into a general pair-based DML framework, where the XBM augmented DML can boost performance considerably. In particular, without bells and whistles, a simple contrastive loss with our XBM can have large R@1 improvements of 12%-22.5% on three large-scale image retrieval datasets, surpassing the most sophisticated state-of-the-art methods, by a large margin. Our XBM is conceptually simple, easy to implement - using several lines of codes, and is memory efficient - with a negligible 0.2 GB extra GPU memory. Code is available at: https://github.com/MalongTech/research-xbm.


title: Spin-mediated charge-to-heat current conversion phenomena in ferromagnetic binary alloys

abstract: Spin-mediated charge-to-heat current conversion phenomena, i.e., the anomalous Ettingshausen effect (AEE) and the anisotropic magneto-Peltier effect (AMPE), have been investigated in various ferromagnetic Ni-Fe, Ni-Pt, Ni-Pd, and Fe-Pt binary alloys at room temperature. When a charge current is applied to a ferromagnetic conductor, the AMPE modulates the Peltier coefficient depending on the angle between the directions of the charge current and magnetization, while the AEE generates a heat current in the direction perpendicular to both the charge current and magnetization. We observed the strong material dependence of the thermoelectric conversion coefficients and figures of merit of these phenomena. Among the ferromagnetic alloys used in this study, Ni$_{95}$Pt$_{5}$ exhibits the largest AMPE of which the anisotropy of the Peltier coefficient is $\sim 12\%$. In contrast, the magnitude of the AEE signals is moderate in Ni$_{95}$Pt$_{5}$ but largest in Ni$_{75}$Pt$_{25}$ and Ni$_{50}$Fe$_{50}$. We discuss these behaviors by exploring the relations between these charge-to-heat current conversion phenomena and other transport as well as magnetic properties. This systematic study will provide a clue for clarifying the mechanisms of the AMPE and AEE and for enhancing the thermoelectric conversion efficiency of these phenomena.


title: An Efficient Augmented Lagrangian Method for Support Vector Machine

abstract: Support vector machine (SVM) has proved to be a successful approach for machine learning. Two typical SVM models are the L1-loss model for support vector classification (SVC) and $\epsilon$-L1-loss model for support vector regression (SVR). Due to the nonsmoothness of the L1-loss function in the two models, most of the traditional approaches focus on solving the dual problem. In this paper, we propose an augmented Lagrangian method for the L1-loss model, which is designed to solve the primal problem. By tackling the nonsmooth term in the model with Moreau-Yosida regularization and the proximal operator, the subproblem in augmented Lagrangian method reduces to a nonsmooth linear system, which can be solved via the quadratically convergent semismooth Newton's method. Moreover, the high computational cost in semismooth Newton's method can be significantly reduced by exploring the sparse structure in the generalized Jacobian. Numerical results on various datasets in LIBLINEAR show that the proposed method is competitive with the most popular solvers in both speed and accuracy.


title: Buried and ridge graphene-based silicon waveguides for broadband polarization-insensitive amplitude and phase modulators

abstract: In this paper, four easy-to-fabricate graphene-based Si waveguide modulators are presented to overcome the strong polarization dependency of graphene-based modulators. The modulation features of two newly proposed structures, i.e. two graphene-based buried silicon waveguides in addition to two standard ridge silicon waveguides at the telecommunication wavelength of $\lambda=1.55 \mu m$ are studied. The results show that for certain widths of each waveguide (the height is constant), the amplitude and phase modulations clearly become polarization-insensitive. The amplitude modulation depths for both the TE and TM modes are equal for these optimized waveguides with the precision of $10^{-4} dB/{\mu m}$. Moreover, in some of the proposed modulators, the maximum variations of the real parts of the effective mode indices (EMI) for both the TE and TM modes coincide with each other with an excellent precision ($5\times 10^{-5}$). This precision value is much smaller than the standard criterion value for confirming a polarization-insensitive phase modulation. Furthermore, the performances of all the structures are studied for all optical telecommunication wavelengths. Even without making any changes to the structures designed at $1.55 \mu m$ at appropriate wavelength intervals, the structures exhibit polarization-insensitive behaviors.


title: A memory and communication efficient algorithm for decentralized counting of nodes in networks

abstract: Node counting on a graph is subject to some fundamental theoretical limitations, yet a solution to such problems is necessary in many applications of graph theory to real-world systems, such as collective robotics and distributed sensor networks. Thus several stochastic and na{\"i}ve deterministic algorithms for distributed graph size estimation or calculation have been provided. Here we present a deterministic and distributed algorithm that allows every node of a connected graph to determine the graph size in finite time, if an upper bound on the graph size is provided. The algorithm consists in the iterative aggregation of information in local hubs which then broadcast it throughout the whole graph. The proposed node-counting algorithm is on average more efficient in terms of node memory and communication cost than its previous deterministic counterpart for node counting, and appears comparable or more efficient in terms of average-case time complexity. As well as node counting, the algorithm is more broadly applicable to problems such as summation over graphs, quorum sensing, and spontaneous hierarchy creation.


title: Optimal PAC-Bayesian Posteriors for Stochastic Classifiers and their use for Choice of SVM Regularization Parameter

abstract: PAC-Bayesian set up involves a stochastic classifier characterized by a posterior distribution on a classifier set, offers a high probability bound on its averaged true risk and is robust to the training sample used. For a given posterior, this bound captures the trade off between averaged empirical risk and KL-divergence based model complexity term. Our goal is to identify an optimal posterior with the least PAC-Bayesian bound. We consider a finite classifier set and 5 distance functions: KL-divergence, its Pinsker's and a sixth degree polynomial approximations; linear and squared distances. Linear distance based model results in a convex optimization problem. We obtain closed form expression for its optimal posterior. For uniform prior, this posterior has full support with weights negative-exponentially proportional to number of misclassifications. Squared distance and Pinsker's approximation bounds are possibly quasi-convex and are observed to have single local minimum. We derive fixed point equations (FPEs) using partial KKT system with strict positivity constraints. This obviates the combinatorial search for subset support of the optimal posterior. For uniform prior, exponential search on a full-dimensional simplex can be limited to an ordered subset of classifiers with increasing empirical risk values. These FPEs converge rapidly to a stationary point, even for a large classifier set when a solver fails. We apply these approaches to SVMs generated using a finite set of SVM regularization parameter values on 9 UCI datasets. These posteriors yield stochastic SVM classifiers with tight bounds. KL-divergence based bound is the tightest, but is computationally expensive due to non-convexity and multiple calls to a root finding algorithm. Optimal posteriors for all 5 distance functions have lowest 10% test error values on most datasets, with linear distance being the easiest to obtain.


title: The UEFA Champions League seeding is not strategy-proof since the 2015/16 season

abstract: Fairness has several interpretations in sports, one of them being that the rules should guarantee incentive compatibility, namely, a team cannot be worse off due to better results in any feasible scenario. The current seeding regime of the most prestigious annual European club football tournament, the UEFA (Union of European Football Associations) Champions League, is shown to violate this requirement since the 2015/16 season. In particular, if the titleholder qualifies for the first pot by being a champion in a high-ranked league, its slot is given to a team from a lower-ranked association, which can harm a top club from the domestic championship of the titleholder. However, filling all vacancies through the national leagues excludes the presence of perverse incentives. UEFA is encouraged to introduce this policy from the 2021-24 cycle onwards.


title: A subspace-accelerated split Bregman method for sparse data recovery with joint l1-type regularizers

abstract: We propose a subspace-accelerated Bregman method for the linearly constrained minimization of functions of the form $f(\mathbf{u})+\tau_1 \|\mathbf{u}\|_1 + \tau_2 \|D\,\mathbf{u}\|_1$, where $f$ is a smooth convex function and $D$ represents a linear operator, e.g. a finite difference operator, as in anisotropic Total Variation and fused-lasso regularizations. Problems of this type arise in a wide variety of applications, including portfolio optimization and learning of predictive models from functional Magnetic Resonance Imaging (fMRI) data, and source detection problems in electroencephalography. The use of $\|D\,\mathbf{u}\|_1$ is aimed at encouraging structured sparsity in the solution. The subspaces where the acceleration is performed are selected so that the restriction of the objective function is a smooth function in a neighborhood of the current iterate. Numerical experiments on multi-period portfolio selection problems using real datasets show the effectiveness of the proposed method.


abstract: In recent years, sentiment analysis in social media has attracted a lot of research interest and has been used for a number of applications. Unfortunately, research has been hindered by the lack of suitable datasets, complicating the comparison between approaches. To address this issue, we have proposed SemEval-2013 Task 2: Sentiment Analysis in Twitter, which included two subtasks: A, an expression-level subtask, and B, a message-level subtask. We used crowdsourcing on Amazon Mechanical Turk to label a large Twitter training dataset along with additional test sets of Twitter and SMS messages for both subtasks. All datasets used in the evaluation are released to the research community. The task attracted significant interest and a total of 149 submissions from 44 teams. The best-performing team achieved an F1 of 88.9% and 69% for subtasks A and B, respectively.


title: On a question of H. A. Schwarz

abstract: This paper is a contribution to the study of tetrahedra with rational side lengths and rational volume. The problem can be formulated as a study of a hyperelliptic variety attached to the Cayley-Menger determinant. The problem posed by Schwarz was as to whether this variety is rational over the rationals. In a thesis that was never published Otto Schulz proved in 1912 that the variety was rational over $\mathbb Q(\sqrt{-1})$. This does not seem to have appeared eleswhere nor, apparently, has the question been studied since then. In this paper we take up an idea of Kurt Heegner to reprove the theorem using the theory of Weddle surfaces. Although this does not lead to a final answer to Schwarz question it seems likely that it is negative.


title: Environmental Sound Classification with Parallel Temporal-spectral Attention

abstract: Convolutional neural networks (CNN) are one of the best-performing neural network architectures for environmental sound classification (ESC). Recently, temporal attention mechanisms have been used in CNN to capture the useful information from the relevant time frames for audio classification, especially for weakly labelled data where the onset and offset times of the sound events are not applied. In these methods, however, the inherent spectral characteristics and variations are not explicitly exploited when obtaining the deep features. In this paper, we propose a novel parallel temporal-spectral attention mechanism for CNN to learn discriminative sound representations, which enhances the temporal and spectral features by capturing the importance of different time frames and frequency bands. Parallel branches are constructed to allow temporal attention and spectral attention to be applied respectively in order to mitigate interference from the segments without the presence of sound events. The experiments on three environmental sound classification (ESC) datasets and two acoustic scene classification (ASC) datasets show that our method improves the classification performance and also exhibits robustness to noise.


title: Operator splitting schemes for American options under the two-asset Merton jump-diffusion model

abstract: This paper deals with the efficient numerical solution of the two-dimensional partial integro-differential complementarity problem (PIDCP) that holds for the value of American-style options under the two-asset Merton jump-diffusion model. We consider the adaptation of various operator splitting schemes of both the implicit-explicit (IMEX) and the alternating direction implicit (ADI) kind that have recently been studied for partial integro-differential equations (PIDEs) in [3]. Each of these schemes conveniently treats the nonlocal integral part in an explicit manner. Their adaptation to PIDCPs is achieved through a combination with the Ikonen-Toivanen splitting technique [14] as well as with the penalty method [32]. The convergence behaviour and relative performance of the acquired eight operator splitting methods is investigated in extensive numerical experiments for American put-on-the-min and put-on-the-average options.


title: Proppy: A System to Unmask Propaganda in Online News

abstract: We present proppy, the first publicly available real-world, real-time propaganda detection system for online news, which aims at raising awareness, thus potentially limiting the impact of propaganda and helping fight disinformation. The system constantly monitors a number of news sources, deduplicates and clusters the news into events, and organizes the articles about an event on the basis of the likelihood that they contain propagandistic content. The system is trained on known propaganda sources using a variety of stylistic features. The evaluation results on a standard dataset show state-of-the-art results for propaganda detection.


title: Implication of $b \to c\tau\nu$ flavor anomalies on $B_s\rightarrow {D_s^*}\tau\nu$ decay observables

abstract: The experimental predictions of $R_D$, $R_{D^*}$, $R_{J/\psi}$, $P_\tau^{D^*}$ and $F_L^{D^*}$ in $B$ decays mediated via $b\,\to\, c\, l\,\nu$ quark level transition deviate significantly from the standard model expectations. The current world average of the ratio of branching ratios $R_D$ and $R_{D^*}$ in $B\,\to\, D^{(*)}\, l\,\nu$ ($l\in e,\tau$) show $1.4\sigma$ and $2.5\sigma$ deviation from the SM expectations. Similarly, the $\tau$ polarization fraction $P_{\tau}^{D^*}$ and the longitudinal polarization fraction of the $D^*$ meson $F_L^{D^*}$ in $B\,\to\, D^*\,\tau\,\nu$ are found to deviate from the standard model expectations at $1.6\sigma$ and $1.5\sigma$ level, respectively. In addition, the ratio of branching ratio $R_{J/\psi}$ in $B_c\,\to\,{J/\psi}\, l\,\nu$ deviates from the standard model prediction at $2\sigma$ level. In this regard, we study the implication of $R_D$, $R_{D^*}$, $R_{J/\psi}$, $P_\tau^{D^*}$, and $F_L^{D^*}$ anomalies on $B_s\,\to\, {D^*_s}\,\tau\,\nu$ decay observables in a model independent effective field theory formalism. We give predictions of several physical observables in the standard model and in the presence of various $1D$ and $2D$ new physics scenarios.


title: Cerberus: A Blockchain-Based Accreditation and Degree Verification System

abstract: Credential fraud is a widespread practice that undermines investment and confidence in higher education systems and bears significant economic and social costs. Legacy credential verification systems are typically time-consuming, costly, and bureaucratic, and struggle against certain classes of credential fraud. In this paper, we propose a comprehensive blockchain-based credential verification solution, Cerberus, which is considerably more efficient, easy and intuitive to use, and effectively mitigates widespread manifestations of credential fraud. Cerberus also improves significantly upon other blockchain-based solutions in the research literature: it adheres closely to the existing credential verification ecosystem, it addresses a threat model informed by real-world fraud scenarios. Moreover, Cerberus uses on-chain smart contracts for credential revocation, and it does not entail students or employers to manage digital identities or cryptographic credentials to use the system. We prototype our solution and describe our attempt to design an online verification service with a rich feature set, including data privacy, transcript verification, and selective disclosure of data. We hope this effort contributes positively to towards alleviating the problem of fake credentials.


title: Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretraining

abstract: We introduce a novel sequence-to-sequence (seq2seq) voice conversion (VC) model based on the Transformer architecture with text-to-speech (TTS) pretraining. Seq2seq VC models are attractive owing to their ability to convert prosody. While seq2seq models based on recurrent neural networks (RNNs) and convolutional neural networks (CNNs) have been successfully applied to VC, the use of the Transformer network, which has shown promising results in various speech processing tasks, has not yet been investigated. Nonetheless, their data-hungry property and the mispronunciation of converted speech make seq2seq models far from practical. To this end, we propose a simple yet effective pretraining technique to transfer knowledge from learned TTS models, which benefit from large-scale, easily accessible TTS corpora. VC models initialized with such pretrained model parameters are able to generate effective hidden representations for high-fidelity, highly intelligible converted speech. Experimental results show that such a pretraining scheme can facilitate data-efficient training and outperform an RNN-based seq2seq VC model in terms of intelligibility, naturalness, and similarity.


title: State preparation of a fluxonium qubit with feedback from a custom FPGA-based platform

abstract: We developed a versatile integrated control and readout instrument for experiments with superconducting quantum bits (qubits), based on a field-programmable gate array (FPGA) platform. Using this platform, we perform measurement-based, closed-loop feedback operations with $428 \, \mathrm{ns}$ platform latency. The feedback capability is instrumental in realizing active reset initialization of the qubit into the ground state in a time much shorter than its energy relaxation time $T_1$. We show experimental results demonstrating reset of a fluxonium qubit with $99.4\,\%$ fidelity, using a readout-and-drive pulse sequence approximately $1.5 \, \mathrm{\mu s}$ long. Compared to passive ground state initialization through thermalization, with the time constant given by $T_1 = ~ 80 \, \mathrm{\mu s}$, the use of the FPGA-based platform allows us to improve both the fidelity and the time of the qubit initialization by an order of magnitude.


title: Flow Solutions of Transport Equations

abstract: Under general assumptions on the velocity field, it is possible to construct a flow that is forward untangled. Once such a flow has been selected, the associated transport problem is well-posed.


title: Active rotational dynamics of a self-diffusiophoretic colloidal motor

abstract: The dynamics of a spherical chemically-powered synthetic colloidal motor that operates by a self-diffusiophoretic mechanism and has a catalytic domain of arbitrary shape is studied using both continuum theory and particle-based simulations. The motor executes active rotational motion when self-generated concentration gradients and interactions between the chemical species and colloidal motor surface break spherical symmetry. Local variations of chemical reaction rates on the motor catalytic surface with catalytic domain sizes and shapes provide such broken symmetry conditions. A continuum theoretical description of the active rotational motion is given, along with the results of particle-based simulations of the active dynamics. From these results a detailed description of the factors responsible for the active rotational dynamics can be given. Since active rotational motion often plays a significant part in the nature of the collective dynamics of many-motor systems and can be used to control motor motion in targeted cargo transport, our results should find applications beyond those considered here.

categories: cond-mat.soft physics.bio-ph physics.chem-ph physics.flu-dyn


title: Ten AI Stepping Stones for Cybersecurity

abstract: With the turmoil in cybersecurity and the mind-blowing advances in AI, it is only natural that cybersecurity practitioners consider further employing learning techniques to help secure their organizations and improve the efficiency of their security operation centers. But with great fears come great opportunities for both the good and the evil, and a myriad of bad deals. This paper discusses ten issues in cybersecurity that hopefully will make it easier for practitioners to ask detailed questions about what they want from an AI system in their cybersecurity operations. We draw on the state of the art to provide factual arguments for a discussion on well-established AI in cybersecurity issues, including the current scope of AI and its application to cybersecurity, the impact of privacy concerns on the cybersecurity data that can be collected and shared externally to the organization, how an AI decision can be explained to the person running the operations center, and the implications of the adversarial nature of cybersecurity in the learning techniques. We then discuss the use of AI by attackers on a level playing field including several issues in an AI battlefield, and an AI perspective on the old cat-and-mouse game including how the adversary may assess your AI power.


title: Advanced Machine Learning Techniques for Self-Interference Cancellation in Full-Duplex Radios

abstract: In-band full-duplex systems allow for more efficient use of temporal and spectral resources by transmitting and receiving information at the same time and on the same frequency. However, this creates a strong self-interference signal at the receiver, making the use of self-interference cancellation critical. Recently, neural networks have been used to perform digital self-interference with lower computational complexity compared to a traditional polynomial model. In this paper, we examine the use of advanced neural networks, such as recurrent and complex-valued neural networks, and we perform an in-depth network architecture exploration. Our neural network architecture exploration reveals that complex-valued neural networks can significantly reduce both the number of floating-point operations and parameters compared to a polynomial model, whereas the real-valued networks only reduce the number of floating-point operations. For example, at a digital self-interference cancellation of 44.51 dB, a complex-valued neural network requires 33.7 % fewer floating-point operations and 26.9 % fewer parameters compared to the polynomial model.


title: Analytic Berezin-Toeplitz operators

abstract: We introduce new tools for analytic microlocal analysis on K\"ahler manifolds. As an application, we prove that the space of Berezin-Toeplitz operators with analytic contravariant symbol is an algebra. We also give a short proof of the Bergman kernel asymptotics up to an exponentially small error.


title: Boundary blow-up analysis of gradient estimates for Lam\'{e} systems in the presence of $M$-convex hard inclusions

abstract: In high-contrast elastic composites, it is vitally important to investigate the stress concentration from an engineering point of view. The purpose of this paper is to show that the blowup rate of the stress depends not only on the shape of the inclusions, but also on the given boundary data, when hard inclusions are close to matrix boundary. First, when the boundary of inclusion is partially relatively parallel to that of matrix, we establish the gradient estimates for Lam\'{e} systems with partially infinite coefficients and find that they are bounded for some boundary data $\varphi$ while some $\varphi$ will increase the blow-up rate. In order to identify such novel blowup phenomenon, we further consider the general $m$-convex inclusion cases and uncover the dependence of blow-up rate on the inclusion's convexity $m$ and the boundary data's order of growth $k$ in all dimensions. In particular, the sharpness of these blow-up rates is also presented for some prescribed boundary data.


title: Everett's Multiverse and the World as Wavefunction

abstract: Everett suggested that there is no such thing as wavefunction collapse. He hypothesized that for an idealized spin measurement the apparatus evolves into a superposition on the pointer basis of two apparatuses, each displaying one of the two outcomes which are standardly thought of as alternatives. And as a result the observer splits into two observers, each perceiving a different outcome.There have been problems. Why the pointer basis? Decoherence is generally accepted by Everettian theorists to be the key to the right answer there. And in what sense is probability involved when all possible outcomes occur? Everett's response to that problem was inadequate. A first attempt to find a different route to probability was introduce by Neil Graham in 1973 and the path from there has led to two distinct models of branching. I describe how the ideas have evolved and their relation to the concepts of uncertainty and objective probability. Then I describe the further problem of wavefunction monism, emphasized by Maudlin, and make a suggestion as to how it might be resolved.


title: On a conjecture of Pappas and Rapoport about the standard local model for $GL_d$

abstract: In their study of local models of Shimura varieties for totally ramified extensions, Pappas and Rapoport posed a conjecture about the reducedness of a certain subscheme of $n \times n$ matrices. We give a positive answer to their conjecture in full generality. Our main ideas follow naturally from two of our previous works. The first is our proof of a conjecture of Kreiman, Lakshmibai, Magyar, and Weyman on the equations defining type A affine Grassmannians. The second is the work of the first two authors and Kamnitzer on affine Grassmannian slices and their reduced scheme structure. We also present a version of our argument that is almost completely elementary: the only non-elementary ingredient is the Frobenius splitting of Schubert varieties.


title: Electroweak Radiative Corrections for Collider Physics

abstract: Current particle phenomenology is characterized by the spectacular agreement of the predictions of the Standard Model of particle physics (SM) with all results from collider experiments and by the absence of significant signals of non-standard physics, despite the fact that we know that the SM cannot be the ultimate theory of nature. In this situation, confronting theory and experiment with high precision is a promising direction to look for potential traces of physics beyond the SM. On the theory side, the calculation of radiative corrections of the strong and electroweak interactions is at the heart of this task, a field that has seen tremendous conceptual and technical progress in the last decades. This review aims at a coherent introduction to the field of electroweak corrections and tries to fill gaps in the literature between standard textbook knowledge and the current state of the art. The SM and the machinery for its perturbative evaluation are reviewed in detail, putting particular emphasis on renormalization, on one-loop techniques, on modern amplitude methods and tools, on the separation of infrared singularities in real-emission corrections, on electroweak issues connected with hadronic initial or final states in collisions, and on the issue of unstable particles in quantum field theory together with corresponding practical solutions.


title: Thermodynamics, shadow and quasinormal modes of black holes in five-dimensional Yang-Mills massive gravity

abstract: In this paper, we consider the Einstein-massive gravity coupled to the Yang-Mills gauge field in five dimensions. Concentrating on the static solutions with planar horizon geometry, we explore the thermodynamic behavior in the extended phase space and examine the validity of the first law of thermodynamics besides local thermal stability by the Hessian matrix. We observe that although the topology of boundary is planar, there exists the van der Waals like phase transition for this kind of solution. We find the critical quantities and discuss how the massive and Yang-Mills parameters affect them. Furthermore, some signatures of the first order phase transition such as the swallow-tail behavior of the Gibbs free energy and divergences of the specific heat are given in detail. We continue with the calculation of the photon sphere and the shadow observed by a distant observer. Finally, we use the WKB method to investigate the quasinormal modes for scalar perturbation under changing the massive and Yang-Mills parameters.


title: Knowledge forest: a novel model to organize knowledge fragments

abstract: With the rapid growth of knowledge, it shows a steady trend of knowledge fragmentization. Knowledge fragmentization manifests as that the knowledge related to a specific topic in a course is scattered in isolated and autonomous knowledge sources. We term the knowledge of a facet in a specific topic as a knowledge fragment. The problem of knowledge fragmentization brings two challenges: First, knowledge is scattered in various knowledge sources, which exerts users' considerable efforts to search for the knowledge of their interested topics, thereby leading to information overload. Second, learning dependencies which refer to the precedence relationships between topics in the learning process are concealed by the isolation and autonomy of knowledge sources, thus causing learning disorientation. To solve the knowledge fragmentization problem, we propose a novel knowledge organization model, knowledge forest, which consists of facet trees and learning dependencies. Facet trees can organize knowledge fragments with facet hyponymy to alleviate information overload. Learning dependencies can organize disordered topics to cope with learning disorientation. We conduct extensive experiments on three manually constructed datasets from the Data Structure, Data Mining, and Computer Network courses, and the experimental results show that knowledge forest can effectively organize knowledge fragments, and alleviate information overload and learning disorientation.


title: The Controlled Large-Area Synthesis of Two Dimensional Metals

abstract: The rise of nanotechnology has been propelled by low dimensional metals. Albeit the long perceived importance, synthesis of freestanding metallic nanomembranes, or the so-called 2D metals, however has been restricted to simple metals with a very limited in-plane size (< 10{\mu}m). In this work, we developed a low-cost method to synthesize 2D metals through polymer surface buckling enabled exfoliation. The 2D metals so obtained could be as chemically complex as high entropy alloys while possessing in-plane dimensions at the scale of bulk metals (> 1 cm). With our approach, we successfully synthesized a variety of 2D metals, such as 2D high entropy alloy and 2D metallic glass, with controllable geometries and morphologies. Moreover, our approach can be readily extended to non-metals and composites, thereby opening a large window to the fabrication of a wide range of 2D materials of technologic importance which have never been reported before.


title: Effects of diagonal strains and H-bond geometry in antiferroelectric squaric acid crystals

abstract: The proton ordering model of the phase transition and physical properties of antiferroelectric crystals of squaric acid is modified by taking into account the influence of diagonal lattice strains and of the local geometry of hydrogen bonds, namely of the distance $\delta$ between the H-sites on a bond. Thermal expansion, the spontaneous strain $\varepsilon_1-\varepsilon_3$, and specific heat of squaric acid are well described by the proposed model. However, a consistent description of hydrostatic pressure influence on the transition temperature is possible only with further modifications of the model.


title: The dominating mechanisms for the formation of solute-rich clusters in steels under irradiation

abstract: The formation of nano-sized, coherent, solute-rich clusters (NSRC) is known to be an important factor degrading the macroscopic properties of steels under irradiation. The mechanisms driving their formation are still debated. This work focuses on low-Cu reactor pressure vessel (RPV) steels, where solute species are generally not expected to precipitate. We rationalize the processes taking place at the nanometre scale under irradiation, relying on the latest theoretical and experimental evidence on atomic-level diffusion and transport processes. These are compiled in a new model, based on the object kinetic Monte Carlo (OKMC) technique. We evaluate the relevance of the underlying physical assumptions by applying the model to a large variety of irradiation experiments. Our model predictions are compared with new experimental data obtained with atom probe tomography and small angle neutron scattering, complemented with information from the literature. The results of this study reveal that the role of immobilized self-interstitial atoms (SIA) loops dominates the nucleation process of NSRC.


title: The method of creative microscoping

abstract: We outline basic principles of a new method that gives a conceptual reasoning for and, at the same time, proofs of (super)congruences for truncated sums of arithmetic hypergeometric evaluations.


title: Stochastic Modeling of Beam Management in mmWave Vehicular Networks

abstract: Mobility management is a major challenge for the wide-spread deployment of millimeter-wave (mmWave) cellular networks. In particular, directional beamforming in mmWave devices renders high-speed mobility support very complex. This complexity, however, is not limited to system design but also the performance estimation and evaluation. Hence, some have turned their attention to stochastic modeling of mmWave vehicular communication to derive closed-form expressions characterizing the coverage and rate behavior of the network. In this article, we model and analyze the beam management for mmWave vehicular networks. To the best of our knowledge, this is the first work that goes beyond coverage and rate analysis. Specifically, we focus on a multi-lane divided highway scenario in which base stations and vehicles are present on both sides of the highway. In addition to providing analytical expressions for the average number of beam switching and handover events, we provide design insights for the network operators to fine-tune their network within the flexibility provided by the standard in the choice of system parameters, including the number of resources dedicated to channel feedback and beam alignment operations.


title: Periodic attractor in the discrete time best-response dynamics of the Rock-Paper-Scissors game

abstract: The Rock-Paper-Scissors (RPS) game is a classic non-cooperative game widely studied in terms of its theoretical analysis as well as in its applications, ranging from sociology and biology to economics. Many experimental results of the RPS game indicate that this game is better modelled by the discretized best-response dynamics rather than continuous time dynamics. In this work we show that the attractor of the discrete time best-response dynamics of the RPS game is finite and periodic. Moreover we also describe the bifurcations of the attractor and determine the exact number, period and location of the periodic strategies.


title: A note on continuous fractional wavelet transform in $\mathbb{R}^n$

abstract: In this paper, we have studied continuous fractional wavelet transform (CFrWT) in $n$-dimensional Euclidean space $\mathbb{R}^n$ with dilation parameter $\boldsymbol a=(a_{1},a_{2},\ldots,a_{n}),$ such that none of $a_{i}'s$ are zero. Necessary and sufficient condition for the admissibility of a function is established with the help of fractional convolution. Inner product relation, reconstruction formula and the reproducing kernel for the CFrWT depending on two wavelets are obtained. Heisenberg's uncertainty inequality and Local uncertainty inequality for the CFrWT are obtained. Finally, boundedness of the transform on the Morrey space $L^{1,\nu}_{M}(\mathbb{R}^n)$ and the estimate of $L^{1,\nu}_{M}(\mathbb{R}^n)$-distance of the CFrWT of two argument functions with respect to different wavelets are discussed.


title: Exploring the radial disc ionization profile of the black hole X-ray binary GRS 1915+105

abstract: Accreting black holes show characteristic 'reflection' features in their X-ray spectra, including the iron K$\alpha$ fluorescence line, which result from X-rays radiated by a compact central corona being reprocessed in the accretion disc atmosphere. The observed line profile is distorted by relativistic effects, providing a diagnostic for disc geometry. Nearly all previous X-ray reflection spectroscopy studies have made the simplifying assumption that the disc ionization state is independent of radius in order to calculate the restframe reflection spectrum. However, this is unlikely to be the case in reality, since the irradiating flux should drop off steeply with radius. Here we analyse a Nuclear Spectroscopic Telescope ARray observation of GRS 1915+105 that exhibits strong reflection features. We find that using a self-consistently calculated radial ionization profile returns a better fit than assuming constant ionization. Our results are consistent with the inner disc being radiation pressure dominated, as is expected from the high inferred accretion rate for this observation. We also find that the assumed ionization profile impacts on the best fitting disc inner radius. This implies that the black hole spin values previously inferred for active galactic nuclei and X-ray binaries by equating the disc inner radius with the innermost stable circular orbit may be changed significantly by the inclusion of a self-consistent ionization profile.


title: A Universal Length-Dependent Vibrational Mode in Graphene Nanoribbons

abstract: Graphene nanoribbons (GNRs) have attracted considerable interest as their atomically tunable structure makes them promising candidates for future electronic devices. However, obtaining detailed information about the length of GNRs has been challenging and typically relies on low-temperature scanning tunneling microscopy. Such methods are ill-suited for practical device application and characterization. In contrast, Raman spectroscopy is a sensitive method for the characterization of GNRs, in particular for investigating their width and structure. Here, we report on a length-dependent, Raman active low-energy vibrational mode that is present in atomically precise, bottom-up synthesized armchair graphene nanoribbons (AGNRs). Our Raman study demonstrates that this mode is present in all families of AGNRs and provides information on their length. Our spectroscopic findings are corroborated by scanning tunneling microscopy images and supported by first-principles calculations that allow us to attribute this mode to a longitudinal acoustic phonon. Finally, we show that this mode is a sensitive probe for the overall structural integrity of the ribbons and their interaction with technologically relevant substrates.


title: Electric field measurements under DC corona discharges in ambient air by electric field induced second harmonic generation

abstract: Electric field distribution is critically important for quantitative insights into the physics of non-equilibrium plasma like corona. To analyze the electric field as well as the ion flow (space charge) distribution under DC corona discharges, the ion flow model has been widely adopted; Kaptzov's assumption, which states the {steady state} electric field at the conductor surface remains at the corona onset value, serves as a boundary condition. In this letter, we investigate the electric field distribution under DC corona discharges between coaxial cylindrical electrodes in ambient air by electric field induced second harmonic generation with nano-second pulse laser beams. The electric field distribution (with or without corona discharge) is obtained. By comparing the measurements with the results predicted by the ion flow model for negative corona discharge, it is found that the electric field at the conductor surface is proportional to the current density of the corona discharge with a negative constant of proportionality. Therefore, for negative corona discharges, Kaptzov's assumption is valid only when the discharge current approaches zero or is small.


title: Nonnegative Low Rank Matrix Approximation for Nonnegative Matrices

abstract: This paper describes a new algorithm for computing Nonnegative Low Rank Matrix (NLRM) approximation for nonnegative matrices. Our approach is completely different from classical nonnegative matrix factorization (NMF) which has been studied for more than twenty five years. For a given nonnegative matrix, the usual NMF approach is to determine two nonnegative low rank matrices such that the distance between their product and the given nonnegative matrix is as small as possible. However, the proposed NLRM approach is to determine a nonnegative low rank matrix such that the distance between such matrix and the given nonnegative matrix is as small as possible. There are two advantages. (i) The minimized distance by the proposed NLRM method can be smaller than that by the NMF method, and it implies that the proposed NLRM method can obtain a better low rank matrix approximation. (ii) Our low rank matrix admits a matrix singular value decomposition automatically which provides a significant index based on singular values that can be used to identify important singular basis vectors, while this information cannot be obtained in the classical NMF. The proposed NLRM approximation algorithm was derived using the alternating projection on the low rank matrix manifold and the non-negativity property. Experimental results are presented to demonstrate the above mentioned advantages of the proposed NLRM method compared the NMF method.


title: Follow Pedro! An Infrared-based Person-Follower using Nonlinear Optimization

abstract: We used ROS2 as a platform to conduct AI research for developing a Follow-Me capability as a proof-of-concept on a wheeled robot, demonstrating that AI research is possible in the ROS2 framework. We developed a complete system that uses perception and navigation components based on a sensor suite of fisheye cameras, lidar, and IMU running on an ARM64 Embedded Linux platform that runs ROS2 natively. The perception package detects AR markers and/or IR beacons to track a person. The tracker uses AI algorithms such as particle filters and nonlinear optimization to extract the SE(3) information of the 2D feature.


title: Cloud Removal in Satellite Images Using Spatiotemporal Generative Networks

abstract: Satellite images hold great promise for continuous environmental monitoring and earth observation. Occlusions cast by clouds, however, can severely limit coverage, making ground information extraction more difficult. Existing pipelines typically perform cloud removal with simple temporal composites and hand-crafted filters. In contrast, we cast the problem of cloud removal as a conditional image synthesis challenge, and we propose a trainable spatiotemporal generator network (STGAN) to remove clouds. We train our model on a new large-scale spatiotemporal dataset that we construct, containing 97640 image pairs covering all continents. We demonstrate experimentally that the proposed STGAN model outperforms standard models and can generate realistic cloud-free images with high PSNR and SSIM values across a variety of atmospheric conditions, leading to improved performance in downstream tasks such as land cover classification.


title: Rest frame vacua of massive Klein-Gordon fields on spatially flat FLRW spacetimes

abstract: We propose a method of projecting the quantum states from a state space of a given geometry into another state space generated by a different geometry, taking care on the correct normalization which is crucial in interpreting the quantum theory. Thanks to this method we can define on any spatially flat FLRW spacetime states in which genuine Minkowskian parameters are measured. We use these Minkowskian states for separating the frequencies in the rest frames of the massive scalar particles defining thus the scalar rest frame vacuum. We show that this vacuum is stable on the de Sitter expanding universe where the energy is conserved. In contrast, on a spatially flat FLRW spacetime with a Milne-type scale factor this vacuum results to be dynamic, corresponding to a time-dependent rest energy interpreted as an effective mass. This dynamic vacuum give rise to a cosmological particle creation which is significant only in the early Milne-type universe considered here. Some interesting features of this new effect are pointed out in a brief analysis.


title: Region and Object based Panoptic Image Synthesis through Conditional GANs

abstract: Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of generative adversarial networks, a lot of attention has been drawn to image-to-image translation tasks. In this paper, we propose and investigate a novel task named as panoptic-level image-to-image translation and a naive baseline of solving this task. Panoptic-level image translation extends the current image translation task to two separate objectives of semantic style translation (adjust the style of objects to that of different domains) and instance transfiguration (swap between different types of objects). The proposed task generates an image from a complete and detailed panoptic perspective which can enrich the context of real-world vision synthesis. Our contribution consists of the proposal of a significant task worth investigating and a naive baseline of solving it. The proposed baseline consists of the multiple instances sequential translation and semantic-level translation with domain-invariant content code.


title: Stability analysis of a magnetic waveguide with self-generated offset field

abstract: The unexpected emerging stability of a time-modulated magnetic guide, realized without external offset fields, is demonstrated. We found a steady periodic solution around which the nonlinear dynamics is linearized. To investigate the orbital stability of the guiding, a formal criterion based on the analysis of the eigenvalues of the monodromy matrix of the system dynamics is used. To circumvent the difficulty in finding an analytical expression for these eigenvalues, a Lyapunov transformation of the system variables is proposed. From this transformation, an equation of state for the system parameters is derived, and it allows one to estimate an upper bound for the computed stability domains. In particular, we found a general expression for the threshold modulation frequency below which the guiding is unstable. Using experimentally accessible parameters, the stable guiding of 87Rb atoms is investigated.


title: Fine-grained Recognition: Accounting for Subtle Differences between Similar Classes

abstract: The main requisite for fine-grained recognition task is to focus on subtle discriminative details that make the subordinate classes different from each other. We note that existing methods implicitly address this requirement and leave it to a data-driven pipeline to figure out what makes a subordinate class different from the others. This results in two major limitations: First, the network focuses on the most obvious distinctions between classes and overlooks more subtle inter-class variations. Second, the chance of misclassifying a given sample in any of the negative classes is considered equal, while in fact, confusions generally occur among only the most similar classes. Here, we propose to explicitly force the network to find the subtle differences among closely related classes. In this pursuit, we introduce two key novelties that can be easily plugged into existing end-to-end deep learning pipelines. On one hand, we introduce diversification block which masks the most salient features for an input to force the network to use more subtle cues for its correct classification. Concurrently, we introduce a gradient-boosting loss function that focuses only on the confusing classes for each sample and therefore moves swiftly along the direction on the loss surface that seeks to resolve these ambiguities. The synergy between these two blocks helps the network to learn more effective feature representations. Comprehensive experiments are performed on five challenging datasets. Our approach outperforms existing methods using similar experimental setting on all five datasets.


title: Electron doping and correlation effects on crystal, electronic and magnetic structures of A$_2$NRuO$_6$ (A2 = Ba$_2$, BaLa; N = V, Cr, Fe)

abstract: Density functional methods have been used to study the crystal, electronic and magnetic structures of new ordered double perovskites A2NRuO6 (A2 = Ba2, BaLa; N = V, Cr, Fe). In the doped compounds, the A-site was replaced by 1:1 of Ba and La cations, BaLaNRuO6. All compounds of A2NRuO6 crystallize in cubic symmetry with space group Fm-3m and tilt system a0a0a0. The electronic and magnetic calculations were performed by the full-potential linear muffin-tin orbital method using both the generalized gradient approximation and GGA plus on-site electron correlation effect GGA+U. In GGA, Ba2NRuO6 shows half-metallic, semiconducting and metallic behavior for N = V, Cr, Fe, respectively, completely change to half-metallic when A2 = BaLa. While, GGA+U method yields clearly half-metallic in all compounds, except for Ba2FeRuO6, shows an insulating behavior. Also, the results of magnetic structures calculations reveal that the A2NRuO6 compounds have ferrimagnetic nature if N = V and Cr, switch to ferromagnetic when N = Fe. The V3+, Cr3+, Fe3+ and Ru5+ ions are in high spin magnetic moments states due to the antiferromagnetic coupling.


title: Regularizing Deep Multi-Task Networks using Orthogonal Gradients

abstract: Deep neural networks are a promising approach towards multi-task learning because of their capability to leverage knowledge across domains and learn general purpose representations. Nevertheless, they can fail to live up to these promises as tasks often compete for a model's limited resources, potentially leading to lower overall performance. In this work we tackle the issue of interfering tasks through a comprehensive analysis of their training, derived from looking at the interaction between gradients within their shared parameters. Our empirical results show that well-performing models have low variance in the angles between task gradients and that popular regularization methods implicitly reduce this measure. Based on this observation, we propose a novel gradient regularization term that minimizes task interference by enforcing near orthogonal gradients. Updating the shared parameters using this property encourages task specific decoders to optimize different parts of the feature extractor, thus reducing competition. We evaluate our method with classification and regression tasks on the multiDigitMNIST, NYUv2 and SUN RGB-D datasets where we obtain competitive results.


title: Empirical and Instance-Dependent Estimation of Markov Chain and Mixing Time

abstract: We address the problem of estimating the mixing time of a Markov chain from a single trajectory of observations. Unlike most previous works which employed Hilbert space methods to estimate spectral gaps, we opt for an approach based on contraction with respect to total variation. Specifically, we estimate the contraction coefficient introduced in Wolfer [2020], inspired from Dobrushin's. This quantity, unlike the spectral gap, controls the mixing time up to strong universal constants and remains applicable to non-reversible chains. We improve existing fully data-dependent confidence intervals around this contraction coefficient, which are both easier to compute and thinner than spectral counterparts. Furthermore, we introduce a novel analysis beyond the worst-case scenario by leveraging additional information about the transition matrix. This allows us to derive instance-dependent rates for estimating the matrix with respect to the induced uniform norm, and some of its mixing properties.


title: A class of sectorial relations and the associated closed forms

abstract: Let $T$ be a closed linear relation from a Hilbert space ${\mathfrak H}$ to a Hilbert space ${\mathfrak K}$ and let $B \in \mathbf{B}({\mathfrak K})$ be selfadjoint. It will be shown that the relation $T^{*}(I+iB)T$ is maximal sectorial via a matrix decomposition of $B$ with respect to the orthogonal decomposition ${\mathfrak H}={\rm d\overline{om}\,} T^* \oplus {\rm mul\,} T$. This leads to an explicit expression of the corresponding closed sectorial form. These results include the case where ${\rm mul\,} T$ is invariant under $B$. The more general description makes it possible to give an expression for the extremal maximal sectorial extensions of the sum of sectorial relations. In particular, one can characterize when the form sum extension is extremal.


title: A Blueprint for the Milky Way's Stellar Populations: The Power of Large Photometric and Astrometric Surveys

abstract: Recent advances from astronomical surveys have revealed spatial, chemical, and kinematical inhomogeneities in the inner region of the stellar halo of the Milky Way Galaxy. In particular, large spectroscopic surveys, combined with Gaia astrometric data, have provided powerful tools for analyzing the detailed abundances and accurate kinematics for individual stars. Despite these noteworthy efforts, however, spectroscopic samples are typically limited by the numbers of stars considered; their analysis and interpretation are also hampered by the complex selection functions that are often employed. Here we present a powerful alternative approach $-$ a synoptic view of the spatial, chemical, and kinematical distributions of stars in the Milky Way based on large photometric survey databases, enabled by a well-calibrated technique for obtaining individual stellar metal abundances from broad-band photometry. We combine metallicities with accurate proper motions from the Gaia mission along the Prime Meridian of the Galaxy, and find that various stellar components are clearly separated from each other in the metallicity versus rotation-velocity space. The observed metallicity distribution of the inner-halo stars deviates from the traditional single-peaked distribution, and exhibits complex substructures comprising varying contributions from individual stellar populations, sometimes with striking double peaks at low metallicities. The substructures revealed from our less-biased, comprehensive maps demonstrate the clear advantages of this approach, which can be built upon by future mixed-band and broad-band photometric surveys, and used as a blueprint for identifying the stars of greatest interest for upcoming spectroscopic studies.


title: Pumping Dynamics of Cold-Atom Experiments in a Single Vacuum Chamber

abstract: A nonlinear analytical model for the pressure dynamics in a vacuum chamber, pumped with a sputter ion pump (SIP), is proposed, discussed and experimentally evaluated. The model describes the physics of the pumping mechanism of SIPs in the context of a cold-atom experiment. By using this model, we fit pump-down curves of our vacuum system to extract the relevant physical parameters characterizing its pressure dynamics. The aim of this investigation is the optimization of cold-atom experiments in terms of reducing the dead time for quantum sensing using atom interferometry. We develop a calibration method to improve the precision in pressure measurements via the ion current in SIPs. Our method is based on a careful analysis of the gas conductance and pumping in order to reliably link the pressure readings at the SIP with the actual pressure in the vacuum (science) chamber. Our results are in agreement with the existence of essentially two pumping regimes determined by the pressure level in the system. In particular, we find our results in agreement with the well-known fact that for a given applied voltage, at low pressures, the discharge current efficiently sputters pumping material from the pump's electrodes. This process sets the leading pumping mechanism in this limit. At high pressures, the discharge current drops and the pumping is mainly performed by the already sputtered material.


title: Hitchin systems on hyperelliptic curves

abstract: We describe a class of spectral curves and find explicit formulas for Darboux coordinates for hyperelliptic Hitchin systems corresponding to classical simple Lie groups. We consider in detail the systems with classical rank 2 gauge groups on genus 2 curves.


title: IMPRESS: Improving Engagement in Software Engineering Courses through Gamification

abstract: Software Engineering courses play an important role for preparing students with the right knowledge and attitude for software development in practice. The implication is far reaching, as the quality of the software that we use ultimately depends on the quality of the people that make them. Educating Software Engineering, however, is quite challenging, as the subject is not considered as most exciting by students, while teachers often have to deal with exploding number of students. The EU project IMPRESS seeks to explore the use of gamification in educating software engineering at the university level to improve students' engagement and hence their appreciation for the taught subjects. This paper presents the project, its objectives, and its current progress.


title: Compact chip-scale guided cold atom gyrometers for inertial navigation: Enabling technologies and design study

abstract: This work reviews the topic of rotation sensing with compact cold atom interferometers. A representative set of compact free-falling cold atom gyroscopes is considered because, in different respects, they establish a rotation-measurement reference for cold guided-atom technologies. This review first discusses enabling technologies relevant to a set of key functional building blocks of an atom chip-based compact inertial sensor with cold guided atoms. These functionalities concern the accurate and reproducible positioning of atoms to initiate a measurement cycle, the coherent momentum transfer to the atom wave packets, the suppression of propagation-induced decoherence due to potential roughness, on-chip detection, and vacuum dynamics because of its impact on sensor stability, which is due to the measurement dead time. Based on the existing enabling technologies, the design of an atom chip gyroscope with guided atoms is formalized using a design case that treats design elements such as guiding, fabrication, scale factor, rotation-rate sensitivity, spectral response, important noise sources, and sensor stability.


title: Study of Adaptive Activity-Aware Constellation List-Based Detection for Massive Machine-Type Communications

abstract: In this work, we propose an adaptive list-based decision feedback detector along with an $l_0$-norm regularized recursive least-squares algorithm that only requires pilot symbols (AA-CL-DF). The proposed detector employs a list strategy based on the signal constellation points to generate different candidates for detection. Simulation results show that the proposed AA-CL-DF successfully mitigates the error propagation and approaches the performance for the oracle LMMSE algorithm.


title: The Tarantula Massive Binary Monitoring. IV. Double-lined photometric binaries

abstract: A high fraction of massive stars are found to be binaries but only a few of them are reported as photometrically variable. By studying the populations of SB2 in the 30 Doradus region, we found a subset of them that have photometry from the OGLE project and that display variations in their light curves related to orbital motions. The goal of this study is to determine the dynamical masses and radii of the 26 binary components to investigate the mass-discrepancy problem and to provide an empirical mass-luminosity relation for the LMC. We use the PHOEBE programme to perform a systematic analysis of the OGLE V and I light curves obtained for 13 binary systems in 30 Dor. We adopt Teff, and orbital parameters derived previously to obtain the inclinations of the systems and the parameters of the individual components. Three systems display eclipses in their light curves, while the others only display ellipsoidal variations. We classify two systems as over-contact, five as semi-detached, and four as detached. The two remaining systems have uncertain configurations due to large uncertainties on their inclinations. The fact that systems display ellipsoidal variations has a significant impact on the inclination errors. From the dynamical masses, luminosities, and radii, we provide LMC-based empirical mass-luminosity and mass-radius relations, and we compare them to other relations given for the Galaxy, the LMC, and the SMC. These relations differ for different mass ranges, but do not seem to depend on the metallicity regimes. We also compare the dynamical, spectroscopic, and evolutionary masses of the stars in our sample. While the dynamical and spectroscopic masses agree with each other, the evolutionary masses are systematically higher, at least for stars in semi-detached systems. This suggests that the mass discrepancy can be partly explained by past or ongoing interactions between the stars.


title: Tensor rank and entanglement of pure quantum states

abstract: The rank of a tensor is analyzed in context of quantum entanglement. A pure quantum state $\bf v$ of a composite system consisting of $d$ subsystems with $n$ levels each is viewed as a vector in the $d$-fold tensor product of $n$-dimensional Hilbert space and can be identified with a tensor with $d$ indices, each running from $1$ to $n$. We discuss the notions of the generic rank and the maximal rank of a tensor and review results known for the low dimensions. Another variant of this notion, called the border rank of a tensor, is shown to be relevant for characterization of orbits of quantum states generated by the group of special linear transformations. A quantum state ${\bf v}$ is called {\sl entangled}, if it {\sl cannot} be written in the product form, ${\bf v} \ne {\bf v}_1 \otimes {\bf v}_2 \otimes \cdots \otimes {\bf v}_d$, what implies correlations between physical subsystems. A relation between various ranks and norms of a tensor and the entanglement of the corresponding quantum state is revealed..


title: Planar maps and random partitions

abstract: This habilitation thesis summarizes the research that I have carried out from 2005 to 2019. It is organized in four chapters. The first three deal with random planar maps. Chapter 1 is about their metric properties: from a general map-mobile bijection, we compute the three-point function of quadrangulations, before discussing the connection with continued fractions. Chapter 2 presents the slice decomposition, a unified bijective approach that applies notably to irreducible maps. Chapter 3 concerns the $O(n)$ loop model on planar maps: by a combinatorial decomposition, we obtain the phase diagram before studying loop nesting statistics. Chapter 4 deals with random partitions and Schur processes, from steep domino tilings to fermionic systems.


title: Dynamic drags acting on moving defects in discrete dispersive media: from dislocation to low-angle grain boundary

abstract: Although continuum theory has been widely used to describe the long-range elastic behavior of dislocations, it is limited in its ability to describe mechanical behaviors that occur near dislocation cores. This limit of the continuum theory mainly stems from the discrete nature of the core region, which induces a drag force on the dislocation core during glide. Depending on external conditions, different drag mechanisms are activated that govern the dynamics of dislocations in their own way. This is revealed by the resultant speed of the dislocation. In this work, we develop a theoretical framework that generally describes the dynamic drag on dislocations and, as a result, derive a phenomenological constitutive equation. Furthermore, given that a low-angle grain boundary (LAGB) can be regarded as an array of dislocations, we extend the model to describe the mobility law of LAGBs as a function of misorientation angle. As a result, we prove that both dislocations and LAGBs follow the developed constitutive equation with the same mathematical form despite their different governing drag sources. The suggested model is also supported by molecular dynamics simulations. Therefore, this work has significance for a fundamental understanding of the dynamic drag acting on defects and facilitates a general description of various drag mechanisms.


title: XMP gas-rich dwarfs in Nearby Voids: results of SALT spectroscopy

abstract: In the framework of an ongoing project aimed at searching for and studying eXtremely Metal-Poor (XMP) very gas-rich blue dwarfs in nearby voids, we conducted spectroscopy with the 11-m Southern African Large Telescope (SALT) of 26 candidates, preselected in the first paper of this series (PEPK19). For 23 of them, we detected Oxygen lines, allowing us to estimate the gas O/H ratio. For ten of them, the oxygen abundance is found to be very low, in the range of 12+log(O/H)=6.95-7.30 dex. Of those, four void dwarfs have 12+log(O/H) < 7.19, or Z < Zo/30. For the majority of observed galaxies, the faint line [OIII]4363A used to estimate O/H with the direct T_e method appeared either too noisy or was not detected. We therefore use the semi-empirical method of Izotov, Thuan (2007) for these spectra, or, when applicable, the new 'Strong line' method of Izotov et al. (2019b). We present and discuss the results for all void dwarfs observed in this work. We also compare their O/H values with O/H values of ~140 void galaxies available from our recent papers. We address the properties of the newly found unusual void XMP dwarfs and compare them with those for ten known prototype void XMP objects. The latter small group is outstanding based on their very small mass fraction of stars (only 0.01--0.02 of the baryonic mass), the blue colours of stars in the outer body (indicating a non-cosmological age for the main star-forming episode), and the low gas metallicity (several times lower than expected for their luminosity).


title: LScDC-new large scientific dictionary

abstract: In this paper, we present a scientific corpus of abstracts of academic papers in English -- Leicester Scientific Corpus (LSC). The LSC contains 1,673,824 abstracts of research articles and proceeding papers indexed by Web of Science (WoS) in which publication year is 2014. Each abstract is assigned to at least one of 252 subject categories. Paper metadata include these categories and the number of citations. We then develop scientific dictionaries named Leicester Scientific Dictionary (LScD) and Leicester Scientific Dictionary-Core (LScDC), where words are extracted from the LSC. The LScD is a list of 974,238 unique words (lemmas). The LScDC is a core list (sub-list) of the LScD with 104,223 lemmas. It was created by removing LScD words appearing in not greater than 10 texts in the LSC. LScD and LScDC are available online. Both the corpus and dictionaries are developed to be later used for quantification of meaning in academic texts. Finally, the core list LScDC was analysed by comparing its words and word frequencies with a classic academic word list 'New Academic Word List (NAWL)' containing 963 word families, which is also sampled from an academic corpus. The major sources of the corpus where NAWL is extracted are Cambridge English Corpus (CEC), oral sources and textbooks. We investigate whether two dictionaries are similar in terms of common words and ranking of words. Our comparison leads us to main conclusion: most of words of NAWL (99.6%) are present in the LScDC but two lists differ in word ranking. This difference is measured.


title: Knowledge-based Conversational Search

abstract: Conversational interfaces that allow for intuitive and comprehensive access to digitally stored information remain an ambitious goal. In this thesis, we lay foundations for designing conversational search systems by analyzing the requirements and proposing concrete solutions for automating some of the basic components and tasks that such systems should support. We describe several interdependent studies that were conducted to analyse the design requirements for more advanced conversational search systems able to support complex human-like dialogue interactions and provide access to vast knowledge repositories. In the first two research chapters, we focus on analyzing the structures common to information-seeking dialogues by capturing recurrent patterns in terms of both domain-independent functional relations between utterances as well as domain-specific implicit semantic relations from shared background knowledge. Our results show that question answering is one of the key components required for efficient information access but it is not the only type of dialogue interactions that a conversational search system should support. In the third research chapter, we propose a novel approach for complex question answering from a knowledge graph that surpasses the current state-of-the-art results in terms of both efficacy and efficiency. In the last research chapter, we turn our attention towards an alternative interaction mode, which we termed conversational browsing, in which, unlike question answering, the conversational system plays a more pro-active role in the course of a dialogue interaction. We show that this approach helps users to discover relevant items that are difficult to retrieve using only question answering due to the vocabulary mismatch problem.


title: Resolving Congestions in the Air Traffic Management Domain via Multiagent Reinforcement Learning Methods

abstract: In this article, we report on the efficiency and effectiveness of multiagent reinforcement learning methods (MARL) for the computation of flight delays to resolve congestion problems in the Air Traffic Management (ATM) domain. Specifically, we aim to resolve cases where demand of airspace use exceeds capacity (demand-capacity problems), via imposing ground delays to flights at the pre-tactical stage of operations (i.e. few days to few hours before operation). Casting this into the multiagent domain, agents, representing flights, need to decide on own delays w.r.t. own preferences, having no information about others' payoffs, preferences and constraints, while they plan to execute their trajectories jointly with others, adhering to operational constraints. Specifically, we formalize the problem as a multiagent Markov Decision Process (MA-MDP) and we show that it can be considered as a Markov game in which interacting agents need to reach an equilibrium: What makes the problem more interesting is the dynamic setting in which agents operate, which is also due to the unforeseen, emergent effects of their decisions in the whole system. We propose collaborative multiagent reinforcement learning methods to resolve demand-capacity imbalances: Extensive experimental study on real-world cases, shows the potential of the proposed approaches in resolving problems, while advanced visualizations provide detailed views towards understanding the quality of solutions provided.


title: A subclass of the Cowen-Douglas class and similarity

abstract: We consider a subclass of the Cowen-Douglas class in which the problem of deciding whether two operators are similar becomes more manageable. A similarity criterion for Cowen-Douglas operators is known to be dependent on the trace of the curvatures of the corresponding eigenvector bundles. Unless the given eignvector bundle is a line bundle, the computation of the curvatures, in general, is not so simple as one might hope. By using a structure theorem given in \cite{JW}, we reduce the problem of finding the trace of the curvatures to looking at the curvatures of the associated line bundles. Moreover, several questions related to the similarity problem are also taken into account.


title: Approximate and Robust Bounded Job Start Scheduling for Royal Mail Delivery Offices

abstract: Motivated by mail delivery scheduling problems arising in Royal Mail, we study a generalization of the fundamental makespan scheduling P||Cmax problem which we call the bounded job start scheduling problem. Given a set of jobs, each specified by an integer processing time p_j, that have to be executed non-preemptively by a set of m parallel identical machines, the objective is to compute a minimum makespan schedule subject to an upper bound g<=m on the number of jobs that may simultaneously begin per unit of time. With perfect input knowledge, we show that Longest Processing Time First (LPT) algorithm is tightly 2-approximate. After proving that the problem is strongly NP-hard even when g=1, we elaborate on improving the 2-approximation ratio for this case. We distinguish the classes of long and short instances satisfying p_j>=m and p_j<m, respectively, for each job j. We show that LPT is 5/3-approximate for the former and optimal for the latter. Then, we explore scheduling long jobs in parallel with short jobs to obtain tightly satisfied packing and bounded job start constraints. For a broad family of instances excluding degenerate instances with many very long jobs, we derive a 1.985-approximation ratio. For general instances, we require machine augmentation to obtain better than 2-approximate schedules. Under uncertain job processing times, we exploit machine augmentation and lexicographic optimization to propose a two-stage robust optimization approach for bounded job start scheduling under uncertainty aiming in a low number of used machines. Given a collection of schedules of makespan <= D, this approach allows distinguishing which are the more robust. We substantiate both the heuristics and our recovery approach numerically using Royal Mail data. We show that, for the Royal Mail application, machine augmentation, i.e. short-term van rental, is especially relevant.


title: Survivor: A Fine-Grained Intrusion Response and Recovery Approach for Commodity Operating Systems

abstract: Despite the deployment of preventive security mechanisms to protect the assets and computing platforms of users, intrusions eventually occur. We propose a novel intrusion survivability approach to withstand ongoing intrusions. Our approach relies on an orchestration of fine-grained recovery and per-service responses (e.g., privileges removal). Such an approach may put the system into a degraded mode. This degraded mode prevents attackers to reinfect the system or to achieve their goals if they managed to reinfect it. It maintains the availability of core functions while waiting for patches to be deployed. We devised a cost-sensitive response selection process to ensure that while the service is in a degraded mode, its core functions are still operating. We built a Linux-based prototype and evaluated the effectiveness of our approach against different types of intrusions. The results show that our solution removes the effects of the intrusions, that it can select appropriate responses, and that it allows services to survive when reinfected. In terms of performance overhead, in most cases, we observed a small overhead, except in the rare case of services that write many small files asynchronously in a burst, where we observed a higher but acceptable overhead.


title: Simulation of a Compact Object with Outflows Moving Through a Gaseous Background

abstract: A compact object moving relative to surrounding gas accretes material and perturbs the density of gas in its vicinity. In the classical picture of Bondi-Hoyle-Lyttleton accretion, the perturbation takes the form of an overdense wake behind the object, which exerts a dynamical friction drag. We use hydrodynamic simulations to investigate how the accretion rate and strength of dynamical friction are modified by the presence of outflow from the compact object. We show that the destruction of the wake by an outflow reduces dynamical friction, and reverses its sign when the outflow is strong enough, in good quantitative agreement with analytic calculations. For a strong isotropic outflow, the outcome on scales that we have simulated is a negative dynamical friction, i.e., net acceleration. For jet-like outflows driven by reprocessed accretion, both the rate of accretion and the magnitude of dynamical friction drop for more powerful jets. The accretion rate is strongly intermittent when the jet points to the same direction as the motion of the compact object. The dynamical effects of outflows may be important for the evolution of compact objects during the common envelope phase of binary systems, and for accreting compact objects and massive stars encountering AGN discs.


title: Randomized derivative-free Milstein algorithm for efficient approximation of solutions of SDEs under noisy information

abstract: We deal with pointwise approximation of solutions of scalar stochastic differential equations in the presence of informational noise about underlying drift and diffusion coefficients. We define a randomized derivative-free version of Milstein algorithm $\mathcal{\bar A}^{df-RM}_n$ and investigate its error. We also study lower bounds on the error of an arbitrary algorithm. It turns out that in some case the scheme $\mathcal{\bar A}^{df-RM}_n$ is the optimal one. Finally, in order to test the algorithm $\mathcal{\bar A}^{df-RM}_n$ in practice, we report performed numerical experiments.


title: Fourth-order moment of the light field in atmosphere

abstract: The quasiclassical distribution function for photon density in the phase space is obtained from solution of the kinetic equation. This equation describes propagation of paraxial laser beams in the Earth atmosphere where "collision integral" embodies the influence of turbulence. The anisotropy of photon distribution is shown and explained. For long propagation path, the explicit expression for fourth-order moment of light is obtained as a sum of linear and quadratic forms of the average distribution function. This moment describes a spatial correlation of four light waves, giving the information about the photon distribution in the cross-section of the beam. The fourth moment can be measured using two small detectors outside the central part of the beam. The linear form describes the shot noise (quantum fluctuations) of photons. The range where the shot noise exceeds the classical noise is found analytically. Derived photon fluctuations are the valuable source of information about statistical properties and local structure of the laser radiation that can be used for applications.


title: Could star-planet magnetic interactions lead to planet migration and influence stellar rotation ?

abstract: The distribution of hot Jupiters, for which star-planet interactions can be significant, questions the evolution of exosystems. We aim to follow the orbital evolution of a planet along the rotational and structural evolution of the host star by taking into account the coupled effects of tidal and magnetic torques from ab initio prescriptions. It allows us to better understand the evolution of star-planet systems and to explain some properties of the distribution of observed close-in planets. To this end we use a numerical model of a coplanar circular star-planet system taking into account stellar structural changes, wind braking and star-planet interactions, called ESPEM (Benbakoura et al. 2019). We find that depending on the initial configuration of the system, magnetic effects can dominate tidal effects during the various phases of the evolution, leading to an important migration of the planet and to significant changes on the rotational evolution of the star. Both kinds of interactions thus have to be taken into account to predict the evolution of compact star-planet systems.


title: Periodic Modulation : Newly emergent emission behaviour in Pulsars

abstract: Periodic modulations are seen in normal period pulsars ($P >$ 0.1 sec) over timescales ranging from a few seconds to several minutes. Such modulations have usually been associated with the phenomenon of subpulse drifting. A number of recent studies have shown subpulse drifting to exhibit very specific physical characteristics : i) drifting is seen only in conal components of the pulse profile and is absent in central core emission; ii) drifting pulsars are distributed over a narrow range of spin-down energy loss ($\dot{E}$), where pulsars with $\dot{E} < 2\times$10$^{32}$ erg s$^{-1}$ show this behaviour, iii) drifting periodicity ($P_3$) is anti-correlated with $\dot{E}$, such that pulsars with lower values of $\dot{E}$ tend to have longer $P_3$. These detailed characterisations of drifting behaviour on the other hand also revealed the presence of other distinct periodic modulations, which can be broadly categorised into two types, periodic nulling and periodic amplitude modulation. In contrast to drifting these periodic phenomena are seen across the entire profile in both the core and conal components simultaneously and are not restricted to any specific $\dot{E}$ range. In this work we have assembled an exhaustive list of around 70 pulsars which show such periodic modulations, 22 of which were newly detected using observations from the Giant Meterwave Radio Telescope and the remaining compiled from past publications. The presence of such a significant group in the pulsar population suggests that periodic nulling and periodic amplitude modulations are newly emergent phenomena in pulsars with their physical origin distinct from subpulse drifting.


title: Global constraints preserving SAV schemes for gradient flows

abstract: We develop several efficient numerical schemes which preserve exactly the global constraints for constrained gradient flows. Our schemes are based on the SAV approach combined with the Lagrangian multiplier approach. They are as efficient as the SAV schemes for unconstrained gradient flows, i.e., only require solving linear equations with constant coefficients at each time step plus an additional nonlinear algebraic system which can be solved at negligible cost, can be unconditionally energy stable, and preserve exactly the global constraints for constrained gradient flows. Ample numerical results for phase-field vesicle membrane and optimal partition models are presented to validate the effectiveness and accuracy of the proposed numerical schemes.


title: Accurate solar-power integration: Solar-weighted Gaussian quadrature

abstract: In this technical note, we explain how to construct Gaussian quadrature rules for efficiently and accurately computing integrals of S(x)f(x) where S(x) is the solar irradiance function tabulated in the ASTM standard and f(x) is an arbitary application-specific smooth function. This allows the integral to be computed accurately with a relatively small number of f(x) evaluations despite the fact that S(x) is non-smooth and wildly oscillatory. Julia software is provided to compute solar-weighted quadrature rules for an arbitrary bandwidth or number of points. We expect that this technique will be useful in solar-energy calculations, where f(x) is often a computationally expensive function such as an absorbance calculated by solving Maxwell's equations.


title: Privacy-Preserving Claims Exchange Networks for Virtual Asset Service Providers

abstract: In order for VASPs to fulfill the regulatory requirements from the FATF and the Travel Rule, VASPs need access to truthful information regarding originators, beneficiaries and other VASPs involved in a virtual asset transfer instance. Additionally, in seeking data regarding subjects (individuals or organizations) VASPs are faced with privacy regulations such as the GDPR and CCPA. In this paper we a propose privacy-preserving claims issuance model that carries indicators of the provenance of the data and the algorithms used to derive the claim or assertion. This allows VASPs to obtain originator and beneficiary information without necessarily having access to the private data about these entities. Secondly we propose the use of a consortium trust network arrangement for VASPs to exchange signed claims about subjects and their public-key information or certificate.


title: Towards Robust Toxic Content Classification

abstract: Toxic content detection aims to identify content that can offend or harm its recipients. Automated classifiers of toxic content need to be robust against adversaries who deliberately try to bypass filters. We propose a method of generating realistic model-agnostic attacks using a lexicon of toxic tokens, which attempts to mislead toxicity classifiers by diluting the toxicity signal either by obfuscating toxic tokens through character-level perturbations, or by injecting non-toxic distractor tokens. We show that these realistic attacks reduce the detection recall of state-of-the-art neural toxicity detectors, including those using ELMo and BERT, by more than 50% in some cases. We explore two approaches for defending against such attacks. First, we examine the effect of training on synthetically noised data. Second, we propose the Contextual Denoising Autoencoder (CDAE): a method for learning robust representations that uses character-level and contextual information to denoise perturbed tokens. We show that the two approaches are complementary, improving robustness to both character-level perturbations and distractors, recovering a considerable portion of the lost accuracy. Finally, we analyze the robustness characteristics of the most competitive methods and outline practical considerations for improving toxicity detectors.


title: Quotients of uniform positroids

abstract: Flag matroids are a rich family of Coxeter matroids that can be characterized using pairs of matroids that form a quotient. We consider a class of matroids called positroids, introduced by Postnikov, and utilize their combinatorial representations to explore characterizations of flag positroids. Given a uniform positroid, we give a purely combinatorial characterization of a family of positroids that form quotients with it. We state this in terms of their associated decorated permutations. In proving our characterization we also fully describe the circuits of this family.


title: The Liar's Walk: Detecting Deception with Gait and Gesture

abstract: We present a data-driven deep neural algorithm for detecting deceptive walking behavior using nonverbal cues like gaits and gestures. We conducted an elaborate user study, where we recorded many participants performing tasks involving deceptive walking. We extract the participants' walking gaits as series of 3D poses. We annotate various gestures performed by participants during their tasks. Based on the gait and gesture data, we train an LSTM-based deep neural network to obtain deep features. Finally, we use a combination of psychology-based gait, gesture, and deep features to detect deceptive walking with an accuracy of 88.41%. This is an improvement of 10.6% over handcrafted gait and gesture features and an improvement of 4.7% and 9.2% over classifiers based on the state-of-the-art emotion and action classification algorithms, respectively. Additionally, we present a novel dataset, DeceptiveWalk, that contains gaits and gestures with their associated deception labels. To the best of our knowledge, ours is the first algorithm to detect deceptive behavior using non-verbal cues of gait and gesture.


title: Natural Actor-Critic Converges Globally for Hierarchical Linear Quadratic Regulator

abstract: Multi-agent reinforcement learning has been successfully applied to a number of challenging problems. Despite these empirical successes, theoretical understanding of different algorithms is lacking, primarily due to the curse of dimensionality caused by the exponential growth of the state-action space with the number of agents. We study a fundamental problem of multi-agent linear quadratic regulator (LQR) in a setting where the agents are partially exchangeable. In this setting, we develop a hierarchical actor-critic algorithm, whose computational complexity is independent of the total number of agents, and prove its global linear convergence to the optimal policy. As LQRs are often used to approximate general dynamic systems, this paper provides an important step towards a better understanding of general hierarchical mean-field multi-agent reinforcement learning.


title: Attending Form and Context to Generate Specialized Out-of-VocabularyWords Representations

abstract: We propose a new contextual-compositional neural network layer that handles out-of-vocabulary (OOV) words in natural language processing (NLP) tagging tasks. This layer consists of a model that attends to both the character sequence and the context in which the OOV words appear. We show that our model learns to generate task-specific \textit{and} sentence-dependent OOV word representations without the need for pre-training on an embedding table, unlike previous attempts. We insert our layer in the state-of-the-art tagging model of \citet{plank2016multilingual} and thoroughly evaluate its contribution on 23 different languages on the task of jointly tagging part-of-speech and morphosyntactic attributes. Our OOV handling method successfully improves performances of this model on every language but one to achieve a new state-of-the-art on the Universal Dependencies Dataset 1.4.


title: Hydrothermal Scheduling in the Continuous-Time Framework

abstract: Continuous-time optimization models have successfully been used to capture the impact of ramping limitations in power systems. In this paper, the continuous-time framework is adapted to model flexible hydropower resources interacting with slow-ramping thermal generators to minimize the hydrothermal system cost of operation. To accurately represent the non-linear hydropower production function with forbidden production zones, binary variables must be used when linearizing the discharge variables and the continuity constraints on individual hydropower units must be relaxed. To demonstrate the performance of the proposed continuous-time hydrothermal model, a small-scale case study of a hydropower area connected to a thermal area through a controllable high-voltage direct current (HVDC) cable is presented. Results show how the flexibility of the hydropower can reduce the need for ramping by thermal units triggered by intermittent renewable power generation. A reduction of 34% of the structural imbalances in the system is achieved by using the continuous-time model.


title: Conquering the Extensional Scalability Problem for Value-Flow Analysis Frameworks

abstract: With an increasing number of value-flow properties to check, existing static program analysis still tends to have scalability issues when high precision is required. We observe that the key design flaw behind the scalability problem is that the core static analysis engine is oblivious of the mutual synergies among different properties being checked and, thus, inevitably loses many optimization opportunities. Our approach is inter-property-aware and able to capture possible overlaps and inconsistencies among different properties. Thus, before analyzing a program, we can make optimization plans which decide how to reuse the specific analysis results of a property to speed up checking other properties. Such a synergistic interaction among the properties significantly improves the analysis performance. We have evaluated our approach by checking twenty value-flow properties in standard benchmark programs and ten real-world software systems. The results demonstrate that our approach is more than 8x faster than existing ones but consumes only 1/7 memory. Such a substantial improvement in analysis efficiency is not achieved by sacrificing the effectiveness: at the time of writing, 39 bugs found by our approach have been fixed by developers and four of them have been assigned CVE IDs due to their security impact.


title: Sensor Fusion using Backward Shortcut Connections for Sleep Apnea Detection in Multi-Modal Data

abstract: Sleep apnea is a common respiratory disorder characterized by breathing pauses during the night. Consequences of untreated sleep apnea can be severe. Still, many people remain undiagnosed due to shortages of hospital beds and trained sleep technicians. To assist in the diagnosis process, automated detection methods are being developed. Recent works have demonstrated that deep learning models can extract useful information from raw respiratory data and that such models can be used as a robust sleep apnea detector. However, trained sleep technicians take into account multiple sensor signals when annotating sleep recordings instead of relying on a single respiratory estimate. To improve the predictive performance and reliability of the models, early and late sensor fusion methods are explored in this work. In addition, a novel late sensor fusion method is proposed which uses backward shortcut connections to improve the learning of the first stages of the models. The performance of these fusion methods is analyzed using CNN as well as LSTM deep learning base-models. The results demonstrate a significant and consistent improvement in predictive performance over the single sensor methods and over the other explored sensor fusion methods, by using the proposed sensor fusion method with backward shortcut connections.


title: Spatial Influence-aware Reinforcement Learning for Intelligent Transportation System

abstract: Intelligent transportation systems (ITSs) are envisioned to be crucial for smart cities, which aims at improving traffic flow to improve the life quality of urban residents and reducing congestion to improve the efficiency of commuting. However, several challenges need to be resolved before such systems can be deployed, for example, conventional solutions for Markov decision process (MDP) and single-agent Reinforcement Learning (RL) algorithms suffer from poor scalability, and multi-agent systems suffer from poor communication and coordination. In this paper, we explore the potential of mutual information sharing, or in other words, spatial influence based communication, to optimize traffic light control policy. First, we mathematically analyze the transportation system. We conclude that the transportation system does not have stationary Nash Equilibrium, thereby reinforcement learning algorithms offer suitable solutions. Secondly, we describe how to build a multi-agent Deep Deterministic Policy Gradient (DDPG) system with spatial influence and social group utility incorporated. Then we utilize the grid topology road network to empirically demonstrate the scalability of the new system. We demonstrate three types of directed communications to show the effect of directions of social influence on the entire network utility and individual utility. Lastly, we define "selfish index" and analyze the effect of it on total group utility.


title: Hyperviscous stochastic Navier-Stokes equations with white noise invariant measure in two dimensions

abstract: We prove existence and uniqueness of martingale solutions to a (slightly) hyperviscous stochastic Navier-Stokes equation in 2d with initial conditions absolutely continuous with respect to the Gibbs measure associated to the energy, getting the results both in the torus and in the whole space setting.


title: Analysis of evanescently-coupled pairs of spin-polarised vertical-cavity surface-emitting lasers

abstract: A general model for the dynamics of arrays of coupled, spin-polarised lasers is derived, which is shown to reduce to both the spin flip model in a single cavity and the coupled mode model for a pair of guides in the appropriate limit. The general model is able to deal with waveguides of any geometry with any number of supported normal modes. A unique feature of the model is that it allows for independent polarisation of the pumping in each laser. The particular geometry is shown to be introduced via `overlap factors', which are a generalisation of the optical confinement factor. These factors play an important role in determining the laser dynamics. The model is specialised to the case of a general double-guided structure, which is then analysed and simulated numerically. For this case it is found that increasing the ellipticity of the pumping tends to enhance the regions where stable solutions are predicted in the plane of pumping strength versus guide separation.