title: Shortlisting Rules and Incentives in an End-to-End Model for Participatory Budgeting

abstract: We introduce an end-to-end model of participatory budgeting grounded in social choice theory. This model accounts for both the first stage, in which participants propose projects to be shortlisted, and the second stage, in which they vote on which of the shortlisted projects should be funded. We introduce several shortlisting rules for the first stage and we analyse them in both normative and algorithmic terms. Our main focus is on the incentives of participants to engage in strategic behaviour, especially in the first stage, in which they need to reason about how their proposals will impact the range of strategies available to everyone in the second stage.


title: Zero-sum squares in $\{-1, 1\}$-matrices with low discrepancy

abstract: Given a matrix $M = (a_{i,j})$ a square is a $2 \times 2$ submatrix with entries $a_{i,j}$, $a_{i, j+s}$, $a_{i+s, j}$, $a_{i+s, j +s}$ for some $s \geq 1$, and a zero-sum square is a square where the entries sum to $0$. Recently, Ar\'evalo, Montejano and Rold\'an-Pensado proved that all large $n \times n$ $\{-1,1\}$-matrices $M$ with discrepancy $|\sum a_{i,j}| \leq n$ contain a zero-sum square unless they are split. We improve this bound by showing that all large $n \times n$ $\{-1,1\}$-matrices $M$ with discrepancy at most $n^2/4$ are either split or contain a zero-sum square. Since zero-sum square free matrices with discrepancy at most $n^2/2$ are already known, this bound is asymptotically optimal.


title: Quasielastic production of polarized $\tau$ leptons in $\nu_{\tau}$ and $\bar{\nu}_{\tau}$ scattering from nucleons

abstract: The cross sections and polarization components of the $\tau$ leptons produced in the charged current induced quasielastic $\nu_\tau~(\bar\nu_\tau) - N$ scattering have been studied. The theoretical uncertainties arising due to the use of different vector form factors and the axial dipole mass in the axial vector form factor have been investigated. Due to the high mass of $\tau$ lepton, the contributions from the term containing pseudoscalar and second class current form factors are non-negligible and contribute to the uncertainty in the cross section and polarization observables as these form factors are not well known. In view of the currently proposed experiments by DUNE, SHiP and DsTau collaborations to study the production of $\tau$ lepton, an updated calculation of the cross sections and polarizations of tau leptons in the case of quasielastic production have been done and the numerical results have been presented along with a discussion of the theoretical uncertainties.


title: Novel Hairy Black Hole Solutions in Einstein-Maxwell-Gauss-Bonnet-Scalar Theory

abstract: It has been previously shown that a Gauss-Bonnet term non-minimally coupled to a scalar field produces a scalarised black hole solution, which can be considered as having secondary scalar hair, parametrised in terms of the black hole's mass and charge. In this paper we extend a previously investigated linear coupling of the form $f(\phi)=\phi$ to a non-minimally coupled Maxwell term, with the form $\frac{1}{8}F_{\mu\nu}F^{\mu\nu}+\beta\phi F_{\mu\nu}F^{\mu\nu}$. By using numerical methods the solutions to the full differential equations are found, as well as a perturbative expansion in the $r\rightarrow\infty$ limit and a perturbative expansion in couplings parameters such as $\beta$. These solutions describe scalarised black holes with modified electric field which have dependence not only on the electric charge of the black hole, but also the value of the non-minimal coupling constant and the horizon radius or mass of the black hole. We also discuss the bounds imposed on the parameters of the black hole by the reality condition of the solution, giving some explicit numerical bounds.


title: On the vibrational free energy of hydrated proteins

abstract: When the hydration shell of a protein is filled with at least 0.6 gram of water per gram of protein, a significant anti-correlation between the vibrational free energy and the potential energy of energy-minimized conformers is observed. This means that low potential energy, well-hydrated, protein conformers tend to be more rigid than high-energy ones. On the other hand, in the case of CASP target 624, when its hydration shell is filled, a significant average energy gap is observed between the crystal structure and the best conformers proposed during the prediction experiment, strongly suggesting that including explicit water molecules may help identifying unlikely conformers among good-looking ones.


title: The complexity of finding and enumerating optimal subgraphs to represent spatial correlation

abstract: Understanding spatial correlation is vital in many fields including epidemiology and social science. Lee, Meeks and Pettersson (Stat. Comput. 2021) recently demonstrated that improved inference for areal unit count data can be achieved by carrying out modifications to a graph representing spatial correlations; specifically, they delete edges of the planar graph derived from border-sharing between geographic regions in order to maximise a specific objective function. In this paper we address the computational complexity of the associated graph optimisation problem. We demonstrate that this problem cannot be solved in polynomial time unless P = NP; we further show intractability for two simpler variants of the problem. We follow these results with two parameterised algorithms that exactly solve the problem. Both of these solve not only the decision problem, but also enumerate all solutions with polynomial time precalculation, delay, and postcalculation time in respective restricted settings. For this problem, efficient enumeration allows the uncertainty in the spatial correlation to be utilised in the modelling. The first enumeration algorithm utilises dynamic programming on a tree decomposition, and has polynomial time precalculation and linear delay if both the treewidth and maximum degree are bounded. The second algorithm is restricted to problem instances with maximum degree three, as may arise from triangulations of planar surfaces, but can output all solutions with FPT precalculation time and linear delay when the maximum number of edges that can be removed is taken as the parameter.


title: Revealing Short-period Exoplanets and Brown Dwarfs in the Galactic Bulge using the Microlensing Xallarap Effect with the \textit{Nancy Grace Roman Space Telescope}

abstract: The \textit{Nancy Grace Roman Space Telescope} (\textit{ Roman}) will provide an enormous number of microlensing light curves with much better photometric precisions than ongoing ground-based observations. Such light curves will enable us to observe high-order microlensing effects which have been previously difficult to detect. In this paper, we investigate \textit{Roman}'s potential to detect and characterize short-period planets and brown dwarfs (BDs) in source systems using the orbital motion of source stars, the so-called xallarap effect. We analytically estimate the measurement uncertainties of xallarap parameters using the Fisher matrix analysis. We show that the \textit{Roman} Galactic Exoplanet Survey (RGES) can detect warm Jupiters with masses down to 0.5 $M_{\rm Jup}$ and orbital period of 30 days via the xallarap effect. Assuming a planetary frequency function from \citet{Cumming+2008}, we find \textit{Roman} will detect $\sim10$ hot and warm Jupiters and $\sim30$ close-in BDs around microlensed source stars during the microlensing survey. These detections are likely to be accompanied by the measurements of the companion's masses and orbital elements, which will aid in the study of the physical properties for close-in planet and BD populations in the Galactic bulge.


title: Quantum tomography of an entangled three-spin state in silicon

abstract: Quantum entanglement is a fundamental property of coherent quantum states and an essential resource for quantum computing. While two-qubit entanglement has been demonstrated for spins in silicon, creation of multipartite entanglement, a first step toward implementing quantum error correction, has remained challenging due to the difficulties in controlling a multi-qubit array, such as device disorder, magnetic and electrical noises and exacting exchange controls. Here, we show operation of a fully functional three-qubit array in silicon and generation of a three-qubit Greenberger-Horne-Zeilinger (GHZ) state. We obtain a state fidelity of 88.0 percent by quantum state tomography, which witnesses a genuine GHZ-class quantum entanglement that is not biseparable. Our result shows the potential of silicon-based qubit platform for demonstrations of multiqubit quantum algorithms.


title: Tailoring the viscoelasticity of polymer gels of gluten proteins through solvent quality

abstract: We investigate the linear viscoelasticity of polymer gels produced by the dispersion of gluten proteins in water:ethanol binary mixtures with various ethanol contents, from pure water to 60% v/v ethanol. We show that the complex viscoelasticity of the gels exhibits a time/solvent composition superposition principle, demonstrating the self-similarity of the gels produced in different binary solvents. All gels can be regarded as near critical gels with characteristic rheological parameters, elastic plateau and characteristic relaxation time, which are related one to another, as a consequence of self-similarity, and span several orders of magnitude when changing the solvent composition. Thanks to calorimetry and neutron scattering experiments, we evidencea co-solvency effect with a better solvation of the complex polymer-like chains of the gluten proteins as the amount of ethanol increases. Overall the gel viscoelasticity can be accounted for by a unique characteristic length characterizing the crosslink density of the supramolecular network, which is solvent composition-dependent. On a molecular level, these findings could be interpreted as a transition of the supramolecular interactions, mainly H-bonds, from intra- to interchains, which would be facilitated by the disruption of hydrophobic interactions by ethanol molecules. This work provides new insight for tailoring the gelation process of complex polymer gels.


title: Higher dimensional formal loop spaces

abstract: If $M$ is a symplectic manifold then the space of smooth loops $\mathrm C^{\infty}(\mathrm S^1,M)$ inherits of a quasi-symplectic form. We will focus in this article on an algebraic analogue of that result. In 2004, Kapranov and Vasserot introduced and studied the formal loop space of a scheme $X$. We generalize their construction to higher dimensional loops. To any scheme $X$ -- not necessarily smooth -- we associate $\mathcal L^d(X)$, the space of loops of dimension $d$. We prove it has a structure of (derived) Tate scheme -- ie its tangent is a Tate module: it is infinite dimensional but behaves nicely enough regarding duality. We also define the bubble space $\mathcal B^d(X)$, a variation of the loop space. We prove that $\mathcal B^d(X)$ is endowed with a natural symplectic form as soon as $X$ has one (in the sense of [PTVV]). Throughout this paper, we will use the tools of $(\infty,1)$-categories and symplectic derived algebraic geometry.


title: Pressure-induced huge increase of Curie temperature of the van der Waals ferromagnet VI3

abstract: Evolution of magnetism in single crystals of the van der Waals compound VI3 in external pressure up to 7.3 GPa studied by measuring magnetization and ac magnetic susceptibility is reported. Four magnetic phase transitions, at T1 = 54.5 K, T2 = 53 K, TC = 49.5 K, and TFM = 26 K, respectively have been observed at ambient pressure. The first two have been attributed to the onset of ferromagnetism in specific crystal-surface layers. The bulk ferromagnetism is characterized by the magnetic ordering transition at Curie temperature TC and the transition between two different ferromagnetic phases TFM, accompanied by a structure transition from monoclinic to triclinic symmetry upon cooling. The pressure effects on magnetic parameters were studied with three independent techniques. TC was found to be almost unaffected by pressures up to 0.6 GPa whereas TFM increases rapidly with increasing pressure and reaches TC at a triple point at ~ 0.85 GPa. At higher pressures, only one magnetic phase transition is observed moving to higher temperatures with increasing pressure to reach 99 K at 7.3 GPa. In contrast, the low-temperature bulk magnetization is dramatically reduced by applying pressure (by more than 50% at 2.5 GPa) suggesting a possible pressure-induced reduction of vanadium magnetic moment. We discussed these results in light of recent theoretical studies to analyze exchange interactions and provide how to increase the Curie temperature of VI3.


title: Excess deaths, baselines, Z-scores, P-scores and peaks

abstract: The recent Covid-19 epidemic has lead to comparisons of the countries suffering from it. These are based on the number of excess deaths attributed either directly or indirectly to the epidemic. Unfortunately the data on which such comparisons rely are often incomplete and unreliable. This article discusses problems of interpretation of data even when the data is largely accurate and delayed by at most two to three weeks. This applies to the Office of National Statistics in the UK, the Statistisches Bundesamt in Germany and the Belgian statistical office Statbel. The data in the article is taken from these three sources. The number of excess deaths is defined as the number of deaths minus the baseline, the definition of which varies from country to country. In the UK it is the average number of deaths over the last five years, in Germany it is over the last four years and in Belgium over the last 11 years. This means that in all cases the individual baselines depend strongly on the timing and intensity of adverse factors such as past influenza epidemics and heat waves. This makes cross-country comparisons difficult. A baseline defined as the number the number of deaths in the absence of adverse factors can be operationalized by taking say the 10\% quantile of the number of deaths. This varies little over time and European countries within given age groups. It therefore enables more robust and accurate comparisons of different countries. The article criticizes the use of Z-scores which distort the comparison between countries. Finally the problem of describing past epidemics by their timing, that is start and finish and time of the maximum, and by their effect, the height of the maximum and the total number of deaths, is considered.


title: An explicit example of polynomials orthogonal on the unit circle with a dense point spectrum generated by a geometric distribution

abstract: We present a new explicit family of polynomials orthogonal on the unit circle with a dense point spectrum. This family is expressed in terms of q-hypergeometric function of type ${_2}\phi_1$. The orthogonality measure is the wrapped geometric distribution. Some "classical" properties of the above polynomials are presented.


title: The Timing Residual Patterns Due to Pulsar Acceleration

abstract: The form of timing residuals due to errors in pulsar spin period $P$ and its derivative $\dot{P}$, in positions, as well as in proper motions, have been well presented for decades in the literature. However, the residual patterns due to errors in the pulsar acceleration have not been reported previously, while a pulsar in the galaxy or a globular cluster (GC) will be unavoidably accelerated. The coupling effect of the pulsar transverse acceleration and the R$\rm{\ddot{o}}$mer delay on timing residuals are simulated in this work. The results show that the residual due to the effect can be identified by the oscillation envelopes of the residuals. It is also shown that the amplitude of the residual due to the effect is usually relatively small, however, it may probably be observable for pulsars distributing in the vicinity of the core of a nearby GC.


title: Topic-Guided Abstractive Text Summarization: a Joint Learning Approach

abstract: We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural topic modeling with a Transformer-based sequence-to-sequence (seq2seq) model in a joint learning framework. This design can learn and preserve the global semantics of the document, which can provide additional contextual guidance for capturing important ideas of the document, thereby enhancing the generation of summary. We conduct extensive experiments on two datasets and the results show that our proposed model outperforms many extractive and abstractive systems in terms of both ROUGE measurements and human evaluation. Our code is available at: https://github.com/chz816/tas.


title: Universal formalism for data sharing and processing in clock comparison networks

abstract: We present a mathematical framework adapted to the comparison of atomic clocks remotely connected by a complex network of optical or microwave links. This framework facilitates the computation of frequency ratios using a generic set of equations that are valid for a wide variety of clock architectures, making the comparison of a large number of clocks practical. This formalism suggests a generic data exchange protocol that can be used in clock comparison collaborations, for which data logging and decision taking are completely local procedures, independently implemented by the participants.


title: Galois reconstruction of Artin-Tate $\mathbb{R}$-motivic spectra

abstract: We explain how to reconstruct the category of Artin-Tate $\mathbb{R}$-motivic spectra as a deformation of the purely topological $C_2$-equivariant stable category. The special fiber of this deformation is algebraic, and equivalent to an appropriate category of $C_2$-equivariant sheaves on the moduli stack of formal groups. As such, our results directly generalize the cofiber of $\tau$ philosophy that has revolutionized classical stable homotopy theory. A key observation is that the Artin-Tate subcategory of $\mathbb{R}$-motivic spectra is easier to understand than the previously studied cellular subcategory. In particular, the Artin-Tate category contains a variant of the $\tau$ map, which is a feature conspicuously absent from the cellular category.


title: Bounds on metric dimensions of graphs with edge disjoint cycles

abstract: In a graph G, cardinality of the smallest ordered set of vertices that distinguishes every element of V (G) is the (vertex) metric dimension of G. Similarly, the cardinality of such a set is the edge metric dimension of G, if it distinguishes E(G). In this paper these invariants are considered first for unicyclic graphs, and it is shown that the vertex and edge metric dimensions obtain values from two particular consecutive integers, which can be determined from the structure of the graph. In particular, as a consequence, we obtain that these two invariants can differ for at most one for a same unicyclic graph. Next we extend the results to graphs with edge disjoint cycles showing that the two invariants can differ at most by c, where c is the number of cycles in such a graph. We conclude the paper with a conjecture that generalizes the previously mentioned consequences to graphs with prescribed cyclomatic number c by claiming that the difference of the invariant is still bounded by c.


title: Can Steering Wheel Detect Your Driving Fatigue?

abstract: Automated Driving System (ADS) has attracted increasing attention from both industrial and academic communities due to its potential for increasing the safety, mobility and efficiency of existing transportation systems. The state-of-the-art ADS follows the human-in-the-loop (HITL) design, where the driver's anomalous behaviour is closely monitored by the system. Though many approaches have been proposed for detecting driver fatigue, they largely depend on vehicle driving parameters and facial features, which lacks reliability. Approaches using physiological based sensors (e.g., electroencephalogram or electrocardiogram) are either too clumsy to wear or impractical to install. In this paper, we propose a novel driver fatigue detection method by embedding surface electromyography (sEMG) sensors on a steering wheel. Compared with the existing methods, our approach is able to collect bio-signals in a non-intrusive way and detect driver fatigue at an earlier stage. The experimental results show that our approach outperforms existing methods with the weighted average F1 scores about 90%. We also propose promising future directions to deploy this approach in real-life settings, such as applying multimodal learning using several supplementary sensors.


title: Interpretable Deep Learning for Automatic Diagnosis of 12-lead Electrocardiogram

abstract: Electrocardiogram (ECG) is a widely used reliable, non-invasive approach for cardiovascular disease diagnosis. With the rapid growth of ECG examinations and the insufficiency of cardiologists, accurate and automatic diagnosis of ECG signals has become a hot research topic. Deep learning methods have demonstrated promising results in predictive healthcare tasks. In this paper, we developed a deep neural network for multi-label classification of cardiac arrhythmias in 12-lead ECG recordings. Experiments on a public 12-lead ECG dataset showed the effectiveness of our method. The proposed model achieved an average area under the receiver operating characteristic curve (AUC) of 0.970 and an average F1 score of 0.813. The deep model showed superior performance than 4 machine learning methods learned from extracted expert features. Besides, the deep models trained on single-lead ECGs produce lower performance than using all 12 leads simultaneously. The best-performing leads are lead I, aVR, and V5 among 12 leads. Finally, we employed the SHapley Additive exPlanations (SHAP) method to interpret the model's behavior at both patient level and population level. Our code is freely available at https://github.com/onlyzdd/ecg-diagnosis.


title: Sub-Optimality of a Dyadic Adaptive Control Architecture

abstract: The dyadic adaptive control architecture evolved as a solution to the problem of designing control laws for nonlinear systems with unmatched nonlinearities, disturbances and uncertainties. A salient feature of this framework is its ability to work with infinite as well as finite dimensional systems, and with a wide range of control and adaptive laws. In this paper, we consider the case where a control law based on the linear quadratic regulator theory is employed for designing the control law. We benchmark the closed-loop system against standard linear quadratic control laws as well as those based on the state-dependent Riccati equation. We pose the problem of designing a part of the control law as a Nehari problem. We obtain analytical expressions for the bounds on the sub-optimality of the control law.


title: On the computation of density and two-point correlation functions of a class of random matrix ensembles

abstract: We demonstrate a method to solve a general class of random matrix ensembles numerically. The method is suitable for solving log-gas models with biorthogonal type two-body interactions and arbitrary potentials. We reproduce standard results for a variety of well-known ensembles and show some new results for the Muttalib-Borodin ensembles and recently introduced $\gamma$-ensemble for which analytic results are not yet available.

categories: math-ph cond-mat.dis-nn cond-mat.stat-mech math.MP


title: Abell 1430: A merging cluster with exceptional diffuse radio emission

abstract: Diffuse radio emission has been found in many galaxy clusters, predominantly in massive systems which are in the state of merging. The radio emission can usually be classified as relic or halo emission, which are believed to be related to merger shocks or volume-filling turbulence, respectively. Recent observations have revealed radio bridges for some pairs of very closeby galaxy clusters. The mechanisms that may allow to explain the high specific density of relativistic electrons, necessary to explain the radio luminosity of these bridge regions, are poorly explored. We analyse the galaxy cluster Abell 1430 with LoTSS data in detail and complement it with recent JVLA L-band observations, XMM-Newton, Chandra, and SDSS data. Moreover, we compare our results to clusters extracted from the "The Three Hundred Project" cosmological simulation. We find that Abell 1430 consists of two components, namely A1430-A and A1430-B. We speculate that the two components undergo an off-axis merger. The more massive component shows diffuse radio emission which can be classified as radio halo showing a low radio power given the mass of the cluster. Most interestingly, there is extended diffuse radio emission, dubbed as the `Pillow', which is apparently related to A1430-B and thus related to low density intracluster or intergalactic medium. To date, a only few examples for emission originating from such regions are known. These discoveries are crucial to constrain possible acceleration mechanisms, which may allow to explain the presence of relativistic electrons in these regions. Our results indicate a spectral index of $\alpha_{144\,\text{MHz}}^{1.5\,\text{GHz}}=-1.4\pm0.5$ for the Pillow. If future observations confirm a slope as flat as the central value of -1.4 or even flatter, this would pose a severe challenge for the electron acceleration scenarios.


title: A computational tool for trend analysis and forecast of the COVID-19 pandemic

abstract: Purpose: This paper proposes a methodology and a computational tool to study the COVID-19 pandemic throughout the world and to perform a trend analysis to assess its local dynamics. Methods: Mathematical functions are employed to describe the number of cases and demises in each region and to predict their final numbers, as well as the dates of maximum daily occurrences and the local stabilization date. The model parameters are calibrated using a computational methodology for numerical optimization. Trend analyses are run, allowing to assess the effects of public policies. Easy to interpret metrics over the quality of the fitted curves are provided. Country-wise data from the European Centre for Disease Prevention and Control (ECDC) concerning the daily number of cases and demises around the world are used, as well as detailed data from Johns Hopkins University and from the Brasil.io project describing individually the occurrences in United States counties and in Brazilian states and cities, respectively. U. S. and Brazil were chosen for a more detailed analysis because they are the current foci of the pandemic. Results: Illustrative results for different countries, U. S. counties and Brazilian states and cities are presented and discussed. Conclusion: The main contributions of this work lie in (i) a straightforward model of the curves to represent the data, which allows automation of the process without requiring interventions from experts; (ii) an innovative approach for trend analysis, whose results provide important information to support authorities in their decision-making process; and (iii) the developed computational tool, which is freely available and allows the user to quickly update the COVID-19 analyses and forecasts for any country, United States county or Brazilian state or city present in the periodic reports from the authorities.


title: CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation

abstract: Growing interests have been attracted in Conversational Recommender Systems (CRS), which explore user preference through conversational interactions in order to make appropriate recommendation. However, there is still a lack of ability in existing CRS to (1) traverse multiple reasoning paths over background knowledge to introduce relevant items and attributes, and (2) arrange selected entities appropriately under current system intents to control response generation. To address these issues, we propose CR-Walker in this paper, a model that performs tree-structured reasoning on a knowledge graph, and generates informative dialog acts to guide language generation. The unique scheme of tree-structured reasoning views the traversed entity at each hop as part of dialog acts to facilitate language generation, which links how entities are selected and expressed. Automatic and human evaluations show that CR-Walker can arrive at more accurate recommendation, and generate more informative and engaging responses.


title: DLWIoT: Deep Learning-based Watermarking for Authorized IoT Onboarding

abstract: The onboarding of IoT devices by authorized users constitutes both a challenge and a necessity in a world, where the number of IoT devices and the tampering attacks against them continuously increase. Commonly used onboarding techniques today include the use of QR codes, pin codes, or serial numbers. These techniques typically do not protect against unauthorized device access-a QR code is physically printed on the device, while a pin code may be included in the device packaging. As a result, any entity that has physical access to a device can onboard it onto their network and, potentially, tamper it (e.g.,install malware on the device). To address this problem, in this paper, we present a framework, called Deep Learning-based Watermarking for authorized IoT onboarding (DLWIoT), featuring a robust and fully automated image watermarking scheme based on deep neural networks. DLWIoT embeds user credentials into carrier images (e.g., QR codes printed on IoT devices), thus enables IoT onboarding only by authorized users. Our experimental results demonstrate the feasibility of DLWIoT, indicating that authorized users can onboard IoT devices with DLWIoT within 2.5-3sec.


title: On the Markov numbers: fixed numerator, denominator, and sum conjectures

abstract: The Markov numbers are the positive integer solutions of the Diophantine equation $x^2 + y^2 + z^2 = 3xyz$. Already in 1880, Markov showed that all these solutions could be generated along a binary tree. So it became quite usual (and useful) to index the Markov numbers by the rationals between 0 and 1 which stand at the same place in the Stern-Brocot binary tree. The Frobenius conjecture claims that each Markov number appears at most once in the tree. In particular, if the conjecture is true, the order of Markov numbers would establish a new strict order on the rationals. Aigner suggested three conjectures to better understand this order. The first one has already been solved for a few months. We prove that the other two conjectures are also true. Along the way, we generalize Markov numbers to any couple (p,q) of nonnegative integers (not only when they are relatively primes) and conjecture that the unicity is still true as soon as $p \leq q$. Finally, we show that the three conjectures are in fact true for this superset.


title: On the stability of a nonlinear non homogeneous multiply hinged beam

abstract: The paper deals with a nonlinear evolution equation describing the dynamics of a non homogeneous multiply hinged beam, subject to a nonlocal restoring force of displacement type. First, a spectral analysis for the associated weighted stationary problem is performed, providing a complete system of eigenfunctions. Then, a linear stability analysis for bi-modal solutions of the evolution problem is carried out, with the final goal of suggesting optimal choices of the density and of the position of the internal hinged points in order to improve the stability of the beam. The analysis exploits both analytical and numerical methods; the main conclusion of the investigation is that non homogeneous density functions improve the stability of the structure.


title: Detection of a universal core-halo transition in dwarf galaxies as predicted by Bose-Einstein dark matter

abstract: The presence of large dark matter cores in dwarf galaxies has long been puzzling and many are now known to be surrounded by an extensive halo of stars. Distinctive core-halo structure is characteristic of dark matter as a Bose Einstein condensate, $\psi$DM, with a dense, soliton core predicted in every galaxy, representing the ground state, surrounded by a large, tenuous halo of excited density waves. A marked density transition is predicted between the core and the halo set by the de Broglie wavelength, as the soliton core is a prominent standing wave that is denser by over an order of magnitude than the surrounding halo. Here we identify this predicted behavior in the stellar profiles of the well known "isolated" dwarfs that lie outside the Milky Way, each with a clear density transition at $\simeq 1.0~{\rm kpc}$, implying a very light boson, $m_{\psi} \simeq 10^{-22}$eV. The classical dwarf galaxies orbiting within the Milky Way also show this predicted core-halo structure but with larger density transitions of over two orders of magnitude, that we show implies tidal stripping of dwarf galaxies by the Milky way, as the tenuous halo is more easily stripped than the stable soliton core. We conclude that dark matter as a light boson explains the observed family of classical dwarf profiles with tidal stripping included, in contrast to the standard heavy particle interpretation where low mass galaxies should be concentrated and core-less, quite unlike the core-halo structure observed.


title: Edge Bias in Federated Learning and its Solution by Buffered Knowledge Distillation

abstract: Federated learning (FL), which utilizes communication between the server (core) and local devices (edges) to indirectly learn from more data, is an emerging field in deep learning research. Recently, Knowledge Distillation-based FL methods with notable performance and high applicability have been suggested. In this paper, we choose knowledge distillation-based FL method as our baseline and tackle a challenging problem that ensues from using these methods. Especially, we focus on the problem incurred in the server model that tries to mimic different datasets, each of which is unique to an individual edge device. We dub the problem 'edge bias', which occurs when multiple teacher models trained on different datasets are used individually to distill knowledge. We introduce this nuisance that occurs in certain scenarios of FL, and to alleviate it, we propose a simple yet effective distillation scheme named 'buffered distillation'. In addition, we also experimentally show that this scheme is effective in mitigating the straggler problem caused by delayed edges.


title: Spectral study of the linearized Boltzmann operator in L^2 spaces with polynomial and Gaussian weights

abstract: The aim of this paper is to extend to the spaces L^2(R^d , (1+|v|)^2k dv) the spectral study led in L^2(R^d , exp(|v|^2/2)dv) by R. Ellis and M. Pinsky on the space inhomogeneous linearized Boltzmann operator for hard spheres. More precisely, we look at the Fourier transform in the space variable of the inhomogeneous operator and consider the dual Fourier variable as a fixed parameter. We then perform a precise study of this operator for small frequencies (by seeing it as a perturbation of the homogeneous one) and also for large frequencies from spectral and semigroup point of views. Our approach is based on perturbation theory for linear operators as well as enlargement arguments from M.P. Gualdani, S. Mischler and C. Mouhot.


title: Leveraging SLIC Superpixel Segmentation and Cascaded Ensemble SVM for Fully Automated Mass Detection In Mammograms

abstract: Identification and segmentation of breast masses in mammograms face complex challenges, owing to the highly variable nature of malignant densities with regards to their shape, contours, texture and orientation. Additionally, classifiers typically suffer from high class imbalance in region candidates, where normal tissue regions vastly outnumber malignant masses. This paper proposes a rigorous segmentation method, supported by morphological enhancement using grayscale linear filters. A novel cascaded ensemble of support vector machines (SVM) is used to effectively tackle the class imbalance and provide significant predictions. For True Positive Rate (TPR) of 0.35, 0.69 and 0.82, the system generates only 0.1, 0.5 and 1.0 False Positives/Image (FPI), respectively.


title: Learning to Learn Variational Semantic Memory

abstract: In this paper, we introduce variational semantic memory into meta-learning to acquire long-term knowledge for few-shot learning. The variational semantic memory accrues and stores semantic information for the probabilistic inference of class prototypes in a hierarchical Bayesian framework. The semantic memory is grown from scratch and gradually consolidated by absorbing information from tasks it experiences. By doing so, it is able to accumulate long-term, general knowledge that enables it to learn new concepts of objects. We formulate memory recall as the variational inference of a latent memory variable from addressed contents, which offers a principled way to adapt the knowledge to individual tasks. Our variational semantic memory, as a new long-term memory module, confers principled recall and update mechanisms that enable semantic information to be efficiently accrued and adapted for few-shot learning. Experiments demonstrate that the probabilistic modelling of prototypes achieves a more informative representation of object classes compared to deterministic vectors. The consistent new state-of-the-art performance on four benchmarks shows the benefit of variational semantic memory in boosting few-shot recognition.


title: Origin of the Magnetic and Orbital ordering in $\alpha$-Sr$_2$CrO$_4$

abstract: Motivated by recent experimental progress in transition metal oxides with the K$_2$NiF$_4$ structure, we investigate the magnetic and orbital ordering in $\alpha$-Sr$_2$CrO$_4$. Using first principles calculations, first we derive a three-orbital Hubbard model, which reproduces the {\it ab initio} band structure near the Fermi level. The unique reverse splitting of $t_{2g}$ orbitals in $\alpha$-Sr$_2$CrO$_4$, with the $3d^2$ electronic configuration for the Cr$^{4+}$ oxidation state, opens up the possibility of orbital ordering in this material. Using real-space Hartree-Fock for multi-orbital systems, we constructed the ground-state phase diagram for the two-dimensional compound $\alpha$-Sr$_2$CrO$_4$. We found stable ferromagnetic, antiferromagnetic, antiferro-orbital, and staggered orbital stripe ordering in robust regions of the phase diagram. Furthermore, using the density matrix renormalization group method for two-leg ladders with the realistic hopping parameters of $\alpha$-Sr$_2$CrO$_4$, we explore magnetic and orbital ordering for experimentally relevant interaction parameters. Again, we find a clear signature of antiferromagnetic spin ordering along with antiferro-orbital ordering at moderate to large Hubbard interaction strength. We also explore the orbital-resolved density of states with Lanczos, predicting insulating behavior for the compound $\alpha$-Sr$_2$CrO$_4$, in agreement with experiments. Finally, an intuitive understanding of the results is provided based on a hierarchy between orbitals, with $d_{xy}$ driving the spin order, while electronic repulsion and the effective one dimensionality of the movement within the $d_{xz}$ and $d_{yz}$ orbitals driving the orbital order.


title: Provenance Graph Kernel

abstract: Provenance is a record that describes how entities, activities, and agents have influenced a piece of data; it is commonly represented as graphs with relevant labels on both their nodes and edges. With the growing adoption of provenance in a wide range of application domains, users are increasingly confronted with an abundance of graph data, which may prove challenging to process. Graph kernels, on the other hand, have been successfully used to efficiently analyse graphs. In this paper, we introduce a novel graph kernel called provenance kernel, which is inspired by and tailored for provenance data. It decomposes a provenance graph into tree-patterns rooted at a given node and considers the labels of edges and nodes up to a certain distance from the root. We employ provenance kernels to classify provenance graphs from three application domains. Our evaluation shows that they perform well in terms of classification accuracy and yield competitive results when compared against existing graph kernel methods and the provenance network analytics method while more efficient in computing time. Moreover, the provenance types used by provenance kernels also help improve the explainability of predictive models built on them.


title: The bi-objective multimodal car-sharing problem

abstract: The aim of the bi-objective multimodal car-sharing problem (BiO-MMCP) is to determine the optimal mode of transport assignment for trips and to schedule the routes of available cars and users whilst minimizing cost and maximizing user satisfaction. We investigate the BiO-MMCP from a user-centred point of view. As user satisfaction is a crucial aspect in shared mobility systems, we consider user preferences in a second objective. Users may choose and rank their preferred modes of transport for different times of the day. In this way we account for, e.g., different traffic conditions throughout the planning horizon. We study different variants of the problem. In the base problem, the sequence of tasks a user has to fulfill is fixed in advance and travel times as well as preferences are constant over the planning horizon. In variant 2, time-dependent travel times and preferences are introduced. In variant 3, we examine the challenges when allowing additional routing decisions. Variant 4 integrates variants 2 and 3. For this last variant, we develop a branch-and-cut algorithm which is embedded in two bi-objective frameworks, namely the $\epsilon$-constraint method and a weighting binary search method. Computational experiments show that the branch-and cut algorithm outperforms the MIP formulation and we discuss changing solutions along the Pareto frontier.


title: The Unpublished Feynman Diagram IIc

abstract: Quantum Electrodynamics (QED) is considered the most accurate theory in the history of science. However, this precision is limited to a single experimental value: the anomalous magnetic moment of the electron (g-factor). The calculation of the electron g-factor was carried out in 1950 by Karplus and Kroll. Seven years later, Petermann detected and corrected a serious error in the calculation of a Feynman diagram; however, neither the original calculation nor the subsequent correction was ever published.Therefore, the entire prestige of QED depends on the calculation of a single Feynman diagram (IIc) that has never been published and cannot be independently verified.


title: Deep Importance Sampling based on Regression for Model Inversion and Emulation

abstract: Understanding systems by forward and inverse modeling is a recurrent topic of research in many domains of science and engineering. In this context, Monte Carlo methods have been widely used as powerful tools for numerical inference and optimization. They require the choice of a suitable proposal density that is crucial for their performance. For this reason, several adaptive importance sampling (AIS) schemes have been proposed in the literature. We here present an AIS framework called Regression-based Adaptive Deep Importance Sampling (RADIS). In RADIS, the key idea is the adaptive construction via regression of a non-parametric proposal density (i.e., an emulator), which mimics the posterior distribution and hence minimizes the mismatch between proposal and target densities. RADIS is based on a deep architecture of two (or more) nested IS schemes, in order to draw samples from the constructed emulator. The algorithm is highly efficient since employs the posterior approximation as proposal density, which can be improved adding more support points. As a consequence, RADIS asymptotically converges to an exact sampler under mild conditions. Additionally, the emulator produced by RADIS can be in turn used as a cheap surrogate model for further studies. We introduce two specific RADIS implementations that use Gaussian Processes (GPs) and Nearest Neighbors (NN) for constructing the emulator. Several numerical experiments and comparisons show the benefits of the proposed schemes. A real-world application in remote sensing model inversion and emulation confirms the validity of the approach.


title: Surface Self-Assembly of Functionalized Molecules on Ag(111): More Than Just Chemical Intuition

abstract: The fabrication of nanomaterials involves self-ordering processes of functional molecules on inorganic surfaces. To obtain specific molecular arrangements, a common strategy is to equip molecules with functional groups. However, focusing on the functional groups alone does not provide a comprehensive picture. Especially at interfaces, processes that govern self-ordering are complex and involve various physical and chemical effects, often leading to structures that defy chemical intuition, as we showcase here on the example of a homologous series of quinones on Ag(111). From chemical intuition one could expect that such quinones, which all bear the same functionalization, form similar motifs. In salient contrast, our joint theoretical and experimental study shows that profoundly different structures are formed. Using a machine-learning-based structure search algorithm, we find that this is due to a shift of the balance of three antagonizing driving forces: adsorbate-substrate interactions governing adsorption sites, adsorbate-adsorbate interactions favoring close packing, and steric hindrance inhibiting certain otherwise energetically beneficial molecular arrangements. The theoretical structures show excellent agreement with our experimental characterizations of the organic/inorganic interfaces, both for the unit cell sizes and the orientations of the molecules within. With a detailed examination of all driving forces, we are further able to devise a design principle for self-assembly of functionalized molecules. The non-intuitive interplay of similarly strong interaction mechanisms will continue to be a challenging aspect for the design of functional interfaces. Our agreement between theory and experiment combined with the new physical insights indicates that these methods have now reached the necessary accuracy to do so.


title: 1.23-Tb/s per Wavelength Single-Waveguide On-Chip Optical Interconnect Enabled by Mode-division Multiplexing

abstract: We experimentally demonstrate a record net capacity per wavelength of 1.23~Tb/s over a single silicon-on-insulator (SOI) multimode waveguide for optical interconnects employing on-chip mode-division multiplexing and 11$\times$11 multiple-in-multiple-out (MIMO) digital signal processing.


title: Modelling of Inhomogeneous Disk-Loaded Waveguides: Matrix Difference Equations and WKB Approximation

abstract: A new approach to the description of inhomogeneous disk-loaded waveguides (chains of coupled resonators) is proposed. New matrix difference equations based on the technique of coupled integral equations and the decomposition method are obtained. Various approximate approaches have been developed, including the WKB approximation.


title: Resource Management Schemes for Cloud-Native Platforms with Computing Containers of Docker and Kubernetes

abstract: Businesses have made increasing adoption and incorporation of cloud technology into internal processes in the last decade. The cloud-based deployment provides on-demand availability without active management. More recently, the concept of cloud-native application has been proposed and represents an invaluable step toward helping organizations develop software faster and update it more frequently to achieve dramatic business outcomes. Cloud-native is an approach to build and run applications that exploit the cloud computing delivery model's advantages. It is more about how applications are created and deployed than where. The container-based virtualization technology, such as Docker and Kubernetes, serves as the foundation for cloud-native applications. This paper investigates the performance of two popular computational-intensive applications, big data, and deep learning, in a cloud-native environment. We analyze the system overhead and resource usage for these applications. Through extensive experiments, we show that the completion time reduces by up to 79.4% by changing the default setting and increases by up to 96.7% due to different resource management schemes on two platforms. Additionally, the resource release is delayed by up to 116.7% across different systems. Our work can guide developers, administrators, and researchers to better design and deploy their applications by selecting and configuring a hosting platform.


title: End-to-end Wireless Path Deployment with Intelligent Surfaces Using Interpretable Neural Networks

abstract: Intelligent surfaces exert deterministic control over the wireless propagation phenomenon, enabling novel capabilities in performance, security and wireless power transfer. Such surfaces come in the form of rectangular tiles that cascade to cover large surfaces such as walls, ceilings or building facades. Each tile is addressable and can receive software commands from a controller, manipulating an impinging electromagnetic wave upon it by customizing its reflection direction, focus, polarization and phase. A new problem arises concerning the orchestration of a set of tiles towards serving end-to-end communication objectives. Towards that end, we propose a novel intelligent surface networking algorithm based on interpretable neural networks. Tiles are mapped to neural network nodes and any tile line-of-sight connectivity is expressed as a neural network link. Tile wave manipulation functionalities are captured via geometric reflection with virtually rotatable tile surface norm, thus being able to tunable distribute power impinging upon a tile over the corresponding neural network links, with the corresponding power parts acting as the link weights. A feedforward/backpropagate process optimizes these weights to match ideal propagation outcomes (normalized network power outputs) to wireless user emissions (normalized network power inputs). An interpretation process translates these weights to the corresponding tile wave manipulation functionalities.


title: Deep Learning for Surface Wave Identification in Distributed Acoustic Sensing Data

abstract: Moving loads such as cars and trains are very useful sources of seismic waves, which can be analyzed to retrieve information on the seismic velocity of subsurface materials using the techniques of ambient noise seismology. This information is valuable for a variety of applications such as geotechnical characterization of the near-surface, seismic hazard evaluation, and groundwater monitoring. However, for such processes to converge quickly, data segments with appropriate noise energy should be selected. Distributed Acoustic Sensing (DAS) is a novel sensing technique that enables acquisition of these data at very high spatial and temporal resolution for tens of kilometers. One major challenge when utilizing the DAS technology is the large volume of data that is produced, thereby presenting a significant Big Data challenge to find regions of useful energy. In this work, we present a highly scalable and efficient approach to process real, complex DAS data by integrating physics knowledge acquired during a data exploration phase followed by deep supervised learning to identify "useful" coherent surface waves generated by anthropogenic activity, a class of seismic waves that is abundant on these recordings and is useful for geophysical imaging. Data exploration and training were done on 130~Gigabytes (GB) of DAS measurements. Using parallel computing, we were able to do inference on an additional 170~GB of data (or the equivalent of 10 days' worth of recordings) in less than 30 minutes. Our method provides interpretable patterns describing the interaction of ground-based human activities with the buried sensors.


title: Online adaptive group-wise sparse NPLS for ECoG neural signal decoding

abstract: Objective. Brain-computer interfaces (BCIs) create a new communication pathway between the brain and an effector without neuromuscular activation. BCI experiments highlighted high intra and inter-subjects variability in the BCI decoders. Although BCI model is generally relying on neurological markers generalizable on the majority of subjects, it requires to generate a wide range of neural features to include possible neurophysiological patterns. However, the processing of noisy and high dimensional features, such as brain signals, brings several challenges to overcome such as model calibration issues, model generalization and interpretation problems and hardware related obstacles. Approach. An online adaptive group-wise sparse decoder named Lp-Penalized REW-NPLS algorithm (PREW-NPLS) is presented to reduce the feature space dimension employed for BCI decoding. The proposed decoder was designed to create BCI systems with low computational cost suited for portable applications and tested during offline pseudo-online study based on online closed-loop BCI control of the left and right 3D arm movements of a virtual avatar from the ECoG recordings of a tetraplegic patient. Main results. PREW-NPLS algorithm highlight at least as good decoding performance as REW-NPLS algorithm. However, the decoding performance obtained with PREW-NPLS were achieved thanks to sparse models with up to 64% and 75% of the electrodes set to 0 for the left and right hand models respectively using L1-PREW-NPLS. Significance. The designed solution proposed an online incremental adaptive algorithm suitable for online adaptive decoder calibration which estimate sparse decoding solutions. The PREW-NPLS models are suited for portable applications with low computational power using only small number of electrodes with degrading the decoding performance.


title: Time-domain Representation of Passband Scattering Parameters

abstract: This paper presents a simple and accurate method for the inclusion of linear, time-invariant (LTI) networks, described by RF frequency-domain data, within equivalent baseband time-domain simulations. The time-domain representation is formulated as an equivalent baseband discrete-time impulse response, which may be convolved with the equivalent baseband form of the input signal, to obtain the corresponding equivalent baseband output. This allows networks which are most accurately described in the frequency domain, such as frequency-dispersive transmission lines, to be efficiently included as part of a transient time-domain simulation.


title: Gap statistics and higher correlations for geometric progressions modulo one

abstract: Koksma's equidistribution theorem from 1935 states that for Lebesgue almost every $\alpha>1$, the fractional parts of the geometric progression $(\alpha^{n})_{n\geq1}$ are equidistributed modulo one. In the present paper we sharpen this result by showing that for almost every $\alpha>1$, the correlations of all finite orders and hence the normalized gaps of $(\alpha^{n})_{n\geq1}$ mod 1 have a Poissonian limit distribution, thereby resolving a conjecture of the two first named authors. While an earlier approach used probabilistic methods in the form of martingale approximation, our reasoning in the present paper is of an analytic nature and based upon the estimation of oscillatory integrals. This method is robust enough to allow us to extend our results to a natural class of sub-lacunary sequences.


title: A Novel Self-Packaged DBBPF With Multiple TZs for 5G Applications

abstract: A self-packaged dual-band bandpass filter (DBBPF) with high isolation and low insertion loss (IL) for 5G applications is proposed in this paper. To get high stopband suppression, multiple and controllable transmission zeros (TZs) are produced. This novel DBBPF is designed with a pair of quarter-wavelength stepped-impedance resonators (QSIRs) and a half-wavelength hairpin resonator (HWHR). This DBBPF is excited by a pair of U-shape feed lines, which are designed on G6 to fully excite the resonators and to introduce source/load TZs at the same time. In this letter, the generation of two passbands and TZs will be discussed by separate electric and magnetic coupling paths (SEMCP) and mixed EM coupling analysis. This DBBPF achieves a low IL of 0.85/1.15 dB with the fractional bandwidths (FBW) of 11.0% and 6.9% at the center frequencies of 3.45 GHz and 4.9 GHz for 5G application, respectively. The total size is 0.32{\lambda}g*0.45{\lambda}g. Especially, three controllable TZs are introduced between two passbands.


title: Automotive Radar Interference Mitigation with Unfolded Robust PCA based on Residual Overcomplete Auto-Encoder Blocks

abstract: In autonomous driving, radar systems play an important role in detecting targets such as other vehicles on the road. Radars mounted on different cars can interfere with each other, degrading the detection performance. Deep learning methods for automotive radar interference mitigation can succesfully estimate the amplitude of targets, but fail to recover the phase of the respective targets. In this paper, we propose an efficient and effective technique based on unfolded robust Principal Component Analysis (RPCA) that is able to estimate both amplitude and phase in the presence of interference. Our contribution consists in introducing residual overcomplete auto-encoder (ROC-AE) blocks into the recurrent architecture of unfolded RPCA, which results in a deeper model that significantly outperforms unfolded RPCA as well as other deep learning models.


title: Non-real zeros of polynomials in a polynomial sequence satisfying a three-term recurrence relation

abstract: This paper discusses the location of zeros of polynomials in a polynomial sequence $\{P_n(z)\}$ generated by a three-term recurrence relation of the form $P_n(z)+ B(z)P_{n-1}(z) +A(z) P_{n-k}(z)=0$ with $k>2$ and the standard initial conditions $P_{0}(z)=1, P_{-1}(z)=\ldots=P_{-k+1}(z)=0,$ where $A(z)$ and $B(z)$ are arbitrary coprime real polynomials. We show that there always exist polynomials in $\{P_n(z)\}$ with non-real zeros.


title: Performance of Dual-Augmented Lagrangian Method and Common Spatial Patterns applied in classification of Motor-Imagery BCI

abstract: Motor-imagery based brain-computer interfaces (MI-BCI) have the potential to become ground-breaking technologies for neurorehabilitation, the reestablishment of non-muscular communication and commands for patients suffering from neuronal disorders and disabilities, but also outside of clinical practice, for video game control and other entertainment purposes. However, due to the noisy nature of the used EEG signal, reliable BCI systems require specialized procedures for features optimization and extraction. This paper compares the two approaches, the Common Spatial Patterns with Linear Discriminant Analysis classifier (CSP-LDA), widely used in BCI for extracting features in Motor Imagery (MI) tasks, and the Dual-Augmented Lagrangian (DAL) framework with three different regularization methods: group sparsity with row groups (DAL-GLR), dual-spectrum (DAL-DS) and l1-norm regularization (DAL-L1). The test has been performed on 7 healthy subjects performing 5 BCI-MI sessions each. The preliminary results show that DAL-GLR method outperforms standard CSP-LDA, presenting 6.9% lower misclassification error (p-value = 0.008) and demonstrate the advantage of DAL framework for MI-BCI.


title: Quantum Chaos and the Correspondence Principle

abstract: The correspondence principle is a cornerstone in the entire construction of quantum mechanics. This principle has been recently challenged by the observation of an early-time exponential increase of the out-of-time-ordered correlator (OTOC) in classically non-chaotic systems [E.B. Rozenbaum et al., Phys. Rev. Lett. 125, 014101 (2020)], Here we show that the correspondence principle is restored after a proper treatment of the singular points. Furthermore our results show that the OTOC maintains its role as a diagnostic of chaotic dynamics.


title: Ultrafast modulation of covalency in GeTe driven by a ferroelectric soft mode

abstract: The general idea of using ultrashort light pulses to control ferroic order parameters has recently attracted attention as a means to achieve control over material properties on unprecedented time scales. Much of the challenge in such work is in understanding the mechanisms by which this control can be achieved, and in particular how observables can be connected to structural and electronic properties. Here we report on a combination of experimental and computational methods to study the electronic structure of the semiconducting ferroelectric GeTe when driven out of equilibrium by absorption of a femtosecond pulse of light. We observe coherent modulations of second harmonic generations on the order of 50%, which we attribute to a combination of atomic and electronic structure changes due to a coherently excited soft mode. Comparison of the observed experimental data with model calculations indicates that this effect is predominantly due to an ultrafast modulation of the covalency of the bonding between Ge and Te ions. This stands in contrast to previously held assumptions in other systems, indicating that care should be exercised in using indirect measurements of electronic structure to make strong conclusions about the magnitude of nuclear motions.


title: Analysis of the phase-locking dynamics of a III-V-on-silicon frequency comb laser

abstract: We present the detailed characterization of the phase dynamics of a telecom hybrid III-V-on-silicon passively mode-locked laser with a ring cavity. We explore the various regimes of operation as a function of gain current and saturable absorber bias voltage. We use a stepped-heterodyne measurement to quantify the spectral chirp and reconstruct the pulse envelop. With this technique we are able to identify regimes of near-transform-limited operation and we assess the degradation of mode-locking in the comb phase relationship when saturable absorber bias voltage is changed. Finally, we present a preliminary study of the phase-locking in hybrid mode-locked operation and demonstrate transform-limited pulses.


title: Bootleg: Chasing the Tail with Self-Supervised Named Entity Disambiguation

abstract: A challenge for named entity disambiguation (NED), the task of mapping textual mentions to entities in a knowledge base, is how to disambiguate entities that appear rarely in the training data, termed tail entities. Humans use subtle reasoning patterns based on knowledge of entity facts, relations, and types to disambiguate unfamiliar entities. Inspired by these patterns, we introduce Bootleg, a self-supervised NED system that is explicitly grounded in reasoning patterns for disambiguation. We define core reasoning patterns for disambiguation, create a learning procedure to encourage the self-supervised model to learn the patterns, and show how to use weak supervision to enhance the signals in the training data. Encoding the reasoning patterns in a simple Transformer architecture, Bootleg meets or exceeds state-of-the-art on three NED benchmarks. We further show that the learned representations from Bootleg successfully transfer to other non-disambiguation tasks that require entity-based knowledge: we set a new state-of-the-art in the popular TACRED relation extraction task by 1.0 F1 points and demonstrate up to 8% performance lift in highly optimized production search and assistant tasks at a major technology company


title: Low-Energy Electron Diffraction With Energy Invariant Carrier Wave Wavenumber Modulated by Exchange-Correlation Interaction

abstract: We present low-energy electron diffraction (LEED) as elastic electron-atom scattering (EEAS) operating in a target crystal waveguide where a Coulombic carrier wave is wavenumber modulated by exchange-correlation (XC) interaction. Carrier potential is designed using a KKR (Korringa-Kohn-Rostoker) muffin-tin model built on overlapping free atoms. XC potential is constructed using Sernelius's many-particle theory on electron self-energy. EEAS phase shifts are derived from Dirac's differential equations, and four recent LEED investigations are recalculated: Cu(111)+$( 3\!\surd3\times\!\surd3 ) \mathrm{R30^\circ}$-TMB, Ag(111)+$(4\!\times \!4 )$-O, Ag(111)+$( 7\!\times\!\surd3 ) \mathrm{rect}$-$\mathrm{SO}_4$, Ru(0001)+$( \surd3\!\times\!\surd3 ) \mathrm{R30^\circ}$-C. TMB stands for 1,3,5-tris(4-mercaptophenyl)-benzene with chemical formula C$_{24}$H$_{15}$S$_3$. We are able to report substantially improved reliability factors.


title: Chaos and turbulence in bubbly flows

abstract: Results of direct numerical simulations and laboratory experiments have been used in order to show that the buoyancy driven bubbly flows at high gas volume fraction are mixed by deterministic chaos with typical exponential spectrum of the liquid kinetic energy, whereas at moderate and small gas volume fraction it is a distributed chaos (turbulence or pseudo-turbulence) dominated by the third and second moments of helicity distribution with the stretched exponential spectra of the kinetic energy. Interaction of the bubbles with isotropic (behind an active grid) and near-wall turbulent flows has been also discussed from this point of view with an application to the pressurized water nuclear reactors.


title: Noncommutative correction to the entropy of Schwarzschild black hole with GUP

abstract: In this paper we study through tunneling formalism, the effect of noncommutativity to Hawking radiation and the entropy of the noncommutative Schwarzschild black hole. In our model we have considered the noncommutativity implemented via the Lorentzian distribution. We obtain non-commutative corrections to the Hawking temperature using the Hamilton-Jacobi method and the Wentzel-Kramers-Brillouin (WKB) approximation. In addition, we found corrections of the logarithmic and other types due to noncommutativity and quantum corrections from the generalized uncertainty principle (GUP) for the entropy of the Schwarzschild black hole.


title: Macroscopic production of highly nuclear-spin-polarized molecules from IR-excitation and photodissociation of molecular beams

abstract: Pure, highly nuclear-spin-polarized molecules have only been produced with molecular beam-separation methods, with production rates up to ${\sim}3{\times}10^{12}$ s$^{-1}$. Here, we propose the production of spin-polarized molecular photofragments from the IR-excitation and photodissociation of molecular beams, with production rates approaching the tabletop-IR-laser photon fluxes of $10^{21}$ s$^{-1}$. We give details on the production of spin-polarized molecular hydrogen and water isotopes, from formaldehyde and formic acid beams, respectively. Macroscopic quantities of these molecules are important for NMR signal enhancement, and for the needs of a nuclear fusion reactor, to increase the D-T or D-$^{3}$He unpolarized nuclear fusion cross section by ${\sim}50{\%}$.


title: A Flatter Loss for Bias Mitigation in Cross-dataset Facial Age Estimation

abstract: The most existing studies in the facial age estimation assume training and test images are captured under similar shooting conditions. However, this is rarely valid in real-world applications, where training and test sets usually have different characteristics. In this paper, we advocate a cross-dataset protocol for age estimation benchmarking. In order to improve the cross-dataset age estimation performance, we mitigate the inherent bias caused by the learning algorithm itself. To this end, we propose a novel loss function that is more effective for neural network training. The relative smoothness of the proposed loss function is its advantage with regards to the optimisation process performed by stochastic gradient descent (SGD). Compared with existing loss functions, the lower gradient of the proposed loss function leads to the convergence of SGD to a better optimum point, and consequently a better generalisation. The cross-dataset experimental results demonstrate the superiority of the proposed method over the state-of-the-art algorithms in terms of accuracy and generalisation capability.


title: Adaptive bandwidth management for entanglement distribution in quantum networks

abstract: Flexible-grid wavelength-division multiplexing is a powerful tool in lightwave communications for maximizing spectral efficiency. In the emerging field of quantum networking, the need for effective resource provisioning is particularly acute, given the generally lower power levels, higher sensitivity to loss, and inapplicability of digital error correction. In this Letter, we leverage flex-grid technology to demonstrate reconfigurable distribution of quantum entanglement in a four-user tabletop network. By adaptively partitioning bandwidth with a single wavelength-selective switch, we successfully equalize two-party coincidence rates that initially differ by over two orders of magnitude. Our scalable approach introduces loss that is fixed with the number of users, offering a practical path for the establishment and management of quality-of-service guarantees in large quantum networks.


title: Monitoring Large Crowds With WiFi: A Privacy-Preserving Approach

abstract: This paper presents a crowd monitoring system based on the passive detection of probe requests. The system meets strict privacy requirements and is suited to monitoring events or buildings with a least a few hundreds of attendees. We present our counting process and an associated mathematical model. From this model, we derive a concentration inequality that highlights the accuracy of our crowd count estimator. Then, we describe our system. We present and discuss our sensor hardware, our computing system architecture, and an efficient implementation of our counting algorithm -- as well as its space and time complexity. We also show how our system ensures the privacy of people in the monitored area. Finally, we validate our system using nine weeks of data from a public library endowed with a camera-based counting system, which generates counts against which we compare those of our counting system. This comparison empirically quantifies the accuracy of our counting system, thereby showing it to be suitable for monitoring public areas. Similarly, the concentration inequality provides a theoretical validation of the system.


title: Orbital Eccentricity -- Multiplicity Correlation for Planetary Systems and Comparison to the Solar System

abstract: The orbit eccentricities of the Solar System planets are unusually low compared to the average of known exoplanetary systems. A power law correlation has previously been found between the multiplicity of a planetary system and the orbital eccentricities of its components, for systems with multiplicities above two. In this study we investigate the correlation for an expanded data sample, by focusing on planetary systems as units (unlike previous studies that have focused on individual planets). Our full data sample contains 1171 exoplanets, in 895 systems, and the correlation between eccentricity and multiplicity is found to follow a clear power law for all multiplicities above one. We discuss the correlation for several individual subsamples, and find that all samples consistently follow the same basic trend regardless of e.g. planet types and detection methods. We find that the eccentricities of the Solar System fit the general trend and suggest that the Solar System might not show uncommonly low eccentricities (as often speculated) but rather uncommonly many planets compared to a "standard" planetary system. The only outlier from the power law correlation is, consistently in all the samples, the one-planet systems. It has previously been suggested that this may be due to additional unseen exoplanets in the observed one-planet systems. Based on this assumption and the power law correlation, we estimate that the probability of a system having 8 planets or more is of the order of 1%, in good agreement with recent predictions from analyses based on independent arguments.


title: On sheaves in finite group representations

abstract: Given a general finite group $G$, we consider several categories built on it, their Grothendieck topologies and resulting sheaf categories. For a certain class of transporter categories and their quotients, equipped with atomic topology, we explicitly compute their sheaf categories via sheafification. This enables us to identify $G$-representations with various fixed-point sheaves. As a consequence, it provides an intrinsic new proof to the equivalence of M. Artin between the category of sheaves on the orbit category and that of group representations.


title: Convolutional neural networks for automatic detection of Focal Cortical Dysplasia

abstract: Focal cortical dysplasia (FCD) is one of the most common epileptogenic lesions associated with cortical development malformations. However, the accurate detection of the FCD relies on the radiologist professionalism, and in many cases, the lesion could be missed. In this work, we solve the problem of automatic identification of FCD on magnetic resonance images (MRI). For this task, we improve recent methods of Deep Learning-based FCD detection and apply it for a dataset of 15 labeled FCD patients. The model results in the successful detection of FCD on 11 out of 15 subjects.


title: Dynamical Landscape and Multistability of a Climate Model

abstract: We apply two independent data analysis methodologies to locate stable climate states in an intermediate complexity climate model and analyze their interplay. First, drawing from the theory of quasipotentials, and viewing the state space as an energy landscape with valleys and mountain ridges, we infer the relative likelihood of the identified multistable climate states, and investigate the most likely transition trajectories as well as the expected transition times between them. Second, harnessing techniques from data science, specifically manifold learning, we characterize the data landscape of the simulation output to find climate states and basin boundaries within a fully agnostic and unsupervised framework. Both approaches show remarkable agreement, and reveal, apart from the well known warm and snowball earth states, a third intermediate stable state in one of the two climate models we consider. The combination of our approaches allows to identify how the negative feedback of ocean heat transport and entropy production via the hydrological cycle drastically change the topography of the dynamical landscape of Earth's climate.

categories: physics.ao-ph cond-mat.stat-mech physics.comp-ph stat.ML


title: Towards Bayesian Data Compression

abstract: In order to handle large data sets omnipresent in modern science, efficient compression algorithms are necessary. Here, a Bayesian data compression (BDC) algorithm that adapts to the specific measurement situation is derived in the context of signal reconstruction. BDC compresses a data set under conservation of its posterior structure with minimal information loss given the prior knowledge on the signal, the quantity of interest. Its basic form is valid for Gaussian priors and likelihoods. For constant noise standard deviation, basic BDC becomes equivalent to a Bayesian analog of principal component analysis. Using Metric Gaussian Variational Inference, BDC generalizes to non-linear settings. In its current form, BDC requires the storage of effective instrument response functions for the compressed data and corresponding noise encoding the posterior covariance structure. Their memory demand counteract the compression gain. In order to improve this, sparsity of the compressed responses can be obtained by separating the data into patches and compressing them separately. The applicability of BDC is demonstrated by applying it to synthetic data and radio astronomical data. Still the algorithm needs further improvement as the computation time of the compression and subsequent inference exceeds the time of the inference with the original data.


title: On derivatives, Riesz transforms and Sobolev spaces for Fourier-Bessel expansions

abstract: We study the problem of an appropriate choice of derivatives associated with discrete Fourier-Bessel expansions. We introduce a new so-called essential measure Fourier-Bessel setting, where the relevant derivative is simply the ordinary derivative. Then we investigate Riesz transforms and Sobolev spaces in this context. Our main results are $L^p$-boundedness of the Riesz transforms (even in a multi-dimensional situation) and an isomorphism between the Sobolev and Fourier-Bessel potential spaces. Moreover, throughout the paper we collect various comments concerning two other closely related Fourier-Bessel situations that were considered earlier in the literature. We believe that our observations shed some new light on analysis of Fourier-Bessel expansions.


title: Observation of Yu-Shiba-Rusinov states in superconducting graphene

abstract: When magnetic atoms are inserted inside a superconductor, the superconducting order is locally depleted as a result of the antagonistic nature of magnetism and superconductivity1. Thereby, distinctive spectral features, known as Yu-Shiba-Rusinov states, appear inside the superconducting gap2-4. The search for Yu-Shiba-Rusinov states in different materials is intense, as they can be used as building blocks to promote Majorana modes5 suitable for topological quantum computing6. Here we report the first realization of Yu-Shiba-Rusinov states in graphene, a non-superconducting 2D material, and without the participation of magnetic atoms. We induce superconductivity in graphene by proximity effect7-9 brought by adsorbing nanometer scale superconducting Pb islands. Using scanning tunneling microscopy and spectroscopy we measure the superconducting proximity gap in graphene and we visualize Yu-Shiba-Rusinov states in graphene grain boundaries. Our results reveal the very special nature of those Yu-Shiba-Rusinov states, which extends more than 20 nm away from the grain boundaries. These observations provide the long sought experimental confirmation that graphene grain boundaries host local magnetic moments10-14 and constitute the first observation of Yu-Shiba-Rusinov states in a chemically pure system.


title: Modeling Data Movement Performance on Heterogeneous Architectures

abstract: The cost of data movement on parallel systems varies greatly with machine architecture, job partition, and nearby jobs. Performance models that accurately capture the cost of data movement provide a tool for analysis, allowing for communication bottlenecks to be pinpointed. Modern heterogeneous architectures yield increased variance in data movement as there are a number of viable paths for inter-GPU communication. In this paper, we present performance models for the various paths of inter-node communication on modern heterogeneous architectures, including the trade-off between GPUDirect communication and copying to CPUs. Furthermore, we present a novel optimization for inter-node communication based on these models, utilizing all available CPU cores per node. Finally, we show associated performance improvements for MPI collective operations.


title: Enhanced proton parallel temperature inside patches of switchbacks in the inner heliosphere

abstract: Switchbacks are discrete angular deflections in the solar wind magnetic field that have been observed throughout the heliosphere. Recent observations by Parker Solar Probe (PSP) have revealed the presence of patches of switchbacks on the scale of hours to days, separated by 'quieter' radial fields. We aim to further diagnose the origin of these patches using measurements of proton temperature anisotropy that can illuminate possible links to formation processes in the solar corona. We fitted 3D bi-Maxwellian functions to the core of proton velocity distributions measured by the SPAN-Ai instrument onboard PSP to obtain the proton parallel, $T_{p,\|}$, and perpendicular, $T_{p,\perp}$, temperature. We show that the presence of patches is highlighted by a transverse deflection in the flow and magnetic field away from the radial direction. These deflections are correlated with enhancements in $T_{p,\|}$, while $T_{p,\perp}$ remains relatively constant. Patches sometimes exhibit small proton and electron density enhancements. We interpret that patches are not simply a group of switchbacks, but rather switchbacks are embedded within a larger-scale structure identified by enhanced $T_{p,\|}$ that is distinct from the surrounding solar wind. We suggest that these observations are consistent with formation by reconnection-associated mechanisms in the corona.


title: Negotiating Team Formation Using Deep Reinforcement Learning

abstract: When autonomous agents interact in the same environment, they must often cooperate to achieve their goals. One way for agents to cooperate effectively is to form a team, make a binding agreement on a joint plan, and execute it. However, when agents are self-interested, the gains from team formation must be allocated appropriately to incentivize agreement. Various approaches for multi-agent negotiation have been proposed, but typically only work for particular negotiation protocols. More general methods usually require human input or domain-specific data, and so do not scale. To address this, we propose a framework for training agents to negotiate and form teams using deep reinforcement learning. Importantly, our method makes no assumptions about the specific negotiation protocol, and is instead completely experience driven. We evaluate our approach on both non-spatial and spatially extended team-formation negotiation environments, demonstrating that our agents beat hand-crafted bots and reach negotiation outcomes consistent with fair solutions predicted by cooperative game theory. Additionally, we investigate how the physical location of agents influences negotiation outcomes.


title: The Forced Soliton Equation and Semiclassical Soliton Form Factors

abstract: We show that the leading semiclassical behavior of soliton form factors at arbitrary momentum transfer is controlled by solutions to a new wave-like integro-differential equation that describes solitons undergoing acceleration. We work in the context of two-dimensional linear sigma models with kink solitons for concreteness, but our methods are purely semiclassical and generalizable.


title: Graphene Field Effect Transistors: A Review

abstract: The past decade has seen rapid growth in the research area of graphene and its application to novel electronics. With Moore's law beginning to plateau, the need for post-silicon technology in industry is becoming more apparent. Moreover, existing technology is insufficient for implementing terahertz detectors and receivers, which are required for a number of applications including medical imaging and security scanning. Graphene is considered to be a key potential candidate for replacing silicon in existing CMOS technology as well as realizing field effect transistors for terahertz detection, due to its remarkable electronic properties, with observed electronic mobilities reaching up to $2 \times 10^5$ cm$^2$ V$^{-1}$ s$^{-1}$ in suspended graphene samples. This report reviews the physics and electronic properties of graphene in the context of graphene transistor implementations. Common techniques used to synthesize graphene, such as mechanical exfoliation, chemical vapor deposition, and epitaxial growth are reviewed and compared. One of the challenges associated with realizing graphene transistors is that graphene is semimetallic, with a zero bandgap, which is troublesome in the context of digital electronics applications. Thus, the report also reviews different ways of opening a bandgap in graphene by using bilayer graphene and graphene nanoribbons. The basic operation of a conventional field effect transistor is explained and key figures of merit used in the literature are extracted. Finally, a review of some examples of state-of-the-art graphene field effect transistors is presented, with particular focus on monolayer graphene, bilayer graphene, and graphene nanoribbons.


title: Gradient flow finite element discretisations with energy-based adaptivity for excited states of Schr\"odingers equation

abstract: We present an effective numerical procedure, which is based on the computational scheme from [Heid et al., arXiv:1906.06954], for the numerical approximation of excited states of Schr\"odingers equation. In particular, this procedure employs an adaptive interplay of gradient flow iterations and local mesh refinements, leading to a guaranteed energy decay in each step of the algorithm. The computational tests highlight that this strategy is able to provide highly accurate results, with optimal convergence rate with respect to the number of degrees of freedom.


title: Influences on Faculty Uptake from a Faculty Learning Community

abstract: Professional development is a tool that faculty members use to develop knowledge and skills that help them become better teachers. We investigate what influences affect the ways in which faculty take up ideas from professional development programs. By employing the framework of Pedagogical Reasoning and Action, we investigate how faculty take up ideas from a particular Faculty Learning Community (the STEM Teaching & Learning Fellowship) and the factors that influence their instructional and material design choices. We examined influences affecting faculty in three different cases. From these cases, we constructed themes, and examined those themes across all cases using a cross-case analysis. In this multiple case study we find that assessment and instructional alignment, participation in instructional practices, and the culture of the department all influence the extent in which faculty bring new teaching ideas and practices into the classroom. These findings can be leveraged by developers to design and improve programs, as well as inform researchers on future avenues of research.


title: Theory of single and double electron spin-flip Raman scattering in semiconductor nanoplatelets

abstract: A theory of electron spin-flip Raman scattering (SFRS) is presented that describes the Raman spectral signals shifted by both single and twice the electron Zeeman energy under nearly resonant excitation of the heavy hole excitons in semiconductor nanoplatelets. We analyze the spin structure of photoexcited intermediate states, derive compound matrix elements of the spin-flip scattering and obtain polarization properties of the one- and two-electron SFRS common for all the intermediate states. We show that, in the resonant scattering process under consideration, the complexes "exciton plus localized resident electrons" play the role of main intermediate states rather than tightly bound trion states. It is demonstrated that, in addition to the direct photoexcitation (and similar photorecombination) channel, there is another indirect channel contributing to the SFRS process. In the indirect channel, the photohole forms the exciton state with the resident electron removed from the localization site while the photoelectron becomes localized on this site. The theoretical results are compared with recent experimental findings for ensembles of CdSe nanoplatelets.


title: A Benchmark for Lease Contract Review

abstract: Extracting entities and other useful information from legal contracts is an important task whose automation can help legal professionals perform contract reviews more efficiently and reduce relevant risks. In this paper, we tackle the problem of detecting two different types of elements that play an important role in a contract review, namely entities and red flags. The latter are terms or sentences that indicate that there is some danger or other potentially problematic situation for one or more of the signing parties. We focus on supporting the review of lease agreements, a contract type that has received little attention in the legal information extraction literature, and we define the types of entities and red flags needed for that task. We release a new benchmark dataset of 179 lease agreement documents that we have manually annotated with the entities and red flags they contain, and which can be used to train and test relevant extraction algorithms. Finally, we release a new language model, called ALeaseBERT, pre-trained on this dataset and fine-tuned for the detection of the aforementioned elements, providing a baseline for further research


title: A Novel Demodulation Scheme for Secure and Reliable UWB Distance Bounding

abstract: Relay attacks pose an important threat in wireless ranging and authentication systems. Distance bounding protocols have been proposed as an effective countermeasure against these attacks and allow a verifier and a prover to establish an upper bound on the distance between them. However, secure distance bounding protocols are hard to realize in practice due to stringent implementation requirements. In this paper, we look into a yet unexplored research area and show how the security strength of Ultra Wide Band (UWB) distance bounding protocols can be significantly increased by imposing several additional security constraints during demodulation and decoding at the receiver. We demonstrate that for equal reliability metrics as in state-of-the-art UWB distance bounding protocols, our solution achieves a reduction of the success probability of a relay attack by a factor of 40. Moreover, we also argue that our security solution only needs to be combined with pulse masking and a distance commitment to achieve these security bounds and there is no need to have pulse reordering in our modulation.


title: No-go theorem of anisotropic inflation via Schwinger mechanism

abstract: In the presence of a dilatonic coupling between an inflaton and a $U(1)$ gauge field, a persistent electric field (i.e., an anisotropic inflation) is obtained as a solution of the classical field equations. We introduce charged, massive, and conformally coupled fields into this model and study the pair production of charged particles. The semiclassical approach allows us to evaluate the induced current due to the pair production on the general dilatonic factor and electric field. Solving the field equations with the induced current, we find that the electric field shows a damped oscillation, whose amplitude decays to zero regardless of the values of the masses of charged fields. In other words, we derive a no-go theorem of anisotropic inflation by taking into account the Schwinger mechanism.


title: Tunable stochasticity in an artificial spin network

abstract: Metamaterials present the possibility of artificially generating advanced functionalities through engineering of their internal structure. Artificial spin networks, in which a large number of nanoscale magnetic elements are coupled together, are promising metamaterial candidates that enable the control of collective magnetic behavior through tuning of the local interaction between elements. In this work, the motion of magnetic domain-walls in an artificial spin network leads to a tunable stochastic response of the metamaterial, which can be tailored through an external magnetic field and local lattice modifications. This type of tunable stochastic network produces a controllable random response exploiting intrinsic stochasticity within magnetic domain-wall motion at the nanoscale. An iconic demonstration used to illustrate the control of randomness is the Galton board. In this system, multiple balls fall into an array of pegs to generate a bell-shaped curve that can be modified via the array spacing or the tilt of the board. A nanoscale recreation of this experiment using an artificial spin network is employed to demonstrate tunable stochasticity. This type of tunable stochastic network opens new paths towards post-Von Neumann computing architectures such as Bayesian sensing or random neural networks, in which stochasticity is harnessed to efficiently perform complex computational tasks.


title: Pulmonary surfactant inhibition of nanoparticle uptake by alveolar epithelial cells

abstract: Pulmonary surfactant forms a sub-micrometer thick fluid layer that covers the surface of alveolar lumen and inhaled nanoparticles therefore come in to contact with surfactant prior to any interaction with epithelial cells. We investigate the role of the surfactant as a protective physical barrier by modeling the interactions using silica-Curosurf-alveolar epithelial cell system in vitro. Electron microscopy displays that the vesicles are preserved in the presence of nanoparticles while nanoparticle-lipid interaction leads to the formation of mixed aggregates. Fluorescence microscopy reveals that the surfactant decreases the uptake of nanoparticles by up to two orders of magnitude in two models of alveolar epithelial cells, A549 and NCI-H441, irrespective of immersed culture on glass or air-liquid interface culture on transwell. Confocal microscopy corroborates the results by showing nanoparticle-lipid colocalization interacting with the cells. Our work thus supports the idea that pulmonary surfactant plays a protective role against inhaled nanoparticles. The effect of surfactant should therefore be considered in predictive assessment of nanoparticle toxicity or drug nanocarrier uptake. Models based on the one presented in this work may be used for preclinical tests with engineered nanoparticles.


title: UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus

abstract: Contextual word embedding models, such as BioBERT and Bio_ClinicalBERT, have achieved state-of-the-art results in biomedical natural language processing tasks by focusing their pre-training process on domain-specific corpora. However, such models do not take into consideration expert domain knowledge. In this work, we introduced UmlsBERT, a contextual embedding model that integrates domain knowledge during the pre-training process via a novel knowledge augmentation strategy. More specifically, the augmentation on UmlsBERT with the Unified Medical Language System (UMLS) Metathesaurus was performed in two ways: i) connecting words that have the same underlying `concept' in UMLS, and ii) leveraging semantic group knowledge in UMLS to create clinically meaningful input embeddings. By applying these two strategies, UmlsBERT can encode clinical domain knowledge into word embeddings and outperform existing domain-specific models on common named-entity recognition (NER) and clinical natural language inference clinical NLP tasks.


title: CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters

abstract: Due to the compelling improvements brought by BERT, many recent representation models adopted the Transformer architecture as their main building block, consequently inheriting the wordpiece tokenization system despite it not being intrinsically linked to the notion of Transformers. While this system is thought to achieve a good balance between the flexibility of characters and the efficiency of full words, using predefined wordpiece vocabularies from the general domain is not always suitable, especially when building models for specialized domains (e.g., the medical domain). Moreover, adopting a wordpiece tokenization shifts the focus from the word level to the subword level, making the models conceptually more complex and arguably less convenient in practice. For these reasons, we propose CharacterBERT, a new variant of BERT that drops the wordpiece system altogether and uses a Character-CNN module instead to represent entire words by consulting their characters. We show that this new model improves the performance of BERT on a variety of medical domain tasks while at the same time producing robust, word-level and open-vocabulary representations.


title: Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

abstract: One of the challenges to reduce the gap between the machine and the human level driving is how to endow the system with the learning capacity to deal with the coupled complexity of environments, intentions, and dynamics. In this paper, we propose a hierarchical driving model with explicit model of continuous intention and continuous dynamics, which decouples the complexity in the observation-to-action reasoning in the human driving data. Specifically, the continuous intention module takes the route planning map obtained by GPS and IMU, perception from a RGB camera and LiDAR as input to generate a potential map encoded with obstacles and intentions being expressed as grid based potentials. Then, the potential map is regarded as a condition, together with the current dynamics, to generate a continuous trajectory as output by a continuous function approximator network, whose derivatives can be used for supervision without additional parameters. Finally, we validate our method on both datasets and simulator, demonstrating that our method has higher prediction accuracy of displacement and velocity and generates smoother trajectories. The method is also deployed on the real vehicle with loop latency, validating its effectiveness. To the best of our knowledge, this is the first work to produce the driving trajectory using a continuous function approximator network.