title: Mean field limit for many-particle interactions

abstract: We provide an error bound for approximating the time evolution of N bosons by a generalized nonlinear Hartree equation. The bosons are assumed to interact via permutation symmetric bounded many-particle potentials and the initial wave-function is a product state. We show that the error between the actual evolution of a single particle derived from tracing out the full N-particle Schrodinger equation and the solution to the mean field approximate generalized nonlinear Hartree equation scales as 1/N for all times. Our result is a generalization of rigorous error bounds previously given for the case of bounded 2-particle potentials


title: Probably Approximately Correct Constrained Learning

abstract: As learning solutions reach critical applications in social, industrial, and medical domains, the need to curtail their behavior has become paramount. There is now ample evidence that without explicit tailoring, learning can lead to biased, unsafe, and prejudiced solutions. To tackle these problems, we develop a generalization theory of constrained learning based on the probably approximately correct (PAC) learning framework. In particular, we show that imposing requirements does not make a learning problem harder in the sense that any PAC learnable class is also PAC constrained learnable using a constrained counterpart of the empirical risk minimization (ERM) rule. For typical parametrized models, however, this learner involves solving a constrained non-convex optimization program for which even obtaining a feasible solution is challenging. To overcome this issue, we prove that under mild conditions the empirical dual problem of constrained learning is also a PAC constrained learner that now leads to a practical constrained learning algorithm based solely on solving unconstrained problems. We analyze the generalization properties of this solution and use it to illustrate how constrained learning can address problems in fair and robust classification.


title: Optimization of Distribution Network Configuration for Pediatric Vaccines using Chance Constraint Programming

abstract: Millions of young people are not immunized in low- and middle-income (LMI) countries because of low vaccine availability resulting from inefficiencies in cold supply chains. We create supply chain network design and distribution models to address the unique characteristics and challenges facing vaccine supply chains in LMI countries. The models capture the uncertainties of demand for vaccinations and the resulting impacts on immunization, the unique challenges of vaccine administration (such as open vial wastage), the interactions between technological improvements of vaccines and immunizations, and the trade-offs between immunization coverage rates and available resources. The objective is to maximize both the percentage of fully immunized children and the vaccine availability in clinics. Our research examines how these two metrics are affected by three factors: number of tiers in the supply chain, vaccine vial size, and new vaccine technologies. We tested the model using Niger's Expanded Program on Immunization, which is sponsored by the World Health Organization. We make many observations and recommendations to help LMI countries increase their immunization coverage.


title: Modeling Label Semantics for Predicting Emotional Reactions

abstract: Predicting how events induce emotions in the characters of a story is typically seen as a standard multi-label classification task, which usually treats labels as anonymous classes to predict. They ignore information that may be conveyed by the emotion labels themselves. We propose that the semantics of emotion labels can guide a model's attention when representing the input story. Further, we observe that the emotions evoked by an event are often related: an event that evokes joy is unlikely to also evoke sadness. In this work, we explicitly model label classes via label embeddings, and add mechanisms that track label-label correlations both during training and inference. We also introduce a new semi-supervision strategy that regularizes for the correlations on unlabeled data. Our empirical evaluations show that modeling label semantics yields consistent benefits, and we advance the state-of-the-art on an emotion inference task.


title: Sublinear Algorithms and Lower Bounds for Metric TSP Cost Estimation

abstract: We consider the problem of designing sublinear time algorithms for estimating the cost of a minimum metric traveling salesman (TSP) tour. Specifically, given access to a $n \times n$ distance matrix $D$ that specifies pairwise distances between $n$ points, the goal is to estimate the TSP cost by performing only sublinear (in the size of $D$) queries. For the closely related problem of estimating the weight of a metric minimum spanning tree (MST), it is known that for any $\varepsilon > 0$, there exists an $\tilde{O}(n/\varepsilon^{O(1)})$ time algorithm that returns a $(1 + \varepsilon)$-approximate estimate of the MST cost. This result immediately implies an $\tilde{O}(n/\varepsilon^{O(1)})$ time algorithm to estimate the TSP cost to within a $(2 + \varepsilon)$ factor for any $\varepsilon > 0$. However, no $o(n^2)$ time algorithms are known to approximate metric TSP to a factor that is strictly better than $2$. On the other hand, there were also no known barriers that rule out the existence of $(1 + \varepsilon)$-approximate estimation algorithms for metric TSP with $\tilde{O}(n)$ time for any fixed $\varepsilon > 0$. In this paper, we make progress on both algorithms and lower bounds for estimating metric TSP cost. We also show that the problem of estimating metric TSP cost is closely connected to the problem of estimating the size of a maximum matching in a graph.


title: Regret Balancing for Bandit and RL Model Selection

abstract: We consider model selection in stochastic bandit and reinforcement learning problems. Given a set of base learning algorithms, an effective model selection strategy adapts to the best learning algorithm in an online fashion. We show that by estimating the regret of each algorithm and playing the algorithms such that all empirical regrets are ensured to be of the same order, the overall regret balancing strategy achieves a regret that is close to the regret of the optimal base algorithm. Our strategy requires an upper bound on the optimal base regret as input, and the performance of the strategy depends on the tightness of the upper bound. We show that having this prior knowledge is necessary in order to achieve a near-optimal regret. Further, we show that any near-optimal model selection strategy implicitly performs a form of regret balancing.


title: Linear Models are Most Favorable among Generalized Linear Models

abstract: We establish a nonasymptotic lower bound on the $L_2$ minimax risk for a class of generalized linear models. It is further shown that the minimax risk for the canonical linear model matches this lower bound up to a universal constant. Therefore, the canonical linear model may be regarded as most favorable among the considered class of generalized linear models (in terms of minimax risk). The proof makes use of an information-theoretic Bayesian Cram\'er-Rao bound for log-concave priors, established by Aras et al. (2019).


title: Predicting and Analyzing Law-Making in Kenya

abstract: Modelling and analyzing parliamentary legislation, roll-call votes and order of proceedings in developed countries has received significant attention in recent years. In this paper, we focused on understanding the bills introduced in a developing democracy, the Kenyan bicameral parliament. We developed and trained machine learning models on a combination of features extracted from the bills to predict the outcome - if a bill will be enacted or not. We observed that the texts in a bill are not as relevant as the year and month the bill was introduced and the category the bill belongs to.


title: Extreme sub-wavelength magneto-elastic electromagnetic antenna implemented with multiferroic nanomagnets

abstract: Antennas typically have emission/radiation efficiencies bounded by A/(lambda)^2 (A < lambda^2) where A is the emitting area and lambda is the wavelength of the emitted wavelength. That makes it challenging to miniaturize antennas to extreme sub-wavelength dimensions. One way to overcome this challenge is to actuate an antenna not at the resonance of the emitted wave, but at the resonance of a different excitation that has a much shorter wavelength at the same frequency. We have actuated an electromagnetic (EM) antenna with a surface acoustic wave (SAW) whose wavelength is about five orders of magnitude smaller than the EM wavelength at the same frequency. This allowed us to implement an extreme sub-wavelength EM antenna, radiating an EM wave of wavelength lambda = 2 m, whose emitting area is ~10^-8 m2 (A/lambda^2 = 2.5 10^-9), and whose measured radiation efficiency exceeded the A/(lambda)^2 limit by over 10^5. The antenna consisted of magnetostrictive nanomagnets deposited on a piezoelectric substrate. A SAW launched in the substrate with an alternating electrical voltage periodically strained the nanomagnets and rotated their magnetizations owing to the Villari effect. The oscillating magnetizations emitted EM waves at the frequency of the SAW. These extreme sub-wavelength antennas, that radiate with efficiencies a few orders of magnitude larger than the A/(lambda)^2 limit, allow drastic miniaturization of communication systems.


title: retQSS: A Novel Methodology for Efficient Modeling and Simulation of Particle Systems in Reticulated Geometries

abstract: This work presents retQSS, a novel methodology for efficient modeling and simulation of particle systems in reticulated meshed geometries. On the simulation side, retQSS profits from the discrete-event nature of Quantized State System (QSS) methods, which enable efficient particle tracking algorithms that are agnostic of the application domain. On the modeling side, retQSS relies on the standardized Modelica modeling language, yielding compact and elegant specifications of hybrid (continuous/discrete) dynamic systems. Combined together, these features offer a sound, general-purpose framework for modeling and simulation of particle systems. We show how the state-events that arise when particles interact with a reticulated mesh are seamlessly translated into easily tractable time-events. The latter can substantially improve simulation performance in scenarios where discontinuities dominate the computational demand. We showcase the flexibility of our approach by addressing four case studies arising from different application domains. Performance studies revealed that retQSS can perform similarly to, and even outperform, well-known domain-specific particle simulation toolkits while offering a clear and sound accuracy control interface.


title: Cross-entropy-based importance sampling with failure-informed dimension reduction for rare event simulation

abstract: The estimation of rare event or failure probabilities in high dimensions is of interest in many areas of science and technology. We consider problems where the rare event is expressed in terms of a computationally costly numerical model. Importance sampling with the cross-entropy method offers an efficient way to address such problems provided that a suitable parametric family of biasing densities is employed. Although some existing parametric distribution families are designed to perform efficiently in high dimensions, their applicability within the cross-entropy method is limited to problems with dimension of O(1e2). In this work, rather than directly building sampling densities in high dimensions, we focus on identifying the intrinsic low-dimensional structure of the rare event simulation problem. To this end, we exploit a connection between rare event simulation and Bayesian inverse problems. This allows us to adapt dimension reduction techniques from Bayesian inference to construct new, effectively low-dimensional, biasing distributions within the cross-entropy method. In particular, we employ the approach in [47], as it enables control of the error in the approximation of the optimal biasing distribution. We illustrate our method using two standard high-dimensional reliability benchmark problems and one structural mechanics application involving random fields.


title: Atomki anomaly in gauged $U(1)_R$ symmetric model

abstract: The Atomki collaboration has reported that unexpected excesses have been observed in the rare decays of Beryllium nucleus. It is claimed that such excesses can suggest the existence of a new boson, called $X$, with the mass of about $17$ MeV. To solve the Atomki anomaly, we consider a model with gauged $U(1)_R$ symmetry and identify the new gauge boson with the $X$ boson. We also introduce two $SU(2)$ doublet Higgs bosons and one singlet Higgs boson, and discuss a very stringent constraint from neutrino-electron scattering. It is found that the $U(1)_R$ charges of the doublet scalars are determined to evade the constraint. In the end, we find the parameter region in which the Atomki signal and all experimental constraints can be simultaneously satisfied.


title: On Decidability of Time-bounded Reachability in CTMDPs

abstract: We consider the time-bounded reachability problem for continuous-time Markov decision processes. We show that the problem is decidable subject to Schanuel's conjecture. Our decision procedure relies on the structure of optimal policies and the conditional decidability (under Schanuel's conjecture) of the theory of reals extended with exponential and trigonometric functions over bounded domains. We further show that any unconditional decidability result would imply unconditional decidability of the bounded continuous Skolem problem, or equivalently, the problem of checking if an exponential polynomial has a non-tangential zero in a bounded interval. We note that the latter problems are also decidable subject to Schanuel's conjecture but finding unconditional decision procedures remain longstanding open problems.


title: Random Statistics of OPE Coefficients and Euclidean Wormholes

abstract: We propose an ansatz for OPE coefficients in chaotic conformal field theories which generalizes the Eigenstate Thermalization Hypothesis and describes any OPE coefficient involving heavy operators as a random variable with a Gaussian distribution. In two dimensions this ansatz enables us to compute higher moments of the OPE coefficients and analyse two and four-point functions of OPE coefficients, which we relate to genus-2 partition functions and their squares. We compare the results of our ansatz to solutions of Einstein gravity in AdS$_3$, including a Euclidean wormhole that connects two genus-2 surfaces. Our ansatz reproduces the non-perturbative correction of the wormhole, giving it a physical interpretation in terms of OPE statistics. We propose that calculations performed within the semi-classical low-energy gravitational theory are only sensitive to the random nature of OPE coefficients, which explains the apparent lack of factorization in products of partition functions.


title: Foreseeing the Benefits of Incidental Supervision

abstract: Real-world applications often require improved models by leveraging a range of cheap incidental supervision signals. These could include partial labels, noisy labels, knowledge-based constraints, and cross-domain or cross-task annotations -- all having statistical associations with gold annotations but not exactly the same. However, we currently lack a principled way to measure the benefits of these signals to a given target task, and the common practice of evaluating these benefits is through exhaustive experiments with various models and hyperparameters. This paper studies whether we can, in a single framework, quantify the benefits of various types of incidental signals for a given target task without going through combinatorial experiments. We propose a unified PAC-Bayesian motivated informativeness measure, PABI, that characterizes the uncertainty reduction provided by incidental supervision signals. We demonstrate PABI's effectiveness by quantifying the value added by various types of incidental signals to sequence tagging tasks. Experiments on named entity recognition (NER) and question answering (QA) show that PABI's predictions correlate well with learning performance, providing a promising way to determine, ahead of learning, which supervision signals would be beneficial.


title: Perspective: Numerically "exact" approach to open quantum dynamics: The hierarchical equations of motion (HEOM)

abstract: An open quantum system refers to a system that is further coupled to a bath system consisting of surrounding radiation fields, atoms, molecules, or proteins. The bath system is typically modeled by an infinite number of harmonic oscillators. This system-bath model can describe the time-irreversible dynamics through which the system evolves toward a thermal equilibrium state at finite temperature. In nuclear magnetic resonance and atomic spectroscopy, dynamics can be studied easily by using simple quantum master equations under the assumption that the system-bath interaction is weak (perturbative approximation) and the bath fluctuations are very fast (Markovian approximation). However, such approximations cannot be applied in chemical physics and biochemical physics problems, where environmental materials are complex and strongly coupled with environments. The hierarchical equations of motion (HEOM) can describe numerically "exact" dynamics of a reduced system under nonperturbative and non-Markovian system--bath interactions, which has been verified on the basis of exact analytical solutions (non-Markovian tests) with any desired numerical accuracy. The HEOM theory has been used to treat systems of practical interest, in particular to account for various linear and nonlinear spectra in molecular and solid state materials, to evaluate charge and exciton transfer rates in biological systems, to simulate resonant tunneling and quantum ratchet processes in nanodevices, and to explore quantum entanglement states in quantum information theories. This article, presents an overview of the HEOM theory, focusing on its theoretical background and applications, to help further the development of the study of open quantum dynamics.


title: Clinical Trial Drug Safety Assessment for Studies and Submissions Impacted by COVID-19

abstract: In this paper, we provide guidance on how standard safety analyses and reporting of clinical trial safety data may need to be modified, given the potential impact of the COVID-19 pandemic. The impact could include missed visits, alternative methods for assessments (such as virtual visits), alternative locations for assessments (such as local labs), and study drug interruptions. We focus on safety planning for Phase 2-4 clinical trials and integrated summaries for submissions. Starting from the recommended safety analyses proposed in white papers and a workshop, created as part of an FDA/PHUSE collaboration (PHUSE 2013, 2015, 2017, 2019), we assess what modifications might be needed. Impact from COVID-19 will likely affect treatment arms equally, so analyses of adverse events from controlled data can, to a large extent, remain unchanged. However, interpretation of summaries from uncontrolled data (summaries that include open-label extension data) will require even more caution than usual. Special consideration will be needed for safety topics of interest, especially events expected to have a higher incidence due to a COVID-19 infection or due to quarantine or travel restrictions (e.g., depression). Analyses of laboratory measurements may need to be modified to account for the combination of measurements from local and central laboratories.


title: Stochastic Automata Network for Performance Evaluation of Heterogeneous SoC Communication

abstract: To meet ever increasing demand for performance of emerging System-on-Chip (SoC) applications, designer employ techniques for concurrent communication between components. Hence communication architecture becomes complex and major performance bottleneck. An early performance evaluation of communication architecture is the key to reduce design time, time-to-market and consequently cost of the system. Moreover, it helps to optimize system performance by selecting appropriate communication architecture. However, performance model of concurrent communication is complex to describe and hard to solve. In this paper, we propose methodology for performance evaluation of bus based communication architectures, modeling for which is based on modular Stochastic Automata Network (SAN). We employ Generalized Semi Markov Process (GSMP) model for each module of the SAN that emulates dynamic behavior of a Processing Element (PE) of an SoC architecture. The proposed modeling approach provides an early estimation of performance parameters viz. memory bandwidth, average queue length at memory and average waiting time seen by a processing element; while we provide parameters viz. number of processing elements, the mean computation time of processing elements and the first and second moments of connection time between processing elements and memories, as input to the model.


title: BCG vaccination in infancy does not protect against COVID-19. Evidence from a natural experiment in Sweden

abstract: The Bacille Calmette-Gu\'erin (BCG) tuberculosis vaccine has immunity benefits against respiratory infections. Accordingly, it has been hypothesized that it may have a protective effect against COVID-19. Recent research found that countries with universal Bacillus Calmette-Gu\'erin (BCG) childhood vaccination policies tend to be less affected by the COVID-19 pandemic. However, such ecological studies are biased by numerous confounders. Instead, this paper takes advantage of a rare nationwide natural experiment that took place in Sweden in 1975, where discontinuation of newborns BCG vaccination led to a dramatic fall of the BCG coverage rate from 92% to 2% , thus allowing us to estimate the BCG's effect without all the biases associated with cross-country comparisons. Numbers of COVID-19 cases and hospitalizations were recorded for birth cohorts born just before and just after that change, representing 1,026,304 and 1,018,544 individuals, respectively. We used regression discontinuity to assess the effect of BCG vaccination on Covid-19 related outcomes. This method used on such a large population allows for a high precision that would be hard to achieve using a classical randomized controlled trial. The odds ratio for Covid-19 cases and Covid-19 related hospitalizations were 0.9997 (CI95: [0.8002-1.1992]) and 1.1931 (CI95: [0.7558-1.6304]), respectively. We can thus reject with 95\% confidence that universal BCG vaccination reduces the number of cases by more than 20% and the number of hospitalizations by more than 24%. While the effect of a recent vaccination must be evaluated, we provide strong evidence that receiving the BCG vaccine at birth does not have a protective effect against COVID-19.


title: On the perturbations of well separated matrices

abstract: A matrix is well separated if all its Gershgorin circles are away from the unit circle and they are separated from each other. In this article, the region of relative errors in the eigenvalues is obtained as a quadratic oval for non diagonal perturbation of well seperated matrices. Thus giving a computable relative error bound in terms of Gershgorin circle parameters. When the separation is $O(n)$ and the matrix is positive definite, an interlacing theorem for the eigenvalues under perturbation is presented. Further when the separation is $O(n^2 )$, condition number of the eigenvector matrix is upper bounded to obtain the region of perturbed eigenvalue. Numerical results show the relation between diagonal entries and the magnitude of the eigenvector entries even when the matrix is not so well separated. We exploit this trend in estimating the Perron vector using power method.


title: Investigating charge carrier scattering processes in anisotropic semiconductors through first-principles calculations: The case of p-type SnSe

abstract: Efficient ab initio computational methods for the calculation of thermoelectric transport properties of materials are of great avail for energy harvesting technologies. The BoltzTraP code has been largely used to efficiently calculate thermoelectric coefficients. However, its current version that is publicly available is based only on the constant relaxation time (RT) approximation, which usually does not hold for real materials. Here, we extended the implementation of the BoltzTraP code by incorporating realistic k-dependent RT models of the temperature dependence of the main scattering processes, namely, screened polar and nonpolar scattering by optical phonons, scattering by acoustic phonons, and scattering by ionized impurities with screening. Our RT models are based on a smooth Fourier interpolation of Kohn-Sham eigenvalues and its derivatives, taking into account non-parabolicity (beyond the parabolic or Kane models), degeneracy and multiplicity of the energy bands on the same footing, within very low computational cost. In order to test our methodology, we calculated the anisotropic thermoelectric transport properties of low temperature phase (Pnma) of intrinsic p-type and hole-doped tin selenide (SnSe). Our results are in quantitative agreement with experimental data, regarding the evolution of the anisotropic thermoelectric coefficients with both temperature and chemical potential. Hence, from this picture, we also obtained the evolution and understanding of the main scattering processes of the overall thermoelectric transport in p-type SnSe.


title: Nonlinear control of networked dynamical systems

abstract: We develop a principled mathematical framework for controlling nonlinear, networked dynamical systems. Our method integrates dimensionality reduction, bifurcation theory and emerging model discovery tools to find low-dimensional subspaces where feed-forward control can be used to manipulate a system to a desired outcome. The method leverages the fact that many high-dimensional networked systems have many fixed points, allowing for the computation of control signals that will move the system between any pair of fixed points. The sparse identification of nonlinear dynamics (SINDy) algorithm is used to fit a nonlinear dynamical system to the evolution on the dominant, low-rank subspace. This then allows us to use bifurcation theory to find collections of constant control signals that will produce the desired objective path for a prescribed outcome. Specifically, we can destabilize a given fixed point while making the target fixed point an attractor. The discovered control signals can be easily projected back to the original high-dimensional state and control space. We illustrate our nonlinear control procedure on established bistable, low-dimensional biological systems, showing how control signals are found that generate switches between the fixed points. We then demonstrate our control procedure for high-dimensional systems on random high-dimensional networks and Hopfield memory networks.


title: Fluid Antenna Multiple Access

abstract: Fluid antenna is a novel technology that can make an antenna appear instantly at one of N preset locations in a predefined space. An important application is to adopt fluid antenna in a small space of mobile device for obtaining the tremendous diversity hidden in the small space. Previous results have revealed that a single-antenna fluid antenna system, even with a very small space, can outperform a multiple antenna maximum ratio combining (MRC) system if $N$ is large enough. This paper explores the potential of using fluid antenna for multiple access through performance analysis. Fluid antenna multiple access (FAMA) exploits moments of deep fade experienced by the interference to achieve a favourable channel condition for the desired signal, without requiring sophisticated signal processing. We analyze the FAMA system by first deriving the outage probability of the signal-to-interference ratio (SIR) in a double integral form. We then obtain an outage probability upper bound in closed form and an average outage capacity lower bound for the FAMA system, with an arbitrary number of interferers, from which the multiplexing gain of FAMA is characterized. We also estimate how large N is required to achieve a given multiplexing gain using fluid antennas with a given size. Results illustrate that it is possible for FAMA to support hundreds of users using only one fluid antenna at each user in a few wavelengths of space, giving rise to significant enhancement in the network outage capacity.


title: Can artificial intelligence (AI) be used to accurately detect tuberculosis (TB) from chest X-rays? An evaluation of five AI products for TB screening and triaging in a high TB burden setting

abstract: Artificial intelligence (AI) products can be trained to recognize tuberculosis (TB)-related abnormalities on chest radiographs. Various AI products are available commercially, yet there is lack of evidence on how their performance compared with each other and with radiologists. We evaluated five AI software products for screening and triaging TB using a large dataset that had not been used to train any commercial AI products. Individuals (>=15 years old) presenting to three TB screening centers in Dhaka, Bangladesh, were recruited consecutively. All CXR were read independently by a group of three Bangladeshi registered radiologists and five commercial AI products: CAD4TB (v7), InferReadDR (v2), Lunit INSIGHT CXR (v4.9.0), JF CXR-1 (v2), and qXR (v3). All five AI products significantly outperformed the Bangladeshi radiologists. The areas under the receiver operating characteristic curve are qXR: 90.81% (95% CI:90.33-91.29%), CAD4TB: 90.34% (95% CI:89.81-90.87), Lunit INSIGHT CXR: 88.61% (95% CI:88.03%-89.20%), InferReadDR: 84.90% (95% CI: 84.27-85.54%) and JF CXR-1: 84.89% (95% CI:84.26-85.53%). Only qXR met the TPP with 74.3% specificity at 90% sensitivity. Five AI algorithms can reduce the number of Xpert tests required by 50%, while maintaining a sensitivity above 90%. All AI algorithms performed worse among the older age and people with prior TB history. AI products can be highly accurate and useful screening and triage tools for TB detection in high burden regions and outperform human readers.


title: DiffExp, a Mathematica package for computing Feynman integrals in terms of one-dimensional series expansions

abstract: DiffExp is a Mathematica package for integrating families of Feynman integrals order-by-order in the dimensional regulator from their systems of differential equations, in terms of one-dimensional series expansions along lines in phase-space, which are truncated at a given order in the line parameter. DiffExp is based on the series expansion strategies that were explored in recent literature for the computation of families of Feynman integrals relevant for Higgs plus jet production with full heavy quark mass dependence at next-to-leading order. The main contribution of this paper, and its associated package, is to provide a public implementation of these series expansion methods, which works for any family of integrals for which the user provides a set of differential equations and boundary conditions (and for which the program is not computationally constrained.) The main functions of the DiffExp package are discussed, and its use is illustrated by applying it to the three loop equal-mass and unequal-mass banana graph families.


title: On the largest real root of the independence polynomial of a unicyclic graph

abstract: The independence polynomial of a graph $G$, denoted $I(G,x)$, is the generating polynomial for the number of independent sets of each size. The roots of $I(G,x)$ are called the \textit{independence roots} of $G$. It is known that for every graph $G$, the independence root of smallest modulus, denoted $\xi(G)$, is real. The relation $\preceq$ on the set of all graphs is defined as follows, $H\preceq G$ if and only if $I(H,x)\ge I(G,x)\text{ for all }x\in [\xi(G),0].$ We find the maximum and minimum connected unicyclic and connected well-covered unicyclic graphs of a given order with respect to $\preceq$. This extends 2013 work by Csikv\'{a}ri where the maximum and minimum trees of a given order were determined and also answers an open question posed in the same work. Corollaries of our results give the graphs that minimize and maximize $\xi(G)$ among all connected (well-covered) unicyclic graphs. We also answer more related open questions posed by Oboudi in 2018 and disprove a conjecture due to Levit and Mandrescu from 2008.


title: Reviving non-Minimal Horndeski-like Theories after GW170817: Kinetic Coupling Corrected Einstein-Gauss-Bonnet Inflation

abstract: After the recent GW170817 event of the two neutron stars merging, many string corrected cosmological theories confronted the non-viability peril. This was due to the fact that most of these theories produce massive gravitons primordially. Among these theories were the ones containing a non-minimal kinetic coupling correction term in the Lagrangian, which belong to a subclass of Horndeski theories. In this work we demonstrate how these theories may be revived and we show how these theories can produce primordial gravitational waves with speed $c_T^2=1$ in natural units, thus complying with the GW170817 event. As we show, if the gravitational action of an Einstein-Gauss-Bonnet theory also contains a kinetic coupling of the form $\sim \xi(\phi) G^{\mu\nu}\partial_\mu\phi\partial_\nu\phi$, the condition of having primordial massless gravitons, or equivalently primordial gravitational waves with speed $c_T^2=1$ in natural units, results to certain conditions on the scalar field dependent coupling function of the Gauss-Bonnet term, which is also the non-minimal coupling of the kinetic coupling. We extensively study the phenomenological implications of such a theory focusing on the inflationary era, by only assuming slow-roll dynamics for the scalar field. Accordingly, we briefly study the case that the scalar field evolves in a constant-roll way. By using some illustrative examples, we demonstrate that the viability of the theoretical framework at hand may easily be achieved. Also, theories containing terms of the form $\sim \xi(\phi)\Box\phi g^{\mu\nu}\partial_\mu\phi\partial_\nu\phi$ and $\sim \xi(\phi)\left(g^{\mu\nu}\partial_\mu\phi\partial_\nu\phi\right)^2$ also lead to the same gravitational wave speed as the theory we shall study in this paper, so this covers a larger class of Horndeski theories.


title: A Deep Learning-Based Method for Automatic Segmentation of Proximal Femur from Quantitative Computed Tomography Images

abstract: Purpose: Proximal femur image analyses based on quantitative computed tomography (QCT) provide a method to quantify the bone density and evaluate osteoporosis and risk of fracture. We aim to develop a deep-learning-based method for automatic proximal femur segmentation. Methods and Materials: We developed a 3D image segmentation method based on V-Net, an end-to-end fully convolutional neural network (CNN), to extract the proximal femur QCT images automatically. The proposed V-net methodology adopts a compound loss function, which includes a Dice loss and a L2 regularizer. We performed experiments to evaluate the effectiveness of the proposed segmentation method. In the experiments, a QCT dataset which included 397 QCT subjects was used. For the QCT image of each subject, the ground truth for the proximal femur was delineated by a well-trained scientist. During the experiments for the entire cohort then for male and female subjects separately, 90% of the subjects were used in 10-fold cross-validation for training and internal validation, and to select the optimal parameters of the proposed models; the rest of the subjects were used to evaluate the performance of models. Results: Visual comparison demonstrated high agreement between the model prediction and ground truth contours of the proximal femur portion of the QCT images. In the entire cohort, the proposed model achieved a Dice score of 0.9815, a sensitivity of 0.9852 and a specificity of 0.9992. In addition, an R2 score of 0.9956 (p<0.001) was obtained when comparing the volumes measured by our model prediction with the ground truth. Conclusion: This method shows a great promise for clinical application to QCT and QCT-based finite element analysis of the proximal femur for evaluating osteoporosis and hip fracture risk.


title: A Machine Learning Early Warning System: Multicenter Validation in Brazilian Hospitals

abstract: Early recognition of clinical deterioration is one of the main steps for reducing inpatient morbidity and mortality. The challenging task of clinical deterioration identification in hospitals lies in the intense daily routines of healthcare practitioners, in the unconnected patient data stored in the Electronic Health Records (EHRs) and in the usage of low accuracy scores. Since hospital wards are given less attention compared to the Intensive Care Unit, ICU, we hypothesized that when a platform is connected to a stream of EHR, there would be a drastic improvement in dangerous situations awareness and could thus assist the healthcare team. With the application of machine learning, the system is capable to consider all patient's history and through the use of high-performing predictive models, an intelligent early warning system is enabled. In this work we used 121,089 medical encounters from six different hospitals and 7,540,389 data points, and we compared popular ward protocols with six different scalable machine learning methods (three are classic machine learning models, logistic and probabilistic-based models, and three gradient boosted models). The results showed an advantage in AUC (Area Under the Receiver Operating Characteristic Curve) of 25 percentage points in the best Machine Learning model result compared to the current state-of-the-art protocols. This is shown by the generalization of the algorithm with leave-one-group-out (AUC of 0.949) and the robustness through cross-validation (AUC of 0.961). We also perform experiments to compare several window sizes to justify the use of five patient timestamps. A sample dataset, experiments, and code are available for replicability purposes.


title: An overall view of key problems in algorithmic trading and recent progress

abstract: We summarize the fundamental issues at stake in algorithmic trading, and the progress made in this field over the last twenty years. We first present the key problems of algorithmic trading, describing the concepts of optimal execution, optimal placement, and price impact. We then discuss the most recent advances in algorithmic trading through the use of Machine Learning, discussing the use of Deep Learning, Reinforcement Learning, and Generative Adversarial Networks.


title: Estimating a fluctuating magnetic field with a continuously monitored atomic ensemble

abstract: We study the problem of estimating a time dependent magnetic field by continuous optical probing of an atomic ensemble. The magnetic field is assumed to follow a stochastic Ornstein-Uhlenbeck process and it induces Larmor precession of the atomic ground state spin, which is read out by the Faraday polarization rotation of a laser field probe. The interactions and the measurement scheme are compatible with a hybrid quantum-classical Gaussian description of the unknown magnetic field, and the atomic and field variables. This casts the joint conditional quantum dynamics and classical parameter estimation problem in the form of update formulas for the first and second moments of the classical and quantum degrees of freedom. Our hybrid quantum-classical theory is equivalent with the classical theory of Kalman filtering and with the quantum theory of Gaussian states. By reference to the classical theory of smoothing and with the quantum theory of past quantum states, we show how optical probing after time $t$ improves our estimate of the value of the magnetic field at time $t$, and we present numerical simulations that analyze and explain the improvement over the conventional filtering approach.


title: Non-Gaussian distribution of displacements for Lennard-Jones particles in equilibrium

abstract: Most meso-scale simulation methods assume Gaussian distributions of velocity-like quantities. These quantities are not true velocities, however, but rather time-averaged velocities or displacements of particles. We show that there is a large range of coarse-graining scales where the assumption of a Gaussian distribution of these displacements fails, and a more complex distribution is required to adequately express these distribution functions of displacements.


title: MVLidarNet: Real-Time Multi-Class Scene Understanding for Autonomous Driving Using Multiple Views

abstract: Autonomous driving requires the inference of actionable information such as detecting and classifying objects, and determining the drivable space. To this end, we present Multi-View LidarNet (MVLidarNet), a two-stage deep neural network for multi-class object detection and drivable space segmentation using multiple views of a single LiDAR point cloud. The first stage processes the point cloud projected onto a perspective view in order to semantically segment the scene. The second stage then processes the point cloud (along with semantic labels from the first stage) projected onto a bird's eye view, to detect and classify objects. Both stages use an encoder-decoder architecture. We show that our multi-view, multi-stage, multi-class approach is able to detect and classify objects while simultaneously determining the drivable space using a single LiDAR scan as input, in challenging scenes with more than one hundred vehicles and pedestrians at a time. The system operates efficiently at 150 fps on an embedded GPU designed for a self-driving car, including a postprocessing step to maintain identities over time. We show results on both KITTI and a much larger internal dataset, thus demonstrating the method's ability to scale by an order of magnitude.


title: Large-volume intrathecal administrations: impact on CSF pressure and safety implications

abstract: The increasing number of studies demonstrates the high potency of the intrathecal (IT) route for the delivery of biopharmaceuticals to the central nervous system (CNS). Our earlier data exhibited that both the infused volume and the infusion rate can regulate the initial disposition of the administered solute within the cerebrospinal fluid (CSF). On the other hand, fast additions of large volumes of liquid to the CSF inevitably raise the intracranial pressure (ICP), which may in turn lead to adverse reactions if the physiologically delimited threshold is exceeded. While long-term biological effects of elevated ICP (hydrocephalus) are known, the safety thresholds pertaining to short-term ICP elevations caused by IT infusions have not yet been characterized. This study aimed to investigate the dynamics of ICP in rats and non-human primates (NHPs) with respect to IT infusion rates and volumes. The data revealed that the addition of a liquid to the CSF raised the ICP in a rate and volume-dependent manner. At low infusion rates (<0.12 ml/min in rats and <2 ml/min in NHPs), NHPs and rats displayed similar tolerance patterns for extended durations. Specifically, safe accommodations of such added volumes were mainly facilitated by the accelerated pressure-dependent CSF drainage into the blood, with ICPs stabilizing at different levels below the safety threshold of 28+/-4 mm Hg in rats and 50+/-5 mm Hg in NHPs. High infusion rates caused uncompensated ICP elevations rapidly exceeding the safety thresholds. Their tolerance was species-dependent and was facilitated by the compensatory role of the varied components of craniospinal compliance while not excluding the possibility of other contributing factors. In conclusion, large volumes of liquids can safely be delivered via IT routes provided that ICP is monitored as a safety factor and cross-species physiological differences are accounted for.


title: An approximate dynamic programming approach to the admission control of elective patients

abstract: In this paper, we propose an approximate dynamic programming (ADP) algorithm to solve a Markov decision process (MDP) formulation for the admission control of elective patients. To manage the elective patients from multiple specialties equitably and efficiently, we establish a waiting list and assign each patient a time-dependent dynamic priority score. Then, taking the random arrivals of patients into account, sequential decisions are made on a weekly basis. At the end of each week, we select the patients to be treated in the following week from the waiting list. By minimizing the cost function of the MDP over an infinite horizon, we seek to achieve the best trade-off between the patients' waiting times and the over-utilization of surgical resources. Considering the curses of dimensionality resulting from the large scale of realistically sized problems, we first analyze the structural properties of the MDP and propose an algorithm that facilitates the search for best actions. We then develop a novel reinforcement-learning-based ADP algorithm as the solution technique. Experimental results reveal that the proposed algorithms consume much less computation time in comparison with that required by conventional dynamic programming methods. Additionally, the algorithms are shown to be capable of computing high-quality near-optimal policies for realistically sized problems.


title: Supervised Learning of Sparsity-Promoting Regularizers for Denoising

abstract: We present a method for supervised learning of sparsity-promoting regularizers for image denoising. Sparsity-promoting regularization is a key ingredient in solving modern image reconstruction problems; however, the operators underlying these regularizers are usually either designed by hand or learned from data in an unsupervised way. The recent success of supervised learning (mainly convolutional neural networks) in solving image reconstruction problems suggests that it could be a fruitful approach to designing regularizers. As a first experiment in this direction, we propose to denoise images using a variational formulation with a parametric, sparsity-promoting regularizer, where the parameters of the regularizer are learned to minimize the mean squared error of reconstructions on a training set of (ground truth image, measurement) pairs. Training involves solving a challenging bilievel optimization problem; we derive an expression for the gradient of the training loss using Karush-Kuhn-Tucker conditions and provide an accompanying gradient descent algorithm to minimize it. Our experiments on a simple synthetic, denoising problem show that the proposed method can learn an operator that outperforms well-known regularizers (total variation, DCT-sparsity, and unsupervised dictionary learning) and collaborative filtering. While the approach we present is specific to denoising, we believe that it can be adapted to the whole class of inverse problems with linear measurement models, giving it applicability to a wide range of image reconstruction problems.


title: Compact SQUID realized in a double layer graphene heterostructure

abstract: Two-dimensional systems that host one-dimensional helical states are exciting from the perspective of scalable topological quantum computation when coupled with a superconductor. Graphene is particularly promising for its high electronic quality, versatility in van der Waals heterostructures and its electron and hole-like degenerate 0$th$ Landau level. Here, we study a compact double layer graphene SQUID (superconducting quantum interference device), where the superconducting loop is reduced to the superconducting contacts, connecting two parallel graphene Josephson junctions. Despite the small size of the SQUID, it is fully tunable by independent gate control of the Fermi energies in both layers. Furthermore, both Josephson junctions show a skewed current phase relationship, indicating the presence of superconducting modes with high transparency. In the quantum Hall regime we measure a well defined conductance plateau of 2$e^2/h$ an indicative of counter propagating edge channels in the two layers. Our work opens a way for engineering topological superconductivity by coupling helical edge states, from graphene's electron-hole degenerate 0$th$ Landau level via superconducting contacts.


title: Invariable generation does not pass to finite index subgroups

abstract: Using small cancellation methods, we show that the property invariable generation does not pass to finite index subgroups, answering questions of Wiegold and Kantor-Lubotzky-Shalev. We further show that a finitely generated group that is invariably generated is not necessarily finitely invariably generated, answering a question of Cox. The same results were also obtained independently by Minasyan.


title: Determining quantum phase diagrams of topological Kitaev-inspired models on NISQ quantum hardware

abstract: Topological protection is employed in fault-tolerant error correction and in developing quantum algorithms with topological qubits. But, topological protection intrinsic to models being simulated, also robustly protects calculations, even on NISQ hardware. We leverage it by simulating Kitaev-inspired models on IBM quantum computers and accurately determining their phase diagrams. This requires constructing conventional quantum circuits for Majorana braiding to prepare the ground states of Kitaev-inspired models. The entanglement entropy is then measured to calculate the quantum phase boundaries. We show how maintaining particle-hole symmetry when sampling through the Brillouin zone is critical to obtaining high accuracy. This work illustrates how topological protection intrinsic to a quantum model can be employed to perform robust calculations on NISQ hardware, when one measures the appropriate protected quantum properties. It opens the door for further simulation of topological quantum models on quantum hardware available today.


title: Knowledge Distillation: A Survey

abstract: In recent years, deep neural networks have been successful in both industry and academia, especially for computer vision tasks. The great success of deep learning is mainly due to its scalability to encode large-scale data and to maneuver billions of model parameters. However, it is a challenge to deploy these cumbersome deep models on devices with limited resources, e.g., mobile phones and embedded devices, not only because of the high computational complexity but also the large storage requirements. To this end, a variety of model compression and acceleration techniques have been developed. As a representative type of model compression and acceleration, knowledge distillation effectively learns a small student model from a large teacher model. It has received rapid increasing attention from the community. This paper provides a comprehensive survey of knowledge distillation from the perspectives of knowledge categories, training schemes, teacher-student architecture, distillation algorithms, performance comparison and applications. Furthermore, challenges in knowledge distillation are briefly reviewed and comments on future research are discussed and forwarded.


title: Relational observables, reference frames, and conditional probabilities

abstract: We discuss the construction of relational observables in time-reparametrization invariant quantum mechanics and we argue that their physical interpretation can be understood in terms of conditional probabilities, which are defined from the solutions of the quantum constraint equation in a generalization of the Page-Wootters formalism. In this regard, we show how conditional expectation values of worldline tensor fields are related to quantum averages of suitably defined relational observables. We also comment on how the dynamics of these observables can be related to a notion of quantum reference frames. After presenting the general formalism, we analyze a recollapsing cosmological model, for which we construct unitarily evolving quantum relational observables. We conclude with some remarks about the relevance of these results for the construction and interpretation of diffeomorphism-invariant operators in quantum gravity.


title: Accelerating the pool-adjacent-violators algorithm for isotonic distributional regression

abstract: In the context of estimating stochastically ordered distribution functions, the pool-adjacent-violators algorithm (PAVA) can be modified such that the computation times are reduced substantially. This is achieved by studying the dependence of antitonic weighted least squares fits on the response vector to be approximated.


title: Environmental effects with Frozen Density Embedding in Real-Time Time-Dependent Density Functional Theory using localized basis functions

abstract: Frozen Density Embedding (FDE) represents a versatile embedding scheme to describe the environmental effect on the electron dynamics in molecular systems. The extension of the general theory of FDE to the real-time time-dependent Kohn-Sham method has previously been presented and implemented in plane-waves and periodic boundary conditions (Pavanello et al. J. Chem. Phys. 142, 154116, 2015). In the current paper, we extend our recent formulation of real-time time-dependent Kohn-Sham method based on localized basis set functions and developed within the Psi4NumPy framework (De Santis et al. J. Chem. Theory Comput. 2020, 16, 2410) to the FDE scheme. The latter has been implemented in its "uncoupled" flavor (in which the time evolution is only carried out for the active subsystem, while the environment subsystems remain at their ground state), using and adapting the FDE implementation already available in the PyEmbed module of the scripting framework PyADF. The implementation was facilitated by the fact that both Psi4NumPy and PyADF, being native Python API, provided an ideal framework of development using the Python advantages in terms of code readability and reusability. We demonstrate that the inclusion of the FDE potential does not introduce any numerical instability in time propagation of the density matrix of the active subsystem and in the limit of weak external field, the numerical results for low-lying transition energies are consistent with those obtained using the reference FDE calculations based on the linear response TDDFT. The method is found to give stable numerical results also in the presence of strong external field inducing non-linear effects.


title: Evolution of $\alpha$ Centauri B's protoplanetary disc

abstract: With hydrodynamical simulations we examine the evolution of a protoplanetary disc around $\alpha$ Centauri B including the effect of the eccentric orbit binary companion $\alpha$ Centauri A. The initially circular orbit disc undergoes two types of eccentricity growth. First, the eccentricity oscillates on the orbital period of the binary, $P_{\rm orb}$, due to the eccentricity of the binary orbit. Secondly, for a sufficiently small disc aspect ratio, the disc undergoes global forced eccentricity oscillations on a time-scale of around $20\,P_{\rm orb}$. These oscillations damp out through viscous dissipation leaving a quasi-steady eccentricity profile for the disc that oscillates only on the binary orbital period. The time-averaged global eccentricity is in the range 0.05-0.1, with no precession in the steady state. The periastrons of the gas particles are aligned to one another. The higher the disc viscosity, the higher the disc eccentricity. With $N$-body simulations we examine the evolution of a disc of planetesimals that forms with the orbital properties of the quasi-steady protoplanetary disc. We find that the average magnitude of the eccentricity of particles increases and their periastrons become misaligned to each other once they decouple from the gas disc. The low planetesimal collision velocity required for planet formation suggests that for planet formation to have occurred in a disc of planetesimals formed from a protoplanetary disc around $\alpha$ Centauri B, said disc's viscosity must be have been small and planet formation must have occurred at orbital radii smaller than about $2.5\,\rm au$. Planet formation may be easier with the presence of gas.


title: Non-uniform localised distortions in generalised elasticity for liquid crystals

abstract: We analyse a recent generalised free-energy for liquid crystals posited by Virga and falling in the class of quartic functionals in the spatial gradients of the nematic director. We review some known interesting solutions, i. e., uniform heliconical structures, and we find new liquid crystal configurations, which closely resemble some novel, experimentally detected, structures called Skyrmion tubes. These new configurations are characterised by a localised pattern given by the variation of the conical angle. We study the equilibrium differential equations and find numerical solutions and analytical approximations.

categories: cond-mat.soft hep-th math-ph math.MP nlin.SI


title: GEOM: Energy-annotated molecular conformations for property prediction and molecular generation

abstract: Machine learning (ML) outperforms traditional approaches in many molecular design tasks. ML models usually predict molecular properties from a 2D chemical graph or a single 3D structure, but neither of these representations accounts for the ensemble of 3D conformers that are accessible to a molecule. Property prediction could be improved by using conformer ensembles as input, but there is no large-scale dataset that contains graphs annotated with accurate conformers and experimental data. Here we use advanced sampling and semi-empirical density functional theory (DFT) to generate 37 million molecular conformations for over 450,000 molecules. The Geometric Ensemble Of Molecules (GEOM) dataset contains conformers for 133,000 species from QM9, and 317,000 species with experimental data related to biophysics, physiology, and physical chemistry. Ensembles of 1,511 species with BACE-1 inhibition data are also labeled with high-quality DFT free energies in an implicit water solvent, and 534 ensembles are further optimized with DFT. GEOM will assist in the development of models that predict properties from conformer ensembles, and generative models that sample 3D conformations.


title: Masks and COVID-19: a causal framework for imputing value to public-health interventions

abstract: During the COVID-19 pandemic, the scientific community developed predictive models to evaluate potential governmental interventions. However, the analysis of the effects these interventions had is less advanced. Here, we propose a data-driven framework to assess these effects retrospectively. We use a regularized regression to find a parsimonious model that fits the data with the least changes in the Rt parameter. Then, we postulate each jump in Rt as the effect of an intervention. Following the do-operator prescriptions, we simulate the counterfactual case by forcing Rt to stay at the pre-jump value. We then attribute a value to the intervention from the difference between true evolution and simulated counterfactual. We show that the recommendation to use facemasks for all activities would reduce the number of cases by 170000 (95% CI 160000 to 180000) in Connecticut, Massachusetts, and New York State. The framework presented here might be used in any case where cause and effects are sparse in time.


title: Optical $N$-invariant of graphene's viscous Hall fluid

abstract: Over the past three decades, graphene has become the prototypical platform for discovering unique phases of topological matter. Both the Chern insulator $C\in\mathbb{Z}$ and the quantum spin Hall insulator $\nu\in\mathbb{Z}_2$ were first predicted in graphene, which led to a veritable explosion of research in topological materials. Here, we introduce a new topological classification of two-dimensional matter -- the optical $N$-phases $N\in\mathbb{Z}$. The $C$ and $\nu$ phases are related to charge and spin transport respectively, whereas the $N$-phases are connected to polarization transport. In all three cases, transportation of charge/spin/polarization quanta is forbidden in the bulk but permitted on the edge. One fundamental difference is that the $N$-invariant is defined for dynamical electromagnetic waves over all Matsubara frequencies and wavevectors. We show this topological quantum number is captured solely by the spatiotemporal dispersion of the susceptibility tensor $\chi(\omega,\mathbf{q})$. We also prove $N\neq 0$ is nontrivial in graphene's viscous Hall fluid with the underlying physical mechanism being Hall viscosity $\eta_H$. In the nontrivial phase, we discover a deep sub-wavelength phenomenon reminiscent of the Meissner effect: at a particularly large photon momentum $q=D_H^{-1}$ defined by the Hall diffusion length $D_H$, the magnetic field is completely expelled from the viscous Hall fluid. We propose a new probe of topological matter, evanescent magneto-optic Kerr effect (e-MOKE) spectroscopy, to unravel this novel optical $N$-invariant and verify the magnetic field expulsion. Our work indicates that graphene with Hall viscosity is the first candidate material for a topological electromagnetic phase of matter.


title: Novelty Detection via Robust Variational Autoencoding

abstract: We propose a new method for novelty detection that can tolerate high corruption of the training points, whereas previous works assumed either no or very low corruption. Our method trains a robust variational autoencoder (VAE), which aims to generate a model for the uncorrupted training points. To gain robustness to high corruption, we incorporate the following four changes to the common VAE: 1. Extracting crucial features of the latent code by a carefully designed dimension reduction component for distributions; 2. Modeling the latent distribution as a mixture of Gaussian low-rank inliers and full-rank outliers, where the testing only uses the inlier model; 3. Applying the Wasserstein-1 metric for regularization, instead of the Kullback-Leibler (KL) divergence; and 4. Using a robust error for reconstruction. We establish both robustness to outliers and suitability to low-rank modeling of the Wasserstein metric as opposed to the KL divergence. We illustrate state-of-the-art results on standard benchmarks.


title: Locally Private Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have demonstrated superior performance in learning node representations for various graph inference tasks. However, learning over graph data can raise privacy concerns when nodes represent people or human-related variables that involve sensitive or personal information. While numerous techniques have been proposed for privacy-preserving deep learning over non-relational data, there is less work addressing the privacy issues pertained to applying deep learning algorithms on graphs. In this paper, we study the problem of node data privacy, where graph nodes have potentially sensitive data that is kept private, but they could be beneficial for a central server for training a GNN over the graph. To address this problem, we develop a privacy-preserving, architecture-agnostic GNN learning algorithm with formal privacy guarantees based on Local Differential Privacy (LDP). Specifically, we propose an LDP encoder and an unbiased rectifier, by which the server can communicate with the graph nodes to privately collect their data and approximate the GNN's first layer. To further reduce the effect of the injected noise, we propose to prepend a simple graph convolution layer, called KProp, which is based on the multi-hop aggregation of the nodes' features acting as a denoising mechanism. Finally, we propose a robust training framework, in which we benefit from KProp's denoising capability to increase the accuracy of inference in the presence of noisy labels. Extensive experiments conducted over real-world datasets demonstrate that our method can maintain a satisfying level of accuracy with low privacy loss.


title: Electronic and Magnetic Properties of Topological Semimetal Candidate NdSbTe

abstract: ZrSiS-type materials represent a large material family with unusual coexistence of topological nonsymmorphic Dirac fermions and nodal-line fermions. As a special group of ZrSiS-family, LnSbTe (Ln = Lanthanide rare earth) compounds provide a unique opportunity to explore new quantum phases due to the intrinsic magnetism induced by Ln. Here we report the single crystal growth and characterization of NdSbTe, a previously unexplored LnSbTe compound. NdSbTe has an antiferromagnetic ground state with field-driven metamagnetic transitions similar to other known LnSbTe, but exhibits distinct enhanced electronic correlations characterized by large a Sommerfeld coefficient of 115 mJ/mol $K^2$, which is the highest among the known LnSbTe compounds. Furthermore, our transport studies have revealed the coupling with magnetism and signatures of Kondo localization. All these findings establish NdSbTe as a new platform for observing novel phenomena arising from the interplay between magnetism, topology, and electron correlations.


title: Bell Non-Locality in Many Body Quantum Systems with Exponential Decay of Correlations

abstract: Using Bell-inequalities as a tool to explore non-classical physical behaviours, in this paper we analyze what one can expect to find in many-body quantum physics. Concretely, framing the usual correlation scenarios as a concrete spin-lattice, we want to know whether or not it is possible to violate a Bell-inequality restricted to this scenario. Using clustering theorems, we are able to show that a large family of quantum many-body systems behave almost locally, violating Bell-inequalities (if so) only by a non-significant amount. We also provide examples, explain some of our assumptions via counter-examples and present all the proofs for our theorems. We hope the paper is self-contained.


title: Dual-stream Maximum Self-attention Multi-instance Learning

abstract: Multi-instance learning (MIL) is a form of weakly supervised learning where a single class label is assigned to a bag of instances while the instance-level labels are not available. Training classifiers to accurately determine the bag label and instance labels is a challenging but critical task in many practical scenarios, such as computational histopathology. Recently, MIL models fully parameterized by neural networks have become popular due to the high flexibility and superior performance. Most of these models rely on attention mechanisms that assign attention scores across the instance embeddings in a bag and produce the bag embedding using an aggregation operator. In this paper, we proposed a dual-stream maximum self-attention MIL model (DSMIL) parameterized by neural networks. The first stream deploys a simple MIL max-pooling while the top-activated instance embedding is determined and used to obtain self-attention scores across instance embeddings in the second stream. Different from most of the previous methods, the proposed model jointly learns an instance classifier and a bag classifier based on the same instance embeddings. The experiments results show that our method achieves superior performance compared to the best MIL methods and demonstrates state-of-the-art performance on benchmark MIL datasets.


title: On Matched Filtering for Statistical Change Point Detection

abstract: Non-parametric and distribution-free two-sample tests have been the foundation of many change point detection algorithms. However, randomness in the test statistic as a function of time makes them susceptible to false positives and localization ambiguity. We address these issues by deriving and applying filters matched to the expected temporal signatures of a change for various sliding window, two-sample tests under IID assumptions on the data. These filters are derived asymptotically with respect to the window size for the Wasserstein quantile test, the Wasserstein-1 distance test, Maximum Mean Discrepancy squared (MMD^2), and the Kolmogorov-Smirnov (KS) test. The matched filters are shown to have two important properties. First, they are distribution-free, and thus can be applied without prior knowledge of the underlying data distributions. Second, they are peak-preserving, which allows the filtered signal produced by our methods to maintain expected statistical significance. Through experiments on synthetic data as well as activity recognition benchmarks, we demonstrate the utility of this approach for mitigating false positives and improving the test precision. Our method allows for the localization of change points without the use of ad-hoc post-processing to remove redundant detections common to current methods. We further highlight the performance of statistical tests based on the Quantile-Quantile (Q-Q) function and show how the invariance property of the Q-Q function to order-preserving transformations allows these tests to detect change points of different scales with a single threshold within the same dataset.


title: Improved Performance of BitTorrent Traffic Prediction Using Kalman Filter

abstract: Supervising internet traffic is essential for any Internet Service Provider (ISP) to dynamically allocate bandwidth in an optimized manner. BitTorrent is a well-known peer-to-peer file-sharing protocol for bulky file transfer. Its extensive bandwidth consumption affects the Quality of Service (QoS) and causes latency to other applications. There is a strong requirement to predict the BitTorrent traffic to improve the QoS. In this paper, we propose a Kalman filter (KF) based method to predict the network traffic for various traffic data sets. The observed performance of KF is superior in terms of both Mean Squared Error (MSE) and total computation time, when compared to Auto Regressive Moving Average (ARMA) model.


title: Comparing the Electric Fields of Transcranial Electric and Magnetic Perturbation

abstract: Noninvasive brain stimulation (NIBS) by quasistatic electromagnetic means is presently comprised of two methods: Magnetic induction methods (Transcranial magnetic perturbation or TMP) and electrical contact methods (Transcranial electric perturbation or TEP). Both methods couple to neuronal systems by means of the electric fields they produce. Both methods are necessarily accompanied by a scalp electric field which is of greater magnitude than anywhere within the brain. A scalp electric field of sufficient magnitude may produce deleterious effects including peripheral nerve stimulation and heating which consequently limit the spatial and temporal characteristics of the brain electric field. Presently the electromagnetic NIBS literature has produced an accurate but non-generalized understanding of the differences between the TEP and TMP methods. The aim of this work is to contribute a generalized understanding of the differences between the two methods which may open doors to novel TEP or TMP methods and translating advances, when possible, between the two methods. This article employs a three shell spherical conductor head model to calculate general analytical results showing the relationship between the spatial scale of the brain electric fields and: (1) the scalp-to-brain mean-squared electric field ratio for the two methods and (2) TEP-to-TMP scalp mean-squared electric field ratio for similar electric fields at depth. The most general result given is an asymptotic limit to the TEP-to-TMP ratio of scalp mean-squared electric fields for similar electric fields at depth. Specific example calculations for these ratios are also given for typical TEP electrode and TMP coil configurations. While TMP has favorable mean-squared electric field ratios compared to TEP this advantage comes at an energetic cost which is briefly elucidated in this work.


title: Guidelines for the Search Strategy to Update Systematic Literature Reviews in Software Engineering

abstract: Context: Systematic Literature Reviews (SLRs) have been adopted within Software Engineering (SE) for more than a decade to provide meaningful summaries of evidence on several topics. Many of these SLRs are now potentially not fully up-to-date, and there are no standard proposals on how to update SLRs in SE. Objective: The objective of this paper is to propose guidelines on how to best search for evidence when updating SLRs in SE, and to evaluate these guidelines using an SLR that was not employed during the formulation of the guidelines. Method: To propose our guidelines, we compare and discuss outcomes from applying different search strategies to identify primary studies in a published SLR, an SLR update, and two replications in the area of effort estimation. These guidelines are then evaluated using an SLR in the area of software ecosystems, its update and a replication. Results: The use of a single iteration forward snowballing with Google Scholar, and employing as a seed set the original SLR and its primary studies is the most cost-effective way to search for new evidence when updating SLRs. Furthermore, the importance of having more than one researcher involved in the selection of papers when applying the inclusion and exclusion criteria is highlighted through the results. Conclusions: Our proposed guidelines formulated based upon an effort estimation SLR, its update and two replications, were supported when using an SLR in the area of software ecosystems, its update and a replication. Therefore, we put forward that our guidelines ought to be adopted for updating SLRs in SE.


title: Machine Learning for Imaging Cherenkov Detectors

abstract: Imaging Cherenkov detectors are largely used in modern nuclear and particle physics experiments where cutting-edge solutions are needed to face always more growing computing demands. This is a fertile ground for AI-based approaches and at present we are witnessing the onset of new highly efficient and fast applications. This paper focuses on novel directions with applications to Cherenkov detectors. In particular, recent advances on detector design and calibration, as well as particle identification are presented.


title: Resolution-Enhanced MRI-Guided Navigation of Spinal Cellular Injection Robot

abstract: This paper presents a method of navigating a surgical robot beyond the resolution of magnetic resonance imaging (MRI) by using a resolution enhancement technique enabled by high-precision piezoelectric actuation. The surgical robot was specifically designed for injecting stem cells into the spinal cord. This particular therapy can be performed in a shorter time by using a MRI-compatible robotic platform than by using a manual needle positioning platform. Imaging resolution of fiducial markers attached to the needle guide tubing was enhanced by reconstructing a high-resolution image from multiple images with sub-pixel movements of the robot. The parallel-plane direct-drive needle positioning mechanism positioned the needle guide with a high spatial precision that is two orders of magnitude higher than typical MRI resolution up to 1 mm. Reconstructed resolution enhanced images were used to navigate the robot precisely that would not have been possible by using standard MRI. Experiments were conducted to verify the effectiveness of the proposed enhanced-resolution image-guided intervention.


title: Physical Education and English Language Arts Based K-12 Engineering Outreach in Software Defined Networking (Extended Version)

abstract: K-12 engineering outreach has typically focused on elementary electrical and mechanical engineering or robot experiments integrated in science or math classes. In contrast, we propose a novel outreach program focusing on communication network principles that enable the ubiquitous web and smart-phone applications. We design outreach activities that illustrate the communication network principles through activities and team competitions in physical education (PE) as well as story writing and cartooning in English Language Arts (ELA) classes. The PE activities cover the principles of store-and-forward packet switching, Hypertext Transfer Protocol (HTTP) web page download, connection establishment in cellular wireless networks, as well as packet routing in Software-Defined Networking (SDN). The proposed outreach program has been formatively evaluated by K-12 teachers. A survey for the evaluation of the impact of the outreach program on the student perceptions, specifically, the students' interest, self-efficacy, utility, and negative stereotype perceptions towards communication network engineering, is also presented.


title: Fundamental Physical and Resource Requirements for a Martian Magnetic Shield

abstract: Mars lacks a substantial magnetic field; as a result, the solar wind ablates the Martian atmosphere, making the surface uninhabitable. Therefore, any terraforming attempt will require an artificial Martian magnetic shield. The fundamental challenge of building an artificial magnetosphere is to condense planetary-scale currents and magnetic fields down to the smallest mass possible. Superconducting electromagnets offer a way to do this. However, the underlying physics of superconductors and electromagnets limits this concentration. Based upon these fundamental limitations, we show that the amount of superconducting material is proportional to $B_c^{-2}a^{-3}$, where $B_c$ is the critical magnetic field for the superconductor and $a$ is the loop radius of a solenoid. Since $B_c$ is set by fundamental physics, the only truly adjustable parameter for the design is the loop radius; a larger loop radius minimizes the amount of superconducting material required. This non-intuitive result means that the "intuitive" strategy of building a compact electromagnet and placing it between Mars and the Sun at the first Lagrange point is unfeasible. Considering reasonable limits on $B_c$, the smallest possible loop radius is $\sim$10 km, and the magnetic shield would have a mass of $\sim 10^{19}$ g. Most high-temperature superconductors are constructed of rare elements; given solar system abundances, building a superconductor with $\sim 10^{19}$ g would require mining a solar system body with several times $10^{25}$ g; this is approximately 10% of Mars. We find that the most feasible design is to encircle Mars with a superconducting wire with a loop radius of $\sim$ 3400 km. The resulting wire diameter can be as small as $\sim$5 cm. With this design, the magnetic shield would have a mass of $\sim 10^{12}$ g and would require mining $\sim 10^{18}$ g, or only 0.1\% of Olympus Mons.


title: Deep Adversarial Koopman Model for Reaction-Diffusion systems

abstract: Reaction-diffusion systems are ubiquitous in nature and in engineering applications, and are often modeled using a non-linear system of governing equations. While robust numerical methods exist to solve them, deep learning-based reduced ordermodels (ROMs) are gaining traction as they use linearized dynamical models to advance the solution in time. One such family of algorithms is based on Koopman theory, and this paper applies this numerical simulation strategy to reaction-diffusion systems. Adversarial and gradient losses are introduced, and are found to robustify the predictions. The proposed model is extended to handle missing training data as well as recasting the problem from a control perspective. The efficacy of these developments are demonstrated for two different reaction-diffusion problems: (1) the Kuramoto-Sivashinsky equation of chaos and (2) the Turing instability using the Gray-Scott model.


title: 3D Point Cloud Feature Explanations Using Gradient-Based Methods

abstract: Explainability is an important factor to drive user trust in the use of neural networks for tasks with material impact. However, most of the work done in this area focuses on image analysis and does not take into account 3D data. We extend the saliency methods that have been shown to work on image data to deal with 3D data. We analyse the features in point clouds and voxel spaces and show that edges and corners in 3D data are deemed as important features while planar surfaces are deemed less important. The approach is model-agnostic and can provide useful information about learnt features. Driven by the insight that 3D data is inherently sparse, we visualise the features learnt by a voxel-based classification network and show that these features are also sparse and can be pruned relatively easily, leading to more efficient neural networks. Our results show that the Voxception-ResNet model can be pruned down to 5\% of its parameters with negligible loss in accuracy.


title: Delayed ionization and excitation dynamics in a filament wake channel in dense gas medium

abstract: A unified theoretical description is developed for the formation of an ionized filament channel in a dense-gas medium and the evolution of electronic degrees of freedom in this channel in the laser pulse wake, as illustrated on an example of high-pressure argon. During the laser pulse, the emerging free electrons gain energy via inverse Bremsstrahlung on neutral atoms, enabling impact ionization and extensive collisional excitation of the atoms. A kinetic model of these processes produces the radial density distributions in the immediate wake of the laser pulse. After the pulse, the thermalized electron gas drives the system evolution via impact ionization (from the ground and excited states) and collisional excitation of the residual neutral atoms, while the excited atoms are engaged in Penning ionization. The interplay of these three processes determines the electron gas cooling dynamics. The local imbalance of the free-electron and ion densities induces a transient radial electric field, which depends critically on the electron temperature. The evolving radial profiles of the electron, ion, and excited-atom densities, as well as the profiles of electron temperature and induced electric field are obtained by solving the system of diffusion-reaction equations numerically. All these characteristics evolve with two characteristic timescales, and allow for measuring the electronic stage of the wake channel evolution via linear and nonlinear light-scattering experiments.


title: Tactile Roughness Perception of Virtual Gratings by Electrovibration

abstract: Realistic display of tactile textures on touch screens is a big step forward for haptic technology to reach a wide range of consumers utilizing electronic devices on a daily basis. Since the texture topography cannot be rendered explicitly by electrovibration on touch screens, it is important to understand how we perceive the virtual textures displayed by friction modulation via electrovibration. We investigated the roughness perception of real gratings made of plexiglass and virtual gratings displayed by electrovibration through a touch screen for comparison. In particular, we conducted two psychophysical experiments with 10 participants to investigate the effect of spatial period and the normal force applied by finger on roughness perception of real and virtual gratings in macro size. We also recorded the contact forces acting on the participants' finger during the experiments. The results showed that the roughness perception of real and virtual gratings are different. We argue that this difference can be explained by the amount of fingerpad penetration into the gratings. For real gratings, penetration increased tangential forces acting on the finger, whereas for virtual ones where skin penetration is absent, tangential forces decreased with spatial period. Supporting our claim, we also found that increasing normal force increases the perceived roughness of real gratings while it causes an opposite effect for the virtual gratings. These results are consistent with the tangential force profiles recorded for both real and virtual gratings. In particular, the rate of change in tangential force ($dF_t/dt$) as a function of spatial period and normal force followed trends similar to those obtained for the roughness estimates of real and virtual gratings, suggesting that it is a better indicator of the perceived roughness than the tangential force magnitude.


title: Recursive moment computation in Filon methods and application to high-frequency wave scattering in two dimensions

abstract: We study the efficient approximation of highly oscillatory integrals using Filon methods. A crucial step in the implementation of these methods is the accurate and fast computation of the Filon quadrature moments. In this work we demonstrate how recurrences can be constructed for a wide class of oscillatory kernel functions, based on the observation that many physically relevant kernel functions are in the null space of a linear differential operator whose action on the Filon interpolation basis is represented by a banded (infinite) matrix. We discuss in further detail the application to two classes of particular interest, integrals with algebraic singularities and stationary points and integrals involving a Hankel function. We provide rigorous stability results for the moment computation for the first of these classes and demonstrate how the corresponding Filon method results in an accurate approximation at truly frequency-independent cost. For the Hankel kernel, we derive error estimates which describe the convergence behaviour of the method in terms of frequency and number of Filon quadrature points. Finally, we show how Filon methods with recursive moment computation can be applied to compute efficiently integrals arising in hybrid numerical-asymptotic collocation methods for high-frequency wave scattering on a screen.


title: Data-driven identification of the spatio-temporal structure of turbulent flows by streaming Dynamic Mode Decomposition

abstract: Streaming Dynamic Mode Decomposition (sDMD) (Hemati et al., Phys. Fluids 26(2014)) is a low-storage version of Dynamic Mode Decomposition (DMD) (Schmid, J. Fluid Mech. 656 (2010)), a data-driven method to extract spatio-temporal flow patterns. Streaming DMD avoids storing the entire data sequence in memory by approximating the dynamic modes through incremental updates with new available data. In this paper, we use sDMD to identify and extract dominant spatio-temporal structures of different turbulent flows, requiring the analysis of large datasets. First, the efficiency and accuracy of sDMD are compared to the classical DMD, using a publicly available test dataset that consists of velocity field snapshots obtained by direct numerical simulation of a wake flow behind a cylinder. Streaming DMD not only reliably reproduces the most important dynamical features of the flow; our calculations also highlight its advantage in terms of the required computational resources. We subsequently use sDMD to analyse three different turbulent flows that all show some degree of large-scale coherence: rapidly rotating Rayleigh--B\'enard convection, horizontal convection and the asymptotic suction boundary layer. Structures of different frequencies and spatial extent can be clearly separated, and the prominent features of the dynamics are captured with just a few dynamic modes. In summary, we demonstrate that sDMD is a powerful tool for the identification of spatio-temporal structures in a wide range of turbulent flows.


title: Neural Methods for Point-wise Dependency Estimation

abstract: Since its inception, the neural estimation of mutual information (MI) has demonstrated the empirical success of modeling expected dependency between high-dimensional random variables. However, MI is an aggregate statistic and cannot be used to measure point-wise dependency between different events. In this work, instead of estimating the expected dependency, we focus on estimating point-wise dependency (PD), which quantitatively measures how likely two outcomes co-occur. We show that we can naturally obtain PD when we are optimizing MI neural variational bounds. However, optimizing these bounds is challenging due to its large variance in practice. To address this issue, we develop two methods (free of optimizing MI variational bounds): Probabilistic Classifier and Density-Ratio Fitting. We demonstrate the effectiveness of our approaches in 1) MI estimation, 2) self-supervised representation learning, and 3) cross-modal retrieval task.


title: Causal Discovery from Incomplete Data using An Encoder and Reinforcement Learning

abstract: Discovering causal structure among a set of variables is a fundamental problem in many domains. However, state-of-the-art methods seldom consider the possibility that the observational data has missing values (incomplete data), which is ubiquitous in many real-world situations. The missing value will significantly impair the performance and even make the causal discovery algorithms fail. In this paper, we propose an approach to discover causal structures from incomplete data by using a novel encoder and reinforcement learning (RL). The encoder is designed for missing data imputation as well as feature extraction. In particular, it learns to encode the currently available information (with missing values) into a robust feature representation which is then used to determine where to search the best graph. The encoder is integrated into a RL framework that can be optimized using the actor-critic algorithm. Our method takes the incomplete observational data as input and generates a causal structure graph. Experimental results on synthetic and real data demonstrate that our method can robustly generate causal structures from incomplete data. Compared with the direct combination of data imputation and causal discovery methods, our method performs generally better and can even obtain a performance gain as much as 43.2%.


title: On the Trade-offs between Coverage Radius, Altitude and Beamwidth for Practical UAV Deployments

abstract: Current studies on Unmanned Aerial Vehicle (UAV) based cellular deployment consider UAVs as aerial base stations for air-to-ground communication. However, they analyze UAV coverage radius and altitude interplay while omitting or over-simplifying an important aspect of UAV deployment, i.e., effect of a realistic antenna pattern. This paper addresses the UAV deployment problem while using a realistic 3D directional antenna model. New trade-offs between UAV design space dimensions are revealed and analyzed in different scenarios. The sensitivity of coverage area to both antenna beamwidth and height is compared. The analysis is extended to multiple UAVs and a new packing scheme is proposed for multiple UAVs coverage that offers several advantages compared to prior approaches.


title: Review of results using heavy ion collisions at CMS

abstract: Ultrarelativistic heavy ion collisions at the laboratory provide a unique chance to study quantum chromodynamics (QCD) under extreme temperature (${\approx}150\,\mathrm{MeV}$) and density (${\approx}1\,\mathrm{GeV}/\mathrm{fm}^3$) conditions. Over the past decade, experimental results from LHC have shown further evidence for the formation of the quark-gluon plasma (QGP), a phase that is thought to permeate the early Universe and is formed in the high-density neutron-star cores. Various QCD predictions that model the behavior of the low-$x$ gluon nuclear density, a poorly explored region, are also tested. Since the photon flux per ion scales as the square of the emitting electric charge $Z^2$, cross sections of so far elusive photon-induced processes are extremely enhanced as compared to nucleon-nucleon collisions. Here, we review recent progress on CMS measurements of particle production with large transverse momentum or mass, photon-initiated processes, jet-induced medium response, and heavy quark production. These high-precision data, along with novel approaches, offer stringent constraints on initial state, QGP formation and transport parameters, and even parametrizations beyond the standard model.


title: ReCOVery: A Multimodal Repository for COVID-19 News Credibility Research

abstract: First identified in Wuhan, China, in December 2019, the outbreak of COVID-19 has been declared as a global emergency in January, and a pandemic in March 2020 by the World Health Organization (WHO). Along with this pandemic, we are also experiencing an "infodemic" of information with low credibility such as fake news and conspiracies. In this work, we present ReCOVery, a repository designed and constructed to facilitate research on combating such information regarding COVID-19. We first broadly search and investigate ~2,000 news publishers, from which 60 are identified with extreme [high or low] levels of credibility. By inheriting the credibility of the media on which they were published, a total of 2,029 news articles on coronavirus, published from January to May 2020, are collected in the repository, along with 140,820 tweets that reveal how these news articles have spread on the Twitter social network. The repository provides multimodal information of news articles on coronavirus, including textual, visual, temporal, and network information. The way that news credibility is obtained allows a trade-off between dataset scalability and label accuracy. Extensive experiments are conducted to present data statistics and distributions, as well as to provide baseline performances for predicting news credibility so that future methods can be compared. Our repository is available at http://coronavirus-fakenews.com.


title: Hermitian-Lifted Codes

abstract: In this paper, we construct codes for local recovery of erasures with high availability and constant-bounded rate from the Hermitian curve. These new codes, called Hermitian-lifted codes, are evaluation codes with evaluation set being the set of $\mathbb{F}_{q^2}$-rational points on the affine curve. The novelty is in terms of the functions to be evaluated; they are a special set of monomials which restrict to low degree polynomials on lines intersected with the Hermitian curve. As a result, the positions corresponding to points on any line through a given point act as a recovery set for the position corresponding to that point.


title: Non-Archimedean Statistical Field Theory

abstract: We construct in a rigorous mathematical way interacting quantum field theories on a p-adic spacetime. The main result is the construction of a measure on a function space which allows a rigorous definition of the partition function. The advantage of the approach presented here is that all the perturbation calculations can be carried out in the standard way using functional derivatives, but in a mathematically rigorous way.


title: Tree Annotations in LiDAR Data Using Point Densities and Convolutional Neural Networks

abstract: LiDAR provides highly accurate 3D point clouds. However, data needs to be manually labelled in order to provide subsequent useful information. Manual annotation of such data is time consuming, tedious and error prone, and hence in this paper we present three automatic methods for annotating trees in LiDAR data. The first method requires high density point clouds and uses certain LiDAR data attributes for the purpose of tree identification, achieving almost 90% accuracy. The second method uses a voxel-based 3D Convolutional Neural Network on low density LiDAR datasets and is able to identify most large trees accurately but struggles with smaller ones due to the voxelisation process. The third method is a scaled version of the PointNet++ method and works directly on outdoor point clouds and achieves an F_score of 82.1% on the ISPRS benchmark dataset, comparable to the state-of-the-art methods but with increased efficiency.


title: Learning Functions to Study the Benefit of Multitask Learning

abstract: We study and quantify the generalization patterns of multitask learning (MTL) models for sequence labeling tasks. MTL models are trained to optimize a set of related tasks jointly. Although multitask learning has achieved improved performance in some problems, there are also tasks that lose performance when trained together. These mixed results motivate us to study the factors that impact the performance of MTL models. We note that theoretical bounds and convergence rates for MTL models exist, but they rely on strong assumptions such as task relatedness and the use of balanced datasets. To remedy these limitations, we propose the creation of a task simulator and the use of Symbolic Regression to learn expressions relating model performance to possible factors of influence. For MTL, we study the model performance against the number of tasks (T), the number of samples per task (n) and the task relatedness measured by the adjusted mutual information (AMI). In our experiments, we could empirically find formulas relating model performance with factors of sqrt(n), sqrt(T), which are equivalent to sound mathematical proofs in Maurer[2016], and we went beyond by discovering that performance relates to a factor of sqrt(AMI).


title: Detection of a Radio Bubble around the Ultraluminous X-ray Source Holmberg IX X-1

abstract: We present C and X-band radio observations of the famous utraluminous X-ray source (ULX) Holmberg IX X-1, previously discovered to be associated with an optical emission line nebula several hundred pc in extent. Our recent infrared study of the ULX suggested that a jet could be responsible for the infrared excess detected at the ULX position. The new radio observations, performed using the Karl G. Jansky Very Large Array (VLA) in B-configuration, reveal the presence of a radio counterpart to the nebula with a spectral slope of -0.56 similar to other ULXs. Importantly, we find no evidence for an unresolved radio source associated with the ULX itself, and we set an upper limit on any 5 GHz radio core emission of 6.6 $\mu$Jy ($4.1\times10^{32}$ erg s$^{-1}$). This is 20 times fainter than what we expect if the bubble is energized by a jet. If a jet exists its core component is unlikely to be responsible for the infrared excess unless it is variable. Strong winds which are expected in super-Eddington sources could also play an important role in inflating the radio bubble. We discuss possible interpretations of the radio/optical bubble and we prefer the jet+winds-blown bubble scenario similar to the microquasar SS 433.