title: SoftDropConnect (SDC) -- Effective and Efficient Quantification of the Network Uncertainty in Deep MR Image Analysis

abstract: Recently, deep learning has achieved remarkable successes in medical image analysis. Although deep neural networks generate clinically important predictions, they have inherent uncertainty. Such uncertainty is a major barrier to report these predictions with confidence. In this paper, we propose a novel yet simple Bayesian inference approach called SoftDropConnect (SDC) to quantify the network uncertainty in medical imaging tasks with gliomas segmentation and metastases classification as initial examples. Our key idea is that during training and testing SDC modulates network parameters continuously so as to allow affected information processing channels still in operation, instead of disabling them as Dropout or DropConnet does. When compared with three popular Bayesian inference methods including Bayes By Backprop, Dropout, and DropConnect, our SDC method (SDC-W after optimization) outperforms the three competing methods with a substantial margin. Quantitatively, our proposed method generates substantial improvements in prediction accuracy (by 3.4%, 2.5%, and 6.7% respectively for whole tumor segmentation in terms of dice score; and by 11.7%, 3.9%, and 8.7% respectively for brain metastases classification) and greatly reduced epistemic and aleatoric uncertainties. Our approach promises to deliver better diagnostic performance and make medical AI imaging more explainable and trustworthy.


title: Pulsations of microwave emission from a solar flare in a twisted loop caused by intrinsic MHD oscillations

abstract: We present results revealing microwave pulsations produced in a model of a flaring twisted solar coronal loop, without any external oscillatory driver. Two types of oscillations are identified: slowly-decaying oscillations with a period of about 70-75s and amplitude of about 5-10% seen in loops both with and without energetic electrons, and oscillations with period of about 40s and amplitude of a few tens of percent observed only in loops with energetic electrons for about 100s after onset of fast energy release. We interpret the longer-period oscillations as the result of a standing kink mode modulating the average magnetic field strength in the loop, whilst the short-period intermittent oscillations associated with energetic electrons are likely to be produced by fast variations of the electric field which produces energetic electrons in this scenario. The slowly-decaying oscillations can explain the quasi-periodic pulsations often observed in the flaring corona.


title: Spin valve effect in two-dimensional VSe$_2$ system

abstract: Vanadium based dichalcogenides, VSe$_2$, are two-dimensional materials in which magnetic Vanadium atoms are arranged in a hexagonal lattice and are coupled ferromagnetically within the plane. However, adjacent atomic planes are coupled antiferromagnetically. This provides new and interesting opportunities for application in spintronics and data storage and processing technologies. A spin valve magnetoresistance may be achieved when magnetic moments of both atomic planes are driven to parallel alignment by an external magnetic field. The resistance change associated with the transition from antiparallel to the parallel configuration is qualitatively similar to that observed in artificially layered metallic magnetic structures. Detailed electronic structure of VSe$_2$ was obtained from DFT calculations. Then, the ballistic spin-valve magnetoresistance was determined within the Landauer formalism. In addition, we also analyze thermal and thermoelectric properties. Both phases of VSe$_2$, denoted as H and T, are considered.


title: Simulation of Graphene Nanoplatelets for NO$_{2}$ and CO Gas Sensing at Room Temperature

abstract: This work reports the modeling and simulation of gas sensors made from pristine graphene nanoplatelets (P-GnPs) using COMSOL Multiphysics software. The mass balance equation was solved while including contributions of electromigration flux. An example GnP-based gas sensor was simulated to undergo exposure to NO2 and CO gases at different concentrations to understand the effects of adsorption. Various electrical properties and the overall sensor responses were also studied as a function of gas concentration in order to determine how viable such sensors could be for target gases. The results herein show that the resistance of the P-GnP-based gas sensor decreases when exposed to NO2 gas whereas an opposite trend is seen when CO gas is used for exposures, ultimately suggesting that the P-GnPs exhibit p-type behavior. Sensitivities of 23 % and 60 % were achieved when the P-GnP-based gas sensor was exposed to 10 mol/m3 concentration of NO2 and CO at room temperature, respectively. The data heavily suggest that a higher sensitivity towards CO may be observed in future sensors. These simulations will benefit research efforts by providing a method for predicting the behavior of GnP-based gas sensors.


title: An Extended and Fragmented Alfv\'en Zone in the Young Solar Wind

abstract: Motivated by theoretical, numerical, and observational evidence, we explore the possibility that the critical transition between sub-Alfv\'enic flow and super-Alfv\'enic flow in the solar atmosphere takes place in fragmented and disconnected subvolumes within a general Alfv\'en critical zone. The initial observations of sub-Alfv\'enic periods by Parker Solar Probe near \(16~R_\odot\) do not yet provide sufficient evidence to distinguish this possibility from that of a folded surface that separates simply-connected regions. Subsequent orbits may well enable such a distinction, but here we use a global magnetohydrodynamic model of the solar wind, coupled to a turbulence transport model, to generate possible realizations of such an Alfv\'en critical zone. Understanding this transition will inform theories of coronal heating, solar wind origin, solar angular momentum loss, and related physical processes in stellar winds beyond the Sun.


title: Prospects for water vapor detection in the atmospheres of temperate and arid rocky exoplanets around M-dwarf stars

abstract: Detection of water vapor in the atmosphere of temperate rocky exoplanets would be a major milestone on the path towards characterization of exoplanet habitability. Past modeling work has shown that cloud formation may prevent the detection of water vapor on Earth-like planets with surface oceans using the James Webb Space Telescope (JWST). Here we analyze the potential for atmospheric detection of H2O on a different class of targets: arid planets. Using transit spectrum simulations, we show that atmospheric H2O may be easier to be detected on arid planets with cold-trapped ice deposits on the surface, because such planets will not possess thick H2O cloud decks that limit the transit depth of spectral features. However, additional factors such as band overlap with CO2 and other gases, extinction by mineral dust, overlap of stellar and planetary H2O lines, and the ultimate noise floor obtainable by JWST still pose important challenges. For this reason, combination of space- and ground-based spectroscopic observations will be essential for reliable detection of H2O on rocky exoplanets in the future.


title: An Analysis of Approximation Algorithms for Iterated Stochastic Integrals and a Julia and MATLAB Simulation Toolbox

abstract: For the approximation and simulation of twofold iterated stochastic integrals and the corresponding L\'{e}vy areas w.r.t. a multi-dimensional Wiener process, we review four algorithms based on a Fourier series approach. Especially, the very efficient algorithm due to Wiktorsson and a newly proposed algorithm due to Mrongowius and R\"ossler are considered. To put recent advances into context, we analyse the four Fourier-based algorithms in a unified framework to highlight differences and similarities in their derivation. A comparison of theoretical properties is complemented by a numerical simulation that reveals the order of convergence for each algorithm. Further, concrete instructions for the choice of the optimal algorithm and parameters for the simulation of solutions for stochastic (partial) differential equations are given. Additionally, we provide advice for an efficient implementation of the considered algorithms and incorporated these insights into an open source toolbox that is freely available for both Julia and MATLAB programming languages. The performance of this toolbox is analysed by comparing it to some existing implementations, where we observe a significant speed-up.


title: FaceOcc: A Diverse, High-quality Face Occlusion Dataset for Human Face Extraction

abstract: Occlusions often occur in face images in the wild, troubling face-related tasks such as landmark detection, 3D reconstruction, and face recognition. It is beneficial to extract face regions from unconstrained face images accurately. However, current face segmentation datasets suffer from small data volumes, few occlusion types, low resolution, and imprecise annotation, limiting the performance of data-driven-based algorithms. This paper proposes a novel face occlusion dataset with manually labeled face occlusions from the CelebA-HQ and the internet. The occlusion types cover sunglasses, spectacles, hands, masks, scarfs, microphones, etc. To the best of our knowledge, it is by far the largest and most comprehensive face occlusion dataset. Combining it with the attribute mask in CelebAMask-HQ, we trained a straightforward face segmentation model but obtained SOTA performance, convincingly demonstrating the effectiveness of the proposed dataset.


title: The Allen-Cahn equation with generic initial datum

abstract: We consider the Allen-Cahn equation $\partial_t u- \Delta u=u-u^3$ with a rapidly mixing Gaussian field as initial condition. We show that provided that the amplitude of the initial condition is not too large, the equation generates fronts described by nodal sets of the Bargmann-Fock Gaussian field, which then evolve according to mean curvature flow.


title: Long Time Decay of Leray Solution of 3D-NSE With Damping

abstract: In \cite{CJ}, the authors show that the Cauchy problem of the Navier-Stokes equations with damping $\alpha|u|^{\beta-1}u(\alpha>0,\;\beta\geq1)$ has global weak solutions in $L^2(\R^3)$. In this paper, we prove the uniqueness, the continuity in $L^2$ for $\beta>3$, also the large time decay is proved for $\beta\geq\frac{10}3$. Fourier analysis and standard techniques are used.


title: Reaction Network Motifs for Static and Dynamic Absolute Concentration Robustness

abstract: Networks with absolute concentration robustness (ACR) have the property that a translation of a coordinate hyperplane either contains all steady states (static ACR) or attracts all trajectories (dynamic ACR). The implication for the underlying biological system is robustness in the concentration of one of the species independent of the initial conditions as well as independent of the concentration of all other species. Identifying network conditions for dynamic ACR is a challenging problem. We lay the groundwork in this paper by studying small reaction networks, those with 2 reactions and 2 species. We give a complete classification by ACR properties of these minimal reaction networks. The dynamics is rich even within this simple setting. Insights obtained from this work will help illuminate the properties of more complex networks with dynamic ACR.


title: A Visual Analytics Approach to Building Logistic Regression Models and its Application to Health Records

abstract: Multidimensional data analysis has become increasingly important in many fields, mainly due to current vast data availability and the increasing demand to extract knowledge from it. In most applications, the role of the final user is crucial to build proper machine learning models and to explain the patterns found in data. In this paper, we present an open unified approach for generating, evaluating, and applying regression models in high-dimensional data sets within a user-guided process. The approach is based on exposing a broad correlation panorama for attributes, by which the user can select relevant attributes to build and evaluate prediction models for one or more contexts. We name the approach UCReg (User-Centered Regression). We demonstrate effectiveness and efficiency of UCReg through the application of our framework to the analysis of Covid-19 and other synthetic and real health records data.


title: Reproducibility in Learning

abstract: We introduce the notion of a reproducible algorithm in the context of learning. A reproducible learning algorithm is resilient to variations in its samples -- with high probability, it returns the exact same output when run on two samples from the same underlying distribution. We begin by unpacking the definition, clarifying how randomness is instrumental in balancing accuracy and reproducibility. We initiate a theory of reproducible algorithms, showing how reproducibility implies desirable properties such as data reuse and efficient testability. Despite the exceedingly strong demand of reproducibility, there are efficient reproducible algorithms for several fundamental problems in statistics and learning. First, we show that any statistical query algorithm can be made reproducible with a modest increase in sample complexity, and we use this to construct reproducible algorithms for finding approximate heavy-hitters and medians. Using these ideas, we give the first reproducible algorithm for learning halfspaces via a reproducible weak learner and a reproducible boosting algorithm. Finally, we initiate the study of lower bounds and inherent tradeoffs for reproducible algorithms, giving nearly tight sample complexity upper and lower bounds for reproducible versus nonreproducible SQ algorithms.


title: Observational Signatures of Black Hole Accretion: Rotating vs. Spherical Flows with Tilted Magnetic Fields

abstract: We study the observational signatures of magnetically arrested black hole accretion with non-rotating inflow onto a rotating black hole; we consider a range of angles between the black hole spin and the initial magnetic field orientation. We compare the results of our General Relativistic Magneto-Hydrodynamic simulations to more commonly used rotating initial conditions and to the Event Horizon Telescope (EHT) observations of M87. We find that the mm intensity images, polarization images, and synchrotron emission spectra are very similar among the different simulations when post-processed with the same electron temperature model; observational differences due to different electron temperature models are significantly larger than those due to the different realizations of magnetically arrested accretion. The orientation of the mm synchrotron polarization is particularly insensitive to the initial magnetic field orientation, the electron temperature model, and the rotation of the inflowing plasma. The largest difference among the simulations with different initial rotation and magnetic tilt is in the strength and stability of the jet; spherical inflow leads to kink-unstable jets. We discuss the implications of our results for current and future EHT observations and for theoretical models of event-horizon-scale black hole accretion.


title: Observational signatures of stellar explosions driven by relativistic jets

abstract: The role of relativistic jets in unbinding the stellar envelope during a supernova (SN) associated with a gamma-ray burst (GRB) is unclear. To study that, we explore observational signatures of stellar explosions that are driven by jets. We focus on the final velocity distribution of the outflow in such explosions and compare its observational imprints to SN/GRB data. We find that jet driven explosions produce an outflow with a flat distribution of energy per logarithmic scale of proper velocity. The flat distribution seems to be universal as it is independent of the jet and the progenitor properties that we explored. The velocity range of the flat distribution for typical GRB parameters is $\gamma\beta \approx 0.03-3$, where $\gamma$ is the outflow Lorentz factor and $\beta$ is its dimensionless velocity. A flat distribution is seen also for collimated choked jets where the highest outflow velocity decreases with the depth at which the jet is choked. Comparison to observations of SN/GRBs rules out jets as the sole explosion source in these events. Instead, in SN/GRB the collapsing star must deposit its energy into two channels - a quasi-spherical (or wide angle) channel and a narrowly collimated one. The former carries most of the energy and is responsible for the SN sub-relativistic ejecta while the latter carries 0.01-0.1 of the total outflow energy and is the source of the GRB. Intriguingly, the same two channels, with a similar energy ratio, were seen in the binary neutron star merger GW170817, suggesting that similar engines are at work in both phenomena.


title: Finite difference and finite element methods for partial differential equations on fractals

abstract: In this paper, we present numerical procedures to compute solutions of partial differential equations posed on fractals. In particular, we consider the strong form of the equation using standard graph Laplacian matrices and also weak forms of the equation derived using standard length or area measure on a discrete approximation of the fractal set. We then introduce a numerical procedure to normalize the obtained diffusions, that is, a way to compute the renormalization constant needed in the definitions of the actual partial differential equation on the fractal set. A particular case that is studied in detail is the solution of the Dirichlet problem in the Sierpinski triangle. Other examples are also presented including a non-planar Hata tree.


title: DROPO: Sim-to-Real Transfer with Offline Domain Randomization

abstract: In recent years, domain randomization over dynamics parameters has gained a lot of traction as a method for sim-to-real transfer of reinforcement learning policies in robotic manipulation; however, finding optimal randomization distributions can be difficult. In this paper, we introduce DROPO, a novel method for estimating domain randomization distributions for safe sim-to-real transfer. Unlike prior work, DROPO only requires a limited, precollected offline dataset of trajectories, and explicitly models parameter uncertainty to match real data using a likelihood-based approach. We demonstrate that DROPO is capable of recovering dynamic parameter distributions in simulation and finding a distribution capable of compensating for an unmodeled phenomenon. We also evaluate the method in two zero-shot sim-to-real transfer scenarios, showing successful domain transfer and improved performance over prior methods.


title: Noisy linear inverse problems under convex constraints: Exact risk asymptotics in high dimensions

abstract: In the standard Gaussian linear measurement model $Y=X\mu_0+\xi \in \mathbb{R}^m$ with a fixed noise level $\sigma>0$, we consider the problem of estimating the unknown signal $\mu_0$ under a convex constraint $\mu_0 \in K$, where $K$ is a closed convex set in $\mathbb{R}^n$. We show that the risk of the natural convex constrained least squares estimator (LSE) $\hat{\mu}(\sigma)$ can be characterized exactly in high dimensional limits, by that of the convex constrained LSE $\hat{\mu}_K^{\mathsf{seq}}$ in the corresponding Gaussian sequence model at a different noise level. The characterization holds (uniformly) for risks in the maximal regime that ranges from constant order all the way down to essentially the parametric rate, as long as certain necessary non-degeneracy condition is satisfied for $\hat{\mu}(\sigma)$. The precise risk characterization reveals a fundamental difference between noiseless (or low noise limit) and noisy linear inverse problems in terms of the sample complexity for signal recovery. A concrete example is given by the isotonic regression problem: While exact recovery of a general monotone signal requires $m\gg n^{1/3}$ samples in the noiseless setting, consistent signal recovery in the noisy setting requires as few as $m\gg \log n$ samples. Such a discrepancy occurs when the low and high noise risk behavior of $\hat{\mu}_K^{\mathsf{seq}}$ differ significantly. In statistical languages, this occurs when $\hat{\mu}_K^{\mathsf{seq}}$ estimates $0$ at a faster `adaptation rate' than the slower `worst-case rate' for general signals. Several other examples, including non-negative least squares and generalized Lasso (in constrained forms), are also worked out to demonstrate the concrete applicability of the theory in problems of different types.


title: A Method of Sequential Log-Convex Programming for Engineering Design

abstract: A method of Sequential Log-Convex Programming (SLCP) is constructed that exploits the log-convex structure present in many engineering design problems. The mathematical structure of Geometric Programming (GP) is combined with the ability of Sequential Quadratic Program (SQP) to accommodate a wide range of objective and constraint functions, resulting in a practical algorithm that can be adopted with little to no modification of existing design practices. Three test problems are considered to demonstrate the SLCP algorithm, comparing it with SQP and the modified Logspace Sequential Quadratic Programming (LSQP). In these cases, SLCP shows up to a 77% reduction in number of iterations compared to SQP, and an 11% reduction compared to LSQP. The airfoil analysis code XFOIL is integrated into one of the case studies to show how SLCP can be used to evolve the fidelity of design problems that have initially been modeled as GP compatible. Finally, a methodology for design based on GP and SLCP is briefly discussed.


title: Twist Angle Tuning of Moir\'{e} Exciton Polaritons in van der Waals Heterostructures

abstract: Twisted atomically thin semiconductors are characterized by moir\'{e} excitons. Their optical signatures and selection rules are well understood. However, their hybridization with photons in the strong coupling regime for heterostructures integrated in an optical cavity has not been in the focus of research yet. Here, we combine an excitonic density matrix formalism with a Hopfield approach to provide microscopic insights into moir\'{e} exciton polaritons. In particular, we show that exciton-light coupling, polariton energy, and even the number of polariton branches can be controlled via the twist angle. We find that these new hybrid light-exciton states become delocalized relative to the constituent excitons due to the mixing with light and higher-energy excitons. The system can be interpreted as a natural quantum metamaterial with a periodicity that can be engineered via the twist angle. Our study presents a significant advance in microscopic understanding and control of moir\'{e} exciton polaritons in twisted atomically thin semiconductors.


title: Did a close tidal encounter cause the Great Dimming of Betelgeuse?

abstract: We assess whether gravity darkening, induced by a tidal interaction during a stellar fly-by, might be sufficient to explain the Great Dimming of Betelgeuse. Adopting several simple approximations, we calculate the tidal deformation and associated gravity darkening in a close tidal encounter, as well as the reduction in the radiation flux as seen by a distant observer. We show that, in principle, the duration and degree of the resulting stellar dimming can be used to estimate the minimum pericenter separation and mass of a fly-by object, which, even if it remains undetected otherwise, might be a black hole, neutron star, or white dwarf. Our estimates show that, while such fly-by events may occur in other astrophysical scenarios, where our analysis should be applicable, they likely are not large enough to explain the Great Dimming of Betelgeuse by themselves.


title: Comments on the negative specific heat of the $T \bar T$ deformed symmetric product CFT

abstract: We show that the $T \bar T$ deformation of conformal field theories whose entropy grows as $S(E) \sim E^\gamma$ for $\gamma > 1/2$ exhibits negative specific heat in its microcanonical thermodynamic function $S({\cal E})$. We analyze the large $N$ symmetric product CFT as a concrete example of a CFT with this property and compute the thermodynamic functions such as $S({\cal E})$ and ${\cal E}(T)$. The negative specific heat in the microcanonical data is interpreted as signaling the first order phase transition when the system is coupled to a heat bath.


title: A Guide to Particle Advection Performance

abstract: The performance of particle advection-based flow visualization techniques is complex, since computational work can vary based on many factors, including number of particles, duration, and mesh type. Further, while many approaches have been introduced to optimize performance, the efficacy of a given approach can be similarly complex. In this work, we seek to establish a guide for particle advection performance by conducting a comprehensive survey of the area. We begin by identifying the building blocks for particle advection and establishing a simple cost model incorporating these building blocks. We then survey existing optimizations for particle advection, using two high-level categories: algorithmic optimizations and hardware efficiency. The sub-categories of algorithmic optimizations include solvers, cell locators, I/O efficiency, and precomputation, while the sub-categories of hardware efficiency all involve parallelism: shared-memory, distributed-memory, and hybrid. Finally, we conclude the survey by identifying current gaps in particle advection performance, and in particular on achieving a workflow for predicting performance under various optimizations.


title: VUDENC: Vulnerability Detection with Deep Learning on a Natural Codebase for Python

abstract: Context: Identifying potential vulnerable code is important to improve the security of our software systems. However, the manual detection of software vulnerabilities requires expert knowledge and is time-consuming, and must be supported by automated techniques. Objective: Such automated vulnerability detection techniques should achieve a high accuracy, point developers directly to the vulnerable code fragments, scale to real-world software, generalize across the boundaries of a specific software project, and require no or only moderate setup or configuration effort. Method: In this article, we present VUDENC (Vulnerability Detection with Deep Learning on a Natural Codebase), a deep learning-based vulnerability detection tool that automatically learns features of vulnerable code from a large and real-world Python codebase. VUDENC applies a word2vec model to identify semantically similar code tokens and to provide a vector representation. A network of long-short-term memory cells (LSTM) is then used to classify vulnerable code token sequences at a fine-grained level, highlight the specific areas in the source code that are likely to contain vulnerabilities, and provide confidence levels for its predictions. Results: To evaluate VUDENC, we used 1,009 vulnerability-fixing commits from different GitHub repositories that contain seven different types of vulnerabilities (SQL injection, XSS, Command injection, XSRF, Remote code execution, Path disclosure, Open redirect) for training. In the experimental evaluation, VUDENC achieves a recall of 78%-87%, a precision of 82%-96%, and an F1 score of 80%-90%. VUDENC's code, the datasets for the vulnerabilities, and the Python corpus for the word2vec model are available for reproduction. Conclusions: Our experimental results suggest...


title: Neural Network Quantization with AI Model Efficiency Toolkit (AIMET)

abstract: While neural networks have advanced the frontiers in many machine learning applications, they often come at a high computational cost. Reducing the power and latency of neural network inference is vital to integrating modern networks into edge devices with strict power and compute requirements. Neural network quantization is one of the most effective ways of achieving these savings, but the additional noise it induces can lead to accuracy degradation. In this white paper, we present an overview of neural network quantization using AI Model Efficiency Toolkit (AIMET). AIMET is a library of state-of-the-art quantization and compression algorithms designed to ease the effort required for model optimization and thus drive the broader AI ecosystem towards low latency and energy-efficient inference. AIMET provides users with the ability to simulate as well as optimize PyTorch and TensorFlow models. Specifically for quantization, AIMET includes various post-training quantization (PTQ, cf. chapter 4) and quantization-aware training (QAT, cf. chapter 5) techniques that guarantee near floating-point accuracy for 8-bit fixed-point inference. We provide a practical guide to quantization via AIMET by covering PTQ and QAT workflows, code examples and practical tips that enable users to efficiently and effectively quantize models using AIMET and reap the benefits of low-bit integer inference.


title: Diversifying the Genomic Data Science Research Community

abstract: Over the last 20 years, there has been an explosion of genomic data collected for disease association, functional analyses, and other large-scale discoveries. At the same time, there have been revolutions in cloud computing that enable computational and data science research, while making data accessible to anyone with a web browser and an internet connection. However, students at institutions with limited resources have received relatively little exposure to curricula or professional development opportunities that lead to careers in genomic data science. To broaden participation in genomics research, the scientific community needs to support students, faculty, and administrators at Underserved Institutions (UIs) including Community Colleges, Historically Black Colleges and Universities, Hispanic-Serving Institutions, and Tribal Colleges and Universities in taking advantage of these tools in local educational and research programs. We have formed the Genomic Data Science Community Network (http://www.gdscn.org/) to identify opportunities and support broadening access to cloud-enabled genomic data science. Here, we provide a summary of the priorities for faculty members at UIs, as well as administrators, funders, and R1 researchers to consider as we create a more diverse genomic data science community.


title: Profit Shifting of Multinational Corporations Worldwide

abstract: We exploit the new country-by-country reporting data of multinational corporations, with unparalleled country coverage, to reveal the distributional consequences of profit shifting. We estimate that multinational corporations worldwide shifted over \$850 billion in profits in 2017, primarily to countries with effective tax rates below 10\%. Countries with lower incomes lose a larger share of their total tax revenue due to profit shifting. We further show that a logarithmic function is better suited for capturing the non-linear relationship between profits and tax rates than linear or quadratic functions. Our findings highlight effective tax rates' importance for profit shifting and tax reforms.


title: A Prescriptive Dirichlet Power Allocation Policy with Deep Reinforcement Learning

abstract: Prescribing optimal operation based on the condition of the system and, thereby, potentially prolonging the remaining useful lifetime has a large potential for actively managing the availability, maintenance and costs of complex systems. Reinforcement learning (RL) algorithms are particularly suitable for this type of problems given their learning capabilities. A special case of a prescriptive operation is the power allocation task, which can be considered as a sequential allocation problem, where the action space is bounded by a simplex constraint. A general continuous action-space solution of such sequential allocation problems has still remained an open research question for RL algorithms. In continuous action-space, the standard Gaussian policy applied in reinforcement learning does not support simplex constraints, while the Gaussian-softmax policy introduces a bias during training. In this work, we propose the Dirichlet policy for continuous allocation tasks and analyze the bias and variance of its policy gradients. We demonstrate that the Dirichlet policy is bias-free and provides significantly faster convergence, better performance and better hyperparameters robustness over the Gaussian-softmax policy. Moreover, we demonstrate the applicability of the proposed algorithm on a prescriptive operation case, where we propose the Dirichlet power allocation policy and evaluate the performance on a case study of a set of multiple lithium-ion (Li-I) battery systems. The experimental results show the potential to prescribe optimal operation, improve the efficiency and sustainability of multi-power source systems.


title: Dealing with elementary paths in the Kidney Exchange Problem

abstract: We study an elementary path problem which appears in the pricing step of a column generation scheme solving the kidney exchange problem. The latter aims at finding exchanges of donations in a pool of patients and donors of kidney transplantations. Informally, the problem is to determine a set of cycles and chains of limited length maximizing a medical benefit in a directed graph. The cycle formulation, a large-scale model of the problem restricted to cycles of donation, is efficiently solved via branch-and-price. When including chains of donation however, the pricing subproblem becomes NP-hard. This article proposes a new complete column generation scheme that takes into account these chains initiated by altruistic donors. The development of non-exact dynamic approaches for the pricing problem, the NG-route relaxation and the color coding heuristic, leads to an efficient column generation process.


title: Development and validation of a targeted LC-MS/MS quantitation method to monitor cell culture expression of tetanus neurotoxin during vaccine production

abstract: The tetanus neurotoxin (TeNT) is one of the most toxic proteins known to man, which prior to the use of the vaccine against the TeNT producing bacteria Clostridium tetani, resulted in a 20 % mortality rate upon infection. The clinical detrimental effects of tetanus have decreased immensely since the introduction of global vaccination programs, which depend on sustainable vaccine production. One of the major critical points in the manufacturing of these vaccines is the stable and reproducible production of high levels of toxin by the bacterial seed strains. In order to minimize time loss, the amount of TeNT is often monitored during and at the end of the bacterial culturing. The different methods that are currently available to assess the amount of TeNT in the bacterial medium suffer from variability, lack of sensitivity, and/or require specific antibodies. In accordance with the consistency approach and the three Rs (3Rs), both aiming to reduce the use of animals for testing, in-process monitoring of TeNT production could benefit from animal and antibody-free analytical tools. In this paper, we describe the development and validation of a new and reliable antibody free targeted LC-MS/MS method that is able to identify and quantify the amount of TeNT present in the bacterial medium during the different production time points up to the harvesting of the TeNT just prior to further upstream purification and detoxification. The quantitation method, validated according to ICH guidelines and by the application of the total error approach, was utilized to assess the amount of TeNT present in the cell culture medium of two TeNT production batches during different steps in the vaccine production process prior to the generation of the toxoid. The amount of TeNT generated under different physical stress conditions applied during bacterial culture was also monitored.


title: Kinit Classification in Ethiopian Chants, Azmaris and Modern Music: A New Dataset and CNN Benchmark

abstract: In this paper, we create EMIR, the first-ever Music Information Retrieval dataset for Ethiopian music. EMIR is freely available for research purposes and contains 600 sample recordings of Orthodox Tewahedo chants, traditional Azmari songs and contemporary Ethiopian secular music. Each sample is classified by five expert judges into one of four well-known Ethiopian Kinits, Tizita, Bati, Ambassel and Anchihoye. Each Kinit uses its own pentatonic scale and also has its own stylistic characteristics. Thus, Kinit classification needs to combine scale identification with genre recognition. After describing the dataset, we present the Ethio Kinits Model (EKM), based on VGG, for classifying the EMIR clips. In Experiment 1, we investigated whether Filterbank, Mel-spectrogram, Chroma, or Mel-frequency Cepstral coefficient (MFCC) features work best for Kinit classification using EKM. MFCC was found to be superior and was therefore adopted for Experiment 2, where the performance of EKM models using MFCC was compared using three different audio sample lengths. 3s length gave the best results. In Experiment 3, EKM and four existing models were compared on the EMIR dataset: AlexNet, ResNet50, VGG16 and LSTM. EKM was found to have the best accuracy (95.00%) as well as the fastest training time. We hope this work will encourage others to explore Ethiopian music and to experiment with other models for Kinit classification.


title: Stabilization of CeGe$_3$ with Ti and O featuring tetravalent Ce ions: (Ce$_{0.85}$Ti$_{0.15}$)Ge$_3$O$_{0.5}$

abstract: Sub-oxides with the anti-perovskite structure constitute a large part of the interstitial stabilized compounds with novel chemical and physical properties, especially in the systems containing rare earth elements and/or early transition metal elements. A new sub-oxide compound, (Ce$_{0.85}$Ti$_{0.15}$)Ge$_3$O$_{0.5}$, is synthesized by flux growth. The compound crystallizes in a cubic structure which can be considered as an ordered vacancy variant of anti-perovskite-structure or an ordered interstitial variant of the Cu$_3$Au type, with a space group of Fm-3m (225). The structure is refined from X-ray single crystal methods. The compound may be considered as a compound stabilized by chemical pressure generated by the substitution and the interstitials atoms. The stability of the compounds in RTr$_3$ systems (R = rare earth elements except Pm and Sc, Tr = tetrel elements such as Si, Ge, Sn, Pb) seem to be highly correlated to the ratio of the rare earth elements' radii to the main group elements' atomic radii. The magnetic property of the compound confirms the 4$^+$ valence of the Ce atoms. The resistivity measurement of the compound shows that it is metallic.


title: Automatic Item Generation of Figural Analogy Problems: A Review and Outlook

abstract: Figural analogy problems have long been a widely used format in human intelligence tests. In the past four decades, more and more research has investigated automatic item generation for figural analogy problems, i.e., algorithmic approaches for systematically and automatically creating such problems. In cognitive science and psychometrics, this research can deepen our understandings of human analogical ability and psychometric properties of figural analogies. With the recent development of data-driven AI models for reasoning about figural analogies, the territory of automatic item generation of figural analogies has further expanded. This expansion brings new challenges as well as opportunities, which demand reflection on previous item generation research and planning future studies. This paper reviews the important works of automatic item generation of figural analogies for both human intelligence tests and data-driven AI models. From an interdisciplinary perspective, the principles and technical details of these works are analyzed and compared, and desiderata for future research are suggested.


title: Regional Negative Bias in Word Embeddings Predicts Racial Animus--but only via Name Frequency

abstract: The word embedding association test (WEAT) is an important method for measuring linguistic biases against social groups such as ethnic minorities in large text corpora. It does so by comparing the semantic relatedness of words prototypical of the groups (e.g., names unique to those groups) and attribute words (e.g., 'pleasant' and 'unpleasant' words). We show that anti-black WEAT estimates from geo-tagged social media data at the level of metropolitan statistical areas strongly correlate with several measures of racial animus--even when controlling for sociodemographic covariates. However, we also show that every one of these correlations is explained by a third variable: the frequency of Black names in the underlying corpora relative to White names. This occurs because word embeddings tend to group positive (negative) words and frequent (rare) words together in the estimated semantic space. As the frequency of Black names on social media is strongly correlated with Black Americans' prevalence in the population, this results in spurious anti-Black WEAT estimates wherever few Black Americans live. This suggests that research using the WEAT to measure bias should consider term frequency, and also demonstrates the potential consequences of using black-box models like word embeddings to study human cognition and behavior.


title: npm-filter: Automating the mining of dynamic information from npm packages

abstract: The static properties of code repositories, e.g., lines of code, dependents, dependencies, etc. can be readily scraped from code hosting platforms such as GitHub, and from package management systems such as npm for JavaScript; Although no less important, information related to the dynamic properties of programs, e.g., number of tests in a test suite that pass or fail, is less readily available. The ability to easily collect this dynamic information could be immensely useful to researchers conducting corpus analyses, as they could differentiate projects based on properties that can only be observed by running them. In this paper, we present npm-filter, an automated tool that can download, install, build, test, and run custom user scripts over the source code of JavaScript projects available on npm, the most popular JavaScript package manager. We outline this tool, describe its implementation, and show that npm-filter has already been useful in developing evaluation suites for multiple JavaScript tools.


title: Flavor alignment of New Physics in light of the $(g-2)_\mu$ anomaly

abstract: Addressing the ${(g-2)_\mu}$ anomaly and simultaneously being consistent with the tight bounds on ${\mu \to e \gamma}$ requires a precise alignment of the lepton dipole operator in flavor space. We investigate this alignment condition in the Standard Model Effective Field Theory by considering the Renormalization Group mixing of the relevant operators. We find that semileptonic four-fermion operators, which are likely to yield a sizable contribution to the ${(g-2)_\mu}$ anomaly, need to be tightly aligned to the lepton dipole operator and Yukawa coupling. We discuss how New Physics models can comply with these stringent conditions by employing particular dynamical assumptions or using flavor symmetries.


title: An error estimate for the Gauss-Jacobi-Lobatto quadrature rule

abstract: An error estimate for the Gauss-Lobatto quadrature formula for integration over the interval $[-1, 1]$, relative to the Jacobi weight function $w^{\alpha,\beta}(t)=(1-t)^\alpha(1+t)^\beta$, $\alpha,\beta>-1$, is obtained. This estimate holds true for functions belonging to some Sobolev-type subspaces of the weighted space $L_{w^{\alpha,\beta}}^1([-1,1])$.


title: LOSTIN: Logic Optimization via Spatio-Temporal Information with Hybrid Graph Models

abstract: Despite the stride made by machine learning (ML) based performance modeling, two major concerns that may impede production-ready ML applications in EDA are stringent accuracy requirements and generalization capability. To this end, we propose hybrid graph neural network (GNN) based approaches towards highly accurate quality-of-result (QoR) estimations with great generalization capability, specifically targeting logic synthesis optimization. The key idea is to simultaneously leverage spatio-temporal information from hardware designs and logic synthesis flows to forecast performance (i.e., delay/area) of various synthesis flows on different designs. The structural characteristics inside hardware designs are distilled and represented by GNNs; the temporal knowledge (i.e., relative ordering of logic transformations) in synthesis flows can be imposed on hardware designs by combining a virtually added supernode or a sequence processing model with conventional GNN models. Evaluation on 3.3 million data points shows that the testing mean absolute percentage error (MAPE) on designs seen and unseen during training are no more than 1.2% and 3.1%, respectively, which are 7-15X lower than existing studies.


title: Towards Web of Things Middleware: A Systematic Review

abstract: Advancements of the Web technology provide this opportunity for Internet of Things (IoT) to take steps towards Web of Things (WoT). By increasing trend of reusing Web techniques to create a monolithic environment to control, monitor, and compose the smart objects, a mature WoT architecture is finally emerged in four layers to be a solution for IoT-middleware. Although WoT architecture facilitates addressing requirements of IoT in architectural or service aspects, but the effectiveness of this solution is indeterminate to meet IoT-middleware objectives. The most surveys and related reviews in this field just investigate IoT-middleware and WoT separately and thereby, report some new technologies or protocols on various middlewares or WoT models. In this paper a comprehensive survey is proposed on common area of IoT and WoT disciplines by leveraging Systematic Literature Review (SLR) as research methodology. This survey classifies variant types of IoT-middleware and WoT architecture to specifies their requirements and characteristics, respectively. Hence, WoT requirements could be categorized by comparing and analyzing IoT-middleware requirements and WoT characteristics. This research heavily reviews existing academic and industrial contributions to select potential platforms (or frameworks) and assess them against proposed WoT requirements. As a result of this survey, strengths and weaknesses of WoT architecture, as a IoT-middleware, are presented. Finally, this research attempts to open new horizon for the WoT architecture to enable researchers to dig role of WoT technologies in the IoT.


title: Cosmic rays in molecular clouds probed by H$_{2}$ rovibrational lines -- Perspectives for the James Webb Space Telescope

abstract: Cosmic rays (CRs) at sub-TeV energies play a fundamental role in the chemical and dynamical evolution of molecular clouds, as they control the ionisation, dissociation, and excitation of H$_{2}$. Their characterisation is important both for the interpretation of observations and for the development of theoretical models. The methods used so far for estimating the CR ionisation rate ($\zeta$) in molecular clouds have several limitations due to uncertainties in the adopted chemical networks. We refine and extend the method proposed by Bialy (2020) to estimate $\zeta$ by observing rovibrational transitions of H$_{2}$ at near-infrared wavelengths, which are mainly excited by secondary CR electrons. Combining models of interstellar CR propagation and attenuation with the calculation of the expected secondary electron spectrum and updated H$_{2}$ excitation cross sections by electron collisions, we derive the intensity of the four H$_{2}$ rovibrational transitions observable in dense, cold gas: (1-0)O(2), (1-0)Q(2), (1-0)S(0), and (1-0)O(4). The proposed method allows the estimation of $\zeta$ for a given observed line intensity and H$_{2}$ column density. We are also able to deduce the shape of the low-energy CR proton spectrum impinging upon the molecular cloud. We present a look-up plot and a web-based application that can be used to constrain the low-energy spectral slope of the interstellar CR proton spectrum. We comment on the capability of the James Webb Space Telescope to detect these near-infrared H$_{2}$ lines, making it possible to derive for the first time spatial variation of $\zeta$ in dense gas. Besides the implications for the interpretation of the chemical-dynamic evolution of a molecular cloud, it will be possible to test competing models of CR propagation and attenuation in the interstellar medium, as well as compare CR spectra in different Galactic regions.


title: Identification of hadronic tau lepton decays using a deep neural network

abstract: A new algorithm is presented to discriminate reconstructed hadronic decays of tau leptons ($\tau_\mathrm{h}$) that originate from genuine tau leptons in the CMS detector against $\tau_\mathrm{h}$ candidates that originate from quark or gluon jets, electrons, or muons. The algorithm inputs information from all reconstructed particles in the vicinity of a $\tau_\mathrm{h}$ candidate and employs a deep neural network with convolutional layers to efficiently process the inputs. This algorithm leads to a significantly improved performance compared with the previously used one. For example, the efficiency for a genuine $\tau_\mathrm{h}$ to pass the discriminator against jets increases by 10-30% for a given efficiency for quark and gluon jets. Furthermore, a more efficient $\tau_\mathrm{h}$ reconstruction is introduced that incorporates additional hadronic decay modes. The superior performance of the new algorithm to discriminate against jets, electrons, and muons and the improved $\tau_\mathrm{h}$ reconstruction method are validated with LHC proton-proton collision data at $\sqrt{s} =$ 13 TeV.


title: Federated Learning with Heterogeneous Architectures using Graph HyperNetworks

abstract: Standard Federated Learning (FL) techniques are limited to clients with identical network architectures. This restricts potential use-cases like cross-platform training or inter-organizational collaboration when both data privacy and architectural proprietary are required. We propose a new FL framework that accommodates heterogeneous client architecture by adopting a graph hypernetwork for parameter sharing. A property of the graph hyper network is that it can adapt to various computational graphs, thereby allowing meaningful parameter sharing across models. Unlike existing solutions, our framework does not limit the clients to share the same architecture type, makes no use of external data and does not require clients to disclose their model architecture. Compared with distillation-based and non-graph hypernetwork baselines, our method performs notably better on standard benchmarks. We additionally show encouraging generalization performance to unseen architectures.


title: Your Tweets Matter: How Social Media Sentiments Associate with COVID-19 Vaccination Rates in the US

abstract: Objective: The aims of the study were to examine the association between social media sentiments surrounding COVID-19 vaccination and the effects on vaccination rates in the United States (US), as well as other contributing factors to the COVID-19 vaccine hesitancy. Method: The dataset used in this study consists of vaccine-related English tweets collected in real-time from January 4 - May 11, 2021, posted within the US, as well as health literacy (HL), social vulnerability index (SVI), and vaccination rates at the state level. Results: The findings presented in this study demonstrate a significant correlation between the sentiments of the tweets and the vaccination rate in the US. The results also suggest a significant negative association between HL and SVI and that the state demographics correlate with both HL and SVI. Discussion: Social media activity provides insights into public opinion about vaccinations and helps determine the required public health interventions to increase the vaccination rate in the US. Conclusion: Health literacy, social vulnerability index and monitoring of social media sentiments need to be considered in public health interventions as part of vaccination campaigns.


title: Polytope: Practical Memory Access Control for C++ Applications

abstract: Designing and implementing secure software is inarguably more important than ever. However, despite years of research into privilege separating programs, it remains difficult to actually do so and such efforts can take years of labor-intensive engineering to reach fruition. At the same time, new intra-process isolation primitives make strong data isolation and privilege separation more attractive from a performance perspective. Yet, substituting intra-process security boundaries for time-tested process boundaries opens the door to subtle but devastating privilege leaks. In this work, we present Polytope, a language extension to C++ that aims to make efficient privilege separation accessible to a wider audience of developers. Polytope defines a policy language encoded as C++11 attributes that separate code and data into distinct program partitions. A modified Clang front-end embeds source-level policy as metadata nodes in the LLVM IR. An LLVM pass interprets embedded policy and instruments an IR with code to enforce the source-level policy using Intel MPK. A run-time support library manages partitions, protection keys, dynamic memory operations, and indirect call target privileges. An evaluation demonstrates that Polytope provides equivalent protection to prior systems with a low annotation burden and comparable performance overhead. Polytope also renders privilege leaks that contradict intended policy impossible to express.


title: Least squares estimators for discretely observed stochastic processes driven by small fractional noise

abstract: We study the problem of parameter estimation for discretely observed stochastic differential equations driven by small fractional noise. Under some conditions, we obtain strong consistency and rate of convergence of the least square estimator(LSE) when small dispersion coefficient converges to 0 and sample size converges to infty.


title: Motional decoherence in ultracold Rydberg atom quantum simulators of spin models

abstract: Ultracold Rydberg atom arrays are an emerging platform for quantum simulation and computing. However, decoherence in these systems remains incompletely understood. Recent experiments [Guardado-Sanchez et al. Phys. Rev. X 8, 021069 (2018)] observed strong decoherence in the quench and longitudinal-field-sweep dynamics of two-dimensional Ising models realized with Lithium-6 Rydberg atoms in optical lattices. This decoherence was conjectured to arise from spin-motion coupling. Here we show that spin-motion coupling indeed leads to decoherence in qualitative, and often quantitative, agreement with the experimental data, treating the difficult spin-motion coupled problem using the discrete truncated Wigner approximation method. We also show that this decoherence will be an important factor to account for in future experiments with Rydberg atoms in optical lattices and microtrap arrays, and discuss methods to mitigate the effect of motion, such as using heavier atoms or deeper traps.


title: On Good Infinite Families of Toric Codes or the Lack Thereof

abstract: A toric code, introduced by Hansen to extend the Reed-Solomon code as a $k$-dimensional subspace of $\mathbb{F}_q^n$, is determined by a toric variety or its associated integral convex polytope $P \subseteq [0,q-2]^n$, where $k=|P \cap \mathbb{Z}^n|$ (the number of integer lattice points of $P$). There are two relevant parameters that determine the quality of a code: the information rate, which measures how much information is contained in a single bit of each codeword; and the relative minimum distance, which measures how many errors can be corrected relative to how many bits each codeword has. Soprunov and Soprunova defined a good infinite family of codes to be a sequence of codes of unbounded polytope dimension such that neither the corresponding information rates nor relative minimum distances go to 0 in the limit. We examine different ways of constructing families of codes by considering polytope operations such as the join and direct sum. In doing so, we give conditions under which no good family can exist and strong evidence that there is no such good family of codes.


title: An Empirical Investigation of Model-to-Model Distribution Shifts in Trained Convolutional Filters

abstract: We present first empirical results from our ongoing investigation of distribution shifts in image data used for various computer vision tasks. Instead of analyzing the original training and test data, we propose to study shifts in the learned weights of trained models. In this work, we focus on the properties of the distributions of dominantly used 3x3 convolution filter kernels. We collected and publicly provide a data set with over half a billion filters from hundreds of trained CNNs, using a wide range of data sets, architectures, and vision tasks. Our analysis shows interesting distribution shifts (or the lack thereof) between trained filters along different axes of meta-parameters, like data type, task, architecture, or layer depth. We argue, that the observed properties are a valuable source for further investigation into a better understanding of the impact of shifts in the input data to the generalization abilities of CNN models and novel methods for more robust transfer-learning in this domain. Data available at: https://github.com/paulgavrikov/CNN-Filter-DB/.


title: Obstructing Lagrangian concordance for closures of 3-braids

abstract: We show that any knot which is smoothly the closure of a 3-braid cannot be Lagrangian concordant to and from the maximum Thurston-Bennequin Legendrian unknot except the unknot itself. Our obstruction comes from drawing the Weinstein handlebody diagrams of particular symplectic fillings of cyclic branched double covers of knots in $S^3$. We use the Legendrian contact homology differential graded algebra of the links in these diagrams to compute the symplectic homology of these fillings to derive a contradiction. As a corollary, we find an infinite family of contact manifolds which are rational homology spheres but do not embed in $\mathbb{R}^4$ as contact type hypersurfaces.


title: Historical Chinese efforts to determine longitude at sea

abstract: High-level Chinese cartographic developments predate European innovations by several centuries. Whereas European cartographic progress -- and in particular the search for a practical solution to the perennial "longitude problem" at sea -- was driven by persistent economic motivations, Chinese mapmaking efforts responded predominantly to administrative, cadastral and topographic needs. Nevertheless, contemporary Chinese scholars and navigators, to some extent aided by experienced Arab navigators and astronomers, developed independent means of longitude determination both on land and at sea, using a combination of astronomical observations and timekeeping devices that continued to operate adequately on pitching and rolling ships. Despite confusing and speculative accounts in the current literature and sometimes overt nationalistic rhetoric, Chinese technical capabilities applied to longitude determination at sea, while different in design from European advances owing to cultural and societal circumstances, were at least on a par with those of their European counterparts.


title: Android Malware Detection using Feature Ranking of Permissions

abstract: We investigate the use of Android permissions as the vehicle to allow for quick and effective differentiation between benign and malware apps. To this end, we extract all Android permissions, eliminating those that have zero impact, and apply two feature ranking algorithms namely Chi-Square test and Fisher's Exact test to rank and additionally filter them, resulting in a comparatively small set of relevant permissions. Then we use Decision Tree, Support Vector Machine, and Random Forest Classifier algorithms to detect malware apps. Our analysis indicates that this approach can result in better accuracy and F-score value than other reported approaches. In particular, when random forest is used as the classifier with the combination of Fisher's Exact test, we achieve 99.34\% in accuracy and 92.17\% in F-score with the false positive rate of 0.56\% for the dataset in question, with results improving to 99.82\% in accuracy and 95.28\% in F-score with the false positive rate as low as 0.05\% when only malware from three most popular malware families are considered.


title: Development of a Virtual EM Detector for the Advanced Particle Accelerator Modeling Code WarpX

abstract: In physics research particle accelerators are highly valued, and extraordinarily expensive, technical instruments. The high cost of particle accelerators results from the immense lengths required to accelerate particles to high energies, using radio frequency cavities. A current promising field of research, laser-driven particle acceleration has the potential to reduce the size, cost, and energy consumption of particle accelerators by orders of magnitude. To understand and control particle acceleration in plasmas using ultra-small spatial configurations, researchers have been developing computational models to simulate the acceleration environment. Within these models, computational scientists have introduced virtual diagnostics to serve as the digital parallel to experimental detectors. Using WarpX\cite{Vay:2021}, an advanced Particle-in-Cell code that simulates laser-driven particle acceleration, we have developed a virtual diagnostic to measure electromagnetic radiation. Such radiation can for instance be produced from scattered and transmitted laser beams. This \textit{FieldProbe} diagnostic measures individual field components for electric and magnetic fields at a point or at all points along a specified geometry (line or plane). This diagnostic is GPU-accelerated and parallelized using the Message Passing Interface (MPI) and can thus run on High Performance Computing Centers such as NERSC.


title: RoboMal: Malware Detection for Robot Network Systems

abstract: Robot systems are increasingly integrating into numerous avenues of modern life. From cleaning houses to providing guidance and emotional support, robots now work directly with humans. Due to their far-reaching applications and progressively complex architecture, they are being targeted by adversarial attacks such as sensor-actuator attacks, data spoofing, malware, and network intrusion. Therefore, security for robotic systems has become crucial. In this paper, we address the underserved area of malware detection in robotic software. Since robots work in close proximity to humans, often with direct interactions, malware could have life-threatening impacts. Hence, we propose the RoboMal framework of static malware detection on binary executables to detect malware before it gets a chance to execute. Additionally, we address the great paucity of data in this space by providing the RoboMal dataset comprising controller executables of a small-scale autonomous car. The performance of the framework is compared against widely used supervised learning models: GRU, CNN, and ANN. Notably, the LSTM-based RoboMal model outperforms the other models with an accuracy of 85% and precision of 87% in 10-fold cross-validation, hence proving the effectiveness of the proposed framework.


title: Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models

abstract: The advent of transformer-based models such as BERT has led to the rise of neural ranking models. These models have improved the effectiveness of retrieval systems well beyond that of lexical term matching models such as BM25. While monolingual retrieval tasks have benefited from large-scale training collections such as MS MARCO and advances in neural architectures, cross-language retrieval tasks have fallen behind these advancements. This paper introduces ColBERT-X, a generalization of the ColBERT multi-representation dense retrieval model that uses the XLM-RoBERTa (XLM-R) encoder to support cross-language information retrieval (CLIR). ColBERT-X can be trained in two ways. In zero-shot training, the system is trained on the English MS MARCO collection, relying on the XLM-R encoder for cross-language mappings. In translate-train, the system is trained on the MS MARCO English queries coupled with machine translations of the associated MS MARCO passages. Results on ad hoc document ranking tasks in several languages demonstrate substantial and statistically significant improvements of these trained dense retrieval models over traditional lexical CLIR baselines.


title: Weighted Sum-Rate Maximization for Rate-Splitting Multiple Access Based Secure Communication

abstract: As investigations on physical layer security evolve from point-to-point systems to multi-user scenarios, multi-user interference (MUI) is introduced and becomes an unavoidable issue. Different from treating MUI totally as noise in conventional secure communications, in this paper, we propose a rate-splitting multiple access (RSMA)-based secure beamforming design, where user messages are split and encoded into common and private streams. Each user not only decodes the common stream and the intended private stream, but also tries to eavesdrop the private streams of other users. We formulate a weighted sum-rate (WSR) maximization problem subject to the secrecy rate requirements of all users. To tackle the non-convexity of the formulated problem, a successive convex approximation (SCA)-based approach is adopted to convert the original non-convex and intractable problem into a low-complexity suboptimal iterative algorithm. Numerical results demonstrate that the proposed secure beamforming scheme outperforms the conventional multi-user linear precoding (MULP) technique in terms of the WSR performance while ensuring user secrecy rate requirements.


title: Assembling a Cyber Range to Evaluate Artificial Intelligence / Machine Learning (AI/ML) Security Tools

abstract: In this case study, we describe the design and assembly of a cyber security testbed at Oak Ridge National Laboratory in Oak Ridge, TN, USA. The range is designed to provide agile reconfigurations to facilitate a wide variety of experiments for evaluations of cyber security tools -- particularly those involving AI/ML. In particular, the testbed provides realistic test environments while permitting control and programmatic observations/data collection during the experiments. We have designed in the ability to repeat the evaluations, so additional tools can be evaluated and compared at a later time. The system is one that can be scaled up or down for experiment sizes. At the time of the conference we will have completed two full-scale, national, government challenges on this range. These challenges are evaluating the performance and operating costs for AI/ML-based cyber security tools for application into large, government-sized networks. These evaluations will be described as examples providing motivation and context for various design decisions and adaptations we have made. The first challenge measured end-point security tools against 100K file samples (benignware and malware) chosen across a range of file types. The second is an evaluation of network intrusion detection systems efficacy in identifying multi-step adversarial campaigns -- involving reconnaissance, penetration and exploitations, lateral movement, etc. -- with varying levels of covertness in a high-volume business network. The scale of each of these challenges requires automation systems to repeat, or simultaneously mirror identical the experiments for each ML tool under test. Providing an array of easy-to-difficult malicious activity for sussing out the true abilities of the AI/ML tools has been a particularly interesting and challenging aspect of designing and executing these challenge events.


title: Post-Training Detection of Backdoor Attacks for Two-Class and Multi-Attack Scenarios

abstract: Backdoor attacks (BAs) are an emerging threat to deep neural network classifiers. A victim classifier will predict to an attacker-desired target class whenever a test sample is embedded with the same backdoor pattern (BP) that was used to poison the classifier's training set. Detecting whether a classifier is backdoor attacked is not easy in practice, especially when the defender is, e.g., a downstream user without access to the classifier's training set. This challenge is addressed here by a reverse-engineering defense (RED), which has been shown to yield state-of-the-art performance in several domains. However, existing REDs are not applicable when there are only {\it two classes} or when {\it multiple attacks} are present. These scenarios are first studied in the current paper, under the practical constraints that the defender neither has access to the classifier's training set nor to supervision from clean reference classifiers trained for the same domain. We propose a detection framework based on BP reverse-engineering and a novel {\it expected transferability} (ET) statistic. We show that our ET statistic is effective {\it using the same detection threshold}, irrespective of the classification domain, the attack configuration, and the BP reverse-engineering algorithm that is used. The excellent performance of our method is demonstrated on six benchmark datasets. Notably, our detection framework is also applicable to multi-class scenarios with multiple attacks. Code is available at https://github.com/zhenxianglance/2ClassBADetection.


title: GenGNN: A Generic FPGA Framework for Graph Neural Network Acceleration

abstract: Graph neural networks (GNNs) have recently exploded in popularity thanks to their broad applicability to ubiquitous graph-related problems such as quantum chemistry, drug discovery, and high energy physics. However, meeting demand for novel GNN models and fast inference simultaneously is challenging because of the gap between the difficulty in developing efficient FPGA accelerators and the rapid pace of creation of new GNN models. Prior art focuses on the acceleration of specific classes of GNNs but lacks the generality to work across existing models or to extend to new and emerging GNN models. In this work, we propose a generic GNN acceleration framework using High-Level Synthesis (HLS), named GenGNN, with two-fold goals. First, we aim to deliver ultra-fast GNN inference without any graph pre-processing for real-time requirements. Second, we aim to support a diverse set of GNN models with the extensibility to flexibly adapt to new models. The framework features an optimized message-passing structure applicable to all models, combined with a rich library of model-specific components. We verify our implementation on-board on the Xilinx Alveo U50 FPGA and observe a speed-up of up to 25x against CPU (6226R) baseline and 13x against GPU (A6000) baseline. Our HLS code will be open-source on GitHub upon acceptance.


title: Search for resonances decaying to three W bosons in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A search for resonances decaying into a W boson and a radion, where the radion decays into two W bosons, is presented. The data analyzed correspond to an integrated luminosity of 138 fb$^{-1}$ recorded in proton-proton collisions with the CMS detector at $\sqrt{s} =$ 13 TeV. One isolated charged lepton is required, together with missing transverse momentum and one or two massive large-radius jets, containing the decay products of either two or one W bosons, respectively. No excess over the background estimation is observed. The results are combined with those from a complementary channel with an all-hadronic final state, described in an accompanying paper. Limits are set on parameters of an extended warped extra-dimensional model. These searches are the first of their kind at the LHC.


title: DDPG-Driven Deep-Unfolding with Adaptive Depth for Channel Estimation with Sparse Bayesian Learning

abstract: Deep-unfolding neural networks (NNs) have received great attention since they achieve satisfactory performance with relatively low complexity. Typically, these deep-unfolding NNs are restricted to a fixed-depth for all inputs. However, the optimal number of layers required for convergence changes with different inputs. In this paper, we first develop a framework of deep deterministic policy gradient (DDPG)-driven deep-unfolding with adaptive depth for different inputs, where the trainable parameters of deep-unfolding NN are learned by DDPG, rather than updated by the stochastic gradient descent algorithm directly. Specifically, the optimization variables, trainable parameters, and architecture of deep-unfolding NN are designed as the state, action, and state transition of DDPG, respectively. Then, this framework is employed to deal with the channel estimation problem in massive multiple-input multiple-output systems. Specifically, first of all we formulate the channel estimation problem with an off-grid basis and develop a sparse Bayesian learning (SBL)-based algorithm to solve it. Secondly, the SBL-based algorithm is unfolded into a layer-wise structure with a set of introduced trainable parameters. Thirdly, the proposed DDPG-driven deep-unfolding framework is employed to solve this channel estimation problem based on the unfolded structure of the SBL-based algorithm. To realize adaptive depth, we design the halting score to indicate when to stop, which is a function of the channel reconstruction error. Furthermore, the proposed framework is extended to realize the adaptive depth of the general deep neural networks (DNNs). Simulation results show that the proposed algorithm outperforms the conventional optimization algorithms and DNNs with fixed depth with much reduced number of layers.


title: Statistical properties of the gravitational force in a random homogeneous medium

abstract: We discuss the statistical distribution of the gravitational (Newtonian) force exerted on a test particle in a infinite random and homogeneous gas of non-correlated particles. The exact solution is known as the Holtsmark distribution at the limit of infinite system corresponding to the number of particle N within the volume and the volume going to infinity. The statistical behaviour of the gravitational force for scale comparable to the inter-distance particle can be analyzed through the combination of the n-th nearest neighbor particle contribution to the total gravitational force, which can be derived from the joint probability density of location for a set of N particles. We investigate two independent approaches to derive the joint probability density of location for a set of N neighbors using integral forms and order statistics to give a general expression of such probability distribution with generalised dimension of space. We found that the non-finite dispersion of the Holtsmark distribution is due to the single contribution of the first nearest neighbor in the total gravitational force.


title: Polyadic analogs of direct product

abstract: We propose a generalization of the external direct product concept to polyadic algebraic structures which introduces novel properties in two ways: the arity of the product can differ from that of the constituents, and the elements from different multipliers can be \textquotedblleft entangled\textquotedblright\ such that the product is no longer componentwise. The main property which we want to preserve is associativity, which is gained by using the associativity quiver technique provided earlier. For polyadic semigroups and groups we introduce two external products: 1) the iterated direct product which is componentwise, but can have arity different from the multipliers; 2) the hetero product (power) which is noncomponentwise and constructed by analogy with the heteromorphism concept introduced earlier. It is shown in which cases the product of polyadic groups can itself be a polyadic group. In the same way the external product of polyadic rings and fields is generalized. The most exotic case is the external product of polyadic fields, which can be a polyadic field (as opposed to the binary fields), when all multipliers are zeroless fields. Many illustrative concrete examples are presented.


title: Dynamique analytique sur $\mathbf{Z}$. I : Mesures d'\'equilibre sur une droite projective relative

abstract: Consider a Berkovich space over a good Banach ring and the relative projective line over it. (It is a space whose fibers are projective lines over different complete valued fields.) For each polarized endomorphism of this line, we prove that the family of equilibrium measures associated to the restrictions of the endomorphism to the fibers is continuous. The result holds, in particular, when the Banach ring is a complete valued field, a hybrid field, a complete discrete valuation ring, or the ring of integers of a number field.


title: Classic Graph Structural Features Outperform Factorization-Based Graph Embedding Methods on Community Labeling

abstract: Graph representation learning (also called graph embeddings) is a popular technique for incorporating network structure into machine learning models. Unsupervised graph embedding methods aim to capture graph structure by learning a low-dimensional vector representation (the embedding) for each node. Despite the widespread use of these embeddings for a variety of downstream transductive machine learning tasks, there is little principled analysis of the effectiveness of this approach for common tasks. In this work, we provide an empirical and theoretical analysis for the performance of a class of embeddings on the common task of pairwise community labeling. This is a binary variant of the classic community detection problem, which seeks to build a classifier to determine whether a pair of vertices participate in a community. In line with our goal of foundational understanding, we focus on a popular class of unsupervised embedding techniques that learn low rank factorizations of a vertex proximity matrix (this class includes methods like GraRep, DeepWalk, node2vec, NetMF). We perform detailed empirical analysis for community labeling over a variety of real and synthetic graphs with ground truth. In all cases we studied, the models trained from embedding features perform poorly on community labeling. In constrast, a simple logistic model with classic graph structural features handily outperforms the embedding models. For a more principled understanding, we provide a theoretical analysis for the (in)effectiveness of these embeddings in capturing the community structure. We formally prove that popular low-dimensional factorization methods either cannot produce community structure, or can only produce ``unstable" communities. These communities are inherently unstable under small perturbations.


title: Deep Attention-Based Supernovae Classification of Multi-Band Light-Curves

abstract: In astronomical surveys, such as the Zwicky Transient Facility, supernovae (SNe) are relatively uncommon objects compared to other classes of variable events. Along with this scarcity, the processing of multi-band light-curves is a challenging task due to the highly irregular cadence, long time gaps, missing-values, few observations, etc. These issues are particularly detrimental to the analysis of transient events: SN-like light-curves. We offer three main contributions: 1) Based on temporal modulation and attention mechanisms, we propose a Deep attention model (TimeModAttn) to classify multi-band light-curves of different SN types, avoiding photometric or hand-crafted feature computations, missing-value assumptions, and explicit imputation/interpolation methods. 2) We propose a model for the synthetic generation of SN multi-band light-curves based on the Supernova Parametric Model, allowing us to increase the number of samples and the diversity of cadence. Thus, the TimeModAttn model is first pre-trained using synthetic light-curves. Then, a fine-tuning process is performed. The TimeModAttn model outperformed other Deep Learning models, based on Recurrent Neural Networks, in two scenarios: late-classification and early-classification. Also, the TimeModAttn model outperformed a Balanced Random Forest (BRF) classifier (trained with real data), increasing the balanced-$F_1$score from $\approx.525$ to $\approx.596$. When training the BRF with synthetic data, this model achieved similar performance to the TimeModAttn model proposed while still maintaining extra advantages. 3) We conducted interpretability experiments. High attention scores were obtained for observations earlier than and close to the SN brightness peaks. This also correlated with an early highly variability of the learned temporal modulation.


title: Comment on Causal Networks and Freedom of Choice in Bell's Theorem

abstract: Bell inequalities may only be derived, if hidden variables do not depend on the experimental settings. The stochastic independence of hidden and setting variables is called: freedom of choice, free will, measurement independence or no conspiracy. By imbedding the Bell causal structure in a larger causal network the authors correctly prove, that one can explain and quantify possible violation of measurement independence without evoking the super-determinism. They assume the independence of the variables that causally determine the settings and investigate how they might become correlated with hidden variables. Using their extended causal networks they derive a contextual probabilistic model on which their further correct results are based. The authors seem to ignore that contextual probabilistic model may be derived directly using only probabilistic concepts and incorporating correctly setting dependent variables describing measuring instruments. In these contextual probabilistic models experimenters freedom of choice is not compromised and the results of Bell Tests including an apparent violation of Einsteinian nonsignaling may be explained in a locally causal way. Talking about freedom of choice is misleading and is rooted in incorrect understanding of Bayes Theorem. We explain why freedom of choice should be called noncontextuality and why its violation in Bell Tests confirms only the contextual character of quantum observables. Therefore, contextuality and not experimenters freedom of choice are important resources in quantum information.


title: Iterated Reasoning with Mutual Information in Cooperative and Byzantine Decentralized Teaming

abstract: Information sharing is key in building team cognition and enables coordination and cooperation. High-performing human teams also benefit from acting strategically with hierarchical levels of iterated communication and rationalizability, meaning a human agent can reason about the actions of their teammates in their decision-making. Yet, the majority of prior work in Multi-Agent Reinforcement Learning (MARL) does not support iterated rationalizability and only encourage inter-agent communication, resulting in a suboptimal equilibrium cooperation strategy. In this work, we show that reformulating an agent's policy to be conditional on the policies of its neighboring teammates inherently maximizes Mutual Information (MI) lower-bound when optimizing under Policy Gradient (PG). Building on the idea of decision-making under bounded rationality and cognitive hierarchy theory, we show that our modified PG approach not only maximizes local agent rewards but also implicitly reasons about MI between agents without the need for any explicit ad-hoc regularization terms. Our approach, InfoPG, outperforms baselines in learning emergent collaborative behaviors and sets the state-of-the-art in decentralized cooperative MARL tasks. Our experiments validate the utility of InfoPG by achieving higher sample efficiency and significantly larger cumulative reward in several complex cooperative multi-agent domains.


title: Stability estimate for the broken non-abelian X-ray transform in Minkowski space

abstract: We study the broken non-abelian X-ray transform in Minkowski space. This transform acts on the space of Hermitian connections on a causal diamond and is known to be injective up to an infinite-dimensional gauge. We show a stability estimate that takes into account the gauge, leading to a new proof of the transform's injectivity. Our proof leads us to consider a special type of connections that we call light-sink connections. We then show that we can consistently recover a light-sink connection from noisy measurement of its X-ray transform data through Bayesian inversion.


title: Critical point particle number fluctuations from molecular dynamics

abstract: We study fluctuations of particle number in the presence of critical point by utilizing molecular dynamics simulations of the classical Lennard-Jones fluid in a periodic box. The numerical solution of the $N$-body problem naturally incorporates all correlations, exact conservation laws, and finite size effects, allowing us to study the fluctuation signatures of the critical point in a dynamical setup. We find that large fluctuations associated with the critical point are observed when measurements are performed in coordinate subspace, but, in the absence of collective flow and expansion, are essentially washed out when momentum cuts are imposed instead. We put our findings in the context of event-by-event fluctuations in heavy-ion collisions.


title: Fluid infiltration of a heterogeneous medium: A stochastic model

abstract: Fluid infiltration of a permeable brick in contact with a pressurized reservoir of fluid is considered. A stochastic model, informed by Darcy's law and the incompressibility of the fluid, shows how the heterogeneity of the permeability field affects the time evolution of the fluid infiltration. In particular, the cause of anomalous (non-Darcian) advance of a plume is determined. The model is applied to bricks that are linear arrays of Sierpinski carpets. These calculated results are compared to experimental results available in the literature, to verify the model and method.


title: Engineering of Form Factor in Rotationally Symmetric Photonic Cavities for Faster Axion Searches

abstract: Form factor can be engineered in photonic cavities such that it dramatically increases the scan speed of axion haloscope detectors. Using higher-order modes of a photonic cavity, we can probe axions at larger mass ranges beyond the reach of current detectors that rely on conventional copper cavities. The main idea is to produce a higher-order mode with longitudinal field distribution that has relatively high amplitude away from both the cavity axis and the cavity walls such that it results in a relatively large form factor and maintains a high-quality factor. The detector scan speed significantly increases as it is proportional to the square of the form factor multiplied by the quality factor.


title: Kronoseismology VI: Reading the recent history of Saturn's gravity field in its rings

abstract: Saturn's C ring contains multiple structures that appear to be density waves driven by time-variable anomalies in the planet's gravitational field. Semi-empirical extensions of density wave theory enable the observed wave properties to be translated into information about how the pattern speeds and amplitudes of these gravitational anomalies have changed over time. Combining these theoretical tools with wavelet-based analyses of data obtained by the Visual and Infrared Mapping Spectrometer (VIMS) onboard the Cassini spacecraft reveals a suite of structures in Saturn's gravity field with azimuthal wavenumber 3, rotation rates between 804 degrees/day and 842 degrees/day and local gravitational potential amplitudes between 30 and 150 cm^2/s^2. Some of these anomalies are transient, appearing and disappearing over the course of a few Earth years, while others persist for decades. Most of these persistent patterns appear to have roughly constant pattern speeds, but there is at least one structure in the planet's gravitational field whose rotation rate steadily increased between 1970 and 2010. This gravitational field structure appears to induce two different asymmetries in the planet's gravity field, one with azimuthal wavenumber 3 that rotates at roughly 810 degrees/day and another with azimuthal wavenumber 1 rotating three times faster. The atmospheric processes responsible for generating the latter pattern may involve solar tides.


title: Tridiagonal real symmetric matrices with a connection to Pascal's triangle and the Fibonacci sequence

abstract: We explore a certain family $\{A_n\}_{n=1}^{\infty}$ of $n \times n$ tridiagonal real symmetric matrices. After deriving a three-term recurrence relation for the characteristic polynomials of this family, we find a closed form solution. The coefficients of these characteristic polynomials turn out to involve the diagonal entries of Pascal's triangle in a tantalizingly predictive manner. Lastly, we explore a relation between the eigenvalues of various members of the family. More specifically, we give a sufficient condition on the values $m,n \in \mathbb{N}$ for when $\texttt{spec}(A_m)$ is contained in $\texttt{spec}(A_n)$. We end the paper with a number of open questions, one of which intertwines our characteristic polynomials with the Fibonacci sequence in an intriguing manner involving ellipses.


title: Linking the rates of neutron star binaries and short gamma-ray bursts

abstract: Short gamma-ray bursts are believed to be produced by both binary neutron star (BNS) and neutron star-black hole (NSBH) mergers. We use current estimates for the BNS and NSBH merger rates to calculate the fraction of observable short gamma-ray bursts produced through each channel. This allows us to constrain merger rates of BNS to $\mathcal{R}_{\rm{BNS}}=384^{+431}_{-213}{\rm{Gpc}^{-3} \rm{yr}^{-1}}$ ($90\%$ credible interval), a $16\%$ decrease in the rate uncertainties from the second LIGO--Virgo Gravitational-Wave Transient Catalog, GWTC-2. Assuming a top-hat emission profile with a large Lorentz factor, we constrain the average opening angle of gamma-ray burst jets produced in BNS mergers to $\approx 15^\circ$. We also measure the fraction of BNS and NSBH mergers that produce an observable short gamma-ray burst to be $0.02^{+0.02}_{-0.01}$ and $0.01 \pm 0.01$, respectively and find that $\gtrsim 40\%$ of BNS mergers launch jets (90\% confidence). We forecast constraints for future gravitational-wave detections given different modelling assumptions, including the possibility that BNS and NSBH jets are different. With $24$ BNS and $55$ NSBH observations, expected within six months of the LIGO-Virgo-KAGRA network operating at design sensitivity, it will be possible to constrain the fraction of BNS and NSBH mergers that launch jets with $10\%$ precision. Within a year of observations, we can determine whether the jets launched in NSBH mergers have a different structure than those launched in BNS mergers and rule out whether $\gtrsim 80\%$ of binary neutron star mergers launch jets. We discuss the implications of future constraints on understanding the physics of short gamma-ray bursts and binary evolution.


title: Empirical likelihood method for complete independence test on high dimensional data

abstract: Given a random sample of size $n$ from a $p$ dimensional random vector, where both $n$ and $p$ are large, we are interested in testing whether the $p$ components of the random vector are mutually independent. This is the so-called complete independence test. In the multivariate normal case, it is equivalent to testing whether the correlation matrix is an identity matrix. In this paper, we propose a one-sided empirical likelihood method for the complete independence test for multivariate normal data based on squared sample correlation coefficients. The limiting distribution for our one-sided empirical likelihood test statistic is proved to be $Z^2I(Z>0)$ when both $n$ and $p$ tend to infinity, where $Z$ is a standard normal random variable. In order to improve the power of the empirical likelihood test statistic, we also introduce a rescaled empirical likelihood test statistic. We carry out an extensive simulation study to compare the performance of the rescaled empirical likelihood method and two other statistics which are related to the sum of squared sample correlation coefficients.


title: Some new results for subsequences of N\"orlund logarithmic means of Walsh-Fourier series

abstract: We prove that there exists a martingale $f\in H_p $ such that the subsequence $\{L_{2^n}f \}$ of N\"orlund logarithmic means with respect to the Walsh system are not bounded in the Lebesgue space $weak-L_p $ for $0<p<1 $. Moreover, we prove that for any $f\in L_p(G),$ $p\geq 1, $ $L_{2^n}f$ converge to $f$ at any Lebesgue point $x$. Some new related inequalities are derived.


title: TOFU: Towards Obfuscated Federated Updates by Encoding Weight Updates into Gradients from Proxy Data

abstract: Advances in Federated Learning and an abundance of user data have enabled rich collaborative learning between multiple clients, without sharing user data. This is done via a central server that aggregates learning in the form of weight updates. However, this comes at the cost of repeated expensive communication between the clients and the server, and concerns about compromised user privacy. The inversion of gradients into the data that generated them is termed data leakage. Encryption techniques can be used to counter this leakage, but at added expense. To address these challenges of communication efficiency and privacy, we propose TOFU, a novel algorithm which generates proxy data that encodes the weight updates for each client in its gradients. Instead of weight updates, this proxy data is now shared. Since input data is far lower in dimensional complexity than weights, this encoding allows us to send much lesser data per communication round. Additionally, the proxy data resembles noise, and even perfect reconstruction from data leakage attacks would invert the decoded gradients into unrecognizable noise, enhancing privacy. We show that TOFU enables learning with less than 1% and 7% accuracy drops on MNIST and on CIFAR-10 datasets, respectively. This drop can be recovered via a few rounds of expensive encrypted gradient exchange. This enables us to learn to near-full accuracy in a federated setup, while being 4x and 6.6x more communication efficient than the standard Federated Averaging algorithm on MNIST and CIFAR-10, respectively.


title: SciBERTSUM: Extractive Summarization for Scientific Documents

abstract: The summarization literature focuses on the summarization of news articles. The news articles in the CNN-DailyMail are relatively short documents with about 30 sentences per document on average. We introduce SciBERTSUM, our summarization framework designed for the summarization of long documents like scientific papers with more than 500 sentences. SciBERTSUM extends BERTSUM to long documents by 1) adding a section embedding layer to include section information in the sentence vector and 2) applying a sparse attention mechanism where each sentences will attend locally to nearby sentences and only a small number of sentences attend globally to all other sentences. We used slides generated by the authors of scientific papers as reference summaries since they contain the technical details from the paper. The results show the superiority of our model in terms of ROUGE scores.


title: Theory and phenomenology of the three-gluon vertex

abstract: The three-gluon vertex is a fundamental ingredient of the intricate QCD dynamics, being inextricably connected to key nonperturbative phenomena, such as the emergence of a mass scale in the gauge sector of the theory. In this presentation, we review the main theoretical properties of the three-gluon vertex in the Landau gauge, obtained from the fruitful synergy between functional methods and lattice simulations. We pay particular attention to the manifestation and origin of the infrared suppression of its main form factors and the associated zero crossing. In addition, we discuss certain characteristic phenomenological applications that require this special vertex as input.


title: Microfluidic lab-on-a-chip characterization of nano- to microparticles suspensions by light extinction spectrometry

abstract: The analysis of nano-and microparticle suspensions with micro systems affords improved space-time yields, selectivity, reaction residence times and conversions capabilities. These capabilities are of primary importance in various fields of research and industry. The few microfluidic lab-on-a-chip approaches that have been developed are essentially designed to analyse fluid phases or involve the use of benchtop particle sizing instruments. We report a novel microscale approach to characterize the particle size distribution and absolute concentration of colloidal suspensions. The method is based on a photonic lab-on-a-chip with three scale-specific detection channels to record simultaneous light extinction spectra. Experiments carried out on particle standards with sizes ranging from 30 nm to 0.5 $\mu$m and volume concentrations of 1 to 1000ppm, clearly demonstrate the value and potential of the proposed method.


title: What Makes the Recognition Problem Hard for Classes Related to Segment and String graphs?

abstract: We explore what could make recognition of particular intersection-defined classes hard. We focus mainly on unit grid intersection graphs (UGIGs), i.e., intersection graphs of unit-length axis-aligned segments and grid intersection graphs (GIGs, which are defined like UGIGs without unit-length restriction) and string graphs, intersection graphs of arc-connected curves in a plane. We show that the explored graph classes are NP-hard to recognized even when restricted on graphs with arbitrarily large girth, i.e., length of a shortest cycle. As well, we show that the recognition of these classes remains hard even for graphs with restricted degree (4, 5 and 8 depending on a particular class). For UGIGs we present structural results on the size of a possible representation, too.