title: The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

abstract: The capabilities of natural neural systems have inspired new generations of machine learning algorithms as well as neuromorphic very large-scale integrated (VLSI) circuits capable of fast, low-power information processing. However, it has been argued that most modern machine learning algorithms are not neurophysiologically plausible. In particular, the workhorse of modern deep learning, the backpropagation algorithm, has proven difficult to translate to neuromorphic hardware. In this study, we present a neuromorphic, spiking backpropagation algorithm based on synfire-gated dynamical information coordination and processing, implemented on Intel's Loihi neuromorphic research processor. We demonstrate a proof-of-principle three-layer circuit that learns to classify digits from the MNIST dataset. To our knowledge, this is the first work to show a Spiking Neural Network (SNN) implementation of the backpropagation algorithm that is fully on-chip, without a computer in the loop. It is competitive in accuracy with off-chip trained SNNs and achieves an energy-delay product suitable for edge computing. This implementation shows a path for using in-memory, massively parallel neuromorphic processors for low-power, low-latency implementation of modern deep learning applications.


title: Simple but accurate estimation of light-matter coupling strength and optical loss for a molecular emitter coupled with photonic modes

abstract: Light-matter coupling strength and optical loss are two key physical quantities in cavity quantum electrodynamics (cQED), and their interplay determines whether light-matter hybrid states can be formed or not in chemical systems. In this study, by using macroscopic quantum electrodynamics (mQED) combined with a pseudomode approach, we present a simple but accurate method which allows us to quickly estimate the light-matter coupling strength and optical loss without free parameters. Moreover, for a molecular emitter coupled with photonic modes (including cavity modes and plasmon polartion modes), we analytically and numerically prove that the dynamics derived from the mQED-based wavefunction approach is mathematically equivalent to the dynamics governed by the cQED-based Lindblad master equation when the Purcell factor behaves like Lorentzians.


title: Category Theory in Machine Learning

abstract: Over the past two decades machine learning has permeated almost every realm of technology. At the same time, many researchers have begun using category theory as a unifying language, facilitating communication between different scientific disciplines. It is therefore unsurprising that there is a burgeoning interest in applying category theory to machine learning. We aim to document the motivations, goals and common themes across these applications. We touch on gradient-based learning, probability, and equivariant learning.


title: Understanding the Interplay between Privacy and Robustness in Federated Learning

abstract: Federated Learning (FL) is emerging as a promising paradigm of privacy-preserving machine learning, which trains an algorithm across multiple clients without exchanging their data samples. Recent works highlighted several privacy and robustness weaknesses in FL and addressed these concerns using local differential privacy (LDP) and some well-studied methods used in conventional ML, separately. However, it is still not clear how LDP affects adversarial robustness in FL. To fill this gap, this work attempts to develop a comprehensive understanding of the effects of LDP on adversarial robustness in FL. Clarifying the interplay is significant since this is the first step towards a principled design of private and robust FL systems. We certify that local differential privacy has both positive and negative effects on adversarial robustness using theoretical analysis and empirical verification.


title: An Extended Multi-Model Regression Approach for Compressive Strength Prediction and Optimization of a Concrete Mixture

abstract: Due to the significant delay and cost associated with experimental tests, a model based evaluation of concrete compressive strength is of high value, both for the purpose of strength prediction as well as the mixture optimization. In this regard, several recent studies have employed state-of-the-art regression models in order to achieve a good prediction model, employing available experimental data sets. Nevertheless, while each of the employed models can better adapt to a specific nature of the input data, the accuracy of each individual model is limited due to the sensitivity to the choice of hyperparameters and the learning strategy. In the present work, we take a further step towards improving the accuracy of the prediction model via the weighted combination of multiple regression methods. Moreover, a (GA)-based multi-objective mixture optimization is proposed, building on the obtained multi-regression model. In particular, we present a data aided framework where the regression methods based on artificial neural network, random forest regression, and polynomial regression are jointly implemented to predict the compressive strength of concrete. The outcome of the individual regression models are then combined via a linear weighting strategy and optimized over the training data set as a quadratic convex optimization problem. It is worth mentioning that due to the convexity of the formulated problem, the globally optimum weighting strategy is obtained via standard numerical solvers. Employing the proposed GA-based optimization, a Pareto front of the cost-CS trade-of has been obtained employing the available data set. Moreover, the resulting accuracy of the proposed multi-model prediction method is shown to outperform the available single-model regression methods in the literature by a valuable margin, via numerical simulations.


abstract: Lifelong Learning (LL) refers to the ability to continually learn and solve new problems with incremental available information over time while retaining previous knowledge. Much attention has been given lately to Supervised Lifelong Learning (SLL) with a stream of labelled data. In contrast, we focus on resolving challenges in Unsupervised Lifelong Learning (ULL) with streaming unlabelled data when the data distribution and the unknown class labels evolve over time. Bayesian framework is natural to incorporate past knowledge and sequentially update the belief with new data. We develop a fully Bayesian inference framework for ULL with a novel end-to-end Deep Bayesian Unsupervised Lifelong Learning (DBULL) algorithm, which can progressively discover new clusters without forgetting the past with unlabelled data while learning latent representations. To efficiently maintain past knowledge, we develop a novel knowledge preservation mechanism via sufficient statistics of the latent representation for raw data. To detect the potential new clusters on the fly, we develop an automatic cluster discovery and redundancy removal strategy in our inference inspired by Nonparametric Bayesian statistics techniques. We demonstrate the effectiveness of our approach using image and text corpora benchmark datasets in both LL and batch settings.


title: Protein-Ligand Docking Surrogate Models: A SARS-CoV-2 Benchmark for Deep Learning Accelerated Virtual Screening

abstract: We propose a benchmark to study surrogate model accuracy for protein-ligand docking. We share a dataset consisting of 200 million 3D complex structures and 2D structure scores across a consistent set of 13 million "in-stock" molecules over 15 receptors, or binding sites, across the SARS-CoV-2 proteome. Our work shows surrogate docking models have six orders of magnitude more throughput than standard docking protocols on the same supercomputer node types. We demonstrate the power of high-speed surrogate models by running each target against 1 billion molecules in under a day (50k predictions per GPU seconds). We showcase a workflow for docking utilizing surrogate ML models as a pre-filter. Our workflow is ten times faster at screening a library of compounds than the standard technique, with an error rate less than 0.01\% of detecting the underlying best scoring 0.1\% of compounds. Our analysis of the speedup explains that to screen more molecules under a docking paradigm, another order of magnitude speedup must come from model accuracy rather than computing speed (which, if increased, will not anymore alter our throughput to screen molecules). We believe this is strong evidence for the community to begin focusing on improving the accuracy of surrogate models to improve the ability to screen massive compound libraries 100x or even 1000x faster than current techniques.


title: Hash Adaptive Bloom Filter

abstract: Bloom filter is a compact memory-efficient probabilistic data structure supporting membership testing, i.e., to check whether an element is in a given set. However, as Bloom filter maps each element with uniformly random hash functions, few flexibilities are provided even if the information of negative keys (elements are not in the set) are available. The problem gets worse when the misidentification of negative keys brings different costs. To address the above problems, we propose a new Hash Adaptive Bloom Filter (HABF) that supports the customization of hash functions for keys. The key idea of HABF is to customize the hash functions for positive keys (elements are in the set) to avoid negative keys with high cost, and pack customized hash functions into a lightweight data structure named HashExpressor. Then, given an element at query time, HABF follows a two-round pattern to check whether the element is in the set. Further, we theoretically analyze the performance of HABF and bound the expected false positive rate. We conduct extensive experiments on representative datasets, and the results show that HABF outperforms the standard Bloom filter and its cutting-edge variants on the whole in terms of accuracy, construction time, query time, and memory space consumption (Note that source codes are available in [1]).


title: Uniform in time $L^\infty$-estimates for an attraction-repulsion chemotaxis system with double saturation

abstract: In this paper we focus on an attraction-repulsion chemotaxis model with consumed signals, formulated in bounded and smooth domains $\Omega$ of $\R^n$, with $n\geq 2$. We derive sufficient conditions on its data yielding global and bounded classical solutions to the related zero-flux Cauchy problem.


title: Contingency-Aware Influence Maximization: A Reinforcement Learning Approach

abstract: The influence maximization (IM) problem aims at finding a subset of seed nodes in a social network that maximize the spread of influence. In this study, we focus on a sub-class of IM problems, where whether the nodes are willing to be the seeds when being invited is uncertain, called contingency-aware IM. Such contingency aware IM is critical for applications for non-profit organizations in low resource communities (e.g., spreading awareness of disease prevention). Despite the initial success, a major practical obstacle in promoting the solutions to more communities is the tremendous runtime of the greedy algorithms and the lack of high performance computing (HPC) for the non-profits in the field -- whenever there is a new social network, the non-profits usually do not have the HPCs to recalculate the solutions. Motivated by this and inspired by the line of works that use reinforcement learning (RL) to address combinatorial optimization on graphs, we formalize the problem as a Markov Decision Process (MDP), and use RL to learn an IM policy over historically seen networks, and generalize to unseen networks with negligible runtime at test phase. To fully exploit the properties of our targeted problem, we propose two technical innovations that improve the existing methods, including state-abstraction and theoretically grounded reward shaping. Empirical results show that our method achieves influence as high as the state-of-the-art methods for contingency-aware IM, while having negligible runtime at test phase.


title: Exogenous and Endogenous Price Jumps Belong to Different Dynamical Classes

abstract: Synchronising a database of stock specific news with 5 years worth of order book data on 300 stocks, we show that abnormal price movements following news releases (exogenous) exhibit markedly different dynamical features from those arising spontaneously (endogenous). On average, large volatility fluctuations induced by exogenous events occur abruptly and are followed by a decaying power-law relaxation, while endogenous price jumps are characterized by progressively accelerating growth of volatility, also followed by a power-law relaxation, but slower than for exogenous jumps. Remarkably, our results are reminiscent of what is observed in different contexts, namely Amazon book sales and YouTube views. Finally, we show that fitting power-laws to {\it individual} volatility profiles allows one to classify large events into endogenous and exogenous dynamical classes, without relying on the news feed.


title: Correcting Exposure Bias for Link Recommendation

abstract: Link prediction methods are frequently applied in recommender systems, e.g., to suggest citations for academic papers or friends in social networks. However, exposure bias can arise when users are systematically underexposed to certain relevant items. For example, in citation networks, authors might be more likely to encounter papers from their own field and thus cite them preferentially. This bias can propagate through naively trained link predictors, leading to both biased evaluation and high generalization error (as assessed by true relevance). Moreover, this bias can be exacerbated by feedback loops. We propose estimators that leverage known exposure probabilities to mitigate this bias and consequent feedback loops. Next, we provide a loss function for learning the exposure probabilities from data. Finally, experiments on semi-synthetic data based on real-world citation networks, show that our methods reliably identify (truly) relevant citations. Additionally, our methods lead to greater diversity in the recommended papers' fields of study. The code is available at https://github.com/shantanu95/exposure-bias-link-rec.


title: Adjacency Energy of Hypergraphs

abstract: In this paper, we define and obtain several properties of the (adjacency) energy of a hypergraph. In particular, bounds for this energy are obtained as functions of structural and spectral parameters, such as Zagreb index and spectral radius. We also study how the energy of a hypergraph varies when a vertex/edge is removed or when an edge is divied. In addition, we solved the extremal problem energy for the class of hyperstars, and show that the energy of a hypergraph is never an odd number.


title: Invariant measures for a stochastic nonlinear and damped 2D Schr\"odinger equation

abstract: We consider a stochastic nonlinear defocusing Schr\"{o}dinger equation with zero-order linear damping, where the stochastic forcing term is given by a combination of a linear multiplicative noise in the Stratonovich form and a nonlinear noise in the It\^o form. We work at the same time on compact Riemannian manifolds without boundary and on relatively compact smooth domains with either the Dirichlet or the Neumann boundary conditions, always in dimension 2. We construct a martingale solution using a modified Faedo-Galerkin's method, following arXiv:1707.05610. Then by means of the Strichartz estimates deduced from arXiv:math/0609455 but modified for our stochastic setting we show the pathwise uniqueness of solutions. Finally, we prove the existence of an invariant measure by means of a version of the Krylov-Bogoliubov method, which involves the weak topology, as proposed by Maslowski and Seidler. This is the first result of this type for stochastic NLS on compact Riemannian manifolds without boundary and on relatively compact smooth domains even for an additive noise. Some remarks on the uniqueness in a particular case are provided as well.


title: Optimal detection of the feature matching map in presence of noise and outliers

abstract: We consider the problem of finding the matching map between two sets of $d$ dimensional vectors from noisy observations, where the second set contains outliers. The matching map is then an injection, which can be consistently estimated only if the vectors of the second set are well separated. The main result shows that, in the high-dimensional setting, a detection region of unknown injection can be characterized by the sets of vectors for which the inlier-inlier distance is of order at least $d^{1/4}$ and the inlier-outlier distance is of order at least $d^{1/2}$. These rates are achieved using the estimated matching minimizing the sum of logarithms of distances between matched pairs of points. We also prove lower bounds establishing optimality of these rates. Finally, we report results of numerical experiments on both synthetic and real world data that illustrate our theoretical results and provide further insight into the properties of the estimators studied in this work.


title: VeriFly: On-the-fly Assertion Checking via Incrementality

abstract: Assertion checking is an invaluable programmer's tool for finding many classes of errors or verifying their absence in dynamic languages such as Prolog. For Prolog programmers this means being able to have relevant properties such as modes, types, determinacy, non-failure, sharing, constraints, cost, etc., checked and errors flagged without having to actually run the program. Such global static analysis tools are arguably most useful the earlier they are used in the software development cycle, and fast response times are essential for interactive use. Triggering a full and precise semantic analysis of a software project every time a change is made can be prohibitively expensive. In our static analysis and verification framework this challenge is addressed through a combination of modular and incremental (context- and path-sensitive) analysis that is responsive to program edits, at different levels of granularity. We describe how the combination of this framework within an integrated development environment (IDE) takes advantage of such incrementality to achieve a high level of reactivity when reflecting analysis and verification results back as colorings and tooltips directly on the program text -- the tool's VeriFly mode. The concrete implementation that we describe is Emacs-based and reuses in part off-the-shelf "on-the-fly" syntax checking facilities (flycheck). We believe that similar extensions are also reproducible with low effort in other mature development environments. Our initial experience with the tool shows quite promising results, with low latency times that provide early, continuous, and precise assertion checking and other semantic feedback to programmers during the development process. The tool supports Prolog natively, as well as other languages by semantic transformation into Horn clauses. This paper is under consideration for acceptance in TPLP.


title: Towards Tight Bounds on the Sample Complexity of Average-reward MDPs

abstract: We prove new upper and lower bounds for sample complexity of finding an $\epsilon$-optimal policy of an infinite-horizon average-reward Markov decision process (MDP) given access to a generative model. When the mixing time of the probability transition matrix of all policies is at most $t_\mathrm{mix}$, we provide an algorithm that solves the problem using $\widetilde{O}(t_\mathrm{mix} \epsilon^{-3})$ (oblivious) samples per state-action pair. Further, we provide a lower bound showing that a linear dependence on $t_\mathrm{mix}$ is necessary in the worst case for any algorithm which computes oblivious samples. We obtain our results by establishing connections between infinite-horizon average-reward MDPs and discounted MDPs of possible further utility.


title: Target Model Agnostic Adversarial Attacks with Query Budgets on Language Understanding Models

abstract: Despite significant improvements in natural language understanding models with the advent of models like BERT and XLNet, these neural-network based classifiers are vulnerable to blackbox adversarial attacks, where the attacker is only allowed to query the target model outputs. We add two more realistic restrictions on the attack methods, namely limiting the number of queries allowed (query budget) and crafting attacks that easily transfer across different pre-trained models (transferability), which render previous attack models impractical and ineffective. Here, we propose a target model agnostic adversarial attack method with a high degree of attack transferability across the attacked models. Our empirical studies show that in comparison to baseline methods, our method generates highly transferable adversarial sentences under the restriction of limited query budgets.


title: Ultrasound Classification of Breast Masses Using a Comprehensive Nakagami Imaging and Machine Learning Framework

abstract: In this study we investigate the potential of parametric images formed from ultrasound B-mode scans using the Nakagami distribution for non-invasive classification of breast lesions. Through a sliding window technique, we generated seven types of parametric images from each patient scan in our dataset using basic and as well as derived parameters of the Nakagami distribution. To determine the most suitable window size for image generation, we conducted an empirical analysis using three windows, and selected the best one for our study. From the parametric images formed for each patient, we extracted a total of 72 features. Feature selection was performed to find the optimum subset of features for the best classification performance. Incorporating the selected subset of features with the Support Vector Machine (SVM) classifier, and by tuning the decision threshold, we obtained a maximum classification accuracy of 93.08%, an Area under the ROC Curve (AUC) of 0.9712, a False Negative Rate of 0%, and a very low False Positive Rate of 8.65%. Our results indicate that the high accuracy of such a procedure may assist in the diagnostic process associated with detection of breast cancer, as well as help to reduce false positive diagnosis.


title: Weakly-supervised High-resolution Segmentation of Mammography Images for Breast Cancer Diagnosis

abstract: In the last few years, deep learning classifiers have shown promising results in image-based medical diagnosis. However, interpreting the outputs of these models remains a challenge. In cancer diagnosis, interpretability can be achieved by localizing the region of the input image responsible for the output, i.e. the location of a lesion. Alternatively, segmentation or detection models can be trained with pixel-wise annotations indicating the locations of malignant lesions. Unfortunately, acquiring such labels is labor-intensive and requires medical expertise. To overcome this difficulty, weakly-supervised localization can be utilized. These methods allow neural network classifiers to output saliency maps highlighting the regions of the input most relevant to the classification task (e.g. malignant lesions in mammograms) using only image-level labels (e.g. whether the patient has cancer or not) during training. When applied to high-resolution images, existing methods produce low-resolution saliency maps. This is problematic in applications in which suspicious lesions are small in relation to the image size. In this work, we introduce a novel neural network architecture to perform weakly-supervised segmentation of high-resolution images. The proposed model selects regions of interest via coarse-level localization, and then performs fine-grained segmentation of those regions. We apply this model to breast cancer diagnosis with screening mammography, and validate it on a large clinically-realistic dataset. Measured by Dice similarity score, our approach outperforms existing methods by a large margin in terms of localization performance of benign and malignant lesions, relatively improving the performance by 39.6% and 20.0%, respectively. Code and the weights of some of the models are available at https://github.com/nyukat/GLAM


title: Blow-up and lifespan estimates for solutions to the weakly coupled system of nonlinear damped wave equations outside a ball

abstract: In this paper, we consider the initial-boundary value problems with several fundamental boundary conditions (the Dirichlet/Neumann/Robin boundary condition) for the multi-component system of semi-linear classical damped wave equations outside a ball. By applying a test function approach with a judicious choice of test functions, which approximates the harmonic functions being subject to these boundary conditions on $\partial \Omega$, simultaneously we have succeeded in proving the blow-up result in a finite time as well as in catching the sharp upper bound of lifespan estimates for small solutions in two and higher spatial dimensions. Moreover, such kind of these results will be discussed in one-dimensional case at the end of this work.


title: Comparative analysis of quality of service scheduling classes in mobile ad-hoc networks

abstract: Quality of Service (QoS) is now regarded as a requirement for all networks in managing resources like bandwidth and avoidance of network impairments like packet loss, jitter, and delay. Media transfer or streaming would be virtually impossible if QoS parameters were not used even if the streaming protocols were perfectly designed. QoS Scheduling classes help in network traffic optimization and the priority management of packets. This paper presents an analysis of QoS scheduling classes using video traffic in a MANET. The main objective was to identify a scheduling class that provides better QoS for video streaming. A simulation was conducted using NetSim and results were analyzed according to throughput, jitter, and delay. The overall results showed that extended real-time Polling Service (ertPS) outperformed the other classes. ertPS has hybrid features of both real-time Polling Service (rtPS) and Unsolicited Grant Service(UGS) hence the enhanced performance. It is recommended that ertPS scheduling class should be used in MANET where QoS consideration is utmost particularly in multimedia streaming applications.


title: Wide Mean-Field Variational Bayesian Neural Networks Ignore the Data

abstract: Variational inference enables approximate posterior inference of the highly over-parameterized neural networks that are popular in modern machine learning. Unfortunately, such posteriors are known to exhibit various pathological behaviors. We prove that as the number of hidden units in a single-layer Bayesian neural network tends to infinity, the function-space posterior mean under mean-field variational inference actually converges to zero, completely ignoring the data. This is in contrast to the true posterior, which converges to a Gaussian process. Our work provides insight into the over-regularization of the KL divergence in variational inference.


title: Convex Sparse Blind Deconvolution

abstract: In the blind deconvolution problem, we observe the convolution of an unknown filter and unknown signal and attempt to reconstruct the filter and signal. The problem seems impossible in general, since there are seemingly many more unknowns than knowns . Nevertheless, this problem arises in many application fields; and empirically, some of these fields have had success using heuristic methods -- even economically very important ones, in wireless communications and oil exploration. Today's fashionable heuristic formulations pose non-convex optimization problems which are then attacked heuristically as well. The fact that blind deconvolution can be solved under some repeatable and naturally-occurring circumstances poses a theoretical puzzle. To bridge the gulf between reported successes and theory's limited understanding, we exhibit a convex optimization problem that -- assuming signal sparsity -- can convert a crude approximation to the true filter into a high-accuracy recovery of the true filter. Our proposed formulation is based on L1 minimization of inverse filter outputs. We give sharp guarantees on performance of the minimizer assuming sparsity of signal, showing that our proposal precisely recovers the true inverse filter, up to shift and rescaling. There is a sparsity/initial accuracy tradeoff: the less accurate the initial approximation, the greater we rely on sparsity to enable exact recovery. To our knowledge this is the first reported tradeoff of this kind. We consider it surprising that this tradeoff is independent of dimension. We also develop finite-$N$ guarantees, for highly accurate reconstruction under $N\geq O(k \log(k) )$ with high probability. We further show stable approximation when the true inverse filter is infinitely long and extend our guarantees to the case where the observations are contaminated by stochastic or adversarial noise.

categories: cs.IT cs.AI cs.SY eess.SY math.IT math.ST stat.OT stat.TH


title: Inferring the mixing properties of an ergodic process

abstract: We propose strongly consistent estimators of the $\ell_1$ norm of the sequence of $\alpha$-mixing (respectively $\beta$-mixing) coefficients of a stationary ergodic process. We further provide strongly consistent estimators of individual $\alpha$-mixing (respectively $\beta$-mixing) coefficients for a subclass of stationary $\alpha$-mixing (respectively $\beta$-mixing) processes with summable sequences of mixing coefficients. The estimators are in turn used to develop strongly consistent goodness-of-fit hypothesis tests. In particular, we develop hypothesis tests to determine whether, under the same summability assumption, the $\alpha$-mixing (respectively $\beta$-mixing) coefficients of a process are upper bounded by a given rate function. Moreover, given a sample generated by a (not necessarily mixing) stationary ergodic process, we provide a consistent test to discern the null hypothesis that the $\ell_1$ norm of the sequence $\boldsymbol{\alpha}$ of $\alpha$-mixing coefficients of the process is bounded by a given threshold $\gamma \in [0,\infty)$ from the alternative hypothesis that $\left\lVert \boldsymbol{\alpha} \right\rVert> \gamma$. An analogous goodness-of-fit test is proposed for the $\ell_1$ norm of the sequence of $\beta$-mixing coefficients of a stationary ergodic process. Moreover, the procedure gives rise to an asymptotically consistent test for independence.


title: GenSF: Simultaneous Adaptation of Generative Pre-trained Models and Slot Filling

abstract: In transfer learning, it is imperative to achieve strong alignment between a pre-trained model and a downstream task. Prior work has done this by proposing task-specific pre-training objectives, which sacrifices the inherent scalability of the transfer learning paradigm. We instead achieve strong alignment by simultaneously modifying both the pre-trained model and the formulation of the downstream task, which is more efficient and preserves the scalability of transfer learning. We present GenSF (Generative Slot Filling), which leverages a generative pre-trained open-domain dialog model for slot filling. GenSF (1) adapts the pre-trained model by incorporating inductive biases about the task and (2) adapts the downstream task by reformulating slot filling to better leverage the pre-trained model's capabilities. GenSF achieves state-of-the-art results on two slot filling datasets with strong gains in few-shot and zero-shot settings. We achieve a 9 F1 score improvement in zero-shot slot filling. This highlights the value of strong alignment between the pre-trained model and the downstream task.


title: Schema-Guided Paradigm for Zero-Shot Dialog

abstract: Developing mechanisms that flexibly adapt dialog systems to unseen tasks and domains is a major challenge in dialog research. Neural models implicitly memorize task-specific dialog policies from the training data. We posit that this implicit memorization has precluded zero-shot transfer learning. To this end, we leverage the schema-guided paradigm, wherein the task-specific dialog policy is explicitly provided to the model. We introduce the Schema Attention Model (SAM) and improved schema representations for the STAR corpus. SAM obtains significant improvement in zero-shot settings, with a +22 F1 score improvement over prior work. These results validate the feasibility of zero-shot generalizability in dialog. Ablation experiments are also presented to demonstrate the efficacy of SAM.


title: FairCanary: Rapid Continuous Explainable Fairness

abstract: Systems that offer continuous model monitoring have emerged in response to (1) well-documented failures of deployed Machine Learning (ML) and Artificial Intelligence (AI) models and (2) new regulatory requirements impacting these models. Existing monitoring systems continuously track the performance of deployed ML models and compute feature importance (a.k.a. explanations) for each prediction to help developers identify the root causes of emergent model performance problems. We present Quantile Demographic Drift (QDD), a novel model bias quantification metric that uses quantile binning to measure differences in the overall prediction distributions over subgroups. QDD is ideal for continuous monitoring scenarios, does not suffer from the statistical limitations of conventional threshold-based bias metrics, and does not require outcome labels (which may not be available at runtime). We incorporate QDD into a continuous model monitoring system, called FairCanary, that reuses existing explanations computed for each individual prediction to quickly compute explanations for the QDD bias metrics. This optimization makes FairCanary an order of magnitude faster than previous work that has tried to generate feature-level bias explanations.


title: The architecture of multi-planet systems as a tracer of their formation mechanisms

abstract: Exoplanets observed by the {\it Kepler} telescope exhibit a bi-modal, radius distribution, which is known as the radius gap. We explore an origin of the radius gap, focusing on multi-planet systems. Our simple theoretical argument predicts that type I planetary migration produces different configurations of protoplanets with different masses and such different configurations can result in two distinguishable populations of small-sized multi-planet systems. We then perform an observational analysis to verify this prediction. In the analysis, multiple Kolmogorov-Smirnov tests are applied to the observed systems, using the statistical measures that are devised to systematically characterize the properties of multi-planet systems. We find with 99.5\% confidence that the observed, small-sized multi-planet systems are divided into two distinct populations. The distinction likely originates from different spatial distributions of protoplanets, which are determined by type I migration and subsequently trigger giant impact. We also show that these distinct populations are separated around the radius gap when the gas surface density of protoplanetary disks is $\sim 10^2$ g cm$^{-2}$ in the vicinity of the host stars. This work therefore emphasizes the importance of planetary migration and the inner disk properties.


title: Multi-Resource List Scheduling of Moldable Parallel Jobs under Precedence Constraints

abstract: The scheduling literature has traditionally focused on a single type of resource (e.g., computing nodes). However, scientific applications in modern High-Performance Computing (HPC) systems process large amounts of data, hence have diverse requirements on different types of resources (e.g., cores, cache, memory, I/O). All of these resources could potentially be exploited by the runtime scheduler to improve the application performance. In this paper, we study multi-resource scheduling to minimize the makespan of computational workflows comprised of parallel jobs subject to precedence constraints. The jobs are assumed to be moldable, allowing the scheduler to flexibly select a variable set of resources before execution. We propose a multi-resource, list-based scheduling algorithm, and prove that, on a system with $d$ types of schedulable resources, our algorithm achieves an approximation ratio of $1.619d+2.545\sqrt{d}+1$ for any $d$, and a ratio of $d+O(\sqrt[3]{d^2})$ for large $d$. We also present improved results for independent jobs and for jobs with special precedence constraints (e.g., series-parallel graphs and trees). Finally, we prove a lower bound of $d$ on the approximation ratio of any list scheduling scheme with local priority considerations. To the best of our knowledge, these are the first approximation results for moldable workflows with multiple resource requirements.


title: Two interacting galaxies hiding as one, revealed by MaNGA

abstract: Given their prominent role in galaxy evolution, it is of paramount importance to unveil galaxy interactions and merger events and to investigate the underlying mechanisms. The use of high-resolution data makes it easier to identify merging systems, but it can still be challenging when the morphology does not show any clear galaxy-pair or gas bridge. Characterising the origin of puzzling kinematic features can help to reveal complicated systems. Here, we present a merging galaxy, MaNGA 1-114955, in which we highlighted the superimposition of two distinct rotating discs along the line of sight. These counter-rotating objects both lie on the star-forming main sequence but display perturbed stellar velocity dispersions. The main galaxy presents off-centred star formation as well as off-centred high-metallicity regions supporting the scenario of recent starbursts, while the secondary galaxy hosts a central starburst which coincides with an extended radio emission, in excess with respect to star formation expectations. Stellar mass as well as dynamical mass estimates agree towards a mass ratio within the visible radius of 9:1 for these interacting galaxies. We suggest we are observing a pre-coalescence stage of a merger. The primary galaxy has accreted gas through a past first pericentre passage about 1 Gyr ago, and more recently from the secondary gas-rich galaxy, which exhibits an underlying active galactic nucleus (AGN). Our results demonstrate how a galaxy can hide another one and the relevance of a multi-component approach to study ambiguous systems. We anticipate our method to be efficient at unveiling the mechanisms taking place in a sub-sample of galaxies observed by the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey, all exhibiting kinematic features of puzzling origin in their gas emission lines.


title: Coniveau filtrations and Milnor operations Qn

abstract: Let BG be the classifying space of an algebraic group over the complex field C. We compute a new stable rational invariant defined by the difference of two coniveau filtrations (by Benoist and Ottem) of a (projective) approximation for BG.


title: Atlas Based Representation and Metric Learning on Manifolds

abstract: We explore the use of a topological manifold, represented as a collection of charts, as the target space of neural network based representation learning tasks. This is achieved by a simple adjustment to the output of an encoder's network architecture plus the addition of a maximal mean discrepancy (MMD) based loss function for regularization. Most algorithms in representation and metric learning are easily adaptable to our framework and we demonstrate its effectiveness by adjusting SimCLR (for representation learning) and standard triplet loss training (for metric learning) to have manifold encoding spaces. Our experiments show that we obtain a substantial performance boost over the baseline for low dimensional encodings. In the case of triplet training, we also find, independent of the manifold setup, that the MMD loss alone (i.e. keeping a flat, euclidean target space but using an MMD loss to regularize it) increases performance over the baseline in the typical, high-dimensional Euclidean target spaces. Code for reproducing experiments is provided at https://github.com/ekorman/neurve .


title: Stationary multi-kinks in the discrete sine-Gordon equation

abstract: We consider the existence and spectral stability of static multi-kink structures in the discrete sine-Gordon equation, as a representative example of the family of discrete Klein-Gordon models. The multi-kinks are constructed using Lin's method from an alternating sequence of well-separated kink and antikink solutions. We then locate the point spectrum associated with these multi-kink solutions by reducing the spectral problem to a matrix equation. For an $m$-structure multi-kink, there will be $m$ eigenvalues in the point spectrum near each eigenvalue of the primary kink, and, as long as the spectrum of the primary kink is imaginary, the spectrum of the multi-kink will be as well. We obtain analytic expressions for the eigenvalues of a multi-kink in terms of the eigenvalues and corresponding eigenfunctions of the primary kink, and these are in very good agreement with numerical results. We also perform numerical time-stepping experiments on perturbations of multi-kinks, and the outcomes of these simulations are interpreted using the spectral results.


title: Stable trace ideals and applications

abstract: We study stable trace ideals in one dimensional local Cohen-Macaulay rings and give numerous applications.


title: Multi-RIS Discrete-Phase Encoding for Interpath-Interference-Free Channel Estimation

abstract: Reconfigurable intelligent surfaces (RISs) are one of the foremost technological enablers of future wireless systems. They improve communication and localization by providing a strong non-line-of-sight path to the receiver. In this paper, we propose a pilot transmission method to enable the receiver to separate signals arriving from different RISs and from the uncontrolled multipath. This facilitates channel estimation and localization, as the channel or its geometric parameters can be estimated for each path separately. Our method is based on designing temporal phase profiles that are orthogonal across RISs without affecting the RIS beamforming capabilities. We take into consideration the limited resolution of the RIS phase shifters and show that in the presence of this practical limitation, orthogonal phase profiles can be designed based on Butson-type Hadamard matrices. For a localization scenario, we show that with our proposed method the estimator can attain the theoretical lower bound even with one-bit RIS phase resolution.


title: Enhanced Hyperspectral Image Super-Resolution via RGB Fusion and TV-TV Minimization

abstract: Hyperspectral (HS) images contain detailed spectral information that has proven crucial in applications like remote sensing, surveillance, and astronomy. However, because of hardware limitations of HS cameras, the captured images have low spatial resolution. To improve them, the low-resolution hyperspectral images are fused with conventional high-resolution RGB images via a technique known as fusion based HS image super-resolution. Currently, the best performance in this task is achieved by deep learning (DL) methods. Such methods, however, cannot guarantee that the input measurements are satisfied in the recovered image, since the learned parameters by the network are applied to every test image. Conversely, model-based algorithms can typically guarantee such measurement consistency. Inspired by these observations, we propose a framework that integrates learning and model based methods. Experimental results show that our method produces images of superior spatial and spectral resolution compared to the current leading methods, whether model- or DL-based.


title: Uniqueness theorems for almost periodic objects

abstract: Uniqueness theorems are considered for various types of almost periodic objects: functions, measures, distributions, multisets, holomorphic and meromorphic functions.


title: HistoTransfer: Understanding Transfer Learning for Histopathology

abstract: Advancement in digital pathology and artificial intelligence has enabled deep learning-based computer vision techniques for automated disease diagnosis and prognosis. However, WSIs present unique computational and algorithmic challenges. WSIs are gigapixel-sized, making them infeasible to be used directly for training deep neural networks. Hence, for modeling, a two-stage approach is adopted: Patch representations are extracted first, followed by the aggregation for WSI prediction. These approaches require detailed pixel-level annotations for training the patch encoder. However, obtaining these annotations is time-consuming and tedious for medical experts. Transfer learning is used to address this gap and deep learning architectures pre-trained on ImageNet are used for generating patch-level representation. Even though ImageNet differs significantly from histopathology data, pre-trained networks have been shown to perform impressively on histopathology data. Also, progress in self-supervised and multi-task learning coupled with the release of multiple histopathology data has led to the release of histopathology-specific networks. In this work, we compare the performance of features extracted from networks trained on ImageNet and histopathology data. We use an attention pooling network over these extracted features for slide-level aggregation. We investigate if features learned using more complex networks lead to gain in performance. We use a simple top-k sampling approach for fine-tuning framework and study the representation similarity between frozen and fine-tuned networks using Centered Kernel Alignment. Further, to examine if intermediate block representation is better suited for feature extraction and ImageNet architectures are unnecessarily large for histopathology, we truncate the blocks of ResNet18 and DenseNet121 and examine the performance.


title: A finite element model for a coupled thermo-mechanical system: nonlinear strain-limiting thermoelastic body

abstract: We investigate a specific finite element model to study the thermoelastic behavior of an elastic body within the context of nonlinear strain-limiting constitutive relation. As a special subclass of implicit relations, the thermoelastic response of our interest is such that stresses can be arbitrarily large, but strains remain small, especially in the neighborhood of crack-tips. Thus, the proposed model can be inherently consistent with the assumption of the small strain theory. In the present communication, we consider a two-dimensional coupled system-linear and quasilinear partial differential equations for temperature and displacements, respectively. Two distinct temperature distributions of the Dirichlet type are considered for boundary condition, and a standard finite element method of continuous Galerkin is employed to obtain the numerical solutions for the field variables. For a domain with an edge-crack, we find that the near-tip strain growth of our model is much slower than the growth of stress, which is the salient feature compared to the inconsistent results of the classical linearized description of the elastic body. Current study can provide a theoretical and computational framework to develop physically meaningful models and examine other coupled multi-physics such as an evolution of complex network of cracks induced by thermal shocks.


title: Laboratory verification of electron-scale reconnection regions modulated by a three-dimensional instability

abstract: During magnetic reconnection in collisionless space plasma, the electron fluid decouples from the magnetic field within narrow current layers, and theoretical models for this process can be distinguished in terms of their predicted current layer widths. From theory, the off-diagonal stress in the electron pressure tensor is related to thermal non-circular orbit motion of electrons around the magnetic field lines. This stress becomes significant when the width of the reconnecting current layer approaches the small characteristic length scale of the electron motion. To aid in situ spacecraft and numerical investigations of reconnection, the structure of the electron diffusion region is here investigated using the Terrestrial Reconnection EXperiment (TREX). In agreement with the closely matched kinetic simulations, laboratory observations reveal the presence of electron-scale current layer widths. Although the layers are modulated by a current-driven instability, 3D simulations demonstrate that it is the off-diagonal stress that is responsible for breaking the frozen-in condition of the electron fluid.


title: Risk Assessment of Stealthy Attacks on Uncertain Control Systems

abstract: In this article, we address the problem of risk assessment of stealthy attacks on uncertain control systems. Considering data injection attacks that aim at maximizing impact while remaining undetected, we use the recently proposed output-to-output gain to characterize the risk associated with the impact of attacks under a limited system knowledge attacker. The risk is formulated using a well-established risk metric, namely the maximum expected loss. Under this setups, the risk assessment problem corresponds to an untractable infinite non-convex optimization problem. To address this limitation, we adopt the framework of scenario-based optimization to approximate the infinite non-convex optimization problem by a sampled non-convex optimization problem. Then, based on the framework of dissipative system theory and S-procedure, the sampled non-convex risk assessment problem is formulated as an equivalent convex semi-definite program. Additionally, we derive the necessary and sufficient conditions for the risk to be bounded. Finally, we illustrate the results through numerical simulation of a hydro-turbine power system.


title: On rainbow-free colourings of uniform hypergraphs

abstract: We study rainbow-free colourings of $k$-uniform hypergraphs; that is, colourings that use $k$ colours but with the property that no hyperedge attains all colours. We show that $p^*=(k-1)(\ln n)/n$ is the threshold function for the existence of a rainbow-free colouring in a random $k$-uniform hypergraph.


title: Temperate distributions with locally finite support and spectrum on Euclidean spaces

abstract: We prove that supports of a wide class of temperate distributions with uniformly discrete support and spectrum on Euclidean spaces are finite unions of translations of full-rank lattices. This result is a generalization of the corresponding theorem for Fourier quasicrystals, and its proof uses the technique of almost periodic distributions.


title: RadArnomaly: Protecting Radar Systems from Data Manipulation Attacks

abstract: Radar systems are mainly used for tracking aircraft, missiles, satellites, and watercraft. In many cases, information regarding the objects detected by the radar system is sent to, and used by, a peripheral consuming system, such as a missile system or a graphical user interface used by an operator. Those systems process the data stream and make real-time, operational decisions based on the data received. Given this, the reliability and availability of information provided by radar systems has grown in importance. Although the field of cyber security has been continuously evolving, no prior research has focused on anomaly detection in radar systems. In this paper, we present a deep learning-based method for detecting anomalies in radar system data streams. We propose a novel technique which learns the correlation between numerical features and an embedding representation of categorical features in an unsupervised manner. The proposed technique, which allows the detection of malicious manipulation of critical fields in the data stream, is complemented by a timing-interval anomaly detection mechanism proposed for the detection of message dropping attempts. Real radar system data is used to evaluate the proposed method. Our experiments demonstrate the method's high detection accuracy on a variety of data stream manipulation attacks (average detection rate of 88% with 1.59% false alarms) and message dropping attacks (average detection rate of 92% with 2.2% false alarms).


title: Revisiting consistency for semi-supervised semantic segmentation

abstract: Semi-supervised learning an attractive technique in practical deployments of deep models since it relaxes the dependence on labeled data. It is especially important in the scope of dense prediction because pixel-level annotation requires significant effort. This paper considers semi-supervised algorithms that enforce consistent predictions over perturbed unlabeled inputs. We study the advantages of perturbing only one of the two model instances and preventing the backward pass through the unperturbed instance. We also propose a competitive perturbation model as a composition of geometric warp and photometric jittering. We experiment with efficient models due to their importance for real-time and low-power applications. Our experiments show clear advantages of (1) one-way consistency, (2) perturbing only the student branch, and (3) strong photometric and geometric perturbations. Our perturbation model outperforms recent work and most of the contribution comes from photometric component. Experiments with additional data from the large coarsely annotated subset of Cityscapes suggest that semi-supervised training can outperform supervised training with the coarse labels.


title: Non-equilibrium in the Solar Neighbourhood using dynamical modelling with Gaia DR2

abstract: Matter distribution models of the Milky Way galaxy are usually stationary, although there are known to be wave-like perturbations in the disc at $\sim10\%$ level of the total density. Modelling of the overall acceleration field by allowing non-equilibrium is a complicated task. We must learn to distinguish whether density enhancements are persistent or not by their nature. In the present paper, we elaborate our orbital arc method to include the effects of massless perturbations and non-stationarities in the modelling. The method is tested by modelling of simulation data and shown to be valid. We apply the method to the Gaia DR 2 data within a region of $\sim 0.5$ kpc from the Sun and confirm that acceleration field in the Solar Neighbourhood has a perturbed nature -- the phase space density along the orbits of stars grow in the order of $h\lesssim 5\%$ per Myr due to non-stationarity. This result is a temporally local value and can be used only within the timeframe of a few Myrs. An attempt to pinpoint the origin of the perturbation shows that the stars having larger absolute angular momentum are the main carriers of the local perturbation. As they are faster than the average thin disc star, they are either originating further away and are close in their pericentre or they are perturbed locally by a fast co-moving perturber, such as gas disc inhomogenities.


title: Inclusive learning for quantum computing: supporting the aims of quantum literacy using the puzzle game Quantum Odyssey

abstract: With a vast domain of applications and now having quantum computing hardware available for commercial use, an education challenge arises in getting people of various background to become quantum literate. Quantum Odyssey is a new piece of computer software that promises to be a medium where people can learn quantum computing without any previous requirements. It aims to achieve this through visual cues and puzzle play, without requiring the user to possess a background in computer coding or even linear algebra, which are traditionally a must to work on quantum algorithms. In this paper we report our findings on an UKRI Citizen Science grant that involves using Quantum Odyssey to teach how to construct quantum computing algorithms. Sessions involved 30 minutes of play, with 10 groups of 5 students, ranging between 11 to 18 years old, in two schools in the UK. Results show the Quantum Odyssey visual methods are efficient in portraying counterintuitive quantum computational logic in a visual and interactive form. This enabled untrained participants to quickly grasp difficult concepts in an intuitive way and solve problems that are traditionally given today in Masters level courses in a mathematical form. The results also show an increased interest in quantum physics after play, a higher openness and curiosity to learn the mathematics behind computing on quantum systems. Participants developed a visual, rather than mathematical intuition, that enabled them to understand and correctly answer entry level technical quantum information science.


title: Quantum Cluster Algorithm for Data classification

abstract: We present a quantum algorithm for data classification based on the nearest-neighbor learning algorithm. The classification algorithm is divided into two steps: Firstly, data in the same class is divided into smaller groups with sublabels assisting building boundaries between data with different labels. Secondly we construct a quantum circuit for classification that contains multi control gates. The algorithm is easy to implement and efficient in predicting the labels of test data. To illustrate the power and efficiency of this approach, we construct the phase transition diagram for the metal-insulator transition of $VO_2$, using limited trained experimental data, where $VO_2$ is a typical strongly correlated electron materials, and the metallic-insulating phase transition has drawn much attention in condensed matter physics. Moreover, we demonstrate our algorithm on the classification of randomly generated data and the classification of entanglement for various Werner states, where the training sets can not be divided by a single curve, instead, more than one curves are required to separate them apart perfectly. Our preliminary result shows considerable potential for various classification problems, particularly for constructing different phases in materials.


title: Decentralized Inertial Best-Response with Voluntary and Limited Communication in Random Communication Networks

abstract: Multiple autonomous agents interact over a random communication network to maximize their individual utility functions which depend on the actions of other agents. We consider decentralized best-response with inertia type algorithms in which agents form beliefs about the future actions of other players based on local information, and take an action that maximizes their expected utility computed with respect to these beliefs or continue to take their previous action. We show convergence of these types of algorithms to a Nash equilibrium in weakly acyclic games under the condition that the belief update and information exchange protocols successfully learn the actions of other players with positive probability in finite time given a static environment, i.e., when other agents' actions do not change. We design a decentralized fictitious play algorithm with voluntary and limited communication (DFP-VL) protocols that satisfy this condition. In the voluntary communication protocol, each agent decides whom to exchange information with by assessing the novelty of its information and the potential effect of its information on others' assessments of their utility functions. The limited communication protocol entails agents sending only their most frequent action to agents that they decide to communicate with. Numerical experiments on a target assignment game demonstrate that the voluntary and limited communication protocol can more than halve the number of communication attempts while retaining the same convergence rate as DFP in which agents constantly attempt to communicate.


title: Semi-verified PAC Learning from the Crowd

abstract: We study the problem of crowdsourced PAC learning of threshold functions. This is a challenging problem and only recently have query-efficient algorithms been established under the assumption that a noticeable fraction of the workers are perfect. In this work, we investigate a more challenging case where the majority may behave adversarially and the rest behave as the Massart noise - a significant generalization of the perfectness assumption. We show that under the {semi-verified model} of Charikar et al. (2017), where we have (limited) access to a trusted oracle who always returns correct annotations, it is possible to PAC learn the underlying hypothesis class with a manageable amount of label queries. Moreover, we show that the labeling cost can be drastically mitigated via the more easily obtained comparison queries. Orthogonal to recent developments in semi-verified or list-decodable learning that crucially rely on data distributional assumptions, our PAC guarantee holds by exploring the wisdom of the crowd.


title: Vertical Strain-Induced Modification of the Electrical and Spin Properties of Monolayer MoSi2X4 (X= N, P, As and Sb)

abstract: In this work, the electrical and spin properties of monolayer MoSi2X4 (X= N, P, As, and Sb) under vertical strain are investigated. The band structures state that MoSi2N4 is an indirect semiconductor, whereas other compounds are direct semiconductors. The vertical strain has been selected to modify the electrical properties. The bandgap shows a maximum and decreases for both tensile and compressive strains. The valence band at K-point displays a large spin-splitting, whereas the conduction band has a negligible splitting. On the other hand, the second conduction band has a large spin-splitting and moves down under vertical strain which leads to a large spin-splitting in both conduction and valence bands edges. The projected density of states along with the projected band structure clarifies the origin of these large spin-splittings. These three spin-splittings can be controlled by vertical strain.


title: Modern light on ancient feud: Robert Hooke and Newton's graphical method

abstract: The feud between Robert Hooke and Isaac Newton has remained ongoing even after 300 years, over whether Newton should have acknowledged Hooke's influence on his graphical method of constructing planet orbits, the celebrated Proposition 1, Theorem 1 of the $Principia$. The drama has escalated in recent decades, with a claim that Hooke may have used the same method and obtained an elliptical orbit for a linear force, a feat that some considered Newton never did for the inverse-square force. Modern understanding of Newton's graphical method as a symplectic integrator can now shed light on whether this claim is creditable. This work, based on knowing the Hamiltonian of the symplectic integrator, deduced the analytical orbit corresponding to Newton's graphical construction. A detailed comparison between this analytical orbit and Hooke's drawing shows that it is unlikely that Hooke had used Newton's graphical method and obtained the correct orbit.


title: Hamiltonicity of 3-tough $(K_2 \cup 3K_1)$-free graphs

abstract: Chv\'{a}tal conjectured in 1973 the existence of some constant $t$ such that all $t$-tough graphs with at least three vertices are hamiltonian. While the conjecture has been proven for some special classes of graphs, it remains open in general. We say that a graph is $(K_2 \cup 3K_1)$-free if it contains no induced subgraph isomorphic to $K_2 \cup 3K_1$, where $K_2 \cup 3K_1$ is the disjoint union of an edge and three isolated vertices. In this paper, we show that every 3-tough $(K_2 \cup 3K_1)$-free graph with at least three vertices is hamiltonian.


title: Security Analysis of the Silver Bullet Technique for RowHammer Prevention

abstract: The purpose of this document is to study the security properties of the Silver Bullet algorithm against worst-case RowHammer attacks. We mathematically demonstrate that Silver Bullet, when properly configured and implemented in a DRAM chip, can securely prevent RowHammer attacks. The demonstration focuses on the most representative implementation of Silver Bullet, the patent claiming many implementation possibilities not covered in this demonstration. Our study concludes that Silver Bullet is a promising RowHammer prevention mechanism that can be configured to operate securely against RowHammer attacks at various efficiency-area tradeoff points, supporting relatively small hammer count values (e.g., 1000) and Silver Bullet table sizes (e.g., 1.06KB).


title: Survey: Image Mixing and Deleting for Data Augmentation

abstract: Neural networks are prone to overfitting and memorizing data patterns. To avoid over-fitting and enhance their generalization and performance, various methods have been suggested in the literature, including dropout, regularization, label smoothing, etc. One such method is augmentation which introduces different types of corruption in the data to prevent the model from overfitting and to memorize patterns present in the data. A sub-area of data augmentation is image mixing and deleting. This specific type of augmentation either deletes image regions or mixes two images to hide or make particular characteristics of images confusing for the network, forcing it to emphasize the overall structure of the object in an image. Models trained with this approach have proven to perform and generalize well compared to those trained without image mixing or deleting. An added benefit that comes with this method of training is robustness against image corruption. Due to its low computational cost and recent success, researchers have proposed many image mixing and deleting techniques. We furnish an in-depth survey of image mixing and deleting techniques and provide categorization via their most distinguishing features. We initiate our discussion with some fundamental relevant concepts. Next, we present essentials, such as each category's strengths and limitations, describing their working mechanism, basic formulations, and applications. We also discuss the general challenges and recommend possible future research directions for image mixing and deleting data augmentation techniques. Datasets and codes for evaluation are publicly available here.


title: Cyclic Einstein-Podolsky-Rosen Steering

abstract: Einstein-Podolsky-Rosen (EPR) steering is a form of quantum correlation that exhibits a fundamental asymmetry in the properties of quantum systems. Given two observers, Alice and Bob, it is known to exist bipartite entangled states which are one-way steerable in the sense that Alice can steer Bob's state, but Bob cannot steer Alice's state. Here we generalize this phenomenon to three parties and find a cyclic property of tripartite EPR steering. In particular, we identify a three-qubit state whose reduced bipartite states are one-way steerable for arbitrary projective measurements. Moreover, the three-qubit state has a cyclic steering property in the sense, that by arranging the system in a triangular configuration the neighboring parties can steer each others' states only in the same (e.g. clockwise) direction. That is, Alice can steer Bob's state, Bob can steer Charlie's state, and Charlie can steer Alice's state, but not the other way around.


title: Koios: A Deep Learning Benchmark Suite for FPGA Architecture and CAD Research

abstract: With the prevalence of deep learning (DL) in many applications, researchers are investigating different ways of optimizing FPGA architecture and CAD to achieve better quality-of-results (QoR) on DL-based workloads. In this optimization process, benchmark circuits are an essential component; the QoR achieved on a set of benchmarks is the main driver for architecture and CAD design choices. However, current academic benchmark suites are inadequate, as they do not capture any designs from the DL domain. This work presents a new suite of DL acceleration benchmark circuits for FPGA architecture and CAD research, called Koios. This suite of 19 circuits covers a wide variety of accelerated neural networks, design sizes, implementation styles, abstraction levels, and numerical precisions. These designs are larger, more data parallel, more heterogeneous, more deeply pipelined, and utilize more FPGA architectural features compared to existing open-source benchmarks. This enables researchers to pin-point architectural inefficiencies for this class of workloads and optimize CAD tools on more realistic benchmarks that stress the CAD algorithms in different ways. In this paper, we describe the designs in our benchmark suite, present results of running them through the Verilog-to-Routing (VTR) flow using a recent FPGA architecture model, and identify key insights from the resulting metrics. On average, our benchmarks have 3.7x more netlist primitives, 1.8x and 4.7x higher DSP and BRAM densities, and 1.7x higher frequency with 1.9x more near-critical paths compared to the widely-used VTR suite. Finally, we present two example case studies showing how architectural exploration for DL-optimized FPGAs can be performed using our new benchmark suite.


title: A new soft computing method for integration of expert's knowledge in reinforcement learn-ing problems

abstract: This paper proposes a novel fuzzy action selection method to leverage human knowledge in reinforcement learning problems. Based on the estimates of the most current action-state values, the proposed fuzzy nonlinear mapping as-signs each member of the action set to its probability of being chosen in the next step. A user tunable parameter is introduced to control the action selection policy, which determines the agent's greedy behavior throughout the learning process. This parameter resembles the role of the temperature parameter in the softmax action selection policy, but its tuning process can be more knowledge-oriented since this parameter reflects the human knowledge into the learning agent by making modifications in the fuzzy rule base. Simulation results indicate that including fuzzy logic within the reinforcement learning in the proposed manner improves the learning algorithm's convergence rate, and provides superior performance.


title: A Language for Modeling And Optimizing Experimental Biological Protocols

abstract: Automation is becoming ubiquitous in all laboratory activities, leading towards precisely defined and codified laboratory protocols. However, the integration between laboratory protocols and mathematical models is still lacking. Models describe physical processes, while protocols define the steps carried out during an experiment: neither cover the domain of the other, although they both attempt to characterize the same phenomena. We should ideally start from an integrated description of both the model and the steps carried out to test it, to concurrently analyze uncertainties in model parameters, equipment tolerances, and data collection. To this end, we present a language to model and optimize experimental biochemical protocols that facilitates such an integrated description, and that can be combined with experimental data. We provide a probabilistic semantics for our language based on a Bayesian interpretation that formally characterizes the uncertainties in both the data collection, the underlying model, and the protocol operations. On a set of case studies we illustrate how the resulting framework allows for automated analysis and optimization of experimental protocols, including Gibson assembly protocols.


title: Ultrahigh thermal conductivity and strength in direct-gap semiconducting graphene-like BC6N: A first-principles and classical investigation

abstract: In recent years, graphene-like boron carbide and carbon nitride nanosheets have attracted remarkable attentions, owing to their semiconducting electronic nature and outstanding mechanical and heat transport properties. Graphene-like BC6N is an experimentally realized layered material and most recently has been the focus of numerous theoretical studies. Interestingly, the most stable form of BC6N monolayer remains unexplored and limited information are known concerning its intrinsic physical properties. Herein, on the basis of density functional theory (DFT) calculations we confirm that the most stable form of BC6N nanosheet shows a rectangular unitcell, in accordance with an overlooked experimental finding. We found that BC6N monolayer is a semiconductor with 1.19 eV direct gap and yields anisotropic and excellent absorption of visible light. First-principles results highlight that BC6N nanosheet exhibits anisotropic and ultrahigh tensile strength and lattice thermal conductivity, outperforming all other fabricated 2D semiconductors. We moreover develop classical molecular dynamic models for the evaluation of heat transport and mechanical properties of BC6N nanomembranes. The presented results in this work not only shed light on the most stable configuration of BC6N nanosheet, but also confirm its outstandingly appealing electronic, optical, heat conduction and mechanical properties, extremely motivating for further theoretical and experimental endeavors.


title: On-Off Center-Surround Receptive Fields for Accurate and Robust Image Classification

abstract: Robustness to variations in lighting conditions is a key objective for any deep vision system. To this end, our paper extends the receptive field of convolutional neural networks with two residual components, ubiquitous in the visual processing system of vertebrates: On-center and off-center pathways, with excitatory center and inhibitory surround; OOCS for short. The on-center pathway is excited by the presence of a light stimulus in its center but not in its surround, whereas the off-center one is excited by the absence of a light stimulus in its center but not in its surround. We design OOCS pathways via a difference of Gaussians, with their variance computed analytically from the size of the receptive fields. OOCS pathways complement each other in their response to light stimuli, ensuring this way a strong edge-detection capability, and as a result, an accurate and robust inference under challenging lighting conditions. We provide extensive empirical evidence showing that networks supplied with the OOCS edge representation gain accuracy and illumination-robustness compared to standard deep models.


title: $\mathcal PT$ symmetry, pattern formation, and finite-density QCD

abstract: A longstanding issue in the study of quantum chromodynamics (QCD) is its behavior at nonzero baryon density, which has implications for many areas of physics. The path integral has a complex integrand when the quark chemical potential is nonzero and therefore has a sign problem, but it also has a generalized $\mathcal PT$ symmetry. We review some new approaches to $\mathcal PT$-symmetric field theories, including both analytical techniques and methods for lattice simulation. We show that $\mathcal PT$-symmetric field theories with more than one field generally have a much richer phase structure than their Hermitian counterparts, including stable phases with patterning behavior. The case of a $\mathcal PT$-symmetric extension of a $\phi^4$ model is explained in detail. The relevance of these results to finite density QCD is explained, and we show that a simple model of finite density QCD exhibits a patterned phase in its critical region.


title: Switchable induced-transmission filters enabled by vanadium dioxide

abstract: Abstract: An induced-transmission filter (ITF) uses an ultrathin layer of metal positioned at an electric-field node within a dielectric thin-film bandpass filter to select one transmission band while suppressing other transmission bands that would have been present without the metal layer. Here, we introduce a switchable mid-infrared ITF where the metal film can be "switched on and off", enabling the modulation of the filter response from single-band to multiband. The switching is enabled by a deeply subwavelength film of vanadium dioxide (VO2), which undergoes a reversible insulator-to-metal phase transition. We designed and experimentally demonstrated an ITF that can switch between two states: one broad passband across the long-wave infrared (LWIR, 8 - 12 um) and one narrow passband at ~8.8 um. Our work generalizes the ITF -- previously a niche type of bandpass filter -- into a new class of tunable devices. Furthermore, our unique fabrication process -- which begins with thin-film VO2 on a suspended membrane -- enables the integration of VO2 into any thin-film assembly that is compatible with physical vapor deposition (PVD) processes, and is thus a new platform for realizing tunable thin-film filters.


title: On the Convergence of Differentially Private Federated Learning on Non-Lipschitz Objectives, and with Normalized Client Updates

abstract: There is a dearth of convergence results for differentially private federated learning (FL) with non-Lipschitz objective functions (i.e., when gradient norms are not bounded). The primary reason for this is that the clipping operation (i.e., projection onto an $\ell_2$ ball of a fixed radius called the clipping threshold) for bounding the sensitivity of the average update to each client's update introduces bias depending on the clipping threshold and the number of local steps in FL, and analyzing this is not easy. For Lipschitz functions, the Lipschitz constant serves as a trivial clipping threshold with zero bias. However, Lipschitzness does not hold in many practical settings; moreover, verifying it and computing the Lipschitz constant is hard. Thus, the choice of the clipping threshold is non-trivial and requires a lot of tuning in practice. In this paper, we provide the first convergence result for private FL on smooth \textit{convex} objectives \textit{for a general clipping threshold} -- \textit{without assuming Lipschitzness}. We also look at a simpler alternative to clipping (for bounding sensitivity) which is \textit{normalization} -- where we use only a scaled version of the unit vector along the client updates, completely discarding the magnitude information. {The resulting normalization-based private FL algorithm is theoretically shown to have better convergence than its clipping-based counterpart on smooth convex functions. We corroborate our theory with synthetic experiments as well as experiments on benchmarking datasets.


title: Linear representation of categorical values

abstract: We propose a binary representation of categorical values using a linear map. This linear representation preserves the neighborhood structure of categorical values. In the context of evolutionary algorithms, it means that every categorical value can be reached in a single mutation. The linear representation is embedded into standard metaheuristics, applied to the problem of Sudoku puzzles, and compared to the more traditional direct binary encoding. It shows promising results in fixed-budget experiments and empirical cumulative distribution functions with high dimension instances, and also in fixed-target experiments with small dimension instances.


title: Tests for partial correlation between repeatedly observed nonstationary nonlinear timeseries

abstract: We describe two families of statistical tests to detect partial correlation in vectorial timeseries. The tests measure whether an observed timeseries Y can be predicted from a second series X, even after accounting for a third series Z which may correlate with X. They do not make any assumptions on the nature of these timeseries, such as stationarity or linearity, but they do require that multiple statistically independent recordings of the 3 series are available. Intuitively, the tests work by asking if the series Y recorded on one experiment can be better predicted from X recorded on the same experiment than on a different experiment, after accounting for the prediction from Z recorded on both experiments.


title: Spin-free formulation of the multireference driven similarity renormalization group: A benchmark study of first-row diatomic molecules and spin-crossover energetics

abstract: We report a spin-free formulation of the multireference (MR) driven similarity renormalization group (DSRG) by employing the ensemble normal ordering of Mukherjee and Kutzelnigg [W. Kutzelnigg and D. Mukherjee, J. Chem. Phys. 107, 432 (1997)]. This ensemble averages over all microstates for a given total spin quantum number and, therefore, it is invariant with respect to SU(2) transformations. As such, all equations may be reformulated in terms of spin-free quantities and they closely resemble those of spin-adapted closed-shell coupled cluster (CC) theory. The current implementation is used to assess the accuracy of various truncated MR-DSRG methods (perturbation theory up to third order and iterative methods with single and double excitations) in computing the constants of thirty-three first-row diatomic molecules. The accuracy trends for these first-row diatomics are consistent with our previous benchmark on a small subset of closed-shell diatomic molecules. We then present the first MR-DSRG application on transition-metal complexes by computing the spin splittings of the [Fe(H$_2$O)$_6$]$^{2+}$ and [Fe(NH$_3$)$_6$]$^{2+}$ molecules. Focal point analysis (FPA) shows that third-order perturbative corrections are essential to achieve reasonably converged energetics. A FPA based on the linearized MR-DSRG theory with one- and two-body operators and up to a quintuple-$\zeta$ basis set predicts the spin splittings of [Fe(H$_2$O)$_6$]$^{2+}$ and [Fe(NH$_3$)$_6$]$^{2+}$ to be $-35.7$ and $-17.1$ kcal mol$^{-1}$, respectively, showing good agreement with results of local CC theory with singles, doubles, and perturbative triples.


title: Security Analysis of Camera-LiDAR Fusion Against Black-Box Attacks on Autonomous Vehicles

abstract: To enable safe and reliable decision-making, autonomous vehicles (AVs) feed sensor data to perception algorithms to understand the environment. Sensor fusion with multi-frame tracking is becoming increasingly popular for detecting 3D objects. Thus, in this work, we perform an analysis of camera-LiDAR fusion, in the AV context, under LiDAR spoofing attacks. Recently, LiDAR-only perception was shown vulnerable to LiDAR spoofing attacks; however, we demonstrate these attacks are not capable of disrupting camera-LiDAR fusion. We then define a novel, context-aware attack: frustum attack, and show that out of 8 widely used perception algorithms - across 3 architectures of LiDAR-only and 3 architectures of camera-LiDAR fusion - all are significantly vulnerable to the frustum attack. In addition, we demonstrate that the frustum attack is stealthy to existing defenses against LiDAR spoofing as it preserves consistencies between camera and LiDAR semantics. Finally, we show that the frustum attack can be exercised consistently over time to form stealthy longitudinal attack sequences, compromising the tracking module and creating adverse outcomes on end-to-end AV control.


title: Composability of global phase invariant distance and its application to approximation error management

abstract: Many quantum algorithms can be written as a composition of unitaries, some of which can be exactly synthesized by a universal fault-tolerant gate set, while others can be approximately synthesized. A quantum compiler synthesizes each approximately synthesizable unitary up to some approximation error, such that the error of the overall unitary remains bounded by a certain amount. In this paper we consider the case when the errors are measured in the global phase invariant distance. Apart from deriving a relation between this distance and the Frobenius norm, we show that this distance composes. If a unitary is written as a composition (product and tensor product) of other unitaries, we derive bounds on the error of the overall unitary as a function of the errors of the composed unitaries. Our bound is better than the sum-of-error bound (Bernstein,Vazirani,1997), derived for the operator norm. This indicates that synthesizing a circuit using global phase invariant distance maybe done with less number of resources. Next we consider the following problem. Suppose we are given a decomposition of a unitary. The task is to distribute the errors in each component such that the T-count is optimized. Specifically, we consider those decompositions where $R_z(\theta)$ gates are the only approximately synthesizable component. We prove analytically that for both the operator norm and global phase invariant distance, the error should be distributed equally among these components (given some approximations). The optimal number of T-gates obtained by using the global phase invariant distance is less. Furthermore, we show that in case of approximate Quantum Fourier Transform, the error obtained by pruning rotation gates is less when measured in this distance.


title: The Impact of Irrational Behaviours in the Optional Prisoner's Dilemma with Game-Environment Feedback

abstract: In the optional prisoner's dilemma (OPD), players can choose to cooperate and defect as usual, but can also abstain as a third possible strategy. This strategy models the players' participation in the game and is a relevant aspect in many settings, e.g. social networks or opinion dynamics where abstention is an option during an election. In this paper, we provide a formulation of the OPD where we consider irrational behaviours in the population inspired by prospect theory. Prospect theory has gained increasing popularity in recent times thanks to its ability to capture aspects such as reference dependence or loss aversion which are common in human behaviour. This element is original in our formulation of the game and is incorporated in our framework through pairwise comparison dynamics. Recently, the impact of the environment has been studied in the form of feedback on the population dynamics. Another element of novelty in our work is the extension of the game-environment feedback to the OPD in two forms of dynamics, the replicator and the pairwise comparison. The contribution of this paper is threefold. First, we propose a modelling framework where prospect theory is used to capture irrational behaviours in an evolutionary game with game-environment feedback. Second, we carry out the stability analysis of the system equilibria and discuss the oscillating behaviours arising from the game-environment feedback. Finally, we extend our previous results to the OPD and we discuss the main differences between the model resulting from the replicator dynamics and the one resulting from the pairwise comparison dynamics.


title: Computing fusion products of MV cycles using the Mirkovic-Vybornov isomorphism

abstract: The fusion of two Mirkovic-Vilonen cycles is a degeneration of their product, defined using the Beilinson-Drinfeld Grassmannian. In this paper, we put in place a conceptually elementary approach to computing this product in type $A$. We do so by transferring the problem to a fusion of generalized orbital varieties using the Mirkovic-Vybornov isomorphism. As an application, we explicitly compute all cluster exchange relations in the coordinate ring of the upper-triangular subgroup of $GL_4$, confirming that all the cluster variables are contained in the Mirkovic-Vilonen basis.


title: Farview: Disaggregated Memory with Operator Off-loading for Database Engines

abstract: Cloud deployments disaggregate storage from compute, providing more flexibility to both the storage and compute layers. In this paper, we explore disaggregation by taking it one step further and applying it to memory (DRAM). Disaggregated memory uses network attached DRAM as a way to decouple memory from CPU. In the context of databases, such a design offers significant advantages in terms of making a larger memory capacity available as a central pool to a collection of smaller processing nodes. To explore these possibilities, we have implemented Farview, a disaggregated memory solution for databases, operating as a remote buffer cache with operator offloading capabilities. Farview is implemented as an FPGA-based smart NIC making DRAM available as a disaggregated, network attached memory module capable of performing data processing at line rate over data streams to/from disaggregated memory. Farview supports query offloading using operators such as selection, projection, aggregation, regular expression matching and encryption. In this paper we focus on analytical queries and demonstrate the viability of the idea through an extensive experimental evaluation of Farview under different workloads. Farview is competitive with a local buffer cache solution for all the workloads and outperforms it in a number of cases, proving that a smart disaggregated memory can be a viable alternative for databases deployed in cloud environments.


title: A News-based Machine Learning Model for Adaptive Asset Pricing

abstract: The paper proposes a new asset pricing model -- the News Embedding UMAP Selection (NEUS) model, to explain and predict the stock returns based on the financial news. Using a combination of various machine learning algorithms, we first derive a company embedding vector for each basis asset from the financial news. Then we obtain a collection of the basis assets based on their company embedding. After that for each stock, we select the basis assets to explain and predict the stock return with high-dimensional statistical methods. The new model is shown to have a significantly better fitting and prediction power than the Fama-French 5-factor model.


title: The link between Bitcoin and Google Trends attention

abstract: This paper shows that Bitcoin is not correlated to a general uncertainty index as measured by the Google Trends data of Castelnuovo and Tran (2017). Instead, Bitcoin is linked to a Google Trends attention measure specific for the cryptocurrency market. First, we find a bidirectional relationship between Google Trends attention and Bitcoin returns up to six days. Second, information flows from Bitcoin volatility to Google Trends attention seem to be larger than information flows in the other direction. These relations hold across different sub-periods and different compositions of the proposed Google Trends Cryptocurrency index.


title: SRAM-SUC: Ultra-Low Latency Robust Digital PUF

abstract: Secret Unknown Ciphers (SUC) have been proposed recently as digital clone-resistant functions overcoming some of Physical(ly) Unclonable Functions (PUF) downsides, mainly their inconsistency because of PUFs analog nature. In this paper, we propose a new practical mechanism for creating internally random ciphers in modern volatile and non-volatile SoC FPGAs, coined as SRAM-SUC. Each created random cipher inside a SoC FPGA constitutes a robust digital PUF. This work also presents a class of involutive SUCs, optimized for the targeted SoC FPGA architecture, as sample realization of the concept; it deploys a generated class of involutive 8-bit S-Boxes, that are selected randomly from a defined large set through an internal process inside the SoC FPGA. Hardware and software implementations show that the resulting SRAM-SUC has ultra-low latency compared to well-known PUF-based authentication mechanisms. SRAM-SUC requires only $2.88/0.72 \mu s$ to generate a response for a challenge at 50/200 MHz respectively. This makes SRAM-SUC a promising and appealing solution for Ultra-Reliable Low Latency Communication (URLLC).


title: Alignment and Comparison of Directed Networks via Transition Couplings of Random Walks

abstract: We describe and study a transport based procedure called NetOTC (network optimal transition coupling) for the comparison and alignment of two networks. The networks of interest may be directed or undirected, weighted or unweighted, and may have distinct vertex sets of different sizes. Given two networks and a cost function relating their vertices, NetOTC finds a transition coupling of their associated random walks having minimum expected cost. The minimizing cost quantifies the difference between the networks, while the optimal transport plan itself provides alignments of both the vertices and the edges of the two networks. Coupling of the full random walks, rather than their marginal distributions, ensures that NetOTC captures local and global information about the networks, and preserves edges. NetOTC has no free parameters, and does not rely on randomization. We investigate a number of theoretical properties of NetOTC and present experiments establishing its empirical performance.


title: Rotated twisted-mass: a convenient regularization scheme for isospin breaking QCD and QED lattice calculations

abstract: We propose a scheme of lattice twisted-mass fermion regularization which is particularly convenient for application to isospin breaking (IB) QCD and QED calculations, based in particular on the so called RM123 approach, in which the IB terms of the action are treated as a perturbation. The main, practical advantage of this scheme is that it allows the calculation of IB effects on some mesonic observables, like e.g. the pi+ - pi0 mass splitting, using lattice correlation functions in which the quark and antiquark fields in the meson are regularized with opposite values of the Wilson parameter r. These correlation functions are found to be affected by much smaller statistical fluctuations, with respect to the analogous functions in which quark and antiquark fields are regularized with the same value of r. Two numerical application of this scheme, that we call "rotated twisted-mass", within pure QCD and QCD+QED respectively, are also provided for illustration.


title: Pointwise Feasibility of Gaussian Process-based Safety-Critical Control under Model Uncertainty

abstract: Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs) are popular tools for enforcing safety and stability of a controlled system, respectively. They are commonly utilized to build constraints that can be incorporated in a min-norm quadratic program (CBF-CLF-QP) which solves for a safety-critical control input. However, since these constraints rely on a model of the system, when this model is inaccurate the guarantees of safety and stability can be easily lost. In this paper, we present a Gaussian Process (GP)-based approach to tackle the problem of model uncertainty in safety-critical controllers that use CBFs and CLFs. The considered model uncertainty is affected by both state and control input. We derive probabilistic bounds on the effects that such model uncertainty has on the dynamics of the CBF and CLF. We then use these bounds to build safety and stability chance constraints that can be incorporated in a min-norm convex optimization-based controller, called GP-CBF-CLF-SOCP. As the main theoretical result of the paper, we present necessary and sufficient conditions for pointwise feasibility of the proposed optimization problem. We believe that these conditions could serve as a starting point towards understanding what are the minimal requirements on the distribution of data collected from the real system in order to guarantee safety. Finally, we validate the proposed framework with numerical simulations of an adaptive cruise controller for an automotive system.


title: Arbitrary Wave Transformations with Huygens' Metasurfaces through Surface-Wave Optimization

abstract: Huygens' metasurfaces have demonstrated the ability to tailor electromagnetic wavefronts with passive low-profile structures. The fundamental constraint enabling passive and ideally lossless solutions is the conservation of the normal real power locally along the metasurface. In this work, we examine the use of auxiliary surface waves to overcome this limitation and design Huygens' metasurfaces for wave transformations with different incident and output power density profiles. The developed method relies on the optimization of a surface-wave distribution that is utilized to redistribute the power at the input side of the metasurface without incurring any reflections. A full design example is presented with a linear patch array along the H-plane illuminating a metasurface that produces uniform output fields along the E-plane. A high aperture illumination efficiency of 92% is obtained despite the small distance between the source and the metasurface. Moreover, the effects of the evanescent spectrum to the losses and the bandwidth of the structure are discussed.


title: Pressure-Informed Velocity Estimation in a Subsonic Jet

abstract: This work aims to estimate time-resolved velocity field that is directly associated with pressure fluctuations in a subsonic round jet. To achieve this goal, synchronous measurements of the velocity field and in-flow pressure fluctuations were performed at Mach number 0.3. Two different experiment campaigns were conducted, the first experimental campaign aims to explore the time-resolved dynamics of the axisymmetric velocity components, and second experiment focuses on the time-resolved, 2D velocity estimates on a streamwise plane. Two different methods were utilized to estimate the input-output relation between velocity and in-flow pressure measurements. A hybrid approach based on the spectral linear stochastic estimation and the proper orthogonal decomposition was applied to setup the model in a linear manner, and a wavelet-based filter was implemented to attenuate the noise level in the cross-correlation functions. In addition, the pressure-velocity relationship was also described by neural network architectures based on the multi-layer perceptron (MLP) and bidirectional long-short-term-memory (LSTM). In both experimental sets, pressure fluctuations inside the flow are found to be connected to the streamwise convection of large-scale coherent structures in the flow. A unique advantage of the bidirectional LSTM method was found among all estimation schemes is also reported in this work. The estimation result represents the space-time dynamics of the acoustic sources in the jet flow field, and it is of great importance to understand the noise generation mechanism.