title: Accelerating Neural Architecture Exploration Across Modalities Using Genetic Algorithms

abstract: Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning research community. While there have been many recent advancements in NAS, there is still a significant focus on reducing the computational cost incurred when validating discovered architectures by making search more efficient. Evolutionary algorithms, specifically genetic algorithms, have a history of usage in NAS and continue to gain popularity versus other optimization approaches as a highly efficient way to explore the architecture objective space. Most NAS research efforts have centered around computer vision tasks and only recently have other modalities, such as the rapidly growing field of natural language processing, been investigated in depth. In this work, we show how genetic algorithms can be paired with lightly trained objective predictors in an iterative cycle to accelerate multi-objective architectural exploration in a way that works in the modalities of both machine translation and image classification.


title: Semi-Supervised Learning and Data Augmentation in Wearable-based Momentary Stress Detection in the Wild

abstract: Physiological and behavioral data collected from wearable or mobile sensors have been used to estimate self-reported stress levels. Since the stress annotation usually relies on self-reports during the study, a limited amount of labeled data can be an obstacle in developing accurate and generalized stress predicting models. On the other hand, the sensors can continuously capture signals without annotations. This work investigates leveraging unlabeled wearable sensor data for stress detection in the wild. We first applied data augmentation techniques on the physiological and behavioral data to improve the robustness of supervised stress detection models. Using an auto-encoder with actively selected unlabeled sequences, we pre-trained the supervised model structure to leverage the information learned from unlabeled samples. Then, we developed a semi-supervised learning framework to leverage the unlabeled data sequences. We combined data augmentation techniques with consistency regularization, which enforces the consistency of prediction output based on augmented and original unlabeled data. We validated these methods using three wearable/mobile sensor datasets collected in the wild. Our results showed that combining the proposed methods improved stress classification performance by 7.7% to 13.8% on the evaluated datasets, compared to the baseline supervised learning models.


title: Automated Parkinson's Disease Detection and Affective Analysis from Emotional EEG Signals

abstract: While Parkinson's disease (PD) is typically characterized by motor disorder, there is evidence of diminished emotion perception in PD patients. This study examines the utility of affective Electroencephalography (EEG) signals to understand emotional differences between PD vs Healthy Controls (HC), and for automated PD detection. Employing traditional machine learning and deep learning methods, we explore (a) dimensional and categorical emotion recognition, and (b) PD vs HC classification from emotional EEG signals. Our results reveal that PD patients comprehend arousal better than valence, and amongst emotion categories, \textit{fear}, \textit{disgust} and \textit{surprise} less accurately, and \textit{sadness} most accurately. Mislabeling analyses confirm confounds among opposite-valence emotions with PD data. Emotional EEG responses also achieve near-perfect PD vs HC recognition. {Cumulatively, our study demonstrates that (a) examining \textit{implicit} responses alone enables (i) discovery of valence-related impairments in PD patients, and (ii) differentiation of PD from HC, and (b) emotional EEG analysis is an ecologically-valid, effective, facile and sustainable tool for PD diagnosis vis-\'a-vis self reports, expert assessments and resting-state analysis.}


title: An Evaluation of the EEG alpha-to-theta and theta-to-alpha band Ratios as Indexes of Mental Workload

abstract: Many research works indicate that EEG bands, specifically the alpha and theta bands, have been potentially helpful cognitive load indicators. However, minimal research exists to validate this claim. This study aims to assess and analyze the impact of the alpha-to-theta and the theta-to-alpha band ratios on supporting the creation of models capable of discriminating self-reported perceptions of mental workload. A dataset of raw EEG data was utilized in which 48 subjects performed a resting activity and an induced task demanding exercise in the form of a multitasking SIMKAP test. Band ratios were devised from frontal and parietal electrode clusters. Building and model testing was done with high-level independent features from the frequency and temporal domains extracted from the computed ratios over time. Target features for model training were extracted from the subjective ratings collected after resting and task demand activities. Models were built by employing Logistic Regression, Support Vector Machines and Decision Trees and were evaluated with performance measures including accuracy, recall, precision and f1-score. The results indicate high classification accuracy of those models trained with the high-level features extracted from the alpha-to-theta ratios and theta-to-alpha ratios. Preliminary results also show that models trained with logistic regression and support vector machines can accurately classify self-reported perceptions of mental workload. This research contributes to the body of knowledge by demonstrating the richness of the information in the temporal, spectral and statistical domains extracted from the alpha-to-theta and theta-to-alpha EEG band ratios for the discrimination of self-reported perceptions of mental workload.


title: Assessing the State of Self-Supervised Human Activity Recognition using Wearables

abstract: The emergence of self-supervised learning in the field of wearables-based human activity recognition (HAR) has opened up opportunities to tackle the most pressing challenges in the field, namely to exploit unlabeled data to derive reliable recognition systems for scenarios where only small amounts of labeled training samples can be collected. As such, self-supervision, i.e., the paradigm of 'pretrain-then-finetune' has the potential to become a strong alternative to the predominant end-to-end training approaches, let alone hand-crafted features for the classic activity recognition chain. Recently a number of contributions have been made that introduced self-supervised learning into the field of HAR, including, Multi-task self-supervision, Masked Reconstruction, CPC, and SimCLR, to name but a few. With the initial success of these methods, the time has come for a systematic inventory and analysis of the potential self-supervised learning has for the field. This paper provides exactly that. We assess the progress of self-supervised HAR research by introducing a framework that performs a multi-faceted exploration of model performance. We organize the framework into three dimensions, each containing three constituent criteria, such that each dimension captures specific aspects of performance, including the robustness to differing source and target conditions, the influence of dataset characteristics, and the feature space characteristics. We utilize this framework to assess seven state-of-the-art self-supervised methods for HAR, leading to the formulation of insights into the properties of these techniques and to establish their value towards learning representations for diverse scenarios.


title: Automated Extraction of Energy Systems Information from Remotely Sensed Data: A Review and Analysis

abstract: High quality energy systems information is a crucial input to energy systems research, modeling, and decision-making. Unfortunately, actionable information about energy systems is often of limited availability, incomplete, or only accessible for a substantial fee or through a non-disclosure agreement. Recently, remotely sensed data (e.g., satellite imagery, aerial photography) have emerged as a potentially rich source of energy systems information. However, the use of these data is frequently challenged by its sheer volume and complexity, precluding manual analysis. Recent breakthroughs in machine learning have enabled automated and rapid extraction of useful information from remotely sensed data, facilitating large-scale acquisition of critical energy system variables. Here we present a systematic review of the literature on this emerging topic, providing an in-depth survey and review of papers published within the past two decades. We first taxonomize the existing literature into ten major areas, spanning the energy value chain. Within each research area, we distill and critically discuss major features that are relevant to energy researchers, including, for example, key challenges regarding the accessibility and reliability of the methods. We then synthesize our findings to identify limitations and trends in the literature as a whole, and discuss opportunities for innovation. These include the opportunity to extend the methods beyond electricity to broader energy systems and wider geographic areas; and the ability to expand the use of these methods in research and decision making as satellite data become cheaper and easier to access. We also find that there are persistent challenges: limited standardization and rigor of performance assessments; limited sharing of code, which would improve replicability; and a limited consideration of the ethics and privacy of data.


title: Fully-integrated multipurpose microwave frequency identification system on a single chip

abstract: We demonstrate a fully-integrated multipurpose microwave frequency identification system on silicon-on-insulator platform. Thanks to its multipurpose features, the chip is able to identify different types of microwave signals, including single-frequency, multiple-frequency, chirped and frequency-hopping microwave signals, as well as discriminate instantaneous frequency variation among the frequency-modulated signals. This demonstration exhibits fully integrated solution and fully functional microwave frequency identification, which can meet the requirements in reduction of size, weight and power for future advanced microwave photonic processor.


title: Digital Signal Analysis based on Convolutional Neural Networks for Active Target Time Projection Chambers

abstract: An algorithm for digital signal analysis using convolutional neural networks (CNN) was developed in this work. The main objective of this algorithm is to make the analysis of experiments with active target time projection chambers more efficient. The code is divided in three steps: baseline correction, signal deconvolution and peak detection and integration. The CNNs were able to learn the signal processing models with relative errors of less than 6\%. The analysis based on CNNs provides the same results as the traditional deconvolution algorithms, but considerably more efficient in terms of computing time (about 65 times faster). This opens up new possibilities to improve existing codes and to simplify the analysis of the large amount of data produced in active target experiments.

categories: eess.SP cs.LG nucl-ex physics.comp-ph physics.data-an physics.ins-det


title: Quadratic phase wave packet transform

abstract: The quadratic phase Fourier transform has gained much popularity in recent years because of its applications in image and signal processing. However, the QPFT is inadequate for localizing the quadratic phase spectrum which is required in some applications. In this paper, the quadratic phase wave packet transform QP WPT is proposed to address this problem, based on the wave packet transform WPT and QPFT. Firstly, we propose the definition of the QP WPT and gave its relation with windowed Fourier transform WFT. Secondly, several notable inequalities and important properties of newly defined QP WPT, such as boundedness, reconstruction formula, Moyals formula, Reproducing kernel are derived. Finally, we formulate several classes of uncertainty inequalities such as Leibs uncertainty principle, logarithmic uncertainty inequality and the Heisenberg uncertainty inequality.


title: Arrhythmia Classifier Using Convolutional Neural Network with Adaptive Loss-aware Multi-bit Networks Quantization

abstract: Cardiovascular disease (CVDs) is one of the universal deadly diseases, and the detection of it in the early stage is a challenging task to tackle. Recently, deep learning and convolutional neural networks have been employed widely for the classification of objects. Moreover, it is promising that lots of networks can be deployed on wearable devices. An increasing number of methods can be used to realize ECG signal classification for the sake of arrhythmia detection. However, the existing neural networks proposed for arrhythmia detection are not hardware-friendly enough due to a remarkable quantity of parameters resulting in memory and power consumption. In this paper, we present a 1-D adaptive loss-aware quantization, achieving a high compression rate that reduces memory consumption by 23.36 times. In order to adapt to our compression method, we need a smaller and simpler network. We propose a 17 layer end-to-end neural network classifier to classify 17 different rhythm classes trained on the MIT-BIH dataset, realizing a classification accuracy of 93.5%, which is higher than most existing methods. Due to the adaptive bitwidth method making important layers get more attention and offered a chance to prune useless parameters, the proposed quantization method avoids accuracy degradation. It even improves the accuracy rate, which is 95.84%, 2.34% higher than before. Our study achieves a 1-D convolutional neural network with high performance and low resources consumption, which is hardware-friendly and illustrates the possibility of deployment on wearable devices to realize a real-time arrhythmia diagnosis.


title: Domain wall between the Dirac sea and the "anti-Dirac sea"

abstract: It was shown in work \cite{vergeles2021note} that in the theory of gravity coupled with the Dirac field, each state $|\lambda\rangle$ has its own twin $|\lambda;PT\rangle$, which is obtained by a discrete PT transformation. If in the state $|\lambda\rangle$ the Dirac sea is filled, then in the state $|\lambda;PT\rangle$ there is an "anti-Dirac" filling (in terms of the state $|\lambda\rangle$). It is important that the energies of these states are the same. Therefore, there may be domains with different filling of the Dirac sea. Here we study a domain wall connecting two such adjacent domains.


title: Generalized form of fixed-point theorems in generalized Banach algebra relative to the weak topology with an application

abstract: In this paper, a general hybrid fixed point theorem for the contractive mappings in generalized Banach spaces is proved via measure of weak non-compactness and it is further applied to fractional integral equations for proving the existence results for the solutions under mixed Lipschitz and weakly sequentially continuous conditions. Finally, an example is given to illustrate the result.


title: A contagion process with self-exciting jumps in credit risk applications

abstract: The modeling of the probability of joint default or total number of defaults among the firms is one of the crucial problems to mitigate the credit risk since the default correlations significantly affect the portfolio loss distribution and hence play a significant role in allocating capital for solvency purposes. In this article, we derive a closed-form expression for the probability of default of a single firm and the probability of the total number of defaults by any time $t$ in a homogeneous portfolio of firms. We use a contagion process to model the arrival of credit events that causes the default and develop a framework that allows firms to have resistance against default unlike the standard intensity-based models. We assume the point process driving the credit events to be composed of a systematic and an idiosyncratic component, whose intensities are independently specified by a mean-reverting affine jump-diffusion process with self-exciting jumps. The proposed framework is competent of capturing the feedback effect, an empirically observed phenomenon in the default events. We further demonstrate how the proposed framework can be used to price synthetic collateralized debt obligation (CDO) and obtain a closed-form solution for tranche spread. Finally, we present the sensitivity analysis to demonstrate the effect of different parameters governing the contagion effect on the spread of tranches and the expected loss of the CDO.


title: A Therapeutic Stress Ball to Monitor Hand Dexterity and Electrodermal Activity

abstract: This work presents a triboelectric nanogenerator-based (TENG) therapeutic stress ball to provide gesture monitoring and physiological data on patients requiring physical therapy of various degrees. The device utilizes a 5-layer stack of silicone and braided silver-coated nylon rope electrodes to create a sensor network that monitors 40-points across the surface of a semi-spherical prototype. A modified version of a standard ECG circuit was utilized to provide proper loading, noise rejection, filtering, and phase of the TENG signals along with multiplexing of the many electrodes. All system components were selected with a final embedded system in mind. Testing of the device was conducted utilizing an Arduino Uno and an EVAL-AD5940BIOZ evaluation board for electrodermal activity for stress and/or pain after exercise. An accelerometer was included for device activation and hand tremor detection. Upon testing, the self-powered TENG sensors produce positive impulses upon contact and negative impulses upon release of contact from the surface of the ball. Furthermore, finger removal detection was demonstrated by capturing the associated negative impulse by maintaining the bipolar signal in our conditioning circuit. EDA results indicate silver-coated nylon as a potentially good dry-electrode which can be used with even more electrodes for bio-impedance or ECG capture to further expand the device functionality. A MATLAB-based GUI was designed to provide the user with data tracking and visual monitoring of the data via serial communication from the microcontrollers. Finally, it should be noted that this provides a means for low-cost low-power gesture tracking without the use of flexible capacitive grid arrays and provides the user with a pleasant tactile experience that one expects form a stress ball due to its unique material design.


title: DAGAM: A Domain Adversarial Graph Attention Model for Subject Independent EEG-Based Emotion Recognition

abstract: One of the most significant challenges of EEG-based emotion recognition is the cross-subject EEG variations, leading to poor performance and generalizability. This paper proposes a novel EEG-based emotion recognition model called the domain adversarial graph attention model (DAGAM). The basic idea is to generate a graph to model multichannel EEG signals using biological topology. Graph theory can topologically describe and analyze relationships and mutual dependency between channels of EEG. Then, unlike other graph convolutional networks, self-attention pooling is applied to benefit salient EEG feature extraction from the graph, which effectively improves the performance. Finally, after graph pooling, the domain adversarial based on the graph is employed to identify and handle EEG variation across subjects, efficiently reaching good generalizability. We conduct extensive evaluations on two benchmark datasets (SEED and SEED IV) and obtain state-of-the-art results in subject-independent emotion recognition. Our model boosts the SEED accuracy to 92.59% (4.69% improvement) with the lowest standard deviation of 3.21% (2.92% decrements) and SEED IV accuracy to 80.74% (6.90% improvement) with the lowest standard deviation of 4.14% (3.88% decrements) respectively.


title: Multi-View Fusion Transformer for Sensor-Based Human Activity Recognition

abstract: As a fundamental problem in ubiquitous computing and machine learning, sensor-based human activity recognition (HAR) has drawn extensive attention and made great progress in recent years. HAR aims to recognize human activities based on the availability of rich time-series data collected from multi-modal sensors such as accelerometers and gyroscopes. However, recent deep learning methods are focusing on one view of the data, i.e., the temporal view, while shallow methods tend to utilize the hand-craft features for recognition, e.g., the statistics view. In this paper, to extract a better feature for advancing the performance, we propose a novel method, namely multi-view fusion transformer (MVFT) along with a novel attention mechanism. First, MVFT encodes three views of information, i.e., the temporal, frequent, and statistical views to generate multi-view features. Second, the novel attention mechanism uncovers inner- and cross-view clues to catalyze mutual interactions between three views for detailed relation modeling. Moreover, extensive experiments on two datasets illustrate the superiority of our methods over several state-of-the-art methods.


title: 2021 BEETL Competition: Advancing Transfer Learning for Subject Independence & Heterogenous EEG Data Sets

abstract: Transfer learning and meta-learning offer some of the most promising avenues to unlock the scalability of healthcare and consumer technologies driven by biosignal data. This is because current methods cannot generalise well across human subjects' data and handle learning from different heterogeneously collected data sets, thus limiting the scale of training data. On the other side, developments in transfer learning would benefit significantly from a real-world benchmark with immediate practical application. Therefore, we pick electroencephalography (EEG) as an exemplar for what makes biosignal machine learning hard. We design two transfer learning challenges around diagnostics and Brain-Computer-Interfacing (BCI), that have to be solved in the face of low signal-to-noise ratios, major variability among subjects, differences in the data recording sessions and techniques, and even between the specific BCI tasks recorded in the dataset. Task 1 is centred on the field of medical diagnostics, addressing automatic sleep stage annotation across subjects. Task 2 is centred on Brain-Computer Interfacing (BCI), addressing motor imagery decoding across both subjects and data sets. The BEETL competition with its over 30 competing teams and its 3 winning entries brought attention to the potential of deep transfer learning and combinations of set theory and conventional machine learning techniques to overcome the challenges. The results set a new state-of-the-art for the real-world BEETL benchmark.


title: Model Attribution of Face-swap Deepfake Videos

abstract: AI-created face-swap videos, commonly known as Deepfakes, have attracted wide attention as powerful impersonation attacks. Existing research on Deepfakes mostly focuses on binary detection to distinguish between real and fake videos. However, it is also important to determine the specific generation model for a fake video, which can help attribute it to the source for forensic investigation. In this paper, we fill this gap by studying the model attribution problem of Deepfake videos. We first introduce a new dataset with DeepFakes from Different Models (DFDM) based on several Autoencoder models. Specifically, five generation models with variations in encoder, decoder, intermediate layer, input resolution, and compression ratio have been used to generate a total of 6,450 Deepfake videos based on the same input. Then we take Deepfakes model attribution as a multiclass classification task and propose a spatial and temporal attention based method to explore the differences among Deepfakes in the new dataset. Experimental evaluation shows that most existing Deepfakes detection methods failed in Deepfakes model attribution, while the proposed method achieved over 70% accuracy on the high-quality DFDM dataset.


title: Superconductivity in cuprates governed by topological constraints

abstract: The remarkable universality of the cuprate $T_c$ dome suggests a very fundamental unifying principle. Moreover, the superconducting gap is known to persist above $T_c$ in the pseudogap phase of all cuprates. So, contrary to BCS, the gap cannot be the order parameter of the transition. In this work, we show that both the $T_c$-dome and the pseudogap line $T^*(p)$ arise from a unique and identifiable principle: the interaction of localized `pairons' on an antiferromagnetic square lattice. The topological constraints on such preformed pairons give rise to both the $T_c$ dome and the pairing energy {\it simultaneously}. It also provides a natural explanation for the critical doping points of the phase diagram. The model matches perfectly both the $T^*$ and $T_c$ experimental lines, with only one adjustable parameter.


title: Optimal finite-time heat engines under constrained control

abstract: We optimize finite-time stochastic heat engines with a periodically scaled Hamiltonian under experimentally motivated constraints on the bath temperature $T$ and the scaling parameter $\lambda$. We present a general geometric proof that maximum-efficiency protocols for $T$ and $\lambda$ are piecewise constant, alternating between the maximum and minimum allowed values. When $\lambda$ is restricted to a small range and the system is close to equilibrium at the ends of the isotherms, a similar argument shows that this protocol also maximizes output power. These results are valid for arbitrary dynamics. We illustrate them for an overdamped Brownian heat engine, which can experimentally be realized using optical tweezers with stiffness $\lambda$.


title: A Hardware-Aware System for Accelerating Deep Neural Network Optimization

abstract: Recent advances in Neural Architecture Search (NAS) which extract specialized hardware-aware configurations (a.k.a. "sub-networks") from a hardware-agnostic "super-network" have become increasingly popular. While considerable effort has been employed towards improving the first stage, namely, the training of the super-network, the search for derivative high-performing sub-networks is still largely under-explored. For example, some recent network morphism techniques allow a super-network to be trained once and then have hardware-specific networks extracted from it as needed. These methods decouple the super-network training from the sub-network search and thus decrease the computational burden of specializing to different hardware platforms. We propose a comprehensive system that automatically and efficiently finds sub-networks from a pre-trained super-network that are optimized to different performance metrics and hardware configurations. By combining novel search tactics and algorithms with intelligent use of predictors, we significantly decrease the time needed to find optimal sub-networks from a given super-network. Further, our approach does not require the super-network to be refined for the target task a priori, thus allowing it to interface with any super-network. We demonstrate through extensive experiments that our system works seamlessly with existing state-of-the-art super-network training methods in multiple domains. Moreover, we show how novel search tactics paired with evolutionary algorithms can accelerate the search process for ResNet50, MobileNetV3 and Transformer while maintaining objective space Pareto front diversity and demonstrate an 8x faster search result than the state-of-the-art Bayesian optimization WeakNAS approach.


title: Spatially distributed computation in cortical circuits

abstract: The traditional view of neural computation in the cerebral cortex holds that sensory neurons are specialized, i.e., selective for certain dimensions of sensory stimuli. This view was challenged by evidence of contextual interactions between stimulus dimensions in which a neuron's response to one dimension strongly depends on other dimensions. Here we use methods of mathematical modeling, psychophysics, and electrophysiology to address shortcomings of the traditional view. Using a model of a generic cortical circuit, we begin with the simple demonstration that cortical responses are always distributed among neurons, forming characteristic waveforms, which we call neural waves. When stimulated by patterned stimuli, circuit responses arise by interference of neural waves. Resulting patterns of interference depend on interaction between stimulus dimensions. Comparison of these modeled responses with responses of biological vision makes it clear that the framework of neural wave interference provides a useful alternative to the standard concept of neural computation.


title: Agile requirements engineering practices: a survey in Brazilian software development companies

abstract: Requirements Engineering (RE) is one of the prime areas in software development. Since agile software development englobes several emerging techniques and advocates for continuous improvement, it urges the question of which agile RE practices are currently most used, their characteristics, and the challenges in their employment. The aim of this work is to investigate and categorize the collection and specification of agile requirements practices based on how professionals perceive their importance for a software project that applies agile methodologies. Thus, a survey was carried out with forty-six (46) Brazilian software development professionals, inquiring which methods are used for the collection and specification of agile requirements, as well as the features, benefits, and difficulties when employing the methods. The responses allowed us to perform data analysis and identify the relationships between the respondents' experience and the viewpoints on the collection methods and the agile requirements specification. In addition, it was noted that the adoption of these methods is still very recent. They have mainly been used for less than five years. Moreover, it was noted that, for most respondents, there are yet significant challenges and advances to be made for better efficiency in applying the informed methods.


title: Deep Neural Network for Automatic Assessment of Dysphonia

abstract: The purpose of this work is to contribute to the understanding and improvement of deep neural networks in the field of vocal quality. A neural network that predicts the perceptual assessment of overall severity of dysphonia in GRBAS scale is obtained. The design focuses on amplitude perturbations, frequency perturbations, and noise. Results are compared with performance of human raters on the same data. Both the precision and the mean absolute error of the neural network are close to human intra-rater performance, exceeding inter-rater performance.


title: Off-Policy Evaluation with Policy-Dependent Optimization Response

abstract: The intersection of causal inference and machine learning for decision-making is rapidly expanding, but the default decision criterion remains an \textit{average} of individual causal outcomes across a population. In practice, various operational restrictions ensure that a decision-maker's utility is not realized as an \textit{average} but rather as an \textit{output} of a downstream decision-making problem (such as matching, assignment, network flow, minimizing predictive risk). In this work, we develop a new framework for off-policy evaluation with \textit{policy-dependent} linear optimization responses: causal outcomes introduce stochasticity in objective function coefficients. Under this framework, a decision-maker's utility depends on the policy-dependent optimization, which introduces a fundamental challenge of \textit{optimization} bias even for the case of policy evaluation. We construct unbiased estimators for the policy-dependent estimand by a perturbation method, and discuss asymptotic variance properties for a set of adjusted plug-in estimators. Lastly, attaining unbiased policy evaluation allows for policy optimization: we provide a general algorithm for optimizing causal interventions. We corroborate our theoretical results with numerical simulations.


title: Image reconstruction algorithms in radio interferometry: from handcrafted to learned regularization denoisers

abstract: We introduce a new class of iterative image reconstruction algorithms for radio interferometry, at the interface of convex optimization and deep learning, inspired by plug-and-play methods. The approach consists in learning a prior image model by training a deep neural network (DNN) as a denoiser, and substituting it for the handcrafted proximal regularization operator of an optimization algorithm. The proposed AIRI (``AI for Regularization in radio-interferometric Imaging'') framework, for imaging complex intensity structure with diffuse and faint emission from visibility data, inherits the robustness and interpretability of optimization, and the learning power and speed of networks. Our approach relies on three steps. Firstly, we design a low dynamic range training database from optical intensity images. Secondly, we train a DNN denoiser at a noise level inferred from the signal-to-noise ratio of the data. We use training losses enhanced with a nonexpansiveness term ensuring algorithm convergence, and including on-the-fly database dynamic range enhancement via exponentiation. Thirdly, we plug the learned denoiser into the forward-backward optimization algorithm, resulting in a simple iterative structure alternating a denoising step with a gradient-descent data-fidelity step. We have validated AIRI against CLEAN, optimization algorithms of the SARA family, and a DNN trained to reconstruct the image directly from visibility data. Simulation results show that AIRI is competitive in imaging quality with SARA and its unconstrained forward-backward-based version uSARA, while providing significant acceleration. CLEAN remains faster but offers lower quality. The end-to-end DNN offers further acceleration, but with far lower quality than AIRI.


title: Quantum vacuum under mixed boundary conditions: the case for curved spacetime

abstract: Influence of gravity on the quantum vacuum of a massless minimally coupled scalar field under Robin boundary conditions on parallel plates is investigated. We introduce the detailed calculation of the volume energy for the case the gravitational background is weak in its most general form for a static spacetime. It founds that the quantum vacuum usually reacts to the gravitational field by decreasing the Casimir energy. In addition, we find sufficient conditions under which the Casimir force increases. Interestingly, the first order perturbation corrections, are present in the obtained formula for the volume energy. We show that for some specific choices of parameters, the energy is independent of Robin coefficients. Consistency with the literature is shown in some limiting cases and well-known examples are presented for both an increase or decrease in the volume energy.


title: Derivative-Free Bound-Constrained Optimization for Solving Structured Problems with Surrogate Models

abstract: We propose and analyze a model-based derivative-free (DFO) algorithm for solving bound-constrained optimization problems where the objective function is the composition of a smooth function and a vector of black-box functions. We assume that the black-box functions are smooth and the evaluation of them is the computational bottleneck of the algorithm. The distinguishing feature of our algorithm is the use of approximate function values at interpolation points which can be obtained by an application-specific surrogate model that is cheap to evaluate. As an example, we consider the situation in which a sequence of related optimization problems is solved and present a regression-based approximation scheme that uses function values that were evaluated when solving prior problem instances. In addition, we propose and analyze a new algorithm for obtaining interpolation points that handles unrelaxable bound constraints. Our numerical results show that our algorithm outperforms a state-of-the-art DFO algorithm for solving a least-squares problem from a chemical engineering application when a history of black-box function evaluations is available.


title: How Do Mothers and Fathers Talk About Parenting to Different Audiences?: Stereotypes and Audience Effects: An Analysis of r/Daddit, r/Mommit, and r/Parenting Using Topic Modelling

abstract: While major strides have been made towards gender equality in public life, serious inequality remains in the domestic sphere, especially around parenting. The present study analyses discussions about parenting on Reddit to explore audience effects and gender stereotypes. It suggests a novel method to study topical variation in individuals' language when interacting with different audiences. Comments posted in 2020 were collected from three parenting subreddits, described as being for fathers (r/Daddit), mothers (r/Mommit), and all parents (r/Parenting). Users posting on r/Parenting and r/Daddit or on r/Parenting and r/Mommit were assumed to identify as fathers or mothers, respectively, allowing gender comparison. Users' comments on r/Parenting (to a mixed-gender audience) were compared with their comments to single-gender audiences on r/Daddit or r/Mommit using LDA topic modelling. Results showed that the most discussed topic among parents is about education and family advice, a topic mainly discussed in the mixed-gender subreddit and more by fathers than mothers. Regarding the basic needs of children (sleep, food, and medical care), mothers seemed to be more concerned regardless of the audience. In contrast, topics such as birth and pregnancy announcements and physical appearance were more discussed by fathers in the father-centric subreddit. Overall, findings seem to show that mothers are generally more concerned about the practical sides of parenting while fathers' expressed concerns are more contextual: with other fathers, there seems to be a desire to show their fatherhood and be recognized for it while they discuss education with mothers. These results demonstrate that concerns expressed by parents on Reddit are context-sensitive but also consistent with gender stereotypes, potentially reflecting a persistent gendered and unequal division of labour in parenting.


title: Glueball-Meson Mixing In Holographic QCD

abstract: Top-down holographic QCD models often work in the "probe" (or "quenched") limit, which assumes that the number of colors is much greater than the number of flavors. Relaxing this limit is essential to a fuller understanding of holography and more accurate phenomenological predictions. In this work, we focus on a mixing of glueball and meson mass eigenstates that arises from the DBI action as a finite Nf/Nc effect. For concreteness, we work in the Witten-Sakai-Sugimoto model, and show that this mixing must be treated in conjunction with the backreaction of the flavor branes onto the background geometry. Including the backreaction with the simplification that it is "smeared out" over the compact transverse direction, we derive a corrected effective action for the vector glueball and scalar states. Along the way, we observe a Stueckelberg-like mechanism that restores translation invariance in the transverse direction. We also derive a general technique, that lends itself easily to numerics, for finding mass eigenstates of Lagrangians with vector-scalar mixing. We then calculate the first order corrections to the mass spectra of both the vector and scalar particles, and show that the term that explicitly mixes vector and scalar states is the most significant correction to the masses of low-lying scalar mesons.


title: Skyrmion crystals in centrosymmetric triangular magnets under hexagonal and trigonal single-ion anisotropy

abstract: We theoretically report an instability toward a skyrmion crystal in centrosymmetric magnets under hexagonal and trigonal single-ion anisotropy. The results are obtained for a minimal spin model with a crystal-dependent single-ion anisotropy on a triangular lattice by performing simulated annealing. By constructing magnetic phase diagrams in the presence of six different types of single-ion anisotropy while changing the amplitudes of external magnetic field and single-ion anisotropy in a systematic way, we find that the hexagonal and trigonal single-ion anisotropy becomes a source of the skyrmion crystal depending on the magnetic-field direction. We show that the skyrmion crystal is stabilized by the uniaxial-type or trigonal-type single-ion anisotropy under the out-of-plane magnetic field, while it is stabilized by the hexagonal-type inplane single-ion anisotropy under the inplane magnetic field. We also find various multiple-$Q$ spin states depending on the types of the single-ion anisotropy.


title: Quantum Persistent Homology

abstract: Persistent homology is a powerful mathematical tool that summarizes useful information about the shape of data allowing one to detect persistent topological features while one adjusts the resolution. However, the computation of such topological features is often a rather formidable task necessitating the subsampling the underlying data. To remedy this, we develop an efficient quantum computation of persistent Betti numbers, which track topological features of data across different scales. Our approach employs a persistent Dirac operator whose square yields the persistent combinatorial Laplacian, and in turn the underlying persistent Betti numbers which capture the persistent features of data. We also test our algorithm on point cloud data.


title: A geometric take on Kostant's Convexity Theorem

abstract: Given a compact Lie group $G$ and an orthogonal $G$-representation $V$, we give a purely metric criterion for a closed subset of the orbit space $V/G$ to have convex pre-image in $V$. In fact, this also holds with the natural quotient map $V\to V/G$ replaced with an arbitrary submetry $V\to X$. In this context, we introduce a notion of "fat section" which generalizes polar representations, representations of non-trivial copolarity, and isoparametric foliations. We show that Kostant's Convexity Theorem partially generalizes from polar representations to submetries with a fat section, and give examples illustrating that it does not fully generalize to this situation.


title: Exploring with Sticky Mittens: Reinforcement Learning with Expert Interventions via Option Templates

abstract: Long horizon robot learning tasks with sparse rewards pose a significant challenge for current reinforcement learning algorithms. A key feature enabling humans to learn challenging control tasks is that they often receive expert intervention that enables them to understand the high-level structure of the task before mastering low-level control actions. We propose a framework for leveraging expert intervention to solve long-horizon reinforcement learning tasks. We consider \emph{option templates}, which are specifications encoding a potential option that can be trained using reinforcement learning. We formulate expert intervention as allowing the agent to execute option templates before learning an implementation. This enables them to use an option, before committing costly resources to learning it. We evaluate our approach on three challenging reinforcement learning problems, showing that it outperforms state-of-the-art approaches by two orders of magnitude. Videos of trained agents and our code can be found at: https://sites.google.com/view/stickymittens


title: Does Label Differential Privacy Prevent Label Inference Attacks?

abstract: Label differential privacy (label-DP) is a popular framework for training private ML models on datasets with public features and sensitive private labels. Despite its rigorous privacy guarantee, it has been observed that in practice label-DP does not preclude label inference attacks (LIAs): Models trained with label-DP can be evaluated on the public training features to recover, with high accuracy, the very private labels that it was designed to protect. In this work, we argue that this phenomenon is not paradoxical and that label-DP is designed to limit the advantage of an LIA adversary compared to predicting training labels using the Bayes classifier. At label-DP $\epsilon=0$ this advantage is zero, hence the optimal attack is to predict according to the Bayes classifier and is independent of the training labels. Our bound shows the semantic protection conferred by label-DP and gives guidelines on how to choose $\varepsilon$ to limit the threat of LIAs below a certain level. Finally, we empirically demonstrate that our result closely captures the behavior of simulated attacks on both synthetic and real world datasets.


title: On abelian covers of the projective line with fixed gonality and many rational points

abstract: A smooth geometrically connected curve over the finite field $\mathbb{F}_q$ with gonality $\gamma$ has at most ${\gamma(q+1)}$ rational points. The first author and Grantham conjectured that there exist curves of every sufficiently large genus with gonality $\gamma$ that achieve this bound. In this paper, we show that this bound can be achieved for an infinite sequence of genera using abelian covers of the projective line. We also argue that abelian covers will not suffice to prove the full conjecture.


title: Critical Infrastructure Cybersecurity Challenges: IoT In Perspective

abstract: A technology platform that is gradually bridging the gap between object visibility and remote accessibility is the Internet of Things (IoT). Rapid deployment of this application can significantly transform the health, housing, and power (distribution and generation) sectors, etc. It has considerably changed the power sector regarding operations, services optimization, power distribution, asset management and aided in engaging customers to reduce energy consumption. Despite its societal opportunities and the benefits it presents, the power generation sector is bedeviled with many security challenges on the critical infrastructure. This review discusses the security challenges posed by IoT in power generation and critical infrastructure. To achieve this, the authors present the various IoT applications, particularly on the grid infrastructure, from an empirical literature perspective. The authors concluded by discussing how the various entities in the sector can overcome these security challenges to ensure an exemplary future IoT implementation on the power critical infrastructure value chain.


title: Grain boundary segregation in steels: Towards engineering the design of internal interfaces

abstract: Solute decoration at grain boundaries (GB) leads to a number of phenomenon such as changes in interface structure,mobility,cohesion etc.Recent experimental investigations on interfacial segregation in steels are based on microstructural characterisation using two correlative methodologies, namely,Transmission Electron Microscopy-Atom Probe Tomography (APT) and Electron Backscatter Diffraction-APT.Considering the growing interest in this avenue,the present review is aimed at addressing the common adsorption isotherms used for quantifying interfacial segregation and providing an overview of the present state of experimental research in the area of GB segregation in steels.The areas where an understanding of GB segregation may be utilised have also been highlighted with a focus on the experimental challenges associated with understanding GB segregation in steels.


title: FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment

abstract: We present Face Swapping GAN (FSGAN) for face swapping and reenactment. Unlike previous work, we offer a subject agnostic swapping scheme that can be applied to pairs of faces without requiring training on those faces. We derive a novel iterative deep learning--based approach for face reenactment which adjusts significant pose and expression variations that can be applied to a single image or a video sequence. For video sequences, we introduce a continuous interpolation of the face views based on reenactment, Delaunay Triangulation, and barycentric coordinates. Occluded face regions are handled by a face completion network. Finally, we use a face blending network for seamless blending of the two faces while preserving the target skin color and lighting conditions. This network uses a novel Poisson blending loss combining Poisson optimization with a perceptual loss. We compare our approach to existing state-of-the-art systems and show our results to be both qualitatively and quantitatively superior. This work describes extensions of the FSGAN method, proposed in an earlier conference version of our work, as well as additional experiments and results.


title: Hypercube Quantum Search: Exact Computation of the Probability of Success in Polynomial Time

abstract: In the emerging domain of quantum algorithms, the Grover's quantum search is certainly one of the most significant. It is relatively simple, performs a useful task and more importantly, does it in an optimal way. However, due to the success of quantum walks in the field, it is logical to study quantum search variants over several kind of walks. In this paper, we propose an in-depth study of the quantum search over a hypercube layout. First, through the analysis of elementary walk operators restricted to suitable eigenspaces, we show that the acting component of the search algorithm takes place in a small subspace of the Hilbert workspace that grows linearly with the problem size. Subsequently, we exploit this property to predict the exact evolution of the probability of success of the quantum search in polynomial time.


title: Correlated disorder induced anomalous transport in magnetically doped topological insulators

abstract: We examine the transport properties of magnetically doped topological insulator (TI) thin films subject to correlated non-magnetic disorder. For the disorder we choose a quasi-periodic potential with a random phase. We restrict the disorder to a central region, which is coupled to two leads in a clean quantum spin Hall insulator (QSHI) state and concentrate on different orientations of the quasi-periodicity in the two-dimensional central region. In the case of a diagonally oriented or purely longitudinal quasi-periodicity we find different topological Anderson insulator (TAI) phases, with a quantum anomalous Hall insulator (QAHI), a quantum spin Chern insulator (QSCI), or a QSHI phase being realized before the Anderson insulation takes over at large disorder strength. Quantized transport from extended bulk states is found for diagonal quasi-periodicity in addition to the above TAI phases that are also observed for the case of uncorrelated disorder. For a purely transverse orientation of the quasi-periodicity the emerging QSHI and QSCI phases persist to arbitrarily strong disorder potential. These topological phase transitions (except to the Anderson insulator phase), can be understood from a self consistent Born approximation.


title: Degenerations of Pascal Lines

abstract: Let $\mathcal{K}$ denote a nonsingular conic in the complex projective plane. Pascal's theorem says that, given six distinct points $A,B,C,D,E,F$ on $\mathcal{K}$, the three intersection points $AE \cap BF, AD \cap CF, BD \cap CE$ are collinear. The line containing them is called the Pascal line of the sextuple. However, this construction may fail when some of the six points come together. In this paper, we find the indeterminacy locus where the Pascal line is not well-defined and then use blow-ups along polydiagonals to define it. We analyse the geometry of Pascals in these degenerate cases. Finally we offer some remarks about the indeterminacy of other geometric elements in Pascal's hexagrammum mysticum.


title: The toy-model of the Boltzmann type equation for the contact force distribution in disordered packings of particles

abstract: The packing of hard-core particles in contact with their neighbors is considered as the simplest model of disordered particulate media. We formulate the statically determinate problem which allows analytical investigation of the statistical distribution of contact force magnitude. The toy-model of the Boltzmann type equation for the probability of contact force distribution is formulated and studied. An experimentally observed exponential distribution is derived.

categories: cond-mat.stat-mech math-ph math.MP nlin.SI


title: Learning physics-informed simulation models for soft robotic manipulation: A case study with dielectric elastomer actuators

abstract: Soft actuators offer a safe, adaptable approach to tasks like gentle grasping and dexterous manipulation. Creating accurate models to control such systems however is challenging due to the complex physics of deformable materials. Accurate Finite Element Method (FEM) models incur prohibitive computational complexity for closed-loop use. Using a differentiable simulator is an attractive alternative, but their applicability to soft actuators and deformable materials remains underexplored. This paper presents a framework that combines the advantages of both. We learn a differentiable model consisting of a material properties neural network and an analytical dynamics model of the remainder of the manipulation task. This physics-informed model is trained using data generated from FEM, and can be used for closed-loop control and inference. We evaluate our framework on a dielectric elastomer actuator (DEA) coin-pulling task. We simulate the task of using DEA to pull a coin along a surface with frictional contact, using FEM, and evaluate the physics-informed model for simulation, control, and inference. Our model attains < 5% simulation error compared to FEM, and we use it as the basis for an MPC controller that requires fewer iterations to converge than model-free actor-critic, PD, and heuristic policies.


title: Virtual permutations and polymorhisms

abstract: There is a natural map from a symmetric group $S_n$ to a smaller symmetric group $S_{n-1}$, we write a decomposition of a permutation into a product of disjoint cycles and remove the element $n$ from this expression. For this reason there exists the inverse limit $\mathfrak{S}$ of sets $S_n$. We equip $S_n$ with the uniform distribution (or more generally with an Ewens distribution) and get a structure of a measure space on $\mathfrak{S}$ (it is called 'virtual permutations' or 'Chinese restaurant process'), a double $S_\infty\times S_\infty $ of an infinite symmetric group acts on $\mathfrak{S}$ by left and right 'multiplications'. We discuss the closure of $S_\infty\times S_\infty $ in the semigroup of polymorphisms (spreading maps with spreaded Radon--Nikodym derivatives) of $\mathfrak{S}$. We get formulas for some polymorphisms, in particular for the center of the closure. Expressions are sums of multiple convolutions of Dirichlet distributions, summation sets are certain collections of dessins d'enfant.


title: Generalised Gaussian Process Latent Variable Models (GPLVM) with Stochastic Variational Inference

abstract: Gaussian process latent variable models (GPLVM) are a flexible and non-linear approach to dimensionality reduction, extending classical Gaussian processes to an unsupervised learning context. The Bayesian incarnation of the GPLVM Titsias and Lawrence, 2010] uses a variational framework, where the posterior over latent variables is approximated by a well-behaved variational family, a factorized Gaussian yielding a tractable lower bound. However, the non-factories ability of the lower bound prevents truly scalable inference. In this work, we study the doubly stochastic formulation of the Bayesian GPLVM model amenable with minibatch training. We show how this framework is compatible with different latent variable formulations and perform experiments to compare a suite of models. Further, we demonstrate how we can train in the presence of massively missing data and obtain high-fidelity reconstructions. We demonstrate the model's performance by benchmarking against the canonical sparse GPLVM for high-dimensional data examples.


title: Simulability of high-dimensional quantum measurements

abstract: We investigate the compression of quantum information with respect to a given set $\mathcal{M}$ of high-dimensional measurements. This leads to a notion of simulability, where we demand that the statistics obtained from $\mathcal{M}$ and an arbitrary quantum state $\rho$ are recovered exactly by first compressing $\rho$ into a lower dimensional space, followed by some quantum measurements. A full quantum compression is possible, i.e., leaving only classical information, if and only if the set $\mathcal{M}$ is jointly measurable. Our notion of simulability can thus be seen as a quantification of measurement incompatibility in terms of dimension. After defining these concepts, we provide an illustrative examples involving mutually unbiased basis, and develop a method based on semi-definite programming for constructing simulation models. In turn we analytically construct optimal simulation models for all projective measurements subjected to white noise or losses. Finally, we discuss how our approach connects with other concepts introduced in the context of quantum channels and quantum correlations.


title: Scalable Gaussian-process regression and variable selection using Vecchia approximations

abstract: Gaussian process (GP) regression is a flexible, nonparametric approach to regression that naturally quantifies uncertainty. In many applications, the number of responses and covariates are both large, and a goal is to select covariates that are related to the response. For this setting, we propose a novel, scalable algorithm, coined VGPR, which optimizes a penalized GP log-likelihood based on the Vecchia GP approximation, an ordered conditional approximation from spatial statistics that implies a sparse Cholesky factor of the precision matrix. We traverse the regularization path from strong to weak penalization, sequentially adding candidate covariates based on the gradient of the log-likelihood and deselecting irrelevant covariates via a new quadratic constrained coordinate descent algorithm. We propose Vecchia-based mini-batch subsampling, which provides unbiased gradient estimators. The resulting procedure is scalable to millions of responses and thousands of covariates. Theoretical analysis and numerical studies demonstrate the improved scalability and accuracy relative to existing methods.


title: Graded Lie-Rinehart algebras

abstract: We introduce the class of graded Lie-Rinehart algebras as a natural generalization of the one of graded Lie algebras. For $G$ an abelian group, we show that if $L$ is a tight $G$-graded Lie-Rinehart algebra over an associative and commutative $G$-graded algebra $A$ then $L$ and $A$ decompose as the orthogonal direct sums $L = \bigoplus_{i \in I}I_i$ and $A = \bigoplus_{j \in J}A_j$, where any $I_i$ is a non-zero ideal of $L$, any $A_j$ is a non-zero ideal of $A$, and both decompositions satisfy that for any $i \in I$ there exists a unique $j \in J$ such that $A_jI_i \neq 0$. Furthermore, any $I_i$ is a graded Lie-Rinehart algebra over $A_j$. Also, under mild conditions, it is shown that the above decompositions of $L$ and $A$ are by means of the family of their, respective, gr-simple ideals.


title: Solving Large-Scale Dynamic Vehicle Routing Problems with Stochastic Requests

abstract: Dynamic vehicle routing problems (DVRPs) arise in several applications such as technician routing, meal delivery, and parcel shipping. We consider the DVRP with stochastic customer requests (DVRPSR), in which vehicles must be routed dynamically with the goal of maximizing the number of served requests. We model the DVRPSR as a multi-stage optimization problem, where the first-stage decision defines route plans for serving scheduled requests. Our main contributions are knapsack-based linear models to approximate accurately the expected reward-to-go, measured as the number of accepted requests, at any state of the stochastic system. These approximations are based on representing each vehicle as a knapsack with a capacity given by the remaining service time available along the vehicle's route. We combine these approximations with optimal acceptance and assignment decision rules and derive efficient and high-performing online scheduling policies. We further leverage good predictions of the expected reward-to-go to design initial route plans that facilitate serving dynamic requests. Computational experiments on very large instances based on a real street network demonstrate the effectiveness of the proposed methods in prescribing high-quality offline route plans and online scheduling decisions.


title: Wearable uBrain: Fabric Based-Spiking Neural Network

abstract: On garment intelligence influenced by artificial neural networks and neuromorphic computing is emerging as a research direction in the e-textile sector. In particular, bio inspired Spiking Neural Networks mimicking the workings of the brain show promise in recent ICT research applications. Taking such technological advancements and new research directions driving forward the next generation of e-textiles and smart materials, we present a wearable micro Brain capable of event driven artificial spiking neural network computation in a fabric based environment. We demonstrate a wearable Brain SNN prototype with multi-layer computation, enabling scalability and flexibility in terms of modifications for hidden layers to be augmented to the network. The wearable micro Brain provides a low size, weight and power artificial on-garment intelligent wearable solution with embedded functionality enabling offline adaptive learning through the provision of interchangeable resistor synaptic weightings. The prototype has been evaluated for fault tolerance, where we have determine the robustness of the circuit when certain parts are damaged. Validations were also conducted for movements to determine if the circuit can still perform accurate computation.


title: OCR-IDL: OCR Annotations for Industry Document Library Dataset

abstract: Pretraining has proven successful in Document Intelligence tasks where deluge of documents are used to pretrain the models only later to be finetuned on downstream tasks. One of the problems of the pretraining approaches is the inconsistent usage of pretraining data with different OCR engines leading to incomparable results between models. In other words, it is not obvious whether the performance gain is coming from diverse usage of amount of data and distinct OCR engines or from the proposed models. To remedy the problem, we make public the OCR annotations for IDL documents using commercial OCR engine given their superior performance over open source OCR models. The contributed dataset (OCR-IDL) has an estimated monetary value over 20K US$. It is our hope that OCR-IDL can be a starting point for future works on Document Intelligence. All of our data and its collection process with the annotations can be found in https://github.com/furkanbiten/idl_data.


title: Extracting Effective Subnetworks with Gumbel-Softmax

abstract: Large and performant neural networks are often overparameterized and can be drastically reduced in size and complexity thanks to pruning. Pruning is a group of methods, which seeks to remove redundant or unnecessary weights or groups of weights in a network. These techniques allow the creation of lightweight networks, which are particularly critical in embedded or mobile applications. In this paper, we devise an alternative pruning method that allows extracting effective subnetworks from larger untrained ones. Our method is stochastic and extracts subnetworks by exploring different topologies which are sampled using Gumbel Softmax. The latter is also used to train probability distributions which measure the relevance of weights in the sampled topologies. The resulting subnetworks are further enhanced using a highly efficient rescaling mechanism that reduces training time and improves performance. Extensive experiments conducted on CIFAR show the outperformance of our subnetwork extraction method against the related work.


title: A Brief Survey on Adaptive Video Streaming Quality Assessment

abstract: Quality of experience (QoE) assessment for adaptive video streaming plays a significant role in advanced network management systems. It is especially challenging in case of dynamic adaptive streaming schemes over HTTP (DASH) which has increasingly complex characteristics including additional playback issues. In this paper, we provide a brief overview of adaptive video streaming quality assessment. Upon our review of related works, we analyze and compare different variations of objective QoE assessment models with or without using machine learning techniques for adaptive video streaming. Through the performance analysis, we observe that hybrid models perform better than both quality-of-service (QoS) driven QoE approaches and signal fidelity measurement. Moreover, the machine learning-based model slightly outperforms the model without using machine learning for the same setting. In addition, we find that existing video streaming QoE assessment models still have limited performance, which makes it difficult to be applied in practical communication systems. Therefore, based on the success of deep learned feature representations for traditional video quality prediction, we also apply the off-the-shelf deep convolutional neural network (DCNN) to evaluate the perceptual quality of streaming videos, where the spatio-temporal properties of streaming videos are taken into consideration. Experiments demonstrate its superiority, which sheds light on the future development of specifically designed deep learning frameworks for adaptive video streaming quality assessment. We believe this survey can serve as a guideline for QoE assessment of adaptive video streaming.


title: Search for a W' boson decaying to a vector-like quark and a top or bottom quark in the all-jets final state at $\sqrt{s} =$ 13 TeV

abstract: A search is presented for a heavy W' boson resonance decaying to a B or T vector-like quark and a t or a b quark, respectively. The analysis is performed using proton-proton collisions collected with the CMS detector at the LHC. The data correspond to an integrated luminosity of 138 fb$^{-1}$ at a center-of-mass energy of 13 TeV. Both decay channels result in a signature with a t quark, a Higgs or Z boson, and a b quark, each produced with a significant Lorentz boost. The all-hadronic decays of the Higgs or Z boson and of the t quark are selected using jet substructure techniques to reduce standard model backgrounds, resulting in a distinct three-jet W' boson decay signature. No significant deviation in data with respect to the standard model background prediction is observed. Upper limits are set at 95% confidence level on the product of the W' boson cross section and the final state branching fraction. A W' boson with a mass below 3.1 TeV is excluded, given the benchmark model assumption of democratic branching fractions. In addition, limits are set based on generalizations of these assumptions. These are the most sensitive limits to date for this final state.


title: Flexible variable selection in the presence of missing data

abstract: In many applications, it is of interest to identify a parsimonious set of features, or panel, from multiple candidates that achieves a desired level of performance in predicting a response. This task is often complicated in practice by missing data arising from the sampling design or other random mechanisms. Most recent work on variable selection in missing data contexts relies in some part on a finite-dimensional statistical model, e.g., a generalized or penalized linear model. In cases where this model is misspecified, the selected variables may not all be truly scientifically relevant and can result in panels with suboptimal classification performance. To address this limitation, we propose a nonparametric variable selection algorithm combined with multiple imputation to develop flexible panels in the presence of missing-at-random data. We outline strategies based on the proposed algorithm that achieve control of commonly used error rates. Through simulations, we show that our proposal has good operating characteristics and results in panels with higher classification and variable selection performance compared to several existing penalized regression approaches in cases where a generalized linear model is misspecified. Finally, we use the proposed method to develop biomarker panels for separating pancreatic cysts with differing malignancy potential in a setting where complicated missingness in the biomarkers arose due to limited specimen volumes.


title: Role of Zirconium Conversion Coating in Corrosion Performance of Aluminum Alloys: An Integrated First-Principles and Multiphysics Modeling Approach

abstract: A variety of chromate-free conversion coatings are being actively investigated to improve the corrosion performance of light-weight alloys for aerospace and defense applications. Advancing conversion coating, however, requires an in-depth understanding of the underlying corrosion mechanisms in order to rationally design sustainable coatings. Here, we present a multiscale modeling approach to predict corrosion performance of metallic materials, with a focus on localized corrosion of Cu-containing aluminum alloys coated with ZrO2 layer. First-principles and transition-state theory are used to implement the kinetics model, which includes electrolyte-metal interfacial reactions. The modeling framework systematically characterizes and couples multiple electrochemical and physical (e.g., transport) phenomena to explore interrelationships between pit morphology, surface chemistry, and local environment. This multiscale model can quantitatively link the corrosion rate of ZrO2-coated aluminum alloys with the evolution of interfacial reactions during immersion, which is very difficult to establish using in situ experiments. We have evaluated the presented multiscale model using available experimental data. The rate of corrosion and pit stability were quantitatively assessed for various environmental parameters and applied potentials. Results show that Zr-based conversion coating strongly enhances the corrosion performance of aluminum alloys due to zirconium involvement in interfacial kinetics.


title: Attacks and Faults Injection in Self-Driving Agents on the Carla Simulator -- Experience Report

abstract: Machine Learning applications are acknowledged at the foundation of autonomous driving, because they are the enabling technology for most driving tasks. However, the inclusion of trained agents in automotive systems exposes the vehicle to novel attacks and faults, that can result in safety threats to the driv-ing tasks. In this paper we report our experimental campaign on the injection of adversarial attacks and software faults in a self-driving agent running in a driving simulator. We show that adversarial attacks and faults injected in the trained agent can lead to erroneous decisions and severely jeopardize safety. The paper shows a feasible and easily-reproducible approach based on open source simula-tor and tools, and the results clearly motivate the need of both protective measures and extensive testing campaigns.


title: Decomposing past and future: Integrated information decomposition based on shared probability mass exclusions

abstract: A core feature of complex systems is that the interactions between elements in the present causally constrain each-other as the system evolves through time. To fully model all of these interactions (between elements, as well as ensembles of elements), we can decompose the total information flowing from past to future into a set of non-overlapping temporal interactions that describe all the different modes by which information can flow. To achieve this, we propose a novel information-theoretic measure of temporal dependency ($I_{\tau sx}$) based on informative and misinformative local probability mass exclusions. To demonstrate the utility of this framework, we apply the decomposition to spontaneous spiking activity recorded from dissociated neural cultures of rat cerebral cortex to show how different modes of information processing are distributed over the system. Furthermore, being a localizable analysis, we show that $I_{\tau sx}$ can provide insight into the computational structure of single moments. We explore the time-resolved computational structure of neuronal avalanches and find that different types of information atoms have distinct profiles over the course of an avalanche, with the majority of non-trivial information dynamics happening before the first half of the cascade is completed. These analyses allow us to move beyond the historical focus on single measures of dependency such as information transfer or information integration, and explore a panoply of different relationships between elements (and groups of elements) in complex systems.


title: Projective Ranking-based GNN Evasion Attacks

abstract: Graph neural networks (GNNs) offer promising learning methods for graph-related tasks. However, GNNs are at risk of adversarial attacks. Two primary limitations of the current evasion attack methods are highlighted: (1) The current GradArgmax ignores the "long-term" benefit of the perturbation. It is faced with zero-gradient and invalid benefit estimates in certain situations. (2) In the reinforcement learning-based attack methods, the learned attack strategies might not be transferable when the attack budget changes. To this end, we first formulate the perturbation space and propose an evaluation framework and the projective ranking method. We aim to learn a powerful attack strategy then adapt it as little as possible to generate adversarial samples under dynamic budget settings. In our method, based on mutual information, we rank and assess the attack benefits of each perturbation for an effective attack strategy. By projecting the strategy, our method dramatically minimizes the cost of learning a new attack strategy when the attack budget changes. In the comparative assessment with GradArgmax and RL-S2V, the results show our method owns high attack performance and effective transferability. The visualization of our method also reveals various attack patterns in the generation of adversarial samples.


title: Generation of Synchronous Unpredictable Oscillations by Coupled Hopfield Neural Networks

abstract: A new criterion based on generalized synchronization is provided for the extension of unpredictable oscillations among coupled Hopfield neural networks (HNNs). It is shown that if a drive HNN possesses an unpredictable oscillation, then a response HNN also possesses such an oscillation provided that they are synchronized in the generalized sense. Extension of unpredictability in coupled 4D HNNs are exemplified with simulations. The auxiliary system approach and conditional Lyapunov exponents are utilized to demonstrate the presence of synchronization.


title: Near Optimal Reconstruction of Spherical Harmonic Expansions

abstract: We propose an algorithm for robust recovery of the spherical harmonic expansion of functions defined on the d-dimensional unit sphere $\mathbb{S}^{d-1}$ using a near-optimal number of function evaluations. We show that for any $f \in L^2(\mathbb{S}^{d-1})$, the number of evaluations of $f$ needed to recover its degree-$q$ spherical harmonic expansion equals the dimension of the space of spherical harmonics of degree at most $q$ up to a logarithmic factor. Moreover, we develop a simple yet efficient algorithm to recover degree-$q$ expansion of $f$ by only evaluating the function on uniformly sampled points on $\mathbb{S}^{d-1}$. Our algorithm is based on the connections between spherical harmonics and Gegenbauer polynomials and leverage score sampling methods. Unlike the prior results on fast spherical harmonic transform, our proposed algorithm works efficiently using a nearly optimal number of samples in any dimension d. We further illustrate the empirical performance of our algorithm on numerical examples.


title: Seagrass deformation affects fluid instability and tracer exchange in canopy flow

abstract: Monami is the synchronous waving of a submerged seagrass bed in response to unidirectional fluid flow. Here we develop a multiphase model for the dynamical instabilities and flow-driven collective motions of buoyant, deformable seagrass. We show that the impedance to flow due to the seagrass results in an unstable velocity shear layer at the canopy interface, leading to a periodic array of vortices that propagate downstream. Each passing vortex locally weakens the along-stream velocity at the canopy top, reducing the drag and allowing the deformed grass to straighten up just beneath it. This causes the grass to oscillate periodically. Crucially, the maximal grass deflection is out of phase with the vortices. A phase diagram for the onset of instability shows its dependence on the fluid Reynolds number and an effective buoyancy parameter. Less buoyant grass is more easily deformed by the flow and forms a weaker shear layer, with smaller vortices and less material exchange across the canopy top. While higher Reynolds number leads to stronger vortices and larger waving amplitudes of the seagrass, waving is maximized at intermediate grass buoyancy. All together, our theory and computations correct some misconceptions in interpretation of the mechanism and provide a robust explanation consistent with a number of experimental observations.


title: Self-Supervised and Interpretable Anomaly Detection using Network Transformers

abstract: Monitoring traffic in computer networks is one of the core approaches for defending critical infrastructure against cyber attacks. Machine Learning (ML) and Deep Neural Networks (DNNs) have been proposed in the past as a tool to identify anomalies in computer networks. Although detecting these anomalies provides an indication of an attack, just detecting an anomaly is not enough information for a user to understand the anomaly. The black-box nature of off-the-shelf ML models prevents extracting important information that is fundamental to isolate the source of the fault/attack and take corrective measures. In this paper, we introduce the Network Transformer (NeT), a DNN model for anomaly detection that incorporates the graph structure of the communication network in order to improve interpretability. The presented approach has the following advantages: 1) enhanced interpretability by incorporating the graph structure of computer networks; 2) provides a hierarchical set of features that enables analysis at different levels of granularity; 3) self-supervised training that does not require labeled data. The presented approach was tested by evaluating the successful detection of anomalies in an Industrial Control System (ICS). The presented approach successfully identified anomalies, the devices affected, and the specific connections causing the anomalies, providing a data-driven hierarchical approach to analyze the behavior of a cyber network.


title: Integrated multimodal artificial intelligence framework for healthcare applications

abstract: Artificial intelligence (AI) systems hold great promise to improve healthcare over the next decades. Specifically, AI systems leveraging multiple data sources and input modalities are poised to become a viable method to deliver more accurate results and deployable pipelines across a wide range of applications. In this work, we propose and evaluate a unified Holistic AI in Medicine (HAIM) framework to facilitate the generation and testing of AI systems that leverage multimodal inputs. Our approach uses generalizable data pre-processing and machine learning modeling stages that can be readily adapted for research and deployment in healthcare environments. We evaluate our HAIM framework by training and characterizing 14,324 independent models based on HAIM-MIMIC-MM, a multimodal clinical database (N=34,537 samples) containing 7,279 unique hospitalizations and 6,485 patients, spanning all possible input combinations of 4 data modalities (i.e., tabular, time-series, text, and images), 11 unique data sources and 12 predictive tasks. We show that this framework can consistently and robustly produce models that outperform similar single-source approaches across various healthcare demonstrations (by 6-33%), including 10 distinct chest pathology diagnoses, along with length-of-stay and 48-hour mortality predictions. We also quantify the contribution of each modality and data source using Shapley values, which demonstrates the heterogeneity in data modality importance and the necessity of multimodal inputs across different healthcare-relevant tasks. The generalizable properties and flexibility of our Holistic AI in Medicine (HAIM) framework could offer a promising pathway for future multimodal predictive systems in clinical and operational healthcare settings.


title: Lipschitz bounds for integral functionals with $(p,q)$-growth conditions

abstract: We study local regularity properties of local minimizer of scalar integral functionals of the form $$\mathcal F[u]:=\int_\Omega F(\nabla u)-f u\,dx$$ where the convex integrand $F$ satisfies controlled $(p,q)$-growth conditions. We establish Lipschitz continuity under sharp assumptions on the forcing term $f$ and improved assumptions on the growth conditions on $F$ with respect to the existing literature. Along the way, we establish an $L^\infty$-$L^2$-estimate for solutions of linear uniformly elliptic equations in divergence form which is optimal with respect to the ellipticity contrast of the coefficients.


title: Robust Estimation of Loss Models for Truncated and Censored Severity Data

abstract: In this paper, we consider robust estimation of claim severity models in insurance, when data are affected by truncation (due to deductibles), censoring (due to policy limits), and scaling (due to coinsurance). In particular, robust estimators based on the methods of trimmed moments (T-estimators) and winsorized moments (W-estimators) are pursued and fully developed. The general definitions of such estimators are formulated and their asymptotic properties are investigated. For illustrative purposes, specific formulas for T- and W-estimators of the tail parameter of a single-parameter Pareto distribution are derived. The practical performance of these estimators is then explored using the well-known Norwegian fire claims data. Our results demonstrate that T- and W-estimators offer a robust and computationally efficient alternative to the likelihood-based inference for models that are affected by deductibles, policy limits, and coinsurance.


title: Non-stationary Bandits and Meta-Learning with a Small Set of Optimal Arms

abstract: We study a sequential decision problem where the learner faces a sequence of $K$-armed bandit tasks. The task boundaries might be known (the bandit meta-learning setting), or unknown (the non-stationary bandit setting). For a given integer $M\le K$, the learner aims to compete with the best subset of arms of size $M$. We design an algorithm based on a reduction to bandit submodular maximization, and show that, for $T$ rounds comprised of $N$ tasks, in the regime of large number of tasks and small number of optimal arms $M$, its regret in both settings is smaller than the simple baseline of $\tilde{O}(\sqrt{KNT})$ that can be obtained by using standard algorithms designed for non-stationary bandit problems. For the bandit meta-learning problem with fixed task length $\tau$, we show that the regret of the algorithm is bounded as $\tilde{O}(NM\sqrt{M \tau}+N^{2/3}M\tau)$. Under additional assumptions on the identifiability of the optimal arms in each task, we show a bandit meta-learning algorithm with an improved $\tilde{O}(N\sqrt{M \tau}+N^{1/2}\sqrt{M K \tau})$ regret.


title: N-electron valence perturbation theory with reference wavefunctions from quantum computing: application to the relative stability of hydroxide anion and hydroxyl radical

abstract: Quantum simulations of the hydroxide anion and hydroxyl radical are reported, employing variational quantum algorithms for near-term quantum devices. The energy of each species is calculated along the dissociation curve, to obtain information about the stability of the molecular species being investigated. It is shown that simulations restricted to valence spaces incorrectly predict the hydroxyl radical to be more stable than the hydroxide anion. Inclusion of dynamical electron correlation from non-valence orbitals is demonstrated, through the integration of the variational quantum eigensolver and quantum subspace expansion methods in the workflow of N-electron valence perturbation theory, and shown to correctly predict the hydroxide anion to be more stable than the hydroxyl radical, provided that basis sets with diffuse orbitals are also employed. Finally, we calculate the electron affinity of the hydroxyl radical using an aug-cc-pVQZ basis on IBM's quantum devices.


title: Decision Making in Non-Stationary Environments with Policy-Augmented Monte Carlo Tree Search

abstract: Decision-making under uncertainty (DMU) is present in many important problems. An open challenge is DMU in non-stationary environments, where the dynamics of the environment can change over time. Reinforcement Learning (RL), a popular approach for DMU problems, learns a policy by interacting with a model of the environment offline. Unfortunately, if the environment changes the policy can become stale and take sub-optimal actions, and relearning the policy for the updated environment takes time and computational effort. An alternative is online planning approaches such as Monte Carlo Tree Search (MCTS), which perform their computation at decision time. Given the current environment, MCTS plans using high-fidelity models to determine promising action trajectories. These models can be updated as soon as environmental changes are detected to immediately incorporate them into decision making. However, MCTS's convergence can be slow for domains with large state-action spaces. In this paper, we present a novel hybrid decision-making approach that combines the strengths of RL and planning while mitigating their weaknesses. Our approach, called Policy Augmented MCTS (PA-MCTS), integrates a policy's actin-value estimates into MCTS, using the estimates to seed the action trajectories favored by the search. We hypothesize that PA-MCTS will converge more quickly than standard MCTS while making better decisions than the policy can make on its own when faced with nonstationary environments. We test our hypothesis by comparing PA-MCTS with pure MCTS and an RL agent applied to the classical CartPole environment. We find that PC-MCTS can achieve higher cumulative rewards than the policy in isolation under several environmental shifts while converging in significantly fewer iterations than pure MCTS.


title: SBbadger: Biochemical Reaction Networks with Definable Degree Distributions

abstract: Motivation: An essential step in developing computational tools for the inference, optimization, and simulation of biochemical reaction networks is gauging tool performance against earlier efforts using an appropriate set of benchmarks. General strategies for the assembly of benchmark models include collection from the literature, creation via subnetwork extraction and de novo generation. However, with respect to biochemical reaction networks, these approaches and their associated tools are either poorly suited to generate models that reflect the wide range of properties found in natural biochemical networks or to do so in numbers that enable rigorous statistical analysis. Results: In this work we present SBbadger, a python-based software tool for the generation of synthetic biochemical reaction or metabolic networks with user-defined degree distributions, multiple available kinetic formalisms, and a host of other definable properties. SBbadger thus enables the creation of benchmark model sets that reflect properties of biological systems and generate the kinetics and model structures typically targeted by computational analysis and inference software. Here we detail the computational and algorithmic workflow of SBbadger, demonstrate its performance under various settings, provide samples outputs, and compare it to currently available biochemical reaction network generation software.


title: Intelligent Vision-based Autonomous Ship Landing of VTOL UAVs

abstract: The paper discusses an intelligent vision-based control solution for autonomous tracking and landing of Vertical Take-Off and Landing (VTOL) capable Unmanned Aerial Vehicles (UAVs) on ships without utilizing GPS signal. The central idea involves automating the Navy helicopter ship landing procedure where the pilot utilizes the ship as the visual reference for long-range tracking; however, refers to a standardized visual cue installed on most Navy ships called the "horizon bar" for the final approach and landing phases. This idea is implemented using a uniquely designed nonlinear controller integrated with machine vision. The vision system utilizes machine learning-based object detection for long-range ship tracking and classical computer vision for the estimation of aircraft relative position and orientation utilizing the horizon bar during the final approach and landing phases. The nonlinear controller operates based on the information estimated by the vision system and has demonstrated robust tracking performance even in the presence of uncertainties. The developed autonomous ship landing system was implemented on a quad-rotor UAV equipped with an onboard camera, and approach and landing were successfully demonstrated on a moving deck, which imitates realistic ship deck motions. Extensive simulations and flight tests were conducted to demonstrate vertical landing safety, tracking capability, and landing accuracy.


title: Weakly Supervised Instance Segmentation using Motion Information via Optical Flow

abstract: Weakly supervised instance segmentation has gained popularity because it reduces high annotation cost of pixel-level masks required for model training. Recent approaches for weakly supervised instance segmentation detect and segment objects using appearance information obtained from a static image. However, it poses the challenge of identifying objects with a non-discriminatory appearance. In this study, we address this problem by using motion information from image sequences. We propose a two-stream encoder that leverages appearance and motion features extracted from images and optical flows. Additionally, we propose a novel pairwise loss that considers both appearance and motion information to supervise segmentation. We conducted extensive evaluations on the YouTube-VIS 2019 benchmark dataset. Our results demonstrate that the proposed method improves the Average Precision of the state-of-the-art method by 3.1.


title: Compressed Matrix Computations

abstract: Frugal computing is becoming an important topic for environmental reasons. In this context, several techniques have been proposed to reduce the storage of scientific data by dedicated compression methods specially tailored for arrays of floating-point numbers. While these techniques are quite efficient to save memory, they introduce additional computations to compress and decompress the data before processing them. In this article, we introduce a new lossy, fixed-rate compression technique for 2D-arrays of floating-point numbers which allows one to compute directly on the compressed data, without decompressing them. We obtain important speedups since less operations are needed to compute among the compressed data and since no decompression and re-compression is needed. More precisely, our technique makes it possible to perform basic linear algebra operations such as addition, multiplication by a constant among compressed matrices and dot product and matrix multiplication among partly uncompressed matrices. This work has been implemented into a tool named blaz and a comparison with the well-known compressor zfp in terms of execution-time and accuracy is presented.


title: Characterization of a Meso-Scale Wearable Robot for Bathing Assistance

abstract: Robotic bathing assistance has long been considered an important and practical task in healthcare. Yet, achieving flexible and efficient cleaning tasks on the human body is challenging, since washing the body involves direct human-robot physical contact and simple, safe, and effective devices are needed for bathing and hygiene. In this paper, we present a meso-scale wearable robot that can locomote along the human body to provide bathing and skin care assistance. We evaluated the cleaning performance of the robot system under different scenarios. The experiments on the pipe show that the robot can achieve cleaning percentage over 92% with two types of stretchable fabrics. The robot removed most of the debris with average values of 94% on a human arm and 93% on a manikin torso. The results demonstrate that the robot exhibits high performance in cleaning tasks.


title: Long-range dispersion-inclusive machine learning potentials for structure search and optimization of hybrid organic-inorganic interfaces

abstract: The computational prediction of the structure and stability of hybrid organic-inorganic interfaces provides important insights into the measurable properties of electronic thin film devices, coatings, and catalyst surfaces and plays an important role in their rational design. However, the rich diversity of molecular configurations and the important role of long-range interactions in such systems make it difficult to use machine learning (ML) potentials to facilitate structure exploration that otherwise require computationally expensive electronic structure calculations. We present an ML approach that enables fast, yet accurate, structure optimizations by combining two different types of deep neural networks trained on high-level electronic structure data. The first model is a short-ranged interatomic ML potential trained on local energies and forces, while the second is an ML model of effective atomic volumes derived from atoms-in-molecules partitioning. The latter can be used to connect short-range potentials to well-established density-dependent long-range dispersion correction methods. For two systems, specifically gold nanoclusters on diamond (110) surfaces and organic $\pi$-conjugated molecules on silver (111) surfaces, we train models on sparse structure relaxation data from density functional theory and show the ability of the models to deliver highly efficient structure optimizations and semi-quantitative energy predictions of adsorption structures.


title: Isometric Actions are Quasidiagonal

abstract: We show every isometric action is quasidiagonal in a strong sense. This shows that reduced crossed products by such actions are quasidiagonal or MF whenever the reduced algebra of the acting group is quasidiagonal or MF.


title: Chemoton 2.0: Autonomous Exploration of Chemical Reaction Networks

abstract: Fueled by advances in hardware and algorithm design, large-scale automated explorations of chemical reaction space have become possible. Here, we present our approach to an open-source, extensible framework for explorations of chemical reaction mechanisms based on the first principles of quantum mechanics. It is intended to facilitate reaction network explorations for diverse chemical problems with a wide range of goals such as mechanism elucidation, reaction path optimization, retrosynthetic path validation, reagent design, and microkinetic modeling. The stringent first-principles basis of all algorithms in our framework is key for the general applicability that avoids any restrictions to specific chemical systems. Such an agile framework requires multiple specialized software components of which we present three modules in this work. The key module, Chemoton,drives the exploration of reaction networks. For the exploration itself, we introduce two new algorithms for elementary-step searches that are based on Newton trajectories. The performance of these algorithms is assessed for a variety of reactions characterized by a broad chemical diversity in terms of bonding patterns and chemical elements. We reproduce and significantly extend what is known about these reactions and provide the resulting data to be used as a starting point for further explorations and for future reference.


title: Modeling of effective interactions between ligand coated nanoparticles through symmetry functions

abstract: Ligand coated nanoparticles are complex objects consisting of a metallic or semiconductor core with organic ligands grafted on their surface. These organic ligands provide stability to a nanoparticle suspension. In solutions, the effective interactions between such nanoparticles are mediated through a complex interplay of interactions between the nanoparticle cores, the surrounding ligands and the solvent molecules. While it is possible to compute these interactions using fully atomistic molecular simulations, such computations are too expensive for studying self-assembly of a large number of nanoparticles. The problem can be made tractable by removing the degrees of freedom associated with the ligand chains and solvent molecules and using the potentials of mean force (PMF) between nanoparticles. In general, the functional dependence of the PMFs on the inter-particle distance is unknown and can be quite complex. In this article, we present a method to model the two-body and three-body potentials of mean force between ligand coated nanoparticles through a linear combination of symmetry functions. The method is quite general and can be extended to model interactions between different types of macromolecules.