title: Inpainting CMB maps using Partial Convolutional Neural Networks

abstract: We present a novel application of partial convolutional neural networks (PCNN) that can inpaint masked images of the cosmic microwave background. The network can reconstruct both the maps and the power spectra to a few percent for circular and irregularly shaped masks covering up to ~10% of the image area. By performing a Kolmogorov-Smirnov test we show that the reconstructed maps and power spectra are indistinguishable from the input maps and power spectra at the 99.9% level. Moreover, we show that PCNNs can inpaint maps with regular and irregular masks to the same accuracy. This should be particularly beneficial to inpaint irregular masks for the CMB that come from astrophysical sources such as galactic foregrounds. The proof of concept application shown in this paper shows that PCNNs can be an important tool in data analysis pipelines in cosmology.


title: "You eat with your eyes first": Optimizing Yelp Image Advertising

abstract: A business's online, photographic representation can play a crucial role in its success or failure. We use Yelp's image dataset and star-based review system as a measurement of an image's effectiveness in promoting a business. After preprocessing the Yelp dataset, we use transfer learning to train a classifier which accepts Yelp images and predicts star-ratings. Additionally, we then train a GAN to qualitatively investigate the common properties of highly effective images. We achieve 90-98% accuracy in classifying simplified star ratings for various image categories and observe that images containing blue skies, open surroundings, and many windows are correlated with higher Yelp reviews.


title: Robust Algorithms for Online Convex Problems via Primal-Dual

abstract: Primal-dual methods in online optimization give several of the state-of-the art results in both of the most common models: adversarial and stochastic/random order. Here we try to provide a more unified analysis of primal-dual algorithms to better understand the mechanisms behind this important method. With this we are able of recover and extend in one goal several results of the literature. In particular, we obtain robust online algorithm for fairly general online convex problems: we consider the MIXED model where in some of the time steps the data is stochastic and in the others the data is adversarial. Both the quantity and location of the adversarial time steps are unknown to the algorithm. The guarantees of our algorithms interpolate between the (close to) best guarantees for each of the pure models. In particular, the presence of adversarial times does not degrade the guarantee relative to the stochastic part of the instance. Concretely, we first consider Online Convex Programming: at each time a feasible set $V_t$ is revealed, and the algorithm needs to select $v_t \in V_t$ to minimize the total cost $\psi(\sum_t v_t)$, for a convex function $\psi$. Our robust primal-dual algorithm for this problem on the MIXED model recovers and extends, for example, a result of Gupta et al. and recent work on $\ell_p$-norm load balancing by the author. We also consider the problem of Welfare Maximization with Convex Production Costs: at each time a customer presents a value $c_t$ and resource consumption vector $a_t$, and the goal is to fractionally select customers to maximize the profit $\sum_t c_t x_t - \psi(\sum_t a_t x_t)$. Our robust primal-dual algorithm on the MIXED model recovers and extends the result of Azar et al. Given the ubiquity of primal-dual algorithms we hope the ideas presented here will be useful in obtaining other robust algorithm in the MIXED or related models.


title: Developing High Quality Training Samples for Deep Learning Based Local Climate Zone Classification in Korea

abstract: Two out of three people will be living in urban areas by 2050, as projected by the United Nations, emphasizing the need for sustainable urban development and monitoring. Common urban footprint data provide high-resolution city extents but lack essential information on the distribution, pattern, and characteristics. The Local Climate Zone (LCZ) offers an efficient and standardized framework that can delineate the internal structure and characteristics of urban areas. Global-scale LCZ mapping has been explored, but are limited by low accuracy, variable labeling quality, or domain adaptation challenges. Instead, this study developed a custom LCZ data to map key Korean cities using a multi-scale convolutional neural network. Results demonstrated that using a novel, custom LCZ data with deep learning can generate more accurate LCZ map results compared to conventional community-based LCZ mapping with machine learning as well as transfer learning of the global So2Sat dataset.


title: Learning Deformable Tetrahedral Meshes for 3D Reconstruction

abstract: 3D shape representations that accommodate learning-based 3D reconstruction are an open problem in machine learning and computer graphics. Previous work on neural 3D reconstruction demonstrated benefits, but also limitations, of point cloud, voxel, surface mesh, and implicit function representations. We introduce Deformable Tetrahedral Meshes (DefTet) as a particular parameterization that utilizes volumetric tetrahedral meshes for the reconstruction problem. Unlike existing volumetric approaches, DefTet optimizes for both vertex placement and occupancy, and is differentiable with respect to standard 3D reconstruction loss functions. It is thus simultaneously high-precision, volumetric, and amenable to learning-based neural architectures. We show that it can represent arbitrary, complex topology, is both memory and computationally efficient, and can produce high-fidelity reconstructions with a significantly smaller grid size than alternative volumetric approaches. The predicted surfaces are also inherently defined as tetrahedral meshes, thus do not require post-processing. We demonstrate that DefTet matches or exceeds both the quality of the previous best approaches and the performance of the fastest ones. Our approach obtains high-quality tetrahedral meshes computed directly from noisy point clouds, and is the first to showcase high-quality 3D tet-mesh results using only a single image as input. Our project webpage: https://nv-tlabs.github.io/DefTet/


title: Environmental processing of galaxies in HI-rich groups

abstract: We present and explore the resolved atomic hydrogen (HI) content of 13 HI-rich and late-type dominated groups denoted `Choirs'. We quantify the HI content of the Choir galaxies with respect to the median of the HI-mass fraction ($f_{\textrm{HI}}$) of their grandparent HIPASS sample. We find that the HI mass fraction of the Choir galaxies is dispersed around the HIPASS median in the range $-1.4 \leq \Delta f_{\textrm{HI}}\textrm{[dex]}\leq 0.7$, from HI-excess to HI-deficient galaxy regime. The HI-excess/HI-deficient galaxies contain more/less than 2.5 times their expected HI content with respect to the HIPASS median. We show and discuss that the environmental processing in Choirs occurs via tidal stripping and galaxy mergers. Our analysis suggests that tidal stripping contributes to the loss of the HI, while galaxy mergers contribute to the enhancement of the HI. Exploring the mid-infrared properties of Choir galaxies we find possible environmental processing in only nine Choir galaxies, which indicates that environmental processing is more perceptible in the HI content than the mid-infrared properties. Moreover, we find that environmental processing occurs in Choir groups regardless of their global environment, whether they are in isolation or in proximity to the denser structures, such as cosmic web filaments. We explore possible scenarios of the Choirs evolution, taking into account their HI content, velocity dispersion, crossing time and their global environment. We conclude that the most likely evolution for the majority of Choir groups is that they will become more compact as their members undergo multiple HI-rich mergers.


title: A Scenario-Based Development Framework for Autonomous Driving

abstract: This article summarizes the research progress of scenario-based testing and development technology for autonomous vehicles. We systematically analyzed previous research works and proposed the definition of scenario, the elements of the scenario ontology, the data source of the scenario, the processing method of the scenario data, and scenario-based V-Model. Moreover, we summarized the automated test scenario construction method by random scenario generation and dangerous scenario generation.


title: Theory of Photon-Assisted Magnetoacoustic Resonance as a New Probe of Quadrupole Dynamics

abstract: Motivated by the recent progress of phonon-mediated control in quantum spin devices, we propose a possibility of hybrid measurement using electron paramagnetic resonance (EPR) and a surface acoustic wave (SAW). Considering quadrupole-strain (QS) couplings suggested for silicon vacancies, we present a minimum model of the two-level system to investigate a magnetoacoustic resonance (MAR) coupled to various strain modes driven by the SAW. The longitudinal and transverse QS couplings can be changed by rotating a magnetic field, which depends on a combination of the strain modes. Using the Floquet theory, we elucidate each coupling effect on the time-averaged transition probability, especially focus on a single-phonon transition process. The important result is that the longitudinal QS coupling brings about a sharp photon-assisted resonance and leads to an abrupt change in the field-angle dependent transition probability. Since this phonon transition process is always accompanied by the photon transition, the field angle for the sharp resonance peak can be detected by the EPR measurement. The hybrid EPR-MAR measurement is useful to confirm the existence of quadrupole degrees of freedom strongly coupled to elastic strains, and thus it is expected to be a complementary probe for the precise evaluation of quadrupole properties.


title: Balanced Partitioning of Several Cache-Oblivious Algorithms

abstract: Frigo et al. proposed an ideal cache model and a recursive technique to design sequential cache-efficient algorithms in a cache-oblivious fashion. Ballard et al. pointed out that it is a fundamental open problem to extend the technique to an arbitrary architecture. Ballard et al. raised another open question on how to parallelize Strassen's algorithm exactly and efficiently on an arbitrary number of processors. We propose a novel way of partitioning a cache-oblivious algorithm to achieve perfect strong scaling on an arbitrary number, even a prime number, of processors within a certain range in a shared-memory setting. Our approach is Processor-Aware but Cache-Oblivious (PACO). We demonstrate our approach on several important cache-oblivious algorithms, including LCS, 1D, GAP, classic rectangular matrix multiplication on a semiring, and Strassen's algorithm. We discuss how to extend our approach to a distributed-memory architecture, or even a heterogeneous computing system. Hence, our work may provide a new perspective on the fundamental open problem of extending the recursive cache-oblivious technique to an arbitrary architecture. We provide an almost exact solution to the open problem on parallelizing Strassen. Our approach may provide a new perspective on extending the recursive cache-oblivious technique to an arbitrary architecture. All our algorithms demonstrate better scalability or better overall parallel cache complexities than the best known algorithms. Preliminary experiments justify our theoretical prediction that the PACO algorithms can outperform significantly state-of-the-art Processor-Oblivious (PO) and Processor-Aware (PA) counterparts.


title: Statistical and Analytical Approaches to Finite Temperature Magnetic Properties of SmFe$_{12}$

abstract: To investigate the magnetic properties of SmFe$_{12}$, we construct an effective spin model, where magnetic moments, crystal field (CF) parameters, and exchange fields at 0 K are determined by first principles. Finite temperature magnetic properties are investigated by using this model. We further develop an analytical method with strong mixing of states with different quantum number of angular momentum $J$ ($J$-mixing), which is caused by strong exchange field acting on spin component of 4$f$ electrons. Comparing our analytical results with those calculated by Boltzmann statistics, we clarify that the previous analytical studies for Sm transition metal compounds over-estimate the $J$-mixing effects. The present method enables us to make quantitative analysis of temperature dependence of magnetic anisotropy (MA) with high-reliability. The analytical method with model approximations reveals that the $J$-mixing caused by exchange field increases spin angular momentum, which enhances the absolute value of orbital angular momentum and MA constants via spin-orbit interaction. It is also clarified that these J-mixing effects remain even above room temperature. Magnetization of SmFe$_{12}$ shows peculiar field dependence known as first-order magnetization process (FOMP), where the magnetization shows an abrupt change at certain magnetic field. The result of the analysis shows that the origin of FOMP is attributed to competitive MA constants between positive $K_1$ and negative $K_2$. The sign of $K_{1(2)}$ appears due to an increase in CF potential denoted by the parameter $A_2^0\langle r^2\rangle$ ($A_4^0\langle r^4\rangle$) caused by hybridization between 3$d$-electrons of Fe on 8$i$ (8$j$) site and 5$d$ and 6$p$ valence electrons on Sm site. It is verified that the requirement for the appearance of FOMP is given as $-K_2<K_1<-6K_2$.


title: The switching mechanisms of social network densification

abstract: Densification and sparsification of temporal networks are attributed to two fundamental mechanisms: a change in the population in the system and/or a change in the chances that nodes in the system are connected. In theory, each of these mechanisms generates a distinctive type of densification scaling, but in reality both types are generally mixed. Here, we develop a Bayesian statistical method to identify the extent to which each of these mechanisms is at play at a given point in time, taking the mixed densification scaling as input. We apply the method to networks of face-to-face interactions of individuals and reveal that the main mechanism that causes densification and sparsification occasionally switches, the frequency of which depending on the social context. The proposed method uncovers an inherent regime-switching property of network dynamics, which will provide a new insight into the mechanics behind evolving social interactions.


title: A Score-and-Search Approach to Learning Bayesian Networks with Noisy-OR Relations

abstract: A Bayesian network is a probabilistic graphical model that consists of a directed acyclic graph (DAG), where each node is a random variable and attached to each node is a conditional probability distribution (CPD). A Bayesian network can be learned from data using the well-known score-and-search approach, and within this approach a key consideration is how to simultaneously learn the global structure in the form of the underlying DAG and the local structure in the CPDs. Several useful forms of local structure have been identified in the literature but thus far the score-and-search approach has only been extended to handle local structure in form of context-specific independence. In this paper, we show how to extend the score-and-search approach to the important and widely useful case of noisy-OR relations. We provide an effective gradient descent algorithm to score a candidate noisy-OR using the widely used BIC score and we provide pruning rules that allow the search to successfully scale to medium sized networks. Our empirical results provide evidence for the success of our approach to learning Bayesian networks that incorporate noisy-OR relations.


title: Towards Fundamental Limits of Multi-armed Bandits with Random Walk Feedback

abstract: In this paper, we consider a new Multi-Armed Bandit (MAB) problem where arms are nodes in an unknown and possibly changing graph, and the agent (i) initiates random walks over the graph by pulling arms, (ii) observes the random walk trajectories, and (iii) receives rewards equal to the lengths of the walks. We provide a comprehensive understanding of this problem by studying both the stochastic and the adversarial setting. We show that this problem is not easier than a standard MAB in an information theoretical sense, although additional information is available through random walk trajectories. Behaviors of bandit algorithms on this problem are also studied.


title: Visualization of Technical and Tactical Characteristics in Fencing

abstract: Fencing is a sport that relies heavily on the use of tactics. However, most existing methods for analyzing fencing data are based on statistical models in which hidden patterns are difficult to discover. Unlike sequential games, such as tennis and table tennis, fencing is a type of simultaneous game. Thus, the existing methods on the sports visualization do not operate well for fencing matches. In this study, we cooperated with experts to analyze the technical and tactical characteristics of fencing competitions. To meet the requirements of the fencing experts, we designed and implemented FencingVis, an interactive visualization system for fencing competition data.The action sequences in the bout are first visualized by modified bar charts to reveal the actions of footworks and bladeworks of both fencers. Then an interactive technique is provided for exploring the patterns of behavior of fencers. The different combinations of tactical behavior patterns are further mapped to the graph model and visualized by a tactical flow graph. This graph can reveal the different strategies adopted by both fencers and their mutual influence in one bout. We also provided a number of well-coordinated views to supplement the tactical flow graph and display the information of the fencing competition from different perspectives. The well-coordinated views are meant to organically integrate with the tactical flow graph through consistent visual style and view coordination. We demonstrated the usability and effectiveness of the proposed system with three case studies. On the basis of expert feedback, FencingVis can help analysts find not only the tactical patterns hidden in fencing bouts, but also the technical and tactical characteristics of the contestant.


title: A Two-Stage Approach to Device-Robust Acoustic Scene Classification

abstract: To improve device robustness, a highly desirable key feature of a competitive data-driven acoustic scene classification (ASC) system, a novel two-stage system based on fully convolutional neural networks (CNNs) is proposed. Our two-stage system leverages on an ad-hoc score combination based on two CNN classifiers: (i) the first CNN classifies acoustic inputs into one of three broad classes, and (ii) the second CNN classifies the same inputs into one of ten finer-grained classes. Three different CNN architectures are explored to implement the two-stage classifiers, and a frequency sub-sampling scheme is investigated. Moreover, novel data augmentation schemes for ASC are also investigated. Evaluated on DCASE 2020 Task 1a, our results show that the proposed ASC system attains a state-of-the-art accuracy on the development set, where our best system, a two-stage fusion of CNN ensembles, delivers a 81.9% average accuracy among multi-device test data, and it obtains a significant improvement on unseen devices. Finally, neural saliency analysis with class activation mapping (CAM) gives new insights on the patterns learnt by our models.


title: Some embedding results for associative algebras

abstract: Suppose we wish to embed an (associative) $k$-algebra $A$ in a $k$-algebra $R$ generated in some specified way; e.g., by two elements, or by copies of given $k$-algebras $A_1,$ $A_2,$ $A_3.$ Several authors have obtained sufficient conditions for such embeddings to exist. We prove here some further results on this theme. In particular, we merge the ideas of existing constructions based on two generating elements, and on three given subalgebra, to get a construction using two given subalgebras. We pose some questions on how these results can be further strengthened.


title: Energy Efficient Pairing and Power Optimization for NOMA UAV Network under QoS Constraints

abstract: Due to an increasing number of unmanned aerial vehicles (UAVs) with generally limited battery power, energy efficient data transmission schemes with massive connectivity capabilities are required for future wireless networks. Non-orthogonal multiple access (NOMA) is one of the promising techniques that provide such massive connectivity by allowing superposed data transmission of multiple users over the same resource block. Unlike existing literature, this paper presents a user pairing and power allocation technique for energy efficient and quality of service (QoS) aware NOMA transmission for cellular-connected mobile UAVs. The aim is to minimize the power consumption of the mobile UAVs during uplink data transmission and guarantee their required transmission rate by jointly optimizing the UAV pairing and power allocation. Furthermore, the performance and pairing complexity for mobile UAVs is analyzed to show that the proposed pairing technique efficiently fulfills their QoS requirements. Numerical and simulation results show the performance gain of the proposed technique compared to the conventional NOMA techniques.


title: Indeterminacy in classical cosmology with dark matter

abstract: We describe a case of indeterminacy in general relativity for homogeneous and isotropic cosmologies for a class of dark energy fluids. The cosmologies are parametrized by an equation of state variable, with one instance giving the same solution as Norton's mechanical dome. Our example goes beyond previously studied cases in that indeterminacy lies in the evolution of spacetime itself: the onset of the Big Bang is indeterminate. We show further that the indeterminacy is resolved if the dynamics is viewed relationally.


title: The unit norm index and $p$-class group in certain degree $\ell$ extensions

abstract: We examine when units in a field are the norms of elements in an extension field, given certain conditions. We apply these results to the study of the $\ell$-class groups in lifts of the anti-cyclotomic $\mathbb{Z}_2$-extension of $\mathbb{Q}(i)$.


title: Meta-Learning for Natural Language Understanding under Continual Learning Framework

abstract: Neural network has been recognized with its accomplishments on tackling various natural language understanding (NLU) tasks. Methods have been developed to train a robust model to handle multiple tasks to gain a general representation of text. In this paper, we implement the model-agnostic meta-learning (MAML) and Online aware Meta-learning (OML) meta-objective under the continual framework for NLU tasks. We validate our methods on selected SuperGLUE and GLUE benchmark.


title: Participation in TREC 2020 COVID Track Using Continuous Active Learning

abstract: We describe our participation in all five rounds of the TREC 2020 COVID Track (TREC-COVID). The goal of TREC-COVID is to contribute to the response to the COVID-19 pandemic by identifying answers to many pressing questions and building infrastructure to improve search systems [8]. All five rounds of this Track challenged participants to perform a classic ad-hoc search task on the new data collection CORD-19. Our solution addressed this challenge by applying the Continuous Active Learning model (CAL) and its variations. Our results showed us to be amongst the top scoring manual runs and we remained competitive within all categories of submissions.


title: Contact Mode Guided Sampling-Based Planning for Quasistatic Dexterous Manipulation in 2D

abstract: The discontinuities and multi-modality introduced by contacts make manipulation planning challenging. Many previous works avoid this problem by pre-designing a set of high-level motion primitives like grasping and pushing. However, such motion primitives are often not adequate to describe dexterous manipulation motions. In this work, we propose a method for dexterous manipulation planning at a more primitive level. The key idea is to use contact modes to guide the search in a sampling-based planning framework. Our method can automatically generate contact transitions and motion trajectories under the quasistatic assumption. In the experiments, this method sometimes generates motions that are often pre-designed as motion primitives, as well as dexterous motions that are more task-specific.


title: Distributed Machine Learning with Strategic Network Design: A Game-Theoretic Perspective

abstract: This paper considers a game-theoretic framework for distributed machine learning problems over networks where the information acquisition at a node is modeled as a rational choice of a player. In the proposed game, players decide both the learning parameters and the network structure. The Nash equilibrium characterizes the tradeoff between the local performance and the global agreement of the learned classifiers. We first introduce a commutative approach which features a joint learning process that integrates the iterative learning at each node and the network formation. We show that our game is equivalent to a generalized potential game in the setting of undirected networks. We study the convergence of the proposed commutative algorithm, analyze the network structures determined by our game, and show the improvement of the social welfare in comparison with standard distributed learning over fixed networks. To adapt our framework to streaming data, we derive a distributed Kalman filter. A concurrent algorithm based on the online mirror descent algorithm is also introduced for solving for Nash equilibria in a holistic manner. In the case study, we use telemonitoring of Parkinson's disease to corroborate the results.


title: Frequency-compensated PINNs for Fluid-dynamic Design Problems

abstract: Incompressible fluid flow around a cylinder is one of the classical problems in fluid-dynamics with strong relevance with many real-world engineering problems, for example, design of offshore structures or design of a pin-fin heat exchanger. Thus learning a high-accuracy surrogate for this problem can demonstrate the efficacy of a novel machine learning approach. In this work, we propose a physics-informed neural network (PINN) architecture for learning the relationship between simulation output and the underlying geometry and boundary conditions. In addition to using a physics-based regularization term, the proposed approach also exploits the underlying physics to learn a set of Fourier features, i.e. frequency and phase offset parameters, and then use them for predicting flow velocity and pressure over the spatio-temporal domain. We demonstrate this approach by predicting simulation results over out of range time interval and for novel design conditions. Our results show that incorporation of Fourier features improves the generalization performance over both temporal domain and design space.


title: Blockchain based Attack Detection on Machine Learning Algorithms for IoT based E-Health Applications

abstract: The application of machine learning (ML) algorithms are massively scaling-up due to rapid digitization and emergence of new tecnologies like Internet of Things (IoT). In today's digital era, we can find ML algorithms being applied in the areas of healthcare, IoT, engineering, finance and so on. However, all these algorithms need to be trained in order to predict/solve a particular problem. There is high possibility of tampering the training datasets and produce biased results. Hence, in this article, we have proposed blockchain based solution to secure the datasets generated from IoT devices for E-Health applications. The proposed blockchain based solution uses using private cloud to tackle the aforementioned issue. For evaluation, we have developed a system that can be used by dataset owners to secure their data.


title: A stabilizer free, pressure robust, and superconvergence weak Galerkin finite element method for the Stokes Equations on polytopal mesh

abstract: In this paper, we propose a new stabilizer free and pressure robust WG method for the Stokes equations with super-convergence on polytopal mesh in the primary velocity-pressure formulation. Convergence rates with one order higher than the optimal-order for velocity in both energy-norm and the $L^2$-norm and for pressure in $L^2$-norm are proved in our proposed scheme. The $H$(div)-preserving operator has been constructed based on the polygonal mesh for arbitrary polynomial degrees and employed in the body source assembling to break the locking phenomenon induced by poor mass conservation in the classical discretization. Moreover, the velocity error in our proposed scheme is proved to be independent of pressure and thus confirm the pressure-robustness. For Stokes simulation, our proposed scheme only modifies the body source assembling but remains the same stiffness matrix. Four numerical experiments are conducted to validate the convergence results and robustness.


title: Weakly- and Semi-supervised Evidence Extraction

abstract: For many prediction tasks, stakeholders desire not only predictions but also supporting evidence that a human can use to verify its correctness. However, in practice, additional annotations marking supporting evidence may only be available for a minority of training examples (if available at all). In this paper, we propose new methods to combine few evidence annotations (strong semi-supervision) with abundant document-level labels (weak supervision) for the task of evidence extraction. Evaluating on two classification tasks that feature evidence annotations, we find that our methods outperform baselines adapted from the interpretability literature to our task. Our approach yields substantial gains with as few as hundred evidence annotations. Code and datasets to reproduce our work are available at https://github.com/danishpruthi/evidence-extraction.


title: Training Wake Word Detection with Synthesized Speech Data on Confusion Words

abstract: Confusing-words are commonly encountered in real-life keyword spotting applications, which causes severe degradation of performance due to complex spoken terms and various kinds of words that sound similar to the predefined keywords. To enhance the wake word detection system's robustness on such scenarios, we investigate two data augmentation setups for training end-to-end KWS systems. One is involving the synthesized data from a multi-speaker speech synthesis system, and the other augmentation is performed by adding random noise to the acoustic feature. Experimental results show that augmentations help improve the system's robustness. Moreover, by augmenting the training set with the synthetic data generated by the multi-speaker text-to-speech system, we achieve a significant improvement regarding confusing words scenario.


title: Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation

abstract: Gait recognition is one of the most important biometric technologies and has been applied in many fields. Recent gait recognition frameworks represent each gait frame by descriptors extracted from either global appearances or local regions of humans. However, the representations based on global information often neglect the details of the gait frame, while local region based descriptors cannot capture the relations among neighboring regions, thus reducing their discriminativeness. In this paper, we propose a novel feature extraction and fusion framework to achieve discriminative feature representations for gait recognition. Towards this goal, we take advantage of both global visual information and local region details and develop a Global and Local Feature Extractor (GLFE). Specifically, our GLFE module is composed of our newly designed multiple global and local convolutional layers (GLConv) to ensemble global and local features in a principle manner. Furthermore, we present a novel operation, namely Local Temporal Aggregation (LTA), to further preserve the spatial information by reducing the temporal resolution to obtain higher spatial resolution. With the help of our GLFE and LTA, our method significantly improves the discriminativeness of our visual features, thus improving the gait recognition performance. Extensive experiments demonstrate that our proposed method outperforms state-of-the-art gait recognition methods on two popular datasets.


title: Distribution-aware Margin Calibration for Medical Image Segmentation

abstract: The Jaccard index, also known as Intersection-over-Union (IoU score), is one of the most critical evaluation metrics in medical image segmentation. However, directly optimizing the mean IoU (mIoU) score over multiple objective classes is an open problem. Although some algorithms have been proposed to optimize its surrogates, there is no guarantee provided for their generalization ability. In this paper, we present a novel data-distribution-aware margin calibration method for a better generalization of the mIoU over the whole data-distribution, underpinned by a rigid lower bound. This scheme ensures a better segmentation performance in terms of IoU scores in practice. We evaluate the effectiveness of the proposed margin calibration method on two medical image segmentation datasets, showing substantial improvements of IoU scores over other learning schemes using deep segmentation models.


title: Simultaneous three-axis torque measurements of micromagnetism

abstract: Measurements of magnetic torque are most commonly preformed about a single axis or component of torque. Such measurements are very useful for hysteresis measurements of thin film structures in particular, where high shape anisotropy yields a near-proportionality of in-plane magnetic moment and the magnetic torque along the perpendicular in-plane axis. A technique to measure the full magnetic torque vector (three orthogonal torque components) on micro- and nano-scale magnetic materials is introduced. The method is demonstrated using a modified, single-paddle silicon-on-insulator resonant torque sensor. The mechanical compliances to all three orthogonal torque components are maximized by clamping the sensor at a single point. Mechanically-resonant AC torques are driven by an RF field containing a frequency component for each fundamental torsional mode of the device, and the resulting displacements read out through optical position-sensitive detection. The measurements are compared with micromagnetic simulations of the mechanical torque to augment the interpretation of the signals. As an application example, simultaneous observations of hysteresis in the net magnetization along with the field-dependent in-plane anisotropy is highly beneficial for studies of exchange bias.


title: Autoencoding Features for Aviation Machine Learning Problems

abstract: The current practice of manually processing features for high-dimensional and heterogeneous aviation data is labor-intensive, does not scale well to new problems, and is prone to information loss, affecting the effectiveness and maintainability of machine learning (ML) procedures. This research explored an unsupervised learning method, autoencoder, to extract effective features for aviation machine learning problems. The study explored variants of autoencoders with the aim of forcing the learned representations of the input to assume useful properties. A flight track anomaly detection autoencoder was developed to demonstrate the versatility of the technique. The research results show that the autoencoder can not only automatically extract effective features for the flight track data, but also efficiently deep clean data, thereby reducing the workload of data scientists. Moreover, the research leveraged transfer learning to efficiently train models for multiple airports. Transfer learning can reduce model training times from days to hours, as well as improving model performance. The developed applications and techniques are shared with the whole aviation community to improve effectiveness of ongoing and future machine learning studies.


title: Theory of dynamical stability for two- and three-dimensional Lennard-Jones crystals

abstract: The dynamical stability of three-dimensional (3D) Lennard-Jones (LJ) crystals has been studied for many years. The face-centered-cubic and hexagonal close packed structures are dynamically stable, while the body-centered cubic structure is stable only for long range LJ potentials that are characterized by relatively small integer pairs $(m,n)$. Here, we study the dynamical stability of two-dimensional (2D) LJ crystals, where the planar hexagonal, the buckled honeycomb, and the buckled square structures are assumed. We demonstrate that the stability property of 2D and 3D LJ crystals can be classified into four groups depending on $(m,n)$. The instabilities of the planar hexagonal, the buckled square, and the body-centered cubic structures are investigated within analytical expressions. The structure-stability relationship between the LJ crystals and the elemental metals in the periodic table is also discussed.


title: Deconfinement and Hadron Resonance Gas for Heavy Quarks

abstract: I discuss the deconfinement transition in 2+1 flavor QCD in terms of Polyakov loops as well as the hadron resonance gas for hadrons containing static quarks and charm quarks.


title: Semi-invariants of Binary Forms Pertaining to a Unimodality Theorem of Reiner and Stanton

abstract: The symmetric difference of the $q$-binomial coefficients $F_{n,k}(q)={n+k\brack k}-q^{n}{n+k-2\brack k-2}$ was introduced by Reiner and Stanton. They proved that $F_{n,k}(q)$ is symmetric and unimodal for $k \geq 2$ and $n$ even by using the representation theory for Lie algebras. Based on Sylvester's proof of the unimodality of the Gaussian coefficients, as conjectured by Cayley, we find an interpretation of the unimodality of $F_{n,k}(q)$ in terms of semi-invariants. In the spirit of the strict unimodality of the Gaussian coefficients due to Pak and Panova, we prove the strict unimodality of the symmetric difference $G_{n,k,r}(q)={n+k\brack k}-q^{nr/2}{n+k-r\brack k-r}$, except for the two terms at both ends, where $n,r\geq8$, $k\geq r$ and at least one of $n$ and $r$ is even.


title: An Incentive Based Approach for COVID-19 using Blockchain Technology

abstract: The current situation of COVID-19 demands novel solutions to boost healthcare services and economic growth. A full-fledged solution that can help the government and people retain their normal lifestyle and improve the economy is crucial. By bringing into the picture a unique incentive-based approach, the strain of government and the people can be greatly reduced. By providing incentives for actions such as voluntary testing, isolation, etc., the government can better plan strategies for fighting the situation while people in need can benefit from the incentive offered. This idea of combining strength to battle against the virus can bring out newer possibilities that can give an upper hand in this war. As the unpredictable future develops, sharing and maintaining COVID related data of every user could be the needed trigger to kick start the economy and blockchain paves the way for this solution with decentralization and immutability of data.


title: L\'{e}vy walk dynamics in mixed potentials from the perspective of random walk theory

abstract: L\'evy walk process is one of the most effective models to describe superdiffusion, which underlies some important movement patterns and has been widely observed in the micro and macro dynamics. From the perspective of random walk theory, here we investigate the dynamics of L\'evy walks under the influences of the constant force field and the one combined with harmonic potential. Utilizing Hermite polynomial approximation to deal with the spatiotemporally coupled analysis challenges, some striking features are detected, including non Gaussian stationary distribution, faster diffusion, and still strongly anomalous diffusion, etc.


title: Fractional Spin fluctuations and quantum liquid signature in Gd2ZnIrO6

abstract: Hitherto, the discrete identification of quantum spin liquid phase, holy grail of condensed matter physics, remains a challenging task experimentally. However, the precursor of quantum spin liquid state may reflect in the spin dynamics even in the paramagnetic phase over a wide temperature range as conjectured theoretically. Here we report comprehensive inelastic light (Raman) scattering measurements on the Ir based double perovskite, Gd2ZnIrO6, as a function of different incident photon energies and polarization in a broad temperature range. Our results evidenced the spin fractionalization within the paramagnetic phase reflected in the emergence of a polarization independent quasi-elastic peak at low energies with lowering temperature. Also, the fluctuating scattering amplitude measured via dynamic Raman susceptibility increases with lowering temperature and decreases mildly upon entering into long-range magnetic ordering phase, below 23 K, suggesting the magnetic origin of these fluctuations. This anomalous scattering response is thus indicative of fluctuating fractional spin evincing the quantum spin liquid phase in a three-dimensional double perovskite system.


title: New multi-hump exact solitons of a coupled Korteweg-de-Vries system with conformable derivative describing shallow water waves via RCAM

abstract: In this article, a modification of the rapidly convergent approximation method is proposed to solve a coupled Korteweg-de Vries equations with conformable derivative that govern shallow-water waves. Based on the Leibniz and chain rule of conformable derivative, these equations reduced into ODEs with integer-order using traveling wave transformation. Adopting the modified scheme a new novel exact solution of the reduced coupled ordinary differential equations is obtained in terms of exponential functions. Finally, by putting them back into traveling wave transformation the solutions of the considered partial differential equations with conformable derivative are derived. To ensure the boundedness of the derived solutions few theorems have been proposed and proved. The derived results of the theorems are utilized to plot the solutions. Graphics exhibit that solutions have variant multi-hump soliton peculiarities and their tails decay to zero exponentially in a monotonic manner. These results not only show the efficiency of the modified scheme but also establish that the solution is enriched with new multi-hump features.


title: MACE: Model Agnostic Concept Extractor for Explaining Image Classification Networks

abstract: Deep convolutional networks have been quite successful at various image classification tasks. The current methods to explain the predictions of a pre-trained model rely on gradient information, often resulting in saliency maps that focus on the foreground object as a whole. However, humans typically reason by dissecting an image and pointing out the presence of smaller concepts. The final output is often an aggregation of the presence or absence of these smaller concepts. In this work, we propose MACE: a Model Agnostic Concept Extractor, which can explain the working of a convolutional network through smaller concepts. The MACE framework dissects the feature maps generated by a convolution network for an image to extract concept based prototypical explanations. Further, it estimates the relevance of the extracted concepts to the pre-trained model's predictions, a critical aspect required for explaining the individual class predictions, missing in existing approaches. We validate our framework using VGG16 and ResNet50 CNN architectures, and on datasets like Animals With Attributes 2 (AWA2) and Places365. Our experiments demonstrate that the concepts extracted by the MACE framework increase the human interpretability of the explanations, and are faithful to the underlying pre-trained black-box model.


title: A Framework for Prediction and Storage of Battery Life in IoT Devices using DNN and Blockchain

abstract: As digitization increases, the need to automate various entities becomes crucial for development. The data generated by the IoT devices need to be processed accurately and in a secure manner. The basis for the success of such a scenario requires blockchain as a means of unalterable data storage to improve the overall security and trust in the system. By providing trust in an automated system, with real-time data updates to all stakeholders, an improved form of implementation takes the stage and can help reduce the stress of adaptability to complete automated systems. This research focuses on a use case with respect to the real time Internet of Things (IoT) network which is deployed at the beach of Chicago Park District. This real time data which is collected from various sensors is then used to design a predictive model using Deep Neural Networks for estimating the battery life of IoT sensors that is deployed at the beach. This proposed model could help the government to plan for placing orders of replaceable batteries before time so that there can be an uninterrupted service. Since this data is sensitive and requires to be secured, the predicted battery life value is stored in blockchain which would be a tamper-proof record of the data.


title: SGB: Stochastic Gradient Bound Method for Optimizing Partition Functions

abstract: This paper addresses the problem of optimizing partition functions in a stochastic learning setting. We propose a stochastic variant of the bound majorization algorithm that relies on upper-bounding the partition function with a quadratic surrogate. The update of the proposed method, that we refer to as Stochastic Partition Function Bound (SPFB), resembles scaled stochastic gradient descent where the scaling factor relies on a second order term that is however different from the Hessian. Similarly to quasi-Newton schemes, this term is constructed using the stochastic approximation of the value of the function and its gradient. We prove sub-linear convergence rate of the proposed method and show the construction of its low-rank variant (LSPFB). Experiments on logistic regression demonstrate that the proposed schemes significantly outperform SGD. We also discuss how to use quadratic partition function bound for efficient training of deep learning models and in non-convex optimization.


title: Grain-Boundary Topological Phase Transitions

abstract: The formation and migration of disconnections (line defects constrained to the grain boundary (GB) plane with both dislocation and step character) control many of the kinetic and dynamical properties of GBs and the polycrystalline materials of which they are central constituents. We demonstrate that GBs undergo a finite-temperature topological phase transition of the Kosterlitz-Thouless (KT) type. This phase transition corresponds to the screening of long-range interactions between (and unbinding of) disconnections. This phase transition leads to abrupt change in the behavior of GB migration, GB sliding, and roughening. We analyze this KT transition through mean-field theory, renormalization group theory, and kinetic Monte Carlo simulations, and examine how this transition affects microstructure-scale phenomena such as grain growth stagnation, abnormal grain growth and superplasticity.


title: Communication-Aware Multi-robot Coordination with Submodular Maximization

abstract: Submodular maximization has been widely used in many multi-robot task planning problems including information gathering, exploration, and target tracking. However, the interplay between submodular maximization and communication is rarely explored in the multi-robot setting. In many cases, maximizing the submodular objective may drive the robots in a way so as to disconnect the communication network. Driven by such observations, in this paper, we consider the problem of maximizing submodular function with connectivity constraints. Specifically, we propose a problem called Communication-aware Submodular Maximization (CSM), in which communication maintenance and submodular maximization are jointly considered in the decision-making process. One heuristic algorithm that consists of two stages, i.e. \textit{topology generation} and \textit{deviation minimization} is proposed. We validate the formulation and algorithm through numerical simulation. We find that our algorithm on average suffers only slightly performance decrease compared to the pure greedy strategy.


title: Kernel Two-Dimensional Ridge Regression for Subspace Clustering

abstract: Subspace clustering methods have been widely studied recently. When the inputs are 2-dimensional (2D) data, existing subspace clustering methods usually convert them into vectors, which severely damages inherent structures and relationships from original data. In this paper, we propose a novel subspace clustering method for 2D data. It directly uses 2D data as inputs such that the learning of representations benefits from inherent structures and relationships of the data. It simultaneously seeks image projection and representation coefficients such that they mutually enhance each other and lead to powerful data representations. An efficient algorithm is developed to solve the proposed objective function with provable decreasing and convergence property. Extensive experimental results verify the effectiveness of the new method.


title: Testing Disk Identification Methods Through Numerical Simulations of Protostellar Evolution

abstract: We test whether the radii of circumstellar disks can be reliably determined in observations applying the results of a numerical simulation. Firstly, we execute a core collapse simulation which starts from a rotating magnetized spherical core, and continue the calculation until the protostellar mass reaches 0.5 Msun. Then, for each set of simulation data, we calculate the radiative transfer to generate the data cube for the synthetic observation. The spatial and velocity resolutions of the synthetic observation are 0.15 arcsec (20 au) and 0.1 km/s, respectively. We define seven different disk radii. Four radii are estimated from the synthetic observation, using the continuum image, continuum visibility, C18O channel map, and C18O position velocity (PV) diagram. The other three radii are taken from the simulation and use the disk rotation, infall motion, and density contrast around the protostar to identify the disk. Finally, we compare the disk radii estimated from the systemic observation with those from the simulation. We find that the disk radius defined using the PV diagram can reliably trace the Keplerian disk when the protostellar mass is larger than M_*>~ 0.2 Msun independent of the inclination angle to the line of sight. In addition, the PV diagram provides an accurate estimate of the central stellar mass through the whole protostellar evolution. The simulation also indicates that the circumstellar disk is massive enough to be gravitationally unstable through the evolution. Such an unstable disk can show either a circular or spiral morphology on a similar timescale.


title: Convergence of Graph Laplacian with kNN Self-tuned Kernels

abstract: Kernelized Gram matrix $W$ constructed from data points $\{x_i\}_{i=1}^N$ as $W_{ij}= k_0( \frac{ \| x_i - x_j \|^2} {\sigma^2} )$ is widely used in graph-based geometric data analysis and unsupervised learning. An important question is how to choose the kernel bandwidth $\sigma$, and a common practice called self-tuned kernel adaptively sets a $\sigma_i$ at each point $x_i$ by the $k$-nearest neighbor (kNN) distance. When $x_i$'s are sampled from a $d$-dimensional manifold embedded in a possibly high-dimensional space, unlike with fixed-bandwidth kernels, theoretical results of graph Laplacian convergence with self-tuned kernels have been incomplete. This paper proves the convergence of graph Laplacian operator $L_N$ to manifold (weighted-)Laplacian for a new family of kNN self-tuned kernels $W^{(\alpha)}_{ij} = k_0( \frac{ \| x_i - x_j \|^2}{ \epsilon \hat{\rho}(x_i) \hat{\rho}(x_j)})/\hat{\rho}(x_i)^\alpha \hat{\rho}(x_j)^\alpha$, where $\hat{\rho}$ is the estimated bandwidth function {by kNN}, and the limiting operator is also parametrized by $\alpha$. When $\alpha = 1$, the limiting operator is the weighted manifold Laplacian $\Delta_p$. Specifically, we prove the point-wise convergence of $L_N f $ and convergence of the graph Dirichlet form with rates. Our analysis is based on first establishing a $C^0$ consistency for $\hat{\rho}$ which bounds the relative estimation error $|\hat{\rho} - \bar{\rho}|/\bar{\rho}$ uniformly with high probability, where $\bar{\rho} = p^{-1/d}$, and $p$ is the data density function. Our theoretical results reveal the advantage of self-tuned kernel over fixed-bandwidth kernel via smaller variance error in low-density regions. In the algorithm, no prior knowledge of $d$ or data density is needed. The theoretical results are supported by numerical experiments on simulated data and hand-written digit image data.


title: Microwaves in Quantum Computing

abstract: Quantum information processing systems rely on a broad range of microwave technologies and have spurred development of microwave devices and methods in new operating regimes. Here we review the use of microwave signals and systems in quantum computing, with specific reference to three leading quantum computing platforms: trapped atomic ion qubits, spin qubits in semiconductors, and superconducting qubits. We highlight some key results and progress in quantum computing achieved through the use of microwave systems, and discuss how quantum computing applications have pushed the frontiers of microwave technology in some areas. We also describe open microwave engineering challenges for the construction of large-scale, fault-tolerant quantum computers.

categories: quant-ph cond-mat.mes-hall cond-mat.supr-con physics.atom-ph


title: Signal detection based on the chaotic motion of an antiferromagnetic domain wall

abstract: The antiferromagnetic domain wall dynamics is currently a hot topic in mesoscopic magnetic systems. In this work, it is found that, based on the Thiele approach, the motion of an antiferromagnetic domain wall is described by the Duffing equation. Numerical simulations demonstrate that the antiferromagnetic domain wall can be used as a Duffing oscillator, and the transition between the periodic and chaotic motion can be used to detect the periodic signal in the presence of the white noise. Furthermore, we calculate the bifurcation diagram and Lyapunov exponents to study the chaotic behavior of an antiferromagnetic domain wall. The numerical simulations are in good agreement with the analytical solutions. Our results may be useful for building spintronic detection devices based on antiferromagnetic domain walls.


title: Layer-Wise Multi-View Learning for Neural Machine Translation

abstract: Traditional neural machine translation is limited to the topmost encoder layer's context representation and cannot directly perceive the lower encoder layers. Existing solutions usually rely on the adjustment of network architecture, making the calculation more complicated or introducing additional structural restrictions. In this work, we propose layer-wise multi-view learning to solve this problem, circumventing the necessity to change the model structure. We regard each encoder layer's off-the-shelf output, a by-product in layer-by-layer encoding, as the redundant view for the input sentence. In this way, in addition to the topmost encoder layer (referred to as the primary view), we also incorporate an intermediate encoder layer as the auxiliary view. We feed the two views to a partially shared decoder to maintain independent prediction. Consistency regularization based on KL divergence is used to encourage the two views to learn from each other. Extensive experimental results on five translation tasks show that our approach yields stable improvements over multiple strong baselines. As another bonus, our method is agnostic to network architectures and can maintain the same inference speed as the original model.


title: Design Paradigms Based on Spring Agonists for Underactuated Robot Hands: Concepts and Application

abstract: In this paper, we focus on a rarely used paradigm in the design of underactuated robot hands: the use of springs as agonists and tendons as antagonists. We formalize this approach in a design matrix also considering its interplay with the underactuation method used (one tendon for multiple joints vs. multiple tendons on one motor shaft). We then show how different cells in this design matrix can be combined in order to facilitate the implementation of desired postural synergies with a single motor. Furthermore, we show that when agonist and antagonist tendons are combined on the same motor shaft, the resulting spring force cancellation can be leveraged to produce multiple desirable behaviors, which we demonstrate in a physical prototype.


title: High-dimensional structure learning of sparse vector autoregressive models using fractional marginal pseudo-likelihood

abstract: Learning vector autoregressive models from multivariate time series is conventionally approached through least squares or maximum likelihood estimation. These methods typically assume a fully connected model which provides no direct insight to the model structure and may lead to highly noisy estimates of the parameters. Because of these limitations, there has been an increasing interest towards methods that produce sparse estimates through penalized regression. However, such methods are computationally intensive and may become prohibitively time-consuming when the number of variables in the model increases. In this paper we adopt an approximate Bayesian approach to the learning problem by combining fractional marginal likelihood and pseudo-likelihood. We propose a novel method, PLVAR, that is both faster and produces more accurate estimates than the state-of-the-art methods based on penalized regression. We prove the consistency of the PLVAR estimator and demonstrate the attractive performance of the method on both simulated and real-world data.


title: Proximity Based Load Balancing Policies on Graphs: A Simulation Study

abstract: Distributed load balancing is the act of allocating jobs among a set of servers as evenly as possible. There are mainly two versions of the load balancing problem that have been studied in the literature: static and dynamic. The static interpretation leads to formulating the load balancing problem as a case with jobs (balls) never leaving the system and accumulating at the servers (bins) whereas the dynamic setting deals with the case when jobs arrive and leave the system after service completion. This paper designs and evaluates server proximity aware job allocation policies for treating load balancing problems with a goal to reduce the communication cost associated with the jobs. We consider a class of proximity aware Power of Two (POT) choice based assignment policies for allocating jobs to servers, where servers are interconnected as an n-vertex graph G(V, E). For the static version, we assume each job arrives at one of the servers, u. For the dynamic setting, we assume G to be a circular graph and job arrival process at each server is described by a Poisson point process with the job service time exponentially distributed. For both settings, we then assign each job to the server with minimum load among servers u and v where v is chosen according to one of the following two policies: (i) Unif-POT(k): Sample a server v uniformly at random from k-hop neighborhood of u (ii) InvSq-POT(k): Sample a server v from k-hop neighborhood of u with probability proportional to the inverse square of the distance between u and v. Our simulation results show that both the policies consistently produce a load distribution which is much similar to that of a classical proximity oblivious POT policy.


title: Intensity equations for birefringent spin lasers

abstract: Semiconductor spin lasers are distinguished from their conventional counterparts by the presence of spin-polarized carriers. The transfer of angular momentum of the spin-polarized carriers to photons provides important opportunities for the operation of lasers. With the injection of spin-polarized carriers, which lead to the circularly polarized light, the polarization of the emitted light can be changed an order of magnitude faster than its intensity. This ultrafast operation of spin lasers relies on a large birefringence, usually viewed as detrimental in spin and conventional lasers. We introduce a transparent description of spin lasers using intensity equations, which elucidate the influence of birefringence on the intensity and polarization modulation of lasers. While intensity modulation is independent of birefringence, for polarization modulation an increase in birefringence directly increases the resonant frequency. Our results for dynamical operation of lasers provide a guide for their spin-dependent response and spintronic applications beyond magnetoresistance.


title: Close-to-Convexity properties of Clausen's Hypergeometric Function $_3F_2(a,b,c;d,e;z)$

abstract: In this paper, we obtain various conditions on the parameters $a,\, b,\, c\,, d$ and $e$ for which the hypergeometric functions $z\,_3F_2(a,b,c;d,e;z)$ to be in the class of all close-to-convex function with respect to some well known convex functions.


title: Multi-armed Bandits with Cost Subsidy

abstract: In this paper, we consider a novel variant of the multi-armed bandit (MAB) problem, MAB with cost subsidy, which models many real-life applications where the learning agent has to pay to select an arm and is concerned about optimizing cumulative costs and rewards. We present two applications, intelligent SMS routing problem and ad audience optimization problem faced by several businesses (especially online platforms), and show how our problem uniquely captures key features of these applications. We show that naive generalizations of existing MAB algorithms like Upper Confidence Bound and Thompson Sampling do not perform well for this problem. We then establish a fundamental lower bound on the performance of any online learning algorithm for this problem, highlighting the hardness of our problem in comparison to the classical MAB problem. We also present a simple variant of explore-then-commit and establish near-optimal regret bounds for this algorithm. Lastly, we perform extensive numerical simulations to understand the behavior of a suite of algorithms for various instances and recommend a practical guide to employ different algorithms.


title: On Computing Stable Extensions of Abstract Argumentation Frameworks

abstract: An \textit{abstract argumentation framework} ({\sc af} for short) is a directed graph $(A,R)$ where $A$ is a set of \textit{abstract arguments} and $R\subseteq A \times A$ is the \textit{attack} relation. Let $H=(A,R)$ be an {\sc af}, $S \subseteq A$ be a set of arguments and $S^+ = \{y \mid \exists x\in S \text{ with }(x,y)\in R\}$. Then, $S$ is a \textit{stable extension} in $H$ if and only if $S^+ = A\setminus S$. In this paper, we present a thorough, formal validation of a known backtracking algorithm for listing all stable extensions in a given {\sc af}.


title: Surpassing the Classical Limit in Magic Square Game with Distant Quantum Dots Coupled to Optical Cavities

abstract: The emergence of quantum technologies is heating up the debate on quantum supremacy, usually focusing on the feasibility of looking good on paper algorithms in realistic settings, due to the vulnerability of quantum systems to myriad sources of noise. In this vein, an interesting example of quantum pseudo-telepathy games that quantum mechanical resources can theoretically outperform classical resources is the Magic Square game (MSG), in which two players play against a referee. Due to noise, however, the unit winning probability of the players can drop well below the classical limit. Here, we propose a timely and unprecedented experimental setup for quantum computation with quantum dots inside optical cavities, along with ancillary photons for realizing interactions between distant dots to implement the MSG. Considering various physical imperfections of our setup, we first show that the MSG can be implemented with the current technology, outperforming the classical resources under realistic conditions. Next, we show that our work gives rise to a new version of the game. That is, if the referee has information on the physical realization and strategy of the players, he can bias the game through filtered randomness and increase his winning probability. We believe our work contributes to not only quantum game theory, but also quantum computing with quantum dots.


title: Kinetic Models for Semiflexible Polymers in a Half-plane

abstract: Based on a general discrete model for a semiflexible polymer chain, we introduce a formal derivation of a kinetic equation for semiflexible polymers in the half-plane via a continuum limit. It turns out that the resulting equation is the kinetic Fokker-Planck-type equation with the Laplace-Beltrami operator under a non-local trapping boundary condition. We then study the well-posedness and the long-chain asymptotics of the solutions of the resulting equation. In particular, we prove that there exists a unique measure-valued solution for the corresponding boundary value problem. In addition, we prove that the equation is hypoelliptic and the solutions are locally H\"older continuous near the singular boundary. Finally, we provide the asymptotic behaviors of the solutions for large polymer chains.


title: Planning for Aerial Robot Teams for Wide-Area Biometric and Phenotypic Data Collection

abstract: This work presents an efficient and implementable solution to the problem of joint task allocation and path planning in a multi-UAV platform deployed for biometric data collection in-the-wild. The sensing requirement associated with the task gives rise to an uncanny variant of the traditional vehicle routing problem with coverage/sensing constraints. As is the case in several multi-robot path-planning problems, our problem reduces to an $m$TSP problem. In order to tame the computational challenges associated with the problem, we propose a hierarchical solution that decouples the vehicle routing problem from the target allocation problem. As a tangible solution to the allocation problem, we use a clustering-based technique that incorporates temporal uncertainty in the cardinality and position of the robots. Finally, we implement the proposed techniques on our multi-quadcopter platforms.


title: Spatially Clustered Regression

abstract: Spatial regression or geographically weighted regression models have been widely adopted to capture the effects of auxiliary information on a response variable of interest over a region. In contrast, relationships between response and auxiliary variables are expected to exhibit complex spatial patterns in many applications. This paper proposes a new approach for spatial regression, called spatially clustered regression, to estimate possibly clustered spatial patterns of the relationships. We combine K-means-based clustering formulation and penalty function motivated from a spatial process known as Potts model for encouraging similar clustering in neighboring locations. We provide a simple iterative algorithm to fit the proposed method, scalable for large spatial datasets. Through simulation studies, the proposed method demonstrates its superior performance to existing methods even under the true structure does not admit spatial clustering. Finally, the proposed method is applied to crime event data in Tokyo and produces interpretable results for spatial patterns. The R code is available at https://github.com/sshonosuke/SCR.


title: Decoupled Structure-Preserving Doubling Algorithm with Truncation for Large-Scale Algebraic Riccati Equations

abstract: In \emph{Guo et al, arXiv:2005.08288}, we propose a decoupled form of the structure-preserving doubling algorithm (dSDA). The method decouples the original two to four coupled recursions, enabling it to solve large-scale algebraic Riccati equations and other related problems. In this paper, we consider the numerical computations of the novel dSDA for solving large-scale continuous-time algebraic Riccati equations with low-rank structures (thus possessing numerically low-rank solutions). With the help of a new truncation strategy, the rank of the approximate solution is controlled. Consequently, large-scale problems can be treated efficiently. Illustrative numerical examples are presented to demonstrate and confirm our claims.


title: Heavy double neutron stars: birth, mid-life and death

abstract: Radio pulsar observations probe the lives of Galactic double neutron-star (DNS) systems while gravitational waves enable us to study extragalactic DNS in their final moments. By combining measurements from radio and gravitational-wave astronomy, we seek to gain a more complete understanding of DNS from formation to merger. We analyse the recent gravitational-wave binary neutron star mergers GW170817 and GW190425 in the context of other DNS known from radio astronomy. By employing a model for the birth and evolution of DNS, we measure the mass distribution of DNS at birth, at mid-life (in the radio), and at death (in gravitational waves). We consider the hypothesis that the high-mass gravitational-wave event GW190425 is part of a subpopulation formed through unstable case BB mass transfer, which quickly merge in $\sim 10-100~\mathrm{Myr}$. We find mild evidence to support this hypothesis and that GW190425 is not a clear outlier from the radio population as previously claimed. If there are fast-merging binaries, we estimate that they constitute $8-79\%$ of DNS at birth (90% credibility). We estimate the typical delay time between the birth and death of fast-merging binaries to be $\approx 5-401~\mathrm{Myr}$ (90% credibility). We discuss the implications for radio and gravitational-wave astronomy.


title: Pulsar glitches in a strangeon star model. II. The activity

abstract: Glitch is supposed to be a useful probe into pulsar's interior, but the underlying physics remains puzzling. The glitch activity may reflect a lower limit of the crustal moment of inertia in conventional neutron star models. Nevertheless, its statistical feature could also be reproduced in the strangeon star model, which is focused here. We formulate the glitch activity of normal radio pulsars under the framework of starquake of solid strangeon star model, the shear modulus of strangeon matter is constrained to be $\mu\simeq 3\times10^{34}~\rm erg/cm^{3}$, consistent with previous work. Nevertheless, about ten times the shift in oblateness accumulated during glitch interval is needed to fulfill the statistical observations. The fact that typical glitch sizes of two rapidly evolving pulsars (the Crab pulsar and PSR B0540-69) are about two orders of magnitude lower than that of the Vela pulsar, significantly lower than the oblateness change they can supply, indicates probably that only a part of oblateness change is relieved when a pulsar is young. The unreleased oblateness and stress may relax as compensation in the following evolution. The small glitch sizes and low glitch activity of the Crab pulsar can be explained simultaneously in this phenomenological model. Finally, we obtain energy release to be $\Delta E\sim 2.4\times 10^{40}~\rm erg$ and $\Delta E\sim 4.2\times 10^{41}~\rm erg$ for typical glitch size of $\Delta\nu/\nu\sim 10^{-6}$ (Vela-like) and $\sim 10^{-8}$ (Crab-like). The upcoming SKA may test this model through the energy release and the power-law relation between the reduced recovery coefficient $Q/|\dot\nu|^{1/2}$ and $\Delta\nu/\nu$.


title: Uncertainty-Oriented Ensemble Data Visualization and Exploration using Variable Spatial Spreading

abstract: As an important method of handling potential uncertainties in numerical simulations, ensemble simulation has been widely applied in many disciplines. Visualization is a promising and powerful ensemble simulation analysis method. However, conventional visualization methods mainly aim at data simplification and highlighting important information based on domain expertise instead of providing a flexible data exploration and intervention mechanism. Trial-and-error procedures have to be repeatedly conducted by such approaches. To resolve this issue, we propose a new perspective of ensemble data analysis using the attribute variable dimension as the primary analysis dimension. Particularly, we propose a variable uncertainty calculation method based on variable spatial spreading. Based on this method, we design an interactive ensemble analysis framework that provides a flexible interactive exploration of the ensemble data. Particularly, the proposed spreading curve view, the region stability heat map view, and the temporal analysis view, together with the commonly used 2D map view, jointly support uncertainty distribution perception, region selection, and temporal analysis, as well as other analysis requirements. We verify our approach by analyzing a real-world ensemble simulation dataset. Feedback collected from domain experts confirms the efficacy of our framework.


title: Wheat Crop Yield Prediction Using Deep LSTM Model

abstract: An in-season early crop yield forecast before harvest can benefit the farmers to improve the production and enable various agencies to devise plans accordingly. We introduce a reliable and inexpensive method to predict crop yields from publicly available satellite imagery. The proposed method works directly on raw satellite imagery without the need to extract any hand-crafted features or perform dimensionality reduction on the images. The approach implicitly models the relevance of the different steps in the growing season and the various bands in the satellite imagery. We evaluate the proposed approach on tehsil (block) level wheat predictions across several states in India and demonstrate that it outperforms existing methods by over 50\%. We also show that incorporating additional contextual information such as the location of farmlands, water bodies, and urban areas helps in improving the yield estimates.


title: Study of the axial U(1) anomaly at high temperature with lattice chiral fermions

abstract: We investigate the axial U(1) anomaly of two-flavor QCD at temperatures 190--330 MeV. In order to preserve precise chiral symmetry on the lattice, we employ the Mobius domain-wall fermion action as well as overlap fermion action implemented with a stochastic reweighting technique. Compared to our previous studies, we reduce the lattice spacing to 0.07 fm, simulate larger multiple volumes to estimate finite size effect, and take more than four quark mass points, including one below physical point to investigate the chiral limit. We measure the topological susceptibility, axial U(1) susceptibility, and examine the degeneracy of U(1) partners in meson and baryon correlators. All the data above the critical temperature indicate that the axial U(1) violation is consistent with zero within statistical errors. The quark mass dependence suggests disappearance of the U(1) anomaly at a rate comparable to that of the SU(2)_L x SU(2)_R symmetry breaking.


title: Floquet Engineering of a Dynamical $Z_{2}$ Lattice Gauge Field with Ultracold Atoms

abstract: In this paper, we propose that a simple model, in which fermions coupled to a dynamical lattice gauge field, can be engineered via the Floquet approach. The model possess both a independent Maxwell term and the local $Z_{2}$ gauge symmetry. Our proposal relies on a species dependent optical lattice, and can be achieved in one, two or three dimension. By an unitary transformation, this model can be mapped into a non-interacting composite Fermion system with fluctuating back ground charge. With the help of this composite Fermion picture, two characteristic observations are predicted. One is the radio-frequency spectroscopy, which exhibits no dispersion in all parameter regimes. Second is the the dynamical localization, which depends on the structure of the initial states.


title: Novel Compositional Data's Grey Model for Structurally Forecasting Arctic Crude Oil Import

abstract: The reserve of crude oil in the Arctic area is abundant. Ice melting is making it possible to have intermediate access to the Arctic crude oil and its transportation. A novel compositional data's grey model is proposed in this paper to structurally forecast Arctic crude oil import. Firstly, the general accumulative operation sequence of multivariate compositional data is defined according to Aitchison geometry, then obtaining the novel model with the form of the compositional data vectors. Secondly, this paper studies the least square parameter estimation of the model. The novel model is deduced and selected as the time-response expression of the solution. Thirdly, this paper infuses the novel model with traditional grey model to improve its robustness. Differential Evolution algorithm is introduced to determine the optimal value of the general matrix. Lastly, two validation examples are provided for confirming the effectiveness of the novel model by comparing it with other existing models, before being employed to forecast the crude oil import structure in China. The results show that the novel model provides better performance in all crude oil cases in short-term forecasting. Therefore, by using the new model, China's development parameter is 0.5214 and Determination Factor of the novel model is 0.5999, which means that the crude oil import structure of China is being changed. Specifically, the amount of crude oil imported from the Arctic area is obviously increasing in the next 6 years, showing sufficient proof of the edge owned by the Arctic area: abundant crude oil reserves and shortening transportation distance.


title: Invisible neutrino decay in precision cosmology

abstract: We revisit the topic of invisible neutrino decay in the precision cosmological context, via a first-principles approach to understanding the cosmic microwave background and large-scale structure phenomenology of such a non-standard physics scenario. Assuming an effective Lagrangian in which a heavier standard-model neutrino $\nu_H$ couples to a lighter one $\nu_l$ and a massless scalar particle $\phi$ via a Yukawa interaction, we derive from first principles the complete set of Boltzmann equations, at both the spatially homogeneous and the first-order inhomogeneous levels, for the phase space densities of $\nu_H$, $\nu_l$, and $\phi$ in the presence of the relevant decay and inverse decay processes. With this set of equations in hand, we perform a critical survey of recent works on cosmological invisible neutrino decay in both limits of decay while $\nu_H$ is ultra-relativistic and non-relativistic. Our two main findings are: (i) in the non-relativistic limit, the effective equations of motion used to describe perturbations in the neutrino--scalar system in the existing literature formally violate momentum conservation and gauge invariance, and (ii) in the ultra-relativistic limit, exponential damping of the anisotropic stress does not occur at the commonly-used rate $\Gamma_{\rm T} =(1/\tau_0) (m_{\nu H}/E_{\nu H})^3$, but at a rate $\sim (1/\tau_0) (m_{\nu H}/E_{\nu H})^5$. Both results are model-independent. The impact of the former finding on the cosmology of invisible neutrino decay is likely small. The latter, however, implies a significant revision of the cosmological limit on the neutrino lifetime $\tau_0$ from $\tau_0^{\rm old} \gtrsim 1.2 \times 10^9\, {\rm s}\, (m_{\nu H}/50\, {\rm meV})^3$ to $\tau_0 \gtrsim (4 \times 10^5 \to 4 \times 10^6)\, {\rm s}\, (m_{\nu H}/50 \, {\rm meV})^5$.


title: The Boltzmann equation with large-amplitude initial data and specular reflection boundary condition

abstract: For the Boltzmann equation with cutoff hard potentials, we construct the unique global solution converging with an exponential rate in large time to global Maxwellians not only for the specular reflection boundary condition with the bounded convex C^3 domain but also for a class of large amplitude initial data where the L^infty norm with a suitable velocity weight can be arbitrarily large but the relative entropy need to be small. A key point in the proof is to introduce a delicate nonlinear iterative process of estimating the gain term basing on the triple Duhamel iteration along the linearized dynamics.


title: BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger

abstract: Motivation: The proliferation of Biomedical research articles has made the task of information retrieval more important than ever. Scientists and Researchers are having difficulty in finding articles that contain information relevant to them. Proper extraction of biomedical entities like Disease, Drug/chem, Species, Gene/protein, can considerably improve the filtering of articles resulting in better extraction of relevant information. Performance on BioNer benchmarks has progressively improved because of progression in transformers-based models like BERT, XLNet, OpenAI, GPT2, etc. These models give excellent results; however, they are computationally expensive and we can achieve better scores for domain-specific tasks using other contextual string-based models and LSTM-CRF based sequence tagger. Results: We introduce BioNerFlair, a method to train models for biomedical named entity recognition using Flair plus GloVe embeddings and Bidirectional LSTM-CRF based sequence tagger. With almost the same generic architecture widely used for named entity recognition, BioNerFlair outperforms previous state-of-the-art models. I performed experiments on 8 benchmarks datasets for biomedical named entity recognition. Compared to current state-of-the-art models, BioNerFlair achieves the best F1-score of 90.17 beyond 84.72 on the BioCreative II gene mention (BC2GM) corpus, best F1-score of 94.03 beyond 92.36 on the BioCreative IV chemical and drug (BC4CHEMD) corpus, best F1-score of 88.73 beyond 78.58 on the JNLPBA corpus, best F1-score of 91.1 beyond 89.71 on the NCBI disease corpus, best F1-score of 85.48 beyond 78.98 on the Species-800 corpus, while near best results was observed on BC5CDR-chem, BC3CDR-disease, and LINNAEUS corpus.


title: Prescribing Gaussian curvature on surfaces with conical singularities and geodesic boundary

abstract: We study conformal metrics with prescribed Gaussian curvature on surfaces with conical singularities and geodesic boundary in supercritical regimes. Exploiting a variational argument, we derive a general existence result for surfaces with at least two boundary components. This seems to be the first result in this setting. Moreover, we allow to have conical singularities with both positive and negative orders, that is cone angles both less and grater than $2\pi$.


title: MAIRE -- A Model-Agnostic Interpretable Rule Extraction Procedure for Explaining Classifiers

abstract: The paper introduces a novel framework for extracting model-agnostic human interpretable rules to explain a classifier's output. The human interpretable rule is defined as an axis-aligned hyper-cuboid containing the instance for which the classification decision has to be explained. The proposed procedure finds the largest (high \textit{coverage}) axis-aligned hyper-cuboid such that a high percentage of the instances in the hyper-cuboid have the same class label as the instance being explained (high \textit{precision}). Novel approximations to the coverage and precision measures in terms of the parameters of the hyper-cuboid are defined. They are maximized using gradient-based optimizers. The quality of the approximations is rigorously analyzed theoretically and experimentally. Heuristics for simplifying the generated explanations for achieving better interpretability and a greedy selection algorithm that combines the local explanations for creating global explanations for the model covering a large part of the instance space are also proposed. The framework is model agnostic, can be applied to any arbitrary classifier, and all types of attributes (including continuous, ordered, and unordered discrete). The wide-scale applicability of the framework is validated on a variety of synthetic and real-world datasets from different domains (tabular, text, and image).


title: VEGA: Towards an End-to-End Configurable AutoML Pipeline

abstract: Automated Machine Learning (AutoML) is an important industrial solution for automatic discovery and deployment of the machine learning models. However, designing an integrated AutoML system faces four great challenges of configurability, scalability, integrability, and platform diversity. In this work, we present VEGA, an efficient and comprehensive AutoML framework that is compatible and optimized for multiple hardware platforms. a) The VEGA pipeline integrates various modules of AutoML, including Neural Architecture Search (NAS), Hyperparameter Optimization (HPO), Auto Data Augmentation, Model Compression, and Fully Train. b) To support a variety of search algorithms and tasks, we design a novel fine-grained search space and its description language to enable easy adaptation to different search algorithms and tasks. c) We abstract the common components of deep learning frameworks into a unified interface. VEGA can be executed with multiple back-ends and hardwares. Extensive benchmark experiments on multiple tasks demonstrate that VEGA can improve the existing AutoML algorithms and discover new high-performance models against SOTA methods, e.g. the searched DNet model zoo for Ascend 10x faster than EfficientNet-B5 and 9.2x faster than RegNetX-32GF on ImageNet. VEGA is open-sourced at https://github.com/huawei-noah/vega.


title: Greetings from a Triparental Planet

abstract: In this work of speculative science, scientists from a distant star system explain the emergence and consequences of triparentalism, when three individuals are required for sexual reproduction, which is the standard form of mating on their home world. The report details the evolution of their reproductive system--that is, the conditions under which triparentalism and three self-avoiding mating types emerged as advantageous strategies for sexual reproduction. It also provides an overview of the biological consequences of triparental reproduction with three mating types, including the genetic mechanisms of triparental reproduction, asymmetries between the three mating types, and infection dynamics arising from their different mode of sexual reproduction. The report finishes by discussing how central aspects of their society, such as short-lasting unions among individuals and the rise of a monoculture, might have arisen as a result of their triparental system.


title: MalFox: Camouflaged Adversarial Malware Example Generation Based on Conv-GANs Against Black-Box Detectors

abstract: Deep learning is a thriving field currently stuffed with many practical applications and active research topics. It allows computers to learn from experience and to understand the world in terms of a hierarchy of concepts, with each being defined through its relations to simpler concepts. Relying on the strong capabilities of deep learning, we propose a convolutional generative adversarial network-based (Conv-GAN) framework titled MalFox, targeting adversarial malware example generation against third-party black-box malware detectors. Motivated by the rival game between malware authors and malware detectors, MalFox adopts a confrontational approach to produce perturbation paths, with each formed by up to three methods (namely Obfusmal, Stealmal, and Hollowmal) to generate adversarial malware examples. To demonstrate the effectiveness of MalFox, we collect a large dataset consisting of both malware and benignware programs, and investigate the performance of MalFox in terms of accuracy, detection rate, and evasive rate of the generated adversarial malware examples. Our evaluation indicates that the accuracy can be as high as 99.0% which significantly outperforms the other 12 well-known learning models. Furthermore, the detection rate is dramatically decreased by 56.8% on average, and the average evasive rate is noticeably improved by up to 56.2%.


title: Pressure induced superconductivity in MnSe

abstract: The rich phenomena in the FeSe and related compounds have attracted great interests as it provides fertile material to gain further insight into the mechanism of high temperature superconductivity. A natural follow-up work was to look into the possibility of superconductivity in MnSe. It was shown that MnP becomes superconducting with Tc ~ 1 K under pressure. We demonstrated in this work that high pressure can effectively suppress the complex magnetic characters of MnSe crystal when observed at ambient condition. MnSe under pressure is found to undergo several structural transformations: the cubic phase first partially transforms to the hexagonal phase at about 12 GPa, the crystal exhibits the coexistence of cubic, hexagonal and orthorhombic phases from 16 GPa to 30 GPa, and above 30 GPa the crystal shows a single orthorhombic phase. Superconductivity with Tc ~ 5 K was first observed at pressure ~12 GPa by magnetic measurements (~16 GPa by resistive measurements). The highest Tc is ~ 9 K (magnetic result) at ~35 GPa. Our observations suggest the observed superconductivity may closely relate to the pressure-induced structural change. However, the interface between the metallic and insulating boundaries may also play an important role to the pressure induced superconductivity in MnSe.


title: Asymmetric Interference Cancellation for 5G Non-Public Network with Uplink-Downlink Spectrum Sharing

abstract: Different from public 4G/5G networks that are dominated by downlink traffic, emerging 5G non-public networks (NPNs) need to support significant uplink traffic to enable emerging applications such as industrial Internet of things (IIoT). The uplink-and-downlink spectrum sharing is becoming a viable solution to enhance the uplink throughput of NPNs, which allows the NPNs to perform the uplink transmission over the time-frequency resources configured for downlink transmission in coexisting public networks. To deal with the severe interference from the downlink public base station (BS) transmitter to the coexisting uplink non-public BS receiver, we propose an adaptive asymmetric successive interference cancellation (SIC) approach, in which the non-public BS receiver is enabled to have the capability of decoding the downlink signals transmitted from the public BS and successively cancelling them for interference mitigation. In particular, this paper studies a basic uplink-and-downlink spectrum sharing scenario when an uplink non-public BS and a downlink public BS coexist in the same area, each communicating with multiple users via orthogonal frequency-division multiple access (OFDMA). Under this setup, we aim to maximize the common uplink throughput of all non-public users, under the condition that the downlink throughput of each public user is above a certain threshold. The decision variables include the subcarrier allocation and user scheduling for both non-public (uplink) and public (downlink) BSs, the decoding mode of the non-public BS over each subcarrier (i.e., with or without SIC), as well as the rate and power control over subcarriers. Numerical results show that the proposed adaptive asymmetric SIC design significantly improves the common uplink throughput as compared to benchmark schemes without such design.


title: Embedding Node Structural Role Identity into Hyperbolic Space

abstract: Recently, there has been an interest in embedding networks in hyperbolic space, since hyperbolic space has been shown to work well in capturing graph/network structure as it can naturally reflect some properties of complex networks. However, the work on network embedding in hyperbolic space has been focused on microscopic node embedding. In this work, we are the first to present a framework to embed the structural roles of nodes into hyperbolic space. Our framework extends struct2vec, a well-known structural role preserving embedding method, by moving it to a hyperboloid model. We evaluated our method on four real-world and one synthetic network. Our results show that hyperbolic space is more effective than euclidean space in learning latent representations for the structural role of nodes.


title: CharBERT: Character-aware Pre-trained Language Model

abstract: Most pre-trained language models (PLMs) construct word representations at subword level with Byte-Pair Encoding (BPE) or its variations, by which OOV (out-of-vocab) words are almost avoidable. However, those methods split a word into subword units and make the representation incomplete and fragile. In this paper, we propose a character-aware pre-trained language model named CharBERT improving on the previous methods (such as BERT, RoBERTa) to tackle these problems. We first construct the contextual word embedding for each token from the sequential character representations, then fuse the representations of characters and the subword representations by a novel heterogeneous interaction module. We also propose a new pre-training task named NLM (Noisy LM) for unsupervised character representation learning. We evaluate our method on question answering, sequence labeling, and text classification tasks, both on the original datasets and adversarial misspelling test sets. The experimental results show that our method can significantly improve the performance and robustness of PLMs simultaneously. Pretrained models, evaluation sets, and code are available at https://github.com/wtma/CharBERT


title: You Do (Not) Belong Here: Detecting DPI Evasion Attacks with Context Learning

abstract: As Deep Packet Inspection (DPI) middleboxes become increasingly popular, a spectrum of adversarial attacks have emerged with the goal of evading such middleboxes. Many of these attacks exploit discrepancies between the middlebox network protocol implementations, and the more rigorous/complete versions implemented at end hosts. These evasion attacks largely involve subtle manipulations of packets to cause different behaviours at DPI and end hosts, to cloak malicious network traffic that is otherwise detectable. With recent automated discovery, it has become prohibitively challenging to manually curate rules for detecting these manipulations. In this work, we propose CLAP, the first fully-automated, unsupervised ML solution to accurately detect and localize DPI evasion attacks. By learning what we call the packet context, which essentially captures inter-relationships across both (1) different packets in a connection; and (2) different header fields within each packet, from benign traffic traces only, CLAP can detect and pinpoint packets that violate the benign packet contexts (which are the ones that are specially crafted for evasion purposes). Our evaluations with 73 state-of-the-art DPI evasion attacks show that CLAP achieves an Area Under the Receiver Operating Characteristic Curve (AUC-ROC) of 0.963, an Equal Error Rate (EER) of only 0.061 in detection, and an accuracy of 94.6% in localization. These results suggest that CLAP can be a promising tool for thwarting DPI evasion attacks.


title: Growth of respiratory droplets in cold and humid air

abstract: The ambient conditions surrounding liquid droplets determine their growth or shrinkage. However, the precise fate of a liquid droplet expelled from a respiratory puff as dictated by its surroundings and the puff itself has not yet been fully quantified. From the view of airborne disease transmission, such as SARS-CoV-2, knowledge of such dependencies are critical. Here we employ direct numerical simulations (DNS) of a turbulent respiratory vapour puff and account for the mass and temperature exchange with respiratory droplets and aerosols. In particular, we investigate how droplets respond to different ambient temperatures and relative humidity (RH) by tracking their Lagrangian statistics. We reveal and quantify that in cold and humid environments, as there the respiratory puff is supersaturated, expelled droplets can first experience significant growth, and only later followed by shrinkage, in contrast to the monotonic shrinkage of droplets as expected from the classical view by William F. Wells (1934). Indeed, cold and humid environments diminish the ability of air to hold water vapour, thus causing the respiratory vapour puff to super-saturate. Consequently, the super-saturated vapour field drives the growth of droplets that are caught and transported within the humid puff. To analytically predict the likelihood for droplet growth, we propose a model for the axial RH based on the assumption of a quasi-stationary jet. Our model correctly predicts super-saturated RH conditions and is in good quantitative agreement with our DNS. Our results culminate in a temperature-RH map that can be employed as an indicator for droplet growth or shrinkage.


title: Quadratic Metric Elicitation for Fairness and Beyond

abstract: Metric elicitation is a recent framework for eliciting classification performance metrics that best reflect implicit user preferences based on the task and context. However, available elicitation strategies have been limited to linear (or quasi-linear) functions of predictive rates, which can be practically restrictive for many applications including fairness. This paper develops a strategy for eliciting more flexible multiclass metrics defined by quadratic functions of rates, designed to reflect human preferences better. We show its application in eliciting quadratic violation-based group-fair metrics. Our strategy requires only relative preference feedback, is robust to noise, and achieves near-optimal query complexity. We further extend this strategy to eliciting polynomial metrics -- thus broadening the use cases for metric elicitation.