title: Detecting Community Sensitive Norm Violations in Online Conversations

abstract: Online platforms and communities establish their own norms that govern what behavior is acceptable within the community. Substantial effort in NLP has focused on identifying unacceptable behaviors and, recently, on forecasting them before they occur. However, these efforts have largely focused on toxicity as the sole form of community norm violation. Such focus has overlooked the much larger set of rules that moderators enforce. Here, we introduce a new dataset focusing on a more complete spectrum of community norms and their violations in the local conversational and global community contexts. We introduce a series of models that use this data to develop context- and community-sensitive norm violation detection, showing that these changes give high performance.


title: An optimization-based strategy for peridynamic-FEM coupling and for the prescription of nonlocal boundary conditions

abstract: We develop and analyze an optimization-based method for the coupling of a static peri-dynamic (PD) model and a static classical elasticity model. The approach formulates the coupling as a control problem in which the states are the solutions of the PD and classical equations, the objective is to minimize their mismatch on an overlap of the PD and classical domains, and the controls are virtual volume constraints and boundary conditions applied at the local-nonlocal interface. Our numerical tests performed on three-dimensional geometries illustrate the consistency and accuracy of our method, its numerical convergence, and its applicability to realistic engineering geometries. We demonstrate the coupling strategy as a means to reduce computational expense by confining the nonlocal model to a subdomain of interest, and as a means to transmit local (e.g., traction) boundary conditions applied at a surface to a nonlocal model in the bulk of the domain.


title: DeepABM: Scalable, efficient and differentiable agent-based simulations via graph neural networks

abstract: We introduce DeepABM, a framework for agent-based modeling that leverages geometric message passing of graph neural networks for simulating action and interactions over large agent populations. Using DeepABM allows scaling simulations to large agent populations in real-time and running them efficiently on GPU architectures. To demonstrate the effectiveness of DeepABM, we build DeepABM-COVID simulator to provide support for various non-pharmaceutical interventions (quarantine, exposure notification, vaccination, testing) for the COVID-19 pandemic, and can scale to populations of representative size in real-time on a GPU. Specifically, DeepABM-COVID can model 200 million interactions (over 100,000 agents across 180 time-steps) in 90 seconds, and is made available online to help researchers with modeling and analysis of various interventions. We explain various components of the framework and discuss results from one research study to evaluate the impact of delaying the second dose of the COVID-19 vaccine in collaboration with clinical and public health experts. While we simulate COVID-19 spread, the ideas introduced in the paper are generic and can be easily extend to other forms of agent-based simulations. Furthermore, while beyond scope of this document, DeepABM enables inverse agent-based simulations which can be used to learn physical parameters in the (micro) simulations using gradient-based optimization with large-scale real-world (macro) data. We are optimistic that the current work can have interesting implications for bringing ABM and AI communities closer.


title: Theoretically Principled Deep RL Acceleration via Nearest Neighbor Function Approximation

abstract: Recently, deep reinforcement learning (RL) has achieved remarkable empirical success by integrating deep neural networks into RL frameworks. However, these algorithms often require a large number of training samples and admit little theoretical understanding. To mitigate these issues, we propose a theoretically principled nearest neighbor (NN) function approximator that can improve the value networks in deep RL methods. Inspired by human similarity judgments, the NN approximator estimates the action values using rollouts on past observations and can provably obtain a small regret bound that depends only on the intrinsic complexity of the environment. We present (1) Nearest Neighbor Actor-Critic (NNAC), an online policy gradient algorithm that demonstrates the practicality of combining function approximation with deep RL, and (2) a plug-and-play NN update module that aids the training of existing deep RL methods. Experiments on classical control and MuJoCo locomotion tasks show that the NN-accelerated agents achieve higher sample efficiency and stability than the baseline agents. Based on its theoretical benefits, we believe that the NN approximator can be further applied to other complex domains to speed-up learning.


title: J-PLUS: Detecting and studying extragalactic globular clusters -- the case of NGC 1023

abstract: Extragalactic globular clusters (GCs) are key objects for studying the history of galaxies. The arrival of wide-field surveys such as the Javalambre Photometric Local Universe Survey (J-PLUS) offers new possibilities for the study of these systems. We perform the first study of GCs in J-PLUS to recover information about the history of NGC 1023 taking advantage of wide-field images and 12 filters. We develop the semiautomatic pipeline GCFinder that detects GC candidates in J-PLUS images and can also be adapted to similar surveys. We study the stellar population properties of a sub-sample of GC candidates using spectral energy distribution (SED) fitting. We find 523 GC candidates in NGC 1023, of which $\sim$300 are new. We identify subpopulations of GC candidates, where age and metallicity distributions have multiple peaks. By comparing our results with simulations, we report a possible broad age-metallicity relation, evidence that NGC 1023 experienced accretion events in the past. The dominating age peak is at $10^{10}$ yr. We report a correlation between masses and ages that suggests that massive GC candidates are more likely to survive the turbulent history of the host galaxy. Modeling the light of NGC 1023, we find two spiral-like arms and detect a displacement of the galaxy's photometric center with respect to the outer isophotes and center of GC distribution ($\sim$700 pc and $\sim$1600 pc, respectively), which could be the result of ongoing interaction between NGC 1023 and NGC 1023A. By studying the GC system of NGC 1023 with J-PLUS we showcase the power of multi-band surveys for this kind of study and find evidence of a complex accretion history of the host galaxy.


title: High quality factor silicon-on-lithium niobate metasurfaces for electro-optically reconfigurable wavefront shaping

abstract: Dynamically reconfigurable metasurfaces promise compact and lightweight spatial light modulation for many applications, including LiDAR, AR/VR, and LiFi systems. Here, we design and computationally investigate high quality factor silicon-on-lithium niobate metasurfaces with electrically-driven, independent control of its constituent nanobars for full phase tunability with high tuning efficiency. Free-space light couples to guided modes within each nanobar via periodic perturbations, generating quality factors exceeding 30,000, while maintaining bar spacing <$\lambda$/1.5. We achieve nearly 2$\pi$ phase variation with an applied bias not exceeding $\pm$ 25 V, maintaining reflection efficiency above 91%. Using full-field simulations, we demonstrate a high angle, 51\deg, switchable beamsplitter with a diffracted efficiency of 93%, and an angle-tunable beamsteerer, spanning 18-31\deg, with up to 86% efficiency, all using the same metasurface device. Our platform provides a foundation for highly efficient wavefront shaping devices with a wide dynamic tuning range capable of generating nearly any transfer function.


title: Arabic Speech Emotion Recognition Employing Wav2vec2.0 and HuBERT Based on BAVED Dataset

abstract: Recently, there have been tremendous research outcomes in the fields of speech recognition and natural language processing. This is due to the well-developed multi-layers deep learning paradigms such as wav2vec2.0, Wav2vecU, WavBERT, and HuBERT that provide better representation learning and high information capturing. Such paradigms run on hundreds of unlabeled data, then fine-tuned on a small dataset for specific tasks. This paper introduces a deep learning constructed emotional recognition model for Arabic speech dialogues. The developed model employs the state of the art audio representations include wav2vec2.0 and HuBERT. The experiment and performance results of our model overcome the previous known outcomes.


title: Vision-based Navigation for a Small-scale Quadruped Robot Pegasus-Mini

abstract: Quadruped locomotion is currently a vibrant research area, which has reached a level of maturity and performance that enables some of the most advanced real-world applications with autonomous quadruped robots both in academia and industry. Blind robust quadruped locomotion has been pushed forward in control and technology aspects within recent decades. However, in the complicated environment, the capability including terrain perception and path planning is still required. Visual perception is an indispensable ability in legged locomotion for such a demand. This study explores a vision-based navigation method for a small-scale quadruped robot Pegasus-Mini, aiming to propose a method that enables efficient and reliable navigation for the small-scale quadruped locomotion. The vision-based navigation method proposed in this study is applicable in such a small-scale quadruped robot platform in which the computation resources and space are limited. The semantic segmentation based on a CNN model is adopted for the real-time path segmentation in the outdoor environment. The desired traverse trajectory is generated through real-time updating the middle line, which is calculated from the edge position of the segmented path in the images. To enhance the stability of the path planning directly based on the semantic segmentation method, a trajectory compensation method is supplemented considering the temporal information to revise the untrustworthy planned path. Experiments of semantic segmentation and navigation in a garden scene are demonstrated to verify the effectiveness of the proposed method.


title: Harnessing Unlabeled Data to Improve Generalization of Biometric Gender and Age Classifiers

abstract: With significant advances in deep learning, many computer vision applications have reached the inflection point. However, these deep learning models need large amount of labeled data for model training and optimum parameter estimation. Limited labeled data for model training results in over-fitting and impacts their generalization performance. However, the collection and annotation of large amount of data is a very time consuming and expensive operation. Further, due to privacy and security concerns, the large amount of labeled data could not be collected for certain applications such as those involving medical field. Self-training, Co-training, and Self-ensemble methods are three types of semi-supervised learning methods that can be used to exploit unlabeled data. In this paper, we propose self-ensemble based deep learning model that along with limited labeled data, harness unlabeled data for improving the generalization performance. We evaluated the proposed self-ensemble based deep-learning model for soft-biometric gender and age classification. Experimental evaluation on CelebA and VISOB datasets suggest gender classification accuracy of 94.46% and 81.00%, respectively, using only 1000 labeled samples and remaining 199k samples as unlabeled samples for CelebA dataset and similarly,1000 labeled samples with remaining 107k samples as unlabeled samples for VISOB dataset. Comparative evaluation suggest that there is $5.74\%$ and $8.47\%$ improvement in the accuracy of the self-ensemble model when compared with supervised model trained on the entire CelebA and VISOB dataset, respectively. We also evaluated the proposed learning method for age-group prediction on Adience dataset and it outperformed the baseline supervised deep-learning learning model with a better exact accuracy of 55.55 $\pm$ 4.28 which is 3.92% more than the baseline.


title: A parametric quantile beta regression for modeling case fatality rates of COVID-19

abstract: Motivated by the case fatality rate (CFR) of COVID-19, in this paper, we develop a fully parametric quantile regression model based on the generalized three-parameter beta (GB3) distribution. Beta regression models are primarily used to model rates and proportions. However, these models are usually specified in terms of a conditional mean. Therefore, they may be inadequate if the observed response variable follows an asymmetrical distribution, such as CFR data. In addition, beta regression models do not consider the effect of the covariates across the spectrum of the dependent variable, which is possible through the conditional quantile approach. In order to introduce the proposed GB3 regression model, we first reparameterize the GB3 distribution by inserting a quantile parameter and then we develop the new proposed quantile model. We also propose a simple interpretation of the predictor-response relationship in terms of percentage increases/decreases of the quantile. A Monte Carlo study is carried out for evaluating the performance of the maximum likelihood estimates and the choice of the link functions. Finally, a real COVID-19 dataset from Chile is analyzed and discussed to illustrate the proposed approach.


title: Improving Distantly-Supervised Named Entity Recognition with Self-Collaborative Denoising Learning

abstract: Distantly supervised named entity recognition (DS-NER) efficiently reduces labor costs but meanwhile intrinsically suffers from the label noise due to the strong assumption of distant supervision. Typically, the wrongly labeled instances comprise numbers of incomplete and inaccurate annotation noise, while most prior denoising works are only concerned with one kind of noise and fail to fully explore useful information in the whole training set. To address this issue, we propose a robust learning paradigm named Self-Collaborative Denoising Learning (SCDL), which jointly trains two teacher-student networks in a mutually-beneficial manner to iteratively perform noisy label refinery. Each network is designed to exploit reliable labels via self denoising, and two networks communicate with each other to explore unreliable annotations by collaborative denoising. Extensive experimental results on five real-world datasets demonstrate that SCDL is superior to state-of-the-art DS-NER denoising methods.


title: RankingMatch: Delving into Semi-Supervised Learning with Consistency Regularization and Ranking Loss

abstract: Semi-supervised learning (SSL) has played an important role in leveraging unlabeled data when labeled data is limited. One of the most successful SSL approaches is based on consistency regularization, which encourages the model to produce unchanged with perturbed input. However, there has been less attention spent on inputs that have the same label. Motivated by the observation that the inputs having the same label should have the similar model outputs, we propose a novel method, RankingMatch, that considers not only the perturbed inputs but also the similarity among the inputs having the same label. We especially introduce a new objective function, dubbed BatchMean Triplet loss, which has the advantage of computational efficiency while taking into account all input samples. Our RankingMatch achieves state-of-the-art performance across many standard SSL benchmarks with a variety of labeled data amounts, including 95.13% accuracy on CIFAR-10 with 250 labels, 77.65% accuracy on CIFAR-100 with 10000 labels, 97.76% accuracy on SVHN with 250 labels, and 97.77% accuracy on SVHN with 1000 labels. We also perform an ablation study to prove the efficacy of the proposed BatchMean Triplet loss against existing versions of Triplet loss.


title: SOMA: Solving Optical Marker-Based MoCap Automatically

abstract: Marker-based optical motion capture (mocap) is the "gold standard" method for acquiring accurate 3D human motion in computer vision, medicine, and graphics. The raw output of these systems are noisy and incomplete 3D points or short tracklets of points. To be useful, one must associate these points with corresponding markers on the captured subject; i.e. "labelling". Given these labels, one can then "solve" for the 3D skeleton or body surface mesh. Commercial auto-labeling tools require a specific calibration procedure at capture time, which is not possible for archival data. Here we train a novel neural network called SOMA, which takes raw mocap point clouds with varying numbers of points, labels them at scale without any calibration data, independent of the capture technology, and requiring only minimal human intervention. Our key insight is that, while labeling point clouds is highly ambiguous, the 3D body provides strong constraints on the solution that can be exploited by a learning-based method. To enable learning, we generate massive training sets of simulated noisy and ground truth mocap markers animated by 3D bodies from AMASS. SOMA exploits an architecture with stacked self-attention elements to learn the spatial structure of the 3D body and an optimal transport layer to constrain the assignment (labeling) problem while rejecting outliers. We extensively evaluate SOMA both quantitatively and qualitatively. SOMA is more accurate and robust than existing state of the art research methods and can be applied where commercial systems cannot. We automatically label over 8 hours of archival mocap data across 4 different datasets captured using various technologies and output SMPL-X body models. The model and data is released for research purposes at https://soma.is.tue.mpg.de/.


title: Group-matching algorithms for subjects and items

abstract: We consider the problem of constructing matched groups such that the resulting groups are statistically similar with respect to their average values for multiple covariates. This group-matching problem arises in many cases, including quasi-experimental and observational studies in which subjects or items are sampled from pre-existing groups, scenarios in which traditional pair-matching approaches may be inappropriate. We consider the case in which one is provided with an existing sample and iteratively eliminates samples so that the groups "match" according to arbitrary statistically-defined criteria. This problem is NP-hard. However, using artificial and real-world data sets, we show that heuristics implemented by the ldamatch package produce high-quality matches.


title: De-biased Lasso for Generalized Linear Models with A Diverging Number of Covariates

abstract: Modeling and drawing inference on the joint associations between single nucleotide polymorphisms and a disease has sparked interest in genome-wide associations studies. In the motivating Boston Lung Cancer Survival Cohort (BLCSC) data, the presence of a large number of single nucleotide polymorphisms of interest, though smaller than the sample size, challenges inference on their joint associations with the disease outcome. In similar settings, we find that neither the de-biased lasso approach (van de Geer et al. 2014), which assumes sparsity on the inverse information matrix, nor the standard maximum likelihood method can yield confidence intervals with satisfactory coverage probabilities for generalized linear models. Under this "large $n$, diverging $p$" scenario, we propose an alternative de-biased lasso approach by directly inverting the Hessian matrix without imposing the matrix sparsity assumption, which further reduces bias compared to the original de-biased lasso and ensures valid confidence intervals with nominal coverage probabilities. We establish the asymptotic distributions of any linear combinations of the parameter estimates, which lays the theoretical ground for drawing inference. Simulations show that the proposed refined de-biased estimating method performs well in removing bias and yields honest confidence interval coverage. We use the proposed method to analyze the aforementioned BLCSC data, a large scale hospital-based epidemiology cohort study, that investigates the joint effects of genetic variants on lung cancer risks.


title: The galaxy size to halo spin relation of disk galaxies in cosmological hydrodynamical simulations

abstract: In the standard disk galaxy formation model, the sizes of galactic disks are tightly related to the spin parameters $\lambda$ of their dark matter haloes. The model has been wildly adopted by various semi-analytic galaxy formation models which have been extremely successful to interpret a large body of observational data. However, the size-$\lambda$ correlation was rarely seen in most modern hydrodynamical simulations of galaxy formation. In this short paper, we make use of 4 sets of large hydrodynamical simulations to explore the size-spin parameter relation with a large sample of simulated disk galaxies, and compare it with a popular disk galaxy formation model of Mo et al. (1998). Intriguingly, galactic sizes correlate strongly with spin parameters of their dark matter haloes in the simulations developed by the IllustrisTNG collaborations, albeit the relation does not always agree with prediction of MMW98 model over all stellar mass range we examined. There is also a size-spin correlation for the Milky way analogies in the EAGLE simulations, while it is relatively weaker than that of the IllustrisTNG counterparts. For the dwarfs in the simulations from the EAGLE collaboration, there is NULL correlation. We conclude that either the detailed subgrid physics or hydrodynamics solvers account for the size-spin relation, which will be explored in our future work.


title: Two-stage Visual Cues Enhancement Network for Referring Image Segmentation

abstract: Referring Image Segmentation (RIS) aims at segmenting the target object from an image referred by one given natural language expression. The diverse and flexible expressions as well as complex visual contents in the images raise the RIS model with higher demands for investigating fine-grained matching behaviors between words in expressions and objects presented in images. However, such matching behaviors are hard to be learned and captured when the visual cues of referents (i.e. referred objects) are insufficient, as the referents with weak visual cues tend to be easily confused by cluttered background at boundary or even overwhelmed by salient objects in the image. And the insufficient visual cues issue can not be handled by the cross-modal fusion mechanisms as done in previous work. In this paper, we tackle this problem from a novel perspective of enhancing the visual information for the referents by devising a Two-stage Visual cues enhancement Network (TV-Net), where a novel Retrieval and Enrichment Scheme (RES) and an Adaptive Multi-resolution feature Fusion (AMF) module are proposed. Through the two-stage enhancement, our proposed TV-Net enjoys better performances in learning fine-grained matching behaviors between the natural language expression and image, especially when the visual information of the referent is inadequate, thus produces better segmentation results. Extensive experiments are conducted to validate the effectiveness of the proposed method on the RIS task, with our proposed TV-Net surpassing the state-of-the-art approaches on four benchmark datasets.


title: Nets of Conics and associated Artinian algebras of length 7

abstract: We classify the orbits of nets of conics under the action of the projective linear group and we determine the specializations of these orbits, using geometric and algebraic methods. We study related geometric questions, as the parametrization of planar cubics. We show that Artinian algebras of Hilbert function H=(1,3,3,0) determined by nets, can be smoothed - deformed to a direct sum of fields; and that algebras of Hilbert function H=(1,r,2,0), determined by pencils of quadrics, can also be smoothed. In a Historical Appendix A we describe related work prior to 1977. In an Update Appendix B we survey some developments since 1977 concerning nets of conics, related geometry, and deformations of Artinian algebras of small length.


title: Clustering Human Trust Dynamics for Customized Real-time Prediction

abstract: Trust calibration is necessary to ensure appropriate user acceptance in advanced automation technologies. A significant challenge to achieve trust calibration is to quantitatively estimate human trust in real-time. Although multiple trust models exist, these models have limited predictive performance partly due to individual differences in trust dynamics. A personalized model for each person can address this issue, but it requires a significant amount of data for each user. We present a methodology to develop customized model by clustering humans based on their trust dynamics. The clustering-based method addresses the individual differences in trust dynamics while requiring significantly less data than personalized model. We show that our clustering-based customized models not only outperform the general model based on entire population, but also outperform simple demographic factor-based customized models. Specifically, we propose that two models based on ``confident'' and ``skeptical'' group of participants, respectively, can represent the trust behavior of the population. The ``confident'' participants, as compared to the ``skeptical'' participants, have higher initial trust levels, lose trust slower when they encounter low reliability operations, and have higher trust levels during trust-repair after the low reliability operations. In summary, clustering-based customized models improve trust prediction performance for further trust calibration considerations.


title: Towards Lightweight Applications: Asymmetric Enroll-Verify Structure for Speaker Verification

abstract: With the development of deep learning, automatic speaker verification has made considerable progress over the past few years. However, to design a lightweight and robust system with limited computational resources is still a challenging problem. Traditionally, a speaker verification system is symmetrical, indicating that the same embedding extraction model is applied for both enrollment and verification in inference. In this paper, we come up with an innovative asymmetric structure, which takes the large-scale ECAPA-TDNN model for enrollment and the small-scale ECAPA-TDNNLite model for verification. As a symmetrical system, our proposed ECAPA-TDNNLite model achieves an EER of 3.07% on the Voxceleb1 original test set with only 11.6M FLOPS. Moreover, the asymmetric structure further reduces the EER to 2.31%, without increasing any computational costs during verification.


title: A Generic Knowledge Based Medical Diagnosis Expert System

abstract: In this paper, we design and implement a generic medical knowledge based system (MKBS) for identifying diseases from several symptoms. In this system, some important aspects like knowledge bases system, knowledge representation, inference engine have been addressed. The system asks users different questions and inference engines will use the certainty factor to prune out low possible solutions. The proposed disease diagnosis system also uses a graphical user interface (GUI) to facilitate users to interact with the expert system. Our expert system is generic and flexible, which can be integrated with any rule bases system in disease diagnosis.


title: Multimodal Approach for Assessing Neuromotor Coordination in Schizophrenia Using Convolutional Neural Networks

abstract: This study investigates the speech articulatory coordination in schizophrenia subjects exhibiting strong positive symptoms (e.g. hallucinations and delusions), using two distinct channel-delay correlation methods. We show that the schizophrenic subjects with strong positive symptoms and who are markedly ill pose complex articulatory coordination pattern in facial and speech gestures than what is observed in healthy subjects. This distinction in speech coordination pattern is used to train a multimodal convolutional neural network (CNN) which uses video and audio data during speech to distinguish schizophrenic patients with strong positive symptoms from healthy subjects. We also show that the vocal tract variables (TVs) which correspond to place of articulation and glottal source outperform the Mel-frequency Cepstral Coefficients (MFCCs) when fused with Facial Action Units (FAUs) in the proposed multimodal network. For the clinical dataset we collected, our best performing multimodal network improves the mean F1 score for detecting schizophrenia by around 18% with respect to the full vocal tract coordination (FVTC) baseline method implemented with fusing FAUs and MFCCs.


title: Natural Language for Human-Robot Collaboration: Problems Beyond Language Grounding

abstract: To enable robots to instruct humans in collaborations, we identify several aspects of language processing that are not commonly studied in this context. These include location, planning, and generation. We suggest evaluations for each task, offer baselines for simple methods, and close by discussing challenges and opportunities in studying language for collaboration.


title: A Primer on Deep Learning for Causal Inference

abstract: This review systematizes the emerging literature for causal inference using deep neural networks under the potential outcomes framework. It provides an intuitive introduction on how deep learning can be used to estimate/predict heterogeneous treatment effects and extend causal inference to settings where confounding is non-linear, time varying, or encoded in text, networks, and images. To maximize accessibility, we also introduce prerequisite concepts from causal inference and deep learning. The survey differs from other treatments of deep learning and causal inference in its sharp focus on observational causal estimation, its extended exposition of key algorithms, and its detailed tutorials for implementing, training, and selecting among deep estimators in Tensorflow 2 available at github.com/kochbj/Deep-Learning-for-Causal-Inference.


title: Turning AGN bubbles into radio relics with sloshing: modeling CR transport with realistic physics

abstract: Radio relics are arc-like synchrotron sources at the periphery of galaxy clusters, produced by cosmic-ray electrons in a $\mu$G magnetic field which are believed to have been (re-)accelerated by merger shock fronts. However, not all relics appear at the same location as shocks as seen in the X-ray. In a previous work, we suggested that the shape of some relics may result from the pre-existing spatial distribution of cosmic-ray electrons, and tested this hypothesis using simulations by launching AGN jets into a cluster atmosphere with sloshing gas motions generated by a previous merger event. We showed that these motions could transport the cosmic ray-enriched material of the AGN bubbles to large radii and stretch it in a tangential direction, producing a filamentary shape resembling a radio relic. In this work, we improve our physical description for the cosmic rays by modeling them as a separate fluid which undergoes diffusion and Alfv\'en losses. We find that including this additional cosmic ray physics significantly diminishes the appearance of these filamentary features, showing that our original hypothesis is sensitive to the modeling of cosmic ray physics in the intracluster medium.


title: Sensoring and Application of Multimodal Data for the Detection of Freezing of Gait in Parkinson's Disease

abstract: The accurate and reliable detection or prediction of freezing of gaits (FOG) is important for fall prevention in Parkinson's Disease (PD) and studying the physiological transitions during the occurrence of FOG. Integrating both commercial and self-designed sensors, a protocal has been designed to acquire multimodal physical and physiological information during FOG, including gait acceleration (ACC), electroencephalogram (EEG), electromyogram (EMG), and skin conductance (SC). Two tasks were designed to trigger FOG, including gait initiation failure and FOG during walking. A total number of 12 PD patients completed the experiments and produced a total length of 3 hours and 42 minutes of valid data. The FOG episodes were labeled by two qualified physicians. Each unimodal data and combinations have been used to detect FOG. Results showed that multimodal data benefit the detection of FOG. Among unimodal data, EEG had better discriminative ability than ACC and EMG. However, the acquisition of EEG are more complicated. Multimodal motional and electrophysiological data can also be used to study the physiological transition process during the occurrence of FOG and provide personalised interventions.


title: Hyperscaling violating Schrodinger black holes in Einstein-Maxwell-scalar theory

abstract: We present a novel family of asymptotically Schrodinger hyperscaling violating black holes with a generic dynamical critical exponent and an arbitrary number of spacetime dimensions. This black hole family represents a solution within the Einstein-Maxwell-scalar setup with a self-interaction scalar potential where the Maxwell field is coupled to the scalar field. Through an analysis of the curvature invariants it is observed that this configuration is asymptotically regular for different ranges of the hyperscaling violating exponent. Furthermore, the above mentioned solution constitutes a gravitational candidate for describing field theories with hyperscaling violating Schrodinger symmetry at finite temperature within the framework of the Gravity/Condensed Matter Theory correspondence.


abstract: The spiral structure in the Solar neighborhood is an important issue in astronomy. In the past few years, there is significant progress in observation. The distances for a large number of good spiral tracers, i.e. giant molecular clouds, high-mass star-formation region masers, HII regions, O-type stars and young open clusters, have been accurately estimated, making it possible to depict the detailed properties of nearby spiral arms. In this work, we first give an overview about the research status for the Galaxy's spiral structure based on different types of tracers. Then the objects with distance uncertainties better than 15\% and $<$0.5 kpc are collected and combined together to depict the spiral structure in the Solar neighborhood. Five segments related with the Perseus, Local, Sagittarius-Carina, Scutum-Centaurus and Norma Arms are traced. With the large dataset, the parameters of the nearby arm segments are fitted and updated. Besides the dominant spiral arms, some substructures probably related to arm spurs or feathers are also noticed and discussed.


title: EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurement

abstract: Camera-based physiological measurement is a growing field with neural models providing state-the-art-performance. Prior research have explored various "end-to-end" models; however these methods still require several preprocessing steps. These additional operations are often non-trivial to implement making replication and deployment difficult and can even have a higher computational budget than the "core" network itself. In this paper, we propose two novel and efficient neural models for camera-based physiological measurement called EfficientPhys that remove the need for face detection, segmentation, normalization, color space transformation or any other preprocessing steps. Using an input of raw video frames, our models achieve strong performance on three public datasets. We show that this is the case whether using a transformer or convolutional backbone. We further evaluate the latency of the proposed networks and show that our most light weight network also achieves a 33% improvement in efficiency.


title: A State Transfer Method That Adapts to Network Bandwidth Variations in Geographic State Machine Replication

abstract: We present a new state transfer method for geographic State Machine Replication (SMR) that dynamically allocates the state to be transferred among replicas according to changes in communication bandwidths. SMR is a method that improves fault tolerance by replicating a service to multiple replicas. When a replica is newly added or is recovered from a failure, the other replicas transfer the current state of the service to it. However, in geographic SMR, the communication bandwidths of replicas are different and constantly changing. Therefore, existing state transfer methods cannot fully utilize the available bandwidth, and their state transfer time becomes long. To overcome this problem, our method divides the state into multiple chunks and assigns them to replicas based on each replica's bandwidth so that the broader a replica's bandwidth is, the more chunks it transfers. The number of assigned chunks is dynamically updated based on the currently estimated bandwidth. The performance evaluation on Amazon EC2 shows that the proposed method reduces the state transfer time by up to 47% compared with the existing one.


title: Time shifting deviation method enhanced laser interferometry: ultrahigh precision localizing of traffic vibration using urban fiber link

abstract: Using fiber network as a huge sensing system will enrich monitoring methods of public infrastructures and geological disasters. With traditional cross-correlation method, laser interferometer has been used to detect and localize the vibration event. However, the random error induced by cross-correlation method limits the localization accuracy, and makes it not suitable for ultrahigh precision localizing applications. We propose a novel time shifting deviation (TSDEV) method, which has advantages over cross-correlation method in practicability and localization accuracy. Three experiments are carried out to demonstrate the novelty of the TSDEV method. In lab test, vibration localization accuracy of ~2.5 m is realized. In field tests, TSDEV method enhanced interferometry is applied to monitor the urban fiber link. Traffic vibration events on the campus road and Beijing ring road have been precisely localized and analyzed, respectively. The proposed technique will extend the function of existing urban fiber network, and better serve the future smart city.


title: Scene Editing as Teleoperation: A Case Study in 6DoF Kit Assembly

abstract: Studies in robot teleoperation have been centered around action specifications -- from continuous joint control to discrete end-effector pose control. However, these robot-centric interfaces often require skilled operators with extensive robotics expertise. To make teleoperation accessible to non-expert users, we propose the framework "Scene Editing as Teleoperation" (SEaT), where the key idea is to transform the traditional "robot-centric" interface into a "scene-centric" interface -- instead of controlling the robot, users focus on specifying the task's goal by manipulating digital twins of the real-world objects. As a result, a user can perform teleoperation without any expert knowledge of the robot hardware. To achieve this goal, we utilize a category-agnostic scene-completion algorithm that translates the real-world workspace (with unknown objects) into a manipulable virtual scene representation and an action-snapping algorithm that refines the user input before generating the robot's action plan. To train the algorithms, we procedurally generated a large-scale, diverse kit-assembly dataset that contains object-kit pairs that mimic real-world object-kitting tasks. Our experiments in simulation and on a real-world system demonstrate that our framework improves both the efficiency and success rate for 6DoF kit-assembly tasks. A user study demonstrates that SEaT framework participants achieve a higher task success rate and report a lower subjective workload compared to an alternative robot-centric interface. Video can be found at https://www.youtube.com/watch?v=-NdR3mkPbQQ .


title: Using multiple reference audios and style embedding constraints for speech synthesis

abstract: The end-to-end speech synthesis model can directly take an utterance as reference audio, and generate speech from the text with prosody and speaker characteristics similar to the reference audio. However, an appropriate acoustic embedding must be manually selected during inference. Due to the fact that only the matched text and speech are used in the training process, using unmatched text and speech for inference would cause the model to synthesize speech with low content quality. In this study, we propose to mitigate these two problems by using multiple reference audios and style embedding constraints rather than using only the target audio. Multiple reference audios are automatically selected using the sentence similarity determined by Bidirectional Encoder Representations from Transformers (BERT). In addition, we use ''target'' style embedding from a Pre-trained encoder as a constraint by considering the mutual information between the predicted and ''target'' style embedding. The experimental results show that the proposed model can improve the speech naturalness and content quality with multiple reference audios and can also outperform the baseline model in ABX preference tests of style similarity.


title: Towards AI Logic for Social Reasoning

abstract: Artificial Intelligence (AI) logic formalizes the reasoning of intelligent agents. In this paper, we discuss how an argumentation-based AI logic could be used also to formalize important aspects of social reasoning. Besides reasoning about the knowledge and actions of individual agents, social AI logic can reason also about social dependencies among agents using the rights, obligations and permissions of the agents. We discuss four aspects of social AI logic. First, we discuss how rights represent relations between the obligations and permissions of intelligent agents. Second, we discuss how to argue about the right-to-know, a central issue in the recent discussion of privacy and ethics. Third, we discuss how a wide variety of conflicts among intelligent agents can be identified and (sometimes) resolved by comparing formal arguments. Importantly, to cover a wide range of arguments occurring in daily life, also fallacious arguments can be represented and reasoned about. Fourth, we discuss how to argue about the freedom to act for intelligent agents. Examples from social, legal and ethical reasoning highlight the challenges in developing social AI logic. The discussion of the four challenges leads to a research program for argumentation-based social AI logic, contributing towards the future development of AI logic.


title: A Novel Quantum Calculus-based Complex Least Mean Square Algorithm (q-CLMS)

abstract: In this research, a novel adaptive filtering algorithm is proposed for complex domain signal processing. The proposed algorithm is based on Wirtinger calculus and is called as q-Complex Least Mean Square (q-CLMS) algorithm. The proposed algorithm could be considered as an extension of the q-LMS algorithm for the complex domain. Transient and steady-state analyses of the proposed q-CLMS algorithm are performed and exact analytical expressions for mean analysis, mean square error (MSE), excess mean square error (EMSE), mean square deviation (MSD) and misadjustment are presented. Extensive experiments have been conducted and a good match between the simulation results and theoretical findings is reported. The proposed q-CLMS algorithm is also explored for whitening applications with satisfactory performance. A modification of the proposed q-CLMS algorithm called Enhanced $q$-CLMS (Eq-CLMS) is also proposed. The Eq-CLMS algorithm eliminates the need for a pre-coded value of the q-parameter thereby automatically adapting to the best value. Extensive experiments are performed on system identification and channel equalization tasks and the proposed algorithm is shown to outperform several benchmark and state-of-the-art approaches namely Complex Least Mean Square (CLMS), Normalized Complex Least Mean Square (NCLMS), Variable Step Size Complex Least Mean Square (VSS-CLMS), Complex FLMS (CFLMS) and Fractional-ordered-CLMS (FoCLMS) algorithms.


title: Dynamic Logic of Legal Competences

abstract: We propose a new formalization of legal competences, and in particular for the Hohfeldian categories of power and immunity, through a deontic reinterpretation of dynamic epistemic logic. We argue that this logic explicitly captures the norm-changing character of legal competences while providing a sophisticated reduction of the latter to static normative positions. The logic is completely axiomatizable, and we apply it to a concrete case in German contract law to illustrate that it can capture the distinction between legal ability and legal permissibility.


title: Electrical conductivity of nanorod-based transparent electrodes: Comparison of mean-field approaches

abstract: We mimic nanorod-based transparent electrodes as random resistor networks (RRN) produced by the homogeneous, isotropic, and random deposition of conductive zero-width sticks onto an insulating substrate. We suppose that the number density (the number of objects per unit area of the surface) of these sticks exceeds the percolation threshold, i.e., the system under consideration is a conductor. We computed the electrical conductivity of random resistor networks vs the number density of conductive fillers for the wire-resistance-dominated case, for the junction-resistance-dominated case, and for an intermediate case. We also offer a consistent continuous variant of the mean-field approach. The results of the RRN computations were compared with this mean-field approach. Our computations suggest that, for a qualitative description of the behavior of the electrical conductivity in relation to the number density of conductive wires, the mean-field approximation can be successfully applied when the number density of the fillers $n > 2n_c$, where $n_c$ is the percolation threshold. However, note the mean-field approach slightly overestimates the electrical conductivity. We demonstrate that this overestimate is caused by the junction potential distribution.


title: Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Rate Control

abstract: We present a novel adaptive deep joint source-channel coding (JSCC) scheme for wireless image transmission. The proposed scheme supports multiple rates using a single deep neural network (DNN) model and learns to dynamically control the rate based on the channel condition and image contents. Specifically, a policy network is introduced to exploit the tradeoff space between the rate and signal quality. To train the policy network, the Gumbel-Softmax trick is adopted to make the policy network differentiable and hence the whole JSCC scheme can be trained end-to-end. To the best of our knowledge, this is the first deep JSCC scheme that can automatically adjust its rate using a single network model. Experiments show that our scheme successfully learns a reasonable policy that decreases channel bandwidth utilization for high SNR scenarios or simple image contents. For an arbitrary target rate, our rate-adaptive scheme using a single model achieves similar performance compared to an optimized model specifically trained for that fixed target rate. To reproduce our results, we make the source code publicly available at https://github.com/mingyuyng/Dynamic_JSCC.


title: Tailoring the Cyber Security Framework: How to Overcome the Complexities of Secure Live Virtual Machine Migration in Cloud Computing

abstract: This paper proposes a novel secure live virtual machine migration framework by using a virtual trusted platform module instance to improve the integrity of the migration process from one virtual machine to another on the same platform. The proposed framework, called Koror\=a, is designed and developed on a public infrastructure-as-a-service cloud-computing environment and runs concurrently on the same hardware components (Input/Output, Central Processing Unit, Memory) and the same hypervisor (Xen); however, a combination of parameters needs to be evaluated before implementing Koror\=a. The implementation of Koror\=a is not practically feasible in traditional distributed computing environments. It requires fixed resources with high-performance capabilities, connected through a high-speed, reliable network. The following research objectives were determined to identify the integrity features of live virtual machine migration in the cloud system: To understand the security issues associated with cloud computing, virtual trusted platform modules, virtualization, live virtual machine migration, and hypervisors; To identify the requirements for the proposed framework, including those related to live VM migration among different hypervisors; To design and validate the model, processes, and architectural features of the proposed framework; To propose and implement an end-to-end security architectural blueprint for cloud environments, providing an integrated view of protection mechanisms, and then to validate the proposed framework to improve the integrity of live VM migration. This is followed by a comprehensive review of the evaluation system architecture and the proposed framework state machine. The overarching aim of this paper, therefore, is to present a detailed analysis of the cloud computing security problem, from the perspective of cloud architectures and the cloud... [Abridged]


title: Vision Transformer based COVID-19 Detection using Chest X-rays

abstract: COVID-19 is a global pandemic, and detecting them is a momentous task for medical professionals today due to its rapid mutations. Current methods of examining chest X-rays and CT scan requires profound knowledge and are time consuming, which suggests that it shrinks the precious time of medical practitioners when people's lives are at stake. This study tries to assist this process by achieving state-of-the-art performance in classifying chest X-rays by fine-tuning Vision Transformer(ViT). The proposed approach uses pretrained models, fine-tuned for detecting the presence of COVID-19 disease on chest X-rays. This approach achieves an accuracy score of 97.61%, precision score of 95.34%, recall score of 93.84% and, f1-score of 94.58%. This result signifies the performance of transformer-based models on chest X-ray.


title: Adversarial Training for Face Recognition Systems using Contrastive Adversarial Learning and Triplet Loss Fine-tuning

abstract: Though much work has been done in the domain of improving the adversarial robustness of facial recognition systems, a surprisingly small percentage of it has focused on self-supervised approaches. In this work, we present an approach that combines Ad-versarial Pre-Training with Triplet Loss AdversarialFine-Tuning. We compare our methods with the pre-trained ResNet50 model that forms the backbone of FaceNet, finetuned on our CelebA dataset. Through comparing adversarial robustness achieved without adversarial training, with triplet loss adversarial training, and our contrastive pre-training combined with triplet loss adversarial fine-tuning, we find that our method achieves comparable results with far fewer epochs re-quired during fine-tuning. This seems promising, increasing the training time for fine-tuning should yield even better results. In addition to this, a modified semi-supervised experiment was conducted, which demonstrated the improvement of contrastive adversarial training with the introduction of small amounts of labels.


title: Removing Interlopers From Intensity Mapping Probes Of Primordial Non-Gaussianity

abstract: Line intensity mapping (LIM) has the potential to produce highly precise measurements of scale-dependence bias from primordial non-Gaussianity (PNG) due to its ability to map much larger volumes than are available from galaxy surveys. PNG parameterized by $f_{NL}$ leads to a scale-dependent correction to the bias, and therefore a correction to the line intensity power spectrum. However, LIM experiences contamination from foreground emission, including interloping emission lines from other redshifts which alter the power spectra of the maps at these scales, potentially biasing measurements of $f_{NL}$. Here we model the effect of line interlopers on upcoming line intensity mapping probes of primordial non-Gaussianity (PNG) from inflation. As an example, we consider the $[\rm CII]$ line at target redshift $z_t = 3.6$ to probe PNG, with the important systematic concern being foreground contamination from CO lines residing at redshifts different from the target redshift. We find interloper lines can lead to a significant bias and an increase in errors for our PNG constraints, leading to a false positive for non-standard inflation models. We model how well the cross-correlation technique could reduce this interloper contamination. We find the uncertainty of $f_{NL}$ reduces by factors of two and six for local and orthogonal shape PNG respectively, and by a factor of five for local shape if we consider seven interloper lines, almost eliminating the effect of interlopers. This work shows that using cross-power and auto-power spectra of line intensity maps jointly could potentially remove the effects of interlopers when measuring non-Gaussianity.


title: Toward Hole-Driven Development with Liquid Haskell

abstract: Liquid Haskell is an extension to the Haskell programming language that adds support for refinement types: data types augmented with SMT-decidable logical predicates that refine the set of values that can inhabit a type. Furthermore, Liquid Haskell's support for refinement reflection enables the use of Haskell for general-purpose mechanized theorem proving. A growing list of large-scale mechanized proof developments in Liquid Haskell take advantage of this capability. Adding theorem-proving capabilities to a "legacy" language like Haskell lets programmers directly verify properties of real-world Haskell programs (taking advantage of the existing highly tuned compiler, run-time system, and libraries), just by writing Haskell. However, more established proof assistants like Agda and Coq offer far better support for interactive proof development and insight into the proof state (for instance, what subgoals still need to be proved to finish a partially-complete proof). In contrast, Liquid Haskell provides only coarse-grained feedback to the user -- either it reports a type error, or not -- unfortunately hindering its usability as a theorem prover. In this paper, we propose improving the usability of Liquid Haskell by extending it with support for Agda-style typed holes and interactive editing commands that take advantage of them. In Agda, typed holes allow programmers to indicate unfinished parts of a proof, and incrementally complete the proof in a dialogue with the compiler. While GHC Haskell already has its own Agda-inspired support for typed holes, we posit that typed holes would be especially powerful and useful if combined with Liquid Haskell's refinement types and SMT automation. We discuss how typed holes might work in Liquid Haskell, and we consider possible implementation approaches and next steps.


title: Extension of the J-PARC Hadron Experimental Facility: Third White Paper

abstract: The J-PARC Hadron Experimental Facility was constructed with an aim to explore the origin and evolution of matter in the universe through the experiments with intense particle beams. In the past decade, many results on particle and nuclear physics have been obtained at the present facility. To expand the physics programs to unexplored regions never achieved, the extension project of the Hadron Experimental Facility has been extensively discussed. This white paper presents the physics of the extension of the Hadron Experimental Facility for resolving the issues in the fields of the strangeness nuclear physics, hadron physics, and flavor physics.


title: Optimization of A Mobile Optical SWIPT System With Asymmetric Spatially Separated Laser Resonator

abstract: High-power and high-rate simultaneous wireless information and power transfer (SWIPT) becomes more and more important with the development of Internet of Things technologies. Optical SWIPT, also known as simultaneous light information and power transfer (SLIPT), has unique advantages such as abundant spectrum resources and low propagation divergence, compared with radio-frequency (RF) SWIPT. However, optical SWIPT faces many challenges in beam steering and receiver positioning/tracking. Resonant beams generated by spatially separated laser resonators (SSLR) have many advantages, including high power, self-aligned mobility, and intrinsic safety. It has been proposed as the carrier of wireless charging and communication. Using resonant beams, mobile electronic devices can be remotely charged and supported with high-rate data transfer. In this paper, we propose a mobile optical SWIPT system based on asymmetric SSLR and present the system optimization procedure. We also determine the boundary of the charging power and communication rate, and discuss the trade-off between power transfer and information transfer. Numerical results show that both the charging power and the communication rate of the optimized asymmetric system are much higher than those of the symmetric system in the previous work.


title: Peripherality in networks: theory and applications

abstract: We investigate several related measures of peripherality and centrality for vertices and edges in networks, including the Mostar index which was recently introduced as a measure of peripherality for both edges and networks. We refute a conjecture on the maximum possible Mostar index of bipartite graphs from (Do\v{s}li\'{c} et al, Journal of Mathematical Chemistry, 2018) and (Ali and Do\v{s}li\'{c}, Applied Mathematics and Computation, 2021). We also correct a result from the latter paper, where they claimed that the maximum possible value of the terminal Mostar index among all trees of order $n$ is $(n-1)(n-2)$. We show that this maximum is $(n-1)(n-3)$ for $n \ge 3$, and that it is only attained by the star. We asymptotically answer another problem on the maximum difference between the Mostar index and the irregularity of trees from (F. Gao et al, On the difference of Mostar index and irregularity of graphs, Bulletin of the Malaysian Mathematical Sciences Society, 2021). We also prove a number of extremal bounds and computational complexity results about the Mostar index, irregularity, and measures of peripherality and centrality. We discuss graphs where the Mostar index is not an accurate measure of peripherality. We construct a general family of graphs with the property that the Mostar index is strictly greater for edges that are closer to the center. We also investigate centrality and peripherality in two graphs which represent the SuperFast and MOZART-4 systems of atmospheric chemical reactions by computing various measures of peripherality and centrality for the vertices and edges in these graphs. For both of these graphs, we find that the Mostar index is closer to a measure of centrality than peripherality of the edges. We also introduce some new indices which perform well as measures of peripherality on the SuperFast and MOZART-4 graphs.


title: Predicting decision-making in the future: Human versus Machine

abstract: Deep neural networks (DNNs) have become remarkably successful in data prediction, and have even been used to predict future actions based on limited input. This raises the question: do these systems actually "understand" the event similar to humans? Here, we address this issue using videos taken from an accident situation in a driving simulation. In this situation, drivers had to choose between crashing into a suddenly-appeared obstacle or steering their car off a previously indicated cliff. We compared how well humans and a DNN predicted this decision as a function of time before the event. The DNN outperformed humans for early time-points, but had an equal performance for later time-points. Interestingly, spatio-temporal image manipulations and Grad-CAM visualizations uncovered some expected behavior, but also highlighted potential differences in temporal processing for the DNN.


title: ProductAE: Towards Training Larger Channel Codes based on Neural Product Codes

abstract: There have been significant research activities in recent years to automate the design of channel encoders and decoders via deep learning. Due the dimensionality challenge in channel coding, it is prohibitively complex to design and train relatively large neural channel codes via deep learning techniques. Consequently, most of the results in the literature are limited to relatively short codes having less than 100 information bits. In this paper, we construct ProductAEs, a computationally efficient family of deep-learning driven (encoder, decoder) pairs, that aim at enabling the training of relatively large channel codes (both encoders and decoders) with a manageable training complexity. We build upon the ideas from classical product codes, and propose constructing large neural codes using smaller code components. More specifically, instead of directly training the encoder and decoder for a large neural code of dimension $k$ and blocklength $n$, we provide a framework that requires training neural encoders and decoders for the code parameters $(n_1,k_1)$ and $(n_2,k_2)$ such that $n_1 n_2=n$ and $k_1 k_2=k$. Our training results show significant gains, over all ranges of signal-to-noise ratio (SNR), for a code of parameters $(225,100)$ and a moderate-length code of parameters $(441,196)$, over polar codes under successive cancellation (SC) decoder. Moreover, our results demonstrate meaningful gains over Turbo Autoencoder (TurboAE) and state-of-the-art classical codes. This is the first work to design product autoencoders and a pioneering work on training large channel codes.


title: Inexorable Edge Kondo Breakdown in Topological Kondo Insulators

abstract: Kondo breakdown is one of the most intriguing problems in strongly correlated electron systems, as it is rooted in many anomalous electron behaviors found in heavy-fermion materials. In Kondo lattice systems, Kondo breakdown can arise from either strong magnetic frustrations or critical fluctuations of collective modes. Here, we reveal a new type of Kondo breakdown with a fully different origin in interacting topological Kondo insulators. By employing numerically exact quantum Monte Carlo simulations, we show that with open boundary conditions, Kondo screening is inexorably destroyed by interaction effects on edges or corners in these systems. We argue that the Kondo breakdown is enforced by the symmetries of the system, because the ground states are symmetry protected Haldane phases.


title: Guided assembly of cellular network models from knowledge in literature

abstract: Computational modeling is crucial for understanding and analyzing complex systems. In biology, model creation is a human dependent task that requires reading hundreds of papers and conducting wet lab experiments, which would take days or months. To overcome this hurdle, we propose a novel automated method, that utilizes the knowledge published in literature to suggest model extensions by selecting most relevant and useful information in few seconds. In particular, our novel approach organizes the events extracted from the literature as a collaboration graph with additional metric that relies on the event occurrence frequency in literature. Additionally, we show that common graph centrality metrics vary in the assessment of the extracted events. We have demonstrated the reliability of the proposed method using three different selected models, namely, T cell differentiation, T cell large granular lymphocyte, and pancreatic cancer cell. Our proposed method was able to find high percent of the desired new events with an average recall of 82%.


title: The $n$-dimensional quadratic Heisenberg algebra as a "non--commutative" $\rm{sl}(2,\mathbb{C})$

abstract: We prove that the commutation relations among the generators of the quadratic Heisenberg algebra of dimension $n\in\mathbb{N}$, look like a kind of \textit{non-commutative extension} of $\hbox{sl}(2, \mathbb{C})$ (more precisely of its unique $1$--dimensional central extension), denoted $\hbox{heis}_{2;\mathbb{C}}(n)$ and called the complex $n$--dimensional quadratic Boson algebra. This \textit{non-commutativity} has a different nature from the one considered in quantum groups. %In particular we prove that, for %most values of $n$, this Lie algebra cannot be isomorphic to %$\hbox{sl}(N, \mathbb{C})$ for almost any value of $N$. We prove the exponentiability of these algebras (for any $n$) in the Fock representation. We obtain the group multiplication law, in coordinates of the first and second kind, for the quadratic Boson group and we show that, in the case of the adjoint representation, these multiplication laws can be expressed in terms of a generalization of the Jordan multiplication. We investigate the connections between these two types of coordinates (disentangling formulas). From this we deduce a new proof of the expression of the vacuum characteristic function of homogeneous quadratic boson fields.


title: Structural and Dynamic Properties of Solvated Hydroxide and Hydronium Ions in Water from Ab Initio Modeling

abstract: Predicting the asymmetric structure and dynamics of solvated hydroxide and hydronium in water has been a challenging task from ab initio molecular dynamics (AIMD). The difficulty mainly comes from a lack of accurate and efficient exchange-correlation functional in elucidating the amphiphilic nature and the ubiquitous proton transfer behaviors of the two ions. By adopting the strongly-constrained and appropriately normed (SCAN) meta-GGA functional in AIMD simulations, we systematically examine the amphiphilic properties, the solvation structures, the electronic structures, and the dynamic properties of the two water ions. In particular, we compare these results to those predicted by the PBE0-TS functional, which is an accurate yet computationally more expensive exchange-correlation functional. We demonstrate that the general-purpose SCAN functional provides a reliable choice in describing the two water ions. Specifically, in the SCAN picture of water ions, the appearance of the fourth and fifth hydrogen bonds near hydroxide stabilizes the pot-like shape solvation structure and suppresses the structural diffusion, while the hydronium stably donates three hydrogen bonds to its neighbors. As a result, hydroxide prefers the stepwise proton transfer (PT) while hydronium prefers the concerted PT behavior. Consequently, hydroxide diffuses slower than hydronium in water, which is consistent with the experiments.


title: Provably Efficient Black-Box Action Poisoning Attacks Against Reinforcement Learning

abstract: Due to the broad range of applications of reinforcement learning (RL), understanding the effects of adversarial attacks against RL model is essential for the safe applications of this model. Prior theoretical works on adversarial attacks against RL mainly focus on either observation poisoning attacks or environment poisoning attacks. In this paper, we introduce a new class of attacks named action poisoning attacks, where an adversary can change the action signal selected by the agent. Compared with existing attack models, the attacker's ability in the proposed action poisoning attack model is more restricted, which brings some design challenges. We study the action poisoning attack in both white-box and black-box settings. We introduce an adaptive attack scheme called LCB-H, which works for most RL agents in the black-box setting. We prove that the LCB-H attack can force any efficient RL agent, whose dynamic regret scales sublinearly with the total number of steps taken, to choose actions according to a policy selected by the attacker very frequently, with only sublinear cost. In addition, we apply LCB-H attack against a popular model-free RL algorithm: UCB-H. We show that, even in the black-box setting, by spending only logarithm cost, the proposed LCB-H attack scheme can force the UCB-H agent to choose actions according to the policy selected by the attacker very frequently.


title: Identifying Majorana bound states at quantum spin Hall edges using a metallic probe

abstract: We study the conductance afforded by a normal-metal probe which is directly contacting the helical edge modes of a quantum spin Hall insulator (QSHI). We show a $2e^2/h$ conductance peak at zero temperature in QSHI-based superconductor--ferromagnet hybrids due to the formation of a single Majorana bound state (MBS). In a corresponding Josephson junction hosting a pair of MBSs, a $4e^2/h$ conductance peak is found at zero temperature. The conductance quantization is robust to changes of the relevant system parameters and, remarkably, remains unaltered with increasing the distance between probe and MBSs. In the low temperature limit, the conductance peak is robust as the probe is placed within the localization length of MBSs. Our findings can therefore provide an effective way to detect the existence of MBSs in QSHI systems.


title: Self-adaptive Multi-task Particle Swarm Optimization

abstract: Multi-task optimization (MTO) studies how to simultaneously solve multiple optimization problems for the purpose of obtaining better performance on each problem. Over the past few years, evolutionary MTO (EMTO) was proposed to handle MTO problems via evolutionary algorithms. So far, many EMTO algorithms have been developed and demonstrated well performance on solving real-world problems. However, there remain many works to do in adapting knowledge transfer to task relatedness in EMTO. Different from the existing works, we develop a self-adaptive multi-task particle swarm optimization (SaMTPSO) through the developed knowledge transfer adaptation strategy, the focus search strategy and the knowledge incorporation strategy. In the knowledge transfer adaptation strategy, each task has a knowledge source pool that consists of all knowledge sources. Each source (task) outputs knowledge to the task. And knowledge transfer adapts to task relatedness via individuals' choice on different sources of a pool, where the chosen probabilities for different sources are computed respectively according to task's success rate in generating improved solutions via these sources. In the focus search strategy, if there is no knowledge source benefit the optimization of a task, then all knowledge sources in the task's pool are forbidden to be utilized except the task, which helps to improve the performance of the proposed algorithm. Note that the task itself is as a knowledge source of its own. In the knowledge incorporation strategy, two different forms are developed to help the SaMTPSO explore and exploit the transferred knowledge from a chosen source, each leading to a version of the SaMTPSO. Several experiments are conducted on two test suites. The results of the SaMTPSO are comparing to that of 3 popular EMTO algorithms and a particle swarm algorithm, which demonstrates the superiority of the SaMTPSO.


title: A Mutual learning framework for Few-shot Sound Event Detection

abstract: Although prototypical network (ProtoNet) has proved to be an effective method for few-shot sound event detection, two problems still exist. Firstly, the small-scaled support set is insufficient so that the class prototypes may not represent the class center accurately. Secondly, the feature extractor is task-agnostic (or class-agnostic): the feature extractor is trained with base-class data and directly applied to unseen-class data. To address these issues, we present a novel mutual learning framework with transductive learning, which aims at iteratively updating the class prototypes and feature extractor. More specifically, we propose to update class prototypes with transductive inference to make the class prototypes as close to the true class center as possible. To make the feature extractor to be task-specific, we propose to use the updated class prototypes to fine-tune the feature extractor. After that, a fine-tuned feature extractor further helps produce better class prototypes. Our method achieves the F-score of 38.4$\%$ on the DCASE 2021 Task 5 evaluation set, which won the first place in the few-shot bioacoustic event detection task of Detection and Classification of Acoustic Scenes and Events (DCASE) 2021 Challenge.


title: Leveraging recent advances in Pre-Trained Language Models forEye-Tracking Prediction

abstract: Cognitively inspired Natural Language Pro-cessing uses human-derived behavioral datalike eye-tracking data, which reflect the seman-tic representations of language in the humanbrain to augment the neural nets to solve arange of tasks spanning syntax and semanticswith the aim of teaching machines about lan-guage processing mechanisms. In this paper,we use the ZuCo 1.0 and ZuCo 2.0 dataset con-taining the eye-gaze features to explore differ-ent linguistic models to directly predict thesegaze features for each word with respect to itssentence. We tried different neural networkmodels with the words as inputs to predict thetargets. And after lots of experimentation andfeature engineering finally devised a novel ar-chitecture consisting of RoBERTa Token Clas-sifier with a dense layer on top for languagemodeling and a stand-alone model consistingof dense layers followed by a transformer layerfor the extra features we engineered. Finally,we took the mean of the outputs of both thesemodels to make the final predictions. We eval-uated the models using mean absolute error(MAE) and the R2 score for each target.


title: Label quality in AffectNet: results of crowd-based re-annotation

abstract: AffectNet is one of the most popular resources for facial expression recognition (FER) on relatively unconstrained in-the-wild images. Given that images were annotated by only one annotator with limited consistency checks on the data, however, label quality and consistency may be limited. Here, we take a similar approach to a study that re-labeled another, smaller dataset (FER2013) with crowd-based annotations, and report results from a re-labeling and re-annotation of a subset of difficult AffectNet faces with 13 people on both expression label, and valence and arousal ratings. Our results show that human labels overall have medium to good consistency, whereas human ratings especially for valence are in excellent agreement. Importantly, however, crowd-based labels are significantly shifting towards neutral and happy categories and crowd-based affective ratings form a consistent pattern different from the original ratings. ResNets fully trained on the original AffectNet dataset do not predict human voting patterns, but when weakly-trained do so much better, particularly for valence. Our results have important ramifications for label quality in affective computing.


title: Enhancement of spin-orbit coupling and magnetic scattering in hydrogenated graphene

abstract: Spin-orbit coupling (SOC) can provide essential tools to manipulate electron spins in two-dimensional materials like graphene, which is of great interest for both fundamental physics and spintronics application. In this paper, we report the low-field magnetotransport of in situ hydrogenated graphene where hydrogen atoms are attached to the graphene surface in continuous low temperature and vacuum environment. Transition from weak localization to weak antilocalization with increasing hydrogen adatom density is observed, indicating enhancing Bychkov-Rashba-type SOC in a mirror symmetry broken system. From the low-temperature saturation of phase breaking scattering rate, the existence of spin-flip scattering is identified, which corroborates the existence of magnetic moments in hydrogenated graphene.


title: Themis: A Network Bandwidth-Aware Collective Scheduling Policy for Distributed Training of DL Models

abstract: Distributed training is a solution to reduce DNN training time by splitting the task across multiple NPUs (e.g., GPU/TPU). However, distributed training adds communication overhead between the NPUs in order to synchronize the gradients and/or activation, depending on the parallelization strategy. In next-generation platforms for training at scale, NPUs will be connected through multi-dimensional networks with diverse, heterogeneous bandwidths. This work identifies a looming challenge of keeping all network dimensions busy and maximizing the network BW within the hybrid environment if we leverage scheduling techniques for collective communication on systems today. We propose Themis, a novel collective scheduling scheme that dynamically schedules collectives (divided into chunks) to balance the communication loads across all dimensions, further improving the network BW utilization. Our results show that on average, Themis can improve the network BW utilization of the single All-Reduce by 1.72X (2.70X max), and improve the end-to-end training iteration performance of real workloads such as ResNet-152, GNMT, DLRM, and Transformer-1T by 1.49X (2.25X max), 1.30X (1.78X max), 1.30X (1.77X max), and 1.25X (1.53X max), respectively.


title: A Feature Consistency Driven Attention Erasing Network for Fine-Grained Image Retrieval

abstract: Large-scale fine-grained image retrieval has two main problems. First, low dimensional feature embedding can fasten the retrieval process but bring accuracy reduce due to overlooking the feature of significant attention regions of images in fine-grained datasets. Second, fine-grained images lead to the same category query hash codes mapping into the different cluster in database hash latent space. To handle these two issues, we propose a feature consistency driven attention erasing network (FCAENet) for fine-grained image retrieval. For the first issue, we propose an adaptive augmentation module in FCAENet, which is selective region erasing module (SREM). SREM makes the network more robust on subtle differences of fine-grained task by adaptively covering some regions of raw images. The feature extractor and hash layer can learn more representative hash code for fine-grained images by SREM. With regard to the second issue, we fully exploit the pair-wise similarity information and add the enhancing space relation loss (ESRL) in FCAENet to make the vulnerable relation stabler between the query hash code and database hash code. We conduct extensive experiments on five fine-grained benchmark datasets (CUB2011, Aircraft, NABirds, VegFru, Food101) for 12bits, 24bits, 32bits, 48bits hash code. The results show that FCAENet achieves the state-of-the-art (SOTA) fine-grained retrieval performance compared with other methods.


title: Bayesian Active Summarization

abstract: Bayesian Active Learning has had significant impact to various NLP problems, but nevertheless it's application to text summarization has been explored very little. We introduce Bayesian Active Summarization (BAS), as a method of combining active learning methods with state-of-the-art summarization models. Our findings suggest that BAS achieves better and more robust performance, compared to random selection, particularly for small and very small data annotation budgets. Using BAS we showcase it is possible to leverage large summarization models to effectively solve real-world problems with very limited annotated data.


title: Comparing Facial Expression Recognition in Humans and Machines: Using CAM, GradCAM, and Extremal Perturbation

abstract: Facial expression recognition (FER) is a topic attracting significant research in both psychology and machine learning with a wide range of applications. Despite a wealth of research on human FER and considerable progress in computational FER made possible by deep neural networks (DNNs), comparatively less work has been done on comparing the degree to which DNNs may be comparable to human performance. In this work, we compared the recognition performance and attention patterns of humans and machines during a two-alternative forced-choice FER task. Human attention was here gathered through click data that progressively uncovered a face, whereas model attention was obtained using three different popular techniques from explainable AI: CAM, GradCAM and Extremal Perturbation. In both cases, performance was gathered as percent correct. For this task, we found that humans outperformed machines quite significantly. In terms of attention patterns, we found that Extremal Perturbation had the best overall fit with the human attention map during the task.


title: Towards Lifelong Learning of Multilingual Text-To-Speech Synthesis

abstract: This work presents a lifelong learning approach to train a multilingual Text-To-Speech (TTS) system, where each language was seen as an individual task and was learned sequentially and continually. It does not require pooled data from all languages altogether, and thus alleviates the storage and computation burden. One of the challenges of lifelong learning methods is "catastrophic forgetting": in TTS scenario it means that model performance quickly degrades on previous languages when adapted to a new language. We approach this problem via a data-replay-based lifelong learning method. We formulate the replay process as a supervised learning problem, and propose a simple yet effective dual-sampler framework to tackle the heavily language-imbalanced training samples. Through objective and subjective evaluations, we show that this supervised learning formulation outperforms other gradient-based and regularization-based lifelong learning methods, achieving 43% Mel-Cepstral Distortion reduction compared to a fine-tuning baseline.


title: Visualizing the embedding space to explain the effect of knowledge distillation

abstract: Recent research has found that knowledge distillation can be effective in reducing the size of a network and in increasing generalization. A pre-trained, large teacher network, for example, was shown to be able to bootstrap a student model that eventually outperforms the teacher in a limited label environment. Despite these advances, it still is relatively unclear \emph{why} this method works, that is, what the resulting student model does 'better'. To address this issue, here, we utilize two non-linear, low-dimensional embedding methods (t-SNE and IVIS) to visualize representation spaces of different layers in a network. We perform a set of extensive experiments with different architecture parameters and distillation methods. The resulting visualizations and metrics clearly show that distillation guides the network to find a more compact representation space for higher accuracy already in earlier layers compared to its non-distilled version.


title: Wav2vec-S: Semi-Supervised Pre-Training for Low-Resource ASR

abstract: Self-supervised pre-training could effectively improve the performance of low-resource automatic speech recognition (ASR). However, existing self-supervised pre-training are task-agnostic, i.e., could be applied to various downstream tasks. Although it enlarges the scope of its application, the capacity of the pre-trained model is not fully utilized for the ASR task, and the learned representations may not be optimal for ASR. In this work, in order to build a better pre-trained model for low-resource ASR, we propose a pre-training approach called wav2vec-S, where we use task-specific semi-supervised pre-training to refine the self-supervised pre-trained model for the ASR task thus more effectively utilize the capacity of the pre-trained model to generate task-specific representations for ASR. Experiments show that compared to wav2vec 2.0, wav2vec-S only requires a marginal increment of pre-training time but could significantly improve ASR performance on in-domain, cross-domain and cross-lingual datasets. Average relative WER reductions are 24.5% and 6.6% for 1h and 10h fine-tuning, respectively. Furthermore, we show that semi-supervised pre-training could close the representation gap between the self-supervised pre-trained model and the corresponding fine-tuned model through canonical correlation analysis.


title: Application of quantum computing to a linear non-Gaussian acyclic model for novel medical knowledge discovery

abstract: Recently, with the digitalization of medicine, the utilization of real-world medical data collected from clinical sites has been attracting attention. In this study, quantum computing was applied to a linear non-Gaussian acyclic model to discover causal relationships from real-world medical data alone. Specifically, the independence measure of DirectLiNGAM, a causal discovery algorithm, was calculated using the quantum kernel and its accuracy on real-world medical data was verified. When DirectLiNGAM with the quantum kernel (qLiNGAM) was applied to real-world medical data, a case was confirmed in which the causal structure could be correctly estimated when the amount of data was small, which was not possible with existing methods. Furthermore, qLiNGAM was implemented on real quantum hardware in an experiment using IBMQ. It is suggested that qLiNGAM may be able to discover new medical knowledge and contribute to the solution of medical problems, even when only a small amount of data is available.


title: PAMA-TTS: Progression-Aware Monotonic Attention for Stable Seq2Seq TTS With Accurate Phoneme Duration Control

abstract: Sequence expansion between encoder and decoder is a critical challenge in sequence-to-sequence TTS. Attention-based methods achieve great naturalness but suffer from unstable issues like missing and repeating phonemes, not to mention accurate duration control. Duration-informed methods, on the contrary, seem to easily adjust phoneme duration but show obvious degradation in speech naturalness. This paper proposes PAMA-TTS to address the problem. It takes the advantage of both flexible attention and explicit duration models. Based on the monotonic attention mechanism, PAMA-TTS also leverages token duration and relative position of a frame, especially countdown information, i.e. in how many future frames the present phoneme will end. They help the attention to move forward along the token sequence in a soft but reliable control. Experimental results prove that PAMA-TTS achieves the highest naturalness, while has on-par or even better duration controllability than the duration-informed model.


title: Colour augmentation for improved semi-supervised semantic segmentation

abstract: Consistency regularization describes a class of approaches that have yielded state-of-the-art results for semi-supervised classification. While semi-supervised semantic segmentation proved to be more challenging, a number of successful approaches have been recently proposed. Recent work explored the challenges involved in using consistency regularization for segmentation problems. In their self-supervised work Chen et al. found that colour augmentation prevents a classification network from using image colour statistics as a short-cut for self-supervised learning via instance discrimination. Drawing inspiration from this we find that a similar problem impedes semi-supervised semantic segmentation and offer colour augmentation as a solution, improving semi-supervised semantic segmentation performance on challenging photographic imagery.


title: Demystifying the Transferability of Adversarial Attacks in Computer Networks

abstract: Convolutional Neural Networks (CNNs) models are one of the most frequently used deep learning networks, and extensively used in both academia and industry. Recent studies demonstrated that adversarial attacks against such models can maintain their effectiveness even when used on models other than the one targeted by the attacker. This major property is known as transferability, and makes CNNs ill-suited for security applications. In this paper, we provide the first comprehensive study which assesses the robustness of CNN-based models for computer networks against adversarial transferability. Furthermore, we investigate whether the transferability property issue holds in computer networks applications. In our experiments, we first consider five different attacks: the Iterative Fast Gradient Method (I-FGSM), the Jacobian-based Saliency Map (JSMA), the Limited-memory Broyden Fletcher Goldfarb Shanno BFGS (L- BFGS), the Projected Gradient Descent (PGD), and the DeepFool attack. Then, we perform these attacks against three well- known datasets: the Network-based Detection of IoT (N-BaIoT) dataset, the Domain Generating Algorithms (DGA) dataset, and the RIPE Atlas dataset. Our experimental results show clearly that the transferability happens in specific use cases for the I- FGSM, the JSMA, and the LBFGS attack. In such scenarios, the attack success rate on the target network range from 63.00% to 100%. Finally, we suggest two shielding strategies to hinder the attack transferability, by considering the Most Powerful Attacks (MPAs), and the mismatch LSTM architecture.


title: Probing gluon helicity with heavy flavor at the EIC

abstract: We propose a new measurement of the heavy flavor hadron double spin asymmetry in deep-inelastic scattering at a future Electron-Ion Collider (EIC) to constrain the polarized gluon distribution function inside the proton. Statistical projection on $D^0$ meson double spin asymmetry is calculated with an EIC central detector using an all-silicon tracker and vertexing subsystem. A first impact study was done by interpreting pseudo-data at next-to-leading order in QCD. The sensitivity of the experimental observable in constraining gluon helicity distribution in a wide range of parton momentum fraction $x$ has been investigated considering different beam energy configurations. This measurement complements the inclusive spin-dependent structure function measurement and provides an opportunity to constrain the gluon helicity distribution in the moderate $x$ region.


title: On resonant generation of electromagnetic modes in nonlinear electrodynamics: Classical approach

abstract: The paper explores a theoretical possibility of resonant amplification of electromagnetic modes generated by a nonlinear effect in Euler-Heisenberg electrodynamics. Precisely, we examine the possibility of the amplification for the third harmonics induced by a single electromagnetic mode in radiofrequency cavity, as well as the generation of signal mode of combined frequencies induced by two pump modes ($\omega_1$ and $\omega_2$) in the cavity. Solving inhomogeneous wave equations for the signal mode, we formulate two resonant conditions for a cavity of arbitrary shape, and apply the obtained formalism to linear and rectangular cavities. We explicitly show that the third harmonics as well as the mode of combined frequency $2\omega_1 + \omega_2$ are not resonantly amplified while the signal mode with frequency $2\omega_1 - \omega_2$ is amplified for a certain cavity geometry.


title: Invertible Tone Mapping with Selectable Styles

abstract: Although digital cameras can acquire high-dynamic range (HDR) images, the captured HDR information are mostly quantized to low-dynamic range (LDR) images for display compatibility and compact storage. In this paper, we propose an invertible tone mapping method that converts the multi-exposure HDR to a true LDR (8-bit per color channel) and reserves the capability to accurately restore the original HDR from this {\em invertible LDR}. Our invertible LDR can mimic the appearance of a user-selected tone mapping style. It can be shared over any existing social network platforms that may re-encode or format-convert the uploaded images, without much hurting the accuracy of the restored HDR counterpart. To achieve this, we regard the tone mapping and the restoration as coupled processes, and formulate them as an encoding-and-decoding problem through convolutional neural networks. Particularly, our model supports pluggable style modulators, each of which bakes a specific tone mapping style, and thus favors the application flexibility. Our method is evaluated with a rich variety of HDR images and multiple tone mapping operators, which shows the superiority over relevant state-of-the-art methods. Also, we conduct ablation study to justify our design and discuss the robustness and generality toward real applications.


title: Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values

abstract: To obtain good performance, convolutional neural networks are usually over-parameterized. This phenomenon has stimulated two interesting topics: pruning the unimportant weights for compression and reactivating the unimportant weights to make full use of network capability. However, current weight reactivation methods usually reactivate the entire filters, which may not be precise enough. Looking back in history, the prosperity of filter pruning is mainly due to its friendliness to hardware implementation, but pruning at a finer structure level, i.e., weight elements, usually leads to better network performance. We study the problem of weight element reactivation in this paper. Motivated by evolution, we select the unimportant filters and update their unimportant elements by combining them with the important elements of important filters, just like gene crossover to produce better offspring, and the proposed method is called weight evolution (WE). WE is mainly composed of four strategies. We propose a global selection strategy and a local selection strategy and combine them to locate the unimportant filters. A forward matching strategy is proposed to find the matched important filters and a crossover strategy is proposed to utilize the important elements of the important filters for updating unimportant filters. WE is plug-in to existing network architectures. Comprehensive experiments show that WE outperforms the other reactivation methods and plug-in training methods with typical convolutional neural networks, especially lightweight networks. Our code is available at https://github.com/BZQLin/Weight-evolution.


title: High-performance computation of the exponential of a large sparse matrix

abstract: Computation of the large sparse matrix exponential has been an important topic in many fields, such as network and finite-element analysis. The existing scaling and squaring algorithm (SSA) is not suitable for the computation of the large sparse matrix exponential as it requires greater memories and computational cost than is actually needed. By introducing two novel concepts, i.e., real bandwidth and bandwidth, to measure the sparsity of the matrix, the sparsity of the matrix exponential is analyzed. It is found that for every matrix computed in the squaring phase of the SSA, a corresponding sparse approximate matrix exists. To obtain the sparse approximate matrix, a new filtering technique in terms of forward error analysis is proposed. Combining the filtering technique with the idea of keeping track of the incremental part, a competitive algorithm is developed for the large sparse matrix exponential. The proposed method can primarily alleviate the over-scaling problem due to the filtering technique. Three sets of numerical experiments, including one large matrix with a dimension larger than 2e6 , are conducted. The numerical experiments show that, compared with the expm function in MATLAB, the proposed algorithm can provide higher accuracy at lower computational cost and with less memory.


title: SGMNet: Scene Graph Matching Network for Few-Shot Remote Sensing Scene Classification

abstract: Few-Shot Remote Sensing Scene Classification (FSRSSC) is an important task, which aims to recognize novel scene classes with few examples. Recently, several studies attempt to address the FSRSSC problem by following few-shot natural image classification methods. These existing methods have made promising progress and achieved superior performance. However, they all overlook two unique characteristics of remote sensing images: (i) object co-occurrence that multiple objects tend to appear together in a scene image and (ii) object spatial correlation that these co-occurrence objects are distributed in the scene image following some spatial structure patterns. Such unique characteristics are very beneficial for FSRSSC, which can effectively alleviate the scarcity issue of labeled remote sensing images since they can provide more refined descriptions for each scene class. To fully exploit these characteristics, we propose a novel scene graph matching-based meta-learning framework for FSRSSC, called SGMNet. In this framework, a scene graph construction module is carefully designed to represent each test remote sensing image or each scene class as a scene graph, where the nodes reflect these co-occurrence objects meanwhile the edges capture the spatial correlations between these co-occurrence objects. Then, a scene graph matching module is further developed to evaluate the similarity score between each test remote sensing image and each scene class. Finally, based on the similarity scores, we perform the scene class prediction via a nearest neighbor classifier. We conduct extensive experiments on UCMerced LandUse, WHU19, AID, and NWPU-RESISC45 datasets. The experimental results show that our method obtains superior performance over the previous state-of-the-art methods.