title: Fine-Grained Few Shot Learning with Foreground Object Transformation

abstract: Traditional fine-grained image classification generally requires abundant labeled samples to deal with the low inter-class variance but high intra-class variance problem. However, in many scenarios we may have limited samples for some novel sub-categories, leading to the fine-grained few shot learning (FG-FSL) setting. To address this challenging task, we propose a novel method named foreground object transformation (FOT), which is composed of a foreground object extractor and a posture transformation generator. The former aims to remove image background, which tends to increase the difficulty of fine-grained image classification as it amplifies the intra-class variance while reduces inter-class variance. The latter transforms the posture of the foreground object to generate additional samples for the novel sub-category. As a data augmentation method, FOT can be conveniently applied to any existing few shot learning algorithm and greatly improve its performance on FG-FSL tasks. In particular, in combination with FOT, simple fine-tuning baseline methods can be competitive with the state-of-the-art methods both in inductive setting and transductive setting. Moreover, FOT can further boost the performances of latest excellent methods and bring them up to the new state-of-the-art. In addition, we also show the effectiveness of FOT on general FSL tasks.


title: Low-Shot Validation: Active Importance Sampling for Estimating Classifier Performance on Rare Categories

abstract: For machine learning models trained with limited labeled training data, validation stands to become the main bottleneck to reducing overall annotation costs. We propose a statistical validation algorithm that accurately estimates the F-score of binary classifiers for rare categories, where finding relevant examples to evaluate on is particularly challenging. Our key insight is that simultaneous calibration and importance sampling enables accurate estimates even in the low-sample regime (< 300 samples). Critically, we also derive an accurate single-trial estimator of the variance of our method and demonstrate that this estimator is empirically accurate at low sample counts, enabling a practitioner to know how well they can trust a given low-sample estimate. When validating state-of-the-art semi-supervised models on ImageNet and iNaturalist2017, our method achieves the same estimates of model performance with up to 10x fewer labels than competing approaches. In particular, we can estimate model F1 scores with a variance of 0.005 using as few as 100 labels.


title: ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

abstract: The recent progress of CNN has dramatically improved face alignment performance. However, few works have paid attention to the error-bias with respect to error distribution of facial landmarks. In this paper, we investigate the error-bias issue in face alignment, where the distributions of landmark errors tend to spread along the tangent line to landmark curves. This error-bias is not trivial since it is closely connected to the ambiguous landmark labeling task. Inspired by this observation, we seek a way to leverage the error-bias property for better convergence of CNN model. To this end, we propose anisotropic direction loss (ADL) and anisotropic attention module (AAM) for coordinate and heatmap regression, respectively. ADL imposes strong binding force in normal direction for each landmark point on facial boundaries. On the other hand, AAM is an attention module which can get anisotropic attention mask focusing on the region of point and its local edge connected by adjacent points, it has a stronger response in tangent than in normal, which means relaxed constraints in the tangent. These two methods work in a complementary manner to learn both facial structures and texture details. Finally, we integrate them into an optimized end-to-end training pipeline named ADNet. Our ADNet achieves state-of-the-art results on 300W, WFLW and COFW datasets, which demonstrates the effectiveness and robustness.


title: The homogeneity of the star forming environment of the Milky Way disk over time

abstract: Stellar abundances and ages afford the means to link chemical enrichment to galactic formation. In the Milky Way, individual element abundances show tight correlations with age, which vary in slope across ([Fe/H]-[$\alpha$/Fe]). Here, we step from characterising abundances as measures of age, to understanding how abundances trace properties of stellar birth-environment in the disk over time. Using measurements from $\sim$27,000 APOGEE stars (R=22,500, SNR$>$200), we build simple local linear models to predict a sample of elements (X = Si, O, Ca, Ti, Ni, Al, Mn, Cr) using (Fe, Mg) abundances alone, as fiducial tracers of supernovae production channels. Given [Fe/H] and [Mg/H], we predict these elements, [X/H], to about double the uncertainty of their measurements. The intrinsic dispersion, after subtracting measurement errors in quadrature is $\approx 0.015-0.04$~dex. The residuals of the prediction (measurement $-$ model) for each element demonstrate that each element has an individual link to birth properties at fixed (Fe, Mg). Residuals from primarily massive-star supernovae (i.e. Si, O, Al) partially correlate with guiding radius. Residuals from primarily supernovae Ia (i.e. Mn, Ni) partially correlate with age. A fraction of the intrinsic scatter that persists at fixed (Fe, Mg), however, after accounting for correlations, does not appear to further discriminate between birth properties that can be traced with present-day measurements. Presumably, this is because the residuals are also, in part, a measure of the typical (in)-homogeneity of the disk's stellar birth environments, previously inferred only using open-cluster systems. Our study implies at fixed birth radius and time, there is a median scatter of $\approx 0.01-0.015$ dex in elements generated in supernovae sources.


title: Clump-scale chemistry in the NGC2264-D cluster-forming region

abstract: We have conducted mapping observations toward the n3 and n5 positions in the NGC\,2264-D cluster-forming region with the Atacama Compact Array (ACA) of the Atacama Large Millimeter/submillimeter Array (ALMA) in Band 3. Observations with 10000 au scale beam reveal the chemical composition at the clump scale. The spatial distributions of the observed low upper-state-energy lines of CH$_{3}$OH are similar to those of CS and SO, and the HC$_{3}$N emission seems to be predominantly associated with clumps containing young stellar objects. The turbulent gas induced by the star formation activities produces large-scale shock regions in NGC\,2264-D, which are traced by the CH$_{3}$OH, CS and SO emissions. We derive the HC$_{3}$N, CH$_{3}$CN, and CH$_{3}$CHO abundances with respect to CH$_{3}$OH. Compared to the n5 field, the n3 field is farther (in projected apparent distance) from the neighboring NGC\,2264-C, yet the chemical composition in the n3 field tends to be similar to that of the protostellar candidate CMM3 in NGC\,2264-C. The HC$_{3}$N/CH$_{3}$OH ratios in the n3 field are higher than those in the n5 field. We find an anti-correlation between the HC$_{3}$N/CH$_{3}$OH ratio and their excitation temperatures. The low HC$_{3}$N/CH$_{3}$OH abundance ratio at the n5 field implies that the n5 field is an environment with more active star formation compared with the n3 field.


title: Algebraic spaces that become schematic after ground field extension

abstract: We construct examples of non-schematic algebraic spaces that become schemes after finite ground field extensions.


title: URLLC and eMBB Coexistence in MIMO Non-orthogonal Multiple Access Systems

abstract: Enhanced mobile broadband (eMBB) and ultrareliable and low-latency communications (URLLC) are two major expected services in the fifth-generation mobile communication systems (5G). Specifically, eMBB applications support extremely high data rate communications, while URLLC services aim to provide stringent latency with high reliability communications. Due to their differentiated quality-of-service (QoS) requirements, the spectrum sharing between URLLC and eMBB services becomes a challenging scheduling issue. In this paper, we aim to investigate the URLLC and eMBB coscheduling/coexistence problem under a puncturing technique in multiple-input multiple-output (MIMO) non-orthogonal multiple access (NOMA) systems. The objective function is formulated to maximize the data rate of eMBB users while satisfying the latency requirements of URLLC users through joint user selection and power allocation scheduling. To solve this problem, we first introduce an eMBB user clustering mechanism to balance the system performance and computational complexity. Thereafter, we decompose the original problem into two subproblems, namely the scheduling problem of user selection and power allocation. We introduce a Gale-Shapley (GS) theory to solve with the user selection problem, and a successive convex approximation (SCA) and a difference of convex (D.C.) programming to deal with the power allocation problem. Finally, an iterative algorithm is utilized to find the global solution with low computational complexity. Numerical results show the effectiveness of the proposed algorithms, and also verify the proposed approach outperforms other baseline methods.


title: The geometrical meaning of statistical isotropy of smooth random fields in two dimensions

abstract: We revisit the geometrical meaning of statistical isotropy that is manifest in excursion sets of smooth random fields in two dimensions. Using the contour Minkowski tensor, $\W_1$, as our basic tool we first examine geometrical properties of single structures. For simple closed curves in two dimensions we show that $\W_1$ is proportional to the identity matrix if the curve has $m$-fold symmetry, with $m\ge 3$. Then we elaborate on how $\W_1$ maps any arbitrary shaped simple closed curve to an ellipse that is unique up to translations of its centroid. We also carry out a comparison of the shape parameters, $\alpha$ and $\beta$, defined using $\W_1$, with the filamentarity parameter defined using two scalar Minkowski functionals - area and contour length. We show that they contain complementary shape information, with $\W_1$ containing additional information of orientation of structures. Next, we apply our method to boundaries of excursion sets of random fields and examine what statistical isotropy means for the geometry of the excursion sets. Focusing on Gaussian isotropic fields, and using a semi-numerical approach we quantify the effect of finite sampling of the field on the geometry of the excursion sets. In doing so we obtain an analytic expression for $\alpha$ which takes into account the effect of finite sampling. Finally we derive an analytic expression for the ensemble expectation of $\W_1$ for Gaussian anisotropic random fields. Our results provide insights that are useful for designing tests of statistical isotropy using cosmological data.


title: Obstructions to Integrability of Nearly Integrable Dynamical Systems near Regular Level Sets

abstract: We study the existence of real-analytic first integrals and real-analytic integrability for perturbations of integrable systems in the sense of Bogoyavlenskij including non-Hamiltonian ones. We especially assume that there exists a family of periodic orbits on a regular level set of the first integrals having a connected and compact component and give sufficient conditions for nonexistence of the same number of real-analytic first integrals in the perturbed systems as the unperturbed ones and for their real-analytic nonintegrability near the level set such that the first integrals and commutative vector fields depend analytically on the small parameter. We compare our results with classical results of Poincar\'e and Kozlov for systems written in action and angle coordinates and discuss their relationships with the subharmonic and homoclinic Melnikov methods for periodic perturbations of single-degree-of-freeedom Hamiltonian systems. We illustrate our theory for three examples containing the periodically forced Duffing oscillator.


title: Best proximity pairs in ultrametric spaces

abstract: In the present paper, we study the existence of best proximity pairs in ultrametric spaces. We show, under suitable assumptions, that the proximinal pair $(A,B)$ has a best proximity pair. As a consequence we generalize a well known best approximation result and we derive some fixed point theorems. Moreover, we provide examples to illustrate the obtained results.


title: CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

abstract: In this paper, we take the advantage of previous pre-trained models (PTMs) and propose a novel Chinese Pre-trained Unbalanced Transformer (CPT). Different from previous Chinese PTMs, CPT is designed to utilize the shared knowledge between natural language understanding (NLU) and natural language generation (NLG) to boost the performance. CPT consists of three parts: a shared encoder, an understanding decoder, and a generation decoder. Two specific decoders with a shared encoder are pre-trained with masked language modeling (MLM) and denoising auto-encoding (DAE) tasks, respectively. With the partially shared architecture and multi-task pre-training, CPT can (1) learn specific knowledge of both NLU or NLG tasks with two decoders and (2) be fine-tuned flexibly that fully exploits the potential of the model. Moreover, the unbalanced Transformer saves the computational and storage cost, which makes CPT competitive and greatly accelerates the inference of text generation. Experimental results on a wide range of Chinese NLU and NLG tasks show the effectiveness of CPT.


title: Optical frequency tweezers

abstract: We show a concept of optical frequency tweezers for tweezing light in the optical frequency domain with a high resolution, which is the frequency version of the optical tweezers for spatial manipulation of microscopic objects. We report the proof-of-principle experiment via frequency conversion inside a cavity only for the converted light. Thanks to the atypical configuration, the experimental result successfully achieves the tweezing operation in the frequency domain, which picks a light at a target frequency from the frequency-multiplexed input light and converts to a different frequency, without touching any other light sitting in different frequency positions and shaking frequency by the pump light.


title: True complexity and iterated Cauchy--Schwarz

abstract: We prove a polynomial bound in the "true complexity" problem of Gowers and Wolf. The proof uses only repeated applications of the Cauchy--Schwarz inequality, answering negatively a question posed by Gowers and Wolf. To choose and reason about the sequence of Cauchy--Schwarz steps needed, we need to introduce several layers of formalism and theory. The highest level of abstraction in this framework concerns building what we term "arithmetic circuits" encoding computations in multilinear algebra. It is plausible this machinery could be used to generate arithmetic inequalities in greater generality, and we state some conjectures along these lines.


title: Proximal Linearized Method for Sparse Equity Portfolio Optimization with Minimum Transaction Cost

abstract: In this paper, we propose a sparse equity portfolio optimization (SEPO) based on the mean-variance portfolio selection model. Aimed at minimizing transaction cost by avoiding small investments, this new model includes $\ell_0$-norm regularization of the asset weights to promote sparsity, hence the acronym SEPO-$\ell_0$. The selection model is also subjected to a minimum expected return. The complexity of the model calls for proximal method, which allows us to handle the objectives terms separately via the corresponding proximal operators. We develop an efficient ADMM-like algorithm to find the optimal portfolio and prove its global convergence. The efficiency of the algorithm is demonstrated using real stock data and the model is promising in portfolio selection in terms of generating higher expected return while maintaining good level of sparsity, and thus minimizing transaction cost.


title: Thermal corrections for positronium

abstract: Thermal corrections, including relativistic effects, for the positronium atom are discussed. The theoretical description of thermal corrections is carried out within the framework of relativistic quantum electrodynamics. As a result, thermal corrections to atomic energy levels with a fine and hyperfine structure and to the probabilities of annihilation of a positronium atom placed in a thermal environment (blackbody radiation) are taken into account. Numerical results are discussed throughout the paper in view of modern experiments and theoretical searches for verification of fundamental interactions.


title: On the number of residues of linear recurrences

abstract: For every nonconstant monic polynomial $g \in \mathbb{Z}[X]$, let $\mathfrak{M}(g)$ be the set of positive integers $m$ for which there exist an integer linear recurrence $(s_n)_{n \geq 0}$ having characteristic polynomial $g$ and a positive integer $M$ such that $(s_n)_{n \geq 0}$ has exactly $m$ distinct residues modulo $M$. Dubickas and Novikas proved that $\mathfrak{M}(X^2 - X - 1) = \mathbb{N}$. We study $\mathfrak{M}(g)$ in the case in which $g$ is divisible by a monic quadratic polynomial $f \in \mathbb{Z}[X]$ with roots $\alpha,\beta$ such that $\alpha\beta = \pm 1$ and $\alpha / \beta$ is not a root of unity. We show that this problem is related to the existence of special primitive divisors of certain Lehmer sequences, and we deduce some consequences on $\mathfrak{M}(g)$. In particular, for $\alpha\beta = -1$, we prove that $m \in \mathfrak{M}(g)$ for every integer $m \geq 7$ with $m \neq 10$ and $4 \nmid m$.


title: The decidability of the genus of regular languages and directed emulators

abstract: The article continues our study of the genus of a regular language $L$, defined as the minimal genus among all genera of all finite deterministic automata recognizing $L$. Here we define and study two closely related tools on a directed graph: directed emulators and automatic relations. A directed emulator morphism essentially encapsulates at the graph-theoretic level an epimorphism onto the minimal deterministic automaton. An automatic relation is the graph-theoretic version of the Myhill-Nerode relation. We show that an automatic relation determines a directed emulator morphism and respectively, a directed emulator morphism determines an automatic relation up to isomorphism. Consider the set $S$ of all directed emulators of the underlying directed graph of the minimal deterministic automaton for $L$. We prove that the genus of $L$ is $\underset{G \in S}{\min}\ g(G)$. We also consider the more restrictive notion of directed cover and prove that the genus of $L$ is reached in the class of directed covers of the underlying directed graph of the minimal deterministic automaton for $L$. This stands in sharp contrast to undirected emulators and undirected covers which we also consider. Finally we prove that if the problem of determining the minimal genus of a directed emulator of a directed graph has a solution then the problem of determining the minimal genus of an undirected emulator of an undirected graph has a solution.


title: Effective Tensor Completion via Element-wise Weighted Low-rank Tensor Train with Overlapping Ket Augmentation

abstract: In recent years, there have been an increasing number of applications of tensor completion based on the tensor train (TT) format because of its efficiency and effectiveness in dealing with higher-order tensor data. However, existing tensor completion methods using TT decomposition have two obvious drawbacks. One is that they only consider mode weights according to the degree of mode balance, even though some elements are recovered better in an unbalanced mode. The other is that serious blocking artifacts appear when the missing element rate is relatively large. To remedy such two issues, in this work, we propose a novel tensor completion approach via the element-wise weighted technique. Accordingly, a novel formulation for tensor completion and an effective optimization algorithm, called as tensor completion by parallel weighted matrix factorization via tensor train (TWMac-TT), is proposed. In addition, we specifically consider the recovery quality of edge elements from adjacent blocks. Different from traditional reshaping and ket augmentation, we utilize a new tensor augmentation technique called overlapping ket augmentation, which can further avoid blocking artifacts. We then conduct extensive performance evaluations on synthetic data and several real image data sets. Our experimental results demonstrate that the proposed algorithm TWMac-TT outperforms several other competing tensor completion methods.


title: Computation of the nearest structured matrix triplet with common null space

abstract: We study computational methods for computing the distance to singularity, the distance to the nearest high index problem, and the distance to instability for linear differential-algebraic systems (DAEs) with dissipative Hamiltonian structure. While for general unstructured DAEs the characterization of these distances is very difficult, and partially open, it has been recently shown that for dissipative Hamiltonian systems and related matrix pencils there exist explicit characterizations. We will use these characterizations for the development of computational methods to compute these distances via methods that follow the flow of a differential equation converging to the smallest perturbation that destroys the property of regularity, index one or stability.


title: Region Invariant Normalizing Flows for Mobility Transfer

abstract: There exists a high variability in mobility data volumes across different regions, which deteriorates the performance of spatial recommender systems that rely on region-specific data. In this paper, we propose a novel transfer learning framework called REFORMD, for continuous-time location prediction for regions with sparse checkin data. Specifically, we model user-specific checkin-sequences in a region using a marked temporal point process (MTPP) with normalizing flows to learn the inter-checkin time and geo-distributions. Later, we transfer the model parameters of spatial and temporal flows trained on a data-rich origin region for the next check-in and time prediction in a target region with scarce checkin data. We capture the evolving region-specific checkin dynamics for MTPP and spatial-temporal flows by maximizing the joint likelihood of next checkin with three channels (1) checkin-category prediction, (2) checkin-time prediction, and (3) travel distance prediction. Extensive experiments on different user mobility datasets across the U.S. and Japan show that our model significantly outperforms state-of-the-art methods for modeling continuous-time sequences. Moreover, we also show that REFORMD can be easily adapted for product recommendations i.e., sequences without any spatial component.


title: CEM: Commonsense-aware Empathetic Response Generation

abstract: A key trait of daily conversations between individuals is the ability to express empathy towards others, and exploring ways to implement empathy is a crucial step towards human-like dialogue systems. Previous approaches on this topic mainly focus on detecting and utilizing the user's emotion for generating empathetic responses. However, since empathy includes both aspects of affection and cognition, we argue that in addition to identifying the user's emotion, cognitive understanding of the user's situation should also be considered. To this end, we propose a novel approach for empathetic response generation, which leverages commonsense to draw more information about the user's situation and uses this additional information to further enhance the empathy expression in generated responses. We evaluate our approach on EmpatheticDialogues, which is a widely-used benchmark dataset for empathetic response generation. Empirical results demonstrate that our approach outperforms the baseline models in both automatic and human evaluations and can generate more informative and empathetic responses.


title: Data Preparation for Software Vulnerability Prediction: A Systematic Literature Review

abstract: Software Vulnerability Prediction (SVP) is a data-driven technique for software quality assurance that has recently gained considerable attention in the Software Engineering research community. However, the difficulties of preparing Software Vulnerability (SV) related data is considered as the main barrier to industrial adoption of SVP approaches. Given the increasing, but dispersed, literature on this topic, it is needed and timely to systematically select, review, and synthesize the relevant peer-reviewed papers reporting the existing SV data preparation techniques and challenges. We have carried out a Systematic Literature Review (SLR) of SVP research in order to develop a systematized body of knowledge of the data preparation challenges, solutions, and the needed research. Our review of the 61 relevant papers has enabled us to develop a taxonomy of data preparation for SVP related challenges. We have analyzed the identified challenges and available solutions using the proposed taxonomy. Our analysis of the state of the art has enabled us identify the opportunities for future research. This review also provides a set of recommendations for researchers and practitioners of SVP approaches.


title: MOEA/D with Adaptative Number of Weight Vectors

abstract: The Multi-Objective Evolutionary Algorithm based on Decomposition (MOEA/D) is a popular algorithm for solving Multi-Objective Problems (MOPs). The main component of MOEA/D is to decompose a MOP into easier sub-problems using a set of weight vectors. The choice of the number of weight vectors significantly impacts the performance of MOEA/D. However, the right choice for this number varies, given different MOPs and search stages. Here we adaptively change the number of vectors by removing unnecessary vectors and adding new ones in empty areas of the objective space. Our MOEA/D variant uses the Consolidation Ratio to decide when to change the number of vectors, and then it decides where to add or remove these weighted vectors. We investigate the effects of this adaptive MOEA/D against MOEA/D with a poorly chosen set of vectors, a MOEA/D with fine-tuned vectors and MOEA/D-AWA on the DTLZ and ZDT benchmark functions. We analyse the algorithms in terms of hypervolume, IGD and entropy performance. Our results show that the proposed method is equivalent to MOEA/D with fine-tuned vectors and superior to MOEA/D with poorly defined vectors. Thus, our adaptive mechanism mitigates problems related to the choice of the number of weight vectors in MOEA/D, increasing the final performance of MOEA/D by filling empty areas of the objective space while avoiding premature stagnation of the search progress.


title: HCDG: A Hierarchical Consistency Framework for Domain Generalization on Medical Image Segmentation

abstract: Modern deep neural networks struggle to transfer knowledge and generalize across diverse domains when deployed to real-world applications. Currently, domain generalization (DG) is introduced to learn a universal representation from multiple domains to improve the network generalization ability on unseen domains. However, previous DG methods only focus on the data-level consistency scheme without considering the synergistic regularization among different consistency schemes. In this paper, we present a novel Hierarchical Consistency framework for Domain Generalization (HCDG) by integrating Extrinsic Consistency and Intrinsic Consistency synergistically. Particularly, for the Extrinsic Consistency, we leverage the knowledge across multiple source domains to enforce data-level consistency. To better enhance such consistency, we design a novel Amplitude Gaussian-mixing strategy into Fourier-based data augmentation called DomainUp. For the Intrinsic Consistency, we perform task-level consistency for the same instance under the dual-task scenario. We evaluate the proposed HCDG framework on two medical image segmentation tasks, i.e., optic cup/disc segmentation on fundus images and prostate MRI segmentation. Extensive experimental results manifest the effectiveness and versatility of our HCDG framework.


title: Explain Me the Painting: Multi-Topic Knowledgeable Art Description Generation

abstract: Have you ever looked at a painting and wondered what is the story behind it? This work presents a framework to bring art closer to people by generating comprehensive descriptions of fine-art paintings. Generating informative descriptions for artworks, however, is extremely challenging, as it requires to 1) describe multiple aspects of the image such as its style, content, or composition, and 2) provide background and contextual knowledge about the artist, their influences, or the historical period. To address these challenges, we introduce a multi-topic and knowledgeable art description framework, which modules the generated sentences according to three artistic topics and, additionally, enhances each description with external knowledge. The framework is validated through an exhaustive analysis, both quantitative and qualitative, as well as a comparative human evaluation, demonstrating outstanding results in terms of both topic diversity and information veracity.


title: Fine-grained Entity Typing via Label Reasoning

abstract: Conventional entity typing approaches are based on independent classification paradigms, which make them difficult to recognize inter-dependent, long-tailed and fine-grained entity types. In this paper, we argue that the implicitly entailed extrinsic and intrinsic dependencies between labels can provide critical knowledge to tackle the above challenges. To this end, we propose \emph{Label Reasoning Network(LRN)}, which sequentially reasons fine-grained entity labels by discovering and exploiting label dependencies knowledge entailed in the data. Specifically, LRN utilizes an auto-regressive network to conduct deductive reasoning and a bipartite attribute graph to conduct inductive reasoning between labels, which can effectively model, learn and reason complex label dependencies in a sequence-to-set, end-to-end manner. Experiments show that LRN achieves the state-of-the-art performance on standard ultra fine-grained entity typing benchmarks, and can also resolve the long tail label problem effectively.


title: The category of finite strings

abstract: We introduce the category of finite strings and study its basic properties. The category is closely related to the augmented simplex category, and it models categories of linear representations. Each lattice of non-crossing partitions arises naturally as a lattice of subobjects.


title: ChangeChip: A Reference-Based Unsupervised Change Detection for PCB Defect Detection

abstract: The usage of electronic devices increases, and becomes predominant in most aspects of life. Surface Mount Technology (SMT) is the most common industrial method for manufacturing electric devices in which electrical components are mounted directly onto the surface of a Printed Circuit Board (PCB). Although the expansion of electronic devices affects our lives in a productive way, failures or defects in the manufacturing procedure of those devices might also be counterproductive and even harmful in some cases. It is therefore desired and sometimes crucial to ensure zero-defect quality in electronic devices and their production. While traditional Image Processing (IP) techniques are not sufficient to produce a complete solution, other promising methods like Deep Learning (DL) might also be challenging for PCB inspection, mainly because such methods require big adequate datasets which are missing, not available or not updated in the rapidly growing field of PCBs. Thus, PCB inspection is conventionally performed manually by human experts. Unsupervised Learning (UL) methods may potentially be suitable for PCB inspection, having learning capabilities on the one hand, while not relying on large datasets on the other. In this paper, we introduce ChangeChip, an automated and integrated change detection system for defect detection in PCBs, from soldering defects to missing or misaligned electronic elements, based on Computer Vision (CV) and UL. We achieve good quality defect detection by applying an unsupervised change detection between images of a golden PCB (reference) and the inspected PCB under various setting. In this work, we also present CD-PCB, a synthesized labeled dataset of 20 pairs of PCB images for evaluation of defect detection algorithms.


title: Honey or Poison? Solving the Trigger Curse in Few-shot Event Detection via Causal Intervention

abstract: Event detection has long been troubled by the \emph{trigger curse}: overfitting the trigger will harm the generalization ability while underfitting it will hurt the detection performance. This problem is even more severe in few-shot scenario. In this paper, we identify and solve the trigger curse problem in few-shot event detection (FSED) from a causal view. By formulating FSED with a structural causal model (SCM), we found that the trigger is a confounder of the context and the result, which makes previous FSED methods much easier to overfit triggers. To resolve this problem, we propose to intervene on the context via backdoor adjustment during training. Experiments show that our method significantly improves the FSED on ACE05, MAVEN and KBP17 datasets.


title: GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks

abstract: A key problem in multi-task learning (MTL) research is how to select high-quality auxiliary tasks automatically. This paper presents GradTS, an automatic auxiliary task selection method based on gradient calculation in Transformer-based models. Compared to AUTOSEM, a strong baseline method, GradTS improves the performance of MT-DNN with a bert-base-cased backend model, from 0.33% to 17.93% on 8 natural language understanding (NLU) tasks in the GLUE benchmarks. GradTS is also time-saving since (1) its gradient calculations are based on single-task experiments and (2) the gradients are re-used without additional experiments when the candidate task set changes. On the 8 GLUE classification tasks, for example, GradTS costs on average 21.32% less time than AUTOSEM with comparable GPU consumption. Further, we show the robustness of GradTS across various task settings and model selections, e.g. mixed objectives among candidate tasks. The efficiency and efficacy of GradTS in these case studies illustrate its general applicability in MTL research without requiring manual task filtering or costly parameter tuning.


title: Meta Navigator: Search for a Good Adaptation Policy for Few-shot Learning

abstract: Few-shot learning aims to adapt knowledge learned from previous tasks to novel tasks with only a limited amount of labeled data. Research literature on few-shot learning exhibits great diversity, while different algorithms often excel at different few-shot learning scenarios. It is therefore tricky to decide which learning strategies to use under different task conditions. Inspired by the recent success in Automated Machine Learning literature (AutoML), in this paper, we present Meta Navigator, a framework that attempts to solve the aforementioned limitation in few-shot learning by seeking a higher-level strategy and proffer to automate the selection from various few-shot learning designs. The goal of our work is to search for good parameter adaptation policies that are applied to different stages in the network for few-shot classification. We present a search space that covers many popular few-shot learning algorithms in the literature and develop a differentiable searching and decoding algorithm based on meta-learning that supports gradient-based optimization. We demonstrate the effectiveness of our searching-based method on multiple benchmark datasets. Extensive experiments show that our approach significantly outperforms baselines and demonstrates performance advantages over many state-of-the-art methods. Code and models will be made publicly available.


title: Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization

abstract: Image harmonization aims to modify the color of the composited region with respect to the specific background. Previous works model this task as a pixel-wise image-to-image translation using UNet family structures. However, the model size and computational cost limit the ability of their models on edge devices and higher-resolution images. To this end, we propose a novel spatial-separated curve rendering network(S$^2$CRNet) for efficient and high-resolution image harmonization for the first time. In S$^2$CRNet, we firstly extract the spatial-separated embeddings from the thumbnails of the masked foreground and background individually. Then, we design a curve rendering module(CRM), which learns and combines the spatial-specific knowledge using linear layers to generate the parameters of the piece-wise curve mapping in the foreground region. Finally, we directly render the original high-resolution images using the learned color curve. Besides, we also make two extensions of the proposed framework via the Cascaded-CRM and Semantic-CRM for cascaded refinement and semantic guidance, respectively. Experiments show that the proposed method reduces more than 90% parameters compared with previous methods but still achieves the state-of-the-art performance on both synthesized iHarmony4 and real-world DIH test sets. Moreover, our method can work smoothly on higher resolution images(eg., $2048\times2048$) in 0.1 seconds with much lower GPU computational resources than all existing methods. The code will be made available at \url{http://github.com/stefanLeong/S2CRNet}.


title: Adversarially Trained Object Detector for Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation, which involves transferring knowledge from a label-rich source domain to an unlabeled target domain, can be used to substantially reduce annotation costs in the field of object detection. In this study, we demonstrate that adversarial training in the source domain can be employed as a new approach for unsupervised domain adaptation. Specifically, we establish that adversarially trained detectors achieve improved detection performance in target domains that are significantly shifted from source domains. This phenomenon is attributed to the fact that adversarially trained detectors can be used to extract robust features that are in alignment with human perception and worth transferring across domains while discarding domain-specific non-robust features. In addition, we propose a method that combines adversarial training and feature alignment to ensure the improved alignment of robust features with the target domain. We conduct experiments on four benchmark datasets and confirm the effectiveness of our proposed approach on large domain shifts from real to artistic images. Compared to the baseline models, the adversarially trained detectors improve the mean average precision by up to 7.7%, and further by up to 11.8% when feature alignments are incorporated. Although our method degrades performance for small domain shifts, quantification of the domain shift based on the Frechet distance allows us to determine whether adversarial training should be conducted.


title: On the Age of Information of a Queuing System with Heterogeneous Servers

abstract: An optimal control problem with heterogeneous servers to minimize the average age of information (AoI) is considered. Each server maintains a separate queue, and each packet arriving to the system is randomly routed to one of the servers. Assuming Poisson arrivals and exponentially distributed service times, we first derive an exact expression of the average AoI for two heterogeneous servers. Next, to solve for the optimal average AoI, a close approximation is derived, called the approximate AoI, this is shown to be useful for multi-server systems as well. We show that for the optimal approximate AoI, server utilization (ratio of arrival rate and service rate) for each server should be same as the optimal server utilization with a single server queue. For two identical servers, it is shown that the average AoI is approximately 5/8 times the average AoI of a single server. Furthermore, the average AoI is shown to decrease considerably with the addition of more servers to the system.


title: Enhancement of Extreme Events through the Allee effect and its Mitigation through Noise in a Three Species System

abstract: We consider the dynamics of a three-species system incorporating the Allee Effect, focussing on its influence on the emergence of extreme events in the system. First we find that under Allee effect the regular periodic dynamics changes to chaotic. Further, we find that the system exhibits unbounded growth in the vegetation population after a critical value of the Allee parameter. The most significant finding is the observation of a critical Allee parameter beyond which the probability of obtaining extreme events becomes non-zero for all three population densities. Though the emergence of extreme events in the predator population is not affected much by the Allee effect, the prey population shows a sharp increase in the probability of obtaining extreme events after a threshold value of the Allee parameter, and the vegetation population also yields extreme events for sufficiently strong Allee effect. Lastly we consider the influence of additive noise on extreme events. First, we find that noise tames the unbounded vegetation growth induced by Allee effect. More interestingly, we demonstrate that stochasticity drastically diminishes the probability of extreme events in all three populations. In fact for sufficiently high noise, we do not observe any more extreme events in the system. This suggests that noise can mitigate extreme events, and has potentially important bearing on the observability of extreme events in naturally occurring systems.


title: Epidemic Management with Admissible and Robust Invariant Sets

abstract: We present a detailed set-based analysis of the well-known SIR and SEIR epidemic models subjected to hard caps on the proportion of infective individuals, and bounds on the allowable intervention strategies, such as social distancing, quarantining and vaccination. We describe the admissible and maximal robust positively invariant (MRPI) sets of these two models via the theory of barriers. We show how the sets may be used in the management of epidemics, for both perfect and imperfect/uncertain models, detailing how intervention strategies may be specified such that the hard infection cap is never breached, regardless of the basic reproduction number. The results are clarified with detailed examples.


title: IQ: Intrinsic measure for quantifying the heterogeneity in meta-analysis

abstract: Quantifying the heterogeneity is an important issue in meta-analysis, and among the existing measures, the $I^2$ statistic is the most commonly used measure in the literature. In this paper, we show that the $I^2$ statistic was, in fact, defined as problematic or even completely wrong from the very beginning. To confirm this statement, we first present a motivating example to show that the $I^2$ statistic is heavily dependent on the study sample sizes, and consequently it may yield contradictory results for the amount of heterogeneity. Moreover, by drawing a connection between ANOVA and meta-analysis, the $I^2$ statistic is shown to have, mistakenly, applied the sampling errors of the estimators rather than the variances of the study populations. Inspired by this, we introduce an Intrinsic measure for Quantifying the heterogeneity in meta-analysis, and meanwhile study its statistical properties to clarify why it is superior to the existing measures. We further propose an optimal estimator, referred to as the IQ statistic, for the new measure of heterogeneity that can be readily applied in meta-analysis. Simulations and real data analysis demonstrate that the IQ statistic provides a nearly unbiased estimate of the true heterogeneity and it is also independent of the study sample sizes.


title: Feynman's Propagator in Schwinger's picture of Quantum Mechanics

abstract: A novel derivation of Feynman's sum-over-histories construction of the quantum propagator using the groupoidal description of Schwinger picture of Quantum Mechanics is presented. It is shown that such construction corresponds to the GNS representation of a natural family of states called Dirac-Feynman-Schwinger (DFS) states. Such states are obtained from a q-Lagrangian function $\ell$ on the groupoid of configurations of the system. The groupoid of histories of the system is constructed and the q-Lagrangian $\ell$ allow to define a DFS state on the algebra of the groupoid. The particular instance of the groupoid of pairs of a Riemannian manifold serves to illustrate Feynman's original derivation of the propagator for a point particle described by a classical Lagrangian $L$.


title: Comparing Quantum Gravity Models: String Theory, Loop Quantum Gravity, and Entanglement gravity versus $SU(\infty)$-QGR

abstract: In a previous work [arXiv:2009.03428] we proposed a new model for Quantum GRavity(QGR) and cosmology, dubbed $SU(\infty)$-QGR. One of the axioms of this model is that Hilbert spaces of the Universe and its subsystems represent $SU(\infty)$ symmetry group. In this framework, the classical spacetime is interpreted as being the parameter space characterizing states of the $SU(\infty)$ representing Hilbert spaces. Using quantum uncertainty relations, it is shown that the parameter space - the spacetime - has a 3+1 dimensional Lorentzian geometry. Here after a review of $SU(\infty)$-QGR, including the demonstration that its classical limit is Einstein gravity, we compare it with several QGR proposals, including: string and M-theories, loop quantum gravity and related models, and QGR proposals inspired by holographic principle and quantum entanglement. The purpose is to find their common and analogous features, even if they apparently seem to have different roles and interpretations. The hope is that such exercise gives a better understanding of gravity as a universal quantum force and clarifies the physical nature of the spacetime. We identify several common features among the studied models: importance of 2D structures; algebraic decomposition to tensor products; special role of $SU(2)$ group in their formulation; necessity of a quantum time as a relational observable. We discuss how these features can be considered as analogous in different models. We also show that they arise in $SU(\infty)$-QGR without fine-tuning, additional assumptions, or restrictions.


title: Cycle saturation in random graphs

abstract: For a fixed graph $F,$ the minimum number of edges in an edge-maximal $F$-free subgraph of $G$ is called the $F$-saturation number. The asymptotics of the $F$-saturation number of the binomial random graph $G(n,p)$ for constant $p\in(0,1)$ is known for complete graphs $F=K_m$ and stars $F=K_{1,m}.$ This paper is devoted to the case when the pattern graph $F$ is a simple cycle $C_m.$ We prove that, for $m\geqslant 5,$ whp $\mathrm{sat}\left(G\left(n,p\right),C_m\right) = n+\Theta\left(\frac{n}{\ln n}\right).$ Also we find $c=c(p)$ such that whp $\frac{3}{2}n(1+o(1))\leqslant\mathrm{sat}\left(G\left(n,p\right),C_4\right)\leqslant cn(1+o(1)).$ In particular, whp $\mathrm{sat}\left(G\left(n,\frac{1}{2}\right),C_4\right)\leqslant\frac{27}{14}n(1+o(1)).$


title: Global-Local Dynamic Feature Alignment Network for Person Re-Identification

abstract: The misalignment of human images caused by bounding box detection errors or partial occlusions is one of the main challenges in person Re-Identification (Re-ID) tasks. Previous local-based methods mainly focus on learning local features in predefined semantic regions of pedestrians. These methods usually use local hard alignment methods or introduce auxiliary information such as key human pose points to match local features, which are often not applicable when large scene differences are encountered. To solve these problems, we propose a simple and efficient Local Sliding Alignment (LSA) strategy to dynamically align the local features of two images by setting a sliding window on the local stripes of the pedestrian. LSA can effectively suppress spatial misalignment and does not need to introduce extra supervision information. Then, we design a Global-Local Dynamic Feature Alignment Network (GLDFA-Net) framework, which contains both global and local branches. We introduce LSA into the local branch of GLDFA-Net to guide the computation of distance metrics, which can further improve the accuracy of the testing phase. Evaluation experiments on several mainstream evaluation datasets including Market-1501, DukeMTMC-reID, CUHK03 and MSMT17 show that our method has competitive accuracy over the several state-of-the-art person Re-ID methods. Specifically, it achieves 86.1% mAP and 94.8% Rank-1 accuracy on Market1501.


title: A growth-fragmentation-isolation process on random recursive trees and contact tracing

abstract: We consider a random process on recursive trees, with three types of events. Vertices give birth at a constant rate (growth), each edge may be removed independently (fragmentation of the tree) and clusters (or trees) are frozen with a rate proportional to their sizes (isolation of connected component). A phase transition occurs when the isolation is able to stop the growth fragmentation process and cause extinction. When the process survives, the number of clusters increases exponentially and we prove that the normalized empirical measure of clusters a.s. converges to a limit law on recursive trees. We exploit the branching structure associated with the size of clusters, which is inherited from the splitting property of random recursive trees. This work is motivated by the control of epidemics and contact tracing where clusters correspond to trees of infected individuals that can be identified and isolated. We complement this work by providing results on the Malthusian exponent to describe the effect of control policies on epidemics.


title: Strain-induced enhancement of $T_c$ in infinite-layer Pr$_{0.8}$Sr$_{0.2}$NiO$_2$ films

abstract: The mechanism of unconventional superconductivity in correlated materials remains a great challenge in condensed matter physics. The recent discovery of superconductivity in infinite-layer nickelates, as analog to high-Tc cuprates, has opened a new route to tackle this challenge. By growing 8 nm Pr0.8Sr0.2NiO2 films on the (LaAlO3)0.3(Sr2AlTaO6)0.7 substrate, we successfully raise the transition temperature Tc from 9 K in the widely studied SrTiO3-substrated nickelates into 15 K. By combining x-ray absorption spectroscopy with the first-principles and many-body simulations, we find a positive correlation between Tc and the pre-edge peak intensity, which can be attributed to the hybridization between Ni and O orbitals induced by the strain. Our result suggests that structural engineering can further enhance unconventional superconductivity, and the charge-transfer property plays a crucial role in the pairing strength.


title: Performance of UAV assisted Multiuser Terrestrial-Satellite Communication System over Mixed FSO/RF Channels

abstract: In this work, performance of a multi-antenna multiuser unmanned aerial vehicle (UAV) assisted terrestrial-satellite communication system over mixed free space optics (FSO)/ radio frequency (RF) channels is analyzed. Downlink transmission from the satellite to the UAV is completed through FSO link which follows Gamma-Gamma distribution with pointing error impairments. Both the heterodyne detection and intensity modulation direct detection techniques are considered at the FSO receiver. To avail the antenna diversity, multiple transmit antennas are considered at the UAV. Selective decode-and-forward scheme is assumed at the UAV and opportunistic user scheduling is performed while considering the practical constraints of outdated channel state information (CSI) during the user selection and transmission phase. The RF links are assumed to follow Nakagami-m distribution due to its versatile nature. In this context, for the performance analysis, analytical expressions of outage probability, asymptotic outage probability, ergodic capacity, effective capacity, and generalized average symbol-error-rate expressions of various quadrature amplitude modulation (QAM) schemes such as hexagonal-QAM, cross-QAM, and rectangular QAM are derived. A comparison of various modulation schemes is presented. Further, the impact of pointing error, number of antennas, delay constraint, fading severity, and imperfect CSI are highlighted on the system performance. Finally, all the analytical results are verified through the Monte-Carlo simulations.


title: $\mathcal{H}$-inverses for RBF interpolation

abstract: We consider the interpolation problem for a class of radial basis functions (RBFs) that includes the classical polyharmonic splines (PHS). We show that the inverse of the system matrix for this interpolation problem can be approximated at an exponential rate in the block rank in the $\mathcal{H}$-matrix format if the block structure of the $\mathcal{H}$-matrix arises from a standard clustering algorithm.


title: Retrieving Dust Grain Sizes from Photopolarimetry: An Experimental Approach

abstract: We present the experimental phase function, degree of linear polarization (DLP), and linear depolarization (deltaL) curves of a set of forsterite samples representative of low-absorbing cosmic dust particles. The samples are prepared using state-of-the-art size-segregating techniques to obtain narrow size distributions spanning a broad range of the scattering size parameter domain. We conclude that the behavior of the phase function at the side- and back-scattering regions provides information on the size regime, the position and magnitude of the maximum of the DLP curve are strongly dependent on particle size, the negative polarization branch is mainly produced by particles with size parameters in the approx. 6 to 20 range, and the deltaL is strongly dependent on particle size at all measured phase angles except for the exact backward direction. From a direct comparison of the experimental data with computations for spherical particles, it becomes clear that the use of the spherical model for simulating the phase function and DLP curves of irregular dust produces dramatic errors in the retrieved composition and size of the scattering particles: The experimental phase functions are reproduced by assuming unrealistically high values of the imaginary part of the refractive index. The spherical model does not reproduce the bell-shaped DLP curve of dust particles with sizes in the resonance and/or geometric optics size domain. Thus, the use of the Mie model for analyzing polarimetric observations might prevent locating dust particles with sizes of the order of or larger than the wavelength of the incident light.


title: DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture

abstract: Automated machine learning (AutoML) usually involves several crucial components, such as Data Augmentation (DA) policy, Hyper-Parameter Optimization (HPO), and Neural Architecture Search (NAS). Although many strategies have been developed for automating these components in separation, joint optimization of these components remains challenging due to the largely increased search dimension and the variant input types of each component. In parallel to this, the common practice of searching for the optimal architecture first and then retraining it before deployment in NAS often suffers from low performance correlation between the searching and retraining stages. An end-to-end solution that integrates the AutoML components and returns a ready-to-use model at the end of the search is desirable. In view of these, we propose DHA, which achieves joint optimization of Data augmentation policy, Hyper-parameter and Architecture. Specifically, end-to-end NAS is achieved in a differentiable manner by optimizing a compressed lower-dimensional feature space, while DA policy and HPO are regarded as dynamic schedulers, which adapt themselves to the update of network parameters and network architecture at the same time. Experiments show that DHA achieves state-of-the-art (SOTA) results on various datasets and search spaces. To the best of our knowledge, we are the first to efficiently and jointly optimize DA policy, NAS, and HPO in an end-to-end manner without retraining.


title: Storage and Transmission Capacity Requirements of a Remote Solar Power Generation System

abstract: Large solar power stations usually locate in remote areas and connect to the main grid via a long transmission line. Energy storage unit is deployed locally with the solar plant to smooth its output. Capacities of the grid-connection transmission line and the energy storage unit have a significant impact on the utilization rate of solar energy, as well as the investment cost. This paper characterizes the feasible set of capacity parameters under a given solar spillage rate and a fixed investment budget. A linear programming based projection algorithm is proposed to obtain such a feasible set, offering valuable references for system planning and policy making.


title: Computation Rate Maximum for Mobile Terminals in UAV-assisted Wireless Powered MEC Networks with Fairness Constraint

abstract: This paper investigates an unmanned aerial vehicle (UAV)-assisted wireless powered mobile-edge computing (MEC) system, where the UAV powers the mobile terminals by wireless power transfer (WPT) and provides computation service for them. We aim to maximize the computation rate of terminals while ensuring fairness among them. Considering the random trajectories of mobile terminals, we propose a soft actor-critic (SAC)-based UAV trajectory planning and resource allocation (SAC-TR) algorithm, which combines off-policy and maximum entropy reinforcement learning to promote the convergence of the algorithm. We design the reward as a heterogeneous function of computation rate, fairness, and reaching of destination. Simulation results show that SAC-TR can quickly adapt to varying network environments and outperform representative benchmarks in a variety of situations.


title: O(n)-invariant Riemannian metrics on SPD matrices

abstract: Symmetric Positive Definite (SPD) matrices are ubiquitous in data analysis under the form of covariance matrices or correlation matrices. Several O(n)-invariant Riemannian metrics were defined on the SPD cone, in particular the kernel metrics introduced by Hiai and Petz. The class of kernel metrics interpolates between many classical O(n)-invariant metrics and it satisfies key results of stability and completeness. However, it does not contain all the classical O(n)-invariant metrics. Therefore in this work, we investigate super-classes of kernel metrics and we study which key results remain true. We also introduce an additional key result called cometric-stability, a crucial property to implement geodesics with a Hamiltonian formulation. Our method to build intermediate embedded classes between O(n)-invariant metrics and kernel metrics is to give a characterization of the whole class of O(n)-invariant metrics on SPD matrices and to specify requirements on metrics one by one until we reach kernel metrics. As a secondary contribution, we synthesize the literature on the main O(n)-invariant metrics, we provide the complete formula of the sectional curvature of the affine-invariant metric and the formula of the geodesic parallel transport between commuting matrices for the Bures-Wasserstein metric.


title: LOgging UnifieD for ASTRI Mini Array

abstract: The ASTRI (Astrofisica con Specchi a Tecnologia Replicante Italiana) Mini-Array (MA) project is an international collaboration led by the Italian National Institute for Astrophysics (INAF). ASTRI MA is composed of nine Cherenkov telescopes operating in the energy range 1-100 TeV, and it aims to study very high-energy gamma ray astrophysics and optical intensity interferometry of bright stars. ASTRI MA is currently under construction, and will be installed at the site of the Teide Observatory in Tenerife (Spain). The hardware and software system that is responsible of monitoring and controlling all the operations carried out at the ASTRI MA site is the Supervision Control and Data Acquisition (SCADA). The LOgging UnifieD (LOUD) subsystem is one of the main components of SCADA. It provides the service responsible for collecting, filtering, exposing and storing log events collected by all the array elements (telescopes, LIDAR, devices, etc.). In this paper, we present the LOUD architecture and the software stack explicitly designed for distributed computing environments exploiting Internet of Things technologies (IoT).


title: The Monitoring, Logging, and Alarm system for the Cherenkov Telescope Array

abstract: We present the current development of the Monitoring, Logging and Alarm subsystems in the framework of the Array Control and Data Acquisition System (ACADA) for the Cherenkov Telescope Array (CTA). The Monitoring System (MON) is the subsystem responsible for monitoring and logging the overall array (at each of the CTA sites) through the acquisition of monitoring and logging information from the array elements. The MON allows us to perform a systematic approach to fault detection and diagnosis supporting corrective and predictive maintenance to minimize the downtime of the system. We present a unified tool for monitoring data items from the telescopes and other devices deployed at the CTA array sites. Data are immediately available for the operator interface and quick-look quality checks and stored for later detailed inspection. The Array Alarm System (AAS) is the subsystem that provides the service that gathers, filters, exposes, and persists alarms raised by both the ACADA processes and the array elements supervised by the ACADA system. It collects alarms from the telescopes, the array calibration, the environmental monitoring instruments and the ACADA systems. The AAS sub-system also creates new alarms based on the analysis and correlation of the system software logs and the status of the system hardware providing the filter mechanisms for all the alarms. Data from the alarm system are then sent to the operator via the human-machine interface.


title: Perturbation CheckLists for Evaluating NLG Evaluation Metrics

abstract: Natural Language Generation (NLG) evaluation is a multifaceted task requiring assessment of multiple desirable criteria, e.g., fluency, coherency, coverage, relevance, adequacy, overall quality, etc. Across existing datasets for 6 NLG tasks, we observe that the human evaluation scores on these multiple criteria are often not correlated. For example, there is a very low correlation between human scores on fluency and data coverage for the task of structured data to text generation. This suggests that the current recipe of proposing new automatic evaluation metrics for NLG by showing that they correlate well with scores assigned by humans for a single criteria (overall quality) alone is inadequate. Indeed, our extensive study involving 25 automatic evaluation metrics across 6 different tasks and 18 different evaluation criteria shows that there is no single metric which correlates well with human scores on all desirable criteria, for most NLG tasks. Given this situation, we propose CheckLists for better design and evaluation of automatic metrics. We design templates which target a specific criteria (e.g., coverage) and perturb the output such that the quality gets affected only along this specific criteria (e.g., the coverage drops). We show that existing evaluation metrics are not robust against even such simple perturbations and disagree with scores assigned by humans to the perturbed output. The proposed templates thus allow for a fine-grained assessment of automatic evaluation metrics exposing their limitations and will facilitate better design, analysis and evaluation of such metrics.


title: Wine is Not v i n. -- On the Compatibility of Tokenizations Across Languages

abstract: The size of the vocabulary is a central design choice in large pretrained language models, with respect to both performance and memory requirements. Typically, subword tokenization algorithms such as byte pair encoding and WordPiece are used. In this work, we investigate the compatibility of tokenizations for multilingual static and contextualized embedding spaces and propose a measure that reflects the compatibility of tokenizations across languages. Our goal is to prevent incompatible tokenizations, e.g., "wine" (word-level) in English vs.\ "v i n" (character-level) in French, which make it hard to learn good multilingual semantic representations. We show that our compatibility measure allows the system designer to create vocabularies across languages that are compatible -- a desideratum that so far has been neglected in multilingual models.


title: Fast Variational AutoEncoder with Inverted Multi-Index for Collaborative Filtering

abstract: Variational AutoEncoder (VAE) has been extended as a representative nonlinear method for collaborative filtering. However, the bottleneck of VAE lies in the softmax computation over all items, such that it takes linear costs in the number of items to compute the loss and gradient for optimization. This hinders the practical use due to millions of items in real-world scenarios. Importance sampling is an effective approximation method, based on which the sampled softmax has been derived. However, existing methods usually exploit the uniform or popularity sampler as proposal distributions, leading to a large bias of gradient estimation. To this end, we propose to decompose the inner-product-based softmax probability based on the inverted multi-index, leading to sublinear-time and highly accurate sampling. Based on the proposed proposals, we develop a fast Variational AutoEncoder (FastVAE) for collaborative filtering. FastVAE can outperform the state-of-the-art baselines in terms of both sampling quality and efficiency according to the experiments on three real-world datasets.


title: Frequency Response Data Based LPV Controller Synthesis Applied to a Control Moment Gyroscope

abstract: Control of systems with operating condition-dependent dynamics, including control moment gyroscopes, often requires operating condition-dependent controllers to achieve high control performance. The aim of this paper is to develop a frequency response data-driven linear parameter-varying control design approach for single-input single-output systems, which allows improved performance for a control moment gyroscope. A stability theory using closed-loop frequency response function data is developed, which is subsequently used in a synthesis procedure that guarantees local stability and performance. Experimental results on a control moment gyroscope demonstrate the performance improvements.


title: Revisiting the quantum open system dynamics of central spin model

abstract: In this article we revisit the theory of open quantum systems from the perspective of fermionic baths. Specifically, we concentrate on the dynamics of a central spin half particle interacting with a spin bath. We have calculated the exact reduced dynamics of the central spin and constructed the Kraus operators in relation to that. Further, the exact Lindblad type cannonical master equation corresponding to the reduced dynamics is constructed. We have also briefly touch upon the aspect of non-Markovianity from the backdrop of the reduced dynamics of the central spin.


title: Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networks

abstract: Human motion prediction, which plays a key role in computer vision, generally requires a past motion sequence as input. However, in real applications, a complete and correct past motion sequence can be too expensive to achieve. In this paper, we propose a novel approach to predicting future human motions from a much weaker condition, i.e., a single image, with mixture density networks (MDN) modeling. Contrary to most existing deep human motion prediction approaches, the multimodal nature of MDN enables the generation of diverse future motion hypotheses, which well compensates for the strong stochastic ambiguity aggregated by the single input and human motion uncertainty. In designing the loss function, we further introduce the energy-based formulation to flexibly impose prior losses over the learnable parameters of MDN to maintain motion coherence as well as improve the prediction accuracy by customizing the energy functions. Our trained model directly takes an image as input and generates multiple plausible motions that satisfy the given condition. Extensive experiments on two standard benchmark datasets demonstrate the effectiveness of our method in terms of prediction diversity and accuracy.


title: A distributed framework for linear adaptive MPC

abstract: Adaptive model predictive control (MPC) robustly ensures safety while reducing uncertainty during operation. In this paper, a distributed version is proposed to deal with network systems featuring multiple agents and limited communication. To solve the problem in a distributed manner, structure is imposed on the control design ingredients without sacrificing performance. Decentralized and distributed adaptation schemes that allow for a reduction of the uncertainty online compatibly with the network topology are also proposed. The algorithm ensures robust constraint satisfaction, recursive feasibility and finite gain $\ell_2$ stability, and yields lower closed-loop cost compared to robust distributed MPC in simulations.


title: Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generation

abstract: Open-domain dialogue generation in natural language processing (NLP) is by default a pure-language task, which aims to satisfy human need for daily communication on open-ended topics by producing related and informative responses. In this paper, we point out that hidden images, named as visual impressions (VIs), can be explored from the text-only data to enhance dialogue understanding and help generate better responses. Besides, the semantic dependency between an dialogue post and its response is complicated, e.g., few word alignments and some topic transitions. Therefore, the visual impressions of them are not shared, and it is more reasonable to integrate the response visual impressions (RVIs) into the decoder, rather than the post visual impressions (PVIs). However, both the response and its RVIs are not given directly in the test process. To handle the above issues, we propose a framework to explicitly construct VIs based on pure-language dialogue datasets and utilize them for better dialogue understanding and generation. Specifically, we obtain a group of images (PVIs) for each post based on a pre-trained word-image mapping model. These PVIs are used in a co-attention encoder to get a post representation with both visual and textual information. Since the RVIs are not provided directly during testing, we design a cascade decoder that consists of two sub-decoders. The first sub-decoder predicts the content words in response, and applies the word-image mapping model to get those RVIs. Then, the second sub-decoder generates the response based on the post and RVIs. Experimental results on two open-domain dialogue datasets show that our proposed approach achieves superior performance over competitive baselines.


title: Deep Joint Source-Channel Coding for Multi-Task Network

abstract: Multi-task learning (MTL) is an efficient way to improve the performance of related tasks by sharing knowledge. However, most existing MTL networks run on a single end and are not suitable for collaborative intelligence (CI) scenarios. In this work, we propose an MTL network with a deep joint source-channel coding (JSCC) framework, which allows operating under CI scenarios. We first propose a feature fusion based MTL network (FFMNet) for joint object detection and semantic segmentation. Compared with other MTL networks, FFMNet gets higher performance with fewer parameters. Then FFMNet is split into two parts, which run on a mobile device and an edge server respectively. The feature generated by the mobile device is transmitted through the wireless channel to the edge server. To reduce the transmission overhead of the intermediate feature, a deep JSCC network is designed. By combining two networks together, the whole model achieves 512x compression for the intermediate feature and a performance loss within 2% on both tasks. At last, by training with noise, the FFMNet with JSCC is robust to various channel conditions and outperforms the separate source and channel coding scheme.


title: Design rule for the emission linewidth of Eu$^{2+}$-activated phosphors

abstract: We study from first principles the emission linewidth of Eu$^{2+}$-doped LED phosphors. Based on the one-dimensional configuration coordinate model, an analysis of first principles data obtained for fifteen compounds show that, at working temperature, the linewidth of Eu$^{2+}$ emission band in solids is negligibly affected by quantum effects, and can be extracted from the Franck-Condon energy shifts. For a fixed Stokes shift, the difference of Franck-Condon energy shifts in the excited and ground states is the key factor for the FWHM determination. Narrow emission Eu$^{2+}$-doped LED phosphors are expected for the case with large positive value of such difference.


title: Point sets with optimal order of extreme and periodic discrepancy

abstract: We study the extreme and the periodic $L_p$ discrepancy of point sets in the $d$-dimensional unit cube. The extreme discrepancy uses arbitrary sub-intervals of the unit cube as test sets, whereas the periodic discrepancy is based on periodic intervals modulo one. This is in contrast to the classical star discrepancy, which uses exclusively intervals that are anchored in the origin as test sets. In a recent paper the authors together with Aicke Hinrichs studied relations between the $L_2$ versions of these notions of discrepancy and presented exact formulas for typical two-dimensional quasi-Monte Carlo point sets. In this paper we study the general $L_p$ case and deduce the exact order of magnitude of the respective minimal discrepancy in the number $N$ of elements of the considered point sets, for arbitrary but fixed dimension $d$, which is $(\log N)^{(d-1)/2}$.


title: Effectiveness of Pre-training for Few-shot Intent Classification

abstract: This paper investigates the effectiveness of pre-training for few-shot intent classification. While existing paradigms commonly further pre-train language models such as BERT on a vast amount of unlabeled corpus, we find it highly effective and efficient to simply fine-tune BERT with a small set of labeled utterances from public datasets. Specifically, fine-tuning BERT with roughly 1,000 labeled data yields a pre-trained model -- IntentBERT, which can easily surpass the performance of existing pre-trained models for few-shot intent classification on novel domains with very different semantics. The high effectiveness of IntentBERT confirms the feasibility and practicality of few-shot intent detection, and its high generalization ability across different domains suggests that intent classification tasks may share a similar underlying structure, which can be efficiently learned from a small set of labeled data. The source code can be found at https://github.com/hdzhang-code/IntentBERT.


title: The State of the Art when using GPUs in Devising Image Generation Methods Using Deep Learning

abstract: Deep learning is a technique for machine learning using multi-layer neural networks. It has been used for image synthesis and image recognition, but in recent years, it has also been used for various social detection and social labeling. In this analysis, we compared (1) the number of Iterations per minute between the GPU and CPU when using the VGG model and the NIN model, and (2) the number of Iterations per minute by the number of pixels when using the VGG model, using an image with 128 pixels. When the number of pixels was 64 or 128, the processing time was almost the same when using the GPU, but when the number of pixels was changed to 256, the number of iterations per minute decreased and the processing time increased by about three times. In this case study, since the number of pixels becomes core dumping when the number of pixels is 512 or more, we can consider that we should consider improvement in the vector calculation part. If we aim to achieve 8K highly saturated computer graphics using neural networks, we will need to consider an environment that allows computation even when the size of the image becomes even more highly saturated and massive, and parallel computation when performing image recognition and tuning.


title: Modeling non-thermal emission from SN 1987A

abstract: The remnant of SN 1987A is the best-studied object of its kind. The rich data-set of its thermal and non-thermal emission across the electromagnetic spectrum poses a unique testbed for the elaboration of particle-acceleration theory. We use 2D simulations of the progenitor's wind to obtain hydro-profiles for the medium around the supernova explosion. Various cones along prominent features of the ambient medium are then used in our time-dependent acceleration code RATPaC to model the evolution of the emission of SN 1987A and compare it to observational data. We solve for the transport of cosmic rays and the hydrodynamical flow, in the test-particle limit.The simulation code relies on 1D profiles but the large expansion speed of the young remnant renders lateral transport unimportant. We find that the increase in thermal X-ray emission predates the increase in the low-energy gamma-ray brightness by several years. The increase of the gamma-ray brightness at lower energies is followed by a smooth increase at the highest energies. The gamma-ray spectrum at the highest energies appears soft during the brightening but hardens as more material in the equatorial ring gets shocked. The X-ray and gamma-ray brightness remain almost constant once the SNR blast-wave passed the region of peak-density in the equatorial plane.


title: Generalized conditional gradient and learning in potential mean field games

abstract: We apply the generalized conditional gradient algorithm to potential mean field games and we show its well-posedeness. It turns out that this method can be interpreted as a learning method called fictitious play. More precisely, each step of the generalized conditional gradient method amounts to compute the best-response of the representative agent, for a predicted value of the coupling terms of the game. We show that for the learning sequence $\delta_k = 2/(k+2)$, the potential cost converges in $O(1/k)$, the exploitability and the variables of the problem (distribution, congestion, price, value function and control terms) converge in $O(1/\sqrt{k})$, for specific norms.


title: A projection-based model reduction method for nonlinear mechanics with internal variables: application to thermo-hydro-mechanical systems

abstract: We propose a projection-based monolithic model order reduction (MOR) procedure for a class of problems in nonlinear mechanics with internal variables. The work is is motivated by applications to thermo-hydro-mechanical (THM) systems for radioactive waste disposal. THM equations model the behaviour of temperature, pore water pressure and solid displacement in the neighborhood of geological repositories, which contain radioactive waste and are responsible for a significant thermal flux towards the Earth's surface. We develop an adaptive sampling strategy based on the POD-Greedy method, and we develop an element-wise empirical quadrature hyper-reduction procedure to reduce assembling costs. We present numerical results for a two-dimensional THM system to illustrate and validate the proposed methodology.


title: Classical Density Functional Theory in the Canonical Ensemble

abstract: Classical density functional theory for finite temperatures is usually formulated in the grand-canonical ensemble where arbitrary variations of the local density are possible. However, in many cases the systems of interest are closed with respect to mass, e.g. canonical systems with fixed temperature and particle number. Although the tools of standard, grand-canonical density functional theory are often used in an ad hoc manner to study closed systems, their formulation directly in the canonical ensemble has so far not been known. In this work, the fundamental theorems underlying classical DFT are revisited and carefully compared in the two ensembles showing that there are only trivial formal differences. The practicality of DFT in the canonical ensemble is then illustrated by deriving the exact Helmholtz functional for several systems: the ideal gas, certain restricted geometries in arbitrary numbers of dimensions and finally a system of two hard-spheres in one dimension (hard rods) in a small cavity. Some remarkable similarities between the ensembles are apparent even for small systems with the latter showing strong echoes of the famous exact of result of Percus in the grand-canonical ensemble.


title: DSNet: A Dual-Stream Framework for Weakly-Supervised Gigapixel Pathology Image Analysis

abstract: We present a novel weakly-supervised framework for classifying whole slide images (WSIs). WSIs, due to their gigapixel resolution, are commonly processed by patch-wise classification with patch-level labels. However, patch-level labels require precise annotations, which is expensive and usually unavailable on clinical data. With image-level labels only, patch-wise classification would be sub-optimal due to inconsistency between the patch appearance and image-level label. To address this issue, we posit that WSI analysis can be effectively conducted by integrating information at both high magnification (local) and low magnification (regional) levels. We auto-encode the visual signals in each patch into a latent embedding vector representing local information, and down-sample the raw WSI to hardware-acceptable thumbnails representing regional information. The WSI label is then predicted with a Dual-Stream Network (DSNet), which takes the transformed local patch embeddings and multi-scale thumbnail images as inputs and can be trained by the image-level label only. Experiments conducted on two large-scale public datasets demonstrate that our method outperforms all recent state-of-the-art weakly-supervised WSI classification methods.


title: ARGO: Modeling Heterogeneity in E-commerce Recommendation

abstract: Nowadays, E-commerce is increasingly integrated into our daily lives. Meanwhile, shopping process has also changed incrementally from one behavior (purchase) to multiple behaviors (such as view, carting and purchase). Therefore, utilizing interaction data of auxiliary behavior data draws a lot of attention in the E-commerce recommender systems. However, all existing models ignore two kinds of intrinsic heterogeneity which are helpful to capture the difference of user preferences and the difference of item attributes. First (intra-heterogeneity), each user has multiple social identities with otherness, and these different identities can result in quite different interaction preferences. Second (inter-heterogeneity), each item can transfer an item-specific percentage of score from low-level behavior to high-level behavior for the gradual relationship among multiple behaviors. Thus, the lack of consideration of these heterogeneities damages recommendation rank performance. To model the above heterogeneities, we propose a novel method named intra- and inter-heterogeneity recommendation model (ARGO). Specifically, we embed each user into multiple vectors representing the user's identities, and the maximum of identity scores indicates the interaction preference. Besides, we regard the item-specific transition percentage as trainable transition probability between different behaviors. Extensive experiments on two real-world datasets show that ARGO performs much better than the state-of-the-art in multi-behavior scenarios.


title: Searching for Axion-Like Particles from Core-Collapse Supernovae with Fermi LAT's Low Energy Technique

abstract: Light axion-like particles (ALPs) are expected to be abundantly produced in core-collapse supernovae (CCSNe), resulting in a $\sim$10-second long burst of ALPs. These particles subsequently undergo conversion into gamma-rays in external magnetic fields to produce a long gamma-ray burst (GRB) with a characteristic spectrum peaking in the 30--100-MeV energy range. At the same time, CCSNe are invoked as progenitors of {\it ordinary} long GRBs, rendering it relevant to conduct a comprehensive search for ALP spectral signatures using the observations of long GRB with the \textit{Fermi} Large Area Telescope (LAT). We perform a data-driven sensitivity analysis to determine CCSN distances for which a detection of an ALP signal is possible with the LAT's low-energy (LLE) technique which, in contrast to the standard LAT analysis, allows for a a larger effective area for energies down to 30~MeV. Assuming an ALP mass $m_a \lesssim 10^{-10}$~eV and ALP-photon coupling $g_{a\gamma} = 5.3\times 10^{-12}$ GeV$^{-1}$, values considered and deduced in ALP searches from SN1987A, we find that the distance limit ranges from $\sim\!0.5$ to $\sim\!10$~Mpc, depending on the sky location and the CCSN progenitor mass. Furthermore, we select a candidate sample of twenty-four GRBs and carry out a model comparison analysis in which we consider different GRB spectral models with and without an ALP signal component. We find that the inclusion of an ALP contribution does not result in any statistically significant improvement of the fits to the data. We discuss the statistical method used in our analysis and the underlying physical assumptions, the feasibility of setting upper limits on the ALP-photon coupling, and give an outlook on future telescopes in the context of ALP searches.


title: Unified Kinematic and Dynamical Modeling of a Soft Robotic Arm by a Piecewise Universal Joint Model

abstract: The compliance of soft robotic arms renders the development of accurate kinematic & dynamical models especially challenging. The most widely used model in soft robotic kinematics assumes Piecewise Constant Curvature (PCC). However, PCC fails to effectively handle external forces, or even the influence of gravity, since the robot does not deform with a constant curvature under these conditions. In this paper, we establish three-dimensional (3D) modeling of a multi-segment soft robotic arm under the less restrictive assumption that each segment of the arm is deformed on a plane without twisting. We devise a kinematic and dynamical model for the soft arm by deriving equivalence to a serial universal joint robot. Numerous experiments on the real robot platform along with simulations attest to the modeling accuracy of our approach in 3D motion with load. The maximum position/rotation error of the proposed model is verified 6.7x/4.6x lower than the PCC model considering gravity and external forces.


title: Perceptions of Fairness and Trustworthiness Based on Explanations in Human vs. Automated Decision-Making

abstract: Automated decision systems (ADS) have become ubiquitous in many high-stakes domains. Those systems typically involve sophisticated yet opaque artificial intelligence (AI) techniques that seldom allow for full comprehension of their inner workings, particularly for affected individuals. As a result, ADS are prone to deficient oversight and calibration, which can lead to undesirable (e.g., unfair) outcomes. In this work, we conduct an online study with 200 participants to examine people's perceptions of fairness and trustworthiness towards ADS in comparison to a scenario where a human instead of an ADS makes a high-stakes decision -- and we provide thorough identical explanations regarding decisions in both cases. Surprisingly, we find that people perceive ADS as fairer than human decision-makers. Our analyses also suggest that people's AI literacy affects their perceptions, indicating that people with higher AI literacy favor ADS more strongly over human decision-makers, whereas low-AI-literacy people exhibit no significant differences in their perceptions.


title: Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models

abstract: Recent works have shown that powerful pre-trained language models (PLM) can be fooled by small perturbations or intentional attacks. To solve this issue, various data augmentation techniques are proposed to improve the robustness of PLMs. However, it is still challenging to augment semantically relevant examples with sufficient diversity. In this work, we present Virtual Data Augmentation (VDA), a general framework for robustly fine-tuning PLMs. Based on the original token embeddings, we construct a multinomial mixture for augmenting virtual data embeddings, where a masked language model guarantees the semantic relevance and the Gaussian noise provides the augmentation diversity. Furthermore, a regularized training strategy is proposed to balance the two aspects. Extensive experiments on six datasets show that our approach is able to improve the robustness of PLMs and alleviate the performance degradation under adversarial attacks. Our codes and data are publicly available at \textcolor{blue}{\url{https://github.com/RUCAIBox/VDA}}.


title: Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questions

abstract: Enabling open-domain dialogue systems to ask clarifying questions when appropriate is an important direction for improving the quality of the system response. Namely, for cases when a user request is not specific enough for a conversation system to provide an answer right away, it is desirable to ask a clarifying question to increase the chances of retrieving a satisfying answer. To address the problem of 'asking clarifying questions in open-domain dialogues': (1) we collect and release a new dataset focused on open-domain single- and multi-turn conversations, (2) we benchmark several state-of-the-art neural baselines, and (3) we propose a pipeline consisting of offline and online steps for evaluating the quality of clarifying questions in various dialogues. These contributions are suitable as a foundation for further research.


title: A Q-learning Control Method for a Soft Robotic Arm Utilizing Training Data from a Rough Simulator

abstract: It is challenging to control a soft robot, where reinforcement learning methods have been applied with promising results. However, due to the poor sample efficiency, reinforcement learning methods require a large collection of training data, which limits their applications. In this paper, we propose a Q-learning controller for a physical soft robot, in which pre-trained models using data from a rough simulator are applied to improve the performance of the controller. We implement the method on our soft robot, i.e., Honeycomb Pneumatic Network (HPN) arm. The experiments show that the usage of pre-trained models can not only reduce the amount of the real-world training data, but also greatly improve its accuracy and convergence rate.


title: FUNKI: Interactive functional footprint-based analysis of omics data

abstract: Motivation: Omics data, such as transcriptomics or phosphoproteomics, are broadly used to get a snap-shot of the molecular status of cells. In particular, changes in omics can be used to estimate the activity of pathways, transcription factors and kinases based on known regulated targets, that we call footprints. Then the molecular paths driving these activities can be estimated using causal reasoning on large signaling networks. Results: We have developed FUNKI, a FUNctional toolKIt for footprint analysis. It provides a user-friendly interface for an easy and fast analysis of several omics data, either from bulk or single-cell experiments. FUNKI also features different options to visualise the results and run post-analyses, and is mirrored as a scripted version in R. Availability: FUNKI is a free and open-source application built on R and Shiny, available in GitHub at https://github.com/saezlab/ShinyFUNKI under GNU v3.0 license and accessible also in https://saezlab.shinyapps.io/funki/ Contact: pub.saez@uni-heidelberg.de Supplementary information: We provide data examples within the app, as well as extensive information about the different variables to select, the results, and the different plots in the help page.


title: Show Me How To Revise: Improving Lexically Constrained Sentence Generation with XLNet

abstract: Lexically constrained sentence generation allows the incorporation of prior knowledge such as lexical constraints into the output. This technique has been applied to machine translation, and dialog response generation. Previous work usually used Markov Chain Monte Carlo (MCMC) sampling to generate lexically constrained sentences, but they randomly determined the position to be edited and the action to be taken, resulting in many invalid refinements. To overcome this challenge, we used a classifier to instruct the MCMC-based models where and how to refine the candidate sentences. First, we developed two methods to create synthetic data on which the pre-trained model is fine-tuned to obtain a reliable classifier. Next, we proposed a two-step approach, "Predict and Revise", for constrained sentence generation. During the predict step, we leveraged the classifier to compute the learned prior for the candidate sentence. During the revise step, we resorted to MCMC sampling to revise the candidate sentence by conducting a sampled action at a sampled position drawn from the learned prior. We compared our proposed models with many strong baselines on two tasks, generating sentences with lexical constraints and text infilling. Experimental results have demonstrated that our proposed model performs much better than the previous work in terms of sentence fluency and diversity. Our code and pre-trained models are available at https://github.com/NLPCode/MCMCXLNet.


title: The Permutation-Spectrum Test: Identifying Periodic Signals using the Maximum Fourier Intensity

abstract: This paper examines the problem of testing whether a discrete time-series vector contains a periodic signal or is merely noise. To do this we examine the stochastic behaviour of the maximum intensity of the observed time-series vector and formulate a simple hypothesis test that rejects the null hypothesis of exchangeability if the maximum intensity spike in the Fourier domain is "too big" relative to its null distribution. This comparison is undertaken by simulating the null distribution of the maximum intensity using random permutations of the time-series vector. We show that this test has a p-value that is uniformly distributed for an exchangeable time-series vector, and that the p-value increases when there is a periodic signal present in the observed vector. We compare our test to Fisher's spectrum test, which assumes normality of the underlying noise terms. We show that our test is more robust than this test, and accommodates noise vectors with fat tails.


title: Runtime Analysis of Single- and Multi-Objective Evolutionary Algorithms for Chance Constrained Optimization Problems with Normally Distributed Random Variables

abstract: Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to achieve high quality results. With this paper, we contribute to the theoretical understanding of evolutionary algorithms for chance constrained optimization. We study the scenario of stochastic components that are independent and Normally distributed. Considering the simple single-objective (1+1)~EA, we show that imposing an additional uniform constraint already leads to local optima for very restricted scenarios and an exponential optimization time. We therefore introduce a multi-objective formulation of the problem which trades off the expected cost and its variance. We show that multi-objective evolutionary algorithms are highly effective when using this formulation and obtain a set of solutions that contains an optimal solution for any possible confidence level imposed on the constraint. Furthermore, we prove that this approach can also be used to compute a set of optimal solutions for the chance constrained minimum spanning tree problem. In order to deal with potentially exponentially many trade-offs in the multi-objective formulation, we propose and analyze improved convex multi-objective approaches. Experimental investigations on instances of the NP-hard stochastic minimum weight dominating set problem confirm the benefit of the multi-objective and the improved convex multi-objective approach in practice.


title: DisCERN:Discovering Counterfactual Explanations using Relevance Features from Neighbourhoods

abstract: Counterfactual explanations focus on "actionable knowledge" to help end-users understand how a machine learning outcome could be changed to a more desirable outcome. For this purpose a counterfactual explainer needs to discover input dependencies that relate to outcome changes. Identifying the minimum subset of feature changes needed to action an output change in the decision is an interesting challenge for counterfactual explainers. The DisCERN algorithm introduced in this paper is a case-based counter-factual explainer. Here counterfactuals are formed by replacing feature values from a nearest unlike neighbour (NUN) until an actionable change is observed. We show how widely adopted feature relevance-based explainers (i.e. LIME, SHAP), can inform DisCERN to identify the minimum subset of "actionable features". We demonstrate our DisCERN algorithm on five datasets in a comparative study with the widely used optimisation-based counterfactual approach DiCE. Our results demonstrate that DisCERN is an effective strategy to minimise actionable changes necessary to create good counterfactual explanations.