title: Revisiting Dockerfiles in Open Source Software Over Time

abstract: Docker is becoming ubiquitous with containerization for developing and deploying applications. Previous studies have analyzed Dockerfiles that are used to create container images in order to better understand how to improve Docker tooling. These studies obtain Dockerfiles using either Docker Hub or Github. In this paper, we revisit the findings of previous studies using the largest set of Dockerfiles known to date with over 9.4 million unique Dockerfiles found in the World of Code infrastructure spanning from 2013-2020. We contribute a historical view of the Dockerfile format by analyzing the Docker engine changelogs and use the history to enhance our analysis of Dockerfiles. We also reconfirm previous findings of a downward trend in using OS images and an upward trend of using language images. As well, we reconfirm that Dockerfile smell counts are slightly decreasing meaning that Dockerfile authors are likely getting better at following best practices. Based on these findings, it indicates that previous analyses from prior works have been correct in many of their findings and their suggestions to build better tools for Docker image creation are further substantiated.


title: Using approximate inertial manifold approach to model turbulent non-premixed combustion

abstract: The theory of inertial manifolds (IM) is used to develop reduced-order models of turbulent combustion. In this approach, the dynamics of the system are tracked in a low-dimensional manifold determined in-situ without invoking laminar flame structures or statistical assumptions about the underlying turbulent flow. The primary concept in approximate IM (AIM) is that slow dominant dynamical behavior of the system is confined to a low-dimension manifold, and fast dynamics respond to the dynamics on the IM instantaneously. Decomposition of slow/fast dynamics and formulation of an AIM is accomplished by only exploiting the governing equations. Direct numerical simulations (DNS) of initially non-premixed fuel-air mixtures developing in forced isotropic turbulence have been carried out to investigate the proposed model. Reaction rate parameters are varied to allow for varying levels of extinction and reignition. The AIM performance in capturing different flame behaviors is assessed both a priori and a posteriori. It is shown that AIM captures the dynamics of the flames including extinction and reignition. Moreover, AIM provides scalar dissipation rate, mixing time for reactive scalars, and closures for nonlinear terms without any additional modeling. The AIM formulation is found promising, and provides a new approach to modeling turbulent combustion.


title: Drop-Bottleneck: Learning Discrete Compressed Representation for Noise-Robust Exploration

abstract: We propose a novel information bottleneck (IB) method named Drop-Bottleneck, which discretely drops features that are irrelevant to the target variable. Drop-Bottleneck not only enjoys a simple and tractable compression objective but also additionally provides a deterministic compressed representation of the input variable, which is useful for inference tasks that require consistent representation. Moreover, it can jointly learn a feature extractor and select features considering each feature dimension's relevance to the target task, which is unattainable by most neural network-based IB methods. We propose an exploration method based on Drop-Bottleneck for reinforcement learning tasks. In a multitude of noisy and reward sparse maze navigation tasks in VizDoom (Kempka et al., 2016) and DMLab (Beattie et al., 2016), our exploration method achieves state-of-the-art performance. As a new IB framework, we demonstrate that Drop-Bottleneck outperforms Variational Information Bottleneck (VIB) (Alemi et al., 2017) in multiple aspects including adversarial robustness and dimensionality reduction.


title: Combinatorics of ancestral lines for a Wright-Fisher diffusion with selection in a L\'evy environment

abstract: Wright-Fisher diffusions describe the evolution of the type composition of an infinite haploid population with two types (say type $0$ and type $1$) subject to neutral reproductions, and possibly selection and mutations. In the present paper we study a Wright-Fisher diffusion in a L\'evy environment that gives a selective advantage to sometimes one type, sometimes the other. Classical methods using the Ancestral Selection Graph (ASG) fail in the study of this model because of the complexity, resulting from the two-sided selection, of the structure of the information contained in the ASG. We propose a new method that consists in encoding the relevant combinatorics of the ASG into a function. We show that the expectations of the coefficients of this function form a (non-stochastic) semigroup and deduce that they satisfy a linear system of differential equations. As a result we obtain a series representation for the fixation probability $h(x)$ (where $x$ is the initial proportion of individuals of type $0$ in the population) as an infinite sum of polynomials whose coefficients satisfy explicit linear relations. Our approach then allows to derive Taylor expansions at every order for $h(x)$ near $x=0$ and to obtain an explicit recursion formula for the coefficients.


title: Optimal lower bounds for first eigenvalues of Riemann surfaces for large genus

abstract: In this article we study the first eigenvalues of closed Riemann surfaces for large genus. We show that for every closed Riemann surface $X_g$ of genus $g$ $(g\geq 2)$, the first eigenvalue of $X_g$ is greater than $\frac{\mathcal{L}_1(X_g)}{g^2}$ up to a uniform positive constant multiplication. Where $\mathcal{L}_1(X_g)$ is the shortest length of multi closed curves separating $X_g$. Moreover,we also show that this new lower bound is optimal as $g \to \infty$.


title: Universality of swap for qudits: a representation theory approach

abstract: An open problem of quantum information theory has been to determine under what conditions universal exchange-only computation is possible for qudits encoded on $d$-state systems for $d>2$. This problem can be posed in terms of representation theory by recognizing that each quantum mechanical swap, generated by exchange-interaction, can be identified with a transposition in a symmetric group, each $d$-state system can be identified with the fundamental representation of $SU(d)$, and each encoded qudit can be identified with an irreducible representation of a Lie algebra generated by transpositions. Towards this end we first give a mathematical definition of exchange-only universality in terms of a map from the special unitary algebra on the product of qudits into a representation of a Lie algebra generated by transpositions. We show that this definition is consistent with quantum computing requirements. We then proceed with the task of characterizing universal families of qudits, that is families of encoded qudits admitting exchange-only universality. This endeavor is aided by the fact that the irreducible representations corresponding to qudits are canonically labeled by partitions. In particular we derive necessary and sufficient conditions for universality on one or two such qudits, in terms of simple arithmetic conditions on the associated partitions. We also derive necessary and sufficient conditions for universality on arbitrarily many such qudits, in terms of Littlewood--Richardson coefficients. Among other results, we prove that universal families of multiple qudits are upward closed, that universality is guaranteed for sufficiently many qudits, and that any family that is not universal can be made so by simply adding at most five ancillae. We also obtain results for 2-state systems as a special case.


title: Tracing Vulnerable Code Lineage

abstract: This paper presents results from the MSR 2021 Hackathon. Our team investigates files/projects that contain known security vulnerabilities and how widespread they are throughout repositories in open source software. These security vulnerabilities can potentially be propagated through code reuse even when the vulnerability is fixed in different versions of the code. We utilize the World of Code infrastructure to discover file-level duplication of code from a nearly complete collection of open source software. This paper describes a method and set of tools to find all open source projects that use known vulnerable files and any previous revisions of those files.


title: A universal quantum gate set for transmon qubits with strong ZZ interactions

abstract: High-fidelity single- and two-qubit gates are essential building blocks for a fault-tolerant quantum computer. While there has been much progress in suppressing single-qubit gate errors in superconducting qubit systems, two-qubit gates still suffer from error rates that are orders of magnitude higher. One limiting factor is the residual ZZ-interaction, which originates from a coupling between computational states and higher-energy states. While this interaction is usually viewed as a nuisance, here we experimentally demonstrate that it can be exploited to produce a universal set of fast single- and two-qubit entangling gates in a coupled transmon qubit system. To implement arbitrary single-qubit rotations, we design a new protocol called the two-axis gate that is based on a three-part composite pulse. It rotates a single qubit independently of the state of the other qubit despite the strong ZZ-coupling. We achieve single-qubit gate fidelities as high as 99.1% from randomized benchmarking measurements. We then demonstrate both a CZ gate and a CNOT gate. Because the system has a strong ZZ-interaction, a CZ gate can be achieved by letting the system freely evolve for a gate time $t_g=53.8$ ns. To design the CNOT gate, we utilize an analytical microwave pulse shape based on the SWIPHT protocol for realizing fast, low-leakage gates. We obtain fidelities of 94.6% and 97.8% for the CNOT and CZ gates respectively from quantum progress tomography.


title: GISE-51: A scalable isolated sound events dataset

abstract: Most of the existing isolated sound event datasets comprise a small number of sound event classes, usually 10 to 15, restricted to a small domain, such as domestic and urban sound events. In this work, we introduce GISE-51, a dataset spanning 51 isolated sound events belonging to a broad domain of event types. We also release GISE-51-Mixtures, a dataset of 5-second soundscapes with hard-labelled event boundaries synthesized from GISE-51 isolated sound events. We conduct baseline sound event recognition (SER) experiments on the GISE-51-Mixtures dataset, benchmarking prominent convolutional neural networks, and models trained with the dataset demonstrate strong transfer learning performance on existing audio recognition benchmarks. Together, GISE-51 and GISE-51-Mixtures attempt to address some of the shortcomings of recent sound event datasets, providing an open, reproducible benchmark for future research along with the freedom to adapt the included isolated sound events for domain-specific applications.


title: Clogging, Dynamics and Reentrant Fluid for Active Matter on Periodic Substrates

abstract: We examine the collective states of run-and-tumble active matter disks driven over a periodic obstacle array. When the drive is applied along a symmetry direction of the array, we find a clog-free uniform liquid state for low activity, while at higher activity, the density becomes increasingly heterogeneous and an active clogged state emerges in which the mobility is strongly reduced. For driving along non-symmetry or incommensurate directions, there are two different clogging behaviors consisting of a drive dependent clogged state in the low activity thermal limit and a drive independent clogged state at high activity. These regimes are separated by a uniform flowing liquid at intermediate activity. There is a critical activity level above which the thermal clogged state does not occur, as well as an optimal activity level that maximizes the disk mobility. Thermal clogged states are dependent on the driving direction while active clogged states are not. In the low activity regime, diluting the obstacles produces a monotonic increase in the mobility; however, for large activities, the mobility is more robust against obstacle dilution. We also examine the velocity-force curves for driving along non-symmetry directions, and find that they are linear when the activity is low or intermediate, but become nonlinear at high activity and show behavior similar to that found for the plastic depinning of solids. At higher drives the active clustering is lost. For low activity we also find a reentrant fluid phase, where the system transitions from a high mobility fluid at low drives to a clogged state at higher drives and then back into another fluid phase at very high drives. We map the regions in which the thermally clogged, partially clogged, active uniform fluid, clustered fluid, active clogged, and directionally locked states occur as a function of disk density, drift force, and activity.


title: IAIA-BL: A Case-based Interpretable Deep Learning Model for Classification of Mass Lesions in Digital Mammography

abstract: Interpretability in machine learning models is important in high-stakes decisions, such as whether to order a biopsy based on a mammographic exam. Mammography poses important challenges that are not present in other computer vision tasks: datasets are small, confounding information is present, and it can be difficult even for a radiologist to decide between watchful waiting and biopsy based on a mammogram alone. In this work, we present a framework for interpretable machine learning-based mammography. In addition to predicting whether a lesion is malignant or benign, our work aims to follow the reasoning processes of radiologists in detecting clinically relevant semantic features of each image, such as the characteristics of the mass margins. The framework includes a novel interpretable neural network algorithm that uses case-based reasoning for mammography. Our algorithm can incorporate a combination of data with whole image labelling and data with pixel-wise annotations, leading to better accuracy and interpretability even with a small number of images. Our interpretable models are able to highlight the classification-relevant parts of the image, whereas other methods highlight healthy tissue and confounding information. Our models are decision aids, rather than decision makers, aimed at better overall human-machine collaboration. We do not observe a loss in mass margin classification accuracy over a black box neural network trained on the same data.


title: Rare-earth chalcohalides: A family of van der Waals layered Kitaev spin liquid candidates

abstract: Kitaev spin liquid (KSL) system has attracted tremendous attention in past years because of its fundamental significance in condensed matter physics and promising applications in fault-tolerant topological quantum computation. Material realization of such a system remains a major challenge in the field due to the unusual configuration of anisotropic spin interactions, though great effort has been made before. Here we reveal that rare-earth chalcohalides REChX (RE=rare earth, Ch=O, S, Se, Te, X=F, Cl, Br, I) can serve as a family of KSL candidates. Most family members have the typical SmSI-type structure with a high symmetry of R-3m and rare-earth magnetic ions form an undistorted honeycomb lattice. The strong spin-orbit coupling of 4f electrons intrinsically offers anisotropic spin interactions as required by Kitaev model. We have grown the crystals of YbOCl and synthesized the polycrystals of SmSI, ErOF, HoOF and DyOF, and made careful structural characterizations. We carry out magnetic and heat capacity measurements down to 1.8 K and find no obvious magnetic transition in all the samples but DyOF. The van der Waals interlayer coupling highlights the true two-dimensionality of the family which is vital for the exact realization of Abelian/non-Abelian anyons, and the graphene-like feature will be a prominent advantage for developing miniaturized devices. The family is expected to act as an inspiring material platform for the exploration of KSL physics.


title: Global expressions for high-order structure functions in Burgers turbulence

abstract: Since the famous work by Kolmogorov on incompressible turbulence, the structure-function theory has been a key foundation of modern turbulence study. Due to the simplicity of Burgers turbulence, structure functions are calculated to arbitrary orders, which provides numerous implications for other compressible turbulent systems. We present the derivation of exact forcing-scale resolving expressions for high-order structure functions of the burgers turbulence. Compared with the previous theories where the structure functions are calculated in the inertial range based on the statistics of shocks, our expressions link high-order structure functions in different orders without extra information on the flow structure and are valid beyond the inertial range, therefore they are easily checked by numerical simulations.


title: SuctionNet-1Billion: A Large-Scale Benchmark for Suction Grasping

abstract: Suction is an important solution for the longstanding robotic grasping problem. Compared with other kinds of grasping, suction grasping is easier to represent and often more reliable in practice. Though preferred in many scenarios, it is not fully investigated and lacks sufficient training data and evaluation benchmarks. To address that, firstly, we propose a new physical model to analytically evaluate seal formation and wrench resistance of a suction grasping, which are two key aspects of grasp success. Secondly, a two-step methodology is adopted to generate annotations on a large-scale dataset collected in real-world cluttered scenarios. Thirdly, a standard online evaluation system is proposed to evaluate suction poses in continuous operation space, which can benchmark different algorithms fairly without the need of exhaustive labeling. Real-robot experiments are conducted to show that our annotations align well with real world. Meanwhile, we propose a method to predict numerous suction poses from an RGB-D image of a cluttered scene and demonstrate our superiority against several previous methods. Result analyses are further provided to help readers better understand the challenges in this area. Data and source code are publicly available at www.graspnet.net.


title: TMR: Evaluating NER Recall on Tough Mentions

abstract: We propose the Tough Mentions Recall (TMR) metrics to supplement traditional named entity recognition (NER) evaluation by examining recall on specific subsets of "tough" mentions: unseen mentions, those whose tokens or token/type combination were not observed in training, and type-confusable mentions, token sequences with multiple entity types in the test data. We demonstrate the usefulness of these metrics by evaluating corpora of English, Spanish, and Dutch using five recent neural architectures. We identify subtle differences between the performance of BERT and Flair on two English NER corpora and identify a weak spot in the performance of current models in Spanish. We conclude that the TMR metrics enable differentiation between otherwise similar-scoring systems and identification of patterns in performance that would go unnoticed from overall precision, recall, and F1.


title: Different Environmental Conditions in Genetic Algorithm

abstract: We propose an extended genetic algorithm (GA) with different local environmental conditions. Genetic entities, or configurations, are put on nodes in a ring structure, and location-dependent environmental conditions are applied for each entity. Our GA is motivated by the geographic aspect of natural evolution: Geographic isolation reduces the diversity in a local group, but at the same time, can enhance intergroup diversity. Mating of genetic entities across different environments can make it possible to search for broad area of the fitness landscape. We validate our extended GA for finding the ground state of three-dimensional spin-glass system and find that the use of different environmental conditions makes it possible to find the lower-energy spin configurations at relatively shorter computation time. Our extension of GA belongs to a meta-optimization method and thus can be applied for a broad research area in which finding of the optimal state in a shorter computation time is the key problem.


title: An introductory review on resource theories of generalized nonclassical light

abstract: Quantum resource theory is perhaps the most revolutionary framework that quantum physics has ever experienced. It plays vigorous roles in unifying the quantification methods of a requisite quantum effect as wells as in identifying protocols that optimize its usefulness in a given application in areas ranging from quantum information to computation. Moreover, the resource theories have transmuted radical quantum phenomena like coherence, nonclassicality and entanglement from being just intriguing to being helpful in executing realistic thoughts. A general quantum resource theoretical framework relies on the method of categorization of all possible quantum states into two sets, namely, the free set and the resource set. Associated with the set of free states there is a number of free quantum operations emerging from the natural constraints attributed to the corresponding physical system. Then, the task of quantum resource theory is to discover possible aspects arising from the restricted set of operations as resources. Along with the rapid growth of various resource theories corresponding to standard harmonic oscillator quantum optical states, significant advancement has been expedited along the same direction for generalized quantum optical states. Generalized quantum optical framework strives to bring in several prosperous contemporary ideas including nonlinearity, $\mathcal{PT}$-symmetric non-Hermitian theories, $q$-deformed bosonic systems, etc., to accomplish similar but elevated objectives of the standard quantum optics and information theories. In this article, we review the developments of nonclassical resource theories of different generalized quantum optical states and their usefulness in the context of quantum information theories.


title: Distributionally Robust Optimization with Moment Ambiguity Sets

abstract: This paper studies distributionally robust optimization (DRO) when the ambiguity set is given by moments for the distributions. The objective and constraints are given by polynomials in decision variables. We reformulate the DRO with equivalent moment conic constraints. Under some general assumptions, we prove the DRO is equivalent to a linear optimization problem with moment and psd polynomial cones. A Moment-SOS relaxation method is proposed to solve it. Its asymptotic and finite convergence are shown under certain assumptions. Numerical examples are presented to show how to solve DRO problems.


title: Effect of entanglement and crosslinking on the hyperelastic behavior of SBR rubber: A multiscale DPD simulation study

abstract: In this study we have investigated into the entanglement effect and crosslinking effect in long-chain SBR rubber polymer system to model the mechanical hyperelastic behavior. The discussed methodologies are developed by a dissipative particle dynamics (DPD) based multiscale modeling method. The DPD interaction parameters are in turn obtained by all atomistic molecular dynamics and subsequently utilized by the DPD simulations. In the DPD simulation boxes, 200 long polymer chains and 1600 vulcanizing sulphur beads were packed. Vulcanization was achieved by random cross-linking among chains and entanglement was detected by utilizing the M-coil estimator. The mechanical effect of entanglement was modelled by extended tube model and the crosslinking effect was modelled by the Arruda-Boyce model. The modelled stress-strain curve is compared with the experimentally obtained curve for the qualitative and quantitative aspects of mechanical properties. It was determined that for strains up to 150%, the contribution of entanglement to the measured mechanical properties can be even up to 50%.


title: HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries (Extended Version)

abstract: Hybrid complex analytics workloads typically include (i) data management tasks (joins, selections, etc. ), easily expressed using relational algebra (RA)-based languages, and (ii) complex analytics tasks (regressions, matrix decompositions, etc.), mostly expressed in linear algebra (LA) expressions. Such workloads are common in many application areas, including scientific computing, web analytics, and business recommendation. Existing solutions for evaluating hybrid analytical tasks - ranging from LA-oriented systems, to relational systems (extended to handle LA operations), to hybrid systems - either optimize data management and complex tasks separately, exploit RA properties only while leaving LA-specific optimization opportunities unexploited, or focus heavily on physical optimization, leaving semantic query optimization opportunities unexplored. Additionally, they are not able to exploit precomputed (materialized) results to avoid recomputing (part of) a given mixed (RA and/or LA) computation. In this paper, we take a major step towards filling this gap by proposing HADAD, an extensible lightweight approach for optimizing hybrid complex analytics queries, based on a common abstraction that facilitates unified reasoning: a relational model endowed with integrity constraints. Our solution can be naturally and portably applied on top of pure LA and hybrid RA-LA platforms without modifying their internals. An extensive empirical evaluation shows that HADAD yields significant performance gains on diverse workloads, ranging from LA-centered to hybrid.


title: Enhanced Spatio-Temporal Interaction Learning for Video Deraining: A Faster and Better Framework

abstract: Video deraining is an important task in computer vision as the unwanted rain hampers the visibility of videos and deteriorates the robustness of most outdoor vision systems. Despite the significant success which has been achieved for video deraining recently, two major challenges remain: 1) how to exploit the vast information among continuous frames to extract powerful spatio-temporal features across both the spatial and temporal domains, and 2) how to restore high-quality derained videos with a high-speed approach. In this paper, we present a new end-to-end video deraining framework, named Enhanced Spatio-Temporal Interaction Network (ESTINet), which considerably boosts current state-of-the-art video deraining quality and speed. The ESTINet takes the advantage of deep residual networks and convolutional long short-term memory, which can capture the spatial features and temporal correlations among continuing frames at the cost of very little computational source. Extensive experiments on three public datasets show that the proposed ESTINet can achieve faster speed than the competitors, while maintaining better performance than the state-of-the-art methods.


title: Matter production effects and interacting scenario within a reconstructed mimetic cosmology for late times

abstract: In this work we explore two possible scenarios that can be considered to extend a recent proposed model by the authors known as reconstructed mimetic cosmology. This study is complemented with an statistical analysis for each case. The first scenario considers the inclusion of matter production as a possible source of cosmic expansion in the reconstructed mimetic model, at effective level was found that this construction can cross the phantom divide, the model evolves from quintessence to phantom dark energy. The second scenario corresponds to a construction of an interacting scheme for the dark sector which is described by the unified mimetic model. The resulting interaction term (not imposed by an Ansatz), $Q$, exhibits changes of sign leading to the violation of the second law along the cosmic evolution and non adiabaticity; the temperatures for the components of the dark sector are computed and such components are shown to be out of thermal equilibrium.


title: Benchmark test of Black-box optimization using D-Wave quantum annealer

abstract: In solving optimization problems, objective functions generally need to be minimized or maximized. However, objective functions cannot always be formulated explicitly in a mathematical form for complicated problem settings. Although several regression techniques infer the approximate forms of objective functions, they are at times expensive to evaluate. Optimal points of "black-box" objective functions are computed in such scenarios, while effectively using a small number of clues. Recently, an efficient method by use of inference by sparse prior for a black-box objective function with binary variables has been proposed. In this method, a surrogate model was proposed in the form of a quadratic unconstrained binary optimization (QUBO) problem, and was iteratively solved to obtain the optimal solution of the black-box objective function. In the present study, we employ the D-Wave 2000Q quantum annealer, which can solve QUBO by driving the binary variables by quantum fluctuations. The D-Wave 2000Q quantum annealer does not necessarily output the ground state at the end of the protocol due to freezing effect during the process. We investigate effects from the output of the D-Wave quantum annealer in performing black-box optimization. We demonstrate a benchmark test by employing the sparse Sherrington-Kirkpatrick (SK) model as the black-box objective function, by introducing a parameter controlling the sparseness of the interaction coefficients. Comparing the results of the D-Wave quantum annealer to those of the simulated annealing (SA) and semidefinite programming (SDP), our results by the D-Wave quantum annealer and SA exhibit superiority in black-box optimization with SDP. On the other hand, we did not find any advantage of the D-Wave quantum annealer over the simulated annealing. As far as in our case, any effects by quantum fluctuation are not found.


title: Learning 6DoF Grasping Using Reward-Consistent Demonstration

abstract: As the number of the robot's degrees of freedom increases, the implementation of robot motion becomes more complex and difficult. In this study, we focus on learning 6DOF-grasping motion and consider dividing the grasping motion into multiple tasks. We propose to combine imitation and reinforcement learning in order to facilitate a more efficient learning of the desired motion. In order to collect demonstration data as teacher data for the imitation learning, we created a virtual reality (VR) interface that allows humans to operate the robot intuitively. Moreover, by dividing the motion into simpler tasks, we simplify the design of reward functions for reinforcement learning and show in our experiments a reduction in the steps required to learn the grasping motion.


title: Extracting Causal Visual Features for Limited label Classification

abstract: Neural networks trained to classify images do so by identifying features that allow them to distinguish between classes. These sets of features are either causal or context dependent. Grad-CAM is a popular method of visualizing both sets of features. In this paper, we formalize this feature divide and provide a methodology to extract causal features from Grad-CAM. We do so by defining context features as those features that allow contrast between predicted class and any contrast class. We then apply a set theoretic approach to separate causal from contrast features for COVID-19 CT scans. We show that on average, the image regions with the proposed causal features require 15% less bits when encoded using Huffman encoding, compared to Grad-CAM, for an average increase of 3% classification accuracy, over Grad-CAM. Moreover, we validate the transfer-ability of causal features between networks and comment on the non-human interpretable causal nature of current networks.


title: Anomaly Detection using Principles of Human Perception

abstract: In the fields of statistics and unsupervised machine learning a fundamental and well-studied problem is anomaly detection. Anomalies are difficult to define, yet many algorithms have been proposed. Underlying the approaches is the nebulous understanding that anomalies are rare, unusual or inconsistent with the majority of data. The present work provides a philosophical treatise to clearly define anomalies and develops an algorithm for their efficient detection with minimal user intervention. Inspired by the Gestalt School of Psychology and the Helmholtz principle of human perception, anomalies are assumed to be observations that are unexpected to occur with respect to certain groupings made by the majority of the data. Under appropriate random variable modelling anomalies are directly found in a set of data by a uniform and independent random assumption of the distribution of constituent elements of the observations, with anomalies corresponding to those observations where the expectation of the number of occurrences of the elements in a given view is $<1$. Starting from fundamental principles of human perception an unsupervised anomaly detection algorithm is developed that is simple, real-time and parameter-free. Experiments suggest it as a competing choice for univariate data with promising results on the detection of global anomalies in multivariate data.


title: A machine-learning approach to synthesize virtual sensors for parameter-varying systems

abstract: This paper introduces a novel model-free approach to synthesize virtual sensors for the estimation of dynamical quantities that are unmeasurable at runtime but are available for design purposes on test benches. After collecting a dataset of measurements of such quantities, together with other variables that are also available during on-line operations, the virtual sensor is obtained using machine learning techniques by training a predictor whose inputs are the measured variables and the features extracted by a bank of linear observers fed with the same measures. The approach is applicable to infer the value of quantities such as physical states and other time-varying parameters that affect the dynamics of the system. The proposed virtual sensor architecture - whose structure can be related to the Multiple Model Adaptive Estimation framework - is conceived to keep computational and memory requirements as low as possible, so that it can be efficiently implemented in embedded hardware platforms. The effectiveness of the approach is shown in different numerical examples, involving the estimation of the scheduling parameter of a nonlinear parameter-varying system, the reconstruction of the mode of a switching linear system, and the estimation of the state of charge (SoC) of a lithium-ion battery.


title: Cross sections of solar neutrino capture by 127I nuclei and Gamow Teller resonances

abstract: Solar neutrino capture cross-section by 127I nucleus has been studied with taking into account the influence of the resonance structure of the nuclear strength function S(E). Three types of isobaric resonances: giant Gamow-Teller, analog resonance and low-lying Gamow-Teller pigmy resonances has been investigated on the framework of self-consistent theory of finite Fermi systems. The calculations have been performed considering the resonance structure of the charge-exchange strength function S(E). We analyze the effect of each resonance on the energy dependence of the cross-section. It has been shown that all high-lying resonances should be considered. Neutron emission process for high energy nuclear excitation leads to formation 126Xe isotope. We evaluate contribution from various sources of solar neutrinos to the 126Xe/127Xe isotopes ratio formed by energetic neutrinos. 126Xe/127Xe isotope ratio could be an indicator of high-energy boron neutrinos in the solar spectrum. We also discuss the uncertainties in the often used Fermi-functions calculations.


title: Security of Healthcare Data Using Blockchains: A Survey

abstract: The advancement in the healthcare sector is entering into a new era in the form of Health 4.0. The integration of innovative technologies like Cyber-Physical Systems (CPS), Big Data, Cloud Computing, Machine Learning, and Blockchain with Healthcare services has led to improved performance and efficiency through data-based learning and interconnection of systems. On the other hand, it has also increased complexities and has brought its own share of vulnerabilities due to the heavy influx, sharing, and storage of healthcare data. The protection of the same from cyber-attacks along with privacy preservation through authenticated access is one of the significant challenges for the healthcare sector. For this purpose, the use of blockchain-based networks can lead to a considerable reduction in the vulnerabilities of the healthcare systems and secure their data. This chapter explores blockchain's role in strengthening healthcare data security by answering the questions related to what data use, when we need, why we need, who needs, and how state-of-the-art techniques use blockchains to secure healthcare data. As a case study, we also explore and analyze the state-of-the-art implementations for blockchain in healthcare data security for the COVID-19 pandemic. In order to provide a path to future research directions, we identify and discuss the technical limitations and regulatory challenges associated with blockchain-based healthcare data security implementation.


title: Adaptive Fractional-Order Sliding Mode Controller with Neural Network Compensator for an Ultrasonic Motor

abstract: Ultrasonic motors (USMs) are commonly used in aerospace, robotics, and medical devices, where fast and precise motion is needed. Remarkably, sliding mode controller (SMC) is an effective controller to achieve precision motion control of the USMs. To improve the tracking accuracy and lower the chattering in the SMC, the fractional-order calculus is introduced in the design of an adaptive SMC in this paper, namely, adaptive fractional-order SMC (AFOSMC), in which the bound of the uncertainty existing in the USMs is estimated by a designed adaptive law. Additionally, a short memory principle is employed to overcome the difficulty of implementing the fractional-order calculus on a practical system in real-time. Here, the short memory principle may increase the tracking errors because some information is lost during its operation. Thus, a compensator according to the framework of Bellman's optimal control theory is proposed so that the residual errors caused by the short memory principle can be attenuated. Lastly, experiments on a USM are conducted, which comparative results verify the performance of the designed controller.


title: Decomposing Normal and Abnormal Features of Medical Images into Discrete Latent Codes for Content-Based Image Retrieval

abstract: In medical imaging, the characteristics purely derived from a disease should reflect the extent to which abnormal findings deviate from the normal features. Indeed, physicians often need corresponding images without abnormal findings of interest or, conversely, images that contain similar abnormal findings regardless of normal anatomical context. This is called comparative diagnostic reading of medical images, which is essential for a correct diagnosis. To support comparative diagnostic reading, content-based image retrieval (CBIR), which can selectively utilize normal and abnormal features in medical images as two separable semantic components, will be useful. Therefore, we propose a neural network architecture to decompose the semantic components of medical images into two latent codes: normal anatomy code and abnormal anatomy code. The normal anatomy code represents normal anatomies that should have existed if the sample is healthy, whereas the abnormal anatomy code attributes to abnormal changes that reflect deviation from the normal baseline. These latent codes are discretized through vector quantization to enable binary hashing, which can reduce the computational burden at the time of similarity search. By calculating the similarity based on either normal or abnormal anatomy codes or the combination of the two codes, our algorithm can retrieve images according to the selected semantic component from a dataset consisting of brain magnetic resonance images of gliomas. Our CBIR system qualitatively and quantitatively achieves remarkable results.


title: Contrastive Reasoning in Neural Networks

abstract: Neural networks represent data as projections on trained weights in a high dimensional manifold. The trained weights act as a knowledge base consisting of causal class dependencies. Inference built on features that identify these dependencies is termed as feed-forward inference. Such inference mechanisms are justified based on classical cause-to-effect inductive reasoning models. Inductive reasoning based feed-forward inference is widely used due to its mathematical simplicity and operational ease. Nevertheless, feed-forward models do not generalize well to untrained situations. To alleviate this generalization challenge, we propose using an effect-to-cause inference model that reasons abductively. Here, the features represent the change from existing weight dependencies given a certain effect. We term this change as contrast and the ensuing reasoning mechanism as contrastive reasoning. In this paper, we formalize the structure of contrastive reasoning and propose a methodology to extract a neural network's notion of contrast. We demonstrate the value of contrastive reasoning in two stages of a neural network's reasoning pipeline : in inferring and visually explaining decisions for the application of object recognition. We illustrate the value of contrastively recognizing images under distortions by reporting an improvement of 3.47%, 2.56%, and 5.48% in average accuracy under the proposed contrastive framework on CIFAR-10C, noisy STL-10, and VisDA datasets respectively.


title: Subconvexity bounds for twisted L-functions, II

abstract: We prove hybrid subconvexity bounds twisted L-functions $L(s,f\times \chi)$ at the central point using a fourth moment estimate, including a new instance of the Burgess subconvexity bound.


title: Bracket structure on Hochschild cohomology of Koszul quiver algebras using homotopy liftings

abstract: We present the Gerstenhaber algebra structure on the Hochschild cohomology of Koszul algebras defined by quivers and relations using the idea of homotopy liftings. E.L. Green, G. Hartman, E.N. Marcos and O. Solberg provided a canonical way of constructing a minimal projective bimodule resolution of a Koszul quiver algebra. The resolution has a comultiplicative structure which we use to define homotopy lifting maps. We first present a short example that demonstrates the theory. We then study the Gerstenhaber algebra structure on Hochschild cohomology of a family of bound quiver algebras, some members of which are counterexamples to the Snashall-Solberg finite generation conjecture. We give examples of homotopy lifting maps for degree $2$ and degree $1$ cocycles and draw connections to derivation operators. As an application, we describe Hochschild 2-cocycles satisfying the Maurer-Cartan equation.


title: A study on free roots of Borcherds-Kac-Moody Lie Superalgebras

abstract: Let $\mathfrak g$ be a Borcherds-Kac-Moody Lie superalgebra (BKM superalgebra in short) with the associated graph $G$. Any such $\mathfrak g$ is constructed from a free Lie superalgebra by introducing three different sets of relations on the generators: (1) Chevalley relations, (2) Serre relations, and (3) Commutation relations coming from the graph $G$. By Chevalley relations we get a triangular decomposition $\mathfrak g = \mathfrak{ n_+} \oplus \mathfrak h \oplus \mathfrak n_{-}$ and each roots space $\mathfrak{ g_{\alpha}}$ is either contained in $\mathfrak{n_+}$ or $\mathfrak{ n_{-}}$. In particular, each $\mathfrak{ g_{\alpha}}$ involves only the relations (2) and (3). In this paper, we are interested in the root spaces of $\mathfrak g$ which are independent of the Serre relations. We call these roots free roots$^{1}$ of $\mathfrak g$. Since these root spaces involve only commutation relations coming from the graph $G$ we can study them combinatorially. We use heaps of pieces to study these roots and prove many combinatorial properties. We construct two different bases for these root spaces of $\mathfrak g$: One by extending the Lalonde's Lyndon heap basis of free partially commutative Lie algebras to the case of free partially commutative Lie superalgebras and the other by extending the basis given in \cite{akv17} for the free root spaces of Borcherds algebras to the case of BKM superalgebras. This is done by studying the combinatorial properties of super Lyndon heaps. We also discuss a few other combinatorial properties of free roots.


title: Breaking the Coupled Cluster Barrier for Machine Learned Potentials of Large Molecules: The Case of 15-atom Acetylacetone

abstract: Machine-learned potential energy surfaces (PESs) for molecules with more than 10 atoms are typically forced to use lower-level electronic structure methods such as density functional theory and second-order Moller-Plesset perturbation theory (MP2). While these are efficient and realistic, they fall short of the accuracy of the ``gold standard'' coupled-cluster method, especially with respect to reaction and isomerization barriers. We report a major step forward in applying a $\Delta$-machine learning method to the challenging case of acetylacetone, whose MP2 barrier height for H-atom transfer is low by roughly 1.5 kcal/mol relative to the benchmark CCSD(T) barrier of 3.2 kcal/mol. From a database of 2151 local CCSD(T) energies, and training with as few as 430 energies, we obtain a new PES with a barrier of 3.49 kcal/mol in agreement with the LCCSD(T) one of 3.54 kcal/mol and close to the benchmark value. Tunneling splittings due to H-atom transfer are calculated using this new PES, providing improved estimates over previous ones obtained using an MP2-based PES.


title: Taming Time-Varying Information Asymmetry in Fresh Status Acquisition

abstract: Many online platforms are providing valuable real-time contents (e.g., traffic) by continuously acquiring the status of different Points of Interest (PoIs). In status acquisition, it is challenging to determine how frequently a PoI should upload its status to a platform, since they are self-interested with private and possibly time-varying preferences. This paper considers a general multi-period status acquisition system, aiming to maximize the aggregate social welfare and ensure the platform freshness. The freshness is measured by a metric termed age of information. For this goal, we devise a long-term decomposition (LtD) mechanism to resolve the time-varying information asymmetry. The key idea is to construct a virtual social welfare that only depends on the current private information, and then decompose the per-period operation into multiple distributed bidding problems for the PoIs and platforms. The LtD mechanism enables the platforms to achieve a tunable trade-off between payoff maximization and freshness conditions. Moreover, the LtD mechanism retains the same social performance compared to the benchmark with symmetric information and asymptotically ensures the platform freshness conditions. Numerical results based on real-world data show that when the platforms pay more attention to payoff maximization, each PoI still obtains a non-negative payoff in the long-term.


title: Model Based Control of Commercial-Off-TheShelf (COTS) Unmanned Rotorcraft for BrickWall Construction

abstract: This work proposes a systematic framework for modelling and controller design of a Commercial-Off-The Shelf (COTS) unmanned rotorcraft using control theory and principles, for brick wall construction. With point to point navigation as the primary application, command velocities in the three axes of the Unmanned Aerial Vehicle (UAV) are considered as inputs of the system while its actual velocities are system outputs. Using the sine and step response data acquired from a Hardware-in-Loop (HiL) test simulator, the considered system was modelled in individual axes with the help of the proposed framework. This model was employed for controller design where a sliding mode controller was chosen to satisfy certain requirements of the application like robustness, flexibility and accuracy. The model was validated using step response data and produced a deviation of only 9%. Finally, the controller results from field test showed fine control up to 8 cms accuracy. Sliding Mode Control (SMC) was also compared with a linear controller derived from iterative experimentations and seen to perform better than the latter in terms of accuracy, and robustness to parametric variations and wind disturbances.


title: Shortcuts to adiabaticity for open quantum systems and a mixed-state inverse engineering scheme

abstract: We propose a fast mixed-state control scheme to transfer the quantum state along designable trajectories in Hilbert space, which is robust to multiple decoherence noises. Starting with the dynamical invariants of open quantum systems, we present the shortcuts to adiabaticity (STAs) of open quantum systems at first, then apply the STAs to speed up the adiabatic steady process. Our scheme drives open systems from a initial steady state to a target steady state by a controlled Liouvillian that possesses the same form as the reference (original) one which is accessible in present-day experiments. The experimental observation with current available parameters for the nitrogen-vacancy (NV) center in diamond is suggested and discussed.


title: Salient Image Matting

abstract: In this paper, we propose an image matting framework called Salient Image Matting to estimate the per-pixel opacity value of the most salient foreground in an image. To deal with a large amount of semantic diversity in images, a trimap is conventionally required as it provides important guidance about object semantics to the matting process. However, creating a good trimap is often expensive and timeconsuming. The SIM framework simultaneously deals with the challenge of learning a wide range of semantics and salient object types in a fully automatic and an end to end manner. Specifically, our framework is able to produce accurate alpha mattes for a wide range of foreground objects and cases where the foreground class, such as human, appears in a very different context than the train data directly from an RGB input. This is done by employing a salient object detection model to produce a trimap of the most salient object in the image in order to guide the matting model about higher-level object semantics. Our framework leverages large amounts of coarse annotations coupled with a heuristic trimap generation scheme to train the trimap prediction network so it can produce trimaps for arbitrary foregrounds. Moreover, we introduce a multi-scale fusion architecture for the task of matting to better capture finer, low-level opacity semantics. With high-level guidance provided by the trimap network, our framework requires only a fraction of expensive matting data as compared to other automatic methods while being able to produce alpha mattes for a diverse range of inputs. We demonstrate our framework on a range of diverse images and experimental results show our framework compares favourably against state of art matting methods without the need for a trimap


title: Consistency Analysis of the Closed-loop SRIVC Estimator

abstract: The Consistency of the Closed-Loop Simplified Refined Instrumental Variable method for Continuous-time system (CLSRIVC) is analysed based on sampled data. It is proven that the CLSRIVC estimator is not consistent when a continuous-time controller is used in the closed-loop.


abstract: Domain Adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision. Recent advances in DA mainly proceed by aligning the source and target distributions. Despite the significant success, the adaptation performance still degrades accordingly when the source and target domains encounter a large distribution discrepancy. We consider this limitation may attribute to the insufficient exploration of domain-specialized features because most studies merely concentrate on domain-general feature learning in task-specific layers and integrate totally-shared convolutional networks (convnets) to generate common features for both domains. In this paper, we relax the completely-shared convnets assumption adopted by previous DA methods and propose Domain Conditioned Adaptation Network (DCAN), which introduces domain conditioned channel attention module with a multi-path structure to separately excite channel activation for each domain. Such a partially-shared convnets module allows domain-specialized features in low-level to be explored appropriately. Further, given the knowledge transferability varying along with convolutional layers, we develop Generalized Domain Conditioned Adaptation Network (GDCAN) to automatically determine whether domain channel activations should be separately modeled in each attention module. Afterward, the critical domain-specialized knowledge could be adaptively extracted according to the domain statistic gaps. As far as we know, this is the first work to explore the domain-wise convolutional channel activations separately for deep DA networks. Additionally, to effectively match high-level feature distributions across domains, we consider deploying feature adaptation blocks after task-specific layers, which can explicitly mitigate the domain discrepancy.


title: Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers

abstract: Segmenting highly-overlapping objects is challenging, because typically no distinction is made between real object contours and occlusion boundaries. Unlike previous two-stage instance segmentation methods, we model image formation as composition of two overlapping layers, and propose Bilayer Convolutional Network (BCNet), where the top GCN layer detects the occluding objects (occluder) and the bottom GCN layer infers partially occluded instance (occludee). The explicit modeling of occlusion relationship with bilayer structure naturally decouples the boundaries of both the occluding and occluded instances, and considers the interaction between them during mask regression. We validate the efficacy of bilayer decoupling on both one-stage and two-stage object detectors with different backbones and network layer choices. Despite its simplicity, extensive experiments on COCO and KINS show that our occlusion-aware BCNet achieves large and consistent performance gain especially for heavy occlusion cases. Code is available at https://github.com/lkeab/BCNet.


title: Symmetry breaking induced tipping to aging

abstract: The competing effect of heterogeneity and symmetry breaking coupling on the emerging dynamics in a system of N globally coupled Stuart-Landau oscillators is investigated. Increasing the heterogeneity, using the standard deviation of the Hopf bifurcation parameter, favors the macroscopic oscillatory state for low values of the symmetry breaking coupling and inhomogeneous steady state for larger values of the coupling. There is also a transition, tipping, to homogeneous steady state (aging state) from the macroscopic oscillatory state. The limiting factor in the diffusive coupling favors the macroscopic oscillatory state even in the presence of a large fraction of inactive oscillators in the network thereby increasing the robustness of the network. The globally coupled oscillators are reduced to a system of two evolution equations for the macroscopic order parameters, corresponding to the mean-field and the shape parameter, using the self-consistent field approach. The bifurcation diagrams obtained from the mean-field variables elucidate various bifurcation scenarios responsible for the dynamical transitions observed in N globally coupled Stuart-Landau oscillators. In particular, tipping to the aging state is found to occur via the Hopf and pitchfork bifurcations illustrating the phenomenon of bifurcation induced tipping. Analytical stability (critical) curves of these bifurcations, deduced from the mean-field variables, are found to fairly well agree with the simulation results.


title: Cosmological perturbations for ultra-light axion-like particles in a state of Bose-Einstein condensate

abstract: For ultra-light scalar particles like axions, dark matter can form a state of the Bose-Einstein condensate (BEC) with a coherent classical wave whose wavelength is of order galactic scales. In the context of an oscillating scalar field with mass $m$, this BEC description amounts to integrating out the field oscillations over the Hubble time scale $H^{-1}$ in the regime $m \gg H$. We provide a gauge-invariant general relativistic framework for studying cosmological perturbations in the presence of a self-interacting BEC associated with a complex scalar field. In particular, we explicitly show the difference of BECs from perfect fluids by taking into account cold dark matter, baryons, and radiation as a Schutz-Sorkin description of perfect fluids. We also scrutinize the accuracy of commonly used Newtonian treatment based on a quasi-static approximation for perturbations deep inside the Hubble radius. For a scalar field which starts to oscillate after matter-radiation equality, we show that, after the BEC formation, a negative self-coupling hardly leads to a Laplacian instability of the BEC density contrast. This is attributed to the fact that the Laplacian instability does not overwhelm the gravitational instability for self-interactions within the validity of the nonrelativistic BEC description. Our analysis does not accommodate the regime of parametric resonance which can potentially occur for a large field alignment during the transient epoch prior to the BEC formation.


title: Skyrmion-size dependence of the topological Hall effect: A real-space calculation

abstract: Motivated by the recent discoveries of magnets harboring short-pitch skyrmion lattices, we investigate the skyrmion-size dependence of the topological Hall effect. By means of large-scale real-space calculations, we find that the Hall conductivity takes its extreme value in the crossover region where both the real-space and momentum-space Berry curvature play a crucial role. We also investigate how the optimum skyrmion size ($\lambda_{\rm sk}^*$) depends on the lifetime of itinerant electrons ($\tau$) and coupling constant between electrons and localized spins ($J$). For the former, we show that $\lambda_{\rm sk}^{*}$ is proportional to $\sqrt{\tau}$, which indicates that $\lambda_{\rm sk}^{*}$ is much less sensitive to $\tau$ than the conventional expectation that $\lambda_{\rm sk}^{*}$ is proportional to the mean-free path $\propto \tau$. For the latter, we show that the non-adiabaticity considerably suppresses the topological Hall effect when the time scale determined by the skyrmion size and Fermi velocity is shorter than $1/J$. However, its effect on $\lambda_{\rm sk}^{*}$ is not so siginificant and $\lambda_{\rm sk}^{*}$ is about ten times the lattice constant in a wide range of $J$ and $\tau$.


title: Joint Distribution across Representation Space for Out-of-Distribution Detection

abstract: Deep neural networks (DNNs) have become a key part of many modern software applications. After training and validating, the DNN is deployed as an irrevocable component and applied in real-world scenarios. Although most DNNs are built meticulously with huge volumes of training data, data in the real world still remain unknown to the DNN model, which leads to the crucial requirement of runtime out-of-distribution (OOD) detection. However, many existing approaches 1) need OOD data for classifier training or parameter tuning, or 2) simply combine the scores of each hidden layer as an ensemble of features for OOD detection. In this paper, we present a novel outlook on in-distribution data in a generative manner, which takes their latent features generated from each hidden layer as a joint distribution across representation spaces. Since only the in-distribution latent features are comprehensively understood in representation space, the internal difference between in-distribution and OOD data can be naturally revealed without the intervention of any OOD data. Specifically, We construct a generative model, called Latent Sequential Gaussian Mixture (LSGM), to depict how the in-distribution latent features are generated in terms of the trace of DNN inference across representation spaces. We first construct the Gaussian Mixture Model (GMM) based on in-distribution latent features for each hidden layer, and then connect GMMs via the transition probabilities of the inference traces. Experimental evaluations on popular benchmark OOD datasets and models validate the superiority of the proposed method over the state-of-the-art methods in OOD detection.


title: The Success of AdaBoost and Its Application in Portfolio Management

abstract: We develop a novel approach to explain why AdaBoost is a successful classifier. By introducing a measure of the influence of the noise points (ION) in the training data for the binary classification problem, we prove that there is a strong connection between the ION and the test error. We further identify that the ION of AdaBoost decreases as the iteration number or the complexity of the base learners increases. We confirm that it is impossible to obtain a consistent classifier without deep trees as the base learners of AdaBoost in some complicated situations. We apply AdaBoost in portfolio management via empirical studies in the Chinese market, which corroborates our theoretical propositions.


title: Co-Grounding Networks with Semantic Attention for Referring Expression Comprehension in Videos

abstract: In this paper, we address the problem of referring expression comprehension in videos, which is challenging due to complex expression and scene dynamics. Unlike previous methods which solve the problem in multiple stages (i.e., tracking, proposal-based matching), we tackle the problem from a novel perspective, \textbf{co-grounding}, with an elegant one-stage framework. We enhance the single-frame grounding accuracy by semantic attention learning and improve the cross-frame grounding consistency with co-grounding feature learning. Semantic attention learning explicitly parses referring cues in different attributes to reduce the ambiguity in the complex expression. Co-grounding feature learning boosts visual feature representations by integrating temporal correlation to reduce the ambiguity caused by scene dynamics. Experiment results demonstrate the superiority of our framework on the video grounding datasets VID and LiOTB in generating accurate and stable results across frames. Our model is also applicable to referring expression comprehension in images, illustrated by the improved performance on the RefCOCO dataset. Our project is available at https://sijiesong.github.io/co-grounding.


title: Shared Latent Space of Font Shapes and Their Noisy Impressions

abstract: Styles of typefaces or fonts are often associated with specific impressions, such as heavy, contemporary, or elegant. This indicates that there are certain correlations between font shapes and their impressions. To understand the correlations, this paper realizes a shared latent space where a font and its impressions are embedded nearby. The difficulty is that the impression words attached to a font are often very noisy. This is because impression words are very subjective and diverse. More importantly, some impression words have no direct relevance to the font shapes and will disturb the realization of the shared latent space. We, therefore, use DeepSets for enhancing shape-relevant words and suppressing shape irrelevant words automatically while training the shared latent space. Quantitative and qualitative experimental results with a large-scale font-impression dataset demonstrate that the shared latent space by the proposed method describes the correlation appropriately, especially for the shape-relevant impression words.


title: Activation cross section data of deuteron induced nuclear reactions on rubidium up to 50 MeV

abstract: Activation cross sections of the $^{nat}$Rb (d,xn)$^{87m,85m,85g,83,82}$Sr, $^{nat}$Rb(d,x)$^{86,84,83,82m}$Rb and $^{nat}$Rb(d,x)$^{85m}$Kr nuclear reactions have been measured for the first time through an activation method combining the stacked foil irradiation technique and gamma-ray spectrometry. The provided cross sections from the present investigation are all new, in such a way contribute to the completeness of the experimental database. The experimental cross sections were compared with the theoretical prediction in the TENDL-2019 TALYS based library and with our calculation using ALICE-D and EMPIRE-D model codes in order the improve their predictivity. Thick target production yields were calculated form the new cross sections for all investigated radioisotopes. Practical applications of the results are shortly discussed.


title: Fast Gradient Methods for Uniformly Convex and Weakly Smooth Problems

abstract: In this paper, acceleration of gradient methods for convex optimization problems with weak levels of convexity and smoothness is considered. Starting from the universal fast gradient method which was designed to be an optimal method for weakly smooth problems whose gradients are H\"older continuous, its momentum is modified appropriately so that it can also accommodate uniformly convex and weakly smooth problems. Different from the existing works, fast gradient methods proposed in this paper do not use the restarting technique but use momentums that are suitably designed to reflect both the uniform convexity and the weak smoothness information of the target energy function. Both theoretical and numerical results that support the superiority of proposed methods are presented.


title: Roughness Index and Roughness Distance for Benchmarking Medical Segmentation

abstract: Medical image segmentation is one of the most challenging tasks in medical image analysis and has been widely developed for many clinical applications. Most of the existing metrics have been first designed for natural images and then extended to medical images. While object surface plays an important role in medical segmentation and quantitative analysis i.e. analyze brain tumor surface, measure gray matter volume, most of the existing metrics are limited when it comes to analyzing the object surface, especially to tell about surface smoothness or roughness of a given volumetric object or to analyze the topological errors. In this paper, we first analysis both pros and cons of all existing medical image segmentation metrics, specially on volumetric data. We then propose an appropriate roughness index and roughness distance for medical image segmentation analysis and evaluation. Our proposed method addresses two kinds of segmentation errors, i.e. (i)topological errors on boundary/surface and (ii)irregularities on the boundary/surface. The contribution of this work is four-fold: (i) detect irregular spikes/holes on a surface, (ii) propose roughness index to measure surface roughness of a given object, (iii) propose a roughness distance to measure the distance of two boundaries/surfaces by utilizing the proposed roughness index and (iv) suggest an algorithm which helps to remove the irregular spikes/holes to smooth the surface. Our proposed roughness index and roughness distance are built upon the solid surface roughness parameter which has been successfully developed in the civil engineering.


title: A Simple Robust MPC for Linear Systems with Parametric and Additive Uncertainty

abstract: We propose a simple and computationally efficient approach for designing a robust Model Predictive Controller (MPC) for constrained uncertain linear systems. The uncertainty is modeled as an additive disturbance and an additive error on the system dynamics matrices. Set based bounds for each component of the model uncertainty are assumed to be known. We separate the constraint tightening strategy into two parts, depending on the length of the MPC horizon. For a horizon length of one, the robust MPC problem is solved exactly, whereas for other horizon lengths, the model uncertainty is over-approximated with a net-additive component. The resulting MPC controller guarantees robust satisfaction of state and input constraints in closed-loop with the uncertain system. With appropriately designed terminal components and an adaptive horizon strategy, we prove the controller's recursive feasibility and stability of the origin. With numerical simulations, we demonstrate that our proposed approach gains up to 15x online computation speedup over a tube MPC strategy, while stabilizing about 98$\%$ of the latter's region of attraction.


title: iMAP: Implicit Mapping and Positioning in Real-Time

abstract: We show for the first time that a multilayer perceptron (MLP) can serve as the only scene representation in a real-time SLAM system for a handheld RGB-D camera. Our network is trained in live operation without prior data, building a dense, scene-specific implicit 3D model of occupancy and colour which is also immediately used for tracking. Achieving real-time SLAM via continual training of a neural network against a live image stream requires significant innovation. Our iMAP algorithm uses a keyframe structure and multi-processing computation flow, with dynamic information-guided pixel sampling for speed, with tracking at 10 Hz and global map updating at 2 Hz. The advantages of an implicit MLP over standard dense SLAM techniques include efficient geometry representation with automatic detail control and smooth, plausible filling-in of unobserved regions such as the back surfaces of objects.


title: An Interpretable Mapping from a Communication System to a Neural Network for Optimal Transceiver-Joint Equalization

abstract: In this paper, we propose a scheme that utilizes the optimization ability of artificial intelligence (AI) for optimal transceiver-joint equalization in compensating for the optical filtering impairments caused by wavelength selective switches (WSS). In contrast to adding or replacing a certain module of existing digital signal processing (DSP), we exploit the similarity between a communication system and a neural network (NN). By mapping a communication system to an NN, in which the equalization modules correspond to the convolutional layers and other modules can been regarded as static layers, the optimal transceiver-joint equalization coefficients can be obtained. In particular, the DSP structure of the communication system is not changed. Extensive numerical simulations are performed to validate the performance of the proposed method. For a 65 GBaud 16QAM signal, it can achieve a 0.76 dB gain when the number of WSSs is 16 with a -6 dB bandwidth of 73 GHz.


title: The evaporating primordial black hole fraction in cool-core galaxy clusters

abstract: Recent studies of gamma-ray, cosmic-ray and radio data put stringent constraints on the fraction of primordial black holes (PBHs) in our universe. In this article, we propose a new indirect method in using the X-ray luminosity data of cool-core clusters to constrain the evaporating PBH fraction for the monochromatic, log-normal and power-law mass distributions. The present results show that the amount of evaporating PBHs only constitutes a minor component of dark matter for a large parameter space. The constraints are consistent with and close to that obtained from other cosmic-ray and multi-wavelength observations.


title: Separations between Combinatorial Measures for Transitive Functions

abstract: The role of symmetry in Boolean functions $f:\{0,1\}^n \to \{0,1\}$ has been extensively studied in complexity theory. For example, symmetric functions, that is, functions that are invariant under the action of $S_n$, is an important class of functions in the study of Boolean functions. A function $f:\{0,1\}^n \to \{0,1\}$ is called transitive (or weakly-symmetric) if there exists a transitive group $G$ of $S_n$ such that $f$ is invariant under the action of $G$ - that is the function value remains unchanged even after the bits of the input of $f$ are moved around according to some permutation $\sigma \in G$. Understanding various complexity measures of transitive functions has been a rich area of research for the past few decades. In this work, we study transitive functions in light of several combinatorial measures. We look at the maximum separation between various pairs of measures for transitive functions. Such study for general Boolean functions has been going on for past many years. The best-known results for general Boolean functions have been nicely compiled by Aaronson et. al (STOC, 2021). The separation between a pair of combinatorial measures is shown by constructing interesting functions that demonstrate the separation. But many of the celebrated separation results are via the construction of functions (like "pointer functions" from Ambainis et al. (JACM, 2017) and "cheat-sheet functions" Aaronson et al. (STOC, 2016)) that are not transitive. Hence, we don't have such separation between the pairs of measures for transitive functions. In this paper we show how to modify some of these functions to construct transitive functions that demonstrate similar separations between pairs of combinatorial measures.


title: Dark-bright excitons mixing in alloyed InGaAs self-assembled quantum dots

abstract: Quantum dots are arguably one of the best platforms for optically accessible spin based qubits. The paramount demand of extended qubit storage time can be met by using quantum-dot-confined dark exciton: a longlived electron-hole pair with parallel spins. Despite its name the dark exciton reveals weak luminescence that can be directly measured. The origins of this optical activity remain largely unexplored. In this work, using the atomistic tight-binding method combined with configuration-interaction approach, we demonstrate that atomic-scale randomness strongly affects oscillator strength of dark excitons confined in self-assembled cylindrical InGaAs quantum dots with no need for faceting or shape-elongation. We show that this process is mediated by two mechanisms: mixing dark and bright configurations by exchange interaction, and equally important appearance of non-vanishing optical transition matrix elements that otherwise correspond to nominally forbidden transitions in a non-alloyed case. The alloy randomness has essential impact on both bright and dark exciton states, including their energy, emission intensity, and polarization angle. We conclude that, due to the atomic-scale alloy randomness, finding dots with desired dark exciton properties may require exploration of a large ensemble, similarly to how dots with low bright exciton splitting are selected for entanglement generation.


title: Unleashing the Hidden Power of Compiler Optimization on Binary Code Difference: An Empirical Study

abstract: Since compiler optimization is the most common source contributing to binary code differences in syntax, testing the resilience against the changes caused by different compiler optimization settings has become a standard evaluation step for most binary diffing approaches. For example, 47 top-venue papers in the last 12 years compared different program versions compiled by default optimization levels (e.g., -Ox in GCC and LLVM). Although many of them claim they are immune to compiler transformations, it is yet unclear about their resistance to non-default optimization settings. Especially, we have observed that adversaries explored non-default compiler settings to amplify malware differences. This paper takes the first step to systematically studying the effectiveness of compiler optimization on binary code differences. We tailor search-based iterative compilation for the auto-tuning of binary code differences. We develop BinTuner to search near-optimal optimization sequences that can maximize the amount of binary code differences. We run BinTuner with GCC 10.2 and LLVM 11.0 on SPEC benchmarks (CPU2006 & CPU2017), Coreutils, and OpenSSL. Our experiments show that at the cost of 279 to 1,881 compilation iterations, BinTuner can find custom optimization sequences that are substantially better than the general -Ox settings. BinTuner's outputs seriously undermine prominent binary diffing tools' comparisons. In addition, the detection rate of the IoT malware variants tuned by BinTuner falls by more than 50%. Our findings paint a cautionary tale for security analysts that attackers have a new way to mutate malware code cost-effectively, and the research community needs to step back to reassess optimization-resistance evaluations.


title: 4D Gauss-Bonnet gravity: cosmological constraints, $H_0$ tension and large scale structure

abstract: We perform correct and reasonable cosmological constraints on the newly proposed 4D Gauss-Bonnet gravity. Using the joint constraint from cosmic microwave background, baryon acoustic oscillations, Type Ia supernovae, cosmic chronometers and redshift space distortions, we obtain, so far, the strongest constraint $\tilde{\alpha}=(1.2\pm5.2)\times 10^{-17}$, namely $\alpha=(2.69\pm11.67)\times10^{48}$ eV$^{-2}$, among various observational limitations from different information channels, which is tighter than previous bound from the speed of gravitational wave by at least one order of magnitude. We find that our bound is well supported by the observations of temperature and lensing potential power spectra of cosmic microwave background from the Planck-2018 final release. Very interestingly, the large $H_0$ tension between the local measurement from the Hubble Space Telescope and global derivation from the Planck-2018 final data under the assumption of $\Lambda$CDM can be greatly resolved from $4.4\sigma$ to $1.94\sigma$ level in the 4D Gauss-Bonnet gravity. In theory, we find that this model can partly relieve the coincidence problem and the rescaling Gauss-Bonnet term, which needs the help of the cosmological constant to explain current cosmic acceleration, is unable to serve as dark energy alone.


title: Generalization of spectral bulk-boundary correspondence

abstract: The bulk-boundary correspondence in one dimension asserts that the physical quantities defined in the bulk and at the edge are connected, as well established in the argument for electric polarization. Recently, a spectral bulk-boundary correspondence (SBBC), an extended version of the conventional bulk-boundary correspondence to energy-dependent spectral functions, such as Green's functions, has been proposed in chiral symmetric systems, in which the chiral operator anticommutes with the Hamiltonian. In this study, we extend the SBBC to a system with impurity scattering and dynamical self-energies, regardless of the presence or absence of a gap in the energy spectrum. Moreover, the SBBC is observed to hold even in a system without chiral symmetry, which substantially generalizes its concept. The SBBC is demonstrated with concrete models, such as superconducting nanowires and a Su-Schrieffer-Heeger model. Its potential applications and certain remaining issues are also discussed.


title: Discovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformer

abstract: Efficient discovery of a speaker's emotional states in a multi-party conversation is significant to design human-like conversational agents. During a conversation, the cognitive state of a speaker often alters due to certain past utterances, which may lead to a flip in their emotional state. Therefore, discovering the reasons (triggers) behind the speaker's emotion-flip during a conversation is essential to explain the emotion labels of individual utterances. In this paper, along with addressing the task of emotion recognition in conversations (ERC), we introduce a novel task - Emotion-Flip Reasoning (EFR), that aims to identify past utterances which have triggered one's emotional state to flip at a certain time. We propose a masked memory network to address the former and a Transformer-based network for the latter task. To this end, we consider MELD, a benchmark emotion recognition dataset in multi-party conversations for the task of ERC, and augment it with new ground-truth labels for EFR. An extensive comparison with five state-of-the-art models suggests improved performances of our models for both tasks. We further present anecdotal evidence and both qualitative and quantitative error analyses to support the superiority of our models compared to the baselines.


title: On two mod p period maps: Ekedahl--Oort and fine Deligne--Lusztig stratifications

abstract: Consider a Shimura variety of Hodge type admitting a smooth integral model S at an odd prime p>3. Consider its perfectoid cover S(p^\infty) and the Hodge-Tate period map introduced by A. Caraiani and P. Scholze. We compare the pull-back to S(p^\infty) of the Ekedahl-Oort stratification on the mod p special fiber of S and the pull back to S(p^\infty) of the fine Deligne-Lusztig stratification on the mod p special fiber of the flag variety which is the target of the Hodge-Tate period map. An application to the non-emptiness of Ekedhal-Oort strata is provided.


title: A Sub-Layered Hierarchical Pyramidal Neural Architecture for Facial Expression Recognition

abstract: In domains where computational resources and labeled data are limited, such as in robotics, deep networks with millions of weights might not be the optimal solution. In this paper, we introduce a connectivity scheme for pyramidal architectures to increase their capacity for learning features. Experiments on facial expression recognition of unseen people demonstrate that our approach is a potential candidate for applications with restricted resources, due to good generalization performance and low computational cost. We show that our approach generalizes as well as convolutional architectures in this task but uses fewer trainable parameters and is more robust for low-resolution faces.


title: A Hecke algebra isomorphism over close local fields

abstract: Let $G$ be a split connected reductive group over $\mathbb{Z}$. Let $F$ be a non-archimedean local field. With $K_m: = Ker(G(\mathfrak{O}_F) \rightarrow G(\mathfrak{O}_F/\mathfrak{p}_F^m))$, Kazhdan proved that for a field $F'$sufficiently close local field to $F$, the Hecke algebras $\mathcal{H}(G(F),K_m)$ and $\mathcal{H}(G(F'),K_m')$ are isomorphic, where $K_m'$ denotes the corresponding object over $F'$. In this article, we generalize this result to general connected reductive groups.


title: Reentrance of the Disordered Phase in the Antiferromagnetic Ising Model on a Square Lattice with Longitudinal and Transverse Magnetic Fields

abstract: Motivated by recent experiments with Rydberg atoms in an optical tweezer array, we accurately map out the ground-state phase diagram of the antiferromagnetic Ising model on a square lattice with longitudinal and transverse magnetic fields using the quantum Monte Carlo method. For a small but nonzero transverse field, the transition longitudinal field is found to remain nearly constant. By scrutinizing the phase diagram, we uncover a narrow region where the system exhibits reentrant transitions between the disordered and antiferromagnetic phases with increasing transverse field. Our phase diagram provides a useful benchmark for quantum simulation of a Rydberg atom system.


title: Risk Analysis and Policy Enforcement of Function Interactions in Robot Apps

abstract: Robot apps are becoming more automated, complex and diverse. An app usually consists of many functions, interacting with each other and the environment. This allows robots to conduct various tasks. However, it also opens a new door for cyber attacks: adversaries can leverage these interactions to threaten the safety of robot operations. Unfortunately, this issue is rarely explored in past works. We present the first systematic investigation about the function interactions in common robot apps. First, we disclose the potential risks and damages caused by malicious interactions. We introduce a comprehensive graph to model the function interactions in robot apps by analyzing 3,100 packages from the Robot Operating System (ROS) platform. From this graph, we identify and categorize three types of interaction risks. Second, we propose RTron, a novel system to detect and mitigate these risks and protect the operations of robot apps. We introduce security policies for each type of risks, and design coordination nodes to enforce the policies and regulate the interactions. We conduct extensive experiments on 110 robot apps from the ROS platform and two complex apps (Baidu Apollo and Autoware) widely adopted in industry. Evaluation results indicated RTron can correctly identify and mitigate all potential risks with negligible performance cost. To validate the practicality of the risks and solutions, we implement and evaluate RTron on a physical UGV (Turtlebot) with real-word apps and environments.


title: Group-aware Label Transfer for Domain Adaptive Person Re-identification

abstract: Unsupervised Domain Adaptive (UDA) person re-identification (ReID) aims at adapting the model trained on a labeled source-domain dataset to a target-domain dataset without any further annotations. Most successful UDA-ReID approaches combine clustering-based pseudo-label prediction with representation learning and perform the two steps in an alternating fashion. However, offline interaction between these two steps may allow noisy pseudo labels to substantially hinder the capability of the model. In this paper, we propose a Group-aware Label Transfer (GLT) algorithm, which enables the online interaction and mutual promotion of pseudo-label prediction and representation learning. Specifically, a label transfer algorithm simultaneously uses pseudo labels to train the data while refining the pseudo labels as an online clustering algorithm. It treats the online label refinery problem as an optimal transport problem, which explores the minimum cost for assigning M samples to N pseudo labels. More importantly, we introduce a group-aware strategy to assign implicit attribute group IDs to samples. The combination of the online label refining algorithm and the group-aware strategy can better correct the noisy pseudo label in an online fashion and narrow down the search space of the target identity. The effectiveness of the proposed GLT is demonstrated by the experimental results (Rank-1 accuracy) for Market1501$\to$DukeMTMC (82.0\%) and DukeMTMC$\to$Market1501 (92.2\%), remarkably closing the gap between unsupervised and supervised performance on person re-identification.


title: Ultrafast element-resolved magneto-optics using a fiber-laser-driven extreme ultraviolet light source

abstract: We present a novel setup to measure the transverse magneto-optical Kerr effect in the extreme ultraviolet spectral range at exceptionally high repetition rates based on a fiber laser amplifier system. This affords a very high and stable flux of extreme ultraviolet light, which we use to measure element-resolved demagnetization dynamics with unprecedented depth of information. Furthermore, the setup is equipped with a strong electromagnet and a cryostat, allowing measurements between 10 and 420 K using magnetic fields up to 0.86 T. The performance of our setup is demonstrated by a set of temperature- and time-dependent magnetization measurements showing distinct element-dependent behavior.


title: A New Approach To Text Rating Classification Using Sentiment Analysis

abstract: Typical use cases of sentiment analysis usually revolve around assessing the probability of a text belonging to a certain sentiment and deriving insight concerning it; little work has been done to explore further use cases derived using those probabilities in the context of rating. In this paper, we redefine the sentiment proportion values as building blocks for a triangle structure, allowing us to derive variables for a new formula for classifying text given in the form of product reviews into a group of higher and a group of lower ratings and prove a dependence exists between the sentiments and the ratings.


title: ReCU: Reviving the Dead Weights in Binary Neural Networks

abstract: Binary neural networks (BNNs) have received increasing attention due to their superior reductions of computation and memory. Most existing works focus on either lessening the quantization error by minimizing the gap between the full-precision weights and their binarization or designing a gradient approximation to mitigate the gradient mismatch, while leaving the "dead weights" untouched. This leads to slow convergence when training BNNs. In this paper, for the first time, we explore the influence of "dead weights" which refer to a group of weights that are barely updated during the training of BNNs, and then introduce rectified clamp unit (ReCU) to revive the "dead weights" for updating. We prove that reviving the "dead weights" by ReCU can result in a smaller quantization error. Besides, we also take into account the information entropy of the weights, and then mathematically analyze why the weight standardization can benefit BNNs. We demonstrate the inherent contradiction between minimizing the quantization error and maximizing the information entropy, and then propose an adaptive exponential scheduler to identify the range of the "dead weights". By considering the "dead weights", our method offers not only faster BNN training, but also state-of-the-art performance on CIFAR-10 and ImageNet, compared with recent methods. Code can be available at https://github.com/z-hXu/ReCU.


title: Multi-Robot Task Allocation -- Complexity and Approximation

abstract: Multi-robot task allocation is one of the most fundamental classes of problems in robotics and is crucial for various real-world robotic applications such as search, rescue and area exploration. We consider the Single-Task robots and Multi-Robot tasks Instantaneous Assignment (ST-MR-IA) setting where each task requires at least a certain number of robots and each robot can work on at most one task and incurs an operational cost for each task. Our aim is to consider a natural computational problem of allocating robots to complete the maximum number of tasks subject to budget constraints. We consider budget constraints of three different kinds: (1) total budget, (2) task budget, and (3) robot budget. We provide a detailed complexity analysis including results on approximations as well as polynomial-time algorithms for the general setting and important restricted settings.


title: Unsupervised domain adaptation via coarse-to-fine feature alignment method using contrastive learning

abstract: Previous feature alignment methods in Unsupervised domain adaptation(UDA) mostly only align global features without considering the mismatch between class-wise features. In this work, we propose a new coarse-to-fine feature alignment method using contrastive learning called CFContra. It draws class-wise features closer than coarse feature alignment or class-wise feature alignment only, therefore improves the model's performance to a great extent. We build it upon one of the most effective methods of UDA called entropy minimization to further improve performance. In particular, to prevent excessive memory occupation when applying contrastive loss in semantic segmentation, we devise a new way to build and update the memory bank. In this way, we make the algorithm more efficient and viable with limited memory. Extensive experiments show the effectiveness of our method and model trained on the GTA5 to Cityscapes dataset has boost mIOU by 3.5 compared to the MinEnt algorithm. Our code will be publicly available.


title: Distributed coordinated path following using guiding vector fields

abstract: It is essential in many applications to impose a scalable coordinated motion control on a large group of mobile robots, which is efficient in tasks requiring repetitive execution, such as environmental monitoring. In this paper, we design a guiding vector field to guide multiple robots to follow possibly different desired paths while coordinating their motions. The vector field uses a path parameter as a virtual coordinate that is communicated among neighboring robots. Then, the virtual coordinate is utilized to control the relative parametric displacement between robots along the paths. This enables us to design a saturated control algorithm for a Dubins-car-like model. The algorithm is distributed, scalable, and applicable for any smooth paths in an $n$-dimensional configuration space, and global convergence is guaranteed. Simulations with up to fifty robots and outdoor experiments with fixed-wing aircraft validate the theoretical results.


title: Improving the Precision of Optical Metrology by Detecting Fewer Photons

abstract: In optical metrological protocols to measure physical quantities, it is, in principle, always beneficial to increase photon number to improve measurement precision. However, practical constraints prevent arbitrary increase of n due to the imperfections of a practical detector, especially when the detector response is dominated by saturation effect. In this work, we show that a modified weak measurement protocol, namely, biased weak measurement significantly improves the precision of optical metrology in the presence of saturation effect. This method detects an ultra-small fraction of photons while maintains considerable amount of metrological information. The biased pre-coupling leads to an additional reduction of photons in the post-selection and generates an extinction point in the spectrum distribution, which is extremely sensitive to the estimated parameter and difficult to be saturated. Therefore, the Fisher information can be persistently enhanced by increasing the photon number. In our magnetic-sensing experiment, biased weak measurement achieves precision approximately one order of magnitude better than those of previously used methods. The proposed method can be applied in various optical measurement schemes to circumvent detector saturation effect with low-cost apparatuses.


title: What Do We Get from Two-Way Fixed Effects Regressions? Implications from Numerical Equivalence

abstract: In any multiperiod panel, a two-way fixed effects (TWFE) regression is numerically equivalent to a first-difference (FD) regression that pools all possible between-period gaps. Building on this observation, this paper develops numerical and causal interpretations of the TWFE coefficient. At the sample level, the TWFE coefficient is a weighted average of FD coefficients with different between-period gaps. This decomposition is useful for assessing the source of identifying variation for the TWFE coefficient. At the population level, a causal interpretation of the TWFE coefficient requires a common trends assumption for any between-period gap, and the assumption has to be conditional on changes in time-varying covariates. I propose a natural generalization of the TWFE estimator that can relax these requirements.


title: Safety-Critical Control using Optimal-decay Control Barrier Function with Guaranteed Point-wise Feasibility

abstract: Safety is one of the fundamental problems in robotics. Recently, a quadratic program-based control barrier function (CBF) method has emerged as a way to enforce safety-critical constraints. Together with control Lyapunov function (CLF), it forms a safety-critical control strategy, named CLF-CBF-QP, which can mediate between achieving the control objective and ensuring safety, while being executable in real-time. However, once additional constraints such as input constraints are introduced, the CLF-CBF-QP may encounter infeasibility. In order to address the challenge that arises due to the infeasibility, we propose an optimal-decay form for safety-critical control wherein the decay rate of the CBF is optimized point-wise in time so as to guarantee point-wise feasibility when the state lies inside the safe set. The proposed control design is numerically validated using an adaptive cruise control example.


title: Generalizing Face Forgery Detection with High-frequency Features

abstract: Current face forgery detection methods achieve high accuracy under the within-database scenario where training and testing forgeries are synthesized by the same algorithm. However, few of them gain satisfying performance under the cross-database scenario where training and testing forgeries are synthesized by different algorithms. In this paper, we find that current CNN-based detectors tend to overfit to method-specific color textures and thus fail to generalize. Observing that image noises remove color textures and expose discrepancies between authentic and tampered regions, we propose to utilize the high-frequency noises for face forgery detection. We carefully devise three functional modules to take full advantage of the high-frequency features. The first is the multi-scale high-frequency feature extraction module that extracts high-frequency noises at multiple scales and composes a novel modality. The second is the residual-guided spatial attention module that guides the low-level RGB feature extractor to concentrate more on forgery traces from a new perspective. The last is the cross-modality attention module that leverages the correlation between the two complementary modalities to promote feature learning for each other. Comprehensive evaluations on several benchmark databases corroborate the superior generalization performance of our proposed method.