title: Trust-aware Control for Intelligent Transportation Systems

abstract: Many intelligent transportation systems are multi-agent systems, i.e., both the traffic participants and the subsystems within the transportation infrastructure can be modeled as interacting agents. The use of AI-based methods to achieve coordination among the different agents systems can provide greater safety over transportation systems containing only human-operated vehicles, and also improve the system efficiency in terms of traffic throughput, sensing range, and enabling collaborative tasks. However, increased autonomy makes the transportation infrastructure vulnerable to compromised vehicular agents or infrastructure. This paper proposes a new framework by embedding the trust authority into transportation infrastructure to systematically quantify the trustworthiness of agents using an epistemic logic known as subjective logic. In this paper, we make the following novel contributions: (i) We propose a framework for using the quantified trustworthiness of agents to enable trust-aware coordination and control. (ii) We demonstrate how to synthesize trust-aware controllers using an approach based on reinforcement learning. (iii) We comprehensively analyze an autonomous intersection management (AIM) case study and develop a trust-aware version called AIM-Trust that leads to lower accident rates in scenarios consisting of a mixture of trusted and untrusted agents.


title: Supersymmetric vortex loops in 3D gauge theories

abstract: We give a precise definition of BPS vortex loops in 3D non-abelian gauge theories with ${\cal N}=2$ SUSY by the path integral over fields with a prescribed singular behavior. We compute the expectation value of a BPS vortex loop on an ellipsoid. Using the result we revisit the known equivalence between Wilson and vortex loops in pure Chern-Simons theory. Naive computations of expectation values in ${\cal N}=2$ theory leads to an unwanted shift of parameters in the rule of correspondence. We resolve the problem by relating the shift to the global anomaly of ${\cal N}=2$ SUSY quantum mechanics. For theories with $U(N)$ gauge group we also develop an alternative description of vortex loops in terms of 1D ${\cal N}=2$ SUSY quantum mechanics on their worldline. For vortex loops in ${\cal N}=4$ theories, our construction reproduces some of the quiver GLSMs of Assel and Gomis.


title: New Measurements of the Beam-Normal Single Spin Asymmetry in Elastic Electron Scattering Over a Range of Spin-0 Nuclei

abstract: We report precision determinations of the beam normal single spin asymmetries ($A_n$) in the elastic scattering of 0.95 and 2.18~GeV electrons off $^{12}$C, $^{40}$Ca, $^{48}$Ca, and $^{208}$Pb at very forward angles where the most detailed theoretical calculations have been performed. The first measurements of $A_n$ for $^{40}$Ca and $^{48}$Ca are found to be similar to that of $^{12}$C, consistent with expectations thus demonstrating the validity of theoretical calculations for nuclei with Z~$\leq20$. We also report $A_n$ for $^{208}$Pb at two new momentum transfers (Q$^2$) extending the previous measurement. Our new data confirm the surprising result previously reported, with all three data points showing significant disagreement with the results from the $Z\leq 20$ nuclei. These data confirm our basic understanding of the underlying dynamics that govern $A_n$ for nuclei containing $\lesssim 50$ nucleons, but point to the need for further investigation to understand the unusual $A_n$ behaviour discovered for scattering off $^{208}$Pb.


title: Quantitative almost reducibility and M\"obius disjointness for analytic quasiperiodic Schrodinger cocycles

abstract: Sarnak's M\"obius disjointness conjecture states that M\"obius function is disjoint to any zero entropy dynamics. We prove that M\"obius disjointness conjecture holds for one-frequency analytic quasi-periodic cocycles which are almost reducible, which extend \cite{LS15,W17} to the noncommutative case. The proof relies on quantitative version of almost reducibility.


title: Spacelike surfaces in Minkowski 4-space with a canonical normal null direction

abstract: A canonical normal null direction on a spacelike surface in the four dimensional Minkowski space $\mathbb{R}^{3,1}$ is a parallel vector field $Z$ on $\mathbb{R}^{3,1}$ such that the normal component of $Z$ on the surface is a lightlike vector field. We describe the geometric properties of a spacelike surface endowed with a canonical normal null direction and we obtain some characterizations of these surfaces. Moreover, using their Gauss map we study other properties of these surface: the associated ellipse of curvature and their asymptotic directions. Finally, we give two different ways to create these surfaces, one of them involves a nonlinear partial differential equation.


title: A Novel Data Pre-processing Technique: Making Data Mining Robust to Different Units and Scales of Measurement

abstract: Many existing data mining algorithms use feature values directly in their model, making them sensitive to units/scales used to measure/represent data. Pre-processing of data based on rank transformation has been suggested as a potential solution to overcome this issue. However, the resulting data after pre-processing with rank transformation is uniformly distributed, which may not be very useful in many data mining applications. In this paper, we present a better and effective alternative based on ranks over multiple sub-samples of data. We call the proposed pre-processing technique as ARES | Average Rank over an Ensemble of Sub-samples. Our empirical results of widely used data mining algorithms for classification and anomaly detection in a wide range of data sets suggest that ARES results in more consistent task specific? outcome across various algorithms and data sets. In addition to this, it results in better or competitive outcome most of the time compared to the most widely used min-max normalisation and the traditional rank transformation.


title: Alternating Automatic Register Machines

abstract: This paper introduces and studies a new model of computation called an Alternating Automatic Register Machine (AARM). An AARM possesses the basic features of a conventional register machine and an alternating Turing machine, but can carry out computations using bounded automatic relations in a single step. One finding is that an AARM can recognise some NP-complete problems, including SAT (using a particular coding), in $\log^* n + O(1)$ steps. On the other hand, if all problems in P can be solved by an AARM in $O(\log^*n)$ rounds, then $\text{P} \subset \text{PSPACE}$. Furthermore, we study an even more computationally powerful machine, called a Polynomial-Size Padded Alternating Automatic Register Machine (PAARM), which allows the input to be padded with a polynomial-size string. It is shown that the polynomial hierarchy can be characterised as the languages that are recognised by a PAARM in $\log^*n + O(1)$ steps. These results illustrate the power of alternation when combined with computations involving automatic relations, and uncover a finer gradation between known complexity classes.


title: Sequence Reconstruction Problem for Deletion Channels: A Complete Asymptotic Solution

abstract: Transmit a codeword $x$, that belongs to an $(\ell-1)$-deletion-correcting code of length $n$, over a $t$-deletion channel for some $1\le \ell\le t<n$. Levenshtein, in 2001, proposed the problem of determining $N(n,\ell,t)+1$, the minimum number of distinct channel outputs required to uniquely reconstruct $x$. Prior to this work, $N(n,\ell,t)$ is known only when $\ell\in\{1,2\}$. Here, we provide an asymptotically exact solution for all values of $\ell$ and $t$. Specifically, we show that $N(n,\ell,t)=\binom{2\ell}{\ell}/(t-\ell)! n^{t-\ell} - O(n^{t-\ell-1})$ and in the special instance where $\ell=t$, we show that $N(n,\ell,\ell)=\binom{2\ell}{\ell}$. We also provide a conjecture on the exact value of $N(n,\ell,t)$ for all values of $n$, $\ell$, and $t$.


title: Identifying Circumgalactic Medium Absorption in QSO Spectra: A Bayesian Approach

abstract: We present a study of candidate galaxy-absorber pairs for 43 low redshift QSO sightlines ($0.06 < z < 0.85$) observed with the {\it Hubble Space Telescope}/Cosmic Origins Spectrograph that lie within the footprint of the Sloan Digital Sky Survey with a statistical approach to match absorbers with galaxies near the QSO lines of sight using only the SDSS Data Release 12 photometric data for the galaxies, including estimates of their redshifts. Our Bayesian methods combine the SDSS photometric information with measured properties of the circumgalactic medium to find the most probable galaxy match, if any, for each absorber in the line of sight QSO spectrum. We find $\sim$630 candidate galaxy-absorber pairs using two different statistics. The methods are able to reproduce pairs reported in the targeted spectroscopic studies upon which we base the statistics at a rate of 72\%. The properties of the galaxies comprising the candidate pairs have median redshift, luminosity, and stellar mass, all estimated from the photometric data, $z=0.13$, $L=0.1L^*$, and $\log(M_*/M_{Sun}) = 9.7$. The median impact parameter of the candidate pairs is $\sim$430~kpc, or $\sim 3.5$ times the galaxy virial radius. The results are broadly consistent with the high \lya\ covering fraction out to this radius found in previous studies. This method of matching absorbers and galaxies can be used to prioritize targets for spectroscopic studies, and we present specific examples of promising systems for such follow-up.


title: Transverse mode-encoded quantum gate on a silicon photonic chip

abstract: As an important degree of freedom (DoF) in integrated photonic circuits, the orthogonal transverse mode provides a promising and flexible way to increasing communication capability, for both classical and quantum information processing. To construct large-scale on-chip multimode multi-DoF quantum systems, a transverse mode-encoded controlled-NOT (CNOT) gate is necessary. Here, through design and integrate transverse mode-dependent directional coupler and attenuators on a silicon photonic chip, we demonstrate the first multimode implementation of a two-qubit quantum gate. With the aid of state preparation and analysis parts, we show the ability of the gate to entangle two separated transverse mode qubits with an average fidelity of $0.89\pm0.02$ and the achievement of 10 standard deviations of violations in the quantum nonlocality verification. In addition, a fidelity of $0.82\pm0.01$ was obtained from quantum process tomography used to completely characterize the CNOT gate. Our work paves the way for universal transverse mode-encoded quantum operations and large-scale multimode multi-DoF quantum systems.


title: Adelic double cosets over semi-global fields

abstract: Double coset spaces of adelic points on linear algebraic groups arise in the study of global fields; e.g., concerning local-global principles and torsors. A different type of double coset space plays a role in the study of semi-global fields such as p-adic function fields. This paper relates the two, by establishing adelic double coset spaces over semi-global fields; relating them to local-global principles and torsors; and providing explicit examples.


title: OpenMP aware MHP Analysis for Improved Static Data-Race Detection

abstract: Data races, a major source of bugs in concurrent programs, can result in loss of manpower and time as well as data loss due to system failures. OpenMP, the de facto shared memory parallelism framework used in the HPC community, also suffers from data races. To detect race conditions in OpenMP programs and improve turnaround time and/or developer productivity, we present a data flow analysis based, fast, static data race checker in the LLVM compiler framework. Our tool can detect races in the presence or absence of explicit barriers, with implicit or explicit synchronization. In addition, our tool effectively works for the OpenMP target offloading constructs and also supports the frequently used OpenMP constructs. We formalize and provide a data flow analysis framework to perform Phase Interval Analysis (PIA) of OpenMP programs. Phase intervals are then used to compute the MHP (and its complement NHP) sets for the programs, which, in turn, are used to detect data races statically. We evaluate our work using multiple OpenMP race detection benchmarks and real world applications. Our experiments show that the checker is comparable to the state-of-the-art in various performance metrics with around 90% accuracy, almost perfect recall, and significantly lower runtime and memory footprint.


title: Personalized Benchmarking with the Ludwig Benchmarking Toolkit

abstract: The rapid proliferation of machine learning models across domains and deployment settings has given rise to various communities (e.g. industry practitioners) which seek to benchmark models across tasks and objectives of personal value. Unfortunately, these users cannot use standard benchmark results to perform such value-driven comparisons as traditional benchmarks evaluate models on a single objective (e.g. average accuracy) and fail to facilitate a standardized training framework that controls for confounding variables (e.g. computational budget), making fair comparisons difficult. To address these challenges, we introduce the open-source Ludwig Benchmarking Toolkit (LBT), a personalized benchmarking toolkit for running end-to-end benchmark studies (from hyperparameter optimization to evaluation) across an easily extensible set of tasks, deep learning models, datasets and evaluation metrics. LBT provides a configurable interface for controlling training and customizing evaluation, a standardized training framework for eliminating confounding variables, and support for multi-objective evaluation. We demonstrate how LBT can be used to create personalized benchmark studies with a large-scale comparative analysis for text classification across 7 models and 9 datasets. We explore the trade-offs between inference latency and performance, relationships between dataset attributes and performance, and the effects of pretraining on convergence and robustness, showing how LBT can be used to satisfy various benchmarking objectives.


title: JaMIE: A Pipeline Japanese Medical Information Extraction System

abstract: We present an open-access natural language processing toolkit for Japanese medical information extraction. We first propose a novel relation annotation schema for investigating the medical and temporal relations between medical entities in Japanese medical reports. We experiment with the practical annotation scenarios by separately annotating two different types of reports. We design a pipeline system with three components for recognizing medical entities, classifying entity modalities, and extracting relations. The empirical results show accurate analyzing performance and suggest the satisfactory annotation quality, the effective annotation strategy for targeting report types, and the superiority of the latest contextual embedding models.


title: Vertex and Mixed $k$-Diameter Component Connectivity

abstract: n the $k$-diameter component connectivity model a network is consider operational if there is a component with diameter at least $k$. Therefore, a network is in a failure state if every component has diameter less than $k$. In this paper we find the vertex variant of the $k$-diameter component connectivity parameter, which is the minimum number of vertex deletions in order to put a network into a failure state, for particular classes of graphs. We also show the mixed variant by allowing vertex and edge failures within the network. We show results for paths, cycles, complete, and complete bipartite graphs for both variants as well as perfect $r$-ary trees for the vertex variant.


title: Federated Learning Based on Dynamic Regularization

abstract: We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem primarily from a communication perspective and allow more device level computations to save transmission costs. We point out a fundamental dilemma, in that the minima of the local-device level empirical loss are inconsistent with those of the global empirical loss. Different from recent prior works, that either attempt inexact minimization or utilize devices for parallelizing gradient computation, we propose a dynamic regularizer for each device at each round, so that in the limit the global and device solutions are aligned. We demonstrate both through empirical results on real and synthetic data as well as analytical results that our scheme leads to efficient training, in both convex and non-convex settings, while being fully agnostic to device heterogeneity and robust to large number of devices, partial participation and unbalanced data.


title: Cross-Modal Object Tracking: Modality-Aware Representations and A Unified Benchmark

abstract: In many visual systems, visual tracking often bases on RGB image sequences, in which some targets are invalid in low-light conditions, and tracking performance is thus affected significantly. Introducing other modalities such as depth and infrared data is an effective way to handle imaging limitations of individual sources, but multi-modal imaging platforms usually require elaborate designs and cannot be applied in many real-world applications at present. Near-infrared (NIR) imaging becomes an essential part of many surveillance cameras, whose imaging is switchable between RGB and NIR based on the light intensity. These two modalities are heterogeneous with very different visual properties and thus bring big challenges for visual tracking. However, existing works have not studied this challenging problem. In this work, we address the cross-modal object tracking problem and contribute a new video dataset, including 654 cross-modal image sequences with over 481K frames in total, and the average video length is more than 735 frames. To promote the research and development of cross-modal object tracking, we propose a new algorithm, which learns the modality-aware target representation to mitigate the appearance gap between RGB and NIR modalities in the tracking process. It is plug-and-play and could thus be flexibly embedded into different tracking frameworks. Extensive experiments on the dataset are conducted, and we demonstrate the effectiveness of the proposed algorithm in two representative tracking frameworks against 17 state-of-the-art tracking methods. We will release the dataset for free academic usage, dataset download link and code will be released soon.


title: Adaptive area-preserving parameterization of open and closed anatomical surfaces

abstract: The parameterization of open and closed anatomical surfaces is of fundamental importance in many biomedical applications. Spherical harmonics, a set of basis functions defined on the unit sphere, are widely used for anatomical shape description. However, establishing a one-to-one correspondence between the object surface and the entire unit sphere may induce a large geometric distortion in case the shape of the surface is too different from a perfect sphere. In this work, we propose adaptive area-preserving parameterization methods for simply-connected open and closed surfaces with the target of the parameterization being a spherical cap. Our methods optimize the shape of the parameter domain along with the mapping from the object surface to the parameter domain. The object surface will be globally mapped to an optimal spherical cap region of the unit sphere in an area-preserving manner while also exhibiting low conformal distortion. We further develop a set of spherical harmonics-like basis functions defined over the adaptive spherical cap domain, which we call the adaptive harmonics. Experimental results show that the proposed parameterization methods outperform the existing methods for both open and closed anatomical surfaces in terms of area and angle distortion. Surface description of the object surfaces can be effectively achieved using a novel combination of the adaptive parameterization and the adaptive harmonics. Our work provides a novel way of mapping anatomical surfaces with improved accuracy and greater flexibility. More broadly, the idea of using an adaptive parameter domain allows easy handling of a wide range of biomedical shapes.


title: Generative Dynamic Patch Attack

abstract: Adversarial patch attack is a family of attack algorithms that perturb a part of image to fool a deep neural network model. Existing patch attacks mostly consider injecting adversarial patches at input-agnostic locations: either a predefined location or a random location. This attack setup may be sufficient for attack but has considerable limitations when using it for adversarial training. Thus, robust models trained with existing patch attacks cannot effectively defend other adversarial attacks. In this paper, we first propose an end-to-end patch attack algorithm, Generative Dynamic Patch Attack (GDPA), which generates both patch pattern and patch location adversarially for each input image. We show that GDPA is a generic attack framework that can produce dynamic/static and visible/invisible patches with a few configuration changes. Secondly, GDPA can be readily integrated for adversarial training to improve model robustness to various adversarial attacks. Extensive experiments on VGGFace, Traffic Sign and ImageNet show that GDPA achieves higher attack success rates than state-of-the-art patch attacks, while adversarially trained model with GDPA demonstrates superior robustness to adversarial patch attacks than competing methods. Our source code can be found at https://github.com/lxuniverse/gdpa.


title: Exponential GARCH-Ito Volatility Models

abstract: This paper introduces a novel Ito diffusion process to model high-frequency financial data, which can accommodate low-frequency volatility dynamics by embedding the discrete-time non-linear exponential GARCH structure with log-integrated volatility in a continuous instantaneous volatility process. The key feature of the proposed model is that, unlike existing GARCH-Ito models, the instantaneous volatility process has a non-linear structure, which ensures that the log-integrated volatilities have the realized GARCH structure. We call this the exponential realized GARCH-Ito (ERGI) model. Given the auto-regressive structure of the log-integrated volatility, we propose a quasi-likelihood estimation procedure for parameter estimation and establish its asymptotic properties. We conduct a simulation study to check the finite sample performance of the proposed model and an empirical study with 50 assets among the S\&P 500 compositions. The numerical studies show the advantages of the new proposed model.


title: Toward A Supersymmetric $w_{1+\infty}$ Symmetry in the Celestial Conformal Field Theory

abstract: The $w_{1+\infty}$ symmetry algebra appears in the Einstein--Yang--Mills theory, proposed recently by Strominger. In this paper, we derive the supersymmetric $w_{1+\infty}$ symmetry by using the known results on the operator product expansions (OPEs) between the graviton, gravitino, gluon, and gluino in the supersymmetric version of the above theory. We calculate the four additional commutator relations between the soft currents explicitly. In addition, we analyze the works of Odake et al. and Pope et al. and introduce the additional symmetry current that corresponds to the celestial gluino operator. Through this procedure, all seven commutator relations can be connected to the ones associated with the supersymmetric $w_{1+\infty}$ algebra with $SU(N)$ symmetry under the restrictions of wedge modes.


title: K-stability and polystable degenerations of polarized spherical varieties

abstract: In this paper, we study the K-stability of polarized spherical varieties. After reduction, it can be treated as a variational problem of the reduced functional of the Futaki invariant on the associated moment polytope. With the convexity constraint of the problem, the minimizers are shown to satisfy the homogeneous Monge-Amp\`ere equation (HMA). When the spherical variety has rank two, a simpler characterization can be established through properties of the HMA. As an application, we determine the strict semistability and polystable degenerations for Fano spherical varieties of rank two.


title: On the existence of rational curves on projective hyperk\"ahler fourfolds

abstract: We show that if $X$ is a projective hyperk\"ahler fourfold and there exists a nonzero effective divisor $D$ which is not of bi-elliptic type and contained in the boundary of the nef cone of $X$, then $X$ contains a rational curve. This is a very special case of Oguiso's conjecture for projective hyperk\"ahler fourfolds.


title: Group-Aware Threshold Adaptation for Fair Classification

abstract: The fairness in machine learning is getting increasing attention, as its applications in different fields continue to expand and diversify. To mitigate the discriminated model behaviors between different demographic groups, we introduce a novel post-processing method to optimize over multiple fairness constraints through group-aware threshold adaptation. We propose to learn adaptive classification thresholds for each demographic group by optimizing the confusion matrix estimated from the probability distribution of a classification model output. As we only need an estimated probability distribution of model output instead of the classification model structure, our post-processing model can be applied to a wide range of classification models and improve fairness in a model-agnostic manner and ensure privacy. This even allows us to post-process existing fairness methods to further improve the trade-off between accuracy and fairness. Moreover, our model has low computational cost. We provide rigorous theoretical analysis on the convergence of our optimization algorithm and the trade-off between accuracy and fairness of our method. Our method theoretically enables a better upper bound in near optimality than existing method under same condition. Experimental results demonstrate that our method outperforms state-of-the-art methods and obtains the result that is closest to the theoretical accuracy-fairness trade-off boundary.


title: Identifying Best Fair Intervention

abstract: We study the problem of best arm identification with a fairness constraint in a given causal model. The goal is to find a soft intervention on a given node to maximize the outcome while meeting a fairness constraint by counterfactual estimation with only partial knowledge of the causal model. The problem is motivated by ensuring fairness on an online marketplace. We provide theoretical guarantees on the probability of error and empirically examine the effectiveness of our algorithm with a two-stage baseline.


title: Mimic: An adaptive algorithm for multivariate time series classification

abstract: Time series data are valuable but are often inscrutable. Gaining trust in time series classifiers for finance, healthcare, and other critical applications may rely on creating interpretable models. Researchers have previously been forced to decide between interpretable methods that lack predictive power and deep learning methods that lack transparency. In this paper, we propose a novel Mimic algorithm that retains the predictive accuracy of the strongest classifiers while introducing interpretability. Mimic mirrors the learning method of an existing multivariate time series classifier while simultaneously producing a visual representation that enhances user understanding of the learned model. Experiments on 26 time series datasets support Mimic's ability to imitate a variety of time series classifiers visually and accurately.


title: Critical branching as a pure death process coming down from infinity

abstract: We consider the critical Galton-Watson process with overlapping generations stemming from a single founder. Assuming that both the variance of the offspring number and the average generation length are finite, we establish the convergence of the finite-dimensional distributions, conditioned on non-extinction at a remote time of observation. The limiting process is identified as a pure death process coming down from infinity. This result brings a new perspective on Vatutin's dichotomy claiming that in the critical regime of age-dependent reproduction, an extant population either contains a large number of short-living individuals or consists of few long-living individuals.


title: Planar Hexacoordinate Silicon

abstract: The occurrence of planar hexacoordination is very rare in cluster chemistry, particularly for main group elements. We report here a class of planar hexacoordinate silicon (phSi) in the global minimum isomer of SiE3M3+ (E = N, P, As, Sb; M = Ca, Sr, Ba). Three Si-E multiple bonds between phSi and E centers is a key structural and electronic prerequisite for the observation of their prefect planarity and high stability. Especially, the electrostatic interactions between phSi and three M centers become less repulsive with decrease in electronegativity of E. Eventually, a sizable electrostatic attractive interaction exists in between phSi and M centers in SiSb3M3+, leading to a true unprecedented phSi bonding motif which features three Si-Sb multiple bonds and three Si-M ionic bonds.


title: Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis

abstract: We introduce DMTet, a deep 3D conditional generative model that can synthesize high-resolution 3D shapes using simple user guides such as coarse voxels. It marries the merits of implicit and explicit 3D representations by leveraging a novel hybrid 3D representation. Compared to the current implicit approaches, which are trained to regress the signed distance values, DMTet directly optimizes for the reconstructed surface, which enables us to synthesize finer geometric details with fewer artifacts. Unlike deep 3D generative models that directly generate explicit representations such as meshes, our model can synthesize shapes with arbitrary topology. The core of DMTet includes a deformable tetrahedral grid that encodes a discretized signed distance function and a differentiable marching tetrahedra layer that converts the implicit signed distance representation to the explicit surface mesh representation. This combination allows joint optimization of the surface geometry and topology as well as generation of the hierarchy of subdivisions using reconstruction and adversarial losses defined explicitly on the surface mesh. Our approach significantly outperforms existing work on conditional shape synthesis from coarse voxel inputs, trained on a dataset of complex 3D animal shapes. Project page: https://nv-tlabs.github.io/DMTet/.


title: Microstructure and the Boson-peak in thermally-treated In_{x}O films

abstract: We report on the correlation between the boson-peak and structural changes associated with thermally-treating amorphous indium-oxide films. In this process, the resistance of a given sample may decrease by a considerable margin while its amorphous structure is preserved. In the present study, we focus on the changes that result from the heat-treatment by employing electron-microscopy, X-ray, and Raman spectroscopy. These techniques were used on films with different stoichiometry and thus different carrier-concentration. The main effect of heat-treatment is material densification, which presumably results from elimination of micro-voids. The densified system presents better wavefunction-overlap and more efficient connectivity for the current flow. X-ray, and electron-beam diffraction experiments indicate that the heat-treated samples show significantly less spatial heterogeneity with only a moderate change of the radial-distribution function metrics. These results are consistent with the changes that occur in the boson-peak characteristics due to annealing as observed in their Raman spectra.


title: Existence of weak solutions for Porous medium equation with a divergence type of drift term

abstract: We consider degenerate porous medium equations with a divergence type of drift terms. We establish the existence of $L^{q}$-weak solutions (satisfying energy estimates or even further with moment and speed estimates in Wasserstein spaces), in case the drift term belongs to a sub-scaling (including scaling invariant) class depending on $q$ and $m$ caused by the nonlinear structure of diffusion, which is a major difference compared to that of a linear case. It is noticeable that the classes of drift terms become wider if the drift term is divergence-free. Similar conditions of gradients of drift terms are also provided to ensure the existence of such weak solutions. Uniqueness results follow under an additional condition on the gradients of the drift terms with the aid of methods developed in Wasserstein spaces. One of our main tools is so called the splitting method to construct a sequence of approximated solutions, which implies, bypassing to the limit, the existence of weak solutions satisfying not only an energy inequality but also moment and speed estimates. One of the crucial points in the construction is uniform H\"{o}lder continuity up to initial time for homogeneous porous medium equations, which seems to be of independent interest. As an application, we improve a regularity result for solutions of a repulsive Keller-Segel system of porous medium type.


title: Batch Reinforcement Learning from Crowds

abstract: A shortcoming of batch reinforcement learning is its requirement for rewards in data, thus not applicable to tasks without reward functions. Existing settings for lack of reward, such as behavioral cloning, rely on optimal demonstrations collected from humans. Unfortunately, extensive expertise is required for ensuring optimality, which hinder the acquisition of large-scale data for complex tasks. This paper addresses the lack of reward in a batch reinforcement learning setting by learning a reward function from preferences. Generating preferences only requires a basic understanding of a task. Being a mental process, generating preferences is faster than performing demonstrations. So preferences can be collected at scale from non-expert humans using crowdsourcing. This paper tackles a critical challenge that emerged when collecting data from non-expert humans: the noise in preferences. A novel probabilistic model is proposed for modelling the reliability of labels, which utilizes labels collaboratively. Moreover, the proposed model smooths the estimation with a learned reward function. Evaluation on Atari datasets demonstrates the effectiveness of the proposed model, followed by an ablation study to analyze the relative importance of the proposed ideas.


title: Non-Gaussian operations in measurement device independent quantum key distribution

abstract: Non-Gaussian operations in continous variable (CV) quantum key distribution (QKD) have been limited to photon subtraction on squeezed vacuum states only. This is mainly due to the ease of calculating the covariance matrix representation of such states. In this paper we study the effects of general non-Gaussian operations corresponding to photon addition, catalysis and subtraction on squeezed coherent states on CV measurement device independent (MDI) QKD. We find that non-Gaussianity coupled with coherence can yield significantly longer transmission distances than without. Particularly we observe that zero photon catalysis on two mode squeezed coherent state (TMSC) is an optimial choice for CV MDI QKD, while single photon subtraction is also a good candidate; both of them offering nearly 70 km of transmission distances. We also derive a single generalized covariance matrix for the aforementioned states which will be useful in several other aspects of CV quantum information processing.


title: A Tungsten Deep Neural-Network Potential for Simulating Mechanical Property Degradation Under Fusion Service Environment

abstract: Tungsten is a promising candidate material in fusion energy facilities. Molecular dynamics (MD) simulations reveal the atomistic scale mechanisms, so they are crucial for the understanding of the macroscopic property deterioration of tungsten under harsh and complex service environments. The interatomic potential used in the MD simulations is required to accurately describe a wide spectrum of relevant defect properties, which is by far challenging to the existing interatomic potentials. In this paper, we propose a new three-body embedding descriptor and hybridize it into the Deep-Potential (DP) framework, an end-to-end deep learning interatomic potential model. Trained with the dataset generated by a concurrent learning method, the potential model for tungsten, named by DP-HYB, is able to accurately predict a wide range of properties including elastic constants, stacking fault energy, the formation energies of free surfaces and point defects, which are included in the training dataset, and formation energies of grain boundaries and prismatic loops, the core structure of screw dislocation, the Peierls barrier and the transition path of the screw dislocation migration, which are not explicitly included in the training dataset. The DP-HYB is a good candidate for the atomistic simulations of tungsten property deterioration, especially those involving the mechanical property degradation under the harsh fusion service environment.


title: Learning an Adaptive Meta Model-Generator for Incrementally Updating Recommender Systems

abstract: Recommender Systems (RSs) in real-world applications often deal with billions of user interactions daily. To capture the most recent trends effectively, it is common to update the model incrementally using only the newly arrived data. However, this may impede the model's ability to retain long-term information due to the potential overfitting and forgetting issues. To address this problem, we propose a novel Adaptive Sequential Model Generation (ASMG) framework, which generates a better serving model from a sequence of historical models via a meta generator. For the design of the meta generator, we propose to employ Gated Recurrent Units (GRUs) to leverage its ability to capture the long-term dependencies. We further introduce some novel strategies to apply together with the GRU meta generator, which not only improve its computational efficiency but also enable more accurate sequential modeling. By instantiating the model-agnostic framework on a general deep learning-based RS model, we demonstrate that our method achieves state-of-the-art performance on three public datasets and one industrial dataset.


title: Gauge Parameter Independence of the Higgs Pole Mass in the Multi-Higgs model

abstract: e have investigated the gauge parameter dependence of the Higgs pole masses in the multi-Higgs model in two different types of the gauge fixing conditions. It turns out that the Higgs pole masses of the multi-Higgs model when expressed in terms of the Lagrangian parameters, are independent of the gauge parameter for both cases.


title: Demonstration of long-range correlations via susceptibility measurements in a one-dimensional superconducting Josephson spin chain

abstract: Spin chains have long been considered an effective medium for long-range interactions, entanglement generation, and quantum state transfer. In this work, we explore the properties of a spin chain implemented with superconducting flux circuits, designed to act as a connectivity medium between two superconducting qubits. The susceptibility of the chain is probed and shown to support long-range, cross chain correlations. In addition, interactions between the two end qubits, mediated by the coupler chain, are demonstrated. This work has direct applicability in near term quantum annealing processors as a means of generating long-range, coherent coupling between qubits.


title: Dineutron in the $2^+_1$ state of $^6$He

abstract: We investigate the dineutron in the $2^+_1$ state of $^6$He via analysis of its decay mode by using the complex scaling method. In this letter, we propose the cross section for the resonant state to distinguish the resonant contributions from the nonresonant ones. As the results, it is found that the shoulder peak appears in the cross section for the resonant state as a function of $\varepsilon_{n\text{-}n}$. Furthermore, we show that the $S$ = 0 component of the cross section, where $S$ is the total spin of the valence two neutrons, has a peak around the shoulder peak, which comes from the dineutron configuration in the $2^+_1$ state. Thus we conclude that the shoulder peak is expected to indicate the existence of the dineutron in the $2^+_1$ state.


title: Deep Unsupervised Active Learning on Learnable Graphs

abstract: Recently deep learning has been successfully applied to unsupervised active learning. However, current method attempts to learn a nonlinear transformation via an auto-encoder while ignoring the sample relation, leaving huge room to design more effective representation learning mechanisms for unsupervised active learning. In this paper, we propose a novel deep unsupervised Active Learning model via Learnable Graphs, named ALLG. ALLG benefits from learning optimal graph structures to acquire better sample representation and select representative samples. To make the learnt graph structure more stable and effective, we take into account $k$-nearest neighbor graph as a priori, and learn a relation propagation graph structure. We also incorporate shortcut connections among different layers, which can alleviate the well-known over-smoothing problem to some extent. To the best of our knowledge, this is the first attempt to leverage graph structure learning for unsupervised active learning. Extensive experiments performed on six datasets demonstrate the efficacy of our method.


title: BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning

abstract: Decentralized algorithm is a form of computation that achieves a global goal through local dynamics that relies on low-cost communication between directly-connected agents. On large-scale optimization tasks involving distributed datasets, decentralized algorithms have shown strong, sometimes superior, performance over distributed algorithms with a central node. Recently, developing decentralized algorithms for deep learning has attracted great attention. They are considered as low-communication-overhead alternatives to those using a parameter server or the Ring-Allreduce protocol. However, the lack of an easy-to-use and efficient software package has kept most decentralized algorithms merely on paper. To fill the gap, we introduce BlueFog, a python library for straightforward, high-performance implementations of diverse decentralized algorithms. Based on a unified abstraction of various communication operations, BlueFog offers intuitive interfaces to implement a spectrum of decentralized algorithms, from those using a static, undirected graph for synchronous operations to those using dynamic and directed graphs for asynchronous operations. BlueFog also adopts several system-level acceleration techniques to further optimize the performance on the deep learning tasks. On mainstream DNN training tasks, BlueFog reaches a much higher throughput and achieves an overall $1.2\times \sim 1.8\times$ speedup over Horovod, a state-of-the-art distributed deep learning package based on Ring-Allreduce. BlueFog is open source at https://github.com/Bluefog-Lib/bluefog.


title: The missing quantum number of the Floquet states

abstract: We reformulate the Floquet theory for periodically driven quantum systems following a perfect analogy with the proof of Bloch theorem. We observe that the current standard method for calculating the Floquet eigenstates by the quasi-energy alone is incomplete and unstable, and pinpoint an overlooked quantum number, the average energy. This new quantum number resolves many shortcomings of the Floquet method stemming from the quasi-energy degeneracy issues, particularly in the continuum limit. Using the average energy quantum number we get properties similar to those of the static energy, including a unique lower-bounded ordering of the Floquet states, from which we define a ground state, and a variational method for calculating the Floquet states. This is a first step towards reformulating Floquet first-principles methods, that have long been thought to be incompatible due to the limitations of the quasi-energy.


title: LMStream: When Distributed Micro-Batch Stream Processing Systems Meet GPU

abstract: This paper presents LMStream, which ensures bounded latency while maximizing the throughput on the GPU-enabled micro-batch streaming systems. The main ideas behind LMStream's design can be summarized as two novel mechanisms: (1) dynamic batching and (2) dynamic operation-level query planning. By controlling the micro-batch size, LMStream significantly reduces the latency of individual dataset because it does not perform unconditional buffering only for improving GPU utilization. LMStream bounds the latency to an optimal value according to the characteristics of the window operation used in the streaming application. Dynamic mapping between a query to an execution device based on the data size and dynamic device preference improves both the throughput and latency as much as possible. In addition, LMStream proposes a low-overhead online cost model parameter optimization method without interrupting the real-time stream processing. We implemented LMStream on Apache Spark, which supports micro-batch stream processing. Compared to the previous throughput-oriented method, LMStream showed an average latency improvement up to a maximum of 70.7%, while improving average throughput up to 1.74x.


title: Understanding glass-like Vogel-Fulcher-Tammann equilibration times: microcanonical effective temperatures in quenched 3D martensites

abstract: We do Monte Carlo simulations of four 3D structural transitions, with vector-spin models of their martensitic strain domains under quenches to $T$, to test a generic post-quench Partial Equilibration Scenario (PES) of Ritort. We indeed confirm that energy-lowering passages between fixed-energy shells induce a signature PES distribution of an exponential tail in heat releases, scaled in an effective search temperature. A linear vanishing of this $T_{eff}(T)\sim T_d -T$ at a temperature $T_d$ where PES passage-searches freeze, explains the Vogel-Fulcher like divergence of equilibration times $ e^{1/ T_{eff} (T)}\sim e^{1/(T_d -T)}$, extracted from incubation-time delays of simulations and martensitic alloys.


title: Non-local $R^2$-like inflation, Gravitational Waves and Non-Gaussianities

abstract: The emergence of $R^2$ (Starobinsky) inflation from the semi-classical modification of gravity due to matter quantum fields (trace anomaly) clearly points out the importance of fundamental physics and the first principles in the construction of successful cosmological models. Along with the observational success, $R^2$ gravity is also an important step beyond general relativity (GR) towards quantum gravity. Furthermore, several approaches of quantum gravity to date are strongly indicating the presence of non-locality at small time and length scales. In this regard, ultraviolet (UV) completion of $R^2$ inflation has been recently studied in a string theory-inspired ghost-free analytic non-local gravity. We discuss the promising theoretical predictions of non-local $R^2$-like inflation with respect to the key observables such as tensor-to-scalar ratio, tensor tilt which tell us about the spectrum of primordial gravitational waves, and scalar Non-Gaussianities which tell us about the three-point correlations in the CMB fluctuations. Any signature of non-local physics in the early Universe will significantly improve our understanding of fundamental physics at UV energy scales and quantum gravity.


title: Homology group of branched cyclic covering over a 2-bridge knot of genus two

abstract: The structure of the first homology group of a cyclic covering of a knot is an important invariant well known in the knot theory. In the last century, H. Seifert developed a general approach to compute the homology group of the covering. Based on his ideas R. Fox found explicit form for $H_{1}(M_{n},\mathbb{Z}),$ where $M_{n}$ is an $n$-fold cyclic covering over a knot $K$ admitting genus one Seifert surface. The aim of the present paper is to find the structure of $H_{1}(M_{n},\mathbb{Z})$ for $2$-bridge knots admitting genus two Seifert surface. The result is given explicitly in terms of Alexander polynomial of the knot.


title: Subduing always defecting mutants by multiplayer reactive strategies: Non-reciprocity versus generosity

abstract: A completely non-generous and reciprocal population of players can create a robust cooperating state that cannot be invaded by always defecting free riders if the interactions among players are repeated for long enough. However, strict non-generosity and strict reciprocity are ideal concepts, and may not even be desirable sometimes. Therefore, to what extent generosity or non-reciprocity can be allowed while still not be swamped by the mutants, is a natural question. In this paper, we not only ask this question but furthermore ask how generosity comparatively fares against non-reciprocity in this context. For mathematical concreteness, we work within the framework of multiplayer repeated prisoner's dilemma game with reactive strategies in a finite and an infinite population; and explore the aforementioned questions through the effects of the benefit to cost ratio, the interaction group size, and the population size.


title: Variations of Renormalized Volume for Minimal Submanifolds of Poincare-Einstein Manifolds

abstract: We investigate the asymptotic expansion and the renormalized volume of minimal submanifolds, $Y^m$ of arbitrary codimension in Poincare-Einstein manifolds, $M^{n+1}$. In particular, we derive formulae for the first and second variations of renormalized volume for $Y^m \subseteq M^{n+1}$ when $m < n + 1$. We apply our formulae to the codimension $1$ and the $M = \mathbb{H}^{n+1}$ case. Furthermore, we prove the existence of an asymptotic description of our minimal submanifold, $Y$, over the boundary cylinder $\partial Y \times \mathbb{R}^+$, and we further derive an $L^2$-inner-product relationship between $u_2$ and $u_{m+1}$ when $M = \mathbb{H}^{n+1}$. Our results apply to a slightly more general class of manifolds, which are conformally compact with a metric that has an even expansion up to high order near the boundary.


title: The Hardness Analysis of Thompson Sampling for Combinatorial Semi-bandits with Greedy Oracle

abstract: Thompson sampling (TS) has attracted a lot of interest in the bandit area. It was introduced in the 1930s but has not been theoretically proven until recent years. All of its analysis in the combinatorial multi-armed bandit (CMAB) setting requires an exact oracle to provide optimal solutions with any input. However, such an oracle is usually not feasible since many combinatorial optimization problems are NP-hard and only approximation oracles are available. An example (Wang and Chen, 2018) has shown the failure of TS to learn with an approximation oracle. However, this oracle is uncommon and is designed only for a specific problem instance. It is still an open question whether the convergence analysis of TS can be extended beyond the exact oracle in CMAB. In this paper, we study this question under the greedy oracle, which is a common (approximation) oracle with theoretical guarantees to solve many (offline) combinatorial optimization problems. We provide a problem-dependent regret lower bound of order $\Omega(\log T/\Delta^2)$ to quantify the hardness of TS to solve CMAB problems with greedy oracle, where $T$ is the time horizon and $\Delta$ is some reward gap. We also provide an almost matching regret upper bound. These are the first theoretical results for TS to solve CMAB with a common approximation oracle and break the misconception that TS cannot work with approximation oracles.


title: Marchenko-Pastur law for a random tensor model

abstract: We study the limiting spectral distribution of large-dimensional sample covariance matrices associated with symmetric random tensors formed by $\binom{n}{d}$ different products of $d$ variables chosen from $n$ independent standardized random variables. We find optimal sufficient conditions for this distribution to be the Marchenko-Pastur law in the case $d=d(n)$ and $n\to\infty$. Our conditions reduce to $d^2=o(n)$ when the variables have uniformly bounded fourth moments. The proofs are based on a new concentration inequality for quadratic forms in symmetric random tensors and a law of large numbers for elementary symmetric random polynomials.


title: Counting Rooted Spanning Forests For Circulant Foliation Over A Graph

abstract: In this paper, we present a new method to produce explicit formulas for the number of rooted spanning forests $f(n)$ for the infinite family of graphs $H_n=H_n(G_1,\,G_2,\ldots,G_m)$ obtained as a circulant foliation over a graph $H$ on $m$ vertices with fibers $G_1,\,G_2,\ldots,G_m.$ Each fiber $G_i=C_n(s_{i,1},\,s_{i,2},\ldots,s_{i,k_i})$ of this foliation is the circulant graph on $n$ vertices with jumps $s_{i,1},\,s_{i,2},\ldots,s_{i,k_i}.$ This family includes the family of generalized Petersen graphs, $I$-graphs, sandwiches of circulant graphs, discrete torus graphs and others. The formulas are expressed through Chebyshev polynomials. We prove that the number of rooted spanning forests can be represented in the form $f(n)=p\,f(H)a(n)^2,$ where $a(n)$ is an integer sequence and $p$ is a prescribed natural number depending on the number of odd elements in the set of $s_{i,j}.$ Finally, we find an asymptotic formula for $f(n)$ through the Mahler measure of the associated Laurent polynomial.


title: Solving String Constraints With Regex-Dependent Functions Through Transducers With Priorities And Variables

abstract: Regular expressions are a classical concept in formal language theory. Regular expressions in programming languages (RegEx) such as JavaScript, feature non-standard semantics of operators (e.g. greedy/lazy Kleene star), as well as additional features such as capturing groups and references. While symbolic execution of programs containing RegExes appeals to string solvers natively supporting important features of RegEx, such a string solver is hitherto missing. In this paper, we propose the first string theory and string solver that natively provide such a support. The key idea of our string solver is to introduce a new automata model, called prioritized streaming string transducers (PSST), to formalize the semantics of RegEx-dependent string functions. PSSTs combine priorities, which have previously been introduced in prioritized finite-state automata to capture greedy/lazy semantics, with string variables as in streaming string transducers to model capturing groups. We validate the consistency of the formal semantics with the actual JavaScript semantics by extensive experiments. Furthermore, to solve the string constraints, we show that PSSTs enjoy nice closure and algorithmic properties, in particular, the regularity-preserving property (i.e., pre-images of regular constraints under PSSTs are regular), and introduce a sound sequent calculus that exploits these properties and performs propagation of regular constraints by means of taking post-images or pre-images. Although the satisfiability of the string constraint language is undecidable, we show that our approach is complete for the so-called straight-line fragment. We evaluate the performance of our string solver on over 195000 string constraints generated from an open-source RegEx library. The experimental results show the efficacy of our approach, drastically improving the existing methods in both precision and efficiency.


title: Poisson-Voronoi percolation in the hyperbolic plane with small intensities

abstract: We consider percolation on the Voronoi tessellation generated by a homogeneous Poisson point process on the hyperbolic plane. We show that the critical probability for the existence of an infinite cluster is asymptotically equal to $\pi \lambda/3$ as $\lambda\to0.$ This answers a question of Benjamini and Schramm.


title: Polarization study of gamma-ray binary

abstract: The polarization of X-ray emission is a unique tool used to investigate the magnetic field structure around astrophysical objects. In this paper, we study the linear polarization of X-ray emissions from gamma-ray binary systems based on pulsar scenarios. We discuss synchrotron emissions from pulsar wind particles accelerated by a standing shock. We explore three kinds of axisymmetric magnetic field structures: (i) toroidal magnetic fields, (ii) poloidal magnetic fields, and (iii) tangled magnetic fields. Because of the axisymmetric structure, the polarization angle of integrated emission is oriented along or perpendicular to the shock-cone axis projected on the sky and swings by 360? in one orbit. For the toroidal case, the polarization angle is always directed along the shock cone axis and smoothly changes along the orbital phase. For the poloidal/tangled magnetic field, the direction of the polarization angle depends on the system parameters and orbital phase. In one orbit, the polarization degree for the toroidal case can reach the maximum value of the synchrotron radiation (? 70%), while the maximum polarization degree for poloidal/tangled field cases is several 10%. We apply our model to bright gamma-ray binary LS 5039 and make predictions for future observations. With the expected sensitivity of the Imaging X-ray Polarimetry Explorer, linear polarization can be detected by an observation of several days if the magnetic field is dominated by the toroidal magnetic field. If the magnetic field is dominated by the poloidal/tangled field, significant detection is expected with an observation longer than 10 days.


title: Transition from a polaronic condensate to a degenerate Fermi gas of heteronuclear molecules

abstract: The interplay of quantum statistics and interactions in atomic Bose--Fermi mixtures leads to a phase diagram markedly different from pure fermionic or bosonic systems. However, investigating this phase diagram remains challenging when bosons condense. Here, we observe evidence for a quantum phase transition from a polaronic to a molecular phase in a density-matched degenerate Bose--Fermi mixture. The condensate fraction, representing the order parameter of the transition, is depleted by interactions and the build-up of strong correlations results in the emergence of a molecular Fermi gas. By driving through the transition, we ultimately produce a quantum-degenerate sample of sodium-potassium molecules exhibiting a large molecule-frame dipole moment of 2.7 Debye. The observed phase transition represents a new phenomenon complementary to the paradigmatic BEC-BCS crossover observed in Fermi systems.


title: How Developers and Managers Define and Trade Productivity for Quality

abstract: In this paper, we present the findings from a survey study to investigate how developers and managers define and trade-off developer productivity and software quality (two related lenses into software development). We found that developers and managers, as cohorts, are not well aligned in their views of what it means to be productive (developers think of productivity in terms of activity, while more managers think of productivity in terms of performance). We also found that developers are not accurate at predicting their managers' views of productivity. In terms of quality, we found that individual developers and managers have quite varied views of what quality means to them, but as cohorts they are closely aligned in their different views, with the majority in both groups defining quality in terms of robustness. Over half of the developers and managers reported that quality can be traded for higher productivity and why this trade-off can be justified, while one third consider quality as a necessary part of productivity that cannot be traded. We also present a new descriptive framework for quality, TRUCE, that we synthesize from the survey responses. We call for more discussion between developers and managers about what they each consider as important software quality attributes, and to have open debate about how software quality relates to developer productivity and what trade-offs should or should not be made.


title: Defense Against Explanation Manipulation

abstract: Explainable machine learning attracts increasing attention as it improves transparency of models, which is helpful for machine learning to be trusted in real applications. However, explanation methods have recently been demonstrated to be vulnerable to manipulation, where we can easily change a model's explanation while keeping its prediction constant. To tackle this problem, some efforts have been paid to use more stable explanation methods or to change model configurations. In this work, we tackle the problem from the training perspective, and propose a new training scheme called Adversarial Training on EXplanations (ATEX) to improve the internal explanation stability of a model regardless of the specific explanation method being applied. Instead of directly specifying explanation values over data instances, ATEX only puts requirement on model predictions which avoids involving second-order derivatives in optimization. As a further discussion, we also find that explanation stability is closely related to another property of the model, i.e., the risk of being exposed to adversarial attack. Through experiments, besides showing that ATEX improves model robustness against manipulation targeting explanation, it also brings additional benefits including smoothing explanations and improving the efficacy of adversarial training if applied to the model.


title: On Jacobian group and complexity of the Y-graph

abstract: In the present paper we suggest a simple approach for counting Jacobian group of the $Y$-graph $Y(n; k, l, m).$ In the case $Y(n; 1, 1, 1)$ the structure of the Jacobian group will be find explicitly. Also, we obtain a closed formula for the number of spanning trees of $Y$-graph in terms of Chebyshev polynomials and give its asymtotics.


title: Bounded cohomology and binate groups

abstract: A group is boundedly acyclic if its bounded cohomology with trivial real coefficients vanishes in all positive degrees. Amenable groups are boundedly acyclic, while the first non-amenable examples were the group of compactly supported homeomorphisms of $\mathbb{R}^n$ (Matsumoto--Morita) and mitotic groups (L\"oh). We prove that binate (alias pseudo-mitotic) groups are boundedly acyclic, which provides a unifying approach to the aforementioned results. Moreover, we show that binate groups are universally boundedly acyclic. We obtain several new examples of boundedly acyclic groups as well as computations of the bounded cohomology of certain groups acting on the circle. In particular, we discuss how these results suggest that the bounded cohomology of the Thompson groups $F$, $T$, and $V$ is as simple as possible.


title: Learning Dipole Moments and Polarizabilities

abstract: Machine learning of scalar molecular properties such as potential energy has enabled widespread applications. However, there are relatively few machine learning models targeting directional properties, including permanent and transition dipole (multipole) moments, as well as polarizability. These properties are essential to determine intermolecular forces and molecular spectra. In this chapter, we review machine learning models for these tensorial properties, with special focus on how to encode the rotational equivariance into these models by taking a similar form as the physical definition of these properties. You will then learn how to use an embedded atom neural network model to train dipole moments and polarizabilities of a representative molecule. The methodology discussed in this chapter can be extended to learn similar or higher-rank tensorial properties, such as magnetic dipole moments, non-adiabatic coupling vectors, and hyperpolarizabilities.


title: State Drift and Gait Plan in Feedback Linearization Control of A Tilt Vehicle

abstract: To stabilize a conventional quadrotor, simplified equivalent vehicles, e.g., autonomous car, are developed to test the designed controller. Based on that, various controllers based on feedback linearization have been developed. With the recently developed concept of tilt-rotor, there lacks the simplified or equivalent model, however. Indeed, the tilt structure is relatively unusual in vehicles. In this research, we put forward a unique fictional vehicle with tilt structure, which is to help evaluate the property of the tilt-structure-aimed controllers. One phenomenon, state drift, in controlling an over-actuated tilt structure by feedback linearization is presented subsequently. State drift can be easily neglected and is not paid attention to in the current researches in tilt-rotor controller design so far. We report this phenomenon and provide a potential approach to avoid this behavior.


title: Learning Context-Aware Representations of Subtrees

abstract: This thesis tackles the problem of learning efficient representations of complex, structured data with a natural application to web page and element classification. We hypothesise that the context around the element inside the web page is of high value to the problem and is currently under exploited. This thesis aims to solve the problem of classifying web elements as subtrees of a DOM tree by also considering their context. To achieve this, first we discuss current expert knowledge systems that work on structures, such as Tree-LSTM. Then, we propose context-aware extensions to this model. We show that the new model achieves an average F1-score of 0.7973 on a multi-class web classification task. This model generates better representations for various subtrees and may be used for applications such element classification, state estimators in reinforcement learning over the Web and more.


title: Assessing learned features of Deep Learning applied to EEG

abstract: Convolutional Neural Networks (CNNs) have achieved impressive performance on many computer vision related tasks, such as object detection, image recognition, image retrieval, etc. These achievements benefit from the CNNs' outstanding capability to learn discriminative features with deep layers of neuron structures and iterative training process. This has inspired the EEG research community to adopt CNN in performing EEG classification tasks. However, CNNs learned features are not immediately interpretable, causing a lack of understanding of the CNNs' internal working mechanism. To improve CNN interpretability, CNN visualization methods are applied to translate the internal features into visually perceptible patterns for qualitative analysis of CNN layers. Many CNN visualization methods have been proposed in the Computer Vision literature to interpret the CNN network structure, operation, and semantic concept, yet applications to EEG data analysis have been limited. In this work we use 3 different methods to extract EEG-relevant features from a CNN trained on raw EEG data: optimal samples for each classification category, activation maximization, and reverse convolution. We applied these methods to a high-performing Deep Learning model with state-of-the-art performance for an EEG sex classification task, and show that the model features a difference in the theta frequency band. We show that visualization of a CNN model can reveal interesting EEG results. Using these tools, EEG researchers using Deep Learning can better identify the learned EEG features, possibly identifying new class relevant biomarkers.


title: Residual-Guided Learning Representation for Self-Supervised Monocular Depth Estimation

abstract: Photometric consistency loss is one of the representative objective functions commonly used for self-supervised monocular depth estimation. However, this loss often causes unstable depth predictions in textureless or occluded regions due to incorrect guidance. Recent self-supervised learning approaches tackle this issue by utilizing feature representations explicitly learned from auto-encoders, expecting better discriminability than the input image. Despite the use of auto-encoded features, we observe that the method does not embed features as discriminative as auto-encoded features. In this paper, we propose residual guidance loss that enables the depth estimation network to embed the discriminative feature by transferring the discriminability of auto-encoded features. We conducted experiments on the KITTI benchmark and verified our method's superiority and orthogonality on other state-of-the-art methods.


title: Portfolio analysis with mean-CVaR and mean-CVaR-skewness criteria based on mean-variance mixture models

abstract: The paper Zhao et al. (2015) shows that mean-CVaR-skewness portfolio optimization problems based on asymetric Laplace (AL) distributions can be transformed into quadratic optimization problems under which closed form solutions can be found. In this note, we show that such result also holds for mean-risk-skewness portfolio optimization problems when the underlying distribution is a larger class of normal mean-variance mixture (NMVM) models than the class of AL distributions. We then study the value at risk (VaR) and conditional value at risk (CVaR) risk measures on portfolios of returns with NMVM distributions. They have closed form expressions for portfolios of normal and more generally elliptically distributed returns as discussed in Rockafellar & Uryasev (2000) and in Landsman & Valdez (2003). When the returns have general NMVM distributions, these risk measures do not give closed form expressions. In this note, we give approximate closed form expressions for VaR and CVaR of portfolios of returns with NMVM distributions. Numerical tests show that our closed form formulas give accurate values for VaR and CVaR and shortens the computational time for portfolio optimization problems associated with VaR and CVaR considerably.


title: Inter-channel Conv-TasNet for multichannel speech enhancement

abstract: Speech enhancement in multichannel settings has been realized by utilizing the spatial information embedded in multiple microphone signals. Moreover, deep neural networks (DNNs) have been recently advanced in this field; however, studies on the efficient multichannel network structure fully exploiting spatial information and inter-channel relationships is still in its early stages. In this study, we propose an end-to-end time-domain speech enhancement network that can facilitate the use of inter-channel relationships at individual layers of a DNN. The proposed technique is based on a fully convolutional time-domain audio separation network (Conv-TasNet), originally developed for speech separation tasks. We extend Conv-TasNet into several forms that can handle multichannel input signals and learn inter-channel relationships. To this end, we modify the encoder-mask-decoder structures of the network to be compatible with 3-D tensors defined over spatial channels, features, and time dimensions. In particular, we conduct extensive parameter analyses on the convolution structure and propose independent assignment of the depthwise and 1$\times$1 convolution layers to the feature and spatial dimensions, respectively. We demonstrate that the enriched inter-channel information from the proposed network plays a significant role in suppressing noisy signals impinging from various directions. The proposed inter-channel Conv-TasNet outperforms the state-of-the-art multichannel variants of neural networks, even with one-tenth of their parameter size. The performance of the proposed model is evaluated using the CHiME-3 dataset, which exhibits a remarkable improvement in SDR, PESQ, and STOI.


title: A Relational Model for One-Shot Classification

abstract: We show that a deep learning model with built-in relational inductive bias can bring benefits to sample-efficient learning, without relying on extensive data augmentation. The proposed one-shot classification model performs relational matching of a pair of inputs in the form of local and pairwise attention. Our approach solves perfectly the one-shot image classification Omniglot challenge. Our model exceeds human level accuracy, as well as the previous state of the art, with no data augmentation.


title: Graph Robustness Benchmark: Benchmarking the Adversarial Robustness of Graph Machine Learning

abstract: Adversarial attacks on graphs have posed a major threat to the robustness of graph machine learning (GML) models. Naturally, there is an ever-escalating arms race between attackers and defenders. However, the strategies behind both sides are often not fairly compared under the same and realistic conditions. To bridge this gap, we present the Graph Robustness Benchmark (GRB) with the goal of providing a scalable, unified, modular, and reproducible evaluation for the adversarial robustness of GML models. GRB standardizes the process of attacks and defenses by 1) developing scalable and diverse datasets, 2) modularizing the attack and defense implementations, and 3) unifying the evaluation protocol in refined scenarios. By leveraging the GRB pipeline, the end-users can focus on the development of robust GML models with automated data processing and experimental evaluations. To support open and reproducible research on graph adversarial learning, GRB also hosts public leaderboards across different scenarios. As a starting point, we conduct extensive experiments to benchmark baseline techniques. GRB is open-source and welcomes contributions from the community. Datasets, codes, leaderboards are available at https://cogdl.ai/grb/home.


title: Spirometry-based airways disease simulation and recognition using Machine Learning approaches

abstract: The purpose of this study is to provide means to physicians for automated and fast recognition of airways diseases. In this work, we mainly focus on measures that can be easily recorded using a spirometer. The signals used in this framework are simulated using the linear bi-compartment model of the lungs. This allows us to simulate ventilation under the hypothesis of ventilation at rest (tidal breathing). By changing the resistive and elastic parameters, data samples are realized simulating healthy, fibrosis and asthma breathing. On this synthetic data, different machine learning models are tested and their performance is assessed. All but the Naive bias classifier show accuracy of at least 99%. This represents a proof of concept that Machine Learning can accurately differentiate diseases based on manufactured spirometry data. This paves the way for further developments on the topic, notably testing the model on real data.


title: SEGA: Semantic Guided Attention on Visual Prototype for Few-Shot Learning

abstract: Teaching machines to recognize a new category based on few training samples especially only one remains challenging owing to the incomprehensive understanding of the novel category caused by the lack of data. However, human can learn new classes quickly even given few samples since human can tell what discriminative features should be focused on about each category based on both the visual and semantic prior knowledge. To better utilize those prior knowledge, we propose the SEmantic Guided Attention (SEGA) mechanism where the semantic knowledge is used to guide the visual perception in a top-down manner about what visual features should be paid attention to when distinguishing a category from the others. As a result, the embedding of the novel class even with few samples can be more discriminative. Concretely, a feature extractor is trained to embed few images of each novel class into a visual prototype with the help of transferring visual prior knowledge from base classes. Then we learn a network that maps semantic knowledge to category-specific attention vectors which will be used to perform feature selection to enhance the visual prototypes. Extensive experiments on miniImageNet, tieredImageNet, CIFAR-FS, and CUB indicate that our semantic guided attention realizes anticipated function and outperforms state-of-the-art results.


title: Best-Response Dynamics and Fictitious Play in Identical-Interest and Zero-Sum Stochastic Games

abstract: This paper combines ideas from Q-learning and fictitious play to define three reinforcement learning procedures which converge to the set of stationary mixed Nash equilibria in identical interest discounted stochastic games. First, we analyse three continuous-time systems that generalize the best-response dynamics defined by Leslie et al. for zero-sum discounted stochastic games. Under some assumptions depending on the system, the dynamics are shown to converge to the set of stationary equilibria in identical interest discounted stochastic games. Then, we introduce three analog discrete-time procedures in the spirit of Sayin et al. and demonstrate their convergence to the set of stationary equilibria using our results in continuous time together with stochastic approximation techniques. Some numerical experiments complement our theoretical findings.


title: Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation

abstract: Medical report generation, which aims to automatically generate a long and coherent report of a given medical image, has been receiving growing research interests. Existing approaches mainly adopt a supervised manner and heavily rely on coupled image-report pairs. However, in the medical domain, building a large-scale image-report paired dataset is both time-consuming and expensive. To relax the dependency on paired data, we propose an unsupervised model Knowledge Graph Auto-Encoder (KGAE) which accepts independent sets of images and reports in training. KGAE consists of a pre-constructed knowledge graph, a knowledge-driven encoder and a knowledge-driven decoder. The knowledge graph works as the shared latent space to bridge the visual and textual domains; The knowledge-driven encoder projects medical images and reports to the corresponding coordinates in this latent space and the knowledge-driven decoder generates a medical report given a coordinate in this space. Since the knowledge-driven encoder and decoder can be trained with independent sets of images and reports, KGAE is unsupervised. The experiments show that the unsupervised KGAE generates desirable medical reports without using any image-report training pairs. Moreover, KGAE can also work in both semi-supervised and supervised settings, and accept paired images and reports in training. By further fine-tuning with image-report pairs, KGAE consistently outperforms the current state-of-the-art models on two datasets.


title: High efficiency uniform positron beam loading in a hollow channel plasma wakefield accelerator

abstract: We propose a novel positron beam loading regime in a hollow plasma channel that can efficiently accelerate $e^+$ beam with high gradient and narrow energy spread. In this regime, the $e^+$ beam coincides with the drive $e^-$ beam in time and space and their net current distribution determines the plasma wakefields. By precisely shaping the beam current profile and loading phase according to explicit expressions, three-dimensional Particle-in-Cell (PIC) simulations show that the acceleration for $e^+$ beam of $\sim$nC charge with $\sim$GV/m gradient, $\lesssim$0.5% induced energy spread and $\sim$50% energy transfer efficiency can be achieved simultaneously. Besides, only tailoring the current profile of the more tunable $e^-$ beam instead of the $e^+$ beam is enough to obtain such favorable results. A theoretical analysis considering both linear and nonlinear plasma responses in hollow plasma channels is proposed to quantify the beam loading effects. This theory agrees very well with the simulation results and verifies the robustness of this beam loading regime over a wide range of parameters.


title: Looking at the analytic structure of Landau gauge propagators

abstract: We report on a study of the analytical structure of the Landau gauge gluon, ghost and quark propagators taken from lattice simulations using large physical volumes, to better access the IR region, and large gauge ensembles to reduce the statistical uncertainties. The investigation uses Pad\'e approximants to look at poles and branch cuts for each of the propagators. For the gluon propagator we identify complex conjugate poles and a branch point. For the ghost propagator the procedure identifies a pole at zero momentum and a branch point for Minkowski-like momenta. The quark propagator appears to have a pole for Minkowski-like momenta that is correlated with the pion mass as expected from PCAC.


title: Towards Debiasing Temporal Sentence Grounding in Video

abstract: The temporal sentence grounding in video (TSGV) task is to locate a temporal moment from an untrimmed video, to match a language query, i.e., a sentence. Without considering bias in moment annotations (e.g., start and end positions in a video), many models tend to capture statistical regularities of the moment annotations, and do not well learn cross-modal reasoning between video and language query. In this paper, we propose two debiasing strategies, data debiasing and model debiasing, to "force" a TSGV model to capture cross-modal interactions. Data debiasing performs data oversampling through video truncation to balance moment temporal distribution in train set. Model debiasing leverages video-only and query-only models to capture the distribution bias, and forces the model to learn cross-modal interactions. Using VSLNet as the base model, we evaluate impact of the two strategies on two datasets that contain out-of-distribution test instances. Results show that both strategies are effective in improving model generalization capability. Equipped with both debiasing strategies, VSLNet achieves best results on both datasets.


title: Development of a Meta-language and its Qualifiable Implementation for the Use in Safety-critical Software

abstract: The use of domain-specific modeling for development of complex (cyber-physical) systems is gaining increasing acceptance in the industrial environment. Domain-specific modeling allows complex systems and data to be abstracted for a more efficient system design, development, validation, and configuration. However, no existing (meta-)modeling framework can be used with reasonable effort in certified software so far, neither for the development of systems nor for the execution of system functions. For the use of (development) artifacts from domain-specific modeling in safety-critical processes or systems it is required to ensure their correctness by either subsequent (manual) verification or the usage of (pre-)qualified software. Existing meta-languages often contain modeling elements that are difficult or impossible to implement in a qualifiable manner leading to a high manual, subsequent certification effort. Therefore, the aim is to develop a (meta-)modeling framework, that can be used in certified software. This can significantly reduce the development effort for safety-critical systems and enables the full advantages of domain-specific modeling. The framework components considered in this PhD-Thesis include: (1) an essential meta-language, (2) a qualifiable runtime environment, and (3) a suitable persistence. The essential \mbox{(meta-)}modeling language is mainly based on the UML standard, but is enhanced with multi-level modeling concepts such as deep instantiation. Supporting a possible qualification, the meta-language is implemented using the highly restrictive, but formally provable programming language Ada SPARK.


title: Phenomenological model for the electromagnetic response of a black hole binary immersed in magnetic field

abstract: Electromagnetic counterparts of gravitational wave events usually involve neutron stars during compact binary coalescences. On the other hand, the community generally believes that electromagnetic emissions are hardly generated during the mergers of binary black holes. Nevertheless, some authors have considered the possibility of an EM counterpart signal after the GW150914, opening the opportunity to investigate the electromagnetic emission of stellar-mass black holes (BHs) mergers. In the case of black holes in a strong magnetic field or with electric charges, electromagnetic emissions would appear accompanied by gravitational waves. In this work, based on the membrane paradigm, we consider a phenomenological model to study the electromagnetic radiation generated by binary black holes surrounded by a uniform magnetic field. We obtain the electromagnetic waveform detected by a far-distance observer for varied black hole spins. By analytical Fourier transformation, we get the chirp property of the electromagnetic waves; we found that the power-law is 5/6, which has the opposite sign compared to gravitational waves. The frequency of such electromagnetic waves is the same as gravitational waves.


title: When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward

abstract: Cyber-physical systems (CPS) have been broadly deployed in safety-critical domains, such as automotive systems, avionics, medical devices, etc. In recent years, Artificial Intelligence (AI) has been increasingly adopted to control CPS. Despite the popularity of AI-enabled CPS, few benchmarks are publicly available. There is also a lack of deep understanding on the performance and reliability of AI-enabled CPS across different industrial domains. To bridge this gap, we initiate to create a public benchmark of industry-level CPS in seven domains and build AI controllers for them via state-of-the-art deep reinforcement learning (DRL) methods. Based on that, we further perform a systematic evaluation of these AI-enabled systems with their traditional counterparts to identify the current challenges and explore future opportunities. Our key findings include (1) AI controllers do not always outperform traditional controllers, (2) existing CPS testing techniques (falsification, specifically) fall short of analyzing AI-enabled CPS, and (3) building a hybrid system that strategically combines and switches between AI controllers and traditional controllers can achieve better performance across different domains. Our results highlight the need for new testing techniques for AI-enabled CPS and the need for more investigations into hybrid CPS systems to achieve optimal performance and reliability.


title: Encircling exceptional points in a Riemann sphere for efficient asymmetric polarization-locked devices

abstract: Dynamically encircling exceptional points (EPs) in two-dimensional Hamiltonian parameter space has enabled intriguing chiral dynamics in which the final state of the system depends on the encircling direction. Here, we show that full Hamiltonian parameter space can be described in a Riemann sphere, and those points on the parameter space boundary with the eigenstates of the system Hamiltonian being convergent, converge to the north vertex. We present that encircling one EP on the Riemann sphere leads to chiral response, and a continuous encircling trajectory passing through the north vertex can realize near-unity asymmetrical transmission. An asymmetric polarization-locked devices are designed by mapping the encircling path onto the L-shaped silicon waveguides. We experimentally demonstrate near 100% asymmetrical polarization conversion efficiency between TE and TM modes with the mode crosstalk below -20 dB at 1550 nm. Our results bring the study of EP-associated dynamics into the realm of highly-efficient asymmetrical polarization conversion and power up new application opportunities for EP physics.


title: On biological flow networks: Antagonism between hydrodynamic and metabolic stimuli as driver of topological transitions

abstract: A plethora of computational models have been developed in recent decades to account for the morphogenesis of complex biological fluid networks, such as capillary beds. Contemporary adaptation models are based on optimization schemes where networks react and adapt toward given flow patterns. Doing so, a system reduces dissipation and network volume, thereby altering its final form. Yet, recent numeric studies on network morphogenesis, incorporating uptake of metabolites by the embedding tissue, have indicated the conventional approach to be insufficient. Here, we systematically study a hybrid-model which combines the network adaptation schemes intended to generate space-filling perfusion as well as optimal filtration of metabolites. As a result, we find hydrodynamic stimuli (wall-shear stress) and filtration based stimuli (uptake of metabolites) to be antagonistic as hydrodynamically optimized systems have suboptimal uptake qualities and vice versa. We show that a switch between different optimization regimes is typically accompanied with a complex transition between topologically redundant meshes and spanning trees. Depending on the metabolite demand and uptake capabilities of the adaptating networks, we are further able to demonstrate the existence of nullity re-entrant behavior and the development of compromised phenotypes such as dangling non-perfused vessels and bottlenecks.


title: A Tale of Invisibility: Constraints on New Physics in $b\to s\nu\nu$

abstract: The Belle II experiment will measure the rare decays $B\to K\nu\nu$ and $B\to K^* \nu\nu$ with increased sensitivity which can hence be expected to serve as a very efficient probe of new physics. We calculate the relevant branching ratios in low-energy effective field theory (LEFT) including an arbitrary number of massive sterile neutrinos and discuss the expected sensitivity to the different operators. We also take into account the longitudinal polarisation fraction $F_L$ and the inclusive decay rate $B\to X_s\nu\nu$. In our investigation we consider new physics dominantly contributing to one and two operators both for massless and massive (sterile) neutrinos. Our results show a powerful interplay of the exclusive decay rates $B\to K\nu\nu$ and $B\to K^*\nu\nu$, and a surprisingly large sensitivity of the inclusive decay mode to vector operators even under conservative assumptions about its uncertainty. Furthermore, the sensitivity of $F_L$ is competitive with the branching ratio of $B\to K^* \nu\nu$ in the search for new physics contributing to scalar operators and thus also complementary to $B\to K\nu\nu$ and $B\to X_s\nu\nu$.


title: Precision tests of Quantum Mechanics and CPT symmetry with entangled neutral kaons at KLOE

abstract: The quantum interference between the decays of entangled neutral kaons is studied in the process $\phi\rightarrow K_S K_L \rightarrow\pi^+\pi^-\pi^+\pi^-$, which exhibits the characteristic Einstein--Podolsky--Rosen correlations that prevent both kaons to decay into $\pi^+\pi^-$ at the same time. This constitutes a very powerful tool for testing at the utmost precision the quantum coherence of the entangled kaon pair state, and to search for tiny decoherence and CPT violation effects, which may be justified in a quantum gravity framework. The analysed data sample was collected with the KLOE detector at DA$\Phi$NE, the Frascati $\phi$-factory, and corresponds to an integrated luminosity of about 1.7 fb$^{-1}$, i.e. to about $1.7 \times 10^9$ $\phi\rightarrow K_S K_L$ decays produced. From the fit of the observed $\Delta t$ distribution, being $\Delta t$ the difference of the kaon decay times, the decoherence and CPT violation parameters of various phenomenological models are measured with a largely improved accuracy with respect to previous analyses. The results are consistent with no deviation from quantum mechanics and CPT symmetry, while for some parameters the precision reaches the interesting level at which -- in the most optimistic scenarios -- quantum gravity effects might show up. They provide the most stringent limits up to date on the considered models.


title: Structure of germanene/Al(111): a two-layers surface alloy

abstract: Unlike silicene, for which the demonstration of its existence has been done through numerous independent studies, the possibility of growing epitaxial germanene remains highly controversial. It has been recently shown by scanning tunneling microscopy that the (3 x 3) surface reconstruction formed upon Ge deposition on Al(111) presents a honeycomb structure, and it was assigned to a pure germanene monolayer. Using quantitative measurements by surface X-ray diffraction compared to density functional theory calculations, we demonstrate that this Ge/Al(111) (3 x 3) reconstruction corresponds, in fact, to a mixed Ge--Al honeycomb layer on top of an alloyed interfacial layer. The model of a germanene monolayer on top of the Al(111) surface can be completely excluded.


title: Characterizing the adversarial vulnerability of speech self-supervised learning

abstract: A leaderboard named Speech processing Universal PERformance Benchmark (SUPERB), which aims at benchmarking the performance of a shared self-supervised learning (SSL) speech model across various downstream speech tasks with minimal modification of architectures and small amount of data, has fueled the research for speech representation learning. The SUPERB demonstrates speech SSL upstream models improve the performance of various downstream tasks through just minimal adaptation. As the paradigm of the self-supervised learning upstream model followed by downstream tasks arouses more attention in the speech community, characterizing the adversarial robustness of such paradigm is of high priority. In this paper, we make the first attempt to investigate the adversarial vulnerability of such paradigm under the attacks from both zero-knowledge adversaries and limited-knowledge adversaries. The experimental results illustrate that the paradigm proposed by SUPERB is seriously vulnerable to limited-knowledge adversaries, and the attacks generated by zero-knowledge adversaries are with transferability. The XAB test verifies the imperceptibility of crafted adversarial attacks.


title: Enhancing Prototypical Few-Shot Learning by Leveraging the Local-Level Strategy

abstract: Aiming at recognizing the samples from novel categories with few reference samples, few-shot learning (FSL) is a challenging problem. We found that the existing works often build their few-shot model based on the image-level feature by mixing all local-level features, which leads to the discriminative location bias and information loss in local details. To tackle the problem, this paper returns the perspective to the local-level feature and proposes a series of local-level strategies. Specifically, we present (a) a local-agnostic training strategy to avoid the discriminative location bias between the base and novel categories, (b) a novel local-level similarity measure to capture the accurate comparison between local-level features, and (c) a local-level knowledge transfer that can synthesize different knowledge transfers from the base category according to different location features. Extensive experiments justify that our proposed local-level strategies can significantly boost the performance and achieve 2.8%-7.2% improvements over the baseline across different benchmark datasets, which also achieves state-of-the-art accuracy.


title: Succinct Data Structure for Path Graphs

abstract: We consider the problem of designing a succinct data structure for {\it path graphs} (which are a proper subclass of chordal graphs and a proper superclass of interval graphs) on $n$ vertices while supporting degree, adjacency, and neighborhood queries efficiently. We provide the following two solutions for this problem: - an $n \log n+o(n \log n)$-bit succinct data structure that supports adjacency query in $O(\log n)$ time, neighborhood query in $O(d \log n)$ time and finally, degree query in $\min\{O(\log^2 n), O(d \log n)\}$ where $d$ is the degree of the queried vertex. - an $O(n \log^2 n)$-bit space-efficient data structure that supports adjacency and degree queries in $O(1)$ time, and the neighborhood query in $O(d)$ time where $d$ is the degree of the queried vertex. Central to our data structures is the usage of the classical heavy path decomposition by Sleator and Tarjan~\cite{ST}, followed by a careful bookkeeping using an orthogonal range search data structure using wavelet trees~\cite{Makinen2007} among others, which maybe of independent interest for designing succinct data structures for other graph classes.


title: threaTrace: Detecting and Tracing Host-based Threats in Node Level Through Provenance Graph Learning

abstract: Host-based threats such as Program Attack, Malware Implantation, and Advanced Persistent Threats (APT), are commonly adopted by modern attackers. Recent studies propose leveraging the rich contextual information in data provenance to detect threats in a host. Data provenance is a directed acyclic graph constructed from system audit data. Nodes in a provenance graph represent system entities (e.g., $processes$ and $files$) and edges represent system calls in the direction of information flow. However, previous studies, which extract features of the whole provenance graph, are not sensitive to the small number of threat-related entities and thus result in low performance when hunting stealthy threats. We present threaTrace, an anomaly-based detector that detects host-based threats at system entity level without prior knowledge of attack patterns. We tailor GraphSAGE, an inductive graph neural network, to learn every benign entity's role in a provenance graph. threaTrace is a real-time system, which is scalable of monitoring a long-term running host and capable of detecting host-based intrusion in their early phase. We evaluate threaTrace on three public datasets. The results show that threaTrace outperforms three state-of-the-art host intrusion detection systems.