title: Hierarchically Coordinated Energy Management for A Regional Multi-microgrid Community

abstract: This paper proposes a novel hierarchically coordinated energy management system (EMS) for a regional community (e.g., residential area, campus, industrial park, etc.) comprising multiple small-scale microgrids (MGs) (e.g., houses, buildings, etc.). It aims to minimize the total operational cost of the MG community and maximize the individual benefit of each MG simultaneously. At the local level inside each MG, with the detailed modeling of various energy resources including photovoltaics (PVs), energy storages (ESs), electric vehicles (EVs) and dispatchable loads, the individual optimization problem is formulated as a mixed-integer linear program (MILP). Local EMSs makes power dispatch decisions for all the controllable units to minimize the operational cost in individual MGs. At the community level, a novel pairing algorithm is proposed to explicitly find the MG pairings with surplus and deficit. The community-level EMS employs the pairing algorithm to determine specific power exchanges among MGs and minimizes the energy transactions with the upstream grid. The operational cost of each individual MG is further reduced by additional economic benefits procured by the community-level EMS. The proposed method has distinguishing advantages on modeling generality, computational complexity and privacy protection, and its performance is verified by the simulation results.


title: Bacteriophage classification for assembled contigs using Graph Convolutional Network

abstract: Motivation: Bacteriophages (aka phages), which mainly infect bacteria, play key roles in the biology of microbes. As the most abundant biological entities on the planet, the number of discovered phages is only the tip of the iceberg. Recently, many new phages have been revealed using high throughput sequencing, particularly metagenomic sequencing. Compared to the fast accumulation of phage-like sequences, there is a serious lag in taxonomic classification of phages. High diversity, abundance, and limited known phages pose great challenges for taxonomic analysis. In particular, alignment-based tools have difficulty in classifying fast accumulating contigs assembled from metagenomic data. Results: In this work, we present a novel semi-supervised learning model, named PhaGCN, to conduct taxonomic classification for phage contigs. In this learning model, we construct a knowledge graph by combining the DNA sequence features learned by convolutional neural network (CNN) and protein sequence similarity gained from gene-sharing network. Then we apply graph convolutional network (GCN) to utilize both the labeled and unlabeled samples in training to enhance the learning ability. We tested PhaGCN on both simulated and real sequencing data. The results clearly show that our method competes favorably against available phage classification tools.


title: DPointNet: A Density-Oriented PointNet for 3D Object Detection in Point Clouds

abstract: For current object detectors, the scale of the receptive field of feature extraction operators usually increases layer by layer. Those operators are called scale-oriented operators in this paper, such as the convolution layer in CNN, and the set abstraction layer in PointNet++. The scale-oriented operators are appropriate for 2D images with multi-scale objects, but not natural for 3D point clouds with multi-density but scale-invariant objects. In this paper, we put forward a novel density-oriented PointNet (DPointNet) for 3D object detection in point clouds, in which the density of points increases layer by layer. In experiments for object detection, the DPointNet is applied to PointRCNN, and the results show that the model with the new operator can achieve better performance and higher speed than the baseline PointRCNN, which verify the effectiveness of the proposed DPointNet.


title: PAC-Bayes Bounds for Meta-learning with Data-Dependent Prior

abstract: By leveraging experience from previous tasks, meta-learning algorithms can achieve effective fast adaptation ability when encountering new tasks. However it is unclear how the generalization property applies to new tasks. Probably approximately correct (PAC) Bayes bound theory provides a theoretical framework to analyze the generalization performance for meta-learning. We derive three novel generalisation error bounds for meta-learning based on PAC-Bayes relative entropy bound. Furthermore, using the empirical risk minimization (ERM) method, a PAC-Bayes bound for meta-learning with data-dependent prior is developed. Experiments illustrate that the proposed three PAC-Bayes bounds for meta-learning guarantee a competitive generalization performance guarantee, and the extended PAC-Bayes bound with data-dependent prior can achieve rapid convergence ability.


title: Role of Attentive History Selection in Conversational Information Seeking

abstract: The rise of intelligent assistant systems like Siri and Alexa have led to the emergence of Conversational Search, a research track of Information Retrieval (IR) that involves interactive and iterative information-seeking user-system dialog. Recently released OR-QuAC and TCAsT19 datasets narrow their research focus on the retrieval aspect of conversational search i.e. fetching the relevant documents (passages) from a large collection using the conversational search history. Currently proposed models for these datasets incorporate history in retrieval by appending the last N turns to the current question before encoding. We propose to use another history selection approach that dynamically selects and weighs history turns using the attention mechanism for question embedding. The novelty of our approach lies in experimenting with soft attention-based history selection approach in an open-retrieval setting.


title: What is a Blockchain? A Definition to Clarify the Role of the Blockchain in the Internet of Things

abstract: The use of the term blockchain is documented for disparate projects, from cryptocurrencies to applications for the Internet of Things (IoT), and many more. The concept of blockchain appears therefore blurred, as it is hard to believe that the same technology can empower applications that have extremely different requirements and exhibit dissimilar performance and security. This position paper elaborates on the theory of distributed systems to advance a clear definition of blockchain that allows us to clarify its role in the IoT. This definition inextricably binds together three elements that, as a whole, provide the blockchain with those unique features that distinguish it from other distributed ledger technologies: immutability, transparency and anonimity. We note however that immutability comes at the expense of remarkable resource consumption, transparency demands no confidentiality and anonymity prevents user identification and registration. This is in stark contrast to the requirements of most IoT applications that are made up of resource constrained devices, whose data need to be kept confidential and users to be clearly known. Building on the proposed definition, we derive new guidelines for selecting the proper distributed ledger technology depending on application requirements and trust models, identifying common pitfalls leading to improper applications of the blockchain. We finally indicate a feasible role of the blockchain for the IoT: myriads of local, IoT transactions can be aggregated off-chain and then be successfully recorded on an external blockchain as a means of public accountability when required.


title: DV-DVFS: Merging Data Variety and DVFS Technique to Manage the Energy Consumption of Big Data Processing

abstract: Data variety is one of the most important features of Big Data. Data variety is the result of aggregating data from multiple sources and uneven distribution of data. This feature of Big Data causes high variation in the consumption of processing resources such as CPU consumption. This issue has been overlooked in previous works. To overcome the mentioned problem, in the present work, we used Dynamic Voltage and Frequency Scaling (DVFS) to reduce the energy consumption of computation. To this goal, we consider two types of deadlines as our constraint. Before applying the DVFS technique to computer nodes, we estimate the processing time and the frequency needed to meet the deadline. In the evaluation phase, we have used a set of data sets and applications. The experimental results show that our proposed approach surpasses the other scenarios in processing real datasets. Based on the experimental results in this paper, DV-DVFS can achieve up to 15% improvement in energy consumption.


title: CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models

abstract: Fine-tuning pre-trained language models (PLMs) has demonstrated its effectiveness on various downstream NLP tasks recently. However, in many low-resource scenarios, the conventional fine-tuning strategies cannot sufficiently capture the important semantic features for downstream tasks. To address this issue, we introduce a novel framework (named "CSS-LM") to improve the fine-tuning phase of PLMs via contrastive semi-supervised learning. Specifically, given a specific task, we retrieve positive and negative instances from large-scale unlabeled corpora according to their domain-level and class-level semantic relatedness to the task. We then perform contrastive semi-supervised learning on both the retrieved unlabeled and original labeled instances to help PLMs capture crucial task-related semantic features. The experimental results show that CSS-LM achieves better results than the conventional fine-tuning strategy on a series of downstream tasks with few-shot settings, and outperforms the latest supervised contrastive fine-tuning strategies. Our datasets and source code will be available to provide more details.


title: Curving Origami with Mechanical Frustration

abstract: We study the three-dimensional equilibrium shape of a shell formed by a deployed accordion-like origami, made from an elastic sheet decorated by a series of parallel creases crossed by a central longitudinal crease. Surprisingly, while the imprinted crease network does not exhibit a geodesic curvature, the emergent structure is characterized by an effective curvature produced by the deformed central fold. Moreover, both finite element analysis and manually made mylar origamis show a robust empirical relation between the imprinted crease network's dimensions and the apparent curvature. A detailed examination of this geometrical relation shows the existence of three typical elastic deformations, which in turn induce three distinct types of morphogenesis. We characterize the corresponding kinematics of crease network deformations and determine their phase diagram. Taking advantage of the frustration caused by the competition between crease stiffness and kinematics of crease network deformations, we provide a novel tool for designing curved origami structures constrained by strong geometrical properties.


title: Relativistic corrections to decays of heavy baryons in the quark model

abstract: We investigate relativistic corrections of order $1/m^{2}$, where $m$ is the constituent quark mass, to heavy baryon decays by emitting one pseudoscalar meson in the quark model. This work is motivated by shortcomings in the previous studies in the nonrelativistic quark model for decays of the Roper-like states such as $\Lambda_c(2765)$. We find that the relativistic corrections due to the internal motion of quarks are essential ingredients in improving their decay properties such that the decay widths are significantly increased. In addition, such corrections can explain a phenomenological suppression of the quark axial-vector coupling constant $g_A^q$ for the $\Sigma_c(2455)$ and $\Sigma_c(2520)$ decays.


title: Feature augmentation for the inversion of the Fourier transform with limited data

abstract: We investigate an interpolation/extrapolation method that, given scattered observations of the Fourier transform, approximates its inverse. The interpolation algorithm takes advantage of modelling the available data via a shape-driven interpolation based on Variably Scaled Kernels (VSKs), whose implementation is here tailored for inverse problems. The so-constructed interpolants are used as inputs for a standard iterative inversion scheme. After providing theoretical results concerning the spectrum of the VSK collocation matrix, we test the method on astrophysical imaging benchmarks.


title: Room-temperature bipolar valleytronic transistor in MoS2/WSe2 heterostructures

abstract: Valley degree of freedom in the 2D semiconductor is a promising platform for the next generation optoelectronics. Electrons in different valleys can have opposite Berry curvature, leading to the valley Hall effect (VHE). However, VHE without the plasmonic structure's assistance has only been reported in cryogenic temperature, limiting its practical application. Here, we report the observation of VHE at room temperature in the MoS2/WSe2 heterostructures. We also uncover that both the magnitude and the polarity of the VHE in the 2D heterostructure is gate tunable. We attribute this to the opposite VHE contribution from the electron and hole in different layers. These results indicate the bipolar transport nature of our valleytronic transistor. Utilizing this gate tunability, we demonstrate a bipolar valleytronic transistor. Our results can be used to improve the ON/OFF ratio of the valleytronic transistor and to realize more versatile valleytronics logic circuits.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.optics quant-ph


title: Bound and Subradiant Multi-Atom Excitations in an Atomic Array with Nonreciprocal Couplings

abstract: Collective decays of multiply-excited atoms become subradiant and bound in space when they are strongly coupled to the guided modes in an atom-waveguide interface. In this interface, we analyze their average density-density and modified third-order correlations via Kubo cumulant expansions, which can arise and sustain for long time. The shape-preserving dimers and trimers of atomic excitations emerge in the most subradiant coupling regime of light-induced dipole-dipole interactions. This leads to a potential application of quantum information processing and quantum storage in the encoded nonreciprocal spin diffusion, where its diffusion speed depends on the initial coherence between the excited atoms and is robust to their relative phase fluctuations. The state-dependent photon routing can be viable as well in this interface.


title: Non-stationary Online Learning with Memory and Non-stochastic Control

abstract: We study the problem of Online Convex Optimization (OCO) with memory, which allows loss functions to depend on past decisions and thus captures temporal effects of learning problems. In this paper, we introduce dynamic policy regret as the performance measure to design algorithms robust to non-stationary environments, which competes algorithms' decisions with a sequence of changing comparators. We propose a novel algorithm for OCO with memory that provably enjoys an optimal dynamic policy regret in terms of time horizon, non-stationarity measure, and memory length. The key technical challenge is how to control the switching cost, the cumulative movements of player's decisions, which is neatly addressed by a novel switching-cost-aware online ensemble approach equipped with a new meta-base decomposition of dynamic policy regret and a careful design of meta-learner and base-learner that explicitly regularizes the switching cost. The results are further applied to tackle non-stationarity in online non-stochastic control (Agarwal et al., 2019), i.e., controlling a linear dynamical system with adversarial disturbance and convex cost functions. We derive a novel gradient-based controller with dynamic policy regret guarantees, which is the first controller provably competitive to a sequence of changing policies for online non-stochastic control.


title: Frame Codes For Distributed Coded Computation

abstract: Distributed computation is a framework used to break down a complex computational task into smaller tasks and distributing them among computational nodes. Erasure correction codes have recently been introduced and have become a popular workaround to the well known ``straggling nodes'' problem, in particular, by matching linear coding for linear computation tasks. It was observed that decoding tends to amplify the computation ``noise'', i.e., the numerical errors at the computation nodes. We propose taking advantage of the case that more nodes return than minimally required. We show how a clever construction of a polynomial code, inspired by recent results on robust frames, can significantly reduce the amplification of noise, and achieves graceful degradation with the number of straggler nodes.


title: Hermitian adjacency matrix of the second kind for mixed graphs

abstract: This contribution gives an extensive study on spectra of mixed graphs via its Hermitian adjacency matrix of the second kind { ($N$-matrix for short)} introduced by Mohar \cite{0001}. This matrix is indexed by the vertices of the mixed graph, and the entry corresponding to an arc from $u$ to $v$ is equal to the sixth root of unity $\omega=\frac{1+{\bf i}\sqrt{3}}{2}$ (and its symmetric entry is $\bar{\omega}=\frac{1-{\bf i}\sqrt{3}}{2}$); the entry corresponding to an undirected edge is equal to 1, and 0 otherwise. The main results of this paper include the following: {equivalent} conditions for a mixed graph that shares the same spectrum of its $N$-matrix with its underlying graph are given. A sharp upper bound on the spectral radius is established and the corresponding extremal mixed graphs are identified. Operations which are called two-way and three-way switchings are discussed--they give rise to some cospectral mixed graphs. We extract all the mixed graphs whose rank of its $N$-matrix is $2$ (resp. 3). Furthermore, we show that {if $M_G$ is a connected mixed graph with rank $2,$ then $M_G$ is switching equivalent to each connected mixed graph to which it is cospectral}. However, this does not hold for some connected mixed graphs with rank $3$. We identify all mixed graphs whose eigenvalues of its $N$-matrix lie in the range $(-\alpha,\, \alpha)$ for $\alpha\in\left\{\sqrt{2},\,\sqrt{3},\,2\right\}$.


title: Dissipative soliton interaction in Kerr resonators with high-order dispersion

abstract: We consider an optical resonator containing a photonic crystal fiber and driven coherently by an injected beam. This device is described by a generalized Lugiato-Lefever equation with fourth order dispersion. We use an asymptotic approach to derive interaction equations governing the slow time evolution of the coordinates of two interacting dissipative solitons. We show that Cherenkov radiation induced by positive fourth-order dispersion leads to a strong increase of the interaction force between the solitons. As a consequence, large number of equidistant soliton bound states in the phase space of the interaction equations can be stabilized. We show that the presence of even small spectral filtering not only dampens the Cherenkov radiation at the soliton tails and reduces the interaction strength, but can also affect the the bound state stability.


title: Time-Domain Speech Extraction with Spatial Information and Multi Speaker Conditioning Mechanism

abstract: In this paper, we present a novel multi-channel speech extraction system to simultaneously extract multiple clean individual sources from a mixture in noisy and reverberant environments. The proposed method is built on an improved multi-channel time-domain speech separation network which employs speaker embeddings to identify and extract multiple targets without label permutation ambiguity. To efficiently inform the speaker information to the extraction model, we propose a new speaker conditioning mechanism by designing an additional speaker branch for receiving external speaker embeddings. Experiments on 2-channel WHAMR! data show that the proposed system improves by 9% relative the source separation performance over a strong multi-channel baseline, and it increases the speech recognition accuracy by more than 16% relative over the same baseline.


title: The Balanced Mode Decomposition Algorithm for Data-Driven LPV Low-Order Models of Aeroservoelastic Systems

abstract: A novel approach to reduced-order modeling of high-dimensional time varying systems is proposed. It leverages the formalism of the Dynamic Mode Decomposition technique together with the concept of balanced realization. It is assumed that the only information available on the system comes from input, state, and output trajectories generated by numerical simulations or recorded and estimated during experiments, thus the approach is fully data-driven. The goal is to obtain an input-output low dimensional linear model which approximates the system across its operating range. Since the dynamics of aeroservoelastic systems markedly changes in operation (e.g. due to change in flight speed or altitude), time-varying features are retained in the constructed models. This is achieved by generating a Linear Parameter-Varying representation made of a collection of state-consistent linear time-invariant reduced-order models. The algorithm formulation hinges on the idea of replacing the orthogonal projection onto the Proper Orthogonal Decomposition modes, used in Dynamic Mode Decomposition-based approaches, with a balancing oblique projection constructed entirely from data. As a consequence, the input-output information captured in the lower-dimensional representation is increased compared to other projections onto subspaces of same or lower size. Moreover, a parameter-varying projection is possible while also achieving state-consistency. The validity of the proposed approach is demonstrated on a morphing wing for airborne wind energy applications by comparing the performance against two algorithms recently proposed in the literature. Comparisons cover both prediction accuracy and performance in model predictive control applications.


title: Quantum Conductors Formation and Resistive Switching Memory Effects in Zirconia Nanotubes

abstract: The development prospects of memristive elements for non-volatile memory with use of the metal-dielectric-metal sandwich structures with a thin oxide layer are due to the possibility of reliable forming the sustained functional states with quantized resistance. In the paper we study the properties of fabricated memristors based on the non-stoichiometric $ZrO_2$ nanotubes in different resistive switching modes. Anodic oxidation of the $Zr$ foil has been used to synthesize a zirconia layer of $1.7$ $\mu$$m$ thickness, consisting of an ordered array of vertically oriented nanotubes with outer diameter of 75 nm. $Zr/ZrO_2/Au$ sandwich structures have been fabricated by mask magnetron deposition. The effects of resistive switching in the $Zr/ZrO_2/Au$ memristors in unipolar and bipolar modes have been investigated. The resistance ratios $\geq3\cdot10^4$ between high-resistance (HRS) and low-resistance (LRS) states have been evaluated. It has been founded the conductivity of LRS is quantized in a wide range with minimum value of $0.5G_0=38.74$ $\mu$$S$ due to the formation of quantum conductors based on oxygen vacancies ($V_O$). Resistive switching mechanisms of $Zr/ZrO_2/Au$ memristors with allowing for migration of $V_O$ in an applied electric field have been proposed. It has been shown that the ohmic type and space charge limited conductivities are realized in the LRS and HRS, correspondingly. We present the results which can be used for development of effective memristors based on functional $Zr/ZrO_2/Au$ nanolayered structure with multiple resistive states and high resistance ratio.


title: Tactical Optimism and Pessimism for Deep Reinforcement Learning

abstract: In recent years, deep off-policy actor-critic algorithms have become a dominant approach to reinforcement learning for continuous control. One of the primary drivers of this improved performance is the use of pessimistic value updates to address function approximation errors, which previously led to disappointing performance. However, a direct consequence of pessimism is reduced exploration, running counter to theoretical support for the efficacy of optimism in the face of uncertainty. So which approach is best? In this work, we show that the most effective degree of optimism can vary both across tasks and over the course of learning. Inspired by this insight, we introduce a novel deep actor-critic framework, Tactical Optimistic and Pessimistic (TOP) estimation, which switches between optimistic and pessimistic value learning online. This is achieved by formulating the selection as a multi-arm bandit problem. We show in a series of continuous control tasks that TOP outperforms existing methods which rely on a fixed degree of optimism, setting a new state of the art in challenging pixel-based environments. Since our changes are simple to implement, we believe these insights can easily be incorporated into a multitude of off-policy algorithms.


title: Ultrafast Evolution of Bulk, Surface and Surface Resonance States in Photoexcited Bi$_{2}$Te$_{3}$

abstract: We use circular dichroism (CD) in time- and angle-resolved photoemission spectroscopy (trARPES) to measure the femtosecond charge dynamics in the topological insulator (TI) Bi$_{2}$Te$_{3}$. We detect clear CD signatures from topological surface states (TSS) and surface resonance (SR) states. In time-resolved measurements, independently from the pump polarization or intensity, the CD shows a dynamics which provides access to the unexplored electronic evolution in unoccupied states of Bi$_{2}$Te$_{3}$. In particular, we are able to disentangle the unpolarized electron dynamics in the bulk states from the spin-textured TSS and SR states on the femtosecond timescale. Our study demonstrates that photoexcitation mainly involves the bulk states and is followed by sub-picosecond transport to the surface. This provides essential details on intra- and interband scatterings in the relaxation process of TSS and SR states. Our results reveal the significant role of SRs in the subtle ultrafast interaction between bulk and surface states in TIs.


title: Physics-guided deep learning framework for predictive modeling of the Reynolds stress anisotropy

abstract: Despite a cost-effective option in practical engineering, Reynolds-averaged Navier-Stokes simulations are facing the ever-growing demand for more accurate turbulence models. Recently, emerging machine learning techniques are making promising impact in turbulence modeling, but in their infancy for widespread industrial adoption. Towards this end, this work proposes a universal, inherently interpretable machine learning framework of turbulence modeling, which mainly consists of two parallel machine-learning-based modules to respectively infer the integrity basis and closure coefficients. At every phase of the model development, both data representing the evolution dynamics of turbulence and domain-knowledge representing prior physical considerations are properly fed and reasonably converted into modeling knowledge. Thus, the developed model is both data- and knowledge-driven. Specifically, a version with pre-constrained integrity basis is provided to demonstrate detailedly how to integrate domain-knowledge, how to design a fair and robust training strategy, and how to evaluate the data-driven model. Plain neural network and residual neural network as the building blocks in each module are compared. Emphases are made on three-fold: (i) a compact input feature parameterizing the newly-proposed turbulent timescale is introduced to release nonunique mappings between conventional input arguments and output Reynolds stress; (ii) the realizability limiter is developed to overcome under-constraint of modeled stress; and (iii) constraints of fairness and noisy-sensitivity are first included in the training procedure. In such endeavors, an invariant, realizable, unbiased and robust data-driven turbulence model is achieved, and does gain good generalization across channel flows at different Reynolds numbers and duct flows with various aspect ratios.


title: From Machine Learning to Transfer Learning in Laser-Induced Breakdown Spectroscopy: the Case of Rock Analysis for Mars Exploration

abstract: With the ChemCam instrument, laser-induced breakdown spectroscopy (LIBS) has successively contributed to Mars exploration by determining elemental compositions of the soil, crust and rocks. Two new lunched missions, Chinese Tianwen 1 and American Perseverance, will further increase the number of LIBS instruments on Mars after the planned landings in spring 2021. Such unprecedented situation requires a reinforced research effort on the methods of LIBS spectral data treatment. Although the matrix effects correspond to a general issue in LIBS, they become accentuated in the case of rock analysis for Mars exploration, because of the large variation of rock composition leading to the chemical matrix effect, and the difference in morphology between laboratory standard samples (in pressed pellet, glass or ceramics) used to establish calibration models and natural rocks encountered on Mars, leading to the physical matric effect. The chemical matrix effect has been tackled in the ChemCam project with large sets of laboratory standard samples offering a good representation of various compositions of Mars rocks. The present work deals with the physical matrix effect which is still expecting a satisfactory solution. The approach consists in introducing transfer learning in LIBS data treatment. For the specific case of total alkali-silica (TAS) classification of natural rocks, the results show a significant improvement of the prediction capacity of pellet sample-based models when trained together with suitable information from rocks in a procedure of transfer learning. The correct classification rate of rocks increases from 33.3% with a machine learning model to 83.3% with a transfer learning model.


title: Observation of Dynamic Screening in the Excited Exciton States in Multi-layered MoS$_2$

abstract: Excitonic resonance and binding energies can be altered by controlling the environmental screening of the attractive Coulomb potential. Although this screening response is often assumed to be static, the time evolution of the excitonic quasiparticles manifests a frequency-dependence in its Coulomb screening efficacy. In this letter, we investigate a ground (1s) and first excited exciton state (2s) in a multi-layered transition metal dichalcogenide (MoS$_2$) upon ultrafast photo-excitation. We explore the dynamic screening effects on the latter and show its resonance frequency is the relevant frequency at which screening from the smaller-sized 1s counterparts is effective. Our finding sheds light on new avenues of external tuning on excitonic properties.


title: The role of local bond-order at crystallization in a simple supercooled liquid

abstract: Large scale Molecular Dynamics simulations of sixty-five systems with N=80000 Lennard-Jones particles at two different supercooled liquid state points reveals, that the supercooled states contain spatially heterogeneous distributed subdomains of particles with significant higher bond-order than the mean bond-order in the supercooled liquid. The onset of crystallization starts in such an area with relative high six-ford bond-order for a supercooled state, but low bond-order for a fcc crystal. The critical nucleus of N \approx 70 particles is surrounded by many hundred of particles with relative high supercooled liquid bond-order and many of these particles are aligned with the crystal ordered particles in the critical nucleus. The crystallizations are very fast and supported by a fast growth of the supercooled areas with relative high liquid bond-order. The crystallization are to fcc crystals, but with significant part of the crystallizations exhibit five fold arrangements of polycrystalline subdomains mainly with fcc crystal order and sign of hcp crystallites.


title: MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Square

abstract: The rapid development of autonomous driving and mobile mapping calls for off-the-shelf LiDAR SLAM solutions that are adaptive to LiDARs of different specifications on various complex scenarios. To this end, we propose MULLS, an efficient, low-drift, and versatile 3D LiDAR SLAM system. For the front-end, roughly classified feature points (ground, facade, pillar, beam, etc.) are extracted from each frame using dual-threshold ground filtering and principal components analysis. Then the registration between the current frame and the local submap is accomplished efficiently by the proposed multi-metric linear least square iterative closest point algorithm. Point-to-point (plane, line) error metrics within each point class are jointly optimized with a linear approximation to estimate the ego-motion. Static feature points of the registered frame are appended into the local map to keep it updated. For the back-end, hierarchical pose graph optimization is conducted among regularly stored history submaps to reduce the drift resulting from dead reckoning. Extensive experiments are carried out on three datasets with more than 100,000 frames collected by seven types of LiDAR on various outdoor and indoor scenarios. On the KITTI benchmark, MULLS ranks among the top LiDAR-only SLAM systems with real-time performance.


title: A note on the spectrum of irreducible operators and semigroups

abstract: Let $T$ denote a positive operator with spectral radius $1$ on, say, an $L^p$-space. A classical result in infinite dimensional Perron--Frobenius theory says that, if $T$ is irreducible and power bounded, then its peripheral point spectrum is either empty or a subgroup of the unit circle. In this note we show that the analogous assertion for the entire peripheral spectrum fails. More precisely, for every finite union $U$ of finite subgroups of the unit circle we construct an irreducible stochastic operator on $\ell^1$ whose peripheral spectrum equals $U$. We also give a similar construction for the $C_0$-semigroup case.


title: SeReNe: Sensitivity based Regularization of Neurons for Structured Sparsity in Neural Networks

abstract: Deep neural networks include millions of learnable parameters, making their deployment over resource-constrained devices problematic. SeReNe (Sensitivity-based Regularization of Neurons) is a method for learning sparse topologies with a structure, exploiting neural sensitivity as a regularizer. We define the sensitivity of a neuron as the variation of the network output with respect to the variation of the activity of the neuron. The lower the sensitivity of a neuron, the less the network output is perturbed if the neuron output changes. By including the neuron sensitivity in the cost function as a regularization term, we areable to prune neurons with low sensitivity. As entire neurons are pruned rather then single parameters, practical network footprint reduction becomes possible. Our experimental results on multiple network architectures and datasets yield competitive compression ratios with respect to state-of-the-art references.


title: Redshift drift as a model independent probe of dark energy

abstract: It is well known that positive values of redshift drift is a signature of dark energy within the conventionally studied Friedmann-Lema\^{\i}tre-Robertson-Walker (FLRW) universe models. Here we show -- without making assumptions on the metric tensor of the Universe -- that redshift drift is a promising direct probe of violation of the strong energy condition within the theory of general relativity.


title: Turbulence modulations and drag reduction by inertialess spheroids in turbulent channel flow

abstract: Previous studies on nonspherical particle-fluid interaction were mostly confined to elongated fiber-like particles, which were observed to induce turbulence drag reduction. However, with the presence of tiny disk-like particles how wall turbulence is modulated and whether drag reduction occurs are still unknown. Motivated by those open questions, we performed two-way coupled direct numerical simulations of inertialess spheroids in turbulent channel flow by an Eulerian-Lagrangian approach. The additional stress accounts for the feedback from inertialess spheroids on the fluid phase. The results demonstrate that both rigid elongated fibers (prolate spheroids) and thin disks (oblate spheroids) can lead to significant turbulence modulations and drag reduction. However, the disk-induced drag reduction is less pronounced than that of rigid fibers with the same volume fraction. Typical features of drag-reduced flows by additives are observed in both flow statistics and turbulence coherent structures. Moreover, in contrast to one-way simulations, the two-way coupled results of spheroidal particles exhibit stronger preferential alignments and lower rotation rates. At the end we propose a drag reduction mechanism by inertialess spheroids and explain the different performance for drag reduction by fibers and disks. We find that the spheroidal particles weaken the quasistreamwise vortices through negative work and, therefore, the Reynolds shear stress is reduced. However, the mean shear stress generated by particles, which is shape-dependent, partly compensates for the reduction of Reynolds shear stress and thus affects the efficiency of drag reduction. The present study implies that tiny disk-like particles can be an alternative drag reduction agent in wall turbulence.


title: Hyperparameter Optimization with Differentiable Metafeatures

abstract: Metafeatures, or dataset characteristics, have been shown to improve the performance of hyperparameter optimization (HPO). Conventionally, metafeatures are precomputed and used to measure the similarity between datasets, leading to a better initialization of HPO models. In this paper, we propose a cross dataset surrogate model called Differentiable Metafeature-based Surrogate (DMFBS), that predicts the hyperparameter response, i.e. validation loss, of a model trained on the dataset at hand. In contrast to existing models, DMFBS i) integrates a differentiable metafeature extractor and ii) is optimized using a novel multi-task loss, linking manifold regularization with a dataset similarity measure learned via an auxiliary dataset identification meta-task, effectively enforcing the response approximation for similar datasets to be similar. We compare DMFBS against several recent models for HPO on three large meta-datasets and show that it consistently outperforms all of them with an average 10% improvement. Finally, we provide an extensive ablation study that examines the different components of our approach.


title: EEGFuseNet: Hybrid Unsupervised Deep Feature Characterization and Fusion for High-Dimensional EEG with An Application to Emotion Recognition

abstract: How to effectively and efficiently extract valid and reliable features from high-dimensional electroencephalography (EEG), particularly how to fuse the spatial and temporal dynamic brain information into a better feature representation, is a critical issue in brain data analysis. Most current EEG studies work in a task driven manner and explore the valid EEG features with a supervised model, which would be limited by the given labels to a great extent. In this paper, we propose a practical hybrid unsupervised deep convolutional recurrent generative adversarial network based EEG feature characterization and fusion model, which is termed as EEGFuseNet. EEGFuseNet is trained in an unsupervised manner, and deep EEG features covering both spatial and temporal dynamics are automatically characterized. Comparing to the existing features, the characterized deep EEG features could be considered to be more generic and independent of any specific EEG task. The performance of the extracted deep and low-dimensional features by EEGFuseNet is carefully evaluated in an unsupervised emotion recognition application based on three public emotion databases. The results demonstrate the proposed EEGFuseNet is a robust and reliable model, which is easy to train and performs efficiently in the representation and fusion of dynamic EEG features. In particular, EEGFuseNet is established as an optimal unsupervised fusion model with promising cross-subject emotion recognition performance. It proves EEGFuseNet is capable of characterizing and fusing deep features that imply comparative cortical dynamic significance corresponding to the changing of different emotion states, and also demonstrates the possibility of realizing EEG based cross-subject emotion recognition in a pure unsupervised manner.


title: Adversarial Training of Variational Auto-encoders for Continual Zero-shot Learning(A-CZSL)

abstract: Most of the existing artificial neural networks(ANNs) fail to learn continually due to catastrophic forgetting, while humans can do the same by maintaining previous tasks' performances. Although storing all the previous data can alleviate the problem, it takes a large memory, infeasible in real-world utilization. We propose a continual zero-shot learning model(A-CZSL) that is more suitable in real-case scenarios to address the issue that can learn sequentially and distinguish classes the model has not seen during training. Further, to enhance the reliability, we develop A-CZSL for a single head continual learning setting where task identity is revealed during the training process but not during the testing. We present a hybrid network that consists of a shared VAE module to hold information of all tasks and task-specific private VAE modules for each task. The model's size grows with each task to prevent catastrophic forgetting of task-specific skills, and it includes a replay approach to preserve shared skills. We demonstrate our hybrid model outperforms the baselines and is effective on several datasets, i.e., CUB, AWA1, AWA2, and aPY. We show our method is superior in class sequentially learning with ZSL(Zero-Shot Learning) and GZSL(Generalized Zero-Shot Learning).


title: Berry curvature induced magnetotransport in 3D noncentrosymmetric metals

abstract: We study the magnetoelectric and magnetothermal transport properties of noncentrosymmetric metals using semiclassical Boltzmann transport formalism by incorporating the effects of Berry curvature and orbital magnetic moment. These effects impart quadratic-B dependence to the magnetoelectric and magnetothermal conductivities, leading to intriguing phenomena such as planar Hall effect, negative magnetoresistance, planar Nernst effect and negative Seebeck effect. The transport coefficients associated with these effects show the usual oscillatory behavior with respect to the angle between the applied electric field and magnetic field. The bands of noncentrosymmetric metals are split by Rashba spin-orbit coupling except at a band touching point. For Fermi energy below (above) the band touching point, giant (diminished) negative magnetoresistance is observed. This difference in the nature of magnetoresistance is related to the magnitudes of the velocities, Berry curvature and orbital magnetic moment on the respective Fermi surfaces, where the orbital magnetic moment plays the dominant role. The absolute magnetoresistance and planar Hall conductivity show a decreasing (increasing) trend with Rashba coupling parameter for Fermi energy below (above) the band touching point.


title: CNN Architecture Comparison for Radio Galaxy Classification

abstract: The morphological classification of radio sources is important to gain a full understanding of galaxy evolution processes and their relation with local environmental properties. Furthermore, the complex nature of the problem, its appeal for citizen scientists and the large data rates generated by existing and upcoming radio telescopes combine to make the morphological classification of radio sources an ideal test case for the application of machine learning techniques. One approach that has shown great promise recently is Convolutional Neural Networks (CNNs). Literature, however, lacks two major things when it comes to CNNs and radio galaxy morphological classification. Firstly, a proper analysis of whether overfitting occurs when training CNNs to perform radio galaxy morphological classification using a small curated training set is needed. Secondly, a good comparative study regarding the practical applicability of the CNN architectures in literature is required. Both of these shortcomings are addressed in this paper. Multiple performance metrics are used for the latter comparative study, such as inference time, model complexity, computational complexity and mean per class accuracy. As part of this study we also investigate the effect that receptive field, stride length and coverage has on recognition performance. For the sake of completeness, we also investigate the recognition performance gains that we can obtain by employing classification ensembles. A ranking system based upon recognition and computational performance is proposed. MCRGNet, Radio Galaxy Zoo and ConvXpress (novel classifier) are the architectures that best balance computational requirements with recognition performance.


title: Exact solution of non-Hermitian systems with generalized boundary conditions: size-dependent boundary effect and fragility of skin effect

abstract: Systems with non-Hermitian skin effects are very sensitive to the imposed boundary conditions and lattice size, and thus an important question is whether non-Hermitian skin effects can survive when deviating from the open boundary condition. To unveil the origin of boundary sensitivity, we present exact solutions for one-dimensional non-Hermitian models with generalized boundary conditions and study rigorously the interplay effect of lattice size and boundary terms. Besides the open boundary condition, we identify the existence of non-Hermitian skin effect when one of the boundary hopping terms vanishes. Apart from this critical line on the boundary parameter space, we find that the skin effect is fragile under any tiny boundary perturbation in the thermodynamic limit, although it can survive in a finite size system. Moreover, we demonstrate that the non-Hermitian Su-Schreieffer-Heeger model exhibits a new phase diagram in the boundary critical line, which is different from either open or periodical boundary case.


title: Using Gaussian Processes to Design Dynamic Experiments for Black-Box Model Discrimination under Uncertainty

abstract: Diverse domains of science and engineering use parameterised mechanistic models. Engineers and scientists can often hypothesise several rival models to explain a specific process or phenomenon. Consider a model discrimination setting where we wish to find the best mechanistic, dynamic model candidate and the best model parameter estimates. Typically, several rival mechanistic models can explain the available data, so design of dynamic experiments for model discrimination helps optimally collect additional data by finding experimental settings that maximise model prediction divergence. We argue there are two main approaches in the literature for solving the optimal design problem: (i) the analytical approach, using linear and Gaussian approximations to find closed-form expressions for the design objective, and (ii) the data-driven approach, which often relies on computationally intensive Monte Carlo techniques. Olofsson et al. (ICML 35, 2018) introduced Gaussian process (GP) surrogate models to hybridise the analytical and data-driven approaches, which allowed for computationally efficient design of experiments for discriminating between black-box models. In this study, we demonstrate that we can extend existing methods for optimal design of dynamic experiments to incorporate a wider range of problem uncertainty. We also extend the Olofsson et al. (2018) method of using GP surrogate models for discriminating between dynamic black-box models. We evaluate our approach on a well-known case study from literature, and explore the consequences of using GP surrogates to approximate gradient-based methods.


title: Rotating shallow water flow under location uncertainty with a structure-preserving discretization

abstract: We introduce a physically relevant stochastic representation of the rotating shallow water equations. The derivation relies mainly on a stochastic transport principle and on a decomposition of the fluid flow into a large-scale component and a noise term that models the unresolved flow components. As for the classical (deterministic) system, this scheme, referred to as modelling under location uncertainty (LU), conserves the global energy of any realization and provides the possibility to generate an ensemble of physically relevant random simulations with a good trade-off between the model error representation and the ensemble's spread. To maintain numerically the energy conservation feature, we combine an energy (in space) preserving discretization of the underlying deterministic model with approximations of the stochastic terms that are based on standard finite volume/difference operators. The LU derivation, built from the very same conservation principles as the usual geophysical models, together with the numerical scheme proposed can be directly used in existing dynamical cores of global numerical weather prediction models. The capabilities of the proposed framework is demonstrated for an inviscid test case on the f-plane and for a barotropically unstable jet on the sphere.


title: Elliptic solutions to the KP hierarchy and elliptic Calogero-Moser model

abstract: We consider solutions of the KP hierarchy which are elliptic functions of $x=t_1$. It is known that their poles as functions of $t_2$ move as particles of the elliptic Calogero-Moser model. We extend this correspondence to the level of hierarchies and find the Hamiltonian $H_k$ of the elliptic Calogero-Moser model which governs the dynamics of poles with respect to the $k$-th hierarchical time. The Hamiltonians $H_k$ are obtained as coefficients of the expansion of the spectral curve near the marked point in which the Baker-Akhiezer function has essential singularity.


title: Robust Explanations for Private Support Vector Machines

abstract: We consider counterfactual explanations for private support vector machines (SVM), where the privacy mechanism that publicly releases the classifier guarantees differential privacy. While privacy preservation is essential when dealing with sensitive data, there is a consequent degradation in the classification accuracy due to the introduced perturbations in the classifier weights. For such classifiers, counterfactual explanations need to be robust against the uncertainties in the SVM weights in order to ensure, with high confidence, that the classification of the data instance to be explained is different than its explanation. We model the uncertainties in the SVM weights through a random vector, and formulate the explanation problem as an optimization problem with probabilistic constraint. Subsequently, we characterize the problem's deterministic equivalent and study its solution. For linear SVMs, the problem is a convex second-order cone program. For non-linear SVMs, the problem is non-convex. Thus, we propose a sub-optimal solution that is based on the bisection method. The results show that, contrary to non-robust explanations, the quality of explanations from the robust solution degrades with increasing privacy in order to guarantee a prespecified confidence level for correct classifications.


title: EMA2S: An End-to-End Multimodal Articulatory-to-Speech System

abstract: Synthesized speech from articulatory movements can have real-world use for patients with vocal cord disorders, situations requiring silent speech, or in high-noise environments. In this work, we present EMA2S, an end-to-end multimodal articulatory-to-speech system that directly converts articulatory movements to speech signals. We use a neural-network-based vocoder combined with multimodal joint-training, incorporating spectrogram, mel-spectrogram, and deep features. The experimental results confirm that the multimodal approach of EMA2S outperforms the baseline system in terms of both objective evaluation and subjective evaluation metrics. Moreover, results demonstrate that joint mel-spectrogram and deep feature loss training can effectively improve system performance.


title: Improving Accuracy and Diversity in Matching of Recommendation with Diversified Preference Network

abstract: Recently, real-world recommendation systems need to deal with millions of candidates. It is extremely challenging to conduct sophisticated end-to-end algorithms on the entire corpus due to the tremendous computation costs. Therefore, conventional recommendation systems usually contain two modules. The matching module focuses on the coverage, which aims to efficiently retrieve hundreds of items from large corpora, while the ranking module generates specific ranks for these items. Recommendation diversity is an essential factor that impacts user experience. Most efforts have explored recommendation diversity in ranking, while the matching module should take more responsibility for diversity. In this paper, we propose a novel Heterogeneous graph neural network framework for diversified recommendation (GraphDR) in matching to improve both recommendation accuracy and diversity. Specifically, GraphDR builds a huge heterogeneous preference network to record different types of user preferences, and conduct a field-level heterogeneous graph attention network for node aggregation. We also innovatively conduct a neighbor-similarity based loss to balance both recommendation accuracy and diversity for the diversified matching task. In experiments, we conduct extensive online and offline evaluations on a real-world recommendation system with various accuracy and diversity metrics and achieve significant improvements. We also conduct model analyses and case study for a better understanding of our model. Moreover, GraphDR has been deployed on a well-known recommendation system, which affects millions of users. The source code will be released.


title: Quantum Divide and Compute: Exploring The Effect of Different Noise Sources

abstract: Our recent work (Ayral et al., 2020 IEEE Computer Society Annual Symposium on VLSI (ISVLSI)) showed the first implementation of the Quantum Divide and Compute (QDC) method, which allows to break quantum circuits into smaller fragments with fewer qubits and shallower depth. QDC can thus deal with the limited number of qubits and short coherence times of noisy, intermediate-scale quantum processors. This article investigates the impact of different noise sources -- readout error, gate error and decoherence -- on the success probability of the QDC procedure. We perform detailed noise modeling on the Atos Quantum Learning Machine, allowing us to understand tradeoffs and formulate recommendations about which hardware noise sources should be preferentially optimized. We describe in detail the noise models we used to reproduce experimental runs on IBM's Johannesburg processor. This work also includes a detailed derivation of the equations used in the QDC procedure to compute the output distribution of the original quantum circuit from the output distribution of its fragments. Finally, we analyze the computational complexity of the QDC method for the circuit under study via tensor-network considerations, and elaborate on the relation the QDC method with tensor-network simulation methods.


title: Extended collinearly-improved Balitsky-Kovchegov evolution equation in target rapidity

abstract: An extended collinearly-improved Balitsky-Kovchegov evolution equation in the target rapidity representation is derived by including the running coupling corrections during the expansion of the "real" $S$-matrix. We find that the running coupling brings important corrections to the evolution equation, as one can see that there are extra contributions to the evolution kernel once the running coupling is included. To identify the significance of the corrections, we numerically solve the evolution equation with and without the running coupling contributions during the $S$-matrix expansion. The numerical results show that the scattering amplitude is largely suppressed by the running coupling corrections, which indicate that one needs to consider the running coupling contributions during the derivation of the non-linear evolution equation in the target rapidity representation.


title: Coarse selectors of groups

abstract: For a group $G$, $\mathcal{F}_G$ denotes the set of all non-empty finite subsets of $G$. We extend the finitary coarse structure of $G$ from $G\times G$ to $\mathcal{F}_G\times \mathcal{F}_G$ and say that a macro-uniform mapping $f: \mathcal{F}_G \rightarrow \mathcal{F}_G$ (resp. $f: [G]^2 \rightarrow G$) is a finitary selector (resp. 2-selector) of $G$ if $f(A)\in A$ for each $A\in \mathcal{F}_G$ (resp. $ A \in [G]^2 $). We prove that a group $G$ admits a finitary selector iff $G$ admits a 2-selector and iff $G$ is a finite extension of an infinite cyclic subgroup or $G$ is countable and locally finite. We use this result to characterize groups admitting linear orders compatible with finitary coarse structures.


title: Recent progress and challenges in magnetic tunnel junctions with 2D materials for spintronic applications

abstract: As Moore's law is gradually losing its effectiveness, developing alternative high-speed and low-energy-consuming information technology with post-silicon advanced materials is urgently needed. The successful application of tunneling magnetoresistance (TMR) in magnetic tunnel junctions (MTJs) has given rise to a tremendous economic impact on magnetic informatics, including MRAM, radio-frequency sensors, microwave generators and neuromorphic computing networks. The emergence of two-dimensional (2D) materials brings opportunities for MTJs based on 2D materials which have many attractive characters and advantages. Especially, the recently discovered intrinsic 2D ferromagnetic materials with high spin-polarization hold the promise for next-generation nanoscale MTJs. With the development of advanced 2D materials, many efforts on MTJs with 2D materials have been made both theoretically and experimentally. Various 2D materials, such as semi-metallic graphene, insulating h-BN, semiconducting MoS2, magnetic semiconducting CrI3, magnetic metallic Fe3GeTe2 and some other recently emerged 2D materials are discussed as the electrodes and/or central scattering materials of MTJs in this review. We discuss the fundamental and main issues facing MTJs, and review the current progress made with 2D MTJs, briefly comment on work with some specific 2D materials, and highlight how they address the current challenges in MTJs, and finally offer an outlook and perspective of 2D MTJs.


title: On the moduli space of the standard Cantor set

abstract: We consider a generalized Cantor set $E(\omega)$ for an infinite sequence $\omega=(q_n)_{n=1}^{\infty}$ of positive numbers with $0<q_n<1$, and examine the quasiconformal equivalence to the standard middle one-third Cantor set $E(\omega_0)$. We may give a necessary and sufficient condition for $E(\omega)$ to be quasiconformally equivalent to $E(\omega_0)$ in terms of $\omega$.


title: Tilting the playing field: Dynamical loss functions for machine learning

abstract: We show that learning can be improved by using loss functions that evolve cyclically during training to emphasize one class at a time. In underparameterized networks, such dynamical loss functions can lead to successful training for networks that fail to find a deep minima of the standard cross-entropy loss. In overparameterized networks, dynamical loss functions can lead to better generalization. Improvement arises from the interplay of the changing loss landscape with the dynamics of the system as it evolves to minimize the loss. In particular, as the loss function oscillates, instabilities develop in the form of bifurcation cascades, which we study using the Hessian and Neural Tangent Kernel. Valleys in the landscape widen and deepen, and then narrow and rise as the loss landscape changes during a cycle. As the landscape narrows, the learning rate becomes too large and the network becomes unstable and bounces around the valley. This process ultimately pushes the system into deeper and wider regions of the loss landscape and is characterized by decreasing eigenvalues of the Hessian. This results in better regularized models with improved generalization performance.


title: A self-adaptive and robust fission clustering algorithm via heat diffusion and maximal turning angle

abstract: Cluster analysis, which focuses on the grouping and categorization of similar elements, is widely used in various fields of research. A novel and fast clustering algorithm, fission clustering algorithm, is proposed in recent year. In this article, we propose a robust fission clustering (RFC) algorithm and a self-adaptive noise identification method. The RFC and the self-adaptive noise identification method are combine to propose a self-adaptive robust fission clustering (SARFC) algorithm. Several frequently-used datasets were applied to test the performance of the proposed clustering approach and to compare the results with those of other algorithms. The comprehensive comparisons indicate that the proposed method has advantages over other common methods.


title: Unsupervised Sentence-embeddings by Manifold Approximation and Projection

abstract: The concept of unsupervised universal sentence encoders has gained traction recently, wherein pre-trained models generate effective task-agnostic fixed-dimensional representations for phrases, sentences and paragraphs. Such methods are of varying complexity, from simple weighted-averages of word vectors to complex language-models based on bidirectional transformers. In this work we propose a novel technique to generate sentence-embeddings in an unsupervised fashion by projecting the sentences onto a fixed-dimensional manifold with the objective of preserving local neighbourhoods in the original space. To delineate such neighbourhoods we experiment with several set-distance metrics, including the recently proposed Word Mover's distance, while the fixed-dimensional projection is achieved by employing a scalable and efficient manifold approximation method rooted in topological data analysis. We test our approach, which we term EMAP or Embeddings by Manifold Approximation and Projection, on six publicly available text-classification datasets of varying size and complexity. Empirical results show that our method consistently performs similar to or better than several alternative state-of-the-art approaches.


title: Brain-computer interface with rapid serial multimodal presentation using artificial facial images and voice

abstract: Electroencephalography (EEG) signals elicited by multimodal stimuli can drive brain-computer interfaces (BCIs), and research has demonstrated that visual and auditory stimuli can be employed simultaneously to improve BCI performance. However, no studies have investigated the effect of multimodal stimuli in rapid serial visual presentation (RSVP) BCIs. In the present study, we propose a rapid serial multimodal presentation (RSMP) BCI that incorporates artificial facial images and artificial voice stimuli. To clarify the effect of audiovisual stimuli on the RSMP BCI, scrambled images and masked sounds were applied instead of visual and auditory stimuli, respectively. Our findings indicated that the audiovisual stimuli improved the performance of the RSMP BCI, and that the P300 at Pz contributed to classification accuracy. Online accuracy of BCI reached 85.7+-11.5%. Taken together, these findings may aid in the development of better gaze-independent BCI systems.


title: Comment on "Relativity of Quantum States in Entanglement Swapping: Violation of Bell's Inequality with no Entanglement"

abstract: In a recent interesting article Chris Nagele, Ebubechukwu O. IloOkeke, Peter P. Rohde, Jonathan P. Dowling, and Tim Byrnes discuss an entanglement swapping experiment using a setup where it is possible to switch the time ordering of measurements. I would like to draw your attention to the fact that the very same idea was introduced in two previous papers, and briefly address some important points related to the subject.


title: Intensity-SLAM: Intensity Assisted Localization and Mapping for Large Scale Environment

abstract: Simultaneous Localization And Mapping (SLAM) is a task to estimate the robot location and to reconstruct the environment based on observation from sensors such as LIght Detection And Ranging (LiDAR) and camera. It is widely used in robotic applications such as autonomous driving and drone delivery. Traditional LiDAR-based SLAM algorithms mainly leverage the geometric features from the scene context, while the intensity information from LiDAR is ignored. Some recent deep-learning-based SLAM algorithms consider intensity features and train the pose estimation network in an end-to-end manner. However, they require significant data collection effort and their generalizability to environments other than the trained one remains unclear. In this paper we introduce intensity features to a SLAM system. And we propose a novel full SLAM framework that leverages both geometry and intensity features. The proposed SLAM involves both intensity-based front-end odometry estimation and intensity-based back-end optimization. Thorough experiments are performed including both outdoor autonomous driving and indoor warehouse robot manipulation. The results show that the proposed method outperforms existing geometric-only LiDAR SLAM methods.


title: Online Limited Memory Neural-Linear Bandits with Likelihood Matching

abstract: We study neural-linear bandits for solving problems where {\em both} exploration and representation learning play an important role. Neural-linear bandits harnesses the representation power of Deep Neural Networks (DNNs) and combines it with efficient exploration mechanisms by leveraging uncertainty estimation of the model, designed for linear contextual bandits on top of the last hidden layer. In order to mitigate the problem of representation change during the process, new uncertainty estimations are computed using stored data from an unlimited buffer. Nevertheless, when the amount of stored data is limited, a phenomenon called catastrophic forgetting emerges. To alleviate this, we propose a likelihood matching algorithm that is resilient to catastrophic forgetting and is completely online. We applied our algorithm, Limited Memory Neural-Linear with Likelihood Matching (NeuralLinear-LiM2) on a variety of datasets and observed that our algorithm achieves comparable performance to the unlimited memory approach while exhibits resilience to catastrophic forgetting.


title: Lightweight 3-D Localization and Mapping for Solid-State LiDAR

abstract: The LIght Detection And Ranging (LiDAR) sensor has become one of the most important perceptual devices due to its important role in simultaneous localization and mapping (SLAM). Existing SLAM methods are mainly developed for mechanical LiDAR sensors, which are often adopted by large scale robots. Recently, the solid-state LiDAR is introduced and becomes popular since it provides a cost-effective and lightweight solution for small scale robots. Compared to mechanical LiDAR, solid-state LiDAR sensors have higher update frequency and angular resolution, but also have smaller field of view (FoV), which is very challenging for existing LiDAR SLAM algorithms. Therefore, it is necessary to have a more robust and computationally efficient SLAM method for this new sensing device. To this end, we propose a new SLAM framework for solid-state LiDAR sensors, which involves feature extraction, odometry estimation, and probability map building. The proposed method is evaluated on a warehouse robot and a hand-held device. In the experiments, we demonstrate both the accuracy and efficiency of our method using an Intel L515 solid-state LiDAR. The results show that our method is able to provide precise localization and high quality mapping. We made the source codes public at \url{https://github.com/wh200720041/SSL_SLAM}.


title: Minimum Principle on Specific Entropy and High-Order Accurate Invariant Region Preserving Numerical Methods for Relativistic Hydrodynamics

abstract: This paper explores Tadmor's minimum entropy principle for the relativistic hydrodynamics (RHD) equations and incorporates this principle into the design of robust high-order discontinuous Galerkin (DG) and finite volume schemes for RHD on general meshes. The schemes are proven to preserve numerical solutions in a global invariant region constituted by all the known intrinsic constraints: minimum entropy principle, the subluminal constraint on fluid velocity, and the positivity of pressure and rest-mass density. Relativistic effects lead to some essential difficulties in the present study, which are not encountered in the non-relativistic case. Most notably, in the RHD case the specific entropy is a highly nonlinear implicit function of the conservative variables, and, moreover, there is also no explicit formula of the flux in terms of the conservative variables. In order to overcome the resulting challenges, we first propose a novel equivalent form of the invariant region, by skillfully introducing two auxiliary variables. As a notable feature, all the constraints in the novel form are explicit and linear with respect to the conservative variables. This provides a highly effective approach to theoretically analyze the invariant-region-preserving (IRP) property of schemes for RHD, without any assumption on the IRP property of the exact Riemann solver. Based on this, we prove the convexity of the invariant region and establish the generalized Lax--Friedrichs splitting properties via technical estimates, lying the foundation for our IRP analysis. It is shown that the first-order Lax--Friedrichs scheme for RHD satisfies a local minimum entropy principle and is IRP under a CFL condition. Provably IRP high-order DG and finite volume methods are developed for the RHD with the help of a simple scaling limiter. Several numerical examples demonstrate the effectiveness of the proposed schemes.


title: Dimension Free Generalization Bounds for Non Linear Metric Learning

abstract: In this work we study generalization guarantees for the metric learning problem, where the metric is induced by a neural network type embedding of the data. Specifically, we provide uniform generalization bounds for two regimes -- the sparse regime, and a non-sparse regime which we term \emph{bounded amplification}. The sparse regime bounds correspond to situations where $\ell_1$-type norms of the parameters are small. Similarly to the situation in classification, solutions satisfying such bounds can be obtained by an appropriate regularization of the problem. On the other hand, unregularized SGD optimization of a metric learning loss typically does not produce sparse solutions. We show that despite this lack of sparsity, by relying on a different, new property of the solutions, it is still possible to provide dimension free generalization guarantees. Consequently, these bounds can explain generalization in non sparse real experimental situations. We illustrate the studied phenomena on the MNIST and 20newsgroups datasets.


title: Lazy OCO: Online Convex Optimization on a Switching Budget

abstract: We study a variant of online convex optimization where the player is permitted to switch decisions at most $S$ times in expectation throughout $T$ rounds. Similar problems have been addressed in prior work for the discrete decision set setting, and more recently in the continuous setting but only with an adaptive adversary. In this work, we aim to fill the gap and present computationally efficient algorithms in the more prevalent oblivious setting, establishing a regret bound of $O(T/S)$ for general convex losses and $\widetilde O(T/S^2)$ for strongly convex losses. In addition, for stochastic i.i.d.~losses, we present a simple algorithm that performs $\log T$ switches with only a multiplicative $\log T$ factor overhead in its regret in both the general and strongly convex settings. Finally, we complement our algorithms with lower bounds that match our upper bounds in some of the cases we consider.


title: Kalman Filters on Differentiable Manifolds

abstract: Kalman filter is presumably one of the most important and extensively used filtering techniques in modern control systems. Yet, nearly all current variants of Kalman filters are formulated in the Euclidean space $\mathbb{R}^n$, while many real-world systems (e.g., robotic systems) are really evolving on manifolds. In this paper, we propose a method to develop Kalman filters for such on-manifold systems. Utilizing $\boxplus$, $\boxminus$ operations and further defining an oplus operation on the respective manifold, we propose a canonical representation of the on-manifold system. Such a canonical form enables us to separate the manifold constraints from the system behaviors in each step of the Kalman filter, ultimately leading to a generic and symbolic Kalman filter framework that are naturally evolving on the manifold. Furthermore, the on-manifold Kalman filter is implemented as a toolkit in $C$++ packages which enables users to implement an on-manifold Kalman filter just like the normal one in $\mathbb{R}^n$: the user needs only to provide the system-specific descriptions, and then call the respective filter steps (e.g., predict, update) without dealing with any of the manifold constraints. The existing implementation supports full iterated Kalman filtering for systems on any manifold composed of $\mathbb{R}^n$, $SO(3)$ and $\mathbb{S}^2$, and is extendable to other types of manifold when necessary. The proposed symbolic Kalman filter and the developed toolkit are verified by implementing a tightly-coupled lidar-inertial navigation system. Results show that the developed toolkit leads to superior filtering performances and computation efficiency comparable to hand-engineered counterparts. Finally, the toolkit is opened sourced at https://github.com/hku-mars/IKFoM to assist practitioners to quickly deploy an on-manifold Kalman filter.


title: The axial charge of the triton from lattice QCD

abstract: The axial charge of the triton is investigated using lattice quantum chromodynamics (QCD). Extending previous work at heavier quark masses, calculations are performed using three ensembles of gauge field configurations generated with quark masses corresponding to a pion mass of 450 MeV. Finite-volume energy levels for the triton, as well as for the deuteron and diproton systems, are extracted from analysis of correlation functions computed on these ensembles, and the corresponding energies are extrapolated to infinite volume using finite-volume pionless effective field theory (FVEFT). It is found with high likelihood that there is a compact bound state with the quantum numbers of the triton at these quark masses. The axial current matrix elements are computed using background field techniques on one of the ensembles and FVEFT is again used to determine the axial charge of the proton and triton. A simple quark mass extrapolation of these results and earlier calculations at heavier quark masses leads to a value of the ratio of the triton to proton axial charges at the physical quark masses of $g_A^{^{3}{\rm H}}/g_A^p=0.91\substack{+0.07 \\ -0.09}$. This result is consistent with the ratio determined from experiment and prefers values less than unity (in which case the triton axial charge would be unmodified from that of the proton), thereby demonstrating that QCD can explain the modification of the axial charge of the triton.


title: Curvature properties of twistor spaces

abstract: In this paper we review some results on the Riemannian and almost Hermitian geometry of twistor spaces of oriented Riemannian $4$-manifolds with emphasis on their curvature properties.


title: Dynamical system related to primal-dual splitting projection methods

abstract: We introduce a dynamical system to the problem of finding zeros of the sum of two maximally monotone operators. We investigate the existence, uniqueness and extendability of solutions to this dynamical system in a Hilbert space. We prove that the trajectories of the proposed dynamical system converge strongly to a primal-dual solution of the considered problem. Under explicit time discretization of the dynamical system we obtain the best approximation algorithm for solving coupled monotone inclusion problem.


title: Amplitude analysis and branching-fraction measurement of $D^{+}_{s}\rightarrow K^{0}_{S}K^{-}\pi^{+}\pi^{+}$

abstract: Using 6.32 fb$^{-1}$ of $e^+e^-$ collision data collected by the BESIII detector at the center-of-mass energies between 4.178 and 4.226 GeV,~an amplitude analysis of the $D^{+}_{s}\rightarrow K^{0}_{S}K^{-}\pi^{+}\pi^{+}$ decays is performed for the first time to determine the intermediate-resonant contributions. The dominant component is the $D_s^+ \to K^*(892)^+\overline{K}^*(892)^0$ decay with a fraction of $(40.6\pm2.9_{\rm stat}\pm4.9_{\rm sys})$%. Our results of the amplitude analysis are used to obtain a more precise measurement of the branching fraction of the $D^{+}_{s}\rightarrow K^{0}_{S}K^{-}\pi^{+}\pi^{+}$ decay, which is determined to be $(1.46\pm0.05_{\rm stat}\pm0.05_{\rm sys}$)%.


title: Bayesian Evidence for Both Astrophysical and Primordial Black Holes: Mapping the GWTC-2 Catalog to Third-Generation Detectors

abstract: We perform a hierarchical Bayesian analysis of the GWTC-2 catalog to investigate the mixed scenario in which the merger events are explained by black holes of both astrophysical and primordial origin. For the astrophysical scenario we adopt the phenomenological model used by the LIGO/Virgo collaboration and we include the correlation between different parameters inferred from data, the role of the spins in both the primordial and astrophysical scenarios, and the impact of accretion in the primordial scenario. Our best-fit mixed model has a strong statistical evidence relative to the single-population astrophysical model, thus supporting the coexistence of populations of black-hole mergers of two different origins. In particular, our results indicate that the astrophysical mergers account for roughly four times the number of primordial black hole events and predict that third-generation detectors, such as the Einstein Telescope and Cosmic Explorer, should detect up to hundreds of mergers from primordial black hole binaries at redshift $z\gtrsim30$.


title: A Thermodynamic Framework for Additive Manufacturing, using Amorphous Polymers, Capable of Predicting Residual Stress, Warpage and Shrinkage

abstract: A thermodynamic framework has been developed for a class of amorphous polymers used in fused deposition modeling (FDM), in order to predict the residual stresses and the accompanying distortion of the geometry of the printed part (warping). When a polymeric melt is cooled, the inhomogeneous distribution of temperature causes spatially varying volumetric shrinkage resulting in the generation of residual stresses. Shrinkage is incorporated into the framework by introducing an isotropic volumetric expansion/contraction in the kinematics of the body. We show that the parameter for shrinkage also appears in the systematically derived rate-type constitutive relation for the stress. The solidification of the melt around the glass transition temperature is emulated by drastically increasing the viscosity of the melt. In order to illustrate the usefulness and efficacy of the derived constitutive relation, we consider four ribbons of polymeric melt stacked on each other such as those extruded using a flat nozzle: each layer laid instantaneously and allowed to cool for one second before another layer is laid on it. Each layer cools, shrinks and warps until a new layer is laid, at which time the heat from the newly laid layer flows and heats up the bottom layers. The residual stresses of the existing and newly laid layers readjust to satisfy equilibrium. Such mechanical and thermal interactions amongst layers result in a complex distribution of residual stresses. The plane strain approximation predicts nearly equibiaxial tensile stress conditions in the core region of the solidified part, implying that a pre-existing crack in that region is likely to propagate and cause failure of the part during service. The free-end of the interface between the first and the second layer is subjected to the largest magnitude of combined shear and tension in the plane with a propensity for delamination.


title: Duo property for rings by the quasinilpotent perspective

abstract: In this paper, we focus on the duo ring property via quasinilpotent elements which gives a new kind of generalizations of commutativity. We call this kind of ring qnil-duo. Firstly, some properties of quasinilpotents in a ring are provided. Then the set of quasinilpotents is applied to the duo property of rings, in this perspective, we introduce and study right (resp., left) qnil-duo rings. We show that this concept is not left-right symmetric. Among others it is proved that if the Hurwitz series ring $H(R; \alpha)$ is right qnil-duo, then $R$ is right qnil-duo. Every right qnil-duo ring is abelian. A right qnil-duo exchange ring has stable range 1.


title: Ripple-like instability in the simulated gel phase of finite size phosphocholine bilayers

abstract: Atomistic molecular dynamics simulations have reached a degree of maturity that makes it possible to investigate the lipid polymorphism of model bilayers over a wide range of temperatures. However if both the fluid $L_{\alpha}$ and tilted gel $L_{\beta'}$ states are routinely obtained, the $P_{\beta'}$ ripple phase of phosphatidylcholine lipid bilayers is still unsatifactorily described. Performing simulations of lipid bilayers made of different numbers of DPPC (1,2-dipalmitoylphosphatidylcholine) molecules ranging from 32 to 512, we demonstrate that the tilted gel phase $L_{\beta'}$ expected below the pre-transition cannot be obtained for large systems ($>$ 94 DPPC molecules) through common simulations settings or temperature treatments. Large systems are instead found in a disordered gel phase which display configurations, topography and energies reminiscent from the ripple phase $P_{\beta'}$ observed between the pretransition and the main melting transition. We show how the state of the bilayers below the pretransition can be controlled and depends on thermal history and conditions of preparations. A mechanism for the observed topographic instability is suggested.


title: A characterization of the planes meeting a hyperbolic quadric of $\PG(3,q)$ in a conic

abstract: In this article, a combinatorial characterization of the family of planes of $\PG(3,q)$ which meet a hyperbolic quadric in an irreducible conic, using their intersection properties with the points and lines of $\PG(3,q)$, is given.


title: MIN2Net: End-to-End Multi-Task Learning for Subject-Independent Motor Imagery EEG Classification

abstract: Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive technique. Despite great advances in MI-based BCI, EEG rhythms are specific to a subject and various changes over time. These issues point to significant challenges to enhance the classification performance, especially in a subject-independent manner. To overcome these challenges, we propose MIN2Net, a novel end-to-end multi-task learning to tackle this task. We integrate deep metric learning into a multi-task autoencoder to learn a compact and discriminative latent representation from EEG and perform classification simultaneously. This approach reduces the complexity in pre-processing, results in significant performance improvement on EEG classification. Experimental results in a subject-independent manner show that MIN2Net outperforms the state-of-the-art techniques, achieving an F1-score improvement of 6.72%, and 2.23% on the SMR-BCI, and OpenBMI datasets, respectively. We demonstrate that MIN2Net improves discriminative information in the latent representation. This study indicates the possibility and practicality of using this model to develop MI-based BCI applications for new users without the need for calibration.


title: Bandits for Learning to Explain from Explanations

abstract: We introduce Explearn, an online algorithm that learns to jointly output predictions and explanations for those predictions. Explearn leverages Gaussian Processes (GP)-based contextual bandits. This brings two key benefits. First, GPs naturally capture different kinds of explanations and enable the system designer to control how explanations generalize across the space by virtue of choosing a suitable kernel. Second, Explearn builds on recent results in contextual bandits which guarantee convergence with high probability. Our initial experiments hint at the promise of the approach.


title: A lower bound on the spectral gap of one-dimensional Schr\"odinger operators

abstract: In this note we provide an explicit lower bound on the spectral gap of one-dimensional Schr\"odinger operators with non-negative bounded potentials and subject to Neumann boundary conditions.


title: Exact exponential synchronization rate of high-dimensional Kuramoto models with identical oscillators and digraphs

abstract: For the high-dimensional Kuramoto model with identical oscillators under a general digraph that has a directed spanning tree, although exponential synchronization was proved under some initial state constraints, the exact exponential synchronization rate has not been revealed until now. In this paper, the exponential synchronization rate is precisely determined as the smallest non-zero real part of Laplacian eigenvalues of the digraph. Our obtained result extends the existing results from the special case of strongly connected balanced digraphs to the condition of general digraphs owning directed spanning trees, which is the weakest condition for synchronization from the aspect of network structure. Moreover, our adopted method is completely different from and much more elementary than the previous differential geometry method.


title: Nearly scale-invariant curvature modes from entropy perturbations during graceful exit

abstract: In this Letter, we describe how a spectrum of entropic perturbations generated during a period of slow contraction can source a nearly scale-invariant spectrum of curvature perturbations on length scales larger than the Hubble radius during the transition from slow contraction to a classical non-singular bounce (the `graceful exit' phase). The sourcing occurs naturally through higher-order scalar field kinetic terms common to classical (non-singular) bounce mechanisms. We present a concrete example in which, by the end of the graceful exit phase, the initial entropic fluctuations have become negligible and the curvature fluctuations have a nearly scale-invariant spectrum with an amplitude consistent with observations.


title: Load balancing for distributed nonlocal models within asynchronous many-task systems

abstract: In this work, we consider the challenges of developing a distributed solver for models based on nonlocal interactions. In nonlocal models, in contrast to the local model, such as the wave and heat partial differential equation, the material interacts with neighboring points on a larger-length scale compared to the mesh discretization. In developing a fully distributed solver, the interaction over a length scale greater than mesh size introduces additional data dependencies among the compute nodes and communication bottleneck. In this work, we carefully look at these challenges in the context of nonlocal models; to keep the presentation specific to the computational issues, we consider a nonlocal heat equation in a 2d setting. In particular, the distributed framework we propose pays greater attention to the bottleneck of data communication and the dynamic balancing of loads among nodes with varying compute capacity. For load balancing, we propose a novel framework that assesses the compute capacity of nodes and dynamically balances the load so that the idle time among nodes is minimal. Our framework relies heavily on HPX library, an asynchronous many-task run time system. We present several results demonstrating the effectiveness of the proposed framework.


title: Cuspy and fractured black hole shadows in a toy model with axisymmetry

abstract: Cuspy shadow was first reported for hairy rotating black holes, whose metrics deviate significantly from the Kerr one. The non-smooth edge of the shadow is attributed to a transition between different branches of unstable but bounded orbits, known as the fundamental photon orbits, which end up at the light rings. In searching for a minimal theoretical setup to reproduce such a salient feature, in this work, we devise a toy model with axisymmetry, a slowly rotating Kerr black hole enveloped by a thin slowly rotating dark matter shell. Despite its simplicity, we show rich structures regarding fundamental photon orbits explicitly in such a system. We observe two disconnected branches of unstable spherical photon orbits, and the jump between them gives rise to a pair of cusps in the resultant black hole shadow. Besides the cuspy shadow, we explore other intriguing phenomena when the Maxwell construction cannot be established. We find that it is possible to have an incomplete arc of Einstein rings and a "fractured" shadow. The potential astrophysical significance of the corresponding findings is addressed.


title: Lie complexity of words

abstract: Given a finite alphabet $\Sigma$ and a right-infinite word $\bf w$ over $\Sigma$, we define the Lie complexity function $L_{\bf w}:\mathbb{N}\to \mathbb{N}$, whose value at $n$ is the number of conjugacy classes (under cyclic shift) of length-$n$ factors $x$ of $\bf w$ with the property that every element of the conjugacy class appears in $\bf w$. We show that the Lie complexity function is uniformly bounded for words with linear factor complexity, and as a result we show that words of linear factor complexity have at most finitely many primitive factors $y$ with the property that $y^n$ is again a factor for every $n$. We then look at automatic sequences and show that the Lie complexity function of a $k$-automatic sequence is again $k$-automatic.


title: On a correspondence between maximal cliques in Paley graphs of square order

abstract: Let $q$ be an odd prime power. Denote by $r(q)$ the value of $q$ modulo 4. In this paper, we establish a linear fractional correspondence between two types of maximal cliques of size $\frac{q+r(q)}{2}$ in the Paley graph of order $q^2$.


title: Evolution of populations with strategy-dependent time delays

abstract: We study effects of strategy-dependent time delays on equilibria of evolving populations. It is well known that time delays may cause oscillations in dynamical systems. Here we report a novel behavior. We show that microscopic models of evolutionary games with strategy-dependent time delays lead to a new type of replicator dynamics. It describes the time evolution of fractions of the population playing given strategies and the size of the population. Unlike in all previous models, stationary states of such dynamics depend continuously on time delays. We show that in games with an interior stationary state (a globally asymptotically stable equilibrium in the standard replicator dynamics), at certain time delays, it may disappear or there may appear another interior stationary state. In the Prisoner's Dilemma game, for time delays of cooperation smaller than time delays of defection, there appears an ustable interior equilibrium and therefore for some initial conditions, the population converges to the homogeneous state with just cooperators.


title: Neural Termination Analysis

abstract: We introduce a novel approach to the automated termination analysis of computer programs: we use neural networks to represent ranking functions. Ranking functions map program states to values that are bounded from below and decrease as a program runs; the existence of a ranking function proves that the program terminates. We train a neural network from sampled execution traces of a program so that the network's output decreases along the traces; then, we use symbolic reasoning to formally verify that it generalises to all possible executions. Upon the affirmative answer we obtain a formal certificate of termination for the program, which we call a neural ranking function. We demonstrate that thanks to the ability of neural networks to represent nonlinear functions our method succeeds over programs that are beyond the reach of state-of-the-art tools. This includes programs that use disjunctions in their loop conditions and programs that include nonlinear expressions.


title: Simulation electronic thermes of two atoms molecules

abstract: In the first order of the perturbation theory, the correction to the electronic terms of a diatomic molecule is calculated taking into account the Pauli principle.


title: Effective and Scalable Clustering on Massive Attributed Graphs

abstract: Given a graph G where each node is associated with a set of attributes, and a parameter k specifying the number of output clusters, k-attributed graph clustering (k-AGC) groups nodes in G into k disjoint clusters, such that nodes within the same cluster share similar topological and attribute characteristics, while those in different clusters are dissimilar. This problem is challenging on massive graphs, e.g., with millions of nodes and billions of edges. For such graphs, existing solutions either incur prohibitively high costs, or produce clustering results with compromised quality. In this paper, we propose ACMin, an effective approach to k-AGC that yields high-quality clusters with cost linear to the size of the input graph G. The main contributions of ACMin are twofold: (i) a novel formulation of the k-AGC problem based on an attributed multi-hop conductance quality measure custom-made for this problem setting, which effectively captures cluster coherence in terms of both topological proximities and attribute similarities, and (ii) a linear-time optimization solver that obtains high-quality clusters iteratively, based on efficient matrix operations such as orthogonal iterations, an alternative optimization approach, as well as an initialization technique that significantly speeds up the convergence of ACMin in practice. Extensive experiments, comparing 11 competitors on 6 real datasets, demonstrate that ACMin consistently outperforms all competitors in terms of result quality measured against ground-truth labels, while being up to orders of magnitude faster. In particular, on the Microsoft Academic Knowledge Graph dataset with 265.2 million edges and 1.1 billion attribute values, ACMin outputs high-quality results for 5-AGC within 1.68 hours using a single CPU core, while none of the 11 competitors finish within 3 days.


title: Graph Neural Network to Dilute Outliers for Refactoring Monolith Application

abstract: Microservices are becoming the defacto design choice for software architecture. It involves partitioning the software components into finer modules such that the development can happen independently. It also provides natural benefits when deployed on the cloud since resources can be allocated dynamically to necessary components based on demand. Therefore, enterprises as part of their journey to cloud, are increasingly looking to refactor their monolith application into one or more candidate microservices; wherein each service contains a group of software entities (e.g., classes) that are responsible for a common functionality. Graphs are a natural choice to represent a software system. Each software entity can be represented as nodes and its dependencies with other entities as links. Therefore, this problem of refactoring can be viewed as a graph based clustering task. In this work, we propose a novel method to adapt the recent advancements in graph neural networks in the context of code to better understand the software and apply them in the clustering task. In that process, we also identify the outliers in the graph which can be directly mapped to top refactor candidates in the software. Our solution is able to improve state-of-the-art performance compared to works from both software engineering and existing graph representation based techniques.


title: Learning to Decode Protograph LDPC Codes

abstract: The recent development of deep learning methods provides a new approach to optimize the belief propagation (BP) decoding of linear codes. However, the limitation of existing works is that the scale of neural networks increases rapidly with the codelength, thus they can only support short to moderate codelengths. From the point view of practicality, we propose a high-performance neural min-sum (MS) decoding method that makes full use of the lifting structure of protograph low-density parity-check (LDPC) codes. By this means, the size of the parameter array of each layer in the neural decoder only equals the number of edge-types for arbitrary codelengths. In particular, for protograph LDPC codes, the proposed neural MS decoder is constructed in a special way such that identical parameters are shared by a bundle of edges derived from the same edge-type. To reduce the complexity and overcome the vanishing gradient problem in training the proposed neural MS decoder, an iteration-by-iteration (i.e., layer-by-layer in neural networks) greedy training method is proposed. With this, the proposed neural MS decoder tends to be optimized with faster convergence, which is aligned with the early termination mechanism widely used in practice. To further enhance the generalization ability of the proposed neural MS decoder, a codelength/rate compatible training method is proposed, which randomly selects samples from a set of codes lifted from the same base code. As a theoretical performance evaluation tool, a trajectory-based extrinsic information transfer (T-EXIT) chart is developed for various decoders. Both T-EXIT and simulation results show that the optimized MS decoding can provide faster convergence and up to 1dB gain compared with the plain MS decoding and its variants with only slightly increased complexity. In addition, it can even outperform the sum-product algorithm for some short codes.