title: Single-Shot Motion Completion with Transformer

abstract: Motion completion is a challenging and long-discussed problem, which is of great significance in film and game applications. For different motion completion scenarios (in-betweening, in-filling, and blending), most previous methods deal with the completion problems with case-by-case designs. In this work, we propose a simple but effective method to solve multiple motion completion problems under a unified framework and achieves a new state of the art accuracy under multiple evaluation settings. Inspired by the recent great success of attention-based models, we consider the completion as a sequence to sequence prediction problem. Our method consists of two modules - a standard transformer encoder with self-attention that learns long-range dependencies of input motions, and a trainable mixture embedding module that models temporal information and discriminates key-frames. Our method can run in a non-autoregressive manner and predict multiple missing frames within a single forward propagation in real time. We finally show the effectiveness of our method in music-dance applications.


title: Dissecting the Performance of Chained-BFT

abstract: Permissioned blockchains employ Byzantine fault-tolerant (BFT) state machine replication (SMR) to reach agreement on an ever-growing, linearly ordered log of transactions. A new paradigm, combined with decades of research in BFT SMR and blockchain (namely chained-BFT, or cBFT), has emerged for directly constructing blockchain protocols. Chained-BFT protocols have a unifying propose-vote scheme instead of multiple different voting phases with a set of voting and commit rules to guarantee safety and liveness. However, distinct voting and commit rules impose varying impacts on performance under different workloads, network conditions, and Byzantine attacks. Therefore, a fair comparison of the proposed protocols poses a challenge that has not yet been addressed by existing work. We fill this gap by studying a family of cBFT protocols with a two-pronged systematic approach. First, we present an evaluation framework, Bamboo, for quick prototyping of cBFT protocols and that includes helpful benchmarking facilities. To validate Bamboo, we introduce an analytic model using queuing theory which also offers a back-of-the-envelope guide for dissecting these protocols. We build multiple cBFT protocols using Bamboo and we are the first to fairly compare three representatives (i.e., HotStuff, two-chain HotStuff, and Streamlet). We evaluated these protocols under various parameters and scenarios, including two Byzantine attacks that have not been widely discussed in the literature. Our findings reveal interesting trade-offs (e.g., responsiveness vs. forking-resilience) between different cBFT protocols and their design choices, which provide developers and researchers with insights into the design and implementation of this protocol family.


title: Explaining Adversarial Vulnerability with a Data Sparsity Hypothesis

abstract: Despite many proposed algorithms to provide robustness to deep learning (DL) models, DL models remain susceptible to adversarial attacks. We hypothesize that the adversarial vulnerability of DL models stems from two factors. The first factor is data sparsity which is that in the high dimensional input data space, there exist large regions outside the support of the data distribution. The second factor is the existence of many redundant parameters in the DL models. Owing to these factors, different models are able to come up with different decision boundaries with comparably high prediction accuracy. The appearance of the decision boundaries in the space outside the support of the data distribution does not affect the prediction accuracy of the model. However, it makes an important difference in the adversarial robustness of the model. We hypothesize that the ideal decision boundary is as far as possible from the support of the data distribution. In this paper, we develop a training framework to observe if DL models are able to learn such a decision boundary spanning the space around the class distributions further from the data points themselves. Semi-supervised learning was deployed during training by leveraging unlabeled data generated in the space outside the support of the data distribution. We measured adversarial robustness of the models trained using this training framework against well-known adversarial attacks and by using robustness metrics. We found that models trained using our framework, as well as other regularization methods and adversarial training support our hypothesis of data sparsity and that models trained with these methods learn to have decision boundaries more similar to the aforementioned ideal decision boundary. The code for our training framework is available at https://github.com/MahsaPaknezhad/AdversariallyRobustTraining.


title: Manifold learning for coarse-graining atomistic simulations: Application to amorphous solids

abstract: We introduce a generalized machine learning framework to probabilistically parameterize upper-scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse-grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse-graining methodology with manifold learning and surrogate-based optimization techniques. Coarse-grained high-dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative-free optimization is employed to adaptively identify a unique set of parameters of the upper-scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse-grained atomic-level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse-graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse-grained microscale simulations to macroscale observables and achieve a high-level of parity between the models across scales.


title: Towards Unbiased COVID-19 Lesion Localisation and Segmentation via Weakly Supervised Learning

abstract: Despite tremendous efforts, it is very challenging to generate a robust model to assist in the accurate quantification assessment of COVID-19 on chest CT images. Due to the nature of blurred boundaries, the supervised segmentation methods usually suffer from annotation biases. To support unbiased lesion localisation and to minimise the labeling costs, we propose a data-driven framework supervised by only image-level labels. The framework can explicitly separate potential lesions from original images, with the help of a generative adversarial network and a lesion-specific decoder. Experiments on two COVID-19 datasets demonstrate the effectiveness of the proposed framework and its superior performance to several existing methods.


title: validation method to improve behavioral flows on uml requirements analysis model by cross-checking with state transition model

abstract: We propose a method to evaluate and improve the validity of required specifications by comparing models from different viewpoints. Inconsistencies are automatically extracted from the model in which the analyst defines the service procedure based on the initial requirement; thereafter, the analyst automatically compares it with a state transition model from the same initial requirement that has been created by an evaluator who is different from the analyst. The identified inconsistencies are reported to the analyst to enable the improvement of the required specifications. We develop a tool for extraction and comparison and then discuss its effectiveness by applying the method to a requirements specification example.


title: Sparse Activity Detection in Multi-Cell Massive MIMO Exploiting Channel Large-Scale Fading

abstract: This paper studies the device activity detection problem in a multi-cell massive multiple-input multiple-output (MIMO) system, in which the active devices transmit signature sequences to multiple base stations (BSs) that are connected to a central unit (CU), and the BSs cooperate across multiple cells to detect the active devices based on the sample covariance matrices at the BSs. This paper demonstrates the importance of exploiting the knowledge of channel large-scale fadings in this cooperative detection setting through a phase transition analysis, which characterizes the length of signature sequences needed for successful device activity detection in the massive MIMO regime. It is shown that when the large-scale fadings are known, the phase transition for the multi-cell scenario is approximately the same as that of a single-cell system. In this case, the length of the signature sequences required for reliable activity detection in the multi-cell system can be made to be independent of the number of cells through cooperation, in contrast to the case where the large-scale fadings are not known. Further, this paper considers the case in which the fronthaul links between the BSs and the CU have capacity constraints and proposes a novel cooperation scheme based on the quantization of preliminary detection results at the BSs and the reconstruction of the sample covariance matrices at the CU. Simulations show that the proposed method significantly outperforms the scheme of directly quantizing the sample covariance matrices.


title: PENet: Towards Precise and Efficient Image Guided Depth Completion

abstract: Image guided depth completion is the task of generating a dense depth map from a sparse depth map and a high quality image. In this task, how to fuse the color and depth modalities plays an important role in achieving good performance. This paper proposes a two-branch backbone that consists of a color-dominant branch and a depth-dominant branch to exploit and fuse two modalities thoroughly. More specifically, one branch inputs a color image and a sparse depth map to predict a dense depth map. The other branch takes as inputs the sparse depth map and the previously predicted depth map, and outputs a dense depth map as well. The depth maps predicted from two branches are complimentary to each other and therefore they are adaptively fused. In addition, we also propose a simple geometric convolutional layer to encode 3D geometric cues. The geometric encoded backbone conducts the fusion of different modalities at multiple stages, leading to good depth completion results. We further implement a dilated and accelerated CSPN++ to refine the fused depth map efficiently. The proposed full model ranks 1st in the KITTI depth completion online leaderboard at the time of submission. It also infers much faster than most of the top ranked methods. The code of this work is available at https://github.com/JUGGHM/PENet_ICRA2021.


title: LiTAMIN2: Ultra Light LiDAR-based SLAM using Geometric Approximation applied with KL-Divergence

abstract: In this paper, a three-dimensional light detection and ranging simultaneous localization and mapping (SLAM) method is proposed that is available for tracking and mapping with 500--1000 Hz processing. The proposed method significantly reduces the number of points used for point cloud registration using a novel ICP metric to speed up the registration process while maintaining accuracy. Point cloud registration with ICP is less accurate when the number of points is reduced because ICP basically minimizes the distance between points. To avoid this problem, symmetric KL-divergence is introduced to the ICP cost that reflects the difference between two probabilistic distributions. The cost includes not only the distance between points but also differences between distribution shapes. The experimental results on the KITTI dataset indicate that the proposed method has high computational efficiency, strongly outperforms other methods, and has similar accuracy to the state-of-the-art SLAM method.


title: Detection and Rectification of Arbitrary Shaped Scene Texts by using Text Keypoints and Links

abstract: Detection and recognition of scene texts of arbitrary shapes remain a grand challenge due to the super-rich text shape variation in text line orientations, lengths, curvatures, etc. This paper presents a mask-guided multi-task network that detects and rectifies scene texts of arbitrary shapes reliably. Three types of keypoints are detected which specify the centre line and so the shape of text instances accurately. In addition, four types of keypoint links are detected of which the horizontal links associate the detected keypoints of each text instance and the vertical links predict a pair of landmark points (for each keypoint) along the upper and lower text boundary, respectively. Scene texts can be located and rectified by linking up the associated landmark points (giving localization polygon boxes) and transforming the polygon boxes via thin plate spline, respectively. Extensive experiments over several public datasets show that the use of text keypoints is tolerant to the variation in text orientations, lengths, and curvatures, and it achieves superior scene text detection and rectification performance as compared with state-of-the-art methods.


title: Daisy: Data analysis integrated software system for X-ray experiments

abstract: Daisy (Data Analysis Integrated Software System) has been designed for the analysis and visualization of the X-ray experiments. To address an extensive range of Chinese radiation facilities community's requirements from purely algorithmic problems to scientific computing infrastructure, Daisy sets up a cloud-native platform to support on-site data analysis services with fast feedback and interaction. The plugs-in based application is convenient to process the expected high throughput data flow in parallel at next-generation facilities such as the High Energy Photon Source (HEPS). The objectives, functionality and architecture of Daisy are described in this article.


title: Self-Supervised Multi-View Learning via Auto-Encoding 3D Transformations

abstract: 3D object representation learning is a fundamental challenge in computer vision to infer about the 3D world. Recent advances in deep learning have shown their efficiency in 3D object recognition, among which view-based methods have performed best so far. However, feature learning of multiple views in existing methods is mostly performed in a supervised fashion, which often requires a large amount of data labels with high costs. In contrast, self-supervised learning aims to learn multi-view feature representations without involving labeled data. To this end, we propose a novel self-supervised paradigm to learn Multi-View Transformation Equivariant Representations (MV-TER), exploring the equivariant transformations of a 3D object and its projected multiple views. Specifically, we perform a 3D transformation on a 3D object, and obtain multiple views before and after the transformation via projection. Then, we self-train a representation to capture the intrinsic 3D object representation by decoding 3D transformation parameters from the fused feature representations of multiple views before and after the transformation. Experimental results demonstrate that the proposed MV-TER significantly outperforms the state-of-the-art view-based approaches in 3D object classification and retrieval tasks, and show the generalization to real-world datasets.


title: Statistical mechanics and Bayesian Inference addressed to the Osborne Paradox

abstract: One of the greatest contributors of the 20th century among all academician in the field of statistical finance, M. F. M. Osborne published in 1956 [6] an essential paper and proposed to treat the question of stock market motion through the prism of both the Law of Weber-Fechner [1, 4] and the branch of physics developed by James Clerk Maxwell, Ludwig Boltzmann and Josiah Willard Gibbs [3, 5] namely the statistical mechanics. He proposed an improvement of the known research made by his predecessor Louis Jean-Baptiste Alphonse Bachelier, by not considering the arithmetic changes of stock prices as means of statistical measurement, but by drawing on the Weber-Fechner Law, to treat the changes of prices. Osborne emphasized that as in statistical mechanics, the probability distribution of the steady-state of subjective change in prices is determined by the condition of maximum probability, a statement close to the Gibbs distribution conditions. However, Osborne also admitted that the empirical observation of the probability distribution of logarithmic changes of stock prices was emphasizing obvious asymmetries and consequently could not perfectly confirm his prior theory. The purpose of this paper is to propose an explanation to what we could call the Osborne paradox and then address an alternative approach via Bayesian inference regarding the description of the probability distribution of changes in logarithms of prices that was thenceforth under the prism of frequentist inference. We show that the stock market returns are locally described by equilibrium statistical mechanics with conserved statistics variables, whereas globally there is yet other statistics with persistent flowing variables that can be effectively described by a superposition of several statistics on different time scales, namely, a superstatistics.


title: High Energy Neutrinos from Choked Gamma-Ray Bursts in AGN Accretion Disks

abstract: Both long-duration gamma-ray bursts (LGRBs) from core collapse of massive stars and short-duration GRBs (SGRBs) from mergers of binary neutron star (BNS) or neutron star--black hole (NSBH) are expected to occur in the accretion disk of active galactic nuclei (AGNs). We show that GRB jets embedded in the migration traps of AGN disks are promised to be choked by the dense disk material. Efficient shock acceleration of cosmic rays at the reverse shock is expected, and high-energy neutrinos would be produced. We find that these sources can effectively produce detectable TeV--PeV neutrinos through $p\gamma$ interactions. From a choked LGRB jet with isotropic equivalent energy of $10^{53}\,{\rm erg}$ at $100\,{\rm Mpc}$, one expects $\sim2\,(7)$ neutrino events detectable by IceCube (IceCube-Gen2). The contribution from choked LGRBs to the observed diffuse neutrino background depends on the unknown local event rate density of these GRBs in AGN disks. For example, if the local event rate density of choked LGRBs in AGN disk is $\sim5\%$ that of low-luminosity GRBs $(\sim10\,{\rm Gpc}^{-3}\,{\rm yr}^{-1})$, the neutrinos from these events would contribute to $\sim10\%$ of the observed diffuse neutrino background. Choked SGRBs in AGN disks are potential sources for future joint electromagnetic, neutrino, and gravitational wave multi-messenger observations.

categories: astro-ph.HE astro-ph.GA astro-ph.SR hep-ph


title: Physical Watermarking for Replay Attack Detection in Continuous-time Systems

abstract: Physical watermarking is a well established technique for replay attack detection in cyber-physical systems (CPSs). Most of the watermarking methods proposed in the literature are designed for discrete-time systems. In general, real physical systems evolve in continuous time. In this paper, we analyze the effect of watermarking on sampled-data continuous-time systems controlled via a Zero-Order Hold. We investigate the effect of sampling on detection performance and we provide a procedure to find a suitable sampling period that ensures detectability and acceptable control performance. Simulations on a quadrotor system are used to illustrate the effectiveness of the theoretical results.


title: RAGA: Relation-aware Graph Attention Networks for Global Entity Alignment

abstract: Entity alignment (EA) is the task to discover entities referring to the same real-world object from different knowledge graphs (KGs), which is the most crucial step in integrating multi-source KGs. The majority of the existing embeddings-based entity alignment methods embed entities and relations into a vector space based on relation triples of KGs for local alignment. As these methods insufficiently consider the multiple relations between entities, the structure information of KGs has not been fully leveraged. In this paper, we propose a novel framework based on Relation-aware Graph Attention Networks to capture the interactions between entities and relations. Our framework adopts the self-attention mechanism to spread entity information to the relations and then aggregate relation information back to entities. Furthermore, we propose a global alignment algorithm to make one-to-one entity alignments with a fine-grained similarity matrix. Experiments on three real-world cross-lingual datasets show that our framework outperforms the state-of-the-art methods.


title: Knowledge-Guided Dynamic Systems Modeling: A Case Study on Modeling River Water Quality

abstract: Modeling real-world phenomena is a focus of many science and engineering efforts, such as ecological modeling and financial forecasting, to name a few. Building an accurate model for complex and dynamic systems improves understanding of underlying processes and leads to resource efficiency. Towards this goal, knowledge-driven modeling builds a model based on human expertise, yet is often suboptimal. At the opposite extreme, data-driven modeling learns a model directly from data, requiring extensive data and potentially generating overfitting. We focus on an intermediate approach, model revision, in which prior knowledge and data are combined to achieve the best of both worlds. In this paper, we propose a genetic model revision framework based on tree-adjoining grammar (TAG) guided genetic programming (GP), using the TAG formalism and GP operators in an effective mechanism to incorporate prior knowledge and make data-driven revisions in a way that complies with prior knowledge. Our framework is designed to address the high computational cost of evolutionary modeling of complex systems. Via a case study on the challenging problem of river water quality modeling, we show that the framework efficiently learns an interpretable model, with higher modeling accuracy than existing methods.


title: Embedded Knowledge Distillation in Depth-Level Dynamic Neural Network

abstract: In real applications, different computation-resource devices need different-depth networks (e.g., ResNet-18/34/50) with high-accuracy. Usually, existing methods either design multiple networks and train them independently, or construct depth-level/width-level dynamic neural networks which is hard to prove the accuracy of each sub-net. In this article, we propose an elegant Depth-Level Dynamic Neural Network (DDNN) integrated different-depth sub-nets of similar architectures. To improve the generalization of sub-nets, we design the Embedded-Knowledge-Distillation (EKD) training mechanism for the DDNN to implement knowledge transfer from the teacher (full-net) to multiple students (sub-nets). Specifically, the Kullback-Leibler (KL) divergence is introduced to constrain the posterior class probability consistency between full-net and sub-nets, and self-attention distillation on the same resolution feature of different depth is addressed to drive more abundant feature representations of sub-nets. Thus, we can obtain multiple high-accuracy sub-nets simultaneously in a DDNN via the online knowledge distillation in each training iteration without extra computation cost. Extensive experiments on CIFAR-10/100, and ImageNet datasets demonstrate that sub-nets in DDNN with EKD training achieve better performance than individually training networks while preserving the original performance of full-nets.


title: Early-Bird GCNs: Graph-Network Co-Optimization Towards More Efficient GCN Training and Inference via Drawing Early-Bird Lottery Tickets

abstract: Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art deep learning model for representation learning on graphs. However, it remains notoriously challenging to train and inference GCNs over large graph datasets, limiting their application to large real-world graphs and hindering the exploration of deeper and more sophisticated GCN graphs. This is because as the graph size grows, the sheer number of node features and the large adjacency matrix can easily explode the required memory and data movements. To tackle the aforementioned challenges, we explore the possibility of drawing lottery tickets when sparsifying GCN graphs, i.e., subgraphs that largely shrink the adjacency matrix yet are capable of achieving accuracy comparable to or even better than their full graphs. Specifically, we for the first time discover the existence of graph early-bird (GEB) tickets that emerge at the very early stage when sparsifying GCN graphs, and propose a simple yet effective detector to automatically identify the emergence of such GEB tickets. Furthermore, we advocate graph-model co-optimization and develop a generic efficient GCN early-bird training framework dubbed GEBT that can significantly boost the efficiency of GCN training by (1) drawing joint early-bird tickets between the GCN graphs and models and (2) enabling simultaneously sparsification of both the GCN graphs and models. Experiments on various GCN models and datasets consistently validate our GEB finding and the effectiveness of our GEBT, e.g., our GEBT achieves up to 80.2% ~ 85.6% and 84.6% ~ 87.5% savings of GCN training and inference costs while offering a comparable or even better accuracy as compared to state-of-the-art methods. Our source code and supplementary appendix are available at https://github.com/RICE-EIC/Early-Bird-GCN.


title: Fluid-plate interaction under periodic forcing

abstract: The motion of a thin elastic plate interacting with a viscous fluid is investigated. A periodic force acting on the plate is considered, which in a setting without damping could lead to a resonant response. The interaction with the viscous fluid provides a damping mechanism due to the energy dissipation in the fluid. Moreover, an internal damping mechanism in the plate is introduced. In this setting, we show that the periodic forcing leads to a time-periodic (non-resonant) solution. We employ the Navier-Stokes and the Kirchhoff-Love plate equation in a periodic cell structure to model the motion of the viscous fluid and the elastic plate, respectively. Maximal Lp regularity for the linearized system is established in a framework of time-periodic function spaces. Existence of a solution to the fully nonlinear system is subsequently shown with a fixed-point argument.


title: Isolated zones and granulation of complex network systems

abstract: The problem of blocking certain areas of network systems and their boundary case, which is the granulation of network to a set of isolated zones, is investigated in the article. The losses that await the system due to blocking of its separate components are determined, and method for finding alternative ways of flow motion bypassing the isolated zone of network are proposed. The granulation process of the network system is reflected as a temporal network and the losses that await the system during the deployment of such processes are calculated.


title: Gravitational waves from Population III binary black holes are consistent with LIGO/Virgo O3a data for the chirp mass larger than $\sim 20M_{\odot}$

abstract: The probability number distribution function of binary black hole mergers observed by LIGO/Virgo O3a has double peaks as a function of chirp mass $M_c$, total mass $M_t$, primary black hole mass $M_1$ and secondary one $M_2$, respectively. The larger chirp mass peak is at $M_c \cong 30 M_{\odot}$. The distribution of $M_2$ vs. $M_1$ follows the relation of $M_2\cong 0.7M_1$. For initial mass functions of Population III stars in the form of $f(M) \propto M^{-\alpha}$, population synthesis numerical simulations with $0\leq \alpha \leq 1.5$ are consistent with O3a data for $M_c \gtrsim 20M_{\odot}$. The distribution of $M_2$ vs. $M_1$ for simulation data also agrees with $M_2\cong 0.7M_1$ relation of O3a data.


title: Polynesia: Enabling Effective Hybrid Transactional/Analytical Databases with Specialized Hardware/Software Co-Design

abstract: An exponential growth in data volume, combined with increasing demand for real-time analysis (i.e., using the most recent data), has resulted in the emergence of database systems that concurrently support transactions and data analytics. These hybrid transactional and analytical processing (HTAP) database systems can support real-time data analysis without the high costs of synchronizing across separate single-purpose databases. Unfortunately, for many applications that perform a high rate of data updates, state-of-the-art HTAP systems incur significant drops in transactional (up to 74.6%) and/or analytical (up to 49.8%) throughput compared to performing only transactions or only analytics in isolation, due to (1) data movement between the CPU and memory, (2) data update propagation, and (3) consistency costs. We propose Polynesia, a hardware-software co-designed system for in-memory HTAP databases. Polynesia (1) divides the HTAP system into transactional and analytical processing islands, (2) implements custom algorithms and hardware to reduce the costs of update propagation and consistency, and (3) exploits processing-in-memory for the analytical islands to alleviate data movement. Our evaluation shows that Polynesia outperforms three state-of-the-art HTAP systems, with average transactional/analytical throughput improvements of 1.70X/3.74X, and reduces energy consumption by 48% over the prior lowest-energy system.


title: Embeddings between weighted Tandori and Ces\`{a}ro Function Spaces

abstract: We give the characterization of the embeddings between weighted Tandori and Ces\`{a}ro function spaces using the combination of duality arguments for weighted Lebesgue spaces and weighted Tandori spaces with estimates for the iterated integral operators.


title: Query Rewriting via Cycle-Consistent Translation for E-Commerce Search

abstract: Nowadays e-commerce search has become an integral part of many people's shopping routines. One critical challenge in today's e-commerce search is the semantic matching problem where the relevant items may not contain the exact terms in the user query. In this paper, we propose a novel deep neural network based approach to query rewriting, in order to tackle this problem. Specifically, we formulate query rewriting into a cyclic machine translation problem to leverage abundant click log data. Then we introduce a novel cyclic consistent training algorithm in conjunction with state-of-the-art machine translation models to achieve the optimal performance in terms of query rewriting accuracy. In order to make it practical in industrial scenarios, we optimize the syntax tree construction to reduce computational cost and online serving latency. Offline experiments show that the proposed method is able to rewrite hard user queries into more standard queries that are more appropriate for the inverted index to retrieve. Comparing with human curated rule-based method, the proposed model significantly improves query rewriting diversity while maintaining good relevancy. Online A/B experiments show that it improves core e-commerce business metrics significantly. Since the summer of 2020, the proposed model has been launched into our search engine production, serving hundreds of millions of users.


title: A Driving Behavior Recognition Model with Bi-LSTM and Multi-Scale CNN

abstract: In autonomous driving, perceiving the driving behaviors of surrounding agents is important for the ego-vehicle to make a reasonable decision. In this paper, we propose a neural network model based on trajectories information for driving behavior recognition. Unlike existing trajectory-based methods that recognize the driving behavior using the hand-crafted features or directly encoding the trajectory, our model involves a Multi-Scale Convolutional Neural Network (MSCNN) module to automatically extract the high-level features which are supposed to encode the rich spatial and temporal information. Given a trajectory sequence of an agent as the input, firstly, the Bi-directional Long Short Term Memory (Bi-LSTM) module and the MSCNN module respectively process the input, generating two features, and then the two features are fused to classify the behavior of the agent. We evaluate the proposed model on the public BLVD dataset, achieving a satisfying performance.


title: Quantum potentiality in Inhomogeneous Cosmology

abstract: For the Szekeres system which describes inhomogeneous and anisotropic spacetimes we make use of a point-like Lagrangian, which describes the evolution of the physical variables of the Szekeres model, in order to perform a canonical quantization and to study the quantum potentiality of the Szekeres system in the content of de Broglie--Bohm theory. We revise previous results on the subject and we find that for a specific family of trajectories with initial conditions which satisfy a constraint equation, there exists additional conservation laws for the classical Szekeres system which are used to define differential operators and to solve the Wheeler-DeWitt equation. From the new conservation laws we construct a wave function which provides a nonzero quantum potential term that modifies the Szekeres system. The quantum potential corresponds to new terms in the dynamical system such that new asymptotic solutions with a nonzero energy momentum tensor of an anisotropic fluid exist. Therefore, the silent property of the Szekeres spacetimes is violated by quantum correction terms.


title: A 3D model-based approach for fitting masks to faces in the wild

abstract: Face recognition now requires a large number of labelled masked face images in the era of this unprecedented COVID-19 pandemic. Unfortunately, the rapid spread of the virus has left us little time to prepare for such dataset in the wild. To circumvent this issue, we present a 3D model-based approach called WearMask3D for augmenting face images of various poses to the masked face counterparts. Our method proceeds by first fitting a 3D morphable model on the input image, second overlaying the mask surface onto the face model and warping the respective mask texture, and last projecting the 3D mask back to 2D. The mask texture is adapted based on the brightness and resolution of the input image. By working in 3D, our method can produce more natural masked faces of diverse poses from a single mask texture. To compare precisely between different augmentation approaches, we have constructed a dataset comprising masked and unmasked faces with labels called MFW-mini. Experimental results demonstrate WearMask3D produces more realistic masked faces, and utilizing these images for training leads to state-of-the-art recognition accuracy for masked faces.


title: Industry Practice of Coverage-Guided Enterprise-Level DBMS Fuzzing

abstract: As an infrastructure for data persistence and analysis, Database Management Systems (DBMSs) are the cornerstones of modern enterprise software. To improve their correctness, the industry has been applying blackbox fuzzing for decades. Recently, the research community achieved impressive fuzzing gains using coverage guidance. However, due to the complexity and distributed nature of enterprise-level DBMSs, seldom are these researches applied to the industry. In this paper, we apply coverage-guided fuzzing to enterprise-level DBMSs from Huawei and Bloomberg LP. In our practice of testing GaussDB and Comdb2, we found major challenges in all three testing stages. The challenges are collecting precise coverage, optimizing fuzzing performance, and analyzing root causes. In search of a general method to overcome these challenges, we propose Ratel, a coverage-guided fuzzer for enterprise-level DBMSs. With its industry-oriented design, Ratel improves the feedback precision, enhances the robustness of input generation, and performs an on-line investigation on the root cause of bugs. As a result, Ratel outperformed other fuzzers in terms of coverage and bugs. Compared to industrial black box fuzzers SQLsmith and SQLancer, as well as coverage-guided academic fuzzer Squirrel, Ratel covered 38.38%, 106.14%, 583.05% more basic blocks than the best results of other three fuzzers in GaussDB, PostgreSQL, and Comdb2, respectively. More importantly, Ratel has discovered 32, 42, and 5 unknown bugs in GaussDB, Comdb2, and PostgreSQL.


title: Superconductivity by Berry connection from many-body wave functions: revisit to Andreev$-$Saint-James reflection and Josephson effect

abstract: Although the standard theory of superconductivity based on the BCS theory is a successful one, several experimental results indicate the necessity for a fundamental revision. We argue that the revision is on the origin of the phase variable for superconductivity; this phase appears as a consequence of the electron-pairing in the standard theory, but its origin is a Berry connection arising from many-body wave functions. When this Berry connection is non-trivial, it gives rise to a collective mode that generates supercurrent; this collective mode creates number-changing operators for particles participating in this mode, and these number-changing operators stabilize the superconducting state by exploiting the Cooper instability. In the new theory, the role of the electron-pairing is to stabilize the nontrivial Berry connection; it is not the cause of superconductivity. In BCS superconductors, however, the simultaneous appearance of the nontrivial Berry connection and the electron-pairing occurs. Therefore, the electron-pairing amplitude can be used as an order parameter for the superconducting state. We revisit the Andreev$-$Saint-James reflection and the Josephson effect. They are explained as consequence of the presence of the Berry connection. Bogoliubov quasiparticles are replaced by the particle-number conserving Bogoliubov excitations that describe the transfer of electrons between the collective mod and single particle mode.


title: Representation Learning for Event-based Visuomotor Policies

abstract: Event-based cameras are dynamic vision sensors that provide asynchronous measurements of changes in per-pixel brightness at a microsecond level. This makes them significantly faster than conventional frame-based cameras, and an appealing choice for high-speed navigation. While an interesting sensor modality, this asynchronously streamed event data poses a challenge for machine learning techniques that are more suited for frame-based data. In this paper, we present an event variational autoencoder and show that it is feasible to learn compact representations directly from asynchronous spatiotemporal event data. Furthermore, we show that such pretrained representations can be used for event-based reinforcement learning instead of end-to-end reward driven perception. We validate this framework of learning event-based visuomotor policies by applying it to an obstacle avoidance scenario in simulation. Compared to techniques that treat event data as images, we show that representations learnt from event streams result in faster policy training, adapt to different control capacities, and demonstrate a higher degree of robustness.


title: Penalized Projected Kernel Calibration for Computer Models

abstract: Projected kernel calibration is a newly proposed frequentist calibration method, which is asymptotic normal and semi-parametric. Its loss function is usually referred to as the PK loss function. In this work, we prove the uniform convergence of PK loss function and show that (1) when the sample size is large, any local minimum point and local maximum point of the $L_2$ loss between the true process and the computer model is a local minimum point of the PK loss function; (2) all the local minima of the PK loss function converge to the same value. These theoretical results imply that it is extremely hard for the projected kernel calibration to identify the global minimum of the $L_2$ loss, i.e. the optimal value of the calibration parameters. To solve this problem, a frequentist method which we term penalized projected kernel calibration method is suggested and analyzed in detail. We prove that the proposed method is as efficient as the projected kernel calibration method. Through an extensive set of numerical simulations, and a real-world case study, we show that the proposed calibration method can accurately estimate the calibration parameters. We also show that its performance compares favorably to other calibration methods regardless of the sample size.


title: Gradient boosting for extreme quantile regression

abstract: Extreme quantile regression provides estimates of conditional quantiles outside the range of the data. Classical quantile regression performs poorly in such cases since data in the tail region are too scarce. Extreme value theory is used for extrapolation beyond the range of observed values and estimation of conditional extreme quantiles. Based on the peaks-over-threshold approach, the conditional distribution above a high threshold is approximated by a generalized Pareto distribution with covariate dependent parameters. We propose a gradient boosting procedure to estimate a conditional generalized Pareto distribution by minimizing its deviance. Cross-validation is used for the choice of tuning parameters such as the number of trees and the tree depths. We discuss diagnostic plots such as variable importance and partial dependence plots, which help to interpret the fitted models. In simulation studies we show that our gradient boosting procedure outperforms classical methods from quantile regression and extreme value theory, especially for high-dimensional predictor spaces and complex parameter response surfaces. An application to statistical post-processing of weather forecasts with precipitation data in the Netherlands is proposed.


title: Over-sampling De-occlusion Attention Network for Prohibited Items Detection in Noisy X-ray Images

abstract: Security inspection is X-ray scanning for personal belongings in suitcases, which is significantly important for the public security but highly time-consuming for human inspectors. Fortunately, deep learning has greatly promoted the development of computer vision, offering a possible way of automatic security inspection. However, items within a luggage are randomly overlapped resulting in noisy X-ray images with heavy occlusions. Thus, traditional CNN-based models trained through common image recognition datasets fail to achieve satisfactory performance in this scenario. To address these problems, we contribute the first high-quality prohibited X-ray object detection dataset named OPIXray, which contains 8885 X-ray images from 5 categories of the widely-occurred prohibited item ``cutters''. The images are gathered from an airport and these prohibited items are annotated manually by professional inspectors, which can be used as a benchmark for model training and further facilitate future research. To better improve occluded X-ray object detection, we further propose an over-sampling de-occlusion attention network (DOAM-O), which consists of a novel de-occlusion attention module and a new over-sampling training strategy. Specifically, our de-occlusion module, namely DOAM, simultaneously leverages the different appearance information of the prohibited items; the over-sampling training strategy forces the model to put more emphasis on these hard samples consisting these items of high occlusion levels, which is more suitable for this scenario. We comprehensively evaluated DOAM-O on the OPIXray dataset, which proves that our model can stably improve the performance of the famous detection models such as SSD, YOLOv3, and FCOS, and outperform many extensively-used attention mechanisms.


title: MFST: Multi-Features Siamese Tracker

abstract: Siamese trackers have recently achieved interesting results due to their balance between accuracy and speed. This success is mainly due to the fact that deep similarity networks were specifically designed to address the image similarity problem. Therefore, they are inherently more appropriate than classical CNNs for the tracking task. However, Siamese trackers rely on the last convolutional layers for similarity analysis and target search, which restricts their performance. In this paper, we argue that using a single convolutional layer as feature representation is not the optimal choice within the deep similarity framework, as multiple convolutional layers provide several abstraction levels in characterizing an object. Starting from this motivation, we present the Multi-Features Siamese Tracker (MFST), a novel tracking algorithm exploiting several hierarchical feature maps for robust deep similarity tracking. MFST proceeds by fusing hierarchical features to ensure a richer and more efficient representation. Moreover, we handle appearance variation by calibrating deep features extracted from two different CNN models. Based on this advanced feature representation, our algorithm achieves high tracking accuracy, while outperforming several state-of-the-art trackers, including standard Siamese trackers. The code and trained models are available at https://github.com/zhenxili96/MFST.


title: Dilaton stabilization in KKLT revisited

abstract: We study the condition for the dilaton stabilization in Type IIB flux compactifications consistent with the KKLT scenario. Since the Gukov-Vafa-Witten superpotential depends linearly on the dilaton, the dilaton mass squared is given by a sum of the gravitino mass squared and additional terms determined by the complex structure moduli stabilization. If the dilaton mass is not much enhanced from the gravitino mass, the mass mixing with the K\"ahler modulus in the presence of the non-perturbative effect generates the saddle point at the supersymmetric field values, hence the potential becomes unstable. When the complex structure moduli other than the conifold modulus are neglected, the saddle point problem arises over the controllable parameter space. We also point out that the dilaton stabilization condition is equivalent to the condition on the NS 3-form fluxes, $|H_{(1,2)}| > | H_{(0,3)}|$.


title: Enhancement for Robustness of Koopman Operator-based Data-driven Mobile Robotic Systems

abstract: Koopman operator theory has served as the basis to extract dynamics for nonlinear system modeling and control across settings, including non-holonomic mobile robot control. There is a growing interest in research to derive robustness (and/or safety) guarantees for systems the dynamics of which are extracted via the Koopman operator. In this paper, we propose a way to quantify the prediction error because of noisy measurements when the Koopman operator is approximated via Extended Dynamic Mode Decomposition. We further develop an enhanced robot control strategy to endow robustness to a class of data-driven (robotic) systems that rely on Koopman operator theory, and we show how part of the strategy can happen offline in an effort to make our algorithm capable of real-time implementation. We perform a parametric study to evaluate the (theoretical) performance of the algorithm using a Van der Pol oscillator and conduct a series of simulated experiments in Gazebo using a non-holonomic wheeled robot.


title: DST: Data Selection and joint Training for Learning with Noisy Labels

abstract: Training a deep neural network heavily relies on a large amount of training data with accurate annotations. To alleviate this problem, various methods have been proposed to annotate the data automatically. However, automatically generating annotations will inevitably yields noisy labels. In this paper, we propose a Data Selection and joint Training (DST) method to automatically select training samples with accurate annotations. Specifically, DST fits a mixture model according to the original annotation as well as the predicted label for each training sample, and the mixture model is utilized to dynamically divide the training dataset into a correctly labeled dataset, a correctly predicted set and a wrong dataset. Then, DST is trained with these datasets in a supervised manner. Due to confirmation bias problem, we train the two networks alternately, and each network is tasked to establish the data division to teach another network. For each iteration, the correctly labeled and predicted labels are reweighted respectively by the probabilities from the mixture model, and a uniform distribution is used to generate the probabilities of the wrong samples. Experiments on CIFAR-10, CIFAR-100 and Clothing1M demonstrate that DST is the comparable or superior to the state-of-the-art methods.


title: Performant implementation of the atomic cluster expansion (PACE): Application to copper and silicon

abstract: The atomic cluster expansion is a general polynomial expansion of the atomic energy in multi-atom basis functions. Here we implement the atomic cluster expansion in the performant C++ code \verb+PACE+ that is suitable for use in large scale atomistic simulations. We briefly review the atomic cluster expansion and give detailed expressions for energies and forces as well as efficient algorithms for their evaluation. We demonstrate that the atomic cluster expansion as implemented in \verb+PACE+ shifts a previously established Pareto front for machine learning interatomic potentials towards faster and more accurate calculations. Moreover, general purpose parameterizations are presented for copper and silicon and evaluated in detail. We show that the new Cu and Si potentials significantly improve on the best available potentials for highly accurate large-scale atomistic simulations.


title: Computation complexity of deep ReLU neural networks in high-dimensional approximation

abstract: The purpose of the present paper is to study the computation complexity of deep ReLU neural networks to approximate functions in H\"older-Nikol'skii spaces of mixed smoothness $H_\infty^\alpha(\mathbb{I}^d)$ on the unit cube $\mathbb{I}^d:=[0,1]^d$. In this context, for any function $f\in H_\infty^\alpha(\mathbb{I}^d)$, we explicitly construct nonadaptive and adaptive deep ReLU neural networks having an output that approximates $f$ with a prescribed accuracy $\varepsilon$, and prove dimension-dependent bounds for the computation complexity of this approximation, characterized by the size and the depth of this deep ReLU neural network, explicitly in $d$ and $\varepsilon$. Our results show the advantage of the adaptive method of approximation by deep ReLU neural networks over nonadaptive one.


title: Contrastive Separative Coding for Self-supervised Representation Learning

abstract: To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating the target signal from contrastive interfering signals. First, a multi-task separative encoder is built to extract shared separable and discriminative embedding; secondly, we propose a powerful cross-attention mechanism performed over speaker representations across various interfering conditions, allowing the model to focus on and globally aggregate the most critical information to answer the "query" (current bottom-up embedding) while paying less attention to interfering, noisy, or irrelevant parts; lastly, we form a new probabilistic contrastive loss which estimates and maximizes the mutual information between the representations and the global speaker vector. While most prior unsupervised methods have focused on predicting the future, neighboring, or missing samples, we take a different perspective of predicting the interfered samples. Moreover, our contrastive separative loss is free from negative sampling. The experiment demonstrates that our approach can learn useful representations achieving a strong speaker verification performance in adverse conditions.


title: Local Tail Statistics of Heavy-Tailed Random Matrix Ensembles with Unitary Invariance

abstract: We study heavy-tailed Hermitian random matrices that are unitarily invariant. The invariance implies that the eigenvalue and eigenvector statistics are decoupled. The motivating question has been whether a freely stable random matrix has stable eigenvalue statistics for the largest eigenvalues in the tail. We investigate this question through the use of both numerical and analytical means, the latter of which makes use of the supersymmetry method. A surprising behaviour is uncovered in that a freely stable random matrix does not necessarily yield stable statistics and if it does then it might exhibit Poisson or Poisson-like statistics. The Poisson statistics have been already observed for heavy-tailed Wigner matrices. We conclude with two conjectures on this peculiar behaviour.

categories: math-ph cond-mat.dis-nn math.MP math.PR math.ST stat.TH


title: Superfluid stars and Q-balls in curved spacetime

abstract: Within the framework of the theory of strongly-interacting quantum Bose liquids, we consider a general relativistic model of self-interacting complex scalar fields with logarithmic nonlinearity taken from dense superfluid models. We demonstrate the existence of gravitational equilibria in this model, described by spherically symmetric nonsingular finite-mass asymptotically-flat solutions. These equilibrium configurations can describe both massive astronomical objects, such as bosonized superfluid stars or cores of neutron stars, and finite-size particles and non-topological solitons, such as Q-balls. We give an estimate for masses and sizes of such objects.


title: Sandglasset: A Light Multi-Granularity Self-attentive Network For Time-Domain Speech Separation

abstract: One of the leading single-channel speech separation (SS) models is based on a TasNet with a dual-path segmentation technique, where the size of each segment remains unchanged throughout all layers. In contrast, our key finding is that multi-granularity features are essential for enhancing contextual modeling and computational efficiency. We introduce a self-attentive network with a novel sandglass-shape, namely Sandglasset, which advances the state-of-the-art (SOTA) SS performance at significantly smaller model size and computational cost. Forward along each block inside Sandglasset, the temporal granularity of the features gradually becomes coarser until reaching half of the network blocks, and then successively turns finer towards the raw signal level. We also unfold that residual connections between features with the same granularity are critical for preserving information after passing through the bottleneck layer. Experiments show our Sandglasset with only 2.3M parameters has achieved the best results on two benchmark SS datasets -- WSJ0-2mix and WSJ0-3mix, where the SI-SNRi scores have been improved by absolute 0.8 dB and 2.4 dB, respectively, comparing to the prior SOTA results.


title: Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialogues

abstract: Compared to traditional visual question answering, video-grounded dialogues require additional reasoning over dialogue context to answer questions in a multi-turn setting. Previous approaches to video-grounded dialogues mostly use dialogue context as a simple text input without modelling the inherent information flows at the turn level. In this paper, we propose a novel framework of Reasoning Paths in Dialogue Context (PDC). PDC model discovers information flows among dialogue turns through a semantic graph constructed based on lexical components in each question and answer. PDC model then learns to predict reasoning paths over this semantic graph. Our path prediction model predicts a path from the current turn through past dialogue turns that contain additional visual cues to answer the current question. Our reasoning model sequentially processes both visual and textual information through this reasoning path and the propagated features are used to generate the answer. Our experimental results demonstrate the effectiveness of our method and provide additional insights on how models use semantic dependencies in a dialogue context to retrieve visual cues.


title: Rethinking complexity for software code structures: A pioneering study on Linux kernel code repository

abstract: The recent progress of artificial intelligence(AI) has shown great potentials for alleviating human burden in various complex tasks. From the view of software engineering, AI techniques can be seen in many fundamental aspects of development, such as source code comprehension, in which state-of-the-art models are implemented to extract and express the meaning of code snippets automatically. However, such technologies are still struggling to tackle and comprehend the complex structures within industrial code, thus far from real-world applications. In the present work, we built an innovative and systematical framework, emphasizing the problem of complexity in code comprehension and further software engineering. Upon automatic data collection from the latest Linux kernel source code, we modeled code structures as complex networks through token extraction and relation parsing. Comprehensive analysis of complexity further revealed the density and scale of network-based code representations. Our work constructed the first large-scale dataset from industrial-strength software code for downstream software engineering tasks including code comprehension, and incorporated complex network theory into code-level investigations of software development for the first time. In the longer term, the proposed methodology could play significant roles in the entire software engineering process, powering software design, coding, debugging, testing, and sustaining by redefining and embracing complexity.


title: Understanding the Complexity of Detecting Political Ads

abstract: Online political advertising has grown significantly over the last few years. To monitor online sponsored political discourse, companies such as Facebook, Google, and Twitter have created public Ad Libraries collecting the political ads that run on their platforms. Currently, both policymakers and platforms are debating further restrictions on political advertising to deter misuses. This paper investigates whether we can reliably distinguish political ads from non-political ads. We take an empirical approach to analyze what kind of ads are deemed political by ordinary people and what kind of ads lead to disagreement. Our results show a significant disagreement between what ad platforms, ordinary people, and advertisers consider political and suggest that this disagreement mainly comes from diverging opinions on which ads address social issues. Overall our results imply that it is important to consider social issue ads as political, but they also complicate political advertising regulations.


title: M6: A Chinese Multimodal Pretrainer

abstract: In this work, we construct the largest dataset for multimodal pretraining in Chinese, which consists of over 1.9TB images and 292GB texts that cover a wide range of domains. We propose a cross-modal pretraining method called M6, referring to Multi-Modality to Multi-Modality Multitask Mega-transformer, for unified pretraining on the data of single modality and multiple modalities. We scale the model size up to 10 billion and 100 billion parameters, and build the largest pretrained model in Chinese. We apply the model to a series of downstream applications, and demonstrate its outstanding performance in comparison with strong baselines. Furthermore, we specifically design a downstream task of text-guided image generation, and show that the finetuned M6 can create high-quality images with high resolution and abundant details.


title: Reparametrization mode Ward Identities and chaos in higher-pt. correlators in CFT$_2$

abstract: Recently introduced reparametrization mode operators in CFTs have been shown to govern stress tensor interactions $via$ the shadow operator formalism and seem to govern the effective dynamics of chaotic systems. We initiate a study of Ward identities of reparametrization mode operators $i.e.$ how two dimensional CFT Ward identities govern the behaviour of insertions of reparametrization modes $\epsilon$ in correlation functions: $\langle\epsilon\epsilon\phi\phi\rangle$. We find that in the semi-classical limit of large $c$ they dictate the leading $\mathcal{O}(c^{-1})$ behaviour. While for the $4$pt function this reproduces the same computation as done by Heahl, Reeves \& Rozali in \cite{Haehl:2019eae}, in the case of 6pt function of pair-wise equal operators this provides an alternative way of computing the Virasoro block in stress-tensor comb channel. We compute a maximally out of time ordered correlation function in a thermal background and find the expected behaviour of an exponential growth governed by Lyapunov index $\lambda_L=2\pi/\beta$ lasting for twice the scrambling time of the system $t^*=\frac{\beta}{2\pi}\log\,c$ for the maximally braided type of $out$-$of$-$time$-$ordering$. However when only the internal operators of the comb channel are \emph{out-of-time-ordered}, the correlator sees no exponential behaviour despite the inclusion of the Virasoro contribution. From a bulk perspective for the \emph{out-of-time-ordered} $4$pt function we find that the Casimir equation for the stress tensor block reproduces the linearised back reaction in the bulk.


title: On universal stably free modules in positive characteristic

abstract: We study the mod $p$ motivic cohomology of homogeneous varieties such as $GL_{n}/GL_{r}$ or $Sp_{2n}/Sp_{2n-2}$ along with the action of the Steenrod operations, without restrictions on the characteristic of the base field. In particular, we prove that certain quotient maps do not admit sections.


title: Mapping the Gravitational-wave Sky with LISA: A Bayesian Spherical Harmonic Approach

abstract: The millihertz gravitational-wave frequency band is expected to contain a rich symphony of signals with sources ranging from galactic white dwarf binaries to extreme mass ratio inspirals. Many of these gravitational-wave signals will not be individually resolvable. Instead, they will incoherently add to produce stochastic gravitational-wave confusion noise whose frequency content will be governed by the dynamics of the sources. The angular structure of the power of the confusion noise will be modulated by the distribution of the sources across the sky. Measurement of this structure can yield important information about the distribution of sources on galactic and extra-galactic scales, their astrophysics and their evolution over cosmic timescales. Moreover, since the confusion noise is part of the noise budget of LISA, mapping it will also be essential for studying resolvable signals. In this paper, we present a Bayesian algorithm to probe the angular distribution of the stochastic gravitational-wave confusion noise with LISA using a spherical harmonic basis. We develop a technique based on Clebsch-Gordan coefficients to mathematically constrain the spherical harmonics to yield a non-negative distribution, making them optimal for expanding the gravitational-wave power and amenable to Bayesian inference. We demonstrate these techniques using a series of simulations and analyses, including recovery of simulated distributed and localized sources of gravitational-wave power. We also apply this method to map the gravitational-wave foreground from galactic white-dwarfs using a simplified model of the galactic white dwarf distribution.


title: Linear Recurrences over a Finite Field with Exactly Two Periods

abstract: In this paper, we study the periodicity structure of finite field linear recurring sequences whose period is not necessarily maximal and determine necessary and sufficient conditions for the characteristic polynomial~\(f\) to have exactly two periods in the sense that the period of any sequence generated by~\(f\) is either one or a unique integer greater than one.


title: The effects of large-scale magnetic fields on the model for repeating changing-look AGNs

abstract: Periodic outbursts are observed in several changing-look (CL) active galactic nuclei (AGNs). \citet{sniegowska_possible_2020} suggested a model to explain the repeating CL in these AGNs, where the periodic outbursts are triggered in a narrow unstable zone between an inner ADAF and outer thin disk. In this work, we intend to investigate the effects of large-scale magnetic fields on the limit cycle behaviors of CL AGNs. The winds driven by magnetic fields can significantly change the structure of thin disk by taking away the angular momentum and energy of the disk. It is found that the period of outburst in repeating CL AGNs can be substantially reduced by the magnetic fields. Conversely, if we keep the period unchanged, the outburst intensity can be raised for several times. These results can help to explain the observational properties of multiple CL AGNs. Besides the magnetic fields, the effects of transition radius $R_{\rm tr}$, the width of transition zone $\Delta R$ and Shakura-Sunyaev parameter $\alpha$ are also explored in this work.


title: 6G Downlink Transmission via Rate Splitting Space Division Multiple Access Based on Grouped Code Index Modulation

abstract: A novel rate splitting space division multiple access (SDMA) scheme based on grouped code index modulation (GrCIM) is proposed for the sixth generation (6G) downlink transmission. The proposed RSMA-GrCIM scheme transmits information to multiple user equipments (UEs) through the space division multiple access (SDMA) technique, and exploits code index modulation for rate splitting. Since the CIM scheme conveys information bits via the index of the selected Walsh code and binary phase shift keying (BPSK) signal, our RSMA scheme transmits the private messages of each user through the indices, and the common messages via the BPSK signal. Moreover, the Walsh code set is grouped into several orthogonal subsets to eliminate the interference from other users. A maximum likelihood (ML) detector is used to recovery the source bits, and a mathematical analysis is provided for the upper bound bit error ratio (BER) of each user. Comparisons are also made between our proposed scheme and the traditional SDMA scheme in spectrum utilization, number of available UEs, etc. Numerical results are given to verify the effectiveness of the proposed SDMA-GrCIM scheme.


title: Dynamical organization of recollisions by a family of invariant tori

abstract: We consider the motion of an electron in an atom subjected to a strong linearly polarized laser field. We identify the invariant structures organizing a very specific subset of trajectories, namely recollisions. Recollisions are trajectories which first escape the ionic core (i.e., ionize) and later return to this ionic core, for instance, to transfer the energy gained during the large excursion away from the core to bound electrons. We consider the role played by the directions transverse to the polarization direction in the recollision process. We compute the family of two-dimensional invariant tori associated with a specific hyperbolic-elliptic periodic orbit and their stable and unstable manifolds. We show that these manifolds organize recollisions in phase space.


title: Online anomaly detection using statistical leverage for streaming business process events

abstract: While several techniques for detecting trace-level anomalies in event logs in offline settings have appeared recently in the literature, such techniques are currently lacking for online settings. Event log anomaly detection in online settings can be crucial for discovering anomalies in process execution as soon as they occur and, consequently, allowing to promptly take early corrective actions. This paper describes a novel approach to event log anomaly detection on event streams that uses statistical leverage. Leverage has been used extensively in statistics to develop measures to identify outliers and it has been adapted in this paper to the specific scenario of event stream data. The proposed approach has been evaluated on both artificial and real event streams.


title: Self-supervised Low Light Image Enhancement and Denoising

abstract: This paper proposes a self-supervised low light image enhancement method based on deep learning, which can improve the image contrast and reduce noise at the same time to avoid the blur caused by pre-/post-denoising. The method contains two deep sub-networks, an Image Contrast Enhancement Network (ICE-Net) and a Re-Enhancement and Denoising Network (RED-Net). The ICE-Net takes the low light image as input and produces a contrast enhanced image. The RED-Net takes the result of ICE-Net and the low light image as input, and can re-enhance the low light image and denoise at the same time. Both of the networks can be trained with low light images only, which is achieved by a Maximum Entropy based Retinex (ME-Retinex) model and an assumption that noises are independently distributed. In the ME-Retinex model, a new constraint on the reflectance image is introduced that the maximum channel of the reflectance image conforms to the maximum channel of the low light image and its entropy should be the largest, which converts the decomposition of reflectance and illumination in Retinex model to a non-ill-conditioned problem and allows the ICE-Net to be trained with a self-supervised way. The loss functions of RED-Net are carefully formulated to separate the noises and details during training, and they are based on the idea that, if noises are independently distributed, after the processing of smoothing filters (\eg mean filter), the gradient of the noise part should be smaller than the gradient of the detail part. It can be proved qualitatively and quantitatively through experiments that the proposed method is efficient.


title: Fast threshold optimization for multi-label audio tagging using Surrogate gradient learning

abstract: Multi-label audio tagging consists of assigning sets of tags to audio recordings. At inference time, thresholds are applied on the confidence scores outputted by a probabilistic classifier, in order to decide which classes are detected active. In this work, we consider having at disposal a trained classifier and we seek to automatically optimize the decision thresholds according to a performance metric of interest, in our case F-measure (micro-F1). We propose a new method, called SGL-Thresh for Surrogate Gradient Learning of Thresholds, that makes use of gradient descent. Since F1 is not differentiable, we propose to approximate the thresholding operation gradients with the gradients of a sigmoid function. We report experiments on three datasets, using state-of-the-art pre-trained deep neural networks. In all cases, SGL-Thresh outperformed three other approaches: a default threshold value (defThresh), an heuristic search algorithm and a method estimating F1 gradients numerically. It reached 54.9\% F1 on AudioSet eval, compared to 50.7% with defThresh. SGL-Thresh is very fast and scalable to a large number of tags. To facilitate reproducibility, data and source code in Pytorch are available online: https://github.com/topel/SGL-Thresh


title: Improving the output quality of official statistics based on machine learning algorithms

abstract: National statistical institutes currently investigate how to improve the output quality of official statistics based on machine learning algorithms. A key obstacle is concept drift, i.e., when the joint distribution of independent variables and a dependent (categorical) variable changes over time. Under concept drift, a statistical model requires regular updating to prevent it from becoming biased. However, updating a model asks for additional data, which are not always available. In the literature, we find a variety of bias correction methods as a promising solution. In the paper, we will compare two popular correction methods: the misclassification estimator and the calibration estimator. For prior probability shift (a specific type of concept drift), we investigate the two correction methods theoretically as well as experimentally. Our theoretical results are expressions for the bias and variance of both methods. As experimental result, we present a decision boundary (as a function of (a) model accuracy, (b) class distribution and (c) test set size) for the relative performance of the two methods. Close inspection of the results will provide a deep insight into the effect of prior probability shift on output quality, leading to practical recommendations on the use of machine learning algorithms in official statistics.


title: Combining Rational maps and Kleinian groups via orbit equivalence

abstract: We develop a new orbit equivalence framework for holomorphically mating the dynamics of complex polynomials with that of Kleinian surface groups. We show that the only torsion-free Fuchsian groups that can be thus mated are punctured sphere groups. We describe a new class of maps that are topologically orbit equivalent to Fuchsian punctured sphere groups. We call these higher Bowen-Series maps. The existence of this class ensures that the Teichm\"uller space of matings has one component corresponding to Bowen-Series maps and one corresponding to higher Bowen-Series maps. We also show that, unlike in higher dimensions, topological orbit equivalence rigidity fails for Fuchsian groups acting on the circle. We also classify the collection of Kleinian Bers boundary groups that are mateable in our framework.


title: Magnetic-Torque Enhanced by Tunable Dipolar interactions

abstract: We use tunable dipolar-interactions between the spins of nitrogen-vacancy (NV) centers in diamond to rotate a diamond crystal. Specifically, we employ cross-relaxation between the electronic spin of pairs of NV centers in a trapped diamond to enhance the anisotropic NV paramagnetism and thus to increase the associated spin torque. Our observations open a path towards the use of mechanical oscillators to detect paramagnetic defects that lack optical transitions, to investigation of angular momentum conservation in spin relaxation processes and to novel means of cooling the motion of mechanical oscillators.


title: Rate of convergence for particle approximation of PDEs in Wasserstein space

abstract: We prove a rate of convergence for the $N$-particle approximation of a second-order partial differential equation in the space of probability measures, like the Master equation or Bellman equation of mean-field control problem under common noise. The rate is of order $1/N$ for the pathwise error on the solution $v$ and of order $1/\sqrt{N}$ for the $L^2$-error on its $L$-derivative $\partial_\mu v$. The proof relies on backward stochastic differential equations techniques.


title: DeepSets and their derivative networks for solving symmetric PDEs

abstract: Machine learning methods for solving nonlinear partial differential equations (PDEs) are hot topical issues, and different algorithms proposed in the literature show efficient numerical approximation in high dimension. In this paper, we introduce a class of PDEs that are invariant to permutations, and called symmetric PDEs. Such problems are widespread, ranging from cosmology to quantum mechanics, and option pricing/hedging in multi-asset market with exchangeable payoff. Our main application comes actually from the particles approximation of mean-field control problems. We design deep learning algorithms based on certain types of neural networks, named PointNet and DeepSet (and their associated derivative networks), for computing simultaneously an approximation of the solution and its gradient to symmetric PDEs. We illustrate the performance and accuracy of the PointNet/DeepSet networks compared to classical feedforward ones, and provide several numerical results of our algorithm for the examples of a mean-field systemic risk, mean-variance problem and a min/max linear quadratic McKean-Vlasov control problem.


title: A new tool for two-dimensional field-reversed configuration equilibrium study

abstract: A new tool (GSEQ-FRC) for solving two-dimensional (2D) equilibrium of field-reversed configuration (FRC) based on fixed boundary and free boundary conditions with external coils included is developed. Benefiting from the two-parameter modified rigid rotor (MRR) radial equilibrium model and the numerical approaches presented by [Ma et al, Nucl. Fusion, 61, 036046, 2021], GSEQ-FRC are used to study the equilibrium properties of FRC quantitatively and will be used for fast FRC equilibrium reconstruction. In GSEQ-FRC, the FRC equilibrium can be conveniently determined by two parameters, i.e., the ratio between thermal pressure and magnetic pressure at the seperatrix $\beta_s$, and the normalized scrape of layer (SOL) width $\delta_s$. Examples with fixed and free boundary conditions are given to demonstrate the capability of GSEQ-FRC in the equilibrium calculations. This new tool is used to quantitatively study the factors affecting the shape of the FRC separatrix, revealing how the FRC changes from racetrack-like to ellipse-like.


title: Charge Redistribution and Spin Polarization Driven by Correlation Induced Electron Exchange in Chiral Molecules

abstract: Chiral induced spin selectivity is a phenomenon that has been attributed to chirality, spin-orbit interactions, and non-equilibrium conditions, while the role of electron exchange and correlations have been investigated only marginally until very recently. However, as recent experiments show that chiral molecules acquire a finite spin-polarization merely by being in contact with a metallic surface, these results suggest that electron correlations play a more crucial role for the emergence of the phenomenon than previously thought. Here, it is demonstrated that molecular vibrations give rise to molecular charge redistribution and accompanied spin-polarization when coupling a chiral molecule to a non-magnetic metal. It is, moreover, shown that enantiomer separation, due to spin-polarization intimately related to the chirality, can be understood in terms of the proposed model.


title: Learning Frequency Domain Approximation for Binary Neural Networks

abstract: Binary neural networks (BNNs) represent original full-precision weights and activations into 1-bit with sign function. Since the gradient of the conventional sign function is almost zero everywhere which cannot be used for back-propagation, several attempts have been proposed to alleviate the optimization difficulty by using approximate gradient. However, those approximations corrupt the main direction of factual gradient. To this end, we propose to estimate the gradient of sign function in the Fourier frequency domain using the combination of sine functions for training BNNs, namely frequency domain approximation (FDA). The proposed approach does not affect the low-frequency information of the original sign function which occupies most of the overall energy, and high-frequency coefficients will be ignored to avoid the huge computational overhead. In addition, we embed a noise adaptation module into the training phase to compensate the approximation error. The experiments on several benchmark datasets and neural architectures illustrate that the binary network learned using our method achieves the state-of-the-art accuracy. Code will be available at \textit{https://gitee.com/mindspore/models/tree/master/research/cv/FDA-BNN}.


title: Asymptotic convergence for a class of anisotropic curvature flows

abstract: In this paper, by using new auxiliary functions, we study a class of contracting flows of closed, star-shaped hypersurfaces in $\mathbb{R}^{n+1}$ with speed $r^{\frac{\alpha}{\beta}}\sigma_k^{\frac{1}{\beta}}$, where $\sigma_k$ is the $k$-th elementary symmetric polynomial of the principal curvatures, $\alpha$, $\beta$ are positive constants and $r$ is the distance from points on the hypersurface to the origin. We obtain convergence results under some assumptions of $k$, $\alpha$, $\beta$. When $k\geq2$, $0<\beta\leq 1$, $\alpha\geq \beta+k$, we prove that the $k$-convex solution to the flow exists for all time and converges smoothly to a sphere after normalization, in particular, we generalize Li-Sheng-Wang's result from uniformly convex to $k$-convex. When $k \geq 2$, $\beta=k$, $\alpha \geq 2k$, we prove that the $k$-convex solution to the flow exists for all time and converges smoothly to a sphere after normalization, in particular, we generalize Ling Xiao's result from $k=2$ to $k \geq 2$.


title: A multistep pulse compressor for 10s to 100s PW lasers

abstract: High-energy tens (10s) to hundreds (100s) petawatt (PW) lasers are key tools for exploring frontier fundamental researches such as strong-field quantum electrodynamics (QED), and the generation of positron-electron pair from vacuum. Recently, pulse compressor became the main obstacle on achieving higher peak power due to the limitation of damage threshold and size of diffraction gratings. Here, we propose a feasible multistep pulse compressor (MPC) to increase the maximum bearable input and output pulse energies through modifying their spatiotemporal properties. Typically, the new MPC including a prism pair for pre-compression, a four-grating compressor (FGC) for main compression, and a spatiotemporal focusing based self-compressor for post-compression. The prism pair can induce spatial dispersion to smooth and enlarge the laser beam, which increase the maximum input and output pulse energies. As a result, as high as 100 PW laser with single beam or more than 150 PW through combining two beams can be obtained by using MPC and current available optics. This new optical design will simplify the compressor, improve the stability, and save expensive gratings/optics simultaneously. Together with the multi-beam tiled-aperture combining method, the tiled-grating method, larger gratings, or negative chirp pulse based self-compression method, several 100s PW laser beam is expected to be obtained by using this MPC method in the future, which will further extend the ultra-intense laser physics research fields.


title: Emotion pattern detection on facial videos using functional statistics

abstract: There is an increasing scientific interest in automatically analysing and understanding human behavior, with particular reference to the evolution of facial expressions and the recognition of the corresponding emotions. In this paper we propose a technique based on Functional ANOVA to extract significant patterns of face muscles movements, in order to identify the emotions expressed by actors in recorded videos. We determine if there are time-related differences on expressions among emotional groups by using a functional F-test. Such results are the first step towards the construction of a reliable automatic emotion recognition system


title: A Brief Summary of Interactions Between Meta-Learning and Self-Supervised Learning

abstract: This paper briefly reviews the connections between meta-learning and self-supervised learning. Meta-learning can be applied to improve model generalization capability and to construct general AI algorithms. Self-supervised learning utilizes self-supervision from original data and extracts higher-level generalizable features through unsupervised pre-training or optimization of contrastive loss objectives. In self-supervised learning, data augmentation techniques are widely applied and data labels are not required since pseudo labels can be estimated from trained models on similar tasks. Meta-learning aims to adapt trained deep models to solve diverse tasks and to develop general AI algorithms. We review the associations of meta-learning with both generative and contrastive self-supervised learning models. Unlabeled data from multiple sources can be jointly considered even when data sources are vastly different. We show that an integration of meta-learning and self-supervised learning models can best contribute to the improvement of model generalization capability. Self-supervised learning guided by meta-learner and general meta-learning algorithms under self-supervision are both examples of possible combinations.


title: A new minimizing-movements scheme for curves of maximal slope

abstract: Curves of maximal slope are a reference gradient-evolution notion in metric spaces and arise as variational formulation of a vast class of nonlinear diffusion equations. Existence theories for curves of maximal slope are often based on minimizing-movements schemes, most notably on the Euler scheme. We present here an alternative minimizing-movements approach, yielding more regular discretizations, serving as a-posteriori convergence estimator, and allowing for a simple convergence proof.


title: Am I a Real or Fake Celebrity? Measuring Commercial Face Recognition Web APIs under Deepfake Impersonation Attack

abstract: Recently, significant advancements have been made in face recognition technologies using Deep Neural Networks. As a result, companies such as Microsoft, Amazon, and Naver offer highly accurate commercial face recognition web services for diverse applications to meet the end-user needs. Naturally, however, such technologies are threatened persistently, as virtually any individual can quickly implement impersonation attacks. In particular, these attacks can be a significant threat for authentication and identification services, which heavily rely on their underlying face recognition technologies' accuracy and robustness. Despite its gravity, the issue regarding deepfake abuse using commercial web APIs and their robustness has not yet been thoroughly investigated. This work provides a measurement study on the robustness of black-box commercial face recognition APIs against Deepfake Impersonation (DI) attacks using celebrity recognition APIs as an example case study. We use five deepfake datasets, two of which are created by us and planned to be released. More specifically, we measure attack performance based on two scenarios (targeted and non-targeted) and further analyze the differing system behaviors using fidelity, confidence, and similarity metrics. Accordingly, we demonstrate how vulnerable face recognition technologies from popular companies are to DI attack, achieving maximum success rates of 78.0% and 99.9% for targeted (i.e., precise match) and non-targeted (i.e., match with any celebrity) attacks, respectively. Moreover, we propose practical defense strategies to mitigate DI attacks, reducing the attack success rates to as low as 0% and 0.02% for targeted and non-targeted attacks, respectively.


title: A Bioinspired Retinal Neural Network for Accurately Extracting Small-Target Motion Information in Cluttered Backgrounds

abstract: Robust and accurate detection of small moving targets in cluttered moving backgrounds is a significant and challenging problem for robotic visual systems to perform search and tracking tasks. Inspired by the neural circuitry of elementary motion vision in the mammalian retina, this paper proposes a bioinspired retinal neural network based on a new neurodynamics-based temporal filtering and multiform 2-D spatial Gabor filtering. This model can estimate motion direction accurately via only two perpendicular spatiotemporal filtering signals, and respond to small targets of different sizes and velocities by adjusting the dendrite field size of the spatial filter. Meanwhile, an algorithm of directionally selective inhibition is proposed to suppress the target-like features in the moving background, which can reduce the influence of background motion effectively. Extensive synthetic and real-data experiments show that the proposed model works stably for small targets of a wider size and velocity range, and has better detection performance than other bioinspired models. Additionally, it can also extract the information of motion direction and motion energy accurately and rapidly.


title: Numerical approximation of the spectrum of self-adjoint continuously invertible operators

abstract: This paper deals with the generalized spectrum of continuously invertible linear operators defined on infinite dimensional Hilbert spaces. More precisely, we consider two bounded, coercive, and self-adjoint operators $\bc{A, B}: V\mapsto V^{\#}$, where $V^{\#}$ denotes the dual of $V$, and investigate the conditions under which the whole spectrum of $\bc{B}^{-1}\bc{A}:V\mapsto V$ can be approximated to an arbitrary accuracy by the eigenvalues of the finite dimensional discretization $\bc{B}_n^{-1}\bc{A}_n$. Since $\bc{B}^{-1}\bc{A}$ is continuously invertible, such an investigation cannot use the concept of uniform (normwise) convergence, and it relies instead on the pointwise (strong) convergence of $\bc{B}_n^{-1}\bc{A}_n$ to $\bc{B}^{-1}\bc{A}$. The paper is motivated by operator preconditioning which is employed in the numerical solution of boundary value problems. In this context, $\bc{A}, \bc{B}: H_0^1(\Omega) \mapsto H^{-1}(\Omega)$ are the standard integral/functional representations of the differential operators $ -\nabla \cdot (k(x)\nabla u)$ and $-\nabla \cdot (g(x)\nabla u)$, respectively, and $k(x)$ and $g(x)$ are scalar coefficient functions. The investigated question differs from the eigenvalue problem studied in the numerical PDE literature which is based on the approximation of the eigenvalues within the framework of compact operators. This work follows the path started by the two recent papers published in [SIAM J. Numer. Anal., 57 (2019), pp.~1369-1394 and 58 (2020), pp.~2193-2211] and addresses one of the open questions formulated at the end of the second paper.


title: Memory effects and KWW relaxation of the interacting magnetic nano-particles

abstract: The nano-particle systems under theoretically and experimentally investigation because of the potential applications in the nano-technology such as drug delivery, ferrofluids mechanics, magnetic data storage, sensors, magnetic resonance imaging, and cancer therapy. Recently, it is reported that interacting nano-particles behave as spin-glasses and experimentally show that the relaxation of these systems obeys stretched exponential i.e., KWW relaxation. Therefore, in this study, considering the interacting nano-particle systems we model the relaxation and investigate frequency and temperature behaviour depends on slow relaxation by using a simple operator formalism. We show that relaxation deviates from Debye and obeys to KWW in the presence of the memory effects in the system. Furthermore, we obtain the frequency and temperature behaviour depend on KWW relaxation. We conclude that the obtained results are consistent with experimental results and the simple model, presented here, is very useful and pedagogical to discuss the slow relaxation of the interacting nano-particles.


title: Robust stability analysis of a simple data-driven model predictive control approach

abstract: In this paper, we provide a theoretical analysis of closed-loop properties of a simple data-driven model predictive control (MPC) scheme. The formulation does not involve any terminal ingredients, thus allowing for a simple implementation without (potential) feasibility issues. The proposed approach relies on an implicit description of linear time-invariant systems based on behavioral systems theory, which only requires one input-output trajectory of an unknown system. For the nominal case with noise-free data, we prove that the data-driven MPC scheme ensures exponential stability for the closed loop if the prediction horizon is sufficiently long. Moreover, we analyze the robust data-driven MPC scheme for noisy output measurements for which we prove closed-loop practical exponential stability. The advantages of the presented approach are illustrated with a numerical example.


title: CrossMap Transformer: A Crossmodal Masked Path Transformer Using Double Back-Translation for Vision-and-Language Navigation

abstract: Navigation guided by natural language instructions is particularly suitable for Domestic Service Robots that interacts naturally with users. This task involves the prediction of a sequence of actions that leads to a specified destination given a natural language navigation instruction. The task thus requires the understanding of instructions, such as ``Walk out of the bathroom and wait on the stairs that are on the right''. The Visual and Language Navigation remains challenging, notably because it requires the exploration of the environment and at the accurate following of a path specified by the instructions to model the relationship between language and vision. To address this, we propose the CrossMap Transformer network, which encodes the linguistic and visual features to sequentially generate a path. The CrossMap transformer is tied to a Transformer-based speaker that generates navigation instructions. The two networks share common latent features, for mutual enhancement through a double back translation model: Generated paths are translated into instructions while generated instructions are translated into path The experimental results show the benefits of our approach in terms of instruction understanding and instruction generation.


title: ADAADepth: Adapting Data Augmentation and Attention for Self-Supervised Monocular Depth Estimation

abstract: Self-supervised learning of depth has been a highly studied topic of research as it alleviates the requirement of having ground truth annotations for predicting depth. Depth is learnt as an intermediate solution to the task of view synthesis, utilising warped photometric consistency. Although it gives good results when trained using stereo data, the predicted depth is still sensitive to noise, illumination changes and specular reflections. Also, occlusion can be tackled better by learning depth from a single camera. We propose ADAA, utilising depth augmentation as depth supervision for learning accurate and robust depth. We propose a relational self-attention module that learns rich contextual features and further enhances depth results. We also optimize the auto-masking strategy across all losses by enforcing L1 regularisation over mask. Our novel progressive training strategy first learns depth at a lower resolution and then progresses to the original resolution with slight training. We utilise a ResNet18 encoder, learning features for prediction of both depth and pose. We evaluate our predicted depth on the standard KITTI driving dataset and achieve state-of-the-art results for monocular depth estimation whilst having significantly lower number of trainable parameters in our deep learning framework. We also evaluate our model on Make3D dataset showing better generalization than other methods.


title: Vy\=akarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages

abstract: While there has been significant progress towards developing NLU resources for Indic languages, syntactic evaluation has been relatively less explored. Unlike English, Indic languages have rich morphosyntax, grammatical genders, free linear word-order, and highly inflectional morphology. In this paper, we introduce Vy\=akarana: a benchmark of Colorless Green sentences in Indic languages for syntactic evaluation of multilingual language models. The benchmark comprises four syntax-related tasks: PoS Tagging, Syntax Tree-depth Prediction, Grammatical Case Marking, and Subject-Verb Agreement. We use the datasets from the evaluation tasks to probe five multilingual language models of varying architectures for syntax in Indic languages. Due to its prevalence, we also include a code-switching setting in our experiments. Our results show that the token-level and sentence-level representations from the Indic language models (IndicBERT and MuRIL) do not capture the syntax in Indic languages as efficiently as the other highly multilingual language models. Further, our layer-wise probing experiments reveal that while mBERT, DistilmBERT, and XLM-R localize the syntax in middle layers, the Indic language models do not show such syntactic localization.


title: From non-unitary wheeled PROPs to smooth amplitudes and generalised convolutions

abstract: We introduce the concept of TRAP (Traces and Permutations), which can roughly be viewed as a wheeled PROP (Products and Permutations) without unit. TRAPs are equipped with a horizontal concatenation and partial trace maps. Continuous morphisms on an infinite dimensional topological space and smooth kernels (resp. smoothing operators) on a closed manifold form a TRAP but not a wheeled PROP. We build the free objects in the category of TRAPs as TRAPs of graphs and show that a TRAP can be completed to a unitary TRAP (or wheeled PROP). We further show that it can be equipped with a vertical concatenation, which on the TRAP of linear homomorphisms of a vector space, amounts to the usual composition. The vertical concatenation in the TRAP of smooth kernels gives rise to generalised convolutions. Graphs whose vertices are decorated by smooth kernels (resp. smoothing operators) on a closed manifold form a TRAP. From their universal properties we build smooth amplitudes associated with the graph.