title: A frequency quintupled laser at 308 nm for spectroscopy of intercombination lines in zinc

abstract: Many experiments in atomic physics and quantum optics, among them optical atomic clocks, require laser sources in the ultra-violet wavelength range with very low intensity noise and phase noise. The development of such lasers is a challenge, especially when a robust and transportable system is required. Here, we report on the development of a novel continuous wave (cw) frequency-quintupled laser at 308 nm with an output power of 0.5 mW, based on a fiber laser operating in the telecom band. Three consecutive frequency conversion stages in nonlinear crystals are employed. The performance of the laser system is demonstrated by linear absorption spectroscopy of a narrow intercombination line in zinc.


title: Monogamy of Entanglement Measures Based on Fidelity in Multiqubit Systems

abstract: We show exactly that the $\alpha$th power of Bures measure of entanglement and geometric measure of entanglement, as special case of entanglement measures based on fidelity, obey a class of general monogamy inequalities in an arbitrary multiqubit mixed state for $\alpha\geq1$.


title: Insight-centric Visualization Recommendation

abstract: Visualization recommendation systems simplify exploratory data analysis (EDA) and make understanding data more accessible to users of all skill levels by automatically generating visualizations for users to explore. However, most existing visualization recommendation systems focus on ranking all visualizations into a single list or set of groups based on particular attributes or encodings. This global ranking makes it difficult and time-consuming for users to find the most interesting or relevant insights. To address these limitations, we introduce a novel class of visualization recommendation systems that automatically rank and recommend both groups of related insights as well as the most important insights within each group. Our proposed approach combines results from many different learning-based methods to discover insights automatically. A key advantage is that this approach generalizes to a wide variety of attribute types such as categorical, numerical, and temporal, as well as complex non-trivial combinations of these different attribute types. To evaluate the effectiveness of our approach, we implemented a new insight-centric visualization recommendation system, SpotLight, which generates and ranks annotated visualizations to explain each insight. We conducted a user study with 12 participants and two datasets which showed that users are able to quickly understand and find relevant insights in unfamiliar data.


title: Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priors

abstract: Images captured in snowy days suffer from noticeable degradation of scene visibility, which degenerates the performance of current vision-based intelligent systems. Removing snow from images thus is an important topic in computer vision. In this paper, we propose a Deep Dense Multi-Scale Network (\textbf{DDMSNet}) for snow removal by exploiting semantic and geometric priors. As images captured in outdoor often share similar scenes and their visibility varies with depth from camera, such semantic and geometric information provides a strong prior for snowy image restoration. We incorporate the semantic and geometric maps as input and learn the semantic-aware and geometry-aware representation to remove snow. In particular, we first create a coarse network to remove snow from the input images. Then, the coarsely desnowed images are fed into another network to obtain the semantic and geometric labels. Finally, we design a DDMSNet to learn semantic-aware and geometry-aware representation via a self-attention mechanism to produce the final clean images. Experiments evaluated on public synthetic and real-world snowy images verify the superiority of the proposed method, offering better results both quantitatively and qualitatively.


title: A Modular and Unified Framework for Detecting and Localizing Video Anomalies

abstract: Anomaly detection in videos has been attracting an increasing amount of attention. Despite the competitive performance of recent methods on benchmark datasets, they typically lack desirable features such as modularity, cross-domain adaptivity, interpretability, and real-time anomalous event detection. Furthermore, current state-of-the-art approaches are evaluated using the standard instance-based detection metric by considering video frames as independent instances, which is not ideal for video anomaly detection. Motivated by these research gaps, we propose a modular and unified approach to the online video anomaly detection and localization problem, called MOVAD, which consists of a novel transfer learning based plug-and-play architecture, a sequential anomaly detector, a mathematical framework for selecting the detection threshold, and a suitable performance metric for real-time anomalous event detection in videos. Extensive performance evaluations on benchmark datasets show that the proposed framework significantly outperforms the current state-of-the-art approaches.


title: Effects of Dynamic-Win-Stay-Lose-Learn model with voluntary participation in social dilemma

abstract: In recent years, Win-Stay-Lose-Learn rule has attracted wide attention as an effective strategy updating rule, and voluntary participation is proposed by introducing a third strategy in Prisoner's dilemma game. Some researches show that combining Win-Stay-Lose-Learn rule with voluntary participation could promote cooperation more significantly under moderate temptation values, however, cooperators' survival under high aspiration levels and high temptation values is still a challenging problem. In this paper, inspired by Achievement Motivation Theory, a Dynamic-Win-Stay-Lose-Learn rule with voluntary participation is investigated, where a dynamic aspiration process is introduced to describe the co-evolution of individuals' strategies and aspirations. It is found that cooperation is extremely promoted and defection is almost extinct in our model, even when the initial aspiration levels and temptation values are high. The combination of dynamic aspiration and voluntary participation plays an active role since loners could survive under high initial aspiration levels and they will expand stably because of their fixed payoffs. The robustness of our model is also discussed and some adverse structures are found which should be alerted in the evolutionary process. Our work provides a more realistic model and shows that cooperators may prevail defectors in an unfavorable initial environment.


title: Asymptotic stability of diffusion waves of a quasi-linear hyperbolic-parabolic model for vasculogenesis

abstract: In this paper, we derive the large-time profile of solutions to the Cauchy problem of a hyperbolic-parabolic system modeling the vasculogenesis in $\R^3$. When the initial data are prescribed in the vicinity of a constant ground state, by constructing a time-frequency Lyapunov functional and employing the Fourier energy method and spectral analysis, we show that solution of the Cauchy problem tend time-asymptotically to linear diffusion waves around the constant ground state with algebraic decaying rates under certain conditions on the density-dependent pressure function.


title: Common Sense Knowledge, Ontology and Text Mining for Implicit Requirements

abstract: The ability of a system to meet its requirements is a strong determinant of success. Thus effective requirements specification is crucial. Explicit Requirements are well-defined needs for a system to execute. IMplicit Requirements (IMRs) are assumed needs that a system is expected to fulfill though not elicited during requirements gathering. Studies have shown that a major factor in the failure of software systems is the presence of unhandled IMRs. Since relevance of IMRs is important for efficient system functionality, there are methods developed to aid the identification and management of IMRs. In this paper, we emphasize that Common Sense Knowledge, in the field of Knowledge Representation in AI, would be useful to automatically identify and manage IMRs. This paper is aimed at identifying the sources of IMRs and also proposing an automated support tool for managing IMRs within an organizational context. Since this is found to be a present gap in practice, our work makes a contribution here. We propose a novel approach for identifying and managing IMRs based on combining three core technologies: common sense knowledge, text mining and ontology. We claim that discovery and handling of unknown and non-elicited requirements would reduce risks and costs in software development.


title: Dynamics of a droplet migration in oscillatory and pulsating microchannel flows and prediction and uncertainty quantification of its lateral equilibrium position using Multi Fidelity Gaussian processes

abstract: Dynamics of a droplet in oscillatory and pulsating flows of a Newtonian fluid in a microchannel has been studied numerically. The effects of oscillation frequency, surface tension, and channel flow rate have been explored by simulating the drop within a microchannel. These types of flows introduce new equilibrium positions for the drop compared to steady flows with similar conditions. The simulation results are very sensitive to the grid resolution due to the unsteady behavior of the base flow. Therefore, a set of fine grids have been used in this study to capture the physics of this problem more accurately. However, these fine grids make the computations significantly expensive. Therefore, a Multi Fidelity Gaussian processes method with two levels of fidelity has been used to predict the results of the remaining fine-grid simulations along with their uncertainties based on their correlations with those of the coarse-grid cases over a wide range of input parameters.


title: The fullerenes with a perfect star packing

abstract: A spanning subgraph of a graph $G$ is called a perfect star packing in $G$ if every component of the spanning subgraph is isomorphic to the star graph $K_{1,3}$. An efficient dominating set of graph $G$ is a vertex subset $D$ of $G$ such that each vertex of $G$ not in $D$ is adjacent to exactly one vertex from $D$ and any two vertices of $D$ are not adjacent in $G$. Fullerene graph is a connected plane cubic graph with only pentagonal and hexagonal faces, which is the molecular graph of carbon fullerene. Clearly, a perfect star packing in a fullerene graph $G$ on $n$ vertices will exist if and only if $G$ has an efficient dominating set of cardinality $\frac{n}{4}$. The problem of finding an efficient dominating set is algorithmically hard \cite{Alg_hard}. In this paper, we give a characterization for a fullerene graph to own a perfect star packing. And mainly show that it is necessary for a fullerene $G$ owning a perfect star packing to have order being divisible by $8$. This answers an open problem asked by Dosli\'{c} et. al. and also shows that a fullerene graph with an efficient dominating set has $8n$ vertices. By the way, we find some counterexamples for the necessity of Theorem $14$ in \cite{Doslic} and list some forbidden configurations to preclude the existence of a perfect star packing of type $P0$.


title: Square-root topological phase with time-reversal and particle-hole symmetry

abstract: Square-root topological phases have been discussed mainly for systems with chiral symmetry. In this paper, we analyze the topology of the squared Hamiltonian for systems preserving the time-reversal and particle-hole symmetry. Our analysis elucidates that two-dimensional systems of class CII host helical edge states due to the nontrivial topology of the squared Hamiltonian in contrast to the absence of ordinary topological phases. The emergence of the helical edge modes is demonstrated by analyzing a toy model. We also show the emergence of surface states induced by the non-trivial topology of the squared Hamiltonian in three dimensions.


title: Extreme High-velocity Outflows from High-redshift BOSS Quasars

abstract: It is common to assume that all narrow absorption lines (NALs) at extreme high-velocity shifts form in cosmologically intervening gas or galaxies unrelated to quasars. However, previous detailed studies of individual quasars have shown that some NALs at these large velocity shifts do form in high-speed quasar ejecta. We search for extreme high-velocity NAL outflows (with speeds $\sim$0.1-0.2c) based on relationships with associated absorption lines (AALs) and broad absorption-line (BAL) outflows. We find that high-velocity NALs are strongly correlated with AALs, BALs, and radio loudness, indicating that a significant fraction of high-velocity systems are either ejected from the quasars or form in material swept up by the radio jets (and are not unrelated intervening gas). We also consider line-locked C IV doublets as another indicator of high-velocity NALs formed in outflows. The fact that line-locked NALs are highly ionized and correlated with BAL outflows and radio-loud quasars implies that physical line locking due to radiative forces is both common and real, which provides indirect evidence that a significant fraction of high-velocity NALs are intrinsic to quasars.


title: QuClassi: A Hybrid Deep Neural Network Architecture based on Quantum State Fidelity

abstract: In the past decade, remarkable progress has been achieved in deep learning related systems and applications. In the post Moore's Law era, however, the limit of semiconductor fabrication technology along with the increasing data size have slowed down the development of learning algorithms. In parallel, the fast development of quantum computing has pushed it to the new ear. Google illustrates quantum supremacy by completing a specific task (random sampling problem), in 200 seconds, which is impracticable for the largest classical computers. Due to the limitless potential, quantum based learning is an area of interest, in hopes that certain systems might offer a quantum speedup. In this work, we propose a novel architecture QuClassi, a quantum neural network for both binary and multi-class classification. Powered by a quantum differentiation function along with a hybrid quantum-classic design, QuClassi encodes the data with a reduced number of qubits and generates the quantum circuit, pushing it to the quantum platform for the best states, iteratively. We conduct intensive experiments on both the simulator and IBM-Q quantum platform. The evaluation results demonstrate that QuClassi is able to outperform the state-of-the-art quantum-based solutions, Tensorflow-Quantum and QuantumFlow by up to 53.75% and 203.00% for binary and multi-class classifications. When comparing to traditional deep neural networks, QuClassi achieves a comparable performance with 97.37% fewer parameters.


title: Nonlinear RF Fingerprints Authentication for OFDM Wireless Devices based on Demodulated Symbols

abstract: Radio Frequency fingerprints (RFF) authentication is one of the methods for the physical-layer information security, which uses the hardware characteristics of the transmitter to identify its real identity. In order to improve the performance of RFF based on preamble with fixed duration, a nonlinear RFF authentication method based on payload symbols is proposed for the wireless OFDM devices with the bit mapping scheme of QPSK. The communication system is modeled as a Hammerstein system containing the nonlinear transmitter and wireless multipath fading channel. A parameter separation technique based on orthogonal polynomial is presented for the estimation of the parameters of the Hammerstein system. The Hammerstein system parameter separation technique is firstly used to estimate the linear parameter with the training signal, which is used to compensate the adverse effect of the linear channel for the demodulation of the successive payload symbols. The demodulated payload symbols are further used to estimate the nonlinear coefficients of the transmitter with the Hammerstein system parameter separation technique again, which is used as the novel RFF for the authentication of the QPSK-OFDM devices. Numerical experiments demonstrate that the proposed method is feasible. The novel method can also be extended to the OFDM signals with other bit mapping schemes.


title: Branching out into Structural Identifiability Analysis with Maple: Interactive Exploration of Uncontrolled Linear Time-Invariant Structures

abstract: Suppose we wish to predict the behaviour of a physical system. We may choose to represent the system by model structure $S$ (a set of related mathematical models defined by parametric relationships between system variables), and a parameter set $\Theta$. Each parameter vector in $\Theta$ is associated with a completely specified model in $S$. We use $S$ with system observations in estimating the "true" (unknown) parameter vector. Inconveniently, multiple parameter vectors may cause $S$ to approximate the data equally well. If we cannot distinguish between such alternatives, and these lead to dissimilar predictions, we cannot confidently use $S$ in decision making. This result may render efforts in data collection and modelling fruitless. This outcome occurs when $S$ lacks the property of structural global identifiability (SGI). Fortunately, we can test various classes of structures for SGI prior to data collection. A non-SGI result may guide changes to our structure or experimental design towards obtaining a better outcome. We aim to assist the testing of structures for SGI through bespoke Maple 2020 procedures. We consider continuous-time, uncontrolled, linear time-invariant state-space structures. Here, the time evolution of the state-variable vector ${\bf x}$ is modelled by a system of constant-coefficient, ordinary differential equations. We utilise the "transfer function" approach, which is also applicable to the "compartmental" subclass (mass is conserved). Our use of Maple's "Explore" enables an interactive consideration of a parent structure and its variants, obtained as the user changes which components of ${\bf x}$ are observed, or have non-zero initial conditions. Such changes may influence the information content of the idealised output available for the SGI test, and hence, its result. Our approach may inform the interactive analysis of structures from other classes.


title: Key-Point Interpolation: A Sparse Data Interpolation Algorithm based on B-splines

abstract: B-splines are widely used in the fields of reverse engineering and computer-aided design, due to their superior properties. Traditional B-spline surface interpolation algorithms usually assume regularity of the data distribution. In this paper, we introduce a novel B-spline surface interpolation algorithm: KPI, which can interpolate sparsely and non-uniformly distributed data points. As a two-stage algorithm, our method generates the dataset out of the sparse data using Kriging, and uses the proposed KPI (Key-Point Interpolation) method to generate the control points. Our algorithm can be extended to higher dimensional data interpolation, such as reconstructing dynamic surfaces. We apply the method to interpolating the temperature of Shanxi Province. The generated dynamic surface accurately interpolates the temperature data provided by the weather stations, and the preserved dynamic characteristics can be useful for meteorology studies.


title: Semantic 3D Map Change Detection and Update based on Smartphone Visual Positioning System

abstract: Accurate localization and 3D maps are increasingly needed for various artificial intelligence based IoT applications such as augmented reality, intelligent transportation, crowd monitoring, robotics, etc. This article proposes a novel semantic 3D map change detection and update based on a smartphone visual positioning system (VPS) for the outdoor and indoor environments. The proposed method presents an alternate solution to SLAM for map update in terms of efficiency, cost, availability, and map reuse. Building on existing 3D maps of recent years, a system is designed to use artificial intelligence to identify high-level semantics in images for positioning and map change detection. Then, a virtual LIDAR that estimates the depth of objects in the 3D map is used to generate a compact point cloud to update changes in the scene. We present an excellent performance of localization with respect to other state-of-the-art smartphone positioning solutions to accurately update semantic 3D maps. It is shown that the proposed solution can position users within 1.9m, and update objects with an average error of 2.1m.


title: Toward Consistent Drift-free Visual Inertial Localization on Keyframe Based Map

abstract: Global localization is essential for robots to perform further tasks like navigation. In this paper, we propose a new framework to perform global localization based on a filter-based visual-inertial odometry framework MSCKF. To reduce the computation and memory consumption, we only maintain the keyframe poses of the map and employ Schmidt-EKF to update the state. This global localization framework is shown to be able to maintain the consistency of the state estimator. Furthermore, we introduce a re-linearization mechanism during the updating phase. This mechanism could ease the linearization error of observation function to make the state estimation more precise. The experiments show that this mechanism is crucial for large and challenging scenes. Simulations and experiments demonstrate the effectiveness and consistency of our global localization framework.


title: PGT: A Progressive Method for Training Models on Long Videos

abstract: Convolutional video models have an order of magnitude larger computational complexity than their counterpart image-level models. Constrained by computational resources, there is no model or training method that can train long video sequences end-to-end. Currently, the main-stream method is to split a raw video into clips, leading to incomplete fragmentary temporal information flow. Inspired by natural language processing techniques dealing with long sentences, we propose to treat videos as serial fragments satisfying Markov property, and train it as a whole by progressively propagating information through the temporal dimension in multiple steps. This progressive training (PGT) method is able to train long videos end-to-end with limited resources and ensures the effective transmission of information. As a general and robust training method, we empirically demonstrate that it yields significant performance improvements on different models and datasets. As an illustrative example, the proposed method improves SlowOnly network by 3.7 mAP on Charades and 1.9 top-1 accuracy on Kinetics with negligible parameter and computation overhead. Code is available at https://github.com/BoPang1996/PGT.


title: A Learned Compact and Editable Light Field Representation

abstract: Light fields are 4D scene representation typically structured as arrays of views, or several directional samples per pixel in a single view. This highly correlated structure is not very efficient to transmit and manipulate (especially for editing), though. To tackle these problems, we present a novel compact and editable light field representation, consisting of a set of visual channels (i.e. the central RGB view) and a complementary meta channel that encodes the residual geometric and appearance information. The visual channels in this representation can be edited using existing 2D image editing tools, before accurately reconstructing the whole edited light field back. We propose to learn this representation via an autoencoder framework, consisting of an encoder for learning the representation, and a decoder for reconstructing the light field. To handle the challenging occlusions and propagation of edits, we specifically designed an editing-aware decoding network and its associated training strategy, so that the edits to the visual channels can be consistently propagated to the whole light field upon reconstruction.Experimental results show that our proposed method outperforms related existing methods in reconstruction accuracy, and achieves visually pleasant performance in editing propagation.


title: Rapid and Unconditional Parametric Reset Protocol for Tunable Superconducting Qubits

abstract: Qubit initialization is a critical task in quantum computation and communication. Extensive efforts have been made to achieve this with high speed, efficiency and scalability. However, previous approaches have either been measurement-based and required fast feedback, suffered from crosstalk or required sophisticated calibration. Here, we report a fast and high-fidelity reset scheme, avoiding the issues above without any additional chip architecture. By modulating the flux through a transmon qubit, we realize a swap between the qubit and its readout resonator that suppresses the excited state population to 0.08% $\pm$ 0.08% within 34 ns (284 ns if photon depletion of the resonator is required). Furthermore, our approach (i) can achieve effective second excited state depletion, (ii) has negligible effects on neighbouring qubits, and (iii) offers a way to entangle the qubit with an itinerant single photon, useful in quantum communication applications.


title: Automated Software Vulnerability Assessment with Concept Drift

abstract: Software Engineering researchers are increasingly using Natural Language Processing (NLP) techniques to automate Software Vulnerabilities (SVs) assessment using the descriptions in public repositories. However, the existing NLP-based approaches suffer from concept drift. This problem is caused by a lack of proper treatment of new (out-of-vocabulary) terms for the evaluation of unseen SVs over time. To perform automated SVs assessment with concept drift using SVs' descriptions, we propose a systematic approach that combines both character and word features. The proposed approach is used to predict seven Vulnerability Characteristics (VCs). The optimal model of each VC is selected using our customized time-based cross-validation method from a list of eight NLP representations and six well-known Machine Learning models. We have used the proposed approach to conduct large-scale experiments on more than 100,000 SVs in the National Vulnerability Database (NVD). The results show that our approach can effectively tackle the concept drift issue of the SVs' descriptions reported from 2000 to 2018 in NVD even without retraining the model. In addition, our approach performs competitively compared to the existing word-only method. We also investigate how to build compact concept-drift-aware models with much fewer features and give some recommendations on the choice of classifiers and NLP representations for SVs assessment.


title: Electromagnetic response in spiral magnets and emergent inductance

abstract: Emergent electromagnetism in magnets originates from the strong coupling between conduction electron spins and those of noncollinear ordered moments and the consequent Berry phase. This offers possibilities to develop new functions of quantum transport and optical responses. The emergent inductance in spiral magnets is an example recently proposed and experimentally demonstrated, used the emergent electric field induced by alternating currents. However, the microscopic theory of this phenomenon is missing, which should reveal the factors to determine the magnitude, sign, frequency dependence, and nonlinearity of the inductance L. Here we theoretically study electromagnetic responses of spiral magnets taking into account their collective modes. In sharp contrast to the collinear spin-density wave, the system remains metallic even in one-dimension, and the canonical conjugate relation of uniform magnetization and phason coordinate plays an essential role, determining the properties of L. This result opens a way to design the emergent inductance of desired properties.


title: Language-Agnostic Representation Learning of Source Code from Structure and Context

abstract: Source code (Context) and its parsed abstract syntax tree (AST; Structure) are two complementary representations of the same computer program. Traditionally, designers of machine learning models have relied predominantly either on Structure or Context. We propose a new model, which jointly learns on Context and Structure of source code. In contrast to previous approaches, our model uses only language-agnostic features, i.e., source code and features that can be computed directly from the AST. Besides obtaining state-of-the-art on monolingual code summarization on all five programming languages considered in this work, we propose the first multilingual code summarization model. We show that jointly training on non-parallel data from multiple programming languages improves results on all individual languages, where the strongest gains are on low-resource languages. Remarkably, multilingual training only from Context does not lead to the same improvements, highlighting the benefits of combining Structure and Context for representation learning on code.


title: Reference-Aided Part-Aligned Feature Disentangling for Video Person Re-Identification

abstract: Recently, video-based person re-identification (re-ID) has drawn increasing attention in compute vision community because of its practical application prospects. Due to the inaccurate person detections and pose changes, pedestrian misalignment significantly increases the difficulty of feature extraction and matching. To address this problem, in this paper, we propose a \textbf{R}eference-\textbf{A}ided \textbf{P}art-\textbf{A}ligned (\textbf{RAPA}) framework to disentangle robust features of different parts. Firstly, in order to obtain better references between different videos, a pose-based reference feature learning module is introduced. Secondly, an effective relation-based part feature disentangling module is explored to align frames within each video. By means of using both modules, the informative parts of pedestrian in videos are well aligned and more discriminative feature representation is generated. Comprehensive experiments on three widely-used benchmarks, i.e. iLIDS-VID, PRID-2011 and MARS datasets verify the effectiveness of the proposed framework. Our code will be made publicly available.


title: Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources

abstract: Warning: this paper contains content that may be offensive or upsetting. Numerous natural language processing models have tried injecting commonsense by using the ConceptNet knowledge base to improve performance on different tasks. ConceptNet, however, is mostly crowdsourced from humans and may reflect human biases such as "lawyers are dishonest." It is important that these biases are not conflated with the notion of commonsense. We study this missing yet important problem by first defining and quantifying biases in ConceptNet as two types of representational harms: overgeneralization of polarized perceptions and representation disparity. We find that ConceptNet contains severe biases and disparities across four demographic categories. In addition, we analyze two downstream models that use ConceptNet as a source for commonsense knowledge and find the existence of biases in those models as well. We further propose a filtered-based bias-mitigation approach and examine its effectiveness. We show that our mitigation approach can reduce the issues in both resource and models but leads to a performance drop, leaving room for future work to build fairer and stronger commonsense models.


title: Fault Prediction based on Software Metrics and SonarQube Rules. Machine or Deep Learning?

abstract: Background. Developers spend more time fixing bugs and refactoring the code to increase the maintainability than developing new features. Researchers investigated the code quality impact on fault-proneness focusing on code smells and code metrics. Objective. We aim at advancing fault-inducing commit prediction based on SonarQube considering the contribution provided by each rule and metric. Method. We designed and conducted a case study among 33 Java projects analyzed with SonarQube and SZZ to identify fault-inducing and fault-fixing commits. Moreover, we investigated fault-proneness of each SonarQube rule and metric using Machine and Deep Learning models. Results. We analyzed 77,932 commits that contain 40,890 faults and infected by more than 174 SonarQube rules violated 1,9M times, on which there was calculated 24 software metrics available by the tool. Compared to machine learning models, deep learning provide a more accurate fault detection accuracy and allowed us to accurately identify the fault-prediction power of each SonarQube rule. As a result, fourteen of the 174 violated rules has an importance higher than 1\% and account for 30\% of the total fault-proneness importance, while the fault proneness of the remaining 165 rules is negligible. Conclusion. Future works might consider the adoption of timeseries analysis and anomaly detection techniques to better and more accurately detect the rules that impact fault-proneness.


title: Unsupervised Learning of Depth Estimation and Visual Odometry for Sparse Light Field Cameras

abstract: While an exciting diversity of new imaging devices is emerging that could dramatically improve robotic perception, the challenges of calibrating and interpreting these cameras have limited their uptake in the robotics community. In this work we generalise techniques from unsupervised learning to allow a robot to autonomously interpret new kinds of cameras. We consider emerging sparse light field (LF) cameras, which capture a subset of the 4D LF function describing the set of light rays passing through a plane. We introduce a generalised encoding of sparse LFs that allows unsupervised learning of odometry and depth. We demonstrate the proposed approach outperforming monocular and conventional techniques for dealing with 4D imagery, yielding more accurate odometry and depth maps and delivering these with metric scale. We anticipate our technique to generalise to a broad class of LF and sparse LF cameras, and to enable unsupervised recalibration for coping with shifts in camera behaviour over the lifetime of a robot. This work represents a first step toward streamlining the integration of new kinds of imaging devices in robotics applications.


title: Chiral excitations of open-beauty systems

abstract: We study the scattering of open-beauty mesons and Goldstone bosons as predicted by the chiral SU(3) Lagrangian. The impact of subleading order chiral interactions to systems with $J^P= 0^+$ and $J^P=1^+$ quantum numbers is worked out. We estimate the relevant low-energy coefficients from the open-charm sector, for which their values have been determined previously from sets of QCD lattice data. The leading order heavy-quark symmetry breaking effects are estimated by matching the $B$-meson ground-state chiral mass formula to the mass formula from the heavy-quark effective theory. We make refined predictions for the flavor anti-triplet and sextet resonances that are generated dynamically by coupled-channel interactions.


title: Efficient cascaded wavelength conversion under two-peak Stark-chirped rapid adiabatic passage via grating structures

abstract: In this paper, we demonstrate a domain inversion crystal structure to study the cascaded three-wave mixing process in a two peak Stark-chirped rapid adiabatic passage. We have achieved efficient wavelength conversion, which can be performed in intuitive order and counterintuitive order. The requirement of crystal is reduced and the flexibility of structure design is improved. When the conversion wavelength is fixed, increasing the coupling coefficient between the two peaks can reduce the intensity of the intermediate wavelength while maintaining high conversion efficiency. Compared with the cascaded wavelength conversion process based on stimulated Raman rapid adiabatic passage, the two-peak Stark-chirped rapid adiabatic passage has a larger convertible wavelength bandwidth. This scheme provides a theoretical basis for obtaining mid-infrared laser source via flexible crystal structure.


title: A Proximal Point Approach for Distributed System State Estimation

abstract: System state estimation constitutes a key problem in several applications involving multi-agent system architectures. This rests upon the estimation of the state of each agent in the group, which is supposed to access only relative measurements w.r.t. some neighbors state. Exploiting the standard least-squares paradigm, the system state estimation task is faced in this work by deriving a distributed Proximal Point-based iterative scheme. This solution entails the emergence of interesting connections between the structural properties of the stochastic matrices describing the system dynamics and the convergence behavior toward the optimal estimate. A deep analysis of such relations is provided, jointly with a further discussion on the penalty parameter that characterizes the Proximal Point approach.


title: A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detection

abstract: A great deal of recent research effort on speech spoofing countermeasures has been invested into back-end neural networks and training criteria. We contribute to this effort with a comparative perspective in this study. Our comparison of countermeasure models on the ASVspoof 2019 logical access task takes into account recently proposed margin-based training criteria, widely used front ends, and common strategies to deal with varied-length input trials. We also measured intra-model differences through multiple training-evaluation rounds with random initialization. Our statistical analysis demonstrates that the performance of the same model may be significantly different when just changing the random initial seed. Thus, we recommend similar analysis or multiple training-evaluation rounds for further research on the database. Despite the intra-model differences, we observed a few promising techniques such as the average pooling to process varied-length inputs and a new hyper-parameter-free loss function. The two techniques led to the best single model in our experiment, which achieved an equal error rate of 1.92% and was significantly different in statistical sense from most of the other experimental models.


title: Comments on Leo Breiman's paper 'Statistical Modeling: The Two Cultures' (Statistical Science, 2001, 16(3), 199-231)

abstract: Breiman challenged statisticians to think more broadly, to step into the unknown, model-free learning world, with him paving the way forward. Statistics community responded with slight optimism, some skepticism, and plenty of disbelief. Today, we are at the same crossroad anew. Faced with the enormous practical success of model-free, deep, and machine learning, we are naturally inclined to think that everything is resolved. A new frontier has emerged; the one where the role, impact, or stability of the {\it learning} algorithms is no longer measured by prediction quality, but an inferential one -- asking the questions of {\it why} and {\it if} can no longer be safely ignored.


title: Adiabatic Solutions in General Relativity and Boundary Symmetries

abstract: We investigate adiabatic solutions to general relativity for a spacetime with spatial slices with boundary, by Manton approximation. This approximation tells us for a theory with a Lagrangian in the natural form, a motion that is described as a slow motion on the space of vacua-static solutions that minimize the energy -- is a good approximate solution. To apply this to the case of general relativity we first bring it to the natural form by splitting space and time and choosing Gaussian normal coordinates, where a spacetime is described by the metric on its spatial slices. Then following Manton we propose slow solutions such that each slice is a slowly changing diffeomorphism of a reference slice, and thus each solution is described by a vector field on the spatial slice. These solutions will have the property that the action will become a functional of the vector fields on the boundaries of the spatial slices. Moreover using the Hodge-Morrey-Friedrichs decomposition we will show that the constraints of general relativity will identify a unique solution for a given boundary value. Then we comment on the structure of the space of vacua which we show to be a (pseudo)-Riemannian homogeneous space. We illustrate our procedure for a specific reference slice we choose: the 3d Euclidean round ball.


title: Optimization Algorithms as Robust Feedback Controllers

abstract: Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorithms as dynamical systems. Besides being insightful in itself, this perspective liberates optimization methods from specific numerical and algorithmic aspects and opens up new possibilities to endow complex real-world systems with sophisticated self-optimizing behavior. Towards this goal, it is necessary to understand how numerical optimization algorithms can be converted into feedback controllers to enable robust "closed-loop optimization". In this article, we focus on recent control designs under the name of "feedback-based optimization" which implement optimization algorithms directly in closed loop with physical systems. In addition to a brief overview of selected continuous-time dynamical systems for optimization, our particular emphasis in this survey lies on closed-loop stability as well as the robust enforcement of physical and operational constraints in closed-loop implementations. To bypass accessing partial model information of physical systems, we further elaborate on fully data-driven and model-free operations. We highlight an emerging application in autonomous reserve dispatch in power systems, where the theory has transitioned to practice by now. We also provide short expository reviews of pioneering applications in communication networks and electricity grids, as well as related research streams, including extremum seeking and pertinent methods from model predictive and process control, to facilitate high-level comparisons with the main topic of this survey.


title: Expected Extinction Times of Epidemics with State-Dependent Infectiousness

abstract: We model an epidemic where the per-person infectiousness in a network of geographic localities changes with the total number of active cases. This would happen as people adopt more stringent non-pharmaceutical precautions when the population has a larger number of active cases. We show that there exists a sharp threshold such that when the curing rate for the infection is above this threshold, the mean time for the epidemic to die out is logarithmic in the initial infection size, whereas when the curing rate is below this threshold, the mean time for epidemic extinction is infinite. We also show that when the per-person infectiousness goes to zero asymptotically as a function of the number of active cases, the mean extinction times all have the same asymptote independent of network structure. Simulations bear out these results, while also demonstrating that if the per-person infectiousness is large when the epidemic size is small (i.e., the precautions are lax when the epidemic is small and only get stringent after the epidemic has become large), it might take a very long time for the epidemic to die out. We also provide some analytical insight into these observations.


title: Lattice QCD calculation of $K\to \ell\nu_\ell \ell'^+ \ell'^-$ decay width

abstract: We develop a methodology for the computation of the $K\to \ell\nu_\ell \ell'^+ \ell'^-$ decay width using lattice QCD and present an exploratory study here. We use a scalar function method to account for the momentum dependence of the decay amplitude and adopt the infinite volume reconstruction method to reduce the systematic errors such as the temporal truncation effects and the finite-volume effects. We then perform a four-body phase-space integral to obtain the decay width. The only remaining technical problem is the possible power-law finite-volume effects associated with the process of $K\to\pi\pi \ell\nu_\ell\to \ell\nu_\ell \ell'^+ \ell'^-$, where the intermediate state involves multiple hadrons. In this work, we use a gauge ensemble of twisted mass fermion with a pion mass $m_\pi=352$ MeV and a nearly-physical kaon mass. At this kinematics, the $\pi\pi$ in the intermediate state cannot be on shell simultaneously as $2m_\pi>m_K$ and the finite-volume effects associated with $\pi\pi$ state are exponentially suppressed. Using the developed methods mentioned above, we calculate the branching ratios for four channels of $K\to \ell\nu_\ell\ell'^+ \ell'^-$, and obtain the results comparable to the experimental measurements and ChPT predictions. Our work demonstrates the capability of lattice QCD to improve Standard Model prediction in $K\to \ell\nu_\ell \ell'^+ \ell'^-$ decay width.


title: AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization

abstract: State-of-the-art abstractive summarization models generally rely on extensive labeled data, which lowers their generalization ability on domains where such data are not available. In this paper, we present a study of domain adaptation for the abstractive summarization task across six diverse target domains in a low-resource setting. Specifically, we investigate the second phase of pre-training on large-scale generative models under three different settings: 1) source domain pre-training; 2) domain-adaptive pre-training; and 3) task-adaptive pre-training. Experiments show that the effectiveness of pre-training is correlated with the similarity between the pre-training data and the target domain task. Moreover, we find that continuing pre-training could lead to the pre-trained model's catastrophic forgetting, and a learning method with less forgetting can alleviate this issue. Furthermore, results illustrate that a huge gap still exists between the low-resource and high-resource settings, which highlights the need for more advanced domain adaptation methods for the abstractive summarization task.


title: ANITA: An Optimal Loopless Accelerated Variance-Reduced Gradient Method

abstract: In this paper, we propose a novel accelerated gradient method called ANITA for solving the fundamental finite-sum optimization problems. Concretely, we consider both general convex and strongly convex settings: i) For general convex finite-sum problems, ANITA improves previous state-of-the-art result given by Varag (Lan et al., 2019). In particular, for large-scale problems or the convergence error is not very small, i.e., $n \geq \frac{1}{\epsilon^2}$, ANITA obtains the \emph{first} optimal result $O(n)$, matching the lower bound $\Omega(n)$ provided by Woodworth and Srebro (2016), while previous results are $O(n \log \frac{1}{\epsilon})$ of Varag (Lan et al., 2019) and $O(\frac{n}{\sqrt{\epsilon}})$ of Katyusha (Allen-Zhu, 2017). ii) For strongly convex finite-sum problems, we also show that ANITA can achieve the optimal convergence rate $O\big((n+\sqrt{\frac{nL}{\mu}})\log\frac{1}{\epsilon}\big)$ matching the lower bound $\Omega\big((n+\sqrt{\frac{nL}{\mu}})\log\frac{1}{\epsilon}\big)$ provided by Lan and Zhou (2015). Besides, ANITA enjoys a simpler loopless algorithmic structure unlike previous accelerated algorithms such as Varag (Lan et al., 2019) and Katyusha (Allen-Zhu, 2017) where they use double-loop structures. Moreover, we provide a novel \emph{dynamic multi-stage convergence analysis}, which is the key technical part for improving previous results to the optimal rates. We believe that our new theoretical rates and novel convergence analysis for the fundamental finite-sum problem will directly lead to key improvements for many other related problems, such as distributed/federated/decentralized optimization problems (e.g., Li and Richt\'arik, 2021). Finally, the numerical experiments show that ANITA converges faster than the previous state-of-the-art Varag (Lan et al., 2019), validating our theoretical results and confirming the practical superiority of ANITA.


title: On Hilbert coefficients and sequentially Cohen-Macaulay rings

abstract: In this paper, we explore the relation between the index of reducibility and the Hilbert coefficients in local rings. Consequently, the main result of this study provides a characterization of a sequentially Cohen-Macaulay ring in terms of its Hilbert coefficients for non-parameter ideals. As corollaries to the main theorem, we obtain characterizations of a Gorenstein/Cohen-Macaulay ring in terms of its Chern coefficients for parameter ideals.


title: A novel strategy for searching for $C\!P$ violations in the baryon sector

abstract: Despite the large baryon-anti-baryon asymmetry in the observable Universe, the closely related phenomenon -- the violation of the combined charge and parity symmetry ($C\!P$V) -- has not been observed in the baryon sector in laboratories. In this paper, a new strategy for searching for $C\!P$V in heavy hadron multi-body decays is proposed, in which a set of novel observables measuring $C\!P$V in such decays -- the partial wave $C\!P$ asymmetries (PW$C\!P$As) -- are introduced. This strategy is model-independent and applicable to multi-body decays of heavy hadrons with arbitrary spin configurations in both initial and final states, and with any number of particles in the final state. It is especially applicable for $C\!P$V investigations in multi-body decays of heavy baryons. As applications of this strategy, we suggest to measure the PW$C\!P$As in some decay channels of bottom baryons such as $\Lambda_b^0\to p \pi^-\pi^+\pi^-$, $\Lambda_b\to p K^- \pi^+\pi^-$, $\Lambda^0_b\to p\pi^-K^+K^-$, $\Lambda_b^0\to\Lambda K^+\pi^-$, and $\Lambda_b^0\to p \pi^- K_s$.}


title: Commuting Probability of Compact Groups

abstract: For any (Hausdorff) compact group $G$ with the normalized Haar measure ${\mathbf m}_G$, denote by ${\rm cp}(G)$ the probability ${\mathbf m}_{G\times G}(\{(x,y)\in G\times G \;|\; xy=yx\})$ of commuting a randomly chosen pair of elements of $G$. Here we prove that if ${\rm cp}(G)>0$, then there exists a finite group $H$ such that ${\rm cp}(G)= \frac{{\rm cp}(H)}{|G:F|^2}$, where $F$ is the FC-center of $G$ i.e. the set of all elements of $G$ whose conjugacy classes are finite and $H$ is isoclinic to $F$ with ${\rm cp}(F)={\rm cp}(H)$. The latter equality enables one to transfer many existing results concerning commuting probability of finite groups to one of compact groups. For example, here for a compact group $G$ we prove that if ${\rm cp}(G)>\frac{3}{40}$ then either $G$ is solvable or, else $G\cong A_5 \times T$ for some abelian group $T$, in which case ${\rm cp}(G)=\frac{1}{12}$; where $A_5$ denotes the alternating group of degree $5$.


title: A predictive model of the turbulent burning velocity for planar and Bunsen flames over a wide range of conditions

abstract: We propose a predictive model of the turbulent burning velocity over a wide range of conditions. The model consists of sub models of the stretch factor and the turbulent flame area. The stretch factor characterizes the flame response of turbulence stretch and incorporates effects of detailed chemistry and transport with a lookup table of laminar counterflow flames. The flame area model captures the area growth based on Lagrangian statistics of propagating surfaces, and considers effects of turbulence length scales and fuel characteristics. The present model predicts the turbulent burning velocity via an algebraic expression without free parameters. It is validated against 285 cases of the direct numerical simulation or experiment reported from various research groups on planar and Bunsen flames over a wide range of conditions, covering fuels from hydrogen to n-dodecane, pressures from 1 to 20 atm, lean and rich mixtures, turbulence intensity ratios from 0.35 to 110, and turbulence length ratios from 0.5 to 80. The comprehensive comparison shows that the proposed turbulent burning velocity model has an overall good agreement over the wide range of conditions, with the averaged modeling error of 25.3%. Furthermore, the model prediction involves the uncertainty quantification for model parameters and chemical kinetics to extend the model applicability.


title: Mining GIS Data to Predict Urban Sprawl

abstract: This paper addresses the interesting problem of processing and analyzing data in geographic information systems (GIS) to achieve a clear perspective on urban sprawl. The term urban sprawl refers to overgrowth and expansion of low-density areas with issues such as car dependency and segregation between residential versus commercial use. Sprawl has impacts on the environment and public health. In our work, spatiotemporal features related to real GIS data on urban sprawl such as population growth and demographics are mined to discover knowledge for decision support. We adapt data mining algorithms, Apriori for association rule mining and J4.8 for decision tree classification to geospatial analysis, deploying the ArcGIS tool for mapping. Knowledge discovered by mining this spatiotemporal data is used to implement a prototype spatial decision support system (SDSS). This SDSS predicts whether urban sprawl is likely to occur. Further, it estimates the values of pertinent variables to understand how the variables impact each other. The SDSS can help decision-makers identify problems and create solutions for avoiding future sprawl occurrence and conducting urban planning where sprawl already occurs, thus aiding sustainable development. This work falls in the broad realm of geospatial intelligence and sets the stage for designing a large scale SDSS to process big data in complex environments, which constitutes part of our future work.


title: Escaping the Time Pit: Pitfalls and Guidelines for Using Time-Based Git Data

abstract: Many software engineering research papers rely on time-based data (e.g., commit timestamps, issue report creation/update/close dates, release dates). Like most real-world data however, time-based data is often dirty. To date, there are no studies that quantify how frequently such data is used by the software engineering research community, or investigate sources of and quantify how often such data is dirty. Depending on the research task and method used, including such dirty data could affect the research results. This paper presents the first survey of papers that utilize time-based data, published in the Mining Software Repositories (MSR) conference series. Out of the 690 technical track and data papers published in MSR 2004--2020, we saw at least 35% of papers utilized time-based data. We then used the Boa and Software Heritage infrastructures to help identify and quantify several sources of dirty commit timestamp data. Finally we provide guidelines/best practices for researchers utilizing time-based data from Git repositories.


title: Jacobi Fields and Tidal Effects in Kerr Spacetime

abstract: General relativistic tidal equations are formulated with respect to the rest frame of a central gravitational source described by the Kerr gravitational field. Specifically, observers that are spatially at rest in the exterior Kerr spacetime are considered in detail; in effect, these fiducial observers define the rest frame of the Kerr source. The generalized Jacobi equation for the free motion of a test particle is worked out within the Fermi coordinate system established along the world line of a fiducial observer at rest on the symmetry axis of the exterior Kerr background. The nature of the solutions of these equations are investigated in connection with the phenomena associated with astrophysical jets.


title: Parameterised-Response Zero-Intelligence Traders

abstract: I introduce PRZI (Parameterised-Response Zero Intelligence), a new form of zero-intelligence trader intended for use in simulation studies of the dynamics of continuous double auction markets. Like Gode & Sunder's classic ZIC trader, PRZI generates quote-prices from a random distribution over some specified domain of allowable quote-prices. Unlike ZIC, which uses a uniform distribution to generate prices, the probability distribution in a PRZI trader is parameterised in such a way that its probability mass function (PMF) is determined by a real-valued control variable s in the range [-1.0, +1.0] that determines the _strategy_ for that trader. When s=0, a PRZI trader is identical to ZIC, with a uniform PMF; but when |s|=~1 the PRZI trader's PMF becomes maximally skewed to one extreme or the other of the price-range, thereby making its quote-prices more or less urgent, biasing the quote-price distribution toward or away from the trader's limit-price. To explore the co-evolutionary dynamics of populations of PRZI traders that dynamically adapt their strategies, I show results from long-term market experiments in which each trader uses a simple stochastic hill-climber algorithm to repeatedly evaluate alternative s-values and choose the most profitable at any given time. In these experiments the profitability of any particular s-value may be non-stationary because the profitability of one trader's strategy at any one time can depend on the mix of strategies being played by the other traders at that time, which are each themselves continuously adapting. Results from these market experiments demonstrate that the population of traders' strategies can exhibit rich dynamics, with periods of stability lasting over hundreds of thousands of trader interactions interspersed by occasional periods of change. Python source-code for the work reported here has been made publicly available on GitHub.


title: BigCarl: Mining frequent subnets from a single large Petri net

abstract: While there have been lots of work studying frequent subgraph mining, very rare publications have discussed frequent subnet mining from more complicated data structures such as Petri nets. This paper studies frequent subnets mining from a single large Petri net. We follow the idea of transforming a Petri net in net graph form and to mine frequent sub-net graphs to avoid high complexity. Technically, we take a minimal traversal approach to produce a canonical label of the big net graph. We adapted the maximal independent embedding set approach to the net graph representation and proposed an incremental pattern growth (independent embedding set reduction) way for discovering frequent sub-net graphs from the single large net graph, which are finally transformed back to frequent subnets. Extensive performance studies made on a single large Petri net, which contains 10K events, 40K conditions and 30 K arcs, showed that our approach is correct and the complexity is reasonable.


title: Implicit type constitutive relations for elastic solids and their use in the development of mathematical models for viscoelastic fluids

abstract: Viscoelastic fluids are non-Newtonian fluids that exhibit both "viscous" and "elastic" characteristics in virtue of mechanisms to store energy and produce entropy. Usually the energy storage properties of such fluids are modelled using the same concepts as in the classical theory of nonlinear solids. Recently new models for elastic solids have been successfully developed by appealing to implicit constitutive relations, and these new models offer a different perspective to the old topic of elastic response of materials. In particular, a sub-class of implicit constitutive relations, namely relations wherein the left Cauchy-Green tensor is expressed as a function of stress is of interest. We show how to use this new perspective it the development of mathematical models for viscoelastic fluids, and we provide a discussion of the thermodynamic underpinnings of such models. We focus on the use of Gibbs free energy instead of the Helmholtz free energy, and using the standard Giesekus/Oldroyd-B models, we show how the alternative approach works in the case of well-known models. The proposed approach is straightforward to generalise to more complex setting wherein the classical approach might be impractical of even inapplicable.


title: Some topological results of Ricci limit spaces

abstract: We study the topology of a Ricci limit space $(X,p)$, which is the Gromov-Hausdorff limit of a sequence of complete $n$-manifolds $(M_i, p_i)$ with $\mathrm{Ric}\ge -(n-1)$. Our first result shows that, if $M_i$ has Ricci bounded covering geometry, i.e. the local Riemannian universal cover is non-collapsed, then $X$ is semi-locally simply connected. In the process, we establish a slice theorem for isometric pseudo-group actions on a closed ball in the Ricci limit space. In the second result, we give a description of the universal cover of $X$ if $M_i$ has a uniform diameter bound.


title: Monte Carlo Information-Oriented Planning

abstract: In this article, we discuss how to solve information-gathering problems expressed as rho-POMDPs, an extension of Partially Observable Markov Decision Processes (POMDPs) whose reward rho depends on the belief state. Point-based approaches used for solving POMDPs have been extended to solving rho-POMDPs as belief MDPs when its reward rho is convex in B or when it is Lipschitz-continuous. In the present paper, we build on the POMCP algorithm to propose a Monte Carlo Tree Search for rho-POMDPs, aiming for an efficient on-line planner which can be used for any rho function. Adaptations are required due to the belief-dependent rewards to (i) propagate more than one state at a time, and (ii) prevent biases in value estimates. An asymptotic convergence proof to epsilon-optimal values is given when rho is continuous. Experiments are conducted to analyze the algorithms at hand and show that they outperform myopic approaches.


title: Fractional mean curvature flow of Lipschitz graphs

abstract: We consider the fractional mean curvature flow of entire Lipschitz graphs. We provide regularity results, and we study the long time asymptotics of the flow. In particular we show that in a suitable rescaled framework, if the initial graph is a sublinear perturbation of a cone, the evolution asymptotically approaches an expanding self-similar solution. We also prove stability of hyperplanes and of convex cones in the unrescaled setting.


title: Finiteness theorems on elliptical billiards and a variant of the Dynamical Mordell-Lang Conjecture

abstract: We offer some theorems, mainly of finiteness, for certain patterns in elliptical billiards, related to periodic trajectories. For instance, if two players hit a ball at a given position and with directions forming a fixed angle in $(0,\pi)$, there are only finitely many cases for both trajectories being periodic. Another instance is the finiteness of the billiard shots which send a given ball into another one so that this falls eventually in a hole. These results have their origin in `relative' cases of the Manin-Mumford conjecture, and constitute instances of how arithmetical content may affect chaotic behaviour (in billiards). We shall also interpret the statements through a variant of the dynamical Mordell-Lang conjecture. In turn, this embraces cases which, somewhat surprisingly, can be treated (only) by completely different methods compared to the former; here we shall offer an explicit example related to diophantine equations in algebraic tori.


title: Predicting the $\sin\phi_S$ Single-Spin-Asymmetry of $\Lambda$ Production off transversely polarized nucleon in SIDIS

abstract: We investigate the transverse target spin asymmetry $A^{\sin\phi_{S}}_{UT}$ for the unpolarized $\Lambda$ production in semi-inclusive deep inelastic scattering with the transverse momentum of the final-state lambda hyperon being integrated out. The asymmetry is contributed by the product of the transversity distribution function $h_1(x)$ of the nucleon and the collinear twist-3 fragmentation function $\tilde{H}(z)$ of the $\Lambda$ hyperon. The later one originates from the quark-gluon-quark correlation and is a naive time-reversal-odd function. We calculate $\tilde{H}$ of the $\Lambda$ hyperon by adopt a diquark spectator model. Using the numerical result of $\tilde{H}(z)$ and the available parametrization of $h_1(x)$ from SIDIS data, we predict the $\sin\phi_{S}$ asymmetry in the electroproduction of the $\Lambda$ hyperon in the kinematical region of EIC, EicC and COMPASS. In the phenomenological analysis we include the evolution effect of the distribution functions and the fragmentation functions. The results show that the asymmetries for the $\Lambda$ production SIDIS process is around 0.1 and may be accessible at EIC, EicC and COMPASS. We also find that the evolution of fragmentation function can affect the size of asymmetry.


title: Neighbor Embedding Variational Autoencoder

abstract: Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i.e. the latent variational distributions collapse to the prior, especially when a strong decoder network is used. In this work, we analyze the latent representation of collapsed VAEs, and proposed a novel model, neighbor embedding VAE(NE-VAE), which explicitly constraints the encoder to encode inputs close in the input space to be close in the latent space. We observed that for VAE variants that report similar ELBO, KL divergence or even mutual information scores may still behave quite differently in the latent organization. In our experiments, NE-VAE can produce qualitatively different latent representations with majority of the latent dimensions remained active, which may benefit downstream latent space optimization tasks. NE-VAE can prevent posterior collapse to a much greater extent than it's predecessors, and can be easily plugged into any autoencoder framework, without introducing addition model components and complex training routines.


title: Link Prediction via controlling the leading eigenvector

abstract: Link prediction is a fundamental challenge in network science. Among various methods, similarity-based algorithms are popular for their simplicity, interpretability, high efficiency and good performance. In this paper, we show that the most elementary local similarity index Common Neighbor (CN) can be linearly decomposed by eigenvectors of the adjacency matrix of the target network, with each eigenvector's contribution being proportional to the square of the corresponding eigenvalue. As in many real networks, there is a huge gap between the largest eigenvalue and the second largest eigenvalue, the CN index is thus dominated by the leading eigenvector and much useful information contained in other eigenvectors may be overlooked. Accordingly, we propose a parameter-free algorithm that ensures the contributions of the leading eigenvector and the secondary eigenvector the same. Extensive experiments on real networks demonstrate that the prediction performance of the proposed algorithm is remarkably better than well-performed local similarity indices in the literature. A further proposed algorithm that can adjust the contribution of leading eigenvector shows the superiority over state-of-the-art algorithms with tunable parameters for its competitive accuracy and lower computational complexity.


title: Cross-Dataset Collaborative Learning for Semantic Segmentation in Autonomous Driving

abstract: Semantic segmentation is an important task for scene understanding in self-driving cars and robotics, which aims to assign dense labels for all pixels in the image. Existing work typically improves semantic segmentation performance by exploring different network architectures on a target dataset. Little attention has been paid to build a unified system by simultaneously learning from multiple datasets due to the inherent distribution shift across different datasets. In this paper, we propose a simple, flexible, and general method for semantic segmentation, termed Cross-Dataset Collaborative Learning (CDCL). Our goal is to train a unified model for improving the performance in each dataset by leveraging information from all the datasets. Specifically, we first introduce a family of Dataset-Aware Blocks (DAB) as the fundamental computing units of the network, which help capture homogeneous convolutional representations and heterogeneous statistics across different datasets. Second, we present a Dataset Alternation Training (DAT) mechanism to facilitate the collaborative optimization procedure. We conduct extensive evaluations on diverse semantic segmentation datasets for autonomous driving. Experiments demonstrate that our method consistently achieves notable improvements over prior single-dataset and cross-dataset training methods without introducing extra FLOPs. Particularly, with the same architecture of PSPNet (ResNet-18), our method outperforms the single-dataset baseline by 5.65\%, 6.57\%, and 5.79\% mIoU on the validation sets of Cityscapes, BDD100K, CamVid, respectively. We also apply CDCL for point cloud 3D semantic segmentation and achieve improved performance, which further validates the superiority and generality of our method. Code and models will be released.


title: Detecting Label Noise via Leave-One-Out Cross-Validation

abstract: We present a simple algorithm for identifying and correcting real-valued noisy labels from a mixture of clean and corrupted sample points using Gaussian process regression. A heteroscedastic noise model is employed, in which additive Gaussian noise terms with independent variances are associated with each and all of the observed labels. Optimizing the noise model using maximum likelihood estimation leads to the containment of the GPR model's predictive error by the posterior standard deviation in leave-one-out cross-validation. A multiplicative update scheme is proposed for solving the maximum likelihood estimation problem under non-negative constraints. While we provide proof of convergence for certain special cases, the multiplicative scheme has empirically demonstrated monotonic convergence behavior in virtually all our numerical experiments. We show that the presented method can pinpoint corrupted sample points and lead to better regression models when trained on synthetic and real-world scientific data sets.


title: Group draw for the FIFA World Cup: Is uniform distribution really necessary?

abstract: Several sports tournaments contain a round-robin group stage where the teams are assigned to groups subject to some constraints. Hence, the organisers usually use a computer-assisted random draw to avoid any dead end, a situation when the teams still to be drawn cannot be assigned to the remaining empty slots. This procedure is known to be unfair: the feasible allocations are not equally likely. We quantify the unfairness of the 2018 FIFA World Cup draw and evaluate its effect on the probability of qualification for the knockout stage for each national team. The official draw order of Pot 1, Pot 2, Pot 3, Pot 4 turns out to be a significantly better option than the 23 other draw orders with respect to the unwanted distortions. Nonetheless, the non-uniform draw distorts the probability of qualification by more than one percentage point for two countries. Our results call attention to the non-negligible role of draw order and make it possible for policymakers to decide whether the use of fairer draw mechanisms is justified.


title: Online Strongly Convex Optimization with Unknown Delays

abstract: We investigate the problem of online convex optimization with unknown delays, in which the feedback of a decision arrives with an arbitrary delay. Previous studies have presented a delayed variant of online gradient descent (OGD), and achieved the regret bound of $O(\sqrt{T+D})$ by only utilizing the convexity condition, where $D$ is the sum of delays over $T$ rounds. In this paper, we further exploit the strong convexity to improve the regret bound. Specifically, we first extend the delayed variant of OGD for strongly convex functions, and establish a better regret bound of $O(d\log T)$, where $d$ is the maximum delay. The essential idea is to let the learning rate decay with the total number of received feedback linearly. Furthermore, we consider the more challenging bandit setting, and obtain similar theoretical guarantees by incorporating the classical multi-point gradient estimator into our extended method. To the best of our knowledge, this is the first work that solves online strongly convex optimization under the general delayed setting.


title: Projectors in the Virtual Temperley-Lieb Algebra

abstract: We present a method of defining projectors in the virtual Temperley-Lieb algebra, that generalizes the Jones-Wenzl projectors in Temperley-Lieb algebra. We show that the projectors have similar properties with the Jones-Wenzl projectors, and contain an extra property which is associated with the virtual generator elements, that is, the product of a projector with a virtual generator is unchanged. We also show the uniqueness of the projector $f_n$ in terms of its axiomatic properties in the virtual Temperley-Lieba algebra $VTL_n(d)$. Finally, we find the coefficients of $f_n$ and give an explicit formula for the projector $f_n$.


title: Structural block driven - enhanced convolutional neural representation for relation extraction

abstract: In this paper, we propose a novel lightweight relation extraction approach of structural block driven - convolutional neural learning. Specifically, we detect the essential sequential tokens associated with entities through dependency analysis, named as a structural block, and only encode the block on a block-wise and an inter-block-wise representation, utilizing multi-scale CNNs. This is to 1) eliminate the noisy from irrelevant part of a sentence; meanwhile 2) enhance the relevant block representation with both block-wise and inter-block-wise semantically enriched representation. Our method has the advantage of being independent of long sentence context since we only encode the sequential tokens within a block boundary. Experiments on two datasets i.e., SemEval2010 and KBP37, demonstrate the significant advantages of our method. In particular, we achieve the new state-of-the-art performance on the KBP37 dataset; and comparable performance with the state-of-the-art on the SemEval2010 dataset.


title: Deep ROC Analysis and AUC as Balanced Average Accuracy to Improve Model Selection, Understanding and Interpretation

abstract: Optimal performance is critical for decision-making tasks from medicine to autonomous driving, however common performance measures may be too general or too specific. For binary classifiers, diagnostic tests or prognosis at a timepoint, measures such as the area under the receiver operating characteristic curve, or the area under the precision recall curve, are too general because they include unrealistic decision thresholds. On the other hand, measures such as accuracy, sensitivity or the F1 score are measures at a single threshold that reflect an individual single probability or predicted risk, rather than a range of individuals or risk. We propose a method in between, deep ROC analysis, that examines groups of probabilities or predicted risks for more insightful analysis. We translate esoteric measures into familiar terms: AUC and the normalized concordant partial AUC are balanced average accuracy (a new finding); the normalized partial AUC is average sensitivity; and the normalized horizontal partial AUC is average specificity. Along with post-test measures, we provide a method that can improve model selection in some cases and provide interpretation and assurance for patients in each risk group. We demonstrate deep ROC analysis in two case studies and provide a toolkit in Python.


title: Enhanced thermo-mechanical properties of 212 MAX phase borides Zr2AB2 (A = In, Tl): an ab-initio understanding

abstract: The discovery of MAX phase borides has added a new dimension for research in the materials science community. In this paper, a first-principles study of the newly known MAX phase borides Zr2AB2 (A = In, Tl) has been carried out. The estimated lattice constants and volumes of the unit cell are found to be consistent with previous study. The dynamical and mechanical stability of the titled compounds have been checked. Fundamental insights into the stiffness constants, elastic moduli, hardness parameters, brittleness and anisotropy indices are presented. The Variation of these mechanical properties was explained based on the Mulliken population analysis and charge density mapping (CDM). The electronic properties have been dealt with by considering electronic band structure and density of states (DOS) which confirmed the metallic nature of Zr2AB2 (A = In, Tl). The lowly dispersive energy bands along the c-direction confirmed anisotropy in conductivity. The analysis of DOS revealed the dominant contribution from Zr-d orbitals to the conductivity with a small contribution from the In/Tl-p states contributing at the Fermi level. The Debye temperature (Theta-D), minimum thermal conductivity (Kmin), Gruneisen parameter and melting temperature (Tm) have been calculated. The higher values of Theta-D and Tm, and lower value of Kmin for Zr2AB2 (A = In, Tl) compared to those of Zr2AC (A = In, Tl). Besides, the specific heat capacities, thermal expansion coefficient, and different thermodynamic potential functions have been calculated. The optical constants have been studied to reveal their possible relevance for application purposes. The reflectivity spectra revealed the applicability of Zr2AB2 (A = In, Tl) as cover materials to diminish the solar heating. The studied physical properties of Zr2AB2 (A = In, Tl) are compared with those of other relevant 212 and 211 MAX phase nanolaminates.


title: Hydrothermal Synthesis of Carbon and Sulfur Mono-Doped Sodium Tantalates

abstract: A set of experiments was conducted to synthesize doped and undoped sodium tantalates with carbon and sulfur in energy efficient single-step hydrothermal process. Undoped sodium tantalate nanocubes were synthesized at 140$^\circ$C and doped one at 180$^\circ$C for 12 hours in rich alkaline atmosphere. The sizes of undoped, carbon-doped, and sulfur-doped sodium tantalate nanocubes were 38 nm, 45 nm, and 40 nm, respectively. The morphological, elemental, compositional, structural, thermal, and photophysical properties of as-synthesized doped and undoped sodium tantalate (NaTaO$_3$) were characterized using scanning electron microscope (SEM), energy dispersive x-ray spectroscope (EDS), Raman spectroscopy, X-ray powder diffraction (XRD), thermal gravimetric analysis (TGA), Fourier transform infrared spectrophotometer (FTIR), and UV-vis spectrophotometer. The sulfur doped NaTaO$_3$ shows a higher photocatalytic activity in degradation of methylene blue than carbon doped and the undoped NaTaO$_3$. The band gaps of undoped NaTaO$_3$, carbon doped c-NaTaO$_3$, and sulfur doped s-NaTaO$_3$ were calculated to be 3.94 eV, 3.8 eV, and 3.52 eV, respectively using Tauc plot.


title: NameRec*: Highly Accurate and Fine-grained Person Name Recognition

abstract: In this paper, we introduce the NameRec* task, which aims to do highly accurate and fine-grained person name recognition. Traditional Named Entity Recognition models have good performance in recognising well-formed person names from text with consistent and complete syntax, such as news articles. However, there are rapidly growing scenarios where sentences are of incomplete syntax and names are in various forms such as user-generated contents and academic homepages. To address person name recognition in this context, we propose a fine-grained annotation scheme based on anthroponymy. To take full advantage of the fine-grained annotations, we propose a Co-guided Neural Network (CogNN) for person name recognition. CogNN fully explores the intra-sentence context and rich training signals of name forms. To better utilize the inter-sentence context and implicit relations, which are extremely essential for recognizing person names in long documents, we further propose an Inter-sentence BERT Model (IsBERT). IsBERT has an overlapped input processor, and an inter-sentence encoder with bidirectional overlapped contextual embedding learning and multi-hop inference mechanisms. To derive benefit from different documents with a diverse abundance of context, we propose an advanced Adaptive Inter-sentence BERT Model (Ada-IsBERT) to dynamically adjust the inter-sentence overlapping ratio to different documents. We conduct extensive experiments to demonstrate the superiority of the proposed methods on both academic homepages and news articles.


title: Hybrid subconvexity bounds for twists of $\rm GL (3)\times GL(2)$ $L$-functions

abstract: In this paper, we solve the hybrid subconvexity problem for $\rm GL (3)\times GL (2)$ $L$-functions twisted by a primtive Dirichlet charater modulo $M$ (prime) in the $M$- and $t$-aspects. We also improve hybrid subconvexity bounds for twists of $\rm GL(3)$ $L$-functions in the $M$- and $t$-aspects.


title: Self adversarial attack as an augmentation method for immunohistochemical stainings

abstract: It has been shown that unpaired image-to-image translation methods constrained by cycle-consistency hide the information necessary for accurate input reconstruction as imperceptible noise. We demonstrate that, when applied to histopathology data, this hidden noise appears to be related to stain specific features and show that this is the case with two immunohistochemical stainings during translation to Periodic acid- Schiff (PAS), a histochemical staining method commonly applied in renal pathology. Moreover, by perturbing this hidden information, the translation models produce different, plausible outputs. We demonstrate that this property can be used as an augmentation method which, in a case of supervised glomeruli segmentation, leads to improved performance.


title: Finding Security Vulnerabilities in IoT Cryptographic Protocol and Concurrent Implementations

abstract: Internet of Things (IoT) consists of a large number of devices connected through a network, which exchange a high volume of data, thereby posing new security, privacy, and trust issues. One way to address these issues is ensuring data confidentiality using lightweight encryption algorithms for IoT protocols. However, the design and implementation of such protocols is an error-prone task; flaws in the implementation can lead to devastating security vulnerabilities. Here we propose a new verification approach named Encryption-BMC and Fuzzing (EBF), which combines Bounded Model Checking (BMC) and Fuzzing techniques to check for security vulnerabilities that arise from concurrent implementations of cyrptographic protocols, which include data race, thread leak, arithmetic overflow, and memory safety. EBF models IoT protocols as a client and server using POSIX threads, thereby simulating both entities' communication. It also employs static and dynamic verification to cover the system's state-space exhaustively. We evaluate EBF against three benchmarks. First, we use the concurrency benchmark from SV-COMP and show that it outperforms other state-of-the-art tools such as ESBMC, AFL, Lazy-CSeq, and TSAN with respect to bug finding. Second, we evaluate an open-source implementation called WolfMQTT. It is an MQTT client implementation that uses the WolfSSL library. We show that \tool detects a data race bug, which other approaches are unable to find. Third, to show the effectiveness of EBF, we replicate some known vulnerabilities in OpenSSL and CyaSSL (lately WolfSSL) libraries. EBF can detect the bugs in minimum time.


title: Schr\"odinger's Ballot: Quantum Information and the Violation of Arrow's Impossibility Theorem

abstract: In this paper we study Arrow's Impossibility Theorem in the quantum setting. Our work is based on the work of Bao and Halpern, in which it is proved that the quantum analogue of Arrow's Impossibility Theorem is not valid. However, we feel unsatisfied about the proof presented there. Moreover, the definition of Quantum Independence of Irrelevant Alternatives (QIIA) seems not appropriate to us. In this paper, we give a better definition of QIIA, which properly captures the idea of the independence of irrelevant alternatives, and a detailed proof of the violation of Arrow's Impossibility Theorem in the quantum setting with the modified definition.


title: Testing General Relativity with black hole X-ray data: recent progress and future developments

abstract: The theory of General Relativity has successfully passed a large number of observational tests. The theory has been extensively tested in the weak-field regime with experiments in the Solar System and observations of binary pulsars. The past five years have seen significant advancements in the study of the strong-field regime, which can now be tested with gravitational waves, X-ray data, and mm Very Long Baseline Interferometry observations. Here I summarize the state-of-the-art of the tests of General Relativity with black hole X-ray data, discussing its recent progress and future developments.


title: Current Advances in Computational Lung Ultrasound Imaging: A Review

abstract: In the field of biomedical imaging, ultrasonography has become increasingly widespread, and an important auxiliary diagnostic tool with unique advantages, such as being non-ionising and often portable. This article reviews the state-of-the-art in medical ultrasound image computing and in particular its application in the examination of the lungs. First, we review the current developments in medical ultrasound technology. We then focus on the characteristics of lung ultrasonography and on its ability to diagnose a variety of diseases through the identification of various artefacts. We review medical ultrasound image processing methods by splitting them into two categories: (1) traditional model-based methods, and (2) data driven methods. For the former, we consider inverse problem based methods by focusing in particular on ultrasound image despeckling, deconvolution, and line artefacts detection. Among the data-driven approaches, we discuss various works based on deep/machine learning, which include various effective network architectures implementing supervised, weakly supervised and unsupervised learning.


title: ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques

abstract: Pre-trained language models of the BERT family have defined the state-of-the-arts in a wide range of NLP tasks. However, the performance of BERT-based models is mainly driven by the enormous amount of parameters, which hinders their application to resource-limited scenarios. Faced with this problem, recent studies have been attempting to compress BERT into a small-scale model. However, most previous work primarily focuses on a single kind of compression technique, and few attention has been paid to the combination of different methods. When BERT is compressed with integrated techniques, a critical question is how to design the entire compression framework to obtain the optimal performance. In response to this question, we integrate three kinds of compression methods (weight pruning, low-rank factorization and knowledge distillation (KD)) and explore a range of designs concerning model architecture, KD strategy, pruning frequency and learning rate schedule. We find that a careful choice of the designs is crucial to the performance of the compressed model. Based on the empirical findings, our best compressed model, dubbed Refined BERT cOmpreSsion with InTegrAted techniques (ROSITA), is $7.5 \times$ smaller than BERT while maintains $98.5\%$ of the performance on five tasks of the GLUE benchmark, outperforming the previous BERT compression methods with similar parameter budget. The code is available at https://github.com/llyx97/Rosita.


title: Deterministic and statistical methods for the characterisation of poroelastic media from multi-observation sound absorption measurements

abstract: This paper proposes a framework for the estimation of the transport and elastic properties of open-cell poroelastic media based on sound absorption measurements. The sought properties are the Biot-Johnson-Champoux-Allard model parameters, namely five transport parameters, two elastic properties and the mass density, as well as the sample thickness. The methodology relies on a multi-observation approach, consisting in combining multiple independent measurements into a single dataset, with the aim of over-determining the problem. In the present work, a poroelastic sample is placed in an impedance tube and tested in two loading conditions, namely in a rigid-backing configuration and coupled to a resonant expansion chamber. Given the non-monotonic nature of the experimental data, an incremental parameter estimation procedure is used in order to guide the model parameters towards the global solution without terminating at local minima. A statistical inversion approach is also discussed, providing refined point estimates, uncertainty ranges and parameter correlations. The methodology is applied to the characterisation of a sample of melamine foam and provides estimates of all nine parameters with compact uncertainty ranges. It is shown that the model parameters are retrieved with a lower uncertainty in the multi-observation case, as compared with a single-observation case. The method proposed here does not require prior knowledge of the thickness or any of the properties of the sample, and can be carried out with a standard two-microphone impedance tube.


title: Work Fluctuations in the Active Ornstein- Uhlenbeck Particle model

abstract: We study the large deviations of the power injected by the active force for an Active Ornstein-Uhlenbeck Particle (AOUP), free or in a confining potential. For the free-particle case, we compute the rate function analytically in d-dimensions from a saddle-point expansion, and numerically in two dimensions by it a) direct sampling of the active work in numerical solutions of the AOUP equations and b) Legendre-Fenchel transform of the scaled cumulant generating function obtained via a cloning algorithm. The rate function presents asymptotically linear branches on both sides and it is independent of the system's dimensionality, apart from a multiplicative factor. For the confining potential case, we focus on two-dimensional systems and obtain the rate function numerically using both methods a) and b). We find a different scenario for harmonic and anharmonic potentials: in the former case, the phenomenology of fluctuations is analogous to that of a free particle, but the rate function might be non-analytic; in the latter case the rate functions are analytic, but fluctuations are realised by entirely different means, which rely strongly on the particle-potential interaction. Finally, we check the validity of a fluctuation relation for the active work distribution. In the free-particle case, the relation is satisfied with a slope proportional to the bath temperature. The same slope is found for the harmonic potential, regardless of activity, and for an anharmonic potential with low activity. In the anharmonic case with high activity, instead, we find a different slope which is equal to an effective temperature obtained from the fluctuation-dissipation theorem.


title: Online Convex Optimization with Continuous Switching Constraint

abstract: In many sequential decision making applications, the change of decision would bring an additional cost, such as the wear-and-tear cost associated with changing server status. To control the switching cost, we introduce the problem of online convex optimization with continuous switching constraint, where the goal is to achieve a small regret given a budget on the \emph{overall} switching cost. We first investigate the hardness of the problem, and provide a lower bound of order $\Omega(\sqrt{T})$ when the switching cost budget $S=\Omega(\sqrt{T})$, and $\Omega(\min\{\frac{T}{S},T\})$ when $S=O(\sqrt{T})$, where $T$ is the time horizon. The essential idea is to carefully design an adaptive adversary, who can adjust the loss function according to the cumulative switching cost of the player incurred so far based on the orthogonal technique. We then develop a simple gradient-based algorithm which enjoys the minimax optimal regret bound. Finally, we show that, for strongly convex functions, the regret bound can be improved to $O(\log T)$ for $S=\Omega(\log T)$, and $O(\min\{T/\exp(S)+S,T\})$ for $S=O(\log T)$.


title: A Powerful Subvector Anderson Rubin Test in Linear Instrumental Variables Regression with Conditional Heteroskedasticity

abstract: We introduce a new test for a two-sided hypothesis involving a subset of the structural parameter vector in the linear instrumental variables (IVs) model. Guggenberger et al. (2019), GKM19 from now on, introduce a subvector Anderson-Rubin (AR) test with data-dependent critical values that has asymptotic size equal to nominal size for a parameter space that allows for arbitrary strength or weakness of the IVs and has uniformly nonsmaller power than the projected AR test studied in Guggenberger et al. (2012). However, GKM19 imposes the restrictive assumption of conditional homoskedasticity. The main contribution here is to robustify the procedure in GKM19 to arbitrary forms of conditional heteroskedasticity. We first adapt the method in GKM19 to a setup where a certain covariance matrix has an approximate Kronecker product (AKP) structure which nests conditional homoskedasticity. The new test equals this adaption when the data is consistent with AKP structure as decided by a model selection procedure. Otherwise the test equals the AR/AR test in Andrews (2017) that is fully robust to conditional heteroskedasticity but less powerful than the adapted method. We show theoretically that the new test has asymptotic size bounded by the nominal size and document improved power relative to the AR/AR test in a wide array of Monte Carlo simulations when the covariance matrix is not too far from AKP.


title: Natural Perturbed Training for General Robustness of Neural Network Classifiers

abstract: We focus on the robustness of neural networks for classification. To permit a fair comparison between methods to achieve robustness, we first introduce a standard based on the mensuration of a classifier's degradation. Then, we propose natural perturbed training to robustify the network. Natural perturbations will be encountered in practice: the difference of two images of the same object may be approximated by an elastic deformation (when they have slightly different viewing angles), by occlusions (when they hide differently behind objects), or by saturation, Gaussian noise etc. Training some fraction of the epochs on random versions of such variations will help the classifier to learn better. We conduct extensive experiments on six datasets of varying sizes and granularity. Natural perturbed learning show better and much faster performance than adversarial training on clean, adversarial as well as natural perturbed images. It even improves general robustness on perturbations not seen during the training. For Cifar-10 and STL-10 natural perturbed training even improves the accuracy for clean data and reaches the state of the art performance. Ablation studies verify the effectiveness of natural perturbed training.


title: ProgressiveSpinalNet architecture for FC layers

abstract: In deeplearning models the FC (fully connected) layer has biggest important role for classification of the input based on the learned features from previous layers. The FC layers has highest numbers of parameters and fine-tuning these large numbers of parameters, consumes most of the computational resources, so in this paper it is aimed to reduce these large numbers of parameters significantly with improved performance. The motivation is inspired from SpinalNet and other biological architecture. The proposed architecture has a gradient highway between input to output layers and this solves the problem of diminishing gradient in deep networks. In this all the layers receives the input from previous layers as well as the CNN layer output and this way all layers contribute in decision making with last layer. This approach has improved classification performance over the SpinalNet architecture and has SOTA performance on many datasets such as Caltech101, KMNIST, QMNIST and EMNIST. The source code is available at https://github.com/praveenchopra/ProgressiveSpinalNet.


title: MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigation

abstract: Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this task; however, they come at a significantly increased computational load. Through this work, we design a novel approach that focuses on performing better or comparable to the existing learning-based solutions but under a clear time/computational budget. To this end, we propose a method to encode vital scene semantics such as traversable paths, unexplored areas, and observed scene objects -- alongside raw visual streams such as RGB, depth, and semantic segmentation masks -- into a semantically informed, top-down egocentric map representation. Further, to enable the effective use of this information, we introduce a novel 2-D map attention mechanism, based on the successful multi-layer Transformer networks. We conduct experiments on 3-D reconstructed indoor PointGoal visual navigation and demonstrate the effectiveness of our approach. We show that by using our novel attention schema and auxiliary rewards to better utilize scene semantics, we outperform multiple baselines trained with only raw inputs or implicit semantic information while operating with an 80% decrease in the agent's experience.