title: Stereo Darkfield Interferometry : a versatile localization method for subnanometer force spectroscopy of single molecules and 3D-tracking of single cells

abstract: Super-resolutive 3D tracking, such as PSF engineering or evanescent field imaging has long been used to track microparticles and to enhance the throughput of single molecules force spectroscopic measurements. However, current methods present two drawbacks. First, they lack precision compared with optical tweezers or AFM. Second, the dependence of their signal upon the position is complex creating the need for a time-consuming calibration step. Here, we introduce a new optical technique that circumvents both issues and allows for a simple, versatile and efficient 3D tracking of diluted particles while offering a sub-nanometer frame-to-frame precision in all three spatial directions. The principle is to combine stereoscopy and interferometry, such that the z (axial) position is measured through the distance between two interferometric fringe patterns. The linearity of this stereoscopy technique alleviates the need for lookup tables while the structured interferometric pattern enhances precision. On the other hand, the extended spatial footprint of this PSF maximizes the number of photons detected per frame without the need of fancy cameras, nor the need for complex hardware. Hence, thanks to its simplicity and versatility, we believe that SDI (Stereo Darkfield Interferometry) technology has the potential to significantly enhance the spreading of 3D tracking. We demonstrate the efficiency of this technique on various single-molecule measurements thanks to magnetic tweezers. In particular we demonstrate the precise quantification of two-state dynamics involving axial steps as short as 1 nm. We then show that SDI can be directly embedded in a commercial objective providing a means to track multiple single cells in 3D .


title: Generic Fibers of Parahoric Hitchin Systems

abstract: In this paper, we talk about parahoric Hitchin systems over smooth projective curves with structure group a semisimple simply connected group. We describe the geometry of generic fibers of parahoric Hitchin fibrations using root stacks. We work over an algebraically closed field with a mild assumption of the characteristic. All of these can be treated as a generalization of GLn case in [SWW19]


title: Respiratory Sound Classification Using Long-Short Term Memory

abstract: Developing a reliable sound detection and recognition system offers many benefits and has many useful applications in different industries. This paper examines the difficulties that exist when attempting to perform sound classification as it relates to respiratory disease classification. Some methods which have been employed such as independent component analysis and blind source separation are examined. Finally, an examination on the use of deep learning and long short-term memory networks is performed in order to identify how such a task can be implemented.


title: Benign Overfitting and Noisy Features

abstract: Modern machine learning often operates in the regime where the number of parameters is much higher than the number of data points, with zero training loss and yet good generalization, thereby contradicting the classical bias-variance trade-off. This \textit{benign overfitting} phenomenon has recently been characterized using so called \textit{double descent} curves where the risk undergoes another descent (in addition to the classical U-shaped learning curve when the number of parameters is small) as we increase the number of parameters beyond a certain threshold. In this paper, we examine the conditions under which \textit{Benign Overfitting} occurs in the random feature (RF) models, i.e. in a two-layer neural network with fixed first layer weights. We adopt a new view of random feature and show that \textit{benign overfitting} arises due to the noise which resides in such features (the noise may already be present in the data and propagate to the features or it may be added by the user to the features directly) and plays an important implicit regularization role in the phenomenon.


title: The emission of electromagnetic radiation from the early stages of relativistic heavy-ion collisions

abstract: We estimate the production of electromagnetic radiation (real and virtual photons) from the early, pre-equilibrium, stage of relativistic heavy-ion collisions. The parton dynamics are obtained as a solution of the Boltzmann equation in the Fokker-Planck diffusion limit. The photon and dilepton rates are integrated and the obtained yields are compared with those from standard sources and with available experimental data. Non-equilibrium photon spectra are predicted for Pb+Pb at $\sqrt{s_{\rm NN}} = 5.02$ TeV.


title: Local earthquakes detection: A benchmark dataset of 3-component seismograms built on a global scale

abstract: Machine learning is becoming increasingly important in scientific and technological progress, due to its ability to create models that describe complex data and generalize well. The wealth of publicly-available seismic data nowadays requires automated, fast, and reliable tools to carry out a multitude of tasks, such as the detection of small, local earthquakes in areas characterized by sparsity of receivers. A similar application of machine learning, however, should be built on a large amount of labeled seismograms, which is neither immediate to obtain nor to compile. In this study we present a large dataset of seismograms recorded along the vertical, north, and east components of 1487 broad-band or very broad-band receivers distributed worldwide; this includes 629,095 3-component seismograms generated by 304,878 local earthquakes and labeled as EQ, and 615,847 ones labeled as noise (AN). Application of machine learning to this dataset shows that a simple Convolutional Neural Network of 67,939 parameters allows discriminating between earthquakes and noise single-station recordings, even if applied in regions not represented in the training set. Achieving an accuracy of 96.7, 95.3, and 93.2% on training, validation, and test set, respectively, we prove that the large variety of geological and tectonic settings covered by our data supports the generalization capabilities of the algorithm, and makes it applicable to real-time detection of local events. We make the database publicly available, intending to provide the seismological and broader scientific community with a benchmark for time-series to be used as a testing ground in signal processing.


title: Unifying Compactly Supported and Matern Covariance Functions in Spatial Statistics

abstract: The Mat{\'e}rn family of covariance functions has played a central role in spatial statistics for decades, being a flexible parametric class with one parameter determining the smoothness of the paths of the underlying spatial field. This paper proposes a new family of spatial covariance functions, which stems from a reparameterization of the generalized Wendland family. As for the Mat{\'e}rn case, the new class allows for a continuous parameterization of the smoothness of the underlying Gaussian random field, being additionally compactly supported. More importantly, we show that the proposed covariance family generalizes the Mat{\'e}rn model which is attained as a special limit case. The practical implication of our theoretical results questions the effective flexibility of the Mat{\'e}rn covariance from modeling and computational viewpoints. Our numerical experiments elucidate the speed of convergence of the proposed model to the Mat{\'e}rn model. We also inspect the level of sparseness of the associated (inverse) covariance matrix and the asymptotic distribution of the maximum likelihood estimator under increasing and fixed domain asymptotics. The effectiveness of our proposal is illustrated by analyzing a georeferenced dataset on maximum temperatures over the southeastern United States, and performing a re-analysis of a large spatial point referenced dataset of yearly total precipitation anomalies


title: Detecting Early-warning signals in Time Series of Visits to Points of Interests to Examine Population Response to COVID -19 Pandemic

abstract: The objective of this paper is to examine population response to COVID-19 and associated policy interventions through detecting early-warning signals in time series of visits to points of interest (POIs). Complex systems, such as cities, demonstrate early-warning signals when they approach phase transitions responding to external perturbation, including crises, policy changes, and human behavior changes. In urban systems, population visits to POIs represent a state in the complex systems that are cities. These states may undergo phase transitions due to population response to pandemic risks and intervention policies. In this study, we conducted early-warning signal detection on population visits to POIs to examine population response to pandemic risks. We examined two early-warning signals, the increase of autocorrelation at-lag-1 and standard deviation, in time series of population visits to POIs in 17 metropolitan cities in the United States of America. The results show that: (1) early-warning signals for population response to COVID-19 were detected between February 14 and March 11, 2020 in 17 cities; (2) detected population response had started prior to shelter-in-place orders in 17 cities; (3) early-warning signals detected from the essential POIs visits appeared earlier than those from non-essential POIs; and 4) longer time lags between detected population response and shelter-in-place orders led to a less decrease in POI visits. The results show the importance of detecting early-warning signals during crises in cities as complex systems. Early-warning signals could provide important insights regarding the timing and extent of population response to crises to inform policy makers.


title: MCMC Algorithms for Posteriors on Matrix Spaces

abstract: We study Markov chain Monte Carlo (MCMC) algorithms for target distributions defined on matrix spaces. Such an important sampling problem has yet to be analytically explored. We carry out a major step in covering this gap by developing the proper theoretical framework that allows for the identification of ergodicity properties of typical MCMC algorithms, relevant in such a context. Beyond the standard Random-Walk Metropolis (RWM) and preconditioned Crank--Nicolson (pCN), a contribution of this paper in the development of a novel algorithm, termed the `Mixed' pCN (MpCN). RWM and pCN are shown not to be geometrically ergodic for an important class of matrix distributions with heavy tails. In contrast, MpCN is robust across targets with different tail behaviour and has very good empirical performance within the class of heavy-tailed distributions. Geometric ergodicity for MpCN is not fully proven in this work, as some remaining drift conditions are quite challenging to obtain owing to the complexity of the state space. We do, however, make a lot of progress towards a proof, and show in detail the last steps left for future work. We illustrate the computational performance of the various algorithms through numerical applications, including calibration on real data of a challenging model arising in financial statistics.


title: Critical patch size reduction by heterogeneous diffusion

abstract: Population survival depends on a large set of factors that includes environment structure. Due to landscape heterogeneity, species can occupy particular regions that provide the ideal scenario for development, working as a refuge from harmful environmental conditions. Survival occurs if population growth overcomes the losses caused by adventurous individuals that cross the patch edge. In this work, we consider a single species dynamics in a bounded domain with a space-dependent diffusion coefficient. We investigate the impact of heterogeneous diffusion on the minimal patch size that allows population survival and show that, typically, this critical size is smaller than the one for a homogeneous medium with the same average diffusivity.


title: Demand Response For Residential Uses: A Data Analytics Approach

abstract: In the Smart Grid environment, the advent of intelligent measuring devices facilitates monitoring appliance electricity consumption. This data can be used in applying Demand Response (DR) in residential houses through data analytics, and developing data mining techniques. In this research, we introduce a smart system foundation that is applied to user's disaggregated power consumption data. This system encourages the users to apply DR by changing their behaviour of using heavier operation modes to lighter modes, and by encouraging users to shift their usages to off-peak hours. First, we apply Cross Correlation (XCORR) to detect times of the occurrences when an appliance is being used. We then use The Dynamic Time Warping (DTW) to recognize the operation mode used.


title: A Vectorial Approach to Unbalanced Optimal Mass Transport

abstract: Unbalanced optimal mass transport (OMT) seeks to remove the conservation of mass constraint by adding a source term to the standard continuity equation in the Benamou-Brenier formulation of OMT. In this note, we show how the addition of the source fits into the vector-valued OMT framework.


title: Spread-F occurrence during geomagnetic storms near the southern crest of the EIA in Argentina

abstract: This work presents, for the first time, the analysis of the occurrence of ionospheric irregularities during geomagnetic storms at Tucum\'an-Argentina, a low latitude station in the Southern American longitudinal sector ( 26.9 {\deg} S, 294.6 {\deg} E; magnetic latitude 15.5 {\deg} S), near the southern crest of the equatorial ionization anomaly (EIA). Three geomagnetic storms occurred on May 27, 2017 (a month of low occurrence rates of spread-F), October 12, 2016 (a month of transition from low to high occurrence rates of spread-F) and November 7, 2017 (a month of high occurrence rates of spread-F) are analyzed using Global Positioning System (GPS) receivers and ionosondes. The rate of change of total electron content (TEC) Index (ROTI), GPS Ionospheric L-band scintillation, the virtual height of the F-layer bottom side (h'F) and the critical frequency of the F2 layer (foF2) are considered. Furthermore, each ionogram is manually examined for the presence of spread-F signatures. The results show that, for the three events studied, geomagnetic activity creates favorable conditions for the initiation of ionospheric irregularities, manifested by ionogram spread-F and TEC fluctuation. Post-midnight irregularities are developed due to the presence of eastward disturbance dynamo electric fields (DDEF). For the storm of May, an eastward over-shielding prompt penetration electric field (PPEF) is also acting. This PPEF is added to the DDEF and produces the uplifting of the F region that helps trigger the irregularities. What is more, during October and November, strong GPS L band scintillation is observed associated with strong range spread-F (SSF), that is, irregularities29 extending from the bottom-side to the topside of the F region.


title: Objective quantification of Particle Pair Diffusion in Homogeneous Isotropic Turbulence

abstract: Turbulence consists of interacting flow structures covering a wide range of length and time scales. A long-standing question looms over pair diffusion of particles in close proximity i.e. particle pair diffusion at small separations: what range of turbulence length scales governs pair diffusion? Here, we attempt to answer this question by addressing pair diffusion by both fine scales and larger scale coherent structures in which the fine scales are embedded - we unavoidably encounter a combination of both local and non-local interactions associated with the small and large length scales. The local structures possess length scales of the same order of magnitude as the pair separation $l$, and they induce strong relative motion between the particle pair. However, the non-local structures, possessing length scales much larger than $l$, also induce (via Biot-Savart) significant relative motion, an effect ignored in prior studies (based on Richardson-Obukhov R-O theory). This fundamentally changes the interpretation of the pair diffusion process, giving the pair diffusivity $K$ scaling as $K\sim l^{1.556}$ -- agreeing within $1\%$ of data. The `R-O constant' $g_l$ is shown to be not a constant, although widely assumed to be a constant. However, new constants (representing pair diffusivity $G_K$ and pair separation $G_l$) are identified, which we show to asymptote to $G_K\approx 0.73$ and $G_l\sim 0.01$ at high Reynolds numbers. As an application, we show that the radius of a cloud of droplets in a spray is smaller by an order of magnitude as compared to R-O theory.


title: Predicting Visual Importance Across Graphic Design Types

abstract: This paper introduces a Unified Model of Saliency and Importance (UMSI), which learns to predict visual importance in input graphic designs, and saliency in natural images, along with a new dataset and applications. Previous methods for predicting saliency or visual importance are trained individually on specialized datasets, making them limited in application and leading to poor generalization on novel image classes, while requiring a user to know which model to apply to which input. UMSI is a deep learning-based model simultaneously trained on images from different design classes, including posters, infographics, mobile UIs, as well as natural images, and includes an automatic classification module to classify the input. This allows the model to work more effectively without requiring a user to label the input. We also introduce Imp1k, a new dataset of designs annotated with importance information. We demonstrate two new design interfaces that use importance prediction, including a tool for adjusting the relative importance of design elements, and a tool for reflowing designs to new aspect ratios while preserving visual importance. The model, code, and importance dataset are available at https://predimportance.mit.edu .


title: On a quarternification of complex Lie algebras

abstract: We give a definition of quarternion Lie algebra and of the quarternification of a complex Lie algebra. By our definition gl(n,H), sl(n,H), so*(2n) and sp(n) are quarternifications of gl(n,C), sl(n,C), so(n,C) and u(n) respectively. Then we shall prove that a simple Lie algebra admits the quarternification. For the proof we follow the well known argument due to Harich-Chandra, Chevalley and Serre to construct the simple Lie algebra from its corresponding root system. The root space decomposition of this quarternion Lie algebra will be given. Each root space of a fundamental root is complex 2-dimensional.


title: On the Application of Error Backpropagation to the Background Calibration of Time Interleaved ADC for Digital Communication Receivers

abstract: This paper introduces a backpropagation-based technique for the calibration of the mismatch errors of time-interleaved analog to digital converters (TI-ADCs). This technique is applicable to digital receivers such as those used in coherent optical communications. The error at the slicer of the receiver is processed using a modified version of the well known backpropagation algorithm from machine learning. The processed slicer error can be directly applied to compensate the TI-ADC mismatch errors with an adaptive equalizer, or it can be used to digitally estimate and correct said mismatch errors using analog techniques such as delay cells and programmable gain amplifiers (PGA). The main advantages of the technique proposed here compared to prior art are its robustness, its speed of convergence, and the fact that it always works in background mode, independently of the oversampling factor and the properties of the input signal, as long as the receiver converges. Moreover, this technique enables the joint compensation of impairments not addressed by traditional TI-ADC calibration techniques, such as I/Q skew in quadrature modulation receivers. Simulations are presented to demonstrate the effectiveness of the technique, and low complexity implementation options are discussed.


title: Kernel Ordinary Differential Equations

abstract: Ordinary differential equation (ODE) is widely used in modeling biological and physical processes in science. In this article, we propose a new reproducing kernel-based approach for estimation and inference of ODE given noisy observations. We do not assume the functional forms in ODE to be known, or restrict them to be linear or additive, and we allow pairwise interactions. We perform sparse estimation to select individual functionals, and construct confidence intervals for the estimated signal trajectories. We establish the estimation optimality and selection consistency of kernel ODE under both the low-dimensional and high-dimensional settings, where the number of unknown functionals can be smaller or larger than the sample size. Our proposal builds upon the smoothing spline analysis of variance (SS-ANOVA) framework, but tackles several important problems that are not yet fully addressed, and thus extends the scope of existing SS-ANOVA too. We demonstrate the efficacy of our method through numerous ODE examples.


title: An Indexing Scheme and Descriptor for 3D Object Retrieval Based on Local Shape Querying

abstract: A binary descriptor indexing scheme based on Hamming distance called the Hamming tree for local shape queries is presented. A new binary clutter resistant descriptor named Quick Intersection Count Change Image (QUICCI) is also introduced. This local shape descriptor is extremely small and fast to compare. Additionally, a novel distance function called Weighted Hamming applicable to QUICCI images is proposed for retrieval applications. The effectiveness of the indexing scheme and QUICCI is demonstrated on 828 million QUICCI images derived from the SHREC2017 dataset, while the clutter resistance of QUICCI is shown using the clutterbox experiment.


title: How do intrinsically disordered protein regions encode a driving force for liquid-liquid phase separation?

abstract: Liquid-liquid phase separation is the mechanism underlying the formation of biomolecular condensates. Disordered protein regions often drive phase separation, but molecular interactions of disordered protein regions are not well understood, sometimes leading to the conflation that all disordered protein regions drive phase separation. Given the critical role of phase separation in many cellular processes, and that dysfunction of phase separation can lead to debilitating diseases, it is important that we understand the interactions and sequence properties underlying phase behavior. A conceptual framework that divides IDRs into interacting and solvating regions has proven particularly useful, and analytical instantiations and coarse-grained models can test our understanding of the driving forces against experimental phase behavior. Validated simulation paradigms enable the exploration of sequence space to help our understanding of how disordered protein regions can encode phase behavior, which IDRs may mediate phase separation in cells, and which IDRs are in contrast highly soluble.


title: Polysemy Deciphering Network for Robust Human-Object Interaction Detection

abstract: Human-Object Interaction (HOI) detection is important to human-centric scene understanding tasks. Existing works tend to assume that the same verb has similar visual characteristics in different HOI categories, an approach that ignores the diverse semantic meanings of the verb. To address this issue, in this paper, we propose a novel Polysemy Deciphering Network (PD-Net) that decodes the visual polysemy of verbs for HOI detection in three distinct ways. First, we refine features for HOI detection to be polysemyaware through the use of two novel modules: namely, Language Prior-guided Channel Attention (LPCA) and Language Prior-based Feature Augmentation (LPFA). LPCA highlights important elements in human and object appearance features for each HOI category to be identified; moreover, LPFA augments human pose and spatial features for HOI detection using language priors, enabling the verb classifiers to receive language hints that reduce intra-class variation for the same verb. Second, we introduce a novel Polysemy-Aware Modal Fusion module (PAMF), which guides PD-Net to make decisions based on feature types deemed more important according to the language priors. Third, we propose to relieve the verb polysemy problem through sharing verb classifiers for semantically similar HOI categories. Furthermore, to expedite research on the verb polysemy problem, we build a new benchmark dataset named HOI-VerbPolysemy (HOIVP), which includes common verbs (predicates) that have diverse semantic meanings in the real world. Finally, through deciphering the visual polysemy of verbs, our approach is demonstrated to outperform state-of-the-art methods by significant margins on the HICO-DET, V-COCO, and HOI-VP databases. Code and data in this paper are available at https://github.com/MuchHair/PD-Net.


title: Can Smartphone Co-locations Detect Friendship? It Depends How You Model It

abstract: We present a study to detect friendship, its strength, and its change from smartphone location data collectedamong members of a fraternity. We extract a rich set of co-location features and build classifiers that detectfriendships and close friendship at 30% above a random baseline. We design cross-validation schema to testour model performance in specific application settings, finding it robust to seeing new dyads and to temporalvariance.


title: Emission of electromagnetic waves as a stopping mechanism for nonlinear collisionless ionization waves in a high-$\beta$ regime

abstract: A high energy density plasma embedded in a neutral gas is able to launch an outward-propagating nonlinear electrostatic ionization wave that traps energetic electrons. The trapping maintains a strong sheath electric field, enabling rapid and long-lasting wave propagation aided by field ionization. Using 1D3V kinetic simulations, we examine the propagation of the ionization wave in the presence of a transverse MG-level magnetic field with the objective to identify qualitative changes in a regime where the initial thermal pressure of the plasma exceeds the pressure of the magnetic field ($\beta>1$). Our key finding is that the magnetic field stops the propagation by causing the energetic electrons sustaining the wave to lose their energy by emitting an electromagnetic wave. The emission is accompanied by the magnetic field expulsion from the plasma and an increased electron loss from the trapping wave structure. The described effect provides a mechanism mitigating rapid plasma expansion for those applications that involve an embedded plasma, such as high-flux neutron production from laser-irradiated deuterium gas jets.


title: Overview of KAGRA : KAGRA science

abstract: KAGRA is a newly build gravitational-wave observatory, a laser interferometer with 3 km arm length, located in Kamioka, Gifu, Japan. In this paper in the series of KAGRA-featured articles, we discuss the science targets of KAGRA projects, considering not only the baseline KAGRA (current design) but also its future upgrade candidates (KAGRA+) for the near to middle term (~5 years).


title: Generalized Silver and Miller measurability

abstract: We present some results about the burgeoning research area concerning set theory of the kappa-reals. We focus on some notions of measurability coming from generalizations of Silver and Miller trees. We present analogies and mostly differences from the classical setting.


title: Extended Calculations with Spectroscopic Accuracy: Energy Levels and Radiative Rates for O-like Ions between Ar XI and Cr XVII

abstract: Using the multiconfiguration Dirac-Hartree-Fock and the relativistic configuration interaction methods, a consistent set of transition energies and radiative transition data for the main states of the $2s^2 2p^4$, $2s 2p^5$, $2p^6$, $2s^2 2p^3 3s$, $2s^2 2p^3 3p$, $2s^2 2p^3 3d$, $2s 2p^4 3s$, $2s 2p^4 3p$, and $2s 2p^4 3d$ configurations in O-like Ions between Ar XI ($Z = 18$) and Cr XVII ($Z = 24$) is provided. Our data set is compared with the NIST compiled values and previous calculations. The data are accurate enough for identification and deblending of new emission lines from hot astrophysical and laboratory plasmas. The amount of data of high accuracy is significantly increased for the $n = 3$ states of several O-like ions, where experimental data are very scarce.


title: A Sub-linear Time Algorithm for Approximating k-Nearest-Neighbor with Full Quality Guarantee

abstract: In this paper we propose an algorithm for the approximate k-Nearest-Neighbors problem. According to the existing researches, there are two kinds of approximation criterion. One is the distance criteria, and the other is the recall criteria. All former algorithms suffer the problem that there are no theoretical guarantees for the two approximation criterion. The algorithm proposed in this paper unifies the two kinds of approximation criterion, and has full theoretical guarantees. Furthermore, the query time of the algorithm is sub-linear. As far as we know, it is the first algorithm that achieves both sub-linear query time and full theoretical approximation guarantee.


title: Classification of genus-$1$ holomorphic Lefschetz pencils

abstract: In this paper, we classify relatively minimal genus-$1$ holomorphic Lefschetz pencils up to smooth isomorphism. We first show that such a pencil is isomorphic to either the pencil on $\mathbb{P}^1\times \mathbb{P}^1$ of bi-degree $(2,2)$ or a blow-up of the pencil on $\mathbb{P}^2$ of degree $3$, provided that no fiber of a pencil contains an embedded sphere. (Note that one can easily classify genus-$1$ Lefschetz pencils with an embedded sphere in a fiber.) We further determine the monodromy factorizations of these pencils and show that the isomorphism class of a blow-up of the pencil on $\mathbb{P}^2$ of degree $3$ does not depend on the choice of blown-up base points. We also show that the genus-$1$ Lefschetz pencils constructed by Korkmaz-Ozbagci (with nine base points) and Tanaka (with eight base points) are respectively isomorphic to the pencils on $\mathbb{P}^2$ and $\mathbb{P}^1\times \mathbb{P}^1$ above, in particular these are both holomorphic.


title: A Note on Using Discretized Simulated Data to Estimate Implicit Likelihoods in Bayesian Analyses

abstract: This article presents a Bayesian inferential method where the likelihood for a model is unknown but where data can easily be simulated from the model. We discretize simulated (continuous) data to estimate the implicit likelihood in a Bayesian analysis employing a Markov chain Monte Carlo algorithm. Three examples are presented as well as a small study on some of the method's properties.


title: A Historical Account of My Early Research Interests

abstract: This paper presents a brief account of some of the my early research interests. This historical account starts from my laurea thesis on Signal Theory and my master thesis on Computation Theory. It recalls some results in Combinatory Logic and Term Rewriting Systems. Some other results concern Program Transformation, Parallel Computation, Theory of Concurrency, and Proof of Program Properties. My early research activity has been mainly done in cooperation with Andrzej Skowron, Anna Labella, and Maurizio Proietti.


title: Privacy-Preserved Collaborative Estimation for Networked Vehicles with Application to Road Anomaly Detection

abstract: Road information such as road profile and traffic density have been widely used in intelligent vehicle systems to improve road safety, ride comfort, and fuel economy. However, vehicle heterogeneity and parameter uncertainty make it extremely difficult for a single vehicle to accurately and reliably measure such information. In this work, we propose a unified framework for learning-based collaborative estimation to fuse local road estimation from a fleet of connected heterogeneous vehicles. The collaborative estimation scheme exploits the sequential measurements made by multiple vehicles traversing the same road segment and let these vehicles relay a learning signal to iteratively refine local estimations. Given that the privacy of individual vehicles' identity must be protected in collaborative estimation, we directly incorporate privacy-protection design into the collaborative estimation design and establish a unified framework for privacy-preserving collaborative estimation. Different from patching conventional privacy mechanisms like differential privacy which will compromise algorithmic accuracy or homomorphic encryption which will incur heavy communication/computational overhead, we leverage the dynamical properties of collective estimation to enable inherent privacy protection without sacrificing accuracy or significantly increasing communication/computation overhead. Numerical simulations confirm the effectiveness and efficiency of our proposed framework.


title: From Well Structured Transition Systems to Program Verification

abstract: We describe the use of the theory of WSTS for verifying programs.


title: Zero-Shot Heterogeneous Transfer Learning from Recommender Systems to Cold-Start Search Retrieval

abstract: Many recent advances in neural information retrieval models, which predict top-K items given a query, learn directly from a large training set of (query, item) pairs. However, they are often insufficient when there are many previously unseen (query, item) combinations, often referred to as the cold start problem. Furthermore, the search system can be biased towards items that are frequently shown to a query previously, also known as the 'rich get richer' (a.k.a. feedback loop) problem. In light of these problems, we observed that most online content platforms have both a search and a recommender system that, while having heterogeneous input spaces, can be connected through their common output item space and a shared semantic representation. In this paper, we propose a new Zero-Shot Heterogeneous Transfer Learning framework that transfers learned knowledge from the recommender system component to improve the search component of a content platform. First, it learns representations of items and their natural-language features by predicting (item, item) correlation graphs derived from the recommender system as an auxiliary task. Then, the learned representations are transferred to solve the target search retrieval task, performing query-to-item prediction without having seen any (query, item) pairs in training. We conduct online and offline experiments on one of the world's largest search and recommender systems from Google, and present the results and lessons learned. We demonstrate that the proposed approach can achieve high performance on offline search retrieval tasks, and more importantly, achieved significant improvements on relevance and user interactions over the highly-optimized production system in online experiments.


title: From Big-Step to Small-Step Semantics and Back with Interpreter Specialisation

abstract: We investigate representations of imperative programs as constrained Horn clauses. Starting from operational semantics transition rules, we proceed by writing interpreters as constrained Horn clause programs directly encoding the rules. We then specialise an interpreter with respect to a given source program to achieve a compilation of the source language to Horn clauses (an instance of the first Futamura projection). The process is described in detail for an interpreter for a subset of C, directly encoding the rules of big-step operational semantics for C. A similar translation based on small-step semantics could be carried out, but we show an approach to obtaining a small-step representation using a linear interpreter for big-step Horn clauses. This interpreter is again specialised to achieve the translation from big-step to small-step style. The linear small-step program can be transformed back to a big-step non-linear program using a third interpreter. A regular path expression is computed for the linear program using Tarjan's algorithm, and this regular expression then guides an interpreter to compute a program path. The transformation is realised by specialisation of the path interpreter. In all of the transformation phases, we use an established partial evaluator and exploit standard logic program transformation to remove redundant data structures and arguments in predicates and rename predicates to make clear their link to statements in the original source program.


title: Cons-free Programs and Complexity Classes between LOGSPACE and PTIME

abstract: Programming language concepts are used to give some new perspectives on a long-standing open problem: is logspace = ptime ?


title: Prolog for Verification, Analysis and Transformation Tools

abstract: This article examines the use of the Prolog language for writing verification, analysis and transformation tools. Guided by experience in teaching and the development of verification tools like ProB or specialisation tools like ECCE and LOGEN, the article presents an assessment of various aspects of Prolog and provides guidelines for using them. The article shows the usefulness of a few key Prolog features. In particular, it discusses how to deal with negation at the level of the object programs being verified or analysed.


title: Transformational Verification of Quicksort

abstract: Many transformation techniques developed for constraint logic programs, also known as constrained Horn clauses (CHCs), have found new useful applications in the field of program verification. In this paper, we work out a nontrivial case study through the transformation-based verification approach. We consider the familiar Quicksort program for sorting lists, written in a functional programming language, and we verify the pre/-postconditions that specify the intended correctness properties of the functions defined in the program. We verify these properties by: (1) translating them into CHCs, (2) transforming the CHCs by removing all list occurrences, and (3) checking the satisfiability of the transformed CHCs by using the Eldarica solver over booleans and integers. The transformation mentioned at Point (2) requires an extension of the algorithms for the elimination of inductively defined data structures presented in previous work, because during one stage of the transformation we use as lemmas some properties that have been proved at previous stages.


title: Generating Distributed Programs from Event-B Models

abstract: Distributed algorithms offer challenges in checking that they meet their specifications. Verification techniques can be extended to deal with the verification of safety properties of distributed algorithms. In this paper, we present an approach for combining correct-by-construction approaches and transformations of formal models (Event-B) into programs (DistAlgo) to address the design of verified distributed programs. We define a subset LB (Local Event-B) of the Event-B modelling language restricted to events modelling the classical actions of distributed programs as internal or local computations, sending messages and receiving messages. We define then transformations of the various elements of the LB language into DistAlgo programs. The general methodology consists in starting from a statement of the problem to program and then progressively producing an LB model obtained after several refinement steps of the initial LB model. The derivation of the LB model is not described in the current paper and has already been addressed in other works. The transformation of LB models into DistAlgo programs is illustrated through a simple example. The refinement process and the soundness of the transformation allow one to produce correct-by-construction distributed programs.


title: Distilling Programs to Prove Termination

abstract: The problem of determining whether or not any program terminates was shown to be undecidable by Turing, but recent advances in the area have allowed this information to be determined for a large class of programs. The classic method for deciding whether a program terminates dates back to Turing himself and involves finding a ranking function that maps a program state to a well-order, and then proving that the result of this function decreases for every possible program transition. More recent approaches to proving termination have involved moving away from the search for a single ranking function and toward a search for a set of ranking functions; this set is a choice of ranking functions and a disjunctive termination argument is used. In this paper, we describe a new technique for determining whether programs terminate. Our technique is applied to the output of the distillation program transformation that converts programs into a simplified form called distilled form. Programs in distilled form are converted into a corresponding labelled transition system and termination can be demonstrated by showing that all possible infinite traces through this labelled transition system would result in an infinite descent of well-founded data values. We demonstrate our technique on a number of examples, and compare it to previous work.


title: An Experiment Combining Specialization with Abstract Interpretation

abstract: It was previously shown that control-flow refinement can be achieved by a program specializer incorporating property-based abstraction, to improve termination and complexity analysis tools. We now show that this purpose-built specializer can be reconstructed in a more modular way, and that the previous results can be achieved using an off-the-shelf partial evaluation tool, applied to an abstract interpreter. The key feature of the abstract interpreter is the abstract domain, which is the product of the property-based abstract domain with the concrete domain. This language-independent framework provides a practical approach to implementing a variety of powerful specializers, and contributes to a stream of research on using interpreters and specialization to achieve program transformations.


title: A Deeper Look at Salient Object Detection: Bi-stream Network with a Small Training Dataset

abstract: Compared with the conventional hand-crafted approaches, the deep learning based methods have achieved tremendous performance improvements by training exquisitely crafted fancy networks over large-scale training sets. However, do we really need large-scale training set for salient object detection (SOD)? In this paper, we provide a deeper insight into the interrelationship between the SOD performances and the training sets. To alleviate the conventional demands for large-scale training data, we provide a feasible way to construct a novel small-scale training set, which only contains 4K images. Moreover, we propose a novel bi-stream network to take full advantage of our proposed small training set, which is consisted of two feature backbones with different structures, achieving complementary semantical saliency fusion via the proposed gate control unit. To our best knowledge, this is the first attempt to use a small-scale training set to outperform state-of-the-art models which are trained on large-scale training sets; nevertheless, our method can still achieve the leading state-of-the-art performance on five benchmark datasets.


title: Competition Report: CHC-COMP-20

abstract: CHC-COMP-20 is the third competition of solvers for Constrained Horn Clauses. In this year, 9 solvers participated at the competition, and were evaluated in four separate tracks on problems in linear integer arithmetic, linear real arithmetic, and arrays. The competition was run in the first week of May 2020 using the StarExec computing cluster. This report gives an overview of the competition design, explains the organisation of the competition, and presents the competition results.


title: Mean Field Game and Decentralized Intelligent Adaptive Pursuit Evasion Strategy for Massive Multi-Agent System under Uncertain Environment

abstract: In this paper, a novel decentralized intelligent adaptive optimal strategy has been developed to solve the pursuit-evasion game for massive Multi-Agent Systems (MAS) under uncertain environment. Existing strategies for pursuit-evasion games are neither efficient nor practical for large population multi-agent system due to the notorious "Curse of dimensionality" and communication limit while the agent population is large. To overcome these challenges, the emerging mean field game theory is adopted and further integrated with reinforcement learning to develop a novel decentralized intelligent adaptive strategy with a new type of adaptive dynamic programing architecture named the Actor-Critic-Mass (ACM). Through online approximating the solution of the coupled mean field equations, the developed strategy can obtain the optimal pursuit-evasion policy even for massive MAS under uncertain environment. In the proposed ACM learning based strategy, each agent maintains five neural networks, which are 1) the critic neural network to approximate the solution of the HJI equation for each individual agent; 2) the mass neural network to estimate the population density function (i.e., mass) of the group; 3) the actor neural network to approximate the decentralized optimal strategy, and 4) two more neural networks are designed to estimate the opponents' group mass as well as the optimal cost function. Eventually, a comprehensive numerical simulation has been provided to demonstrate the effectiveness of the designed strategy.


title: Exploring entanglement and optimization within the Hamiltonian Variational Ansatz

abstract: Quantum variational algorithms are one of the most promising applications of near-term quantum computers; however, recent studies have demonstrated that unless the variational quantum circuits are configured in a problem-specific manner, optimization of such circuits will most likely fail. In this paper, we focus on a special family of quantum circuits called the Hamiltonian Variational Ansatz (HVA), which takes inspiration from the quantum approximation optimization algorithm and adiabatic quantum computation. Through the study of its entanglement spectrum and energy gradient statistics, we find that HVA exhibits favorable structural properties such as mild or entirely absent barren plateaus and a restricted state space that eases their optimization in comparison to the well-studied "hardware-efficient ansatz." We also numerically observe that the optimization landscape of HVA becomes almost trap free when the ansatz is over-parameterized. We observe a size-dependent "computational phase transition" as the number of layers in the HVA circuit is increased where the optimization crosses over from a hard to an easy region in terms of the quality of the approximations and speed of convergence to a good solution. In contrast with the analogous transitions observed in the learning of random unitaries which occur at a number of layers that grows exponentially with the number of qubits, our Variational Quantum Eigensolver experiments suggest that the threshold to achieve the over-parameterization phenomenon scales at most polynomially in the number of qubits for the transverse field Ising and XXZ models. Lastly, as a demonstration of its entangling power and effectiveness, we show that HVA can find accurate approximations to the ground states of a modified Haldane-Shastry Hamiltonian on a ring, which has long-range interactions and has a power-law entanglement scaling.


title: Exclusive heavy quark dijet cross section

abstract: We study the exclusive heavy quark dijet cross section from $e^+e^-$-annihilation using soft-collinear effective theory. In order to resum the large logarithms of small jet veto parameter $\beta$ and jet radius $R$, we factorize the cross section into the hard, hard-soft, collinear, and collinear-soft parts. Compared with the case of a massless quark, the jet sector with the collinear and collinear-soft parts can be modified to include the heavy quark mass. The factorization of the jet sector can be systematically achieved through matching onto the boosted heavy quark effective theory. Heavy quark mass corrections enhance the cross section sizably and cannot be ignored when the quark mass is comparable with the jet size $E_JR$. We also analyze the exclusive heavy quark pair production in the limit as $R$ goes to zero. Using the resummed result, the top isolation effects on the cross section are estimated.


title: P/2019 LD2 (ATLAS): An Active Centaur in Imminent Transition to the Jupiter Family

abstract: The recently discovered object P/2019 LD2 (ATLAS) was initially thought to be a Jupiter Trojan asteroid, until dynamical studies and the appearance of persistent cometary activity revealed that this object is actually an active Centaur. However, the dynamical history, thermal environment, and impact of such environments on the activity of 2019 LD2 are poorly understood. Here we conduct dynamical simulations to constrain its orbital history and resulting thermal environment over the past 3000 years. We find that 2019 LD2 is currently in the vicinity of a dynamical "Gateway" that facilitates the majority of transitions from the Centaur population into the Jupiter Family of Comets (JFC population; Sarid et al. 2019). Our calculations show that it is unlikely to have spent significant amounts of time in the inner solar system, suggesting that its nucleus is relatively pristine in terms of physical, chemical, and thermal processing through its history. This could explain its relatively high level of distant activity as a recently activated primordial body. Finally, we find that the median frequency of transition from the Gateway population into the JFC population varies from once every ~3 years to less than once every 70 years, if 2019 LD2's nucleus is ~1 km in radius or greater than 3 km in radius. Forward modeling of 2019 LD2 shows that it will transition into the JFC population in 2063, representing the first known opportunity to observe the evolution of an active Centaur nucleus as it experiences this population-defining transition.


title: Evaluating Representation Learning of Code Changes for Predicting Patch Correctness in Program Repair

abstract: A large body of the literature of automated program repair develops approaches where patches are generated to be validated against an oracle (e.g., a test suite). Because such an oracle can be imperfect, the generated patches, although validated by the oracle, may actually be incorrect. While the state of the art explore research directions that require dynamic information or rely on manually-crafted heuristics, we study the benefit of learning code representations to learn deep features that may encode the properties of patch correctness. Our work mainly investigates different representation learning approaches for code changes to derive embeddings that are amenable to similarity computations. We report on findings based on embeddings produced by pre-trained and re-trained neural networks. Experimental results demonstrate the potential of embeddings to empower learning algorithms in reasoning about patch correctness: a machine learning predictor with BERT transformer-based embeddings associated with logistic regression yielded an AUC value of about 0.8 in predicting patch correctness on a deduplicated dataset of 1000 labeled patches. Our study shows that learned representations can lead to reasonable performance when comparing against the state-of-the-art, PATCH-SIM, which relies on dynamic information. These representations may further be complementary to features that were carefully (manually) engineered in the literature.


title: Automata groups generated by Cayley machines of groups of nilpotency class two

abstract: We show presentations of automata groups generated by Cayley machines of finite groups of nilpotency class two and these automata groups are all cross-wired lamplighters.


title: Simulating periodic systems on quantum computer

abstract: The variational quantum eigensolver (VQE) is one of the most appealing quantum algorithms to simulate electronic structure properties of molecules on near-term noisy intermediate-scale quantum devices. In this work, we generalize the VQE algorithm for simulating extended systems. However, the numerical study of an one-dimensional (1D) infinite hydrogen chain using existing VQE algorithms shows a remarkable deviation of the ground state energy with respect to the exact full configuration interaction (FCI) result. Here, we present two schemes to improve the accuracy of quantum simulations for extended systems. The first one is a modified VQE algorithm, which introduces an unitary transformation of Hartree-Fock orbitals to avoid the complex Hamiltonian. The second one is a Post-VQE approach combining VQE with the quantum subspace expansion approach (VQE/QSE). Numerical benchmark calculations demonstrate that both of two schemes provide an accurate enough description of the potential energy curve of the 1D hydrogen chain. In addition, excited states computed with the VQE/QSE approach also agree very well with FCI results.


title: Synchronization of clocks and metronomes:A perturbation analysis based on multiple timescales

abstract: In 1665, Huygens observed that two pendulum clocks hanging from the same board became synchronized in antiphase after hundreds of swings. On the other hand, modern experiments with metronomes placed on a movable platform show that they often tend to synchronize in phase, not antiphase. Here we study both in-phase and antiphase synchronization in a model of pendulum clocks and metronomes and analyze their long-term dynamics with the tools of perturbation theory. Specifically, we exploit the separation of timescales between the fast oscillations of the individual pendulums and the much slower adjustments of their amplitudes and phases. By scaling the equations appropriately and applying the method of multiple timescales, we derive explicit formulas for the regimes in parameter space where either antiphase or in-phase synchronization are stable, or where both are stable. Although this sort of perturbative analysis is standard in other parts of nonlinear science, it has been applied surprisingly rarely in the context of Huygens's clocks. Unusual features of our approach include its treatment of the escapement mechanism, a small-angle approximation up to cubic order, and both a two- and three-timescale asymptotic analysis.


title: Li-rich giant stars under scrutiny: Binarity, magnetic activity and the evolutionary status after Gaia DR2

abstract: We present a study of the evolutionary state of a few lithium-rich giant stars based on the Gaia DR2 parallaxes and photometry. We also investigate the chromospheric activity, the presence of a surface magnetic field, and the radial velocity for our sample stars. We analysed both archive and new data. We gathered archive spectra from several instruments, mainly ELODIE and NARVAL, and we added new data acquired with the spectrograph MUSICOS. We applied the Least-Squares Deconvolution technique to obtain Stokes V and Stokes I mean profiles to compute longitudinal magnetic field for a subset. Moreover, for the same subset, we analysed the Ca II H and K emission lines to calculate the S-index. We also derived atmospheric parameters and Li abundances for all eighteen stars of our sample. We found that stars previously classified as RGB may actually be at a different evolutionary state. Furthermore, we identified that most stars in our sample with detection of surface magnetic field show at least moderate rotation velocities, but nonetheless, we could not detect a magnetic field in two fast rotators. Due to our small sample of magnetic giants, it is difficult to determine if the presence of surface magnetic field and the Li-rich giant phenomena could be somehow linked. The large variation of the radial velocity of part of our sample indicates that some of them might have a binary companion, which may change the way we look at the Li problem in giant stars.


title: Robust photon transmission in nonlinear parity-time-symmetric cavities

abstract: We explore the photon transfer in the nonlinear parity-time-symmetry system of two coupled cavities, which contains nonlinear gain and loss dependent on the intracavity photons. Analytical solution to the steady state gives a saturated gain, which satisfy the parity-time symmetry automatically. The eigen-frequency self-adapts the nonlinear saturated gain to reach the maximum efficiency in the steady state. We find that the saturated gain in the weak coupling regime does not match the loss in the steady state, exhibiting an appearance of a spontaneous symmetry-breaking. The photon transmission efficiency in the parity-time-symmetric regime is robust against the variation of the coupling strength, which improves the results of the conventional methods by tuning the frequency or the coupling strength to maintain optimal efficiency. Our scheme provides an experimental platform for realizing the robust photon transfer in cavities with nonlinear parity-time symmetry.


title: Multi-speaker Text-to-speech Synthesis Using Deep Gaussian Processes

abstract: Multi-speaker speech synthesis is a technique for modeling multiple speakers' voices with a single model. Although many approaches using deep neural networks (DNNs) have been proposed, DNNs are prone to overfitting when the amount of training data is limited. We propose a framework for multi-speaker speech synthesis using deep Gaussian processes (DGPs); a DGP is a deep architecture of Bayesian kernel regressions and thus robust to overfitting. In this framework, speaker information is fed to duration/acoustic models using speaker codes. We also examine the use of deep Gaussian process latent variable models (DGPLVMs). In this approach, the representation of each speaker is learned simultaneously with other model parameters, and therefore the similarity or dissimilarity of speakers is considered efficiently. We experimentally evaluated two situations to investigate the effectiveness of the proposed methods. In one situation, the amount of data from each speaker is balanced (speaker-balanced), and in the other, the data from certain speakers are limited (speaker-imbalanced). Subjective and objective evaluation results showed that both the DGP and DGPLVM synthesize multi-speaker speech more effective than a DNN in the speaker-balanced situation. We also found that the DGPLVM outperforms the DGP significantly in the speaker-imbalanced situation.


title: Fast Identification of Saturated Cut-sets using Graph Search Techniques

abstract: When multiple outages occur in rapid succession, it is important to know quickly if the power transfer capability of different interconnections (or cut-sets) of the power network are limited. The algorithm developed in this paper identifies such limited cut-sets very fast, thereby enhancing the real-time situational awareness of power system operators. The significance of the proposed approach is described using the IEEE 39-bus test system, while its computational benefits are demonstrated using relatively large test-cases containing thousands of buses. The results indicate that the proposed network analysis can estimate the impact of an outage on any cut-set of the system and screen out the cut-set that gets saturated by the largest margin, very quickly.


title: Few Shot Learning Framework to Reduce Inter-observer Variability in Medical Images

abstract: Most computer aided pathology detection systems rely on large volumes of quality annotated data to aid diagnostics and follow up procedures. However, quality assuring large volumes of annotated medical image data can be subjective and expensive. In this work we present a novel standardization framework that implements three few-shot learning (FSL) models that can be iteratively trained by atmost 5 images per 3D stack to generate multiple regional proposals (RPs) per test image. These FSL models include a novel parallel echo state network (ParESN) framework and an augmented U-net model. Additionally, we propose a novel target label selection algorithm (TLSA) that measures relative agreeability between RPs and the manually annotated target labels to detect the "best" quality annotation per image. Using the FSL models, our system achieves 0.28-0.64 Dice coefficient across vendor image stacks for intra-retinal cyst segmentation. Additionally, the TLSA is capable of automatically classifying high quality target labels from their noisy counterparts for 60-97% of the images while ensuring manual supervision on remaining images. Also, the proposed framework with ParESN model minimizes manual annotation checking to 12-28% of the total number of images. The TLSA metrics further provide confidence scores for the automated annotation quality assurance. Thus, the proposed framework is flexible to extensions for quality image annotation curation of other image stacks as well.


title: Neural Complexity Measures

abstract: While various complexity measures for deep neural networks exist, specifying an appropriate measure capable of predicting and explaining generalization in deep networks has proven challenging. We propose Neural Complexity (NC), a meta-learning framework for predicting generalization. Our model learns a scalar complexity measure through interactions with many heterogeneous tasks in a data-driven way. The trained NC model can be added to the standard training loss to regularize any task learner in a standard supervised learning scenario. We contrast NC's approach against existing manually-designed complexity measures and other meta-learning models, and we validate NC's performance on multiple regression and classification tasks


title: Deep Active Learning with Crowdsourcing Data for Privacy Policy Classification

abstract: Privacy policies are statements that notify users of the services' data practices. However, few users are willing to read through policy texts due to the length and complexity. While automated tools based on machine learning exist for privacy policy analysis, to achieve high classification accuracy, classifiers need to be trained on a large labeled dataset. Most existing policy corpora are labeled by skilled human annotators, requiring significant amount of labor hours and effort. In this paper, we leverage active learning and crowdsourcing techniques to develop an automated classification tool named Calpric (Crowdsourcing Active Learning PRIvacy Policy Classifier), which is able to perform annotation equivalent to those done by skilled human annotators with high accuracy while minimizing the labeling cost. Specifically, active learning allows classifiers to proactively select the most informative segments to be labeled. On average, our model is able to achieve the same F1 score using only 62% of the original labeling effort. Calpric's use of active learning also addresses naturally occurring class imbalance in unlabeled privacy policy datasets as there are many more statements stating the collection of private information than stating the absence of collection. By selecting samples from the minority class for labeling, Calpric automatically creates a more balanced training set.


title: Constraining the nuclear symmetry energy and properties of neutron star from GW170817 by Bayesian analysis

abstract: Based on the distribution of tidal deformabilities and component masses of binary neutron star merger GW170817, the parametric equation of states (EOS) are employed to probe the nuclear symmetry energy and the properties of neutron star. To obtain a proper distribution of the parameters of the EOS that is consistent with the observation, Bayesian analysis is used and the constraints of causality and maximum mass are considered. From this analysis, it is found that the symmetry energy at twice the saturation density of nuclear matter can be constrained within $E_{sym}(2{\rho_{0}})$ = $34.5^{+20.5}_{-2.3}$ MeV at 90\% credible level. Moreover, the constraints on the radii and dimensionless tidal deformabilities of canonical neutron stars are also demonstrated through this analysis, and the corresponding constraints are 10.80 km $< R_{1.4} <$ 13.20 km and $133 < \Lambda_{1.4} < 686$ at 90\% credible level, with the most probable value of $\bar{R}_{1.4}$ = 12.60 km and $\bar{\Lambda}_{1.4}$ = 500, respectively. With respect to the prior, our result (posterior result) prefers a softer EOS, corresponding to a lower expected value of symmetry energy, a smaller radius and a smaller tidal deformability.


title: Bootstrapping Neural Processes

abstract: Unlike in the traditional statistical modeling for which a user typically hand-specify a prior, Neural Processes (NPs) implicitly define a broad class of stochastic processes with neural networks. Given a data stream, NP learns a stochastic process that best describes the data. While this "data-driven" way of learning stochastic processes has proven to handle various types of data, NPs still rely on an assumption that uncertainty in stochastic processes is modeled by a single latent variable, which potentially limits the flexibility. To this end, we propose the Boostrapping Neural Process (BNP), a novel extension of the NP family using the bootstrap. The bootstrap is a classical data-driven technique for estimating uncertainty, which allows BNP to learn the stochasticity in NPs without assuming a particular form. We demonstrate the efficacy of BNP on various types of data and its robustness in the presence of model-data mismatch.


title: Dual Convolutional Neural Networks for Breast Mass Segmentation and Diagnosis in Mammography

abstract: Deep convolutional neural networks (CNNs) have emerged as a new paradigm for Mammogram diagnosis. Contemporary CNN-based computer-aided-diagnosis (CAD) for breast cancer directly extract latent features from input mammogram image and ignore the importance of morphological features. In this paper, we introduce a novel deep learning framework for mammogram image processing, which computes mass segmentation and simultaneously predict diagnosis results. Specifically, our method is constructed in a dual-path architecture that solves the mapping in a dual-problem manner, with an additional consideration of important shape and boundary knowledge. One path called the Locality Preserving Learner (LPL), is devoted to hierarchically extracting and exploiting intrinsic features of the input. Whereas the other path, called the Conditional Graph Learner (CGL) focuses on generating geometrical features via modeling pixel-wise image to mask correlations. By integrating the two learners, both the semantics and structure are well preserved and the component learning paths in return complement each other, contributing an improvement to the mass segmentation and cancer classification problem at the same time. We evaluated our method on two most used public mammography datasets, DDSM and INbreast. Experimental results show that DualCoreNet achieves the best mammography segmentation and classification simultaneously, outperforming recent state-of-the-art models.


title: New quasi-universal relations for static and rapid rotating neutron stars

abstract: In the last few decades, lots of universal relations between different global physical quantities of neutron stars have been proposed to constrain the unobservable or hard to be observed properties of neutron stars. But few of them are related to the gravitational redshift or the gravitational binding energy, especially for the fast rotating neutron stars. Here we will focus on the universal relations related to these two quantities. Based on 11 equations of state (EOSs) from the predictions of microscopic nuclear many-body theories for normal or hybrid neutron stars, we proposed a set of new quasi-universal relations under three rotating cases: static, general rotating and Keplerian rotating. These new quasi-universal relations provide a potential way to constrain or estimate the unobservable or hard to be observed properties of neutron stars.


title: Decay Spectroscopy of $^{129}$Cd

abstract: Excited states of $^{129}$In populated following the $\beta$-decay of $^{129}$Cd were experimentally studied with the GRIFFIN spectrometer at the ISAC facility of TRIUMF, Canada. A 480-MeV proton beam was impinged on a uranium carbide target and $^{129}$Cd was extracted using the Ion Guide Laser Ion Source (IG-LIS). $\beta$- and $\gamma$-rays following the decay of $^{129}$Cd were detected with the GRIFFIN spectrometer comprising the plastic scintillator SCEPTAR and 16 high-purity germanium (HPGe) clover-type detectors. %, along with the $\beta$-particles were detected with SCEPTAR. From the $\beta$-$\gamma$-$\gamma$ coincidence analysis, 32 new transitions and 7 new excited states were established, expanding the previously known level scheme of $^{129}$In. The $\log ft$ values deduced from the $\beta$-feeding intensities suggest that some of the high-lying states were populated by the $\nu 0 g_{7/2} \rightarrow \pi 0 g_{9/2}$ allowed Gamow-Teller (GT) transition, which indicates that the allowed GT transition is more dominant in the $^{129}$Cd decay than previously reported. Observation of fragmented Gamow-Teller strengths is consistent with theoretical calculations.


title: A semi-analytic model of pairwise velocity distribution between dark matter halos

abstract: We study the probability distribution function (PDF) of relative velocity between two different dark matter halos (i.e. pairwise velocity) with a set of high-resolution cosmological $N$-body simulations. We investigate the pairwise velocity PDFs over a wide range of halo masses of $10^{12.5-15}\, h^{-1}M_{\odot}$ and redshifts of $0<z<1$. At a given set of masses, redshift and the separation length between two halos, our model requires three parameters to set the pairwise velocity PDF, whereas previous non-Gaussian models in the literature assume four or more free parameters. At the length scales of $r=5-40\, [h^{-1}\, \mathrm{Mpc}]$, our model predicts the mean and dispersion of the pairwise velocity for dark matter halos with their masses of $10^{12.5-13.5} \, [h^{-1}M_{\odot}]$ at $0.3 < z < 1$ with a 5%-level precision, while the model precision reaches a 20% level (mostly a 10% level) for other masses and redshifts explored in the simulations. We demonstrate that our model of the pairwise velocity PDF provides an accurate mapping of the two-point clustering of massive-galaxy-sized halos at the scales of $O(10)\, h^{-1}\mathrm{Mpc}$ between redshift and real space for a given real-space correlation function. For a mass-limited halo sample with their masses greater than $10^{13.5}\, h^{-1}M_{\odot}$ at $z=0.55$, our model can explain the monopole and quadropole moments of the redshift-space two-point correlations with a precision better than 5% at the scales of $5-40$ and $10-30\, h^{-1}\mathrm{Mpc}$, respectively. Our model of the pairwise velocity PDF will give a detailed explanation of statistics of massive galaxies at the intermediate scales in redshift surveys, including the non-linear redshift-space distortion effect in two-point correlation functions and the measurements of the kinematic Sunyaev-Zel'dovich effect.


title: From Connectomic to Task-evoked Fingerprints: Individualized Prediction of Task Contrasts from Resting-state Functional Connectivity

abstract: Resting-state functional MRI (rsfMRI) yields functional connectomes that can serve as cognitive fingerprints of individuals. Connectomic fingerprints have proven useful in many machine learning tasks, such as predicting subject-specific behavioral traits or task-evoked activity. In this work, we propose a surface-based convolutional neural network (BrainSurfCNN) model to predict individual task contrasts from their resting-state fingerprints. We introduce a reconstructive-contrastive loss that enforces subject-specificity of model outputs while minimizing predictive error. The proposed approach significantly improves the accuracy of predicted contrasts over a well-established baseline. Furthermore, BrainSurfCNN's prediction also surpasses test-retest benchmark in a subject identification task.


title: Kernel Embedding based Variational Approach for Low-dimensional Approximation of Dynamical Systems

abstract: Transfer operators such as Perron-Frobenius or Koopman operator play a key role in modeling and analysis of complex dynamical systems, which allow linear representations of nonlinear dynamics by transforming the original state variables to feature spaces. However, it remains challenging to identify the optimal low-dimensional feature mappings from data. The variational approach for Markov processes (VAMP) provides a comprehensive framework for the evaluation and optimization of feature mappings based on the variational estimation of modeling errors, but it still suffers from a flawed assumption on the transfer operator and therefore sometimes fails to capture the essential structure of system dynamics. In this paper, we develop a powerful alternative to VAMP, called kernel embedding based variational approach for dynamical systems (KVAD). By using the distance measure of functions in the kernel embedding space, KVAD effectively overcomes the theoretical and practical limitations of VAMP. In addition, we develop a data-driven KVAD algorithm for seeking the ideal feature mapping within a subspace spanned by given basis functions, and numerical experiments show that the proposed algorithm can significantly improve the modeling accuracy compared to VAMP.


title: Distribution of genus among numerical semigroups with fixed Frobenius number

abstract: A numerical semigroup is a sub-semigroup of the natural numbers that has a finite complement. The size of its complement is called the genus and the largest number in the complement is called its Frobenius number. We consider the set of numerical semigroups with a fixed Frobenius number $f$ and analyse their genus. We find the asymptotic distribution of genus in this set of numerical semigroups and show that it is a product of a Gaussian and a power series. We show that almost all numerical semigroups with Frobenius number $f$ have genus close to $\frac{3f}{4}$. We denote the number of numerical semigroups of Frobenius number $f$ by $N(f)$. While $N(f)$ is not monotonic we prove that $N(f)<N(f+2)$ for every $f$.


title: Which Kind Is Better in Open-domain Multi-turn Dialog,Hierarchical or Non-hierarchical Models? An Empirical Study

abstract: Currently, open-domain generative dialog systems have attracted considerable attention in academia and industry. Despite the success of single-turn dialog generation, multi-turn dialog generation is still a big challenge. So far, there are two kinds of models for open-domain multi-turn dialog generation: hierarchical and non-hierarchical models. Recently, some works have shown that the hierarchical models are better than non-hierarchical models under their experimental settings; meanwhile, some works also demonstrate the opposite conclusion. Due to the lack of adequate comparisons, it's not clear which kind of models are better in open-domain multi-turn dialog generation. Thus, in this paper, we will measure systematically nearly all representative hierarchical and non-hierarchical models over the same experimental settings to check which kind is better. Through extensive experiments, we have the following three important conclusions: (1) Nearly all hierarchical models are worse than non-hierarchical models in open-domain multi-turn dialog generation, except for the HRAN model. Through further analysis, the excellent performance of HRAN mainly depends on its word-level attention mechanism; (2) The performance of other hierarchical models will also obtain a great improvement if integrating the word-level attention mechanism into these models. The modified hierarchical models even significantly outperform the non-hierarchical models; (3) The reason why the word-level attention mechanism is so powerful for hierarchical models is because it can leverage context information more effectively, especially the fine-grained information. Besides, we have implemented all of the models and already released the codes.


title: Improve Generalization and Robustness of Neural Networks via Weight Scale Shifting Invariant Regularizations

abstract: Using weight decay to penalize the L2 norms of weights in neural networks has been a standard training practice to regularize the complexity of networks. In this paper, we show that a family of regularizers, including weight decay, is ineffective at penalizing the intrinsic norms of weights for networks with positively homogeneous activation functions, such as linear, ReLU and max-pooling functions. As a result of homogeneity, functions specified by the networks are invariant to the shifting of weight scales between layers. The ineffective regularizers are sensitive to such shifting and thus poorly regularize the model capacity, leading to overfitting. To address this shortcoming, we propose an improved regularizer that is invariant to weight scale shifting and thus effectively constrains the intrinsic norm of a neural network. The derived regularizer is an upper bound for the input gradient of the network so minimizing the improved regularizer also benefits the adversarial robustness. Residual connections are also considered and we show that our regularizer also forms an upper bound to input gradients of such a residual network. We demonstrate the efficacy of our proposed regularizer on various datasets and neural network architectures at improving generalization and adversarial robustness.


title: A Novel Video Salient Object Detection Method via Semi-supervised Motion Quality Perception

abstract: Previous video salient object detection (VSOD) approaches have mainly focused on designing fancy networks to achieve their performance improvements. However, with the slow-down in development of deep learning techniques recently, it may become more and more difficult to anticipate another breakthrough via fancy networks solely. To this end, this paper proposes a universal learning scheme to get a further 3\% performance improvement for all state-of-the-art (SOTA) methods. The major highlight of our method is that we resort the "motion quality"---a brand new concept, to select a sub-group of video frames from the original testing set to construct a new training set. The selected frames in this new training set should all contain high-quality motions, in which the salient objects will have large probability to be successfully detected by the "target SOTA method"---the one we want to improve. Consequently, we can achieve a significant performance improvement by using this new training set to start a new round of network training. During this new round training, the VSOD results of the target SOTA method will be applied as the pseudo training objectives. Our novel learning scheme is simple yet effective, and its semi-supervised methodology may have large potential to inspire the VSOD community in the future.


title: Fitting ideals in two-variable equivariant Iwasawa theory and an application

abstract: We study equivariant Iwasawa theory for two-variable abelian extensions of an imaginary quadratic field. One of the main goals of this paper is to describe the Fitting ideals of Iwasawa modules using $p$-adic $L$-functions. We also provide an application to Selmer groups of elliptic curves with complex multiplication.


title: Tidal Evolution of the Evection Resonance/Quasi-Resonance and the Angular Momentum of the Earth-Moon System

abstract: Forming the Moon by a high-angular momentum impact may explain the Earth-Moon isotopic similarities, however, the post-impact angular momentum needs to be reduced by a factor of 2 or more to the current value (1 L_EM) after the Moon forms. Capture into the evection resonance, occurring when the lunar perigee precession period equals one year, could remove the angular momentum excess. However the appropriate angular momentum removal appears sensitive to the tidal model and chosen tidal parameters. In this work, we use a constant-time delay tidal model to explore the Moon's orbital evolution through evection. We find that exit from formal evection occurs early and that subsequently, the Moon enters a quasi-resonance regime, in which evection still regulates the lunar eccentricity even though the resonance angle is no longer librating. Although not in resonance proper, during quasi-resonance angular momentum is continuously removed from the Earth-Moon system and transferred to Earth's heliocentric orbit. The final angular momentum, set by the timing of quasi-resonance escape, is a function of the ratio of tidal strength in the Moon and Earth and the absolute rate of tidal dissipation in the Earth. We consider a physically-motivated model for tidal dissipation in the Earth as the mantle cools from a molten to a partially molten state. We find that as the mantle solidifies, increased terrestrial dissipation drives the Moon out of quasi-resonance. For post-impact systems that contain >2 L_EM, final angular momentum values after quasi-resonance escape remain significantly higher than the current Earth-Moon value.


title: Quantum-enhanced stochastic phase estimation with SU(1,1) interferometer

abstract: The quantum stochastic phase estimation has many applications in the precise measurement of various physical parameters. Similar to the estimation of a constant phase, there is a standard quantum limit for stochastic phase estimation, which can be obtained with the Mach-Zehnder interferometer and coherent input state. Recently, it has been shown that the stochastic standard quantum limit can be surpassed with non-classical resources such as the squeezed light. However, practical methods to achieve the quantum enhancement in the stochastic phase estimation remains largely unexplored. Here we propose a method utilizing the SU(1,1) interferometer and coherent input states to estimate a stochastic optical phase. As an example, we investigate the Ornstein-Uhlenback stochastic phase. We analyze the performance of this method for three key estimation problems: prediction, tracking and smoothing. The results show significant reduction of the mean square error compared with the Mach-Zehnder interferometer under the same photon number flux inside the interferometers. In particular, we show that the method with the SU(1,1) interferometer can achieve the fundamental quantum scaling, the stochastic Heisenberg scaling, and surpass the precision of the canonical measurement.


title: Constraints on primordial non-Gaussianity using multitracer technique for skew spectrum

abstract: Extracting the bispectrum information from the large scale structure observations is challenging due to the complex models and the computational costs to measure the signal and its covariance. Recently, the skew spectrum was proposed to access parts of the bispectrum information with a more effective way and has been confirmed it can provide complementary information to that enclosed in the power spectrum measurements. In this work, we generalize the theory to apply the multitracer technique and explore its ability to constrain the local type primordial non-Gaussianity. Using the spectra and their covariance estimated from $N$-body simulations, we find the multitracer approach is effective to reduce the cosmic variance noise. The $1\sigma$ marginalized errors for $b_1^2A_s, n_s$ and $f_{\rm NL}^{\rm loc}$ are reduced by 50\%, 52\% and 73\% comparing with the results using only power spectrum obtained from a single tracer. It indicate that both the skew spectrum and the multitracer technique are useful to constrain the primordial non-Gaussianity with the forthcoming wide-field galaxy surveys.


title: Large deviation principle for the three dimensional planetary geostrophic equations of large-scale ocean circulation with small multiplicative noise

abstract: We demonstrate the large deviation principle in the small noise limit for the three dimensional stochastic planetary geostrophic equations of large-scale ocean circulation. In this paper, we first prove the well-posedness of weak solutions to this system by the method of monotonicity. As we know, a recently developed method, weak convergent method, has been employed in studying the large deviations and this method is essentially based on the main result of \cite{ba2} which discloses the variational representation of exponential integrals with respect to the Brownian noise. The It\^{o} inequality and Burkholder-Davis-Gundy inequality are the main tools in our proofs, and the weak convergence method introduced by Budhiraja, Dupuis and Ganguly in \cite{ba3} is also used to establish the large deviation principle.


title: Viscous Properties of a Degenerate One-Dimensional Fermi Gas

abstract: We study the viscous properties of a system of weakly interacting spin-$\frac{1}{2}$ fermions in one dimension. Accounting for the effect of interactions on the quasiparticle energy spectrum, we obtain the bulk viscosity of this system at low temperatures. Our result is valid for frequencies that are small compared with the rate of fermion backscattering. For frequencies larger than this exponentially small rate, the excitations of the system become decoupled from the center of mass motion, and the fluid is described by two-fluid hydrodynamics. We calculate the three transport coefficients required to describe viscous dissipation in this regime.


title: Exploring Rich and Efficient Spatial Temporal Interactions for Real Time Video Salient Object Detection

abstract: The current main stream methods formulate their video saliency mainly from two independent venues, i.e., the spatial and temporal branches. As a complementary component, the main task for the temporal branch is to intermittently focus the spatial branch on those regions with salient movements. In this way, even though the overall video saliency quality is heavily dependent on its spatial branch, however, the performance of the temporal branch still matter. Thus, the key factor to improve the overall video saliency is how to further boost the performance of these branches efficiently. In this paper, we propose a novel spatiotemporal network to achieve such improvement in a full interactive fashion. We integrate a lightweight temporal model into the spatial branch to coarsely locate those spatially salient regions which are correlated with trustworthy salient movements. Meanwhile, the spatial branch itself is able to recurrently refine the temporal model in a multi-scale manner. In this way, both the spatial and temporal branches are able to interact with each other, achieving the mutual performance improvement. Our method is easy to implement yet effective, achieving high quality video saliency detection in real-time speed with 50 FPS.


title: MiNet: Mixed Interest Network for Cross-Domain Click-Through Rate Prediction

abstract: Click-through rate (CTR) prediction is a critical task in online advertising systems. Existing works mainly address the single-domain CTR prediction problem and model aspects such as feature interaction, user behavior history and contextual information. Nevertheless, ads are usually displayed with natural content, which offers an opportunity for cross-domain CTR prediction. In this paper, we address this problem and leverage auxiliary data from a source domain to improve the CTR prediction performance of a target domain. Our study is based on UC Toutiao (a news feed service integrated with the UC Browser App, serving hundreds of millions of users daily), where the source domain is the news and the target domain is the ad. In order to effectively leverage news data for predicting CTRs of ads, we propose the Mixed Interest Network (MiNet) which jointly models three types of user interest: 1) long-term interest across domains, 2) short-term interest from the source domain and 3) short-term interest in the target domain. MiNet contains two levels of attentions, where the item-level attention can adaptively distill useful information from clicked news / ads and the interest-level attention can adaptively fuse different interest representations. Offline experiments show that MiNet outperforms several state-of-the-art methods for CTR prediction. We have deployed MiNet in UC Toutiao and the A/B test results show that the online CTR is also improved substantially. MiNet now serves the main ad traffic in UC Toutiao.


title: Domination number of middle graphs

abstract: In this paper, we study the domination number of middle graphs. Indeed, we obtain tight bounds for this number in terms of the order of the graph. We also compute the domination number of some families of graphs such as star graphs, double start graphs, path graphs, cycle graphs, wheel graphs, complete graphs, complete bipartite graphs and friendship graphs, explicitly. Moreover, some Nordhaus-Gaddum-like relations are presented for the domination number of middle graphs.


title: Data Weighted Training Strategies for Grammatical Error Correction

abstract: Recent progress in the task of Grammatical Error Correction (GEC) has been driven by addressing data sparsity, both through new methods for generating large and noisy pretraining data and through the publication of small and higher-quality finetuning data in the BEA-2019 shared task. Building upon recent work in Neural Machine Translation (NMT), we make use of both kinds of data by deriving example-level scores on our large pretraining data based on a smaller, higher-quality dataset. In this work, we perform an empirical study to discover how to best incorporate delta-log-perplexity, a type of example scoring, into a training schedule for GEC. In doing so, we perform experiments that shed light on the function and applicability of delta-log-perplexity. Models trained on scored data achieve state-of-the-art results on common GEC test sets.


title: A Channel Model of Transceivers for Multiterminal Secret Key Agreement

abstract: Information theoretic secret key agreement is impossible without making initial assumptions. One type of initial assumption is correlated random variables that are generated by using a noisy channel that connects the terminals. Terminals use the correlated random variables and communication over a reliable public channel to arrive at a shared secret key. Previous channel models assume that each terminal either controls one input to the channel, or receives one output variable of the channel. In this paper, we propose a new channel model of transceivers where each terminal simultaneously controls an input variable and observes an output variable of the (noisy) channel. We give upper and lower bounds for the secret key capacity (i.e., highest achievable key rate) of this transceiver model, and prove the secret key capacity under the conditions that the public communication is noninteractive and input variables of the noisy channel are independent.


title: On the invertibility in periodic ARFIMA models

abstract: The present paper, characterizes the invertibility and causality conditions of a periodic ARFIMA (PARFIMA) models. We first, discuss the conditions in the multivariate case, by considering the corresponding p-variate stationary ARFIMA models. Second, we construct the conditions using the univariate case and we deduce a new infinite autoregressive representation for the PARFIMA model, the results are investigated through a simulation study.


title: Role-Based Deception in Enterprise Networks

abstract: Historically, enterprise network reconnaissance is an active process, often involving port scanning. However, as routers and switches become more complex, they also become more susceptible to compromise. From this vantage point, an attacker can passively identify high-value hosts such as the workstations of IT administrators, C-suite executives, and finance personnel. The goal of this paper is to develop a technique to deceive and dissuade such adversaries. We propose HoneyRoles, which uses honey connections to build metaphorical haystacks around the network traffic of client hosts belonging to high-value organizational roles. The honey connections also act as network canaries to signal network compromise, thereby dissuading the adversary from acting on information observed in network flows. We design a prototype implementation of HoneyRoles using an OpenFlow SDN controller and evaluate its security using the PRISM probabilistic model checker. Our performance evaluation shows that HoneyRoles has a small effect on network request completion time and our security analysis demonstrates that once an alert is raised, HoneyRoles can quickly identify the compromised switch with high probability. In doing so, we show that a role-based network deception is a promising approach for defending against adversaries that have compromised network devices.


title: Textual Description for Mathematical Equations

abstract: Reading of mathematical expression or equation in the document images is very challenging due to the large variability of mathematical symbols and expressions. In this paper, we pose reading of mathematical equation as a task of generation of the textual description which interprets the internal meaning of this equation. Inspired by the natural image captioning problem in computer vision, we present a mathematical equation description (MED) model, a novel end-to-end trainable deep neural network based approach that learns to generate a textual description for reading mathematical equation images. Our MED model consists of a convolution neural network as an encoder that extracts features of input mathematical equation images and a recurrent neural network with attention mechanism which generates description related to the input mathematical equation images. Due to the unavailability of mathematical equation image data sets with their textual descriptions, we generate two data sets for experimental purpose. To validate the effectiveness of our MED model, we conduct a real-world experiment to see whether the students are able to write equations by only reading or listening their textual descriptions or not. Experiments conclude that the students are able to write most of the equations correctly by reading their textual descriptions only.


title: Structure-driven intercalated architecture of septuple-atomic-layer $MA_2Z_4$ family with diverse properties from semiconductor to topological insulator to Ising superconductor

abstract: Motivated by the fact that septuple-atomic-layer MnBi$_2$Te$_4$ can be structurally viewed as the combination of double-atomic-layer MnTe intercalating into quintuple-atomic-layer Bi$_2$Te$_3$, we present a general approach of constructing twelve septuple-atomic-layer $\alpha_i$- and $\beta_i$-$MA_2Z_4$ monolayer family (\emph{i} = 1 to 6) by intercalating MoS$_2$-type $MZ$$_2$ monolayer into InSe-type A$_2$Z$_2$ monolayer. Besides reproducing the experimentally synthesized $\alpha_1$-MoSi$_2$N$_4$, $\alpha_1$-WSi$_2$N$_4$ and $\beta_5$-MnBi$_2$Te$_4$ monolayer materials, another 66 thermodynamically and dynamically stable $MA_2Z_4$ were predicted, which span a wide range of properties upon the number of valence electrons (VEC). $MA_2Z_4$ with the rules of 32 or 34 VEC are mostly semiconductors with direct or indirect band gap and, however, with 33 VEC are generally metal, half-metal ferromagnetism, or spin-gapless semiconductor upon whether or not an unpaired electron is spin polarized. Moreover, we propose $\alpha_2$-WSi$_2$P$_4$ for the spin-valley polarization, $\alpha_1$-TaSi$_2$N$_4$ for Ising superconductor and $\beta_2$-SrGa$_2$Se$_4$ for topological insulator.


title: From formal to actual Puiseux series solutions of algebraic differential equations of first order

abstract: The existence, uniqueness and convergence of formal Puiseux series solutions of non-autonomous algebraic differential equations of first order at a nonsingular point of the equation is studied, including the case where the celebrated Painleve theorem cannot be applied explicitly for the study of convergence. Several examples illustrating relationships to the Painleve theorem and lesser-known Petrovic's results are provided.


title: A theoretical estimate of the pole-equator temperature difference and a possible origin of the near-surface shear layer

abstract: Convective motions in the deep layers of the solar convection zone are affected by rotation, making the convective heat transport latitude-dependent, but this is not the case in the top layers near the surface. We use the thermal wind balance condition in the deeper layers to estimate the pole-equator temperature difference. Surface observations of this temperature difference can be used for estimating the depth of the near-surface layer within which convection is not affected by rotation. If we require that the thermal wind balance holds in this layer also, then we have to conclude that this must be a layer of strong differential rotation and its characteristics which we derive are in broad agreement with the observational data of the near-surface shear layer.


title: NuI-Go: Recursive Non-Local Encoder-Decoder Network for Retinal Image Non-Uniform Illumination Removal

abstract: Retinal images have been widely used by clinicians for early diagnosis of ocular diseases. However, the quality of retinal images is often clinically unsatisfactory due to eye lesions and imperfect imaging process. One of the most challenging quality degradation issues in retinal images is non-uniform which hinders the pathological information and further impairs the diagnosis of ophthalmologists and computer-aided analysis.To address this issue, we propose a non-uniform illumination removal network for retinal image, called NuI-Go, which consists of three Recursive Non-local Encoder-Decoder Residual Blocks (NEDRBs) for enhancing the degraded retinal images in a progressive manner. Each NEDRB contains a feature encoder module that captures the hierarchical feature representations, a non-local context module that models the context information, and a feature decoder module that recovers the details and spatial dimension. Additionally, the symmetric skip-connections between the encoder module and the decoder module provide long-range information compensation and reuse. Extensive experiments demonstrate that the proposed method can effectively remove the non-uniform illumination on retinal images while well preserving the image details and color. We further demonstrate the advantages of the proposed method for improving the accuracy of retinal vessel segmentation.