title: Fast Approximation of the Gauss-Newton Hessian Matrix for the Multilayer Perceptron

abstract: We introduce a fast algorithm for entry-wise evaluation of the Gauss-Newton Hessian (GNH) matrix for the fully-connected feed-forward neural network. The algorithm has a precomputation step and a sampling step. While it generally requires $O(Nn)$ work to compute an entry (and the entire column) in the GNH matrix for a neural network with $N$ parameters and $n$ data points, our fast sampling algorithm reduces the cost to $O(n+d/\epsilon^2)$ work, where $d$ is the output dimension of the network and $\epsilon$ is a prescribed accuracy (independent of $N$). One application of our algorithm is constructing the hierarchical-matrix (H-matrix) approximation of the GNH matrix for solving linear systems and eigenvalue problems. It generally requires $O(N^2)$ memory and $O(N^3)$ work to store and factorize the GNH matrix, respectively. The H-matrix approximation requires only $O(N r_o)$ memory footprint and $O(N r_o^2)$ work to be factorized, where $r_o \ll N$ is the maximum rank of off-diagonal blocks in the GNH matrix. We demonstrate the performance of our fast algorithm and the H-matrix approximation on classification and autoencoder neural networks.


title: Unraveling the Effect of Spatial Resolution and Scan Acceleration on 3D Image-Based Navigators for Respiratory Motion Tracking in Coronary MR Angiography

abstract: Purpose: To study the accuracy of motion information extracted from beat-to-beat 3D image-based navigators (3D iNAVs) collected using a variable-density cones trajectory with different combinations of spatial resolutions and scan acceleration factors. Methods: Fully sampled, breath-held 4.4 mm 3D iNAV datasets for six respiratory phases are acquired in a volunteer. Ground truth translational and nonrigid motion information is derived from these datasets. Subsequently, the motion estimates from synthesized undersampled 3D iNAVs with isotropic spatial resolutions of 4.4 mm (acceleration factor = 10.9), 5.4 mm (acceleration factor = 7.2), 6.4 mm (acceleration factor = 4.2), and 7.8 mm (acceleration factor = 2.9) are assessed against the ground truth information. The undersampled 3D iNAV configuration with the highest accuracy motion estimates in simulation is then compared with the originally proposed 4.4 mm undersampled 3D iNAV in six volunteer studies. Results: The simulations indicate that for navigators beyond certain scan acceleration factors, the accuracy of motion estimates is compromised due to errors from residual aliasing and blurring/smoothening effects following compressed sensing reconstruction. The 6.4 mm 3D iNAV achieves an acceptable spatial resolution with a small acceleration factor, resulting in the highest accuracy motion information among all assessed undersampled 3D iNAVs. Reader scores for six volunteer studies demonstrate superior coronary vessel sharpness when applying an autofocusing nonrigid correction technique using the 6.4 mm 3D iNAVs in place of 4.4 mm 3D iNAVs. Conclusion: Undersampled 6.4 mm 3D iNAVs enable motion tracking with improved accuracy relative to previously proposed undersampled 4.4 mm 3D iNAVs.


title: A Jacobi spectral method for computing eigenvalue gaps and their distribution statistics of the fractional Schr\"{o}dinger operator

abstract: We propose a spectral method by using the Jacobi functions for computing eigenvalue gaps and their distribution statistics of the fractional Schr\"{o}dinger operator (FSO). In the problem, in order to get reliable gaps distribution statistics, we have to calculate accurately and efficiently a very large number of eigenvalues, e.g. up to thousands or even millions eigenvalues, of an eigenvalue problem related to the FSO. The proposed Jacobi spectral method is extremely suitable and demanded for the discretization of an eigenvalue problem when a large number of eigenvalues need to be calculated. Then the Jacobi spectral method is applied to study numerically the asymptotics of the nearest neighbour gaps, average gaps, minimum gaps, normalized gaps and their distribution statistics in 1D. Based on our numerical results, several interesting numerical observations (or conjectures) about eigenvalue gaps and their distribution statistics of the FSO in 1D are formulated. Finally, the Jacobi spectral method is extended to the directional fractional Schr\"{o}dinger operator in high dimensions and extensive numerical results about eigenvalue gaps and their distribution statistics are reported.


title: A Mixed-Integer SDP Solution Approach to Distributionally Robust Unit Commitment with Second Order Moment Constraints

abstract: A power system unit commitment (UC) problem considering uncertainties of renewable energy sources is investigated in this paper, through a distributionally robust optimization approach. We assume that the first and second order moments of stochastic parameters can be inferred from historical data, and then employed to model the set of probability distributions. The resulting problem is a two-stage distributionally robust unit commitment with second order moment constraints, and we show that it can be recast as a mixed-integer semidefinite programming (MI-SDP) with finite constraints. The solution algorithm of the problem comprises solving a series of relaxed MI-SDPs and a subroutine of feasibility checking and vertex generation. Based on the verification of strong duality of the semidefinite programming (SDP) problems, we propose a cutting plane algorithm for solving the MI-SDPs; we also introduce a SDP relaxation for the feasibility checking problem, which is an intractable biconvex optimization. Experimental results on a IEEE 6-bus system are presented, showing that without any tunings of parameters, the real-time operation cost of distributionally robust UC method outperforms those of deterministic UC and two-stage robust UC methods in general, and our method also enjoys higher reliability of dispatch operation.


title: The first observed stellar occultations by the irregular satellite (Saturn IX) Phoebe and improved rotational period

abstract: We report six stellar occultations by (Saturn IX) Phoebe, an irregular satellite of Saturn, obtained between mid-2017 and mid-2019. The 2017 July 06 event is the first stellar occultation by an irregular satellite ever observed. The occultation chords were compared to a 3D shape model of the satellite obtained from Cassini observations. The rotation period available in the literature led to a sub-observer point at the moment of the observed occultations where the chords could not fit the 3D model. A procedure was developed to identify the correct sub-observer longitude. It allowed us to obtain the rotation period with improved precision over currently known value from literature. We show that the difference between the observed and the predicted sub-observer longitude suggests two possible solutions for the rotation period. By comparing these values with recently observed rotational light curves and single-chord stellar occultations, we can identify the best solution for Phoebe's rotational period as $9.27365 \pm 0.00002$ h. From the stellar occultations, we also obtained 6 geocentric astrometric positions in the ICRS as realised by the Gaia-DR2 with uncertainties at the 1-mas level.


title: Revisiting weak measurement in light of thermodynamics

abstract: We investigate a weak measurement described by a von Neumann type interaction $\hat{A}\otimes \hat{p}^2$, where $\hat{A}$ is a system observable and $\hat{p}^2$ is a measurement pointer observable. We consider the weak measurement in terms of thermodynamics by adopting a mixed Gaussian state as a quantum state of the measurement pointer. We show that Maxwell's demon appears as a measure who carries out post-selections. It is found that, even if the demon only knows the weak value, a difference in the von Neumann entropy between the initial and final system can be the QC mutual information contents, which is the maximum amount of obtainable information by a measurement. Besides, our study indicates that a temperature of the system described by this interaction is amplified by weak value amplification. In addition, we show that this demon can be realized in an atomic system.


title: Mechanoradicals in tensed tendon collagen as a new source of oxidative stress

abstract: As established nearly a century ago, mechanoradicals originate from homolytic bond scission in polymers. The existence, nature and biological relevance of mechanoradicals in proteins, instead, are unknown. We here show that mechanical stress on collagen produces radicals and subsequently reactive oxygen species, essential biological signaling molecules. Electron-paramagnetic resonance (EPR) spectroscopy of stretched rat tail tendon, atomistic Molecular Dynamics simulations and quantum calculations show that the radicals form by bond scission in the direct vicinity of crosslinks in collagen. Radicals migrate to adjacent clusters of aromatic residues and stabilize on oxidized tyrosyl radicals, giving rise to a distinct EPR spectrum consistent with a stable dihydroxyphenylalanine (DOPA) radical. The protein mechanoradicals, as a yet undiscovered source of oxidative stress, finally convert into hydrogen peroxide. Our study suggests collagen I to have evolved as a radical sponge against mechano-oxidative damage and proposes a new mechanism for exercise-induced oxidative stress and redox-mediated pathophysiological processes.


title: Federated Uncertainty-Aware Learning for Distributed Hospital EHR Data

abstract: Recent works have shown that applying Machine Learning to Electronic Health Records (EHR) can strongly accelerate precision medicine. This requires developing models based on diverse EHR sources. Federated Learning (FL) has enabled predictive modeling using distributed training which lifted the need of sharing data and compromising privacy. Since models are distributed in FL, it is attractive to devise ensembles of Deep Neural Networks that also assess model uncertainty. We propose a new FL model called Federated Uncertainty-Aware Learning Algorithm (FUALA) that improves on Federated Averaging (FedAvg) in the context of EHR. FUALA embeds uncertainty information in two ways: It reduces the contribution of models with high uncertainty in the aggregated model. It also introduces model ensembling at prediction time by keeping the last layers of each hospital from the final round. In FUALA, the Federator (central node) sends at each round the average model to all hospitals as well as a randomly assigned hospital model update to estimate its generalization on that hospital own data. Each hospital sends back its model update as well a generalization estimation of the assigned model. At prediction time, the model outputs C predictions for each sample where C is the number of hospital models. The experimental analysis conducted on a cohort of 87K deliveries for the task of preterm-birth prediction showed that the proposed approach outperforms FedAvg when evaluated on out-of-distribution data. We illustrated how uncertainty could be measured using the proposed approach.


title: Geometry and topology of manifolds with integral radial curvature bounds

abstract: In this paper, we systematically investigate the geometry and topology of manifolds with integral radial curvature bounds, and obtain many interesting and important conclusions.


title: Immersive Insights: A Hybrid Analytics System for Collaborative Exploratory Data Analysis

abstract: In the past few years, augmented reality (AR) and virtual reality (VR) technologies have experienced terrific improvements in both accessibility and hardware capabilities, encouraging the application of these devices across various domains. While researchers have demonstrated the possible advantages of AR and VR for certain data science tasks, it is still unclear how these technologies would perform in the context of exploratory data analysis (EDA) at large. In particular, we believe it is important to better understand which level of immersion EDA would concretely benefit from, and to quantify the contribution of AR and VR with respect to standard analysis workflows. In this work, we leverage a Dataspace reconfigurable hybrid reality environment to study how data scientists might perform EDA in a co-located, collaborative context. Specifically, we propose the design and implementation of Immersive Insights, a hybrid analytics system combining high-resolution displays, table projections, and augmented reality (AR) visualizations of the data. We conducted a two-part user study with twelve data scientists, in which we evaluated how different levels of data immersion affect the EDA process and compared the performance of Immersive Insights with a state-of-the-art, non-immersive data analysis system.


title: A geometric interpretation of stochastic gradient descent using diffusion metrics

abstract: Stochastic gradient descent (SGD) is a key ingredient in the training of deep neural networks and yet its geometrical significance appears elusive. We study a deterministic model in which the trajectories of our dynamical systems are described via geodesics of a family of metrics arising from the diffusion matrix. These metrics encode information about the highly non-isotropic gradient noise in SGD. We establish a parallel with General Relativity models, where the role of the electromagnetic field is played by the gradient of the loss function. We compute an example of a two layer network.


title: Stokes Polytopes and Intersection Theory

abstract: Intersection numbers of Stokes polytopes living in complex projective space are computed using the techniques employed to find the inverse string KLT matrix elements in terms of intersection numbers of associahedra. To do this requires an appropriate convex realization of Stokes polytopes in $\mathbb{CP}^{n}$ loaded with suitable generalizations of the Koba-Nielsen factor. The procedure is carried out explicitly for the lower point cases and the prescription for the generic higher point cases is laid out as well. The intersection numbers are identified as scattering amplitudes corresponding to a theory the coupling constants of which are determined entirely in terms of the combinatorial weights of the Stokes polytopes. A parameter $\alpha'$ having units of length is used to define the intersection numbers in a manner that yields the amplitudes of $\phi^4$ theory to leading order when the limit of vanishing $\alpha'$ limit is taken. Most importantly, we contrast this method of understanding quartic vertices with previous string-theoretic attempts to obtain quartic interaction amplitudes and highlight the advantages offered.


title: Word-level Textual Adversarial Attacking as Combinatorial Optimization

abstract: Adversarial attacks are carried out to reveal the vulnerability of deep neural networks. Textual adversarial attacking is challenging because text is discrete and a small perturbation can bring significant change to the original input. Word-level attacking, which can be regarded as a combinatorial optimization problem, is a well-studied class of textual attack methods. However, existing word-level attack models are far from perfect, largely because unsuitable search space reduction methods and inefficient optimization algorithms are employed. In this paper, we propose a novel attack model, which incorporates the sememe-based word substitution method and particle swarm optimization-based search algorithm to solve the two problems separately. We conduct exhaustive experiments to evaluate our attack model by attacking BiLSTM and BERT on three benchmark datasets. Experimental results demonstrate that our model consistently achieves much higher attack success rates and crafts more high-quality adversarial examples as compared to baseline methods. Also, further experiments show our model has higher transferability and can bring more robustness enhancement to victim models by adversarial training. All the code and data of this paper can be obtained on https://github.com/thunlp/SememePSO-Attack.


title: Look-up and Adapt: A One-shot Semantic Parser

abstract: Computing devices have recently become capable of interacting with their end users via natural language. However, they can only operate within a limited "supported" domain of discourse and fail drastically when faced with an out-of-domain utterance, mainly due to the limitations of their semantic parser. In this paper, we propose a semantic parser that generalizes to out-of-domain examples by learning a general strategy for parsing an unseen utterance through adapting the logical forms of seen utterances, instead of learning to generate a logical form from scratch. Our parser maintains a memory consisting of a representative subset of the seen utterances paired with their logical forms. Given an unseen utterance, our parser works by looking up a similar utterance from the memory and adapting its logical form until it fits the unseen utterance. Moreover, we present a data generation strategy for constructing utterance-logical form pairs from different domains. Our results show an improvement of up to 68.8% on one-shot parsing under two different evaluation settings compared to the baselines.


title: Effectuses in Categorical Quantum Foundations

abstract: This thesis develops the theory of effectuses as a categorical axiomatic approach to quantum theory. It provides a comprehensive introduction to effectus theory and reveals its connections with various other topics and approaches.


title: High-Resolution, Respiratory-Resolved Coronary MRA Using a Phyllotaxis-Reordered Variable-Density 3D Cones Trajectory

abstract: Purpose: To develop a respiratory-resolved motion-compensation method for free-breathing, high-resolution coronary magnetic resonance angiography using a 3D cones trajectory. Methods: To achieve respiratory-resolved 0.98 mm resolution images in a clinically relevant scan time, we undersample the imaging data with a variable-density 3D cones trajectory. For retrospective motion compensation, translational estimates from 3D image-based navigators (3D iNAVs) are used to bin the imaging data into four phases from end-expiration to end-inspiration. To ensure pseudo-random undersampling within each respiratory phase, we devise a phyllotaxis readout ordering scheme mindful of eddy current artifacts in steady state free precession imaging. Following binning, residual 3D translational motion within each phase is computed using the 3D iNAVs and corrected for in the imaging data. The noise-like aliasing characteristic of the combined phyllotaxis and cones sampling pattern is leveraged in a compressed sensing reconstruction with spatial and temporal regularization to reduce aliasing in each of the respiratory phases. Results: In a volunteer and 5 patients, respiratory motion compensation using the proposed method yields improved image quality compared to non-respiratory-resolved approaches with no motion correction and with 3D translational correction. Qualitative assessment by two cardiologists indicates the superior sharpness of coronary segments reconstructed with the proposed method (P < 0.01). Conclusion: The proposed method better mitigates motion artifacts in free-breathing, high-resolution coronary angiography exams compared to translational correction.


title: Annual Interruption Rate as a KPI, its measurement and comparison

abstract: This article is divided into two chapters. The first chapter describes the failure rate as a KPI and studies its properties. The second one goes over ways to compare this KPI across two groups using the concepts of statistical hypothesis testing. In section 1., we will motivate the failure rate as a KPI (in Azure, it is dubbed `Annual Interruption Rate' or AIR. In section 3, we will discuss measuring failure rate from logs machines typically generate. In section 1.2, we will discuss the problem of measuring it from real-world data. In section 2.1, we will discuss the general concepts of hypothesis testing. In section 2.2, we will go over some general count distributions for modeling Azure reboots. In section 2.3, we will go over some experiments on applying various hypothesis tests to simulated data. In section 2.4, we will discuss some applications of this work like using these statistical methods to catch regressions in failure rate and how long we need to let changes to the system `bake' before we are reasonably sure they didn't regress failure rate.


title: Towards Extracting Highlights From Recorded Live Videos: An Implicit Crowdsourcing Approach

abstract: Live streaming platforms need to store a lot of recorded live videos on a daily basis. An important problem is how to automatically extract highlights (i.e., attractive short video clips) from these massive, long recorded live videos. One approach is to directly apply a highlight extraction algorithm to video content. However, algorithmic approaches are either domain-specific, which require experts to spend a long time to design, or resource-intensive, which require a lot of training data and/or computing resources. In this paper, we propose Lightor, a novel implicit crowdsourcing approach to overcome these limitations. The key insight is to collect users' natural interactions with a live streaming platform, and then leverage them to detect highlights. Lightor consists of two major components. Highlight Initializer collects time-stamped chat messages from a live video and then uses them to predict approximate highlight positions. Highlight Extractor keeps track of how users interact with these approximate highlight positions and then refines these positions iteratively. We find that the collected user chat and interaction data are very noisy, and propose effective techniques to deal with noise. Lightor can be easily deployed into existing live streaming platforms, or be implemented as a web browser extension. We recruit hundreds of users from Amazon Mechanical Turk, and evaluate the performance of Lightor using two popular games in Twitch. The results show that Lightor can achieve high extraction precision with a small set of training data and low computing resources.


title: CONNA: Addressing Name Disambiguation on The Fly

abstract: Name disambiguation is a key and also a very tough problem in many online systems such as social search and academic search. Despite considerable research, a critical issue that has not been systematically studied is disambiguation on the fly -- to complete the disambiguation in the real-time. This is very challenging, as the disambiguation algorithm must be accurate, efficient, and error tolerance. In this paper, we propose a novel framework -- CONNA -- to train a matching component and a decision component jointly via reinforcement learning. The matching component is responsible for finding the top matched candidate for the given paper, and the decision component is responsible for deciding on assigning the top matched person or creating a new person. The two components are intertwined and can be bootstrapped via jointly training. Empirically, we evaluate CONNA on two name disambiguation datasets. Experimental results show that the proposed framework can achieve a 1.21%-19.84% improvement on F1-score using joint training of the matching and the decision components. The proposed CONNA has been successfully deployed on AMiner -- a large online academic search system.


title: Do Sentence Interactions Matter? Leveraging Sentence Level Representations for Fake News Classification

abstract: The rising growth of fake news and misleading information through online media outlets demands an automatic method for detecting such news articles. Of the few limited works which differentiate between trusted vs other types of news article (satire, propaganda, hoax), none of them model sentence interactions within a document. We observe an interesting pattern in the way sentences interact with each other across different kind of news articles. To capture this kind of information for long news articles, we propose a graph neural network-based model which does away with the need of feature engineering for fine grained fake news classification. Through experiments, we show that our proposed method beats strong neural baselines and achieves state-of-the-art accuracy on existing datasets. Moreover, we establish the generalizability of our model by evaluating its performance in out-of-domain scenarios. Code is available at https://github.com/MysteryVaibhav/fake_news_semantics


title: Spectral Algorithm for Low-rank Multitask Regression

abstract: Multitask learning, i.e. taking advantage of the relatedness of individual tasks in order to improve performance on all of them, is a core challenge in the field of machine learning. We focus on matrix regression tasks where the rank of the weight matrix is constrained to reduce sample complexity. We introduce the common mechanism regression (CMR) model which assumes a shared left low-rank component across all tasks, but allows an individual per-task right low-rank component. This dramatically reduces the number of samples needed for accurate estimation. The problem of jointly recovering the common and the local components has a non-convex bi-linear structure. We overcome this hurdle and provide a provably beneficial non-iterative spectral algorithm. Appealingly, the solution has favorable behavior as a function of the number of related tasks and the small number of samples available for each one. We demonstrate the efficacy of our approach for the challenging task of remote river discharge estimation across multiple river sites, where data for each task is naturally scarce. In this scenario sharing a low-rank component between the tasks translates to a shared spectral reflection of the water, which is a true underlying physical model. We also show the benefit of the approach on the markedly different setting of image classification where the common component can be interpreted as the shared convolution filters.


title: Chemistry on rotating grain surfaces: ro-thermal hopping and segregation of molecules in ice mantles

abstract: Grain surfaces play a central role in the formation and desorption of molecules in space. To form molecules on a grain surface, adsorbed species trapped in binding sites must be mobile and migrate to adjacent sites. Thermal hopping is a popular mechanism for the migration of adsorbed species when the grain surface is warmed up by stellar radiation. However, previous studies disregarded the fact that grains can be spun-up to suprathermal rotation by radiative torques (RATs) during grain heating process. To achieve an accurate model of surface astrochemistry, in this paper, we study the effect of grain suprathermal rotation by RATs on thermal hopping of adsorbed species on icy grain mantles. We find that centrifugal force due to grain suprathermal rotation can increase the mobility of radicals on/in the ice mantle compared to the prediction by thermal hopping, and we term this mechanism ro-thermal hopping. The rate of ro-thermal hopping depends both on the local radiation energy density (i.e., grain temperature) and gas density, whereas thermal hopping only depends on grain temperature. We calculate the decrease in grain temperature required by ro-thermal hopping to produce the same hopping rate as thermal hopping and find that it increases with increasing the diffusion energy and decreasing the gas density. We finally study the effect of grain suprathermal rotation on the segregation of ice mixtures and find that ro-thermal segregation of CO$_2$ from H$_2$O-CO$_2$ ices can occur at much lower temperatures than thermal segregation reported by experiments. Our results indicate that grain suprathermal rotation can enhance mobility, formation, desorption, and segregation of molecules in icy grain mantles.


title: Segmenting Ships in Satellite Imagery With Squeeze and Excitation U-Net

abstract: The ship-detection task in satellite imagery presents significant obstacles to even the most state of the art segmentation models due to lack of labelled dataset or approaches which are not able to generalize to unseen images. The most common methods for semantic segmentation involve complex two-stage networks or networks which make use of a multi-scale scene parsing module. In this paper, we propose a modified version of the popular U-Net architecture called Squeeze and Excitation U-Net and train it with a loss that helps in directly optimizing the intersection over union (IoU) score. Our method gives comparable performance to other methods while having the additional benefit of being computationally efficient.


title: An Active Approach for Model Interpretation

abstract: Model interpretation, or explanation of a machine learning classifier, aims to extract generalizable knowledge from a trained classifier into a human-understandable format, for various purposes such as model assessment, debugging and trust. From a computaional viewpoint, it is formulated as approximating the target classifier using a simpler interpretable model, such as rule models like a decision set/list/tree. Often, this approximation is handled as standard supervised learning and the only difference is that the labels are provided by the target classifier instead of ground truth. This paradigm is particularly popular because there exists a variety of well-studied supervised algorithms for learning an interpretable classifier. However, we argue that this paradigm is suboptimal for it does not utilize the unique property of the model interpretation problem, that is, the ability to generate synthetic instances and query the target classifier for their labels. We call this the active-query property, suggesting that we should consider model interpretation from an active learning perspective. Following this insight, we argue that the active-query property should be employed when designing a model interpretation algorithm, and that the generation of synthetic instances should be integrated seamlessly with the algorithm that learns the model interpretation. In this paper, we demonstrate that by doing so, it is possible to achieve more faithful interpretation with simpler model complexity. As a technical contribution, we present an active algorithm Active Decision Set Induction (ADS) to learn a decision set, a set of if-else rules, for model interpretation. ADS performs a local search over the space of all decision sets. In every iteration, ADS computes confidence intervals for the value of the objective function of all local actions and utilizes active-query to determine the best one.


title: On the asymptotic distribution of model averaging based on information criterion

abstract: Smoothed AIC (S-AIC) and Smoothed BIC (S-BIC) are very widely used in model averaging and are very easily to implement. Especially, the optimal model averaging method MMA and JMA have only been well developed in linear models. Only by modifying, they can be applied to other models. But S-AIC and S-BIC can be used in all situations where AIC and BIC can be calculated. In this paper, we study the asymptotic behavior of two commonly used model averaging estimators, the S-AIC and S-BIC estimators, under the standard asymptotic with general fixed parameter setup. In addition, the resulting coverage probability in Buckland et al. (1997) is not studied accurately, but it is claimed that it will be close to the intended. Our derivation make it possible to study accurately. Besides, we also prove that the confidence interval construction method in Hjort and Claeskens (2003) still works in linear regression with normal distribution error. Both the simulation and applied example support our theory conclusion.


title: Jackknife Model Averaging for Composite Quantile Regression

abstract: Model averaging considers the model uncertainty and is an alternative to model selection. In this paper, we propose a frequentist model averaging estimator for composite quantile regressions. In recent years, research on these topics has been added as a separate method, but no study has investigated them in combination. We apply a delete-one cross-validation method to estimate the model weights, and prove that the jackknife model averaging estimator is asymptotically optimal in terms of minimizing out-of-sample composite final prediction error. Simulations are conducted to demonstrate the good finite sample properties of our estimator and compare it with commonly used model selection and averaging methods. The proposed method is applied to the analysis of the stock returns data and the wage data and performs well.


title: An outlier-robust model averaging approach by Mallows-type criterion

abstract: Model averaging is an alternative to model selection for dealing with model uncertainty, which is widely used and very valuable. However, most of the existing model averaging methods are proposed based on the least squares loss function, which could be very sensitive to the presence of outliers in the data. In this paper, we propose an outlier-robust model averaging approach by Mallows-type criterion. The key idea is to develop weight choice criteria by minimising an estimator of the expected prediction error for the function being convex with an unique minimum, and twice differentiable in expectation, rather than the expected squared error. The robust loss functions, such as least absolute deviation and Huber's function, reduce the effects of large residuals and poor samples. Simulation study and real data analysis are conducted to demonstrate the finite-sample performance of our estimators and compare them with other model selection and averaging methods.


title: High-intensity focused ultrasound therapy in the uterine fibroid: a clinical case study of poor heating efficacy

abstract: A clinical case study of high-intensity focused ultrasound (HIFU) treatment in the uterine fibroid was conducted. During the therapy, poor heating efficacy was observed which could be attributed to several factors such as the local perfusion rate, patient-specific anatomy or changes in acoustic parameters of the ultrasound field. In order to determine the cause of the diminished heating, perfusion analyses and ultrasound simulations were conducted using the magnetic resonance imaging (MRI) data from the treatment. The perfusion analysis showed high local perfusion rate in the myoma (301.0 +- 25.6 mL/100 g/min) compared to the surrounding myometrium (233.8 +- 16.2 mL/100 g/min). The ultrasound simulations did not show large differences in the focal point shape or the acoustic pressure (2.07 +- 0.06 MPa) when tilting the transducer. However, a small shift (-2.2 +- 1.3 mm) in the axial location of the focal point was observed. The main causes for the diminished heating were likely the high local perfusion and ultrasound attenuation due to the deep location of the myoma.


title: Neural Network Augmented Physics Models for Systems with Partially Unknown Dynamics: Application to Slider-Crank Mechanism

abstract: Dynamic models of mechatronic systems are abundantly used in the context of motion control and design of complex servo applications. In practice, these systems are often plagued by unknown interactions, which make the physics-based relations of the system dynamics only partially known. This paper presents a neural network augmented physics (NNAP) model as a combination of physics-inspired and neural layers. The neural layers are inserted in the model to compensate for the unmodeled interactions, without requiring direct measurements of these unknown phenomena. In contrast to traditional approaches, both the neural network and physical parameters are simultaneously optimized, solely by using state and control input measurements. The methodology is applied on experimental data of a slider-crank setup for which the state dependent load interactions are unknown. The NNAP model proves to be a stable and accurate modeling formalism for dynamic systems that ab initio can only be partially described by physical laws. Moreover, the results show that a recurrent implementation of the NNAP model enables improved robustness and accuracy of the system state predictions, compared to its feedforward counterpart. Besides capturing the system dynamics, the NNAP model provides a means to gain new insights by extracting the neural network from the converged NNAP model. In this way, we discovered accurate representations of the unknown spring force interaction and friction phenomena acting on the slider mechanism.


title: Effects of four-wave-mixing in high-power Raman fiber amplifiers

abstract: In this work, we derive and present the coupled amplitude equations to describe the evolutions of different spectral components in different transverse modes for Raman fiber amplifiers (RFAs). Both the effects of the four-wave-mixing in the fundamental mode (FM FWM) and the inter-modal four-wave-mixing (IM FWM) on high-power RFAs are demonstrated through numerical simulations. Specifically, effective FM FWM interactions could occur and lead to a drop of the Raman threshold for RFAs by over 50%, despite that the corresponding wave-vector mismatch is rather big. In addition, the IM FWM could also impact the Raman threshold for RFAs with additional generation of the first order Raman Stokes light in the higher-order mode. We also investigate the effects of the intensity fluctuations in the initial inserted pump and seed lasers on high-power RFAs. It reveals that the temporal stability of the initial inserted pump laser have much more significant impacts on high-power RFAs than that of the initial inserted seed laser. Notably, through applying temporal stable laser as the initial inserted pump laser, both the FM FWM and IM FWM effects could be effectively suppressed, and the Raman threshold for high-power RFAs could be increased by over twice.


title: Global Track Reconstruction and Data Compression Strategy in ALICE for LHC Run 3

abstract: In LHC Run 3, ALICE will increase the data taking rate significantly, from an approximately 1 kHz trigger readout in minimum-bias Pb--Pb collisions to a 50 kHz continuous readout rate. The reconstruction strategy of the online-offline computing upgrade foresees a synchronous online reconstruction stage during data taking, which generates the detector calibration, and a posterior calibrated asynchronous reconstruction stage. The huge amount of data requires a significant compression in order to store all recorded events. The aim is a factor 20 compression of the TPC data, which is one of the main challenges during synchronous reconstruction. In addition, the reconstruction will run online, processing 50 times more collisions than at present, yielding results comparable to current offline reconstruction. These requirements pose new challenges for the tracking, including the continuous TPC readout, more overlapping collisions, no a priori knowledge of the primary vertex position and of location-dependent calibration during the synchronous phase, identification of low-momentum looping tracks, and a distorted refit to improve track model entropy coding. At the 2018 workshop, the TPC tracking for Run 3 was presented, which matches the physics performance of the Run 2 offline tracking. It leverages the potential of hardware accelerators via the OpenCL and CUDA APIs in a shared source code for CPUs and GPUs for both reconstruction stages. Porting more reconstruction steps like the remainder of the TPC reconstruction and tracking for other detectors to GPU will shift the computing balance from traditional processors towards GPUs. These proceedings focus on the global tracking strategy, including the ITS and TRD detectors, offloading more reconstruction steps onto GPU, and the approaches taken to achieve the necessary data compression.


title: Kilowatt-level Yb-Raman fiber amplifier with narrow-linewidth and near-diffraction-limited beam quality

abstract: By focusing on a typical emitting wavelength of 1120 nm as an example, we present the first demonstration of a high-efficiency, narrow-linewidth kilowatt-level all-fiber amplifier based on hybrid ytterbium-Raman (Yb-Raman) gains. Notably, two temporally stable, phase-modulated single-frequency lasers operating at 1064 nm and 1120nm, respectively, were applied in the fiber amplifier, to alleviate the spectral broadening of the 1120 signal laser and suppress the stimulated Brillouin scattering (SBS) effect simultaneously. Over 1 kW narrow-linewidth 1120 nm signal laser was obtained with a slope efficiency of ~ 77% and a beam quality of M2~1.21. The amplified spontaneous emission (ASE) noise in the fiber amplifier was effectively suppressed by incorporating an ASE-filtering system between the seed laser and the main amplifier. Further examination of the influence of power ratios between the two seed lasers on the conversion efficiency had proved that the presented amplifier could work efficiently when the power ratio of 1120 nm seed laser ranged from 31% to 61%. Overall, this setup could provide a well reference for obtaining high power narrow-linewidth fiber lasers operating within 1100-1200 nm.


title: Unveiling the temporal dynamics in multi-longitudinal mode ytterbium-doped fiber lasers

abstract: In this work, we propose a unified spatio-temporal model to study the temporal dynamics in continuously pumped ytterbium-doped fiber lasers (YDFLs). Different from previously reported theories, this model is capable of obtaining the temporal evolution of an YDFL from relaxation oscillation region to relative stable region in different time scales ranging from sub-nanosecond to millisecond. It reveals that there exists dual time scale characteristics in the temporal evolution of a multi-longitudinal mode YDFL. Specifically, the temporal evolution would experience sharp change during one cavity round-trip while keep relatively stable between adjacent cavity round-trips. Representative cases are simulated to study the influences of structure parameters on the temporal dynamics and the longitudinal mode characteristics in YDFLs. Three types of temporal instabilities, i.e. sustained self-pulsing, self-mode locking, and turbulence-like pulsing, coexist in a multi-longitudinal mode YDFL. The simulation results clarify that the three temporal instabilities are all the reflectors of intrinsic characteristics of longitudinal modes superposition in multi-longitudinal mode YDFLs. In addition, the strength of the irregular sustained self-pulsing is the major issue which impacts the macroscopic temporal fluctuations in YDFLs.


title: Spatially Coupled LDPC Codes with Sub-Block Locality

abstract: A new type of spatially coupled low-density parity-check (SC-LDPC) codes motivated by practical storage applications is presented. SC-LDPCL codes (suffix 'L' stands for locality) can be decoded locally at the level of sub-blocks that are much smaller than the full code block, thus offering flexible access to the coded information alongside the strong reliability of the global full-block decoding. Toward that, we propose constructions of SC-LDPCL codes that allow controlling the trade-off between local and global correction performance. In addition to local and global decoding, the paper develops a density-evolution analysis for a decoding mode we call semi-global decoding, in which the decoder has access to the requested sub-block plus a prescribed number of sub-blocks around it. SC-LDPCL codes are also studied under a channel model with variability across sub-blocks, for which decoding-performance lower bounds are derived.


title: A Novel Method to Construct NSSD Molecular Graphs

abstract: A graph is said to be NSSD (= non-singular with a singular deck) if it has no eigenvalue equal to zero, whereas all its vertex-deleted subgraphs have eigenvalues equal to zero. NSSD graphs are of importance in the theory of conductance of organic compounds. In this paper, a novel method is described for constructing NSSD molecular graphs from the commuting graphs of the $H_v$-group. An algorithm is presented to construct the NSSD graphs from these commuting graphs.


title: The Dirichlet-to-Neumann operator associated with the $1$-Laplace operator and evolution problems

abstract: We present first results on the Dirichlet-to-Neumann operator associated with the $1$-Laplace operator in $L^1$. In particular, we show that this operator can be realized as a sub-differential operator in $L^1\times L^{\infty}$ of a homogeneous convex, continuous functional with effective domain $L^1$. Even though the Dirichlet problem associated with the $1$-Laplace operator loses the property that weak solutions for boundary data in $L^1$ are unique, we prove a type of stability/compactness result with respect to the boundary data in $L^1$ of this problem. We apply our results for the stationary Dirichlet problem to evolution problems governed by the Dirichlet-to-Neumann operator, which can equivalently be formulated as singular coupled elliptic-parabolic initial boundary-value problems. For initial data in $L^q$, $1\le q\le \infty$, we obtain well-posedness, that every mild solution is, indeed, a strong solution, and establish long-time stability of the semigroup generated by the negative Dirichlet-to-Neumann operator associated with the $1$-Laplace operator.


title: Universal minimal flows of homeomorphism groups of high-dimensional manifolds are not metrizable

abstract: Answering a question of Uspenskij, we prove that if $X$ is a closed manifold of dimension $2$ or higher or the Hilbert cube, then the universal minimal flow of $\mathrm{Homeo}(X)$ is not metrizable. In dimension $3$ or higher, we also show that the minimal $\mathrm{Homeo}(X)$-flow consisting of all maximal, connected chains in $X$ has meager orbits.


title: Hight temperature generation of entangled light in parametrically excited micro and nano-ring ressonators for integrated optics

abstract: We propose a physical scheme to generate entangled light at high temperatures through the excitation of vacuum fluctuations of the electromagnetic field using periodic modulations of a refractive index of a ring resonator. We consider the processes of dissipation and decoherence resulting from the coupling of the system with an environment at finite temperature and show that the total amount of entanglement generated does not depend on the temperature, which only affects the time necessary for the system to produce such an amount of entanglement.


title: f-SAEM: A fast Stochastic Approximation of the EM algorithm for nonlinear mixed effects models

abstract: The ability to generate samples of the random effects from their conditional distributions is fundamental for inference in mixed effects models. Random walk Metropolis is widely used to perform such sampling, but this method is known to converge slowly for medium dimensional problems, or when the joint structure of the distributions to sample is spatially heterogeneous. The main contribution consists of an independent Metropolis-Hastings (MH) algorithm based on a multidimensional Gaussian proposal that takes into account the joint conditional distribution of the random effects and does not require any tuning. Indeed, this distribution is automatically obtained thanks to a Laplace approximation of the incomplete data model. Such approximation is shown to be equivalent to linearizing the structural model in the case of continuous data. Numerical experiments based on simulated and real data illustrate the performance of the proposed methods. For fitting nonlinear mixed effects models, the suggested MH algorithm is efficiently combined with a stochastic approximation version of the EM algorithm for maximum likelihood estimation of the global parameters.


title: Human Keypoint Detection by Progressive Context Refinement

abstract: Human keypoint detection from a single image is very challenging due to occlusion, blur, illumination and scale variance of person instances. In this paper, we find that context information plays an important role in addressing these issues, and propose a novel method named progressive context refinement (PCR) for human keypoint detection. First, we devise a simple but effective context-aware module (CAM) that can efficiently integrate spatial and channel context information to aid feature learning for locating hard keypoints. Then, we construct the PCR model by stacking several CAMs sequentially with shortcuts and employ multi-task learning to progressively refine the context information and predictions. Besides, to maximize PCR's potential for the aforementioned hard case inference, we propose a hard-negative person detection mining strategy together with a joint-training strategy by exploiting the unlabeled coco dataset and external dataset. Extensive experiments on the COCO keypoint detection benchmark demonstrate the superiority of PCR over representative state-of-the-art (SOTA) methods. Our single model achieves comparable performance with the winner of the 2018 COCO Keypoint Detection Challenge. The final ensemble model sets a new SOTA on this benchmark.


title: Noether currents of locally equivalent symmetries

abstract: Local symmetry transformations play an important role for establishing the existence and form of a conserved (Noether) current in systems with a global continuous symmetry. We explain how this fact leads to the existence of linear relations between Noether currents of distinct global symmetries that coincide on the local level, thus generalizing the well-known relationship $\vec L=\vec r\times\vec p$ between momentum $\vec p$ and angular momentum $\vec L$. As a byproduct, we find a natural interpretation for the discrepancy between the canonical and metric energy-momentum tensors in theories of particles with spin. A symmetric energy-momentum tensor can thus be obtained from the Noether procedure without adding any ad hoc corrections or imposing additional constraints such as gauge invariance in Maxwell's electrodynamics.


title: On Lie Bialgebroid Crossed Modules

abstract: We study Lie bialgebroid crossed modules which are pairs of Lie algebroid crossed modules in duality that canonically give rise to Lie bialgebroids. A one-one correspondence between such Lie bialgebroid crossed modules and co-quadratic Manin triples $(K,P,Q)$ is established, where $K$ is a co-quadratic Lie algebroid and $(P,Q)$ is a pair of transverse Dirac structures in $K$.


title: Invariant metric under deformed Markov embeddings with overlapped supports

abstract: Due to \v{C}encov's theorem, there exists a unique family of invariant symmetric $(0,2)$-tensor fields on the space of positive probability measures on a set of $n$-points indexed by $n\in \mathbb{N}$ under Markov embeddings. We deform Markov embeddings keeping sufficiency, and prove existence and uniqueness of invariant families under the embeddings.


title: EdgeFool: An Adversarial Image Enhancement Filter

abstract: Adversarial examples are intentionally perturbed images that mislead classifiers. These images can, however, be easily detected using denoising algorithms, when high-frequency spatial perturbations are used, or can be noticed by humans, when perturbations are large. In this paper, we propose EdgeFool, an adversarial image enhancement filter that learns structure-aware adversarial perturbations. EdgeFool generates adversarial images with perturbations that enhance image details via training a fully convolutional neural network end-to-end with a multi-task loss function. This loss function accounts for both image detail enhancement and class misleading objectives. We evaluate EdgeFool on three classifiers (ResNet-50, ResNet-18 and AlexNet) using two datasets (ImageNet and Private-Places365) and compare it with six adversarial methods (DeepFool, SparseFool, Carlini-Wagner, SemanticAdv, Non-targeted and Private Fast Gradient Sign Methods). Code is available at https://github.com/smartcameras/EdgeFool.git.


title: Ring-theoretic approaches to point-set topology

abstract: In this paper, it is shown that a topological space $X$ is compact iff every maximal ideal of the power set ring $\mathcal{P}(X)$ converges to exactly one point of $X$. Then as an application, simple and ring-theoretic proofs are provided for the Tychonoff theorem and Alexander subbase theorem. As another result in this spirit, a ring-theoretic proof is given to the fact that a topological space is a profinite space iff it is compact and totally disconnected.


title: Problems related to isoparametric theory

abstract: In this note we briefly survey and propose some open problems related to isoparametric theory.


title: Multiple Embedded Eigenstates in Nonlocal Plasmonic Nanostructures

abstract: Trapping light in open cavities is a long sought "holy grail" of nanophotonics. Plasmonic materials may offer a unique opportunity in this context, as they may fully suppress the radiation loss and enable the observation of spatially localized light states with infinite lifetime in an open system. Here, we investigate how the spatial dispersion effects, e.g., caused by the electron-electron interactions in a metal, affect the trapped eigenstates. Heuristically, one may expect that the repulsive-type electron-electron interactions should act against light localization, and thereby that they should have a negative impact on the formation of the embedded eigenstates. Surprisingly, here we find that the nonlocality of the material response creates new degrees of freedom and relaxes the requirements for the observation of trapped light. In particular, a zero-permittivity condition is no longer mandatory and the same resonator shell can potentially suppress the radiation loss at multiple frequencies.


title: Anomalous dimensions of quark masses in the three-loop approximation

abstract: The results of calculation of the three-loop radiative correction to the renormalization constant of fermion masses for non-abelian gauge theory interacting with fermions are presented. Dimensional regularization and the 't Hooft minimal subtraction scheme are used. The method of calculation is described in detail. The renormalization group function $\gamma_m$ determining the behavior of the effective mass of fermions is presented. The anomalous dimensions of fermions for QED and QCD up to three loops are given. All calculations were performed on a computer with the help of the SCHOOONSCHIP system for analytical manipulations. The present text was published in 1982 as a JINR Communication, JINR-P2-82-900 (in russian).


title: Neural Network Distiller: A Python Package For DNN Compression Research

abstract: This paper presents the philosophy, design and feature-set of Neural Network Distiller, an open-source Python package for DNN compression research. Distiller is a library of DNN compression algorithms implementations, with tools, tutorials and sample applications for various learning tasks. Its target users are both engineers and researchers, and the rich content is complemented by a design-for-extensibility to facilitate new research. Distiller is open-source and is available on Github at https://github.com/NervanaSystems/distiller.


title: Cheeger-like inequalities for the largest eigenvalue of the graph Laplace Operator

abstract: We define a new Cheeger-like constant for graphs and we use it for proving Cheeger-like inequalities that bound the largest eigenvalue of the normalized Laplace operator.


title: Covariant Bethe-Salpeter approximation in strongly correlated electron systems model

abstract: Strongly correlated electron systems are generally described by tight binding lattice Hamiltonians with strong local (on site) interactions, the most popular being the Hubbard model. Although the half filled Hubbard model can be simulated by Monte Carlo(MC), physically more interesting cases beyond half filling are plagued by the sign problem. One therefore should resort to other methods. It was demonstrated recently that a systematic truncation of the set of Dyson-Schwinger equations for correlators of the Hubbard, supplemented by a \textquotedblleft covariant" calculation of correlators leads to a convergent series of approximants. The covariance preserves all the Ward identities among correlators describing various condensed matter probes. While first order (classical), second (Hartree-Fock or gaussian) and third (Cubic) covariant approximation were worked out, the fourth (quartic) seems too complicated to be effectively calculable in fermionic systems. It turns out that the complexity of the quartic calculation\ in local interaction models,is manageable computationally. The quartic (Bethe - Salpeter type) approximation is especially important in 1D and 2D models in which the symmetry broken state does not exists (the Mermin - Wagner theorem), although strong fluctuations dominate the physics at strong coupling. Unlike the lower order approximations, it respects the Mermin - Wagner theorem. The scheme is tested and exemplified on the single band 1D and 2D Hubbard model.


title: Fostering Peer Learning through a New Game-Theoretical Approach in a Blended Learning Environment

abstract: Obtaining knowledge and skill achievement through peer learning can lead to higher academic achievement. However, peer learning implementation is not just about putting students together and hoping for the best. At its worst-designed, peer learning may result in one person doing all the effort for instance, or may fail to encourage the students to interact enough with the task and so enhance the task in hand. This study proposes a mechanism as well as an instructional design to foster well-organized peer learning based on game theory $(PD\_PL)$. The proposed mechanism uses prisoner's dilemma and maps the strategy and payoff concepts found in prisoner's dilemma onto a peer learning atmosphere. PD\_PL was implemented during several sessions of four university courses and with 142 computer engineering students. %The results of the pre-test and post-test exams of all the sessions were compared with R software through Paired Hotelling's T-Square analysis in order to investigate the impacts of $PD\_PL$ and the proposed instructional design on students' personal learning. The study results indicated that PD\_PL was beneficial and favourable to the students. Further analysis showed that the $PD\_PL$ had sometimes even enhanced learning by up to $47.2\%$. %The results of a subjective evaluation showed that the majority of respondents found $PD\_PL$ to be an attractive and efficient tool for learning enhancement. %Everybody who is interested in designing peer learning programs and tools will find this study interesting.


title: The supermoduli of SUSY curves with Ramond punctures

abstract: We construct local and global moduli spaces of supersymmetric curves with Ramond-Ramond punctures. We assume that the underlying ordinary algebraic curves have a level n structure and build these supermoduli spaces as algebraic superspaces, i.e., quotients of \'etale equivalence relations between superschemes.


title: Relative Entropy Method for the relaxation limit of Hydrodynamic models

abstract: We show how to obtain general nonlinear aggregation-diffusion models, including Keller-Segel type models with nonlinear diffusions, as relaxations from nonlocal compressible Euler-type hydrodynamic systems via the relative entropy method. We discuss the assumptions on the confinement and interaction potentials depending on the relative energy of the free energy functional allowing for this relaxation limit to hold. We deal with weak solutions for the nonlocal compressible Euler-type systems and strong solutions for the limiting aggregation-diffusion equations. Finally, we show the existence of weak solutions to the nonlocal compressible Euler-type systems satisfying the needed properties for completeness sake.


title: A Density-Based Basis-Set Incompleteness Correction for GW Methods

abstract: Similar to other electron correlation methods, many-body perturbation theory methods based on Green functions, such as the so-called $GW$ approximation, suffer from the usual slow convergence of energetic properties with respect to the size of the one-electron basis set. This displeasing feature is due to lack of explicit electron-electron terms modeling the infamous Kato electron-electron cusp and the correlation Coulomb hole around it. Here, we propose a computationally efficient density-based basis set correction based on short-range correlation density functionals which significantly speeds up the convergence of energetics towards the complete basis set limit. The performance of this density-based correction is illustrated by computing the ionization potentials of the twenty smallest atoms and molecules of the GW100 test set at the perturbative $GW$ (or $G_0W_0$) level using increasingly large basis sets. We also compute the ionization potentials of the five canonical nucleobases (adenine, cytosine, thymine, guanine, and uracil) and show that, here again, a significant improvement is obtained.


title: Pulsar Timing Array Constraints on Primordial Black Holes with NANOGrav 11-Year Data Set

abstract: The detection of binary black hole coalescences by LIGO/Virgo has aroused the interest in primordial black holes (PBHs), because they could be both the progenitors of these black holes and a compelling candidate of dark matter (DM). PBHs are formed soon after the enhanced scalar perturbations re-enter horizon during radiation dominated era, which would inevitably induce gravitational waves as well. Searching for such scalar induced gravitational waves (SIGWs) provides an elegant way to probe PBHs. We perform the first direct search for the signals of SIGWs accompanying the formation of PBHs in North American Nanohertz Observatory for Gravitational waves (NANOGrav) 11-year data set. No statistically significant detection has been made, and hence we place a stringent upper limit on the abundance of PBHs at $95\%$ confidence level. In particular, less than one part in a million of the total DM mass could come from PBHs in the mass range of $[2 \times 10^{-3}, 7\times 10^{-1}] \Msun$.


title: PRNet: Self-Supervised Learning for Partial-to-Partial Registration

abstract: We present a simple, flexible, and general framework titled Partial Registration Network (PRNet), for partial-to-partial point cloud registration. Inspired by recently-proposed learning-based methods for registration, we use deep networks to tackle non-convexity of the alignment and partial correspondence problems. While previous learning-based methods assume the entire shape is visible, PRNet is suitable for partial-to-partial registration, outperforming PointNetLK, DCP, and non-learning methods on synthetic data. PRNet is self-supervised, jointly learning an appropriate geometric representation, a keypoint detector that finds points in common between partial views, and keypoint-to-keypoint correspondences. We show PRNet predicts keypoints and correspondences consistently across views and objects. Furthermore, the learned representation is transferable to classification.


title: Pre-train and Learn: Preserve Global Information for Graph Neural Networks

abstract: Graph neural networks (GNNs) have shown great power in learning on attributed graphs. However, it is still a challenge for GNNs to utilize information faraway from the source node. Moreover, general GNNs require graph attributes as input, so they cannot be appled to plain graphs. In the paper, we propose new models named G-GNNs (Global information for GNNs) to address the above limitations. First, the global structure and attribute features for each node are obtained via unsupervised pre-training, which preserve the global information associated to the node. Then, using the global features and the raw network attributes, we propose a parallel framework of GNNs to learn different aspects from these features. The proposed learning methods can be applied to both plain graphs and attributed graphs. Extensive experiments have shown that G-GNNs can outperform other state-of-the-art models on three standard evaluation graphs. Specially, our methods establish new benchmark records on Cora (84.31\%) and Pubmed (80.95\%) when learning on attributed graphs.


title: New quaternary codes derived from posets of the disjoint union of two chains

abstract: Based on the generic construction of linear codes, we construct linear codes over the ring $\Bbb Z_4$ via posets of the disjoint union of two chains. We determine the Lee weight distributions of the quaternary codes. Moreover, we obtain some new linear quaternary codes and good binary codes by using the Gray map.


title: Solving Optimization Problems through Fully Convolutional Networks: an Application to the Travelling Salesman Problem

abstract: In the new wave of artificial intelligence, deep learning is impacting various industries. As a closely related area, optimization algorithms greatly contribute to the development of deep learning. But the reverse applications are still insufficient. Is there any efficient way to solve certain optimization problem through deep learning? The key is to convert the optimization to a representation suitable for deep learning. In this paper, a traveling salesman problem (TSP) is studied. Considering that deep learning is good at image processing, an image representation method is proposed to transfer a TSP to an image. Based on samples of a 10 city TSP, a fully convolutional network (FCN) is used to learn the mapping from a feasible region to an optimal solution. The training process is analyzed and interpreted through stages. A visualization method is presented to show how a FCN can understand the training task of a TSP. Once the training is completed, no significant effort is required to solve a new TSP and the prediction is obtained on the scale of milliseconds. The results show good performance in finding the global optimal solution. Moreover, the developed FCN model has been demonstrated on TSP's with different city numbers, proving excellent generalization performance.


title: Investigating MMM Ponzi scheme on Bitcoin

abstract: Cybercriminals exploit cryptocurrencies to carry out illicit activities. In this paper, we focus on Ponzi schemes that operate on Bitcoin and perform an in-depth analysis of MMM, one of the oldest and most popular Ponzi schemes. Based on 423K transactions involving 16K addresses, we show that: (1) Starting Sep 2014, the scheme goes through three phases over three years. At its peak, MMM circulated more than 150M dollars a day, after which it collapsed by the end of Jun 2016. (2) There is a high income inequality between MMM members, with the daily Gini index reaching more than 0.9. The scheme also exhibits a zero-sum investment model, in which one member's loss is another member's gain. The percentage of victims who never made any profit has grown from 0% to 41% in five months, during which the top-earning scammer has made 765K dollars in profit. (3) The scheme has a global reach with 80 different member countries but a highly-asymmetrical flow of money between them. While India and Indonesia have the largest pairwise flow in MMM, members in Indonesia have received 12x more money than they have sent to their counterparts in India.


title: Synthesis of La0.5Ca0.5-x xMnO3 nanocrystalline manganites by sucrose assisted auto combustion route and study of their structural, magnetic and magnetocaloric properties

abstract: Perovskite manganite La0.5Ca0.5-x xMnO3 (LCMO) nanomaterials were elaborated using the sucrose modified auto combustion method. Rietveld refinements of the X-ray diffraction patterns of the crystalline structure confirm a single-phase orthorhombic state with Pbnm space group (No. 62). The Ca-vacancies were voluntarily created in the LCMO structure in order to study their influence on the magnetic behaviour in the system. The magnetic susceptibility was found to be highly enhanced in the sample with Ca-vacancies. Paramagnetic-to-ferromagnetic phase transition was evidenced in both samples around 254 K. This transition is, characterized by a drastic jump of the susceptibility in the sample with Ca-vacancies. The maximum of entropy change, observed for both compounds at magnetic field of 6T was 2.30 J kg-1K-1 and 2.70 J kg-1K-1 for the parent compound and the lacunar one respectively. The magnetocaloric adiabatic temperature change value calculated by indirect method was 5.6 K and 5.2 K for the non-lacunar and Ca-vacancy compound, respectively. The Ca-lacunar La0.5Ca0.5-x xMnO3 (x=0.05) reported in this work demonstrated overall enhancement of the magnetocaloric effect over the LCMO. The technique used to elaborate LCMO materials was beneficial to enhance the magnetocaloric effect and magnetic behaviour. Therefore, we conclude that this less costly environmentally friendly system can be considered as more advantageous candidate for magnetic refrigeration applications then the commonly Gd-based compounds.


title: Prediction stability as a criterion in active learning

abstract: Recent breakthroughs made by deep learning rely heavily on large number of annotated samples. To overcome this shortcoming, active learning is a possible solution. Beside the previous active learning algorithms that only adopted information after training, we propose a new class of method based on the information during training, named sequential-based method. An specific criterion of active learning called prediction stability is proposed to prove the feasibility of sequential-based methods. Experiments are made on CIFAR-10 and CIFAR-100, and the results indicates that prediction stability is effective and works well on fewer-labeled datasets. Prediction stability reaches the accuracy of traditional acquisition functions like entropy on CIFAR-10, and notably outperforms them on CIFAR-100.


title: Optimal $k$-Deletion Correcting Codes

abstract: Levenshtein introduced the problem of constructing $k$-deletion correcting codes in 1966, proved that the optimal redundancy of those codes is $O(k\log N)$, and proposed an optimal redundancy single-deletion correcting code (using the so-called VT construction). However, the problem of constructing optimal redundancy $k$-deletion correcting codes remained open. Our key contribution is a solution to this longstanding open problem. We present a $k$-deletion correcting code that has redundancy $8k\log n +o(\log n)$ and encoding/decoding algorithms of complexity $O(n^{2k+1})$ for constant $k$.


title: Magnetic phase diagram of the triangular antiferromagnetic $Cs_2CuCl_{4-x}Br_x$ mixed system

abstract: The novel magnetic phase diagram of the $Cs_2CuCl_{4-x}Br_x$ mixed system is established by means of single crystal neutron diffraction in the lowest temperature region and zero magnetic field. Two long-range ordered magnetic phases exist in this mixed system depending on the Cl/Br concentration. In the rich Cl concentration range, the ordered magnetic state occurs below the ordering temperature $T_N = 0.51(1)K$ for $Cs_2CuCl_3Br_1$ and at $Cs_2CuCl_{2.6}Br_{1.4}$ below $T_N = 0.24(2)K$. Magnetic order with a temperature-independent position $(0, 0.573(1), 0)$ below the ordering temperature $T_N = 0.63(1)K$ appears in the rich Br concentration for $Cs_2CuCl_{0.6}Br_{3.4}$. Between the rich Cl and rich Br concentration ranges (two magnetic phases), there is a range of x without magnetic order down to $50mK$. A suggestion about the magnetic exchange paths in the $bc$-layer for different regimes is presented, which can be controlled depending on the preferred Br-occupation in the [CuX4] tetrahedra. The density functional theory (DFT) calculations of the exchange coupling constants J, J^' for some ordered compositions of the mixed system $Cs_2CuCl_{4-x}Br_x$ indicate that these are not frustrated.


title: An Adaptive and Momental Bound Method for Stochastic Learning

abstract: Training deep neural networks requires intricate initialization and careful selection of learning rates. The emergence of stochastic gradient optimization methods that use adaptive learning rates based on squared past gradients, e.g., AdaGrad, AdaDelta, and Adam, eases the job slightly. However, such methods have also been proven problematic in recent studies with their own pitfalls including non-convergence issues and so on. Alternative variants have been proposed for enhancement, such as AMSGrad, AdaShift and AdaBound. In this work, we identify a new problem of adaptive learning rate methods that exhibits at the beginning of learning where Adam produces extremely large learning rates that inhibit the start of learning. We propose the Adaptive and Momental Bound (AdaMod) method to restrict the adaptive learning rates with adaptive and momental upper bounds. The dynamic learning rate bounds are based on the exponential moving averages of the adaptive learning rates themselves, which smooth out unexpected large learning rates and stabilize the training of deep neural networks. Our experiments verify that AdaMod eliminates the extremely large learning rates throughout the training and brings significant improvements especially on complex networks such as DenseNet and Transformer, compared to Adam. Our implementation is available at: https://github.com/lancopku/AdaMod


title: Symmetry breaking bifurcations in the NLS equation with an asymmetric delta potential

abstract: We consider the NLS equation with a linear double well potential. Symmetry breaking, i.e., the localisation of an order parameter in one of the potential wells that can occur when the system is symmetric, has been studied extensively. However, when the wells are asymmetric, only a few analytical works have been reported. Using double Dirac delta potentials, we study rigorously the effect of such asymmetry on the bifurcation type. We show that the standard pitchfork bifurcation becomes broken and instead a saddle-centre type is obtained. Using a geometrical approach, we also establish the instability of the corresponding solutions along each branch in the bifurcation diagram


title: Relevance of magnetism to cuprate superconductivity: Lanthanides versus charge-compensated cuprates

abstract: We address what seemed to be a contradiction between the lanthanide series REBa$_2$Cu$_3$O$_y$ (RE123) and the charge-compensated series (Ca$_{x}$La$_{1-x}$)(Ba$_{1.75-x}$La$_{0.25+x} $)Cu$_{3}$O$_{y}$ (CLBLCO) regarding the superexchange ($J$) dependence of the maximum superconductivity (SC) critical temperature $T_c^{max}(J)$; RE and $x$ are implicit variables. This is done by measuring the N\'{e}el temperature and the temperature dependence of the magnetic order parameter for RE=Nd, Sm, Eu, Gd, Dy, Yb, Y, and for Y(BaSr)Cu$_3$O$_y$, at various very light dopings. The doping is determined by thermopower, and the magnetic properties by muon spin rotation. We find that the normalized-temperature dependence of the order parameter is identical for all RE123 in the undoped limit (with the exception of Gd123) implying identical out-of-plane magnetic coupling. The extrapolation of $T_N$ to zero doping suggests that, despite the variations in ionic radii, $J$ varies too weakly in this system to test the relation between SC and magnetism. This stands in contrast to CLBLCO where both $T_c^{max}$ and $T_N^{max}$ vary considerably in the undoped limit, and a positive correlation between the two quantities was observed.


title: Kernel Stein Tests for Multiple Model Comparison

abstract: We address the problem of non-parametric multiple model comparison: given $l$ candidate models, decide whether each candidate is as good as the best one(s) or worse than it. We propose two statistical tests, each controlling a different notion of decision errors. The first test, building on the post selection inference framework, provably controls the number of best models that are wrongly declared worse (false positive rate). The second test is based on multiple correction, and controls the proportion of the models declared worse but are in fact as good as the best (false discovery rate). We prove that under appropriate conditions the first test can yield a higher true positive rate than the second. Experimental results on toy and real (CelebA, Chicago Crime data) problems show that the two tests have high true positive rates with well-controlled error rates. By contrast, the naive approach of choosing the model with the lowest score without correction leads to more false positives.


title: What kind of a friend is Wigner's?

abstract: Proietti et al. (arXiv:1902.05080) reported on an experiment designed to settle, or at least to throw light upon, the paradox of Wigner's friend. Without questioning the rigor or ingenuity of the experimental protocol, I argue that its relevance to the paradox itself is rather limited.


title: The growth mechanism of turbulent bands in channel flow at low Reynolds numbers

abstract: In this work, we carried out direct numerical simulations in large channel domains and studied the kinematics and dynamics of fully localised turbulent bands at Reynolds number Re = 750. Our results show that the downstream end of the band features fast streak generation and travels into the adjacent laminar flow, whereas streaks at the upstream end continually and relatively more slowly decay. This asymmetry is responsible for the transverse growth of the band. We particularly investigated the mechanism of streak generation at the downstream end, which engines the growth of the band. We identified a spanwise inflectional instability associated with the local mean flow near the downstream end and our results strongly suggest that this instability is responsible for the streak generation and ultimately for the growth of the band. Based on our study, we propose a possible self-sustaining mechanism of fully localised turbulent bands at low Reynolds numbers in channel flow.


title: Stable limits for associated regularly varying sequences

abstract: For a stationary sequence that is regularly varying and associated we give conditions which guarantee that partial sums of this sequence, under normalization related to the exponent of regular variation, converge in distribution to a stable, non-Gaussian limit. The obtained limit theorem admits a natural extension to the functional convergence in Skorokhod's $M_1$ topology.


title: Complexity and Information in Invariant Inference

abstract: This paper addresses the complexity of SAT-based invariant inference, a prominent approach to safety verification. We consider the problem of inferring an inductive invariant of polynomial length given a transition system and a safety property. We analyze the complexity of this problem in a black-box model, called the Hoare-query model, which is general enough to capture algorithms such as IC3/PDR and its variants. An algorithm in this model learns about the system's reachable states by querying the validity of Hoare triples. We show that in general an algorithm in the Hoare-query model requires an exponential number of queries. Our lower bound is information-theoretic and applies even to computationally unrestricted algorithms, showing that no choice of generalization from the partial information obtained in a polynomial number of Hoare queries can lead to an efficient invariant inference procedure in this class. We then show, for the first time, that by utilizing rich Hoare queries, as done in PDR, inference can be exponentially more efficient than approaches such as ICE learning, which only utilize inductiveness checks of candidates. We do so by constructing a class of transition systems for which a simple version of PDR with a single frame infers invariants in a polynomial number of queries, whereas every algorithm using only inductiveness checks and counterexamples requires an exponential number of queries. Our results also shed light on connections and differences with the classical theory of exact concept learning with queries, and imply that learning from counterexamples to induction is harder than classical exact learning from labeled examples. This demonstrates that the convergence rate of Counterexample-Guided Inductive Synthesis depends on the form of counterexamples.


title: Smart Hypothesis Generation for Efficient and Robust Room Layout Estimation

abstract: We propose a novel method to efficiently estimate the spatial layout of a room from a single monocular RGB image. As existing approaches based on low-level feature extraction, followed by a vanishing point estimation are very slow and often unreliable in realistic scenarios, we build on semantic segmentation of the input image. To obtain better segmentations, we introduce a robust, accurate and very efficient hypothesize-and-test scheme. The key idea is to use three segmentation hypotheses, each based on a different number of visible walls. For each hypothesis, we predict the image locations of the room corners and select the hypothesis for which the layout estimated from the room corners is consistent with the segmentation. We demonstrate the efficiency and robustness of our method on three challenging benchmark datasets, where we significantly outperform the state-of-the-art.


title: Compressed Sensing with Probability-based Prior Information

abstract: This paper deals with the design of a sensing matrix along with a sparse recovery algorithm by utilizing the probability-based prior information for compressed sensing system. With the knowledge of the probability for each atom of the dictionary being used, a diagonal weighted matrix is obtained and then the sensing matrix is designed by minimizing a weighted function such that the Gram of the equivalent dictionary is as close to the Gram of dictionary as possible. An analytical solution for the corresponding sensing matrix is derived which leads to low computational complexity. We also exploit this prior information through the sparse recovery stage and propose a probability-driven orthogonal matching pursuit algorithm that improves the accuracy of the recovery. Simulations for synthetic data and application scenarios of surveillance video are carried out to compare the performance of the proposed methods with some existing algorithms. The results reveal that the proposed CS system outperforms existing CS systems.


title: L*ReLU: Piece-wise Linear Activation Functions for Deep Fine-grained Visual Categorization

abstract: Deep neural networks paved the way for significant improvements in image visual categorization during the last years. However, even though the tasks are highly varying, differing in complexity and difficulty, existing solutions mostly build on the same architectural decisions. This also applies to the selection of activation functions (AFs), where most approaches build on Rectified Linear Units (ReLUs). In this paper, however, we show that the choice of a proper AF has a significant impact on the classification accuracy, in particular, if fine, subtle details are of relevance. Therefore, we propose to model the degree of absence and the presence of features via the AF by using piece-wise linear functions, which we refer to as L*ReLU. In this way, we can ensure the required properties, while still inheriting the benefits in terms of computational efficiency from ReLUs. We demonstrate our approach for the task of Fine-grained Visual Categorization (FGVC), running experiments on seven different benchmark datasets. The results do not only demonstrate superior results but also that for different tasks, having different characteristics, different AFs are selected.


title: Perfect Italian Domination Number of Graphs

abstract: In this paper, an upper bound for the perfect Italian domination number of the cartesian product of any two graphs is obtained and the exact value of this parameter for cartesian product of some special graphs are obtained. We have also proved that for any two positive integers $a$, $b$ there exists a graph $G$ and an induced subgraph $H$ of $G$ such that $\gamma_I^p(G) = a$ and $\gamma_I^p(H) = b$. Relationship of the perfect Italian domination number with the Roman domination number and the perfect domination number of a graph $G$ are obtained and the corresponding realization problems are also solved. We have also obtained the perfect Italian domination number of the Mycielskian of a graph in terms of the perfect domination number of the graph. Some open problems related to this parameters are also included.


title: Typical Snapshots Selection for Shortest Path Query in Dynamic Road Networks

abstract: Finding the shortest paths in road network is an important query in our life nowadays, and various index structures are constructed to speed up the query answering. However, these indexes can hardly work in real-life scenario because the traffic condition changes dynamically, which makes the pathfinding slower than in the static environment. In order to speed up path query answering in the dynamic road network, we propose a framework to support these indexes. Firstly, we view the dynamic graph as a series of static snapshots. After that, we propose two kinds of methods to select the typical snapshots. The first kind is time-based and it only considers the temporal information. The second category is the graph representation-based, which considers more insights: edge-based that captures the road continuity, and vertex-based that reflects the region traffic fluctuation. Finally, we propose the snapshot matching to find the most similar typical snapshot for the current traffic condition and use its index to answer the query directly. Extensive experiments on real-life road network and traffic conditions validate the effectiveness of our approach.


title: Eikonal black hole ringings in generalized energy-momentum squared gravity

abstract: In the scope of black hole spectroscopy, several attempts have been made in the past decades in order to test black holes or gravitational theories via black hole quasinormal modes. In the eikonal approximation, the quasinormal modes are generically associated with the photon ring of the black hole. This correspondence is valid for most cases in general relativity, but may not be true in other theories of gravity. In this paper, we consider the generalized energy-momentum squared gravity in which matter fields are non-minimally coupled to geometry. We investigate the axial perturbations of the charged black holes in this model, without assuming any explicit expression of the action functional. After obtaining the modified Klein-Gordon equation and the modified Maxwell equations, we perturb the gravitational equations and the modified Maxwell equations to derive the coupled master equations of the axial perturbations. In the presence of the non-minimal coupling between matter and geometry, the correspondence between the eikonal quasinormal modes and the photon ring is not satisfied in general. Also, the two coupled fields of the axial perturbations are found to propagate independently and they do not share the same quasinormal frequencies in the eikonal limit.


title: Prior Specification for Bayesian Matrix Factorization via Prior Predictive Matching

abstract: The behavior of many Bayesian models used in machine learning critically depends on the choice of prior distributions, controlled by some hyperparameters that are typically selected by Bayesian optimization or cross-validation. This requires repeated, costly, posterior inference. We provide an alternative for selecting good priors without carrying out posterior inference, building on the prior predictive distribution that marginalizes out the model parameters. We estimate virtual statistics for data generated by the prior predictive distribution and then optimize over the hyperparameters to learn ones for which these virtual statistics match target values provided by the user or estimated from (subset of) the observed data. We apply the principle for probabilistic matrix factorization, for which good solutions for prior selection have been missing. We show that for Poisson factorization models we can analytically determine the hyperparameters, including the number of factors, that best replicate the target statistics, and we study empirically the sensitivity of the approach for model mismatch. We also present a model-independent procedure that determines the hyperparameters for general models by stochastic optimization, and demonstrate this extension in context of hierarchical matrix factorization models.


title: Rel--$C^\infty$ Structures on Gromov-Witten Moduli Spaces

abstract: We show that moduli spaces of transversely cut-out (perturbed) pseudo-holomorphic curves in an almost complex manifold carry canonical relative smooth structures ("relative to the moduli space of domain curves"). The main point is that these structures can be characterized by a universal property. The tools required are ordinary gluing analysis combined with some fundamental results from the polyfold theory of Hofer--Wysocki--Zehnder.


title: Factorization of special harmonic polynomials of three variables

abstract: We consider harmonic polynomials of real variables $x,y,z$ that are eigenfunctions of the rotations about the axis $z$. They have the form $(x\pm yi)^{n}p(x,y,z)$, where $p$ is a rotation invariant polynomial. Let ${\mathfrak R}_{m}$ be the family of the polynomials $p$ of degree $m$ which are reducible over the rationals. We describe ${\mathfrak R}_{m}$ for $m\leq5$ and prove that ${\mathfrak R}_{6}$ and ${\mathfrak R}_{7}$ are finite.


title: Geometric Constructions of Regular Polygons and Applications to Trigonometry

abstract: In this paper, constructions of regular pentagon and decagon, and the calculation of the main trigonometric ratios of the corresponding central angles are approached. In this way, for didactic purposes, it is intended to show the reader that it is possible to broaden the study of Trigonometry by addressing new applications and exercises, for example, with angles 18{\deg}, 36{\deg} and 72{\deg}. It is also considered constructions of other regular polygons and a relation to a construction of the regular icosahedron.


title: A novel high-power test for continuous outcomes truncated by death

abstract: Patient reported outcomes including quality of life (QoL) assessments are increasingly being included as either primary or secondary outcomes in randomized controlled trials. While making the outcomes more relevant for patients it entails a challenge in cases where death or a similar event makes the outcome of interest undefined. A pragmatic - and much used - solution is to assign diseased patient with the lowest possible QoL score. This makes medical sense, but creates a statistical problem since traditional tests such as t-tests or Wilcox tests potentially looses large amounts of statistical power. In this paper we propose a novel test that can keep the medical relevant composite outcome, but preserve full statistical power. The test is also applicable in other situations where a specific value (say 0 days alive outside hospitals) encodes a special meaning. The test is implemented in an R package which is available for download.


title: Null-controllability of linear hyperbolic systems in one dimensional space

abstract: This paper is devoted to the controllability of a general linear hyperbolic system in one space dimension using boundary controls on one side. Under precise and generic assumptions on the boundary conditions on the other side, we previously established the optimal time for the null and the exact controllability for this system for a generic source term. In this work, we prove the null-controllability for any time greater than the optimal time and for any source term. Similar results for the exact controllability are also discussed.


title: Theoretical Study of Elastic Far-Field Decay from Dislocations in Multilattices

abstract: We precisely and rigorously characterise the decay of elastic fields generated by dislocations in crystalline materials, focusing specifically on the role of multilattices. Concretely, we establish that the elastic field generated by a dislocation in a multilattice can be decomposed into a continuum field predicted by a linearised Cauchy-Born elasticity theory, and a discrete and nonlinear core corrector representing the defect core. We demonstrate both analytically and numerically the consequences of this result for cell size effects in numerical simulations.


title: Analytical and Numerical Bifurcation Analysis of a Forest-Grassland Ecosystem Model with Human Interaction

abstract: We perform both analytical and numerical bifurcation analysis of a forest-grassland ecosystem model coupled with human interaction. The model consists of two nonlinear ordinary differential equations incorporating the human perception of forest/grassland value. The system displays multiple steady states corresponding to different forest densities as well as regimes characterized by both stable and unstable limit cycles. We derive analytically the conditions with respect to the model parameters that give rise to various types of codimension-one criticalities such as transcritical, saddle-node, and Andronov-Hopf bifurcations and codimension-two criticalities such as cusp and Bogdanov-Takens bifurcations. We also perform a numerical continuation of the branches of limit cycles. By doing so, we reveal turning points of limit cycles marking the appearance/disappearance of sustained oscillations. These far-from-equilibrium criticalities that cannot be detected analytically give rise to the abrupt loss of the sustained oscillations, thus leading to another mechanism of catastrophic shifts


title: Experimental implementation of universal nonadiabatic geometric quantum gates in a superconducting circuit

abstract: Using geometric phases to realize noise-resilient quantum computing is an important method to enhance the control fidelity. In this work, we experimentally realize a universal nonadiabatic geometric quantum gate set in a superconducting qubit chain. We characterize the realized single- and two-qubit geometric gates with both quantum process tomography and randomized benchmarking methods. The measured average fidelities for the single-qubit rotation gates and two-qubit controlled-Z gate are 0.9977(1) and 0.977(9), respectively. Besides, we also experimentally demonstrate the noise-resilient feature of the realized single-qubit geometric gates by comparing their performance with the conventional dynamical gates with different types of errors in the control field. Thus, our experiment proves a way to achieve high-fidelity geometric quantum gates for robust quantum computation.


title: Declarative Semantics of the Hybrid Constraint Language HydLa

abstract: Hybrid systems are dynamical systems with continuous evolution of states and discrete evolution of states and governing equations. We have worked on the design and implementation of HydLa, a constraint-based modeling language for hybrid systems, with a view to the proper handling of uncertainties and the integration of simulation and verification. HydLa's constraint hierarchies facilitate the description of constraints with adequate strength, but its semantical foundations are not obvious due to the interaction of various language constructs. This paper gives the declarative semantics of HydLa and discusses its properties and consequences by means of examples.


title: Exploring 3 R's of Long-term Tracking: Re-detection, Recovery and Reliability

abstract: Recent works have proposed several long term tracking benchmarks and highlight the importance of moving towards long-duration tracking to bridge the gap with application requirements. The current evaluation methodologies, however, do not focus on several aspects that are crucial in a long term perspective like Re-detection, Recovery, and Reliability. In this paper, we propose novel evaluation strategies for a more in-depth analysis of trackers from a long-term perspective. More specifically, (a) we test re-detection capability of the trackers in the wild by simulating virtual cuts, (b) we investigate the role of chance in the recovery of tracker after failure and (c) we propose a novel metric allowing visual inference on the ability of a tracker to track contiguously (without any failure) at a given accuracy. We present several original insights derived from an extensive set of quantitative and qualitative experiments.


title: Algorithmic Copywriting: Automated Generation of Health-Related Advertisements to Improve their Performance

abstract: Search advertising, a popular method for online marketing, has been employed to improve health by eliciting positive behavioral change. However, writing effective advertisements requires expertise and experimentation, which may not be available to health authorities wishing to elicit such changes, especially when dealing with public health crises such as epidemic outbreaks. Here we develop a framework, comprised of two neural networks models, that automatically generate ads. First, it employs a generator model, which create ads from web pages. It then employs a translation model, which transcribes ads to improve performance. We trained the networks using 114K health-related ads shown on Microsoft Advertising. We measure ads performance using the click-through rates (CTR). Our experiments show that the generated advertisements received approximately the same CTR as human-authored ads. The marginal contribution of the generator model was, on average, 28\% lower than that of human-authored ads, while the translator model received, on average, 32\% more clicks than human-authored ads. Our analysis shows that the translator model produces ads reflecting higher values of psychological attributes associated with a user action, including higher valance and arousal, and more calls-to-actions. In contrast, levels of these attributes in ads produced by the generator model are similar to those of human-authored ads. Our results demonstrate the ability to automatically generate useful advertisements for the health domain. We believe that our work offers health authorities an improved ability to nudge people towards healthier behaviors while saving the time and cost needed to build effective advertising campaigns.