title: RobustTrend: A Huber Loss with a Combined First and Second Order Difference Regularization for Time Series Trend Filtering

abstract: Extracting the underlying trend signal is a crucial step to facilitate time series analysis like forecasting and anomaly detection. Besides noise signal, time series can contain not only outliers but also abrupt trend changes in real-world scenarios. To deal with these challenges, we propose a robust trend filtering algorithm based on robust statistics and sparse learning. Specifically, we adopt the Huber loss to suppress outliers, and utilize a combination of the first order and second order difference on the trend component as regularization to capture both slow and abrupt trend changes. Furthermore, an efficient method is designed to solve the proposed robust trend filtering based on majorization minimization (MM) and alternative direction method of multipliers (ADMM). We compared our proposed robust trend filter with other nine state-of-the-art trend filtering algorithms on both synthetic and real-world datasets. The experiments demonstrate that our algorithm outperforms existing methods.


title: Symmetry Properties of Nested Canalyzing Functions

abstract: Many researchers have studied symmetry properties of various Boolean functions. A class of Boolean functions, called nested canalyzing functions (NCFs), has been used to model certain biological phenomena. We identify some interesting relationships between NCFs, symmetric Boolean functions and a generalization of symmetric Boolean functions, which we call $r$-symmetric functions (where $r$ is the symmetry level). Using a normalized representation for NCFs, we develop a characterization of when two variables of an NCF are symmetric. Using this characterization, we show that the symmetry level of an NCF $f$ can be easily computed given a standard representation of $f$. We also present an algorithm for testing whether a given $r$-symmetric function is an NCF. Further, we show that for any NCF $f$ with $n$ variables, the notion of strong asymmetry considered in the literature is equivalent to the property that $f$ is $n$-symmetric. We use this result to derive a closed form expression for the number of $n$-variable Boolean functions that are NCFs and strongly asymmetric. We also identify all the Boolean functions that are NCFs and symmetric.


title: Out-of-Vocabulary Embedding Imputation with Grounded Language Information by Graph Convolutional Networks

abstract: Due to the ubiquitous use of embeddings as input representations for a wide range of natural language tasks, imputation of embeddings for rare and unseen words is a critical problem in language processing. Embedding imputation involves learning representations for rare or unseen words during the training of an embedding model, often in a post-hoc manner. In this paper, we propose an approach for embedding imputation which uses grounded information in the form of a knowledge graph. This is in contrast to existing approaches which typically make use of vector space properties or subword information. We propose an online method to construct a graph from grounded information and design an algorithm to map from the resulting graphical structure to the space of the pre-trained embeddings. Finally, we evaluate our approach on a range of rare and unseen word tasks across various domains and show that our model can learn better representations. For example, on the Card-660 task our method improves Pearson's and Spearman's correlation coefficients upon the state-of-the-art by 11% and 17.8% respectively using GloVe embeddings.


title: A sequential least squares method for elliptic equations in non-divergence form

abstract: We develop a new least squares method for solving the second-order elliptic equations in non-divergence form. Two least-squares-type functionals are proposed for solving the equations in two steps. We first obtain a numerical approximation to the gradient in a piecewisely irrotational polynomial space. Then together with the numerical gradient, we seek a numerical solution of the primitive variable in continuous finite element space. The variational setting naturally provides a posteriori error which could be used in an adaptive refinement algorithm. The error estimates in $L^2$ norm and energy norms for both two unknowns are derived. By a series of numerical experiments, we verify the convergence rates and show the efficiency of the adaptive algorithm.


title: Termodin\'amica de agujeros negros y campos escalares

abstract: Since the descovery by Stephen Hawking that black holes emit radiation in the context of the semiclassical approach to gravity, the black hole thermodynamics has become an active field of research in theoretical physics. In this thesis, the influence of scalar fields on the black hole thermodynamics in $D=4$ dimensions is studied. On one hand, the role played by scalar fields in the first law of black hole thermodynamics is elucidated, by using the quasilocal formalism of Brown and York, which is based on a correct variational principle, and some concrete examples are provided. On the other, the thermodynamic stability of asymptotically flat charged hairy black hole exact solutions is analysed. The solutions considered have a non-trivial scalar field potential and they can be embebbed in supergravity theories. It is explicitly shown that these solutions contain thermodynamically stable black holes.


title: Arqu\'imedes y las superficies cu\'adricas

abstract: A brief review of the history of the conic sections would not be complete without an exhaustively tolerable account of all the things related to the subject that can be found in the extensive work of the wise Archimedes. There is no strong evidence that the Syracusan genius wrote a treatise on Conics separately.


title: Identifying Data And Information Streams In Cyberspace: A Multi-Dimensional Perspective

abstract: Cyberspace has gradually replaced the physical reality, its role evolving from a simple enabler of daily live processes to a necessity for modern existence. As a result of this convergence of physical and virtual realities, for all processes being critically dependent on networked communications, information representative of our physical, logical and social thoughts is constantly being generated in cyberspace. The interconnection and integration of links between our physical and virtual realities creates a new hyperspace as a source of data and information. Additionally, significant studies in cyber analysis have predominantly revolved around a single linear analysis of information from a single source of evidence (The Network). These studies are limited in their ability to understand the dynamics of relationships across the multiple dimensions of cyberspace. This paper introduces a multi-dimensional perspective for data identification in cyberspace. It provides critical discussions for identifying entangled relationships amongst entities across cyberspace.


title: Low-energy dynamics of the Affleck-Kennedy-Lieb-Tasaki model in the one- and two-triplon basis

abstract: The elementary excitation in the antiferromagnetic spin-1 model known as the Affleck-Kennedy-Lieb-Tasaki (AKLT) Hamiltonian has been described alternatively as magnons or kink-like solitons (triplons). The latter, which we call the triplon throughout this paper, has been proven equivalent descriptions of the same magnon excitation and not an independent branch of excited states. On the other hand, no careful examination of multi-magnon and multi-triplon equivalence was made in the past. In this paper we prove that two-magnon and two-triplon states are also identical descriptions of the same excited states, and furthermore that their energies break down as the sum of one-triplon energies exactly for the AKLT Hamiltonian. The statement holds despite the fact that the model is non-integrable. Such magnon/triplon dichotomy is conjectured to hold for arbitrary n-magnon and n-triplon states. The one- and two-triplon states form orthogonal sets that can be used to span the low-energy Hilbert space. We construct an effective version of the AKLT Hamiltonian within such subspace, and work out the correction to the one-triplon energy gap that finds excellent agreement with the known exact value.


title: A Shuffling Theorem for Centrally Symmetric Tilings

abstract: Rohatgi and the author recently proved a shuffling theorem for lozenge tilings of `doubly-dented hexagons' (arXiv:1905.08311). The theorem can be considered as a hybrid between two classical theorems in the enumeration of tilings: MacMahon's theorem about centrally symmetric hexagons and Cohn-Larsen-Prop's theorem about semihexagons with dents. In this paper, we consider a similar shuffling theorem for the centrally symmetric tilings of the doubly-dented hexagons. Our theorem also implies a conjecture posed by the author in arXiv:1803.02792 about the enumeration of centrally symmetric tilings of hexagons with three arrays of triangular holes. This enumeration, in turn, can be considered as a common generalization of (a tiling-equivalent version of) Stanley's enumeration of self-complementary plane partitions and Ciucu's work on symmetries of the shamrock structure. Moreover, our enumeration also confirms a recent conjecture posed by Ciucu in arXiv:1906.02951.


title: Proposal for Use the Fractional Derivative of Radial Functions in Interpolation Problems

abstract: In this document we present the construction of a radial functions that have the objective of emulating the behavior of the radial basis function thin plate spline (TPS), which we will name as function TPS, we propose a way to partially and totally apply the fractional derivative to these functions to be used in interpolation problems, a proposal is presented to precondition the matrices generated in the interpolation problem using the $QR$ decomposition and finally is proposed the form of a radial interpolant to be used when solving differential equations using the asymmetric collocation method.


title: The Impact of Regularization on High-dimensional Logistic Regression

abstract: Logistic regression is commonly used for modeling dichotomous outcomes. In the classical setting, where the number of observations is much larger than the number of parameters, properties of the maximum likelihood estimator in logistic regression are well understood. Recently, Sur and Candes have studied logistic regression in the high-dimensional regime, where the number of observations and parameters are comparable, and show, among other things, that the maximum likelihood estimator is biased. In the high-dimensional regime the underlying parameter vector is often structured (sparse, block-sparse, finite-alphabet, etc.) and so in this paper we study regularized logistic regression (RLR), where a convex regularizer that encourages the desired structure is added to the negative of the log-likelihood function. An advantage of RLR is that it allows parameter recovery even for instances where the (unconstrained) maximum likelihood estimate does not exist. We provide a precise analysis of the performance of RLR via the solution of a system of six nonlinear equations, through which any performance metric of interest (mean, mean-squared error, probability of support recovery, etc.) can be explicitly computed. Our results generalize those of Sur and Candes and we provide a detailed study for the cases of $\ell_2^2$-RLR and sparse ($\ell_1$-regularized) logistic regression. In both cases, we obtain explicit expressions for various performance metrics and can find the values of the regularizer parameter that optimizes the desired performance. The theory is validated by extensive numerical simulations across a range of parameter values and problem instances.


title: Incorporating Open Data into Introductory Courses in Statistics

abstract: The 2016 Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report emphasized six recommendations to teach introductory courses in statistics. Among them: use of real data with context and purpose. Many educators have created databases consisting of multiple data sets for use in class; sometimes making hundreds of data sets available. Yet `the context and purpose' component of the data may remain elusive if just a generic database is made available. We describe the use of open data in introductory courses. Countries and cities continue to share data through open data portals. Hence, educators can find regional data that engages their students more effectively. We present excerpts from case studies that show the application of statistical methods to data on: crime, housing, rainfall, tourist travel, and others. Data wrangling and discussion of results are recognized as important case study components. Thus the open data based case studies attend most GAISE College Report recommendations. Reproducible \textsf{R} code is made available for each case study. Example uses of open data in more advanced courses in statistics are also described.


title: Quantum random number generation by coherent detection of phase noise

abstract: We demonstrate a quantum random number generator based on the random nature of the phase difference between two independent laser sources. The speed of random bit generation is determined by the photodetector bandwidth and the linewidth of the lasers used. The system implemented is robust and generates a probability distribution of quantum origin which is intrinsically uniform and thus in principle needs no randomness extraction. The phase is measured with telecom equipment routinely used for high capacity coherent optical communications, which allows to keep track of the phase drift of the lasers and is readily available in the telecommunication industry.


title: Learning from Unlabelled Videos Using Contrastive Predictive Neural 3D Mapping

abstract: Predictive coding theories suggest that the brain learns by predicting observations at various levels of abstraction. One of the most basic prediction tasks is view prediction: how would a given scene look from an alternative viewpoint? Humans excel at this task. Our ability to imagine and fill in missing information is tightly coupled with perception: we feel as if we see the world in 3 dimensions, while in fact, information from only the front surface of the world hits our retinas. This paper explores the role of view prediction in the development of 3D visual recognition. We propose neural 3D mapping networks, which take as input 2.5D (color and depth) video streams captured by a moving camera, and lift them to stable 3D feature maps of the scene, by disentangling the scene content from the motion of the camera. The model also projects its 3D feature maps to novel viewpoints, to predict and match against target views. We propose contrastive prediction losses to replace the standard color regression loss, and show that this leads to better performance on complex photorealistic data. We show that the proposed model learns visual representations useful for (1) semi-supervised learning of 3D object detectors, and (2) unsupervised learning of 3D moving object detectors, by estimating the motion of the inferred 3D feature maps in videos of dynamic scenes. To the best of our knowledge, this is the first work that empirically shows view prediction to be a scalable self-supervised task beneficial to 3D object detection.


title: Energetics and electronic structure of native point defects in ${\alpha}$-Ga2O3

abstract: We report first-principles calculations that clarify the formation energies and charge transition levels of native point defects (Ga and O vacancies, interstitials, and a Ga vacancy-O vacancy pair) in corundum structured ${\alpha}$-Ga2O3. Either under a Ga- or O-rich growth condition, the negatively-charged Ga vacancy and the positively-charged Ga interstitial on a site surrounded by six O atoms are dominant when the Fermi level approaches the conduction and valence band edges, respectively. These defects would compensate carrier electrons and holes, respectively. Ga-rich conditions relatively suppress the formation of the Ga vacancy and, therefore, are suited for extrinsic n-type doping of ${\alpha}$-Ga2O3.


title: Variance Reduction in Gradient Exploration for Online Learning to Rank

abstract: Online Learning to Rank (OL2R) algorithms learn from implicit user feedback on the fly. The key of such algorithms is an unbiased estimation of gradients, which is often (trivially) achieved by uniformly sampling from the entire parameter space. This unfortunately introduces high-variance in gradient estimation, and leads to a worse regret of model estimation, especially when the dimension of parameter space is large. In this paper, we aim at reducing the variance of gradient estimation in OL2R algorithms. We project the selected updating direction into a space spanned by the feature vectors from examined documents under the current query (termed the "document space" for short), after interleaved test. Our key insight is that the result of interleaved test solely is governed by a user's relevance evaluation over the examined documents. Hence, the true gradient introduced by this test result should lie in the constructed document space, and components orthogonal to the document space in the proposed gradient can be safely removed for variance reduction. We prove that the projected gradient is an unbiased estimation of the true gradient, and show that this lower-variance gradient estimation results in significant regret reduction. Our proposed method is compatible with all existing OL2R algorithms which rank documents using a linear model. Extensive experimental comparisons with several state-of-the-art OL2R algorithms have confirmed the effectiveness of our proposed method in reducing the variance of gradient estimation and improving overall performance.


title: BAGS: An automatic homework grading system using the pictures taken by smart phones

abstract: Homework grading is critical to evaluate teaching quality and effect. However, it is usually time-consuming to grade the homework manually. In automatic homework grading scenario, many optical mark reader (OMR)-based solutions which require specific equipments have been proposed. Although many of them can achieve relatively high accuracy, they are less convenient for users. In contrast, with the popularity of smart phones, the automatic grading system which depends on the image photographed by phones becomes more available. In practice, due to different photographing angles or uneven papers, images may be distorted. Moreover, most of images are photographed under complex backgrounds, making answer areas detection more difficult. To solve these problems, we propose BAGS, an automatic homework grading system which can effectively locate and recognize handwritten answers. In BAGS, all the answers would be written above the answer area underlines (AAU), and we use two segmentation networks based on DeepLabv3+ to locate the answer areas. Then, we use the characters recognition part to recognize students' answers. Finally, the grading part is designed for the comparison between the recognized answers and the standard ones. In our test, BAGS correctly locates and recognizes the handwritten answers in 91% of total answer areas.


title: A cost-reducing partial labeling estimator in text classification problem

abstract: We propose a new approach to address the text classification problems when learning with partial labels is beneficial. Instead of offering each training sample a set of candidate labels, we assign negative-oriented labels to the ambiguous training examples if they are unlikely fall into certain classes. We construct our new maximum likelihood estimators with self-correction property, and prove that under some conditions, our estimators converge faster. Also we discuss the advantages of applying one of our estimator to a fully supervised learning problem. The proposed method has potential applicability in many areas, such as crowdsourcing, natural language processing and medical image analysis.


title: Nonlocality test of energy-time entanglement via nonlocal dispersion cancellation with nonlocal detection

abstract: Energy-time entangled biphoton source plays a great role in quantum communication, quantum metrology and quantum cryptography due to its strong temporal correlation and capability of nonlocal dispersion cancellation. As a quantum effect, nonlocal dispersion cancellation is further proposed as an alternative way for nonlocality test of continuous variable entanglement via the violation of Bell-like inequality proposed by Wasak et al. [Phys. Rev. A, 82, 052120 (2010)]. However, to date there is no experimental report either on the inequality violation or on a nonlocal detection with single-photon detectors at long-distance transmission channel, which is key for a true nonlocality test. In this paper, we report an experimental realization of a violation of the inequality after 62km optical fiber transmission at telecom wavelength with a nonlocal detection based on event timers and cross-correlation algorithm, which indicates a successful nonlocal test of energy-time entanglement. This work provides a new feasibility for the strict test of the nonlocality for continuous variables in both long-distance communication fiber channel and free space.


title: Fixed points for branched covering maps of the plane

abstract: A well-known result from Brouwer states that any orientation preserving homeomorphism of the plane with no fixed points has an empty non-wandering set. In particular, an invariant compact set implies the existence of a fixed point. In this paper we give sufficient conditions for degree 2 branched covering maps of the plane to have a fixed point, namely: A totally invariant compact subset such that it does not separate the critical point from its image An invariant compact subset with a connected neighbourhood $U$, such that $\mathrm{Fill}(U \cup f(U))$ does not contain the critical point nor its image. An invariant continuum such that the critical point and its image belong to the same connected component of its complement.


title: Composition of Safety Constraints For Fixed-Wing Collision Avoidance Amidst Limited Communications

abstract: This paper considers how to ensure that a system of fixed wing Unmanned Aerial Vehicles (UAVs) can avoid collisions. To do so we develop a novel method for creating a barrier function, which is similar to a Lyapunov function and can be used to ensure that a system can stay safe for all future times. After introducing the general approach, it is shown how to ensure that collision avoidance for two vehicles can be guaranteed for all future times. The construction is then extended to the case of arbitrarily many vehicles by addressing how to satisfy multiple safety objectives simultaneously. We do this while ensuring output actuator commands are within specified limits. Because this formulation requires communication of control values and may therefore reduce throughput of other important messages, we then show how to reformulate the solution without this significant communication overhead while still ensuring safety is maintained and actuator limits are respected. We validate the theoretical developments of this paper in the simulator SCRIMMAGE with a simulation of 20 UAVs that maintain safe distances from each other even though their nominal paths would otherwise cause a collision.


title: Multimodal Data Fusion of Non-Gaussian Spatial Fields in Sensor Networks

abstract: We develop a robust data fusion algorithm for field reconstruction of multiple physical phenomena. The contribution of this paper is twofold: First, we demonstrate how multi-spatial fields which can have any marginal distributions and exhibit complex dependence structures can be constructed. To this end we develop a model where a latent process of these physical phenomena is modelled as Multiple Gaussian Process (MGP), and the dependence structure between these phenomena is captured through a Copula process. This model has the advantage of allowing one to choose any marginal distributions for the physical phenomenon. Second, we develop an efficient and robust linear estimation algorithm to predict the mean behaviour of the physical phenomena using rank correlation instead of the conventional linear Pearson correlation. Our approach has the advantage of avoiding the need to derive intractable predictive posterior distribution and also has a tractable solution for the rank correlation values. We show that our model outperforms the model which uses the conventional linear Pearson correlation metric in terms of the prediction mean-squared-errors (MSE). This provides the motivation for using our models for multimodal data fusion.


title: DataLearner: A Data Mining and Knowledge Discovery Tool for Android Smartphones and Tablets

abstract: Smartphones have become the ultimate 'personal' computer, yet despite this, general-purpose data-mining and knowledge discovery tools for mobile devices are surprisingly rare. DataLearner is a new data-mining application designed specifically for Android devices that imports the Weka data-mining engine and augments it with algorithms developed by Charles Sturt University. Moreover, DataLearner can be expanded with additional algorithms. Combined, DataLearner delivers 40 classification, clustering and association rule mining algorithms for model training and evaluation without need for cloud computing resources or network connectivity. It provides the same classification accuracy as PCs and laptops, while doing so with acceptable processing speed and consuming negligible battery life. With its ability to provide easy-to-use data-mining on a phone-size screen, DataLearner is a new portable, self-contained data-mining tool for remote, personalised and learning applications alike. DataLearner features four elements - this paper, the app available on Google Play, the GPL3-licensed source code on GitHub and a short video on YouTube.


title: Room Temperature Initialisation and Readout of Intrinsic Spin Defects in a Van der Waals Crystal

abstract: Optically addressable spins in widebandgap semiconductors have become one of the most prominent platforms for exploring fundamental quantum phenomena. While several candidates in 3D crystals including diamond and silicon carbide have been extensively studied, the identification of spindependent processes in atomically thin 2D materials has remained elusive. Although optically accessible spin states in hBN are theoretically predicted, they have not yet been observed experimentally. Here, employing rigorous electron paramagnetic resonance techniques and photoluminescence spectroscopy, we identify fluorescence lines in hexagonal boron nitride associated with a particular defect, the negatively charged boron vacancy and determine the parameters of its spin Hamiltonian. We show that the defect has a triplet ground state with a zero field splitting of 3.5 GHz and establish that the centre exhibits optically detected magnetic resonance at room temperature. We also demonstrate the spin polarization of this centre under optical pumping, which leads to optically induced population inversion of the spin ground state a prerequisite for coherent spin manipulation schemes. Our results constitute a leap forward in establishing two dimensional hBN as a prime platform for scalable quantum technologies, with extended potential for spin based quantum information and sensing applications, as our ODMR studies on hBN NV diamonds hybrid structures show.


title: Sequential nonabsorbing microwave single-photon detector

abstract: We propose a nonabsorbing microwave single-photon detector that uses an artificial atom as a coherent interaction mediator between a traveling photon and a high-Q resonator, fully exploiting the knowledge of the photon's arrival time. Our proposal can be implemented with the current level of technology and achieves distinguishability (probability of distinguishing between zero and one photon) in excess of 98% for realistic parameters. This is better than any of the similar detector proposals, even the ones using several artificial atoms.


title: Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction

abstract: Click-through rate (CTR) prediction is a critical task in online advertising systems. A large body of research considers each ad independently, but ignores its relationship to other ads that may impact the CTR. In this paper, we investigate various types of auxiliary ads for improving the CTR prediction of the target ad. In particular, we explore auxiliary ads from two viewpoints: one is from the spatial domain, where we consider the contextual ads shown above the target ad on the same page; the other is from the temporal domain, where we consider historically clicked and unclicked ads of the user. The intuitions are that ads shown together may influence each other, clicked ads reflect a user's preferences, and unclicked ads may indicate what a user dislikes to certain extent. In order to effectively utilize these auxiliary data, we propose the Deep Spatio-Temporal neural Networks (DSTNs) for CTR prediction. Our model is able to learn the interactions between each type of auxiliary data and the target ad, to emphasize more important hidden information, and to fuse heterogeneous data in a unified framework. Offline experiments on one public dataset and two industrial datasets show that DSTNs outperform several state-of-the-art methods for CTR prediction. We have deployed the best-performing DSTN in Shenma Search, which is the second largest search engine in China. The A/B test results show that the online CTR is also significantly improved compared to our last serving model.


title: A Regression Approach to Certain Information Transmission Problems

abstract: A general information transmission model, under independent and identically distributed Gaussian codebook and nearest neighbor decoding rule with processed channel output, is investigated using the performance metric of generalized mutual information. When the encoder and the decoder know the statistical channel model, it is found that the optimal channel output processing function is the conditional expectation operator, thus hinting a potential role of regression, a classical topic in machine learning, for this model. Without utilizing the statistical channel model, a problem formulation inspired by machine learning principles is established, with suitable performance metrics introduced. A data-driven inference algorithm is proposed to solve the problem, and the effectiveness of the algorithm is validated via numerical experiments. Extensions to more general information transmission models are also discussed.


title: Scalar radiation from a source rotating around a regular black hole

abstract: The scalar radiation emitted by a source in geodesic circular orbit around a regular Bardeen black hole is analyzed. We use the quantum field theory in curved spacetime framework to obtain the emitted power of radiation by computing the one-particle emission amplitude of scalar particles in the curved background. We compare our results to a similar setting in the spacetime of a Reissner-Nordstr\"{o}m black hole.


title: Multi-label learning for improving discretely-modulated continuous-variable quantum key distribution

abstract: Discretely-modulated continuous-variable quantum key distribution (CVQKD) is more suitable for long-distance transmission compared with its Gaussian-modulated CVQKD counterpart. However, its security can only be guaranteed when modulation variance is very small, which limits its further development. To solve this problem, in this work, we propose a novel scheme for discretely-modulated CVQKD using multi-label learning technology, called multi-label learning-based CVQKD (ML-CVQKD). In particular, the proposed scheme divides the whole quantum system into state learning and state prediction. The former is used for training and estimating quantum classifier, and the latter is used for generating final secret key. A quantum multi-label classification (QMLC) algorithm is also designed as an embedded classifier for distinguishing coherent state. Feature extraction for coherent state and related machine learning-based metrics for the quantum classifier are successively suggested. Security analysis shows that QMLC-embedded ML-CVQKD is able to immune intercept-resend attack so that small modulation variance is no longer compulsively required, thereby improving the performance of discretely-modulated CVQKD system.


title: Exchange Splitting of a Hybrid Surface State and Ferromagnetic Order in a 2D Surface Alloy

abstract: Surface alloys are highly flexible materials for tailoring the spin-dependent properties of surfaces. Here, we study the spin-dependent band structure of a DyAg$_2$ surface alloy formed on an Ag(111) crystal. We find a significant exchange spin-splitting of the localized Dy 4f states pointing to a ferromagnetic coupling between the localized Dy moments at $40\,$K. The magnetic coupling between these moments is mediated by an indirect, RKKY-like exchange coupling via the spin-polarized electrons of the hole-like Dy-Ag hybrid surface state.


title: A compact analytical approximation for a light sterile neutrino oscillation in matter

abstract: The existence of light sterile neutrinos is a long standing question for particle physics. Several experimental ``anomalies'' could be explained by introducing ~eV mass scaled light sterile neutrinos. Many experiments are actively hunting for such light sterile neutrinos through neutrino oscillation. For long baseline experiments, matter effect needs to be treated carefully for precise neutrino oscillation probability calculation. However, it is usually time-consuming or analytical complexity. In this manuscript we adopt the Jacobi-like method to diagonalize the Hermitian Hamiltonian matrix and derive analytically simplified neutrino oscillation probabilities for 3 (active) + 1 (sterile)-neutrino mixing for a constant matter density. These approximations can reach quite high numerical accuracy while keeping its analytical simplicity and fast computing speed. It would be useful for the current and future long baseline neutrino oscillation experiments.


title: Giant anisotropic magnetoresistance and nonvolatile memory in canted antiferromagnet Sr2IrO4

abstract: Antiferromagnets have been generating intense interest in the spintronics community, owing to their intrinsic appealing properties like zero stray field and ultrafast spin dynamics. While the control of antiferromagnetic (AFM) orders has been realized by various means, applicably appreciated functionalities on the readout side of AFM-based devices are urgently desired. Here, we report the remarkably enhanced anisotropic magnetoresistance (AMR) as giant as ~ 160% in a simple resistor structure made of AFM Sr2IrO4 without auxiliary reference layer. The underlying mechanism for the giant AMR is an indispensable combination of atomic scale giant-MR-like effect and magnetocrystalline anisotropy energy, which was not accessed earlier. Furthermore, we demonstrate the bistable nonvolatile memory states that can be switched in-situ without the inconvenient heat-assisted procedure, and robustly preserved even at zero magnetic field, due to the modified interlayer coupling by 1% Ga-doping in Sr2IrO4. These findings represent a straightforward step toward the AFM spintronic devices.


title: Sequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks

abstract: Sequential labeling-based NER approaches restrict each word belonging to at most one entity mention, which will face a serious problem when recognizing nested entity mentions. In this paper, we propose to resolve this problem by modeling and leveraging the head-driven phrase structures of entity mentions, i.e., although a mention can nest other mentions, they will not share the same head word. Specifically, we propose Anchor-Region Networks (ARNs), a sequence-to-nuggets architecture for nested mention detection. ARNs first identify anchor words (i.e., possible head words) of all mentions, and then recognize the mention boundaries for each anchor word by exploiting regular phrase structures. Furthermore, we also design Bag Loss, an objective function which can train ARNs in an end-to-end manner without using any anchor word annotation. Experiments show that ARNs achieve the state-of-the-art performance on three standard nested entity mention detection benchmarks.


title: Superfast Approximate Linear Least Squares Solution of a Highly Overdetermined Linear System of Equations

abstract: With a high probability the Sarlos randomized algorithm of 2006 outputs a nearly optimal least squares solution of a highly overdeterminedlinear system of equations. We propose its simple deterministic variation which computes such a solution for a random input whp and therefore computes it deterministically for a large input class. Unlike the Sarlos original algorithm our variation performs computations at sublinear cost or, as we say, superfast, that is, by using much fewer memory cells and arithmetic operations than an input matrix has entries. Our extensive tests are in good accordance with this result.


title: Generalized Data Augmentation for Low-Resource Translation

abstract: Translation to or from low-resource languages LRLs poses challenges for machine translation in terms of both adequacy and fluency. Data augmentation utilizing large amounts of monolingual data is regarded as an effective way to alleviate these problems. In this paper, we propose a general framework for data augmentation in low-resource machine translation that not only uses target-side monolingual data, but also pivots through a related high-resource language HRL. Specifically, we experiment with a two-step pivoting method to convert high-resource data to the LRL, making use of available resources to better approximate the true data distribution of the LRL. First, we inject LRL words into HRL sentences through an induced bilingual dictionary. Second, we further edit these modified sentences using a modified unsupervised machine translation framework. Extensive experiments on four low-resource datasets show that under extreme low-resource settings, our data augmentation techniques improve translation quality by up to~1.5 to~8 BLEU points compared to supervised back-translation baselines


title: BDNet: Bengali Handwritten Numeral Digit Recognition based on Densely connected Convolutional Neural Networks

abstract: Images of handwritten digits are different from natural images as the orientation of a digit, as well as similarity of features of different digits, makes confusion. On the other hand, deep convolutional neural networks are achieving huge success in computer vision problems, especially in image classification. BDNet is a densely connected deep convolutional neural network model used to classify (recognize) Bengali handwritten numeral digits. It is end-to-end trained using ISI Bengali handwritten numeral dataset. During training, untraditional data preprocessing and augmentation techniques are used so that the trained model works on a different dataset. The model has achieved the test accuracy of 99.775%(baseline was 99.40%) on the test dataset of ISI Bengali handwritten numerals. So, the BDNet model gives 62.5% error reduction compared to previous state-of-the-art models. Here we have also created a dataset of 1000 images of Bengali handwritten numerals to test the trained model, and it giving promising results. Codes, trained model and our own dataset are available at: {https://github.com/Sufianlab/BDNet}.


title: Intriguing properties of adversarial training at scale

abstract: Adversarial training is one of the main defenses against adversarial attacks. In this paper, we provide the first rigorous study on diagnosing elements of adversarial training, which reveals two intriguing properties. First, we study the role of normalization. Batch normalization (BN) is a crucial element for achieving state-of-the-art performance on many vision tasks, but we show it may prevent networks from obtaining strong robustness in adversarial training. One unexpected observation is that, for models trained with BN, simply removing clean images from training data largely boosts adversarial robustness, i.e., 18.3%. We relate this phenomenon to the hypothesis that clean images and adversarial images are drawn from two different domains. This two-domain hypothesis may explain the issue of BN when training with a mixture of clean and adversarial images, as estimating normalization statistics of this mixture distribution is challenging. Guided by this two-domain hypothesis, we show disentangling the mixture distribution for normalization, i.e., applying separate BNs to clean and adversarial images for statistics estimation, achieves much stronger robustness. Additionally, we find that enforcing BNs to behave consistently at training and testing can further enhance robustness. Second, we study the role of network capacity. We find our so-called "deep" networks are still shallow for the task of adversarial learning. Unlike traditional classification tasks where accuracy is only marginally improved by adding more layers to "deep" networks (e.g., ResNet-152), adversarial training exhibits a much stronger demand on deeper networks to achieve higher adversarial robustness. This robustness improvement can be observed substantially and consistently even by pushing the network capacity to an unprecedented scale, i.e., ResNet-638.


title: Quantization of Hydrodynamics: Rotating Superfluid and Gravitational Anomaly

abstract: We present a consistent scheme of quantization of chiral flows (flows with extensive vorticity) in ideal hydrodynamics in two dimensions. Chiral flows occur in rotating superfluid, rotating turbulence and also in electronic systems in the magnetic field in the regime of a fractional Hall effect. The quantization is based on a geometric relation of chiral flows to two-dimensional quantum gravity and is implemented by the gravitational anomaly. The effect of the gravitational anomaly violates the major property of classical hydrodynamics, the Helmholtz law: vortices are no longer frozen into the flow. Effects of quantization could be cast in the form of quantum stress. We show that the quantum stress generates Virasoro algebra, the centrally extended algebra of holomorphic diffeomorphisms.


title: Haagerup property for wreath products constructed with Thompson's groups

abstract: Using recent techniques introduced by Jones we prove that a large family of discrete groups and groupoids have the Haagerup property. In particular, we show that if G is a discrete group with the Haagerup property, then the wreath product $\oplus_{Q_2}G\rtimes V$ obtained from the group G and the usual action of Thompson's group V on the dyadic rational $Q_2$ of the unit interval has the Haagerup property.


title: Exact solutions of the Wheeler-DeWitt equation with ordering term in a dark energy scenario

abstract: We investigate the quantum evolution of the universe in the presence of two types of dark energies. First, we consider the phantom class ($\omega<-1$) which would be responsible for a super-accelerated cosmic expansion, and then we apply the procedure to an ordinary $\Lambda>0$ vacuum ($\omega=-1$). This is done by analytically solving the Wheeler-DeWitt equation with ordering term (WdW) in the cosmology of Friedmann-Robertson-Walker. In this paper, we find exact solutions in the scale factor $a$ and the ordering parameter $q$. For $q=1$ it is shown that the universe has a high probability of evolving from a big bang singularity. On the other hand, for $q = 0$ the solution indicates that an initial singularity is unlikely. Instead, the universe has maximal probability of starting with a finite well-defined size which we compute explicitly at primordial times. We also study the time evolution of the scale factor by means of the Hamilton-Jacobi equation and show that an ultimate big rip singularity emerges explicitly from our solutions. The phantom scenario thus predicts a dramatic end in which the universe would reach an infinite scale factor in a finite cosmological time as pointed by Caldwell et al. in a classical setup. Finally, we solve the WdW equation with ordinary constant dark energy and show that in this case the universe does not rip apart in a finite era.


title: Randomization and reweighted $\ell_1$-minimization for A-optimal design of linear inverse problems

abstract: We consider optimal design of PDE-based Bayesian linear inverse problems with infinite-dimensional parameters. We focus on the A-optimal design criterion, defined as the average posterior variance and quantified by the trace of the posterior covariance operator. We propose using structure exploiting randomized methods to compute the A-optimal objective function and its gradient, and provide a detailed analysis of the error for the proposed estimators. To ensure sparse and binary design vectors, we develop a novel reweighted $\ell_1$-minimization algorithm. We also introduce a modified A-optimal criterion and present randomized estimators for its efficient computation. We present numerical results illustrating the proposed methods on a model contaminant source identification problem, where the inverse problem seeks to recover the initial state of a contaminant plume, using discrete measurements of the contaminant in space and time.


title: Trigonal Toda lattice Equation

abstract: In this article, we give the trigonal Toda lattice equation, $$ -\frac{1}{2}\frac{d^3}{d t^3} q_{\ell}(t) = e^{q_{\ell+1}(t)} +e^{q_{\ell+\zeta_3}(t)} +e^{q_{\ell+\zeta_3^2}(t)}-3e^{q_\ell(t)}, $$ for a lattice point $\ell \in \mathbb{Z}[\zeta_3]$ as a directed 6-regular graph where $\zeta_3=e^{2\pi i/3}$, and its elliptic solution for the curve $y(y-s)=x^3$, ($s\neq 0$).


title: Union of Two Arithmetic Progressions with the Same Common Difference Is Not Sum-dominant

abstract: Given a finite set $A\subseteq \mathbb{N}$, define the sum set $$A+A = \{a_i+a_j\mid a_i,a_j\in A\}$$ and the difference set $$A-A = \{a_i-a_j\mid a_i,a_j\in A\}.$$ The set $A$ is said to be sum-dominant if $|A+A|>|A-A|$. We prove the following results. 1) The union of two arithmetic progressions (with the same common difference) is not sum-dominant. This result partially proves a conjecture proposed by the author in a previous paper; that is, the union of any two arbitrary arithmetic progressions is not sum-dominant. 2) Hegarty proved that a sum-dominant set must have at least $8$ elements with computers' help. The author of the current paper provided a human-verifiable proof that a sum-dominant set must have at least $7$ elements. A natural question is about the largest cardinality of sum-dominant subsets of an arithmetic progression. Fix $n\ge 16$. Let $N$ be the cardinality of the largest sum-dominant subset(s) of $\{0,1,\ldots,n-1\}$ that contain(s) $0$ and $n-1$. Then $n-7\le N\le n-4$; that is, from an arithmetic progression of length $n\ge 16$, we need to discard at least $4$ and at most $7$ elements (in a clever way) to have the largest sum-dominant set(s). 3) Let $R\in \mathbb{N}$ have the property that for all $r\ge R$, $\{1,2,\ldots,r\}$ can be partitioned into $3$ sum-dominant subsets, while $\{1,2,\ldots,R-1\}$ cannot. Then $24\le R\le 145$. This result answers a question by the author et al. in another paper on whether we can find a stricter upper bound for $R$.


title: The Broad Optimality of Profile Maximum Likelihood

abstract: We study three fundamental statistical-learning problems: distribution estimation, property estimation, and property testing. We establish the profile maximum likelihood (PML) estimator as the first unified sample-optimal approach to a wide range of learning tasks. In particular, for every alphabet size $k$ and desired accuracy $\varepsilon$: $\textbf{Distribution estimation}$ Under $\ell_1$ distance, PML yields optimal $\Theta(k/(\varepsilon^2\log k))$ sample complexity for sorted-distribution estimation, and a PML-based estimator empirically outperforms the Good-Turing estimator on the actual distribution; $\textbf{Additive property estimation}$ For a broad class of additive properties, the PML plug-in estimator uses just four times the sample size required by the best estimator to achieve roughly twice its error, with exponentially higher confidence; $\boldsymbol{\alpha}\textbf{-R\'enyi entropy estimation}$ For integer $\alpha>1$, the PML plug-in estimator has optimal $k^{1-1/\alpha}$ sample complexity; for non-integer $\alpha>3/4$, the PML plug-in estimator has sample complexity lower than the state of the art; $\textbf{Identity testing}$ In testing whether an unknown distribution is equal to or at least $\varepsilon$ far from a given distribution in $\ell_1$ distance, a PML-based tester achieves the optimal sample complexity up to logarithmic factors of $k$. Most of these results also hold for a near-linear-time computable variant of PML. Stronger results hold for a different and novel variant called truncated PML (TPML).


title: Cell vibron polariton in the myelin sheath of nerve

abstract: Polaritons are arousing tremendous interests in physics and material sciences for their unique and amazing properties, especially including the condensation, lasing without inversion and even room-temperature superfluidity. Herein, we propose a cell vibron polariton (cell-VP): a collectively coherent mode of a photon and all phospholipid molecules in a myelin sheath which is a nervous cell majorly consisting of the phospholipid molecules. Cell-VP can be resonantly self-confined in the myelin sheath under physiological conditions. The observations benefit from the specifically compact, ordered and polar thin-film structure of the sheath, and the relatively strong coupling of the mid-infrared photon with the vibrons of phospholipid tails in the myelin. The underlying physics is revealed to be the collectively coherent superposition of the photon and vibrons, the polariton induced significant enhancement of myelin permittivity, and the resonance of the polariton with the sheath cell. The captured cell-VPs in myelin sheaths may provide a promising way for super-efficient consumption of extra-weak bioenergy and even directly serve for quantum information in the nervous system. These findings further the understanding of neuroscience on the cellular level from the view of quantum mechanics.


title: Spin Seebeck effect in paramagnets and antiferromagnets at elevated temperatures

abstract: We develop a theory of the spin Seebeck effect (SSE) in paramagnets as well as in antiferromagnets at elevated temperatures where the classical limit of the fluctuation-dissipation theorem is applicable. Employing dissipative stochastic models that are valid at these temperatures, we calculate the SSE signal, and we find that both the paramagnetic SSE and the antiferromagnetic SSE are expressed by a single equation that is proportional to the external magnetic field times the spin susceptibility of the magnet. The present result suggests the appearance of a cusp structure at the Neel temperature in the antiferromagnetic SSE signal.


title: Annulus Maximal Averages on Variable Hyperplanes

abstract: By giving a thin width of $0<\delta\ll 1$ to both a unit circle and a unit line, we set an annulus and a tube on the Euclidean plane $\mathbb{R}^2$. Consider the maximal means $M_\delta$ over dilations of the annulus, and $N_\delta$ over rotations of the tube. It is known that their operator norms on $L^2(\mathbb{R}^2)$ are $O(|\log 1/\delta|^{1/2})$. In this paper, we study the maximal averages $\mathcal{M}^A_\delta$ and $\mathcal{N}^A_\delta$ over those annuli and tubes now imbedded on the variable hyperplanes $(x,x_3)+\left\{\left(y, \langle A(x), y\rangle\right): y\in\mathbb{R}^2\right\}\subset \mathbb{R}^3$ where $A$ is a $2\times 2$ matrix. The model hyperplane is the horizontal plane of the Heisenberg group when $A$ is the skew--symmetric matrix denoted by $E$. It turns out that a rank of matrix $EA+(EA)^T$ or $A+A^T$ determines $\|\mathcal{M}^A_\delta\|_{op} $ or $\|\mathcal{N}^A_\delta\|_{op}$ respectively. In the higher dimension, the corresponding spherical maximal means is bounded in $L^p$ if $A$ has only complex eigenvalues.


title: Elliptic variational problems with mixed nonlinearities

abstract: In this paper, we study the existence and multiplicity results of nontrivial positive solutions to a quasilinear elliptic equation in $\RN$, when $N\geq2$, as \begin{equation} \Lp u+u^{p-1}=\lambda\hspace{0.2mm}k(x)u^{r-1}-h(x)u^{q-1}.\nonumber \end{equation} Here, $h(x),k(x)>0$ are Lebesgue measurable functions, $1<p<q<\infty$, $p<r<\min\{p^*,q\}$ if $p<N$ while $p<r<q$ if $p\geq N$, and $\lambda>0$ is a parameter.


title: Fast Spatially-Varying Indoor Lighting Estimation

abstract: We propose a real-time method to estimate spatiallyvarying indoor lighting from a single RGB image. Given an image and a 2D location in that image, our CNN estimates a 5th order spherical harmonic representation of the lighting at the given location in less than 20ms on a laptop mobile graphics card. While existing approaches estimate a single, global lighting representation or require depth as input, our method reasons about local lighting without requiring any geometry information. We demonstrate, through quantitative experiments including a user study, that our results achieve lower lighting estimation errors and are preferred by users over the state-of-the-art. Our approach can be used directly for augmented reality applications, where a virtual object is relit realistically at any position in the scene in real-time.


title: Three-Dimensional Yielding in Anisotropic Materials: Validation of Hill Criterion

abstract: Yielding transition in isotropic soft materials under superposition of orthogonal deformation fields is known to follow von Mises criterion. However, in anisotropic soft materials von Mises criterion fails owing to preferred directions associated with the system. In this work we study a model anisotropic yield stress system: electrorheological (ER) fluids that show structure formation in the direction of electric field. We subject the ER fluids to superposition of orthogonal stress fields that leads to different yield stress values. We obtain a yielding state diagram by plotting normalized rotational shear stress against normalized radial shear stress corresponding to yield point for a given electric field. Remarkably, the state diagram validates the Hill yielding criterion, which is a general yielding criterion for materials having anisotropy along three orthogonal directions, originally developed for metallic systems. Validation of Hill criterion suggests the universality of its application to anisotropic systems including conventional anisotropic soft materials having yield stress.

categories: cond-mat.soft cond-mat.mtrl-sci physics.chem-ph physics.flu-dyn


title: The environment of supernova remnant VRO 42.05.01 as probed with IRAM 30m molecular line observations

abstract: The environment of supernova remnants (SNRs) is a key factor in their evolution, particularly at later stages of their existence. It is often assumed that mixed-morphology (MM) SNRs evolve in very dense environments, and that their centre-filled X-ray morphology is due to interactions between the SNRs and their surroundings. We aim to determine whether MMSNR VRO 42.05.01 is embedded in, and interacting with, a dense molecular environment. We used the IRAM telescope in Pico Veleta, Spain, to search for interaction between the SNR and neighbouring molecular clouds. We observed a region of $26'\times14'$ towards the west of VRO 42.05.01 and a region of $8'\times4'$ towards the north of the remnant in the $^{12}$CO $J=1-0$, $^{13}$CO $J=1-0$, and $^{12}$CO $J=2-1$ transitions with the EMIR receiver. We made maps of the properties of the observed molecular clouds (peak temperatures, central velocities, velocity dispersions), column density along the line of sight, and ratio of the $^{12}$CO $J=2-1$ to $^{12}$CO $J=1-0$ transitions. We analyse archival optical, infrared, and radio spectroscopic data for other hints on the nature of the medium. We do not find conclusive physical proof that the SNR is interacting with the few, clumpy molecular clouds that surround it in the region of our observations, although there is some suggestion of such interaction (in a region outside our map) from infrared emission. There is a velocity gradient in one of the molecular clouds that is consistent with a stellar wind blown by a $12-14$ $M_{\odot}$ progenitor star. We reassess the literature distance to VRO 42.05.01, and propose that it has a local standard of rest velocity of $-6$ km s$^{-1}$, and that it is located $1.0\pm0.4$ kpc away (the earlier distance value was $4.5\pm1.5$ kpc). We find that a dust sheet intersects VRO 42.05.01 and is possibly related to its double shell-shaped morphology.


title: Successive Symmetry Breaking in a Jeff = 3/2 Quartet in the Spin-Orbit Coupled Insulator Ba2MgReO6

abstract: We report on the cubic double perovskite Ba2MgReO6 containing Re6+ ions with the 5d1 electron configuration. Resistivity, magnetization, and heat capacity measurements using single crystals show that the compound is a Mott insulator with a magnetic transition at Tm = 18 K, which is accompanied by a weak ferromagnetic moment with [110] anisotropy. Another transition is observed at Tq = 33 K in heat capacity, where the inverse of magnetic susceptibility changes its slope, indicating a substantial change in the electronic state. The significance of spin-orbit coupling is revealed by the reduced effective magnetic moment of ~0.68{\mu}B at high temperature above Tq and the total electronic entropy close to Rln4. These features indicate that Ba2MgReO6 is a spin-orbit coupled Mott insulator possessing a Jeff = 3/2 quartet state, which exhibits quadrupolar and dipolar orders at Tq and Tm, respectively.


title: Rotating Equilibria of Vortex Sheets

abstract: We consider relative equilibrium solutions of the two-dimensional Euler equations in which the vorticity is concentrated on a union of finite-length vortex sheets. Using methods of complex analysis, more specifically the theory of the Riemann-Hilbert problem, a general approach is proposed to find such equilibria which consists of two steps: first, one finds a geometric configuration of vortex sheets ensuring that the corresponding circulation density is real-valued and also vanishes at all sheet endpoints such that the induced velocity field is well-defined; then, the circulation density is determined by evaluating a certain integral formula. As an illustration of this approach, we construct a family of rotating equilibria involving different numbers of straight vortex sheets rotating about a common center of rotation and with endpoints at the vertices of a regular polygon. This equilibrium generalizes the well-known solution involving single rotating vortex sheet. With the geometry of the configuration specified analytically, the corresponding circulation densities are obtained in terms of a integral expression which in some cases lends itself to an explicit evaluation. It is argued that as the number of sheets in the equilibrium configuration increases to infinity, the equilibrium converges in a certain distributional sense to a hollow vortex bounded by a constant-intensity vortex sheet, which is also a known equilibrium solution of the two-dimensional Euler equations.


title: Model-Based Reinforcement Learning with a Generative Model is Minimax Optimal

abstract: This work considers the sample and computational complexity of obtaining an $\epsilon$-optimal policy in a discounted Markov Decision Process (MDP), given only access to a generative model. In this work, we study the effectiveness of the most natural plug-in approach to model-based planning: we build the maximum likelihood estimate of the transition model in the MDP from observations and then find an optimal policy in this empirical MDP. We ask arguably the most basic and unresolved question in model based planning: is the naive "plug-in" approach, non-asymptotically, minimax optimal in the quality of the policy it finds, given a fixed sample size? Here, the non-asymptotic regime refers to when the sample size is sublinear in the model size. With access to a generative model, we resolve this question in the strongest possible sense: our main result shows that \emph{any} high accuracy solution in the plug-in model constructed with $N$ samples, provides an $\epsilon$-optimal policy in the true underlying MDP (where $\epsilon$ is the minimax accuracy with $N$ samples at every state, action pair). In comparison, all prior (non-asymptotically) minimax optimal results use model free approaches, such as the Variance Reduced Q-value iteration algorithm (Sidford et al 2018), while the best known model-based results (e.g. Azar et al 2013) require larger sample sizes in their dependence on the planning horizon or the state space. Notably, we show that the model-based approach allows the use of \emph{any} efficient planning algorithm in the empirical MDP, which simplifies algorithm design as this approach does not tie the algorithm to the sampling procedure. The core of our analysis is avnovel "absorbing MDP" construction to address the statistical dependency issues that arise in the analysis of model-based planning approaches, a construction which may be helpful more generally.


title: Improving Neural Language Modeling via Adversarial Training

abstract: Recently, substantial progress has been made in language modeling by using deep neural networks. However, in practice, large scale neural language models have been shown to be prone to overfitting. In this paper, we present a simple yet highly effective adversarial training mechanism for regularizing neural language models. The idea is to introduce adversarial noise to the output embedding layer while training the models. We show that the optimal adversarial noise yields a simple closed-form solution, thus allowing us to develop a simple and time efficient algorithm. Theoretically, we show that our adversarial mechanism effectively encourages the diversity of the embedding vectors, helping to increase the robustness of models. Empirically, we show that our method improves on the single model state-of-the-art results for language modeling on Penn Treebank (PTB) and Wikitext-2, achieving test perplexity scores of 46.01 and 38.07, respectively. When applied to machine translation, our method improves over various transformer-based translation baselines in BLEU scores on the WMT14 English-German and IWSLT14 German-English tasks.


title: Partially complex ranks for real projective varieties

abstract: Let $X(\mathbb {C})\subset \mathbb {P}^r(\mathbb {C})$ be an integral non-degenerate variety defined over $\mathbb {R}$. For any $q\in \mathbb {P}^r(\mathbb {R})$ we study the existence of $S\subset X(\mathbb {C})$ with small cardinality, invariant for the complex conjugation and with $q$ contained in the real linear space spanned by $S$. We discuss the advantages of these additive decompositions with respect to the $X(\mathbb {R})$-rank, i.e. the rank of $q$ with respect to $X(\mathbb {R})$. We describe the case of hypersurfaces and Veronese varieties.


title: Multiway clustering via tensor block models

abstract: We consider the problem of identifying multiway block structure from a large noisy tensor. Such problems arise frequently in applications such as genomics, recommendation system, topic modeling, and sensor network localization. We propose a tensor block model, develop a unified least-square estimation, and obtain the theoretical accuracy guarantees for multiway clustering. The statistical convergence of the estimator is established, and we show that the associated clustering procedure achieves partition consistency. A sparse regularization is further developed for identifying important blocks with elevated means. The proposal handles a broad range of data types, including binary, continuous, and hybrid observations. Through simulation and application to two real datasets, we demonstrate the outperformance of our approach over previous methods.


title: A Closed-Form Learned Pooling for Deep Classification Networks

abstract: In modern computer vision tasks, convolutional neural networks (CNNs) are indispensable for image classification tasks due to their efficiency and effectiveness. Part of their superiority compared to other architectures, comes from the fact that a single, local filter is shared across the entire image. However, there are scenarios where we may need to treat spatial locations in non-uniform manner. We see this in nature when considering how humans have evolved foveation to process different areas in their field of vision with varying levels of detail. In this paper we propose a way to enable CNNs to learn different pooling weights for each pixel location. We do so by introducing an extended definition of a pooling operator. This operator can learn a strict super-set of what can be learned by average pooling or convolutions. It has the benefit of being shared across feature maps and can be encouraged to be local or diffuse depending on the data. We show that for fixed network weights, our pooling operator can be computed in closed-form by spectral decomposition of matrices associated with class separability. Through experiments, we show that this operator benefits generalization for ResNets and CNNs on the CIFAR-10, CIFAR-100 and SVHN datasets and improves robustness to geometric corruptions and perturbations on the CIFAR-10-C and CIFAR-10-P test sets.


title: Anomalous electron transport in epitaxial NdNiO$_3$ films

abstract: The origin of simultaneous electronic, structural and magnetic transitions in bulk rare-earth nickelates ($RE$NiO$_3$) remains puzzling with multiple conflicting reports on the nature of these entangled phase transitions. Heterostructure engineering of these materials offers unique opportunity to decouple metal-insulator transition (MIT) from the magnetic transition. However, the evolution of underlying electronic properties across these decoupled transitions remains largely unexplored. In order to address this, we have measured Hall effect on a series of epitaxial NdNiO$_3$ films, spanning a variety of electronic and magnetic phases. We find that the MIT results in only partially gapped Fermi surface, whereas full insulating phase forms below the magnetic transition. In addition, we also find a systematic reduction of the Hall coefficient ($R_H$) in the metallic phase of these films with epitaxial strain and also a surprising transition to negative value at large compressive strain. Partially gapped weakly insulating, paramagnetic phase is reminiscence of pseudogap behavior of high $T_c$ cuprates. The precursor metallic phase, which undergoes transition to insulating phase is a non-Fermi liquid with the temperature exponent ($n$) of resistivity of 1, whereas the exponent increases to 4/3 in the non-insulating samples. Such nickelate phase diagram with sign-reversal of $R_H$, pseudo-gap phase and non Fermi liquid behavior are intriguingly similar to high $T_c$ cuprates, giving important guideline to engineer unconventional superconductivity in oxide heterostructure.


title: Long-time behavior for three dimensional compressible viscous and heat-conductive gases

abstract: We study the large-time behavior of solutions to the compressible Navier-Stokes equations for a viscous and heat-conductive gases in $\mathbb{R}^3$. More precisely, under a suitable additional condition involving only the low frequencies of the initial data, we exhibit the optimal time decay rates for the constructed global solutions. The proof relies on some new energy arguments developed by Xin and Xu [39] for the compressible Navier-Stokes equations.


title: Control of A High Performance Bipedal Robot using Viscoelastic Liquid Cooled Actuators

abstract: This paper describes the control, and evaluation of a new human-scaled biped robot with liquid cooled viscoelastic actuators (VLCA). Based on the lessons learned from previous work from our team on VLCA [1], we present a new system design embodying a Reaction Force Sensing Series Elastic Actuator (RFSEA) and a Force Sensing Series Elastic Actuator (FSEA). These designs are aimed at reducing the size and weight of the robot's actuation system while inheriting the advantages of our designs such as energy efficiency, torque density, impact resistance and position/force controllability. The system design takes into consideration human-inspired kinematics and range-of-motion (ROM), while relying on foot placement to balance. In terms of actuator control, we perform a stability analysis on a Disturbance Observer (DOB) designed for force control. We then evaluate various position control algorithms both in the time and frequency domains for our VLCA actuators. Having the low level baseline established, we first perform a controller evaluation on the legs using Operational Space Control (OSC) [2]. Finally, we move on to evaluating the full bipedal robot by accomplishing unsupported dynamic walking by means of the algorithms to appear in [3].


title: Data-Efficient and Safe Learning for Humanoid Locomotion Aided by a Dynamic Balancing Model

abstract: In this letter, we formulate a novel Markov Decision Process (MDP) for safe and data-efficient learning for humanoid locomotion aided by a dynamic balancing model. In our previous studies of biped locomotion, we relied on a low-dimensional robot model, commonly used in high-level Walking Pattern Generators (WPGs). However, a low-level feedback controller cannot precisely track desired footstep locations due to the discrepancies between the full order model and the simplified model. In this study, we propose mitigating this problem by complementing a WPG with reinforcement learning. More specifically, we propose a structured footstep control method consisting of a WPG, a neural network, and a safety controller. The WPG provides an analytical method that promotes efficient learning while the neural network maximizes long-term rewards, and the safety controller encourages safe exploration based on step capturability and the use of control-barrier functions. Our contributions include the following (1) a structured learning control method for locomotion, (2) a data-efficient and safe learning process to improve walking using a physics-based model, and (3) the scalability of the procedure to various types of humanoid robots and walking.


title: Sampling Humans for Optimizing Preferences in Coloring Artwork

abstract: Many circumstances of practical importance have performance or success metrics which exist implicitly---in the eye of the beholder, so to speak. Tuning aspects of such problems requires working without defined metrics and only considering pairwise comparisons or rankings. In this paper, we review an existing Bayesian optimization strategy for determining most-preferred outcomes, and identify an adaptation to allow it to handle ties. We then discuss some of the issues we have encountered when humans use this optimization strategy to optimize coloring a piece of abstract artwork. We hope that, by participating in this workshop, we can learn how other researchers encounter difficulties unique to working with humans in the loop.


title: Learned Conjugate Gradient Descent Network for Massive MIMO Detection

abstract: In this work, we consider the use of model-driven deep learning techniques for massive multiple-input multiple-output (MIMO) detection. Compared with conventional MIMO systems, massive MIMO promises improved spectral efficiency, coverage and range. Unfortunately, these benefits are coming at the cost of significantly increased computational complexity. To reduce the complexity of signal detection and guarantee the performance, we present a learned conjugate gradient descent network (LcgNet), which is constructed by unfolding the iterative conjugate gradient descent (CG) detector. In the proposed network, instead of calculating the exact values of the scalar step-sizes, we explicitly learn their universal values. Also, we can enhance the proposed network by augmenting the dimensions of these step-sizes. Furthermore, in order to reduce the memory costs, a novel quantized LcgNet is proposed, where a low-resolution nonuniform quantizer is integrated into the LcgNet to smartly quantize the aforementioned step-sizes. The quantizer is based on a specially designed soft staircase function with learnable parameters to adjust its shape. Meanwhile, due to fact that the number of learnable parameters is limited, the proposed networks are easy and fast to train. Numerical results demonstrate that the proposed network can achieve promising performance with much lower complexity.


title: Learning to Segment Skin Lesions from Noisy Annotations

abstract: Deep convolutional neural networks have driven substantial advancements in the automatic understanding of images. Requiring a large collection of images and their associated annotations is one of the main bottlenecks limiting the adoption of deep networks. In the task of medical image segmentation, requiring pixel-level semantic annotations performed by human experts exacerbate this difficulty. This paper proposes a new framework to train a fully convolutional segmentation network from a large set of cheap unreliable annotations and a small set of expert-level clean annotations. We propose a spatially adaptive reweighting approach to treat clean and noisy pixel-level annotations commensurately in the loss function. We deploy a meta-learning approach to assign higher importance to pixels whose loss gradient direction is closer to those of clean data. Our experiments on training the network using segmentation ground truth corrupted with different levels of annotation noise show how spatial reweighting improves the robustness of deep networks to noisy annotations.


title: Note on generating functions and connected correlators of 1/2-BPS Wilson loops in $\mathcal{N}=4$ SYM theory

abstract: The generating functions for the Wilson loops in the symmetric and antisymmetric representations of the gauge group $U(N)$ are expressed in terms of the connected correlators of multiply-wound Wilson loops, using ingredients from the representation theory of the symmetric group. This provides a proof of a recent observation by Okuyama. As a by-product, we present a new calculation of the connected 2-point correlator of multiply-wound Wilson loops at leading order in $1/N$.


title: Random Access for Massive Machine-Type Communications

abstract: The thesis is dedicated to studying methods to improve the efficiency of random access schemes and to facilitate their deployment in machine-type communications (MTC). First, a joint user activity identification and channel estimation scheme is designed for grant-free random access systems. We propose a decentralized transmission control and design a compressed sensing (CS)-based user identification and channel estimation scheme. We analyze the packet delay and throughput of the proposed scheme. We also optimize the transmission control scheme to maximize the system throughput. Second, a random access scheme, i.e., the coded slotted ALOHA (CSA) scheme, is designed for erasure channels to improve the system throughput. By deriving the extrinsic information transfer (EXIT) functions and optimizing their convergence behavior, we design the code probability distributions for CSA schemes with repetition codes and maximum distance separable (MDS) codes to maximize the expected traffic load, under packet erasure and slot erasure channels. We derive the asymptotic throughput of CSA schemes over the erasure channels for an infinite frame length, which is verified to well approximate the throughput for a practical frame length. Third, an efficient data decoding algorithm for the CSA scheme is proposed to further improve the system efficiency. We present a low-complexity physical-layer network coding (PNC) method to obtain linear combinations of collided packets and design an enhanced message-level successive interference cancellation (SIC) algorithm to exploit the linear combinations of collided packets. We propose an analytical framework and derive the system throughput for the proposed scheme. The CSA scheme is further optimized to maximize the system throughput and energy efficiency.


title: Poly-$\mathbb{Z}$ group actions on Kirchberg algebras II

abstract: This is the second part of our serial work on the classification of poly-$\mathbb{Z}$ group actions on Kirchberg algebras. Based on technical results obtained in our previous work, we completely reduce the problem to the classification of continuous fields of Kirchberg algebras over the classifying spaces. As an application, we determine the number of cocycle conjugacy classes of outer $\mathbb{Z}^n$-actions on the Cuntz algebras.


title: FairLedger: A Fair Blockchain Protocol for Financial Institutions

abstract: Financial institutions are currently looking into technologies for permissioned blockchains. A major effort in this direction is Hyperledger, an open source project hosted by the Linux Foundation and backed by a consortium of over a hundred companies. A key component in permissioned blockchain protocols is a byzantine fault tolerant (BFT) consensus engine that orders transactions. However, currently available BFT solutions in Hyperledger (as well as in the literature at large) are inadequate for financial settings; they are not designed to ensure fairness or to tolerate selfish behavior that arises when financial institutions strive to maximize their own profit. We present FairLedger, a permissioned blockchain BFT protocol, which is fair, designed to deal with rational behavior, and, no less important, easy to understand and implement. The secret sauce of our protocol is a new communication abstraction, called detectable all-to-all (DA2A), which allows us to detect participants (byzantine or rational) that deviate from the protocol, and punish them. We implement FairLedger in the Hyperledger open source project, using Iroha framework, one of the biggest projects therein. To evaluate FairLegder's performance, we also implement it in the PBFT framework and compare the two protocols. Our results show that in failure-free scenarios FairLedger achieves better throughput than both Iroha's implementation and PBFT in wide-area settings.


title: Open-Domain Targeted Sentiment Analysis via Span-Based Extraction and Classification

abstract: Open-domain targeted sentiment analysis aims to detect opinion targets along with their sentiment polarities from a sentence. Prior work typically formulates this task as a sequence tagging problem. However, such formulation suffers from problems such as huge search space and sentiment inconsistency. To address these problems, we propose a span-based extract-then-classify framework, where multiple opinion targets are directly extracted from the sentence under the supervision of target span boundaries, and corresponding polarities are then classified using their span representations. We further investigate three approaches under this framework, namely the pipeline, joint, and collapsed models. Experiments on three benchmark datasets show that our approach consistently outperforms the sequence tagging baseline. Moreover, we find that the pipeline model achieves the best performance compared with the other two models.


title: Time-Series Anomaly Detection Service at Microsoft

abstract: Large companies need to monitor various metrics (for example, Page Views and Revenue) of their applications and services in real time. At Microsoft, we develop a time-series anomaly detection service which helps customers to monitor the time-series continuously and alert for potential incidents on time. In this paper, we introduce the pipeline and algorithm of our anomaly detection service, which is designed to be accurate, efficient and general. The pipeline consists of three major modules, including data ingestion, experimentation platform and online compute. To tackle the problem of time-series anomaly detection, we propose a novel algorithm based on Spectral Residual (SR) and Convolutional Neural Network (CNN). Our work is the first attempt to borrow the SR model from visual saliency detection domain to time-series anomaly detection. Moreover, we innovatively combine SR and CNN together to improve the performance of SR model. Our approach achieves superior experimental results compared with state-of-the-art baselines on both public datasets and Microsoft production data.


title: Making Classical Machine Learning Pipelines Differentiable: A Neural Translation Approach

abstract: Classical Machine Learning (ML) pipelines often comprise of multiple ML models where models, within a pipeline, are trained in isolation. Conversely, when training neural network models, layers composing the neural models are simultaneously trained using backpropagation. We argue that the isolated training scheme of ML pipelines is sub-optimal, since it cannot jointly optimize multiple components. To this end, we propose a framework that translates a pre-trained ML pipeline into a neural network and fine-tunes the ML models within the pipeline jointly using backpropagation. Our experiments show that fine-tuning of the translated pipelines is a promising technique able to increase the final accuracy.


title: Noninvasive super-resolution imaging through scattering media

abstract: Super-resolution imaging with advanced optical systems has been revolutionizing technical analysis in various fields from biological to physical sciences. However, many objects are hidden by strongly scattering media such as rough wall corners or biological tissues that scramble light paths, create speckle patterns and hinder object's visualization, let alone super-resolution imaging. Here, we realize a method to do non-invasive super-resolution imaging through scattering media based on stochastic optical scattering localization imaging (SOSLI) technique. Simply by capturing multiple speckle patterns of photo-switchable emitters in our demonstration, the stochastic approach utilizes the speckle correlation properties of scattering media to retrieve an image with more than five-fold resolution enhancement compared to the diffraction limit, while posing no fundamental limit in achieving higher spatial resolution. More importantly, we demonstrate our SOSLI to do non-invasive super-resolution imaging through not only optical diffusers, i.e. static scattering media, but also biological tissues, i.e. dynamic scattering media with decorrelation of up to 80%. Our approach paves the way to non-invasively visualize various samples behind scattering media at unprecedented levels of detail.


title: A Survey on Neural Machine Reading Comprehension

abstract: Enabling a machine to read and comprehend the natural language documents so that it can answer some questions remains an elusive challenge. In recent years, the popularity of deep learning and the establishment of large-scale datasets have both promoted the prosperity of Machine Reading Comprehension. This paper aims to present how to utilize the Neural Network to build a Reader and introduce some classic models, analyze what improvements they make. Further, we also point out the defects of existing models and future research directions


title: Direct Imaging Revealing Halved Ferromagnetism in Tensile-Strained LaCoO3 Thin Films

abstract: The enigma of the emergent ferromagnetic state in tensile-strained LaCoO3 thin films remains to be explored because of the lack of a well agreed explanation. The direct magnetic imaging technique using a low-temperature magnetic force microscope (MFM) is critical to reveal new aspects of the ferromagnetism by investigating the lateral magnetic phase distribution. Here we show the experimental demonstration of the rare halved occupation of the ferromagnetic state in tensile-strained LaCoO3 thin films on SrTiO3 substrates using the MFM. The films have uniformly strained lattice structure and minimal oxygen vacancies (less than 2%) beyond the measurement limit. It is found that percolated ferromagnetic regions with typical sizes between 100 nm and 200 nm occupy about 50% of the entire film, even down to the lowest achievable temperature of 4.5 K and up to the largest magnetic field of 13.4 T. Preformed ferromagnetic droplets were still observed when the temperature is 20 K above the Curie temperature indicating the existence of possible Griffiths phase. Our study demonstrated a sub-micron level phase separation in high quality LaCoO3 thin films, which has substantial implications in revealing the intrinsic nature of the emergent ferromagnetism.


title: Network Implosion: Effective Model Compression for ResNets via Static Layer Pruning and Retraining

abstract: Residual Networks with convolutional layers are widely used in the field of machine learning. Since they effectively extract features from input data by stacking multiple layers, they can achieve high accuracy in many applications. However, the stacking of many layers raises their computation costs. To address this problem, we propose Network Implosion, it erases multiple layers from Residual Networks without degrading accuracy. Our key idea is to introduce a priority term that identifies the importance of a layer; we can select unimportant layers according to the priority and erase them after the training. In addition, we retrain the networks to avoid critical drops in accuracy after layer erasure. A theoretical assessment reveals that our erasure and retraining scheme can erase layers without accuracy drop, and achieve higher accuracy than is possible with training from scratch. Our experiments show that Network Implosion can, for classification on Cifar-10/100 and ImageNet, reduce the number of layers by 24.00 to 42.86 percent without any drop in accuracy.


title: On the Riesz Transforms for the inverse Gauss measure

abstract: Let $\gamma_{-1}$ be the absolutely continuous measure on $\mathbb{R}^n$ whose density is the reciprocal of a Gaussian function. Let further $\mathscr{A}$ be the natural self-adjoint Laplacian on $L^2(\gamma_{-1})$. In this paper, we prove that the Riesz transforms associated with $\mathscr{A}$ of order one or two are of weak type $(1,1)$, but that those of higher order are not.


title: Efficient Bayesian estimation for GARCH-type models via Sequential Monte Carlo

abstract: The advantages of sequential Monte Carlo (SMC) are exploited to develop parameter estimation and model selection methods for GARCH (Generalized AutoRegressive Conditional Heteroskedasticity) style models. It provides an alternative method for quantifying estimation uncertainty relative to classical inference. Even with long time series, it is demonstrated that the posterior distribution of model parameters are non-normal, highlighting the need for a Bayesian approach and an efficient posterior sampling method. Efficient approaches for both constructing the sequence of distributions in SMC, and leave-one-out cross-validation, for long time series data are also proposed. Finally, an unbiased estimator of the likelihood is developed for the Bad Environment-Good Environment model, a complex GARCH-type model, which permits exact Bayesian inference not previously available in the literature.


title: Transfer Learning for Hate Speech Detection in Social Media

abstract: Today, the internet is an integral part of our daily lives, enabling people to be more connected than ever before. However, this greater connectivity and access to information increase exposure to harmful content such as cyber-bullying and cyber-hatred. Models based on machine learning and natural language offer a way to make online platforms safer by identifying hate speech in web text autonomously. However, the main difficulty is annotating a sufficiently large number of examples to train these models. This paper uses a transfer learning technique to leverage two independent datasets jointly and builds a single representation of hate speech. We build an interpretable two-dimensional visualization tool of the constructed hate speech representation -- dubbed the Map of Hate -- in which multiple datasets can be projected and comparatively analyzed. The hateful content is annotated differently across the two datasets (racist and sexist in one dataset, hateful and offensive in another). However, the common representation successfully projects the harmless class of both datasets into the same space and can be used to uncover labeling errors (false positives). We also show that the joint representation boosts prediction performances when only a limited amount of supervision is available. These methods and insights hold the potential for safer social media and reduce the need to expose human moderators and annotators to distressing online messaging.


title: Stochastic Mirror Descent on Overparameterized Nonlinear Models: Convergence, Implicit Regularization, and Generalization

abstract: Most modern learning problems are highly overparameterized, meaning that there are many more parameters than the number of training data points, and as a result, the training loss may have infinitely many global minima (parameter vectors that perfectly interpolate the training data). Therefore, it is important to understand which interpolating solutions we converge to, how they depend on the initialization point and the learning algorithm, and whether they lead to different generalization performances. In this paper, we study these questions for the family of stochastic mirror descent (SMD) algorithms, of which the popular stochastic gradient descent (SGD) is a special case. Our contributions are both theoretical and experimental. On the theory side, we show that in the overparameterized nonlinear setting, if the initialization is close enough to the manifold of global minima (something that comes for free in the highly overparameterized case), SMD with sufficiently small step size converges to a global minimum that is approximately the closest one in Bregman divergence. On the experimental side, our extensive experiments on standard datasets and models, using various initializations, various mirror descents, and various Bregman divergences, consistently confirms that this phenomenon happens in deep learning. Our experiments further indicate that there is a clear difference in the generalization performance of the solutions obtained by different SMD algorithms. Experimenting on a standard image dataset and network architecture with SMD with different kinds of implicit regularization, $\ell_1$ to encourage sparsity, $\ell_2$ yielding SGD, and $\ell_{10}$ to discourage large components in the parameter vector, consistently and definitively shows that $\ell_{10}$-SMD has better generalization performance than SGD, which in turn has better generalization performance than $\ell_1$-SMD.


title: Explicit behaviors affected by driver's trust in a driving automation system

abstract: As various driving automation system (DAS) are commonly used in the vehicle, the over-trust in the DAS may put the driver in the risk. In order to prevent the over-trust while driving, the trust state of the driver should be recognized. However, description variables of the trust state are not distinct. This paper assumed that the outward expressions of a driver can represent the trust state of him/her-self. The explicit behaviors when driving with DAS is seen as those outward expressions. In the experiment, a driving simulator with a driver monitoring system was used for simulating a vehicle with the adaptive cruise control (ACC) and observing the motion information of the driver. Results show that if the driver completely trusted in the ACC, then 1) the participants were likely to put their feet far away from the pedals; 2) the operational intervention of the driver will delay in dangerous situations. In the future, a machine learning model will be tried to predict the trust state by using the motion information of the driver.


title: Asymmetry of non-local dissipation: From drift-diffusion to hydrodynamics

abstract: We study dissipation in inhomogeneous two-dimensional electron systems. We predict a relatively strong current-induced spatial asymmetry in the heating of the electron and phonon systems -- even if the inhomogeneity responsible for the electrical resistance is symmetric with respect to the current direction. We also show that the heat distributions in the hydrodynamic and impurity-dominated limits are essentially different. In particular, within a wide, experimentally relevant interval of driving fields, the dissipation profile in the hydrodynamic limit turns out to be asymmetric, and the characteristic spatial scale of the temperature distribution can be controlled by the driving field. By contrast, in the same range of parameters, impurity-dominated heating is almost symmetric, with the size of the dissipation region being independent of the field. This allows one to distinguish experimentally the hydrodynamic and impurity-dominated limits. Our results are consistent with recent experimental findings on transport and dissipation in narrow constrictions and quantum point contacts.


title: Cumulants and Scaling Functions of Infinite Matrix Product States

abstract: The order parameter cumulants of infinite matrix product ground states are evaluated across a quantum phase transition. A scheme using the Binder cumulant, finite-entanglement scaling and scaling functions to obtain the critical point and exponents of the correlation length and cumulants is presented. Analogous to the scaling relations that relate the exponents of various thermodynamic quantities, a cumulant exponent relation is derived and used to check the consistency and relationship between the cumulant exponents. This scheme gives a numerically economical way of accurately obtaining the critical exponents. Examples of this scheme are shown for four one-dimensional models - the transverse field Ising model, the topological Kondo insulator, the S = 1 Heisenberg chain with single-ion anisotropy and the Bose-Hubbard model. A two-dimensional model is also exemplified in the square lattice transverse field Ising model on an infinite cylinder. These exemplary systems portray a variety of local and string order parameters as well as phase transition classes that can be studied with the scaling functions and infinite matrix product states.


title: Quantum algorithm for logistic regression

abstract: Logistic regression (LR) is an important machine learning model for classification, with wide applications in text classification, image analysis and medicine diagnosis, etc. However, training LR generally entails an iterative gradient descent method, and is quite time consuming when processing big data sets. To solve this problem, we present a quantum algorithm for LR to implement the key task of the gradient descent method, obtaining the classical gradients in each iteration. It is shown that our algorithm achieves exponential speedup over its classical counterpart in each iteration when the dimension of each data point M grows polylogarithmically with the number of data points N, i.e.,M=O(polylog N). It is worth noting that the optimal model parameters are finally derived by performing simple calculations on the obtained gradients. So once the optimal model parameters are determined, one can use them to classify new data at little cost.


title: SAR: Learning Cross-Language API Mappings with Little Knowledge

abstract: To save manual effort, developers often translate programs from one programming language to another, instead of implementing it from scratch. Translating application program interfaces (APIs) used in one language to functionally equivalent ones available in another language is an important aspect of program translation. Existing approaches facilitate the translation by automatically identifying the API mappings across programming languages. However, all these approaches still require large amount of manual effort in preparing parallel program corpora, ranging from pairs of APIs, to manually identified code in different languages that are considered as functionally equivalent. To minimize the manual effort in identifying parallel program corpora and API mappings, this paper aims at an automated approach to map APIs across languages with much less knowledge a priori needed than other existing approaches. The approach is based on an realization of the notion of domain adaption combined with code embedding, which can better align two vector spaces: taking as input large sets of programs, our approach first generates numeric vector representations of the programs, especially the APIs used in each language, and it adapts generative adversarial networks (GAN) to align the vectors from the spaces of two languages. For a better alignment, we initialize the GAN with parameters derived from optional API mapping seeds that can be identified accurately with a simple automatic signature-based matching heuristic. Then the cross-language API mappings can be identified via nearest-neighbors queries in the aligned vector spaces.


title: Minimal Session Types (Extended Version)

abstract: Session types are a type-based approach to the verification of message-passing programs. They have been much studied as type systems for the pi-calculus and for languages such as Java. A session type specifies what and when should be exchanged through a channel. Central to session-typed languages are constructs in types and processes that specify sequencing in protocols. Here we study minimal session types, session types without sequencing. This is arguably the simplest form of session types. By relying on a core process calculus with sessions and higher-order concurrency (abstraction passing), we prove that every process typable with usual (non minimal) session types can be compiled down into a process typed with minimal session types. This means that having sequencing constructs in both processes and session types is redundant; only sequentiality in processes is indispensable, as it can precisely codify sequentiality in types. Our developments draw inspiration from work by Parrow on behavior-preserving decompositions of untyped processes. By casting Parrow's results in the realm of typed processes, our results reveal a conceptually simple formulation of session types and a principled avenue to the integration of session types into languages without sequencing in types.