title: Meet Malexa, Alexa's Malicious Twin: Malware-Induced Misperception Through Intelligent Voice Assistants

abstract: This paper reports the findings of a study where users (N=220) interacted with Malexa, Alexa's malicious twin. Malexa is an intelligent voice assistant with a simple and seemingly harmless third-party skill that delivers news briefings to users. The twist, however, is that Malexa covertly rewords these briefings to intentionally introduce misperception about the reported events. This covert rewording is referred to as a Malware-Induced Misperception (MIM) attack. It differs from squatting or invocation hijacking attacks in that it is focused on manipulating the "content" delivered through a third-party skill instead of the skill's "invocation logic." Malexa, in the study, reworded regulatory briefings to make a government response sound more accidental or lenient than the original news delivered by Alexa. The results show that users who interacted with Malexa perceived that the government was less friendly to working people and more in favor of big businesses. The results also show that Malexa is capable of inducing misperceptions regardless of the user's gender, political ideology or frequency of interaction with intelligent voice assistants. We discuss the implications in the context of using Malexa as a covert "influencer" in people's living or working environments.


title: Random family method: Confirming inter-generational relations by restricted re-sampling

abstract: Randomness is one of the important key concepts of statistics. In epidemiology or medical science, we investigate our hypotheses and interpret results through this statistical randomness. We hypothesized by imposing some conditions to this randomness, interpretation of our result may be changed. In this article, we introduced the restricted re-sampling method to confirm inter-generational relations and presented an example.


title: Classification of $\aleph_0$-categorical $C$-minimal pure $C$-sets

abstract: In this paper we classify all $\aleph_0$-categorical and $C$-minimal sets up to elementary equivalence.


title: Projected Stein Variational Gradient Descent

abstract: The curse of dimensionality is a longstanding challenge in Bayesian inference in high dimensions. In this work, we propose a projected Stein variational gradient descent (pSVGD) method to overcome this challenge by exploiting the fundamental property of intrinsic low dimensionality of the data informed subspace stemming from ill-posedness of such problems. We adaptively construct the subspace using a gradient information matrix of the log-likelihood, and apply pSVGD to the much lower-dimensional coefficients of the parameter projection. The method is demonstrated to be more accurate and efficient than SVGD. It is also shown to be more scalable with respect to the number of parameters, samples, data points, and processor cores via experiments with parameters dimensions ranging from the hundreds to the tens of thousands.


title: Control of Large-Scale Networked Cyberphysical Systems Using Cryptographic Techniques

abstract: This paper aims to create a secure environment for networked control systems composed of multiple dynamic entities and computational control units via networking, in the presence of disclosure attacks. In particular, we consider the situation where some dynamic entities or control units are vulnerable to attacks and can become malicious. Our objective is to ensure that the input and output data of the benign entities are protected from the malicious entities as well as protected when they are transferred over the networks in a distributed environment. Both these security requirements are achieved using cryptographic techniques. However, the use of cryptographic mechanisms brings additional challenges to the design of controllers in the encrypted state space; the closed-loop system gains and states are required to match the specified cryptographic algorithms. In this paper, we propose a methodology for the design of secure networked control systems integrating the cryptographic mechanisms with the control algorithms. The approach is based on the separation principle, with the cryptographic techniques addressing the security requirements and the control algorithms satisfying their performance requirements.


title: MOGPTK: The Multi-Output Gaussian Process Toolkit

abstract: We present MOGPTK, a Python package for multi-channel data modelling using Gaussian processes (GP). The aim of this toolkit is to make multi-output GP (MOGP) models accessible to researchers, data scientists, and practitioners alike. MOGPTK uses a Python front-end, relies on the GPflow suite and is built on a TensorFlow back-end, thus enabling GPU-accelerated training. The toolkit facilitates implementing the entire pipeline of GP modelling, including data loading, parameter initialization, model learning, parameter interpretation, up to data imputation and extrapolation. MOGPTK implements the main multi-output covariance kernels from literature, as well as spectral-based parameter initialization strategies. The source code, tutorials and examples in the form of Jupyter notebooks, together with the API documentation, can be found at http://github.com/GAMES-UChile/mogptk


title: Biologically Inspired Visual System Architecture for Object Recognition in Autonomous Systems

abstract: Findings in recent years on the sensitivity of convolutional neural networks to additive noise, light conditions and to the wholeness of the training dataset, indicate that this technology still lacks the robustness needed for the autonomous robotic industry. In an attempt to bring computer vision algorithms closer to the capabilities of a human operator, the mechanisms of the human visual system was analyzed in this work. Recent studies show that the mechanisms behind the recognition process in the human brain include continuous generation of predictions based on prior knowledge of the world. These predictions enable rapid generation of contextual hypotheses that bias the outcome of the recognition process. This mechanism is especially advantageous in situations of uncertainty, when visual input is ambiguous. In addition, the human visual system continuously updates its knowledge about the world based on the gaps between its prediction and the visual feedback. Convolutional neural networks are feed forward in nature and lack such top-down contextual attenuation mechanisms. As a result, although they process massive amounts of visual information during their operation, the information is not transformed into knowledge that can be used to generate contextual predictions and improve their performance. In this work, an architecture was designed that aims to integrate the concepts behind the top-down prediction and learning processes of the human visual system with the state of the art bottom-up object recognition models, e.g., deep convolutional neural networks. The work focuses on two mechanisms of the human visual system: anticipation-driven perception and reinforcement-driven learning. Imitating these top-down mechanisms, together with the state of the art bottom-up feed-forward algorithms, resulted in an accurate, robust, and continuously improving target recognition model.


title: Tracking the Gust Fronts of Convective Cold Pools

abstract: It is increasingly acknowledged that cold pools can influence the initiation of new convective cells. Yet, the full complexity of convective organization through cold pool interaction is poorly understood. This lack of understanding may partially be due to the intricacy of the dynamical pattern formed by precipitation cells and their cold pools. Additionally, how exactly cold pools interact is insufficiently known. To better understand this dynamics, we develop a tracking algorithm for cold pool gust fronts. Rather than tracking thermodynamic anomalies, which do not generally coincide with the gust front boundaries, our approach tracks the dynamical cold pool outflow. Our algorithm first determines the locus of the precipitation event. Second, relative to this origin and for each azimuthal bin, the steepest gradient in the near-surface horizontal radial velocity $v_r$ is employed to determine the respective locus of the cold pool gust front edge. Steepest $v_r$-gradients imply largest updraft velocities, hence strongest dynamical triggering. Results are compared to a previous algorithm based on the steepest gradient in temperature --- highlighting the benefit of the method described here in determining dynamically active gust front regions. Applying the method to a range of numerical experiments, the algorithm successfully tracks an ensemble of cold pools. A linear relation emerges between the peak rain intensity of a given event and maximal $v_r$ for its associated cold pool gust front --- a relation found to be nearly independent of the specific sensitivity experiment.


title: Convective Self-Aggregation as a Cold-Pool Driven Critical Phenomenon

abstract: Convective self-aggregation is when thunderstorm clouds cluster over a constant temperature surface in radiative convective equilibrium. Self-aggregation was implicated in the Madden-Julian Oscillation and hurricanes. Yet, numerical simulations succeed or fail at producing self-aggregation, depending on modeling choices. Common explanations for self-aggregation invoke radiative effects, acting to concentrate moisture in a sub-domain. Interaction between cold pools, caused by rain evaporation, drives reorganization of boundary layer moisture and triggers new updrafts. We propose a simple model for aggregation by cold pool interaction, assuming a local number density $\rho(\mathbf{r})$ of precipitation cells, and that interaction scales quadratically with $\rho(\mathbf{r})$. Our model mimics global energy constraints by limiting further cell production when many cells are present. The phase diagram shows a continuous phase transition between a continuum and an aggregated state. Strong cold pool-cold pool interaction gives a uniform convective phase, while weak interaction yields few and independent cells. Segregation results for intermediate interaction strength.


title: PBE-CC: Congestion Control via Endpoint-Centric, Physical-Layer Bandwidth Measurements

abstract: Wireless networks are becoming ever more sophisticated and overcrowded, imposing the most delay, jitter, and throughput damage to end-to-end network flows in today's internet. We therefore argue for fine-grained mobile endpoint-based wireless measurements to inform a precise congestion control algorithm through a well-defined API to the mobile's wireless physical layer. Our proposed congestion control algorithm is based on Physical-Layer Bandwidth measurements taken at the Endpoint (PBE-CC), and captures the latest 5G New Radio innovations that increase wireless capacity, yet create abrupt rises and falls in available wireless capacity that the PBE-CC sender can react to precisely and very rapidly. We implement a proof-of-concept prototype of the PBE measurement module on software-defined radios and the PBE sender and receiver in C. An extensive performance evaluation compares PBE-CC head to head against the leading cellular-aware and wireless-oblivious congestion control protocols proposed in the research community and in deployment, in mobile and static mobile scenarios, and over busy and quiet networks. Results show 6.3% higher average throughput than BBR, while simultaneously reducing 95th percentile delay by 1.8x.


title: Composable finite-size effects in free-space CV-QKD systems

abstract: Free-space channels provide the possibility of establishing continuous-variable quantum key distribution (CV-QKD) in global communication networks. However, the fluctuating nature of transmissivity in these channels introduces an extra noise which reduces the achievable secret key rate. We consider two classical post-processing strategies, post-selection of high-transmissivity data and data clusterization, to reduce the fluctuation-induced noise of the channel. We undertake the first investigation of such strategies utilising a composable security proof in a realistic finite-size regime against both collective and individual attacks. We also present an efficient parameter estimation approach to estimate the effective Gaussian parameters over the post-selected data or the clustered data. Although the composable finite-size effects become more significant with the post-selection and clusterization both reducing the size of the data, our results show that these strategies are still able to enhance the finite-size key rate against both individual and collective attacks with a remarkable improvement against collective attacks--even moving the protocol from an insecure regime to a secure regime under certain conditions.


title: Quantum Fourier Analysis

abstract: {\em Quantum Fourier analysis} is a new subject that combines an algebraic Fourier transform (pictorial in the case of subfactor theory) with analytic estimates. This provides interesting tools to investigate phenomena such as quantum symmetry. We establish bounds on the quantum Fourier transform $\FS$, as a map between suitably defined $L^{p}$ spaces, leading to a new uncertainty principle for relative entropy. We cite several applications of the quantum Fourier analysis in subfactor theory, in category theory, and in quantum information. We suggest a new topological inequality, and we outline several open problems.


title: Interpretable Off-Policy Evaluation in Reinforcement Learning by Highlighting Influential Transitions

abstract: Off-policy evaluation in reinforcement learning offers the chance of using observational data to improve future outcomes in domains such as healthcare and education, but safe deployment in high stakes settings requires ways of assessing its validity. Traditional measures such as confidence intervals may be insufficient due to noise, limited data and confounding. In this paper we develop a method that could serve as a hybrid human-AI system, to enable human experts to analyze the validity of policy evaluation estimates. This is accomplished by highlighting observations in the data whose removal will have a large effect on the OPE estimate, and formulating a set of rules for choosing which ones to present to domain experts for validation. We develop methods to compute exactly the influence functions for fitted Q-evaluation with two different function classes: kernel-based and linear least squares, as well as importance sampling methods. Experiments on medical simulations and real-world intensive care unit data demonstrate that our method can be used to identify limitations in the evaluation process and make evaluation more robust.


title: Affine Super Yangians and Rectangular $W$-superalgebras

abstract: In this paper, we construct a homomorphism from the affine super Yangian $Y_{\ve_1,\ve_2}(\widehat{\mathfrak{sl}}(m|n))$ to the universal enveloping algebra of the rectangular $W$-superalgebra $W^{k}(\mathfrak{gl}(ml|nl),(l^{(m|n)}))$. We also show that the image of this homomorphism is dense provided that $k+(m-n)(l-1)\neq0$.


title: Semi-Supervised Class Discovery

abstract: One promising approach to dealing with datapoints that are outside of the initial training distribution (OOD) is to create new classes that capture similarities in the datapoints previously rejected as uncategorizable. Systems that generate labels can be deployed against an arbitrary amount of data, discovering classification schemes that through training create a higher quality representation of data. We introduce the Dataset Reconstruction Accuracy, a new and important measure of the effectiveness of a model's ability to create labels. We introduce benchmarks against this Dataset Reconstruction metric. We apply a new heuristic, class learnability, for deciding whether a class is worthy of addition to the training dataset. We show that our class discovery system can be successfully applied to vision and language, and we demonstrate the value of semi-supervised learning in automatically discovering novel classes.


title: Importance of self-interaction-error removal in density functional calculations on water cluster anions

abstract: Accurate description of the excess charge in water cluster anions is challenging for standard semi-local and (global) hybrid density functional approximations (DFAs). Using the recent unitary invariant implementation of the Perdew-Zunger self-interaction correction (SIC) method using Fermi-L\"owdin orbitals, we assess the effect of self-interaction error on the vertical detachment energies of water clusters anions with the local spin density approximation (LSDA), Perdew-Burke-Ernzerhof (PBE) generalized gradient approximation, and the strongly constrained and appropriately normed (SCAN) meta-GGA functionals. Our results show that for the relative energies of isomers with respect to reference CCSD(T) values, the uncorrected SCAN functional has the smallest deviation of 21 meV, better than that for the MP2 method. The performance of SIC-SCAN is comparable to that of MP2 and is better than SIC-LSDA and SIC-PBE, but it reverses the ordering of the two lowest isomers for water hexamer anions. Removing self interaction error (SIE) corrects the tendency of LSDA, PBE, and SCAN to over-bind the extra electron. The vertical detachment energies (VDEs) of water cluster anions, obtained from the total energy differences of corresponding anion and neutral clusters, are significantly improved by removing self-interaction and are better than the hybrid B3LYP functional, but fall short of MP2 accuracy. Removing SIE results in substantial improvement in the position of the eigenvalue of the extra electron. The negative of the highest occupied eigenvalue after SIC provides an excellent approximation to the VDE, especially for SIC-PBE where the mean absolute error with respect to CCSD(T) is only 17 meV, the best among all approximations compared in this work.


title: Ultra High Fidelity Image Compression with $\ell_\infty$-constrained Encoding and Deep Decoding

abstract: In many professional fields, such as medicine, remote sensing and sciences, users often demand image compression methods to be mathematically lossless. But lossless image coding has a rather low compression ratio (around 2:1 for natural images). The only known technique to achieve significant compression while meeting the stringent fidelity requirements is the methodology of $\ell_\infty$-constrained coding that was developed and standardized in nineties. We make a major progress in $\ell_\infty$-constrained image coding after two decades, by developing a novel CNN-based soft $\ell_\infty$-constrained decoding method. The new method repairs compression defects by using a restoration CNN called the $\ell_\infty\mbox{-SDNet}$ to map a conventionally decoded image to the latent image. A unique strength of the $\ell_\infty\mbox{-SDNet}$ is its ability to enforce a tight error bound on a per pixel basis. As such, no small distinctive structures of the original image can be dropped or distorted, even if they are statistical outliers that are otherwise sacrificed by mainstream CNN restoration methods. More importantly, this research ushers in a new image compression system of $\ell_\infty$-constrained encoding and deep soft decoding ($\ell_\infty\mbox{-ED}^2$). The $\ell_\infty \mbox{-ED}^2$ approach beats the best of existing lossy image compression methods (e.g., BPG, WebP, etc.) not only in $\ell_\infty$ but also in $\ell_2$ error metric and perceptual quality, for bit rates near the threshold of perceptually transparent reconstruction. Operationally, the new compression system is practical, with a low-complexity real-time encoder and a cascade decoder consisting of a fast initial decoder and an optional CNN soft decoder.


title: The relative eta invariant for a pair of Dirac-type operators on non-compact manifolds

abstract: Let $\mathcal{A}_0$ and $\mathcal{A}_1$ be two self-adjoint Fredholm Dirac-type operators defined on two non-compact manifolds. If they coincide at infinity so that the relative heat operator is trace-class, one can define their relative eta function as in the compact case. The regular value of this function at the zero point, which we call the relative eta invariant of $\mathcal{A}_0$ and $\mathcal{A}_1$, is a generalization of the eta invariant to non-compact situation. We study its variation formula and gluing law. In particular, under certain conditions, we show that this relative eta invariant coincides with the relative eta invariant that we previously defined using APS index of strongly Callias-type operators.


title: Tuning of multivariable model predictive controllersthrough expert bandit feedback

abstract: For certain industrial control applications an explicit function capturing the nontrivial trade-off between competing objectives in closed loop performance is not available. In such scenarios it is common practice to use the human innate ability to implicitly learn such a relationship and manually tune the corresponding controller to achieve the desirable closed loop performance. This approach has its deficiencies because of individual variations due to experience levels and preferences in the absence of an explicit calibration metric. Moreover, as the complexity of the underlying system and/or the controller increase, in the effort to achieve better performance, so does the tuning time and the associated tuning cost. To reduce the overall tuning cost, a tuning framework is proposed herein, whereby a supervised machine learning is used to extract the human-learned cost function and an optimization algorithm that can efficiently deal with a large number of variables, is used for optimizing the extracted cost function. Given the interest in the implementation across many industrial domains and the associated high degree of freedom present in the corresponding tuning process, a Model Predictive Controller applied to air path control in a diesel engine is tuned for the purpose of demonstrating the potential of the framework.


title: Evaluating Sequence-to-Sequence Learning Models for If-Then Program Synthesis

abstract: Implementing enterprise process automation often requires significant technical expertise and engineering effort. It would be beneficial for non-technical users to be able to describe a business process in natural language and have an intelligent system generate the workflow that can be automatically executed. A building block of process automations are If-Then programs. In the consumer space, sites like IFTTT and Zapier allow users to create automations by defining If-Then programs using a graphical interface. We explore the efficacy of modeling If-Then programs as a sequence learning task. We find Seq2Seq approaches have high potential (performing strongly on the Zapier recipes) and can serve as a promising approach to more complex program synthesis challenges.


title: Seifert fibred 2-knot manifolds. II

abstract: We show that if $B$ is an aspherical 2-orbifold in one of the families known to have orbifold fundamental groups of weight 1 then $B$ is the base of a Seifert fibration of a 2-knot manifold $M(K)$.


title: Interface Dynamics in a Two-phase Tumor Growth Model

abstract: We study a tumor growth model in two space dimensions, where proliferation of the tumor cells leads to expansion of the tumor domain and migration of surrounding normal tissues into the exterior vacuum. The model features two moving interfaces separating the tumor, the normal tissue, and the exterior vacuum. We prove local-in-time existence and uniqueness of strong solutions for their evolution starting from a nearly radial initial configuration. It is assumed that the tumor has lower mobility than the normal tissue, which is in line with the well-known Saffman-Taylor condition in viscous fingering.


title: Security and Privacy in IoT Using Machine Learning and Blockchain: Threats & Countermeasures

abstract: Security and privacy of the users have become significant concerns due to the involvement of the Internet of things (IoT) devices in numerous applications. Cyber threats are growing at an explosive pace making the existing security and privacy measures inadequate. Hence, everyone on the Internet is a product for hackers. Consequently, Machine Learning (ML) algorithms are used to produce accurate outputs from large complex databases, where the generated outputs can be used to predict and detect vulnerabilities in IoT-based systems. Furthermore, Blockchain (BC) techniques are becoming popular in modern IoT applications to solve security and privacy issues. Several studies have been conducted on either ML algorithms or BC techniques. However, these studies target either security or privacy issues using ML algorithms or BC techniques, thus posing a need for a combined survey on efforts made in recent years addressing both security and privacy issues using ML algorithms and BC techniques. In this paper, we provide a summary of research efforts made in the past few years, starting from 2008 to 2019, addressing security and privacy issues using ML algorithms and BCtechniques in the IoT domain. First, we discuss and categorize various security and privacy threats reported in the past twelve years in the IoT domain. Then, we classify the literature on security and privacy efforts based on ML algorithms and BC techniques in the IoT domain. Finally, we identify and illuminate several challenges and future research directions in using ML algorithms and BC techniques to address security and privacy issues in the IoT domain.


title: Flyback-Based Multiple Output dc-dc Converter with Independent Voltage Regulation

abstract: This paper proposes a new single input multiple output power supply by integrating a flyback converter and several buck converters. The flyback converter works as the main regulator, and the buck converters provide series voltage compensation with the aim of tight regulation. A time multiplexing switching scheme is proposed to deliver multiple output voltage levels via a two winding transformer and to eliminate the cross regulation between output channels. This configuration reduces the size of flyback transformer and filter capacitors, and consequently improves the overall form factor. A detailed steady state analysis is conducted on the circuit to obtain the design criteria. A three output channel power supply is designed and the effectiveness of the proposed configuration is validated via simulation with a MATLAB/Simscape model. Simulation results also demonstrate satisfactory transient response to load changes.


title: A Test for Independence Via Bayesian Nonparametric Estimation of Mutual Information

abstract: Mutual information is a well-known tool to measure the mutual dependence between variables. In this paper, a Bayesian nonparametric estimation of mutual information is established by means of the Dirichlet process and the $k$-nearest neighbor distance. As a direct outcome of the estimation, an easy-to-implement test of independence is introduced through the relative belief ratio. Several theoretical properties of the approach are presented. The procedure is investigated through various examples where the results are compared to its frequentist counterpart and demonstrate a good performance.


title: Massive Access for 5G and Beyond

abstract: Massive access, also known as massive connectivity or massive machine-type communication (mMTC), is one of the main use cases of the fifth-generation (5G) and beyond 5G (B5G) wireless networks. A typical application of massive access is the cellular Internet of Things (IoT). Different from conventional human-type communication, massive access aims at realizing efficient and reliable communications for a massive number of IoT devices. Hence, the main characteristics of massive access include low power, massive connectivity, and broad coverage, which require new concepts, theories, and paradigms for the design of next-generation cellular networks. This paper presents a comprehensive survey of aspects of massive access design for B5G wireless networks. Specifically, we provide a detailed review of massive access from the perspectives of theory, protocols, techniques, coverage, energy, and security. Furthermore, several future research directions and challenges are identified.


title: All-Pay Auctions as Models for Trade Wars and Military Annexation

abstract: We explore an application of all-pay auctions to model trade wars and territorial annexation. Specifically, in the model we consider the expected resource, production, and aggressive (military/tariff) power are public information, but actual resource levels are private knowledge. We consider the resource transfer at the end of such a competition which deprives the weaker country of some fraction of its original resources. In particular, we derive the quasi-equilibria strategies for two country conflicts under different scenarios. This work is relevant for the ongoing US-China trade war, and the recent Russian capture of Crimea, as well as historical and future conflicts.


title: AI-oriented Medical Workload Allocation for Hierarchical Cloud/Edge/Device Computing

abstract: In a hierarchically-structured cloud/edge/device computing environment, workload allocation can greatly affect the overall system performance. This paper deals with AI-oriented medical workload generated in emergency rooms (ER) or intensive care units (ICU) in metropolitan areas. The goal is to optimize AI-workload allocation to cloud clusters, edge servers, and end devices so that minimum response time can be achieved in life-saving emergency applications. In particular, we developed a new workload allocation method for the AI workload in distributed cloud/edge/device computing systems. An efficient scheduling and allocation strategy is developed in order to reduce the overall response time to satisfy multi-patient demands. We apply several ICU AI workloads from a comprehensive edge computing benchmark Edge AIBench. The healthcare AI applications involved are short-of-breath alerts, patient phenotype classification, and life-death threats. Our experimental results demonstrate the high efficiency and effectiveness in real-life health-care and emergency applications.


title: Interpretable Companions for Black-Box Models

abstract: We present an interpretable companion model for any pre-trained black-box classifiers. The idea is that for any input, a user can decide to either receive a prediction from the black-box model, with high accuracy but no explanations, or employ a companion rule to obtain an interpretable prediction with slightly lower accuracy. The companion model is trained from data and the predictions of the black-box model, with the objective combining area under the transparency--accuracy curve and model complexity. Our model provides flexible choices for practitioners who face the dilemma of choosing between always using interpretable models and always using black-box models for a predictive task, so users can, for any given input, take a step back to resort to an interpretable prediction if they find the predictive performance satisfying, or stick to the black-box model if the rules are unsatisfying. To show the value of companion models, we design a human evaluation on more than a hundred people to investigate the tolerable accuracy loss to gain interpretability for humans.


title: A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat Minima

abstract: Stochastic Gradient Descent (SGD) and its variants are mainstream methods for training deep networks in practice. SGD is known to find a flat minimum that often generalizes well. However, it is mathematically unclear how deep learning can select a flat minimum among so many minima. To answer the question quantitatively, we develop a density diffusion theory (DDT) to reveal how minima selection quantitatively depends on the minima sharpness and the hyperparameters. To the best of our knowledge, we are the first to theoretically and empirically prove that, benefited from the Hessian-dependent covariance of stochastic gradient noise, SGD favors flat minima exponentially more than sharp minima, while Gradient Descent (GD) with injected white noise favors flat minima only polynomially more than sharp minima. We also reveal that either a small learning rate or large-batch training requires exponentially many iterations to escape from minima in terms of the ratio of the batch size and learning rate. Thus, large-batch training cannot search flat minima efficiently in a realistic computational time.


title: Variational principle of action and group theory for bifurcation of figure-eight solutions

abstract: Figure-eight solutions are solutions to planar equal mass three-body problem under homogeneous or inhomogeneous potentials. They are known to be invariant under the transformation group $D_6$: the dihedral group of regular hexagons. Numerical investigation shows that each figure-eight solution has some bifurcation points. Six bifurcation patterns are known with respect to the symmetry of the bifurcated solution. In this paper we will show the followings. The variational principle of action and group theory show that the bifurcations of every figure-eight solution are determined by the irreducible representations of $D_6$. Each irreducible representation has one to one correspondence to each bifurcation. This explains numerically observed six bifurcation patterns. In general, in Lagrangian mechanics, bifurcations of a periodic solution is determined by irreducible representations of the transformation group that leaves this solution invariant.


title: Few-shot Domain Adaptation by Causal Mechanism Transfer

abstract: We study few-shot supervised domain adaptation (DA) for regression problems, where only a few labeled target domain data and many labeled source domain data are available. Many of the current DA methods base their transfer assumptions on either parametrized distribution shift or apparent distribution similarities, e.g., identical conditionals or small distributional discrepancies. However, these assumptions may preclude the possibility of adaptation from intricately shifted and apparently very different distributions. To overcome this problem, we propose mechanism transfer, a meta-distributional scenario in which a data generating mechanism is invariant among domains. This transfer assumption can accommodate nonparametric shifts resulting in apparently different distributions while providing a solid statistical basis for DA. We take the structural equations in causal modeling as an example and propose a novel DA method, which is shown to be useful both theoretically and experimentally. Our method can be seen as the first attempt to fully leverage the structural causal models for DA.


title: Dynamical generalizations of the Prime Number Theorem and disjointness of additive and multiplicative semigroup actions

abstract: We establish two ergodic theorems which have among their corollaries numerous classical results from multiplicative number theory, including the Prime Number Theorem, a theorem of Pillai-Selberg, a theorem of Erd\H{o}s-Delange, the mean value theorem of Wirsing, and special cases of the mean value theorem of Hal\'asz. By building on the ideas behind our ergodic results, we recast Sarnak's M\"obius disjointness conjecture in a new dynamical framework. This naturally leads to an extension of Sarnak's conjecture which focuses on the disjointness of additive and multiplicative semigroup actions. We substantiate this extension by providing proofs of several special cases.


title: Arithmetic special cycles and Jacobi forms

abstract: We consider families of special cycles, as introduced by Kudla, on Shimura varieties attached to anisotropic quadratic spaces over totally real fields. By augmenting these cycles with Green currents, we obtain classes in the arithmetic Chow groups of the canonical models of these Shimura varieties (viewed as arithmetic varieties over their reflex fields). The main result of this paper asserts that generating series built from these cycles can be identified with the Fourier expansions of non-holomorphic Hilbert-Jacobi modular forms. This result provides evidence for an arithmetic analogue of Kudla's conjecture relating these cycles to Siegel modular forms.


title: Watch out! Motion is Blurring the Vision of Your Deep Neural Networks

abstract: The state-of-the-art deep neural networks (DNNs) are vulnerable against adversarial examples with additive random-like noise perturbations. While such examples are hardly found in the physical world, the image blurring effect caused by object motion, on the other hand, commonly occurs in practice, making the study of which greatly important especially for the widely adopted real-time image processing tasks (e.g., object detection, tracking). In this paper, we initiate the first step to comprehensively investigate the potential hazards of the blur effect for DNN, caused by object motion. We propose a novel adversarial attack method that can generate visually natural motion-blurred adversarial examples, named motion-based adversarial blur attack (ABBA). To this end, we first formulate the kernel-prediction-based attack where an input image is convolved with kernels in a pixel-wise way, and the misclassification capability is achieved by tuning the kernel weights. To generate visually more natural and plausible examples, we further propose the saliency-regularized adversarial kernel prediction, where the salient region serves as a moving object, and the predicted kernel is regularized to achieve naturally visual effects. Besides, the attack is further enhanced by adaptively tuning the translations of object and background. A comprehensive evaluation on the NeurIPS'17 adversarial competition dataset demonstrates the effectiveness of ABBA by considering various kernel sizes, translations, and regions. The in-depth study further confirms that our method shows more effective penetrating capability to the state-of-the-art GAN-based deblurring mechanisms compared with other blurring methods. We release the code to https://github.com/tsingqguo/ABBA.


title: Segmenting Unseen Industrial Components in a Heavy Clutter Using RGB-D Fusion and Synthetic Data

abstract: Segmentation of unseen industrial parts is essential for autonomous industrial systems. However, industrial components are texture-less, reflective, and often found in cluttered and unstructured environments with heavy occlusion, which makes it more challenging to deal with unseen objects. To tackle this problem, we present a synthetic data generation pipeline that randomizes textures via domain randomization to focus on the shape information. In addition, we propose an RGB-D Fusion Mask R-CNN with a confidence map estimator, which exploits reliable depth information in multiple feature levels. We transferred the trained model to real-world scenarios and evaluated its performance by making comparisons with baselines and ablation studies. We demonstrate that our methods, which use only synthetic data, could be effective solutions for unseen industrial components segmentation.


title: Numerical solution for the stress near a hole with corners in an infinite plate under biaxial loading

abstract: We consider the elastic stress near a hole with corners in an infinite plate under biaxial stress. The elasticity problem is formulated using complex Goursat functions, resulting in a set of singular integro-differential equations on the boundary. The resulting boundary integral equations are solved numerically using a Chebyshev collocation method which is augmented by a fractional power term, derived by asymptotic analysis of the corner region, to resolve stress singularities at corners of the hole. We apply our numerical method to the test case of the hole formed by two partially-overlapping circles, which can include either a corner pointing into the solid or a corner pointing out of the solid. Our numerical results recover the exact stress on the boundary to within relative error $10^{-3}$ for modest computational effort.


title: Regularized Submodular Maximization at Scale

abstract: In this paper, we propose scalable methods for maximizing a regularized submodular function $f = g - \ell$ expressed as the difference between a monotone submodular function $g$ and a modular function $\ell$. Indeed, submodularity is inherently related to the notions of diversity, coverage, and representativeness. In particular, finding the mode of many popular probabilistic models of diversity, such as determinantal point processes, submodular probabilistic models, and strongly log-concave distributions, involves maximization of (regularized) submodular functions. Since a regularized function $f$ can potentially take on negative values, the classic theory of submodular maximization, which heavily relies on the non-negativity assumption of submodular functions, may not be applicable. To circumvent this challenge, we develop the first one-pass streaming algorithm for maximizing a regularized submodular function subject to a $k$-cardinality constraint. It returns a solution $S$ with the guarantee that $f(S)\geq(\phi^{-2}-\epsilon) \cdot g(OPT)-\ell (OPT)$, where $\phi$ is the golden ratio. Furthermore, we develop the first distributed algorithm that returns a solution $S$ with the guarantee that $\mathbb{E}[f(S)] \geq (1-\epsilon) [(1-e^{-1}) \cdot g(OPT)-\ell(OPT)]$ in $O(1/ \epsilon)$ rounds of MapReduce computation, without keeping multiple copies of the entire dataset in each round (as it is usually done). We should highlight that our result, even for the unregularized case where the modular term $\ell$ is zero, improves the memory and communication complexity of the existing work by a factor of $O(1/ \epsilon)$ while arguably provides a simpler distributed algorithm and a unifying analysis. We also empirically study the performance of our scalable methods on a set of real-life applications, including finding the mode of distributions, data summarization, and product recommendation.


title: Compact convex structure of measurements and its applications to simulability, incompatibility, and convex resource theory of continuous-outcome measurements

abstract: We introduce the post-processing preorder and equivalence relations for general measurements on a possibly infinite-dimensional general probabilistic theory described by an order unit Banach space $E$ with a Banach predual. We define the measurement space $\mathfrak{M}(E)$ as the set of post-processing equivalence classes of continuous measurements on $E .$ We define the weak topology on $\mathfrak{M} (E)$ as the weakest topology in which the state discrimination probabilities for any finite-label ensembles are continuous and show that $\mathfrak{M}(E)$ equipped with the convex operation corresponding to the probabilistic mixture of measurements can be regarded as a compact convex set regularly embedded in a locally convex Hausdorff space. We also prove that the measurement space $\mathfrak{M}(E) $ is infinite-dimensional except when the system is $1$-dimensional and give a characterization of the post-processing monotone affine functional. We apply these general results to the problems of simulability and incompatibility of measurements. We show that the robustness measures of unsimulability and incompatibility coincide with the optimal ratio of the state discrimination probability of measurement(s) relative to that of simulable or compatible measurements, respectively. The latter result for incompatible measurements generalizes the recent result for finite-dimensional quantum measurements. Throughout the paper, the fact that any weakly$\ast$ continuous measurement can be arbitrarily approximated in the weak topology by a post-processing increasing net of finite-outcome measurements is systematically used to reduce the discussions to finite-outcome cases.


title: Inequality Constraints in Facility Location and Other Similar Optimization Problems: An Entropy Based Approach

abstract: In this paper we propose an annealing based framework to incorporate inequality constraints in optimization problems such as facility location, simultaneous facility location with path optimization, and the last mile delivery problem. These inequality constraints are used to model several application specific size and capacity limitations on the corresponding facilities, transportation paths and the service vehicles. We design our algorithms in such a way that it allows to (possibly) violate the constraints during the initial stages of the algorithm, so as to facilitate a thorough exploration of the solution space; as the algorithm proceeds, this violation (controlled through the annealing parameter) is gradually lowered till the solution converges in the feasible region of the optimization problem. We present simulations on various datasets that demonstrate the efficacy of our algorithm.


title: Searching for Galactic Micro-FRB with Lunar Scattering

abstract: Does the Galaxy contain sources of micro-FRB, lower energy events resembling the known FRB but detectable only at Galactic distances? The answer to this question is essential to determining the nature of FRB sources. At typical ($10$ kpc) Galactic distances a burst would be about 117 dB brighter than at a "cosmological" ($z = 1$) distance. The radiation of Galactic micro-FRB, if they exist, could be detected after Lunar reflection, or an upper bound on their rate set, by a modest (20 m at 1.4 GHz) radio telescope staring at the Moon. It would have all-sky sensitivity. The delay between detection of direct (by STARE2 or dipoles) and Lunar-scattered radiation would restrict a burst's position to a narrow arc.


title: Fast radio bursts from activities of neutron stars newborn in BNS mergers: offset, birth rate and observational properties

abstract: Young neutron stars (NSs) born in core-collapse explosions are promising candidates for the central engines of fast radio bursts (FRBs), since the first localized repeating burst FRB 121102 happens in a star forming dwarf galaxy, which is similar to the host galaxies of superluminous supernovae (SLSNe) and long gamma-ray bursts (LGRBs). However, FRB 180924 and FRB 190523 are localized to massive galaxies with low rates of star formation, compared with the host of FRB 121102. Meanwhile, the offsets between the bursts and host centers are about 4 kpc and 29 kpc for FRB 180924 and FRB 190523, respectively. These properties of hosts are similar to short gamma-ray bursts \textbf{(SGRBs)}, which are produced by mergers of binary neutron star (BNS) or neutron star-black hole (NS-BH). Therefore, the NSs powering FRBs may be formed in BNS mergers. In this paper, we study the BNS merger rates, merger times, and predict their most likely merger locations for different types of host galaxies using population synthesis method. We find that the BNS merger channel is consistent with the recently reported offsets of FRB 180924 and FRB 190523. The offset distribution of short GRBs is well reproduced by population synthesis using galaxy model which is similar to GRB hosts. The event rate of FRBs (including non-repeating and repeating), is larger than those of BNS merger and short GRBs, which requires a large fraction of observed FRBs emitting several bursts. Using curvature radiation by bunches in NS magnetospheres, we also predict the observational properties of FRBs from BNS mergers, including the dispersion measure, and rotation measure. At late times ($t\geq1$yr), the contribution to dispersion measure and rotation measure from BNS merger ejecta could be neglected.


title: Fair Correlation Clustering

abstract: In this paper we study the problem of correlation clustering under fairness constraints. In the classic correlation clustering problem, we are given a complete graph where each edge is labeled positive or negative. The goal is to obtain a clustering of the vertices that minimizes disagreements -- the number of negative edges trapped inside a cluster plus positive edges between different clusters. We consider two variations of fairness constraint for the problem of correlation clustering where each node has a color, and the goal is to form clusters that do not over-represent vertices of any color. The first variant aims to generate clusters with minimum disagreements, where the distribution of a feature (e.g. gender) in each cluster is same as the global distribution. For the case of two colors when the desired ratio of the number of colors in each cluster is $1:p$, we get $\mathcal{O}(p^2)$-approximation algorithm. Our algorithm could be extended to the case of multiple colors. We prove this problem is NP-hard. The second variant considers relative upper and lower bounds on the number of nodes of any color in a cluster. The goal is to avoid violating upper and lower bounds corresponding to each color in each cluster while minimizing the total number of disagreements. Along with our theoretical results, we show the effectiveness of our algorithm to generate fair clusters by empirical evaluation on real world data sets.


title: A New Perspective for Flexible Feature Gathering in Scene Text Recognition Via Character Anchor Pooling

abstract: Irregular scene text recognition has attracted much attention from the research community, mainly due to the complexity of shapes of text in natural scene. However, recent methods either rely on shape-sensitive modules such as bounding box regression, or discard sequence learning. To tackle these issues, we propose a pair of coupling modules, termed as Character Anchoring Module (CAM) and Anchor Pooling Module (APM), to extract high-level semantics from two-dimensional space to form feature sequences. The proposed CAM localizes the text in a shape-insensitive way by design by anchoring characters individually. APM then interpolates and gathers features flexibly along the character anchors which enables sequence learning. The complementary modules realize a harmonic unification of spatial information and sequence learning. With the proposed modules, our recognition system surpasses previous state-of-the-art scores on irregular and perspective text datasets, including, ICDAR 2015, CUTE, and Total-Text, while paralleling state-of-the-art performance on regular text datasets.


title: Autonomous quadrotor obstacle avoidance based on dueling double deep recurrent Q-learning with monocular vision

abstract: The rapid development of unmanned aerial vehicles (UAV) puts forward a higher requirement for autonomous obstacle avoidance. Due to the limited payload and power supply, small UAVs such as quadrotors usually carry simple sensors and computation units, which makes traditional methods more challenging to implement. In this paper, a novel framework is demonstrated to control a quadrotor flying through crowded environments autonomously with monocular vision. The framework adopts a two-stage architecture, consisting of a sensing module and a decision module. The sensing module is based on an unsupervised deep learning method. And the decision module uses dueling double deep recurrent Q-learning to eliminate the adverse effects of limited observation capacity of an on-board monocular camera. The framework enables the quadrotor to realize autonomous obstacle avoidance without any prior environment information or labeled datasets for training. The trained model shows a high success rate in the simulation and a good generalization ability for transformed scenarios.


title: Finite \'etale extension of Tate rings and decompletion of perfectoid algebras

abstract: In this paper, we examine the behavior of ideal-adic separatedness and completeness under certain ring extensions using trace map. Then we prove that adic completeness of a base ring is hereditary to its ring extension under reasonable conditions. We aim to give many results on ascent and descent of certain ring theoretic properties under completion. As an application, we give conceptual details to the proof of the almost purity theorem for Witt-perfect rings by Davis and Kedlaya. Witt-perfect rings have the advantage that one does not need to assume that the rings are complete and separated.


title: A variant of perfectoid Abhyankar's lemma and almost Cohen-Macaulay algebras

abstract: In this paper, we prove that a complete Noetherian local domain of mixed characteristic $p>0$ with perfect residue field has an integral extension that is an integrally closed, almost Cohen-Macaulay domain such that the Frobenius map is surjective modulo $p$. This result is seen as a mixed characteristic analogue of the fact that the perfect closure of a complete local domain in positive characteristic is almost Cohen-Macaulay. To this aim, we carry out a detailed study of decompletion of perfectoid rings and establish the Witt-perfect (decompleted) version of Andr\'e's perfectoid Abhyankar's lemma and Riemann's extension theorem.


title: Learning Stochastic Behaviour from Aggregate Data

abstract: Learning nonlinear dynamics from aggregate data is a challenging problem because the full trajectory of each individual is not available, namely, the individual observed at one time may not be observed at the next time point, or the identity of individual is unavailable. This is in sharp contrast to learning dynamics with full trajectory data, on which the majority of existing methods are based. We propose a novel method using the weak form of Fokker Planck Equation (FPE) -- a partial differential equation -- to describe the density evolution of data in a sampled form, which is then combined with Wasserstein generative adversarial network (WGAN) in the training process. In such a sample-based framework we are able to learn the nonlinear dynamics from aggregate data without explicitly solving the partial differential equation (PDE) FPE. We demonstrate our approach in the context of a series of synthetic and real-world data sets.


title: Explainable Deep RDFS Reasoner

abstract: Recent research efforts aiming to bridge the Neural-Symbolic gap for RDFS reasoning proved empirically that deep learning techniques can be used to learn RDFS inference rules. However, one of their main deficiencies compared to rule-based reasoners is the lack of derivations for the inferred triples (i.e. explainability in AI terms). In this paper, we build on these approaches to provide not only the inferred graph but also explain how these triples were inferred. In the graph words approach, RDF graphs are represented as a sequence of graph words where inference can be achieved through neural machine translation. To achieve explainability in RDFS reasoning, we revisit this approach and introduce a new neural network model that gets the input graph--as a sequence of graph words-- as well as the encoding of the inferred triple and outputs the derivation for the inferred triple. We evaluated our justification model on two datasets: a synthetic dataset-- LUBM benchmark-- and a real-world dataset --ScholarlyData about conferences-- where the lowest validation accuracy approached 96%.


title: Straggler-resistant distributed matrix computation via coding theory

abstract: The current BigData era routinely requires the processing of large scale data on massive distributed computing clusters. Such large scale clusters often suffer from the problem of "stragglers", which are defined as slow or failed nodes. The overall speed of a computational job on these clusters is typically dominated by stragglers in the absence of a sophisticated assignment of tasks to the worker nodes. In recent years, approaches based on coding theory (referred to as "coded computation") have been effectively used for straggler mitigation. Coded computation offers significant benefits for specific classes of problems such as distributed matrix computations (which play a crucial role in several parts of the machine learning pipeline). The essential idea is to create redundant tasks so that the desired result can be recovered as long as a certain number of worker nodes complete their tasks. In this survey article, we overview recent developments in the field of coding for straggler-resilient distributed matrix computations.


title: Semi-Implicit Back Propagation

abstract: Neural network has attracted great attention for a long time and many researchers are devoted to improve the effectiveness of neural network training algorithms. Though stochastic gradient descent (SGD) and other explicit gradient-based methods are widely adopted, there are still many challenges such as gradient vanishing and small step sizes, which leads to slow convergence and instability of SGD algorithms. Motivated by error back propagation (BP) and proximal methods, we propose a semi-implicit back propagation method for neural network training. Similar to BP, the difference on the neurons are propagated in a backward fashion and the parameters are updated with proximal mapping. The implicit update for both hidden neurons and parameters allows to choose large step size in the training algorithm. Finally, we also show that any fixed point of convergent sequences produced by this algorithm is a stationary point of the objective loss function. The experiments on both MNIST and CIFAR-10 demonstrate that the proposed semi-implicit BP algorithm leads to better performance in terms of both loss decreasing and training/validation accuracy, compared to SGD and a similar algorithm ProxBP.


title: Random Smoothing Might be Unable to Certify $\ell_\infty$ Robustness for High-Dimensional Images

abstract: We show a hardness result for random smoothing to achieve certified adversarial robustness against attacks in the $\ell_p$ ball of radius $\epsilon$ when $p>2$. Although random smoothing has been well understood for the $\ell_2$ case using the Gaussian distribution, much remains unknown concerning the existence of a noise distribution that works for the case of $p>2$. This has been posed as an open problem by Cohen et al. (2019) and includes many significant paradigms such as the $\ell_\infty$ threat model. In this work, we show that any noise distribution $\mathcal{D}$ over $\mathbb{R}^d$ that provides $\ell_p$ robustness for all base classifiers with $p>2$ must satisfy $\mathbb{E}\eta_i^2=\Omega(d^{1-2/p}\epsilon^2(1-\delta)/\delta^2)$ for 99% of the features (pixels) of vector $\eta\sim\mathcal{D}$, where $\epsilon$ is the robust radius and $\delta$ is the score gap between the highest-scored class and the runner-up. Therefore, for high-dimensional images with pixel values bounded in $[0,255]$, the required noise will eventually dominate the useful information in the images, leading to trivial smoothed classifiers.


title: Multilingual Alignment of Contextual Word Representations

abstract: We propose procedures for evaluating and strengthening contextual embedding alignment and show that they are useful in analyzing and improving multilingual BERT. In particular, after our proposed alignment procedure, BERT exhibits significantly improved zero-shot performance on XNLI compared to the base model, remarkably matching pseudo-fully-supervised translate-train models for Bulgarian and Greek. Further, to measure the degree of alignment, we introduce a contextual version of word retrieval and show that it correlates well with downstream zero-shot transfer. Using this word retrieval task, we also analyze BERT and find that it exhibits systematic deficiencies, e.g. worse alignment for open-class parts-of-speech and word pairs written in different scripts, that are corrected by the alignment procedure. These results support contextual alignment as a useful concept for understanding large multilingual pre-trained models.


title: Self-Attentive Associative Memory

abstract: Heretofore, neural networks with external memory are restricted to single memory with lossy representations of memory interactions. A rich representation of relationships between memory pieces urges a high-order and segregated relational memory. In this paper, we propose to separate the storage of individual experiences (item memory) and their occurring relationships (relational memory). The idea is implemented through a novel Self-attentive Associative Memory (SAM) operator. Found upon outer product, SAM forms a set of associative memories that represent the hypothetical high-order relationships between arbitrary pairs of memory elements, through which a relational memory is constructed from an item memory. The two memories are wired into a single sequential model capable of both memorization and relational reasoning. We achieve competitive results with our proposed two-memory model in a diversity of machine learning tasks, from challenging synthetic problems to practical testbeds such as geometry, graph, reinforcement learning, and question answering.


title: An empirical analysis of information encoded in disentangled neural speaker representations

abstract: The primary characteristic of robust speaker representations is that they are invariant to factors of variability not related to speaker identity. Disentanglement of speaker representations is one of the techniques used to improve robustness of speaker representations to both intrinsic factors that are acquired during speech production (e.g., emotion, lexical content) and extrinsic factors that are acquired during signal capture (e.g., channel, noise). Disentanglement in neural speaker representations can be achieved either in a supervised fashion with annotations of the nuisance factors (factors not related to speaker identity) or in an unsupervised fashion without labels of the factors to be removed. In either case it is important to understand the extent to which the various factors of variability are entangled in the representations. In this work, we examine speaker representations with and without unsupervised disentanglement for the amount of information they capture related to a suite of factors. Using classification experiments we provide empirical evidence that disentanglement reduces the information with respect to nuisance factors from speaker representations, while retaining speaker information. This is further validated by speaker verification experiments on the VOiCES corpus in several challenging acoustic conditions. We also show improved robustness in speaker verification tasks using data augmentation during training of disentangled speaker embeddings. Finally, based on our findings, we provide insights into the factors that can be effectively separated using the unsupervised disentanglement technique and discuss potential future directions.


title: UGRWO-Sampling for COVID-19 dataset: A modified random walk under-sampling approach based on graphs to imbalanced data classification

abstract: This paper proposes a new RWO-Sampling (Random Walk Over-Sampling) based on graphs for imbalanced datasets. In this method, two schemes based on under-sampling and over-sampling methods are introduced to keep the proximity information robust to noises and outliers. After constructing the first graph on minority class, RWO-Sampling will be implemented on selected samples, and the rest will remain unchanged. The second graph is constructed for the majority class, and the samples in a low-density area (outliers) are removed. Finally, in the proposed method, samples of the majority class in a high-density area are selected, and the rest are eliminated. Furthermore, utilizing RWO-sampling, the boundary of minority class is increased though the outliers are not raised. This method is tested, and the number of evaluation measures is compared to previous methods on nine continuous attribute datasets with different over-sampling rates and one data set for the diagnosis of COVID-19 disease. The experimental results indicated the high efficiency and flexibility of the proposed method for the classification of imbalanced data


title: Image-based Analysis of Patterns Formed in Drying Drops

abstract: Image processing and pattern recognition offer a useful and versatile method for optically characterizing drops of a colloidal solution during the drying process and in its final state. This paper exploits image processing techniques applied to cross-polarizing microscopy to probe birefringence and the bright-field microscopy to examine the morphological patterns. The bio-colloidal solution of interest is a mixture of water, liquid crystal (LC) and three different proteins [lysozyme (Lys), myoglobin (Myo), and bovine serum albumin (BSA)], all at a fixed relative concentration. During the drying process, the LC phase separates and becomes optically active detectable through its birefringence. Further, as the protein concentrates, it forms cracks under strain due to the evaporation of water. The mean intensity profile of the drying process is examined using an automated image processing technique that reveals three unique regimes: a steady upsurge, a speedy rise, and an eventual saturation. The high values of standard deviation show the complexity, the roughness, and inhomogeneity of the image surface. A semi-automated image processing technique is proposed to quantify the distance between the consecutive cracks by converting those into high contrast images. The outcome of the image analysis correlates with the initial state of the mixture, the nature of the proteins, and the mechanical response of the final patterns. The paper reveals new insights on the self-assembly of the macromolecules during the drying mechanism of any aqueous solution.


title: Submodular Maximization Through Barrier Functions

abstract: In this paper, we introduce a novel technique for constrained submodular maximization, inspired by barrier functions in continuous optimization. This connection not only improves the running time for constrained submodular maximization but also provides the state of the art guarantee. More precisely, for maximizing a monotone submodular function subject to the combination of a $k$-matchoid and $\ell$-knapsack constraint (for $\ell\leq k$), we propose a potential function that can be approximately minimized. Once we minimize the potential function up to an $\epsilon$ error it is guaranteed that we have found a feasible set with a $2(k+1+\epsilon)$-approximation factor which can indeed be further improved to $(k+1+\epsilon)$ by an enumeration technique. We extensively evaluate the performance of our proposed algorithm over several real-world applications, including a movie recommendation system, summarization tasks for YouTube videos, Twitter feeds and Yelp business locations, and a set cover problem.


title: Explicit parity violation in $SU(2)_L\otimes SU(2)_R\otimes U(1)_{B-L}$ models

abstract: Here we propose models with $SU(2)_L\otimes SU(2)_R\otimes U(1)_{B-L}$ electroweak gauge symmetry in which parity (or charge conjugation) is broken explicitly and the interactions of left- and right-handed fermions are completely different from each other at any energy scale. In these sort of models there is no restoration of parity at high energies. However, as in all left-right symmetric models, the electroweak charged interactions of quarks and leptons appear to be only left-handed at low energies, because the right-handed interactions are suppressed by the mass of the respective charged vector bosons and/or because these interactions may be much weaker than the left-handed ones.


title: Crystal Defects: A Portal To Dark Matter Detection

abstract: We propose to use the defect creation energy loss in commonly used high energy physics solid state detectors as a tool to statistically identify dark matter signal from background. We simulate the energy loss in the process of defect creation using density functional theory and molecular dynamics methods and calculate the corresponding expected dark matter spectra. We show that in phonon-mediated solid state detectors, the energy loss due to defect creation convolved with the expected dark matter interaction signal results in a significant change in the expected spectra for common detector materials. With recent progress towards $\sim$10 eV threshold low-mass dark matter searches, this variation in expected dark matter spectrum can be used as a direct signature of dark matter interactions with atomic nuclei.

categories: physics.ins-det astro-ph.CO cond-mat.mtrl-sci hep-ex


title: Identifying defect-related quantum emitters in monolayer WSe$_2$

abstract: Monolayer transition metal dichalcogenides have recently attracted great interests because the quantum dots embedded in monolayer can serve as optically active single photon emitters. Here, we provide an interpretation of the recombination mechanisms of these quantum emitters through polarization-resolved and magneto-optical spectroscopy at low temperature. Three types of defect-related quantum emitters in monolayer tungsten diselenide (WSe$_2$) are observed, with different exciton g factors of 2.02, 9.36 and unobservable Zeeman shift, respectively. The various magnetic response of the spatially localized excitons strongly indicate that the radiative recombination stems from the different transitions between defect-induced energy levels, valance and conduction bands. Furthermore, the different g factors and zero-field splittings of the three types of emitters strongly show that quantum dots embedded in monolayer have various types of confining potentials for localized excitons, resulting in electron-hole exchange interaction with a range of values in the presence of anisotropy. Our work further sheds light on the recombination mechanisms of defect-related quantum emitters and paves a way toward understanding the role of defects in single photon emitters in atomically thin semiconductors.


title: Vertex cut of a graph and connectivity of its neighbourhood complex

abstract: We show that if a graph $G$ satisfies certain conditions then the connectivity of neighbourhood complex $\mathcal{N}(G)$ is strictly less than the vertex connectivity of $G$. As an application, we give a relation between the connectivity of the neighbourhood complex and the vertex connectivity for stiff chordal graphs, and for weakly triangulated graphs satisfying certain properties. Further, we prove that for a graph $G$ if there exists a vertex $v$ satisfying the property that for any $k$-subset $S$ of neighbours of $v$, there exists a vertex $v_S \neq v$ such that $S$ is subset of neighbours of $v_S$, then $\mathcal{N}(G-\{v\})$ is $(k-1)$-connected implies that $\mathcal{N}(G)$ is $(k-1)$-connected. As a consequence of this, we show that:(i) neighbourhood complexes of queen and king graphs are simply connected and (ii) if $G$ is a $(n+1)$-connected chordal graph which is not folded onto a clique of size $n+2$, then $\mathcal{N}(G)$ is $n$-connected.


title: Multi-object Monocular SLAM for Dynamic Environments

abstract: In this paper, we tackle the problem of multibody SLAM from a monocular camera. The term multibody, implies that we track the motion of the camera, as well as that of other dynamic participants in the scene. The quintessential challenge in dynamic scenes is unobservability: it is not possible to unambiguously triangulate a moving object from a moving monocular camera. Existing approaches solve restricted variants of the problem, but the solutions suffer relative scale ambiguity (i.e., a family of infinitely many solutions exist for each pair of motions in the scene). We solve this rather intractable problem by leveraging single-view metrology, advances in deep learning, and category-level shape estimation. We propose a multi pose-graph optimization formulation, to resolve the relative and absolute scale factor ambiguities involved. This optimization helps us reduce the average error in trajectories of multiple bodies over real-world datasets, such as KITTI. To the best of our knowledge, our method is the first practical monocular multi-body SLAM system to perform dynamic multi-object and ego localization in a unified framework in metric scale.


title: Complex Phase Diagram of Doped XXZ Ladder: Localization and Pairing

abstract: How the ground state nature can be dramatically changed by the distinct underlying spin correlation is a central issue of doped Mott insulators. The two-leg XXZ ladder provides a prototypical spin background, which can be tuned from a long-range N\'{e}el order to a short-range ``spin liquid'' via the superexchange anisotropy, giving rise to a complex phase diagram at finite doping. By density matrix renormalization group method, we show that although the charge is always self-localized in the N\'{e}el ordered phase, a second insulating phase emerges, in which the doped holes become paired but remain localized while the transverse spin-spin correlation reduces to short-ranged one to make the N\'{e}el order classical. Only when the N\'{e}el order totally disappears by further reducing anisotropy, does the pairing become truly coherent as characterized by a Luther-Emery state. In sharp contrast, the pairing is totally absent in the in-plane ferromagnetic XXZ regime, where a direct transition from the charge self-localization in the N\'{e}el ordered phase to a Fermi-gas-like state in the spin liquid phase is found. A consistent physical picture is briefly discussed.


title: Asymmetric Cell Transmission Model-Based, Ramp-Connected Robust Traffic Density Estimation under Bounded Disturbances

abstract: In modern transportation systems, traffic congestion is inevitable. To minimize the loss caused by congestion, various control strategies have been developed most of which rely on observing real-time traffic conditions. As vintage traffic sensors are limited, traffic density estimation is very helpful for gaining network-wide observability. This paper deals with this problem by first, presenting a traffic model for stretched highway having multiple ramps built based on asymmetric cell transmission model (ACTM). Second, based on the assumption that the encompassed nonlinearity of the ACTM is Lipschitz, a robust dynamic observer framework for performing traffic density estimation is proposed. Numerical test results show that the observer yields a sufficient performance in estimating traffic densities having noisy measurements, while being computationally faster the Unscented Kalman Filter in performing real-time estimation.


title: A Novel Kuhnian Ontology for Epistemic Classification of STM Scholarly Articles

abstract: Thomas Kuhn proposed his paradigmatic view of scientific discovery five decades ago. The concept of paradigm has not only explained the progress of science, but has also become the central epistemic concept among STM scientists. Here, we adopt the principles of Kuhnian philosophy to construct a novel ontology aims at classifying and evaluating the impact of STM scholarly articles. First, we explain how the Kuhnian cycle of science describes research at different epistemic stages. Second, we show how the Kuhnian cycle could be reconstructed into modular ontologies which classify scholarly articles according to their contribution to paradigm-centred knowledge. The proposed ontology and its scenarios are discussed. To the best of the authors knowledge, this is the first attempt for creating an ontology for describing scholarly articles based on the Kuhnian paradigmatic view of science.


title: Understanding and Improving Knowledge Distillation

abstract: Knowledge Distillation (KD) is a model-agnostic technique to improve model quality while having a fixed capacity budget. It is a commonly used technique for model compression, where a larger capacity teacher model with better quality is used to train a more compact student model with better inference efficiency. Through distillation, one hopes to benefit from student's compactness, without sacrificing too much on model quality. Despite the large success of knowledge distillation, better understanding of how it benefits student model's training dynamics remains under-explored. In this paper, we categorize teacher's knowledge into three hierarchical levels and study its effects on knowledge distillation: (1) knowledge of the `universe', where KD brings a regularization effect through label smoothing; (2) domain knowledge, where teacher injects class relationships prior to student's logit layer geometry; and (3) instance specific knowledge, where teacher rescales student model's per-instance gradients based on its measurement on the event difficulty. Using systematic analyses and extensive empirical studies on both synthetic and real-world datasets, we confirm that the aforementioned three factors play a major role in knowledge distillation. Furthermore, based on our findings, we diagnose some of the failure cases of applying KD from recent studies.


title: Laser tracker adaptive tuning

abstract: The goal of the automatic tuning algorithm is to compute suitable values for the controller gains, including the proportional (Kp), integral (Ki), and derivative (Kd), as well as the tachometer feedback gain (Kv).


title: Discrete Action On-Policy Learning with Action-Value Critic

abstract: Reinforcement learning (RL) in discrete action space is ubiquitous in real-world applications, but its complexity grows exponentially with the action-space dimension, making it challenging to apply existing on-policy gradient based deep RL algorithms efficiently. To effectively operate in multidimensional discrete action spaces, we construct a critic to estimate action-value functions, apply it on correlated actions, and combine these critic estimated action values to control the variance of gradient estimation. We follow rigorous statistical analysis to design how to generate and combine these correlated actions, and how to sparsify the gradients by shutting down the contributions from certain dimensions. These efforts result in a new discrete action on-policy RL algorithm that empirically outperforms related on-policy algorithms relying on variance control techniques. We demonstrate these properties on OpenAI Gym benchmark tasks, and illustrate how discretizing the action space could benefit the exploration phase and hence facilitate convergence to a better local optimal solution thanks to the flexibility of discrete policy.


title: Collisionless particle dynamic in an axi-symmetric diamagnetic trap

abstract: Particle dynamic in an axi-symmetric mirror machine with an extremely high plasma pressure equal to pressure of vacuum magnetic field (so-called regime of diamagnetic confinement) is investigated. Extrusion of magnetic field from central region due to plasma diamagnetism leads to non-conservation of the magnetic moment and can result in chaotic movement and fast losses of particles. The following mechanisms can provide particle confinement for unlimited time: absolute confinement of particles with high azimuthal velocity and conservation of adiabatic invariant for particle moving in smooth magnetic field. The criteria of particle confinement and estimations of lifetime of unconfined particles are obtained and verified in direct numerical simulation. Particle confinement time in the diamagnetic trap in regime of gas-dynamic outflow is discussed.


title: What Changed Your Mind: The Roles of Dynamic Topics and Discourse in Argumentation Process

abstract: In our world with full of uncertainty, debates and argumentation contribute to the progress of science and society. Despite of the increasing attention to characterize human arguments, most progress made so far focus on the debate outcome, largely ignoring the dynamic patterns in argumentation processes. This paper presents a study that automatically analyzes the key factors in argument persuasiveness, beyond simply predicting who will persuade whom. Specifically, we propose a novel neural model that is able to dynamically track the changes of latent topics and discourse in argumentative conversations, allowing the investigation of their roles in influencing the outcomes of persuasion. Extensive experiments have been conducted on argumentative conversations on both social media and supreme court. The results show that our model outperforms state-of-the-art models in identifying persuasive arguments via explicitly exploring dynamic factors of topic and discourse. We further analyze the effects of topics and discourse on persuasiveness, and find that they are both useful - topics provide concrete evidence while superior discourse styles may bias participants, especially in social media arguments. In addition, we draw some findings from our empirical results, which will help people better engage in future persuasive conversations.


title: Calibrating wood products for load duration and rate: A statistical look at three damage models

abstract: Lumber and wood-based products are versatile construction materials that are susceptible to weakening as a result of applied stresses. To assess the effects of load duration and rate, experiments have been carried out by applying preset load profiles to sample specimens. This paper studies these effects via a damage modeling approach, by considering three models in the literature: the Gerhards and Foschi accumulated damage models, and a degradation model based on the gamma process. We present a statistical framework for fitting these models to failure time data generated by a combination of ramp and constant load settings, and show how estimation uncertainty can be quantified. The models and methods are illustrated and compared via a novel analysis of a Hemlock lumber dataset. Practical usage of the fitted damage models is demonstrated with an application to long-term reliability prediction under stochastic future loadings.


title: Tiling Iterated Function Systems

abstract: This paper presents a detailed symbolic approach to the study of self-similar tilings. It uses properties of addresses associated with graph-directed iterated function systems to establish conjugacy properties of tiling spaces. Tiles may be fractals and the tiled set may be a complicated unbounded subset of $\mathbb{R}^{M}$.


title: On the Complexity of Constructive Control under Nearly Single-Peaked Preferences

abstract: We investigate the complexity of {\sc{Constructive Control by Adding/Deleting Votes}} (CCAV/CCDV) for $r$-approval, Condorcet, Maximin and Copeland$^{\alpha}$ in $k$-axes and $k$-candidates partition single-peaked elections. In general, we prove that CCAV and CCDV for most of the voting correspondences mentioned above are NP-hard even when~$k$ is a very small constant. Exceptions are CCAV and CCDV for Condorcet and CCAV for $r$-approval in $k$-axes single-peaked elections, which we show to be fixed-parameter tractable with respect to~$k$. In addition, we give a polynomial-time algorithm for recognizing $2$-axes elections, resolving an open problem. Our work leads to a number of dichotomy results. To establish an NP-hardness result, we also study a property of $3$-regular bipartite graphs which may be of independent interest. In particular, we prove that for every $3$-regular bipartite graph, there are two linear orders of its vertices such that the two endpoints of every edge are consecutive in at least one of the two orders.


title: A wave-pulse neural network for quasi-quantum coding

abstract: We design a physical wave-pulse neural network (WPNN) for both wave and pulse propagation, which gives more degrees of freedom for neural coding than spike neural networks (SNN). We define the rules and the information entropy of this kind of neural network, where the signal speed, arrival time, and the length of connections between neurons all become crucial parameters for signal coding. We call it quasi-quantum coding (QQC) since the combination of wave and pulse signals here behaves like a classical mimic of quantum wave-particle duality, and can be studied by borrowing some concepts form quantum mechanics. We present that the quasi-quantum coding can give efficient methods for both sound and image recognitions. We also discuss the possibility of the wave-pulse neural network and the quasi-quantum coding methods running on it in biological brains where both neural oscillations and action potentials are important to cognition.


title: Resilient Consensus via Weight Learning and Its Application in Fault-Tolerant Clock Synchronization

abstract: This paper addresses the distributed consensus problem in the presence of faulty nodes. A novel weight learning algorithm is introduced such that neither network connectivity nor a sequence of history records is required to achieve resilient consensus. The critical idea is to dynamically update the interaction weights among neighbors learnt from their credibility measurement. Basically, we define a reward function that is inversely proportional to the distance to its neighbor, and then adjust the credibility based on the reward derived at the present step and the previous credibility. In such a way, the interaction weights are updated at every step, which integrates the historic information and degrades the influences from faulty nodes. Both fixed and stochastic topologies are considered in this paper. Furthermore, we apply this novel approach in clock synchronization problem. By updating the logical clock skew and offset via the corresponding weight learning algorithms, respectively, the logical clock synchronization is eventually achieved regardless of faulty nodes. Simulations are provided to illustrate the effectiveness of the strategy.


title: Oriented Matroids and Combinatorial Neural Codes

abstract: A combinatorial neural code $\mathscr C\subseteq 2^{[n]}$ is convex if it arises as the intersection pattern of convex open subsets of $\mathbb R^d$. We relate the emerging theory of convex neural codes to the established theory of oriented matroids, both categorically and with respect to geometry and computational complexity. On the categorical side, we show that the map taking an acyclic oriented matroid to the code of positive parts of its topes is a faithful functor. We adapt the oriented matroid ideal introduced by Novik, Postnikov, and Sturmfels into a functor from the category of oriented matroids to the category of rings; then, we show that the resulting ring maps naturally to the neural ring of the matroid's neural code. For geometry and computational complexity, we show that a code has a realization with convex polytopes if and only if it lies below the code of a representable oriented matroid in the partial order of codes introduced by Jeffs. We show that previously published examples of non-convex codes do not lie below any oriented matroids, and we construct examples of non-convex codes lying below non-representable oriented matroids. By way of this construction, we can apply Mn\"{e}v-Sturmfels universality to show that deciding whether a combinatorial code is convex is NP-hard.


title: Before the Page time: maximum entanglements or the return of the monster?

abstract: The conservation of information of evaporating black holes is a very natural consequence of unitarity which is the fundamental symmetry of quantum mechanics. In order to study the conservation of information, we need to understand the nature of the entanglement entropy. The entropy of Hawking radiation is approximately equal to the maximum of entanglement entropy if a black hole is in a state before the Page time, i.e., when the entropy of Hawking radiation is smaller than the entropy of the black hole. However, if there exists a process generating smaller entanglements rather than maximal entanglements, the entropy of Hawking radiation will become smaller than the maximum of the entanglement entropy before the Page time. If this process accumulates, even though the probability is small, the emitted radiation can eventually be distinguished from the exactly thermal state. In this paper, we provide several interpretations of this phenomenon: (1) information of the collapsed matter is emitted before the Page time, (2) there exists a firewall or a non-local effect before the Page time, or (3) the statistical entropy is greater than the areal entropy; a monster is formed. Our conclusion will help resolve the information loss paradox by providing groundwork for further research.


title: On rational maps with buried critical points

abstract: In this paper, we construct geometrically finite rational maps with buried critical points on the boundaries of some hyperbolic components by using the pinching and plumbing deformations.


title: Extended H$\alpha$ over compact far-infrared continuum in dusty submillimeter galaxies -- Insights into dust distributions and star-formation rates at $z\sim2$

abstract: Using data from ALMA and near-infrared (NIR) integral field spectrographs including both SINFONI and KMOS on the VLT, we investigate the two-dimensional distributions of H$\alpha$ and rest-frame far-infrared (FIR) continuum in six submillimeter galaxies at $z\sim2$. At a similar spatial resolution ($\sim$0.5" FWHM; $\sim$4.5 kpc at $z=2$), we find that the half-light radius of H$\alpha$ is significantly larger than that of the FIR continuum in half of the sample, and on average H$\alpha$ is a median factor of $2.0\pm0.4$ larger. Having explored various ways to correct for the attenuation, we find that the attenuation-corrected H$\alpha$-based SFRs are systematically lower than the IR-based SFRs by at least a median factor of $3\pm1$, which cannot be explained by the difference in half-light radius alone. In addition, we find that in 40% of cases the total $V$-band attenuation ($A_V$) derived from energy balance modeling of the full ultraviolet(UV)-to-FIR spectral energy distributions (SEDs) is significantly higher than that derived from SED modeling using only the UV-to-NIR part of the SEDs, and the discrepancy appears to increase with increasing total infrared luminosity. Finally, considering all our findings along with the studies in the literature, we postulate that the dust distributions in SMGs, and possibly also in less IR luminous $z\sim2$ massive star-forming galaxies, can be decomposed into three main components; the diffuse dust heated by older stellar populations, the more obscured and extended young star-forming HII regions, and the heavily obscured central regions that have a low filling factor but dominate the infrared luminosity in which the majority of attenuation cannot be probed via UV-to-NIR emissions.


title: Continuous-time Lower Bounds for Gradient-based Algorithms

abstract: This article derives lower bounds on the convergence rate of continuous-time gradient-based optimization algorithms. The algorithms are subjected to a time-normalization constraint that avoids a reparametrization of time in order to make the discussion of continuous-time convergence rates meaningful. We reduce the multi-dimensional problem to a single dimension, recover well-known lower bounds from the discrete-time setting, and provide insight into why these lower bounds occur. We present algorithms that achieve the proposed lower bounds, even when the function class under consideration includes certain nonconvex functions.


title: Non-perturbative renormalization of the average color charge and multi-point correlators of color charge from a non-Gaussian small-$x$ action

abstract: The McLerran-Venugopalan (MV) model is a Gaussian effective theory of color charge fluctuations at small-$x$ in the limit of large valence charge density, {\it i}.{\it e}., a large nucleus made of uncorrelated color charges. In this work, we explore the effects of the first non-trivial (even C-parity) non-Gaussian correction on the color charge density to the MV model ("quartic" term) in SU(2) and SU(3) color group in the non-perturbative regime. We compare our (numerical) non-perturbative results to (analytical) perturbative ones in the limit of small or large non-Gaussian fluctuations. The couplings in the non-Gaussian action, $\bar\mu$ for the quadratic and $\kappa_4$ for the quartic term, need to be renormalized in order to match the two-point function in the Gaussian theory. We investigate three different choices for the renormalization of these couplings: i) $\kappa_{4}$ is proportional to a power of $\bar\mu$; ii) $\kappa_4$ is kept constant and iii) $\bar\mu$ is kept constant. We find that the first two choices lead to a scenario where the small-$x$ action evolves towards a theory dominated by large non-Gaussian fluctuations, regardless of the system size, while the last one allows for controlling the deviations from the MV model.


title: Polystability and the Hitchin-Kobayashi correspondence

abstract: Using a quasi-linear version of Hodge theory, holomorphic vector bundles in a neighbourhood of a given polystable bundle on a compact Kaehler manifold are shown to be (poly)stable if and only if their corresponding classes are (poly)stable in the sense of geometric invariant theory with respect to the linear action of the automorphism group of the bundle on its space of infinitesimal deformations.


title: Adversarial TCAV -- Robust and Effective Interpretation of Intermediate Layers in Neural Networks

abstract: Interpreting neural network decisions and the information learned in intermediate layers is still a challenge due to the opaque internal state and shared non-linear interactions. Although (Kim et al, 2017) proposed to interpret intermediate layers by quantifying its ability to distinguish a user-defined concept (from random examples), the questions of robustness (variation against the choice of random examples) and effectiveness (retrieval rate of concept images) remain. We investigate these two properties and propose improvements to make concept activations reliable for practical use. Effectiveness: If the intermediate layer has effectively learned a user-defined concept, it should be able to recall --- at the testing step --- most of the images containing the proposed concept. For instance, we observed that the recall rate of Tiger shark and Great white shark from the ImageNet dataset with "Fins" as a user-defined concept was only 18.35% for VGG16. To increase the effectiveness of concept learning, we propose A-CAV --- the Adversarial Concept Activation Vector --- this results in larger margins between user concepts and (negative) random examples. This approach improves the aforesaid recall to 76.83% for VGG16. For robustness, we define it as the ability of an intermediate layer to be consistent in its recall rate (the effectiveness) for different random seeds. We observed that TCAV has a large variance in recalling a concept across different random seeds. For example, the recall of cat images (from a layer learning the concept of tail) varies from 18% to 86% with 20.85% standard deviation on VGG16. We propose a simple and scalable modification that employs a Gram-Schmidt process to sample random noise from concepts and learn an average "concept classifier". This approach improves the aforesaid standard deviation from 20.85% to 6.4%.


title: Graphs on surfaces with positive Forman curvature or corner curvature

abstract: On one hand, we study the class of graphs on surfaces, satisfying tessellation properties, with positive Forman curvature on each edge. Via medial graphs, we provide a new proof for the finiteness of the class, and give a complete classification. On the other hand, we classify the class of graphs on surfaces with positive corner curvature.


title: Big-bang limit of $2+1$ gravity and Thurston boundary of Teichm\"uller space

abstract: We study the asymptotic behavior of the solution curves of the dynamics of spacetimes of the topological type $\Sigma_{p}\times \mathbb{R}$, $p>1$, where $\Sigma_{p}$ is a closed Riemann surface of genus $p$, in the regime of $2+1$ dimensional classical general relativity. The configuration space of the gauge fixed dynamics is identified with the Teichm\"uller space ($\mathcal{T}\Sigma_{p}\approx \mathbb{R}^{6p-6}$) of $\Sigma_{p}$. Utilizing the properties of the Dirichlet energy of certain harmonic maps, estimates derived from the associated elliptic equations in conjunction with a few standard results of the theory of the compact Riemann surfaces, we prove that every non-trivial solution curve runs off the edge of the Teichm\"uller space at the limit of the big bang singularity and approaches the space of projective measured laminations/foliations ($\mathcal{PML}$ $\mathcal{PMF}$), the Thurston boundary of the Teichm\"uller space.


title: Automating App Review Response Generation

abstract: Previous studies showed that replying to a user review usually has a positive effect on the rating that is given by the user to the app. For example, Hassan et al. found that responding to a review increases the chances of a user updating their given rating by up to six times compared to not responding. To alleviate the labor burden in replying to the bulk of user reviews, developers usually adopt a template-based strategy where the templates can express appreciation for using the app or mention the company email address for users to follow up. However, reading a large number of user reviews every day is not an easy task for developers. Thus, there is a need for more automation to help developers respond to user reviews. Addressing the aforementioned need, in this work we propose a novel approach RRGen that automatically generates review responses by learning knowledge relations between reviews and their responses. RRGen explicitly incorporates review attributes, such as user rating and review length, and learns the relations between reviews and corresponding responses in a supervised way from the available training data. Experiments on 58 apps and 309,246 review-response pairs highlight that RRGen outperforms the baselines by at least 67.4% in terms of BLEU-4 (an accuracy measure that is widely used to evaluate dialogue response generation systems). Qualitative analysis also confirms the effectiveness of RRGen in generating relevant and accurate responses.