title: Information production in homogeneous isotropic turbulence

abstract: We study the Reynolds number scaling of the Kolmogorov-Sinai entropy and attractor dimension for three dimensional homogeneous isotropic turbulence through the use of direct numerical simulation. To do so, we obtain Lyapunov spectra for a range of different Reynolds numbers by following the divergence of a large number of orthogonal fluid trajectories. We find that the attractor dimension grows with the Reynolds number as Re$^{2.35}$ with this exponent being larger than predicted by either dimensional arguments or intermittency models. The distribution of Lyapunov exponents is found to be finite around $\lambda \approx 0$ contrary to a possible divergence suggested by Ruelle. The relevance of the Kolmogorov-Sinai entropy and Lyapunov spectra in comparing complex physical systems is discussed.


title: Multi-Task Bidirectional Transformer Representations for Irony Detection

abstract: Supervised deep learning requires large amounts of training data. In the context of the FIRE2019 Arabic irony detection shared task (IDAT@FIRE2019), we show how we mitigate this need by fine-tuning the pre-trained bidirectional encoders from transformers (BERT) on gold data in a multi-task setting. We further improve our models by by further pre-training BERT on `in-domain' data, thus alleviating an issue of dialect mismatch in the Google-released BERT model. Our best model acquires 82.4 macro F1 score, and has the unique advantage of being feature-engineering free (i.e., based exclusively on deep learning).


title: Large Scale Question Answering using Tourism Data

abstract: We introduce the novel task of answering entity-seeking recommendation questions using a collection of reviews that describe candidate answer entities. We harvest a QA dataset that contains 47,124 paragraph-sized real user questions from travelers seeking recommendations for hotels, attractions and restaurants. Each question can have thousands of candidate answers to choose from and each candidate is associated with a collection of unstructured reviews. This dataset is especially challenging because commonly used neural architectures for reasoning and QA are prohibitively expensive for a task of this scale. As a solution, we design a scalable cluster-select-rerank approach. It first clusters text for each entity to identify exemplar sentences describing an entity. It then uses a scalable neural information retrieval (IR) module to select a set of potential entities from the large candidate set. A reranker uses a deeper attention-based architecture to pick the best answers from the selected entities. This strategy performs better than a pure IR or a pure attention-based reasoning approach yielding nearly 25% relative improvement in Accuracy@3 over both approaches.


title: Periodic training of creeping solids

abstract: We consider disordered solids in which the microscopic elements can deform plastically in response to stresses on them. We show that by driving the system periodically, this plasticity can be exploited to train in desired elastic properties, both in the global moduli and in local "allosteric" interactions. Periodic driving can couple an applied "source" strain to a target strain over a path in the energy landscape. This coupling allows control of the system's response even at large strains well into the nonlinear regime, where it can be difficult to achieve control simply by design.


title: Generating Reliable Friends via Adversarial Training to Improve Social Recommendation

abstract: Most of the recent studies of social recommendation assume that people share similar preferences with their friends and the online social relations are helpful in improving traditional recommender systems. However, this assumption is often untenable as the online social networks are quite sparse and a majority of users only have a small number of friends. Besides, explicit friends may not share similar interests because of the randomness in the process of building social networks. Therefore, discovering a number of reliable friends for each user plays an important role in advancing social recommendation. Unlike other studies which focus on extracting valuable explicit social links, our work pays attention to identifying reliable friends in both the observed and unobserved social networks. Concretely, in this paper, we propose an end-to-end social recommendation framework based on Generative Adversarial Nets (GAN). The framework is composed of two blocks: a generator that is used to produce friends that can possibly enhance the social recommendation model, and a discriminator that is responsible for assessing these generated friends and ranking the items according to both the current user and her friends' preferences. With the competition between the generator and the discriminator, our framework can dynamically and adaptively generate reliable friends who can perfectly predict the current user' preference at a specific time. As a result, the sparsity and unreliability problems of explicit social relations can be mitigated and the social recommendation performance is significantly improved. Experimental studies on real-world datasets demonstrate the superiority of our framework and verify the positive effects of the generated reliable friends.


title: A hypothesis-testing perspective on the G-normal distribution theory

abstract: The G-normal distribution was introduced by Peng [2007] as the limiting distribution in the central limit theorem for sublinear expectation spaces. Equivalently, it can be interpreted as the solution to a stochastic control problem where we have a sequence of random variables, whose variances can be chosen based on all past information. In this note we study the tail behavior of the G-normal distribution through analyzing a nonlinear heat equation. Asymptotic results are provided so that the tail "probabilities" can be easily evaluated with high accuracy. This study also has a significant impact on the hypothesis testing theory for heteroscedastic data; we show that even if the data are generated under the null hypothesis, it is possible to cheat and attain statistical significance by sequentially manipulating the error variances of the observations.


title: (GL_k x S_n)-modules and nabla of hook-indexed Schur functions

abstract: The aim of this paper is to describe structural properties of spaces of diagonal rectangular harmonic polynomials in several sets (say $k$) of $n$ variables, both as $GL_k$-modules and $S_n$-modules. We construct explicit such modules associated to any hook shape partitions. For the two sets of variables case, we conjecture that the associated graded Frobenius characteristic corresponds to the effect of the operator Nabla on the corresponding hook-indexed Schur function, up to a usual renormalization. We prove identities that give indirect support to this conjecture, and show that its restriction to one set of variables holds. We further give indications on how the several sets context gives a better understanding of questions regarding the structures of these modules and the links between them.


title: Comparison theorems on H-type sub-Riemannian manifolds

abstract: On H-type sub-Riemannian manifolds we establish sub-Hessian and sub-Laplacian comparison theorems which are uniform for a family of approximating Riemannian metrics converging to the sub-Riemannian one. We also prove a sharp sub-Riemannian Bonnet-Myers theorem that extends to this general setting results previously proved on contact and quaternionic contact manifolds.


title: An Update of the ABMP16 PDF Fit

abstract: We present an updated version of the ABMP16 nucleon PDFs, which is tuned by using recent precise data on $W$- and $Z/\gamma^*$-production at the LHC and the final HERA data on DIS $c$- and $b$-quark production and by imposing a stringent $Q^2$-cut on the inclusive DIS data in order to avoid the impact of higher twist terms at small $x$ at HERA. The new $W$- and $Z$-boson production data, in particular the updated version of the ATLAS data at the c.m.s. energy 7 TeV, are well accommodated into the present fit. The strange sea distribution obtained is consistent with the average of the up and down quark ones at small $x$. However, it is still suppressed with respect to the non-strange one by a factor of $\sim 0.5$ at moderate $x$. The small-$x$ gluon distribution is enhanced as compared to the previous ABMP16 fit, in line with updated data on the DIS $c$-quark production. Finally, a good description of the non-resonant $\gamma^*/Z$-production data, which are included into the ABM analysis for the first time, is achieved provided the photon-initiated lepton pair production is taken into account.


title: A New GNG Graph-Based Hand Gesture Recognition Approach

abstract: Hand Gesture Recognition (HGR) is of major importance for Human-Computer Interaction (HCI) applications. In this paper, we present a new hand gesture recognition approach called GNG-IEMD. In this approach, first, we use a Growing Neural Gas (GNG) graph to model the image. Then we extract features from this graph. These features are not geometric or pixel-based, so do not depend on scale, rotation, and articulation. The dissimilarity between hand gestures is measured with a novel Improved Earth Mover\textquotesingle s Distance (IEMD) metric. We evaluate the performance of the proposed approach on challenging public datasets including NTU Hand Digits, HKU, HKU multi-angle, and UESTC-ASL and compare the results with state-of-the-art approaches. The experimental results demonstrate the performance of the proposed approach.


title: Residual finiteness growths of Lamplighter groups

abstract: Residual finiteness growth gives an invariant that indicates how well-approximated a finitely generated group is by its finite quotients. We briefly survey the state of the subject. We then improve on the best known upper and lower bounds for lamplighter groups. Notably, any lamplighter group has super-linear residual finiteness growth. In our proof, we quantify a congruence subgroup property for lamplighter groups.


title: Non-gaussian waves in Seba's billiard

abstract: The Seba billiard, a rectangular torus with a point scatterer, is a popular model to study the transition between integrability and chaos in quantum systems. Whereas such billiards are classically essentially integrable, they may display features such as quantum ergodicity [KU] which are usually associated with quantum systems whose classical dynamics is chaotic. Seba proposed that the eigenfunctions of toral point scatterers should also satisfy Berry's random wave conjecture, which implies that the semiclassical moments of the eigenfunctions ought to be Gaussian. We prove a conjecture of Keating, Marklof and Winn who suggested that Seba billiards with irrational aspect ratio violate the random wave conjecture. More precisely, in the case of diophantine tori, we construct a subsequence of eigenfunctions of essentially full density and show that its semiclassical moments cannot be Gaussian.


title: A Framework for Data-Based Turbulent Combustion Closure: A Posteriori Validation

abstract: In this work, we demonstrate a framework for developing closure models in turbulent combustion using experimental multi-scalar measurements. The framework is based on the construction of conditional means and joint scalar PDFs from experimental data based on the parameterization of composition space using principal component analysis (PCA). The resulting principal components (PCs) act as both conditioning variables and transport variables. Their chemical source terms are constructed starting from instantaneous temperature and species measurements using a variant of the pairwise mixing stirred reactor (PMSR) approach. A multi-dimensional kernel density estimation (KDE) approach is used to construct the joint PDFs in PC space. Convolutions of these joint PDFs with conditional means are used to determine the unconditional means for the closure terms: the mean PCs chemical source terms and the density. These means are parameterized in terms of the mean PCs using artificial neural networks (ANN). The framework is demonstrated a posteriori using the data from the Sandia piloted turbulent jet flames D, E and F by performing RANS calculations. The radial profiles of mean and RMS of temperature and measured species mass fractions agree well with the experimental means for these flames.


title: The vortex fiber nulling mode of the Keck Planet Imager and Characterizer (KPIC)

abstract: The Keck Planet Imager and Characterizer (KPIC) is an upgrade to the Keck II adaptive optics system that includes an active fiber injection unit (FIU) for efficiently routing light from exoplanets to NIRSPEC, a high-resolution spectrograph. Towards the end of 2019, we will add a suite of new coronagraph modes as well as a high-order deformable mirror. One of these modes, operating in $K$-band (2.2$\mu m$), will be the first vortex fiber nuller to go on sky. Vortex Fiber Nulling (VFN) is a new interferometric method for suppressing starlight in order to spectroscopically characterize exoplanets at angular separations that are inaccessible with conventional coronagraph systems. A monochromatic starlight suppression of $6\times10^{-5}$ in 635 nm laser light has already been demonstrated on a VFN testbed in the lab. A polychromatic experiment is now underway and coupling efficiencies of $<5\times10^{-4}$ and $\sim5\%$ have been demonstrated for the star and planet respectively in 10% bandwidth light. Here we describe those experiments, the new KPIC VFN mode, and the expected performance of this mode using realistic parameters determined from on-sky tests done during the KPIC commissioning.


title: Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity

abstract: With the recent evolution of mobile health technologies, health scientists are increasingly interested in developing just-in-time adaptive interventions (JITAIs), typically delivered via notification on mobile device and designed to help the user prevent negative health outcomes and promote the adoption and maintenance of healthy behaviors. A JITAI involves a sequence of decision rules (i.e., treatment policy) that takes the user's current context as input and specifies whether and what type of an intervention should be provided at the moment. In this paper, we develop a Reinforcement Learning (RL) algorithm that continuously learns and improves the treatment policy embedded in the JITAI as the data is being collected from the user. This work is motivated by our collaboration on designing the RL algorithm in HeartSteps V2 based on data from HeartSteps V1. HeartSteps is a physical activity mobile health application. The RL algorithm developed in this paper is being used in HeartSteps V2 to decide, five times per day, whether to deliver a context-tailored activity suggestion.


title: Inference In High-dimensional Single-Index Models Under Symmetric Designs

abstract: The problem of statistical inference for regression coefficients in a high-dimensional single-index model is considered. Under elliptical symmetry, the single index model can be reformulated as a proxy linear model whose regression parameter is identifiable. We construct estimates of the regression coefficients of interest that are similar to the debiased lasso estimates in the standard linear model and exhibit similar properties: root-n-consistency and asymptotic normality. The procedure completely bypasses the estimation of the unknown link function, which can be extremely challenging depending on the underlying structure of the problem. Furthermore, under Gaussianity, we propose more efficient estimates of the coefficients by expanding the link function in the Hermite polynomial basis. Finally, we illustrate our approach via carefully designed simulation experiments.


title: Monogenic cyclotomic compositions

abstract: Let $m$ and $n$ be positive integers, and let $p$ be a prime. Let $T(x)=\Phi_{p^m}\left(\Phi_{2^n}(x)\right)$, where $\Phi_k(x)$ is the cyclotomic polynomial of index $k$. In this article, we prove that $T(x)$ is irreducible over $\mathbb Q$ and that \[\left\{1,\theta,\theta^2,\ldots,\theta^{2^{n-1}p^{m-1}(p-1)-1}\right\}\] is a basis for the ring of integers of $\mathbb Q(\theta)$, where $T(\theta)=0$.


title: When lattice cubes meet affine subspaces: a short note

abstract: We give short and simple proofs of what seem to be folklore results: * the maximum cardinality of the intersection of a lattice cube with an affine subspace; * the minimum number of affine subspaces needed to cover a lattice cube.


title: An Experimental Study of Structural Diversity in Social Networks

abstract: Several recent studies of online social networking platforms have found that adoption rates and engagement levels are positively correlated with structural diversity, the degree of heterogeneity among an individual's contacts as measured by network ties. One common theory for this observation is that structural diversity increases utility, in part because there is value to interacting with people from different network components on the same platform. While compelling, evidence for this causal theory comes from observational studies, making it difficult to rule out non-causal explanations. We investigate the role of structural diversity on retention by conducting a large-scale randomized controlled study on the Twitter platform. We first show that structural diversity correlates with user retention on Twitter, corroborating results from past observational studies. We then exogenously vary structural diversity by altering the set of network recommendations new users see when joining the platform; we confirm that this design induces the desired changes to network topology. We find, however, that low, medium, and high structural diversity treatment groups in our experiment have comparable retention rates. Thus, at least in this case, the observed correlation between structural diversity and retention does not appear to result from a causal relationship, challenging theories based on past observational studies.


title: Czech Text Processing with Contextual Embeddings: POS Tagging, Lemmatization, Parsing and NER

abstract: Contextualized embeddings, which capture appropriate word meaning depending on context, have recently been proposed. We evaluate two meth ods for precomputing such embeddings, BERT and Flair, on four Czech text processing tasks: part-of-speech (POS) tagging, lemmatization, dependency pars ing and named entity recognition (NER). The first three tasks, POS tagging, lemmatization and dependency parsing, are evaluated on two corpora: the Prague Dependency Treebank 3.5 and the Universal Dependencies 2.3. The named entity recognition (NER) is evaluated on the Czech Named Entity Corpus 1.1 and 2.0. We report state-of-the-art results for the above mentioned tasks and corpora.


title: Super-quantum discord in ferromagnetic and antiferromagnetic materials

abstract: Super-quantum discord is an extension of the quantum discord concept where weak measurements are made instead of projective measurements. We study the temperature behavior of the super-quantum discord for two real magnetic materials. We extract information about super-quantum discord from the magnetic susceptibility data for iron nitrosyl complexes $\mathrm{ Fe_2(SC_3 H_5N_2)_2(NO)_4}$ and binuclear Cu(II) acetate complex $\mathrm{[Cu_2 L(OAc)]\cdot 6 H_2O}$, where $\mathrm{ L}$ is a ligand that allows us to compare the super-quantum discord with the standard one. The dependence of the super-quantum discord on the parameter describing weak measurements is studied. Obtained difference between super-quantum and quantum discords confirms the detection of additional quantum correlations that are usually destroyed during projective measurements. The use of the approach allows to predict quantitatively in advance the advantages of use of weak measurements versus projective one for quantum technologies in real settings where quantum discord is used as resource. This can be relevant particularly in macroscopic quantum systems where weak measurements can be used to extract information about the system.


title: Entity, Relation, and Event Extraction with Contextualized Span Representations

abstract: We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction. Our framework (called DyGIE++) accomplishes all tasks by enumerating, refining, and scoring text spans designed to capture local (within-sentence) and global (cross-sentence) context. Our framework achieves state-of-the-art results across all tasks, on four datasets from a variety of domains. We perform experiments comparing different techniques to construct span representations. Contextualized embeddings like BERT perform well at capturing relationships among entities in the same or adjacent sentences, while dynamic span graph updates model long-range cross-sentence relationships. For instance, propagating span representations via predicted coreference links can enable the model to disambiguate challenging entity mentions. Our code is publicly available at https://github.com/dwadden/dygiepp and can be easily adapted for new tasks or datasets.


title: Convex Set Disjointness, Distributed Learning of Halfspaces, and LP Feasibility

abstract: We study the Convex Set Disjointness (CSD) problem, where two players have input sets taken from an arbitrary fixed domain~$U\subseteq \mathbb{R}^d$ of size $\lvert U\rvert = n$. Their mutual goal is to decide using minimum communication whether the convex hulls of their sets intersect (equivalently, whether their sets can be separated by a hyperplane). Different forms of this problem naturally arise in distributed learning and optimization: it is equivalent to {\em Distributed Linear Program (LP) Feasibility} -- a basic task in distributed optimization, and it is tightly linked to {\it Distributed Learning of Halfdpaces in $\mathbb{R}^d$}. In {communication complexity theory}, CSD can be viewed as a geometric interpolation between the classical problems of {Set Disjointness} (when~$d\geq n-1$) and {Greater-Than} (when $d=1$). We establish a nearly tight bound of $\tilde \Theta(d\log n)$ on the communication complexity of learning halfspaces in $\mathbb{R}^d$. For Convex Set Disjointness (and the equivalent task of distributed LP feasibility) we derive upper and lower bounds of $\tilde O(d^2\log n)$ and~$\Omega(d\log n)$. These results improve upon several previous works in distributed learning and optimization. Unlike typical works in communication complexity, the main technical contribution of this work lies in the upper bounds. In particular, our protocols are based on a {\it Container Lemma for Halfspaces} and on two variants of {\it Carath\'eodory's Theorem}, which may be of independent interest. These geometric statements are used by our protocols to provide a compressed summary of the players' input.


title: Equivalence of light-front quantization and instant-time quantization

abstract: Commutation or anticommutation relations quantized at equal instant time and commutation or anticommutation relations quantized at equal light-front time not only cannot be transformed into each other, they take completely different forms. While they would thus appear to describe different theories, we show that this is not in fact the case. By looking not at equal times but at unequal times, we show that unequal instant-time commutation or anticommutation relations are completely equivalent to unequal light-front time commutation or anticommutation relations. Light-front quantization and instant-time quantization are thus the same, with it being only the restriction to equal times that makes them look different. However for fermions there is a caveat, as the light-front anticommutation relations involve projection operators acting on the fermion fields. Nonetheless, not only can one still derive fermion unequal light-front time anticommutators starting from unequal instant-time ones, one can even derive unequal instant-time fermion anticommutators starting from unequal light-front time anticommutators even though the fermion projection operators that are relevant in the light-front case are not invertible. To establish the equivalence for gauge fields we present a quantization procedure that does not involve zero-mode singularities that are commonly encountered in light-front gauge field studies. We also study time-ordered products of fields, and again show the equivalence despite the fact that there are additional terms in the fermion light-front case. We establish our results first for free theories, and then to all orders in interacting theories though comparison of the instant-time and light-front Lehmann representations. Finally, we compare instant-time Hamiltonians and light-front Hamiltonians, and show that in the instant-time rest frame they give identical results.


title: Prediction of optical spectra of coarse-grained polymers as a sequence generation problem: the Recurrent Neural Networks solution

abstract: Coarse-grained simulations of conjugated polymers have become a popular way of investigating the device physics of organic photovoltaics. While UV-Vis spectroscopy remains one of key experimental methods for the interrogation of these devices, a rigorous bridge between coarse-grained simulations and spectroscopy has never been established. Here we address this challenge by developing a method that predicts spectra of conjugated polymers directly from coarse-grained representations while avoiding ad-hoc procedures such as back-mapping from coarse-grained to atomistic representations followed by computing the spectra using standard quantum chemistry methods. Our approach is based on a generative deep learning model: the long-short-term memory recurrent neural network (LSTM-RNN) and it is suggested by the apparent similarity between natural languages and the mathematical structure of the perturbative expansions of the excited state energies due to small fluctuations of the polymer conformation. We use this model to demonstrate a dangerous discrepancy between the spectra obtained in the coarse-grained representation and after the back-mapping. This indicates that standard protocols may require additional fine-tuning in order to become reliable and that our model presents a novel tool uniquely suited for improving the back-mapping protocols and for including spectral data in the development of coarse-grained potentials.


title: Lecture Notes: Optimization for Machine Learning

abstract: Lecture notes on optimization for machine learning, derived from a course at Princeton University and tutorials given in MLSS, Buenos Aires, as well as Simons Foundation, Berkeley.


title: Zero-Calibration Device-free Localization for the IoT based on Participatory Sensing

abstract: Device-free localization (DFL) is an emerging technology for estimating the position of a human or object that is not equipped with any electronic tag, nor participate actively in the localization process. Similar to device-based localization, the initial phase in DFL is to build the fingerprint database which is usually done manually using site surveying. This process is tedious, time-consuming, and vulnerable to environmental dynamics. Motivated by the recent advances in the Internet of Things (IoT), this paper introduces RadioGrapher; a system that automates the process of device-free fingerprint calibration in IoT environments. RadioGrapher leverages the device-based locations of entities in the area of interest in a crowd-sensing manner, aided with Fresnel zones of the wirelessly connected IoT devices to automatically construct a device-free fingerprint. Experimental evaluation of RadioGrapher in an IoT testbed using multiple entities shows that it can construct DFL fingerprints with high accuracy. Moreover, its median localization accuracy is comparable to that of manual fingerprinting. This comes with no calibration overhead, highlighting the promise of RadioGrapher as a crowdsourcing device-free fingerprint constructor in IoT environments.


title: Cross Domain Image Matching in Presence of Outliers

abstract: Cross domain image matching between image collections from different source and target domains is challenging in times of deep learning due to i) limited variation of image conditions in a training set, ii) lack of paired-image labels during training, iii) the existing of outliers that makes image matching domains not fully overlap. To this end, we propose an end-to-end architecture that can match cross domain images without labels in the target domain and handle non-overlapping domains by outlier detection. We leverage domain adaptation and triplet constraints for training a network capable of learning domain invariant and identity distinguishable representations, and iteratively detecting the outliers with an entropy loss and our proposed weighted MK-MMD. Extensive experimental evidence on Office [17] dataset and our proposed datasets Shape, Pitts-CycleGAN shows that the proposed approach yields state-of-the-art cross domain image matching and outlier detection performance on different benchmarks. The code will be made publicly available.


title: QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions

abstract: We introduce the first open-domain dataset, called QuaRTz, for reasoning about textual qualitative relationships. QuaRTz contains general qualitative statements, e.g., "A sunscreen with a higher SPF protects the skin longer.", twinned with 3864 crowdsourced situated questions, e.g., "Billy is wearing sunscreen with a lower SPF than Lucy. Who will be best protected from the sun?", plus annotations of the properties being compared. Unlike previous datasets, the general knowledge is textual and not tied to a fixed set of relationships, and tests a system's ability to comprehend and apply textual qualitative knowledge in a novel setting. We find state-of-the-art results are substantially (20%) below human performance, presenting an open challenge to the NLP community.


title: Relativistic effect of $J/\psi$ hadroproduction in large $p_T$ region

abstract: By combining NRQCD factorization and collinear factorization, we compute a series of relativistic corrections for $J/\psi$ hadroproduction to all orders in $v^2$ at large $p_T$ limit. The $v^2$ expansion converges well for all channels. We find that the ratio of relativistic correction term to the corresponding leading term is independent of kinematic variables for any channel, which generalizes the proportional relations found in previous works to all orders.


title: Performance considerations on execution of large scale workflow applications on cloud functions

abstract: Function-as-a-Service is a novel type of cloud service used for creating distributed applications and utilizing computing resources. Application developer supplies source code of cloud functions, which are small applications or application components, while the service provider is responsible for provisioning the infrastructure, scaling and exposing a REST style API. This environment seems to be adequate for running scientific workflows, which in recent years, have become an established paradigm for implementing and preserving complex scientific processes. In this paper, we present work done on evaluating three major FaaS providers (Amazon, Google, IBM) as a platform for running scientific workflows. The experiments were performed with a dedicated benchmarking framework, which consisted of instrumented workflow execution engine. The testing load was implemented as a large scale bag-of-tasks style workflow, where task count reached 5120 running in parallel. The studied parameters include raw performance, efficiency of infrastructure provisioning, overhead introduced by the API and network layers, as well as aspects related to run time accounting. Conclusions include insights into available performance, expressed as raw GFlops values and charts depicting relation of performance to function size. The infrastructure provisioning proved to be governed by parallelism and rate limits, which can be deducted from included charts. The overhead imposed by using a REST API proved to be a significant contribution to overall run time of individual tasks, and possibly the whole workflow. The paper ends with pointing out possible future work, which includes building performance models and designing a dedicated scheduling algorithms for running scientific workflows on FaaS.


title: A remark on norm inflation for nonlinear wave equations

abstract: In this note, we study the ill-posedness of nonlinear wave equations (NLW). Namely, we show that NLW experiences norm inflation at every initial data in negative Sobolev spaces. This result covers a gap left open in a paper of Christ, Colliander, and Tao (2003) and extends the result by Oh, Tzvetkov, and the second author (2019) to non-cubic integer nonlinearities. In particular, for some low dimensional cases, we obtain norm inflation above the scaling critical regularity. We also prove ill-posedness for NLW, via norm inflation at general initial data, in negative regularity Fourier-Lebesgue and Fourier-amalgam spaces.


title: AtLoc: Attention Guided Camera Localization

abstract: Deep learning has achieved impressive results in camera localization, but current single-image techniques typically suffer from a lack of robustness, leading to large outliers. To some extent, this has been tackled by sequential (multi-images) or geometry constraint approaches, which can learn to reject dynamic objects and illumination conditions to achieve better performance. In this work, we show that attention can be used to force the network to focus on more geometrically robust objects and features, achieving state-of-the-art performance in common benchmark, even if using only a single image as input. Extensive experimental evidence is provided through public indoor and outdoor datasets. Through visualization of the saliency maps, we demonstrate how the network learns to reject dynamic objects, yielding superior global camera pose regression performance. The source code is avaliable at https://github.com/BingCS/AtLoc.


title: Fluctuations in extractable work bound the charging power of quantum batteries

abstract: We study the connection between the charging power of quantum batteries and the fluctuations of the extractable work. We prove that in order to have a non-zero rate of change of the extractable work, the state $\rho_\mathcal{W}$ of the battery cannot be an eigenstate of a `\emph{free energy operator}', defined by $\mathcal{F}~\equiv~H_\mathcal{W}~+~\beta^{-1}\log(\rho_\mathcal{W})$, where $H_\mathcal{W}$ is the Hamiltonian of the battery and $\beta$ is the inverse temperature of a reference thermal bath with respect to which the extractable work is calculated. We do so by proving that fluctuations in the free energy operator upper bound the charging power of a quantum battery. Our findings also suggest that quantum coherence in the battery enhances the charging process, which we illustrate on a toy model of a heat engine. \ \emph{Note: this version includes our Reply to a Comment by Cusumano and Rudnicki, both published in Phys. Rev. Lett.}


title: Explicit error estimates for spline approximation of arbitrary smoothness in isogeometric analysis

abstract: In this paper we provide a priori error estimates with explicit constants for both the $L^2$-projection and the Ritz projection onto spline spaces of arbitrary smoothness defined on arbitrary grids. This extends the results recently obtained for spline spaces of maximal smoothness. The presented error estimates are in agreement with the numerical evidence found in the literature that smoother spline spaces exhibit a better approximation behavior per degree of freedom, even for low smoothness of the functions to be approximated. First we introduce results for univariate spline spaces, and then we address multivariate tensor-product spline spaces and isogeometric spline spaces generated by means of a mapped geometry, both in the single-patch and in the multi-patch case.


title: Evolving Order and Chaos: Comparing Particle Swarm Optimization and Genetic Algorithms for Global Coordination of Cellular Automata

abstract: We apply two evolutionary search algorithms: Particle Swarm Optimization (PSO) and Genetic Algorithms (GAs) to the design of Cellular Automata (CA) that can perform computational tasks requiring global coordination. In particular, we compare search efficiency for PSO and GAs applied to both the density classification problem and to the novel generation of 'chaotic' CA. Our work furthermore introduces a new variant of PSO, the Binary Global-Local PSO (BGL-PSO).


title: On linear-quadratic Poisson pencils on trivial central extensions of semisimple Lie algebras

abstract: The paper is devoted to quadratic Poisson structures compatible with the canonical linear Poisson structures on trivial 1-dimensional central extensions of semisimple Lie algebras. In particular, we develop the general theory of such structures and study related families of functions in involution. We also show that there exists a 10-parametric family of quadratic Poisson structures on $\gl(3)^*$ compatible with the canonical linear Poisson structure and containing the 3-parametric family of quadratic bivectors recently introduced by Vladimir Sokolov. The involutive family of polynomial functions related to the corresponding Poisson pencils contains the hamiltonian of the polynomial form of the elliptic Calogero--Moser system.


title: Almost all orbits of the Collatz map attain almost bounded values

abstract: Define the \emph{Collatz map} $\mathrm{Col} : \mathbb{N}+1 \to \mathbb{N}+1$ on the positive integers $\mathbb{N}+1 = \{1,2,3,\dots\}$ by setting $\mathrm{Col}(N)$ equal to $3N+1$ when $N$ is odd and $N/2$ when $N$ is even, and let $\mathrm{Col}_{\min}(N) := \inf_{n \in \mathbb{N}} \mathrm{Col}^n(N)$ denote the minimal element of the Collatz orbit $N, \mathrm{Col}(N), \mathrm{Col}^2(N), \dots$. The infamous \emph{Collatz conjecture} asserts that $\mathrm{Col}_{\min}(N)=1$ for all $N \in \mathbb{N}+1$. Previously, it was shown by Korec that for any $\theta > \frac{\log 3}{\log 4} \approx 0.7924$, one has $\mathrm{Col}_{\min}(N) \leq N^\theta$ for almost all $N \in \mathbb{N}+1$ (in the sense of natural density). In this paper we show that for \emph{any} function $f : \mathbb{N}+1 \to \mathbb{R}$ with $\lim_{N \to \infty} f(N)=+\infty$, one has $\mathrm{Col}_{\min}(N) \leq f(N)$ for almost all $N \in \mathbb{N}+1$ (in the sense of logarithmic density). Our proof proceeds by establishing an approximate transport property for a certain first passage random variable associated with the Collatz iteration (or more precisely, the closely related Syracuse iteration), which in turn follows from estimation of the characteristic function of a certain skew random walk on a $3$-adic cyclic group at high frequencies. This estimation is achieved by studying how a certain two-dimensional renewal process interacts with a union of triangles associated to a given frequency.


title: Indecomposable continua as Higson coronae

abstract: In this paper, we consider spaces whose Higson coronae are indecomposable continua. We show that for a non-compact proper metric space $X$ which is coarsely geodesic and has coarse bounded geometry, the Higson corona of $X$ is an indecomposable continuum if and only if $X$ is coarsely equivalent to the space of natural numbers. Then we give characterizations of finitely generated groups that have one or two ends by decomposability/indecomposability of the components of their Higson coronae. we characterize it as a group whose Higson corona is a topological sum of two indecomposable continua.


title: Transfer Learning Robustness in Multi-Class Categorization by Fine-Tuning Pre-Trained Contextualized Language Models

abstract: This study compares the effectiveness and robustness of multi-class categorization of Amazon product data using transfer learning on pre-trained contextualized language models. Specifically, we fine-tuned BERT and XLNet, two bidirectional models that have achieved state-of-the-art performance on many natural language tasks and benchmarks, including text classification. While existing classification studies and benchmarks focus on binary targets, with the exception of ordinal ranking tasks, here we examine the robustness of such models as the number of classes grows from 1 to 20. Our experiments demonstrate an approximately linear decrease in performance metrics (i.e., precision, recall, $F_1$ score, and accuracy) with the number of class labels. BERT consistently outperforms XLNet using identical hyperparameters on the entire range of class label quantities for categorizing products based on their textual descriptions. BERT is also more affordable than XLNet in terms of the computational cost (i.e., time and memory) required for training. In all cases studied, the performance degradation rates were estimated to be 1% per additional class label.


title: Computation of the Distance-based Bound on Strong Structural Controllability in Networks

abstract: In this paper, we study the problem of computing a tight lower bound on the dimension of the strong structurally controllable subspace (SSCS) in networks with Laplacian dynamics. The bound is based on a sequence of vectors containing the distances between leaders (nodes with external inputs) and followers (remaining nodes) in the underlying network graph. Such vectors are referred to as the distance-to-leaders vectors. {We give exact and approximate algorithms to compute the longest sequences of distance-to-leaders vectors, which directly provide distance-based bounds on the dimension of SSCS. The distance-based bound is known to outperform the other known bounds (for instance, based on zero-forcing sets), especially when the network is partially strong structurally controllable. Using these results, we discuss an application of the distance-based bound in solving the leader selection problem for strong structural controllability. Further, we characterize strong structural controllability in path and cycle graphs with a given set of leader nodes using sequences of distance-to-leaders vectors. Finally, we numerically evaluate our results on various graphs.


title: Sampling Conditionally on a Rare Event via Generalized Splitting

abstract: We propose and analyze a generalized splitting method to sample approximately from a distribution conditional on the occurrence of a rare event. This has important applications in a variety of contexts in operations research, engineering, and computational statistics. The method uses independent trials starting from a single particle. We exploit this independence to obtain asymptotic and non-asymptotic bounds on the total variation error of the sampler. Our main finding is that the approximation error depends crucially on the relative variability of the number of points produced by the splitting algorithm in one run, and that this relative variability can be readily estimated via simulation. We illustrate the relevance of the proposed method on an application in which one needs to sample (approximately) from an intractable posterior density in Bayesian inference.


title: What You See Is What You Get? The Impact of Representation Criteria on Human Bias in Hiring

abstract: Although systematic biases in decision-making are widely documented, the ways in which they emerge from different sources is less understood. We present a controlled experimental platform to study gender bias in hiring by decoupling the effect of world distribution (the gender breakdown of candidates in a specific profession) from bias in human decision-making. We explore the effectiveness of \textit{representation criteria}, fixed proportional display of candidates, as an intervention strategy for mitigation of gender bias by conducting experiments measuring human decision-makers' rankings for who they would recommend as potential hires. Experiments across professions with varying gender proportions show that balancing gender representation in candidate slates can correct biases for some professions where the world distribution is skewed, although doing so has no impact on other professions where human persistent preferences are at play. We show that the gender of the decision-maker, complexity of the decision-making task and over- and under-representation of genders in the candidate slate can all impact the final decision. By decoupling sources of bias, we can better isolate strategies for bias mitigation in human-in-the-loop systems.


title: Backward-Forward Reachable Set Splitting for State-Constrained Differential Games

abstract: This paper is about a set-based computing method for solving a general class of two-player zero-sum Stackelberg differential games. We assume that the game is modeled by a set of coupled nonlinear differential equations, which can be influenced by the control inputs of the players. Here, each of the players has to satisfy their respective state and control constraints or loses the game. The main contribution is a backward-forward reachable set splitting scheme, which can be used to derive numerically tractable conservative approximations of such two player games. In detail, we introduce a novel class of differential inequalities that can be used to find convex outer approximations of these backward and forward reachable sets. This approach is worked out in detail for ellipsoidal set parameterizations. Our numerical examples illustrate not only the effectiveness of the approach, but also the subtle differences between standard robust optimal control problems and more general constrained two-player zero-sum Stackelberg differential games.


title: Neural Gaussian Copula for Variational Autoencoder

abstract: Variational language models seek to estimate the posterior of latent variables with an approximated variational posterior. The model often assumes the variational posterior to be factorized even when the true posterior is not. The learned variational posterior under this assumption does not capture the dependency relationships over latent variables. We argue that this would cause a typical training problem called posterior collapse observed in all other variational language models. We propose Gaussian Copula Variational Autoencoder (VAE) to avert this problem. Copula is widely used to model correlation and dependencies of high-dimensional random variables, and therefore it is helpful to maintain the dependency relationships that are lost in VAE. The empirical results show that by modeling the correlation of latent variables explicitly using a neural parametric copula, we can avert this training difficulty while getting competitive results among all other VAE approaches.


title: Maximal rigid subalgebras of deformations and $L^{2}$-cohomology

abstract: In the past two decades, Sorin Popa's breakthrough deformation/rigidity theory has produced remarkable rigidity results for von Neumann algebras $M$ which can be deformed inside a larger algebra $\widetilde M \supseteq M$ by an action $\alpha: \mathbb{R} \to {\rm Aut}(\widetilde M)$, while simultaneously containing subalgebras $Q$ {\it rigid} with respect to that deformation, that is, such that $\alpha_t \to {\rm id}$ uniformly on the unit ball of $Q$ as $t \to 0$. However, it has remained unclear how to exploit the interplay between distinct rigid subalgebras not in specified relative position. We show that in fact, any diffuse subalgebra which is rigid with respect to a mixing s-malleable deformation is contained in a subalgebra which is uniquely maximal with respect to being rigid. In particular, the algebra generated by any family of rigid subalgebras that intersect diffusely must itself be rigid with respect to that deformation. The case where this family has two members was the motivation for this work, showing for example that if $G$ is a countable group with $\beta^{1}_{(2)}(G) > 0$, then $L(G)$ cannot be generated by two property $(T)$ subalgebras with diffuse intersection; however, the result is most striking when the family is infinite.


title: Learning and Suggesting Source Code Changes from Version History: A Systematic Review

abstract: Context: Software systems are in continuous evolution through source code changes to fixing bugs, adding new functionalities and improving the internal architecture. All these practices are recorded in the version history, which can be reused as an advantage in the development process. Objective: This paper aims to investigate approaches and techniques related to the learning of source code changes, since the change identification step, learning, and reuse in recommending strategies. Method: We conducted a systematic review related to primary studies about source code changes. The search approach identified 2410 studies, up to and including 2012, which resulted in a final set of 39 selected papers. We grouped the studies according to each established research question. This review investigates how source code changes, which were performed in the past of software, can support the improvement of the software project. Results: The majority of approaches and techniques have used repetitiveness behavior of source code changes to identify structural or metrics patterns in software repositories, trough the evaluation of sequences of versions. To extract the structural patterns, the approaches have used programming-by-example techniques to differencing source code changes. In quality metrics analysis, the studies have applied mainly complexity and object-oriented metrics. Conclusion: The main implication of this review is that source code changes as examples, to support the improvement of coding practice during the development process, in which we presented some relevant strategies to guide each step, since identifying until the suggesting of source code changes.


title: Scattering theory for nls with inverse-square potential in 2d

abstract: In this paper, we study the long time behavior of the solution of nonlinear Schr\"odinger equation with a singular potential. We prove scattering below the ground state for the radial NLS with inverse-square potential in dimension two $$iu_t+\Delta u-\frac{a u}{|x|^2}= -|u|^pu$$ when $2<p<\infty$ and $a>0$. This work extends the result in [13, 14, 16] to dimension 2D. The key point is a modified version of Arora-Dodson-Murphy's approach [2].


title: LCSCNet: Linear Compressing Based Skip-Connecting Network for Image Super-Resolution

abstract: In this paper, we develop a concise but efficient network architecture called linear compressing based skip-connecting network (LCSCNet) for image super-resolution. Compared with two representative network architectures with skip connections, ResNet and DenseNet, a linear compressing layer is designed in LCSCNet for skip connection, which connects former feature maps and distinguishes them from newly-explored feature maps. In this way, the proposed LCSCNet enjoys the merits of the distinguish feature treatment of DenseNet and the parameter-economic form of ResNet. Moreover, to better exploit hierarchical information from both low and high levels of various receptive fields in deep models, inspired by gate units in LSTM, we also propose an adaptive element-wise fusion strategy with multi-supervised training. Experimental results in comparison with state-of-the-art algorithms validate the effectiveness of LCSCNet.


title: A fixed-point policy-iteration-type algorithm for symmetric nonzero-sum stochastic impulse control games

abstract: Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has hindered their proliferation. Semi-analytical approaches make strong assumptions pertaining to very particular cases. To the author's best knowledge, the only numerical method in the literature is the heuristic one we put forward to solve an underlying system of quasi-variational inequalities. Focusing on symmetric games, this paper presents a simpler, more precise and efficient fixed-point policy-iteration-type algorithm which removes the strong dependence on the initial guess and the relaxation scheme of the previous method. A rigorous convergence analysis is undertaken with natural assumptions on the players strategies, which admit graph-theoretic interpretations in the context of weakly chained diagonally dominant matrices. A novel provably convergent single-player impulse control solver is also provided. The main algorithm is used to compute with high precision equilibrium payoffs and Nash equilibria of otherwise very challenging problems, and even some which go beyond the scope of the currently available theory.


title: A direct Hamiltonian MCMC approach for reliability estimation

abstract: Accurate and efficient estimation of rare events probabilities is of significant importance, since often the occurrences of such events have widespread impacts. The focus in this work is on precisely quantifying these probabilities, often encountered in reliability analysis of complex engineering systems, by introducing a gradient-based Hamiltonian Markov Chain Monte Carlo (HMCMC) framework, termed Approximate Sampling Target with Post-processing Adjustment (ASTPA). The basic idea is to construct a relevant target distribution by weighting the high-dimensional random variable space through a one-dimensional likelihood model, using the limit-state function. To sample from this target distribution we utilize HMCMC algorithms that produce Markov chain samples based on Hamiltonian dynamics rather than random walks. We compare the performance of typical HMCMC scheme with our newly developed Quasi-Newton based mass preconditioned HMCMC algorithm that can sample very adeptly, particularly in difficult cases with high-dimensionality and very small failure probabilities. To eventually compute the probability of interest, an original post-sampling step is devised at this stage, using an inverse importance sampling procedure based on the samples. The involved user-defined parameters of ASTPA are then discussed and general default values are suggested. Finally, the performance of the proposed methodology is examined in detail and compared against Subset Simulation in a series of static and dynamic low- and high-dimensional benchmark problems.


title: A Privacy-Preserving Longevity Study of Tor's Hidden Services

abstract: Tor and hidden services have emerged as a practical solution to protect user privacy against tracking and censorship. At the same time, little is known about the lifetime and nature of hidden services. Data collection and study of Tor hidden services is challenging due to its nature of providing privacy. Studying the lifetime of hidden services provides several benefits. For example, it allows investigation of the maliciousness of domains based on their lifetime. Short-lived hidden services are more likely not to be legitimate domains, e.g., used by ransomware, as compared to long-lived domains. In this work, we investigate the lifetime of hidden services by collecting data from a small (2%) subset of all Tor HSDir relays in a privacy-preserving manner. Based on the data collected, we devise protocols and extrapolation techniques to infer the lifetime of hidden services. Moreover we show that, due to Tor's specifics, our small subset of HSDir relays is sufficient to extrapolate lifetime with high accuracy, while respecting Tor user and service privacy and following Tor's research safety guidelines. Our results indicate that a large majority of the hidden services have a very short lifetime. In particular, 50% of all current Tor hidden services have an estimate lifetime of only 10 days or less, and 80% have a lifetime of less than a month.


title: A New Analysis of Differential Privacy's Generalization Guarantees

abstract: We give a new proof of the "transfer theorem" underlying adaptive data analysis: that any mechanism for answering adaptively chosen statistical queries that is differentially private and sample-accurate is also accurate out-of-sample. Our new proof is elementary and gives structural insights that we expect will be useful elsewhere. We show: 1) that differential privacy ensures that the expectation of any query on the posterior distribution on datasets induced by the transcript of the interaction is close to its true value on the data distribution, and 2) sample accuracy on its own ensures that any query answer produced by the mechanism is close to its posterior expectation with high probability. This second claim follows from a thought experiment in which we imagine that the dataset is resampled from the posterior distribution after the mechanism has committed to its answers. The transfer theorem then follows by summing these two bounds, and in particular, avoids the "monitor argument" used to derive high probability bounds in prior work. An upshot of our new proof technique is that the concrete bounds we obtain are substantially better than the best previously known bounds, even though the improvements are in the constants, rather than the asymptotics (which are known to be tight). As we show, our new bounds outperform the naive "sample-splitting" baseline at dramatically smaller dataset sizes compared to the previous state of the art, bringing techniques from this literature closer to practicality.


title: Role of the confinement-induced effective range on the thermodynamics of a strongly correlated Fermi gas in two dimensions

abstract: We theoretically investigate the thermodynamic properties of a strongly correlated two-dimensional Fermi gas with a confinement-induced negative effective range of interactions, which is described by a two-channel model Hamiltonian. By extending the many-body T-matrix approach by Nozi\`eres and Schmitt-Rink to the two-channel model, we calculate the equation of state in the normal phase and present several thermodynamic quantities as functions of temperature, interaction strength, and effective range. We find that there is a non-trivial dependence of thermodynamics on the effective range. In experiment, where the effective range is set by the tight axial confinement, the contribution of the effective range becomes non-negligible as the temperature decreases down to the degenerate temperature. We compare our finite-range results with recent measurements on the density equation of state, and show that the effective range has to be taken into account for the purpose of a quantitative understanding of the experimental data.


title: Boosting Item-based Collaborative Filtering via Nearly Uncoupled Random Walks

abstract: Item-based models are among the most popular collaborative filtering approaches for building recommender systems. Random walks can provide a powerful tool for harvesting the rich network of interactions captured within these models. They can exploit indirect relations between the items, mitigate the effects of sparsity, ensure wider itemspace coverage, as well as increase the diversity of recommendation lists. Their potential, however, can be hindered by the tendency of the walks to rapidly concentrate towards the central nodes of the graph, thereby significantly restricting the range of K-step distributions that can be exploited for personalized recommendations. In this work we introduce RecWalk; a novel random walk-based method that leverages the spectral properties of nearly uncoupled Markov chains to provably lift this limitation and prolong the influence of users' past preferences on the successive steps of the walk---allowing the walker to explore the underlying network more fruitfully. A comprehensive set of experiments on real-world datasets verify the theoretically predicted properties of the proposed approach and indicate that they are directly linked to significant improvements in top-n recommendation accuracy. They also highlight RecWalk's potential in providing a framework for boosting the performance of item-based models. RecWalk achieves state-of-the-art top-n recommendation quality outperforming several competing approaches, including recently proposed methods that rely on deep neural networks.


title: Extreme Low Resolution Activity Recognition with Confident Spatial-Temporal Attention Transfer

abstract: Activity recognition on extreme low-resolution videos, e.g., a resolution of 12*16 pixels, plays a vital role in far-view surveillance and privacy-preserving multimedia analysis. Low-resolution videos only contain limited information. Given the fact that one same activity may be represented by videos in both high resolution (HR) and extreme low resolution (eLR), it is worth studying to utilize the relevant HR data to improve the eLR activity recognition. In this work, we propose a novel Confident Spatial-Temporal Attention Transfer (CSTAT) for eLR activity recognition. CSTAT can acquire information from HR data by reducing the attention differences with a transfer-learning strategy. Besides, the credibility of the supervisory signal is also taken into consideration for a more confident transferring process. Experimental results on two well-known datasets, i.e., UCF101 and HMDB51, demonstrate that, the proposed method can effectively improve the accuracy of eLR activity recognition and achieve an accuracy of 59.23% on 12*16 videos in HMDB51, a state-of-the-art performance.


title: Quantum differentiability on noncommutative Euclidean spaces

abstract: We study the topic of quantum differentiability on quantum Euclidean $d$-dimensional spaces (otherwise known as Moyal $d$-spaces), and we find conditions that are necessary and sufficient for the singular values of the quantised differential to have decay $O(n^{-\alpha})$ for $0 < \alpha \leq \frac{1}{d}$. This result is substantially more difficult than the analogous problems for Euclidean space and for quantum $d$-tori.


title: Clickbait? Sensational Headline Generation with Auto-tuned Reinforcement Learning

abstract: Sensational headlines are headlines that capture people's attention and generate reader interest. Conventional abstractive headline generation methods, unlike human writers, do not optimize for maximal reader attention. In this paper, we propose a model that generates sensational headlines without labeled data. We first train a sensationalism scorer by classifying online headlines with many comments ("clickbait") against a baseline of headlines generated from a summarization model. The score from the sensationalism scorer is used as the reward for a reinforcement learner. However, maximizing the noisy sensationalism reward will generate unnatural phrases instead of sensational headlines. To effectively leverage this noisy reward, we propose a novel loss function, Auto-tuned Reinforcement Learning (ARL), to dynamically balance reinforcement learning (RL) with maximum likelihood estimation (MLE). Human evaluation shows that 60.8% of samples generated by our model are sensational, which is significantly better than the Pointer-Gen baseline and other RL models.


title: Unified Underwater Structure-from-Motion

abstract: This paper shows that accurate underwater 3D shape reconstruction is possible using a single camera, observing a target through a refractive interface. We provide unified reconstruction techniques for a variety of scenarios such as single static camera and moving refractive interface, single moving camera and static refractive interface, and single moving camera and moving refractive interface. In our basic setup, we assume that the refractive interface is planar, and simultaneously estimate the unknown transformations of the planar interface and the camera, and the unknown target shape using bundle adjustment. We also extend it to relax the planarity assumption, which enables us to use waves of the refractive interface for the reconstruction task. Experiments with real data show the superiority of our method to existing methods.


title: Reality as a simulation of reality: robot illusions, fundamental limits, and a physical demonstration

abstract: We consider problems in which robots conspire to present a view of the world that differs from reality. The inquiry is motivated by the problem of validating robot behavior physically despite there being a discrepancy between the robots we have at hand and those we wish to study, or the environment for testing that is available versus that which is desired, or other potential mismatches in this vein. After formulating the concept of a convincing illusion, essentially a notion of system simulation that takes place in the real world, we examine the implications of this type of simulability in terms of infrastructure requirements. Time is one important resource: some robots may be able to simulate some others but, perhaps, only at a rate that is slower than real-time. This difference gives a way of relating the simulating and the simulated systems in a form that is relative. We establish some theorems, including one with the flavor of an impossibility result, and providing several examples throughout. Finally, we present data from a simple multi-robot experiment based on this theory, with a robot navigating amid an unbounded field of obstacles.


title: Learning to Sample: an Active Learning Framework

abstract: Meta-learning algorithms for active learning are emerging as a promising paradigm for learning the ``best'' active learning strategy. However, current learning-based active learning approaches still require sufficient training data so as to generalize meta-learning models for active learning. This is contrary to the nature of active learning which typically starts with a small number of labeled samples. The unavailability of large amounts of labeled samples for training meta-learning models would inevitably lead to poor performance (e.g., instabilities and overfitting). In our paper, we tackle these issues by proposing a novel learning-based active learning framework, called Learning To Sample (LTS). This framework has two key components: a sampling model and a boosting model, which can mutually learn from each other in iterations to improve the performance of each other. Within this framework, the sampling model incorporates uncertainty sampling and diversity sampling into a unified process for optimization, enabling us to actively select the most representative and informative samples based on an optimized integration of uncertainty and diversity. To evaluate the effectiveness of the LTS framework, we have conducted extensive experiments on three different classification tasks: image classification, salary level prediction, and entity resolution. The experimental results show that our LTS framework significantly outperforms all the baselines when the label budget is limited, especially for datasets with highly imbalanced classes. In addition to this, our LTS framework can effectively tackle the cold start problem occurring in many existing active learning approaches.


title: Curve Fitting from Probabilistic Emissions and Applications to Dynamic Item Response Theory

abstract: Item response theory (IRT) models are widely used in psychometrics and educational measurement, being deployed in many high stakes tests such as the GRE aptitude test. IRT has largely focused on estimation of a single latent trait (e.g. ability) that remains static through the collection of item responses. However, in contemporary settings where item responses are being continuously collected, such as Massive Open Online Courses (MOOCs), interest will naturally be on the dynamics of ability, thus complicating usage of traditional IRT models. We propose DynAEsti, an augmentation of the traditional IRT Expectation Maximization algorithm that allows ability to be a continuously varying curve over time. In the process, we develop CurvFiFE, a novel non-parametric continuous-time technique that handles the curve-fitting/regression problem extended to address more general probabilistic emissions (as opposed to simply noisy data points). Furthermore, to accomplish this, we develop a novel technique called grafting, which can successfully approximate distributions represented by graphical models when other popular techniques like Loopy Belief Propogation (LBP) and Variational Inference (VI) fail. The performance of DynAEsti is evaluated through simulation, where we achieve results comparable to the optimal of what is observed in the static ability scenario. Finally, DynAEsti is applied to a longitudinal performance dataset (80-years of competitive golf at the 18-hole Masters Tournament) to demonstrate its ability to recover key properties of human performance and the heterogeneous characteristics of the different holes. Python code for CurvFiFE and DynAEsti is publicly available at github.com/chausies/DynAEstiAndCurvFiFE. This is the full version of our ICDM 2019 paper.


title: Statistical Modelling of the Clipping Noise in OFDM-based Visible Light Communication System

abstract: This paper analyses the statistics of the clipping noise in orthogonal frequency-division-multiplex (OFDM) based visible light Communication systems. The clipped signal is generally modelled as the summation of the scaled original signal and clipping noise, which is treated by the linear equalizer in the receiver. Generally, it is assumed that the clipped and original signal share the same statistics. Although valid in some cases, we show that such assumption is invalid when the transmitter is tightly constrained. We derive closed-form probability distribution function (pdf) for the clipping noise and use the pdf for statistical hypothesis testing in an optimum receiver


abstract: Unsupervised paraphrase generation is a promising and important research topic in natural language processing. We propose UPSA, a novel approach that accomplishes Unsupervised Paraphrasing by Simulated Annealing. We model paraphrase generation as an optimization problem and propose a sophisticated objective function, involving semantic similarity, expression diversity, and language fluency of paraphrases. Then, UPSA searches the sentence space towards this objective by performing a sequence of local editing. Our method is unsupervised and does not require parallel corpora for training, so it could be easily applied to different domains. We evaluate our approach on a variety of benchmark datasets, namely, Quora, Wikianswers, MSCOCO, and Twitter. Extensive results show that UPSA achieves the state-of-the-art performance compared with previous unsupervised methods in terms of both automatic and human evaluations. Further, our approach outperforms most existing domain-adapted supervised models, showing the generalizability of UPSA.


title: Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations

abstract: We introduce a variational algorithm to estimate the likelihood of a rare event within a nonequilibrium molecular dynamics simulation through the evaluation of an optimal control force. Optimization of a control force within a chosen basis is made possible by explicit forms for the gradients of a cost function in terms of the susceptibility of driven trajectories to changes in variational parameters. We consider probabilities of time-integrated dynamical observables as characterized by their large deviation functions, and find that in many cases the variational estimate is quantitatively accurate. Additionally, we provide expressions to exactly correct the variational estimate that can be evaluated directly. We benchmark this algorithm against the numerically exact solution of a model of a driven particle in a periodic potential, where the control force can be represented with a complete basis. We then demonstrate the utility of the algorithm in a model of repulsive particles on a line, which undergo a dynamical phase transition, resulting in singular changes to the form of the optimal control force. In both systems, we find fast convergence and are able to evaluate large deviation functions with significant increases in statistical efficiency over alternative Monte Carlo approaches.


title: Does Order Matter? An Empirical Study on Generating Multiple Keyphrases as a Sequence

abstract: Recently, concatenating multiple keyphrases as a target sequence has been proposed as a new learning paradigm for keyphrase generation. Existing studies concatenate target keyphrases in different orders but no study has examined the effects of ordering on models' behavior. In this paper, we propose several orderings for concatenation and inspect the important factors for training a successful keyphrase generation model. By running comprehensive comparisons, we observe one preferable ordering and summarize a number of empirical findings and challenges, which can shed light on future research on this line of work.


title: Neural Network Models for the Anisotropic Reynolds Stress Tensor in Turbulent Channel Flow

abstract: Reynolds-averaged Navier-Stokes (RANS) equations are presently one of the most popular models for simulating turbulence. Performing RANS simulation requires additional modeling for the anisotropic Reynolds stress tensor, but traditional Reynolds stress closure models lead to only partially reliable predictions. Recently, data-driven turbulence models for the Reynolds anisotropy tensor involving novel machine learning techniques have garnered considerable attention and have been rapidly developed. Focusing on modeling the Reynolds stress closure for the specific case of turbulent channel flow, this paper proposes three modifications to a standard neural network to account for the no-slip boundary condition of the anisotropy tensor, the Reynolds number dependence, and spatial non-locality. The modified models are shown to provide increased predicative accuracy compared to the standard neural network when they are trained and tested on channel flow at different Reynolds numbers. The best performance is yielded by the model combining the boundary condition enforcement and Reynolds number injection. This model also outperforms the Tensor Basis Neural Network (Ling et al., 2016) on the turbulent channel flow dataset.


title: Deformations of Dolbeault cohomology classes

abstract: In this paper, we establish a deformation theory for Dolbeault cohomology classes valued in holomorphic tensor bundles. We prove the extension equation which will play the role of Maurer-Cartan equation. Following the classical theory of Kodaira-Spencer-Kuranishi, we construct a canonical complete family of deformations by using the power series method. We also prove a simple relation between the existence of deformations and the varying of the dimensions of Dolbeault cohomology. The deformations of $(p,q)$-forms is shown to be unobstructed under some mild conditions. By analyzing Nakamura's example of complex parallelizable manifolds, we will see that the deformation theory developed in this work provides precise explanations to the jumping phenomenon of Dolbeault cohomology.


title: Rapid Variability in the SOL2011-08-04 Flare: Implications for Electron Acceleration

abstract: Particle acceleration in solar flares remains an outstanding problem in solar physics. It is yet unclear which of the acceleration mechanisms dominates and how exactly is the excessive magnetic energy transferred to the nonthermal and other forms of energy. We emphasize, that the ultimate acceleration mechanism must be capable of efficiently working in the most extreme conditions, such as the shortest detected time scales and the highest acceleration efficiency. Here we focus on detailed multiwavelength analysis of a very initial phase of the SOL2011-08-04 flare, which demonstrated prominent short subpeaks of nonthermal emission during filament eruption associated with the flare. We demonstrate that the three-dimensional configuration of the flare, combined with timing and spectral behavior of the rapidly varying component, put very stringent constraints on the acceleration regime. Specifically, the rapid subpeaks are generated by short injections of nonthermal electrons with a reasonably hard, single power-law spectrum and a relatively narrow spread of pitch-angles along the mean magnetic field. The acceleration site is a compact volume located near the top of extended coronal loop(s). The electrons are accelerated up to several hundreds of keV promptly, with the characteristic acceleration time shorter than 50 ms. We show, that these properties are difficult to reconcile with widely adopted stochastic acceleration models, while the data inescapably require acceleration by a super-Dreicer electric field, whether regular or random.


title: Structural Decomposition for Quantum Two-level Systems

abstract: An input-output model of a two-level quantum system in the Heisenberg picture is of bilinear form with constant system matrices, which allows the introduction of the concepts of controllability and observability in analogy with those of quantum linear systems. By means of the notions of controllability and observability, coordinate transformations, which are rotation matrices, can be constructed explicitly that transform an input-output model to a new one. The new input-output model enables us to investigate many interesting properties of the two-level quantum system, such as steady-state solutions to the Lindblad master equation, quantum decoherence-free (DF) subspaces, quantum non-demolition (QND) variables, and the realization of quantum back-action evading (BAE) measurements. The physical system in (Wang, J. \& Wiseman, H. M. (2001), Feedback-stabilization of an arbitrary pure state of a two-level atom, Physical Review A 64(6), 063810) is re-studied to illustrate the results presented in this paper.


title: A NICER thermonuclear burst from the millisecond X-ray pulsar SAX J1808.4-3658

abstract: The Neutron Star Interior Composition Explorer (NICER) has extensively monitored the August 2019 outburst of the 401 Hz millisecond X-ray pulsar SAX J1808.4-3658. In this Letter, we report on the detection of a bright helium-fueled Type I X-ray burst. With a bolometric peak flux of $(2.3\pm0.1)\times 10^{-7}$ erg/cm^2/s, this was the brightest X-ray burst among all bursting sources observed with NICER to date. The burst shows a remarkable two-stage evolution in flux, emission lines at $1.0$ keV and $6.7$ keV, and burst oscillations at the known pulsar spin frequency, with $\approx4$\% fractional sinusoidal amplitude. We interpret the burst flux evolution as the detection of the local Eddington limits associated with the hydrogen and helium layers of the neutron star envelope. The emission lines are likely associated with Fe, due to reprocessing of the burst emission in the accretion disk.


title: Lessons Learned from Developing a Microservice Based Mobile Location-Based Crowdsourcing Platform

abstract: Research in Mobile Location-Based Crowdsourcing is hindered by a marked lack of real-world data. The development of a standardized, lightweight, easily deployable, modular, composable, and most of all, scalable experimentation framework would go a long way in facilitating such research. Conveniently, these are all salient characteristics of systems developed using a microservices approach. We propose QRowdsource - a MLBC experimentation framework built using a distributed services architecture. In this paper, we discuss the design and development of QRowdsource, from the decomposition of functional components to the orchestration of services within the framework. We also take a look at how the advantages and disadvantages of using a microservices approach translate to our specific use case and deliberate over a number of lessons learned while developing the experimentation framework.


title: Strongly chordal digraphs and $\Gamma$-free matrices

abstract: We define strongly chordal digraphs, which generalize strongly chordal graphs and chordal bipartite graphs, and are included in the class of chordal digraphs. They correspond to square 0,1 matrices that admit a simultaneous row and column permutation avoiding the {\Gamma} matrix. In general, it is not clear if these digraphs can be recognized in polynomial time, and we focus on symmetric digraphs (i.e., graphs with possible loops), tournaments with possible loops, and balanced digraphs. In each of these cases we give a polynomial-time recognition algorithm and a forbidden induced subgraph characterization. We also discuss an algorithm for minimum general dominating set in strongly chordal graphs with possible loops, extending and unifying similar algorithms for strongly chordal graphs and chordal bipartite graphs.


title: What Matters for Neural Cross-Lingual Named Entity Recognition: An Empirical Analysis

abstract: Building named entity recognition (NER) models for languages that do not have much training data is a challenging task. While recent work has shown promising results on cross-lingual transfer from high-resource languages to low-resource languages, it is unclear what knowledge is transferred. In this paper, we first propose a simple and efficient neural architecture for cross-lingual NER. Experiments show that our model achieves competitive performance with the state-of-the-art. We further analyze how transfer learning works for cross-lingual NER on two transferable factors: sequential order and multilingual embeddings, and investigate how model performance varies across entity lengths. Finally, we conduct a case-study on a non-Latin language, Bengali, which suggests that leveraging knowledge from Wikipedia will be a promising direction to further improve the model performances. Our results can shed light on future research for improving cross-lingual NER.


title: Thermal rectification in the thermodynamic limit

abstract: We show that an increasingly strong thermal rectification effect occurs in the thermodynamic limit in a one-dimensional, graded rotor lattice with nearest-neighboring interactions only. The underlying mechanism is related to the transition from normal to abnormal heat conduction behavior observed in the corresponding homogeneous lattices as the temperature decreases. In contrast and in addition to that by invoking long-range interactions, this finding provides a distinct scenario to make the thermal rectification effect robust.


title: Cost-aware Multi-objective Bayesian optimisation

abstract: The notion of expense in Bayesian optimisation generally refers to the uniformly expensive cost of function evaluations over the whole search space. However, in some scenarios, the cost of evaluation for black-box objective functions is non-uniform since different inputs from search space may incur different costs for function evaluations. We introduce a cost-aware multi-objective Bayesian optimisation with non-uniform evaluation cost over objective functions by defining cost-aware constraints over the search space. The cost-aware constraints are a sorted tuple of indexes that demonstrate the ordering of dimensions of the search space based on the user's prior knowledge about their cost of usage. We formulate a new multi-objective Bayesian optimisation acquisition function with detailed analysis of the convergence that incorporates this cost-aware constraints while optimising the objective functions. We demonstrate our algorithm based on synthetic and real-world problems in hyperparameter tuning of neural networks and random forests.


title: Unbiased Recommender Learning from Missing-Not-At-Random Implicit Feedback

abstract: Recommender systems widely use implicit feedback such as click data because of its general availability. Although the presence of clicks signals the users' preference to some extent, the lack of such clicks does not necessarily indicate a negative response from the users, as it is possible that the users were not exposed to the items (positive-unlabeled problem). This leads to a difficulty in predicting the users' preferences from implicit feedback. Previous studies addressed the positive-unlabeled problem by uniformly upweighting the loss for the positive feedback data or estimating the confidence of each data having relevance information via the EM-algorithm. However, these methods failed to address the missing-not-at-random problem in which popular or frequently recommended items are more likely to be clicked than other items even if a user does not have a considerable interest in them. To overcome these limitations, we first define an ideal loss function to be optimized to realize recommendations that maximize the relevance and propose an unbiased estimator for the ideal loss. Subsequently, we analyze the variance of the proposed unbiased estimator and further propose a clipped estimator that includes the unbiased estimator as a special case. We demonstrate that the clipped estimator is expected to improve the performance of the recommender system, by considering the bias-variance trade-off. We conduct semi-synthetic and real-world experiments and demonstrate that the proposed method largely outperforms the baselines. In particular, the proposed method works better for rare items that are less frequently observed in the training data. The findings indicate that the proposed method can better achieve the objective of recommending items with the highest relevance.


title: DEAR: Deep Reinforcement Learning for Online Advertising Impression in Recommender Systems

abstract: With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in utilizing RL for online advertising in recommendation platforms (e.g., e-commerce and news feed sites). However, most RL-based advertising algorithms focus on optimizing ads' revenue while ignoring the possible negative influence of ads on user experience of recommended items (products, articles and videos). Developing an optimal advertising algorithm in recommendations faces immense challenges because interpolating ads improperly or too frequently may decrease user experience, while interpolating fewer ads will reduce the advertising revenue. Thus, in this paper, we propose a novel advertising strategy for the rec/ads trade-off. To be specific, we develop an RL-based framework that can continuously update its advertising strategies and maximize reward in the long run. Given a recommendation list, we design a novel Deep Q-network architecture that can determine three internally related tasks jointly, i.e., (i) whether to interpolate an ad or not in the recommendation list, and if yes, (ii) the optimal ad and (iii) the optimal location to interpolate. The experimental results based on real-world data demonstrate the effectiveness of the proposed framework.


title: Broadband Quantum Noise Reduction in Future Long Baseline Gravitational-wave Detectors via EPR Entanglement

abstract: Broadband quantum noise reduction can be achieved in gravitational wave detectors by injecting frequency dependent squeezed light into the the dark port of the interferometer. This frequency dependent squeezing can be generated by combining squeezed light with external filter cavities. However, in future long baseline interferometers (LBIs), the filter cavity required to achieve the broadband squeezing has a low bandwidth -- necessitating a very long cavity to mitigate the issue from optical loss. It has been shown recently that by taking advantage of Einstein-Podolsky-Rosen (EPR) entanglement in the squeezed light source, the interferometer can simultaneously act as a detector and a filter cavity. This is an attractive broadband squeezing scheme for LBIs because the length requirement for the filter cavity is naturally satisfied by the length of the interferometer arms. In this paper we present a systematic way of finding the working points for this broadband squeezing scheme in LBIs. We also show that in LBIs, the EPR scheme achieves nearly perfect ellipse rotation as compared to 4km interferometers which have appreciable error around the intermediate frequency. Finally, we show that an approximation for the opto-mechanical coupling constant in the 4km case can break down for longer baselines. These results are applicable to future detectors such as the 10km Einstein Telescope and the 40km Cosmic Explorer.


title: Adaptive Sketch-and-Project Methods for Solving Linear Systems

abstract: We present new adaptive sampling rules for the sketch-and-project method for solving linear systems. To deduce our new sampling rules, we first show how the progress of one step of the sketch-and-project method depends directly on a sketched residual. Based on this insight, we derive a 1) max-distance sampling rule, by sampling the sketch with the largest sketched residual 2) a proportional sampling rule, by sampling proportional to the sketched residual, and finally 3) a capped sampling rule. The capped sampling rule is a generalization of the recently introduced adaptive sampling rules for the Kaczmarz method. We provide a global linear convergence theorem for each sampling rule and show that the max-distance rule enjoys the fastest convergence. This finding is also verified in extensive numerical experiments that lead us to conclude that the max-distance sampling rule is superior both experimentally and theoretically to the capped sampling rule. We also provide numerical insights into implementing the adaptive strategies so that the per iteration cost is of the same order as using a fixed sampling strategy when the number of sketches times the sketch size is not significantly larger than the number of columns.


title: Distinguishing between dynamical and static Rashba effects in hybrid perovskite nanocrystals using transient absorption spectroscopy

abstract: The dynamical and static Rashba effects in hybrid methylammonium (MA) lead halide perovskites have recently been theoretically predicted. However, only the static effect was experimentally confirmed so far. Here we report on the dynamical Rashba effect observed using snapshot transient absorption spectral imaging with 400 nm pumping for a fully encapsulated film of 20-nm-sized 3D MAPbBr3 nanocrystals. The effect causes a 240 meV splitting of the lowest-energy absorption bleaching band, initially appearing over sub-ps timescale and progressively stabilizing to 60 meV during 500 ps. The integrated intensities of the split subbands demonstrate a photon-helicity-dependent asymmetry, thus proving the Rashba-type splitting and providing direct experimental evidence for the Rashba spin-split edge states in lead halide perovskite materials. The ultrafast dynamics is governed by the relaxation of two-photon-excited electrons in the Rashba spin-split system caused by a built-in electric field originating from dynamical charge separation in the entire MAPbBr3 nanocrystal.


title: Photo-Nernst detection of cyclotron resonance in partially irradiated graphene

abstract: Cyclotron resonance of a Landau-quantized graphene can absorb significant amount of infrared light. However, application of this phenomenon to the photodetector had been limited due to the lack of efficient photon to charge conversion scheme. Here, we demonstrate the detection of cyclotron resonance in a partially metal-masked monolayer graphene two-terminal device using photo-Nernst effect. Due to the presence of the mask, incident infrared light is irradiated on only one-half of the graphene channel. This partial irradiation creates a temperature gradient perpendicular to the graphene channel. In the presence of an external magnetic field, thermopower is generated perpendicular to the temperature gradient due to the Nernst effect. Consequently, photo-Nernst voltage is generated along the graphene channel, which can be detected from the contacts on both ends of the channel. We demonstrate selective detection of the photo-Nernst effect while minimizing the other photovoltaic contributions, such as the photo-Seebeck effect. We investigate the dependence of the photo-Nernst effect on magnetic field and excitation wavelength, which reveals a significant enhancement of photo-Nernst signal at the cyclotron resonance conditions in graphene. Our finding could facilitate the realization of far-infrared light detector using cyclotron resonance of graphene.


title: Countably compact group topologies on the free Abelian group of size continuum (and a Wallace semigroup) from a selective ultrafilter

abstract: We prove that the existence of a selective ultrafilter implies the existence of a countably compact Hausdorff group topology on the free Abelian group of size continuum. As a consequence, we show that the existence of a selective ultrafilter implies the existence of a Wallace semigroup (i.e., a countably compact both-sided cancellative topological semigroup which is not a topological group).


title: Intrinsic quantum Ising model on a triangular lattice magnet TmMgGaO$_{4}$ and beyond

abstract: The rare-earth magnet TmMgGaO$_{4}$ is proposed to be an intrinsic quantum Ising magnet described by the antiferromagnetic transverse field Ising model (TFIM) on a triangular lattice, where the relevant degrees of freedom are the non-degenerate dipole-multipole doublets of the Tm$^{3+}$ ions and the transverse field has an intrinsic origin from the weak splitting of the doublet. We compare this special doublet of Tm$^{3+}$ with the dipole-octupole Kramers doublet. We study the proposed effective model for the Tm-based triangular lattice and consider the effects of external magnetic fields and finite temperatures. From the "orthogonal operator approach", we show that the TFIM with the three-sublattice intertwined ordered state agrees with the experiments and further clarify the discrepancy in the nubmers of the magnetic sublattices and the measured magnon branches. We make specific predictions for the evolution of the magnetic properties with the external magnetic field. Furthermore, we demonstrate that an emergent U(1) symmetry emerges in thermal melting of the underlying orders and at the criticality, and summarize the previously known signatures related to the finite-temperature Berezinskii-Kosterlitz-Thouless (BKT) physics. We discuss the broad relevance of intrinsic quantum Ising magnets to many other systems, especially the Tm-based materials.


title: Quantitative estimates for enhancement of the field excited by an emitter due to presence of two closely located spherical inclusions

abstract: A field in a homogeneous medium can be amplified or enhanced by inserting closely located perfectly conducting inclusions into the medium. In this paper precise quantitative estimates for such enhancement are derived when the given field is the one excited by an emitter of a dipole type and inclusions are spheres of the same radii in three dimensions. Derived estimates reveal the difference, as well as the similarity, between enhancement of the field excited by the emitter and that of the smooth back-ground field. In particular, an estimate shows that when the enhancement occurs, the factor of enhancement is $(\sqrt{\epsilon}|\log \epsilon|)^{-1}$, which is different from that for the smooth background field, which is known to be $(\epsilon|\log \epsilon|)^{-1}$ ($\epsilon$ is the distance between two inclusions).


title: Ferroelectric nonlinear anomalous Hall effect in few-layer WTe$_2$

abstract: Under broken time reversal symmetry such as in the presence of external magnetic field or internal magnetization, a transverse voltage can be established in materials perpendicular to both longitudinal current and applied magnetic field, known as classical Hall effect. However, this symmetry constraint can be relaxed in the nonlinear regime, thereby enabling nonlinear anomalous Hall current in time-reversal invariant materials - an underexplored realm with exciting new opportunities beyond classical linear Hall effect. Here, using group theory and first-principles theory, we demonstrate a remarkable ferroelectric nonlinear anomalous Hall effect in time-reversal invariant few-layer WTe$_2$ where nonlinear anomalous Hall current switches in odd-layer WTe$_2$ while remaining invariant in even-layer WTe$_2$ upon ferroelectric transition. This even-odd oscillation of ferroelectric nonlinear anomalous Hall effect was found to originate from the absence and presence of Berry curvature dipole reversal and shift dipole reversal due to distinct ferroelectric transformation in even and odd-layer WTe$_2$. Our work not only treats Berry curvature dipole and shift dipole on an equal footing to account for intraband and interband contributions to nonlinear anomalous Hall effect, but also establishes Berry curvature dipole and shift dipole as new order parameters for noncentrosymmetric materials. The present findings, therefore, suggest that ferroelectric metals and Weyl semimetals may offer unprecedented opportunities for the development of nonlinear quantum electronics.


title: An Acceleration Framework for High Resolution Image Synthesis

abstract: Synthesis of high resolution images using Generative Adversarial Networks (GANs) is challenging, which usually requires numbers of high-end graphic cards with large memory and long time of training. In this paper, we propose a two-stage framework to accelerate the training process of synthesizing high resolution images. High resolution images are first transformed to small codes via the trained encoder and decoder networks. The code in latent space is times smaller than the original high resolution images. Then, we train a code generation network to learn the distribution of the latent codes. In this way, the generator only learns to generate small latent codes instead of large images. Finally, we decode the generated latent codes to image space via the decoder networks so as to output the synthesized high resolution images. Experimental results show that the proposed method accelerates the training process significantly and increases the quality of the generated samples. The proposed acceleration framework makes it possible to generate high resolution images using less training time with limited hardware resource. After using the proposed acceleration method, it takes only 3 days to train a 1024 *1024 image generator on Celeba-HQ dataset using just one NVIDIA P100 graphic card.