title: Deep ensemble learning for Alzheimers disease classification

abstract: Ensemble learning use multiple algorithms to obtain better predictive performance than any single one of its constituent algorithms could. With growing popularity of deep learning, researchers have started to ensemble them for various purposes. Few if any, however, has used the deep learning approach as a means to ensemble algorithms. This paper presents a deep ensemble learning framework which aims to harness deep learning algorithms to integrate multisource data and tap the wisdom of experts. At the voting layer, a sparse autoencoder is trained for feature learning to reduce the correlation of attributes and diversify the base classifiers ultimately. At the stacking layer, a nonlinear feature-weighted method based on deep belief networks is proposed to rank the base classifiers which may violate the conditional independence. Neural network is used as meta classifier. At the optimizing layer, under-sampling and threshold-moving are used to cope with cost-sensitive problem. Optimized predictions are obtained based on ensemble of probabilistic predictions by similarity calculation. The proposed deep ensemble learning framework is used for Alzheimers disease classification. Experiments with the clinical dataset from national Alzheimers coordinating center demonstrate that the classification accuracy of our proposed framework is 4% better than 6 well-known ensemble approaches as well as the standard stacking algorithm. Adequate coverage of more accurate diagnostic services can be provided by utilizing the wisdom of averaged physicians. This paper points out a new way to boost the primary care of Alzheimers disease from the view of machine learning.


title: Wasserstein Style Transfer

abstract: We propose Gaussian optimal transport for Image style transfer in an Encoder/Decoder framework. Optimal transport for Gaussian measures has closed forms Monge mappings from source to target distributions. Moreover interpolates between a content and a style image can be seen as geodesics in the Wasserstein Geometry. Using this insight, we show how to mix different target styles , using Wasserstein barycenter of Gaussian measures. Since Gaussians are closed under Wasserstein barycenter, this allows us a simple style transfer and style mixing and interpolation. Moreover we show how mixing different styles can be achieved using other geodesic metrics between gaussians such as the Fisher Rao metric, while the transport of the content to the new interpolate style is still performed with Gaussian OT maps. Our simple methodology allows to generate new stylized content interpolating between many artistic styles. The metric used in the interpolation results in different stylizations.


title: Quantum Communication using Code Division Multiple Access Network

abstract: For combining different single photon channels into single path, we use an effective and reliable technique which is known as quantum multiple access. We take advantage of an add-drop multiplexer capable of pushing and withdrawing a single photon into an optical fiber cable which carries quantum bits from multiusers. In addition to this, spreading spreads the channel noise at receiver side and use of filters stop the overlapping of adjacent channels, which helps in reducing the noise level and improved signal-to-noise ratio. In this way, we obtain enhanced performance of code division multiple access-based QKD links with a single photon without necessity of amplifiers and modulators.


title: Attention: A Big Surprise for Cross-Domain Person Re-Identification

abstract: In this paper, we focus on model generalization and adaptation for cross-domain person re-identification (Re-ID). Unlike existing cross-domain Re-ID methods, leveraging the auxiliary information of those unlabeled target-domain data, we aim at enhancing the model generalization and adaptation by discriminative feature learning, and directly exploiting a pre-trained model to new domains (datasets) without any utilization of the information from target domains. To address the discriminative feature learning problem, we surprisingly find that simply introducing the attention mechanism to adaptively extract the person features for every domain is of great effectiveness. We adopt two popular type of attention mechanisms, long-range dependency based attention and direct generation based attention. Both of them can perform the attention via spatial or channel dimensions alone, even the combination of spatial and channel dimensions. The outline of different attentions are well illustrated. Moreover, we also incorporate the attention results into the final output of model through skip-connection to improve the features with both high and middle level semantic visual information. In the manner of directly exploiting a pre-trained model to new domains, the attention incorporation method truly could enhance the model generalization and adaptation to perform the cross-domain person Re-ID. We conduct extensive experiments between three large datasets, Market-1501, DukeMTMC-reID and MSMT17. Surprisingly, introducing only attention can achieve state-of-the-art performance, even much better than those cross-domain Re-ID methods utilizing auxiliary information from the target domain.


title: Noether Converse: all identically conserved geometric tensors are metric variations of an action in (at least) D = 2

abstract: The title's century-old conjecture is established fpr D=2 and is likely for all D.


title: Pseudo-spin triplet superconductivity in transition-metal dichalcogenide monolayers and Andreev reflection in the lateral heterostructures of 2$H$-NbSe$_2$

abstract: We study the pseudo-spin of electron pair in superconducting transition-metal dichalcogenide monolayers and show that the pseudo-spin affects the electric transport property of lateral heterojunction of the superconducting and metallic monolayers. The pseudo-spins of two electrons forming a Cooper pair are parallel to each other unlike the real spins being anti-parallel. In the lateral heterojunction, the electronic transport with forming a Cooper pair, the Andreev reflection, is suppressed with the Fermi level crossing the valence band near the edge in the metallic monolayer. We numerically investigate the electric transport property of the lateral heterojunctions of semiconducting and superconducting transition-metal dichalcogenides, MoSe$_2$ monolayer and NbSe$_2$ monolayer with the charge doping, respectively. We find the sign change of conductance difference between the normal and superconducting phases by varying the charge density and show that the sign change is resulted from the pseudo-spin triplet superconductivity.


title: Evolution of the extended X-ray emission from the PSR B1259-63/LS 2883 binary in the 2014-2017 binary cycle

abstract: We have performed a series of Chandra X-ray Observatory observations of the gamma-ray binary LS 2883, which is comprised of a young pulsar (PSR B1259-63) orbiting a massive Be star with a period of 1236.7 days. The system was observed in 5 epochs, spanning a range from 352 to 1175 days after the periastron passage on 2014 May 4. The observations confirmed the recurrent nature of the high-speed ejecta that appear as an extended X-ray structure (clump) moving away from the binary. Compared to the results of the previous monitoring campaign (between the 2010 and 2014 periastron passages), this time we find evidence suggesting that the clump is accelerated to a projected velocity $ v_{\perp}\approx0.15c$ with an acceleration $a_{\perp}=47\pm2$ cm s$^{-2}$ (for uniformly accelerated motion), assuming that it was launched near periastron passage. The observed X-ray properties of the clump are consistent with synchrotron emission from pulsar wind particles accelerated at the interface between the pulsar wind and the clump. We have also performed contemporaneous observations with the {\sl Hubble Space Telescope}, which are used to set an upper limit on the optical flux of the extended emission.


title: Exploring the Effects of Data Set Choice on Measuring International Research Collaboration: an Example Using the ACM Digital Library and Microsoft Academic Graph

abstract: International research collaboration (IRC) measurement is important because countries can and want to benefit from international collaboration but performing the same measurement procedure on different data sets can lead to different results. This study aims to explore the effects of data set choice on IRC measurement.


title: Adversarial Sub-sequence for Text Generation

abstract: Generative adversarial nets (GAN) has been successfully introduced for generating text to alleviate the exposure bias. However, discriminators in these models only evaluate the entire sequence, which causes feedback sparsity and mode collapse. To tackle these problems, we propose a novel mechanism. It first segments the entire sequence into several sub-sequences. Then these sub-sequences, together with the entire sequence, are evaluated individually by the discriminator. At last these feedback signals are all used to guide the learning of GAN. This mechanism learns the generation of both the entire sequence and the sub-sequences simultaneously. Learning to generate sub-sequences is easy and is helpful in generating an entire sequence. It is easy to improve the existing GAN-based models with this mechanism. We rebuild three previous well-designed models with our mechanism, and the experimental results on benchmark data show these models are improved significantly, the best one outperforms the state-of-the-art model.\footnote[1]{All code and data are available at https://github.com/liyzcj/seggan.git


title: Bounding the mass of graviton in a dynamic regime with binary pulsars

abstract: In Einstein's general relativity, gravity is mediated by a massless spin-2 metric field, and its extension to include a mass for the graviton has profound implication for gravitation and cosmology. In 2002, Finn and Sutton used the gravitational-wave (GW) back-reaction in binary pulsars, and provided the first bound on the mass of graviton. Here we provide an improved analysis using 9 well-timed binary pulsars with a phenomenological treatment. First, individual mass bounds from each pulsar are obtained in the frequentist approach with the help of an ordering principle. The best upper limit on the graviton mass, $m_{g}<3.5\times10^{-20} \, {\rm eV}/c^{2}$ (90% C.L.), comes from the Hulse-Taylor pulsar PSR B1913+16. Then, we combine individual pulsars using the Bayesian theorem, and get $m_{g}<5.2\times10^{-21} \, {\rm eV}/c^{2}$ (90% C.L.) with a uniform prior for $\ln m_g$. This limit improves the Finn-Sutton limit by a factor of more than 10. Though it is not as tight as those from GWs and the Solar System, it provides an independent and complementary bound from a dynamic regime.


title: The General Pair-based Weighting Loss for Deep Metric Learning

abstract: Deep metric learning aims at learning the distance metric between pair of samples, through the deep neural networks to extract the semantic feature embeddings where similar samples are close to each other while dissimilar samples are farther apart. A large amount of loss functions based on pair distances have been presented in the literature for guiding the training of deep metric learning. In this paper, we unify them in a general pair-based weighting loss function, where the minimizing objective loss is just the distances weighting of informative pairs. The general pair-based weighting loss includes two main aspects, (1) samples mining and (2) pairs weighting. Samples mining aims at selecting the informative positive and negative pair sets to exploit the structured relationship of samples in a mini-batch and also reduce the number of non-trivial pairs. Pair weighting aims at assigning different weights for different pairs according to the pair distances for discriminatively training the network. We detailedly review those existing pair-based losses inline with our general loss function, and explore some possible methods from the perspective of samples mining and pairs weighting. Finally, extensive experiments on three image retrieval datasets show that our general pair-based weighting loss obtains new state-of-the-art performance, demonstrating the effectiveness of the pair-based samples mining and pairs weighting for deep metric learning.


title: Topological complexity of unordered configuration spaces of certain graphs

abstract: The unordered configuration space of $n$ points on a graph $\Gamma,$ denoted here by $UC^n(\Gamma),$ can be viewed as the space of all configurations of $n$ unlabeled robots on a system of one-dimensional tracks, which is interpreted as a graph $\Gamma.$ The topology of these spaces is related to the number of vertices of degree greater than 2; this number is denoted by $m(\Gamma).$ We discuss a combinatorial approach to compute the topological complexity of a "discretized" version of this space, $UD^n(\Gamma),$ and give results for certain classes of graphs. In the first case, we show that for a large class of graphs, as long as the number of robots is at least $2m(\Gamma)$, then $TC(UD^n(\Gamma))=2m(\Gamma)+1.$ In the second, we show that as long as the number of robots is at most half the number of vertex-disjoint cycles in $\Gamma,$ we have $TC(UD^n(\Gamma))=2n+1.$


title: Twisted Schubert polynomials

abstract: We prove that twisted versions of Schubert polynomials defined by $\widetilde{\mathfrak S}_{w_0} = x_1^{n-1}x_2^{n-2} \cdots x_{n-1}$ and $\widetilde{\mathfrak S}_{ws_i} = (s_i+\partial_i)\widetilde{\mathfrak S}_w$ are monomial positive and give a combinatorial formula for their coefficients. In doing so, we reprove and extend a previous result about positivity of skew divided difference operators and show how it implies the Pieri rule for Schubert polynomials. We also give positive formulas for double versions of the $\widetilde{\mathfrak S}_w$ as well as their localizations.


title: A Newton-bracketing method for a simple conic optimization problem

abstract: For the Lagrangian-DNN relaxation of quadratic optimization problems (QOPs), we propose a Newton-bracketing method to improve the performance of the bisection-projection method implemented in BBCPOP [to appear in ACM Tran. Softw., 2019]. The relaxation problem is converted into the problem of finding the largest zero $y^*$ of a continuously differentiable (except at $y^*$) convex function $g : \mathbb{R} \rightarrow \mathbb{R}$ such that $g(y) = 0$ if $y \leq y^*$ and $g(y) > 0$ otherwise. In theory, the method generates lower and upper bounds of $y^*$ both converging to $y^*$. Their convergence is quadratic if the right derivative of $g$ at $y^*$ is positive. Accurate computation of $g'(y)$ is necessary for the robustness of the method, but it is difficult to achieve in practice. As an alternative, we present a secant-bracketing method. We demonstrate that the method improves the quality of the lower bounds obtained by BBCPOP and SDPNAL+ for binary QOP instances from BIQMAC. Moreover, new lower bounds for the unknown optimal values of large scale QAP instances from QAPLIB are reported.


title: The Who, What, How of Software Engineering Research: A Socio-Technical Framework

abstract: Software engineering is a socio-technical endeavor, and while many of our contributions focus on technical aspects, human stakeholders such as software developers are directly affected by and can benefit from our research and tool innovations. In this paper, we question how much of our research addresses human and social issues, and explore how much we study human and social aspects in our research designs. To answer these questions, we developed a socio-technical research framework to capture the main beneficiary of a research study (the who), the main type of research contribution produced (the what), and the research strategies used in the study (how we methodologically approach delivering relevant results given the who and what of our studies). We used this Who-What-How framework to analyze 151 papers from two well-cited publishing venues---the main technical track at the International Conference on Software Engineering, and the Empirical Software Engineering Journal by Springer---to assess how much this published research explicitly considers human aspects. We find that although a majority of these papers claim the contained research should benefit human stakeholders, most focus on technical contributions without engaging humans in their studies. Although our analysis is scoped to two venues, our results suggest a need for more diversification and triangulation of research strategies. In particular, there is a need for strategies that aim at a deeper understanding of human and social aspects of software development practice to balance the design and evaluation of technical innovations. We recommend that the framework should be used in the design of future studies in order to nudge software engineering research towards explicitly including human and social concerns in their designs, and to improve the relevance of our research for human stakeholders.


title: Finite-time Analysis of Approximate Policy Iteration for the Linear Quadratic Regulator

abstract: We study the sample complexity of approximate policy iteration (PI) for the Linear Quadratic Regulator (LQR), building on a recent line of work using LQR as a testbed to understand the limits of reinforcement learning (RL) algorithms on continuous control tasks. Our analysis quantifies the tension between policy improvement and policy evaluation, and suggests that policy evaluation is the dominant factor in terms of sample complexity. Specifically, we show that to obtain a controller that is within $\varepsilon$ of the optimal LQR controller, each step of policy evaluation requires at most $(n+d)^3/\varepsilon^2$ samples, where $n$ is the dimension of the state vector and $d$ is the dimension of the input vector. On the other hand, only $\log(1/\varepsilon)$ policy improvement steps suffice, resulting in an overall sample complexity of $(n+d)^3 \varepsilon^{-2} \log(1/\varepsilon)$. We furthermore build on our analysis and construct a simple adaptive procedure based on $\varepsilon$-greedy exploration which relies on approximate PI as a sub-routine and obtains $T^{2/3}$ regret, improving upon a recent result of Abbasi-Yadkori et al.


title: Fair Regression: Quantitative Definitions and Reduction-based Algorithms

abstract: In this paper, we study the prediction of a real-valued target, such as a risk score or recidivism rate, while guaranteeing a quantitative notion of fairness with respect to a protected attribute such as gender or race. We call this class of problems \emph{fair regression}. We propose general schemes for fair regression under two notions of fairness: (1) statistical parity, which asks that the prediction be statistically independent of the protected attribute, and (2) bounded group loss, which asks that the prediction error restricted to any protected group remain below some pre-determined level. While we only study these two notions of fairness, our schemes are applicable to arbitrary Lipschitz-continuous losses, and so they encompass least-squares regression, logistic regression, quantile regression, and many other tasks. Our schemes only require access to standard risk minimization algorithms (such as standard classification or least-squares regression) while providing theoretical guarantees on the optimality and fairness of the obtained solutions. In addition to analyzing theoretical properties of our schemes, we empirically demonstrate their ability to uncover fairness--accuracy frontiers on several standard datasets.


title: Unsupervised Classification of Street Architectures Based on InfoGAN

abstract: Street architectures play an essential role in city image and streetscape analysing. However, existing approaches are all supervised which require costly labeled data. To solve this, we propose a street architectural unsupervised classification framework based on Information maximizing Generative Adversarial Nets (InfoGAN), in which we utilize the auxiliary distribution $Q$ of InfoGAN as an unsupervised classifier. Experiments on database of true street view images in Nanjing, China validate the practicality and accuracy of our framework. Furthermore, we draw a series of heuristic conclusions from the intrinsic information hidden in true images. These conclusions will assist planners to know the architectural categories better.


title: Towards Photo-Realistic Visible Watermark Removal with Conditional Generative Adversarial Networks

abstract: Visible watermark plays an important role in image copyright protection and the robustness of a visible watermark to an attack is shown to be essential. To evaluate and improve the effectiveness of watermark, watermark removal attracts increasing attention and becomes a hot research top. Current methods cast the watermark removal as an image-to-image translation problem where the encode-decode architectures with pixel-wise loss are adopted to transfer the transparent watermarked pixels into unmarked pixels. However, when a number of realistic images are presented, the watermarks are more likely to be unknown and diverse (i.e., the watermarks might be opaque or semi-transparent; the category and pattern of watermarks are unknown). When applying existing methods to the real-world scenarios, they mostly can not satisfactorily reconstruct the hidden information obscured under the complex and various watermarks (i.e., the residual watermark traces remain and the reconstructed images lack reality). To address this difficulty, in this paper, we present a new watermark processing framework using the conditional generative adversarial networks (cGANs) for visible watermark removal in the real-world application. The proposed method enables the watermark removal solution to be more closed to the photo-realistic reconstruction using a patch-based discriminator conditioned on the watermarked images, which is adversarially trained to differentiate the difference between the recovered images and original watermark-free images. Extensive experimental results on a large-scale visible watermark dataset demonstrate the effectiveness of the proposed method and clearly indicate that our proposed approach can produce more photo-realistic and convincing results compared with the state-of-the-art methods.


title: Isgur-Wise function in $B_c$ decays to charmonium with the Bethe-Salpeter method

abstract: The Isgur-Wise function vastly reduces the weak-decay form factors of hadrons containing one heavy quark. In this paper, we extract the Isgur-Wise functions from the instantaneous Bethe-Salpeter method, and give the numerical results for the $B_c$ decays to charmonium where the final states include $1S$, $1P$, $2S$ and $2P$. The overlapping integral of the wave functions for the initial and final states is the Isgur-Wise function, as the heavy quark effective theory does. In the case of accurate calculation, describing form factors need to introduce more relativistic corrections which are the overlapping integrals with the relative momentum between the quark and antiquark to Isgur-Wise function. The relativistic corrections to Isgur-Wise function provide greater contributions especially involving the excited state, and therefore are necessary to be adopted.


title: A high-magnetic-field radio pulsar survey with Swift/XRT

abstract: We present the X-ray survey results of high-magnetic-field radio pulsars (high-B PSRs) with Swift/XRT. X-ray observations of the rotation-powered pulsars with the dipole magnetic field ${\it B_{\rm d}}$ near the quantum critical field ${\it B_{\rm q}}=4.4\times10^{13}$ G is of great importance for understanding the transition between the rotation-powered pulsars and the magnetars, because there are a few objects that have magnetar-like properties. Out of the 27 high-B PSRs that are in the ATNF pulsar catalogue but have not been reported or have no effective upper-limits in the X-ray bands, we analyze the Swift/XRT data for 21 objects, where 6 objects are newly observed and 15 objects are taken from the archival data. As a result, we have new $3\sigma$ upper-limits for all the 21 objects. Since the upper-limits are tight, we conclude that we do not find any magnetar-like high-B PSRs such as PSR J1819$-$1458. The probability of the high X-ray efficiency in the high-B PSRs is obtained to be $11\%-29\%$. Combining the previous observations, we discuss which parameter causes magnetar-like properties. It may be suggested that the magnetar-like properties appear only when ${\it B_{\rm d}}\gtrsim10^{13.5}$ G for the radio pulsar population. This is true even if the radio-quiet high-B RPP are included.


title: A Simple but Effective Method to Incorporate Multi-turn Context with BERT for Conversational Machine Comprehension

abstract: Conversational machine comprehension (CMC) requires understanding the context of multi-turn dialogue. Using BERT, a pre-training language model, has been successful for single-turn machine comprehension, while modeling multiple turns of question answering with BERT has not been established because BERT has a limit on the number and the length of input sequences. In this paper, we propose a simple but effective method with BERT for CMC. Our method uses BERT to encode a paragraph independently conditioned with each question and each answer in a multi-turn context. Then, the method predicts an answer on the basis of the paragraph representations encoded with BERT. The experiments with representative CMC datasets, QuAC and CoQA, show that our method outperformed recently published methods (+0.8 F1 on QuAC and +2.1 F1 on CoQA). In addition, we conducted a detailed analysis of the effects of the number and types of dialogue history on the accuracy of CMC, and we found that the gold answer history, which may not be given in an actual conversation, contributed to the model performance most on both datasets.


title: Provably Efficient Q-Learning with Low Switching Cost

abstract: We take initial steps in studying PAC-MDP algorithms with limited adaptivity, that is, algorithms that change its exploration policy as infrequently as possible during regret minimization. This is motivated by the difficulty of running fully adaptive algorithms in real-world applications (such as medical domains), and we propose to quantify adaptivity using the notion of local switching cost. Our main contribution, Q-Learning with UCB2 exploration, is a model-free algorithm for H-step episodic MDP that achieves sublinear regret whose local switching cost in K episodes is $O(H^3SA\log K)$, and we provide a lower bound of $\Omega(HSA)$ on the local switching cost for any no-regret algorithm. Our algorithm can be naturally adapted to the concurrent setting, which yields nontrivial results that improve upon prior work in certain aspects.


title: Third Harmonics and Defects in Modulated Phases of Structural Quantum Order-Disorder Systems

abstract: Influences of defects generating random fields on modulated phases in materials with the order-disorder type of phase transition are studied. It is shown that under appropriate conditions third harmonics of the ground state modulation may be suppressed by these defects.


title: A single-domain implementation of the Voigt/complex error function by vectorized interpolation

abstract: In this work we show how to perform a rapid computation of the Voigt/complex error over a single domain by vectorized interpolation. This approach enables us to cover the entire set of the parameters $x,y \in \mathbb{R}$ required for the HITRAN-based spectroscopic applications. The computational test reveals that within domains $x\in\left[0,15\right]\cap y\in\left[10^{-8},15\right]$ and $x\in\left[0,50000\right]\cap y\geq 10^{-8}$ our algorithmic implementation is faster in computation by factors of about $8$ and $3$, respectively, as compared to the fastest known C/C++ code for the Voigt/complex error function. A rapid MATLAB code is presented.


title: A New Mixed Generalized Negative Binomial Distribution

abstract: In this article, a generalized version of Negative binomial-beta exponential distribution with five parameters have been introduced. Some interesting submodels have been derived from it. A comprehensive mathematical treatment of proposed distribution is being provided. Various expressions like that of moment generating function, moments are derived. The model parameters are estimated by the maximum likelihood method. Finally, the application of proposed distribution is carried out on one sample of automobile insurance data.


title: RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methods

abstract: This paper sets a new foundation for data-driven inertial navigation research, where the task is the estimation of positions and orientations of a moving subject from a sequence of IMU sensor measurements. More concretely, the paper presents 1) a new benchmark containing more than 40 hours of IMU sensor data from 100 human subjects with ground-truth 3D trajectories under natural human motions; 2) novel neural inertial navigation architectures, making significant improvements for challenging motion cases; and 3) qualitative and quantitative evaluations of the competing methods over three inertial navigation benchmarks. We will share the code and data to promote further research.


title: Space-Efficient Algorithms for Computing Minimal/Shortest Unique Substrings

abstract: Given a string $T$ of length $n$, a substring $u = T[i..j]$ of $T$ is called a shortest unique substring (SUS) for an interval $[s,t]$ if (a) $u$ occurs exactly once in $T$, (b) $u$ contains the interval $[s,t]$ (i.e. $i \leq s \leq t \leq j$), and (c) every substring $v$ of $T$ with $|v| < |u|$ containing $[s,t]$ occurs at least twice in $T$. Given a query interval $[s, t] \subset [1, n]$, the interval SUS problem is to output all the SUSs for the interval $[s,t]$. In this article, we propose a $4n + o(n)$ bits data structure answering an interval SUS query in output-sensitive $O(\mathit{occ})$ time, where $\mathit{occ}$ is the number of returned SUSs. Additionally, we focus on the point SUS problem, which is the interval SUS problem for $s = t$. Here, we propose a $\lceil (\log_2{3} + 1)n \rceil + o(n)$ bits data structure answering a point SUS query in the same output-sensitive time. We also propose space-efficient algorithms for computing the minimal unique substrings of $T$.


title: Ab initio theory of the spin-dependent conductivity tensor and the spin Hall effect in random alloys

abstract: We present an extension of the relativistic electron transport theory for the standard (charge) conductivity tensor of random alloys within the tight-binding linear muffin-tin orbital method to the so-called spin-dependent conductivity tensor, which describes the Kubo linear response of spin currents to external electric fields. The approach is based on effective charge- and spin-current operators, that correspond to intersite electron transport and that are nonrandom, which simplifies the configuration averaging by means of the coherent potential approximation. Special attention is paid to the Fermi sea term of the spin-dependent conductivity tensor, which contains a nonzero incoherent part, in contrast to the standard conductivity tensor. The developed formalism is applied to the spin Hall effect in binary random nonmagnetic alloys, both on a model level and for Pt-based alloys with an fcc structure. We show that the spin Hall conductivity consists of three contributions (one intrinsic and two extrinsic) which exhibit different concentration dependences in the dilute limit of an alloy. Results for selected Pt alloys (Pt-Re, Pt-Ta) lead to the spin Hall angles around 0.2; these sizable values are obtained for compositions that belong to thermodynamically equilibrium phases. These alloys can thus be considered as an alternative to other systems for efficient charge to spin conversion, which are often metastable crystalline or amorphous alloys.


title: Does a Cloud of Strings Affect Shear Viscosity Bound?

abstract: The Einstein AdS black brane with a cloud of strings background in context of massive gravity is introduced. There is a momentum dissipation on the boundary because of graviton mass on the bulk. The ratio of shear viscosity to entropy density is calculated for this solution. This value violates the KSS bound if we apply the Dirichlet boundary and regularity on the horizon conditions. Our result shows that this value is independent of the cloud of strings.


title: XDoser, A Benchmarking Tool for System Load Measurement Using Denial of Service Features

abstract: Technology has developed so fast that we feel both safe as well as unsafe in both ways. Systems used today are always prone to attack by malicious users. In most cases, services are hindered because these systems cannot handle the amount of over loads the attacker provides. So, proper service load measurement is necessary. The tool that is being described in this paper for developments is based on the Denial of Service methodologies. This tool, XDoser will put a synthetic load on the servers for testing purpose. The HTTP Flood method is used which includes an HTTP POST method as it forces the website to gather the maximum resources possible in response to every single request. The tool developed in this paper will focus on overloading the backend with multiple requests. So, the tool can be implemented for servers new or old for synthetic test endurance testing.


title: Alignment and precession of a black hole misaligned with its accretion disc: Application to Low Mass X-ray Binaries

abstract: A thin viscous accretion disc around a Kerr black hole, which is warped due to the Lense-Thirring (LT) effect, was shown to cause the spin axis of the black hole to precess and align with the outer disc. We calculate the total LT torque acting on the black hole, and compute the alignment and precession time-scales for both persistent and transient accretors. In our analysis, we consider the contribution of the inner disc, as it can stay misaligned with the black hole spin for a reasonable range of parameter values. We find that the alignment time-scale increases with a decrease in the Kerr parameter below a critical Kerr parameter value, contrary to earlier predictions. Besides, the time-scales are generally longer for transience than the time-scales calculated for persistent accretion. From our analysis of the transient case, we find that the black hole in the low mass X-ray binary (LMXB) 4U 1543-47 could be misaligned, whereas that in the LMXB XTE J1550-564 has aligned itself with the outer disc. The age of the LMXB H 1743-322 is estimated assuming a misaligned disc. We also find that the black hole in a typical Galactic LMXB can take a significantly longer time to align than what was estimated in the past. This may have an important implication on the measurement of black hole spin using the continuum X-ray spectral fitting method.


title: Heterogeneity in demand and optimal price conditioning for local rail transport

abstract: This paper describes the results of research project on optimal pricing for LLC "Perm Local Rail Company". In this study we propose a regression tree based approach for estimation of demand function for local rail tickets considering high degree of demand heterogeneity by various trip directions and the goals of travel. Employing detailed data on ticket sales for 5 years we estimate the parameters of demand function and reveal the significant variation in price elasticity of demand. While in average the demand is elastic by price, near a quarter of trips is characterized by weakly elastic demand. Lower elasticity of demand is correlated with lower degree of competition with other transport and inflexible frequency of travel.


title: Stability of Current Density Impedance Imaging

abstract: We study stability of reconstruction in current density impedance imaging (CDII), that is, the inverse problem of recovering the conductivity of a body from the measurement of the magnitude of the current density vector field in the interior of the object. Our results show that CDII is stable with respect to errors in interior measurements of the current density vector field, and confirm the stability of reconstruction which was previously observed in numerical simulations, and was long believed to be the case.


title: Study of cosmogenic radionuclides in the COSINE-100 NaI(Tl) detectors

abstract: COSINE-100 is a direct detection dark matter search experiment that uses a 106 kg array of eight NaI(Tl) crystals that are kept underground at the Yangyang Underground Laboratory to avoid cosmogenic activation of radioisotopes by cosmic rays. Even though the cosmogenic activity is declining with time, there are still significant background rates from the remnant nuclides. In this paper, we report measurements of cosmogenic isotope contaminations with less than one year half-lives that are based on extrapolations of the time dependent activities of their characteristic energy peaks to activity rates at the time the crystals were deployed underground. For longer-lived $^{109}$Cd ($T_{1/2}=1.6$ y) and $^{22}$Na ($T_{1/2}=2.6$ y), we investigate time correlations of characteristic $\gamma$/X-ray peaks. The inferred sea-level production rates are compared with caluclations based on the ACTIVIA and MENDL-2 model calculations and experimental data. For $^{3}$H, which has a long, 12.3 year half-life, we evaluated the activity levels from the exposure times and determined a cosmogenic activation rate that is consistent with other measurements.


title: Explainable Fashion Recommendation: A Semantic Attribute Region Guided Approach

abstract: In fashion recommender systems, each product usually consists of multiple semantic attributes (e.g., sleeves, collar, etc). When making cloth decisions, people usually show preferences for different semantic attributes (e.g., the clothes with v-neck collar). Nevertheless, most previous fashion recommendation models comprehend the clothing images with a global content representation and lack detailed understanding of users' semantic preferences, which usually leads to inferior recommendation performance. To bridge this gap, we propose a novel Semantic Attribute Explainable Recommender System (SAERS). Specifically, we first introduce a fine-grained interpretable semantic space. We then develop a Semantic Extraction Network (SEN) and Fine-grained Preferences Attention (FPA) module to project users and items into this space, respectively. With SAERS, we are capable of not only providing cloth recommendations for users, but also explaining the reason why we recommend the cloth through intuitive visual attribute semantic highlights in a personalized manner. Extensive experiments conducted on real-world datasets clearly demonstrate the effectiveness of our approach compared with the state-of-the-art methods.


title: CS-R-FCN: Cross-supervised Learning for Large-Scale Object Detection

abstract: Generic object detection is one of the most fundamental problems in computer vision, yet it is difficult to provide all the bounding-box-level annotations aiming at large-scale object detection for thousands of categories. In this paper, we present a novel cross-supervised learning pipeline for large-scale object detection, denoted as CS-R-FCN. First, we propose to utilize the data flow of image-level annotated images in the fully-supervised two-stage object detection framework, leading to cross-supervised learning combining bounding-box-level annotated data and image-level annotated data. Second, we introduce a semantic aggregation strategy utilizing the relationships among the cross-supervised categories to reduce the unreasonable mutual inhibition effects during the feature learning. Experimental results show that the proposed CS-R-FCN improves the mAP by a large margin compared to previous related works.


title: Interpretable Adversarial Training for Text

abstract: Generating high-quality and interpretable adversarial examples in the text domain is a much more daunting task than it is in the image domain. This is due partly to the discrete nature of text, partly to the problem of ensuring that the adversarial examples are still probable and interpretable, and partly to the problem of maintaining label invariance under input perturbations. In order to address some of these challenges, we introduce sparse projected gradient descent (SPGD), a new approach to crafting interpretable adversarial examples for text. SPGD imposes a directional regularization constraint on input perturbations by projecting them onto the directions to nearby word embeddings with highest cosine similarities. This constraint ensures that perturbations move each word embedding in an interpretable direction (i.e., towards another nearby word embedding). Moreover, SPGD imposes a sparsity constraint on perturbations at the sentence level by ignoring word-embedding perturbations whose norms are below a certain threshold. This constraint ensures that our method changes only a few words per sequence, leading to higher quality adversarial examples. Our experiments with the IMDB movie review dataset show that the proposed SPGD method improves adversarial example interpretability and likelihood (evaluated by average per-word perplexity) compared to state-of-the-art methods, while suffering little to no loss in training performance.


title: The abundance of massive compact galaxies at $1.0 < z < 3.0$ in 3D-HST/CANDELS

abstract: Based on a large sample of massive ($M_{*}\geq 10^{10} M_{\odot}$) compact galaxies at $1.0 < z < 3.0$ in five 3D-HST/CANDELS fields, we quantify the fractional abundance and comoving number density of massive compact galaxies as a function of redshift. The samples of compact quiescent galaxies (cQGs) and compact star-forming galaxies (cSFGs) are constructed by various selection criteria of compact galaxies in literatures, and the effect of compactness definition on abundance estimate is proved to be remarkable, particularly for the cQGs and cSFGs at high redshifts. Regardless of the compactness criteria adopted, their overall redshift evolutions of fractional abundance and number density are found to be rather similar. Large samples of the cQGs exhibit a sustaining increase in number density from $z \sim 3$ to 2 and a plateau at $1<z<2$. For massive cSFGs, a plateau in the number density at $2<z<3$ can be found, as well as a continuous drop from $z \sim 2$ to 1. The evolutionary trends of the cQG and cSFG abundances support the scenario that the cSFGs at $z \geq 2$ may have been rapidly quenched into quiescent phase via violent dissipational processes such as major merger and disk instabilities. Rarity of the cSFGs at lower redshifts ($z < 1$) can be interpreted by the decrease of gas reservoirs in dark matter halos and the consequent low efficiency of gas-rich dissipation.


title: Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention

abstract: Semantically controlled neural response generation on limited-domain has achieved great performance. However, moving towards multi-domain large-scale scenarios are shown to be difficult because the possible combinations of semantic inputs grow exponentially with the number of domains. To alleviate such scalability issue, we exploit the structure of dialog acts to build a multi-layer hierarchical graph, where each act is represented as a root-to-leaf route on the graph. Then, we incorporate such graph structure prior as an inductive bias to build a hierarchical disentangled self-attention network, where we disentangle attention heads to model designated nodes on the dialog act graph. By activating different (disentangled) heads at each layer, combinatorially many dialog act semantics can be modeled to control the neural response generation. On the large-scale Multi-Domain-WOZ dataset, our model can yield a significant improvement over the baselines on various automatic and human evaluation metrics.


title: Cross-modal Variational Auto-encoder with Distributed Latent Spaces and Associators

abstract: In this paper, we propose a novel structure for a cross-modal data association, which is inspired by the recent research on the associative learning structure of the brain. We formulate the cross-modal association in Bayesian inference framework realized by a deep neural network with multiple variational auto-encoders and variational associators. The variational associators transfer the latent spaces between auto-encoders that represent different modalities. The proposed structure successfully associates even heterogeneous modal data and easily incorporates the additional modality to the entire network via the proposed cross-modal associator. Furthermore, the proposed structure can be trained with only a small amount of paired data since auto-encoders can be trained by unsupervised manner. Through experiments, the effectiveness of the proposed structure is validated on various datasets including visual and auditory data.


title: Benchmarking Regression Methods: A comparison with CGAN

abstract: In recent years, impressive progress has been made in the design of implicit probabilistic models via Generative Adversarial Networks (GAN) and its extension, the Conditional GAN (CGAN). Excellent solutions have been demonstrated mostly in image processing applications which involve large, continuous output spaces. There is almost no application of these powerful tools to problems having small dimensional output spaces. Regression problems involving the inductive learning of a map, $y=f(x,z)$, $z$ denoting noise, $f:\mathbb{R}^n\times \mathbb{R}^k \rightarrow \mathbb{R}^m$, with $m$ small (e.g., $m=1$ or just a few) is one good case in point. The standard approach to solve regression problems is to probabilistically model the output $y$ as the sum of a mean function $m(x)$ and a noise term $z$; it is also usual to take the noise to be a Gaussian. These are done for convenience sake so that the likelihood of observed data is expressible in closed form. In the real world, on the other hand, stochasticity of the output is usually caused by missing or noisy input variables. Such a real world situation is best represented using an implicit model in which an extra noise vector, $z$ is included with $x$ as input. CGAN is naturally suited to design such implicit models. This paper makes the first step in this direction and compares the existing regression methods with CGAN. We notice however, that the existing methods like mixture density networks (MDN) and XGBoost do quite well compared to CGAN in terms of likelihood and mean absolute error, respectively. Both these methods are comparatively easier to train than CGANs. CGANs need more innovation to have a comparable modeling and ease-of-training with respect to the existing regression solvers. In summary, for modeling uncertainty MDNs are better while XGBoost is better for the cases where accurate prediction is more important.


title: Error-speed correlations in biopolymer synthesis

abstract: Synthesis of biopolymers such as DNA, RNA, and proteins are biophysical processes aided by enzymes. Performance of these enzymes is usually characterized in terms of their average error rate and speed. However, because of thermal fluctuations in these single-molecule processes, both error and speed are inherently stochastic quantities. In this paper, we study fluctuations of error and speed in biopolymer synthesis and show that they are in general correlated. This means that, under equal conditions, polymers that are synthesized faster due to a fluctuation tend to have either better or worse errors than the average. The error-correction mechanism implemented by the enzyme determines which of the two cases holds. For example, discrimination in the forward reaction rates tends to grant smaller errors to polymers with faster synthesis. The opposite occurs for discrimination in monomer rejection rates. Our results provide an experimentally feasible way to identify error-correction mechanisms by measuring the error-speed correlations.


title: On the Operator Jensen Inequality for Convex Functions

abstract: This paper is mainly devoted to studying operator Jensen inequality. More precisely, a new generalization of Jensen inequality and its reverse version for convex (not necessary operator convex) functions have been proved. Several special cases are discussed as well.


title: A Trainable Multiplication Layer for Auto-correlation and Co-occurrence Extraction

abstract: In this paper, we propose a trainable multiplication layer (TML) for a neural network that can be used to calculate the multiplication between the input features. Taking an image as an input, the TML raises each pixel value to the power of a weight and then multiplies them, thereby extracting the higher-order local auto-correlation from the input image. The TML can also be used to extract co-occurrence from the feature map of a convolutional network. The training of the TML is formulated based on backpropagation with constraints to the weights, enabling us to learn discriminative multiplication patterns in an end-to-end manner. In the experiments, the characteristics of the TML are investigated by visualizing learned kernels and the corresponding output features. The applicability of the TML for classification and neural network interpretation is also evaluated using public datasets.


title: A study of coherence based measure of quantumness in (non) Markovian channels

abstract: We make a detailed analysis of quantumness for various quantum noise channels, both Markovian and non-Markovian. The noise channels considered include dephasing channels like random telegraph noise, non-Markovian dephasing and phase damping, as well as the non-dephasing channels such as generalized amplitude damping and Unruh channels. We make use of a recently introduced witness for quantumness based on the square $l_1$ norm of coherence. It is found that the increase in the degree of non-Markovianity increases the quantumness of the channel.


title: Imaging graphene field-effect transistors on diamond using nitrogen-vacancy microscopy

abstract: The application of imaging techniques based on ensembles of nitrogen-vacancy (NV) sensors in diamond to characterise electrical devices has been proposed, but the compatibility of NV sensing with operational gated devices remains largely unexplored. Here we fabricate graphene field-effect transistors (GFETs) directly on the diamond surface and characterise them via NV microscopy. The current density within the gated graphene is reconstructed from NV magnetometry under both mostly p- and n-type doping, but the exact doping level is found to be affected by the measurements. Additionally, we observe a surprisingly large modulation of the electric field at the diamond surface under an applied gate potential, seen in NV photoluminescence and NV electrometry measurements, suggesting a complex electrostatic response of the oxide-graphene-diamond structure. Possible solutions to mitigate these effects are discussed.


title: Information theoretic learning of robust deep representations

abstract: We propose a novel objective function for learning robust deep representations of data based on information theory. Data is projected into a feature-vector space such that the mutual information of all subsets of features relative to the supervising signal is maximized. This objective function gives rise to robust representations by conserving available information relative to supervision in the face of noisy or unavailable features. Although the objective function is not directly tractable, we are able to derive a surrogate objective function. Minimizing this surrogate loss encourages features to be non-redundant and conditionally independent relative to the supervising signal. To evaluate the quality of obtained solutions, we have performed a set of preliminary experiments that show promising results.


title: Fast Reciprocal Collision Avoidance Under Measurement Uncertainty

abstract: We present a fully distributed collision avoidance algorithm based on convex optimization for a team of mobile robots. This method addresses the practical case in which agents sense each other via measurements from noisy on-board sensors with no inter-agent communication. Under some mild conditions, we provide guarantees on mutual collision avoidance for a broad class of policies including the one presented. Additionally, we provide numerical examples of computational performance and show that, in both 2D and 3D simulations, all agents avoid each other and reach their desired goals in spite of their uncertainty about the locations of other agents.


title: Electron heating and mechanical properties of graphene

abstract: The heating of electrons in graphene by laser irradiation, and its effects on the lattice structure, are studied. Values for the temperature of the electron system in realistic situations are obtained. For sufficiently high electron temperatures, the occupancy of the states in the $\sigma$ band of graphene is modified. The strength of the carbon-carbon bonds changes, leading to the emergence of strains, and to buckling in suspended samples. While most applications of `strain engineering' in two dimensional materials focus on the effects of strains on electronic properties, the effect studied here leads to alterations of the structure induced by light. This novel optomechanical coupling can induce deflections in the order of $\sim 50$ nm in micron size samples.


title: Using Restart Heuristics to Improve Agent Performance in Angry Birds

abstract: Over the past few years the Angry Birds AI competition has been held in an attempt to develop intelligent agents that can successfully and efficiently solve levels for the video game Angry Birds. Many different agents and strategies have been developed to solve the complex and challenging physical reasoning problems associated with such a game. However none of these agents attempt one of the key strategies which humans employ to solve Angry Birds levels, which is restarting levels. Restarting is important in Angry Birds because sometimes the level is no longer solvable or some given shot made has little to no benefit towards the ultimate goal of the game. This paper proposes a framework and experimental evaluation for when to restart levels in Angry Birds. We demonstrate that restarting is a viable strategy to improve agent performance in many cases.


title: Comparing Long-Duration Gamma-Ray Flares and High-Energy Solar Energetic Particles

abstract: Little is known about the origin of the high-energy and sustained emission from solar Long-Duration Gamma-Ray Flares (LDGRFs), identified with the Compton Gamma Ray Observatory (CGRO), the Solar Maximum Mission (SMM), and now Fermi. Though Fermi/Large Area Space Telescope (LAT) has identified dozens of flares with LDGRF signature, the nature of this phenomenon has been a challenge to explain both due to the extreme energies and long durations. The highest-energy emission has generally been attributed to pion production from the interaction of >300 MeV protons with the ambient matter. The extended duration suggests that particle acceleration occurs over large volumes extending high in the corona, either from stochastic acceleration within large coronal loops or from back precipitation from coronal mass ejection driven shocks. It is possible to test these models by making direct comparison between the properties of the accelerated ion population producing the gamma-ray emission derived from the Fermi/LAT observations, and the characteristics of solar energetic particles (SEPs) measured by the Payload for Matter-Antimatter Exploration and Light Nuclei Astrophysics (PAMELA) spacecraft in the energy range corresponding to the pion-related emission detected with Fermi. For fourteen of these events we compare the two populations -- SEPs in space and the interacting particles at the Sun -- and discuss the implications in terms of potential sources. Our analysis shows that the two proton numbers are poorly correlated, with their ratio spanning more than five orders of magnitude, suggesting that the back precipitation of shock-acceleration particles is unlikely the source of the LDGRF emission.


title: Multi-Objective Generalized Linear Bandits

abstract: In this paper, we study the multi-objective bandits (MOB) problem, where a learner repeatedly selects one arm to play and then receives a reward vector consisting of multiple objectives. MOB has found many real-world applications as varied as online recommendation and network routing. On the other hand, these applications typically contain contextual information that can guide the learning process which, however, is ignored by most of existing work. To utilize this information, we associate each arm with a context vector and assume the reward follows the generalized linear model (GLM). We adopt the notion of Pareto regret to evaluate the learner's performance and develop a novel algorithm for minimizing it. The essential idea is to apply a variant of the online Newton step to estimate model parameters, based on which we utilize the upper confidence bound (UCB) policy to construct an approximation of the Pareto front, and then uniformly at random choose one arm from the approximate Pareto front. Theoretical analysis shows that the proposed algorithm achieves an $\tilde O(d\sqrt{T})$ Pareto regret, where $T$ is the time horizon and $d$ is the dimension of contexts, which matches the optimal result for single objective contextual bandits problem. Numerical experiments demonstrate the effectiveness of our method.


title: Dissipation Induced Nonstationarity in a Quantum Gas

abstract: Non-stationary long-time dynamics was recently observed in a driven two-component Bose-Einstein condensate coupled to an optical cavity [N. Dogra, et al. arXiv:1901.05974] and analyzed in mean-field theory. We solve the underlying model in the thermodynamic limit and show that this system is always dynamically unstable -- even when mean-field theory predicts stability. Instabilities always occur in higher-order correlation functions leading to squeezing and entanglement induced by cavity dissipation. The dynamics may be understood as the formation of a dissipative time crystal. We use perturbation theory for finite system sizes to confirm the non-stationary behaviour.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech physics.atom-ph


title: Matrix Completion in the Unit Hypercube via Structured Matrix Factorization

abstract: Several complex tasks that arise in organizations can be simplified by mapping them into a matrix completion problem. In this paper, we address a key challenge faced by our company: predicting the efficiency of artists in rendering visual effects (VFX) in film shots. We tackle this challenge by using a two-fold approach: first, we transform this task into a constrained matrix completion problem with entries bounded in the unit interval [0, 1]; second, we propose two novel matrix factorization models that leverage our knowledge of the VFX environment. Our first approach, expertise matrix factorization (EMF), is an interpretable method that structures the latent factors as weighted user-item interplay. The second one, survival matrix factorization (SMF), is instead a probabilistic model for the underlying process defining employees' efficiencies. We show the effectiveness of our proposed models by extensive numerical tests on our VFX dataset and two additional datasets with values that are also bounded in the [0, 1] interval.


title: Function approximation by deep networks

abstract: We show that deep networks are better than shallow networks at approximating functions that can be expressed as a composition of functions described by a directed acyclic graph, because the deep networks can be designed to have the same compositional structure, while a shallow network cannot exploit this knowledge. Thus, the blessing of compositionality mitigates the curse of dimensionality. On the other hand, a theorem called good propagation of errors allows to `lift' theorems about shallow networks to those about deep networks with an appropriate choice of norms, smoothness, etc. We illustrate this in three contexts where each channel in the deep network calculates a spherical polynomial, a non-smooth ReLU network, or another zonal function network related closely with the ReLU network.


title: P3SGD: Patient Privacy Preserving SGD for Regularizing Deep CNNs in Pathological Image Classification

abstract: Recently, deep convolutional neural networks (CNNs) have achieved great success in pathological image classification. However, due to the limited number of labeled pathological images, there are still two challenges to be addressed: (1) overfitting: the performance of a CNN model is undermined by the overfitting due to its huge amounts of parameters and the insufficiency of labeled training data. (2) privacy leakage: the model trained using a conventional method may involuntarily reveal the private information of the patients in the training dataset. The smaller the dataset, the worse the privacy leakage. To tackle the above two challenges, we introduce a novel stochastic gradient descent (SGD) scheme, named patient privacy preserving SGD (P3SGD), which performs the model update of the SGD in the patient level via a large-step update built upon each patient's data. Specifically, to protect privacy and regularize the CNN model, we propose to inject the well-designed noise into the updates. Moreover, we equip our P3SGD with an elaborated strategy to adaptively control the scale of the injected noise. To validate the effectiveness of P3SGD, we perform extensive experiments on a real-world clinical dataset and quantitatively demonstrate the superior ability of P3SGD in reducing the risk of overfitting. We also provide a rigorous analysis of the privacy cost under differential privacy. Additionally, we find that the models trained with P3SGD are resistant to the model-inversion attack compared with those trained using non-private SGD.


title: M-GWAP: An Online and Multimodal Game With A Purpose in WordPress for Mental States Annotation

abstract: M-GWAP is a multimodal game with a purpose of that leverages on the wisdom of crowds phenomenon for the annotation of multimedia data in terms of mental states. This game with a purpose is developed in WordPress to allow users implementing the game without programming skills. The game adopts motivational strategies for the player to remain engaged, such as a score system, text motivators while playing, a ranking system to foster competition and mechanics for identify building. The current version of the game was deployed after alpha and beta testing helped refining the game accordingly.


abstract: Recurrent neural networks (RNNs) have been extraordinarily successful for prediction with sequential data. To tackle highly variable and noisy real-world data, we introduce Particle Filter Recurrent Neural Networks (PF-RNNs), a new RNN family that explicitly models uncertainty in its internal structure: while an RNN relies on a long, deterministic latent state vector, a PF-RNN maintains a latent state distribution, approximated as a set of particles. For effective learning, we provide a fully differentiable particle filter algorithm that updates the PF-RNN latent state distribution according to the Bayes rule. Experiments demonstrate that the proposed PF-RNNs outperform the corresponding standard gated RNNs on a synthetic robot localization dataset and 10 real-world sequence prediction datasets for text classification, stock price prediction, etc.


title: iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images

abstract: Existing Earth Vision datasets are either suitable for semantic segmentation or object detection. In this work, we introduce the first benchmark dataset for instance segmentation in aerial imagery that combines instance-level object detection and pixel-level segmentation tasks. In comparison to instance segmentation in natural scenes, aerial images present unique challenges e.g., a huge number of instances per image, large object-scale variations and abundant tiny objects. Our large-scale and densely annotated Instance Segmentation in Aerial Images Dataset (iSAID) comes with 655,451 object instances for 15 categories across 2,806 high-resolution images. Such precise per-pixel annotations for each instance ensure accurate localization that is essential for detailed scene analysis. Compared to existing small-scale aerial image based instance segmentation datasets, iSAID contains 15$\times$ the number of object categories and 5$\times$ the number of instances. We benchmark our dataset using two popular instance segmentation approaches for natural images, namely Mask R-CNN and PANet. In our experiments we show that direct application of off-the-shelf Mask R-CNN and PANet on aerial images provide suboptimal instance segmentation results, thus requiring specialized solutions from the research community. The dataset is publicly available at: https://captain-whu.github.io/iSAID/index.html


title: Does computer vision matter for action?

abstract: Computer vision produces representations of scene content. Much computer vision research is predicated on the assumption that these intermediate representations are useful for action. Recent work at the intersection of machine learning and robotics calls this assumption into question by training sensorimotor systems directly for the task at hand, from pixels to actions, with no explicit intermediate representations. Thus the central question of our work: Does computer vision matter for action? We probe this question and its offshoots via immersive simulation, which allows us to conduct controlled reproducible experiments at scale. We instrument immersive three-dimensional environments to simulate challenges such as urban driving, off-road trail traversal, and battle. Our main finding is that computer vision does matter. Models equipped with intermediate representations train faster, achieve higher task performance, and generalize better to previously unseen environments. A video that summarizes the work and illustrates the results can be found at https://youtu.be/4MfWa2yZ0Jc


title: Imitation Learning as $f$-Divergence Minimization

abstract: We address the problem of imitation learning with multi-modal demonstrations. Instead of attempting to learn all modes, we argue that in many tasks it is sufficient to imitate any one of them. We show that the state-of-the-art methods such as GAIL and behavior cloning, due to their choice of loss function, often incorrectly interpolate between such modes. Our key insight is to minimize the right divergence between the learner and the expert state-action distributions, namely the reverse KL divergence or I-projection. We propose a general imitation learning framework for estimating and minimizing any f-Divergence. By plugging in different divergences, we are able to recover existing algorithms such as Behavior Cloning (Kullback-Leibler), GAIL (Jensen Shannon) and Dagger (Total Variation). Empirical results show that our approximate I-projection technique is able to imitate multi-modal behaviors more reliably than GAIL and behavior cloning.


title: Unsupervised pre-training helps to conserve views from input distribution

abstract: We investigate the effects of the unsupervised pre-training method under the perspective of information theory. If the input distribution displays multiple views of the supervision, then unsupervised pre-training allows to learn hierarchical representation which communicates these views across layers, while disentangling the supervision. Disentanglement of supervision leads learned features to be independent conditionally to the label. In case of binary features, we show that conditional independence allows to extract label's information with a linear model and therefore helps to solve under-fitting. We suppose that representations displaying multiple views help to solve over-fitting because each view provides information that helps to reduce model's variance. We propose a practical method to measure both disentanglement of supervision and quantity of views within a binary representation. We show that unsupervised pre-training helps to conserve views from input distribution, whereas representations learned using supervised models disregard most of them.


title: An Introduction to Engineering Multiagent Industrial Symbiosis Systems: Potentials and Challenges

abstract: Multiagent Systems (MAS) research reached a maturity to be confidently applied to real-life complex problems. Successful application of MAS methods for behavior modeling, strategic reasoning, and decentralized governance, encouraged us to focus on applicability of MAS techniques in a class of industrial systems and to elaborate on potentials and challenges for method integration/contextualization. We direct attention towards a form of industrial practices called Industrial Symbiosis Systems (ISS) as a highly dynamic domain of application for MAS techniques. In ISS, firms aim to reduce their material and energy footprint by circulating reusable resources among the members. To enable systematic reasoning about ISS behavior and support firms' (as well as ISS designers') decisions, we see the opportunity for marrying industrial engineering with engineering multiagent systems. This enables introducing (1) representation frameworks to reason about dynamics of ISS, (2) operational semantics to develop computational models for ISS, and (3) coordination mechanisms to enforce desirable ISS behaviors. We argue for applicability and expressiveness of resource-bounded formalisms and norm-aware mechanisms for the design and deployment of ISS practices. In this proposal, we elaborate on different dimensions of ISS, present a methodological foundation for ISS development, and finally discuss open problems.


title: The BF Calculus and the Square Root of Negation

abstract: The concept of imaginary logical values was introduced by Spencer-Brown in Laws of Form, in analogy to the square root of -1 in the complex numbers. In this paper, we develop a new approach to representing imaginary values. The resulting system, which we call BF, is a four-valued generalization of Laws of Form. Imaginary values in BF act as cyclic four-valued operators. The central characteristic of BF is its capacity to portray imaginary values as both values and as operators. We show that the BF algebra is a stronger, axiomatically complete extension to Laws of Form capable of representing other four-valued systems, including the Kauffman/Varela Waveform Algebra and Belnap's Four-Valued Bilattice. We conclude by showing a representation of imaginary values based on the Artin braid group, a representation of the braid group and a braided representation of the quaternions in this form.


title: AlignFlow: Cycle Consistent Learning from Multiple Domains via Normalizing Flows

abstract: Given datasets from multiple domains, a key challenge is to efficiently exploit these data sources for modeling a target domain. Variants of this problem have been studied in many contexts, such as cross-domain translation and domain adaptation. We propose AlignFlow, a generative modeling framework that models each domain via a normalizing flow. The use of normalizing flows allows for a) flexibility in specifying learning objectives via adversarial training, maximum likelihood estimation, or a hybrid of the two methods; and b) learning and exact inference of a shared representation in the latent space of the generative model. We derive a uniform set of conditions under which AlignFlow is marginally-consistent for the different learning objectives. Furthermore, we show that AlignFlow guarantees exact cycle consistency in mapping datapoints from a source domain to target and back to the source domain. Empirically, AlignFlow outperforms relevant baselines on image-to-image translation and unsupervised domain adaptation and can be used to simultaneously interpolate across the various domains using the learned representation.


title: A General Optimization Framework for Dynamic Time Warping

abstract: The goal of dynamic time warping is to transform or warp time in order to approximately align two signals together. We pose the choice of warping function as an optimization problem with several terms in the objective. The first term measures the misalignment of the time-warped signals. Two additional regularization terms penalize the cumulative warping and the instantaneous rate of time warping; constraints on the warping can be imposed by assigning the value +inf to the regularization terms. Different choices of the three objective terms yield different time warping functions that trade off signal fit or alignment and properties of the warping function. The optimization problem we formulate is a classical optimal control problem, with initial and terminal constraints, and a state dimension of one. We describe an effective general method that minimizes the objective by discretizing the values of the original and warped time, and using standard dynamic programming to compute the (globally) optimal warping function with the discretized values. Iterated refinement of this scheme yields a high accuracy warping function in just a few iterations. Our method is implemented as an open source Python package GDTW.


title: Origin of the Complex Structure of Quantum Mechanics

abstract: This paper addresses the question why quantum mechanics is formulated in a unitary Hilbert space, i.e. in a manifestly complex setting. Investigating the linear dynamics of real quantum theory in a finite-dimensional Euclidean Hilbert space hints at the emergence of a complex structure. A widespread misconception concerning the measurement process in quantum mechanics and the hermiticity of observables is briefly discussed.


title: Interior-Point Methods Strike Back: Solving the Wasserstein Barycenter Problem

abstract: Computing the Wasserstein barycenter of a set of probability measures under the optimal transport metric can quickly become prohibitive for traditional second-order algorithms, such as interior-point methods, as the support size of the measures increases. In this paper, we overcome the difficulty by developing a new adapted interior-point method that fully exploits the problem's special matrix structure to reduce the iteration complexity and speed up the Newton procedure. Different from regularization approaches, our method achieves a well-balanced tradeoff between accuracy and speed. A numerical comparison on various distributions with existing algorithms exhibits the computational advantages of our approach. Moreover, we demonstrate the practicality of our algorithm on image benchmark problems including MNIST and Fashion-MNIST.


title: The 3.6 meter Devasthal Optical Telescope: From inception to realisation

abstract: India's largest size 3.6 meter Devashal optical telescope (DOT) was commissioned in the year 2016, though the idea of building it germinated way back in the year 1976. This article provides research accounts as well as glimpses of its nearly four decades of journey. After a decade of site surveys, location of Devasthal in central Himalyan region of Kumaon was identified. Thereafter, a detailed site characterization was conducted and project approvals were obtained. The telescope is designed to be a technologically advanced optical astronomy instrument. It has been demonstrated to resolve a binary star having angular separation of 0.4 arc-sec. After the technical activation of the telescope on March 30, 2016, it has been in regular use for testing various back-end instruments as well as for optical and near-infrared observations of celestial objects. Back-end instruments used for these observations are 4KX4K CCD imager, Faint object imager cum spectrograph and TIFR near-infrared camera-II. A few published science results based on the observations taken with the telescope are also presented. Furthermore, the routine observations find that for a good fraction of observing time the telescope provides sky images of sub-arc-second resolution at optical and near-infrared wavelengths. This indicates that the extreme care taken in the design and construction of the telescope dome building has been rewarding since the as-built thermal mass contributes minimally so as not to degrade the natural atmospheric seeing measured at Devasthal about two decades ago during 1997-1999 using differential image motion monitor. The overall on-site performance of the telescope is found to be excellent and at par with the performance of other similar telescopes located over the globe.


title: A Compare-Aggregate Model with Latent Clustering for Answer Selection

abstract: In this paper, we propose a novel method for a sentence-level answer-selection task that is a fundamental problem in natural language processing. First, we explore the effect of additional information by adopting a pretrained language model to compute the vector representation of the input text and by applying transfer learning from a large-scale corpus. Second, we enhance the compare-aggregate model by proposing a novel latent clustering method to compute additional information within the target corpus and by changing the objective function from listwise to pointwise. To evaluate the performance of the proposed approaches, experiments are performed with the WikiQA and TREC-QA datasets. The empirical results demonstrate the superiority of our proposed approach, which achieve state-of-the-art performance for both datasets.


title: Learning Semantics-aware Distance Map with Semantics Layering Network for Amodal Instance Segmentation

abstract: In this work, we demonstrate yet another approach to tackle the amodal segmentation problem. Specifically, we first introduce a new representation, namely a semantics-aware distance map (sem-dist map), to serve as our target for amodal segmentation instead of the commonly used masks and heatmaps. The sem-dist map is a kind of level-set representation, of which the different regions of an object are placed into different levels on the map according to their visibility. It is a natural extension of masks and heatmaps, where modal, amodal segmentation, as well as depth order information, are all well-described. Then we also introduce a novel convolutional neural network (CNN) architecture, which we refer to as semantic layering network, to estimate sem-dist maps layer by layer, from the global-level to the instance-level, for all objects in an image. Extensive experiments on the COCOA and D2SA datasets have demonstrated that our framework can predict amodal segmentation, occlusion and depth order with state-of-the-art performance.


title: Revised description of dust diffusion and a new instability creating multiple rings in protoplanetary disks

abstract: Various instabilities have been proposed as a promising mechanism to accumulate dust. Moreover, some of them are expected to lead to the multiple-ring structure formation and the planetesimal formation in protoplanetary disks. In a turbulent gaseous disk, the growth of the instabilities and the dust accumulation are quenched by turbulent diffusion of dust grains. The diffusion process has been often modeled by a diffusion term in the continuity equation for the dust density. The dust diffusion model, however, does not guarantee the angular momentum conservation in a disk. In this study, we first formulate equations that describe the dust diffusion and also conserve the total angular momentum of a disk. Second, we perform the linear perturbation analysis on the secular gravitational instability (GI) using the equations. The results show that the secular GI is a monotonically growing mode, contrary to the result of previous analyses that found it overstable. We find that the overstability is caused by the non-conservation of the angular momentum. Third, we find a new axisymmetric instability due to the combination of the dust-gas friction and the turbulent gas viscosity, which we refer to as two-component viscous gravitational instability (TVGI). The most unstable wavelength of TVGI is comparable to or smaller than the gas scale height. TVGI accumulates dust grains efficiently, which indicates that TVGI is a promising mechanism for the formation of multiple-ring-like structures and planetesimals. Finally, we examine the validity of the ring formation via the secular GI and TVGI in the HL Tau disk and find both instabilities can create multiple rings whose width is about 10 au at orbital radii larger than 50 au.


title: R Boundedness, Maximal Regularity and Free Boundary Problems for the Navier-Stokes Equations

abstract: In this lecture note, we study free boundary problems for the Navier-Stokes equations with and without surface tension. The local well-posedness, the global well-posedness, and asymptotics of solutions as time goes to infinity are studied in the Lp in time and Lq in space framework. The tool in proving the local well-posedness is the maximal Lp-Lq regularity for the Stokes equations with non-homogeneous free boundary conditions. The approach here of proving the maximal Lp-Lq regularity is based on the R bounded solution operators of the generalized resolvent problem for the Stokes equations with non-homogeneous free boundary conditions and the Weis operator valued Fourier multiplier. The key issue of proving the global well-posedness for the strong solutions is the decay properties of Stokes semigroup, which are derived by spectral analysis of the Stokes operator in the bulk space and the Laplace-Beltrami operator on the boundary. In this lecture note, we study the following two cases: (1) a bounded domain with surface tension and (2) an exterior domain without surface tension. In particular, in studying the exterior domain case, it is essential to choose different exponents p and q. Because, in the unbounded domain case, we can obtain only polynomial decay in suitable Lq norms in space, and so to guarantee the integrability of Lp norm of solutions in time, it is necessary to have freedom to choose an exponent with respect to time variable.


title: Wright-Fisher-type equations for opinion formation, large time behavior and weighted logarithmic-Sobolev inequalities

abstract: We study the rate of convergence to equilibrium of the solution of a Fokker--Planck type equation introduced by one of the authors in 2006 to describe opinion formation in a multi-agent system. The main feature of this Fokker--Planck equation is the presence of a variable diffusion coefficient and boundaries, which introduce new challenging mathematical problems in the study of its long-time behavior.


title: Accurate modeling of the fringing field effect in liquid crystal based spatial light modulators

abstract: Liquid crystal based spatial light modulators are widely used in applied optics due to their ability to continuously modulate the phase of a light field with very high spatial resolution. A common problem in these devices is the pixel crosstalk, also called the fringing field effect, which causes the response of these devices to deviate from the ideal behavior. This fringing effect decreases the performance of the spatial light modulator and is shown to cause an asymmetry in the diffraction efficiency between positive and negative diffraction orders. We use simulations of the director distribution to reproduce diffraction efficiency measurements of binary and blazed gratings. To overcome these limitations in performance, the simulations of the director distribution in the liquid crystal layer are used to develop a fast and precise model to compute the phase response of the spatial light modulator. To compensate the fringing field effect, we implement this model in phase retrieval algorithms and calculate the phase profile corresponding to a regular spot pattern as a generic example. With this method, we are able to increase the spot uniformity significantly compared to a calculation without considering the fringing field effect. Additionally, polarization conversion efficiencies of various simple phase patterns are simulated and measured for different orientations of the spatial light modulator. We found that the polarization conversion has the the smallest effect for a setup in which the liquid crystal molecules at the alignment layer lie in the plane of incidence of the light beam.


title: Measurements of decay branching fractions of $H\to b\bar{b}/c\bar{c}/gg$ in associated $(e^{+}e^{-}/\mu^{+}\mu^{-})H$ production at the CEPC

abstract: The high-precision measurement of Higgs boson properties is one of the primary goals of the Circular Electron Positron Collider (CEPC). The measurements of $H\to b\bar{b}/c\bar{c}/gg$ decay branching fraction in the CEPC experiment is presented, considering a scenario of analysing 5000 $\mathrm{fb}^{-1}$ $e^{+}e^{-}$ collision data with the center-of-mass energy of 250 GeV. In this study the Higgs bosons are produced in association with a pair of leptons, dominantly mediated by the $ZH$ production process. The statistical uncertainty of the signal cross section is estimated to be about 1 % in the $H\to b\bar{b}$ final state, and approximately 5 % - 10 % in the $H\to c\bar{c}/gg$ final states. In addition, the main sources of the systematic uncertainties and their impacts to the measurements of branching fractions are discussed. This study demonstrates the potential of precise measurement of the hadronic final states of the Higgs boson decay at the CEPC, and will provide key information to understand the Yukawa couplings between the Higgs boson and quarks, which are predicted to be the origin of quarks' masses in the Standard Model.


title: Tunable Klein-like tunneling of high-temperature superconducting pairs into graphene

abstract: Superconductivity can be induced in a normal material via the leakage of superconducting pairs of charge carriers from an adjacent superconductor. This so-called proximity effect is markedly influenced by graphene unique electronic structure, both in fundamental and technologically relevant ways. These include an unconventional form of the leakage mechanism the Andreev reflection and the potential of supercurrent modulation through electrical gating. Despite the interest of high-temperature superconductors in that context, realizations have been exclusively based on low-temperature ones. Here we demonstrate gate-tunable, high-temperature superconducting proximity effect in graphene. Notably, gating effects result from the perfect transmission of superconducting pairs across an energy barrier -a form of Klein tunneling, up to now observed only for non-superconducting carriers- and quantum interferences controlled by graphene doping. Interestingly, we find that this type of interferences become dominant without the need of ultra-clean graphene, in stark contrast to the case of low-temperature superconductors. These results pave the way to a new class of tunable, high-temperature Josephson devices based on large-scale graphene.


title: Memory Effect and BMS-like Symmetries for Impulsive Gravitational Waves

abstract: Cataclysmic astrophysical phenomena can produce impulsive gravitational waves that can possibly be detected by the advanced versions of present-day detectors in the future. Gluing of two spacetimes across a null surface produces impulsive gravitational waves (in the phraseology of Penrose [1]) having a Dirac Delta function type pulse profile along the surface. It is known that BMS-like symmetries appear as soldering freedom while we glue two spacetimes along a null surface. In this note, we study the effect of such impulsive gravitational waves on test particles (detectors) or geodesics. We show explicitly some measurable effects that depend on BMS-transformation parameters on timelike and null geodesics. BMS-like symmetry parameters carried by the gravitational wave leave some "memory" on test geodesics upon passing through them.


title: 1/f^2 spectra of decoherence noise on ^75^As nuclear spins in bulk GaAs

abstract: To identify the decoherence origin, frequency spectra using multiple {\pi}-pulses have been extensively studied. However, little has been discussed on how to define the spectral intensities from multiple-echo decays and how to incorporate the Hahn-echo T_2 in the noise spectra. Here, we show that experiments based on two theories solve these issues. With the previous theory clarifying that the spectral intensity should be given as the decay in the long-time limit, the intensity can be deduced without experimental artifacts usually entailed in the initial process. The other is the fluctuation-dissipation theory, with which the Hahn-echo T_2 is utilized as the zero-frequency limit of the noise spectrum and as an answer to the divergent issue on the 1/f^n noises. As a result, arsenic nuclear spins are found to exhibit 1/f2 dependences over two orders of magnitude in all the substrates of un-doped, Cr-doped semi-insulating and Si-doped metallic GaAs at 297 K. The 1/f^2 dependence indicates single noise source that is characterized by the characteristic frequency f_c_^un^=170 Hz, f_c_^Cr^=210 Hz and f_c_^Si^ =460 Hz. These f_c values are explained by a model that the decoherence is caused by the fluctuations of next-nearest-neighboring nuclear spins.


title: Dual Quantum Zeno Superdense Coding

abstract: Quantum superdense coding enables a sender to encode a two-bit classical message in one qubit using the preshared entanglement. In this paper, we develop a superdense coding protocol using a dual quantum Zeno (DQZ) gate to take the full advantage of quantum superdense coding from the complete Bell-state analysis. We verify that the DQZ gate allows remote parties to achieve the distinguishability of orthonormal Bell states in a semi-counterfactual manner and the DQZ superdense coding achieves high throughput efficiency as a function of cycle numbers for the Bell-state analyzer.


title: Algorithmic Detection and Analysis of Vaccine-Denialist Sentiment Clusters in Social Networks

abstract: Vaccination rates are decreasing in many areas of the world, and outbreaks of preventable diseases tend to follow in areas with particular low rates. Much research has been devoted to improving our understanding of the motivations behind vaccination decisions and the effects of various types of information offered to skeptics, no large-scale study of the structure of online vaccination discourse have been conducted. Here, we offer an approach to quantitatively study the vaccine discourse in an online system, exemplified by Twitter. We use train a deep neural network to predict tweet vaccine sentiments, surpassing state-of-the-art performance, attaining two-class accuracy of $90.4\%$, and a three-class F1 of $0.762$. We identify profiles which consistently produce strongly anti- and pro-vaccine content. We find that strongly anti-vaccine profiles primarily post links to Youtube, and commercial sites that make money on selling alternative health products, representing a conflict of interest. We also visualize the network of repeated mutual interactions of actors in the vaccine discourse and find that it is highly stratified, with an assortativity coefficient of $r = .813$.


title: Deep multi-class learning from label proportions

abstract: We propose a learning algorithm capable of learning from label proportions instead of direct data labels. In this scenario, our data are arranged into various bags of a certain size, and only the proportions of each label within a given bag are known. This is a common situation in cases where per-data labeling is lengthy, but a more general label is easily accessible. Several approaches have been proposed to learn in this setting with linear models in the multiclass setting, or with nonlinear models in the binary classification setting. Here we investigate the more general nonlinear multiclass setting, and compare two differentiable loss functions to train end-to-end deep neural networks from bags with label proportions. We illustrate the relevance of our methods on an image classification benchmark, and demonstrate the possibility to learn accurate image classifiers from bags of images.


title: Note About Canonical Description of T-duality Along Light-Like Isometry

abstract: In this short note we analyze canonical description of T-duality along light-like isometry. We show that T-duality of relativistic string theory on this background leads to non-relativistic string theory action on T-dual background.


title: Quantum dynamical speedup in correlated noisy channels

abstract: The maximal evolution speed of a quantum system can be represented by quantum speed limit time (QSLT).We investigate QSLT of a two-qubit system passing through a correlated channel (amplitude damping, phase damping, and depolarizing).By adjusting the correlation parameter of channel and the initial entanglement,a method to accelerate the evolution speed of the system for some specific channels is proposed.It is shown that, in amplitude damping channel and depolarizing channel,QSLT may be shortened in some cases by increasing correlation parameter of the channel and initial entanglement, which are in sharp contrast to phase damping channel.In particular, under depolarizing channels, the transition from no-speedup evolution to speedup evolution for the system can be realized by changing correlation strength of the channel.


title: Analysis on Riemannian foliations of bounded geometry

abstract: A leafwise Hodge decomposition was proved by Sanguiao for Riemannian foliations of bounded geometry. Its proof is explained again in terms of our study of bounded geometry for Riemannian foliations. It is used to associate smoothing operators to foliated flows, and describe their Schwartz kernels. All of this is extended to a leafwise version of the Novikov differential complex.


title: Information Source Detection with Limited Time Knowledge

abstract: This paper investigates the problem of utilizing network topology and partial timestamps to detect the information source in a network. The problem incurs prohibitive cost under canonical maximum likelihood estimation (MLE) of the source due to the exponential number of possible infection paths. Our main idea of source detection, however, is to approximate the MLE by an alternative infection path based estimator, the essence of which is to identify the most likely infection path that is consistent with observed timestamps. The source node associated with that infection path is viewed as the estimated source $\hat{v}$. We first study the case of tree topology, where by transforming the infection path based estimator into a linear integer programming, we find a reduced search region that remarkably improves the time efficiency. Within this reduced search region, the estimator $\hat{v}$ is provably always on a path which we term as \emph{candidate path}. This notion enables us to analyze the distribution of $d(v^{\ast},\hat{v})$, the error distance between $\hat{v}$ and the true source $v^{\ast}$, on arbitrary tree, which allows us to obtain for the first time, in the literature provable performance guarantee of the estimator under limited timestamps. Specifically, on the infinite $g$-regular tree with uniform sampled timestamps, we get a refined performance guarantee in the sense of a constant bounded $d(v^{\ast},\hat{v})$. By virtue of time labeled BFS tree, the estimator still performs fairly well when extended to more general graphs. Experiments on both synthetic and real datasets further demonstrate the superior performance of our proposed algorithms.


title: Meta Dropout: Learning to Perturb Features for Generalization

abstract: A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we know how to optimally perturb training examples to account for test examples, we may achieve better generalization performance. However, obtaining such perturbation is not possible in standard machine learning frameworks as the distribution of the test data is unknown. To tackle this challenge, we propose a novel regularization method, meta-dropout, which learns to perturb the latent features of training examples for generalization in a meta-learning framework. Specifically, we meta-learn a noise generator which outputs a multiplicative noise distribution for latent features, to obtain low errors on the test instances in an input-dependent manner. Then, the learned noise generator can perturb the training examples of unseen tasks at the meta-test time for improved generalization. We validate our method on few-shot classification datasets, whose results show that it significantly improves the generalization performance of the base model, and largely outperforms existing regularization methods such as information bottleneck, manifold mixup, and information dropout.


title: Separating an Outlier from a Change

abstract: We study the change detection problem with an unknown post-change distribution. Under this constraint, the unknown change in the distribution of observations may occur in many ways without much structure on the observations, whereas, before the change point, a false alarm (outlier) is highly structured, following a particular sample path. We first characterize these likely events for the deviation and propose a method to test the empirical distribution, relative to the most likely way for it to occur as an outlier. We benchmark our method with finite moving average (FMA) and generalized likelihood ratio tests (GLRT) under 4 different performance criteria including the run time time complexity. Finally, we apply our method on economic market indicators and climate data. Our method successfully captures the regime shifts during times of historical significance for the markets and identifies the current climate change phenomenon to be a highly likely regime shift rather than a random event.


title: Effective Medical Test Suggestions Using Deep Reinforcement Learning

abstract: Effective medical test suggestions benefit both patients and physicians to conserve time and improve diagnosis accuracy. In this work, we show that an agent can learn to suggest effective medical tests. We formulate the problem as a stage-wise Markov decision process and propose a reinforcement learning method to train the agent. We introduce a new representation of multiple action policy along with the training method of the proposed representation. Furthermore, a new exploration scheme is proposed to accelerate the learning of disease distributions. Our experimental results demonstrate that the accuracy of disease diagnosis can be significantly improved with good medical test suggestions.