title: Recency predicts bursts in the evolution of author citations

abstract: The citations process for scientific papers has been studied extensively. But while the citations accrued by authors are the sum of the citations of their papers, translating the dynamics of citation accumulation from the paper to the author level is not trivial. Here we conduct a systematic study of the evolution of author citations, and in particular their bursty dynamics. We find empirical evidence of a correlation between the number of citations most recently accrued by an author and the number of citations they receive in the future. Using a simple model where the probability for an author to receive new citations depends only on the number of citations collected in the previous 12-24 months, we are able to reproduce both the citation and burst size distributions of authors across multiple decades.


title: Automatic prediction of suicidal risk in military couples using multimodal interaction cues from couples conversations

abstract: Suicide is a major societal challenge globally, with a wide range of risk factors, from individual health, psychological and behavioral elements to socio-economic aspects. Military personnel, in particular, are at especially high risk. Crisis resources, while helpful, are often constrained by access to clinical visits or therapist availability, especially when needed in a timely manner. There have hence been efforts on identifying whether communication patterns between couples at home can provide preliminary information about potential suicidal behaviors, prior to intervention. In this work, we investigate whether acoustic, lexical, behavior and turn-taking cues from military couples' conversations can provide meaningful markers of suicidal risk. We test their effectiveness in real-world noisy conditions by extracting these cues through an automatic diarization and speech recognition front-end. Evaluation is performed by classifying 3 degrees of suicidal risk: none, ideation, attempt. Our automatic system performs significantly better than chance in all classification scenarios and we find that behavior and turn-taking cues are the most informative ones. We also observe that conditioning on factors such as speaker gender and topic of discussion tends to improve classification performance.


title: Improving Fictitious Play Reinforcement Learning with Expanding Models

abstract: Fictitious play with reinforcement learning is a general and effective framework for zero-sum games. However, using the current deep neural network models, the implementation of fictitious play faces crucial challenges. Neural network model training employs gradient descent approaches to update all connection weights, and thus is easy to forget the old opponents after training to beat the new opponents. Existing approaches often maintain a pool of historical policy models to avoid the forgetting. However, learning to beat a pool in stochastic games, i.e., a wide distribution over policy models, is either sample-consuming or insufficient to exploit all models with limited amount of samples. In this paper, we propose a learning process with neural fictitious play to alleviate the above issues. We train a single model as our policy model, which consists of sub-models and a selector. Everytime facing a new opponent, the model is expanded by adding a new sub-model, where only the new sub-model is updated instead of the whole model. At the same time, the selector is also updated to mix up the new sub-model with the previous ones at the state-level, so that the model is maintained as a behavior strategy instead of a wide distribution over policy models. Experiments on Kuhn poker, a grid-world Treasure Hunting game, and Mini-RTS environments show that the proposed approach alleviates the forgetting problem, and consequently improves the learning efficiency and the robustness of neural fictitious play.


title: CSPNet: A New Backbone that can Enhance Learning Capability of CNN

abstract: Neural networks have enabled state-of-the-art approaches to achieve incredible results on computer vision tasks such as object detection. However, such success greatly relies on costly computation resources, which hinders people with cheap devices from appreciating the advanced technology. In this paper, we propose Cross Stage Partial Network (CSPNet) to mitigate the problem that previous works require heavy inference computations from the network architecture perspective. We attribute the problem to the duplicate gradient information within network optimization. The proposed networks respect the variability of the gradients by integrating feature maps from the beginning and the end of a network stage, which, in our experiments, reduces computations by 20% with equivalent or even superior accuracy on the ImageNet dataset, and significantly outperforms state-of-the-art approaches in terms of AP50 on the MS COCO object detection dataset. The CSPNet is easy to implement and general enough to cope with architectures based on ResNet, ResNeXt, and DenseNet. Source code is at https://github.com/WongKinYiu/CrossStagePartialNetworks.


title: Accumulative time-based ranking method to reputation evaluation in information networks

abstract: With the rapid development of modern technology, the Web has become an important platform for users to make friends and acquire information. However, since information on the Web is over-abundant, information filtering becomes a key task for online users to obtain relevant suggestions. As most Websites can be ranked according to users' rating and preferences, relevance to queries, and recency, how to extract the most relevant item from the over-abundant information is always a key topic for researchers in various fields. In this paper, we adopt tools used to analyze complex networks to evaluate user reputation and item quality. In our proposed accumulative time-based ranking (ATR) algorithm, we incorporate two behavioral weighting factors which are updated when users select or rate items, to reflect the evolution of user reputation and item quality over time. We showed that our algorithm outperforms state-of-the-art ranking algorithms in terms of precision and robustness on empirical datasets from various online retailers and the citation datasets among research publications.


title: Evaluating Commonsense in Pre-trained Language Models

abstract: Contextualized representations trained over large raw text data have given remarkable improvements for NLP tasks including question answering and reading comprehension. There have been works showing that syntactic, semantic and word sense knowledge are contained in such representations, which explains why they benefit such tasks. However, relatively little work has been done investigating commonsense knowledge contained in contextualized representations, which is crucial for human question answering and reading comprehension. We study the commonsense ability of GPT, BERT, XLNet, and RoBERTa by testing them on seven challenging benchmarks, finding that language modeling and its variants are effective objectives for promoting models' commonsense ability while bi-directional context and larger training set are bonuses. We additionally find that current models do poorly on tasks require more necessary inference steps. Finally, we test the robustness of models by making dual test cases, which are correlated so that the correct prediction of one sample should lead to correct prediction of the other. Interestingly, the models show confusion on these test cases, which suggests that they learn commonsense at the surface rather than the deep level. We release a test set, named CATs publicly, for future research.


title: Survey of Attacks and Defenses on Edge-Deployed Neural Networks

abstract: Deep Neural Network (DNN) workloads are quickly moving from datacenters onto edge devices, for latency, privacy, or energy reasons. While datacenter networks can be protected using conventional cybersecurity measures, edge neural networks bring a host of new security challenges. Unlike classic IoT applications, edge neural networks are typically very compute and memory intensive, their execution is data-independent, and they are robust to noise and faults. Neural network models may be very expensive to develop, and can potentially reveal information about the private data they were trained on, requiring special care in distribution. The hidden states and outputs of the network can also be used in reconstructing user inputs, potentially violating users' privacy. Furthermore, neural networks are vulnerable to adversarial attacks, which may cause misclassifications and violate the integrity of the output. These properties add challenges when securing edge-deployed DNNs, requiring new considerations, threat models, priorities, and approaches in securely and privately deploying DNNs to the edge. In this work, we cover the landscape of attacks on, and defenses, of neural networks deployed in edge devices and provide a taxonomy of attacks and defenses targeting edge DNNs.


title: Simultaneous Neural Machine Translation using Connectionist Temporal Classification

abstract: Simultaneous machine translation is a variant of machine translation that starts the translation process before the end of an input. This task faces a trade-off between translation accuracy and latency. We have to determine when we start the translation for observed inputs so far, to achieve good practical performance. In this work, we propose a neural machine translation method to determine this timing in an adaptive manner. The proposed method introduces a special token '<wait>', which is generated when the translation model chooses to read the next input token instead of generating an output token. It also introduces an objective function to handle the ambiguity in wait timings that can be optimized using an algorithm called Connectionist Temporal Classification (CTC). The use of CTC enables the optimization to consider all possible output sequences including '<wait>' that are equivalent to the reference translations and to choose the best one adaptively. We apply the proposed method into simultaneous translation from English to Japanese and investigate its performance and remaining problems.


title: A Secure and Robust Scheme for Sharing Confidential Information in IoT Systems

abstract: In Internet of Things (IoT) systems with security demands, there is often a need to distribute sensitive information (such as encryption keys, digital signatures, or login credentials, etc.) among the devices, so that it can be retrieved for confidential purposes at a later moment. However, this information cannot be entrusted to any one device, since the failure of that device or an attack on it will jeopardize the security of the entire network. Even if the information is divided among devices, there is still the danger that an attacker can compromise a group of devices and expose the sensitive information. In this work, we design and implement a secure and robust scheme to enable the distribution of sensitive information in IoT networks. The proposed approach has two important properties: (1) it uses Threshold Secret Sharing (TSS) to split the information into pieces distributed among all devices in the system - and so the information can only be retrieved collaboratively by groups of devices; and (2) it ensures the privacy and integrity of the information, even when attackers hijack a large number of devices and use them in concert - specifically, all the compromised devices can be identified, the confidentiality of information is kept, and authenticity of the secret can be guaranteed.


title: AIPNet: Generative Adversarial Pre-training of Accent-invariant Networks for End-to-end Speech Recognition

abstract: As one of the major sources in speech variability, accents have posed a grand challenge to the robustness of speech recognition systems. In this paper, our goal is to build a unified end-to-end speech recognition system that generalizes well across accents. For this purpose, we propose a novel pre-training framework AIPNet based on generative adversarial nets (GAN) for accent-invariant representation learning: Accent Invariant Pre-training Networks. We pre-train AIPNet to disentangle accent-invariant and accent-specific characteristics from acoustic features through adversarial training on accented data for which transcriptions are not necessarily available. We further fine-tune AIPNet by connecting the accent-invariant module with an attention-based encoder-decoder model for multi-accent speech recognition. In the experiments, our approach is compared against four baselines including both accent-dependent and accent-independent models. Experimental results on 9 English accents show that the proposed approach outperforms all the baselines by 2.3 \sim 4.5% relative reduction on average WER when transcriptions are available in all accents and by 1.6 \sim 6.1% relative reduction when transcriptions are only available in US accent.


title: Generalizing Complex Hypotheses on Product Distributions: Auctions, Prophet Inequalities, and Pandora's Problem

abstract: This paper explores a theory of generalization for learning problems on product distributions, complementing the existing learning theories in the sense that it does not rely on any complexity measures of the hypothesis classes. The main contributions are two general sample complexity bounds: (1) $\tilde{O} \big( \frac{nk}{\epsilon^2} \big)$ samples are sufficient and necessary for learning an $\epsilon$-optimal hypothesis in any problem on an $n$-dimensional product distribution, whose marginals have finite supports of sizes at most $k$; (2) $\tilde{O} \big( \frac{n}{\epsilon^2} \big)$ samples are sufficient and necessary for any problem on $n$-dimensional product distributions if it satisfies a notion of strong monotonicity from the algorithmic game theory literature. As applications of these theories, we match the optimal sample complexity for single-parameter revenue maximization (Guo et al., STOC 2019), improve the state-of-the-art for multi-parameter revenue maximization (Gonczarowski and Weinberg, FOCS 2018) and prophet inequality (Correa et al., EC 2019), and provide the first and tight sample complexity bound for Pandora's problem.


title: Period Adaptation for Continuous Security Monitoring in Multicore Real-Time Systems

abstract: We propose a design-time framework (named HYDRA-C) for integrating security tasks into partitioned real-time systems (RTS) running on multicore platforms. Our goal is to opportunistically execute security monitoring mechanisms in a 'continuous' manner -- i.e., as often as possible, across cores, to ensure that security tasks run with as few interruptions as possible. Our framework will allow designers to integrate security mechanisms without perturbing existing real-time (RT) task properties or execution order. We demonstrate the framework using a proof-of-concept implementation with intrusion detection mechanisms as security tasks. We develop and use both, (a) a custom intrusion detection system (IDS), as well as (b) Tripwire -- an open source data integrity checking tool. These are implemented on a realistic rover platform designed using an ARM multicore chip. We compare the performance of HYDRA-C with a state-of-the-art RT security integration approach for multicore-based RTS and find that our method can, on average, detect intrusions 19.05% faster without impacting the performance of RT tasks.


title: Transfer Learning in Visual and Relational Reasoning

abstract: Transfer learning has become the de facto standard in computer vision and natural language processing, especially where labeled data is scarce. Accuracy can be significantly improved by using pre-trained models and subsequent fine-tuning. In visual reasoning tasks, such as image question answering, transfer learning is more complex. In addition to transferring the capability to recognize visual features, we also expect to transfer the system's ability to reason. Moreover, for video data, temporal reasoning adds another dimension. In this work, we formalize these unique aspects of transfer learning and propose a theoretical framework for visual reasoning, exemplified by the well-established CLEVR and COG datasets. Furthermore, we introduce a new, end-to-end differentiable recurrent model (SAMNet), which shows state-of-the-art accuracy and better performance in transfer learning on both datasets. The improved performance of SAMNet stems from its capability to decouple the abstract multi-step reasoning from the length of the sequence and its selective attention enabling to store only the question-relevant objects in the external memory.


title: Baer--Suzuki theorem for the $\pi$-radical

abstract: In the paper we prove (modulo the classification of finite simple groups) an analogue of the famous Baer-Suzuki theorem for the $\pi$-radical of a finite group, where $\pi$ is a set of primes


title: Ballistic and shift currents in the bulk photovoltaic effect theory

abstract: The bulk photovoltaic effect (BPVE) -- generation of electric currents by light in noncentrosymmetric materials in the absence of electric fields and gradients -- has been intensively investigated in the end of the last century. The outcomes including all main aspects of this phenomenon were summarized in review and books. A new upsurge of interest to the BPVE occurred recently and resulted in a flux of misleading theoretical and experimental publications centered around the so-called shift current. Numerous top-rated recent publications ignore the basic principles of charge-transport phenomena and the previous results of joined experimental-theoretical studies. Specifically, dominating (or substantial) contributions to the currents caused by asymmetry of the momentum distributions of electrons and holes are missed. The widespread starting relation for the shift current, originating from the quadratic nonlinear response theory and pretending to be omnipotent, is in fact incomplete. It ignores kinetic processes of relaxation and recombination of photo-excited electrons and leads to non-vanishing shift currents in thermal equilibrium. The goals of this methodical note is to specify and argue the benchmarks of the BPVE theory and return the studies on the right track in the interest of development of photovoltaic devices.


title: Active Quenching of Superconducting Nanowire Single Photon Detectors

abstract: Superconducting nanowire single photon detectors are typically biased using a constant current source and shunted in a conductance which is over an order of magnitude larger than the peak normal domain conductance of the detector. While this design choice is required to ensure quenching of the normal domain, the use of a small load resistor limits the pulse amplitude, rising-edge slew rate, and recovery time of the detector. Here, we explore the possibility of actively quenching the normal domain, thereby removing the need to shunt the detector in a small resistance. We first consider the theoretical performance of an actively quenched superconducting nanowire single photon detector and, in comparison to a passively quenched device, we predict roughly an order of magnitude improvement in the slew rate and peak voltage achieved in this configuration. The experimental performance of actively and passively quenched superconducting nanowire single photon detectors are then compared. It is shown that, in comparison to a passively quenched device, the actively quenched detectors simultaneously exhibited improved count rates, dark count rates, and timing jitter.


title: Rethinking the Item Order in Session-based Recommendation with Graph Neural Networks

abstract: Predicting a user's preference in a short anonymous interaction session instead of long-term history is a challenging problem in the real-life session-based recommendation, e.g., e-commerce and media stream. Recent research of the session-based recommender system mainly focuses on sequential patterns by utilizing the attention mechanism, which is straightforward for the session's natural sequence sorted by time. However, the user's preference is much more complicated than a solely consecutive time pattern in the transition of item choices. In this paper, therefore, we study the item transition pattern by constructing a session graph and propose a novel model which collaboratively considers the sequence order and the latent order in the session graph for a session-based recommender system. We formulate the next item recommendation within the session as a graph classification problem. Specifically, we propose a weighted attention graph layer and a Readout function to learn embeddings of items and sessions for the next item recommendation. Extensive experiments have been conducted on two benchmark E-commerce datasets, Yoochoose and Diginetica, and the experimental results show that our model outperforms other state-of-the-art methods.


title: Novelty Detection Via Blurring

abstract: Conventional out-of-distribution (OOD) detection schemes based on variational autoencoder or Random Network Distillation (RND) have been observed to assign lower uncertainty to the OOD than the target distribution. In this work, we discover that such conventional novelty detection schemes are also vulnerable to the blurred images. Based on the observation, we construct a novel RND-based OOD detector, SVD-RND, that utilizes blurred images during training. Our detector is simple, efficient at test time, and outperforms baseline OOD detectors in various domains. Further results show that SVD-RND learns better target distribution representation than the baseline RND algorithm. Finally, SVD-RND combined with geometric transform achieves near-perfect detection accuracy on the CelebA dataset.


title: The Sasa-Satsuma equation with non-vanishing boundary conditions

abstract: We concentrate on inverse scattering transformation for the Sasa-Satsuma equation with $3\times 3$ matrix spectral and nonzero boundary condition in this article. To circumvent multi valuedness of eigenvalues, we introduce a suitable two-sheet Riemann surface to map the original spectral parameter $k$ into a single-valued parameter $z$. The analyticity of the Jost eigenfunctions and scattering coefficients of Lax pair for the SS equation are analyzed in details. According to the analyticity of eigenfunctions and scattering coefficients, the $z$-complex plane is divided into four analytic regions $D_j, \ j=1, 2, 3, 4$. Since the second column of Jost eigenfunctions is analytic in $D_{j}, \ j=1, 2, 3, 4$, but in upper-half or lower-half plane, we introduce certain auxiliary eigenfunctions which are necessary for deriving the analytic eigenfunctions in $D_{j}$. We find that for the eigenfunctions, scattering coefficients and the auxiliary eigenfunctions all possess three kinds of symmetries, which characterize the distribution of discrete spectrum. The asymptotic behaviors of eigenfunctions, auxiliary eigenfunctions and scattering coefficients are also systematically derived. Then a matrix Riemann-Hilbert problem with four kind jump conditions associated with the problem of nonzero asymptotic boundary conditions is established, from which $N$-soliton solutions is obtained via the corresponding reconstruction formulae. The reflectionless soliton solutions are explicitly given. As application of the $N$-soliton formula, we present three kinds of single-soliton solutions according to the distribution of discrete spectrum.


title: Sharp quantitative stability of the planar Brunn-Minkowski inequality

abstract: We prove a sharp stability result for the Brunn-Minkowski inequality for $A,B\subset\mathbb{R}^2$. Assuming that the Brunn-Minkowski deficit $\delta=|A+B|^{\frac{1}{2}}/(|A|^\frac12+|B|^\frac12)-1$ is sufficiently small in terms of $t=|A|^{\frac{1}{2}}/(|A|^{\frac{1}{2}}+|B|^{\frac{1}{2}})$, there exist homothetic convex sets $K_A \supset A$ and $K_B\supset B$ such that $\frac{|K_A\setminus A|}{|A|}+\frac{|K_B\setminus B|}{|B|} \le C t^{-\frac{1}{2}}\delta^{\frac{1}{2}}$. The key ingredient is to show for every $\epsilon>0$, if $\delta$ is sufficiently small then $|co(A+B)\setminus (A+B)|\le (1+\epsilon)(|co(A)\setminus A|+|co(B)\setminus B|)$.


title: Can Attention Masks Improve Adversarial Robustness?

abstract: Deep Neural Networks (DNNs) are known to be susceptible to adversarial examples. Adversarial examples are maliciously crafted inputs that are designed to fool a model, but appear normal to human beings. Recent work has shown that pixel discretization can be used to make classifiers for MNIST highly robust to adversarial examples. However, pixel discretization fails to provide significant protection on more complex datasets. In this paper, we take the first step towards reconciling these contrary findings. Focusing on the observation that discrete pixelization in MNIST makes the background completely black and foreground completely white, we hypothesize that the important property for increasing robustness is the elimination of image background using attention masks before classifying an object. To examine this hypothesis, we create foreground attention masks for two different datasets, GTSRB and MS-COCO. Our initial results suggest that using attention mask leads to improved robustness. On the adversarially trained classifiers, we see an adversarial robustness increase of over 20% on MS-COCO.


title: Beyond Limber: Efficient computation of angular power spectra for galaxy clustering and weak lensing

abstract: Angular two-point statistics of large-scale structure observables are important cosmological probes. To reach the high accuracy required by the statistical precision of future surveys, some of these statistics may need to be computed without the commonly employed Limber approximation; the exact computation however requires integration over Bessel functions, and a brute-force evaluation is slow to converge. We present a new method based on our generalized FFTLog algorithm for the efficient computation of angular power spectra beyond the Limber approximation. The new method significantly simplifies the calculation and improves the numerical speed and stability. It is easily extended to handle integrals involving derivatives of Bessel functions, making it equally applicable to numerically more challenging cases such as contributions from redshift-space distortions and Doppler effects. We implement our method for galaxy clustering and galaxy-galaxy lensing power spectra. We find that using the Limber approximation for galaxy clustering in future analyses like LSST Year 1 and DES Year 6 may cause significant biases in cosmological parameters, indicating that going beyond the Limber approximation is necessary for these analyses.


title: A note on observation processes in epidemic models

abstract: Many disease models focus on characterizing the underlying transmission mechanism but make simple, possibly naive assumptions about how infections are reported. In this note, we use a simple deterministic Susceptible-Infected-Removed (SIR) model to compare two common assumptions about disease incidence reports: individuals can report their infection as soon as they become infected or as soon as they recover. We show that incorrect assumptions about the underlying observation processes can bias estimates of the basic reproduction number and lead to overly narrow confidence intervals.


title: Region of existence of multiple solutions for a class of 4-point BVPs

abstract: The aim of this article is to prove the existence of solution and compute the region of existence for a class of 4-point BVPs defined as, \begin{eqnarray*} &&-u''(x)=\psi(x,u,u'), \quad 0<x<1, &&u'(0)=\lambda_{1}u(\xi), \quad u'(1)=\lambda_{2} u(\eta), \end{eqnarray*} where $I=[0,1]$, $0<\xi\leq\eta<1$ and $\lambda_1,\lambda_2> 0$. The non linear source term $\psi\in C(I\times\mathbb{R}\times\mathbb{R},\mathbb{R})$ is one sided Lipschitz in $u$ with Lipschitz constant $L_1$ and Lipschitz in $u'$ with Lipschitz function $L_2(x)$, where $L_2(x):I\rightarrow \mathbb{R}^+ $ such that $ L_2(0)=0$ and $L_2'(x)\geq 0$. The novelty in this paper allows us to use simplest form of computational iteration and existence is achieved with a restriction that $L_2$ depends on $x$. We develop monotone iterative technique in well ordered and reverse ordered cases. We prove maximum anti-maximum principle under certain assumptions and use it to show the monotonic behavior of sequences of upper and lower solutions. The conditions derived in this paper are sufficient and have been verified for two examples. The method involves Newton's quasilinearization which involves a parameter $k$ which is equivalent to $\dfrac{\partial \psi}{\partial u}$. Our aim is to find a range of $k$ so that the iterative technique is convergent.


title: Trading Convergence Rate with Computational Budget in High Dimensional Bayesian Optimization

abstract: Scaling Bayesian optimisation (BO) to high-dimensional search spaces is a active and open research problems particularly when no assumptions are made on function structure. The main reason is that at each iteration, BO requires to find global maximisation of acquisition function, which itself is a non-convex optimization problem in the original search space. With growing dimensions, the computational budget for this maximisation gets increasingly short leading to inaccurate solution of the maximisation. This inaccuracy adversely affects both the convergence and the efficiency of BO. We propose a novel approach where the acquisition function only requires maximisation on a discrete set of low dimensional subspaces embedded in the original high-dimensional search space. Our method is free of any low dimensional structure assumption on the function unlike many recent high-dimensional BO methods. Optimising acquisition function in low dimensional subspaces allows our method to obtain accurate solutions within limited computational budget. We show that in spite of this convenience, our algorithm remains convergent. In particular, cumulative regret of our algorithm only grows sub-linearly with the number of iterations. More importantly, as evident from our regret bounds, our algorithm provides a way to trade the convergence rate with the number of subspaces used in the optimisation. Finally, when the number of subspaces is "sufficiently large", our algorithm's cumulative regret is at most $\mathcal{O}^{*}(\sqrt{T\gamma_T})$ as opposed to $\mathcal{O}^{*}(\sqrt{DT\gamma_T})$ for the GP-UCB of Srinivas et al. (2012), reducing a crucial factor $\sqrt{D}$ where $D$ being the dimensional number of input space.


title: Taking a Stance on Fake News: Towards Automatic Disinformation Assessment via Deep Bidirectional Transformer Language Models for Stance Detection

abstract: The exponential rise of social media and digital news in the past decade has had the unfortunate consequence of escalating what the United Nations has called a global topic of concern: the growing prevalence of disinformation. Given the complexity and time-consuming nature of combating disinformation through human assessment, one is motivated to explore harnessing AI solutions to automatically assess news articles for the presence of disinformation. A valuable first step towards automatic identification of disinformation is stance detection, where given a claim and a news article, the aim is to predict if the article agrees, disagrees, takes no position, or is unrelated to the claim. Existing approaches in literature have largely relied on hand-engineered features or shallow learned representations (e.g., word embeddings) to encode the claim-article pairs, which can limit the level of representational expressiveness needed to tackle the high complexity of disinformation identification. In this work, we explore the notion of harnessing large-scale deep bidirectional transformer language models for encoding claim-article pairs in an effort to construct state-of-the-art stance detection geared for identifying disinformation. Taking advantage of bidirectional cross-attention between claim-article pairs via pair encoding with self-attention, we construct a large-scale language model for stance detection by performing transfer learning on a RoBERTa deep bidirectional transformer language model, and were able to achieve state-of-the-art performance (weighted accuracy of 90.01%) on the Fake News Challenge Stage 1 (FNC-I) benchmark. These promising results serve as motivation for harnessing such large-scale language models as powerful building blocks for creating effective AI solutions to combat disinformation.


title: Label Dependent Deep Variational Paraphrase Generation

abstract: Generating paraphrases that are lexically similar but semantically different is a challenging task. Paraphrases of this form can be used to augment data sets for various NLP tasks such as machine reading comprehension and question answering with non-trivial negative examples. In this article, we propose a deep variational model to generate paraphrases conditioned on a label that specifies whether the paraphrases are semantically related or not. We also present new training recipes and KL regularization techniques that improve the performance of variational paraphrasing models. Our proposed model demonstrates promising results in enhancing the generative power of the model by employing label-dependent generation on paraphrasing datasets.


title: OGLE-2016-BLG-1227L: A Wide-separation Planet from a Very Short-timescale Microlensing Event

abstract: We present the analysis of the microlensing event OGLE-2016-BLG-1227. The light curve of this short-duration event appears to be a single-lens event affected by severe finite-source effects. Analysis of the light curve based on single-lens single-source (1L1S) modeling yields very small values of the event timescale, $t_{\rm E}\sim 3.5$ days, and the angular Einstein radius, $\theta_{\rm E}\sim 0.009$ mas, making the lens a candidate of a free-floating planet. Close inspection reveals that the 1L1S solution leaves small residuals with amplitude $\Delta I\lesssim 0.03$ mag. We find that the residuals are explained by the existence of an additional widely-separated heavier lens component, indicating that the lens is a wide-separation planetary system rather than a free-floating planet. From Bayesian analysis, it is estimated that the planet has a mass of $M_{\rm p} = 0.79^{+1.30}_{-0.39} M_{\rm J}$ and it is orbiting a low-mass host star with a mass of $M_{\rm host}=0.10^{+0.17}_{-0.05} M_\odot$ located with a projected separation of $a_\perp=3.4^{+2.1}_{-1.0}$ au. The planetary system is located in the Galactic bulge with a line-of-sight separation from the source star of $D_{\rm LS}=1.21^{+0.96}_{-0.63}$ kpc. The event shows that there are a range of deviations in the signatures of host stars for apparently isolated planetary lensing events and that it is possible to identify a host even when a deviation is subtle.


title: The Pan-Pacific Planet Search. VIII. Complete results and the occurrence rate of planets around low-luminosity giants

abstract: Our knowledge of the populations and occurrence rates of planets orbiting evolved intermediate-mass stars lags behind that for solar-type stars by at least a decade. Some radial velocity surveys have targeted these low-luminosity giant stars, providing some insights into the properties of their planetary systems. Here we present the final data release of the Pan-Pacific Planet Search, a 5-year radial velocity survey using the 3.9m Anglo-Australian Telescope. We present 1293 precise radial velocity measurements for 129 stars, and highlight six potential substellar-mass companions which require additional observations to confirm. Correcting for the substantial incompleteness in the sample, we estimate the occurrence rate of giant planets orbiting low-luminosity giant stars to be approximately 7.8$^{+9.1}_{-3.3}$\%. This result is consistent with the frequency of such planets found to orbit main-sequence A-type stars, from which the PPPS stars have evolved.


title: H\"olderian error bounds and Kurdyka-{\L}ojasiewicz inequality for the trust region subproblem

abstract: In this paper, we study the local variational geometry of the optimal solution set of the trust region subproblem (TRS), which minimizes a general, possibly nonconvex, quadratic function over the unit ball. Specifically, we demonstrate that a H\"olderian error bound holds globally for the TRS with modulus 1/4 and the Kurdyka-{\L}ojasiewicz (KL) inequality holds locally for the TRS with a KL exponent 3/4 at any optimal solution. We further prove that unless in a special case, the H\"olderian error bound modulus, as well as the KL exponent, is 1/2. Finally, based on the obtained KL property, we further show that the projected gradient methods studied in [A. Beck and Y. Vaisbourd, SIAM J. Optim., 28 (2018), pp. 1951--1967] for solving the TRS achieve a sublinear or even linear rate of convergence.


title: Universal Relation Between Thermodynamic Driving Force and One-Way Fluxes in a Nonequilibrium Chemical Reaction with Complex Mechanism

abstract: In nonequilibrium chemical reaction systems, a fundamental relationship between unbalanced kinetic one-way fluxes and thermodynamic chemical driving forces is believed to exists. However this relation has been rigorously demonstrated only in a few cases in which one-way fluxes are well defined. In terms of its stochastic kinetic representation, we formulate the one-way fluxes for a general chemical reaction far from equilibrium, with arbitrary complex mechanisms, multiple intermediates, and internal kinetic cycles. For each kinetic cycle, the logarithm of the ratio of the steady-state forward and backward one-way fluxes is equal to the free energy difference between the reactants and products along the cycle. This fundamental relation is further established for general chemical reaction networks with multiple input and output complexes. Our result not only provides an equivalent definition of free energy difference in nonequilibrium chemical reaction networks, it also unifies the stochastic and macroscopic nonequilibrium chemical thermodynamics in a very broad sense.


title: Free boundary problems with nonlocal and local diffusions II: Spreading-vanishing and long-time behavior

abstract: This is part II of our study on the free boundary problems with nonlocal and local diffusions. In part I, we obtained the existence, uniqueness, regularity and estimates of global solution. In part II here, we show a spreading-vanishing dichotomy, and provide the criteria of spreading and vanishing, as well as the long time behavior of solution when spreading happens.


title: Multiscale modeling meets machine learning: What can we learn?

abstract: Machine learning is increasingly recognized as a promising technology in the biological, biomedical, and behavioral sciences. There can be no argument that this technique is incredibly successful in image recognition with immediate applications in diagnostics including electrophysiology, radiology, or pathology, where we have access to massive amounts of annotated data. However, machine learning often performs poorly in prognosis, especially when dealing with sparse data. This is a field where classical physics-based simulation seems to remain irreplaceable. In this review, we identify areas in the biomedical sciences where machine learning and multiscale modeling can mutually benefit from one another: Machine learning can integrate physics-based knowledge in the form of governing equations, boundary conditions, or constraints to manage ill-posted problems and robustly handle sparse and noisy data; multiscale modeling can integrate machine learning to create surrogate models, identify system dynamics and parameters, analyze sensitivities, and quantify uncertainty to bridge the scales and understand the emergence of function. With a view towards applications in the life sciences, we discuss the state of the art of combining machine learning and multiscale modeling, identify applications and opportunities, raise open questions, and address potential challenges and limitations. We anticipate that it will stimulate discussion within the community of computational mechanics and reach out to other disciplines including mathematics, statistics, computer science, artificial intelligence, biomedicine, systems biology, and precision medicine to join forces towards creating robust and efficient models for biological systems.


title: Characterising the Structure of Halo Merger Trees Using a Single Parameter: The Tree Entropy

abstract: Linking the properties of galaxies to the assembly history of their dark matter haloes is a central aim of galaxy evolution theory. This paper introduces a dimensionless parameter $s\in[0,1]$, the "tree entropy", to parametrise the geometry of a halo's entire mass assembly hierarchy, building on a generalisation of Shannon's information entropy. By construction, the minimum entropy ($s=0$) corresponds to smoothly assembled haloes without any mergers. In contrast, the highest entropy ($s=1$) represents haloes grown purely by equal-mass binary mergers. Using simulated merger trees extracted from the cosmological $N$-body simulation SURFS, we compute the natural distribution of $s$, a skewed bell curve peaking near $s=0.4$. This distribution exhibits weak dependences on halo mass $M$ and redshift $z$, which can be reduced to a single dependence on the relative peak height $\delta_{\rm c}/\sigma(M,z)$ in the matter perturbation field. By exploring the correlations between $s$ and global galaxy properties generated by the SHARK semi-analytic model, we find that $s$ contains a significant amount of information on the morphology of galaxies $-$ in fact more information than the spin, concentration and assembly time of the halo. Therefore, the tree entropy provides an information-rich link between galaxies and their dark matter haloes.


title: LucidDream: Controlled Temporally-Consistent DeepDream on Videos

abstract: In this work, we aim to propose a set of techniques to improve the controllability and aesthetic appeal when DeepDream, which uses a pre-trained neural network to modify images by hallucinating objects into them, is applied to videos. In particular, we demonstrate a simple modification that improves control over the class of object that DeepDream is induced to hallucinate. We also show that the flickering artifacts which frequently appear when DeepDream is applied on videos can be mitigated by the use of an additional temporal consistency loss term.


title: AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization

abstract: The point process is a solid framework to model sequential data, such as videos, by exploring the underlying relevance. As a challenging problem for high-level video understanding, weakly supervised action recognition and localization in untrimmed videos has attracted intensive research attention. Knowledge transfer by leveraging the publicly available trimmed videos as external guidance is a promising attempt to make up for the coarse-grained video-level annotation and improve the generalization performance. However, unconstrained knowledge transfer may bring about irrelevant noise and jeopardize the learning model. This paper proposes a novel adaptability decomposing encoder-decoder network to transfer reliable knowledge between trimmed and untrimmed videos for action recognition and localization via bidirectional point process modeling, given only video-level annotations. By decomposing the original features into domain-adaptable and domain-specific ones based on their adaptability, trimmed-untrimmed knowledge transfer can be safely confined within a more coherent subspace. An encoder-decoder based structure is carefully designed and jointly optimized to facilitate effective action classification and temporal localization. Extensive experiments are conducted on two benchmark datasets (i.e., THUMOS14 and ActivityNet1.3), and experimental results clearly corroborate the efficacy of our method.


title: Approximating Permanent of Random Matrices with Vanishing Mean: Made Better and Simpler

abstract: The algorithm and complexity of approximating the permanent of a matrix is an extensively studied topic. Recently, its connection with quantum supremacy and more specifically BosonSampling draws special attention to the average-case approximation problem of the permanent of random matrices with zero or small mean value for each entry. Eldar and Mehraban (FOCS 2018) gave a quasi-polynomial time algorithm for random matrices with mean at least $1/\mathbf{\mathrm{polyloglog}} (n)$. In this paper, we improve the result by designing a deterministic quasi-polynomial time algorithm and a PTAS for random matrices with mean at least $1/\mathbf{\mathrm{polylog}}(n)$. We note that if it can be further improved to $1/\mathbf{\mathrm{poly}}(n)$, it will disprove a central conjecture for quantum supremacy. Our algorithm is also much simpler and has a better and flexible trade-off for running time. The running time can be quasi-polynomial in both $n$ and $1/\epsilon$, or PTAS (polynomial in $n$ but exponential in $1/\epsilon$), where $\epsilon$ is the approximation parameter.


title: Group topologies on integers and S-unit equations

abstract: A sequence of integers $ \{ s_n \}_{n \in \mathbb{N}} $ is called a T-sequence if there exists a Hausdorff group topology on $ \mathbb{Z} $ such that $ \{ s_n \}_{n \in \mathbb{N}} $ converges to zero. For every finite set of primes $ S $ we build a Hausdorff group topology on $ \mathbb{Z} $ such that every growing sequence of $ S $-integers converges to zero. As a corollary, we solve in the affirmative an open problem by I.V. Protasov and E.G. Zelenuk asking if $ \{ 2^n + 3^n \}_{n \in \mathbb{N}} $ is a T-sequence. Our results rely on a nontrivial number-theoretic fact about $ S $-unit equations.


title: Strongly irreducible Heegaard splittings of hyperbolic 3-manifolds

abstract: Colding and Gabai have given an effective version of Li's theorem that non-Haken hyperbolic 3-manifolds have finitely many irreducible Heegaard splittings. As a corollary of their work, we show that Haken hyperbolic 3-manifolds have a finite collection of strongly irreducible Heegaard surfaces $S_i$ and incompressible surfaces $K_j$ such that any strongly irreducible Heegaard surface is a Haken sum $S_i + \sum_j n_j K_j$, up to one-sided associates of the Heegaard surfaces.


title: Embedded multilevel Monte Carlo for uncertainty quantification in random domains

abstract: The multilevel Monte Carlo (MLMC) method has proven to be an effective variance-reduction statistical method for Uncertainty quantification in PDE models. It combines approximations at different levels of accuracy using a hierarchy of meshes in a similar way as multigrid. The generation of body-fitted mesh hierarchies is only possible for simple geometries. On top of that, MLMC for random domains involves the generation of a mesh for every sample. Instead, here we consider the use of embedded methods which make use of simple background meshes of an artificial domain (a bounding-box) for which it is easy to define a mesh hierarchy, thus eliminating the need of body-fitted unstructured meshes, but can produce ill-conditioned discrete problems. To avoid this complication, we consider the recent aggregated finite element method (AgFEM). In particular, we design an embedded MLMC framework for (geometrically and topologically) random domains implicitly defined through a random level-set function, which makes use of a set of hierarchical background meshes and the AgFEM. Performance predictions from existing theory are verified statistically in three numerical experiments, namely the solution of the Poisson equation on a circular domain of random radius, the solution of the Poisson equation on a topologically identical but more complex domain, and the solution of a heat-transfer problem in a domain that has geometric and topological uncertainties. Finally, the use of AgFE is statistically demonstrated to be crucial for complex and uncertain geometries in terms of robustness and computational cost.


title: A Survey of Mobile Edge Computing in the Industrial Internet

abstract: With the advent of a new round of the Industrial Revolution, the Industrial Internet will carry the convergence of heterogeneous network and the dynamic reconfiguration of industrial equipment. In order to further provide higher performance of network capabilities, the Industrial Internet has experienced unprecedented growth while facing enormous challenges from the actual needs of industrial networks. The typical scenarios in industrial applications, combined with the technical advantages of mobile edge computing, are described in view of the low latency, high bandwidth and high reliability demanded by the Industrial Internet in the new era. The key technologies of mobile edge computing for the Industrial Internet have been outlined in this treatise, whose feasibility and importance are demonstrated by typical industrial applications that have been deployed. As combined with the development trend of the Industrial Internet, this paper summarizes the existing work and discusses the future research direction of key technologies of mobile edge computing for the Industrial Internet.


title: Layer engineered interlayer excitons

abstract: Photoluminescence (PL) from excitons serves as a powerful tool to characterize the optoelectronic property and band structure of semiconductors, especially for atomically thin 2D transition metal chalcogenide (TMD) materials. However, PL quenches quickly when the thickness of TMD material increases from monolayer to few-layers, due to the change from direct to indirect band transition. Here we show that PL can be recovered by engineering multilayer heterostructures, with the band transition reserved to be direct type. We report emission from layer engineered interlayer excitons from these multilayer heterostructures. Moreover, as desired for valleytronic devices, the lifetime, valley polarization, and the valley lifetime of the generated interlayer excitons can all be significantly improved as compared with that in the monolayer-monolayer heterostructure. Our results pave the way for controlling the properties of interlayer excitons by layer engineering.


title: Observation of the Magnon Polarization

abstract: We measure the mode-resolved direction of the precessional motion of the magnetic order, i.e., magnon polarization, via the chiral term of inelastic polarized neutron scattering spectra. The magnon polarisation is important in spintronics, affecting thermodynamic properties such as the magnitude and sign of the spin Seebeck effect. The observation of both signs of magnon polarization in Y3Fe5O12 also gives direct proof of its ferrimagnetic nature. The experiments agree very well with atomistic simulations of the scattering cross section.


title: Signed harmonic sums of integers with $k$ distinct prime factors

abstract: We give some theoretical and computational results on "random" harmonic sums with prime numbers, and more generally, for integers with a fixed number of prime factors.


title: Graph Representation for Face Analysis in Image Collections

abstract: Given an image collection of a social event with a huge number of pictures, it is very useful to have tools that can be used to analyze how the individuals --that are present in the collection-- interact with each other. In this paper, we propose an optimal graph representation that is based on the `connectivity' of them. The connectivity of a pair of subjects gives a score that represents how `connected' they are. It is estimated based on co-occurrence, closeness, facial expressions, and the orientation of the head when they are looking to each other. In our proposed graph, the nodes represent the subjects of the collection, and the edges correspond to their connectivities. The location of the nodes is estimated according to their connectivity (the closer the nodes, the more connected are the subjects). Finally, we developed a graphical user interface in which we can click onto the nodes (or the edges) to display the corresponding images of the collection in which the subject of the nodes (or the connected subjects) are present. We present relevant results by analyzing a wedding celebration, a sitcom video, a volleyball game and images extracted from Twitter given a hashtag. We believe that this tool can be very helpful to detect the existing social relations in an image collection.


title: With or without replacement? Sampling uncertainty in Shepp's urn scheme

abstract: We introduce a variant of Shepp's classical urn problem in which the optimal stopper does not know whether sampling from the urn is done with or without replacement. By considering the problem's continuous-time analog, we provide bounds on the value function and in the case of a balanced urn (with an equal number of each ball type) an explicit solution is found. Surprisingly, the optimal strategy for the balanced urn is the same as in the classical urn problem.


title: Adversarial Deep Reinforcement Learning based Adaptive Moving Target Defense

abstract: Moving target defense (MTD) is a proactive defense approach that aims to thwart attacks by continuously changing the attack surface of a system (e.g., changing host or network configurations), thereby increasing the adversary's uncertainty and attack cost. To maximize the impact of MTD, a defender must strategically choose when and what changes to make, taking into account both the characteristics of its system as well as the adversary's observed activities. Finding an optimal strategy for MTD presents a significant challenge, especially when facing a resourceful and determined adversary who may respond to the defender's actions. In this paper, we propose a multi-agent partially-observable Markov Decision Process model of MTD and formulate a two-player general-sum game between the adversary and the defender. Based on an established model of adaptive MTD, we propose a multi-agent reinforcement learning framework based on the double oracle algorithm to solve the game. In the experiments, we show the effectiveness of our framework in finding optimal policies.


title: A Most Irrational Foraging Algorithm

abstract: We present a foraging algorithm, GoldenFA, in which search direction is chosen based on the Golden Ratio. We show both theoretically and empirically that GoldenFA is more efficient for a single searcher than a comparable algorithm where search direction is chosen uniformly at random. Moreover, we give a variant of our algorithm that parallelizes linearly with the number of searchers.


title: On the Minimal Set of Inputs Required for Efficient Neuro-Evolved Foraging

abstract: In this paper, we perform an ablation study of \neatfa, a neuro-evolved foraging algorithm that has recently been shown to forage efficiently under different resource distributions. Through selective disabling of input signals, we identify a \emph{sufficiently} minimal set of input features that contribute the most towards determining search trajectories which favor high resource collection rates. Our experiments reveal that, independent of how the resources are distributed in the arena, the signals involved in imparting the controller the ability to switch from searching of resources to transporting them back to the nest are the most critical. Additionally, we find that pheromones play a key role in boosting performance of the controller by providing signals for informed locomotion in search for unforaged resources.


title: Inclination Dependence of The Time-Lag -- Photon-Index Correlation in BHXRBs and its Explanation with a Simple Jet Model

abstract: Recently, we reported an observational correlation between a) the time-lag of the hard (9 - 15 keV) with respect to the soft (2 - 5 keV) X-ray photons in black-hole X-ray binaries (BHXRBs) and b) the power-law photon index $\Gamma$ of the X-ray spectrum. This was physically explained with a simple jet model, i.e., a model where the Comptonization (the Compton upscattering of soft photons) happens in the jet. Here, we report the inclination dependence of this correlation, which we also explain with our jet model. Photons that emerge at different polar angles from the jet axis have different spectra and different time-lags. Because of this, we can explain quantitatively the type-B QPOs of GX 339-4 as resulting from a precessing jet.


title: An Efficient Machine Learning-based Elderly Fall Detection Algorithm

abstract: Falling is a commonly occurring mishap with elderly people, which may cause serious injuries. Thus, rapid fall detection is very important in order to mitigate the severe effects of fall among the elderly people. Many fall monitoring systems based on the accelerometer have been proposed for the fall detection. However, many of them mistakenly identify the daily life activities as fall or fall as daily life activity. To this aim, an efficient machine learning-based fall detection algorithm has been proposed in this paper. The proposed algorithm detects fall with efficient sensitivity, specificity, and accuracy as compared to the state-of-the-art techniques. A publicly available dataset with a very simple and computationally efficient set of features is used to accurately detect the fall incident. The proposed algorithm reports and accuracy of 99.98% with the Support Vector Machine(SVM) classifier.


title: Replica wormholes and the black hole interior

abstract: Recent work has shown how to obtain the Page curve of an evaporating black hole from holographic computations of entanglement entropy. We show how these computations can be justified using the replica trick, from geometries with a spacetime wormhole connecting the different replicas. In a simple model, we study the Page transition in detail by summing replica geometries with different topologies. We compute related quantities in less detail in more complicated models, including JT gravity coupled to conformal matter and the SYK model. Separately, we give a direct gravitational argument for entanglement wedge reconstruction using an explicit formula known as the Petz map; again, a spacetime wormhole plays an important role. We discuss an interpretation of the wormhole geometries as part of some ensemble average implicit in the gravity description.


title: Non-Hermitian Floquet topological superconductors with multiple Majorana edge modes

abstract: Majorana edge modes are candidate elements of topological quantum computing. In this work, we purpose a Floquet engineering approach to generate arbitrarily many non-Hermitian Majorana zero and $\pi$ modes at the edges of a one-dimensional topological superconductor. Focusing on a Kitaev chain with periodically kicked superconducting pairings and gain/losses in the chemical potential or nearest neighbor hopping terms, we found rich non-Hermitian Floquet topological superconducting phases, which are originated from the interplay between drivings and non-Hermitian effects. Each of the phases is characterized by a pair of topological winding numbers, which can in principle take arbitrarily large integer values thanks to the applied driving fields. Under open boundary conditions, these winding numbers also predict the number of degenerate Majorana edge modes with quasienergies zero and $\pi$. Our findings thus expand the family of Floquet topological phases in non-Hermitian settings, with potential applications in realizing environmentally robust Floquet topological quantum computations.


title: The spectrum of an operator associated with $G_{2}-$instantons with $1-$dimensional singularities and Hermitian Yang-Mills connections with isolated singularities

abstract: This is the first step in an attempt at a deformation theory for $G_{2}-$instantons with $1-$dimensional conic singularities. Under a set of model data, the linearization yields a self-adjoint first order elliptic operator $P$ on a certain bundle over $\mathbb{S}^{5}$. As a dimension reduction, the operator $P$ also arises from Hermitian Yang-Mills connections with isolated conic singularities on a Calabi-Yau $3$-fold. Using the Quaternion structure in the Sasakian geometry of $\mathbb{S}^{5}$, we describe the set of all eigenvalues of $P$ (denoted by $Spec P$). We show that $SpecP$ consists of finitely many integers induced by certain sheaf cohomologies on $\mathbb{P}^{2}$, and infinitely many real numbers induced by the spectrum of the rough Laplacian on the pullback endomorphism bundle over $\mathbb{S}^{5}$. The multiplicities and the form of an eigensection can be described fairly explicitly. Using the representation theory of $SU(3)$ and the subgroup $S[U(1)\times U(2)]$, we show an example in which $SpecP$ and the multiplicities can be completely determined.


title: Probes of holographic thermalization in a simple model with momentum relaxation

abstract: From the viewpoint of AdS/CFT correspondence, we investigate the holographic thermalization process in a four dimensional Einstein-Maxwell-axions gravity theory, which is considered as a simple bulk theory dual to a boundary theory with momentum relaxation. We probe the thermalization process using the equal time two-point functions and the entanglement entropy with the circle profile. We analyze the effects of momentum relaxation on the process in details and results show that the momentum relaxation gives longer thermalization time, which means it suppresses the holographic thermalization process. This matches the properties of the quasi-normal frequencies for the bulk fluctuations which the frequency violates from zero mode more profoundly for stronger momentum relaxation. We claim that is reasonable because the decay of the bulk fluctuations holographically describes the approach to thermal equilibrium in the dual theory.


title: Class-Conditional Domain Adaptation on Semantic Segmentation

abstract: Semantic segmentation is an important sub-task for many applications, but pixel-level ground truth labeling is costly and there is a tendency to overfit the training data, limiting generalization. Unsupervised domain adaptation can potentially address these problems, allowing systems trained on labelled datasets from one or more source domains (including less expensive synthetic domains) to be adapted to novel target domains. The conventional approach is to automatically align the representational distributions of source and target domains. One limitation of this approach is that it tends to disadvantage lower probability classes. We address this problem by introducing a Class-Conditional Domain Adaptation method (CCDA). It includes a class-conditional multi-scale discriminator and the class-conditional loss. This novel CCDA method encourages the network to shift the domain in a class-conditional manner, and it equalizes loss over classes. We evaluate our CCDA method on two transfer tasks and demonstrate performance comparable to state-of-the-art methods.


title: Quantum thermodynamic uncertainty relation for continuous measurement

abstract: We use quantum estimation theory to derive a thermodynamic uncertainty relation in Markovian open quantum systems, which bounds the fluctuation of continuous measurements. The derived quantum thermodynamic uncertainty relation holds for arbitrary continuous measurements satisfying a scaling condition. We derive two relations; the first relation bounds the fluctuation by the dynamical activity and the second one does so by the entropy production. We apply our bounds to a two-level atom driven by a laser field and a three-level quantum thermal machine with jump and diffusion measurements. Our result shows that there exists a universal bound upon the fluctuations, regardless of continuous measurements.


title: Benefits of Jointly Training Autoencoders: An Improved Neural Tangent Kernel Analysis

abstract: A remarkable recent discovery in machine learning has been that deep neural networks can achieve impressive performance (in terms of both lower training error and higher generalization capacity) in the regime where they are massively over-parameterized. Consequently, over the past year, the community has devoted growing interest in analyzing optimization and generalization properties of over-parameterized networks, and several breakthrough works have led to important theoretical progress. However, the majority of existing work only applies to supervised learning scenarios and hence are limited to settings such as classification and regression. In contrast, the role of over-parameterization in the unsupervised setting has gained far less attention. In this paper, we study the gradient dynamics of two-layer over-parameterized autoencoders with ReLU activation. We make very few assumptions about the given training dataset (other than mild non-degeneracy conditions). Starting from a randomly initialized autoencoder network, we rigorously prove the linear convergence of gradient descent in two learning regimes, namely: (i) the weakly-trained regime where only the encoder is trained, and (ii) the jointly-trained regime where both the encoder and the decoder are trained. Our results indicate the considerable benefits of joint training over weak training for finding global optima, achieving a dramatic decrease in the required level of over-parameterization. We also analyze the case of weight-tied autoencoders (which is a commonly used architectural choice in practical settings) and prove that in the over-parameterized setting, training such networks from randomly initialized points leads to certain unexpected degeneracies.


title: SAG-VAE: End-to-end Joint Inference of Data Representations and Feature Relations

abstract: Variational Autoencoders (VAEs) are powerful in data representation inference, but it cannot learn relations between features with its vanilla form and common variations. The ability to capture relations within data can provide the much needed inductive bias necessary for building more robust Machine Learning algorithms with more interpretable results. In this paper, inspired by recent advances in relational learning using Graph Neural Networks, we propose the Self-Attention Graph Variational AutoEncoder (SAG-VAE) network which can simultaneously learn feature relations and data representations in an end-to-end manner. SAG-VAE is trained by jointly inferring the posterior distribution of two types of latent variables, which denote the data representation and a shared graph structure, respectively. Furthermore, we introduce a novel self-attention graph network that improves the generative capabilities of SAG-VAE by parameterizing the generative distribution allowing SAG-VAE to generate new data via graph convolution, while still trainable via backpropagation. A learnable relational graph representation enhances SAG-VAE's robustness to perturbation and noise, while also providing deeper intuition into model performance. Experiments based on graphs show that SAG-VAE is capable of approximately retrieving edges and links between nodes based entirely on feature observations. Finally, results on image data illustrate that SAG-VAE is fairly robust against perturbations in image reconstruction and sampling.


title: Semantic Head Enhanced Pedestrian Detection in a Crowd

abstract: Pedestrian detection in the crowd is a challenging task because of intra-class occlusion. More prior information is needed for the detector to be robust against it. Human head area is naturally a strong cue because of its stable appearance, visibility and relative location to body. Inspired by it, we adopt an extra branch to conduct semantic head detection in parallel with traditional body branch. Instead of manually labeling the head regions, we use weak annotations inferred directly from body boxes, which is named as `semantic head'. In this way, the head detection is formulated into using a special part of labeled box to detect the corresponding part of human body, which surprisingly improves the performance and robustness to occlusion. Moreover, the head-body alignment structure is explicitly explored by introducing Alignment Loss, which functions in a self-supervised manner. Based on these, we propose the head-body alignment net (HBAN) in this work, which aims to enhance pedestrian detection by fully utilizing the human head prior. Comprehensive evaluations are conducted to demonstrate the effectiveness of HBAN on CityPersons dataset.


title: Floquet Anderson Localization of Two Interacting Discrete Time Quantum Walks

abstract: We study the interplay of two interacting discrete time quantum walks in the presence of disorder. Each walk is described by a Floquet unitary map defined on a chain of two-level systems. Strong disorder induces a novel Anderson localization phase with a gapless Floquet spectrum and one unique localization length $\xi_1$ for all eigenstates for noninteracting walks. We add a local contact interaction which is parametrized by a phase shift $\gamma$. A wave packet is spreading subdiffusively beyond the bounds set by $\xi_1$ and saturates at a new length scale $\xi_2 \gg \xi_1$. In particular we find $\xi_2 \sim \xi_1^{1.2}$ for $\gamma=\pi$. We observe a nontrivial dependence of $\xi_2$ on $\gamma$, with a maximum value observed for $\gamma$-values which are shifted away from the expected strongest interaction case $\gamma=\pi$. The novel Anderson localization regime violates single parameter scaling for both interacting and noninteracting walks.


title: Nonlinear optical response properties of a quantum dot embedded in a semiconductor microcavity : possible applications in quantum communication platforms

abstract: We theoretically investigate optical bistability, mechanically induced absorption (MIA) and Fano resonance of a hybrid system comprising of a single quantum dot (QD) embedded in a solid state microcavity interacting with the quantized cavity mode and the deformation potential associated with the lattice vibration. We find that the bistability can be tuned by the QD-cavity mode coupling. We further show that the normalized power transmission displays anomalous dispersion indicating that the system can be used to generate slow light. We also demonstrate the possibility of using the system as all optomechanical Kerr switch.


title: GRIm-RePR: Prioritising Generating Important Features for Pseudo-Rehearsal

abstract: Pseudo-rehearsal allows neural networks to learn a sequence of tasks without forgetting how to perform in earlier tasks. Preventing forgetting is achieved by introducing a generative network which can produce data from previously seen tasks so that it can be rehearsed along side learning the new task. This has been found to be effective in both supervised and reinforcement learning. Our current work aims to further prevent forgetting by encouraging the generator to accurately generate features important for task retention. More specifically, the generator is improved by introducing a second discriminator into the Generative Adversarial Network which learns to classify between real and fake items from the intermediate activation patterns that they produce when fed through a continual learning agent. Using Atari 2600 games, we experimentally find that improving the generator can considerably reduce catastrophic forgetting compared to the standard pseudo-rehearsal methods used in deep reinforcement learning. Furthermore, we propose normalising the Q-values taught to the long-term system as we observe this substantially reduces catastrophic forgetting by minimising the interference between tasks' reward functions.


title: A wide star-black-hole binary system from radial-velocity measurements

abstract: All stellar mass black holes have hitherto been identified by X-rays emitted by gas that is accreting onto the black hole from a companion star. These systems are all binaries with black holes below 30 M$_{\odot}$$^{1-4}$. Theory predicts, however, that X-ray emitting systems form a minority of the total population of star-black hole binaries$^{5,6}$. When the black hole is not accreting gas, it can be found through radial velocity measurements of the motion of the companion star. Here we report radial velocity measurements of a Galactic star, LB-1, which is a B-type star, taken over two years. We find that the motion of the B-star and an accompanying H$\alpha$ emission line require the presence of a dark companion with a mass of $68^{+11}_{-13}$ M$_{\odot}$, which can only be a black hole. The long orbital period of 78.9 days shows that this is a wide binary system. The gravitational wave experiments have detected similarly massive black holes$^{7,8}$, but forming such massive ones in a high-metallicity environment would be extremely challenging to current stellar evolution theories$^{9-11}$.


title: Cosmic Censorship and the Evolution of d-Dimensional Charged Evaporating Black Holes

abstract: The cosmic censorship conjecture essentially states that naked singularities should not form from generic initial conditions. Since black hole parameters can change their values under Hawking evaporation, one has to ask whether it is possible to reach extremality by simply waiting for the black hole to evaporate. If so a slight perturbation would likely render the singularity naked. Fortunately, at least for the case of asymptotically flat 4-dimensional Reissner-Nordstr\"om black hole, Hiscock and Weems showed that it can never reach extremality despite the fact that for a sufficiently massive black hole, its charge-to-mass ratio can increase during Hawking evaporation. Hence cosmic censorship is never violated by Hawking emission. However, we know that under some processes, it is easier to violate cosmic censorship in higher dimensions, therefore it is crucial to generalize Hiscock and Weems model to dimensions above four to check cosmic censorship. We found that Hawking evaporation cannot lead to violation of cosmic censorship even in higher dimensional Reissner-Nordstr\"om spacetimes. Morerover, it seems to be more difficult to reach extremality as number of dimension increases.


title: A selected review on reinforcement learning based control for autonomous underwater vehicles

abstract: Recently, reinforcement learning (RL) has been extensively studied and achieved promising results in a wide range of control tasks. Meanwhile, autonomous underwater vehicle (AUV) is an important tool for executing complex and challenging underwater tasks. The advances in RL offers ample opportunities for developing intelligent AUVs. This paper provides a selected review on RL based control for AUVs with the focus on applications of RL to low-level control tasks for underwater regulation and tracking. To this end, we first present a concise introduction to the RL based control framework. Then, we provide an overview of RL methods for AUVs control problems, where the main challenges and recent progresses are discussed. Finally, two representative cases of RL-based controllers are given in detail for the model-free RL methods on AUVs.


title: Composition operators on reproducing kernel Hilbert spaces with analytic positive definite functions

abstract: In this paper, we specify what functions induce the bounded composition operators on a reproducing kernel Hilbert space (RKHS) associated with an analytic positive definite function defined on $\mathbf{R}^d$. We prove that only affine transforms can do so in a pretty large class of RKHS. Our result covers not only the Paley-Wiener space on the real line, studied in previous works, but also much more general RKHSs corresponding to analytic positive definite functions where existing methods do not work. Our method only relies on an intrinsic properties of the RKHSs, and we establish a connection between the behavior of composition operators and the asymptotic properties of the greatest zeros of orthogonal polynomials on a weighted $L^2$-spaces on the real line. We also investigate the compactness of the composition operators and show that any bounded composition operators cannot be compact in our situation.


title: A race-DC in Big Data

abstract: The strategy of divide-and-combine (DC) has been widely used in the area of big data. Bias-correction is crucial in the DC procedure for validly aggregating the locally biased estimators, especial for the case when the number of batches of data is large. This paper establishes a race-DC through a residual-adjustment composition estimate (race). The race-DC applies to various types of biased estimators, which include but are not limited to Lasso estimator, Ridge estimator and principal component estimator in linear regression, and least squares estimator in nonlinear regression. The resulting global estimator is strictly unbiased under linear model, and is acceleratingly bias-reduced in nonlinear model, and can achieve the theoretical optimality, for the case when the number of batches of data is large. Moreover, the race-DC is computationally simple because it is a least squares estimator in a pro forma linear regression. Detailed simulation studies demonstrate that the resulting global estimator is significantly bias-corrected, and the behavior is comparable with the oracle estimation and is much better than the competitors.


title: New narrow LHCb pentaquarks as lowest antiquark-diquark-diquark systems

abstract: The antiquark-diquark-diquark model describes pentaquark states both in terms of quarks and hadrons. We discuss pentaquark states with hidden charm $P(\bar c cuud)$ discovered in the $J/\Psi p$ spectrum by the LHCb collaboration. We consider three pentaquark states as members of the lowest ($S$-wave) multiplet and discuss the mass splitting scheme. The latest LHCb data for pentaquarks with hidden charm provide an opportunity to make an assumption about the diquark content of the pentaquark states. We give a classification for the LHCb pentaquarks and define recombination channels for these states.


title: BLAS: Broadcast Relative Localization and Clock Synchronization for Dynamic Dense Multi-Agent Systems

abstract: The spatiotemporal information plays crucial roles in a multi-agent system (MAS). However, for a highly dynamic and dense MAS in unknown environments, estimating its spatiotemporal states is a difficult problem. In this paper, we present BLAS: a wireless broadcast relative localization and clock synchronization system to address these challenges. Our BLAS system exploits a broadcast architecture, under which a MAS is categorized into parent agents that broadcast wireless packets and child agents that are passive receivers, to reduce the number of required packets among agents for relative localization and clock synchronization. We first propose an asynchronous broadcasting and passively receiving (ABPR) protocol. The protocol schedules the broadcast of parent agents using a distributed time division multiple access (D-TDMA) scheme and delivers inter-agent information used for joint relative localization and clock synchronization. We then present distributed state estimation approaches in parent and child agents that utilize the broadcast inter-agent information for joint estimation of spatiotemporal states. The simulations and real-world experiments based on ultra-wideband (UWB) illustrate that our proposed BLAS cannot only enable accurate, high-frequency and real-time estimation of relative position and clock parameters but also support theoretically an unlimited number of agents.


title: Existence and uniqueness of global Koopman eigenfunctions for stable fixed points and periodic orbits

abstract: We consider $C^1$ dynamical systems having an attracting hyperbolic fixed point or periodic orbit and prove existence and uniqueness results for $C^k$ (actually $C^{k,\alpha}_{\text{loc}}$) linearizing semiconjugacies -- of which Koopman eigenfunctions are a special case -- defined on the entire basin of attraction. Our main results both generalize and sharpen Sternberg's $C^k$ linearization theorem for hyperbolic sinks, and in particular our corollaries include uniqueness statements for Sternberg linearizations and Floquet normal forms. Using our main results we also prove new existence and uniqueness statements for $C^k$ Koopman eigenfunctions, including a complete classification of $C^\infty$ eigenfunctions assuming a $C^\infty$ dynamical system with semisimple and nonresonant linearization. We give an intrinsic definition of "principal Koopman eigenfunctions" which generalizes the definition of Mohr and Mezi\'{c} for linear systems, and which includes the notions of "isostables" and "isostable coordinates" appearing in work by Ermentrout, Mauroy, Mezi\'{c}, Moehlis, Wilson, and others. Our main results yield existence and uniqueness theorems for the principal eigenfunctions and isostable coordinates and also show, e.g., that the (a priori non-unique) "pullback algebra" defined in \cite{mohr2016koopman} is unique under certain conditions. We also discuss the limit used to define the "faster" isostable coordinates in \cite{wilson2018greater,monga2019phase} in light of our main results.


title: SecureGBM: Secure Multi-Party Gradient Boosting

abstract: Federated machine learning systems have been widely used to facilitate the joint data analytics across the distributed datasets owned by the different parties that do not trust each others. In this paper, we proposed a novel Gradient Boosting Machines (GBM) framework SecureGBM built-up with a multi-party computation model based on semi-homomorphic encryption, where every involved party can jointly obtain a shared Gradient Boosting machines model while protecting their own data from the potential privacy leakage and inferential identification. More specific, our work focused on a specific "dual--party" secure learning scenario based on two parties -- both party own an unique view (i.e., attributes or features) to the sample group of samples while only one party owns the labels. In such scenario, feature and label data are not allowed to share with others. To achieve the above goal, we firstly extent -- LightGBM -- a well known implementation of tree-based GBM through covering its key operations for training and inference with SEAL homomorphic encryption schemes. However, the performance of such re-implementation is significantly bottle-necked by the explosive inflation of the communication payloads, based on ciphertexts subject to the increasing length of plaintexts. In this way, we then proposed to use stochastic approximation techniques to reduced the communication payloads while accelerating the overall training procedure in a statistical manner. Our experiments using the real-world data showed that SecureGBM can well secure the communication and computation of LightGBM training and inference procedures for the both parties while only losing less than 3% AUC, using the same number of iterations for gradient boosting, on a wide range of benchmark datasets.


title: Estimates of formal solutions for some generalized moment partial differential equations

abstract: Using increasing sequences of real numbers, we generalize the idea of formal moment differentiation first introduced by W. Balser and M. Yoshino. Slight departure from the concept of Gevrey sequences enables us to include a wide variety of operators in our study. Basing our approach on tools such as the Newton polygon and divergent formal norms, we obtain estimates for formal solutions of certain families of generalized linear moment partial differential equations with constant and time variable coefficients.


title: Recovering Facial Reflectance and Geometry from Multi-view Images

abstract: While the problem of estimating shapes and diffuse reflectances of human faces from images has been extensively studied, there is relatively less work done on recovering the specular albedo. This paper presents a lightweight solution for inferring photorealistic facial reflectance and geometry. Our system processes video streams from two views of a subject, and outputs two reflectance maps for diffuse and specular albedos, as well as a vector map of surface normals. A model-based optimization approach is used, consisting of the three stages of multi-view face model fitting, facial reflectance inference and facial geometry refinement. Our approach is based on a novel formulation built upon the 3D morphable model (3DMM) for representing 3D textured faces in conjunction with the Blinn-Phong reflection model. It has the advantage of requiring only a simple setup with two video streams, and is able to exploit the interaction between the diffuse and specular reflections across multiple views as well as time frames. As a result, the method is able to reliably recover high-fidelity facial reflectance and geometry, which facilitates various applications such as generating photorealistic facial images under new viewpoints or illumination conditions.


title: Monomial Rota-Baxter operators on free commutative non-unital algebra

abstract: A Rota-Baxter operator defined on the polynomial algebra is called monomial if it maps each monomial to a monomial with some coefficient. We classify monomial Rota-Baxter operators defined on the algebra of polynomials in one variable without constant term. We also describe injective monomial Rota--Baxter operators of nonzero weight on the algebra of polynomials in several variables without constant term.


title: A Convexification Approach for Small-Signal Stability Constrained Optimal Power Flow

abstract: In this paper, a novel convexification approach for Small-Signal Stability Constraint Optimal Power Flow (SSSC-OPF) has been presented that does not rely on eigenvalue analysis. The proposed methodology is based on the sufficient condition for the small-signal stability, developed as a Bilinear Matrix Inequality (BMI), and uses network structure-preserving Differential Algebraic Equation (DAE) modeling of the power system. The proposed formulation is based on Semi-definite Programming (SDP) and objective penalization that has been proposed for feasible solution recovery, making the method computationally efficient for large-scale systems. A vector-norm based objective penalty function has also been proposed for feasible solution recovery while working over large and dense BMIs with matrix variables. An effectiveness study carried out on WECC 9-bus, New England 39-bus, and IEEE 118-bus test systems show that the proposed method is capable of achieving a stable equilibrium point without inflicting a high stability-induced additional cost.


title: An adaptive well-balanced positivity preserving central-upwind scheme on quadtree grids for shallow water equations

abstract: We present an adaptive well-balanced positivity preserving central-upwind scheme on quadtree grids for shallow water equations. The use of quadtree grids results in a robust, efficient and highly accurate numerical method. The quadtree model is developed based on the well-balanced positivity preserving central-upwind scheme proposed in [A. Kurganov and G. Petrova, Commun. Math. Sci., 5 (2007), pp. 133--160]. The designed scheme is well-balanced in the sense that it is capable of exactly preserving "lake-at-rest" steady states. In order to achieve this as well as to preserve positivity of water depth, a continuous piecewise bilinear interpolation of the bottom topography function is utilized. This makes the proposed scheme capable of modelling flows over discontinuous bottom topography. Local gradients are examined to determine new seeding points in grid refinement for the next timestep. Numerical examples demonstrate the promising performance of the central-upwind quadtree scheme.


title: Measuring similarity between two mixture trees using mixture distance metric and algorithms

abstract: Ancestral mixture model, proposed by Chen and Lindsay (2006), is an important model to build a hierarchical tree from high dimensional binary sequences. Mixture trees created from ancestral mixture models involve in the inferred evolutionary relationships among various biological species. Moreover, it contains the information of time when the species mutates. Tree comparison metric, an essential issue in bioinformatics, is to measure the similarity between trees. However, to our knowledge, the approach to the comparison between two mixture trees is still under development. In this paper, we propose a new metric, named mixture distance metric, to measure the similarity of two mixture trees. It uniquely considers the factor of evolutionary times between trees. In addition, we also further develop two algorithms to compute the mixture distance between two mixture trees. One requires O(n^2) and the other requires O(nh) computation time with O(n) preprocessing time, where n denotes the number of leaves in the two mixture trees, and h denotes the minimum height of these two trees.


title: Schmidt's Game and Nonuniformly Expanding Interval Maps

abstract: We study Manneville-Pomeau maps on the unit interval and prove that the set of points whose forward orbits miss an interval with left endpoint 0 is strong winning for Schmidt's game. Strong winning sets are dense, have full Hausdorff dimension, and satisfy a countable intersection property. Similar results were known for certain expanding maps, but these did not address the nonuniformly expanding case. Our analysis is complicated by the presence of infinite distortion and unbounded geometry.


title: On popular sums and differences of sets with small products

abstract: Given a subset of real numbers $A$ with small product $AA$ we obtain a new upper bound for the additive energy of $A$. The proof uses a natural observation that level sets of convolutions of the characteristic function of $A$ have small product with $A$.


title: Characteristics Of Post Partum Perineum Wounds With Infra Red Therapy

abstract: Perineal wounds other than their localization in humid feminine areas and can pose a risk of infection. This quantitative study aims to see a description of the characteristics of post partum maternal perineal wounds with infrared therapy twice a day for three consecutive days with a descriptive analytic analysis design. Sample selection technique with purposive sampling in post partum mothers with spontaneous parturition, 1-2 degrees of perineal wounds in the amount of 20 people. Perineal wound characteristics were assessed and observed using the Southampton instrument with the results of the instrument trial r = 0.99 (Karl Pearson correlation coefficient), and the reliability value of 0.99 (brown spearman). The results of this study showed that degeneration of wounds was found only until the first day of post-intervention (1.95 ), poor wound regeneration occurred until the second day of pre-intervention (1.95), and wound regeneration was being encountered changes from the first day to the second day pre-intervention (1.05). These results indicate that infrared therapy does not show significant changes if only done for one day. Key Words: localization, parturition, regeneration


title: Weakly-Supervised Road Affordances Inference and Learning in Scenes without Traffic Signs

abstract: Road attributes understanding is extensively researched to support vehicle's action for autonomous driving, whereas current works mainly focus on urban road nets and rely much on traffic signs. This paper generalizes the same issue to the scenes with little or without traffic signs, such as campuses and residential areas. These scenes face much more individually diverse appearances while few annotated datasets. To explore these challenges, a weakly-supervised framework is proposed to infer and learn road affordances without manual annotation, which includes three attributes of drivable direction, driving attention center and remaining distance. The method consists of two steps: affordances inference from trajectory and learning from partially labeled data. The first step analyzes vehicle trajectories to get partial affordances annotation on image, and the second step implements a weakly-supervised network to learn partial annotation and predict complete road affordances while testing. Real-world datasets are collected to validate the proposed method which achieves 88.2%/80.9% accuracy on direction-level and 74.3% /66.7% accuracy on image-level in familiar and unfamiliar scenes respectively.


title: A tale of two toolkits, report the second: bake off redux. Chapter 1. dictionary based classifiers

abstract: Time series classification (TSC) is the problem of learning labels from time dependent data. One class of algorithms is derived from a bag of words approach. A window is run along a series, the subseries is shortened and discretised to form a word, then features are formed from the histogram of frequency of occurrence of words. We call this type of approach to TSC dictionary based classification. We compare four dictionary based algorithms in the context of a wider project to update the great time series classification bakeoff, a comparative study published in 2017. We experimentally characterise the algorithms in terms of predictive performance, time complexity and space complexity. We find that we can improve on the previous best in terms of accuracy, but this comes at the cost of time and space. Alternatively, the same performance can be achieved with far less cost. We review the relative merits of the four algorithms before suggesting a path to possible improvement.


title: Involution pipe dreams

abstract: Involution Schubert polynomials represent cohomology classes of $K$-orbit closures in the complete flag variety, where $K$ is the orthogonal or symplectic group. We show they also represent $T$-equivariant cohomology classes of subvarieties defined by upper-left rank conditions in the spaces of symmetric or skew-symmetric matrices. This geometry implies that these polynomials are positive combinations of monomials in the variables $x_i + x_j$, and we give explicit formulas of this kind as sums over new objects called involution pipe dreams. Our formulas are analogues of the Billey-Jockusch-Stanley formula for Schubert polynomials. In Knutson and Miller's approach to matrix Schubert varieties, pipe dream formulas reflect Gr\"obner degenerations of the ideals of those varieties, and we conjecturally identify analogous degenerations in our setting.


title: Unique continuation properties for one dimensional higher order Schr\"{o}dinger equations

abstract: We study two types of unique continuation properties for the higher order Schr\"{o}dinger equation with potential $$ i\partial_tu=(-\Delta_x)^mu+V(t,x)u,\quad(t,x)\in\mathbb{R}^{1+n},\,2\leq m\in\mathbb{N}_+. $$ The first one says if $u$ has certain exponential decay at two times, then $u\equiv0$, and this result is sharp by constructing critical non-trivial solutions. The second one says if $u\equiv0$ in an arbitrary half-space of $\mathbb{R}^{1+n}$, then $u\equiv0$ identically. The uniqueness theorems are given when $n=1$, but we also prove partial results when $n\in\mathbb{N}_+$ for their own interests. Possibility or obstacles to proving these unique continuation properties in higher spatial dimensions are also discussed.


title: JEC-QA: A Legal-Domain Question Answering Dataset

abstract: We present JEC-QA, the largest question answering dataset in the legal domain, collected from the National Judicial Examination of China. The examination is a comprehensive evaluation of professional skills for legal practitioners. College students are required to pass the examination to be certified as a lawyer or a judge. The dataset is challenging for existing question answering methods, because both retrieving relevant materials and answering questions require the ability of logic reasoning. Due to the high demand of multiple reasoning abilities to answer legal questions, the state-of-the-art models can only achieve about 28% accuracy on JEC-QA, while skilled humans and unskilled humans can reach 81% and 64% accuracy respectively, which indicates a huge gap between humans and machines on this task. We will release JEC-QA and our baselines to help improve the reasoning ability of machine comprehension models. You can access the dataset from http://jecqa.thunlp.org/.


title: Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awareness

abstract: We present Uncertainty-aware Cascaded Stereo Network (UCS-Net) for 3D reconstruction from multiple RGB images. Multi-view stereo (MVS) aims to reconstruct fine-grained scene geometry from multi-view images. Previous learning-based MVS methods estimate per-view depth using plane sweep volumes with a fixed depth hypothesis at each plane; this generally requires densely sampled planes for desired accuracy, and it is very hard to achieve high-resolution depth. In contrast, we propose adaptive thin volumes (ATVs); in an ATV, the depth hypothesis of each plane is spatially varying, which adapts to the uncertainties of previous per-pixel depth predictions. Our UCS-Net has three stages: the first stage processes a small standard plane sweep volume to predict low-resolution depth; two ATVs are then used in the following stages to refine the depth with higher resolution and higher accuracy. Our ATV consists of only a small number of planes; yet, it efficiently partitions local depth ranges within learned small intervals. In particular, we propose to use variance-based uncertainty estimates to adaptively construct ATVs; this differentiable process introduces reasonable and fine-grained spatial partitioning. Our multi-stage framework progressively subdivides the vast scene space with increasing depth resolution and precision, which enables scene reconstruction with high completeness and accuracy in a coarse-to-fine fashion. We demonstrate that our method achieves superior performance compared with state-of-the-art benchmarks on various challenging datasets.