title: An algebraically stable variety for a four-dimensional dynamical system reduced from the lattice super-KdV equation

abstract: In a prior paper the authors obtained a four-dimensional discrete integrable dynamical system by the traveling wave reduction from the lattice super-KdV equation in a case of finitely generated Grassmann algebra. The system is a coupling of a Quispel-Roberts-Thompson map and a linear map but does not satisfy the singularity confinement criterion. It was conjectured that the dynamical degree of this system grows quadratically. In this paper, constructing a rational variety where the system is lifted to an algebraically stable map and using the action of the map on the Picard lattice, we prove this conjecture. We also show that invariants can be found through the same technique.


title: A normality Criterion for a Family of Meromorphic Functions

abstract: Schwick, in [6], states that let $\mathcal{F}$ be a family of meromorphic functions on a domain $D$ and if for each $f\in\mathcal{F}$, $(f^n)^{(k)}\neq 1$, for $z\in D$, where $n, k$ are positive integers such that $n\geq k+3$, then $\mathcal{F}$ is a normal family in $D$. In this paper, we investigate the opposite view that if for each $f\in\mathcal{F}$, $(f^n)^{(k)}(z)-\psi(z)$ has zeros in $D$, where $\psi(z)$ is a holomorphic function in $D$, then what can be said about the normality of the family $\mathcal{F}$?


title: Question-type Driven Question Generation

abstract: Question generation is a challenging task which aims to ask a question based on an answer and relevant context. The existing works suffer from the mismatching between question type and answer, i.e. generating a question with type $how$ while the answer is a personal name. We propose to automatically predict the question type based on the input answer and context. Then, the question type is fused into a seq2seq model to guide the question generation, so as to deal with the mismatching problem. We achieve significant improvement on the accuracy of question type prediction and finally obtain state-of-the-art results for question generation on both SQuAD and MARCO datasets.


title: Deep Reinforcement Learning with Distributional Semantic Rewards for Abstractive Summarization

abstract: Deep reinforcement learning (RL) has been a commonly-used strategy for the abstractive summarization task to address both the exposure bias and non-differentiable task issues. However, the conventional reward Rouge-L simply looks for exact n-grams matches between candidates and annotated references, which inevitably makes the generated sentences repetitive and incoherent. In this paper, instead of Rouge-L, we explore the practicability of utilizing the distributional semantics to measure the matching degrees. With distributional semantics, sentence-level evaluation can be obtained, and semantically-correct phrases can also be generated without being limited to the surface form of the reference sentences. Human judgments on Gigaword and CNN/Daily Mail datasets show that our proposed distributional semantics reward (DSR) has distinct superiority in capturing the lexical and compositional diversity of natural language.


title: Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence Representations

abstract: Prior work on pretrained sentence embeddings and benchmarks focus on the capabilities of stand-alone sentences. We propose DiscoEval, a test suite of tasks to evaluate whether sentence representations include broader context information. We also propose a variety of training objectives that makes use of natural annotations from Wikipedia to build sentence encoders capable of modeling discourse. We benchmark sentence encoders pretrained with our proposed training objectives, as well as other popular pretrained sentence encoders on DiscoEval and other sentence evaluation tasks. Empirically, we show that these training objectives help to encode different aspects of information in document structures. Moreover, BERT and ELMo demonstrate strong performances over DiscoEval with individual hidden layers showing different characteristics.


title: V and heavy flavour production: status and recent theoretical developments

abstract: In this talk, we review the status of the associated production of a vector boson and heavy flavour quarks, and some recent theoretical developments. While some aspects of these multiscale processes are not yet completely under control, a general understanding on how to treat them is emerging, thanks to many efforts to match a completely massless, with a completely massive approach.


title: Searching for signs of jet-driven negative feedback in the nearby radio galaxy UGC 05771

abstract: Hydrodynamical simulations predict that the jets of young radio sources can inhibit star formation in their host galaxies by injecting heat and turbulence into the interstellar medium (ISM). To investigate jet-ISM interactions in a galaxy with a young radio source, we have carried out a multi-wavelength study of the $z = 0.025$ Compact Steep Spectrum radio source hosted by the early-type galaxy UGC 05771. Using Keck/OSIRIS observations, we detected H\textsubscript{2} 1--0 S(1) and [Fe \textsc{ii}] emission at radii of 100s of pc, which traces shocked molecular and ionised gas being accelerated outwards by the jets to low velocities, creating a `stalling wind'. At kpc radii, we detected shocked ionised gas using observations from the CALIFA survey, covering an area much larger than the pc-scale radio source. We found that existing interferometric radio observations fail to recover a large fraction of the source's total flux, indicating the likely existence of jet plasma on kpc scales, which is consistent with the extent of shocked gas in the host galaxy. To investigate the star formation efficiency in UGC 05771, we obtained IRAM CO observations to analyse the molecular gas properties. We found that UGC 05771 sits below the Kennicutt-Schmidt relation, although we were unable to definitively conclude if direct interactions from the jets are inhibiting star formation. This result shows that jets may be important in regulating star formation in the host galaxies of compact radio sources.


title: Stochastic Convolutional Sparse Coding

abstract: State-of-the-art methods for Convolutional Sparse Coding usually employ Fourier-domain solvers in order to speed up the convolution operators. However, this approach is not without shortcomings. For example, Fourier-domain representations implicitly assume circular boundary conditions and make it hard to fully exploit the sparsity of the problem as well as the small spatial support of the filters. In this work, we propose a novel stochastic spatial-domain solver, in which a randomized subsampling strategy is introduced during the learning sparse codes. Afterwards, we extend the proposed strategy in conjunction with online learning, scaling the CSC model up to very large sample sizes. In both cases, we show experimentally that the proposed subsampling strategy, with a reasonable selection of the subsampling rate, outperforms the state-of-the-art frequency-domain solvers in terms of execution time without losing the learning quality. Finally, we evaluate the effectiveness of the over-complete dictionary learned from large-scale datasets, which demonstrates an improved sparse representation of the natural images on account of more abundant learned image features.


title: Dispersions of Many-Body Bethe strings

abstract: Complex bound states of magnetic excitations, known as Bethe string, were predicted almost a century ago to exist in one-dimensional quantum magnets 1. The dispersions of the string states have so far remained the subject of intensive theoretical studies 2-7. By performing neutron scattering experiments on the one-dimensional Heisenberg-Ising antiferromagnet SrCo2V2O8 in high longitudinal magnetic fields, we reveal in detail the dispersion relations of the string states over the full Brillouin zone, as well as their magnetic field dependences. Furthermore the characteristic energy, the scattering intensity and linewidth of the observed string states exhibit excellent agreement with our precise Bethe Ansatz calculations. Our results establish the important role of string states in the quantum spin dynamics of one-dimensional systems, and will invoke studies of their dynamical properties in more general many-body systems.


title: Degree bipartite Ramsey numbers

abstract: Let $H\xrightarrow{s} G$ denote that any edge-coloring of $H$ by $s$ colors contains a monochromatic $G$. The degree Ramsey number $r_{\Delta}(G;s)$ is defined to be $\min\{\Delta(H):H\xrightarrow{s} G\}$, and the degree bipartite Ramsey number $br_{\Delta}(G;s)$ is defined to be $\min\{\Delta(H):H\xrightarrow{s} G\; \mbox{and} \;\chi(H)=2\}$. In this note, we show that $r_{\Delta}(K_{m,n};s)$ is linear on $n$ with $m$ fixed. We also determine $br_{\Delta}(G;s)$ where $G$ are trees, including stars and paths, and complete bipartite graphs.


title: Martingale interpretation of weakly cancelling differential operators

abstract: We provide martingale analogs of weakly cancelling differential operators and prove a Sobolev-type embedding theorem for these operators in the martingale setting.


title: Parallel Unbalanced Optimal Transport Regularization for Large Scale Imaging Problems

abstract: The modeling of phenomenological structure is a crucial aspect in inverse imaging problems. One emerging modeling tool in computational imaging is the optimal transport framework. Its ability to model geometric displacements across an image's support gives it attractive qualities similar to those of optical flow methods which are effective at capturing visual motion, but are restricted to operate in significantly smaller state-spaces. Despite this advantage, two major drawbacks make it unsuitable for general deployment: (i) it suffers from exorbitant computational costs due to a quadratic optimization-variable complexity, and (ii) it has a mass-balancing assumption that limits applications with natural images. We tackle these issues simultaneously by proposing a novel formulation for an unbalanced optimal transport regularizer that has linear optimization-variable complexity. In addition, we present a general parallelizable proximal method for this regularizer, and demonstrate superior empirical performance on novel dynamical tracking applications in synthetic and real video.


title: On inclusion chromatic index of a graph

abstract: Let $\chi'_\subset(G)$ be the least number of colours necessary to properly colour the edges of a graph $G$ with minimum degree $\delta\geq 2$ so that the set of colours incident with any vertex is not contained in a set of colours incident to any its neighbour. We provide an infinite family of examples of graphs $G$ with $\chi'_\subset(G)\geq (1+\frac{1}{\delta-1})\Delta$, where $\Delta$ is the maximum degree of $G$, and we conjecture that $\chi'_\subset(G)\leq \lceil(1+\frac{1}{\delta-1})\Delta\rceil$ for every connected graph with $\delta\geq 2$ which is not isomorphic to $C_5$. The equality here is attained e.g. for the family of complete bipartite graphs. Using a probabilistic argument we support this conjecture by proving that for any fixed $\delta\ge2$, $\chi'_\subset(G) \le (1+\frac{4}{\delta})\Delta (1+o(1))$ (for $\Delta\to\infty$), what implies that $\chi'_\subset(G) \le (1+\frac{4}{\delta-1})\Delta$ for $\Delta$ large enough.


title: Normality and Montel's Theorem

abstract: In this article, we prove a normality criterion for a family of meromorphic functions having zeros with some multiplicity which involves sharing of a holomorphic function by the members of the family. Our result generalizes Montel's normality test in a certain sense.


title: Dynamic characterization of beating sinusoidal wave oscillations in a thin-slice solid-state laser with coupled orthogonally polarized transverse modes

abstract: Dynamic characterization of self-induced beating sinusoidal wave (BSW) oscillations and related phenomena, which were previously explored in a thin-slice dual-polarization solid-state laser operating in the regime of incomplete mode-locking of orthogonally polarized transverse eigenmodes, namely, a quasi-locked state [Laser Physics Letters, 15 (2018) 075001], is performed in terms of the amplitude correlation coefficient and intensity circulation among various orthogonally polarized mode pairs. Polarization-dependent symmetry-breaking featuring a nonreciprocal intensity flow for different orthogonally polarized mode pairs operating in the BSW state are found. The singular state is hidden in a nonlinear system where a perfect mode-locked BSW state with a large amplitude correlation coefficient featuring reciprocal intensity flow is established for a transverse mode pair possessing particular polarization directions that are related to the intensity ratio of orthogonally polarized transverse eigenmodes. Self-organized chaos synchronization is shown to take place for such a singular transverse mode pair subjected to self-mixing modulations.


title: Adversarial Learning with Contextual Embeddings for Zero-resource Cross-lingual Classification and NER

abstract: Contextual word embeddings (e.g. GPT, BERT, ELMo, etc.) have demonstrated state-of-the-art performance on various NLP tasks. Recent work with the multilingual version of BERT has shown that the model performs very well in zero-shot and zero-resource cross-lingual settings, where only labeled English data is used to finetune the model. We improve upon multilingual BERT's zero-resource cross-lingual performance via adversarial learning. We report the magnitude of the improvement on the multilingual MLDoc text classification and CoNLL 2002/2003 named entity recognition tasks. Furthermore, we show that language-adversarial training encourages BERT to align the embeddings of English documents and their translations, which may be the cause of the observed performance gains.


title: Rethinking travel behavior modeling representations through embeddings

abstract: This paper introduces the concept of travel behavior embeddings, a method for re-representing discrete variables that are typically used in travel demand modeling, such as mode, trip purpose, education level, family type or occupation. This re-representation process essentially maps those variables into a latent space called the \emph{embedding space}. The benefit of this is that such spaces allow for richer nuances than the typical transformations used in categorical variables (e.g. dummy encoding, contrasted encoding, principal components analysis). While the usage of latent variable representations is not new per se in travel demand modeling, the idea presented here brings several innovations: it is an entirely data driven algorithm; it is informative and consistent, since the latent space can be visualized and interpreted based on distances between different categories; it preserves interpretability of coefficients, despite being based on Neural Network principles; and it is transferrable, in that embeddings learned from one dataset can be reused for other ones, as long as travel behavior keeps consistent between the datasets. The idea is strongly inspired on natural language processing techniques, namely the word2vec algorithm. Such algorithm is behind recent developments such as in automatic translation or next word prediction. Our method is demonstrated using a model choice model, and shows improvements of up to 60\% with respect to initial likelihood, and up to 20% with respect to likelihood of the corresponding traditional model (i.e. using dummy variables) in out-of-sample evaluation. We provide a new Python package, called PyTre (PYthon TRavel Embeddings), that others can straightforwardly use to replicate our results or improve their own models. Our experiments are themselves based on an open dataset (swissmetro).


title: EnGN: A High-Throughput and Energy-Efficient Accelerator for Large Graph Neural Networks

abstract: Graph neural networks (GNNs) emerge as a powerful approach to process non-euclidean data structures and have been proved powerful in various application domains such as social networks and e-commerce. While such graph data maintained in real-world systems can be extremely large and sparse, thus employing GNNs to deal with them requires substantial computational and memory overhead, which induces considerable energy and resource cost on CPUs and GPUs. In this work, we present a specialized accelerator architecture, EnGN, to enable high-throughput and energy-efficient processing of large-scale GNNs. The proposed EnGN is designed to accelerate the three key stages of GNN propagation, which is abstracted as common computing patterns shared by typical GNNs. To support the key stages simultaneously, we propose the ring-edge-reduce(RER) dataflow that tames the poor locality of sparsely-and-randomly connected vertices, and the RER PE-array to practice RER dataflow. In addition, we utilize a graph tiling strategy to fit large graphs into EnGN and make good use of the hierarchical on-chip buffers through adaptive computation reordering and tile scheduling. Overall, EnGN achieves performance speedup by 1802.9X, 19.75X, and 2.97X and energy efficiency by 1326.35X, 304.43X, and 6.2X on average compared to CPU, GPU, and a state-of-the-art GCN accelerator HyGCN, respectively.


title: NCLS: Neural Cross-Lingual Summarization

abstract: Cross-lingual summarization (CLS) is the task to produce a summary in one particular language for a source document in a different language. Existing methods simply divide this task into two steps: summarization and translation, leading to the problem of error propagation. To handle that, we present an end-to-end CLS framework, which we refer to as Neural Cross-Lingual Summarization (NCLS), for the first time. Moreover, we propose to further improve NCLS by incorporating two related tasks, monolingual summarization and machine translation, into the training process of CLS under multi-task learning. Due to the lack of supervised CLS data, we propose a round-trip translation strategy to acquire two high-quality large-scale CLS datasets based on existing monolingual summarization datasets. Experimental results have shown that our NCLS achieves remarkable improvement over traditional pipeline methods on both English-to-Chinese and Chinese-to-English CLS human-corrected test sets. In addition, NCLS with multi-task learning can further significantly improve the quality of generated summaries. We make our dataset and code publicly available here: http://www.nlpr.ia.ac.cn/cip/dataset.htm.


title: Improving Back-Translation with Uncertainty-based Confidence Estimation

abstract: While back-translation is simple and effective in exploiting abundant monolingual corpora to improve low-resource neural machine translation (NMT), the synthetic bilingual corpora generated by NMT models trained on limited authentic bilingual data are inevitably noisy. In this work, we propose to quantify the confidence of NMT model predictions based on model uncertainty. With word- and sentence-level confidence measures based on uncertainty, it is possible for back-translation to better cope with noise in synthetic bilingual corpora. Experiments on Chinese-English and English-German translation tasks show that uncertainty-based confidence estimation significantly improves the performance of back-translation.


title: Electromagnetic field expectations as measures of photon localization

abstract: The questions of whether a photon can be localized in an arbitrarily small volume and what is the allowable strength of that localization (the decrease with distance of the functional form) are questions of current interest. We propose a measure of localization for the single photon that is the expectation values of the electromagnetic field strength components in a coherent wavepacket state of mean photon number unity. As such, we deal with real quantities that have a physical meaning rather than complex amplitudes. It is seen that the real parts of complex amplitudes proposed previously as measures of localization are equal to our field expectations. With this measure, we examine two test states. The first has a well-resolved momentum. The field expectations show Gaussian (quadratic exponential) localization in all directions, although the localization length scale is much larger than the mean wavelength. For the other test state, with a spherically symmetric momentum distribution, we find almost exponential localization in all directions at t = 0. The profiles are scale invariant, so choosing the momentum width very large would make the localization length arbitrarily small. We conclude that there is no lower bound on the localization length scale of a photon as determined by this measure.


title: Global boundedness of the curl for a p-curl system in convex domains

abstract: In this paper, we study a semilinear system involving the curl operator in a bounded and convex domain in $R^3$, which comes from the steady-state approximation for Bean critical-state model for type-II superconductors. We show the existence and the $L^{\infty}$ estimate for weak solutions to this system.


title: Incorporating Domain Knowledge into Medical NLI using Knowledge Graphs

abstract: Recently, biomedical version of embeddings obtained from language models such as BioELMo have shown state-of-the-art results for the textual inference task in the medical domain. In this paper, we explore how to incorporate structured domain knowledge, available in the form of a knowledge graph (UMLS), for the Medical NLI task. Specifically, we experiment with fusing embeddings obtained from knowledge graph with the state-of-the-art approaches for NLI task (ESIM model). We also experiment with fusing the domain-specific sentiment information for the task. Experiments conducted on MedNLI dataset clearly show that this strategy improves the baseline BioELMo architecture for the Medical NLI task.


title: Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach

abstract: Zero-shot text classification (0Shot-TC) is a challenging NLU problem to which little attention has been paid by the research community. 0Shot-TC aims to associate an appropriate label with a piece of text, irrespective of the text domain and the aspect (e.g., topic, emotion, event, etc.) described by the label. And there are only a few articles studying 0Shot-TC, all focusing only on topical categorization which, we argue, is just the tip of the iceberg in 0Shot-TC. In addition, the chaotic experiments in literature make no uniform comparison, which blurs the progress. This work benchmarks the 0Shot-TC problem by providing unified datasets, standardized evaluations, and state-of-the-art baselines. Our contributions include: i) The datasets we provide facilitate studying 0Shot-TC relative to conceptually different and diverse aspects: the ``topic'' aspect includes ``sports'' and ``politics'' as labels; the ``emotion'' aspect includes ``joy'' and ``anger''; the ``situation'' aspect includes ``medical assistance'' and ``water shortage''. ii) We extend the existing evaluation setup (label-partially-unseen) -- given a dataset, train on some labels, test on all labels -- to include a more challenging yet realistic evaluation label-fully-unseen 0Shot-TC (Chang et al., 2008), aiming at classifying text snippets without seeing task specific training data at all. iii) We unify the 0Shot-TC of diverse aspects within a textual entailment formulation and study it this way. Code & Data: https://github.com/yinwenpeng/BenchmarkingZeroShot


title: High-fidelity magnonic gates for surface spin waves

abstract: We study the propagation of surface spin waves in two wave guides coupled through the dipole-dipole interaction. Essential for the observations made here is the magneto-electric coupling between the spin waves and the effective ferroelectric polarization. This allows an external electric field to act on spin waves and to modify the band gaps of magnonic excitations in individual layers. By an on/off switching of the electric field and/or varying its strength or direction with respect to the equilibrium magnetization, it is possible to permit or ban the propagation of the spin waves in selected waveguide. We propose experimentally feasible nanoscale device operating as a high fidelity surface wave magnonic gate.


title: A new approach to optimal stopping for Hunt processes

abstract: In this paper we present a new verification theorem for optimal stopping problems for Hunt processes. The approach is based on the Fukushima-Dynkin formula, and its advantage is that it allows us to verify that a given function is the value function without using the viscosity solution argument. Our verification theorem works in any dimension. We illustrate our results with some examples of optimal stopping of reflected diffusions and absorbed diffusions.


title: Named Entity Recognition Only from Word Embeddings

abstract: Deep neural network models have helped named entity (NE) recognition achieve amazing performance without handcrafting features. However, existing systems require large amounts of human annotated training data. Efforts have been made to replace human annotations with external knowledge (e.g., NE dictionary, part-of-speech tags), while it is another challenge to obtain such effective resources. In this work, we propose a fully unsupervised NE recognition model which only needs to take informative clues from pre-trained word embeddings. We first apply Gaussian Hidden Markov Model and Deep Autoencoding Gaussian Mixture Model on word embeddings for entity span detection and type prediction, and then further design an instance selector based on reinforcement learning to distinguish positive sentences from noisy sentences and refine these coarse-grained annotations through neural networks. Extensive experiments on CoNLL benchmark datasets demonstrate that our proposed light NE recognition model achieves remarkable performance without using any annotated lexicon or corpus.


title: Visual attention while solving the test of understanding graphs in kinematics: An eye-tracking analysis

abstract: This study used eye-tracking to capture the students' visual attention while taking the test of understanding graphs in kinematics (TUG-K). A total of N = 115 upper-secondary-level students from Germany and Switzerland took the 26-item multiple-choice instrument after learning about kinematics graphs in the regular classroom. Besides choosing the correct alternative among research-based distractors, the students were required to judge their response confidence for each question. The items were presented sequentially on a computer screen equipped with a remote eye tracker, resulting in a set of approx. 3000 paired responses (accuracy and confidence) and about 40 hours of eye movementdata (approx. 500.000 fixations). The analysis of students' visual attention related to the item stems (questions) and the item options reveal that high response confidence is correlated with shorter visit duration on both elements of the items. While the students' response accuracy and their response confidence are highly correlated on the score level, r(115) = 0.63, p < 0.001, the eye-tracking measures do not sufficiently discriminate between correct and incorrect responses. However, a more fine-grained analysis of visual attention based on different answer options reveals a significant discrimination between correct and incorrect answers in terms of an interaction effect: Incorrect responses are associated with longer visit durations on strong distractors and less time spent on correct options while correct responses show the opposite trend. Outcomes of this study provide new insights into the validation of concept inventories based on students' behavioural level.


title: Bi-Directional ConvLSTM U-Net with Densley Connected Convolutions

abstract: In recent years, deep learning-based networks have achieved state-of-the-art performance in medical image segmentation. Among the existing networks, U-Net has been successfully applied on medical image segmentation. In this paper, we propose an extension of U-Net, Bi-directional ConvLSTM U-Net with Densely connected convolutions (BCDU-Net), for medical image segmentation, in which we take full advantages of U-Net, bi-directional ConvLSTM (BConvLSTM) and the mechanism of dense convolutions. Instead of a simple concatenation in the skip connection of U-Net, we employ BConvLSTM to combine the feature maps extracted from the corresponding encoding path and the previous decoding up-convolutional layer in a non-linear way. To strengthen feature propagation and encourage feature reuse, we use densely connected convolutions in the last convolutional layer of the encoding path. Finally, we can accelerate the convergence speed of the proposed network by employing batch normalization (BN). The proposed model is evaluated on three datasets of: retinal blood vessel segmentation, skin lesion segmentation, and lung nodule segmentation, achieving state-of-the-art performance.


title: Efficient quantum transport in a multi-site system combining classical noise and quantum baths

abstract: We study the population dynamics and quantum transport efficiency of a multi-site dissipative system driven by a random telegraph noise (RTN) by using a variational polaron master equation for both linear chain and ring configurations. By using two different environment descriptions -- RTN only and a thermal bath+RTN -- we show that the presence of the classical noise has a nontrivial role on the quantum transport. We observe that there exists large areas of parameter space where the combined bath+RTN influence is clearly beneficial for populating the target state of the transport, and for average trapping time and transport efficiency when accounting for the presence of the reaction center via the use of the sink. This result holds for both of the considered intra-site coupling configurations including a chain and ring. In general, our formalism and achieved results provide a platform for engineering and characterizing efficient quantum transport in multi-site systems both for realistic environments and engineered systems.


title: Covariant Constructive Gravity

abstract: We present a method of constructing perturbative equations of motion for the geometric background of any given tensorial field theory. Requiring invariance of the gravitational dynamics under spacetime diffeomorphisms leads to a PDE system for the gravitational Lagrangian that can be solved by means of a power series ansatz. Furthermore, in each order we pose conditions on the causality of the gravitational equations, that ensure coevolution of the matter fields and the gravitational background is possible, i.e. gravitational equations and matter equations share the same initial data hypersurfaces.


title: Imbalance Problems in Object Detection: A Review

abstract: In this paper, we present a comprehensive review of the imbalance problems in object detection. To analyze the problems in a systematic manner, we introduce a problem-based taxonomy. Following this taxonomy, we discuss each problem in depth and present a unifying yet critical perspective on the solutions in the literature. In addition, we identify major open issues regarding the existing imbalance problems as well as imbalance problems that have not been discussed before. Moreover, in order to keep our review up to date, we provide an accompanying webpage which catalogs papers addressing imbalance problems, according to our problem-based taxonomy. Researchers can track newer studies on this webpage available at: https://github.com/kemaloksuz/ObjectDetectionImbalance .


title: Open Named Entity Modeling from Embedding Distribution

abstract: In this paper, we report our discovery on named entity distribution in a general word embedding space, which helps an open definition on multilingual named entity definition rather than previous closed and constraint definition on named entities through a named entity dictionary, which is usually derived from human labor and replies on schedule update. Our initial visualization of monolingual word embeddings indicates named entities tend to gather together despite of named entity types and language difference, which enable us to model all named entities using a specific geometric structure inside embedding space, namely, the named entity hypersphere. For monolingual cases, the proposed named entity model gives an open description of diverse named entity types and different languages. For cross-lingual cases, mapping the proposed named entity model provides a novel way to build a named entity dataset for resource-poor languages. At last, the proposed named entity model may be shown as a handy clue to enhance state-of-the-art named entity recognition systems generally.


title: Near-optimal Approximate Discrete and Continuous Submodular Function Minimization

abstract: In this paper we provide improved running times and oracle complexities for approximately minimizing a submodular function. Our main result is a randomized algorithm, which given any submodular function defined on $n$-elements with range $[-1, 1]$, computes an $\epsilon$-additive approximate minimizer in $\tilde{O}(n/\epsilon^2)$ oracle evaluations with high probability. This improves over the $\tilde{O}(n^{5/3}/\epsilon^2)$ oracle evaluation algorithm of Chakrabarty \etal~(STOC 2017) and the $\tilde{O}(n^{3/2}/\epsilon^2)$ oracle evaluation algorithm of Hamoudi \etal. Further, we leverage a generalization of this result to obtain efficient algorithms for minimizing a broad class of nonconvex functions. For any function $f$ with domain $[0, 1]^n$ that satisfies $\frac{\partial^2f}{\partial x_i \partial x_j} \le 0$ for all $i \neq j$ and is $L$-Lipschitz with respect to the $L^\infty$-norm we give an algorithm that computes an $\epsilon$-additive approximate minimizer with $\tilde{O}(n \cdot \mathrm{poly}(L/\epsilon))$ function evaluation with high probability.


title: Tensor products of finitely presented functors

abstract: We study right exact tensor products on the category of finitely presented functors. As our main technical tool, we use a multilinear version of the universal property of so-called Freyd categories. Furthermore, we compare our constructions with the Day convolution of arbitrary functors. Our results are stated in a constructive way and give a unified approach for the implementation of tensor products in various contexts.


title: Fluctuations and pairing in Fe-based superconductors: Light scattering experiments

abstract: Inelastic scattering of visible light (Raman effect) offers a window into properties of correlated metals such as spin, electron and lattice dynamics as well as their mutual interactions. In this review we focus on electronic and spin excitations in Fe-based pnictides and chalcogenides in particular, but not exclusively superconductors. After a general introduction to the basic theory including the selection rules for the various scattering processes we provide an overview over the major results. In the superconducting state below the transition temperature Tc the pair-breaking effect can be observed, and the energy gap can be derived. The energies can be associated with the gaps and their anisotropy on the electron and hole bands. In spite of the similarities of the overall band structures the results are strongly dependent on the family and may even change qualitatively within one family. In some of the compounds strong collective modes appear below Tc. In Ba1-xKxFe2As2, which has the most isotropic gap of all Fe-based superconductors, there are indications that these modes are exciton-like states appearing in the presence of a hierarchy of pairing tendencies. The strong in-gap modes observed in Co-doped NaFeAs are interpreted in terms of quadrupolar orbital excitations which become undamped in the superconducting state. The doping dependence of the scattering intensity in Ba(Fe1-xCox)2As2 is associated with a nematic resonance above a quantum critical point and interpreted in terms of a critical enhancement at the maximal Tc. In the normal state the response from particle-hole excitations reflects the resistivity. In addition, there are contributions from presumably critical fluctuations in the energy range of kBT which can be compared to the elastic properties. Currently it is not settled whether the fluctuations observed by light scattering are related to spin or charge.


title: Experimental analyses on 2-hop-based and 3-hop-based link prediction algorithms

abstract: Link prediction is a significant and challenging task in network science. The majority of known methods are similarity-based, which assign similarity indices for node pairs and assume that two nodes of larger similarity have higher probability to be connected by a link. Due to their simplicity, interpretability and high efficiency, similarity-based methods, in particular those based only on local information, have already found successful applications on disparate fields. In this research domain, an intuitive consensus is that two nodes sharing common neighbors are very likely to have a link, while some recent evidences argue that the number of 3-hop paths more accurately predicts missing links than the number of common neighbors. In this paper, we implement extensive experimental comparisons between 2-hop-based and 3-hop-based similarity indices on 128 real networks. Our results indicate that the 3-hop-based indices perform slightly better with a winning rate about 55.88%, but which index is the best one still depends on the target network. Overall speaking, the class of Cannistraci-Hebb indices performs the best among all considered candidates.


title: Joint Detection and Location of English Puns

abstract: A pun is a form of wordplay for an intended humorous or rhetorical effect, where a word suggests two or more meanings by exploiting polysemy (homographic pun) or phonological similarity to another word (heterographic pun). This paper presents an approach that addresses pun detection and pun location jointly from a sequence labeling perspective. We employ a new tagging scheme such that the model is capable of performing such a joint task, where useful structural information can be properly captured. We show that our proposed model is effective in handling both homographic and heterographic puns. Empirical results on the benchmark datasets demonstrate that our approach can achieve new state-of-the-art results.


title: Quantity Tagger: A Latent-Variable Sequence Labeling Approach to Solving Addition-Subtraction Word Problems

abstract: An arithmetic word problem typically includes a textual description containing several constant quantities. The key to solving the problem is to reveal the underlying mathematical relations (such as addition and subtraction) among quantities, and then generate equations to find solutions. This work presents a novel approach, Quantity Tagger, that automatically discovers such hidden relations by tagging each quantity with a sign corresponding to one type of mathematical operation. For each quantity, we assume there exists a latent, variable-sized quantity span surrounding the quantity token in the text, which conveys information useful for determining its sign. Empirical results show that our method achieves 5 and 8 points of accuracy gains on two datasets respectively, compared to prior approaches.


title: Functions with ultradifferentiable powers

abstract: We study the regularity of smooth functions $f$ defined on an open set of $\mathbb{R}^n$ and such that, for certain integers $p\geq 2$, the powers $f^p :x\mapsto (f(x))^p$ belong to a Denjoy-Carleman class $\mathcal{C}_M$ associated with a suitable weight sequence $M$. Our main result is a statement analogous to a classic theorem of H. Joris on $\mathcal{C}^\infty$ functions: if a function $f:\mathbb{R}\to\mathbb{R}$ is such that both functions $f^p$ and $f^q$ with $\gcd(p,q)=1$ are of class $\mathcal{C}_M$ on $\mathbb{R}$, and if the weight sequence $M$ satisfies the so-called moderate growth assumption, then $f$ itself is of class $\mathcal{C}_M$. Various ancillary results, corollaries and examples are presented.


title: Learning self-triggered controllers with Gaussian processes

abstract: This paper investigates the design of self-triggered controllers for networked control systems (NCSs), where the dynamics of the plant is \textit{unknown} apriori. To deal with the unknown transition dynamics, we employ the Gaussian process (GP) regression in order to learn the dynamics of the plant. To design the self-triggered controller, we formulate an optimal control problem, such that the optimal control and communication policies can be jointly designed based on the GP model of the plant. Moreover, we provide an overall implementation algorithm that jointly learns the dynamics of the plant and the self-triggered controller based on a reinforcement learning framework. Finally, a numerical simulation illustrates the effectiveness of the proposed approach.


title: Boundary-Aware Feature Propagation for Scene Segmentation

abstract: In this work, we address the challenging issue of scene segmentation. To increase the feature similarity of the same object while keeping the feature discrimination of different objects, we explore to propagate information throughout the image under the control of objects' boundaries. To this end, we first propose to learn the boundary as an additional semantic class to enable the network to be aware of the boundary layout. Then, we propose unidirectional acyclic graphs (UAGs) to model the function of undirected cyclic graphs (UCGs), which structurize the image via building graphic pixel-by-pixel connections, in an efficient and effective way. Furthermore, we propose a boundary-aware feature propagation (BFP) module to harvest and propagate the local features within their regions isolated by the learned boundaries in the UAG-structured image. The proposed BFP is capable of splitting the feature propagation into a set of semantic groups via building strong connections among the same segment region but weak connections between different segment regions. Without bells and whistles, our approach achieves new state-of-the-art segmentation performance on three challenging semantic segmentation datasets, i.e., PASCAL-Context, CamVid, and Cityscapes.


title: Explicit Cross-lingual Pre-training for Unsupervised Machine Translation

abstract: Pre-training has proven to be effective in unsupervised machine translation due to its ability to model deep context information in cross-lingual scenarios. However, the cross-lingual information obtained from shared BPE spaces is inexplicit and limited. In this paper, we propose a novel cross-lingual pre-training method for unsupervised machine translation by incorporating explicit cross-lingual training signals. Specifically, we first calculate cross-lingual n-gram embeddings and infer an n-gram translation table from them. With those n-gram translation pairs, we propose a new pre-training model called Cross-lingual Masked Language Model (CMLM), which randomly chooses source n-grams in the input text stream and predicts their translation candidates at each time step. Experiments show that our method can incorporate beneficial cross-lingual information into pre-trained models. Taking pre-trained CMLM models as the encoder and decoder, we significantly improve the performance of unsupervised machine translation.


title: Weak invariants in dissipative systems: Action principle and Noether charge for kinetic theory

abstract: In nonequilibrium classical thermostatistics, the state of a system may be described by not only dynamical/thermodynamical variables but also a kinetic distribution function. This "double structure" bears some analogy with that in quantum thermodynamics, where both dynamical variables and the Hilbert space are involved. Recently, the concept of weak invariants has repeatedly been discussed in the context of quantum thermodynamics. A weak invariant is defined in such a way that its value changes in time but its expectation value is conserved under time evolution prescribed by a kinetic equation. Here, a new aspect of a weak invariant is revealed for the classical Fokker-Planck equation as an example of classical kinetic equations. The auxiliary field formalism is applied to construction of the action for the kinetic equation. Then, it is shown that the auxiliary field is a weak invariant and is the Noether charge. The action is invariant under the transformation generated by the weak invariant. The result may shed light on possible roles of the symmetry principle in the kinetic descriptions of nonequilibrium systems.


title: Scale Calibrated Training: Improving Generalization of Deep Networks via Scale-Specific Normalization

abstract: Standard convolutional neural networks(CNNs) require consistent image resolutions in both training and testing phase. However, in practice, testing with smaller image sizes is necessary for fast inference. We show that trivially evaluating low-resolution images on networks trained with high-resolution images results in a catastrophic accuracy drop in standard CNN architectures. We propose a novel training regime called Scale calibrated Training(SCT) which allows networks to learn from various scales of input simultaneously. By taking advantages of SCT, single network can provide decent accuracy at test time in response to multiple test scales. In our analysis, we surprisingly find that vanilla batch normalization can lead to sub-optimal performance in SCT. Therefore, a novel normalization scheme called Scale-Specific Batch Normalization is equipped to SCT in replacement of batch normalization. Experiment results show that SCT improves accuracy of single Resnet-50 on ImageNet by 1.7% and 11.5% accuracy when testing on image sizes of 224 and 128 respectively.


title: Extracting information from free text through unsupervised graph-based clustering: an application to patient incident records

abstract: The large volume of text in electronic healthcare records often remains underused due to a lack of methodologies to extract interpretable content. Here we present an unsupervised framework for the analysis of free text that combines text-embedding with paragraph vectors and graph-theoretical multiscale community detection. We analyse text from a corpus of patient incident reports from the National Health Service in England to find content-based clusters of reports in an unsupervised manner and at different levels of resolution. Our unsupervised method extracts groups with high intrinsic textual consistency and compares well against categories hand-coded by healthcare personnel. We also show how to use our content-driven clusters to improve the supervised prediction of the degree of harm of the incident based on the text of the report. Finally, we discuss future directions to monitor reports over time, and to detect emerging trends outside pre-existing categories.


title: Borophosphene: a New Anisotropic Dirac Cone Monolayer with High Fermi Velocity and Unique Feature of Self-doping

abstract: Two-dimensional (2D) Dirac cone materials exhibit linear energy dispersion at the Fermi level, where the effective masses of carriers are very close to zero and the Fermi velocity is ultrahigh, only 2 ~ 3 orders of magnitude lower than the light velocity. Such the Dirac cone materials have great promise in high-performance electronic devices. Herein, we have employed the genetic algorithms methods combining with first-principles calculations to propose a new 2D anisotropic Dirac cone material, that is, orthorhombic boron phosphide (BP) monolayer named as borophosphene. Molecular dynamics simulation and phonon dispersion have been used to evaluate the dynamic and thermal stability of borophosphene. Because of the unique arrangements of B-B and P-P dimers, the mechanical and electronic properties are highly anisotropic. Of great interest is that the Dirac cone of the borophosphene is robust, independent of in-plane biaxial and uniaxial strains, and can also be observed in its one-dimensional (1D) zigzag nanoribbons and armchair nanotubes. The Fermi velocities are ~ 105 m/s, the same order of magnitude with that of graphene. By using a tight-binding model, the origin of the Dirac cone of borophosphene is analyzed. Moreover, a unique feature of self-doping can be induced by the in-plane biaxial and uniaxial strains of borophosphene and the Curvature effect of nanotubes, which is great beneficial to realizing high speed carriers (holes). Our results suggest that the borophosphene holds a great promise in high-performance electronic devices, which could promote the experimental and theoretical studies to further explore the potential applications of other 2D Dirac cone sheets.


title: Evolution of interdependent co-authorship and citation networks

abstract: Studies of bibliographic data suggest a strong correlation between the growth of citation networks and their corresponding co-authorship networks. We explore the interdependence between evolving citation and co-authorship networks focused on the publications, by Indian authors, in American Physical Society journals between 1970 and 2013. We record interactions between each possible pair of authors in two ways: first, by tracing the change in citations they exchanged and, second, by tracing the shortest path between authors in the co-authorship network. We create these data for every year of the period of our analysis. We use probability methods to quantify the correlation between citations and shortest paths, and the effect on the dynamics of the citation-co-authorship system. We find that author pairs who have a co-authorship distance $d \leq 3$ significantly affect each others citations, but that this effect falls off rapidly for longer distances in the co-authorship network. The exchange of citation between pairs with $d=1$ exhibits a sudden increase at the time of first co-authorship events and decays thereafter, indicating an aging effect in collaboration. This suggests that the dynamics of the co-authorship network appear to be driving those of the citation network rather than vice versa. Moreover, the majority of citations received by most authors are due to reciprocal citations from current, or past, co-authors. We conclude that, in order to answer questions on nature and dynamics of scientific collaboration, it is necessary to study both co-authorship and citation network simultaneously.


title: Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes

abstract: Volumetric ultrasound has great potentials in promoting prenatal examinations. Automated solutions are highly desired to efficiently and effectively analyze the massive volumes. Segmentation and landmark localization are two key techniques in making the quantitative evaluation of prenatal ultrasound volumes available in clinic. However, both tasks are non-trivial when considering the poor image quality, boundary ambiguity and anatomical variations in volumetric ultrasound. In this paper, we propose an effective framework for simultaneous segmentation and landmark localization in prenatal ultrasound volumes. The proposed framework has two branches where informative cues of segmentation and landmark localization can be propagated bidirectionally to benefit both tasks. As landmark localization tends to suffer from false positives, we propose a distance based loss to suppress the noise and thus enhance the localization map and in turn the segmentation. Finally, we further leverage an adversarial module to emphasize the correspondence between segmentation and landmark localization. Extensively validated on a volumetric ultrasound dataset of fetal femur, our proposed framework proves to be a promising solution to facilitate the interpretation of prenatal ultrasound volumes.


title: Deep Ordinal Regression for Pledge Specificity Prediction

abstract: Many pledges are made in the course of an election campaign, forming important corpora for political analysis of campaign strategy and governmental accountability. At present, there are no publicly available annotated datasets of pledges, and most political analyses rely on manual analysis. In this paper we collate a novel dataset of manifestos from eleven Australian federal election cycles, with over 12,000 sentences annotated with specificity (e.g., rhetorical vs.\ detailed pledge) on a fine-grained scale. We propose deep ordinal regression approaches for specificity prediction, under both supervised and semi-supervised settings, and provide empirical results demonstrating the effectiveness of the proposed techniques over several baseline approaches. We analyze the utility of pledge specificity modeling across a spectrum of policy issues in performing ideology prediction, and further provide qualitative analysis in terms of capturing party-specific issue salience across election cycles.


title: Improving Multi-Head Attention with Capsule Networks

abstract: Multi-head attention advances neural machine translation by working out multiple versions of attention in different subspaces, but the neglect of semantic overlapping between subspaces increases the difficulty of translation and consequently hinders the further improvement of translation performance. In this paper, we employ capsule networks to comb the information from the multiple heads of the attention so that similar information can be clustered and unique information can be reserved. To this end, we adopt two routing mechanisms of Dynamic Routing and EM Routing, to fulfill the clustering and separating. We conducted experiments on Chinese-to-English and English-to-German translation tasks and got consistent improvements over the strong Transformer baseline.


title: Long rotation period main-sequence stars from Kepler SAP light curves

abstract: Stellar rotation plays a key role in stellar activity. The rotation period could be detected through light curve variations caused by starspots. Kepler provides two types of light curves, one is the Pre-search Data Conditioning (PDC) light curves, the other is the Simple Aperture Photometer (SAP) light curves. Compared with the PDC light curves, the SAP light curves keep the long-term trend, relatively suitable for searches of long period signals. However, SAP data are inflicted by some artefacts such as quarterly rolls and instrumental errors, making it difficult to find the physical periods in the SAP light curves. We explore a systematic approach based on the light curve pre-processing, period detection and candidate selection. We also develop a simulated light curve test to estimate our detection limits for the SAP-like LCs. After applying our method to the raw SAP light curves, we found more than 1000 main-sequence stars with the period longer than 30 days, 165 are newly discovered. Considering the potential flaw of the SAP, we also inspect the newly found objects with photometry methods, and most of our periodical signals are confirmed.


title: CKM matrix and FCNC suppression in $SO(5) \times U(1) \times SU(3)$ gauge-Higgs unification

abstract: The Cabibbo-Kobayashi-Maskawa (CKM) mixing matrix and flavor-changing neutral currents (FCNC's) in the quark sector are examined in the GUT inspired $SO(5) \times U(1) \times SU(3)$ gauge-Higgs unification in which the 4D Higgs boson is identified with the Aharonov-Bohm phase in the fifth dimension. Gauge invariant brane interactions play an important role for the flavor mixing in the charged-current weak interactions. The CKM matrix is reproduced except that the up quark mass needs to be larger than the observed one. FCNC's are naturally suppressed as a consequence of the gauge invariance, with a factor of order $10^{-6}$. It is also shown that induced flavor-changing Yukawa couplings are extremely small.


title: Some inequalities for the multilinear singular integrals with Lipschitz functions on weighted Morrey spaces

abstract: The aim of this paper is to prove the boundedness of the oscillation and variation operators for the multilinear singular integrals with Lipschitz functions on weighted Morrey spaces.


title: Combined Task and Motion Planning for a Dual-arm Robot to Use a Suction Cup Tool

abstract: This paper proposes a combined task and motion planner for a dual-arm robot to use a suction cup tool. The planner consists of three sub-planners -- A suction pose sub-planner and two regrasp and motion sub-planners. The suction pose sub-planner finds all the available poses for a suction cup tool to suck on the object, using the models of the tool and the object. The regrasp and motion sub-planner builds the regrasp graph that represents all possible grasp sequences to reorient and move the suction cup tool from an initial pose to a goal pose. Two regrasp graphs are used to plan for a single suction cup and the complex of the suction cup and an object respectively. The output of the proposed planner is a sequence of robot motion that uses a suction cup tool to manipulate objects following human instructions. The planner is examined and analyzed by both simulation experiments and real-world executions using several real-world tasks. The results show that the planner is efficient, robust, and can generate sequential transit and transfer robot motion to finish complicated combined task and motion planning tasks in a few seconds.


title: Functional advantages of an adaptive Theory of Mind for robotics: a review of current architectures

abstract: Great advancements have been achieved in the field of robotics, however, main challenges remain, including building robots with an adaptive Theory of Mind (ToM). In the present paper, seven current robotic architectures for human-robot interactions were described as well as four main functional advantages of equipping robots with an adaptive ToM. The aim of the present paper was to determine in which way and how often ToM features are integrated in the architectures analyzed, and if they provide robots with the associated functional advantages. Our assessment shows that different methods are used to implement ToM features in robotic architectures. Furthermore, while a ToM for false-belief understanding and tracking is often built in social robotic architectures, a ToM for proactivity, active perception and learning is less common. Nonetheless, progresses towards better adaptive ToM features in robots are warranted to provide them with full access to the advantages of having a ToM resembling that of humans.


title: Inverse problems for certain subsequence sums in integers

abstract: Let $A$ be a nonempty finite set of $k$ integers. Given a subset $B$ of $A$, the sum of all elements of $B$, denoted by $s(B)$, is called the subset sum of $B$. For a nonnegative integer $\alpha$ ($\leq k$), let \[\Sigma_{\alpha} (A):=\{s(B): B \subset A, |B|\geq \alpha\}.\] Now, let $\mathcal{A}=(\underbrace{a_{1},\ldots,a_{1}}_{r_{1}~\text{copies}}, \underbrace{a_{2},\ldots,a_{2}}_{r_{2}~\text{copies}},\ldots, \underbrace{a_{k},\ldots,a_{k}}_{r_{k}~\text{copies}})$ be a finite sequence of integers with $k$ distinct terms, where $r_{i}\geq 1$ for $i=1,2,\ldots,k$. Given a subsequence $\mathcal{B}$ of $\mathcal{A}$, the sum of all terms of $\mathcal{B}$, denoted by $s(\mathcal{B})$, is called the subsequence sum of $\mathcal{B}$. For $0\leq \alpha \leq \sum_{i=1}^{k} r_{i}$, let \[\Sigma_{\alpha} (\bar{r},\mathcal{A}):=\left\{s(\mathcal{B}): \mathcal{B}~\text{is a subsequence of}~\mathcal{A}~\text{of length} \geq \alpha \right\},\] where $\bar{r}=(r_{1},r_{2},\ldots,r_{k})$. Very recently, Balandraud obtained the minimum cardinality of $\Sigma_{\alpha} (A)$ in finite fields. Motivated by Baladraud's work, we find the minimum cardinality of $\Sigma_{\alpha}(A)$ in the group of integers. We also determine the structure of the finite set $A$ of integers for which $|\Sigma_{\alpha} (A)|$ is minimal. Furthermore, we generalize these results of subset sums to the subsequence sums $\Sigma_{\alpha} (\bar{r},\mathcal{A})$. As special cases of our results we obtain some already known results for the usual subset and subsequence sums.


title: Energy Balance in Avalanche Models for Solar Flares

abstract: The distributions of solar flare energies and waiting times have not been described simultaneously by a single physical model, yet. In this research, we investigate whether recent avalanche models can describe the distributions for both the released energies and waiting times of flares in an active region. Flaring events are simulated using the modified Lu and Hamilton model (Lu and Hamilton (1991), ApJ, 380, 89) and also the optimized model (Farhang et al. (2018), ApJ, 859, 41). Applying a probability balance equation approach, we study the statistics of the simulated flaring events and investigate the origin of the observed power law in the flare frequency-size distribution. The results indicate that the power law originates in the distribution of transition rates (the distribution of the probabilities of transitions between different energies) rather than the distribution of the energy of the active region. It is also observed that the waiting-time distribution of simulated flaring events follows a q-exponential function which approximates a simple Poisson distribution.


title: Peculiarities of escape kinetics in the presence of athermal noises

abstract: Stochastic evolution of various dynamic systems and reaction networks is commonly described in terms of noise assisted escape of an overdamped particle from a potential well, as devised by the paradigmatic Langevin equation in which additive Gaussian stochastic force reproduces effects of thermal fluctuations from the reservoir. When implemented for systems close to equilibrium, the approach correctly explains emergence of Boltzmann distribution for the ensemble of trajectories generated by Langevin equation and relates intensity of the noise strength to the mobility. This scenario can be further generalized to include effects of non-Gaussian, burst-like forcing modeled by L\'evy noise. In this case however, the pulsatile additive noise cannot be treated as the internal (thermal), since the relation between the strength of the friction and variance of the noise is violated. Heavy tails of L\'evy noise distributions not only facilitate escape kinetics, but more importantly, change the escape protocol by altering final stationary state to a non-Boltzmann, non-equilibrium form. As a result, contrary to the kinetics induced by a Gaussian white noise, escape rates in environments with L\'evy noise are determined not by the barrier height, but instead, by the barrier width. We further discuss consequences of simultaneous action of thermal and L\'evy noises on statistics of passage times and population of reactants in double-well potentials.


title: Transferring Adaptive Theory of Mind to social robots: insights from developmental psychology to robotics

abstract: Despite the recent advancement in the social robotic field, important limitations restrain its progress and delay the application of robots in everyday scenarios. In the present paper, we propose to develop computational models inspired by our knowledge of human infants' social adaptive abilities. We believe this may provide solutions at an architectural level to overcome the limits of current systems. Specifically, we present the functional advantages that adaptive Theory of Mind (ToM) systems would support in robotics (i.e., mentalizing for belief understanding, proactivity and preparation, active perception and learning) and contextualize them in practical applications. We review current computational models mainly based on the simulation and teleological theories, and robotic implementations to identify the limitations of ToM functions in current robotic architectures and suggest a possible future developmental pathway. Finally, we propose future studies to create innovative computational models integrating the properties of the simulation and teleological approaches for an improved adaptive ToM ability in robots with the aim of enhancing human-robot interactions and permitting the application of robots in unexplored environments, such as disasters and construction sites. To achieve this goal, we suggest directing future research towards the modern cross-talk between the fields of robotics and developmental psychology.


title: The design of China Reconfigurable Analog-digital backEnd for FAST

abstract: The Five-hundred-meter Aperture Spherical radio Telescope(FAST) was launched on September 25,2016.From early 2017,we began to use the FAST wideband receiver,which was designed,constructed and installed on the FAST in Guizhou,China.The front end of the receiver is composed an uncooled Quad Ridge Flared Horn feed(QRFH) with the frequency range of 270 to 1620 MHz,and a cryostat operating at 10 K.Stephen et al. 2016We have coop-erated with the Institute of Automation of the Chinese Academy of Sciences to developed the China Reconfigurable ANalog-digital backEnd.The system covers the 3 GHz operating band of FAST.The hardware part of the backend includes an Analog Front-end Board,a wideband high precision Analog Digital Converter,and a FAST Digital Back-end.Analog circuit boards, field programmable gate arrays, and control computers form a set of hardware, software, and firmware platforms to achieve flexible bandwidth requirements through parameter changes. It is also suitable for the versatility of different astronomical observations, and can meet specific requirements. This paper briefly introduces the hardware and software of CRANE, as well as some observations of the system.


title: Element specificity of transient extreme ultra-violet magnetic dichroism

abstract: In this work we combine theory and experiment to study transient magnetic circular dichroism (tr-MCD) in the extreme ultraviolet spectral range (XUV) in bulk Co and CoPt. We use the \emph{ab-initio} method of real-time time-dependent density functional theory (RT-TDDFT) to simulate the magnetization dynamics in the presence of ultrafast laser pulses. From this we demonstrate how tr-MCD may be calculated using an approximation to the excited-state linear-response. We apply this approximation to Co and CoPt and show computationally that element-specific dynamics of the local spin moments can be extracted from the tr-MCD in XUV energy range, as is commonly assumed. We then compare our theoretical prediction for the tr-MCD for CoPt with experimental measurement and find excellent agreement at many different frequencies including the $M_{2 3}$-edge of Co and $N_{6 7}$- and $O_{2 3}$- edges of Pt.


title: A study of the corrections to factorization in $\bar{B}^0 \to D^{* +} \omega \pi^-$

abstract: A factorization hypothesis is tested by examining a form factor of the $\omega\pi$ production in hadronic $B^0 \to D^{\ast \pm}\omega\pi^\mp$ decays. The form factor is compared to that from available $\tau$-lepton as well as $e^+e^-$ data using the conserved vector current hypothesis. The difference of normalizations of form factor shapes from $B$ and $\tau~(e^+e^-)$ data indicates the important role of the large $N_c$ limit in QCD. Moreover, the growth of the difference between the form factors with the $\omega\pi$ invariant mass is related to the perturbative QCD corrections of factorization. The current precision of $B$ data does not allow one to find any evidence of corrections to factorization. A promising study could be performed with the Belle II and LHCb data sets.


title: Software-Defined Network-Based Vehicular Networks: A Position Paper on Their Modeling and Implementation

abstract: There is a strong devotion in the automotive industry to be part of a wider progression towards the Fifth Generation (5G) era. In-vehicle integration costs between cellular and vehicle-to-vehicle networks using Dedicated Short Range Communication could be avoided by adopting Cellular Vehicle-to-Everything (C-V2X) technology with the possibility to re-use the existing mobile network infrastructure. More and more, with the emergence of Software Defined Networks, the flexibility and the programmability of the network have not only impacted the design of new vehicular network architectures but also the implementation of V2X services in future intelligent transportation systems. In this paper, we define the concepts that help evaluate software-defined-based vehicular network systems in the literature based on their modeling and implementation schemes. We first overview the current studies available in the literature on C-V2X technology in support of V2X applications. We then present the different architectures and their underlying system models for LTE-V2X communications. We later describe the key ideas of software-defined networks and their concepts for V2X services. Lastly, we provide a comparative analysis of existing SDN-based vehicular network system grouped according to their modeling and simulation concepts. We provide a discussion and highlight vehicular ad-hoc networks' challenges handled by SDN-based vehicular networks.


title: Limits to surface-enhanced Raman scattering near arbitrary-shape scatterers

abstract: The low efficiency of Raman spectroscopy can be overcome by placing the active molecules in the vicinity of scatterers, typically rough surfaces or nanostructures with various shapes. This surface-enhanced Raman scattering (SERS) leads to substantial enhancement that depends on the scatterer that is used. In this work, we find fundamental upper bounds on the Raman enhancement for arbitrary-shaped scatterers, depending only on its material constants and the separation distance from the molecule. According to our metric, silver is optimal in visible wavelengths while aluminum is better in the near-UV region. Our general analytical bound scales as the volume of the scatterer and the inverse sixth power of the distance to the active molecule. Numerical computations show that simple geometries fall short of the bounds, suggesting further design opportunities for future improvement. For periodic scatterers, we use two formulations to discover different bounds, and the tighter of the two always must apply. Comparing these bounds suggests an optimal period depending on the volume of the scatterer.


title: Analogue two-dimensional semiconductor electronics

abstract: While digital electronics has become entirely ubiquitous in today's world and appears in the limelight, analogue electronics is still playing a crucial role in many devices and applications. Current analogue circuits are mostly manufactured using silicon as active material, but the ever present demand for improved performance, new devices and flexible integration has - similar to their digital counterparts - pushed for research into alternative materials. In recent years two-dimensional materials have received considerable research interest, fitting their promising properties for future electronics. In this work we demonstrate an operational amplifier - a basic building block of analogue electronics - using a two-dimensional semiconductor, namely molybdenum disulfide, as active material. Our device is capable of stable operation with good performance, and we demonstrate its use in feedback circuits such as inverting amplifiers, integrators, log amplifiers, and transimpedance amplifiers.


title: NEZHA: Neural Contextualized Representation for Chinese Language Understanding

abstract: The pre-trained language models have achieved great successes in various natural language understanding (NLU) tasks due to its capacity to capture the deep contextualized information in text by pre-training on large-scale corpora. In this technical report, we present our practice of pre-training language models named NEZHA (NEural contextualiZed representation for CHinese lAnguage understanding) on Chinese corpora and finetuning for the Chinese NLU tasks. The current version of NEZHA is based on BERT with a collection of proven improvements, which include Functional Relative Positional Encoding as an effective positional encoding scheme, Whole Word Masking strategy, Mixed Precision Training and the LAMB Optimizer in training the models. The experimental results show that NEZHA achieves the state-of-the-art performances when finetuned on several representative Chinese tasks, including named entity recognition (People's Daily NER), sentence matching (LCQMC), Chinese sentiment classification (ChnSenti) and natural language inference (XNLI).


title: Real-time image processing with a 2D semiconductor neural network vision sensor

abstract: In recent years, machine vision has taken huge leaps and is now becoming an integral part of various intelligent systems, including autonomous vehicles, robotics, and many others. Usually, visual information is captured by a frame-based camera, converted into a digital format, and processed afterwards using a machine learning algorithm such as an artificial neural network (ANN). A large amount of (mostly redundant) data being passed through the entire signal chain, however, results in low frame rates and large power consumption. Various visual data preprocessing techniques have thus been developed that allow to increase the efficiency of the subsequent signal processing in an ANN. Here, we demonstrate that an image sensor itself can constitute an ANN that is able to simultaneously sense and process optical images without latency. Our device is based on a reconfigurable two-dimensional (2D) semiconductor photodiode array, with the synaptic weights of the network being stored in a continuously tunable photoresponsivity matrix. We demonstrate both supervised and unsupervised learning and successfully train the sensor to classify and encode images, that are optically projected onto the chip, with a throughput of 20 million bins per second.


title: Push for Quantization: Deep Fisher Hashing

abstract: Current massive datasets demand light-weight access for analysis. Discrete hashing methods are thus beneficial because they map high-dimensional data to compact binary codes that are efficient to store and process, while preserving semantic similarity. To optimize powerful deep learning methods for image hashing, gradient-based methods are required. Binary codes, however, are discrete and thus have no continuous derivatives. Relaxing the problem by solving it in a continuous space and then quantizing the solution is not guaranteed to yield separable binary codes. The quantization needs to be included in the optimization. In this paper we push for quantization: We optimize maximum class separability in the binary space. We introduce a margin on distances between dissimilar image pairs as measured in the binary space. In addition to pair-wise distances, we draw inspiration from Fisher's Linear Discriminant Analysis (Fisher LDA) to maximize the binary distances between classes and at the same time minimize the binary distance of images within the same class. Experiments on CIFAR-10, NUS-WIDE and ImageNet100 demonstrate compact codes comparing favorably to the current state of the art.


title: On planes through points off the twisted cubic in $\mathrm{PG}(3,q)$ and multiple covering codes

abstract: Let $\mathrm{PG}(3,q)$ be the projective space of dimension three over the finite field with $q$ elements. Consider a twisted cubic in $\mathrm{PG}(3,q)$. The structure of the point-plane incidence matrix in $\mathrm{PG}(3,q)$ with respect to the orbits of points and planes under the action of the stabilizer group of the twisted cubic is described. This information is used to view generalized doubly-extended Reed-Solomon codes of codimension four as asymptotically optimal multiple covering codes.


title: Metrics and Uniform Harnack Inequality on the Strichartz Hexacarpet

abstract: We construct \emph{intrinsic} metrics on the Strichartz hexacarpet using weight functions and show that these metrics do \emph{not} satisfy the chain condition. We give uniform Harnack inequality on the approximating graphs of the Strichartz hexacarpet with respect to the intrinsic metrics instead of graph metrics.


title: The chemical structure of young high-mass star-forming clumps: (I) Deuteration

abstract: The chemical structure of high-mass star nurseries is important for a general understanding of star formation. Deuteration is a key chemical process in the earliest stages of star formation because its efficiency is sensitive to the environment. Using the IRAM-30 m telescope at 1.3--4.3 mm wavelengths, we have imaged two parsec-scale high-mass protostellar clumps (P1 and S) that show different evolutionary stages but are located in the same giant filamentary {infrared dark cloud} G28.34+0.06. Deep spectral images at subparsec resolution reveal the dust and gas physical structures of both clumps. We find that (1) the low-$J$ lines of $\rm N_2H^+$, HCN, HNC, and $\rm HCO^+$ isotopologues are subthermally excited; and (2) the deuteration of $\rm N_2H^+$ is more efficient than that of $\rm HCO^+$, HCN, and HNC by an order of magnitude. The deuterations of these species are enriched toward the chemically younger clump S compared with P1, indicating that this process favors the colder and denser environment ($\rm T_{kin} \sim14 K$, $\rm N(NH_3) \sim 9\times 10^{15}\,cm^{-2}$). In contrast, single deuteration of $\rm NH_3$ is insensitive to the environmental difference between P1 and S; and (3) single deuteration of $\rm CH_3OH$ ($\rm > 10\%$) is detected toward the location where CO shows a depletion of $\sim10$. This comparative chemical study between P1 and S links the chemical variations to the environmental differences and shows chemical similarities between the early phases of high- and low-mass star-forming regions.


title: Towards smart optical focusing: Deep learning-empowered wavefront shaping in nonstationary scattering media

abstract: Optical focusing at depths in tissue is the Holy Grail of biomedical optics that may bring revolutionary advancement to the field. Wavefront shaping is a widely accepted approach to solve this problem, but most implementations thus far have only operated with stationary media which, however, are scarcely existent in practice. In this article, we propose to apply a deep convolutional neural network named as ReFocusing-Optical-Transformation-Net (RFOTNet), which is a Multi-input Single-output network, to tackle the grand challenge of light focusing in nonstationary scattering media. As known, deep convolutional neural networks are intrinsically powerful to solve inverse scattering problems without complicated computation. Considering the optical speckles of the medium before and after moderate perturbations are correlated, an optical focus can be rapidly recovered based on fine-tuning of pre-trained neural networks, significantly reducing the time and computational cost in refocusing. The feasibility is validated experimentally in this work. The proposed deep learning-empowered wavefront shaping framework has great potentials in facilitating optimal optical focusing and imaging in deep and dynamic tissue.


title: Robust BGA Void Detection Using Multi Directional Scan Algorithms

abstract: The life time of electronic circuits board are impacted by the voids present in soldering balls. The quality inspection of solder balls by detecting and measuring the void is important to improve the board yield issues in electronic circuits. In general, the inspection is carried out manually, based on 2D or 3D X-ray images. For high quality inspection, it is difficult to detect and measure voids accurately with high repeatability through the manual inspection and it is time consuming process. In need of high quality and fast inspection, various approaches were proposed for void detection. But, lacks in robustness in dealing with various challenges like vias, reflections from the plating or vias, inconsistent lighting, noise, void-like artefacts, various void shapes, low resolution images and scalability to various devices. Robust BGA void detection becomes quite difficult problem, especially if the image size is very small (say, around 40x40) and with low contrast between void and the BGA background (say around 7 intensity levels on a scale of 255). In this work, we propose novel approach for void detection based on the multi directional scanning. The proposed approach is able to segment the voids for low resolution images and can be easily scaled to various electronic manufacturing products.


title: Fluorescence of rubidium vapor in a transient interaction regime

abstract: We have studied modification of the fluorescence spectra of a room-temperature atomic rubidium vapor in the region of $^{85}$Rb and $^{87}$Rb D$_2$ line while changing the temporal rate of linear (triangular) scanning of laser radiation frequency. Increase of the ramping speed over certain value ($\approx$ 10$^6$ MHz/s) results in essential modification of magnitudes of individual atomic transitions, different on rising and falling slopes, which characterize transition from a steady-state interaction regime to a transient one. Our experimental results are well consistent with the developed theoretical model. The obtained results can be used for determination of atomic system parameters such as ground-state relaxation rate. Possible follow-up actions on addressed control of atomic levels population is discussed.


title: Generalized 3x + 1 Mappings : counting cycles

abstract: We demonstrate that the number of cycles for two problems of the family of generalized 3x+1 mappings is possible finite.


title: An analogue of the Erd\H{o}s-Gallai theorem for random graphs

abstract: Recently, variants of many classical extremal theorems have been proved in the random environment. We, complementing existing results, extend the Erd\H{o}s-Gallai Theorem in random graphs. In particular, we determine, up to a constant factor, the maximum number of edges in a $P_n$-free subgraph of $G(N,p)$, practically for all values of $N,n$ and $p$. Our work is also motivated by the recent progress on the size-Ramsey number of paths.


title: QAInfomax: Learning Robust Question Answering System by Mutual Information Maximization

abstract: Standard accuracy metrics indicate that modern reading comprehension systems have achieved strong performance in many question answering datasets. However, the extent these systems truly understand language remains unknown, and existing systems are not good at distinguishing distractor sentences, which look related but do not actually answer the question. To address this problem, we propose QAInfomax as a regularizer in reading comprehension systems by maximizing mutual information among passages, a question, and its answer. QAInfomax helps regularize the model to not simply learn the superficial correlation for answering questions. The experiments show that our proposed QAInfomax achieves the state-of-the-art performance on the benchmark Adversarial-SQuAD dataset.


title: Conditions for Unnecessary Logical Constraints in Kernel Machines

abstract: A main property of support vector machines consists in the fact that only a small portion of the training data is significant to determine the maximum margin separating hyperplane in the feature space, the so called support vectors. In a similar way, in the general scheme of learning from constraints, where possibly several constraints are considered, some of them may turn out to be unnecessary with respect to the learning optimization, even if they are active for a given optimal solution. In this paper we extend the definition of support vector to support constraint and we provide some criteria to determine which constraints can be removed from the learning problem still yielding the same optimal solutions. In particular, we discuss the case of logical constraints expressed by Lukasiewicz logic, where both inferential and algebraic arguments can be considered. Some theoretical results that characterize the concept of unnecessary constraint are proved and explained by means of examples.


title: Charge regulation radically modifies electrostatics in membrane stacks

abstract: Motivated by biological membrane-containing organelles in plants and photosynthetic bacteria, we study charge regulation in a model membrane stack. Considering (de)protonation as the simplest mechanism of charge equilibration between the membranes and with the bathing environment, we uncover a symmetry-broken charge state in the stack with a quasiperiodic effective charge sequence. In the case of a monovalent bathing salt solution our model predicts complex, inhomogeneous charge equilibria depending on the strength of the (de)protonation reaction, salt concentration, intermembrane separation, and their number in the stack. Our results shed light on the basic reorganization mechanism of thylakoid membrane stacks.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.chem-ph


title: Epistemic Uncertainty Sampling

abstract: Various strategies for active learning have been proposed in the machine learning literature. In uncertainty sampling, which is among the most popular approaches, the active learner sequentially queries the label of those instances for which its current prediction is maximally uncertain. The predictions as well as the measures used to quantify the degree of uncertainty, such as entropy, are almost exclusively of a probabilistic nature. In this paper, we advocate a distinction between two different types of uncertainty, referred to as epistemic and aleatoric, in the context of active learning. Roughly speaking, these notions capture the reducible and the irreducible part of the total uncertainty in a prediction, respectively. We conjecture that, in uncertainty sampling, the usefulness of an instance is better reflected by its epistemic than by its aleatoric uncertainty. This leads us to suggest the principle of "epistemic uncertainty sampling", which we instantiate by means of a concrete approach for measuring epistemic and aleatoric uncertainty. In experimental studies, epistemic uncertainty sampling does indeed show promising performance.


title: Maximal entropy measures of diffeomorphisms of circle fiber bundles

abstract: We characterize the maximal entropy measures of partially hyperbolic C^2 diffeomorphisms whose center foliations form circle bundles, by means of suitable finite sets of saddle points, that we call skeletons. In the special case of 3-dimensional nilmanifolds other than the torus, this entails the following dichotomy: either the diffeomorphism is a rotation extension of an Anosov diffeomorphism -- in which case there is a unique maximal measure, with full support and zero center Lyapunov exponents -- or there exist exactly two ergodic maximal measures, both hyperbolic and whose center Lyapunov exponents have opposite signs. Moreover, the set of maximal measures varies continuously with the diffeomorphism.


title: Riesz means on symmetric spaces

abstract: Let $X$ be a non-compact symmetric space of dimension $n$. We prove that if $f\in L^{p}(X)$, $1\leq p\leq 2$, then the Riesz means $S_{R}^{z}\left( f\right)$ converge to $f$ almost everywhere as $R\rightarrow \infty $, whenever $\operatorname{Re}z>\left( n-\frac{1}{2}\right) \left( \frac{2}{p}-1\right) $.


title: D\'ej\`a vu: A data-centric forecasting approach through time series cross-similarity

abstract: Accurate forecasts are vital for supporting the decisions of modern companies. Forecasters typically select the most appropriate statistical model for each time series. However, statistical models usually presume some data generation process while making strong assumptions about the errors. In this paper, we present a novel data-centric approach -- `forecasting with similarity', which tackles model uncertainty in a model-free manner. Existing similarity-based methods focus on identifying similar patterns within the series, i.e., `self-similarity'. In contrast, we propose searching for similar patterns from a reference set, i.e., `cross-similarity'. Instead of extrapolating, the future paths of the similar series are aggregated to obtain the forecasts of the target series. Building on the cross-learning concept, our approach allows the application of similarity-based forecasting on series with limited lengths. We evaluate the approach using a rich collection of real data and show that it yields competitive accuracy in both points forecasts and prediction intervals.


title: Search for Dark Matter decay signals in the Galactic Halo with the MAGIC telescopes

abstract: MAGIC is a system of two Cherenkov telescopes located in the Canary island of La Palma. A key part of MAGIC Fundamental Physics program is the search for indirect signals of Dark Matter (DM) from different sources. In the Milky Way, DM forms an almost spherically symmetric halo, with a density peaked towards the center of the Galaxy and decreasing toward the outer region. We search for DM decay signals from the Galactic Halo, with a special methodology developed for this work. Our strategy is to compare pairs of observations performed at different angular distances from the Galactic Center, selected in such a way that all the diffuse components cancel out, except for those coming from the DM. In order to keep the systematic uncertainty of this novel background estimation method down to a minimum, the observation pairs have been acquired during the same nights and follow exactly the same azimuth and zenith paths. We collected 20 hours of data during 2018. Using half of them to determine the systematic uncertainty in the background estimation of our analysis, we obtain a value of 4.8\% with no dependence on energy. Accounting for this systematic uncertainty in the likelihood analysis based on the 10 remaining hours of data collected so far, we present the limit to TeV DM particle with a lifetime of $10^{26}$ s in the $\mathrm{b\bar{b}}$ decay channel.


title: Simple $k$-Planar Graphs are Simple $(k+1)$-Quasiplanar

abstract: A simple topological graph is $k$-quasiplanar ($k\geq 2$) if it contains no $k$ pairwise crossing edges, and $k$-planar if no edge is crossed more than $k$ times. In this paper, we explore the relationship between $k$-planarity and $k$-quasiplanarity to show that, for $k \geq 2$, every $k$-planar simple topological graph can be transformed into a $(k+1)$-quasiplanar simple topological graph.


title: AC charge transport in holographic Horndeski gravity

abstract: In this paper, we investigate the AC charge transport in the holographic Horndeski gravity and identify a metal-semiconductor like transition that is driven by the Horndeski coupling. Moreover, we fit our numeric data by the Drude formula in slow relaxation cases.


title: Statistical Robust Chinese Remainder Theorem for Multiple Numbers

abstract: Generalized Chinese Remainder Theorem (CRT) is a well-known approach to solve ambiguity resolution related problems. In this paper, we study the robust CRT reconstruction for multiple numbers from a view of statistics. To the best of our knowledge, it is the first rigorous analysis on the underlying statistical model of CRT-based multiple parameter estimation. To address the problem, two novel approaches are established. One is to directly calculate a conditional maximum a posteriori probability (MAP) estimation of the residue clustering, and the other is based on a generalized wrapped Gaussian mixture model to iteratively search for MAP of both estimands and clustering. Residue error correcting codes are introduced to improve the robustness further. Experimental results show that the statistical schemes achieve much stronger robustness compared to state-of-the-art deterministic schemes, especially in heavy-noise scenarios.


title: Small worlds and clustering in spatial networks

abstract: Networks with underlying metric spaces attract increasing research attention in network science, statistical physics, applied mathematics, computer science, sociology, and other fields. This attention is further amplified by the current surge of activity in graph embedding. In the vast realm of spatial network models, only a few reproduce even the most basic properties of real-world networks. Here, we focus on three such properties---sparsity, small worldness, and clustering---and identify the general subclass of spatial homogeneous and heterogeneous network models that are sparse small worlds and that have nonzero clustering in the thermodynamic limit. We rely on the maximum entropy approach where network links correspond to noninteracting fermions whose energy dependence on spatial distances determines network small worldness and clustering.


title: Spectrum of a Supersymmetric Color Superconductor

abstract: We have recently shown that the ground state of ${\cal N} = 4$, SU($N_{\rm{\tiny c}}$) super Yang--Mills coupled to $N_{\rm{\tiny f}} \ll N_{\rm{\tiny c}}$ flavors, in the presence of non-zero isospin and R-symmetry charges, is a supersymmetric, superfluid, color superconductor. The holographic description consists of $N_{\rm{\tiny f}}$ D7-brane probes in AdS$_5\times$S$^5$ with electric and instantonic fields on their worldvolume. These correspond to fundamental strings and D3-branes dissolved on the D7-branes, respectively. Here we use this description to determine the spectrum of mesonic excitations. As expected for a charged superfluid we find non-relativistic, massless Goldstone modes. We also find extra ungapped modes that are not associated to the breaking of any global symmetries but to the supersymmetric nature of the ground state. If the quark mass is much smaller than the scale of spontaneous symmetry breaking a pseudo-Goldstone boson is also present. We highlight some new features that appear only for $N_{\rm{\tiny f}}> 2$. We show that, in the generic case of unequal R-symmetry charges, the dissolved strings and D3-branes blow up into a D5-brane supertube stretched between the D7-branes.


title: Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphs

abstract: Document-level relation extraction is a complex human process that requires logical inference to extract relationships between named entities in text. Existing approaches use graph-based neural models with words as nodes and edges as relations between them, to encode relations across sentences. These models are node-based, i.e., they form pair representations based solely on the two target node representations. However, entity relations can be better expressed through unique edge representations formed as paths between nodes. We thus propose an edge-oriented graph neural model for document-level relation extraction. The model utilises different types of nodes and edges to create a document-level graph. An inference mechanism on the graph edges enables to learn intra- and inter-sentence relations using multi-instance learning internally. Experiments on two document-level biomedical datasets for chemical-disease and gene-disease associations show the usefulness of the proposed edge-oriented approach.


title: UPI-Net: Semantic Contour Detection in Placental Ultrasound

abstract: Semantic contour detection is a challenging problem that is often met in medical imaging, of which placental image analysis is a particular example. In this paper, we investigate utero-placental interface (UPI) detection in 2D placental ultrasound images by formulating it as a semantic contour detection problem. As opposed to natural images, placental ultrasound images contain specific anatomical structures thus have unique geometry. We argue it would be beneficial for UPI detectors to incorporate global context modelling in order to reduce unwanted false positive UPI predictions. Our approach, namely UPI-Net, aims to capture long-range dependencies in placenta geometry through lightweight global context modelling and effective multi-scale feature aggregation. We perform a subject-level 10-fold nested cross-validation on a placental ultrasound database (4,871 images with labelled UPI from 49 scans). Experimental results demonstrate that, without introducing considerable computational overhead, UPI-Net yields the highest performance in terms of standard contour detection metrics, compared to other competitive benchmarks.


title: Collaborative Policy Learning for Open Knowledge Graph Reasoning

abstract: In recent years, there has been a surge of interests in interpretable graph reasoning methods. However, these models often suffer from limited performance when working on sparse and incomplete graphs, due to the lack of evidential paths that can reach target entities. Here we study open knowledge graph reasoning---a task that aims to reason for missing facts over a graph augmented by a background text corpus. A key challenge of the task is to filter out "irrelevant" facts extracted from corpus, in order to maintain an effective search space during path inference. We propose a novel reinforcement learning framework to train two collaborative agents jointly, i.e., a multi-hop graph reasoner and a fact extractor. The fact extraction agent generates fact triples from corpora to enrich the graph on the fly; while the reasoning agent provides feedback to the fact extractor and guides it towards promoting facts that are helpful for the interpretable reasoning. Experiments on two public datasets demonstrate the effectiveness of the proposed approach. Source code and datasets used in this paper can be downloaded at https://github.com/shanzhenren/CPL


title: Warm dense matter simulation via electron temperature dependent deep potential molecular dynamics

abstract: Simulating warm dense matter that undergoes a wide range of temperatures and densities is challenging. Predictive theoretical models, such as quantum-mechanics-based first-principles molecular dynamics (FPMD), require a huge amount of computational resources. Herein, we propose a deep learning based scheme, called electron temperature dependent deep potential molecular dynamics (TDDPMD), for efficiently simulating warm dense matter with the accuracy of FPMD. The TDDPMD simulation is several orders of magnitudes faster than FPMD, and, unlike FPMD, its efficiency is not affected by the electron temperature. We apply the TDDPMD scheme to beryllium (Be) in a wide range of temperatures (0.4 to 2500 eV) and densities (3.50 to 8.25 g/cm$^3$). Our results demonstrate that the TDDPMD method not only accurately reproduces the structural properties of Be along the principal Hugoniot curve at the FPMD level, but also yields even more reliable diffusion coefficients than typical FPMD simulations due to its ability to simulate larger systems with longer time.