title: Study on Asymmetric Diffraction of Acoustic Parity-Time-Symmetric Gratings Using Rigorous Coupled-Wave Analysis

abstract: In PT-symmetric gratings, asymmetric diffraction can be generated by modulating the ratio between imaginary and real refractive indices. In this paper, a rigorous coupled-wave analysis (RCWA) has been developed to analyze the diffraction properties of acoustic PT-symmetric gratings with two kinds of modulating approaches, including modulating the effective modulus and the effective density. Asymmetric diffraction with both Bragg incident angles and perpendicular incident angles is discussed by using the RCWA method. Results show that the modulation ratio for the diffraction vanishing point changes with the modulation amplitude differently for two kinds of modulating approaches. Moreover, the sound energy will be weaken or be enhanced at Bragg incident angles depending on the sign of incident angles and the modulation ratio.


title: Zero-Shot Paraphrase Generation with Multilingual Language Models

abstract: Leveraging multilingual parallel texts to automatically generate paraphrases has drawn much attention as size of high-quality paraphrase corpus is limited. Round-trip translation, also known as the pivoting method, is a typical approach to this end. However, we notice that the pivoting process involves multiple machine translation models and is likely to incur semantic drift during the two-step translations. In this paper, inspired by the Transformer-based language models, we propose a simple and unified paraphrasing model, which is purely trained on multilingual parallel data and can conduct zero-shot paraphrase generation in one step. Compared with the pivoting approach, paraphrases generated by our model is more semantically similar to the input sentence. Moreover, since our model shares the same architecture as GPT (Radford et al., 2018), we are able to pre-train the model on large-scale unparallel corpus, which further improves the fluency of the output sentences. In addition, we introduce the mechanism of denoising auto-encoder (DAE) to improve diversity and robustness of the model. Experimental results show that our model surpasses the pivoting method in terms of relevance, diversity, fluency and efficiency.


title: Interactive Classification by Asking Informative Questions

abstract: We study the potential for interaction in natural language classification. We add a limited form of interaction for intent classification, where users provide an initial query using natural language, and the system asks for additional information using binary or multi-choice questions. At each turn, our system decides between asking the most informative question or making the final classification prediction.The simplicity of the model allows for bootstrapping of the system without interaction data, instead relying on simple crowdsourcing tasks. We evaluate our approach on two domains, showing the benefit of interaction and the advantage of learning to balance between asking additional questions and making the final prediction.


title: CenterFace: Joint Face Detection and Alignment Using Face as Point

abstract: Face detection and alignment in unconstrained environment is always deployed on edge devices which have limited memory storage and low computing power. This paper proposes a one-stage method named CenterFace to simultaneously predict facial box and landmark location with real-time speed and high accuracy. The proposed method also belongs to the anchor free category. This is achieved by: (a) learning face existing possibility by the semantic maps, (b) learning bounding box, offsets and five landmarks for each position that potentially contains a face. Specifically, the method can run in real-time on a single CPU core and 200 FPS using NVIDIA 2080TI for VGA-resolution images, and can simultaneously achieve superior accuracy (WIDER FACE Val/Test-Easy: 0.935/0.932, Medium: 0.924/0.921, Hard: 0.875/0.873 and FDDB discontinuous: 0.980, continuous: 0.732). A demo of CenterFace can be available at https://github.com/Star-Clouds/CenterFace.


title: Distributed Redundant Placement for Microservice-based Applications at the Edge

abstract: Multi-access Edge Computing (MEC) is booming as a promising paradigm to push the computation and communication resources from cloud to the network edge to provide services and to perform computations. With container technologies, mobile devices with small memory footprint can run composite microservice-based applications without time-consuming backbone. Service placement at the edge is of importance to put MEC from theory into practice. However, current state-of-the-art research does not sufficiently take the composite property of services into consideration. Besides, although Kubernetes has certain abilities to heal container failures, high availability cannot be ensured due to heterogeneity and variability of edge sites. To deal with these problems, we propose a distributed redundant placement framework SAA-RP and a GA-based Server Selection (GASS) algorithm for microservice-based applications with sequential combinatorial structure. We formulate a stochastic optimization problem with the uncertainty of microservice request considered, and then decide for each microservice, how it should be deployed and with how many instances as well as on which edge sites to place them. Benchmark policies are implemented in two scenarios, where redundancy is allowed and not, respectively. Numerical results based on a real-world dataset verify that GASS significantly outperforms all the benchmark policies.


title: Table-to-Text Natural Language Generation with Unseen Schemas

abstract: Traditional table-to-text natural language generation (NLG) tasks focus on generating text from schemas that are already seen in the training set. This limitation curbs their generalizabilities towards real-world scenarios, where the schemas of input tables are potentially infinite. In this paper, we propose the new task of table-to-text NLG with unseen schemas, which specifically aims to test the generalization of NLG for input tables with attribute types that never appear during training. To do this, we construct a new benchmark dataset for this task. To deal with the problem of unseen attribute types, we propose a new model that first aligns unseen table schemas to seen ones, and then generates text with updated table representations. Experimental evaluation on the new benchmark demonstrates that our model outperforms baseline methods by a large margin. In addition, comparison with standard data-to-text settings shows the challenges and uniqueness of our proposed task.


title: Charge Densities for Conducting Ellipsoids

abstract: The volume charge density for a conducting ellipsoid is expressed in simple geometrical terms, and then used to obtain the known surface charge density as well as the uniform charge per length along any principal axis. Corresponding results are presented for conducting hyperellipsoids in any number of spatial dimensions.


title: Dense 3D Reconstruction for Visual Tunnel Inspection using Unmanned Aerial Vehicle

abstract: Advances in Unmanned Aerial Vehicle (UAV) opens venues for application such as tunnel inspection. Owing to its versatility to fly inside the tunnels, it can quickly identify defects and potential problems related to safety. However, long tunnels, especially with repetitive or uniform structures pose a significant problem for UAV navigation. Furthermore, post-processing visual data from the camera mounted on the UAV is required to generate useful information for the inspection task. In this work, we design a UAV with a single rotating camera to accomplish the task. Compared to other platforms, our solution can fit the stringent requirement for tunnel inspection, in terms of battery life, size and weight. While the current state-of-the-art can estimate camera pose and 3D geometry from a sequence of images, they assume large overlap, small rotational motion, and many distinct matching points between images. These assumptions severely limit their effectiveness in tunnel-like scenarios where the camera has erratic or large rotational motion, such as the one mounted on the UAV. This paper presents a novel solution which exploits Structure-from-Motion, Bundle Adjustment, and available geometry priors to robustly estimate camera pose and automatically reconstruct a fully-dense 3D scene using the least possible number of images in various challenging tunnel-like environments. We validate our system with both Virtual Reality application and experimentation with a real dataset. The results demonstrate that the proposed reconstruction along with texture mapping allows for remote navigation and inspection of tunnel-like environments, even those which are inaccessible for humans.


title: A Simplified Fully Quantized Transformer for End-to-end Speech Recognition

abstract: While significant improvements have been made in recent years in terms of end-to-end automatic speech recognition (ASR) performance, such improvements were obtained through the use of very large neural networks, unfit for embedded use on edge devices. That being said, in this paper, we work on simplifying and compressing Transformer-based encoder-decoder architectures for the end-to-end ASR task. We empirically introduce a more compact Speech-Transformer by investigating the impact of discarding particular modules on the performance of the model. Moreover, we evaluate reducing the numerical precision of our network's weights and activations while maintaining the performance of the full-precision model. Our experiments show that we can reduce the number of parameters of the full-precision model and then further compress the model 4x by fully quantizing to 8-bit fixed point precision.


title: Worst-Case Analysis for Randomly Collected Data

abstract: We introduce a framework for statistical estimation that leverages knowledge of how samples are collected but makes no distributional assumptions on the data values. Specifically, we consider a population of elements $[n]={1,\ldots,n}$ with corresponding data values $x_1,\ldots,x_n$. We observe the values for a "sample" set $A \subset [n]$ and wish to estimate some statistic of the values for a "target" set $B \subset [n]$ where $B$ could be the entire set. Crucially, we assume that the sets $A$ and $B$ are drawn according to some known distribution $P$ over pairs of subsets of $[n]$. A given estimation algorithm is evaluated based on its "worst-case, expected error" where the expectation is with respect to the distribution $P$ from which the sample $A$ and target sets $B$ are drawn, and the worst-case is with respect to the data values $x_1,\ldots,x_n$. Within this framework, we give an efficient algorithm for estimating the target mean that returns a weighted combination of the sample values--where the weights are functions of the distribution $P$ and the sample and target sets $A$, $B$--and show that the worst-case expected error achieved by this algorithm is at most a multiplicative $\pi/2$ factor worse than the optimal of such algorithms. The algorithm and proof leverage a surprising connection to the Grothendieck problem. This framework, which makes no distributional assumptions on the data values but rather relies on knowledge of the data collection process, is a significant departure from typical estimation and introduces a uniform algorithmic analysis for the many natural settings where membership in a sample may be correlated with data values, such as when sampling probabilities vary as in "importance sampling", when individuals are recruited into a sample via a social network as in "snowball sampling", or when samples have chronological structure as in "selective prediction".


title: Correspondence of cosmology from non-extensive thermodynamics with fluids of generalized equation of state

abstract: We show that there is a correspondence between cosmology from non-extensive thermodynamics and cosmology with fluids of redefined and generalized equation of state. We first establish the correspondence in the case of basic non-extensive thermodynamics, and then we proceed by investigating the more consistent case, from the quantum field theoretical point of view, of varying exponent, namely depending on the scale. The obtained duality provides a way of explaining the complicated phenomenological forms of the effective fluid equation-of-state parameters that are being broadly used in the literature, since their microphysical origin may indeed lie in the non-extensive thermodynamics of spacetime. Finally, concerning the cosmological behavior, we show that at late times the effective fluid may drive the universe acceleration even in the absence of an explicit cosmological constant, and even if the initial fluid is the standard dust matter one. Similarly, at early times we obtain an effective cosmological constant which is enhanced through screening, and hence it can drive a a successful inflation without spoiling the correct late-time acceleration.


title: DeepMask: an algorithm for cloud and cloud shadow detection in optical satellite remote sensing images using deep residual network

abstract: Detecting and masking cloud and cloud shadow from satellite remote sensing images is a pervasive problem in the remote sensing community. Accurate and efficient detection of cloud and cloud shadow is an essential step to harness the value of remotely sensed data for almost all downstream analysis. DeepMask, a new algorithm for cloud and cloud shadow detection in optical satellite remote sensing imagery, is proposed in this study. DeepMask utilizes ResNet, a deep convolutional neural network, for pixel-level cloud mask generation. The algorithm is trained and evaluated on the Landsat 8 Cloud Cover Assessment Validation Dataset distributed across 8 different land types. Compared with CFMask, the most widely used cloud detection algorithm, land-type-specific DeepMask models achieve higher accuracy across all land types. The average accuracy is 93.56%, compared with 85.36% from CFMask. DeepMask also achieves 91.02% accuracy on all-land-type dataset. Compared with other CNN-based cloud mask algorithms, DeepMask benefits from the parsimonious architecture and the residual connection of ResNet. It is compatible with input of any size and shape. DeepMask still maintains high performance when using only red, green, blue, and NIR bands, indicating its potential to be applied to other satellite platforms that only have limited optical bands.


title: Positive Ricci curvature on fiber bundles with compact structure group

abstract: The aim of this paper is to present a direct and simple proof of a result concerning the existence of metrics of positive Ricci curvature on the total space of fiber bundles with compact structure groups. In particular, it also generalizes and puts in a unified framework the results in Nash \cite{nash} and Poor \cite{poor}. With the intention of disseminating this result, we apply it to build new examples of manifolds with positive Ricci curvature, including bundles whose base consists of gradient shrinking Ricci solitons.


title: Cellular Automata: Reversibility, Semi-reversibility and Randomness

abstract: In this dissertation, we study two of the global properties of 1-dimensional cellular automata (CAs) under periodic boundary condition, namely, reversibility and randomness. To address reversibility of finite CAs, we develop a mathematical tool, named reachability tree, which can efficiently characterize those CAs. A decision algorithm is proposed using minimized reachability tree which takes a CA rule and size n as input and verifies whether the CA is reversible for that n. To decide reversibility of a finite CA, we need to know both the rule and the CA size. However, for infinite CAs, reversibility is decided based on the local rule only. Therefore, apparently, these two cases seem to be divergent. This dissertation targets to construct a bridge between these two cases. To do so, reversibility of CAs is redefined and the notion of semi-reversible CAs is introduced. Hence, we propose a new classification of finite CAs -(1) reversible CAs, (2) semi-reversible CAs and (3) strictly irreversible CAs. Finally, relation between reversibility of finite and infinite CAs is established. This dissertation also explores CAs as source of randomness and build pseudo-random number generators (PRNGs) based on CAs. We identify a list of properties for a CA to be a good source of randomness. Two heuristic algorithms are proposed to synthesize candidate (decimal) CAs which have great potentiality as PRNGs. Two schemes tare developed o use these CAs as window-based PRNGs - (1) as decimal number generators and as (2) binary number generators. We empirically observe that in comparison to the best PRNG SFMT19937-64, average performance of our proposed PRNGs are slightly better. Hence, our decimal CAs based PRNGs are one of the best PRNGs today.


title: Unstable higher Toda brackets II

abstract: We define subscripted unstable higher Toda brackets and study their elementary properties. This paper is the continuation of our previous paper in which we defined the non-subscripted unstable higher Toda brackets.


title: Thallium Strontium Iodide: A High Efficiency Scintillator for Gamma-ray Detection

abstract: Europium-doped TlSr2I5 (TSI), a new high light yield scintillator for gamma-ray detection, has been grown by the vertical Bridgman method. A 12mm and 16mm diameter boules of TSI is grown in a two-zone vertical furnaces. Samples extracted from the grown boule have been characterized for their scintillation properties. Energy resolution of < 3% (FWHM) at 662 keV and a gamma-ray light yield of approximately 54,000 Ph/MeV have been obtained. Decay times of 395 ns (89%) and 2.0 microseconds (11%) have been measured.


title: Perturbation theories for symmetry-protected bound states in the continuum on two-dimensional periodic structures

abstract: On dielectric periodic structures with a reflection symmetry in a periodic direction, there can be antisymmetric standing waves (ASWs) that are symmetry-protected bound states in the continuum (BICs). The BICs have found many applications, mainly because they give rise to resonant modes of extremely large quality-factors ($Q$-factors). The ASWs are robust to symmetric perturbations of the structure, but they become resonant modes if the perturbation is non-symmetric. The $Q$-factor of a resonant mode on a perturbed structure is typically $O(1/\delta^2)$ where $\delta$ is the amplitude of the perturbation, but special perturbations can produce resonant modes with larger $Q$-factors. For two-dimensional (2D) periodic structures with a 1D periodicity, we derive conditions on the perturbation profile such that the $Q$-factors are $O(1/\delta^4)$ or $O(1/\delta^6)$. For the unperturbed structure, an ASW is surrounded by resonant modes with a nonzero Bloch wave vector. For 2D periodic structures, the $Q$-factors of nearby resonant modes are typically $O(1/\beta^2)$, where $\beta$ is the Bloch wavenumber. We show that the $Q$-factors can be $O(1/\beta^6)$ if the ASW satisfies a simple condition.


title: On the structure of variable exponent spaces

abstract: The first part of this paper surveys several results on the lattice structure of variable exponent Lebesgue function spaces (or Nakano spaces) $\lpv$. In the second part strictly singular and disjointly strictly singular operators between spaces $\lpv$ are studied. New results on the disjoint strict singularity of the inclusions $ L^{p(\cdot)}(\Omega) \hookrightarrow L^{q(\cdot)}(\Omega)$ are given.


title: Improving Machine Reading Comprehension via Adversarial Training

abstract: Adversarial training (AT) as a regularization method has proved its effectiveness in various tasks, such as image classification and text classification. Though there are successful applications of AT in many tasks of natural language processing (NLP), the mechanism behind it is still unclear. In this paper, we aim to apply AT on machine reading comprehension (MRC) and study its effects from multiple perspectives. We experiment with three different kinds of RC tasks: span-based RC, span-based RC with unanswerable questions and multi-choice RC. The experimental results show that the proposed method can improve the performance significantly and universally on SQuAD1.1, SQuAD2.0 and RACE. With virtual adversarial training (VAT), we explore the possibility of improving the RC models with semi-supervised learning and prove that examples from a different task are also beneficial. We also find that AT helps little in defending against artificial adversarial examples, but AT helps the model to learn better on examples that contain more low-frequency words.


title: Universal Flying Objects: Modular Multirotor System for Flight of Rigid Objects

abstract: We introduce UFO, a modular aerial robotic platform for transforming a rigid object into a multirotor robot. To achieve this, we develop flight modules, in the form of a control module and propelling modules, that can be affixed to an object. The object, or payload, serves as the airframe of the vehicle. The modular design produces a highly versatile platform as it is reconfigurable by the addition or removal of flight modules, adjustment of the modules' arrangement, or change of payloads. To facilitate the flight control, we propose an IMU-based estimation strategy for rapid computation of the robot's configuration. When combined with the adaptive geometric controller for further refinement of uncertain parameters, stable flights are accomplished with minimal manual intervention or tuning required by a user. To this end, we demonstrate hovering and trajectory tracking flights through various robot's configurations with different dummy payloads, weighing ~200-800 grams, using four to eight propelling modules. The results reveal that stable flights are attainable thanks to the proposed IMU-based estimation method. The flight performance is markedly improved over time through the adaptive scheme, with the position errors of a few centimeters after the parameter convergence.


title: Fully discrete polynomial de Rham sequences of arbitrary degree on polygons and polyhedra

abstract: In this work, merging ideas from compatible discretisations and polyhedral methods, we construct novel fully discrete polynomial de Rham sequences of arbitrary degree on polygons and polyhedra. The spaces and operators that appear in these sequences are directly amenable to computer implementation. Besides proving exactness, we show that the usual three-dimensional sequence of trimmed Finite Element spaces forms, through appropriate interpolation operators, a commutative diagram with our sequence, which ensures suitable approximation properties. A discussion on reconstructions of potentials and discrete $L^2$-products completes the exposition.


title: Stochastic Predictive Control under Intermittent Observations and Unreliable Actions

abstract: We propose a provably stabilizing and tractable approach for control of constrained linear systems under intermittent observations and unreliable transmissions of control commands. A smart sensor equipped with a Kalman filter is employed for the estimation of the states from incomplete and corrupt measurements, and an estimator at the controller side optimally feeds the intermittently received sensor data to the controller. The remote controller iteratively solves constrained stochastic optimal control problems and transmits the control commands according to a carefully designed transmission protocol through an unreliable channel. We present a (globally) recursively feasible quadratic program, which is solved online to yield a stabilizing controller for Lyapunov stable linear time invariant systems under any positive bound on control values and any non-zero transmission probabilities of Bernoulli channels.


title: Worst Cases Policy Gradients

abstract: Recent advances in deep reinforcement learning have demonstrated the capability of learning complex control policies from many types of environments. When learning policies for safety-critical applications, it is essential to be sensitive to risks and avoid catastrophic events. Towards this goal, we propose an actor-critic framework that models the uncertainty of the future and simultaneously learns a policy based on that uncertainty model. Specifically, given a distribution of the future return for any state and action, we optimize policies for varying levels of conditional Value-at-Risk. The learned policy can map the same state to different actions depending on the propensity for risk. We demonstrate the effectiveness of our approach in the domain of driving simulations, where we learn maneuvers in two scenarios. Our learned controller can dynamically select actions along a continuous axis, where safe and conservative behaviors are found at one end while riskier behaviors are found at the other. Finally, when testing with very different simulation parameters, our risk-averse policies generalize significantly better compared to other reinforcement learning approaches.


title: A conservative diffuse-interface method for compressible two-phase flows

abstract: In this article, we propose a novel conservative diffuse-interface method for the simulation of immiscible compressible two-phase flows. The proposed method discretely conserves the mass of each phase, momentum and total energy of the system. We use the baseline five-equation model and propose interface-regularization (diffusion--sharpening) terms in such a way that the resulting model maintains the conservative property of the underlying baseline model; and lets us use a central-difference scheme for the discretization of all the operators in the model, which leads to a non-dissipative implementation that is crucial for the simulation of turbulent flows and acoustics. Furthermore, the provable strengths of the proposed model are: (a) the model maintains the boundedness property of the volume fraction field, which is a physical realizability requirement for the simulation of two-phase flows, (b) the proposed model is such that the transport of volume fraction field inherently satisfies the total-variation-diminishing property without having to add any flux limiters that destroy the non-dissipative nature of the scheme, (c) the proposed interface-regularization terms in the model do not spuriously contribute to the kinetic energy of the system and therefore do not affect the non-linear stability of the numerical simulation, and (d) the model is consistent with the second law of thermodynamics. Finally, we present numerical simulations using the model and assess (a) the accuracy of evolution of the interface shape, (b) implementation of surface tension effects, (c) propagation of acoustics and their interaction with material interfaces, (d) the accuracy and robustness of the numerical scheme for simulation of complex high-Reynolds-number flows, and (e) performance and scalability of the method.


title: Adaptivity in Adaptive Submodularity

abstract: Adaptive sequential decision making is one of the central challenges in machine learning and artificial intelligence. In such problems, the goal is to design an interactive policy that plans for an action to take, from a finite set of $n$ actions, given some partial observations. It has been shown that in many applications such as active learning, robotics, sequential experimental design, and active detection, the utility function satisfies adaptive submodularity, a notion that generalizes the notion of diminishing returns to policies. In this paper, we revisit the power of adaptivity in maximizing an adaptive monotone submodular function. We propose an efficient semi adaptive policy that with $O(\log n \times\log k)$ adaptive rounds of observations can achieve an almost tight $1-1/e-\epsilon$ approximation guarantee with respect to an optimal policy that carries out $k$ actions in a fully sequential manner. To complement our results, we also show that it is impossible to achieve a constant factor approximation with $o(\log n)$ adaptive rounds. We also extend our result to the case of adaptive stochastic minimum cost coverage where the goal is to reach a desired utility $Q$ with the cheapest policy. We first prove the conjecture of the celebrated work of Golovin and Krause by showing that the greedy policy achieves the asymptotically tight logarithmic approximation guarantee without resorting to stronger notions of adaptivity. We then propose a semi adaptive policy that provides the same guarantee in polylogarithmic adaptive rounds through a similar information-parallelism scheme. Our results shrink the adaptivity gap in adaptive submodular maximization by an exponential factor.


title: Learning Deep Bilinear Transformation for Fine-grained Image Representation

abstract: Bilinear feature transformation has shown the state-of-the-art performance in learning fine-grained image representations. However, the computational cost to learn pairwise interactions between deep feature channels is prohibitively expensive, which restricts this powerful transformation to be used in deep neural networks. In this paper, we propose a deep bilinear transformation (DBT) block, which can be deeply stacked in convolutional neural networks to learn fine-grained image representations. The DBT block can uniformly divide input channels into several semantic groups. As bilinear transformation can be represented by calculating pairwise interactions within each group, the computational cost can be heavily relieved. The output of each block is further obtained by aggregating intra-group bilinear features, with residuals from the entire input features. We found that the proposed network achieves new state-of-the-art in several fine-grained image recognition benchmarks, including CUB-Bird, Stanford-Car, and FGVC-Aircraft.


title: Finite-time quantum Otto engine: Surpassing the quasi-static efficiency due to friction

abstract: In finite-time quantum heat engines, some work is consumed to drive a working fluid accompanying coherence, which is called `friction'. To understand the role of friction in quantum thermodynamics, we present a couple of finite-time quantum Otto cycles with two different baths: Agarwal versus Lindbladian. We solve them exactly and compare the performance of the Agarwal engine with that of the Lindbladian engine. In particular, we find remarkable and counterintuitive results that the performance of the Agarwal engine due to friction can be much higher than that in the quasistatic limit with the Otto efficiency, and the power of the Lindbladian engine can be nonzero in the short-time limit. Based on additional numerical calculations of these outcomes, we discuss possible origins of such differences between two engines and reveal them. Our results imply that even with an equilibrium bath, a nonequilibrium working fluid brings on the higher performance than what an equilibrium working fluid does.


title: Analyzing Bias in Sensitive Personal Information Used to Train Financial Models

abstract: Bias in data can have unintended consequences that propagate to the design, development, and deployment of machine learning models. In the financial services sector, this can result in discrimination from certain financial instruments and services. At the same time, data privacy is of paramount importance, and recent data breaches have seen reputational damage for large institutions. Presented in this paper is a trusted model-lifecycle management platform that attempts to ensure consumer data protection, anonymization, and fairness. Specifically, we examine how datasets can be reproduced using deep learning techniques to effectively retain important statistical features in datasets whilst simultaneously protecting data privacy and enabling safe and secure sharing of sensitive personal information beyond the current state-of-practice.


title: Natural and Realistic Single Image Super-Resolution with Explicit Natural Manifold Discrimination

abstract: Recently, many convolutional neural networks for single image super-resolution (SISR) have been proposed, which focus on reconstructing the high-resolution images in terms of objective distortion measures. However, the networks trained with objective loss functions generally fail to reconstruct the realistic fine textures and details that are essential for better perceptual quality. Recovering the realistic details remains a challenging problem, and only a few works have been proposed which aim at increasing the perceptual quality by generating enhanced textures. However, the generated fake details often make undesirable artifacts and the overall image looks somewhat unnatural. Therefore, in this paper, we present a new approach to reconstructing realistic super-resolved images with high perceptual quality, while maintaining the naturalness of the result. In particular, we focus on the domain prior properties of SISR problem. Specifically, we define the naturalness prior in the low-level domain and constrain the output image in the natural manifold, which eventually generates more natural and realistic images. Our results show better naturalness compared to the recent super-resolution algorithms including perception-oriented ones.


title: Recent developments in controlled crowd dynamics

abstract: We survey recent results on controlled particle systems. The control aspect introduces new challenges in the discussion of properties and suitable mean field limits. Some of the aspects are highlighted in a detailed discussion of a particular controlled particle dynamics. The applied techniques are shown on this simple problem to illustrate the basic methods. Computational results confirming the theoretical findings are presented and further particle models are discussed.

categories: math.OC cs.NA math-ph math.DS math.MP math.NA


title: Beyond Statistical Relations: Integrating Knowledge Relations into Style Correlations for Multi-Label Music Style Classification

abstract: Automatically labeling multiple styles for every song is a comprehensive application in all kinds of music websites. Recently, some researches explore review-driven multi-label music style classification and exploit style correlations for this task. However, their methods focus on mining the statistical relations between different music styles and only consider shallow style relations. Moreover, these statistical relations suffer from the underfitting problem because some music styles have little training data. To tackle these problems, we propose a novel knowledge relations integrated framework (KRF) to capture the complete style correlations, which jointly exploits the inherent relations between music styles according to external knowledge and their statistical relations. Based on the two types of relations, we use a graph convolutional network to learn the deep correlations between styles automatically. Experimental results show that our framework significantly outperforms state-of-the-art methods. Further studies demonstrate that our framework can effectively alleviate the underfitting problem and learn meaningful style correlations. The source code can be available at https://github.com/Makwen1995/MusicGenre.


title: Learning to Copy for Automatic Post-Editing

abstract: Automatic post-editing (APE), which aims to correct errors in the output of machine translation systems in a post-processing step, is an important task in natural language processing. While recent work has achieved considerable performance gains by using neural networks, how to model the copying mechanism for APE remains a challenge. In this work, we propose a new method for modeling copying for APE. To better identify translation errors, our method learns the representations of source sentences and system outputs in an interactive way. These representations are used to explicitly indicate which words in the system outputs should be copied, which is useful to help CopyNet (Gu et al., 2016) better generate post-edited translations. Experiments on the datasets of the WMT 2016-2017 APE shared tasks show that our approach outperforms all best published results.


title: Entangled States of Qutrit Bipartite System

abstract: We develop a systematic method to construct the Bell states of a qubit bipartite system while taking $SU(2)$ group as the basis group. An alternative formulation of fidelity, called $SU(2)$ fidelity, is proposed which gives the Bell-CHSH inequality. Taking analogy from the octet theory governed by the $SU(3)$ group, it is shown that the method can be easily generalized to derive all possible entangled states and the $SU(3)$ fidelity of the higher dimensional bipartite qutrit system. The properties of these states are studied which reveal the existence of some inequalities for the qutrit bipartite system.


title: Tit-for-Tat Dynamics and Market Volatility

abstract: We consider tit-for-tat dynamics in production markets, where there is a set of $n$ players connected via a weighted graph. Each player $i$ can produce an eponymous good using its linear production function, given as input various amounts of goods in the system. In the tit-for-tat dynamic, each player $i$ shares its good with its neighbors in fractions proportional to how much they helped player $i$'s production in the last round. Our contribution is to characterize the asymptotic behavior of the dynamic as a function of the graph structure, finding that the fortune of a player grows in the long term if and only if the player has a good self loop (i.e. the player works well alone) or works well with at least one other player. We also consider a generalized damped update, where the players may update their strategies with different speeds, and obtain a lower bound on their rate of growth by identifying a function that gives insight into the behavior of the dynamical system. The model can capture circular economies, where players use each other's products, and organizational partnerships, where fostering long-term growth of an organization hinges on creating relationships in which reciprocal exchanges between the agents in the organization are paramount.


title: Action Recognition Using Supervised Spiking Neural Networks

abstract: Biological neurons use spikes to process and learn temporally dynamic inputs in an energy and computationally efficient way. However, applying the state-of-the-art gradient-based supervised algorithms to spiking neural networks (SNN) is a challenge due to the non-differentiability of the activation function of spiking neurons. Employing surrogate gradients is one of the main solutions to overcome this challenge. Although SNNs naturally work in the temporal domain, recent studies have focused on developing SNNs to solve static image categorization tasks. In this paper, we employ a surrogate gradient descent learning algorithm to recognize twelve human hand gestures recorded by dynamic vision sensor (DVS) cameras. The proposed SNN could reach 97.2% recognition accuracy on test data.


title: Hierarchical Graph Network for Multi-hop Question Answering

abstract: In this paper, we present Hierarchical Graph Network (HGN) for multi-hop question answering. To aggregate clues from scattered texts across multiple paragraphs, a hierarchical graph is created by constructing nodes on different levels of granularity (questions, paragraphs, sentences, entities), the representations of which are initialized with pre-trained contextual encoders. Given this hierarchical graph, the initial node representations are updated through graph propagation, and multi-hop reasoning is performed via traversing through the graph edges for each subsequent sub-task (e.g., paragraph selection, supporting facts extraction, answer prediction). By weaving heterogeneous nodes into an integral unified graph, this hierarchical differentiation of node granularity enables HGN to support different question answering sub-tasks simultaneously. Experiments on the HotpotQA benchmark demonstrate that the proposed model achieves new state of the art, outperforming existing multi-hop QA approaches.


title: Smart Scheduling and Feedback Allocation over Non-stationary Wireless Channels

abstract: It is well known that opportunistic scheduling algorithms are throughput optimal under dynamic channel and network conditions. However, these algorithms achieve a hypothetical rate region which does not take into account the overhead associated with channel probing and feedback required to obtain the full channel state information at every slot. In this work, we design a joint scheduling and channel probing algorithm by considering the overhead of obtaining the channel state information. We adopt a correlated and non-stationary channel model, which is more realistic than those used in the literature. We use concepts from learning and information theory to accurately track channel variations to minimize the number of channels probed at every slot, while scheduling users to maximize the achievable rate region of the network. More specifically, we employ Gaussian Process Regression that enable us to predict future channel state and also provide a way to measure uncertainty in the learning and prediction. Simulation results show that with the proposed algorithm, the network can carry higher user traffic. The proposed solution can be utilized in more complex and heterogeneous environments such as 5G and beyond networks where the model free approach is needed.


title: Large Area Automated Characterisation of Chemical Vapour Deposition Grown Monolayer Transition Metal Dichalcogenides Through Photoluminescence Imaging

abstract: CVD growth is capable of producing multiple single crystal islands of atomically thin TMDs over large area substrates, with potential control of their morphology, lateral size, and epitaxial alignment to substrates with hexagonal symmetry. Subsequent merging of epitaxial domains can lead to single-crystal monolayer sheets - a step towards scalable production of high quality TMDs. For CVD growth to be effectively used for such production it is necessary to be able to rapidly assess the quality of material across entire large area substrates. To date characterisation has been limited to sub 0.1 mm2 areas, where the properties measured are not necessarily representative of an entire sample. Here, we apply photoluminescence (PL) imaging and computer vision techniques to create an automated analysis for large area samples of semiconducting TMDs, measuring the properties of island size, density of islands, relative PL intensity and homogeneity, and orientation of triangular domains. The analysis is applied to 20x magnification optical microscopy images that completely map samples of WSe2 on hBN, 5.0 mm x 5.0 mm in size, and MoSe2-WS2 on SiO2/Si, 11.2 mm x 5.8 mm in size. For the latter sample 100,245 objects were identified and their properties measured, with an orientation extracted from 27,779 objects that displayed a triangular morphology. In the substrates studied, two prevailing orientations of epitaxial growth were observed in WSe2 grown on hBN and four predominant orientations were observed in MoSe2, initially grown on c-plane sapphire. The proposed analysis will greatly reduce the time needed to study freshly synthesised material over large area substrates and provide feedback to optimise growth conditions, advancing techniques to produce high quality TMD monolayer sheets for commercial applications.


title: Inclusion-Exclusion-Like identities

abstract: An expression $E(X_{1},...,X_{n})$ built using union, intersection, and complements is called inclusion-exclusion-like if, like the union in the exclusion-inclusion principle, there are constants $c_{1},c_{2},...,c_{n}$ so that for any sequence of sets${ A=(A_{1},...,A_{n})}$ the cardinality of ${ E(A_{1},...,A_{n})}$ can be expressed as $\left|E(A_{1},...,A_{n})\right|=$$\sum_{k=1}^{n}c_{k}i_{n,k}(A)$ where $i_{n,k}(A)=\sum_{I\subseteq\overline{n},\left|I=k\right|}^{n}\left|\cap_{i\in I}A_{i}\right|$ is the sum of the cardinalities of all intersections of $k$ sets in the sequence $A$. In this paper, we construct, from the expression $E$, a set of nonempty subsets of $\left\{ 1,\ldots,n\right\} $ called the characteristic set of $E$, and using this set to give a necessary and sufficient condition for the expression to be inclusion-exclusion-like . Furthermore, we give a method for determining the constants $c_{1},c_{2},...,c_{n}$ in the expression for the cardinality of ${ E(A_{1},...,A_{n})}$ when it exists. The content of the paper is illustrated by a simple detailed example given in the introduction.


title: Tautological algebra of the moduli space of semistable bundles on an elliptic curve

abstract: In this paper, our aim is to find the relations amongst the cohomology classes of Brill-Noether subvarieties of the moduli space of semistable bundles over an elliptic curve. We obtain results similar to the Poincar\'e relations on a Jacobian variety.


title: On Traffic Flow with Nonlocal Flux: a Relaxation Representation

abstract: We consider a conservation law model of traffic flow, where the velocity of each car depends on a weighted average of the traffic density $\rho$ ahead. The averaging kernel is of exponential type: $w_\varepsilon(s)=\varepsilon ^{-1} e^{-s/\varepsilon}$. By a transformation of coordinates, the problem can be reformulated as a $2\times 2$ hyperbolic system with relaxation. Uniform BV bounds on the solution are thus obtained, independent of the scaling parameter $\varepsilon $. Letting $\varepsilon\to 0$, the limit yields a weak solution to the corresponding conservation law $\rho_t + ( \rho v(\rho))_x=0$. In the case where the velocity $v(\rho)= a-b\rho$ is affine, using the Hardy-Littlewood rearrangement inequality we prove that the limit is the unique entropy-admissible solution to the scalar conservation law.


title: Boundary-type Sets of Strong Product of Directed Graphs

abstract: Let $D=(V,E)$ be a strongly connected digraph and let $u ,v\in V(D)$. The maximum distance $md (u,v)$ is defined as\\ $md(u,v)$=max\{$\overrightarrow{d}(u,v), \overrightarrow{d}(v,u)$\} where $\overrightarrow{d}(u,v)$ denote the length of a shortest directed $u-v$ path in $D$. This is a metric. The boundary, contour, eccentric and peripheral sets of a strong digraph $D$ with respect to this metric have been defined, and the above said metrically defined sets of a large strong digraph $D$ have been investigated in terms of the factors in its prime factor decomposition with respect to Cartesian product. In this paper we investigate about the above boundary-type sets of a strong digraph $D$ in terms of the factors in its prime factor decomposition with respect to strong product.


title: Spin-orbit coupling in wurtzite quantum wells

abstract: Effective spin-orbit (SO) Hamiltonians for conduction electrons in wurtzite heterostructures are lacking in the literature, in contrast to zincblende structures. Here we address this issue by deriving such an effective Hamiltonian valid for quantum wells, wires, and dots with arbitrary confining potentials and external magnetic fields. We start from an 8$\times$8 Kane model accounting for the $s$--$p_z$ orbital mixing important to wurtzite structures, but absent in zincblende, and apply both quasi-degenerate perturbation theory (L\"owdin partitioning) and the folding down approach to derive an effective 2$\times$2 electron Hamiltonian. We obtain the usual $k$-linear Rashba term arising from the structural inversion asymmetry of the wells and, differently from zincblende structures, a bulk Rashba-type term induced by the inversion asymmetry of the wurtzite lattice. We also find linear- and cubic-in-momentum Dresselhaus contributions. Both the bulk Rashba-type term and the Dresselhaus terms originate exclusively from the admixture of $s$- and $p_z$-like states in wurtzites structures. Interestingly, in these systems the linear Rashba and the Dresselhaus terms have the same symmetry and can in principle cancel each other out completely, thus making the spin a conserved quantity. We determine the intrasubband (intersubband) Rashba $\alpha_\nu$ ($\eta$) and linear Dresselhaus $\beta_\nu$ ($\Gamma$) SO strengths of GaN/AlGaN single and double wells with one and two occupied subbands ($\nu=1,2$). We believe our general effective Hamiltonian for electrons in wurtzite heterostructures put forward here, should stimulate additional theoretical works on wurtzite quantum wells, wires, and dots with variously defined geometries and external magnetic fields.


title: Stability of a scalar potential under gravity

abstract: In the present note we show that the thin-wall approximation is not an assumption rather a necessary condition for satisfying Boucher's criteria for gravitational stability of the scalar potential.


title: Impact of crowders on the morphology of bacterial chromosomes

abstract: Inspired by recent experiments on the effects of cytosolic crowders on the organization of bacterial chromosomes, we consider a "feather-boa" type model chromosome in the presence of non-additive crowders, encapsulated within a cylindrical cell. We observe spontaneous emergence of complementary helicity of the confined polymer and crowders. This feature is reproduced within a simplified effective model of the chromosome. This latter model further establishes the occurrence of longitudinal and transverse spatial segregation transitions between the chromosome and crowders upon increasing crowder size.


title: (Co)Homology Self-closeness Numbers of Simply-connected Spaces

abstract: The (co)homology self-closeness number of a simply-connected based CW-complexes $X$ is the minimal number $k$ such that any self-map $f$ of $X$ inducing an automorphism of the (co)homology groups for dimensions$\leq k$ is a self-homotopy equivalence. These two numbers are homotopy invariants and have a close relation with the group of self-homotopy equivalences. In this paper, we compare the (co)homology self-closeness numbers of spaces in certain cofibrations, define the mod $p$ (co)homology self-closeness number of simply-connected $p$-local spaces with finitely generated homologies and study some properties of the (mod $p$) (co)homology self-closeness numbers.


title: Towards Understanding Gender Bias in Relation Extraction

abstract: Recent developments in Neural Relation Extraction (NRE) have made significant strides towards Automated Knowledge Base Construction (AKBC). While much attention has been dedicated towards improvements in accuracy, there have been no attempts in the literature to our knowledge to evaluate social biases in NRE systems. We create WikiGenderBias, a distantly supervised dataset with a human annotated test set. WikiGenderBias has sentences specifically curated to analyze gender bias in relation extraction systems. We use WikiGenderBias to evaluate systems for bias and find that NRE systems exhibit gender biased predictions and lay groundwork for future evaluation of bias in NRE. We also analyze how name anonymization, hard debiasing for word embeddings, and counterfactual data augmentation affect gender bias in predictions and performance.


title: Periodically-driven facilitated high-efficiency dissipative entanglement with Rydberg atoms

abstract: A time-dependent periodical field can be utilized to efficiently modify the Rabi coupling of system, exhibiting nontrivial dynamics. We propose a scheme to show that this feature can be applied for speeding up the formation of dissipative steady entanglement based on Rydberg anti-blockade mechanism in a simplified configuration, fundamentally stemming from a frequency match between the external-field modulation frequency and the systematic characteristic frequency. In the presence of an optimal modulation frequency that is exactly equal to the central frequency of driving field, it enables a sufficient residence time of the two-excitation Rydberg state for an irreversible spontaneous decay onto the target state, leading to an accelerated high-fidelity steady entanglement ~0.98, with a shorter formation time <400\mu s. We show that, a global maximal fidelity benefits from a consistence of microwave-field coupling and spontaneous decay strengths, by which the scheme promises a robust insensitivity to the initial population distributions. This simple approach to facilitate the generation of dissipative entangled two-qubit states by using periodic drivings may guide a new experimental direction in Rydberg quantum technology and quantum information.


title: Hate Speech Detection on Vietnamese Social Media Text using the Bi-GRU-LSTM-CNN Model

abstract: In recent years, Hate Speech Detection has become one of the interesting fields in natural language processing or computational linguistics. In this paper, we present the description of our system to solve this problem at the VLSP shared task 2019: Hate Speech Detection on Social Networks with the corpus which contains 20,345 human-labeled comments/posts for training and 5,086 for public-testing. We implement a deep learning method based on the Bi-GRU-LSTM-CNN classifier into this task. Our result in this task is 70.576% of F1-score, ranking the 5th of performance on public-test set.


title: Pairwise coupling of convolutional neural networks for better explicability of classification systems

abstract: We examine several aspects of explicability of a classification system built from neural networks. The first aspect is the pairwise explicability, which is the ability to provide the most accurate prediction when the range of possibilities is narrowed to just two. Next we consider explicability in development, which means ability to make incremental improvement in prediction accuracy based on observed deficiency of the system. Inherent stochasticity of neural network based classifiers can be interpreted using likelihood randomness explicability. Finally, sureness explicability indicates confidence of the classifying system to make any prediction at all. These concepts are examined in the framework of pairwise coupling, which is a non-trainable metamodel that originated during development of support vector machines. Several methodologies are evaluated, of which the key one is shown to be the choice of the pairwise coupling method. We compare two methods: the established Wu-Lin-Weng method with the recently proposed Bayes covariant method. Our experiments indicate that the Wu-Lin-Weng method gives more weight to a single pairwise classifier, whereas the latter tries to balance information from the whole matrix of pairwise likelihoods. This translates into higher accuracy, and better sureness predictions for the Bayes covariant method. Pairwise coupling methodology has its costs, especially in terms of the number of parameters (but not necessarily in terms of training costs). However, when additional explicability aspects beyond accuracy are desired in an application, the pairwise coupling models are a promising alternative to the established methodology.


title: East Asia VLBI Network observations of the TeV Gamma-Ray Burst 190114C

abstract: Observations of gamma-ray bursts (GRBs) at Very High Energy (VHE) offer a unique opportunity to investigate particle acceleration processes, magnetic fields and radiation fields in these events. Very Long Baseline Interferometry (VLBI) observations have been proven to be a powerful tool providing unique information on the source size of the GRBs at mas scales, as well as their accurate positions and possible expansion speeds. This paper reports on the follow-up observations of GRB 190114C, the first ever GRB detected with high significance at TeV photon energies by the MAGIC telescope, conducted with the East Asia VLBI Network (EAVN) at 22 GHz on three epochs, corresponding to 6, 15 and 32 days after the burst. The derived maps do not show any significant source above 5 sigma. The inferred upper limits on the GRB 190114C flux density at 22 GHz are used here to constrain the allowable two-dimensional parameter space for the afterglow emission. We find that our limits are consistent with most afterglow parameter combinations proposed so far in the literature. This is the first effort for the EAVN to search and monitor a radio transient in the Target of Opportunity mode. In addition to the useful constraints on GRB 190114C radio emission, experience gained from these observations is very helpful for future routine operation of EAVN transient program.


title: Schiffer comparison operators and approximations on Riemann surfaces bordered by quasicircles

abstract: We consider a compact Riemann surface $R$ of arbitrary genus, with a finite number of non-overlapping quasicircles, which separate $R$ into two subsets: a connected Riemann surface $\Sigma$, and the union $\mathcal{O}$ of a finite collection of simply-connected regions. We prove that the Schiffer integral operator mapping the Bergman space of anti-holomorphic one-forms on $\mathcal{O}$ to the Bergman space of holomorphic forms on $\Sigma$ is an isomorphism. We then apply this to prove versions of the Plemelj-Sokhotski isomorphism and jump decomposition for such a configuration. Finally we obtain some approximation theorems for the Bergman space of one-forms and Dirichlet space of holomorphic functions on $\Sigma$ by elements of Bergman space and Dirichlet space on fixed regions in $R$ containing $\Sigma$.


title: Hate Speech Detection on Vietnamese Social Media Text using the Bidirectional-LSTM Model

abstract: In this paper, we describe our system which participates in the shared task of Hate Speech Detection on Social Networks of VLSP 2019 evaluation campaign. We are provided with the pre-labeled dataset and an unlabeled dataset for social media comments or posts. Our mission is to pre-process and build machine learning models to classify comments/posts. In this report, we use Bidirectional Long Short-Term Memory to build the model that can predict labels for social media text according to Clean, Offensive, Hate. With this system, we achieve comparative results with 71.43% on the public standard test set of VLSP 2019.


title: Stable attractors in the three-dimensional general relativistic Poynting-Robertson effect

abstract: We prove the stability of the critical hypersurfaces associated with the three-dimensional general relativistic Poynting-Robertson effect. The equatorial ring configures to be as a stable attractor and the whole critical hypersurface as a basin of attraction for this dynamical system. We introduce a new, simpler (in terms of calculations), and more physical approach within the Lyapunov theory. We propose three different Lyapunov functions, each one carrying important information and very useful for understanding such phenomenon under different aspects.

categories: hep-th astro-ph.HE gr-qc math-ph math.MP


title: Topological defects of spin-orbit coupled Bose-Einstein condensates in a rotating anharmonic trap

abstract: We investigate the topological defects and spin structures of binary Bose-Einstein condensates (BECs) with Dresselhaus spin-orbit coupling (D-SOC) in a rotating anharmonic trap. Our results show that for initially mixed BECs without SOC the increasing rotation frequency can lead to the structural phase transition of the system. In the presence of isotropic D-SOC, the system sustains vortex pair,Anderson--Toulouse coreless vortices, circular vortex sheets, and combined vortex structures. In particular, when the rotation frequency is fixed above the radial trapping frequency the strong D-SOC results in a peculiar topological structure which is comprised of multi-layer visible vortex necklaces, hidden vortex necklaces and a hidden giant vortex. In addition, the system exhibits rich spin textures including basic skyrmion, meron cluster, skyrmion string and various skyrmion lattices. The skyrmions will be destroyed in the limit of large D-SOC or rotation frequency. Furthermore, the effects of anisotropic D-SOC and Rashba-Dresselhaus SOC on the topological structures of the system are discussed.


title: $C^0$ finite element approximations of linear elliptic equations in non-divergence form and Hamilton-Jacobi-Bellman equations with Cordes coefficients

abstract: This paper is concerned with $C^0$ (non-Lagrange) finite element approximations of the linear elliptic equations in non-divergence form and the Hamilton-Jacobi-Bellman (HJB) equations with Cordes coefficients. Motivated by the Miranda-Talenti estimate, a discrete analog is proved once the finite element space is $C^0$ on the $(n-1)$-dimensional subsimplex (face) and $C^1$ on $(n-2)$-dimensional subsimplex. The main novelty of the non-standard finite element methods is to introduce an interior penalty term to argument the PDE-induced variational form of the linear elliptic equations in non-divergence form or the HJB equations. As a distinctive feature of the proposed methods, no penalization or stabilization parameter is involved in the variational forms. As a consequence, the coercivity constant (resp. monotonicity constant) for the linear elliptic equations in non-divergence form (resp. the HJB equations) at discrete level is exactly the same as that from PDE theory. The quasi-optimal order error estimates as well as the convergence of the semismooth Newton method are established. Numerical experiments are provided to validate the convergence theory and to illustrate the accuracy and computational efficiency of the proposed methods.


title: Tangency property and prior-saturation points in minimal time problems in the plane

abstract: In this paper, we consider minimal time problems governed by control-affine-systems in the plane, and we focus on the synthesis problem in presence of a singular locus that involves a saturation point for the singular control. After giving sufficient conditions on the data ensuring occurence of a prior-saturation point and a switching curve, we show that the bridge (i.e., the optimal bang arc issued from the singular locus at this point) is tangent to the switching curve at the prior-saturation point. This property is proved using the Pontryagin Maximum Principle that also provides a set of non-linear equations that can be used to compute the prior-saturation point. These issues are illustrated on a fed-batch model in bioprocesses and on a Magnetic Resonance Imaging (MRI) model for which minimal time syntheses for the point-to-point problem are discussed.


title: Protecting from Malware Obfuscation Attacks through Adversarial Risk Analysis

abstract: Malware constitutes a major global risk affecting millions of users each year. Standard algorithms in detection systems perform insufficiently when dealing with malware passed through obfuscation tools. We illustrate this studying in detail an open source metamorphic software, making use of a hybrid framework to obtain the relevant features from binaries. We then provide an improved alternative solution based on adversarial risk analysis which we illustrate describe with an example.


title: L-FGADMM: Layer-Wise Federated Group ADMM for Communication Efficient Decentralized Deep Learning

abstract: This article proposes a communication-efficient decentralized deep learning algorithm, coined layer-wise federated group ADMM (L-FGADMM). To minimize an empirical risk, every worker in L-FGADMM periodically communicates with two neighbors, in which the periods are separately adjusted for different layers of its deep neural network. A constrained optimization problem for this setting is formulated and solved using the stochastic version of GADMM proposed in our prior work. Numerical evaluations show that by less frequently exchanging the largest layer, L-FGADMM can significantly reduce the communication cost, without compromising the convergence speed. Surprisingly, despite less exchanged information and decentralized operations, intermittently skipping the largest layer consensus in L-FGADMM creates a regularizing effect, thereby achieving the test accuracy as high as federated learning (FL), a baseline method with the entire layer consensus by the aid of a central entity.


title: DataSist: A Python-based library for easy data analysis, visualization and modeling

abstract: A large amount of data is produced every second from modern information systems such as mobile devices, the world wide web, Internet of Things, social media, etc. Analysis and mining of this massive data requires a lot of advanced tools and techniques. Therefore, big data analytics and mining is currently an active and trending area of research because of the enormous benefits businesses and organizations derive from it. Numerous tools like Pandas, Numpy, STATA, SPSS, have been created to help analyze and mine these huge outburst of data and some have become so popular and widely used in the field. This paper presents a new python-based library, DataSist, which offers high level, intuitive and easy to use functions, and methods that helps data scientists/analyst to quickly analyze, mine and visualize big data sets. The objectives of this project were to (i) design a python library to aid data analysis process by abstracting low level syntax, (ii) increase productivity of data scientist by making them focus on what to do rather than how to do it. This project shows that data analysis can be automated and much faster when we abstract certain functions, and will serve as an important tool in the workflow of data scientists.


title: Visible actions and criteria for multiplicity-freeness of representations of Heisenberg groups

abstract: A visible action on a complex manifold is a holomorphic action that admits a $J$-transversal totally real submanifold $S$. It is said to be strongly visible if there exists an orbit-preserving anti-holomorphic diffeomorphism $\sigma $ such that $\sigma |_S = \operatorname{id}_S$. Let $G$ be the Heisenberg group and $H$ a non-trivial connected closed subgroup of $G$. We prove that any complex homogeneous space $D = G^{\mathbb{C}}/H^{\mathbb{C}}$ admits a strongly visible $L$-action, where $L$ stands for a connected closed subgroup of $G$ explicitly constructed through a co-exponential basis of $H$ in $G$. This leads in turn that $G$ itself acts strongly visibly on $D$. The proof is carried out by finding explicitly an orbit-preserving anti-holomorphic diffeomorphism and a totally real submanifold $S$, for which the dimension depends upon the dimensions of $G$ and $H$. As a direct application, our geometric results provide a proof of various multiplicity-free theorems on continuous representations on the space of holomorphic sections on $D$. Moreover, we also generate as a consequence, a geometric criterion for a quasi-regular representation of $G$ to be multiplicity-free.


title: Interaction-Range Effects and Universality in the BCS-BEC Crossover of Spin-Orbit Coupled Fermi Gases

abstract: We explore the evolution of a ultracold quantum gas of interacting fermions crossing from a Bardeen-Cooper-Schrieffer (BCS) superfluidity to a Bose-Einstein condensation (BEC) of molecular bosons in the presence of a tunable-range interaction among the fermions and of an artificial magnetic field, which can be used to simulate a pseudo-spin-orbit coupling (SOC) and to produce topological states. We find that the crossover is affected by a competition between the finite range of the interaction and the SOC and that the threshold $\lambda_B$ for the topological transition is affected by the interactions only in the small pair size, BEC-like, regime. Below $\lambda_B$, we find persistence of universal behavior in the critical temperature, chemical potential, and condensate fraction, provided that the pair correlation length is used as a driving parameter. Above threshold, universality is lost in the regime of large pair sizes. Here, the limiting ground state departs from a weakly-interacting BCS-like, so that a different description is required. Our results can be relevant in view of current experiments with cold atoms in optical cavities, where tunable-range effective atomic interactions can be engineered.


title: Missing Features Reconstruction and Its Impact on Classification Accuracy

abstract: In real-world applications, we can encounter situations when a well-trained model has to be used to predict from a damaged dataset. The damage caused by missing or corrupted values can be either on the level of individual instances or on the level of entire features. Both situations have a negative impact on the usability of the model on such a dataset. This paper focuses on the scenario where entire features are missing which can be understood as a specific case of transfer learning. Our aim is to experimentally research the influence of various imputation methods on the performance of several classification models. The imputation impact is researched on a combination of traditional methods such as k-NN, linear regression, and MICE compared to modern imputation methods such as multi-layer perceptron (MLP) and gradient boosted trees (XGBT). For linear regression, MLP, and XGBT we also propose two approaches to using them for multiple features imputation. The experiments were performed on both real world and artificial datasets with continuous features where different numbers of features, varying from one feature to 50%, were missing. The results show that MICE and linear regression are generally good imputers regardless of the conditions. On the other hand, the performance of MLP and XGBT is strongly dataset dependent. Their performance is the best in some cases, but more often they perform worse than MICE or linear regression.


title: Locally equivalent Floer complexes and unoriented link cobordisms

abstract: We show that the local equivalence class of the collapsed link Floer complex $cCFL^\infty(L)$, together with many $\Upsilon$-type invariants extracted from this group, is a concordance invariant of links. In particular, we define a version of the invariants $\Upsilon_L(t)$ and $\nu^+(L)$ when $L$ is a link and we prove that they give a lower bound for the slice genus $g_4(L)$. Furthermore, in the last section of the paper we study the homology group $HFL'(L)$ and its behaviour under unoriented cobordisms. We obtain that a normalized version of the $\upsilon$-set, introduced by Ozsv\'ath, Stipsicz and Szab\'o, produces a lower bound for the 4-dimensional smooth crosscap number $\gamma_4(L)$.


title: Exact solutions of Einstein-aether gravity in Bianchi Type V Cosmology

abstract: We present the solution space of the field equations in the Einstein-aether theory for the case of a vacuum Bianchi Type V space-time. We also find that there are portions of the initial parameters space for which no solution is admitted by the reduced equations. Whenever solutions do exist, their physical interpretation is examined through the behavior of Ricci and/or Kretsmann scalar, as well as with the identification of the effective energy momentum tensor in terms of a perfect fluid. There are cases in which no singularities appear and others where the effective fluid is isotropic.


title: Cost for a controlled linear KdV equation

abstract: The controllability of the linearized KdV equation with right Neumann control is studied in the pioneering work of Rosier [25]. However, the proof is by contradiction arguments and the value of the observability constant remains unknown, though rich mathematical theories are built on this totally unknown constant. We introduce a constructive method that gives the quantitative value of this constant.


title: Influence of single observations on the choice of the penalty parameter in ridge regression

abstract: Penalized regression methods such as ridge regression heavily rely on the choice of a tuning or penalty parameter, which is often computed via cross-validation. Discrepancies in the value of the penalty parameter may lead to substantial differences in regression coefficient estimates and predictions. In this paper, we investigate the effect of single observations on the optimal choice of the tuning parameter, showing how the presence of influential points can change it dramatically. We distinguish between points as ``expanders'' and ``shrinkers'', based on their effect on the model complexity. Our approach supplies a visual exploratory tool to identify influential points, naturally implementable for high-dimensional data where traditional approaches usually fail. Applications to simulated and real data examples, both low- and high-dimensional, are presented. The visual tool is implemented in the R package influridge.


title: Style is NOT a single variable: Case Studies for Cross-Style Language Understanding

abstract: Every natural text is written in some style. Style is formed by a complex combination of different stylistic factors, including formality markers, emotions, metaphors, etc. One cannot form a complete understanding of a text without considering these factors. The factors combine and co-vary in complex ways to form styles. Studying the nature of the co-varying combinations sheds light on stylistic language in general, sometimes called cross-style language understanding. This paper provides the benchmark corpus (xSLUE) that combines existing datasets and collects a new one for sentence-level cross-style language understanding and evaluation. The benchmark contains text in 15 different styles under the proposed four theoretical groupings: figurative, personal, affective, and interpersonal groups. For valid evaluation, we collect an additional diagnostic set by annotating all 15 styles on the same text. Using xSLUE, we propose three interesting cross-style applications in classification, correlation, and generation. First, our proposed cross-style classifier trained with multiple styles together helps improve overall classification performance against individually-trained style classifiers. Second, our study shows that some styles are highly dependent on each other in human-written text. Finally, we find that combinations of some contradictive styles likely generate stylistically less appropriate text. We believe our benchmark and case studies help explore interesting future directions for cross-style research. The preprocessed datasets and code are publicly available.


title: Generation of macroscopic entangled cat states in a molecular cavity-QED system

abstract: Macroscopic entangled cat states not only are significant in the demonstration of the fundamentals of quantum physics, but also have wide applications in modern quantum technologies such as continuous-variable quantum information processing and quantum metrology. Here we propose a scheme for generation of macroscopic entangled cat states in a molecular cavity-QED system, which is composed of an organic molecule (including electronic and vibrational states) coupled to a single-mode cavity field. By simultaneously modulating the resonance frequencies of the molecular vibration and the cavity field, the molecular vibrational displacement can be enhanced significantly and hence macroscopic entangled cat states between the molecular vibrational mode and the cavity mode can be created. We also study quantum coherence effects in the generated states by calculating the joint Wigner function and the degree of entanglement. The dissipation effects are included by considering the state generation in the open-system case. Our results will pave the way to the study of quantum physics and quantum chemistry in molecular cavity-QED systems.


title: New types of topological superconductors under local magnetic symmetries

abstract: We classify gapped topological superconducting (TSC) phases of one-dimensional quantum wires with local magnetic symmetries (LMSs), in which the time-reversal symmetry $\mathcal{T}$ is broken but its combinations with certain crystalline symmetry such as $M_x \mathcal{T}$, $C_{2z} \mathcal{T}$, $C_{4z}\mathcal{T}$, and $C_{6z}\mathcal{T}$ are preserved. Our results demonstrate that an equivalent BDI class TSC can be realized in the $M_x \mathcal{T}$ or $C_{2z} \mathcal{T}$ superconducting wire, which is characterized by a chiral $Z^c$ invariant. More interestingly, we also find two types of totally new TSC phases in the $C_{4z}\mathcal{T}$, and $C_{6z}\mathcal{T}$ superconducing wires, which are beyond the known AZ class, and are characterized by a helical $Z^h$ invariant and $Z^h\oplus Z^c$ invariants, respectively. In the $Z^h$ TSC phase, $Z$-pairs of MZMs are protected at each end. In the $C_{6z}\mathcal{T}$ case, the MZMs can be either chiral or helical, and even helical-chiral coexisting. The minimal models preserving $C_{4z}\mathcal{T}$ or $C_{6z}\mathcal{T}$ symmetry are presented to illustrate their novel TSC properties and MZMs.


title: The rotating rigid body model based on a non-twisting frame

abstract: This work proposes and investigates a new model of the rotating rigid body based on the non-twisting frame. Such a frame consists of three mutually orthogonal unit vectors whose rotation rate around one of the three axis remains zero at all times and thus, is represented by a nonholonomic restriction. Then, the corresponding Lagrange-D'Alembert equations are formulated by employing two descriptions, the first one relying on rotations and a splitting approach, and the second one relying on constrained directors. For vanishing external moments, we prove that the new model possesses conservation laws, i.e., the kinetic energy and two nonholonomic momenta that substantially differ from the holonomic momenta preserved by the standard rigid body model. Additionally, we propose a new specialization of a class of energy-momentum integration schemes that exactly preserves the kinetic energy and the nonholonomic momenta replicating the continuous counterpart. Finally, we present numerical results that show the excellent conservation properties as well as the accuracy for the time-discretized governing equations.

categories: physics.class-ph cs.NA math-ph math.MP math.NA


title: Factored Latent-Dynamic Conditional Random Fields for Single and Multi-label Sequence Modeling

abstract: Conditional Random Fields (CRF) are frequently applied for labeling and segmenting sequence data. Morency et al. (2007) introduced hidden state variables in a labeled CRF structure in order to model the latent dynamics within class labels, thus improving the labeling performance. Such a model is known as Latent-Dynamic CRF (LDCRF). We present Factored LDCRF (FLDCRF), a structure that allows multiple latent dynamics of the class labels to interact with each other. Including such latent-dynamic interactions leads to improved labeling performance on single-label and multi-label sequence modeling tasks. We apply our FLDCRF models on two single-label (one nested cross-validation) and one multi-label sequence tagging (nested cross-validation) experiments across two different datasets - UCI gesture phase data and UCI opportunity data. FLDCRF outperforms all state-of-the-art sequence models, i.e., CRF, LDCRF, LSTM, LSTM-CRF, Factorial CRF, Coupled CRF and a multi-label LSTM model in all our experiments. In addition, LSTM based models display inconsistent performance across validation and test data, and pose diffculty to select models on validation data during our experiments. FLDCRF offers easier model selection, consistency across validation and test performance and lucid model intuition. FLDCRF is also much faster to train compared to LSTM, even without a GPU. FLDCRF outshines the best LSTM model by ~4% on a single-label task on UCI gesture phase data and outperforms LSTM performance by ~2% on average across nested cross-validation test sets on the multi-label sequence tagging experiment on UCI opportunity data. The idea of FLDCRF can be extended to joint (multi-agent interactions) and heterogeneous (discrete and continuous) state space models.


title: Multi-Perspective Inferrer: Reasoning Sentences Relationship from Holistic Perspective

abstract: Natural Language Inference (NLI) aims to determine the logic relationships (i.e., entailment, neutral and contradiction) between a pair of premise and hypothesis. Recently, the alignment mechanism effectively helps NLI by capturing the aligned parts (i.e., the similar segments) in the sentence pairs, which imply the perspective of entailment and contradiction. However, these aligned parts will sometimes mislead the judgment of neutral relations. Intuitively, NLI should rely more on multiple perspectives to form a holistic view to eliminate bias. In this paper, we propose the Multi-Perspective Inferrer (MPI), a novel NLI model that reasons relationships from multiple perspectives associated with the three relationships. The MPI determines the perspectives of different parts of the sentences via a routing-by-agreement policy and makes the final decision from a holistic view. Additionally, we introduce an auxiliary supervised signal to ensure the MPI to learn the expected perspectives. Experiments on SNLI and MultiNLI show that 1) the MPI achieves substantial improvements on the base model, which verifies the motivation of multi-perspective inference; 2) visualized evidence verifies that the MPI learns highly interpretable perspectives as expected; 3) more importantly, the MPI is architecture-free and compatible with the powerful BERT.


title: Reflectometry with registration of secondary radiation at total neutron reflection

abstract: Neutron reflectometry is a method for measuring of the spatial dependence (profile) of the potential interaction between neutron and medium. At interface of media the interaction potential is the sum of the elements potentials. For definition of potentials of separate elements (isotopes) a secondary radiation is recorded. Recording channels of secondary radiation are created on spectrometer REMUR at pulsed reactor IBR-2 in Dubna (Russia). The results for testing of the channels are reported and perspectives of reflectometry with registration of secondary radiation are discussed


title: Decays of charged $B$-mesons into three charged leptons and a neutrino

abstract: In the framework of the Standard Model we present predictions for partial widths, double and single differential distributions, and forward--backward lepton asymmetries for four-leptonic decays $B^- \to \mu^+\mu^- {\bar \nu}_e\, e^-$, $B^- \to e^+ e^- {\bar \nu}_\mu\,\mu^-$, $B^- \to \mu^+ \mu^-{\bar \nu}_\mu\,\mu^-$, and $B^- \to e^+ e^- {\bar \nu}_e\, e^-$. We consider the contributions of virtual photon emission from the light and heavy quarks of the $B^-$--meson, and we include bremsstrahlung of a virtual photon from the charged lepton in the final state. We use the model of vector meson dominance for calculation of virtual photon emission by the light quark of the $B^-$--meson and take into account the isotopic correction.


title: Bayesian Active Learning for Structured Output Design

abstract: In this paper, we propose an active learning method for an inverse problem that aims to find an input that achieves a desired structured-output. The proposed method provides new acquisition functions for minimizing the error between the desired structured-output and the prediction of a Gaussian process model, by effectively incorporating the correlation between multiple outputs of the underlying multi-valued black box output functions. The effectiveness of the proposed method is verified by applying it to two synthetic shape search problem and real data. In the real data experiment, we tackle the input parameter search which achieves the desired crystal growth rate in silicon carbide (SiC) crystal growth modeling, that is a problem of materials informatics.


title: Synchronized L\'evy queues

abstract: We consider a multivariate L\'evy process where the first coordinate is a L\'evy process with no negative jumps which is not a subordinator and the others are nondecreasing. We determine the Laplace-Stieltjes transform of the steady-state buffer content vector of an associated system of parallel queues. The special structure of this transform allows us to rewrite it as a product of joint Laplace-Stieltjes transforms. We are thus able to interpret the buffer content vector as a sum of independent random vectors.


title: Thermalization of local observables in the $\alpha$-FPUT chain

abstract: Most studies on the problem of equilibration of the Fermi-Pasta-Ulam-Tsingou (FPUT) system have focused on equipartition of energy being attained amongst the normal modes of the corresponding harmonic system. In the present work, we instead discuss the equilibration problem in terms of local variables, and consider initial conditions corresponding to spatially localized energy. We estimate the time-scales for equipartition of space localized degrees of freedom and find significant differences with the times scales observed for normal modes. Measuring thermalization in classical systems necessarily requires some averaging, and this could involve one over initial conditions or over time or spatial averaging. Here we consider averaging over initial conditions chosen from a narrow distribution in phase space. We examine in detail the effect of the width of the initial phase space distribution, and of integrability and chaos, on the time scales for thermalization. We show how thermalization properties of the system, quantified by its equilibration time, defined in this work, can be related to chaos, given by the maximal Lyapunov exponent. Somewhat surprisingly we also find that the ensemble averaging can lead to thermalization of the integrable Toda chain, though on much longer time scales.


title: Preservation of Anomalous Subgroups On Machine Learning Transformed Data

abstract: In this paper, we investigate the effect of machine learning based anonymization on anomalous subgroup preservation. In particular, we train a binary classifier to discover the most anomalous subgroup in a dataset by maximizing the bias between the group's predicted odds ratio from the model and observed odds ratio from the data. We then perform anonymization using a variational autoencoder (VAE) to synthesize an entirely new dataset that would ideally be drawn from the distribution of the original data. We repeat the anomalous subgroup discovery task on the new data and compare it to what was identified pre-anonymization. We evaluated our approach using publicly available datasets from the financial industry. Our evaluation confirmed that the approach was able to produce synthetic datasets that preserved a high level of subgroup differentiation as identified initially in the original dataset. Such a distinction was maintained while having distinctly different records between the synthetic and original dataset. Finally, we packed the above end to end process into what we call Utility Guaranteed Deep Privacy (UGDP) system. UGDP can be easily extended to onboard alternative generative approaches such as GANs to synthesize tabular data.


title: A Fractal Analysis of Magnetograms within Active Regions

abstract: The magnetograms of sixteen Active Regions, observed during June - November 2015, were obtained from the Joint Science Operations Center and used to determine the fractal dimensions of various magnetic field groups. The fields were divided into strong (positive and negative) and weak (positive and negative) groupings. The area-perimeter method was used to determine the fractal dimensions for the umbral and penumbral regions of the magnetograms. The fractal dimensions were found to be 1.79 \pm 0.49 and 1.96 \pm 0.29 for strong and weak magnetic fields respectively. When compared to the umbral and penumbral fractal dimensions determined by (Rajkumar, Haque and Hrudey, 2017) using white light images, an inverse relationship was found, with the umbra showing lower fractal dimensions than the penumbra for the magnetic field groups compared to the intensity images. This directly implies that there is greater complexity in the penumbral magnetic field groupings than the umbral region. This has implications for models that constrain how the magnetic field groups are contained in the cooler umbral regions.


title: A TESS Search for Distant Solar System Objects: Yield Estimates

abstract: As the NASA Transiting Exoplanet Survey Satellite (TESS) fulfills its primary mission, it is executing an unprecedented survey of almost the entire sky: TESS's approved extended mission will likely extend sky coverage to ~94%, including ~60% of the ecliptic. In an accompanying note we demonstrated that `digital tracking' techniques can be used to efficiently `shift-and-stack' TESS full frame images (FFIs) and showed that combining ~1,300 exposures from a TESS sector gives a 50% detection threshold of $I_C\sim 22.0\pm0.5$, raising the possibility that TESS could discover the hypothesized Planet Nine. In this note, we estimate the yield for such a survey and demonstrate that this technique has the potential to discover hundreds of Kuiper Belt Objects, Scattered Disk Objects and Centaurs in TESS FFI data.


title: A Reinforced Generation of Adversarial Examples for Neural Machine Translation

abstract: Neural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of this systems-fathoming how and when neural-based systems fail in such cases is critical for industrial maintenance. Instead of collecting and analyzing bad cases using limited handcrafted error features, here we investigate this issue by generating adversarial examples via a new paradigm based on reinforcement learning. Our paradigm could expose pitfalls for a given performance metric, e.g., BLEU, and could target any given neural machine translation architecture. We conduct experiments of adversarial attacks on two mainstream neural machine translation architectures, RNN-search, and Transformer. The results show that our method efficiently produces stable attacks with meaning-preserving adversarial examples. We also present a qualitative and quantitative analysis for the preference pattern of the attack, demonstrating its capability of pitfall exposure.


title: Bootstrapping Disjoint Datasets for Multilingual Multimodal Representation Learning

abstract: Recent work has highlighted the advantage of jointly learning grounded sentence representations from multiple languages. However, the data used in these studies has been limited to an aligned scenario: the same images annotated with sentences in multiple languages. We focus on the more realistic disjoint scenario in which there is no overlap between the images in multilingual image--caption datasets. We confirm that training with aligned data results in better grounded sentence representations than training with disjoint data, as measured by image--sentence retrieval performance. In order to close this gap in performance, we propose a pseudopairing method to generate synthetically aligned English--German--image triplets from the disjoint sets. The method works by first training a model on the disjoint data, and then creating new triples across datasets using sentence similarity under the learned model. Experiments show that pseudopairs improve image--sentence retrieval performance compared to disjoint training, despite requiring no external data or models. However, we do find that using an external machine translation model to generate the synthetic data sets results in better performance.


title: Decision Procedures for Guarded Logics

abstract: An important class of decidable first-order logic fragments are those satisfying a guardedness condition, such as the guarded fragment (GF). Usually, decidability for these logics is closely linked to the tree-like model property - the fact that satisfying models can be taken to have tree-like form. Decision procedures for the guarded fragment based on the tree-like model property are difficult to implement. An alternative approach, based on restricting first-order resolution, has been proposed, and this shows more promise from the point of view of implementation. In this work, we connect the tree-like model property of the guarded fragment with the resolution-based approach. We derive efficient resolution-based rewriting algorithms that solve the Quantifier-Free Query Answering Problem under Guarded Tuple Generating Dependencies (GTGDs) and Disjunctive Guarded Tuple Generating Dependencies (DisGTGDs). The Query Answering Problem for these classes subsumes many cases of GF satisfiability. Our algorithms, in addition to making the connection to the tree-like model property clear, give a natural account of the selection and ordering strategies used by resolution procedures for the guarded fragment. We also believe that our rewriting algorithm for the special case of GTGDs may prove itself valuable in practice as it does not require any Skolemisation step and its theoretical runtime outperforms those of known GF resolution procedures in case of fixed dependencies. Moreover, we show a novel normalisation procedure for the widely used chase procedure in case of (disjunctive) GTGDs, which could be useful for future studies.


title: A new concept of differentiability for interval-valued functions

abstract: In this paper we propose a new concept of differentiability for interval-valued functions. This concept is based on the properties of the Hausdorff-Pompeiu metric and avoids using the generalized Hukuhara difference.


title: E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT

abstract: We present a novel way of injecting factual knowledge about entities into the pretrained BERT model (Devlin et al., 2019): We align Wikipedia2Vec entity vectors (Yamada et al., 2016) with BERT's native wordpiece vector space and use the aligned entity vectors as if they were wordpiece vectors. The resulting entity-enhanced version of BERT (called E-BERT) is similar in spirit to ERNIE (Zhang et al., 2019) and KnowBert (Peters et al., 2019), but it requires no expensive further pretraining of the BERT encoder. We evaluate E-BERT on unsupervised question answering (QA), supervised relation classification (RC) and entity linking (EL). On all three tasks, E-BERT outperforms BERT and other baselines. We also show quantitatively that the original BERT model is overly reliant on the surface form of entity names (e.g., guessing that someone with an Italian-sounding name speaks Italian), and that E-BERT mitigates this problem.


title: Optimized geometrical metrics satisfying free-stream preservation

abstract: Computational fluid dynamics and aerodynamics, which complement more expensive empirical approaches, are critical for developing aerospace vehicles. During the past three decades, computational aerodynamics capability has improved remarkably, following advances in computer hardware and algorithm development. However, for complex applications, the demands on computational fluid dynamics continue to increase in a quest to gain a few percent improvements in accuracy. Herein, we numerically demonstrate that optimizing the metric terms which arise from smoothly mapping each cell to a reference element, lead to a solution whose accuracy is practically never worse and often noticeably better than the one obtained using the widely adopted Thomas and Lombard metric terms computation (Geometric conservation law and its application to flow computations on moving grids, AIAA Journal, 1979). Low and high-order accurate entropy stable schemes on distorted, high-order tensor product elements are used to simulate three-dimensional inviscid and viscous compressible test cases for which an analytical solution is known.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: A Polynomial Kernel for Paw-Free Editing

abstract: For a fixed graph $H$, the $H$-free-editing problem asks whether we can modify a given graph $G$ by adding or deleting at most $k$ edges such that the resulting graph does not contain $H$ as an induced subgraph. The problem is known to be NP-complete for all fixed $H$ with at least $3$ vertices and it admits a $2^{O(k)}n^{O(1)}$ algorithm. Cai and Cai showed that the $H$-free-editing problem does not admit a polynomial kernel whenever $H$ or its complement is a path or a cycle with at least $4$ edges or a $3$-connected graph with at least $1$ edge missing. Their results suggest that if $H$ is not independent set or a clique, then $H$-free-editing admits polynomial kernels only for few small graphs $H$, unless $\textsf{coNP} \in \textsf{NP/poly}$. Therefore, resolving the kernelization of $H$-free-editing for small graphs $H$ plays a crucial role in obtaining a complete dichotomy for this problem. In this paper, we positively answer the question of compressibility for one of the last two unresolved graphs $H$ on $4$ vertices. Namely, we give the first polynomial kernel for paw-free editing with $O(k^{6})$vertices.


title: An Algorithmic View on Optimal Storage Sizing

abstract: Users can arbitrage against Time-of-Use (ToU) pricing with storage by charging in off-peak period and discharge in peak periods. In this paper we design the optimal control policy and the solve optimal investment for general ToU scheme. We formulate the problem as dynamic programming for efficient solution. Our result is feasible facing multi-peaked ToU scheme. Simulation studies examine how the user's cost varies with respect to the user's demand randomness; we also demonstrate the performance of our scheme when aggregating users for extra savings.


title: Estimation of entropy measures for categorical variables with spatial correlation

abstract: Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to synthesize the observed data in a single, interpretable number. In other studies the objective is, instead, to use data for entropy estimation; several proposals can be found in the literature, which basically are corrections of the estimator based on substituting the involved probabilities with proportions. In this case, independence is assumed and spatial correlation is not considered. We propose a path for spatial entropy estimation: instead of correcting the global entropy estimator, we focus on improving the estimation of its components, i.e. the probabilities, in order to account for spatial effects. Once probabilities are suitably evaluated, estimating entropy is straightforward since it is a deterministic function of the distribution. Following a Bayesian approach, we derive the posterior probabilities of a multinomial distribution for categorical variables, accounting for spatial correlation. A posterior distribution for entropy can be obtained, which may be synthesized as wished and displayed as an entropy surface for the area under study.