title: Longitudinal laboratory testing tied to PCR diagnostics in COVID-19 patients reveals temporal evolution of distinctive coagulopathy signatures

abstract: Temporal inference from laboratory testing results and their triangulation with clinical outcomes as described in the associated unstructured text from the providers notes in the Electronic Health Record (EHR) is integral to advancing precision medicine. Here, we studied 181 COVIDpos and 7,775 COVIDneg patients subjected to 1.3 million laboratory tests across 194 assays during a two-month observation period centered around their SARS-CoV-2 PCR testing dates. We found that compared to COVIDneg at the time of clinical presentation and diagnostic testing, COVIDpos patients tended to have higher plasma fibrinogen levels and similarly low platelet counts, with approximately 25% of patients in both cohorts showing outright thrombocytopenia. However, these measures show opposite longitudinal trends as the infection evolves, with declining fibrinogen and increasing platelet counts to levels that are lower and higher compared to the COVIDneg cohort, respectively. Our EHR augmented curation efforts suggest a minority of patients develop thromboembolic events after the PCR testing date, including rare cases with disseminated intravascular coagulopathy (DIC), with most patients lacking the platelet reductions typically observed in consumptive coagulopathies. These temporal trends present, for the first time, fine-grained resolution of COVID-19 associated coagulopathy (CAC), via a digital framework that synthesizes longitudinal lab measurements with structured medication data and neural network-powered extraction of outcomes from the unstructured EHR. This study demonstrates how a precision medicine platform can help contextualize each patients specific coagulation profile over time, towards the goal of informing better personalization of thromboprophylaxis regimen.


title: One-loop matching for the twist-3 parton distribution $g_T (x)$

abstract: Perturbative matching relates the parton quasi-distributions, defined by Euclidean correlators at finite hadron momenta, to the light-cone distributions which are accessible in experiments. Previous matching calculations have exclusively focused on twist-2 distributions. In this work, we address, for the first time, the one-loop matching for the twist-3 parton distribution function $g_T(x)$. The results have been obtained using three different infrared regulators, while dimensional regularization has been adopted to deal with the ultraviolet divergences. We present the renormalized expressions of the matching coefficient for $g_{T}(x)$ in the $\overline{\rm MS}$ and modified $\overline{\rm MS}$ schemes. We also discuss the role played by a zero-mode contribution. Our results have already been used for the extraction of $g_T(x)$ from lattice QCD calculations.


title: When Dictionary Learning Meets Deep Learning: Deep Dictionary Learning and Coding Network for Image Recognition with Limited Data

abstract: We present a new Deep Dictionary Learning and Coding Network (DDLCN) for image recognition tasks with limited data. The proposed DDLCN has most of the standard deep learning layers (e.g., input/output, pooling, fully connected, etc.), but the fundamental convolutional layers are replaced by our proposed compound dictionary learning and coding layers. The dictionary learning learns an over-complete dictionary for input training data. At the deep coding layer, a locality constraint is added to guarantee that the activated dictionary bases are close to each other. Then the activated dictionary atoms are assembled and passed to the compound dictionary learning and coding layers. In this way, the activated atoms in the first layer can be represented by the deeper atoms in the second dictionary. Intuitively, the second dictionary is designed to learn the fine-grained components shared among the input dictionary atoms, thus a more informative and discriminative low-level representation of the dictionary atoms can be obtained. We empirically compare DDLCN with several leading dictionary learning methods and deep learning models. Experimental results on five popular datasets show that DDLCN achieves competitive results compared with state-of-the-art methods when the training data is limited. Code is available at https://github.com/Ha0Tang/DDLCN.


title: Improved regularity for the $p$-Poisson equation

abstract: In this paper we produce new, optimal, regularity results for the solutions to $p$-Poisson equations. We argue through a delicate approximation method, under a smallness regime for the exponent $p$, that imports information from a limiting profile driven by the Laplace operator. Our arguments contain a novelty of technical interest, namely a sequential stability result; it connects the solutions to $p$-Poisson equations with harmonic functions, yielding improved regularity for the former. Our findings relate a smallness regime with improved $\mathcal{C}^{1,1-}$-estimates in the presence of $L^\infty$-source terms.


title: Explicit and implicit non-convex sweeping processes in the space of absolutely continuous functions

abstract: We show that sweeping processes with possibly non-convex prox-regular constraints generate a strongly continuous input-output mapping in the space of absolutely continuous functions. Under additional smoothness assumptions on the constraint we prove the local Lipschitz continuity of the input-output mapping. Using the Banach contraction principle, we subsequently prove that also the solution mapping associated with the state-dependent problem is locally Lipschitz continuous.


title: Out of Nowhere: The 'emergence' of spacetime in string theory

abstract: This is a chapter of the planned monograph "Out of Nowhere: The Emergence of Spacetime in Quantum Theories of Gravity", co-authored by Nick Huggett and Christian W\"uthrich and under contract with Oxford University Press. (More information at www.beyondspacetime.net.) This chapter analyses the nature and derivation of spacetime topology and geometry according to string theory.


title: A note on bilinear wave-Schr\"odinger interactions

abstract: We consider bilinear restriction estimates for wave-Schr\"odinger interactions and provided a sharp condition to ensure that the product belongs to $L^q_t L^r_x$ in the full bilinear range $\frac{2}{q} + \frac{d+1}{r} < d+1$, $1 \leqslant q, r \leqslant 2$. Moreover, we give a counter-example which shows that the bilinear restriction estimate can fail, even in the transverse setting. This failure is closely related to the lack of curvature of the cone. Finally we mention extensions of these estimates to adapted function spaces. In particular we give a general transference type principle for $U^2$ type spaces that roughly implies that if an estimate holds for homogeneous solutions, then it also holds in $U^2$. This transference argument can be used to obtain bilinear and multilinear estimates in $U^2$ from the corresponding bounds for homogeneous solutions.


title: New Grids of Pure-Hydrogen White-Dwarf NLTE Model Atmospheres \newline and the HST/STIS Flux Calibration

abstract: Non-local Thermodynamic Equilibrium (NLTE) calculations of hot white dwarf (WD) model atmospheres are the cornerstone of modern flux calibrations for the Hubble Space Telescope (HST) and for the CALSPEC database. These theoretical spectral energy distributions (SEDs) provide the relative flux vs. wavelength, and only the absolute flux level remains to be set by reconciling the measured absolute flux of Vega in the visible with the Midcourse Space Experiment (MSX) values for Sirius in the mid-IR. The most recent SEDs calculated by the \textsc{tlusty} and \textsc{tmap} NLTE model atmosphere codes for the primary WDs G191-B2B, GD153, and GD71 show improved agreement to 1\% from 1500~\AA\ to 30~\micron, in comparison to the previous 1\% consistency only from 2000~\AA\ to 5~\micron. These new NLTE models of hot WDs now provide consistent flux standards from the FUV to the mid-IR.


title: The critical exponent for nonlinear damped $\sigma$-evolution equations

abstract: In this paper, we derive suitable optimal $L^p-L^q$ decay estimates, $1\leq p\leq q\leq \infty$, for the solutions to the $\sigma$-evolution equation, $\sigma>1$, with structural damping and power nonlinearity $|u|^{1+\alpha}$ or $|u_t|^{1+\alpha}$, \[ u_{tt}+(-\Delta)^\sigma u +(-\Delta)^\theta u_t=\begin{cases} |u|^{1+\alpha}, \\ |u_t|^{1+\alpha}, \end{cases}\] where $t\geq0$ and $x\in\mathbb{R}^n$. Using these estimates, we can solve the problem of finding the critical exponents for the two nonlinear problems above in the so-called non-effective case, $\theta\in(\sigma/2,\sigma]$. This latter is more difficult than the effective case $\theta\in[0,\sigma/2)$, since the asymptotic profile of the solution involves a diffusive component and an oscillating one. The novel idea in this paper consists in treating separately the two components to neglect the loss of decay rate created by the interplay of the two components. We deal with the oscillating component, by localizing the low frequencies, where oscillations appear, in the extended phase space. This strategy allows us to recover a quasi-scaling property which replaces the lack of homogeneity of the equation.


title: A Novel Semantics for Belief, Knowledge and Psychological Alethic Modality

abstract: Recently there have been numerous proposed solutions to the problem of logical omniscience in doxastic and epistemic logic. Though these solutions display an impressive breadth of subtlety and motivation, the crux of these approaches seems to have a common theme-minor revisions around the ubiquitous Kripke semantics-rooted approach. In addition, the psychological mechanisms at work in and around both belief and knowledge have been left largely untouched. In this paper, we cut straight to the core of the problem of logical omniscience, taking a psychologically-rooted approach, taking as bedrock the "quanta" of given percepts, qualia and cognitions, terming our approach "PQG logic", short for percept, qualia, cognition logic. Building atop these quanta, we reach a novel semantics of belief, knowledge, in addition to a semantics for psychological necessity and possibility. With these notions we are well-equipped to not only address the problem of logical omniscience but to more deeply investigate the psychical-logical nature of belief and knowledge.


title: CovidNet: To Bring Data Transparency in the Era of COVID-19

abstract: Timely, creditable, and fine-granular case information is vital for local communities and individual citizens to make rational and data-driven responses to the COVID-19 pandemic. This paper presents CovidNet, a COVID-19 tracking project associated with a large scale epidemic dataset, which was initiated by 1Point3Acres. To the best of our knowledge, the project is the only platform providing real-time global case information of more than 4,124 sub-divisions from over 27 countries worldwide with multi-language supports. The platform also offers interactive visualization tools to analyze the full historical case curves in each region. Initially launched as a voluntary project to bridge the data transparency gap in North America in January 2020, this project by far has become one of the major independent sources worldwide and has been consumed by many other tracking platforms. The accuracy and freshness of the dataset is a result of the painstaking efforts from our voluntary teamwork, crowd-sourcing channels, and automated data pipelines. As of May 18, 2020, the project website has been visited more than 200 million times and the CovidNet dataset has empowered over 522 institutions and organizations worldwide in policy-making and academic researches. All datasets are openly accessible for non-commercial purposes at https://coronavirus.1point3acres.com via a formal request through our APIs.


title: Divergence-Measure Fields: Gauss-Green Formulas and Normal Traces

abstract: The classical Gauss-Green formula for the multidimensional case is generally stated for $C^{1}$ vector fields and domains with $C^{1}$ boundaries. However, motivated by the physical solutions with discontinuity/singularity for Partial Differential Equations (PDEs) and Calculus of Variations, such as nonlinear hyperbolic conservation laws and Euler-Lagrange equations, the following fundamental issue arises: Does the Gauss-Green formula still hold for vector fields with discontinuity/singularity (such as divergence-measure fields) and domains with rough boundaries? The objective of this paper is to provide an answer to this issue and to present a short historical review of the contributions by many mathematicians spanning more than two centuries, which have made the discovery of the Gauss-Green formula possible.


title: Imaging the 511 keV positron annihilation sky with COSI

abstract: The balloon-borne Compton Spectrometer and Imager (COSI) had a successful 46-day flight in 2016. The instrument is sensitive to photons in the energy range $0.2$-$5$ MeV. Compton telescopes have the advantage of a unique imaging response and provide the possibility of strong background suppression. With its high-purity germanium detectors, COSI can precisely map $\gamma$-ray line emission. The strongest persistent and diffuse $\gamma$-ray line signal is the 511 keV emission line from the annihilation of electrons with positrons from the direction of the Galactic centre. While many sources have been proposed to explain the amount of positrons, $\dot{N}_{\mathrm{e^+}} \sim 10^{50}\,\mathrm{e^+\,yr^{-1}}$, the true contributions remain unsolved. In this study, we aim at imaging the 511 keV sky with COSI and pursue a full-forward modelling approach, using a simulated and binned imaging response. For the strong instrumental background, we describe an empirical approach to take the balloon environment into account. We perform two alternative methods to describe the signal: Richardson-Lucy deconvolution, an iterative method towards the maximum likelihood solution, and model fitting with pre-defined emission templates. Consistently with both methods, we find a 511 keV bulge signal with a flux between $0.9$ and $3.1 \times 10^{-3}\,\mathrm{ph\,cm^{-2}\,s^{-1}}$, confirming earlier measurements, and also indications of more extended emission. The upper limit we find for the 511 keV disk, $< 4.3 \times 10^{-3}\,\mathrm{ph\,cm^{-2}\,s^{-1}}$, is consistent with previous detections. For large-scale emission with weak gradients, coded aperture mask instruments suffer from their inability to distinguish isotropic emission from instrumental background, while Compton-telescopes provide a clear imaging response, independent of the true emission.


title: A machine learning approach to using Quality-of-Life patient scores in guiding prostate radiation therapy dosing

abstract: Thanks to advancements in diagnosis and treatment, prostate cancer patients have high long-term survival rates. Currently, an important goal is to preserve quality-of-life during and after treatment. The relationship between the radiation a patient receives and the subsequent side effects he experiences is complex and difficult to model or predict. Here, we use machine learning algorithms and statistical models to explore the connection between radiation treatment and post-treatment gastro-urinary function. Since only a limited number of patient datasets are currently available, we used image flipping and curvature-based interpolation methods to generate more data in order to leverage transfer learning. Using interpolated and augmented data, we trained a convolutional autoencoder network to obtain near-optimal starting points for the weights. A convolutional neural network then analyzed the relationship between patient-reported quality-of-life and radiation. We also used analysis of variance and logistic regression to explore organ sensitivity to radiation and develop dosage thresholds for each organ region. Our findings show no connection between the bladder and quality-of-life scores. However, we found a connection between radiation applied to posterior and anterior rectal regions to changes in quality-of-life. Finally, we estimated radiation therapy dosage thresholds for each organ. Our analysis connects machine learning methods with organ sensitivity, thus providing a framework for informing cancer patient care using patient reported quality-of-life metrics.


title: Femtosecond streaking in ambient air

abstract: We demonstrate a novel method to measure the temporal evolution of electric fields with optical frequencies. Our technique is based on the detection of transient currents in air plasma. These directional currents result from sub-cycle ionization of air with a short pump pulse, and the steering of the released electrons with the pulse to be sampled. We assess the validity of our approach by comparing it with different state-of-the-art laser-pulse characterization techniques. Notably, our method works in ambient air and facilitates a direct measurement of the field waveform, which can be viewed in real time on an oscilloscope in the exact same way as a radio frequency signal.


title: A Concise Review of Recent Few-shot Meta-learning Methods

abstract: Few-shot meta-learning has been recently reviving with expectations to mimic humanity's fast adaption to new concepts based on prior knowledge. In this short communication, we give a concise review on recent representative methods in few-shot meta-learning, which are categorized into four branches according to their technical characteristics. We conclude this review with some vital current challenges and future prospects in few-shot meta-learning.


title: Head2Head: Video-based Neural Head Synthesis

abstract: In this paper, we propose a novel machine learning architecture for facial reenactment. In particular, contrary to the model-based approaches or recent frame-based methods that use Deep Convolutional Neural Networks (DCNNs) to generate individual frames, we propose a novel method that (a) exploits the special structure of facial motion (paying particular attention to mouth motion) and (b) enforces temporal consistency. We demonstrate that the proposed method can transfer facial expressions, pose and gaze of a source actor to a target video in a photo-realistic fashion more accurately than state-of-the-art methods.


title: Staggered DG method with small edges for Darcy flows in fractured porous media

abstract: In this paper, we present and analyze a staggered discontinuous Galerkin method for Darcy flows in fractured porous media on fairly general meshes. A staggered discontinuous Galerkin method and a standard conforming finite element method with appropriate inclusion of interface conditions are exploited for the bulk region and the fracture, respectively. Our current analysis weakens the usual assumption on the polygonal mesh, which can integrate more general meshes such as elements with arbitrarily small edges into our theoretical framework. We prove the optimal convergence estimates in $L^2$ error for all the variables by exploiting the Ritz projection. Importantly, our error estimates are shown to be fully robust with respect to the heterogeneity and anisotropy of the permeability coefficients. Several numerical experiments including meshes with small edges and anisotropic meshes are carried out to confirm the theoretical findings. Finally, our method is applied in the framework of unfitted mesh.


title: NagE: Non-Abelian Group Embedding for Knowledge Graphs

abstract: We demonstrated the existence of a group algebraic structure hidden in relational knowledge embedding problems, which suggests that a group-based embedding framework is essential for designing embedding models. Our theoretical analysis explores merely the intrinsic property of the embedding problem itself hence is model-independent. Motivated by the theoretical analysis, we have proposed a group theory-based knowledge graph embedding framework, in which relations are embedded as group elements, and entities are represented by vectors in group action spaces. We provide a generic recipe to construct embedding models associated with two instantiating examples: SO3E and SU2E, both of which apply a continuous non-Abelian group as the relation embedding. Empirical experiments using these two exampling models have shown state-of-the-art results on benchmark datasets.


title: Classification of Epithelial Ovarian Carcinoma Whole-Slide Pathology Images Using Deep Transfer Learning

abstract: Ovarian cancer is the most lethal cancer of the female reproductive organs. There are $5$ major histological subtypes of epithelial ovarian cancer, each with distinct morphological, genetic, and clinical features. Currently, these histotypes are determined by a pathologist's microscopic examination of tumor whole-slide images (WSI). This process has been hampered by poor inter-observer agreement (Cohen's kappa $0.54$-$0.67$). We utilized a \textit{two}-stage deep transfer learning algorithm based on convolutional neural networks (CNN) and progressive resizing for automatic classification of epithelial ovarian carcinoma WSIs. The proposed algorithm achieved a mean accuracy of $87.54\%$ and Cohen's kappa of $0.8106$ in the slide-level classification of $305$ WSIs; performing better than a standard CNN and pathologists without gynecology-specific training.


title: Recurring Outbursts of P/2019 LM$_4$ (Palomar)

abstract: We present a preliminary analysis of comet P/2019 LM$_4$ (Palomar) as observed by the Zwicky Transient Facility (ZTF) survey in 2019 and 2020. We find that the discovery of the comet in 2019 and the recovery in 2020 is largely attributed to two separate outbursts that are $\gtrsim2$ and $\gtrsim3.9$ mag in strength. The outbursts occurred around the end of April to early May of 2019 as well as between 2020 May 8.31 and 9.52 UTC, respectively.


title: K2-HERMES II. Planet-candidate properties from K2 Campaigns 1-13

abstract: Accurate and precise radius estimates of transiting exoplanets are critical for understanding their compositions and formation mechanisms. To know the planet, we must know the host star in as much detail as possible. We present complete results for planet-candidate hosts from the K2-HERMES survey, which uses the HERMES multi-object spectrograph on the Anglo-Australian Telescope to obtain R$\sim$28,000 spectra for more than 30,000 K2 stars. We present complete host-star parameters and planet-candidate radii for 224 K2 candidate planets from C1-C13. Our results cast severe doubt on 30 K2 candidates, as we derive unphysically large radii, larger than 2 $R_{Jup}$. This work highlights the importance of obtaining accurate, precise, and self-consistent stellar parameters for ongoing large planet search programs - something that will only become more important in the coming years, as TESS begins to deliver its own harvest of exoplanets.


title: Misplaced Trust: Measuring the Interference of Machine Learning in Human Decision-Making

abstract: ML decision-aid systems are increasingly common on the web, but their successful integration relies on people trusting them appropriately: they should use the system to fill in gaps in their ability, but recognize signals that the system might be incorrect. We measured how people's trust in ML recommendations differs by expertise and with more system information through a task-based study of 175 adults. We used two tasks that are difficult for humans: comparing large crowd sizes and identifying similar-looking animals. Our results provide three key insights: (1) People trust incorrect ML recommendations for tasks that they perform correctly the majority of the time, even if they have high prior knowledge about ML or are given information indicating the system is not confident in its prediction; (2) Four different types of system information all increased people's trust in recommendations; and (3) Math and logic skills may be as important as ML for decision-makers working with ML recommendations.


title: Feeling Like It is Time to Reopen Now? COVID-19 New Normal Scenarios based on Reopening Sentiment Analytics

abstract: The Coronavirus pandemic has created complex challenges and adverse circumstances. This research discovers public sentiment amidst problematic socioeconomic consequences of the lockdown, and explores ensuing four potential sentiment associated scenarios. The severity and brutality of COVID-19 have led to the development of extreme feelings, and emotional and mental healthcare challenges. This research identifies emotional consequences - the presence of extreme fear, confusion and volatile sentiments, mixed along with trust and anticipation. It is necessary to gauge dominant public sentiment trends for effective decisions and policies. This study analyzes public sentiment using Twitter Data, time-aligned to COVID-19, to identify dominant sentiment trends associated with the push to 'reopen' the economy. Present research uses textual analytics methodologies to analyze public sentiment support for two potential divergent scenarios - an early opening and a delayed opening, and consequences of each. Present research concludes on the basis of exploratory textual analytics and textual data visualization, that Tweets data from American Twitter users shows more trust sentiment support, than fear, for reopening the US economy. With additional validation, this could present a valuable time sensitive opportunity for state governments, the federal government, corporations and societal leaders to guide the nation into a successful new normal future.


title: Observation of T=3/2 Isobaric Analog States in 9Be using p+8Li resonance scattering

abstract: Background: Resonance scattering has been extensively used to study the structure of exotic, neutron-deficient nuclei. Extension of the resonance scattering technique to neutron-rich nuclei was suggested more than 20 years ago. This development is based on the isospin conservation law. In spite of broad field of the application, it has never gained a wide-spread acceptance. Purpose: To benchmark the experimental approach to study the structure of exotic neutron-rich nuclei through resonance scattering on a proton target. Method: The excitation function for p+8Li resonance scattering is measured using a thick target by recording coincidence between light and heavy recoils, populating T=3/2 isobaric analog states (IAS) in 9Be. Results: A good fit of the 8Li(p,p)8Li resonance elastic scattering excitation function was obtained using previously tentatively known 5/2- T=3/2 state at 18.65 MeV in 9Be and a new broad T=3/2 s-wave state - the 5/2+ at 18.5 MeV. These results fit the expected iso-mirror properties for the T=3/2 A=9 iso-quartet. Conclusions: Our analysis confirmed isospin as a good quantum number for the investigated highly excited T=3/2 states and demonstrated that studying the structure of neutron-rich exotic nuclei through IAS is a promising approach.


title: Stochastic control liaisons: Richard Sinkhorn meets Gaspard Monge on a Schroedinger bridge

abstract: In 1931/32, Schroedinger studied a hot gas Gedankenexperiment, an instance of large deviations of the empirical distribution and an early example of the so-called maximum entropy inference method. This so-called Schroedinger bridge problem (SBP) was recently recognized as a regularization of the Monge-Kantorovich Optimal Mass Transport (OMT), leading to effective computation of the latter. Specifically, OMT with quadratic cost may be viewed as a zero-temperature limit of SBP, which amounts to minimization of the Helmholtz's free energy over probability distributions constrained to possess given marginals. The problem features a delicate compromise, mediated by a temperature parameter, between minimizing the internal energy and maximizing the entropy. These concepts are central to a rapidly expanding area of modern science dealing with the so-called {\em Sinkhorn algorithm} which appears as a special case of an algorithm first studied by the French analyst Robert Fortet in 1938/40 specifically for Schroedinger bridges. Due to the constraint on end-point distributions, dynamic programming is not a suitable tool to attack these problems. Instead, Fortet's iterative algorithm and its discrete counterpart, the Sinkhorn iteration, permit computation by iteratively solving the so-called {\em Schroedinger system}. In both the continuous as well as the discrete-time and space settings, {\em stochastic control} provides a reformulation and dynamic versions of these problems. The formalism behind these control problems have attracted attention as they lead to a variety of new applications in spacecraft guidance, control of robot or biological swarms, sensing, active cooling, network routing as well as in computer and data science. This multifacet and versatile framework, intertwining SBP and OMT, provides the substrate for a historical and technical overview of the field taken up in this paper.


title: Optimal eddy viscosity for resolvent-based models of coherent structures in turbulent jets

abstract: Response modes computed via linear resolvent analysis of a turbulent mean-flow field have been shown to qualitatively capture characteristics of the observed turbulent coherent structures in both wall-bounded and free shear flows. To make such resolvent models predictive, the nonlinear forcing term must be closed. Strategies to do so include imposing self-consistent sets of triadic interactions, proposing various source models, or through turbulence modelling. For the latter, several investigators have proposed using the mean-field eddy viscosity acting linearly on the fluctuation field. In this study, a data-driven approach is taken to quantitatively improve linear resolvent models by deducing an optimal eddy-viscosity field that maximizes the projection of the dominant resolvent mode to the energy-optimal coherent structure educed using spectral proper orthogonal decomposition (SPOD) of data from high-fidelity simulations. We use large-eddy simulation databases for round isothermal jets at subsonic, transonic, and supersonic conditions and show that the optimal eddy viscosity substantially improves the alignment between resolvent and SPOD modes, reaching over 90% alignment at those frequencies where the jet exhibits a low-rank response. We then consider a fixed model for the eddy viscosity and show that with the calibration of a single constant, the results are generally close to the optimal one. In particular, the use of a standard Reynolds-Averaged-Navier-Stokes (RANS) eddy-viscosity resolvent model, with a single coefficient, provides substantial agreement between SPOD and resolvent modes for three turbulent jets and across the most energetic wavenumbers and frequencies.


title: Role of rotational coherence in femtosecond-pulse-driven nitrogen ion lasing

abstract: We experimentally investigated the rotationally resolved polarization characteristics of N$_2^+$ lasing at 391 and 428 nm using a pump-seed scheme. By varying the relative angle between the linear polarizations of the pump and seed, it is found that the polarizations of the P and R branches of 391-nm lasing are counter-rotated. By contrast, both branches of 428-nm lasing remain polarized along the pump. The origin of the puzzled abnormal polarization characteristics is found based on a complete physical model that simultaneously includes the transient photoionization and the subsequent coupling among the electronic, vibrational and rotational quantum states of ions.It suggests that the cascaded resonant Raman processes following ionization create negative coherence between the rotational states of $J$ and $J$+2 in the ionic ground state X$^2\Sigma_g^+(\nu=0)$, which leads to mirror-symmetrical polarization for the P and R branches of 391-nm lasing. Both the experiment and theory indicate that the demonstrated rotational coherence plays an extremely pivotal role in clarifying the gain mechanism of N$_2^+$ lasing and opens up the route toward quantum optics under ultrafast strong fields.


title: Pricing Barrier Options with DeepBSDEs

abstract: This paper presents a novel and direct approach to price boundary and final-value problems, corresponding to barrier options, using forward deep learning to solve forward-backward stochastic differential equations (FBSDEs). Barrier instruments are instruments that expire or transform into another instrument if a barrier condition is satisfied before maturity; otherwise they perform like the instrument without the barrier condition. In the PDE formulation, this corresponds to adding boundary conditions to the final value problem. The deep BSDE methods developed so far have not addressed barrier/boundary conditions directly. We extend the forward deep BSDE to the barrier condition case by adding nodes to the computational graph to explicitly monitor the barrier conditions for each realization of the dynamics as well as nodes that preserve the time, state variables, and trading strategy value at barrier breach or at maturity otherwise. Given these additional nodes in the computational graph, the forward loss function quantifies the replication of the barrier or final payoff according to a chosen risk measure such as squared sum of differences. The proposed method can handle any barrier condition in the FBSDE set-up and any Dirichlet boundary conditions in the PDE set-up, both in low and high dimensions.


title: Counting the Lyapunov inflections in piecewise linear systems

abstract: Following the pioneering work of Iommi-Kiwi and Jenkinson-Pollicott-Vytnova, we continue to study the inflection points of the Lyapunov spectrum in this work. We prove that for any 3-branch piecewise linear expanding map on an interval, the number of its Lyapunov inflections is bounded above by 2. Then we continue to show that, there is a 4-branch piecewise linear expanding map, such that its Lyapunov spectrum has exactly 4 inflection points. These results give an answer to a question by Jenkinson-Pollicott-Vytnova on the least number of branches needed to observe 4 inflections in the Lyapunov spectrum of piecewise linear maps. In the general case, we give upper bound on the number of Lyapunov inflections for any n-branch piecewise linear expanding maps, and construct a family of n-branch piecewise linear expanding maps with 2n-4 Lyapunov inflections. We also consider the number of Lyapunov inflections of piecewise linear maps in words of the essential branch number in this work. There are some results on distributions of the Lyapunov inflections of piecewise linear maps through out the work, in case of their existence.


title: Standard pairs for monomial ideals in semigroup rings

abstract: We extend the notion of standard pairs to the context of monomial ideals in semigroup rings. Standard pairs can be used as a data structure to encode such monomial ideals, providing an alternative to generating sets that is well suited to computing intersections, decompositions, and multiplicities. We give algorithms to compute standard pairs from generating sets and vice versa and make all of our results effective. We assume that the underlying semigroup ring is positively graded, but not necessarily normal. The lack of normality is at the root of most challenges, subtleties, and innovations in this work.


title: Categories over quantum affine algebras and monoidal categorification

abstract: Let $U_q'(\mathfrak{g})$ be a quantum affine algebra of untwisted affine $ADE$ type, and $\mathcal{C}_{\mathfrak{g}}^0$ the Hernandez-Leclerc category of finite-dimensional $U_q'(\mathfrak{g})$-modules. For a suitable infinite sequence $\widehat{w}_0= \cdots s_{i_{-1}}s_{i_0}s_{i_1} \cdots$ of simple reflections, we introduce subcategories $\mathcal{C}_{\mathfrak{g}}^{[a,b]}$ of $\mathcal{C}_{\mathfrak{g}}^0$ for all $a \le b \in \mathbb{Z}\sqcup\{ \pm \infty \}$. Associated with a certain chain $\mathfrak{C}$ of intervals in $[a,b]$, we construct a real simple commuting family $M(\mathfrak{C})$ in $\mathcal{C}_{\mathfrak{g}}^{[a,b]}$, which consists of Kirillov-Reshetikhin modules. The category $\mathcal{C}_{\mathfrak{g}}^{[a,b]}$ provides a monoidal categorification of the cluster algebra $K(\mathcal{C}_{\mathfrak{g}}^{[a,b]})$, whose set of initial cluster variables is $[M(\mathfrak{C})]$. In particular, this result gives an affirmative answer to the monoidal categorification conjecture on $\mathcal{C}_{\mathfrak{g}}^-$ by Hernandez-Leclerc since it is $\mathcal{C}_{\mathfrak{g}}^{[-\infty,0]}$, and is also applicable to $\mathcal{C}_{\mathfrak{g}}^0$ since it is $\mathcal{C}_{\mathfrak{g}}^{[-\infty,\infty]}$.


title: A Complex KBQA System using Multiple Reasoning Paths

abstract: Multi-hop knowledge based question answering (KBQA) is a complex task for natural language understanding. Many KBQA approaches have been proposed in recent years, and most of them are trained based on labeled reasoning path. This hinders the system's performance as many correct reasoning paths are not labeled as ground truth, and thus they cannot be learned. In this paper, we introduce an end-to-end KBQA system which can leverage multiple reasoning paths' information and only requires labeled answer as supervision. We conduct experiments on several benchmark datasets containing both single-hop simple questions as well as muti-hop complex questions, including WebQuestionSP (WQSP), ComplexWebQuestion-1.1 (CWQ), and PathQuestion-Large (PQL), and demonstrate strong performance.


title: Dipolar spin waves in uniaxial easy-axis antiferromagnets: A natural topological nodal-line semimetal

abstract: The existence of the magnetostatic surface spin waves in ferromagnets, known as Damon-Eshbach mode, was recently demonstrated to originate from the topology of the dipole-dipole interaction. In this work, we study the topological characteristics of magnons in easy-axis antiferromagnets with uniaxial anisotropy. The dipolar spin waves are found to be, driven by the dipole-dipole interaction, in a topological nodal-line semimetal phase, which hosts Damon-Eshbach-type surface modes due to the bulk-edge correspondence. The long wavelength character of dipolar spin waves makes our proposal valid for any natural uniaxial easy-axis antiferromagnet, and thus enriches the candidates of topological magnonic materials. In contrast to the nonreciprocal property in ferromagnetic case, the surface modes with opposite momentum coexist at each surface, but with different chiralities. Such a chirality-momentum or spin-momentum locking, similar to that of electronic surface states in topological insulators, offers the opportunity to design novel chirality-based magnonic devices in antiferromagnets.


title: Large $m$ asymptotics for minimal partitions of the Dirichlet eigenvalue

abstract: In this paper, we study large $m$ asymptotics of the $l^1$ minimal $m$-partition problem for Dirichlet eigenvalue. For any smooth domain $\Omega\in \mathbb{R}^n$ such that $|\Omega|=1$, we prove that the limit $\lim\limits_{m\rightarrow\infty}l_m^1(\Omega)=c_0$ exists, and the constant $c_0$ is independent of the shape of $\Omega$. Here $l_m^1(\Omega)$ denotes the minimal value of the normalized sum of the first Laplacian eigenvalues for any $m$-partition of $\Omega$.


title: A Consistent Estimator for Skewness of Partial Sums of Dependent Data

abstract: We introduce an estimation method for the scaled skewness coefficient of the sample mean of short and long memory linear processes. This method can be extended to estimate higher moments such as curtosis coefficient of the sample mean. Also a general result on computing all asymptotic moments of partial sums is obtained, allowing in particular a much easier derivation of some existing central limit theorems for linear processes. The introduced skewness estimator provides a tool to empirically examine the error of the central limit theorem for long and short memory linear processes. We also show that, for both short and long memory linear processes, the skewness coefficient of the sample mean converges to zero at the same rate as in the i.i.d. case.


title: The Preservation of Super Earths and the Emergence of Gas Giants after Their Progenitor Cores have Entered the Pebble Isolation Phase

abstract: The omnipresence of super-Earths suggests that they are able to be retained in natal disks around low-mass stars, whereas exoplanets' mass distribution indicates that some cores have transformed into gas giants through runaway gas accretion at 1AU from solar-type stars. In this paper, we show that transition to runaway gas accretion by cores may be self-impeded by an increase of the grain opacity in their envelope after they have acquired sufficient mass (typically 10Mearth) to enter a pebble-isolation phase. The accumulation of mm-m size pebbles in their migration barriers enhances their local fragmentation rates. The freshly produced sub-mm grains pass through the barrier, elevate the effective dust opacity and reduce the radiative flux in the cores envelope. These effects alone are adequate to suppress the transition to runaway accretion and preserve super-Earths in the stellar proximity (0.1 AU), albeit entropy advection between the envelope and the disk can further reduce the accretion rate. At intermediate distance (1AU) from their host stars, the escalation in the dust opacity dominates over entropy advection in stalling the transition to runaway accretion for marginally pebble-isolated cores. Beyond a few AU, the transformation of more massive cores to gas giants is reachable before severe depletion of disk gas. This requirement can be satisfied either in extended disks with large scale height via orderly accretion of migrating pebbles or through the mergers of oligarchic protoplanetary embryos, and can account for the correlated occurrence of long-period gas giants and close-in super-Earths.


title: Positivity of solutions to the Cauchy problem for linear and semilinear biharmonic heat equations

abstract: This paper is concerned with the positivity of solutions to the Cauchy problem for linear and nonlinear parabolic equations with the biharmonic operator as fourth order elliptic principal part. Generally, Cauchy problems for parabolic equations of fourth order have no positivity preserving property due to the change of sign of the fundamental solution. One has eventual local positivity for positive initial data, but on short time scales, one will in general have also regions of negativity. The first goal of this paper is to find sufficient conditions on initial data which ensure the existence of solutions to the Cauchy problem for the linear biharmonic heat equation which are positive for all times and in the whole space. The second goal is to apply these results to show existence of globally positive solutions to the Cauchy problem for a semilinear biharmonic parabolic equation.


title: Surprising simplicity in the modeling of dynamic granular intrusion

abstract: Granular intrusions, such as dynamic impact or wheel locomotion, are complex multiphase phenomena where the grains exhibit solid-like and fluid-like characteristics together with an ejected gas-like phase. Despite decades of modeling efforts, a unified description of the physics in such intrusions is as yet unknown. Here we show that a continuum model based on the simple notions of frictional flow and tension-free separation describes complex granular intrusions near free surfaces. This model captures dynamics in a variety of experiments including wheel locomotion, plate intrusions, and running legged robots. The model reveals that three effects (a static contribution and two dynamic ones) primarily give rise to intrusion forces in such scenarios. Identification of these effects enables the development of a further reduced-order technique (Dynamic Resistive Force Theory) for rapid modeling of granular locomotion of arbitrarily shaped intruders. The continuum-motivated strategy we propose for identifying physical mechanisms and corresponding reduced-order relations has potential use for a variety of other materials.


title: SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognition

abstract: Scene text recognition is a hot research topic in computer vision. Recently, many recognition methods based on the encoder-decoder framework have been proposed, and they can handle scene texts of perspective distortion and curve shape. Nevertheless, they still face lots of challenges like image blur, uneven illumination, and incomplete characters. We argue that most encoder-decoder methods are based on local visual features without explicit global semantic information. In this work, we propose a semantics enhanced encoder-decoder framework to robustly recognize low-quality scene texts. The semantic information is used both in the encoder module for supervision and in the decoder module for initializing. In particular, the state-of-the art ASTER method is integrated into the proposed framework as an exemplar. Extensive experiments demonstrate that the proposed framework is more robust for low-quality text images, and achieves state-of-the-art results on several benchmark datasets.


title: Non-Abelian Generalizations of the Hofstadter model: Spin-orbit-coupled Butterfly Pairs

abstract: The Hofstadter model, well-known for its fractal butterfly spectrum, describes two-dimensional electrons under a perpendicular magnetic field, which gives rise to the integer quantum hall effect. Inspired by the real-space building blocks of non-Abelian gauge fields from a recent experiment [Science, 365, 1021 (2019)], we introduce and theoretically study two non-Abelian generalizations of the Hofstadter model. Each model describes two pairs of Hofstadter butterflies that are spin-orbit coupled. In contrast to the original Hofstadter model that can be equivalently studied in the Landau and symmetric gauges, the corresponding non-Abelian generalizations exhibit distinct spectra due to the non-commutativity of the gauge fields. We derive the genuine (necessary and sufficient) non-Abelian condition for the two models from the commutativity of their arbitrary loop operators. At zero energy, the models are gapless and host Weyl and Dirac points protected by internal and crystalline symmetries. Double (8-fold), triple (12-fold), and quadrupole (16-fold) Dirac points also emerge, especially under equal hopping phases of the non-Abelian potentials. At other fillings, the gapped phases of the models give rise to $\mathbb{Z}_2$ topological insulators. We conclude by discussing possible schemes for the experimental realizations of the models in photonic platforms.


title: Focus Longer to See Better:Recursively Refined Attention for Fine-Grained Image Classification

abstract: Deep Neural Network has shown great strides in the coarse-grained image classification task. It was in part due to its strong ability to extract discriminative feature representations from the images. However, the marginal visual difference between different classes in fine-grained images makes this very task harder. In this paper, we tried to focus on these marginal differences to extract more representative features. Similar to human vision, our network repetitively focuses on parts of images to spot small discriminative parts among the classes. Moreover, we show through interpretability techniques how our network focus changes from coarse to fine details. Through our experiments, we also show that a simple attention model can aggregate (weighted) these finer details to focus on the most dominant discriminative part of the image. Our network uses only image-level labels and does not need bounding box/part annotation information. Further, the simplicity of our network makes it an easy plug-n-play module. Apart from providing interpretability, our network boosts the performance (up to 2%) when compared to its baseline counterparts. Our codebase is available at https://github.com/TAMU-VITA/Focus-Longer-to-See-Better


title: Construction of Variational Matrix Product States for the Heisenberg Spin-1 Chain

abstract: We propose a simple variational wave function that captures the correct ground state energy of the spin-1 Heisenberg chain model to within 0.04\%. The wave function is written in the matrix product state (MPS) form with the bond dimension $D=8$, and characterized by three fugacity parameters. The proposed MPS generalizes the Affleck-Kennedy-Lieb-Tasaki (AKLT) state by dressing it with dimers, trimers, and general $q$-dimers. The fugacity parameters control the number and the average size of the $q$-mers. Furthermore, the $D=8$ variational MPS state captures the ground states of the entire family of bilinear-biquadratic Hamiltonian belonging to the Haldane phase to high accuracy. The 2-4-2 degeneracy structure in the entanglement spectrum of our MPS state is found to match well with the results of density matrix renormalization group (DMRG) calculation, which is computationally much heavier. Spin-spin correlation functions also find excellent fit with those obtained by DMRG.


title: Dynamics of A Single Population Model with Memory Effect and Spatial Heterogeneity

abstract: In this paper, a single population model with memory effect and the heterogeneity of the environment, equipped with the Neumann boundary, is considered. The global existence of a spatial nonhomogeneous steady state is proved by the method of upper and lower solutions, which is asymptotically stable for relatively small memorized diffusion. However, after the memorized diffusion rate exceeding a critical value, spatial inhomogeneous periodic solution can be generated through Hopf bifurcation, if the integral of intrinsic growth rate over the domain is negative. Such phenomenon will never happen, if only memorized diffusion or spatially heterogeneity is presented, and therefore must be induced by their joint effects. This indicates that the memorized diffusion will bring about spatial-temporal patterns in the overall hostile environment. When the integral of intrinsic growth rate over the domain is positive, it turns out that the steady state is still asymptotically stable. Finally, the possible dynamics of the model is also discussed, if the boundary condition is replaced by Dirichlet condition.


title: Probing excited-state dynamics with quantum entangled photons: Correspondence to coherent multidimensional spectroscopy

abstract: Quantum light is a key resource for promoting quantum technology. One such class of technology aims to improve the precision of optical measurements using engineered quantum states of light. In this study, we investigate transmission measurement of frequency-entangled broadband photon pairs generated via parametric down-conversion with a monochromatic laser. It is observed that state-to-state dynamics in the system under study are temporally resolved by adjusting the path difference between the entangled twin beams when the entanglement time is sufficiently short. The non-classical photon correlation enables time-resolved spectroscopy with monochromatic pumping. It is further demonstrated that the signal corresponds to the spectral information along anti-diagonal lines of, for example, two-dimensional Fourier-transformed photon echo spectra. This correspondence inspires us to anticipate that more elaborately engineered photon states would broaden the availability of quantum light spectroscopy.


title: Rotating black hole with a probe string in Horndeski Gravity

abstract: In this work, we present the effect of a probe string on the complexity of a black hole according to the CA (Complexity equals action) conjecture on Horndeski's gravity. In our system, we consider a particle moving on the boundary of black hole spacetime in ($2+1$)-dimensions. To obtain a dual description, we need to insertion a fundamental string on the bulk spacetime. The effect of this string is given by the Nambu-Goto term. For the Nambu-Goto term, we can analyze the time development of this system, which is affected by the parameters of Horndeski's gravity. In our case, we show some interesting complexity properties for this gravity.


title: RankPose: Learning Generalised Feature with Rank Supervision for Head Pose Estimation

abstract: We address the challenging problem of RGB image-based head pose estimation. We first reformulate head pose representation learning to constrain it to a bounded space. Head pose represented as vector projection or vector angles shows helpful to improving performance. Further, a ranking loss combined with MSE regression loss is proposed. The ranking loss supervises a neural network with paired samples of the same person and penalises incorrect ordering of pose prediction. Analysis on this new loss function suggests it contributes to a better local feature extractor, where features are generalised to Abstract Landmarks which are pose-related features instead of pose-irrelevant information such as identity, age, and lighting. Extensive experiments show that our method significantly outperforms the current state-of-the-art schemes on public datasets: AFLW2000 and BIWI. Our model achieves significant improvements over previous SOTA MAE on AFLW2000 and BIWI from 4.50 to 3.66 and from 4.0 to 3.71 respectively. Source code will be made available at: https://github.com/seathiefwang/RankHeadPose.


title: Apply VGGNet-based deep learning model of vibration data for prediction model of gravity acceleration equipment

abstract: Hypergravity accelerators are a type of large machinery used for gravity training or medical research. A failure of such large equipment can be a serious problem in terms of safety or costs. This paper proposes a prediction model that can proactively prevent failures that may occur in a hypergravity accelerator. The method proposed in this paper was to convert vibration signals to spectograms and perform classification training using a deep learning model. An experiment was conducted to evaluate the performance of the method proposed in this paper. A 4-channel accelerometer was attached to the bearing housing, which is a rotor, and time-amplitude data were obtained from the measured values by sampling. The data were converted to a two-dimensional spectrogram, and classification training was performed using a deep learning model for four conditions of the equipment: Unbalance, Misalignment, Shaft Rubbing, and Normal. The experimental results showed that the proposed method had a 99.5% F1-Score, which was up to 23% higher than the 76.25% for existing feature-based learning models.


title: A Convolutional Neural Network with Parallel Multi-Scale Spatial Pooling to Detect Temporal Changes in SAR Images

abstract: In synthetic aperture radar (SAR) image change detection, it is quite challenging to exploit the changing information from the noisy difference image subject to the speckle. In this paper, we propose a multi-scale spatial pooling (MSSP) network to exploit the changed information from the noisy difference image. Being different from the traditional convolutional network with only mono-scale pooling kernels, in the proposed method, multi-scale pooling kernels are equipped in a convolutional network to exploit the spatial context information on changed regions from the difference image. Furthermore, to verify the generalization of the proposed method, we apply our proposed method to the cross-dataset bitemporal SAR image change detection, where the MSSP network (MSSP-Net) is trained on a dataset and then applied to an unknown testing dataset. We compare the proposed method with other state-of-arts and the comparisons are performed on four challenging datasets of bitemporal SAR images. Experimental results demonstrate that our proposed method obtains comparable results with S-PCA-Net on YR-A and YR-B dataset and outperforms other state-of-art methods, especially on the Sendai-A and Sendai-B datasets with more complex scenes. More important, MSSP-Net is more efficient than S-PCA-Net and convolutional neural networks (CNN) with less executing time in both training and testing phases.


title: Investigating Vulnerability to Adversarial Examples on Multimodal Data Fusion in Deep Learning

abstract: The success of multimodal data fusion in deep learning appears to be attributed to the use of complementary in-formation between multiple input data. Compared to their predictive performance, relatively less attention has been devoted to the robustness of multimodal fusion models. In this paper, we investigated whether the current multimodal fusion model utilizes the complementary intelligence to defend against adversarial attacks. We applied gradient based white-box attacks such as FGSM and PGD on MFNet, which is a major multispectral (RGB, Thermal) fusion deep learning model for semantic segmentation. We verified that the multimodal fusion model optimized for better prediction is still vulnerable to adversarial attack, even if only one of the sensors is attacked. Thus, it is hard to say that existing multimodal data fusion models are fully utilizing complementary relationships between multiple modalities in terms of adversarial robustness. We believe that our observations open a new horizon for adversarial attack research on multimodal data fusion.


title: Avoiding COVID-19: Aerosol Guidelines

abstract: The COVID-19 pandemic has brought into sharp focus the need to understand respiratory virus transmission mechanisms. In preparation for an anticipated influenza pandemic, a substantial body of literature has developed over the last few decades showing that the short-range aerosol route is an important, though often neglected transmission path. We develop a simple mathematical model for COVID-19 transmission via aerosols, apply it to known outbreaks, and present quantitative guidelines for ventilation and occupancy in the workplace.


title: Mutually Normalizing Regular Permutation Groups and Zappa-Szep Extensions of the Holomorph

abstract: For a group $G$, embedded in its group of permutations $B=Perm(G)$ via the left regular representation $\lambda:G\rightarrow B$, the normalizer of $\lambda(G)$ in $B$ is $\operatorname{Hol}(G)$, the holomorph of $G$. The set $\mathcal{H}(G)$ of those regular $N\leq \operatorname{Hol}(G)$ such that $N\cong G$ and $\operatorname{Norm}_B(N)=\operatorname{Hol}(G)$ is keyed to the structure of the so-called multiple holomorph of $G$, $N\!Hol(G)=\operatorname{Norm}_B(\operatorname{Hol}(G))$, in that $\mathcal{H}(G)$ is the set of conjugates of $\lambda(G)$ by $N\!Hol(G)$. We wish to generalize this by considering a certain set $\mathcal{Q}(G)$ consisting of regular subgroups $M\leq \operatorname{Hol}(G)$, where $M\cong G$, that contains $\mathcal{H}(G)$ with the property that its members mutually normalize each other. This set will generally give rise to a group $Q\!\operatorname{Hol}(G)$ which we will call the quasi-holomorph of $G$, where the orbit of $\lambda(G)$ under $Q\!\operatorname{Hol}(G)$ is $\mathcal{Q}(G)$. The multiple holomorph is a group extension of $\operatorname{Hol}(G)$ and the quasi-holomorph will contain $N\!Hol(G)$, but, when larger than $N\!Hol(G)$, is frequently a Zappa-Sz\'ep product with the holomorph.


title: Metamaterial enhancement of metal-halide perovskite luminescence

abstract: Metal-halide perovskites are rapidly emerging as solution-processable optical materials for light emitting applications. Here we adopt a plasmonic metamaterial approach to enhance photoluminescence emission and extraction of methylammonium lead iodide (MAPbI3) thin films, based on the Purcell effect. We show that hybridization of the active metal-halide film with resonant nanoscale sized slits carved into a gold film can yield more than one order of magnitude enhancement of luminescence intensity, and nearly threefold reduction of luminescence lifetime. This shows the effectiveness of resonant nanostructures in controlling metal-halide perovskite light emission properties over a tunable spectral range, a viable approach toward highly efficient perovskite light emitting devices and single-photon emitters.


title: Anisotropic 2+1 dimensional black holes by gravitational decoupling

abstract: In the present paper, we analyze the well-known 2+1 dimensional black holes (assuming a non-vanishing cosmological constant) in light of the gravitational decoupling by the minimal geometric deformation approach. To illustrate our results, we consider the BTZ geometry as the seed solution to generate new anisotropic ones. To complement the study, the curvature scalars and the energy conditions are analyzed.


title: A CNN-LSTM Architecture for Detection of Intracranial Hemorrhage on CT scans

abstract: We propose a novel method that combines a convolutional neural network (CNN) with a long short-term memory (LSTM) mechanism for accurate prediction of intracranial hemorrhage on computed tomography (CT) scans. The CNN plays the role of a slice-wise feature extractor while the LSTM is responsible for linking the features across slices. The whole architecture is trained end-to-end with input being an RGB-like image formed by stacking 3 different viewing windows of a single slice. We validate the method on the recent RSNA Intracranial Hemorrhage Detection challenge and on the CQ500 dataset. For the RSNA challenge, our best single model achieves a weighted log loss of 0.0522 on the leaderboard, which is comparable to the top 3% performances, almost all of which make use of ensemble learning. Importantly, our method generalizes very well: the model trained on the RSNA dataset significantly outperforms the 2D model, which does not take into account the relationship between slices, on CQ500. Our codes and models is publicly avaiable at https://github.com/VinBDI-MedicalImagingTeam/midl2020-cnnlstm-ich.


title: Polynomial traces and elementary symmetric functions in the latent roots of a non-central Wishart matrix

abstract: Hypergeometric functions and zonal polynomials are the tools usually addressed in the literature to deal with the expected value of the elementary symmetric functions in non-central Wishart latent roots. The method here proposed recovers the expected value of these symmetric functions by using the umbral operator applied to the trace of suitable polynomial matrices and their cumulants. The employment of a suitable linear operator in place of hypergeometric functions and zonal polynomials was conjectured by de Waal in 1972. Here we show how the umbral operator accomplishes this task and consequently represents an alternative tool to deal with these symmetric functions. When special formal variables are plugged in the variables, the evaluation through the umbral operator deletes all the monomials in the latent roots except those contributing in the elementary symmetric functions. Cumulants further simplify the computations taking advantage of the convolution structure of the polynomial trace. Open problems are addressed at the end of the paper.


title: Abstractions for computing all robotic sensors that suffice to solve a planning problem

abstract: Whether a robot can perform some specific task depends on several aspects, including the robot's sensors and the plans it possesses. We are interested in search algorithms that treat plans and sensor designs jointly, yielding solutions---i.e., plan and sensor characterization pairs---if and only if they exist. Such algorithms can help roboticists explore the space of sensors to aid in making design trade-offs. Generalizing prior work where sensors are modeled abstractly as sensor maps on p-graphs, the present paper increases the potential sensors which can be sought significantly. But doing so enlarges a problem currently on the outer limits of being considered tractable. Toward taming this complexity, two contributions are made: (1) we show how to represent the search space for this more general problem and describe data structures that enable whole sets of sensors to be summarized via a single special representative; (2) we give a means by which other structure (either task domain knowledge, sensor technology or fabrication constraints) can be incorporated to reduce the sets to be enumerated. These lead to algorithms that we have implemented and which suffice to solve particular problem instances, albeit only of small scale. Nevertheless, the algorithm aids in helping understand what attributes sensors must possess and what information they must provide in order to ensure a robot can achieve its goals despite non-determinism.


title: Reconfigurable Intelligent Surface Enhanced Cognitive Radio Networks

abstract: The cognitive radio (CR) network is a promising network architecture that meets the requirement of enhancing scarce radio spectrum utilization. Meanwhile, reconfigurable intelligent surfaces (RIS) is a promising solution to enhance the energy and spectrum efficiency of wireless networks by properly altering the signal propagation via tuning a large number of passive reflecting units. In this paper, we investigate the downlink transmit power minimization problem for the RIS-enhanced single-cell cognitive radio (CR) network coexisting with a single-cell primary radio (PR) network by jointly optimizing the transmit beamformers at the secondary user (SU) transmitter and the phase shift matrix at the RIS. The investigated problem is a highly intractable due to the coupled optimization variables and unit modulus constraint, for which an alternative minimization framework is presented. Furthermore, a novel difference-of-convex (DC) algorithm is developed to solve the resulting non-convex quadratic program by lifting it into a low-rank matrix optimization problem. We then represent non-convex rank-one constraint as a DC function by exploiting the difference between trace norm and spectral norm. The simulation results validate that our proposed algorithm outperforms the existing state-of-the-art methods.


title: Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Data

abstract: Domain adaptation (DA) offers a valuable means to reuse data and models for new problem domains. However, robust techniques have not yet been considered for time series data with varying amounts of data availability. In this paper, we make three main contributions to fill this gap. First, we propose a novel Convolutional deep Domain Adaptation model for Time Series data (CoDATS) that significantly improves accuracy and training time over state-of-the-art DA strategies on real-world sensor data benchmarks. By utilizing data from multiple source domains, we increase the usefulness of CoDATS to further improve accuracy over prior single-source methods, particularly on complex time series datasets that have high variability between domains. Second, we propose a novel Domain Adaptation with Weak Supervision (DA-WS) method by utilizing weak supervision in the form of target-domain label distributions, which may be easier to collect than additional data labels. Third, we perform comprehensive experiments on diverse real-world datasets to evaluate the effectiveness of our domain adaptation and weak supervision methods. Results show that CoDATS for single-source DA significantly improves over the state-of-the-art methods, and we achieve additional improvements in accuracy using data from multiple source domains and weakly supervised signals. Code is available at: https://github.com/floft/codats


title: Phase retrieval by pattern classification and circular mean for robust optical testing

abstract: For the optical testing of a large mirror with a long radius of curvature, it is generally necessary to use a single-shot phase-shifting interferometer to take several measurements because the influence of air turbulence on air stratification prevention should be reduced for an accurate measurement. In this paper, a new technique that applies hierarchical clustering, which classifies a few clusters according to the pattern similarity of acquired wrapped phases, is proposed. As the minority patterns of the wrapped phases are excluded, the effects of unknown noises can be reduced. For each cluster, the circular mean is used to calculate the denoised wrapped phases. The surface figure is obtained from the unwrapped phases. Because the running number of the phase-unwrapping algorithm becomes the same as the number of chosen clusters, the proposed technique is much faster than conventional procedures. In 500 measurements using a spherical mirror with a diameter of 1.5 m, the measurement time and standard deviation of the surface figure's root-mean-square error are reduced by up to approximately 23% and 15%, respectively, of the results obtained via the conventional procedure.


title: Navigated Weighting to Improve Inverse Probability Weighting for Missing Data Problems and Causal Inference

abstract: The inverse probability weighting (IPW) is broadly utilized to address missing data problems including causal inference but may suffer from large variances and biases due to propensity score model misspecification. To solve these problems, I propose an estimation method called the navigated weighting (NAWT), which utilizes estimating equations suitable for a specific pre-specified parameter of interest (e.g., the average treatment effects on the treated). Since these pre-specified parameters determine the relative importance of each unit as a function of propensity scores, the NAWT prioritizes important units in the propensity score estimation to improve efficiency and robustness to model misspecification. I investigate its large-sample properties and demonstrate its finite sample improvements through simulation studies and an empirical example. An R package nawtilus which implements the NAWT is developed and available from the Comprehensive R Archive Network (http://cran.r-project.org/package=nawtilus).


title: Spoof Face Detection Via Semi-Supervised Adversarial Training

abstract: Face spoofing causes severe security threats in face recognition systems. Previous anti-spoofing works focused on supervised techniques, typically with either binary or auxiliary supervision. Most of them suffer from limited robustness and generalization, especially in the cross-dataset setting. In this paper, we propose a semi-supervised adversarial learning framework for spoof face detection, which largely relaxes the supervision condition. To capture the underlying structure of live faces data in latent representation space, we propose to train the live face data only, with a convolutional Encoder-Decoder network acting as a Generator. Meanwhile, we add a second convolutional network serving as a Discriminator. The generator and discriminator are trained by competing with each other while collaborating to understand the underlying concept in the normal class(live faces). Since the spoof face detection is video based (i.e., temporal information), we intuitively take the optical flow maps converted from consecutive video frames as input. Our approach is free of the spoof faces, thus being robust and general to different types of spoof, even unknown spoof. Extensive experiments on intra- and cross-dataset tests show that our semi-supervised method achieves better or comparable results to state-of-the-art supervised techniques.


title: Further results on a space-time FOSLS formulation of parabolic PDEs

abstract: In [2019, Space-time least-squares finite elements for parabolic equations, arXiv:1911.01942] by F\"uhrer& Karkulik, well-posedness of a space-time First-Order System Least-Squares formulation of the heat equation was proven. In the present work, this result is generalized to general second order parabolic PDEs with possibly inhomogenoeus boundary conditions, and plain convergence of a standard adaptive finite element method driven by the least-squares estimator is demonstrated. The proof of the latter easily extends to a large class of least-squares formulations.


title: Integrated Single Photon Emitters

abstract: The realization of scalable systems for quantum information processing and networking is of utmost importance to the quantum information community. However, building such systems is difficult because of challenges in achieving all the necessary functionalities on a unified platform while maintaining stringent performance requirements of the individual elements. A promising approach which addresses this challenge is based on the consolidation of experimental and theoretical capabilities in quantum physics and integrated photonics. Integrated quantum photonics devices allow efficient control and read-out of quantum information while being scalable and cost effective. Here we review recent developments in solid-state single photon emitters coupled with various integrated photonic structures, which form a critical component of future scalable quantum devices. Our work contributes to the further development and realization of quantum networking protocols and quantum logic on a scalable and fabrication-friendly platform.


title: AC Loop Current Attacks Against The KLJN Secure Key Exchange Scheme

abstract: A new attack against the Kirchhoff-Law-Johnson-Noise(KLJN) secure key exchange scheme is introduced. The attack exploits a parasitic (periodic) AC voltage-source at either Alice or Bob ends. Such situations exist due to AC ground loops and electromagnetic interference (EMI). In the low-frequency case, the procedure is the generalized form of the former DC ground loop based attack. In the high-frequency case, the power spectrum of the wire voltage is utilized. The attack is demonstrated in both the low and the high-frequency situations. Defense protocols against the attack are also discussed.


title: SODA: Detecting Covid-19 in Chest X-rays with Semi-supervised Open Set Domain Adaptation

abstract: Due to the shortage of COVID-19 viral testing kits and the long waiting time, radiology imaging is used to complement the screening process and triage patients into different risk levels. Deep learning based methods have taken an active role in automatically detecting COVID-19 disease in chest x-ray images, as witnessed in many recent works in early 2020. Most of these works first train a Convolutional Neural Network (CNN) on an existing large-scale chest x-ray image dataset and then fine-tune it with a COVID-19 dataset at a much smaller scale. However, direct transfer across datasets from different domains may lead to poor performance for CNN due to two issues, the large domain shift present in the biomedical imaging datasets and the extremely small scale of the COVID-19 chest x-ray dataset. In an attempt to address these two important issues, we formulate the problem of COVID-19 chest x-ray image classification in a semi-supervised open set domain adaptation setting and propose a novel domain adaptation method, Semi-supervised Open set Domain Adversarial network (SODA). SODA is able to align the data distributions across different domains in a general domain space and also in a common subspace of source and target data. In our experiments, SODA achieves a leading classification performance compared with recent state-of-the-art models in separating COVID-19 with common pneumonia. We also present initial results showing that SODA can produce better pathology localizations in the chest x-rays.


title: NAUTILUS: a Versatile Voice Cloning System

abstract: We introduce a novel speech synthesis system, called NAUTILUS, that can generate speech with a target voice either from a text input or a reference utterance of an arbitrary source speaker. By using a multi-speaker speech corpus to train all requisite encoders and decoders in the initial training stage, our system can clone unseen voices using untranscribed speech of target speakers on the basis of the backpropagation algorithm. Moreover, depending on the data circumstance of the target speaker, the cloning strategy can be adjusted to take advantage of additional data and modify the behaviors of text-to-speech (TTS) and/or voice conversion (VC) systems to accommodate the situation. We test the performance of the proposed framework by using deep convolution layers to model the encoders, decoders and WaveNet vocoder. Evaluations show that it achieves comparable quality with state-of-the-art TTS and VC systems when cloning with just five minutes of untranscribed speech. Moreover, it is demonstrated that the proposed framework has the ability to switch between TTS and VC with high speaker consistency, which will be useful for many applications.


title: Modeling Stakeholder-centric Value Chain of Data to Understand Data Exchange Ecosystem

abstract: In recent years, the expectation that new businesses and economic value can be created by combining/exchanging data from different fields has risen. However, value creation by data exchange involves not only data, but also technologies and a variety of stakeholders that are integrated and in competition with one another. This makes the data exchange ecosystem a challenging subject to study. In this paper, we propose a model describing the stakeholder-centric value chain (SVC) of data by focusing on the relationships among stakeholders in data businesses and discussing creative ways to use them. The SVC model enables the analysis and understanding of the structural characteristics of the data exchange ecosystem. We identified stakeholders who carry potential risk, those who play central roles in the ecosystem, and the distribution of profit among them using business models collected by the SVC.


title: Weights and recursion relations for $\phi^p$ tree amplitudes from the positive geometry

abstract: Recently, the accordiohedron in kinematic space was proposed as the positive geometry for planar tree-level scattering amplitudes in the $\phi^p$ theory \cite{Raman:2019utu}. The scattering amplitudes are given as a weighted sum over canonical forms of some accordiohedra with appropriate weights. These weights were determined by demanding that the weighted sum corresponds to the scattering amplitudes. It means that we need additional data from the quantum field theory to compute amplitudes from the geometry. It has been an important problem whether scattering amplitudes are completely obtained from only the geometry even in this $\phi^p$ theory. In this paper, we show that these weights are completely determined by the factorization property of the accordiohedron. It means that the geometry of the accordiohedron is enough to determine these weights. In addition to this, we study one-parameter recursion relations for the $\phi^p$ amplitudes. The one-parameter "BCFW"-like recursion relation for the $\phi^3$ amplitudes was obtained from the triangulation of the ABHY-associahedron \cite{Arkani-Hamed:2017tmz}. After this, a new recursion relation was proposed from the projecting triangulation of the generalized ABHY-associahedron in \cite{Arkani-Hamed:2019vag, Yang:2019esm}. We generalize these one-parameter recursion relations to the $\phi^p$ amplitudes and interpret as triangulations of the accordiohedra.


title: Secure and Differentially Private Bayesian Learning on Distributed Data

abstract: Data integration and sharing maximally enhance the potential for novel and meaningful discoveries. However, it is a non-trivial task as integrating data from multiple sources can put sensitive information of study participants at risk. To address the privacy concern, we present a distributed Bayesian learning approach via Preconditioned Stochastic Gradient Langevin Dynamics with RMSprop, which combines differential privacy and homomorphic encryption in a harmonious manner while protecting private information. We applied the proposed secure and privacy-preserving distributed Bayesian learning approach to logistic regression and survival analysis on distributed data, and demonstrated its feasibility in terms of prediction accuracy and time complexity, compared to the centralized approach.


title: A low-cost, helmet-based, non-invasive ventilator for COVID-19

abstract: Coronavirus disease 2019 (COVID-19) has created an unprecedented need for breathing assistance devices. Since the demand for commercial, full-featured ventilators is far higher than the supply capacity, many rapid-response ventilators are being developed for invasive mechanical ventilation of patients. Most of these emergency ventilators utilize mechanical squeezing of bag-valve-masks or Ambu-bags. These "bag squeezer" designs are bulky and heavy, depends on many moving parts, and difficulty to assemble and use. Also, invasive ventilation requires intensive care unit support, which may be unavailable to a vast majority of patients, especially in developing countries. In this work, we present a low-cost ($<$\$200), portable (fits in an 8"x8"x4" box), non-invasive ventilator (NIV), designed to provide relief to early-stage COVID-19 patients in low-resource settings. We used a high-pressure blower fan for providing noninvasive positive-pressure ventilation. Our design supports continuous positive airway pressure (CPAP) and bilevel positive airway pressure (BiPAP) modes. A common concern of using CPAP or BiPAP for treating COVID-19 patients is the aerosolization of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). We used a helmet-based solution that contains the spread of the virus. Our end-to-end solution is compact, low-cost ($<$\$400 including the helmet, viral filters, and a valve), and easy-to-use. Our NIV provides 0-20 cmH$_{2}$O pressure with flow rates of 60-180 Lmin$^{-1}$. We hope that our report will encourage implementations and further studies on helmet-based NIV for treating COVID-19 patients in low-resource settings.


title: Investigating Label Bias in Beam Search for Open-ended Text Generation

abstract: Beam search is an effective and widely used decoding algorithm in many sequence-to-sequence (seq2seq) text generation tasks. However, in open-ended text generation, beam search is often found to produce repetitive and generic texts, sampling-based decoding algorithms like top-k sampling and nucleus sampling are more preferred. Standard seq2seq models suffer from label bias due to its locally normalized probability formulation. This paper provides a series of empirical evidence that label bias is a major reason for such degenerate behaviors of beam search. By combining locally normalized maximum likelihood estimation and globally normalized sequence-level training, label bias can be reduced with almost no sacrifice in perplexity. To quantitatively measure label bias, we test the model's ability to discriminate the groundtruth text and a set of context-agnostic distractors. We conduct experiments on large-scale response generation datasets. Results show that beam search can produce more diverse and meaningful texts with our approach, in terms of both automatic and human evaluation metrics. Our analysis also suggests several future working directions towards the grand challenge of open-ended text generation.


title: QCD Corrections to $e^+e^- \rightarrow H^{\pm}W^{\mp}$ in Type-I THDM at Electron Positron Colliders

abstract: We investigate in detail the charged Higgs production associated with a $W$ boson at electron-positron colliders within the framework of the Type-I two-Higgs-doublet model (THDM). We calculate the integrated cross section at the LO and analyze the dependence of the cross section on the THDM parameters and the colliding energy in a benchmark scenario of the input parameters of Higgs sector. The numerical results show that the integrated cross section is sensitive to the charged Higgs mass, especially in the vicinity of $m_{H^{\pm}} \simeq 184~ {\rm GeV}$ at a $500~ {\rm GeV}$ $e^+e^-$ collider, and decreases consistently as the increment of $\tan\beta$ in the low $\tan\beta$ region. The peak in the colliding energy distribution of the cross section arises from the resonance of loop integrals and its position moves towards low colliding energy as the increment of $m_{H^{\pm}}$. We also study the two-loop NLO QCD corrections to both the integrated cross section and the angular distribution of the charged Higgs boson, and find that the QCD relative correction is also sensitive to the charged Higgs mass and strongly depends on the final-state phase space. For $\tan\beta = 2$, the QCD relative correction at a $500~ {\rm GeV}$ $e^+e^-$ collider varies in the range of $[-10\%,\, 11\%]$ as $m_{H^{\pm}}$ increases from $150$ to $400~ {\rm GeV}$.


title: Using models to improve optimizers for variational quantum algorithms

abstract: Variational quantum algorithms are a leading candidate for early applications on noisy intermediate-scale quantum computers. These algorithms depend on a classical optimization outer-loop that minimizes some function of a parameterized quantum circuit. In practice, finite sampling error and gate errors make this a stochastic optimization with unique challenges that must be addressed at the level of the optimizer. The sharp trade-off between precision and sampling time in conjunction with experimental constraints necessitates the development of new optimization strategies to minimize overall wall clock time in this setting. In this work, we introduce two optimization methods and numerically compare their performance with common methods in use today. The methods are surrogate model-based algorithms designed to improve reuse of collected data. They do so by utilizing a least-squares quadratic fit of sampled function values within a moving trusted region to estimate the gradient or a policy gradient. To make fair comparisons between optimization methods, we develop experimentally relevant cost models designed to balance efficiency in testing and accuracy with respect to cloud quantum computing systems. The results here underscore the need to both use relevant cost models and optimize hyperparameters of existing optimization methods for competitive performance. The methods introduced here have several practical advantages in realistic experimental settings, and we have used one of them successfully in a separately published experiment on Google's Sycamore device.


title: The soft-mode phonons mediated unconventional superconductivity in monolayer 1T'-WTe2

abstract: Recent experiments have tuned the monolayer 1T'-WTe2 to be superconducting by electrostatic gating. Here, we theoretically study the phonon-mediated superconductivity in monolayer 1T'-WTe2 via charge doping. We reveal that the emergence of soft-mode phonons with specific momentum is crucial to give rise to the superconductivity in electron-doping regime, whereas no such soft-mode phonons and no superconductivity emerge in hole-doping regime. We also find a superconducting dome, which can be attributed to the change of Fermi surface nesting condition as electron doping. By taking into account the experimentally established strong anisotropy of temperature-dependent upper critical field H_{c2} between the in-plane and out-of-plane directions, we show that the superconducting state probably has the unconventional equal-spin-triplet pairing in A_{u} channel of C_{2h} point group. Our studies provide a promising understanding to the doping dependent superconductivity and strong anisotropy of H_{c2} in monolayer 1T'-WTe2.


title: Theory and Simulations of Compressional and Global Alfven Eigenmode Stability in Spherical Tokamaks

abstract: Neutral-beam-driven, sub-cyclotron compressional (CAE) and global (GAE) \Alfven eigenmodes are routinely excited in spherical tokamaks such as NSTX(-U) and MAST, have been observed on the conventional aspect ratio tokamak DIII-D, and may be unstable in ITER burning plasmas. Their presence has been experimentally linked to the anomalous flattening of electron temperature profiles at high beam power in NSTX, potentially limiting fusion performance. A detailed understanding of CAE/GAE excitation, therefore, is vital to predicting (and ultimately controlling) their effects on plasma confinement. To this end, hybrid kinetic-MHD simulations are complemented with an analytic study of the linear stability properties of CAEs and GAEs. Perturbative, local analytic theory has been used to derive new instability conditions for CAEs/GAEs driven by realistic neutral beam distributions. A comprehensive set of simulations of NSTX-like plasmas has been performed for a wide range of beam parameters, providing a wealth of information on CAE and GAE stability in spherical tokamaks. Linear simulations show that the excitation of CAEs vs GAEs has a complex dependence on the fast ion injection velocity and geometry, qualitatively described by the analytic theory developed in this thesis. Strong energetic particle modifications of GAEs are found in simulations, indicating the existence of a new type of high frequency energetic particle mode. A cross validation between the theoretical stability bounds, simulation results, and experimental measurements shows favorable agreement for both the unstable CAE and GAE spectra's dependence on fast ion parameters. The analytic results accurately explain the recent experimental discovery of GAE stabilization with small amounts of off-axis beam injection on NSTX-U and suggest new techniques for control of these instabilities in future experiments.


title: Intent Mining from past conversations for conversational agent

abstract: Conversational systems are of primary interest in the AI community. Chatbots are increasingly being deployed to provide round-the-clock support and to increase customer engagement. Many of the commercial bot building frameworks follow a standard approach that requires one to build and train an intent model to recognize a user input. Intent models are trained in a supervised setting with a collection of textual utterance and intent label pairs. Gathering a substantial and wide coverage of training data for different intent is a bottleneck in the bot building process. Moreover, the cost of labeling a hundred to thousands of conversations with intent is a time consuming and laborious job. In this paper, we present an intent discovery framework that involves 4 primary steps: Extraction of textual utterances from a conversation using a pre-trained domain agnostic Dialog Act Classifier (Data Extraction), automatic clustering of similar user utterances (Clustering), manual annotation of clusters with an intent label (Labeling) and propagation of intent labels to the utterances from the previous step, which are not mapped to any cluster (Label Propagation); to generate intent training data from raw conversations. We have introduced a novel density-based clustering algorithm ITER-DBSCAN for unbalanced data clustering. Subject Matter Expert (Annotators with domain expertise) manually looks into the clustered user utterances and provides an intent label for discovery. We conducted user studies to validate the effectiveness of the trained intent model generated in terms of coverage of intents, accuracy and time saving concerning manual annotation. Although the system is developed for building an intent model for the conversational system, this framework can also be used for a short text clustering or as a labeling framework.


title: A short note on plain convergence of adaptive least-squares finite element methods

abstract: We show that adaptive least-squares finite element methods driven by the canonical least-squares functional converge under weak conditions on PDE operator, mesh-refinement, and marking strategy. Contrary to prior works, our plain convergence does neither rely on sufficiently fine initial meshes nor on severe restrictions on marking parameters. Finally, we prove that convergence is still valid if a contractive iterative solver is used to obtain the approximate solutions (e.g., the preconditioned conjugate gradient method with optimal preconditioner). The results apply within a fairly abstract framework which covers a variety of model problems.


title: Reinforcement learning with human advice: a survey

abstract: In this paper, we provide an overview of the existing methods for integrating human advice into a Reinforcement Learning process. We first propose a taxonomy of the different forms of advice that can be provided to a learning agent. We then describe the methods that can be used for interpreting advice when its meaning is not determined beforehand. Finally, we review different approaches for integrating advice into the learning process.


title: Robust Layout-aware IE for Visually Rich Documents with Pre-trained Language Models

abstract: Many business documents processed in modern NLP and IR pipelines are visually rich: in addition to text, their semantics can also be captured by visual traits such as layout, format, and fonts. We study the problem of information extraction from visually rich documents (VRDs) and present a model that combines the power of large pre-trained language models and graph neural networks to efficiently encode both textual and visual information in business documents. We further introduce new fine-tuning objectives to improve in-domain unsupervised fine-tuning to better utilize large amount of unlabeled in-domain data. We experiment on real world invoice and resume data sets and show that the proposed method outperforms strong text-based RoBERTa baselines by 6.3% absolute F1 on invoices and 4.7% absolute F1 on resumes. When evaluated in a few-shot setting, our method requires up to 30x less annotation data than the baseline to achieve the same level of performance at ~90% F1.


title: Semi-Supervised Learning: the Case When Unlabeled Data is Equally Useful

abstract: Semi-supervised learning algorithms attempt to take advantage of relatively inexpensive unlabeled data to improve learning performance. In this work, we consider statistical models where the data distributions can be characterized by continuous parameters. We show that under certain conditions on the distribution, unlabeled data is equally useful as labeled date in terms of learning rate. Specifically, let $n, m$ be the number of labeled and unlabeled data, respectively. It is shown that the learning rate of semi-supervised learning scales as $O(1/n)$ if $m\sim n$, and scales as $O(1/n^{1+\gamma})$ if $m\sim n^{1+\gamma}$ for some $\gamma>0$, whereas the learning rate of supervised learning scales as $O(1/n)$.


title: microPhantom: Playing microRTS under uncertainty and chaos

abstract: This competition paper presents microPhantom, a bot playing microRTS and participating in the 2020 microRTS AI competition. microPhantom is based on our previous bot POAdaptive which won the partially observable track of the 2018 and 2019 microRTS AI competitions. In this paper, we focus on decision-making under uncertainty, by tackling the Unit Production Problem with a method based on a combination of Constraint Programming and decision theory. We show that using our method to decide which units to train improves significantly the win rate against the second-best microRTS bot from the partially observable track. We also show that our method is resilient in chaotic environments, with a very small loss of efficiency only. To allow replicability and to facilitate further research, the source code of microPhantom is available, as well as the Constraint Programming toolkit it uses.


title: Exploring cultural challenges to implementing Educational Technology in the higher education sector in India

abstract: When learning technologies are introduced in educational environments, it is assumed that the educational environment is culture neutral i.e, all educational environments have the same challenges, problems and cultural norms. However, it can be observed that cultural factors can influence the successful implementation and use of learning technologies. In this study the aims were to explore contextual challenges to implementing different educational technologies and to explore the effects of culture. The results of this survey suggest that Hofstede's cultural measures of uncertainty avoidance, power distance and Individualist/collectivist measures, and Duckworth's Grit measure of passion and perseverance have a strong impact on the culture of technology use in India.


title: Classification and Clustering of arXiv Documents, Sections, and Abstracts, Comparing Encodings of Natural and Mathematical Language

abstract: In this paper, we show how selecting and combining encodings of natural and mathematical language affect classification and clustering of documents with mathematical content. We demonstrate this by using sets of documents, sections, and abstracts from the arXiv preprint server that are labeled by their subject class (mathematics, computer science, physics, etc.) to compare different encodings of text and formulae and evaluate the performance and runtimes of selected classification and clustering algorithms. Our encodings achieve classification accuracies up to $82.8\%$ and cluster purities up to $69.4\%$ (number of clusters equals number of classes), and $99.9\%$ (unspecified number of clusters) respectively. We observe a relatively low correlation between text and math similarity, which indicates the independence of text and formulae and motivates treating them as separate features of a document. The classification and clustering can be employed, e.g., for document search and recommendation. Furthermore, we show that the computer outperforms a human expert when classifying documents. Finally, we evaluate and discuss multi-label classification and formula semantification.


title: Insurance-Finance Arbitrage

abstract: Most insurance contracts are inherently linked to financial markets, be it via interest rates, or -- as hybrid products like equity-linked life insurance and variable annuities -- directly to stocks or indices. However, insurance contracts are not for trade except sometimes as surrender to the selling office. This excludes the situation of arbitrage by buying and selling insurance contracts at different prices. Furthermore, the insurer uses private information on top of the publicly available one about financial market. This paper provides a study of the consistency of insurance contracts in connection with trades in the financial market with explicit mention of the information involved. By defining strategies on an insurance portfolio and combining them with financial trading strategies, we arrive at the notion of insurance-finance arbitrage (IFA). In analogy to the classical fundamental theorem of asset pricing, we give a fundamental theorem on the absence of IFA, leading to the existence of an insurance-finance-consistent probability. In addition, we study when this probability gives the expected discounted cash-flows required by the EIOPA best estimate. The generality of our approach allows to incorporate many important aspects, like mortality risk or general levels of dependence between mortality and stock markets. Utilizing the theory of enlargements of filtrations, we construct a tractable framework for insurance-finance consistent valuation.