title: Emergence and Breaking of Duality Symmetry in Generalized Fundamental Thermodynamic Relations

abstract: Thermodynamics as limiting behaviors of statistics is generalized to arbitrary system with probability {\it a priori} where thermodynamic infinite-size limit is replaced by multiple-measurement limit. A duality symmetry between Massieu's and Gibbs' entropy arises in the limit of infinitely repeated observations, yielding the Gibbs equation and Hill-Gibbs-Duhem equation (HGDE) as dual pair. If a system has thermodynamic limit satisfying Callen's postulate, entropy being an Eulerian function, the symmetry is lost: the HGDE reduces to the Gibbs-Duhem equation. This theory provides a de-mechanized foundation for classical and nanothermodynamics and offers a framework for distilling emergence from large data, free from underlying details.


title: $\mathbb Z/2$-Godeaux surfaces

abstract: We compute explicit equations for all (universal coverings of) Godeaux surfaces with torsion group $\mathbb Z/2.$ We show that their moduli space is irreducible and unirational of dimension 8.


title: Extra-fine sheaves and interaction decompositions

abstract: We introduce an original notion of extra-fine sheaf on a topological space, and a variant (hyper-extra-fine) for which \v{C}ech cohomology in strictly positive degree vanishes. We provide a characterization of such sheaves when the topological space is a partially ordered set (poset) equipped with the Alexandrov topology. Then we further specialize our results to some sheaves of vector spaces and injective maps, where extra-fineness is (essentially) equivalent to the decomposition of the sheaf into a direct sum of subfunctors, known as interaction decomposition, and can be expressed by a sum-intersection condition. We use these results to compute the dimension of the space of global sections when the presheaves are freely generated over a functor of sets, generalizing classical counting formulae for the number of solutions of the linearized marginal problem (Kellerer and Mat\'u\v{s}). We finish with a comparison theorem between the \v{C}ech cohomology associated to a covering and the topos cohomology of the poset with coefficients in the presheaf, which is also the cohomology of a cosimplicial local system over the nerve of the poset. For that, we give a detailed treatment of cosimplicial local systems on simplicial sets. The appendixes present presheaves, sheaves and \v{C}ech cohomology, and their application to the marginal problem.


title: Operads for Designing Systems of Systems

abstract: System of systems engineering seeks to analyze, design and deploy collections of systems that together can flexibly address an array of complex tasks. In the Complex Adaptive System Composition and Design Environment program, we developed "network operads" as a tool for designing and tasking systems of systems, and applied them to domains including maritime search and rescue. The network operad formalism offers new ways to handle changing levels of abstraction in system-of-system design and tasking.


title: Quantitative and Qualitative Evaluation of Explainable Deep Learning Methods for Ophthalmic Diagnosis

abstract: Background: The lack of explanations for the decisions made by algorithms such as deep learning has hampered their acceptance by the clinical community despite highly accurate results on multiple problems. Recently, attribution methods have emerged for explaining deep learning models, and they have been tested on medical imaging problems. The performance of attribution methods is compared on standard machine learning datasets and not on medical images. In this study, we perform a comparative analysis to determine the most suitable explainability method for retinal OCT diagnosis. Methods: A commonly used deep learning model known as Inception v3 was trained to diagnose 3 retinal diseases - choroidal neovascularization (CNV), diabetic macular edema (DME), and drusen. The explanations from 13 different attribution methods were rated by a panel of 14 clinicians for clinical significance. Feedback was obtained from the clinicians regarding the current and future scope of such methods. Results: An attribution method based on a Taylor series expansion, called Deep Taylor was rated the highest by clinicians with a median rating of 3.85/5. It was followed by two other attribution methods, Guided backpropagation and SHAP (SHapley Additive exPlanations). Conclusion: Explanations of deep learning models can make them more transparent for clinical diagnosis. This study compared different explanations methods in the context of retinal OCT diagnosis and found that the best performing method may not be the one considered best for other deep learning tasks. Overall, there was a high degree of acceptance from the clinicians surveyed in the study. Keywords: explainable AI, deep learning, machine learning, image processing, Optical coherence tomography, retina, Diabetic macular edema, Choroidal Neovascularization, Drusen


title: Estimation of the incubation time distribution for COVID-19

abstract: We consider smooth nonparametric estimation of the incubation time distribution of COVID-19, in connection with the investigation of researchers from the National Institute for Public Health and the Environment (Dutch: RIVM) of 88 travelers from Wuhan: Backer et al (2020). The advantages of the smooth nonparametric approach w.r.t. the parametric approach, using three parametric distributions (Weibull, log-normal and gamma) in Backer et al (2020) is discussed. It is shown that the typical rate of convergence of the smooth estimate of the density is $n^{2/7}$ in a continuous version of the model, where $n$ is the sample size. The (non-smoothed) nonparametric maximum likelihood estimator (MLE) itself is computed by the iterative convex minorant algorithm (Groeneboom and Jongbloed (2014)). All computations are available as {\tt R} scripts in Groeneboom (2020).


title: Attractors are not algebraic

abstract: The Attractor Conjecture for Calabi-Yau moduli spaces predicts the algebraicity of the moduli values of certain isolated points picked out by Hodge-theoretic conditions. We provide a family of counterexamples to the Attractor Conjecture in all suitably high, odd dimensions conditional on the Zilber-Pink conjecture.


title: ADMM-Net for Communication Interference Removal in Stepped-Frequency Radar

abstract: Complex ADMM-Net, a complex-valued neural network architecture inspired by the alternating direction method of multipliers (ADMM), is designed for interference removal in super-resolution stepped frequency radar angle-range-doppler imaging. Tailored to an uncooperative scenario wherein a MIMO radar shares spectrum with communications, the ADMM-Net recovers the radar image---which is assumed to be sparse---and simultaneously removes the communication interference, which is modeled as sparse in the frequency domain owing to spectrum underutilization. The scenario motivates an $\ell_1$-minimization problem whose ADMM iteration, in turn, undergirds the neural network design, yielding a set of generalized ADMM iterations that have learnable hyperparameters and operations. To train the network we use random data generated according to the radar and communication signal models. In numerical experiments ADMM-Net exhibits markedly lower error and computational cost than ADMM and CVX.


title: Improved Buildup Model for Radiation-Induced Defects in MOSFET Isolation Oxides

abstract: Ionizing radiation induces defects in STI oxides in current MOSFETs. These defects may degrade the performance of the MOS circuit. Analytical models for the buildup of these defects during the radiation exposure are available in literature. In this paper, we show that the classical model used to estimate the buildup of TID-induced traps in MOSTs predicts inaccurate results at high radiation levels. We, further, introduce an improved model to estimate the buildup of defects that is valid for both low and high radiation doses. Our improved model is compared to published data showing its validity.


title: Entanglement entropy of cosmological perturbations for S-brane Ekpyrosis

abstract: We calculate the entanglement entropy of scalar perturbations due to gravitational non-linearities present in any model of canonically-coupled, single-field ekpyrosis. Specifically, we focus on a recent model of improved ekpyrosis which is able to generate a scale-invariant power spectrum of curvature perturbations and gravitational waves as well as have a non-singular bounce due to an S-brane at the end of ekpyrotic contraction. By requiring that the entanglement entropy remians subdominant to the thermal entropy produced during reheating, we get an upper bound on the energy scale of the bounce.


title: Supersymmetric Proximity

abstract: I argue that a certain perturbative proximity exists between some supersymmetric and non-supersymmetric theories (namely, pure Yang-Mills and adjoint QCD with two flavors, adjQCD$_{N_f=2}$). I start with ${\mathcal N}=2$ super-Yang-Mills theory built of two ${\mathcal N}=1$ superfields: vector and chiral. In ${\mathcal N}=1$ language the latter presents matter in the adjoint representation of SU$(N). $ Then I convert the matter superfield into a "{\em phantom}" one (in analogy with ghosts), breaking ${\mathcal N}=2$ down to ${\mathcal N}=1$. The global SU(2) acting between two gluinos in the original theory becomes graded. Exact results in thus deformed theory allows one to obtain insights in certain aspects of non-supersymmetric gluodynamics. In particular, it becomes clear how the splitting of the $\beta$ function coefficients in pure gluodynamics, $\beta_1 =(4 -\frac 13 )N$ and $\beta_2= (6-\frac 13)N^2$, occurs. Here the first terms in the braces (4 and 6, always integers) are geometry-related while the second terms ($-\frac 13$ in both cases) are {\it bona fide} quantum effects. In the same sense adjQCD$_{N_f=2}$ is close to ${\mathcal N}=2$ SYM. Thus, I establish a certain proximity between pure gluodynamics and adjQCD$_{N_f=2}$ with supersymmetric theories. (Of course, in both cases we loose all features related to flat directions and Higgs/Coulomb branches in ${\mathcal N}=2$.) As a warmup exercise I use this idea in 2D CP(1) sigma model with ${\mathcal N}=(2,2)$ supersymmetry, through the minimal heterotic ${\mathcal N}=(0,2) \to$ bosonic CP(1).


title: Nondisturbing Quantum Measurement Models

abstract: A measurement model is a framework that describes a quantum measurement process. In this article we restrict attention to $MM$s on finite-dimensional Hilbert spaces. Suppose we want to measure an observable $A$ whose outcomes $A_x$ are represented by positive operators (effects) on a Hilbert Space $H$. We call $H$ the base or object system. We interact $H$ with a probe system on another Hilbert space $K$ by means of a quantum channel. The probe system contains a probe (or meter or pointer) observable $F$ whose outcomes $F_x$ are measured by an apparatus that is frequently (but need not be) classical in practice. The $MM$ protocol gives a method for determining the probability of an outcome $A_x$ for any state of $H$ in terms of the outcome $F_x$. The interaction channel usually entangles this state with an initial probe state of $K$ that can be quite complicated. However, if the channel is nondisturbing in a sense that we describe, then the entanglement is considerably simplified. In this article, we give formulas for observables and instruments measured by nondisturbing $MM$s. We begin with a general discussion of nondisturbing operators relative to a quantum context. We present two examples that illustrate this theory in terms of unitary nondisturbing channels.


title: Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression

abstract: Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR) data. Effort has been put both on increasing models' overall performance as well as improving their interpretability, particularly regarding the decision-making process. In this study, we present a temporal deep learning model to perform bidirectional representation learning on EHR sequences with a transformer architecture to predict future diagnosis of depression. This model is able to aggregate five heterogenous and high-dimensional data sources from the EHR and process them in a temporal manner for chronic disease prediction at various prediction windows. We applied the current trend of pretraining and fine-tuning on EHR data to outperform the current state-of-the-art in chronic disease prediction, and to demonstrate the underlying relation between EHR codes in the sequence. The model generated the highest increases of precision-recall area under the curve (PRAUC) from 0.70 to 0.76 in depression prediction compared to the best baseline model. Furthermore, the self-attention weights in each sequence quantitatively demonstrated the inner relationship between various codes, which improved the model's interpretability. These results demonstrate the model's ability to utilize heterogeneous EHR data to predict depression while achieving high accuracy and interpretability, which may facilitate constructing clinical decision support systems in the future for chronic disease screening and early detection.


title: Age of Information in Multi-hop Networks with Priorities

abstract: Age of Information is a new metric used in real-time status update tracking applications. It measures at the destination the time elapsed since the generation of the last received packet. In this paper, we consider the co-existence of critical and noncritical status updates in a two-hop system, for which the network assigns different scheduling priorities. Specifically, the high priority is reserved to the packets that traverse the two nodes, as they experience worse latency performance. We obtain the distribution of the age and its natural upper bound termed peak age. We provide tight upper and lower bounds for priority updates and the exact expressions for the non-critical flow of packets with a general service distribution. The results give fundamental insights for the design of age-sensitive multi-hop systems.


title: Domain Generalization via Semi-supervised Meta Learning

abstract: The goal of domain generalization is to learn from multiple source domains to generalize to unseen target domains under distribution discrepancy. Current state-of-the-art methods in this area are fully supervised, but for many real-world problems it is hardly possible to obtain enough labeled samples. In this paper, we propose the first method of domain generalization to leverage unlabeled samples, combining of meta learning's episodic training and semi-supervised learning, called DGSML. DGSML employs an entropy-based pseudo-labeling approach to assign labels to unlabeled samples and then utilizes a novel discrepancy loss to ensure that class centroids before and after labeling unlabeled samples are close to each other. To learn a domain-invariant representation, it also utilizes a novel alignment loss to ensure that the distance between pairs of class centroids, computed after adding the unlabeled samples, is preserved across different domains. DGSML is trained by a meta learning approach to mimic the distribution shift between the input source domains and unseen target domains. Experimental results on benchmark datasets indicate that DGSML outperforms state-of-the-art domain generalization and semi-supervised learning methods.


title: The Sun Diver: Combining solar sails with the Oberth effect

abstract: A highly reflective sail provides a way to propel a spacecraft out of the solar system using solar radiation pressure. The closer the spacecraft is to the Sun when it starts its outward journey, the larger the radiation pressure and so the larger the final velocity. For a spacecraft starting on the Earth's orbit, closer proximity can be achieved via a retrograde impulse from a rocket engine. The sail is then deployed at the closest approach to the Sun. Employing the so-called Oberth effect, a second, prograde, impulse at closest approach will raise the final velocity further. Here I investigate how a fixed total impulse ({\Delta}v) can best be distributed in this procedure to maximize the sail's velocity at infinity. Once {\Delta}v exceeds a threshold that depends on the lightness number of the sail (a measure of its sun-induced acceleration), the best strategy is to use all of the {\Delta}v in the retrograde impulse to dive as close as possible to the Sun. Below the threshold the best strategy is to use all of the {\Delta}v in the prograde impulse and thus not to dive at all. Although larger velocities can be achieved with multi-stage impulsive transfers, this study shows some interesting and perhaps counter-intuitive consequences of combining impulses with solar sails.

categories: physics.pop-ph astro-ph.IM physics.class-ph physics.space-ph


title: Characterizing and Detecting Freezing of Gait using Multi-modal Physiological Signals

abstract: Freezing-of-gait a mysterious symptom of Parkinsons disease and defined as a sudden loss of ability to move forward. Common treatments of freezing episodes are currently of moderate efficacy and can likely be improved through a reliable freezing evaluation. Basic-science studies about the characterization of freezing episodes and a 24/7 evidence-support freezing detection system can contribute to the reliability of the evaluation in daily life. In this study, we analyzed multi-modal features from brain, eye, heart, motion, and gait activity from 15 participants with idiopathic Parkinsons disease and 551 freezing episodes induced by turning in place. Statistical analysis was first applied on 248 of the 551 to determine which multi-modal features were associated with freezing episodes. Features significantly associated with freezing episodes were ranked and used for the freezing detection. We found that eye-stabilization speed during turning and lower-body trembling measure significantly associated with freezing episodes and used for freezing detection. Using a leave-one-subject-out cross-validation, we obtained a sensitivity of 97%+/-3%, a specificity of 96%+/-7%, a precision of 73%+/-21%, a Matthews correlation coefficient of 0.82+/-0.15, and an area under the Precision-Recall curve of 0.94+/-0.05. According to the Precision-Recall curves, the proposed freezing detection method using the multi-modal features performed better than using single-modal features.


title: Novel perspectives gained from new reconstruction algorithms

abstract: Since the 1970s, much of traditional interferometric imaging has been built around variations of the CLEAN algorithm, in both terminology, methodology, and algorithm development. Recent developments in applying new algorithms from convex optimization to interferometry has allowed old concepts to be viewed from a new perspective, ranging from image restoration to the development of computationally distributed algorithms. We present how this has ultimately led the authors to new perspectives in wide-field imaging, allowing for the first full individual non-coplanar corrections applied during imaging over extremely wide-fields of view for the Murchison Widefield Array (MWA) telescope. Furthermore, this same mathematical framework has provided a novel understanding of wide-band polarimetry at low frequencies, where instrumental channel depolarization can be corrected through the new $\delta\lambda^2$-projection algorithm. This is a demonstration that new algorithm development outside of traditional radio astronomy is valuable for the new theoretical and practical perspectives gained. These perspectives are timely with the next generation of radio telescopes coming online.


title: Co-Planar Parametrization for Stereo-SLAM and Visual-Inertial Odometry

abstract: This work proposes a novel SLAM framework for stereo and visual inertial odometry estimation. It builds an efficient and robust parametrization of co-planar points and lines which leverages specific geometric constraints to improve camera pose optimization in terms of both efficiency and accuracy. %reduce the size of the Hessian matrix in the optimization. The pipeline consists of extracting 2D points and lines, predicting planar regions and filtering the outliers via RANSAC. Our parametrization scheme then represents co-planar points and lines as their 2D image coordinates and parameters of planes. We demonstrate the effectiveness of the proposed method by comparing it to traditional parametrizations in a novel Monte-Carlo simulation set. Further, the whole stereo SLAM and VIO system is compared with state-of-the-art methods on the public real-world dataset EuRoC. Our method shows better results in terms of accuracy and efficiency than the state-of-the-art. The code is released at https://github.com/LiXin97/Co-Planar-Parametrization.


title: Preconditioned BFGS-based Uncertainty Quantification in elastic Full Waveform Inversion

abstract: Full Waveform Inversion (FWI) plays a vital role in reconstructing geophysical structures. The Uncertainty Quantification regarding the inversion results is equally important but has been missing out in most of the current geophysical inversions. Mathematically, uncertainty quantification is involved with the inverse Hessian (or the posterior covariance matrix), which is prohibitive in computation and storage for practical geophysical FWI problems. L-BFGS populates as the most efficient Gauss-Newton method; however, in this study, we empower it with the new possibility of accessing the inverse Hessian for uncertainty quantification in FWI. To facilitate the inverse-Hessian retrieval, we put together BFGS (essentially, full-history L-BFGS) with randomized singular value decomposition towards a low-rank approximation of the Hessian inverse. That the rank number equals the number of iterations makes this solution efficient and memory-affordable even for large-scale inversions. Also, based on the adjoint method, we formulate different diagonal Hessian initials as preconditioners and compare their performances in elastic FWI. We highlight our methods with the elastic Marmousi benchmark, demonstrating the applicability of preconditioned BFGS in large-scale FWI and uncertainty quantification.


title: Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks

abstract: Multispectral images (e.g. visible and infrared) may be particularly useful when detecting objects with the same model in different environments (e.g. day/night outdoor scenes). To effectively use the different spectra, the main technical problem resides in the information fusion process. In this paper, we propose a new halfway feature fusion method for neural networks that leverages the complementary/consistency balance existing in multispectral features by adding to the network architecture, a particular module that cyclically fuses and refines each spectral feature. We evaluate the effectiveness of our fusion method on two challenging multispectral datasets for object detection. Our results show that implementing our Cyclic Fuse-and-Refine module in any network improves the performance on both datasets compared to other state-of-the-art multispectral object detection methods.


title: Nonclassical Measurement Error in the Outcome Variable

abstract: We study a semi-/nonparametric regression model with a general form of nonclassical measurement error in the outcome variable. We show equivalence of this model to a generalized regression model. Our main identifying assumptions are a special regressor type restriction and monotonicity in the nonlinear relationship between the observed and unobserved true outcome. Nonparametric identification is then obtained under a normalization of the unknown link function, which is a natural extension of the classical measurement error case. We propose a novel sieve rank estimator for the regression function and establish its rate of convergence. In Monte Carlo simulations, we find that our estimator corrects for biases induced by nonclassical measurement error and provides numerically stable results. We apply our method to analyze belief formation of stock market expectations with survey data from the German Socio-Economic Panel (SOEP) and find evidence for nonclassical measurement error in subjective belief data.


title: Numerical Continuation and Bifurcation Analysis in a Harvested Predator-Prey Model with Time Delay using DDE-Biftool

abstract: Time delay has been incorporated in models to reflect certain physical or biological meaning. The theory of delay differential equations (DDEs), which has seen extensive growth in the last seventy years or so, can be used to examine the effects of time delay in the dynamical behavior of systems being considered. Numerical tools to study DDEs have played a significant role not only in illustrating theoretical results but also in discovering interesting dynamics of the model. DDE-Biftool, which is a Matlab package for numerical continuation and numerical bifurcation analysis of DDEs, is one of the most utilized and popular numerical tools for DDEs. In this paper, we present a guide to using the latest version of DDE-Biftool targeted to researchers who are new to the study of time delay systems. A short discussion of an example application, which is a harvested predator-prey model with a single discrete time delay, will be presented first. We then implement this example model in DDE-Biftool, pointing out features where beginners need to be cautious. We end with a comparison of our theoretical and numerical results.


title: Estimating Linear Dynamical Networks of Cyclostationary Processes

abstract: Topology learning is an important problem in dynamical systems with implications to security and optimal control. The majority of prior work in consistent topology estimation relies on dynamical systems excited by temporally uncorrelated processes. In this article, we present a novel algorithm for guaranteed topology learning, in networks that are excited by temporally colored, cyclostationary processes. Furthermore, unlike prior work, the framework applies to linear dynamic system with complex valued dependencies. In the second part of the article, we analyze conditions for consistent topology learning for bidirected radial networks when a subset of the network is unobserved. Here, few agents are unobserved and the full topology along with unobserved nodes are recovered from observed agents data alone. Our theoretical contributions are validated on test networks.


title: Thermodynamic curvature of the binary van der Waals fluid

abstract: The thermodynamic Ricci curvature scalar $R$ has been applied in a number of contexts, mostly for systems characterized by 2D thermodynamic geometries. Calculations of $R$ in thermodynamic geometries of dimension three or greater have been very few, especially in the fluid regime. In this paper, we calculate $R$ for two examples involving binary fluid mixtures: a binary mixture of a van der Waals (vdW) fluid with only repulsive interactions, and a binary vdW mixture with attractive interactions added. In both these examples, we evaluate $R$ for full 3D thermodynamic geometries. Our finding is that basic physical patterns found for $R$ in the pure fluid are reproduced to a large extent for the binary fluid.


title: Aerostructural Wing Shape Optimization assisted by Algorithmic Differentiation

abstract: With more efficient structures, last trends in aeronautics have witnessed an increased flexibility of wings, calling for adequate design and optimization approaches. To correctly model the coupled physics, aerostructural optimization has progressively become more important, being nowadays performed also considering higher-fidelity discipline methods, i.e., CFD for aerodynamics and FEM for structures. In this paper a methodology for high-fidelity gradient-based aerostructural optimization of wings, including aerodynamic and structural nonlinearities, is presented. The main key feature of the method is its modularity: each discipline solver, independently employing algorithmic differentiation for the evaluation of adjoint-based sensitivities, is interfaced at high-level by means of a wrapper to both solve the aerostructural primal problem and evaluate exact discrete gradients of the coupled problem. The implemented capability, ad-hoc created to demonstrate the methodology, and freely available within the open-source SU2 multiphysics suite, is applied to perform aerostructural optimization of aeroelastic test cases based on the ONERA M6 and NASA CRM wings. Single-point optimizations, employing Euler or RANS flow models, are carried out to find wing optimal outer mold line in terms of aerodynamic efficiency. Results remark the importance of taking into account the aerostructural coupling when performing wing shape optimization.


title: Effective Kan fibrations in simplicial sets

abstract: We introduce the notion of an effective Kan fibration, a new mathematical structure that can be used to study simplicial homotopy theory. Our main motivation is to make simplicial homotopy theory suitable for homotopy type theory. Effective Kan fibrations are maps of simplicial sets equipped with a structured collection of chosen lifts that satisfy certain non-trivial properties. This contrasts with the ordinary, unstructured notion of a Kan fibration. We show that fundamental properties of Kan fibrations can be extended to explicit constructions on effective Kan fibrations. In particular, we give a constructive (explicit) proof showing that effective Kan fibrations are stable under push forward, or fibred exponentials. This is known to be impossible for ordinary Kan fibrations. We further show that effective Kan fibrations are local, or completely determined by their fibres above representables. We also give an (ineffective) proof saying that the maps which can be equipped with the structure of an effective Kan fibration are precisely the ordinary Kan fibrations. Hence implicitly, both notions still describe the same homotopy theory. By showing that the effective Kan fibrations combine all these properties, we solve an open problem in homotopy type theory. In this way our work provides a first step in giving a constructive account of Voevodsky's model of univalent type theory in simplicial sets.


title: A comprehensive picture for binary interactions of subaqueous barchans

abstract: We investigate experimentally the short-range interactions occurring between two subaqueous barchans. The experiments were conducted in a water channel of transparent material where controlled grains were poured inside, and a camera placed on the top acquired images of the bedforms. We varied the grain types (diameter, density and roundness), pile masses, transverse distances, water flow rates and initial conditions. As a result, five different patterns were identified for both aligned and off-centered configurations and we propose interaction maps that depend basically on the ratio between the number of grains of each dune, Shields number and alignment of barchans. In addition, we show experimental indications that an ejected barchan has roughly the same mass of the impacting one in some cases, and that in wake-dominated processes the asymmetry of the downstream dune is large. The present results shed light on the size regulation of barchans found on Earth and other planets.


title: Reliability-Performance Trade-offs in Neuromorphic Computing

abstract: Neuromorphic architectures built with Non-Volatile Memory (NVM) can significantly improve the energy efficiency of machine learning tasks designed with Spiking Neural Networks (SNNs). A major source of voltage drop in a crossbar of these architectures are the parasitic components on the crossbar's bitlines and wordlines, which are deliberately made longer to achieve lower cost-per-bit. We observe that the parasitic voltage drops create a significant asymmetry in programming speed and reliability of NVM cells in a crossbar. Specifically, NVM cells that are on shorter current paths are faster to program but have lower endurance than those on longer current paths, and vice versa. This asymmetry in neuromorphic architectures create reliability-performance trade-offs, which can be exploited efficiently using SNN mapping techniques. In this work, we demonstrate such trade-offs using a previously-proposed SNN mapping technique with 10 workloads from contemporary machine learning tasks for a state-of-the art neuromoorphic hardware.


title: Cosmological signatures of a Rapid Diluted Energy Density

abstract: We study the cosmological signatures of having extra energy density, $\rho_{ex}$, beyond the $\Lambda$CDM model that dilutes rapidly, faster than radiation, at a scale factor $a_c$ with a corresponding mode $k_c=a_c H(a_c)$ crossing the horizon at that time. These types of models are motivated by phase transitions of the underlying elementary particles, for example the creation of protons and neutrons from almost massless quarks or the recently proposed Bound Dark Energy model. The rapidly dilution of $\rho_{ex}$ leaves distinctive imprints in the Universe not only in the expansion history with a clear impact on the acoustic scale, $r_s(a_cc)$, and angular distances, $D_A(a)$, but also in the matter and CMB power spectra. The rapidly diluted energy density $\rho_{ex}$, (RDED) generates characteristic signatures that can be observed with current and future precision cosmological data. In particular, we find a bump in the matter power spectrum compared to the standard $\Lambda$CDM. We identify the amplitude, width, and time scale of the bump to the physical properties of the transition. We study these effects with linear theory, standard perturbation theory, and the correlated impact on cosmological distances, allowing for independent measurements of these extensions of the standard $\Lambda$CDM model.


title: Enhancing a Neurocognitive Shared Visuomotor Model for Object Identification, Localization, and Grasping With Learning From Auxiliary Tasks

abstract: We present a follow-up study on our unified visuomotor neural model for the robotic tasks of identifying, localizing, and grasping a target object in a scene with multiple objects. Our Retinanet-based model enables end-to-end training of visuomotor abilities in a biologically inspired developmental approach. In our initial implementation, a neural model was able to grasp selected objects from a planar surface. We embodied the model on the NICO humanoid robot. In this follow-up study, we expand the task and the model to reaching for objects in a three-dimensional space with a novel dataset based on augmented reality and a simulation environment. We evaluate the influence of training with auxiliary tasks, i.e., if learning of the primary visuomotor task is supported by learning to classify and locate different objects. We show that the proposed visuomotor model can learn to reach for objects in a three-dimensional space. We analyze the results for biologically-plausible biases based on object locations or properties. We show that the primary visuomotor task can be successfully trained simultaneously with one of the two auxiliary tasks. This is enabled by a complex neurocognitive model with shared and task-specific components, similar to models found in biological systems.


title: A Primal-Dual Subgradient Approachfor Fair Meta Learning

abstract: The problem of learning to generalize to unseen classes during training, known as few-shot classification, has attracted considerable attention. Initialization based methods, such as the gradient-based model agnostic meta-learning (MAML), tackle the few-shot learning problem by "learning to fine-tune". The goal of these approaches is to learn proper model initialization, so that the classifiers for new classes can be learned from a few labeled examples with a small number of gradient update steps. Few shot meta-learning is well-known with its fast-adapted capability and accuracy generalization onto unseen tasks. Learning fairly with unbiased outcomes is another significant hallmark of human intelligence, which is rarely touched in few-shot meta-learning. In this work, we propose a Primal-Dual Fair Meta-learning framework, namely PDFM, which learns to train fair machine learning models using only a few examples based on data from related tasks. The key idea is to learn a good initialization of a fair model's primal and dual parameters so that it can adapt to a new fair learning task via a few gradient update steps. Instead of manually tuning the dual parameters as hyperparameters via a grid search, PDFM optimizes the initialization of the primal and dual parameters jointly for fair meta-learning via a subgradient primal-dual approach. We further instantiate examples of bias controlling using mean difference and decision boundary covariance as fairness constraints to each task for supervised regression and classification, respectively. We demonstrate the versatility of our proposed approach by applying our approach to various real-world datasets. Our experiments show substantial improvements over the best prior work for this setting.


title: Possibility of coherent electron transport in a nanoscale circuit

abstract: Others have solved the Schr\"odinger equation to estimate the tunneling current between two electrodes at specified potentials, or the transmission through a potential barrier, assuming that an incident wave causes one reflected wave and one transmitted wave. However, this may not be appropriate in some nanoscale circuits because the electron mean-free path may be as long as 68 nm in metals. Thus, the wavefunction may be coherent throughout the metal components in a circuit if the interaction of the electrons with the surface of conductors and grain boundaries, which reduces the mean-free path, is reduced. We consider the use of single-crystal wires, and include a tunneling junction to focus and collimate the electrons near the axis, to further reduce their interaction with the surface of the wire. Our simulations suggest that, in addition to the incoherent phenomena, there are extremely sharply-defined coherent modes in nanoscale circuits. Algorithms are presented with examples to determine the sets of the parameters for these modes. Other algorithms are presented to determine the normalized coefficients in the wavefunction and the distribution of current in the circuits. This is done using only algebra with calculus for analytical solutions of the Schr\"odinger equation.


title: KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoning

abstract: Generative commonsense reasoning which aims to empower machines to generate sentences with the capacity of reasoning over a set of concepts is a critical bottleneck for text generation. Even the state-of-the-art pre-trained language generation models struggle at this task and often produce implausible and anomalous sentences. One reason is that they rarely consider incorporating the knowledge graph which can provide rich relational information among the commonsense concepts. To promote the ability of commonsense reasoning for text generation, we propose a novel knowledge graph augmented pre-trained language generation model KG-BART, which encompasses the complex relations of concepts through the knowledge graph and produces more logical and natural sentences as output. Moreover, KG-BART can leverage the graph attention to aggregate the rich concept semantics that enhances the model generalization on unseen concept sets. Experiments on benchmark CommonGen dataset verify the effectiveness of our proposed approach by comparing with several strong pre-trained language generation models, particularly KG-BART outperforms BART by 5.80, 4.60, in terms of BLEU-3, 4. Moreover, we also show that the generated context by our model can work as background scenarios to benefit downstream commonsense QA tasks.


title: I Like to Move It: 6D Pose Estimation as an Action Decision Process

abstract: Object pose estimation is an integral part of robot vision and AR. Previous 6D pose retrieval pipelines treat the problem either as a regression task or discretize the pose space to classify. We change this paradigm and reformulate the problem as an action decision process where an initial pose is updated in incremental discrete steps that sequentially move a virtual 3D rendering towards the correct solution. A neural network estimates likely moves from a single RGB image iteratively and determines so an acceptable final pose. In comparison to other approaches that train object-specific pose models, we learn a decision process. This allows for a lightweight architecture while it naturally generalizes to unseen objects. A coherent stop action for process termination enables dynamic reduction of the computation cost if there are insignificant changes in a video sequence. Instead of a static inference time, we thereby automatically increase the runtime depending on the object motion. Robustness and accuracy of our action decision network are evaluated on Laval and YCB video scenes where we significantly improve the state-of-the-art.


title: Sparse-Hamiltonian approach to the time evolution of molecules on quantum computers

abstract: Quantum chemistry has been viewed as one of the potential early applications of quantum computing. Two techniques have been proposed for electronic structure calculations: (i) the variational quantum eigensolver and (ii) the phase-estimation algorithm. In both cases, the complexity of the problem increases for basis sets where either the Hamiltonian is not sparse, or it is sparse, but many orbitals are required to accurately describe the molecule of interest. In this work, we explore the possibility of mapping the molecular problem onto a sparse Hubbard-like Hamiltonian, which allows a Green's-function-based approach to electronic structure via a hybrid quantum-classical algorithm. We illustrate the time-evolution aspect of this methodology with a simple four-site hydrogen ring.


title: Generalizing Kirchhoff laws for Signed Graphs

abstract: Kirchhoff-type Laws for signed graphs are characterized by generalizing transpedances through the incidence-oriented structure of bidirected graphs. The classical $2$-arborescence interpretation of Tutte is shown to be equivalent to single-element Boolean classes of reduced incidence-based cycle covers, called contributors. A generalized contributor-transpedance is introduced using entire Boolean classes that naturally cancel in a graph; classical conservation is proven to be property of the trivial Boolean classes. The contributor-transpedances on signed graphs are shown to produce non-conservative Kirchhoff-type Laws, where every contributor possesses the unique source-sink path property. Finally, the maximum value of a contributor-transpedance is calculated through the signless Laplacian.


title: Clustering-based Unsupervised Generative Relation Extraction

abstract: This paper focuses on the problem of unsupervised relation extraction. Existing probabilistic generative model-based relation extraction methods work by extracting sentence features and using these features as inputs to train a generative model. This model is then used to cluster similar relations. However, these methods do not consider correlations between sentences with the same entity pair during training, which can negatively impact model performance. To address this issue, we propose a Clustering-based Unsupervised generative Relation Extraction (CURE) framework that leverages an "Encoder-Decoder" architecture to perform self-supervised learning so the encoder can extract relation information. Given multiple sentences with the same entity pair as inputs, self-supervised learning is deployed by predicting the shortest path between entity pairs on the dependency graph of one of the sentences. After that, we extract the relation information using the well-trained encoder. Then, entity pairs that share the same relation are clustered based on their corresponding relation information. Each cluster is labeled with a few words based on the words in the shortest paths corresponding to the entity pairs in each cluster. These cluster labels also describe the meaning of these relation clusters. We compare the triplets extracted by our proposed framework (CURE) and baseline methods with a ground-truth Knowledge Base. Experimental results show that our model performs better than state-of-the-art models on both New York Times (NYT) and United Nations Parallel Corpus (UNPC) standard datasets.


title: Decision-Aware Conditional GANs for Time Series Data

abstract: We introduce the decision-aware time-series conditional generative adversarial network (DAT-CGAN) as a method for time-series generation. The framework adopts a multi-Wasserstein loss on structured decision-related quantities, capturing the heterogeneity of decision-related data and providing new effectiveness in supporting the decision processes of end users. We improve sample efficiency through an overlapped block-sampling method, and provide a theoretical characterization of the generalization properties of DAT-CGAN. The framework is demonstrated on financial time series for a multi-time-step portfolio choice problem. We demonstrate better generative quality in regard to underlying data and different decision-related quantities than strong, GAN-based baselines.


title: Reinforcement Learning-based N-ary Cross-Sentence Relation Extraction

abstract: The models of n-ary cross sentence relation extraction based on distant supervision assume that consecutive sentences mentioning n entities describe the relation of these n entities. However, on one hand, this assumption introduces noisy labeled data and harms the models' performance. On the other hand, some non-consecutive sentences also describe one relation and these sentences cannot be labeled under this assumption. In this paper, we relax this strong assumption by a weaker distant supervision assumption to address the second issue and propose a novel sentence distribution estimator model to address the first problem. This estimator selects correctly labeled sentences to alleviate the effect of noisy data is a two-level agent reinforcement learning model. In addition, a novel universal relation extractor with a hybrid approach of attention mechanism and PCNN is proposed such that it can be deployed in any tasks, including consecutive and nonconsecutive sentences. Experiments demonstrate that the proposed model can reduce the impact of noisy data and achieve better performance on general n-ary cross sentence relation extraction task compared to baseline models.


title: MicroAnalyzer: A Python Tool for Automated Bacterial Analysis with Fluorescence Microscopy

abstract: Fluorescence microscopy is a widely used method among cell biologists for studying the localization and co-localization of fluorescent protein. For microbial cell biologists, these studies often include tedious and time-consuming manual segmentation of bacteria and of the fluorescence clusters or working with multiple programs. Here, we present MicroAnalyzer - a tool that automates these tasks by providing an end-to-end platform for microscope image analysis. While such tools do exist, they are costly, black-boxed programs. Microanalyzer offers an open-source alternative to these tools, allowing flexibility and expandability by advanced users. MicroAnalyzer provides accurate cell and fluorescence cluster segmentation based on state-of-the-art deep-learning segmentation models, combined with ad-hoc post-processing and Colicoords - an open-source cell image analysis tool for calculating general cell and fluorescence measurements. Using these methods, it performs better than generic approaches since the dynamic nature of neural networks allows for a quick adaptation to experiment restrictions and assumptions. Other existing tools do not consider experiment assumptions, nor do they provide fluorescence cluster detection without the need for any specialized equipment. The key goal of MicroAnalyzer is to automate the entire process of cell and fluorescence image analysis "from microscope to database", meaning it does not require any further input from the researcher except for the initial deep-learning model training. In this fashion, it allows the researchers to concentrate on the bigger picture instead of granular, eye-straining labor


title: The smoothed complexity of Frank-Wolfe methods via conditioning of random matrices and polytopes

abstract: Frank-Wolfe methods are popular for optimization over a polytope. One of the reasons is because they do not need projection onto the polytope but only linear optimization over it. To understand its complexity, Lacoste-Julien and Jaggi introduced a condition number for polytopes and showed linear convergence for several variations of the method. The actual running time can still be exponential in the worst case (when the condition number is exponential). We study the smoothed complexity of the condition number, namely the condition number of small random perturbations of the input polytope and show that it is polynomial for any simplex and exponential for general polytopes. Our results also apply to other condition measures of polytopes that have been proposed for the analysis of Frank-Wolfe methods: vertex-facet distance (Beck and Shtern) and facial distance (Pe\~na and Rodr\'iguez). Our argument for polytopes is a refinement of an argument that we develop to study the conditioning of random matrices. The basic argument shows that for $c>1$ a $d$-by-$n$ random Gaussian matrix with $n \geq cd$ has a $d$-by-$d$ submatrix with minimum singular value that is exponentially small with high probability. This has consequences on results about the robust uniqueness of tensor decompositions.


title: Robust Hypothesis Testing and Model Selection for Parametric Proportional Hazard Regression Models

abstract: The semi-parametric Cox proportional hazards regression model has been widely used for many years in several applied sciences. However, a fully parametric proportional hazards model, if appropriately assumed, can often lead to more efficient inference. To tackle the extreme non-robustness of the traditional maximum likelihood estimator in the presence of outliers in the data under such fully parametric proportional hazard models, a robust estimation procedure has recently been proposed extending the concept of the minimum density power divergence estimator (MDPDE) under this set-up. In this paper, we consider the problem of statistical inference under the parametric proportional hazards model and develop robust Wald-type hypothesis testing and model selection procedures using the MDPDEs. We have also derived the necessary asymptotic results which are used to construct the testing procedure for general composite hypothesis and study its asymptotic powers. The claimed robustness properties are studied theoretically via appropriate influence function analyses. We have studied the finite sample level and power of the proposed MDPDE based Wald type test through extensive simulations where comparisons are also made with the existing semi-parametric methods. The important issue of the selection of appropriate robustness tuning parameter is also discussed. The practical usefulness of the proposed robust testing and model selection procedures is finally illustrated through three interesting real data examples.


title: Characterization of the Link Function in GN and EGN methods for Nonlinearity Assessment of Ultrawideband Coherent Fiber Optic Communication Systems with Raman Effect

abstract: In this paper, we present an accurate and numerically efficient method to implement the GN and EGN nonlinearity prediction methods when the power evolution along the fiber is in an arbitrary form. This approach will provide us with a reliable tool to efficiently use GN and Enhanced GN (EGN) methods for analysis of the nonlinearity for ultrawideband coherent fiber optic WDM systems (C+L band or even wider bandwidth systems) in the presence of the Inter-channel Stimulated Raman Scattering (ISRS) and systems using forward-pumped or/and backward-pumped Raman amplification.


title: An Asymptotic Expansion for the Number of 2-Connected Chord Diagrams

abstract: We derive a functional relation between the generating functions of connected chord diagrams and 2-connected chord diagrams. This relation enables us to calculate an asymptotic expansion for the number of 2-connected chord diagrams on $n$ chords. The asymptotic information obtained from this expansion refines the last established results and provides a simple alternative for calculating the asymptotic behaviour of certain Green functions in Quenched QED and Yukawa theory in the context of quantum field theory.


title: Lunar Opportunities for SETI

abstract: A radio telescope placed in lunar orbit, or on the surface of the Moon's farside, could be of great value to the Search for Extraterrestrial Intelligence (SETI). The advantage of such a telescope is that it would be shielded by the body of the Moon from terrestrial sources of radio frequency interference (RFI). While RFI can be identified and ignored by other fields of radio astronomy, the possible spectral similarity between human and alien-generated radio emission makes the abundance of artificial radio emission on and around the Earth a significant complicating factor for SETI. A Moon-based telescope would avoid this challenge. In this paper, we review existing literature on Moon-based radio astronomy, discuss the benefits of lunar SETI, contrast possible surface- and orbit-based telescope designs, and argue that such initiatives are scientifically feasible, both technically and financially, within the next decade.


title: Adaptive Non-reversible Stochastic Gradient Langevin Dynamics

abstract: It is well known that adding any skew symmetric matrix to the gradient of Langevin dynamics algorithm results in a non-reversible diffusion with improved convergence rate. This paper presents a gradient algorithm to adaptively optimize the choice of the skew symmetric matrix. The resulting algorithm involves a non-reversible diffusion algorithm cross coupled with a stochastic gradient algorithm that adapts the skew symmetric matrix. The algorithm uses the same data as the classical Langevin algorithm. A weak convergence proof is given for the optimality of the choice of the skew symmetric matrix. The improved convergence rate of the algorithm is illustrated numerically in Bayesian learning and tracking examples.


title: A Multi-Agent System for Solving the Dynamic Capacitated Vehicle Routing Problem with Stochastic Customers using Trajectory Data Mining

abstract: The worldwide growth of e-commerce has created new challenges for logistics companies, one of which is being able to deliver products quickly and at low cost, which reflects directly in the way of sorting packages, needing to eliminate steps such as storage and batch creation. Our work presents a multi-agent system that uses trajectory data mining techniques to extract territorial patterns and use them in the dynamic creation of last-mile routes. The problem can be modeled as a Dynamic Capacitated Vehicle Routing Problem (VRP) with Stochastic Customer, being therefore NP-HARD, what makes its implementation unfeasible for many packages. The work's main contribution is to solve this problem only depending on the Warehouse system configurations and not on the number of packages processed, which is appropriate for Big Data scenarios commonly present in the delivery of e-commerce products. Computational experiments were conducted for single and multi depot instances. Due to its probabilistic nature, the proposed approach presented slightly lower performances when compared to the static VRP algorithm. However, the operational gains that our solution provides making it very attractive for situations in which the routes must be set dynamically.


title: Problems and results in Extremal Combinatorics -- IV

abstract: Extremal Combinatorics is among the most active topics in Discrete Mathematics, dealing with problems that are often motivated by questions in other areas, including Theoretical Computer Science and Information Theory. This paper contains a collection of problems and results in the area, including solutions or partial solutions to open problems suggested by various researchers. The topics considered here include questions in Extremal Graph Theory, Coding Theory and Social Choice. This is by no means a comprehensive survey of the area, and is merely a collection of problems, results and proofs, which are hopefully interesting. As the title of the paper suggests, this is a sequel of three previous papers of the same flavour. Each section of this paper is essentially self contained, and can be read separately.


title: A Review of Complex Systems Approaches to Cancer Networks

abstract: Cancers remain the lead cause of disease-related, pediatric death in North America. The emerging field of complex systems has redefined cancer networks as a computational system with intractable algorithmic complexity. Herein, a tumor and its heterogeneous phenotypes are discussed as dynamical systems having multiple, strange attractors. Machine learning, network science and algorithmic information dynamics are discussed as current tools for cancer network reconstruction. Deep Learning architectures and computational fluid models are proposed for better forecasting gene expression patterns in cancer ecosystems. Cancer cell decision-making is investigated within the framework of complex systems and complexity theory.


title: A note on commutators on weighted Morrey spaces on spaces of homogeneous type

abstract: In this paper we study the boundedness and compactness characterizations of the commutator of Calder\'{o}n-Zygmund operators $T$ on spaces of homogeneous type $(X,d,\mu)$ in the sense of Coifman and Weiss. More precisely, We show that the commutator $[b, T]$ is bounded on weighted Morrey space $L_{\omega}^{p,\kappa}(X)$ ($\kappa\in(0,1), \omega\in A_{p}(X), 1<p<\infty$) if and only if $b$ is in the BMO space. Moreover, the commutator $[b, T]$ is compact on weighted Morrey space $L_{\omega}^{p,\kappa}(X)$ ($\kappa\in(0,1), \omega\in A_{p}(X), 1<p<\infty$) if and only if $b$ is in the VMO space.


title: Techniques to Improve Q&A Accuracy with Transformer-based models on Large Complex Documents

abstract: This paper discusses the effectiveness of various text processing techniques, their combinations, and encodings to achieve a reduction of complexity and size in a given text corpus. The simplified text corpus is sent to BERT (or similar transformer based models) for question and answering and can produce more relevant responses to user queries. This paper takes a scientific approach to determine the benefits and effectiveness of various techniques and concludes a best-fit combination that produces a statistically significant improvement in accuracy.


title: Comparing Theories for the Maintenance of Late LTP and Long-Term Memory: Computational Analysis of the Roles of Kinase Feedback Pathways and Synaptic Reactivation

abstract: How can memories be maintained from days to a lifetime, given turnover of proteins that underlie expression of long-term synaptic potentiation (LTP)? One likely solution relies on synaptic positive feedback loops, prominently including persistent activation of CaM kinase II (CaMKII) and self-activated synthesis of protein kinase M zeta (PKM). Recent studies also suggest positive feedback based on recurrent synaptic reactivation within neuron assemblies, or engrams, is necessary to maintain memories. The relative importance of these feedback mechanisms is controversial. To explore the likelihood that each mechanism is necessary or sufficient, we simulated LTP maintenance with a simplified model incorporating persistent kinase activation, synaptic tagging, and preferential reactivation of strong synapses, and analyzed implications of recent data. We simulated three model variants, each maintaining LTP with one feedback loop: self-activated PKM synthesis (variant I); self-activated CamKII (variant II); and recurrent reactivation of strengthened synapses (variant III). Variant I requires and predicts that PKM must contribute to synaptic tagging. Variant II maintains LTP and suggests persistent CaMKII activation could maintain PKM activity, a feedforward interaction not previously considered. However we note data challenging this feedback loop. In variant III synaptic reactivation drives, and thus predicts, recurrent or persistent activity elevations of CamKII and other necessary kinases, plausibly contributing to empirically persistent elevation of PKM levels. Reactivation is thus predicted to sustain recurrent rounds of synaptic tagging and incorporation of plasticity-related proteins. We also suggest (model variant IV) that synaptic reactivation and autonomous kinase activation could synergistically maintain LTP. We propose experiments that could discriminate these maintenance mechanisms.


title: Modifying a Graph's Degree Sequence and the Testablity of Degree Sequence Properties

abstract: We show that if the degree sequence of a graph $G$ is close in $\ell_1$-distance to a given realizable degree sequence $(d_1,\dots,d_n)$, then $G$ is close in edit distance to a graph with degree sequence $(d_1,\dots,d_n)$. We then use this result to prove that every graph property defined in terms of the degree sequence is testable in the dense graph model with query complexity independent of $n$.


title: COVID-19 Infection Map Generation and Detection from Chest X-Ray Images

abstract: Computer-aided diagnosis has become a necessity for accurate and immediate coronavirus disease 2019 (COVID-19) detection to aid treatment and prevent the spread of the virus. Numerous studies have proposed to use Deep Learning techniques for COVID-19 diagnosis. However, they have used very limited chest X-ray (CXR) image repositories for evaluation with a small number, a few hundreds, of COVID-19 samples. Moreover, these methods can neither localize nor grade the severity of COVID-19 infection. For this purpose, recent studies proposed to explore the activation maps of deep networks. However, they remain inaccurate for localizing the actual infestation making them unreliable for clinical use. This study proposes a novel method for the joint localization, severity grading, and detection of COVID-19 from CXR images by generating the so-called infection maps. To accomplish this, we have compiled the largest dataset with 119,316 CXR images including 2951 COVID-19 samples, where the annotation of the ground-truth segmentation masks is performed on CXRs by a novel collaborative human-machine approach. Furthermore, we publicly release the first CXR dataset with the ground-truth segmentation masks of the COVID-19 infected regions. A detailed set of experiments show that state-of-the-art segmentation networks can learn to localize COVID-19 infection with an F1-score of 83.20%, which is significantly superior to the activation maps created by the previous methods. Finally, the proposed approach achieved a COVID-19 detection performance with 94.96% sensitivity and 99.88% specificity.


title: Proximity Inference with Wifi-Colocation during the COVID-19 Pandemic

abstract: In this work we propose a WiFi colocation methodology for digital contact tracing. The approach works by having a device scan and store nearby access point information to perform proximity inference. We make our approach resilient to different practical scenarios by configuring a device to turn into a hotspot if access points are unavailable, which makes the approach feasible in both dense urban areas and sparse rural places. We compare various shortcomings and advantages of this work over other conventional ways of doing digital contact tracing. Preliminary results indicate the feasibility of our approach for determining proximity between users, which is relevant for improving existing digital contact tracing and exposure notification implementations.


title: SO(5) non-Fermi liquid in a Coulomb box device

abstract: Non-Fermi liquid (NFL) physics can be realized in quantum dot devices where competing interactions frustrate the exact screening of dot spin or charge degrees of freedom. We show that a standard nanodevice architecture, involving a dot coupled to both a quantum box and metallic leads, can host an exotic SO(5) symmetry Kondo effect, with entangled dot and box charge and spin. This NFL state is surprisingly robust to breaking channel and spin symmetry, but destabilized by particle-hole asymmetry. By tuning gate voltages, the SO(5) state evolves continuously to a spin and then "flavor" two-channel Kondo state. The expected experimental conductance signatures are highlighted.


title: Sentifiers: Interpreting Vague Intent Modifiers in Visual Analysis using Word Co-occurrence and Sentiment Analysis

abstract: Natural language interaction with data visualization tools often involves the use of vague subjective modifiers in utterances such as "show me the sectors that are performing" and "where is a good neighborhood to buy a house?." Interpreting these modifiers is often difficult for these tools because their meanings lack clear semantics and are in part defined by context and personal user preferences. This paper presents a system called \system that makes a first step in better understanding these vague predicates. The algorithm employs word co-occurrence and sentiment analysis to determine which data attributes and filters ranges to associate with the vague predicates. The provenance results from the algorithm are exposed to the user as interactive text that can be repaired and refined. We conduct a qualitative evaluation of the Sentifiers system that indicates the usefulness of the interface as well as opportunities for better supporting subjective utterances in visual analysis tasks through natural language.


title: Neural Proof Nets

abstract: Linear logic and the linear {\lambda}-calculus have a long standing tradition in the study of natural language form and meaning. Among the proof calculi of linear logic, proof nets are of particular interest, offering an attractive geometric representation of derivations that is unburdened by the bureaucratic complications of conventional prooftheoretic formats. Building on recent advances in set-theoretic learning, we propose a neural variant of proof nets based on Sinkhorn networks, which allows us to translate parsing as the problem of extracting syntactic primitives and permuting them into alignment. Our methodology induces a batch-efficient, end-to-end differentiable architecture that actualizes a formally grounded yet highly efficient neuro-symbolic parser. We test our approach on {\AE}Thel, a dataset of type-logical derivations for written Dutch, where it manages to correctly transcribe raw text sentences into proofs and terms of the linear {\lambda}-calculus with an accuracy of as high as 70%.


title: An Adaptive EM Accelerator for Unsupervised Learning of Gaussian Mixture Models

abstract: We propose an Anderson Acceleration (AA) scheme for the adaptive Expectation-Maximization (EM) algorithm for unsupervised learning a finite mixture model from multivariate data (Figueiredo and Jain 2002). The proposed algorithm is able to determine the optimal number of mixture components autonomously, and converges to the optimal solution much faster than its non-accelerated version. The success of the AA-based algorithm stems from several developments rather than a single breakthrough (and without these, our tests demonstrate that AA fails catastrophically). To begin, we ensure the monotonicity of the likelihood function (a the key feature of the standard EM algorithm) with a recently proposed monotonicity-control algorithm (Henderson and Varahdan 2019), enhanced by a novel monotonicity test with little overhead. We propose nimble strategies for AA to preserve the positive definiteness of the Gaussian weights and covariance matrices strictly, and to conserve up to the second moments of the observed data set exactly. Finally, we employ a K-means clustering algorithm using the gap statistic to avoid excessively overestimating the initial number of components, thereby maximizing performance. We demonstrate the accuracy and efficiency of the algorithm with several synthetic data sets that are mixtures of Gaussians distributions of known number of components, as well as data sets generated from particle-in-cell simulations. Our numerical results demonstrate speed-ups with respect to non-accelerated EM of up to 60X when the exact number of mixture components is known, and between a few and more than an order of magnitude with component adaptivity.


title: Strengthened SDP Relaxation for an Extended Trust Region Subproblem with an Application to Optimal Power Flow

abstract: We study an extended trust region subproblem minimizing a nonconvex function over the hollow ball $r \le \|x\| \le R$ intersected with a full-dimensional second order cone (SOC) constraint of the form $\|x - c\| \le b^T x - a$. In particular, we present a class of valid cuts that improve existing semidefinite programming (SDP) relaxations and are separable in polynomial time. We connect our cuts to the literature on the optimal power flow (OPF) problem by demonstrating that previously derived cuts capturing a convex hull important for OPF are actually just special cases of our cuts. In addition, we apply our methodology to derive a new class of closed-form, locally valid, SOC cuts for nonconvex quadratic programs over the mixed polyhedral-conic set $\{x \ge 0 : \| x \| \le 1 \}$. Finally, we show computationally on randomly generated instances that our cuts are effective in further closing the gap of the strongest SDP relaxations in the literature, especially in low dimensions.


title: On compact classes of solutions of the Dirichlet problem with integral restrictions

abstract: We have proved theorems on compact classes of homeomorphisms with hydrodynamic normalization that are solutions of the Beltrami equation, whose characteristics are compactly supported and satisfy certain constraints of an integral type. As a consequence, we obtained results on compact classes of solutions of corresponding Dirichlet problems considered in some Jordan domain.


title: Discrete Conformal Geometry of Polyhedral Surfaces and Its Convergence

abstract: The paper proves a result on the convergence of discrete conformal maps to the Riemann mappings for Jordan domains. It is a counterpart of Rodin-Sullivan's theorem on convergence of circle packing mappings to the Riemann mapping in the new setting of discrete conformality. The proof follows the same strategy that Rodin-Sullivan used by establishing a rigidity result for regular hexagonal triangulations of the plane and estimating the quasiconformal constants associated to the discrete conformal maps.


title: The Hardy space from an engineer's perspective

abstract: We give an overview of parts of the theory of Hardy spaces from the viewpoint of signals and systems theory. There are books on this topic, which dates back to Bode, Nyquist, and Wiener, and that eventually led to the developement of $H^{\infty}$ optimal control. Our modest goal here is giving a beginner's dictionary for mathematicians and engineers who know little of either systems or $H^2$ spaces.


title: Ultrafast Electron Holes in Plasma Phase Space Dynamics

abstract: Electron holes (EH) are localized modes in plasma kinetic theory which appear as vortices in phase space. Earlier research on EH is based on the Schamel distribution function (df). A novel distribution function is proposed here, generalizing the original Schamel df in a recursive manner. Nonlinear solutions obtained by kinetic simulations are presented, with velocities twice the electron thermal speed. Using 1D-1V kinetic simulations, their propagation characteristics are traced and their stability is established by studying their long-time evolution and their behavior through mutual collisions.


title: Exchange and exclusion in the non-abelian anyon gas

abstract: We review and develop the many-body spectral theory of ideal anyons, i.e. identical quantum particles in the plane whose exchange rules are governed by unitary representations of the braid group on $N$ strands. Allowing for arbitrary rank (dependent on $N$) and non-abelian representations, and letting $N \to \infty$, this defines the ideal non-abelian many-anyon gas. We compute exchange operators and phases for a common and wide class of representations defined by fusion algebras, including the Fibonacci and Ising anyon models. Furthermore, we extend methods of statistical repulsion (Poincar\'e and Hardy inequalities) and a local exclusion principle (also implying a Lieb-Thirring inequality) developed for abelian anyons to arbitrary geometric anyon models, i.e. arbitrary sequences of unitary representations of the braid group, for which two-anyon exchange is nontrivial.

categories: math-ph cond-mat.quant-gas math.MP math.SP


title: Heterogeneous Molecular Graph Neural Networks for Predicting Molecule Properties

abstract: As they carry great potential for modeling complex interactions, graph neural network (GNN)-based methods have been widely used to predict quantum mechanical properties of molecules. Most of the existing methods treat molecules as molecular graphs in which atoms are modeled as nodes. They characterize each atom's chemical environment by modeling its pairwise interactions with other atoms in the molecule. Although these methods achieve a great success, limited amount of works explicitly take many-body interactions, i.e., interactions between three and more atoms, into consideration. In this paper, we introduce a novel graph representation of molecules, heterogeneous molecular graph (HMG) in which nodes and edges are of various types, to model many-body interactions. HMGs have the potential to carry complex geometric information. To leverage the rich information stored in HMGs for chemical prediction problems, we build heterogeneous molecular graph neural networks (HMGNN) on the basis of a neural message passing scheme. HMGNN incorporates global molecule representations and an attention mechanism into the prediction process. The predictions of HMGNN are invariant to translation and rotation of atom coordinates, and permutation of atom indices. Our model achieves state-of-the-art performance in 9 out of 12 tasks on the QM9 dataset.


title: Local and non-local dependency learning and emergence of rule-like representations in speech data by Deep Convolutional Generative Adversarial Networks

abstract: This paper argues that training GANs on local and non-local dependencies in speech data offers insights into how deep neural networks discretize continuous data and how symbolic-like rule-based morphophonological processes emerge in a deep convolutional architecture. Acquisition of speech has recently been modeled as a dependency between latent space and data generated by GANs in Begu\v{s} (2020b; arXiv:2006.03965), who models learning of a simple local allophonic distribution. We extend this approach to test learning of local and non-local phonological processes that include approximations of morphological processes. We further parallel outputs of the model to results of a behavioral experiment where human subjects are trained on the data used for training the GAN network. Four main conclusions emerge: (i) the networks provide useful information for computational models of speech acquisition even if trained on a comparatively small dataset of an artificial grammar learning experiment; (ii) local processes are easier to learn than non-local processes, which matches both behavioral data in human subjects and typology in the world's languages. This paper also proposes (iii) how we can actively observe the network's progress in learning and explore the effect of training steps on learning representations by keeping latent space constant across different training steps. Finally, this paper shows that (iv) the network learns to encode the presence of a prefix with a single latent variable; by interpolating this variable, we can actively observe the operation of a non-local phonological process. The proposed technique for retrieving learning representations has general implications for our understanding of how GANs discretize continuous speech data and suggests that rule-like generalizations in the training data are represented as an interaction between variables in the network's latent space.


title: Variation in interface strength of Silicon with surface engineered Ti3C2 MXenes

abstract: Current advancements in battery technologies require electrodes to combine high-performance active material such as Silicon (Si) with two-dimensional materials such as transition metal carbides (MXenes) for prolonged cycle stability and enhanced electrochemical performance. More so, it is the interface between these materials, which is the nexus for their applicatory success. Herein, the interface strength variations between amorphous Si and Ti3C2Tx MXene are determined as the MXene surface functional groups (Tx) are changed using first principle calculations. Si is interfaced with three Ti3C2 MXene substrates having surface -OH, -OH and -O mixed, and -F functional groups. Density functional theory (DFT) results reveal that completely hydroxylated Ti3C2 has the highest interface strength of 0.6 J/m2 with amorphous Si. This interface strength value drops as the proportion of surface -O and -F groups increases. Additional analysis of electron redistribution and charge separation across the interface is provided for a complete understanding of underlying physico-chemical factors affecting the surface chemistry and resultant interface strength values. The presented comprehensive analysis of the interface aims to develop sophisticated MXene based electrodes by their targeted surface engineering.


title: Teaching an Old Ball New Tricks: Another Look at Energetics, Motion Detectors and a Bouncing Rubber Ball

abstract: A bouncing rubber ball under a motion sensor is a classic of introductory physics labs. It is often used to measure the acceleration due to gravity, and can also demonstrate conservation of energy. By observing that the ball rises to a lower height upon each bounce, posing the question "what is the main source of energy loss?" and requiring students to construct their own measured values for velocity from position data, a rich lab experience can be created that results in good student discussions of proper analysis of data, and implementation of models. The payoff is student understanding that seemingly small differences in definitions can lead to very different conclusions.


title: Efficient exponential Runge--Kutta methods of high order: construction and implementation

abstract: Exponential Runge--Kutta methods have shown to be competitive for the time integration of stiff semilinear parabolic PDEs. The current construction of stiffly accurate exponential Runge--Kutta methods, however, relies on a convergence result that requires weakening many of the order conditions, resulting in schemes whose stages must be implemented in a sequential way. In this work, after showing a stronger convergence result, we are able to derive two new families of fourth- and fifth-order exponential Runge--Kutta methods, which, in contrast to the existing methods, have multiple stages that are independent of one another and share the same format, thereby allowing them to be implemented in parallel or simultaneously, and making the methods to behave like using with much less stages. Moreover, all of their stages involve only one linear combination of the product of $\varphi$-functions (using the same argument) with vectors. Overall, these features make these new methods to be much more efficient to implement when compared to the existing methods of the same orders. Numerical experiments on a one-dimensional semilinear parabolic problem, a nonlinear Schr\"odinger equation, and a two-dimensional Gray--Scott model are given to confirm the accuracy and efficiency of the two newly constructed methods.


title: School cohesion, speed, and efficiency are modulated by the swimmers flapping motion

abstract: Fish schools are ubiquitous in marine life. Although flow interactions are thought to be beneficial for schooling, their exact effects on the speed, energetics, and stability of the group remain elusive. Recent experiments suggest that flow interactions stabilize in-tandem formations of heaving foils. Here, we propose a minimal approach based on the vortex sheet model that captures salient features of the flow interactions among flapping swimmers, and we study the free swimming of a pair of in-line swimmers driven with identical heaving or pitching motions. We find that, independent of the flapping mode, the follower passively stabilizes at discrete locations in the wake of the leader, consistent with the heaving foil experiments, but pitching swimmers exhibit tighter and more cohesive formations. Further, in comparison to swimming alone, pitching motions increase the energetic efficiency of the group while heaving motions result in a slight increase in the swimming speed. These results recapitulate that flow interactions provide a passive mechanism that promotes school cohesion, and provide novel insight into the role of the flapping mode in controlling the emergent properties of the school.


title: Odd primary analogs of Real orientations

abstract: We define, in $C_p$-equivariant homotopy theory for $p>2$, a notion of $\mu_p$-orientation analogous to a $C_2$-equivariant Real orientation. The definition hinges on a $C_p$-space $\mathbb{CP}^{\infty}_{\mu_p}$, which we prove to be homologically even in a sense generalizing recent $C_2$-equivariant work on conjugation spaces. We prove that the height $p-1$ Morava $E$-theory is $\mu_p$-oriented and that $\mathrm{tmf}(2)$ is $\mu_3$-oriented. We explain how a single equivariant map $v_1^{\mu_p}:S^{2\rho} \to \Sigma^{\infty} \mathbb{CP}^{\infty}_{\mu_p}$ completely generates the homotopy of $E_{p-1}$ and $\mathrm{tmf}(2)$, expressing a height-shifting phenomenon pervasive in equivariant chromatic homotopy theory.


title: Impact of cosmological signatures in two-point statistics beyond the linear regime

abstract: Some beyond $\Lambda$CDM cosmological models have dark-sector energy densities that suffer phase transitions. Fluctuations entering the horizon during such a transition can receive enhancements that ultimately show up as a distinctive bump in the power spectrum relative to a model with no phase transition. In this work, we study the non-linear evolution of such signatures in the matter power spectrum and correlation function using N-body simulations, perturbation theory and HMcode - a halo-model based method. We focus on modelling the response, computed as the ratio of statistics between a model containing a bump and one without it, rather than in the statistics themselves. Instead of working with a specific theoretical model, we inject a parametric family of Gaussian bumps into otherwise standard $\Lambda$CDM spectra. We find that even when the primordial bump is located at linear scales, non-linearities tend to produce a second bump at smaller scales. This effect is understood within the halo model due to a more efficient halo formation. In redshift space these nonlinear signatures are partially erased because of the damping along the line-of-sight direction produced by non-coherent motions of particles at small scales. In configuration space, the bump modulates the correlation function reflecting as oscillations in the response, as it is clear in linear Eulerian theory; however, they become damped because large scale coherent flows have some tendency to occupy regions more depleted of particles. This mechanism is explained within Lagrangian Perturbation Theory and well captured by our simulations.


title: Differentially Private Adversarial Robustness Through Randomized Perturbations

abstract: Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be combatted by optimizing the worst case loss function over all possible substitutions of training examples. However, this can be prone to weighing unlikely substitutions higher, limiting the accuracy gain. In this paper, we study adversarial robustness through randomized perturbations, which has two immediate advantages: (1) by ensuring that substitution likelihood is weighted by the proximity to the original word, we circumvent optimizing the worst case guarantees and achieve performance gains; and (2) the calibrated randomness imparts differentially-private model training, which additionally improves robustness against adversarial attacks on the model outputs. Our approach uses a novel density-based mechanism based on truncated Gumbel noise, which ensures training on substitutions of both rare and dense words in the vocabulary while maintaining semantic similarity for model robustness.


title: Stylized Dialogue Response Generation Using Stylized Unpaired Texts

abstract: Generating stylized responses is essential to build intelligent and engaging dialogue systems. However, this task is far from well-explored due to the difficulties of rendering a particular style in coherent responses, especially when the target style is embedded only in unpaired texts that cannot be directly used to train the dialogue model. This paper proposes a stylized dialogue generation method that can capture stylistic features embedded in unpaired texts. Specifically, our method can produce dialogue responses that are both coherent to the given context and conform to the target style. In this study, an inverse dialogue model is first introduced to predict possible posts for the input responses, and then this inverse model is used to generate stylized pseudo dialogue pairs based on these stylized unpaired texts. Further, these pseudo pairs are employed to train the stylized dialogue model with a joint training process, and a style routing approach is proposed to intensify stylistic features in the decoder. Automatic and manual evaluations on two datasets demonstrate that our method outperforms competitive baselines in producing coherent and style-intensive dialogue responses.


title: Novel soliton in dipolar BEC caused by the quantum fluctuations

abstract: Solitons in the extended hydrodynamic model of the dipolar Bose-Einstein condensate with quantum fluctuations are considered. This model includes the continuity equation for the scalar field of concentration, the Euler equation for the vector field of velocity, the pressure evolution equation for the second rank tensor of pressure, and the evolution equation for the third rank tensor. Large amplitude soliton solution caused by the dipolar part of quantum fluctuations is found. It appears as the bright soliton. Hence, it is the area of compression of the number of particles. Moreover, it exists for the repulsive short-range interaction.


title: A Brief Survey and Comparative Study of Recent Development of Pronoun Coreference Resolution

abstract: Pronoun Coreference Resolution (PCR) is the task of resolving pronominal expressions to all mentions they refer to. Compared with the general coreference resolution task, the main challenge of PCR is the coreference relation prediction rather than the mention detection. As one important natural language understanding (NLU) component, pronoun resolution is crucial for many downstream tasks and still challenging for existing models, which motivates us to survey existing approaches and think about how to do better. In this survey, we first introduce representative datasets and models for the ordinary pronoun coreference resolution task. Then we focus on recent progress on hard pronoun coreference resolution problems (e.g., Winograd Schema Challenge) to analyze how well current models can understand commonsense. We conduct extensive experiments to show that even though current models are achieving good performance on the standard evaluation set, they are still not ready to be used in real applications (e.g., all SOTA models struggle on correctly resolving pronouns to infrequent objects). All experiment codes are available at https://github.com/HKUST-KnowComp/PCR.


title: FLASHING: New high-velocity H$_2$O masers in IRAS 18286$-$0959

abstract: We discovered new high-velocity components of H$_2$O maser emission in one of the "water fountain" sources, IRAS~18286$-$0959, which has been monitored using the Nobeyama 45 m telescope in the new FLASHING (Finest Legacy Acquisitions of SiO- and H$_2$O-maser Ignitions by Nobeyama Generation) project since 2018 December. The maser spectra show new, extremely high expansion velocities ($>$200~km~s$^{-1}$ projected in the line of sight) components, some of which are located symmetrically in the spectrum with respect to the systemic velocity. They were also mapped with KaVA (KVN and VERA Combined Array) in 2019 March. We located some of these maser components closer to the central stellar system than other high velocity components (50--200~km~s$^{-1}$) that have been confirmed to be associated with the known bipolar outflow. The new components would flash in the fast collimated jet at a speed over 300~km~s$^{-1}$ (soon) after 2011 when they had not been detected. The fastest of the new components seem to indicate rapid deceleration in these spectra, however our present monitoring is still too sparse to unambiguously confirm it (up to 50~km~s$^{-1}$yr$^{-1}$) and too short to reveal their terminal expansion velocity, which will be equal to the expansion velocity that has been observed ($v_{\rm exp}\sim$120~km~s$^{-1}$). Future occurrences of such extreme velocity components may provide a good opportunity to investigate possible recurrent outflow ignitions. Thus sculpture of the parental envelope will be traced by the dense gas that is entrained by the fast jet and exhibits spectacular distributions of the relatively stable maser features.


title: A generalization for the expected value of the earth mover's distance

abstract: The earth mover's distance (EMD), also called the first Wasserstein distance, can be naturally extended to compare arbitrarily many probability distributions, rather than only two, on the set $[n]=\{1,\dots,n\}$. We present the details for this generalization, along with a highly efficient algorithm inspired by combinatorics; it turns out that in the special case of three distributions, the EMD is half the sum of the pairwise EMD's. Extending the methods of Bourn and Willenbring (arXiv:1903.03673), we compute the expected value of this generalized EMD on random $d$-tuples of distributions, using a generating function which coincides with the Hilbert series of the Segre embedding. We then use the EMD to analyze a real-world data set of grade distributions.


title: Beneficial Perturbations Network for Defending Adversarial Examples

abstract: Deep neural networks can be fooled by adversarial attacks: adding carefully computed small adversarial perturbations to clean inputs can cause misclassification on state-of-the-art machine learning models. The reason is that neural networks fail to accommodate the distribution drift of the input data caused by adversarial perturbations. Here, we present a new solution - Beneficial Perturbation Network (BPN) - to defend against adversarial attacks by fixing the distribution drift. During training, BPN generates and leverages beneficial perturbations (somewhat opposite to well-known adversarial perturbations) by adding new, out-of-network biasing units. Biasing units influence the parameter space of the network, to preempt and neutralize future adversarial perturbations on input data samples. To achieve this, BPN creates reverse adversarial attacks during training, with very little cost, by recycling the training gradients already computed. Reverse attacks are captured by the biasing units, and the biases can in turn effectively defend against future adversarial examples. Reverse attacks are a shortcut, i.e., they affect the network's parameters without requiring instantiation of adversarial examples that could assist training. We provide comprehensive empirical evidence showing that 1) BPN is robust to adversarial examples and is much more running memory and computationally efficient compared to classical adversarial training. 2) BPN can defend against adversarial examples with negligible additional computation and parameter costs compared to training only on clean examples; 3) BPN hurts the accuracy on clean examples much less than classic adversarial training; 4) BPN can improve the generalization of the network 5) BPN trained only with Fast Gradient Sign Attack can generalize to defend PGD attacks.


title: Geometric inequalities and rigidity of gradient shrinking Ricci solitons

abstract: In this paper we prove that the Sobolev inequality, the logarithmic Sobolev inequality, the Schr\"odinger heat kernel upper bound, the Faber-Krahn inequality, the Nash inequality and the Rozenblum-Cwikel-Lieb inequality all equivalently exist on complete gradient shrinking Ricci solitons. We also obtain some integral gap theorems for compact shrinking Ricci solitons.


title: Phase transition and entropic force of de Sitter black hole in massive gravity

abstract: It is well known that de Sitter(dS) black holes generally have a black hole horizon and a cosmological horizon, both of which have Hawking radiation. But the radiation temperature of the two horizons is generally different, so dS black holes do not meet the requirements of thermal equilibrium stability, which brings certain difficulties to the study of the thermodynamic characteristics of black holes. In this paper, dS black hole is regarded as a thermodynamic system, and the effective thermodynamic quantities of the system are obtained. The influence of various state parameters on the effective thermodynamic quantities in the massive gravity space-time is discussed. The condition of the phase transition of the de Sitter black hole in massive gravity space-time is given. We consider that the total entropy of the dS black hole is the sum of the corresponding entropy of the two horizons plus an extra term from the correlation of the two horizons. By comparing the entropic force of interaction between black hole horizon and the cosmological horizon with Lennard-Jones force between two particles, we find that the change rule of entropic force between the two system is surprisingly the same. The research will help us to explore the real reason of accelerating expansion of the universe.


title: Multi-timescale Representation Learning in LSTM Language Models

abstract: Language models must capture statistical dependencies between words at timescales ranging from very short to very long. Earlier work has demonstrated that dependencies in natural language tend to decay with distance between words according to a power law. However, it is unclear how this knowledge can be used for analyzing or designing neural network language models. In this work, we derived a theory for how the memory gating mechanism in long short-term memory (LSTM) language models can capture power law decay. We found that unit timescales within an LSTM, which are determined by the forget gate bias, should follow an Inverse Gamma distribution. Experiments then showed that LSTM language models trained on natural English text learn to approximate this theoretical distribution. Further, we found that explicitly imposing the theoretical distribution upon the model during training yielded better language model perplexity overall, with particular improvements for predicting low-frequency (rare) words. Moreover, the explicit multi-timescale model selectively routes information about different types of words through units with different timescales, potentially improving model interpretability. These results demonstrate the importance of careful, theoretically-motivated analysis of memory and timescale in language models.


title: Network analysis of ballast-mediated species transfer reveals important introduction and dispersal patterns in the Arctic

abstract: Rapid climate change has wide-ranging implications for the Arctic region, including sea ice loss, increased geopolitical attention, and expanding economic activity, including a dramatic increase in shipping activity. As a result, the risk of harmful non-native marine species being introduced into this critical region will increase unless policy and management steps are implemented in response. Using big data about shipping, ecoregions, and environmental conditions, we leverage network analysis and data mining techniques to assess, visualize, and project ballast water-mediated species introductions into the Arctic and dispersal of non-native species within the Arctic. We first identify high-risk connections between the Arctic and non-Arctic ports that could be sources of non-native species over 15 years (1997-2012) and observe the emergence of shipping hubs in the Arctic where the cumulative risk of non-native species introduction is increasing. We then consider how environmental conditions can constrain this Arctic introduction network for species with different physiological limits, thus providing a species-level tool for decision-makers. Next, we focus on within-Arctic ballast-mediated species dispersal where we use higher-order network analysis to identify critical shipping routes that may facilitate species dispersal within the Arctic. The risk assessment and projection framework we propose could inform risk-based assessment and management of ship-borne invasive species in the Arctic.