title: Reverse Transfer Learning: Can Word Embeddings Trained for Different NLP Tasks Improve Neural Language Models?

abstract: Natural language processing (NLP) tasks tend to suffer from a paucity of suitably annotated training data, hence the recent success of transfer learning across a wide variety of them. The typical recipe involves: (i) training a deep, possibly bidirectional, neural network with an objective related to language modeling, for which training data is plentiful; and (ii) using the trained network to derive contextual representations that are far richer than standard linear word embeddings such as word2vec, and thus result in important gains. In this work, we wonder whether the opposite perspective is also true: can contextual representations trained for different NLP tasks improve language modeling itself? Since language models (LMs) are predominantly locally optimized, other NLP tasks may help them make better predictions based on the entire semantic fabric of a document. We test the performance of several types of pre-trained embeddings in neural LMs, and we investigate whether it is possible to make the LM more aware of global semantic information through embeddings pre-trained with a domain classification model. Initial experiments suggest that as long as the proper objective criterion is used during training, pre-trained embeddings are likely to be beneficial for neural language modeling.


title: Super ensemble learning for daily streamflow forecasting: Large-scale demonstration and comparison with multiple machine learning algorithms

abstract: Daily streamflow forecasting through data-driven approaches is traditionally performed using a single machine learning algorithm. Existing applications are mostly restricted to examination of few case studies, not allowing accurate assessment of the predictive performance of the algorithms involved. Here we propose super learning (a type of ensemble learning) by combining 10 machine learning algorithms. We apply the proposed algorithm in one-step ahead forecasting mode. For the application, we exploit a big dataset consisting of 10-year long time series of daily streamflow, precipitation and temperature from 511 basins. The super learner improves over the performance of the linear regression algorithm by 20.06%, outperforming the "hard to beat in practice" equal weight combiner. The latter improves over the performance of the linear regression algorithm by 19.21%. The best performing individual machine learning algorithm is neural networks, which improves over the performance of the linear regression algorithm by 16.73%, followed by extremely randomized trees (16.40%), XGBoost (15.92%), loess (15.36%), random forests (12.75%), polyMARS (12.36%), MARS (4.74%), lasso (0.11%) and support vector regression (-0.45%). Based on the obtained large-scale results, we propose super learning for daily streamflow forecasting.


title: Fast IMEX Time Integration of Nonlinear Stiff Fractional Differential Equations

abstract: Efficient long-time integration of nonlinear fractional differential equations is significantly challenging due to the integro-differential nature of the fractional operators. In addition, the inherent non-smoothness introduced by the inverse power-law kernels deteriorates the accuracy and efficiency of many existing numerical methods. We develop two efficient first- and second-order implicit-explicit (IMEX) methods for accurate time-integration of stiff/nonlinear fractional differential equations with fractional order $\alpha \in (0,1]$ and prove their convergence and linear stability properties. The developed methods are based on a linear multi-step fractional Adams-Moulton method (FAMM), followed by the extrapolation of the nonlinear force terms. In order to handle the singularities nearby the initial time, we employ Lubich-like corrections to the resulting fractional operators. The obtained linear stability regions of the developed IMEX methods are larger than existing IMEX methods in the literature. Furthermore, the size of the stability regions increase with the decrease of fractional order values, which is suitable for stiff problems. We also rewrite the resulting IMEX methods in the language of nonlinear Toeplitz systems, where we employ a fast inversion scheme to achieve a computational complexity of $\mathcal{O}(N \log N)$, where $N$ denotes the number of time-steps. Our computational results demonstrate that the developed schemes can achieve global first- and second-order accuracy for highly-oscillatory stiff/nonlinear problems with singularities.


title: Measurements of differential Z boson production cross sections in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: Measurements are presented of the differential cross sections for Z bosons produced in proton-proton collisions at $\sqrt{s} =$ 13 TeV and decaying to muons and electrons. The data analyzed were collected in 2016 with the CMS detector at the LHC and correspond to an integrated luminosity of 35.9 fb$^{-1}$. The measured fiducial inclusive product of cross section and branching fraction agrees with next-to-next-to-leading order quantum chromodynamics calculations. Differential cross sections of the transverse momentum $p_\mathrm{T}$, the optimized angular variable $\phi^*_\eta$, and the rapidity of lepton pairs are measured. The data are corrected for detector effects and compared to theoretical predictions using fixed order, resummed, and parton shower calculations. The uncertainties of the measured normalized cross sections are smaller than 0.5% for $\phi^*_\eta$ $<$ 0.5 and for $p_\mathrm{T}^\mathrm{Z}$ $<$ 50 GeV.


title: Option Encoder: A Framework for Discovering a Policy Basis in Reinforcement Learning

abstract: Option discovery and skill acquisition frameworks are integral to the functioning of a Hierarchically organized Reinforcement learning agent. However, such techniques often yield a large number of options or skills, which can potentially be represented succinctly by filtering out any redundant information. Such a reduction can reduce the required computation while also improving the performance on a target task. In order to compress an array of option policies, we attempt to find a policy basis that accurately captures the set of all options. In this work, we propose Option Encoder, an auto-encoder based framework with intelligently constrained weights, that helps discover a collection of basis policies. The policy basis can be used as a proxy for the original set of skills in a suitable hierarchically organized framework. We demonstrate the efficacy of our method on a collection of grid-worlds and on the high-dimensional Fetch-Reach robotic manipulation task by evaluating the obtained policy basis on a set of downstream tasks.


title: On CDCL-based proof systems with the ordered decision strategy

abstract: We prove that conflict-driven clause learning SAT-solvers with the ordered decision strategy and the DECISION learning scheme are equivalent to ordered resolution. We also prove that, by replacing this learning scheme with its opposite that stops after the first new clause when backtracking, they become equivalent to general resolution. To the best of our knowledge, this is the first theoretical study of the interplay between specific decision strategies and clause learning. For both results, we allow nondeterminism in the solver's ability to perform unit propagation, conflict analysis, and restarts, in a way that is similar to previous works in the literature. To aid the presentation of our results, and possibly future research, we define a model and language for discussing CDCL-based proof systems that allows for succinct and precise theorem statements.


title: Coherent states for exactly solvable time-dependent oscillators generated by Darboux transformations

abstract: The Darboux method is commonly used in the coordinate variable to produce new exactly solvable (stationary) potentials in quantum mechanics. In this work we follow a variation introduced by Bagrov, Samsonov, and Shekoyan (BSS) to include the time-variable as a parameter of the transformation. The new potentials are nonstationary and define Hamiltonians which are not integrals of motion for the system under study. We take the stationary oscillator of constant frequency to produce nonstationary oscillators, and also provide an invariant that serves to define uniquely the state of the system. In this sense our approach completes the program of the BSS method since the eigenfunctions of the invariant are an orthonormal basis for the space of solutions of the related Schrodinger equation. The orthonormality holds when the involved functions are evaluated at the same time. The dynamical algebra of the nonstationary oscillators is generated by properly chosen ladder operators and coincides with the Heisenberg algebra. We also construct the related coherent states and show that they form an overcomplete set that minimizes the quadratures defined by the ladder operators. These states are not invariant under time-evolution since their time-dependence relies on the basis of states and not on the complex eigenvalue that labels them. Some concrete examples are provided.


title: Multicomponent compact Abelian-Higgs lattice models

abstract: We investigate the phase diagram and critical behavior of three-dimensional multicomponent Abelian-Higgs models, in which an N-component complex field z_x^a of unit length and charge is coupled to compact quantum electrodynamics in the usual Wilson lattice formulation. We determine the phase diagram and study the nature of the transition line for N=2 and N=4. Two phases are identified, specified by the behavior of the gauge-invariant local composite operator Q_x^{ab} = \bar{z}_x^a z_x^b - \delta^{ab}/N, which plays the role of order parameter. In one phase, we have \langle Q_x^{ab}\rangle =0, while in the other Q_x^{ab} condenses. Gauge correlations are never critical: gauge excitations are massive for any finite coupling. The two phases are separated by a transition line. Our numerical data are consistent with the simple scenario in which the nature of the transition is independent of the gauge coupling. Therefore, for any finite positive value of the gauge coupling, we predict a continuous transition in the Heisenberg universality class for N=2 and a first-order transition for N=4. However, notable crossover phenomena emerge for large gauge couplings, when gauge fluctuations are suppressed. Such crossover phenomena are related to the unstable O(2N) fixed point, describing the behavior of the model in the infinite gauge-coupling limit.


title: Self-reinforcing Unsupervised Matching

abstract: Remarkable gains in deep learning usually rely on tremendous supervised data. Ensuring the modality diversity for one object in training set is critical for the generalization of cutting-edge deep models, but it burdens human with heavy manual labor on data collection and annotation. In addition, some rare or unexpected modalities are new for the current model, causing reduced performance under such emerging modalities. Inspired by the achievements in speech recognition, psychology and behavioristics, we present a practical solution, self-reinforcing unsupervised matching (SUM), to annotate the images with 2D structure-preserving property in an emerging modality by cross-modality matching. This approach requires no any supervision in emerging modality and only one template in seen modality, providing a possible route towards continual learning.


title: A PMU Based Islanding Detection Scheme Immune to Additive Instrumentation Channel Errors

abstract: Traditional synchrophasor measurement-based islanding detection techniques have primarily relied on voltage angle measurements and/or their derivatives for successfully detecting islands. However, relatively high instrumentation channel errors associated with phasor measurement unit (PMU) data, can significantly degrade islanding detection accuracies. In this paper, a new islanding detection scheme employing cumulative sum of change in voltage phase angle difference (CUSPAD) is proposed, which is immune to additive instrumentation channel errors in the PMU measurements. The robustness of the proposed islanding detection algorithm is established through application to an 18-bus test system and the IEEE 118-bus system having different wind energy penetration levels. Comparative analysis of the accuracies of the proposed approach (CUSPAD) and the conventional angle difference (AD) approach prove the former's superior performance when additive instrumentation channel errors are present.


title: The highest-speed local dark matter particles come from the Large Magellanic Cloud

abstract: Using N-body simulations of the Large Magellanic Cloud (LMC's) passage through the Milky Way (MW), tailored to reproduce observed kinematic properties of both galaxies, we show that the high-speed tail of the Solar Neighborhood dark matter distribution is overwhelmingly of LMC origin. Two populations contribute at high speeds: 1) Particles that were once bound to the LMC, and 2) MW halo particles that have been accelerated owing to the response of the halo to the recent passage of the LMC. These particles reach speeds of 700-900 km/s with respect to the Earth, above the local escape speed of the MW. The high-speed particles follow trajectories similar to the Solar reflex motion, with peak velocities reached in June. For low-mass dark matter, these high-speed particles can dominate the signal in direct-detection experiments, extending the reach of the experiments to lower mass and elastic scattering cross sections even with existing data sets. Our study shows that even non-disrupted MW satellite galaxies can leave a significant dark-matter footprint in the Solar Neighborhood.


title: Detection and Classification of Breast Cancer Metastates Based on U-Net

abstract: This paper presents U-net based breast cancer metastases detection and classification in lymph nodes, as well as patient-level classification based on metastases detection. The whole pipeline can be divided into five steps: preprocessing and data argumentation, patch-based segmentation, post processing, slide-level classification, and patient-level classification. In order to reduce overfitting and speedup convergence, we applied batch normalization and dropout into U-Net. The final Kappa score reaches 0.902 on training data.


title: DaTscan SPECT Image Classification for Parkinson's Disease

abstract: Parkinson's Disease (PD) is a neurodegenerative disease that currently does not have a cure. In order to facilitate disease management and reduce the speed of symptom progression, early diagnosis is essential. The current clinical, diagnostic approach is to have radiologists perform human visual analysis of the degeneration of dopaminergic neurons in the substantia nigra region of the brain. Clinically, dopamine levels are monitored through observing dopamine transporter (DaT) activity. One method of DaT activity analysis is performed with the injection of an Iodine-123 fluoropropyl (123I-FP-CIT) tracer combined with single photon emission computerized tomography (SPECT) imaging. The tracer illustrates the region of interest in the resulting DaTscan SPECT images. Human visual analysis is slow and vulnerable to subjectivity between radiologists, so the goal was to develop an introductory implementation of a deep convolutional neural network that can objectively and accurately classify DaTscan SPECT images as Parkinson's Disease or normal. This study illustrates the approach of using a deep convolutional neural network and evaluates its performance on DaTscan SPECT image classification. The data used in this study was obtained through a database provided by the Parkinson's Progression Markers Initiative (PPMI). The deep neural network in this study utilizes the InceptionV3 architecture, 1st runner up in the 2015 ImageNet Large Scale Visual Recognition Competition (ILSVRC), as a base model. A custom, binary classifier block was added on top of this base. In order to account for the small dataset size, a ten fold cross validation was implemented to evaluate the model's performance.


title: Chirp Spread Spectrum Signaling for Future Air-Ground Communications

abstract: In this paper, we investigate the use of chirp spread spectrum signaling over air-ground channels. This includes evaluation of not only the traditional linear chirp, but also of a new chirp signal format we have devised for multiple access applications. This new format is more practical than prior multi-user chirp systems in the literature, because we allow for imperfect synchronism. Specifically we evaluate multi-user chirp signaling over air-ground channels in a quasi-synchronous condition. The air-ground channels we employ are models based upon an extensive NASA measurement campaign. We show that our new signaling scheme outperforms the classic linear chirp in these air-ground settings.


title: Kubo conductivity for anisotropic tilted Dirac semimetals and its application to 8-Pmmn borophene: The role of different frequency, temperature and scattering limits

abstract: The electronic and optical conductivities for anisotropic tilted Dirac semimetals are calculated using the Kubo formula. As in graphene, it is shown that the minimal conductivity is sensitive to the order in which the temperature, frequency and scattering limits are taken. Both intraband and interband scattering are found to be direction dependent. In the high frequency and low temperature limit, the conductivities do not depend on frequency and are weighted by the anisotropy in such a way that the geometrical mean $\sqrt{\sigma_{xx}\sigma_{yy}}$ of the conductivity is the same as in graphene. This results from the fact that in the zero temperature limit, interband transitions are not affected by the tilt in the dispersion, a result that is physically interpreted as a global tilting of the allowed transitions. Such result is verified by an independent and direct calculation of the absorption coefficient using the Fermi golden rule. However, as temperature is raised, an interesting minimum is observed in the interband scattering, interpreted here as a result of the interplay between the tilt and the chemical potential increasing with temperature.


title: Application of Machine Learning for Online Dynamic Security Assessment in Presence of System Variability and Additive Instrumentation Errors

abstract: Large-scale blackouts that have occurred in the past few decades have necessitated the need to do extensive research in the field of grid security assessment. With the aid of synchrophasor technology, which uses phasor measurement unit (PMU) data, dynamic security assessment (DSA) can be performed online. However, existing applications of DSA are challenged by variability in system conditions and unaccounted for measurement errors. To overcome these challenges, this research develops a DSA scheme to provide security prediction in real-time for load profiles of different seasons in presence of realistic errors in the PMU measurements. The major contributions of this paper are: (1) develop a DSA scheme based on PMU data, (2) consider seasonal load profiles, (3) account for varying penetrations of renewable generation, and (4) compare the accuracy of different machine learning (ML) algorithms for DSA with and without erroneous measurements. The performance of this approach is tested on the IEEE-118 bus system. Comparative analysis of the accuracies of the ML algorithms under different operating scenarios highlights the importance of considering realistic errors and variability in system conditions while creating a DSA scheme.


title: Generalized Ponce's inequality

abstract: This note provides the generalization of a remarkable inequality by A. C. Ponce whose consequences are essential in several fields, as Characterization of Sobolev Spaces or Nonlocal Modelization.


title: A Three-Feature Model to Predict Colour Change Blindness

abstract: Change blindness is a striking shortcoming of our visual system which is exploited in the popular "Spot the difference" game. It makes us unable to notice large visual changes happening right before our eyes and illustrates the fact that we see much less than we think we do. We introduce a fully automated model to predict colour change blindness in cartoon images based on two low-level image features and observer experience. Using linear regression with only three parameters, the predictions of the proposed model correlate significantly with measured detection times. We also demonstrate the efficacy of the model to classify stimuli in terms of difficulty.


title: ACE-Net: Biomedical Image Segmentation with Augmented Contracting and Expansive Paths

abstract: Nowadays U-net-like FCNs predominate various biomedical image segmentation applications and attain promising performance, largely due to their elegant architectures, e.g., symmetric contracting and expansive paths as well as lateral skip-connections. It remains a research direction to devise novel architectures to further benefit the segmentation. In this paper, we develop an ACE-net that aims to enhance the feature representation and utilization by augmenting the contracting and expansive paths. In particular, we augment the paths by the recently proposed advanced techniques including ASPP, dense connection and deep supervision mechanisms, and novel connections such as directly connecting the raw image to the expansive side. With these augmentations, ACE-net can utilize features from multiple sources, scales and reception fields to segment while still maintains a relative simple architecture. Experiments on two typical biomedical segmentation tasks validate its effectiveness, where highly competitive results are obtained in both tasks while ACE-net still runs fast at inference.


title: A Simple Galerkin Meshless Method, the Fragile Points Method (FPM) Using Point Stiffness Matrices, for 2D Linear Elastic Problems in Complex Domains with Crack and Rupture Propagation

abstract: The Fragile Points Method (FPM) is an elementarily simple Galerkin meshless method, employing Point-based discontinuous trial and test functions only, without using element-based trial and test functions. In this study, the algorithmic formulations of FPM for linear elasticity are given in detail, by exploring the concepts of point stiffness matrices and numerical flux corrections. Advantages of FPM for simulating the deformations of complex structures, and for simulating complex crack propagations and rupture developments, are also thoroughly discussed. Numerical examples of deformation and stress analyses of benchmark problems, as well as of realistic structures with complex geometries, demonstrate the accuracy, efficiency and robustness of the proposed FPM. Simulations of crack initiation and propagations are also given in this study, demonstrating the advantages of the present FPM in modeling complex rupture and fracture phenomena. The crack and rupture propagation modeling in FPM is achieved without remeshing or augmenting the trial functions as in standard, extended or generalized FEM. The simulation of impact, penetration and other extreme problems by FPM will be discussed in our future papers.


title: Machine and Deep Learning for Crowd Analytics

abstract: In high population cities, the gatherings of large crowds in public places and public areas accelerate or jeopardize people safety and transportation, which is a key challenge to the researchers. Although much research has been carried out on crowd analytics, many of existing methods are problem-specific, i.e., methods learned from a specific scene cannot be properly adopted to other videos. Therefore, this presents weakness and the discovery of these researches, since additional training samples have to be found from diverse videos. This paper will investigate diverse scene crowd analytics with traditional and deep learning models. We will also consider pros and cons of these approaches. However, once general deep methods are investigated from large datasets, they can be consider to investigate different crowd videos and images. Therefore, it would be able to cope with the problem including to not limited to crowd density estimation, crowd people counting, and crowd event recognition. Deep learning models and approaches are required to have large datasets for training and testing. Many datasets are collected taking into account many different and various problems related to building crowd datasets, including manual annotations and increasing diversity of videos and images. In this paper, we will also propose many models of deep neural networks and training approaches to learn the feature modeling for crowd analytics.


title: Stabilization of high-pressure GeCu$_{2}$O$_{4}$ spinel cuprate with quasi-1D $S=1/2$ chains in the epitaxial thin-film form

abstract: GeCu$_2$O$_4$ is a high-pressure recoverable cuprate with a strongly tetragonally elongated spinel structure and magnetic lattice formed by $S=1/2$ CuO$_2$ linear chains with frustrated exchange interactions and exotic magnetic behavior. Here we report on the first stabilization of epitaxial thin films of GeCu$_2$O$_4$ on (001)-oriented MgAl$_2$O$_4$ substrate. Developed growth mode, surface morphology, crystal structure and copper valence state were characterized by \emph{in-situ} reflection high-energy electron diffraction, atomic force microscopy, X-ray reflectivity, X-ray diffraction and X-ray photoelectron spectroscopy. The availability of large single-crystalline GeCu$_2$O$_4$ thin films paves road to comprehensive investigation of physical properties including the puzzle of magnetism and multiferroicity in this peculiar compound.


title: The Overarching Framework of Core-Collapse Supernova Explosions as Revealed by 3D Fornax Simulations

abstract: We have conducted nineteen state-of-the-art 3D core-collapse supernova simulations spanning a broad range of progenitor masses. This is the largest collection of sophisticated 3D supernova simulations ever performed. We have found that while the majority of these models explode, not all do, and that even models in the middle of the available progenitor mass range may be less explodable. This does not mean that those models for which we did not witness explosion would not explode in Nature, but that they are less prone to explosion than others. One consequence is that the "compactness" measure is not a metric for explodability. We find that lower-mass massive star progenitors likely experience lower-energy explosions, while the higher-mass massive stars likely experience higher-energy explosions. Moreover, most 3D explosions have a dominant dipole morphology, have a pinched, wasp-waist structure, and experience simultaneous accretion and explosion. We reproduce the general range of residual neutron-star masses inferred for the galactic neutron-star population. The most massive progenitor models, however, in particular vis \`a vis explosion energy, need to be continued for longer physical times to asymptote to their final states. We find that while the majority of the inner ejecta have Y$_e = 0.5$, there is a substantial proton-rich tail. This result has important implications for the nucleosynthetic yields as a function of progenitor. Finally, we find that the non-exploding models eventually evolve into compact inner configurations that experience a quasi-periodic spiral SASI mode. We otherwise see little evidence of the SASI in the exploding models.


title: Adaptive Third Order Adams-Bashforth Time Stepping for Extended Boussinesq Equations

abstract: We develop the third-order adaptive Adams-Bashforth time stepping and the second-order finite difference equation for variable time steps. We incorporate these schemes in the Celeris Advent software to discretize and solve the 2D extended Boussinesq equations. This software uses a hybrid finite volume - finite difference scheme and leverages the GPU to solve the equations faster than real-time while concurrently visualizing them. We simulate several benchmarks using the adaptive time stepping scheme of Celeris Advent and demonstrate the capability of the software in modeling wave-breaking, wave runup, irregular waves, and rip currents. The adaptive scheme significantly improves the robustness of the model while providing faster computational performance.


title: Extended Mean Field Games with Singular Controls

abstract: This paper establishes the existence of equilibria result of a class of mean field games with singular controls. The interaction takes place through both states and controls. A relaxed solution approach is used. To circumvent the tightness issue, we prove the existence of equilibria by first considering the corresponding mean field games with continuous controls instead of singular controls and then taking approximation.


title: Magneto-electro-statics of axionically active systems: Induced field restructuring in magnetic stars

abstract: In the framework of Einstein-Maxwell-axion theory we consider a static field configuration in the outer zone of a magnetic star. We assume that this field configuration is formed by the following interacting quartet: a spherically symmetric gravitational field of the Reissner-Nordstr\"om type, pseudoscalar field, associated with an axionic dark matter, strong intrinsic magnetic field, and axionically induced electric field. Based on the analysis of the solutions to the master equations of the model, we show that the structure of the formed field configuration reveals the following triple effect. First, if the strong magnetic field of the star has the dipole component, the axionic halo around the magnetic star with spherically symmetric gravitational field is no longer spheroidal, and the distortion is induced by the axion-photon coupling; second, due to the distortion of the axionic halo the magnetic field is no longer pure dipolar, and the induced quadruple, octupole, etc., components appear thus redistributing the magnetic energy between the components with more steep radial profiles than the dipolar one; third, the interaction of the axionic and magnetic fields produces the electric field, which inherits their multipole structure. We attract attention to possible applications of the predicted field restructuring to the theory of axionic rotating magnetars.


title: Tunable tunnel barriers in a semiconductor via ionization of individual atoms

abstract: We report scanning tunneling microscopy studies of individual adatoms deposited on an InSb(110) surface. The adatoms can be reproducibly dropped off from the STM tip by voltage pulses, and impact tunneling into the surface by up to ~100x. The spatial extent and magnitude of the tunneling effect are widely tunable by imaging conditions such as bias voltage, set current and photoillumination. We attribute the effect to occupation of a (+/0) charge transition level, and switching of the associated adatom-induced band bending. The effect in STM topographic images is well reproduced by transport modeling of filling and emptying rates as a function of the tip position. STM atomic contrast and tunneling spectra are in good agreement with density functional theory calculations for In adatoms. The adatom ionization effect can extend to distances greater than 50 nm away, which we attribute to the low concentration and low binding energy of the residual donors in the undoped InSb crystal. These studies demonstrate how individual atoms can be used to sensitively control current flow in nanoscale devices.


title: Self-Teaching Networks

abstract: We propose self-teaching networks to improve the generalization capacity of deep neural networks. The idea is to generate soft supervision labels using the output layer for training the lower layers of the network. During the network training, we seek an auxiliary loss that drives the lower layer to mimic the behavior of the output layer. The connection between the two network layers through the auxiliary loss can help the gradient flow, which works similar to the residual networks. Furthermore, the auxiliary loss also works as a regularizer, which improves the generalization capacity of the network. We evaluated the self-teaching network with deep recurrent neural networks on speech recognition tasks, where we trained the acoustic model using 30 thousand hours of data. We tested the acoustic model using data collected from 4 scenarios. We show that the self-teaching network can achieve consistent improvements and outperform existing methods such as label smoothing and confidence penalization.


title: Dispersive analysis of the $\gamma^{*}\gamma^{*} \to \pi \pi$ process

abstract: In this paper, we present a dispersive analysis of the double-virtual photon-photon scattering to two pions up to 1.5 GeV. Through unitarity, this process is very sensitive to hadronic final state interaction. For the $s$-wave, we use a coupled-channel $\pi\pi,\, K\bar{K}$ analysis which allows a simultaneous description of both $f_0(500)$ and $f_{0}(980)$ resonances. For higher energies, $f_2(1270)$ shows up as a dominant structure which we approximate by a single channel $\pi\pi$ rescattering in the $d$-wave. In the dispersive approach, the latter requires taking into account $t$- and $u$-channel vector-meson exchange left-hand cuts which exhibit an anomalous-like behavior for large space-like virtualities. In our paper, we show how to readily incorporate such behavior using a contour deformation. Besides, we devote special attention to kinematic constraints of helicity amplitudes and show their correlations explicitly.


title: The Multi-variable Affine Index Polynomial

abstract: We define a multi-variable version of the Affine Index Polynomial for virtual links. This invariant reduces to the original Affine Index Polynomial in the case of virtual knots, and also generalizes the version for compatible virtual links recently developed by L. Kauffman. We prove that this invariant is a Vassiliev invariant of order one, and study what happens as we shift the coloring of one or more components.


title: Structural and semantic pattern matching analysis in Haskell

abstract: Haskell functions are defined as a series of clauses consisting of patterns that are matched against the arguments in the order of definition. In case an input is not matched by any of the clauses, an error occurs. Therefore it is desirable to statically prove that the function is defined for all well-typed inputs. Conversely, a clause that can never be matched also indicates a likely defect. Analyzing these properties is challenging due to presence of GADT and guards as well as due to Haskell's lazy evaluation. We implement a recently proposed algorithm that unifies and extends the related analyses implemented in version 7 of the Glasgow Haskell Compiler. By using an SMT solver to handle the semantic constraints arising from pattern guards, we achieve a further improvement in precision over the existing GHC 8.0.1 implementation. We present a tool that uses the analysis to give sound, more precise, and actionable warnings about program defects.


title: Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentation

abstract: Existing weakly supervised semantic segmentation (WSSS) methods usually utilize the results of pre-trained saliency detection (SD) models without explicitly modeling the connections between the two tasks, which is not the most efficient configuration. Here we propose a unified multi-task learning framework to jointly solve WSSS and SD using a single network, \ie saliency, and segmentation network (SSNet). SSNet consists of a segmentation network (SN) and a saliency aggregation module (SAM). For an input image, SN generates the segmentation result and, SAM predicts the saliency of each category and aggregating the segmentation masks of all categories into a saliency map. The proposed network is trained end-to-end with image-level category labels and class-agnostic pixel-level saliency labels. Experiments on PASCAL VOC 2012 segmentation dataset and four saliency benchmark datasets show the performance of our method compares favorably against state-of-the-art weakly supervised segmentation methods and fully supervised saliency detection methods.


title: From scattered-light to millimeter emission: A comprehensive view of the Gyr-old system of HD 202628 and its eccentric debris ring

abstract: We present here new observations of the eccentric debris ring surrounding the Gyr-old solar-type star HD 202628: at millimeter wavelengths with ALMA, at far-infrared wavelengths with \textit{Herschel}, and in scattered light with \textit{HST}. The ring inner edge is found to be consistent between ALMA and \textit{HST} data. As radiation pressure affects small grains seen in scattered-light, the ring appears broader at optical than at millimeter wavelengths. The best fit to the ring seen with ALMA has inner and outer edges at $143.1 \pm 1.7$ AU and $165.5 \pm 1.4$, respectively, and an inclination of $57.4^\circ \pm 0.4$ from face-on. The offset of the ring centre of symmetry from the star allows us to quantify its eccentricity to be $e=0.09_{-0.01}^{+0.02}$. This eccentric feature is also detected in low resolution \textit{Herschel}/PACS observations, under the form of a pericenter-glow. Combining the infrared and millimeter photometry, we retrieve a disk grain size distribution index of $\sim -3.4$, and therefore exclude in-situ formation of the inferred belt-shaping perturber, for which we provide new dynamical constraints. Finally, ALMA images show four point-like sources that exceed 100$\,\mu$Jy, one of them being just interior to the ring. Although the presence of a background object cannot be excluded, we cannot exclude either that this source is circumplanetary material surrounding the belt-shaper, in which case degeneracies between its mass and orbital parameters could be lifted, allowing us to fully characterize such a distant planet in this mass and age regime for the very first time.


title: MLOD: A multi-view 3D object detection based on robust feature fusion method

abstract: This paper presents Multi-view Labelling Object Detector (MLOD). The detector takes an RGB image and a LIDAR point cloud as input and follows the two-stage object detection framework. A Region Proposal Network (RPN) generates 3D proposals in a Bird's Eye View (BEV) projection of the point cloud. The second stage projects the 3D proposal bounding boxes to the image and BEV feature maps and sends the corresponding map crops to a detection header for classification and bounding-box regression. Unlike other multi-view based methods, the cropped image features are not directly fed to the detection header, but masked by the depth information to filter out parts outside 3D bounding boxes. The fusion of image and BEV features is challenging, as they are derived from different perspectives. We introduce a novel detection header, which provides detection results not just from fusion layer, but also from each sensor channel. Hence the object detector can be trained on data labelled in different views to avoid the degeneration of feature extractors. MLOD achieves state-of-the-art performance on the KITTI 3D object detection benchmark. Most importantly, the evaluation shows that the new header architecture is effective in preventing image feature extractor degeneration.


title: Knowledge Enhanced Contextual Word Representations

abstract: Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a general method to embed multiple knowledge bases (KBs) into large scale models, and thereby enhance their representations with structured, human-curated knowledge. For each KB, we first use an integrated entity linker to retrieve relevant entity embeddings, then update contextual word representations via a form of word-to-entity attention. In contrast to previous approaches, the entity linkers and self-supervised language modeling objective are jointly trained end-to-end in a multitask setting that combines a small amount of entity linking supervision with a large amount of raw text. After integrating WordNet and a subset of Wikipedia into BERT, the knowledge enhanced BERT (KnowBert) demonstrates improved perplexity, ability to recall facts as measured in a probing task and downstream performance on relationship extraction, entity typing, and word sense disambiguation. KnowBert's runtime is comparable to BERT's and it scales to large KBs.


title: Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract Programs

abstract: Semantic parsing aims to map natural language utterances onto machine interpretable meaning representations, aka programs whose execution against a real-world environment produces a denotation. Weakly-supervised semantic parsers are trained on utterance-denotation pairs treating programs as latent. The task is challenging due to the large search space and spuriousness of programs which may execute to the correct answer but do not generalize to unseen examples. Our goal is to instill an inductive bias in the parser to help it distinguish between spurious and correct programs. We capitalize on the intuition that correct programs would likely respect certain structural constraints were they to be aligned to the question (e.g., program fragments are unlikely to align to overlapping text spans) and propose to model alignments as structured latent variables. In order to make the latent-alignment framework tractable, we decompose the parsing task into (1) predicting a partial "abstract program" and (2) refining it while modeling structured alignments with differential dynamic programming. We obtain state-of-the-art performance on the WIKITABLEQUESTIONS and WIKISQL datasets. When compared to a standard attention baseline, we observe that the proposed structured-alignment mechanism is highly beneficial.


title: Central Moment Lattice Boltzmann Method using a Pressure-based Formulation for Multiphase Flows at High Density Ratios and including Effects of Surface Tension and Marangoni Stresses

abstract: Simulation of multiphase flows require coupled capturing or tracking of the interfaces in conjunction with the solution of fluid motion often occurring at multiple scales. We will present unified cascaded LB methods based on central moments for the solution of the incompressible two-phase flows at high density ratios and for capturing of the interfacial dynamics. Based on a modified continuous Boltzmann equation (MCBE) for two-phase flows, where a kinetic transformation to the distribution function involving the pressure field is introduced to reduce the associated numerical stiffness at high density gradients, a central moment cascaded LB formulation for computing the fluid motion will be constructed. In this LB scheme, the collision step is prescribed by the relaxation of various central moments to their equilibria that are reformulated in terms of the pressure field obtained via matching to the continuous equilibria based on the transformed Maxwell distribution. Furthermore, the differential treatments for the effects of the source term representing the change due to the pressure field and of the source term due to the interfacial tension force and body forces appearing in the MCBE on different moments are consistently accounted for in this cascaded LB solver that computes the pressure and velocity fields. In addition, another cascaded LB scheme via modified equilibria will be developed to solve for the interfacial dynamics represented by a phase field model based on the conservative Allen-Cahn equation. Based on numerical simulations of a variety of two-phase flow benchmark problems at high density ratios and involving the effects of surface tension and its tangential gradients (Marangoni stresses), we will validate our unified cascaded LB approach and also demonstrate improvements in numerical stability.


title: Sensitivity Analysis for Markov Decision Process Congestion Games

abstract: We consider a non-atomic congestion game where each decision maker performs selfish optimization over states of a common MDP. The decision makers optimize for their own expected costs, and influence each other through congestion effects on the state-action costs. We analyze on the sensitivity of MDP congestion game equilibria to uncertainty and perturbations in the state-action costs by applying an implicit function type analysis. The occurrence of a stochastic Braess paradox is defined, analyzed based on sensitivity of game equilibria and demonstrated in simulation. We further analyze how the introduction of stochastic dynamics affects the magnitude of Braess paradox in comparison to deterministic dynamics.


title: Visible Sterile Neutrinos as the Earliest Relic Probes of Cosmology

abstract: A laboratory detection of a sterile neutrino could provide the first indication of the evolution of the Universe before Big-Bang Nucleosynthesis (BBN), an epoch yet untested. Such "visible" sterile neutrinos are observable in upcoming experiments such as KATRIN/TRISTAN and HUNTER in the keV mass range and PTOLEMY and others in the eV mass range. A set of standard assumptions is typically made about cosmology before the temperature of the Universe was 5 MeV. However, non-standard pre-BBN cosmologies based on alternative assumptions could arise in motivated theoretical models and are equally in agreement with all existing data. We revisit the production of sterile neutrinos of mass 0.01 eV to 1 MeV in two examples of such models: scalar-tensor and low reheating temperature pre-BBN cosmologies. In both of them, the putative 3.5 keV X-ray signal line corresponds to a sterile neutrino with a mixing large enough to be tested in upcoming laboratory experiments. Additionally, the cosmological/astrophysical upper limits on active-sterile neutrino mixings are significantly weaker than in the standard pre-BBN cosmology, which shows that these limits are not robust. For example, in the scalar-tensor case the potential signal regions implied by the LSND and MiniBooNE short-baseline as well as the DANSS and NEOS reactor experiments are entirely not bound by cosmological restrictions. Our work highlights that sterile neutrinos may constitute a sensitive probe of the pre-BBN epoch.


title: OncoNetExplainer: Explainable Predictions of Cancer Types Based on Gene Expression Data

abstract: The discovery of important biomarkers is a significant step towards understanding the molecular mechanisms of carcinogenesis; enabling accurate diagnosis for, and prognosis of, a certain cancer type. Before recommending any diagnosis, genomics data such as gene expressions(GE) and clinical outcomes need to be analyzed. However, complex nature, high dimensionality, and heterogeneity in genomics data make the overall analysis challenging. Convolutional neural networks(CNN) have shown tremendous success in solving such problems. However, neural network models are perceived mostly as `black box' methods because of their not well-understood internal functioning. However, interpretability is important to provide insights on why a given cancer case has a certain type. Besides, finding the most important biomarkers can help in recommending more accurate treatments and drug repositioning. In this paper, we propose a new approach called OncoNetExplainer to make explainable predictions of cancer types based on GE data. We used genomics data about 9,074 cancer patients covering 33 different cancer types from the Pan-Cancer Atlas on which we trained CNN and VGG16 networks using guided-gradient class activation maps++(GradCAM++). Further, we generate class-specific heat maps to identify significant biomarkers and computed feature importance in terms of mean absolute impact to rank top genes across all the cancer types. Quantitative and qualitative analyses show that both models exhibit high confidence at predicting the cancer types correctly giving an average precision of 96.25%. To provide comparisons with the baselines, we identified top genes, and cancer-specific driver genes using gradient boosted trees and SHapley Additive exPlanations(SHAP). Finally, our findings were validated with the annotations provided by the TumorPortal.


title: Meta-learnt priors slow down catastrophic forgetting in neural networks

abstract: Current training regimes for deep learning usually involve exposure to a single task / dataset at a time. Here we start from the observation that in this context the trained model is not given any knowledge of anything outside its (single-task) training distribution, and has thus no way to learn parameters (i.e., feature detectors or policies) that could be helpful to solve other tasks, and to limit future interference with the acquired knowledge, and thus catastrophic forgetting. Here we show that catastrophic forgetting can be mitigated in a meta-learning context, by exposing a neural network to multiple tasks in a sequential manner during training. Finally, we present SeqFOMAML, a meta-learning algorithm that implements these principles, and we evaluate it on sequential learning problems composed by Omniglot and MiniImageNet classification tasks.


title: An Efficient Algorithm for Multiple-Pursuer-Multiple-Evader Pursuit/Evasion Game

abstract: We present a method for pursuit/evasion that is highly efficient and and scales to large teams of aircraft. The underlying algorithm is an efficient algorithm for solving Markov Decision Processes (MDPs) that supports fully continuous state spaces. We demonstrate the algorithm in a team pursuit/evasion setting in a 3D environment using a pseudo-6DOF model and study performance by varying sizes of team members. We show that as the number of aircraft in the simulation grows, computational performance remains efficient and is suitable for real-time systems. We also define probability-to-win and survivability metrics that describe the teams' performance over multiple trials, and show that the algorithm performs consistently. We provide numerical results showing control inputs for a typical 1v1 encounter and provide videos for 1v1, 2v2, 3v3, 4v4, and 10v10 contests to demonstrate the ability of the algorithm to adapt seamlessly to complex environments.


title: Cooperative Distributed State Estimation: Resilient Topologies against Smart Spoofers

abstract: A network of observers is considered, where through asynchronous (with bounded delay) communications, they cooperatively estimate the states of a Linear Time-Invariant (LTI) system. In such a setting, a new type of adversary might affect the observation process by impersonating the identity of the regular node, which is a violation of communication authenticity. These adversaries also inherit the capabilities of Byzantine nodes, making them more powerful threats called smart spoofers. We show how asynchronous networks are vulnerable to smart spoofing attack. In the estimation scheme considered in this paper, information flows from the sets of source nodes, which can detect a portion of the state variables each, to the other follower nodes. The regular nodes, to avoid being misguided by the threats, distributively filter the extreme values received from the nodes in their neighborhood. Topological conditions based on strong robustness are proposed to guarantee the convergence. Two simulation scenarios are provided to verify the results.


title: $L^p$-Sobolev estimates for a class of integral operators with folding canonical relations

abstract: We prove a sharp $L^p$-Sobolev regularity results for a class of generalized Radon transforms for families of curves in a three dimensional manifold, with folding canonical relations. The proof relies on decoupling inequalities by Wolff and by Bourgain-Demeter for plate decompositions of thin neighborhoods of cones.


title: Mathematical Modeling for 2D Light-Sheet Fluorescence Microscopy image reconstruction

abstract: We study an inverse problem for Light Sheet Fluorescence Microscopy (LSFM), where the density of fluorescent molecules needs to be reconstructed. Our first step is to present a mathematical model to describe the measurements obtained by an optic camera during an LSFM experiment. Two meaningful stages are considered: excitation and fluorescence. We propose a paraxial model to describe the excitation process which is directly related with the Fermi pencil-beam equation. For the fluorescence stage, we use the transport equation to describe the transport of photons towards the detection camera. For the mathematical inverse problem that we obtain after the modeling, we present a uniqueness result, recasting the problem as the recovery of the initial condition for the heat equation in $\mathbb{R}\times(0,\infty)$ from measurements in a space-time curve. Additionally, we present numerical experiments to recover the density of the fluorescent molecules by discretizing the proposed model and facing this problem as the solution of a large and sparse linear system. Some iterative and regularized methods are used to achieve this objective. The results show that solving the inverse problem achieves better reconstructions than the direct acquisition method that is currently used.


title: On the spectrum of an oscillator in a magnetic field

abstract: We consider the Hamiltonian for a charged particle in a harmonic potential in the presence of a magnetic field. The most symmetric case depends on one parameter, the variation of which leads from a spectrum bounded from below to an unbounded spectrum. At the transition point the spectrum is bounded from below but each eigenvalue has infinite multiplicity. The algebraic method proves to be a remarkable tool for the analysis of this quadratic Hamiltonian.


title: Learning to Learn and Predict: A Meta-Learning Approach for Multi-Label Classification

abstract: Many tasks in natural language processing can be viewed as multi-label classification problems. However, most of the existing models are trained with the standard cross-entropy loss function and use a fixed prediction policy (e.g., a threshold of 0.5) for all the labels, which completely ignores the complexity and dependencies among different labels. In this paper, we propose a meta-learning method to capture these complex label dependencies. More specifically, our method utilizes a meta-learner to jointly learn the training policies and prediction policies for different labels. The training policies are then used to train the classifier with the cross-entropy loss function, and the prediction policies are further implemented for prediction. Experimental results on fine-grained entity typing and text classification demonstrate that our proposed method can obtain more accurate multi-label classification results.


title: Spatial offsets between interstellar bone-like filaments, radio masers, and cold diffuse CO gas, in the Scutum spiral arm

abstract: The advent of more precise measurements of distance estimates for some objects (bayesian estimates for filaments, trigonometric estimates for masers) permits a better comparison of their relative locations, and a comparison with a most recent spiral arm model fitted to the diffuse CO 1-0 gas. Our results support the idea that some bone-like filaments, greater than 10 pc (labeled elsewhere as bones, mst, herschel) and smaller than 100 pc, are observed near the potential minimum of the Scutum spiral arm (bone-like filaments are offset outward from masers by about 200 pc).


title: Translation Operator in Graph Signal Processing: A Generalized Approach

abstract: The notion of translation (shift) is straightforward in classical signal processing, however, it is challenging on an irregular graph structure. In this work, we present an approach to characterize the translation operator in various signal domains. By a natural generalization from classical domains, one can characterize an abstract representation for the graph translation operator. Then we propose an isometric translation operator in joint time-vertex domain consistent with the abstract form of translation operators in other domains. We also demonstrate the connection between this notion and the Schr\"{o}dinger equation on a dynamic system which intriguingly describes the idea behind translation on graph.


title: Vortices in a Monopole Superconducting Weyl Semi-metal

abstract: A monopole harmonic superconductor is a novel topological phase of matter with topologically protected gap nodes that result from the non-trivial Berry phase structure of Cooper pairs. In this work we propose to realize a monopole superconductor by the proximity effect between a time-reversal broken Weyl semi-metal and an $s$-wave superconductor. Furthermore, we study the zero-energy vortex bound states in this system by projection methods and by exact solutions. The zero modes exhibit a non-trivial phase winding in real space as a result of the non-trivial winding of the order parameter in momentum space. By mapping the Hamiltonian to the $(1+1)$d Dirac Hamiltonian, it is shown that the zero modes, analogous to the Jackiw-Rebbi mode, are protected by the index theorem. Finally, we propose possible experimental realizations.


title: On symmetric wedge mode of an elastic solid

abstract: The existence of a symmetric mode in an elastic solid wedge for all admissible values of the Poisson ratio and arbitrary openings close to $\pi$ has been proven.


title: BERT-Based Arabic Social Media Author Profiling

abstract: We report our models for detecting age, language variety, and gender from social media data in the context of the Arabic author profiling and deception detection shared task (APDA). We build simple models based on pre-trained bidirectional encoders from transformers (BERT). We first fine-tune the pre-trained BERT model on each of the three datasets with shared task released data. Then we augment shared task data with in-house data for gender and dialect, showing the utility of augmenting training data. Our best models on the shared task test data are acquired with a majority voting of various BERT models trained under different data conditions. We acquire 54.72% accuracy for age, 93.75% for dialect, 81.67% for gender, and 40.97% joint accuracy across the three tasks.


title: Learning Object-specific Distance from a Monocular Image

abstract: Environment perception, including object detection and distance estimation, is one of the most crucial tasks for autonomous driving. Many attentions have been paid on the object detection task, but distance estimation only arouse few interests in the computer vision community. Observing that the traditional inverse perspective mapping algorithm performs poorly for objects far away from the camera or on the curved road, in this paper, we address the challenging distance estimation problem by developing the first end-to-end learning-based model to directly predict distances for given objects in the images. Besides the introduction of a learning-based base model, we further design an enhanced model with a keypoint regressor, where a projection loss is defined to enforce a better distance estimation, especially for objects close to the camera. To facilitate the research on this task, we construct the extented KITTI and nuScenes (mini) object detection datasets with a distance for each object. Our experiments demonstrate that our proposed methods outperform alternative approaches (e.g., the traditional IPM, SVR) on object-specific distance estimation, particularly for the challenging cases that objects are on a curved road. Moreover, the performance margin implies the effectiveness of our enhanced method.


title: Stochastic Control of Tolman-Oppenheimer-Snyder Collapse of Zero-Pressure Stars to Black Holes: Rigorous Criteria for Density Bounds and Singularity Smoothing

abstract: The Tolman-Oppenheimer-Snyder description gives exact analytical solutions for an Einstein-matter system describing total gravitational collapse of a zero-pressure perfect-fluid sphere, representing a massive star which has exhausted its nuclear fuel. The star collapses to a point of infinite density within a finite comoving proper time interval $[0,t_{*}]$, and the exterior metric matches the Schwarzchild black hole metric. The description is re-expressed in terms of a 'density function' $u(t)=(\rho(t)/\rho_{o}))^{1/3}=R^{-1}(t)$ for initial density $u_{0}=R^{-1}(0)=1$ and radius $R(0)$, whereby the general-relativistic formulation reduces to an autonomous nonlinear ODE for $u(t)$. The solution blows up or is singular at $t=t_{*}=\pi/2(8\pi G/3\rho_{o})^{1/2}$. The blowup interval $[0,t_{*}]$ is partitioned into domains $[0,t_{\epsilon}]\bigcup[t_{\epsilon},t_{*}]$,with $t_{*}=t_{\epsilon}+|\epsilon|$ and $|\epsilon|\ll 1$, so that $t_{\epsilon}$ can be infinitesimally close to $t_{*}$. Randomness or 'stochastic control' is introduced via the 'switching on' of specific (white-noise) perturbations at $t=t_{\epsilon}$. Hybrid nonlinear ODES-SDES are then 'engineered' over the partition. Within the Ito interpretation, the resulting density function diffusion $\overline{u(t)}$ is proved to be a martingale whose supremum, volatility and higher-order moments are finite, bounded and singularity free for all finite $t>t_{\epsilon}$. The collapse is (comovingly) eternal but never becomes singular. Extensive and rigorous boundedness and no-blowup criteria are established via various methods, and blowup probability is always zero. The density singularity is therefore smoothed or 'noise-suppressed'. Within the Stratanovitch interpretation, the singularity formation probability is unity; however, null recurrence ensures the expected comoving time for this to occur is now infinite.


title: On Examples of Supersingular and Rationally Chain Connected Threefolds

abstract: In this work, we show that for a certain class of threefolds in positive characteristics, rational-chain-connectivity is equivalent to supersingularity. The same result is known for K3 surfaces with elliptic fibrations. And there are examples of threefolds that are both supersingular and rationally chain connected.


title: Simplified optical configuration for a sloshing-speedmeter-enhanced gravitational wave detector

abstract: We propose a new optical configuration for an interferometric gravitational wave detector based on the speedmeter concept using a sloshing cavity. Speedmeters provide an inherently better quantum-noise limited sensitivity at low frequencies than the currently used Michelson interferometers. We show that a practical sloshing cavity can be added relatively simply to an existing dual-recycled Michelson interferometer such as Advanced LIGO.


title: All-optical spin switching under different spin configurations

abstract: We employ an atomic spin model and present a systematic investigation from a single spin to a large system of over a million spins. To have an efficient spin switching, the electron initial momentum direction must closely follow the spin's orientation, so the orbital angular momentum is transverse to the spin and consequently the spin-orbit torque lies in the same direction as the spin. The module of the spin-orbit torque is $\lambda |{\bf S}||{\bf r}||{\bf P}| \sqrt{\cos^2\alpha+\cos^2\beta-2\cos\alpha \cos\beta \cos\gamma} $, where $\alpha(\beta)$ is the angle between spin {\bf S} and position {\bf r}(momentum { \bf P}) and $\gamma$ is the angle between {\bf r} and {\bf P}. These findings are manifested in a much larger system. The spin response depends on underlying spin structures. A linearly polarized laser pulse creates a dip in a uniform inplane-magnetized thin film, but has little effects on \neel and Bloch walls. Both right- and left- circularly polarized light ($\sigma^+$ and $\sigma^-$) have stronger but different effects in both uniform spin domains and Neel walls. While $\sigma^+$ light creates a basin of spins pointing down, $\sigma^-$ light creates a mound of spins pointing up. In the vicinity of the structure spins are reversed, similar to the experimental observation. $\sigma^+$ light has a dramatic effect, disrupting spins in Bloch walls. By contrast, $\sigma^-$ light has a small effect on Bloch walls because $\sigma^-$ only switches down spins up and once the spins already point up, there is no major effect.


title: Two-Dimensional Extended Homotopy Field Theories

abstract: We give another definition of two-dimensional extended homotopy field theories (E-HFTs) with aspherical targets and classify them. When the target of E-HFT is chosen to be a $K(G,1)$-space, we classify E-HFTs taking values in the symmetric monoidal bicategory of algebras, bimodules, and bimodule maps by certain Frobenius $G$-algebras called quasi-biangular $G$-algebras. As an application, for any discrete group $G$, we verify a special case of the $(G \times SO(2))$-structured cobordism hypothesis due to Lurie.


title: Signal retrieval with measurement system knowledge using variational generative model

abstract: Signal retrieval from a series of indirect measurements is a common task in many imaging, metrology and characterization platforms in science and engineering. Because most of the indirect measurement processes are well-described by physical models, signal retrieval can be solved with an iterative optimization that enforces measurement consistency and prior knowledge on the signal. These iterative processes are time-consuming and only accommodate a linear measurement process and convex signal constraints. Recently, neural networks have been widely adopted to supersede iterative signal retrieval methods by approximating the inverse mapping of the measurement model. However, networks with deterministic processes have failed to distinguish signal ambiguities in an ill-posed measurement system, and retrieved signals often lack consistency with the measurement. In this work we introduce a variational generative model to capture the distribution of all possible signals, given a particular measurement. By exploiting the known measurement model in the variational generative framework, our signal retrieval process resolves the ambiguity in the forward process, and learns to retrieve signals that satisfy the measurement with high fidelity in a variety of linear and nonlinear ill-posed systems, including ultrafast pulse retrieval, coded aperture compressive video sensing and image retrieval from Fresnel hologram.

categories: eess.IV cs.LG eess.SP physics.comp-ph stat.ML


title: Follow the Leader: Documents on the Leading Edge of Semantic Change Get More Citations

abstract: Diachronic word embeddings -- vector representations of words over time -- offer remarkable insights into the evolution of language and provide a tool for quantifying sociocultural change from text documents. Prior work has used such embeddings to identify shifts in the meaning of individual words. However, simply knowing that a word has changed in meaning is insufficient to identify the instances of word usage that convey the historical or the newer meaning. In this paper, we link diachronic word embeddings to documents, by situating those documents as leaders or laggards with respect to ongoing semantic changes. Specifically, we propose a novel method to quantify the degree of semantic progressiveness in each word usage, and then show how these usages can be aggregated to obtain scores for each document. We analyze two large collections of documents, representing legal opinions and scientific articles. Documents that are scored as semantically progressive receive a larger number of citations, indicating that they are especially influential. Our work thus provides a new technique for identifying lexical semantic leaders and demonstrates a new link between progressive use of language and influence in a citation network.


title: Recommendation System-based Upper Confidence Bound for Online Advertising

abstract: In this paper, the method UCB-RS, which resorts to recommendation system (RS) for enhancing the upper-confidence bound algorithm UCB, is presented. The proposed method is used for dealing with non-stationary and large-state spaces multi-armed bandit problems. The proposed method has been targeted to the problem of the product recommendation in the online advertising. Through extensive testing with RecoGym, an OpenAI Gym-based reinforcement learning environment for the product recommendation in online advertising, the proposed method outperforms the widespread reinforcement learning schemes such as $\epsilon$-Greedy, Upper Confidence (UCB1) and Exponential Weights for Exploration and Exploitation (EXP3).


title: Sublattice Melting in Binary Superionic Colloidal Crystals

abstract: In superionic compounds one component pre-melts providing high ionic conductivity to solid state electrolytes. Here, we find sublattice melting in colloidal crystals of oppositely charged particles that are highly asymmetric in size and charge in salt solutions. The small particles in ionic compounds melt when the temperature increases forming a superionic phase. These delocalized small particles in a crystal of large oppositely charged particles, in contrast to superionic phases in atomic systems, form crystals with non-electroneutral stoichiometric ratios. This generates structures with multiple domains of ionic crystals in percolated superionic phases with adjustable stoichiometries.


title: Asymptotic kinematics of Globular Clusters: the emergence of a Tully-Fisher relation

abstract: Using a recent homogeneous sample of 40 high quality velocity dispersion profiles for Galactic globular clusters, we study the low gravitational acceleration regime relevant to the outskirts of these systems. We find that a simple empirical profile having a central Gaussian component and a constant large radius asymptote, $\sigma_{\infty}$, accurately describes the variety of observed velocity dispersion profiles. We use published population synthesis models, carefully tailored to each individual cluster, to estimate mass to light ratios from which total stellar masses, $M$, are inferred. We obtain a clear scaling, reminiscent of the galactic Tully-Fisher relation of $\sigma_{\infty}( km s^{-1})= 0.084^{+0.075}_{-0.040} (M/M_{\odot})^{0.3 \pm 0.051} $, which is interesting to compare to the deep MOND limit of $\sigma_{\infty} (km s^{-1})=0.2(M/M_{\odot})^{0.25}$. Under a Newtonian interpretation, our results constitute a further restriction on models where initial conditions are crafted to yield the outer flattening observed today. Within a modified gravity scheme, as the globular clusters studied are not isolated objects in the deep MOND regime, the results obtained point towards a modified gravity where the external field effect of MOND does not appear, or is much suppressed.


title: A Bochner Formula on Path Space for the Ricci Flow

abstract: We generalize the classical Bochner formula for the heat flow on evolving manifolds $(M,g_{t})_{t \in [0,T]}$ to an infinite-dimensional Bochner formula for martingales on parabolic path space $P\mathcal{M}$ of space-time $\mathcal{M} = M \times [0,T]$. Our new Bochner formula and the inequalities that follow from it are strong enough to characterize solutions of the Ricci flow. Specifically, we obtain characterizations of the Ricci flow in terms of Bochner inequalities on parabolic path space. We also obtain gradient and Hessian estimates for martingales on parabolic path space, as well as condensed proofs of the prior characterizations of the Ricci flow from Haslhofer-Naber \cite{HN18a}. Our results are parabolic counterparts of the recent results in the elliptic setting from \cite{HN18b}.


title: The paraconductivity of granular Al-films at high reduced temperatures and magnetic fields

abstract: The electrical conductivity induced near the superconducting transition by thermal fluctuations was measured in different granular aluminum films. The seemingly anomalous behavior at high reduced temperatures and magnetic fields is explained by taking into account a total-energy cutoff in the superconducting fluctuation spectrum in both the direct (Aslamazov-Larkin) and the indirect (anomalous Maki-Thompson) contributions to the fluctuation effects. The analysis allowed a reliable determination of the coherence length amplitudes, which resulted to be much larger (20-48 nm) than the grains size (5-10 nm). This suggests that the grains are strongly Josephson-coupled, while the Tc value is still as high as twice the bulk value. These results could contribute to identify the mechanisms enhancing Tc in these materials.


title: High Dielectric Ternary Oxides from Crystal Structure Prediction and High-throughput Screening

abstract: The development of new high dielectric materials is essential for advancement in modern electronics. Oxides are generally regarded as the most promising class of high dielectric materials for industrial applications as they possess both high dielectric constants and large band gaps. Most previous researches on high dielectrics were limited to already known materials. In this study, we conducted an extensive search for high dielectrics over a set of ternary oxides by combining crystal structure prediction and density functional perturbation theory calculations. From this search, we adopted multiple stage screening to identify 440 new low-energy high dielectric materials. Among these materials, 33 were identified as potential high dielectrics favorable for modern device applications. Our research has opened an avenue to explore novel high dielectric materials by combining crystal structure prediction and high throughput screening.


title: Machine learning accelerates parameter optimization and uncertainty assessment of a land surface model

abstract: The performance of land surface models (LSMs) significantly affects the understanding of atmospheric and related processes. Many of the LSMs' soil and vegetation parameters were unknown so that it is crucially important to efficiently optimize them. Here I present a globally applicable and computationally efficient method for parameter optimization and uncertainty assessment of the LSM by combining Markov Chain Monte Carlo (MCMC) with machine learning. First, I performed the long-term (decadal scales) ensemble simulation of the LSM, in which each ensemble member has different parameters' values, and calculated the gap between simulation and observation, or the cost function, for each ensemble member. Second, I developed the statistical machine learning based surrogate model, which is computationally cheap but accurately mimics the relationship between parameters and the cost function, by applying the Gaussian process regression to learn the model simulation. Third, we applied MCMC by repeatedly driving the surrogate model to get the posterior probabilistic distribution of parameters. Using satellite passive microwave brightness temperature observations, both synthetic and real-data experiments in the Sahel region of west Africa were performed to optimize unknown soil and vegetation parameters of the LSM. The primary findings are (1) the proposed method is 50,000 times as fast as the direct application of MCMC to the full LSM; (2) the skill of the LSM to simulate both soil moisture and vegetation dynamics can be improved; (3) I successfully quantify the characteristics of equifinality by obtaining the full non-parametric probabilistic distribution of parameters.


title: Irreducibility of the Fermi Surface for Planar Periodic Graph Operators

abstract: We prove that the Fermi surface of a connected doubly periodic self-adjoint discrete graph operator is irreducible at all but finitely many energies provided that the graph (1) can be drawn in the plane without crossing edges (2) has positive coupling coefficients (3) has two vertices per period. If "positive" is relaxed to "complex", the only cases of reducible Fermi surface occur for the graph of the tetrakis square tiling, and these can be explicitly parameterized when the coupling coefficients are real. The irreducibility result applies to weighted graph Laplacians with positive weights.


title: Preech: A System for Privacy-Preserving Speech Transcription

abstract: New Advances in machine learning have made Automated Speech Recognition (ASR) systems practical and more scalable. These systems, however, pose serious privacy threats as speech is a rich source of sensitive acoustic and textual information. Although offline and open-source ASR eliminates the privacy risks, its transcription performance is inferior to that of cloud-based ASR systems, especially for real-world use cases. In this paper, we propose Pr$\epsilon\epsilon$ch, an end-to-end speech transcription system which lies at an intermediate point in the privacy-utility spectrum. It protects the acoustic features of the speakers' voices and protects the privacy of the textual content at an improved performance relative to offline ASR. Additionally, Pr$\epsilon\epsilon$ch provides several control knobs to allow customizable utility-usability-privacy trade-off. It relies on cloud-based services to transcribe a speech file after applying a series of privacy-preserving operations on the user's side. We perform a comprehensive evaluation of Pr$\epsilon\epsilon$ch, using diverse real-world datasets, that demonstrates its effectiveness. Pr$\epsilon\epsilon$ch provides transcriptions at a 2% to 32.25% (mean 17.34%) relative improvement in word error rate over Deep Speech, while fully obfuscating the speakers' voice biometrics and allowing only a differentially private view of the textual content.


title: Further Results on the Pseudo-$L_{g}(s)$ Association Scheme with $g\geq 3$, $s\geq g+2$

abstract: It is inevitable that the $L_{g}(s)$ association scheme with $g\geq 3, s\geq g+2$ is a pseudo-$L_{g}(s)$ association scheme. On the contrary, although $s^2$ treatments of the pseudo-$L_{g}(s)$ association scheme can form one $L_{g}(s)$ association scheme, it is not always an $L_{g}(s)$ association scheme. Mainly because the set of cardinality $s$, which contains two first-associates treatments of the pseudo-$L_{g}(s)$ association scheme, is non-unique. Whether the order $s$ of a Latin square $\mathbf{L}$ is a prime power or not, the paper proposes two new conditions in order to extend a $POL(s,w)$ containing $\mathbf{L}$. It has been known that a $POL(s,w)$ can be extended to a $POL(s,s-1)$ so long as Bruck's \cite{brh} condition $s\geq \frac{(s-1-w)^4-2(s-1-w)^3+2(s-1-w)^2+(s-1-w)}{2}$ is satisfied, Bruck's condition will be completely improved through utilizing six properties of the $L_{w+2}(s)$ association scheme in this paper. Several examples are given to elucidate the application of our results.


title: NormLime: A New Feature Importance Metric for Explaining Deep Neural Networks

abstract: The problem of explaining deep learning models, and model predictions generally, has attracted intensive interest recently. Many successful approaches forgo global approximations in order to provide more faithful local interpretations of the model's behavior. LIME develops multiple interpretable models, each approximating a large neural network on a small region of the data manifold and SP-LIME aggregates the local models to form a global interpretation. Extending this line of research, we propose a simple yet effective method, NormLIME for aggregating local models into global and class-specific interpretations. A human user study strongly favored class-specific interpretations created by NormLIME to other feature importance metrics. Numerical experiments confirm that NormLIME is effective at recognizing important features.


title: On Mean curvature flow of Singular Riemannian foliations: Non compact cases

abstract: In this paper we investigate the mean curvature flow (MCF) of a regular leaf of a closed generalized isoparametric foliation as initial datum, generalizing previous results of Radeschi and first author. We show that, under bounded curvature conditions, any finite time singularity is a singular leaf, and the singularity is of type I. We also discuss the existence of basin of attractions, how cylinder structures can affect convergence of basic MCF of immersed submanifolds and make a few remarks on MCF of non closed leaves of generalized isoparametric foliation.


title: Augmenting Monte Carlo Dropout Classification Models with Unsupervised Learning Tasks for Detecting and Diagnosing Out-of-Distribution Faults

abstract: The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications to improve the classification performance on incipient faults. In this paper, we propose a novel approach of augmenting the classification model with an additional unsupervised learning task. We justify our choice of algorithm design via an information-theoretical analysis. Our experimental results on three datasets from diverse application domains show that the proposed method leads to improved fault detection and diagnosis performance, especially on out-of-distribution examples including both incipient and unknown faults.


title: Novel diffusion-derived distance measures for graphs

abstract: We define a new family of similarity and distance measures on graphs, and explore their theoretical properties in comparison to conventional distance metrics. These measures are defined by the solution(s) to an optimization problem which attempts find a map minimizing the discrepancy between two graph Laplacian exponential matrices, under norm-preserving and sparsity constraints. Variants of the distance metric are introduced to consider such optimized maps under sparsity constraints as well as fixed time-scaling between the two Laplacians. The objective function of this optimization is multimodal and has discontinuous slope, and is hence difficult for univariate optimizers to solve. We demonstrate a novel procedure for efficiently calculating these optima for two of our distance measure variants. We present numerical experiments demonstrating that (a) upper bounds of our distance metrics can be used to distinguish between lineages of related graphs; (b) our procedure is faster at finding the required optima, by as much as a factor of 10^3; and (c) the upper bounds satisfy the triangle inequality exactly under some assumptions and approximately under others. We also derive an upper bound for the distance between two graph products, in terms of the distance between the two pairs of factors. Additionally, we present several possible applications, including the construction of infinite "graph limits" by means of Cauchy sequences of graphs related to one another by our distance measure.


title: The Impact of Type Ia Supernovae in Quiescent Galaxies: II. Energetics and Turbulence

abstract: Type Ia supernovae (SNe Ia) provide unique and important feedback in quiescent galaxies, but their impact has been underappreciated. In this paper, we analyze a series of high-resolution simulations to examine the energetics and turbulence of the medium under SNe Ia. We find that when SN remnants are resolved, their effects differ distinctly from a volumetric heating term, as is commonly assumed in unresolved simulations. First, the net heating is significantly higher than expected, by 30$\pm$10\% per cooling time. This is because a large fraction of the medium is pushed into lower densities which cool inefficiently. Second, the medium is turbulent; the root-mean-squared (RMS) velocity of the gas to 20-50 km s$^{-1}$ on a driving scale of tens of parsec. The velocity field of the medium is dominated by compressional modes, which are larger than the solenoidal components by a factor of 3-7. Third, the hot gas has a very broad density distribution. The ratio between the density fluctuations and the RMS Mach number, parameterized as $b$, is 2-20. This is in contrast to previous simulations of turbulent media, which have found $b\lesssim$ 1. The reason for the difference is mainly caused by the \textit{localized} heating of SNe Ia, which creates a large density contrast. Last, the typical length scale of a density fluctuation grows with time, forming increasingly larger bubbles and filamentary ridges. These underlying density fluctuations need to be included when X-ray observations are interpreted.


title: Are gravitating magnetic monopoles stable?

abstract: The gravitating Julia-Zee dyon is a particle-like solution with both electric and magnetic charge. It is found in the Einstein-Yang-Mills-Higgs system of SU(2) with a scalar field in the adjoint representation coupled to gravity. Within the magnetic ansatz this system is reduced from describing dyons to describing the gravitating 't Hooft-Polyakov magnetic monopole. The stability of the well-known static gravitating magnetic monopole solutions with respect to perturbations within the magnetic ansatz--so-called magnetic perturbations--is well studied, but their stability with respect to perturbations outside the magnetic ansatz--so-called sphaleronic perturbations--is not. I undertake a purely numerical study by adding sphaleronic perturbations to gravitating magnetic monopole solutions and then dynamically evolving the system. For large perturbations I find that the system heads toward a dyon configuration, as expected. For sufficiently small perturbations, however, the system oscillates about the magnetic ansatz in a manner consistent with oscillations about a stable equilibrium.


title: Novel imaging revealing inner dynamics for cardiovascular waveform analysis via unsupervised manifold learning

abstract: Cardiovascular waveforms contain information for clinical diagnosis. By "learning" and organizing the subtle change of waveform morphology from large amounts of raw waveform data, unsupervised manifold learning helps delineate a high-dimensional structure and display it as a novel three-dimensional (3D) image. We investigate the electrocardiography (ECG) waveform for ischemic heart disease and arterial blood pressure (ABP) waveform in dynamic vasoactive episodes. We model each beat or pulse to be a point lying on a manifold, like a surface, and use the diffusion map (DMap) to establish the relationship among those pulses. For ECG datasets, first we analyzed the non-ST-elevation ECG waveform distribution from unstable angina to healthy control, and we investigated intraoperative ST-elevation ECG waveforms to show the dynamic ECG waveform changes. For ABP datasets, we analyzed waveforms collected under endotracheal intubation and administration of vasodilator. To quantify the dynamic separation, we applied the support vector machine (SVM) analysis and the trajectory analysis. For the non-ST-elevation ECG, a hierarchical tree structure comprising consecutive ECG waveforms spanning from unstable angina to healthy control is presented in the 3D image (accuracy=97.6%, macro-F1=96.1%). The DMap helps quantify and visualize the evolving direction of intraoperative ST-elevation myocardial episode in a 1-hour period (accuracy=97.58%, macro-F1=96.06%). The ABP waveform analysis of Nicardipine administration shows inter-individual difference (accuracy=95.01%, macro-F1=96.9%) and their common directions from intra-individual moving trajectories. The dynamic change of the ABP waveform during endotracheal intubation shows a loop-like trajectory structure, which can be further divided using the knowledge obtained from Nicardipine. The 3D images provide clues of underneath physiological mechanisms.


title: Confidence Measure Guided Single Image De-raining

abstract: Single image de-raining is an extremely challenging problem since the rainy images contain rain streaks which often vary in size, direction and density. This varying characteristic of rain streaks affect different parts of the image differently. Previous approaches have attempted to address this problem by leveraging some prior information to remove rain streaks from a single image. One of the major limitations of these approaches is that they do not consider the location information of rain drops in the image. The proposed Image Quality-based single image Deraining using Confidence measure (QuDeC), network addresses this issue by learning the quality or distortion level of each patch in the rainy image, and further processes this information to learn the rain content at different scales. In addition, we introduce a technique which guides the network to learn the network weights based on the confidence measure about the estimate of both quality at each location and residual rain streak information (residual map). Extensive experiments on synthetic and real datasets demonstrate that the proposed method achieves significant improvements over the recent state-of-the-art methods.


title: Non-equilibrium diffusion characteristics of a particle system and the correspondence to a social system

abstract: A Langevin equation is suggested to describe a system driven by correlated Gaussian white noise as well as with positive and negative damping demarcated by a critical velocity. The equation can be transformed into the Fokker-Planck equation by the Kramers-Moyal expansion. The solution exhibits some non-equilibrium phenomena. In the beginning the distribution curve of velocity/energy takes on a random oscillation, and then a near-equilibrium distribution described by the Boltzmann distribution is gradually established. However, a spike appears on the distribution curve and breaks this stable distribution. The spike moves in the direction of velocity/energy decreasing and is nonlinearly enlarged so as to sustain. The final distribution is a sharp peak formed by a monotonically ascending segment and a monotonically descending one. The calculating results of the statistical quantities demonstrate that the process is a sub-diffusion, and the spike originates from the correlation between noise and space. Based on a basic hypothesis that the generalized displacement is regarded as the information carried by an opinion particle, and the velocity is taken as the sensitivity of an agent to an event, we map the observations in this system to a social system to understand the propagation of public opinion or message.


title: Comments on "Three regimes of QCD" by L.Glozman

abstract: There are no "three regimes of QCD", as speculated in that paper. There are only two, separated by already well known $T_c\sim 155\, MeV$. Above it electric interactions are screened rather then confined. Magnetic ones remain confined all the way to $T\rightarrow \infty$. Spectrum of "mesonic screening masses" is there, but they do not represent real masses. At high $T$ they correspond to "heavy quarkonia" of 2+1 d gauge theory, which is well known to be a confining theory. There is no reason to expect any transition unbinding them, at $T\sim 1\, GeV$ as claimed. I make calculation of correction to screening masses in 2+1d at high temperature including spatial screening tension and find results in agreement with recent lattice data.


title: Fragility of surface states in topological superfluid $^3$He

abstract: Topological superfluid $^3$He, with unconventional spin-triplet p-wave pairing, provides a model system for topological superconductors, which have attracted significant interest through potential applications in topologically protected quantum computing. In topological insulators and quantum Hall systems, the surface/edge states, arising from bulk-surface correspondence and the momentum space topology of the band structure, are robust. Here we demonstrate that in topological superconductors the surface Andreev bound states, which depend on the momentum space topology of the emergent order parameter, are fragile with respect to the details of surface scattering. We confine superfluid $^3$He within a cavity of height comparable to the Cooper pair diameter. We precisely determine the superfluid transition temperature $T_{\mathrm{c}}$ and the suppression of the superfluid energy gap, for different scattering conditions tuned in situ, and compare to the predictions of quasi-classical theory. We discover that surface magnetic scattering leads to unexpectedly large suppression of $T_{\mathrm{c}}$, corresponding to an increased density of low energy bound states.


title: Adiabatic Elimination and Sub-space Evolution of Open Quantum Systems

abstract: Efficient descriptions of open quantum systems can be obtained by performing an adiabatic elimination of the fast degrees of freedom and formulating effective operators for the slow degrees of freedom in reduced dimensions. Here, we perform the construction of effective operators in frequency space, and using the final value theorem or alternatively the Keldysh theorem, we provide a correction for the trace of the density matrix which takes into account the non trace-preserving character of the evolution. We illustrate our results with two different systems, ones where the eliminated fast subspace is constituted by a continuous set of states and ones with discrete states. Furthermore, we show that the two models converge for very large dissipation and at coherent population trapping points. Our results also provide an intuitive picture of the correction to the trace of the density matrix as a detailed balance equation.

categories: quant-ph cond-mat.mes-hall physics.atom-ph physics.chem-ph


title: The Chiral Anomaly of the Free Fermion in Functorial Field Theory

abstract: When trying to cast the free fermion in the framework of functorial field theory, its chiral anomaly manifests in the fact that it assigns the determinant of the Dirac operator to a top-dimensional closed spin manifold, which is not a number as expected, but an element of a complex line. In functorial field theory language, this means that the theory is twisted, which gives rise to an anomaly theory. In this paper, we give a detailed construction of this anomaly theory, as a functor that sends manifolds to infinite-dimensional Clifford algebras and bordisms to bimodules.


title: Selfie: User-defined Sensitive Memory Protection and Recovery

abstract: Different users always have different requirement for sensitive memory definition. It is not flexible for aborting program execution once detecting memory corruption. Because the users may loose some sensitive data. We presented Selfie, a hybrid solution to provide one flexible solution to protect the sensitive memory according to users' requirements in runtime. Finally, Selfie can provide one solution to decide whether execution needs to be recovered. If the memory corruption doesn't belong sensitive memory, Selfie provides symbolic solver that can help figure out whether the memory corruption can affect the sensitive memory in future.


title: Anomalous bremsstrahlung and the structure of cosmic ray electron-positron fluxes at the GeV-TeV energy range

abstract: We reveal that the energy spectra of electrons-positrons in primary cosmic rays measured at atmosphere top have double structures: an excess component $\Phi^s_{e^+}(E)=\Phi^s_{e^-}(E)$ around $400 GeV$, which origins from a strong $e^+e^-$-source and the distorted background $\Phi^0_{e^-}(E)$. We supposed that the difference between AMS-CALET and Fermi-LAT-DAMPE data origins from the energy loss of the fluxes due to the anomalous bremsstrahlung effect at a special window. The evolution of spectra under anomalous bremsstrahlung effect satisfies an improved electromagnetic cascade equation. The above spectra are parameterized and they can be regarded as the subjects exploring new physics. We suggest to check the previous applications of the Bethe-Heitler formula in the study of the propagation of high energy electrons and photons.


title: Garland Recurrences

abstract: Partially ordered sets have received much attention in recent years, not just due to their usefulness in combinatorics and abstract algebra, but also due to their practical applications in fields ranging from chemistry to macroeconomics. The garland or double fence $G_N$ is a partially ordered set with $2N$ elements which generalizes the well-known fence or zigzag poset. The main result of this paper is recurrence relations for enumerating the linear extensions of $G_N$. These recurrences were then applied to prove divergence of the standard type $G_N$-generating series. When coded in Python, it provides a fast method for computing $e(G_n)$ for arbitrary $n$. The first 200 terms of this sequence are published online under OEIS A227656.


title: Structural disorder on small scales softens hierarchical structures

abstract: Hierarchically structured materials, which possess distinct features on different length scales, are ubiquitous in nature and engineering. In many cases, one structural level may be ordered while another structural level may be disordered. Here, we investigate the impact of structural disorder on the mechanical properties of hierarchical filamentous structures. Through simulations of networks with two hierarchical levels, we show that disorder does not change how stiffness scales with the mean coordination number - the average number of bonds per node - on large and small length scales. However, we find that network rigidity and stiffness depend strongly on the presence or absence of disorder on the small length scale, but not on the large length scale. In fact, the amount of material necessary for a fully connected, network ordered on the small scale is insufficient to create even a marginally rigid network with small-scale disorder. We trace these phenomena back to a difference in the maximum mean coordination number on the small scale. While single length scale ordered and disordered networks have similar mean coordination numbers in the interior and on surfaces, we find that disorder strongly impacts the structure of surfaces, resulting in a larger fraction of surface nodes on the small scale. While this effect increases in strength as large scale bonds become narrower, it persists even for bonds that are wider than they are long (i.e., aspect ratios < 1).