title: Magnetic Field Magnitude Modification for a Force-free Magnetic Cloud Model

abstract: A scheme was developed by Lepping, Berdichevsky, and Wu (Solar Phys., doi.10. 1007/ s11207-016-1040-9, 2017) [called the LBW article here] to approximate the average magnetic field magnitude (B-) profile of a "typical" magnetic cloud (MC) at/near 1AU. It was based on actual Wind MC data, taken over 21 years, that was used to modify a time shifted Bessel function (force-free) magnetic field, where shifted refers to a field that was adjusted for typical MC self-similar expansion. This was developed in the context of the Lepping, Jones, and Burlaga (J. Geophys. Res. vol. 95, p.11957, 1990) [called LJB here] MC parameter fitting model and should provide more realistic future representations of the MC's B-profile in most cases. In the LBW article, through testing, it was shown that on average it can be expected that in about 80% of the MC cases (but it varies according to the spacecrafts' actual closest approach distances) the modified model's B-profile of the MC should be significantly improved by use of this scheme. We describe how this scheme can be employed practically in modifying the LJB MC fitting model, and we test a new and slightly better (and less unwieldy) version of the scheme, the non-shifted (of Bessel functions) version, which is the one actually used in the LJB model modification. The new scheme is based on modification formulae that are slightly more accurate than the old scheme, and it is expected to improve the B-profile in approximately 83% of the cases on average. The schemes are applicable for use with data originating only at/near 1 AU, since the magnetic field and plasma data used in the development of the associated formulae were from only the Wind spacecraft, which was and is at 1 AU.


title: Search for steady point-like sources in the astrophysical muon neutrino flux with 8 years of IceCube data

abstract: The IceCube Collaboration has observed a high-energy astrophysical neutrino flux and recently found evidence for neutrino emission from the blazar TXS 0506+056. These results open a new window into the high-energy universe. However, the source or sources of most of the observed flux of astrophysical neutrinos remains uncertain. Here, a search for steady point-like neutrino sources is performed using an unbinned likelihood analysis. The method searches for a spatial accumulation of muon-neutrino events using the very high-statistics sample of about $497\,000$ neutrinos recorded by IceCube between 2009 and 2017. The median angular resolution is $\sim1^\circ$ at 1 TeV and improves to $\sim0.3^\circ$ for neutrinos with an energy of 1 PeV. Compared to previous analyses, this search is optimized for point-like neutrino emission with the same flux-characteristics as the observed astrophysical muon-neutrino flux and introduces an improved event-reconstruction and parametrization of the background. The result is an improvement in sensitivity to the muon-neutrino flux compared to the previous analysis of $\sim35\%$ assuming an $E^{-2}$ spectrum. The sensitivity on the muon-neutrino flux is at a level of $E^2 \mathrm{d} N /\mathrm{d} E = 3\cdot 10^{-13}\,\mathrm{TeV}\,\mathrm{cm}^{-2}\,\mathrm{s}^{-1}$. No new evidence for neutrino sources is found in a full sky scan and in an a priori candidate source list that is motivated by gamma-ray observations. Furthermore, no significant excesses above background are found from populations of sub-threshold sources. The implications of the non-observation for potential source classes are discussed.


title: On Collision Course: The Nature of the Binary Star Cluster NGC 2006 / SL 538

abstract: The LMC hosts a rich variety of star clusters seen in close projected proximity. Ages have been derived for few of them showing differences up to few million years, hinting at being binary star clusters. However, final confirmation needs to be done through spectroscopic analysis. Here we focus on the LMC cluster pair NGC2006-SL538 and aim to determine whether the star cluster pair is a bound entity (binary star cluster) or a chance alignment. Using the MIKE echelle spectrograph at LCO we have acquired integrated-light spectra for each cluster. We have measured radial velocities by two methods: a) direct line profile measurement yields v$_r=300.3\pm5\pm6$ km/s for NGC2006 and $v_r=310.2\pm4\pm6$ km/s for SL538. b) By comparing observed spectra with synthetic bootstrapped spectra yielding $v_r=311.0\pm0.6$ km/s for NGC2006 and $v_r=309.4\pm0.5$ km/s for SL538. Finally when spectra are directly compared, we find a ${\Delta}v=1.08\pm0.47$ km/s. Full-spectrum SED fits reveal that the stellar population ages lie in the range 13-21 Myr with a metallicity of Z=0.008. We find indications for differences in the chemical abundance patterns as revealed by the helium absorption lines between the two clusters. The dynamical analysis shows that the two clusters are likely to merge within the next $\sim$150 Myr. The NGC2006-SL538 cluster pair shows radial velocities, stellar population and dynamical parameters consistent with a gravitational bound entity. We conclude that this is a genuine binary cluster pair, and we propose that their differences in ages and stellar population chemistry is most likely due to variances in their chemical enrichment history within their environment. We suggest that their formation may have taken place in a loosely bound star-formation complex which saw initial fragmentation but then had its clusters become a gravitationally bound pair by tidal capture.


title: Age evolution in the mean field forest fire model via multitype branching processes

abstract: We study the distribution of ages in the mean field forest fire model introduced by R\'ath and T\'oth. This model is an evolving random graph whose dynamics combine Erd\H{o}s-R\'enyi edge-addition with a Poisson rain of lightning strikes. All edges in a connected component are deleted when any of its vertices is struck by lightning. We consider the asymptotic regime of lightning rates for which the model displays self-organized criticality. The age of a vertex increases at unit rate, but it is reset to zero at each burning time. We show that the empirical age distribution converges as a process to a deterministic solution of an autonomous measure-valued differential equation. The main technique is to observe that, conditioned on the vertex ages, the graph is an inhomogeneous random graph in the sense of Bollob\'as, Janson and Riordan. We then study the evolution of the ages via the multitype Galton--Watson trees that arise as the limit in law of the component of an identified vertex at any fixed time. These trees are critical from the gelation time onwards.


title: Generative Model for Material Experiments Based on Prior Knowledge and Attention Mechanism

abstract: Material irradiation experiment is dangerous and complex, thus it requires those with a vast advanced expertise to process the images and data manually. In this paper, we propose a generative adversarial model based on prior knowledge and attention mechanism to achieve the generation of irradiated material images (data-to-image model), and a prediction model for corresponding industrial performance (image-to-data model). With the proposed models, researchers can skip the dangerous and complex irradiation experiments and obtain the irradiation images and industrial performance parameters directly by inputing some experimental parameters only. We also introduce a new dataset ISMD which contains 22000 irradiated images with 22,143 sets of corresponding parameters. Our model achieved high quality results by compared with several baseline models. The evaluation and detailed analysis are also performed.


title: Towards a realization of device-independent quantum key distribution

abstract: In the implementation of device-independent quantum key distribution we are interested in maximizing the key rate, i.e. the number of key bits that can be obtained per signal, for a fixed security parameter. In the finite size regime, we furthermore also care about the minimum number of signals required before key can be obtained at all. Here, we perform a fully finite size analysis of device independent protocols using the CHSH inequality both for collective and coherent attacks. For coherent attacks, we sharpen the results recently derived in Arnon-Friedman et al., Nat. Commun. 9, 459 (2018), to reduce the minimum number of signals before key can be obtained. In the regime of collective attacks, where the devices are restricted to have no memory, we employ two different techniques that exploit this restriction to further reduce the number of signals. We then discuss experimental platforms in which DIQKD may be implemented. We analyse Bell violations and expected QBER achieved in previous Bell tests with distant setups and situate these parameters in the security analysis. Moreover, focusing on one of the experimental platforms, namely nitrogen-vacancy based systems, we describe experimental improvements that can lead to a device-independent quantum key distribution implementation in the near future.


title: Electric vehicle charging during the day or at night: a perspective on carbon emissions

abstract: We propose an emission-oriented charging scheme to evaluate the emissions of electric vehicle (EV) charging from the electricity sector at the region of Electric Reliability Council of Texas (ERCOT). We investigate both day- and night-charging scenarios combined with realistic system load demand under the emission-oriented vs direct charging schemes. Our emission-oriented charging scheme reduces carbon emissions in the day by 13.8% on average. We also find that emission-oriented charging results in a significant CO2 reduction in 30% of the days in a year compared with direct charging. Apart from offering a flat rebate for EV owners, our analysis reveals that certain policy incentives (e.g. pricing) regarding EV charging should be taken into account in order to reflect the benefits of emissions reduction that haven't been incorporated in the current market of electricity transactions.


title: Deep Learning for Automated Classification of Tuberculosis-Related Chest X-Ray: Dataset Specificity Limits Diagnostic Performance Generalizability

abstract: Machine learning has been an emerging tool for various aspects of infectious diseases including tuberculosis surveillance and detection. However, WHO provided no recommendations on using computer-aided tuberculosis detection software because of the small number of studies, methodological limitations, and limited generalizability of the findings. To quantify the generalizability of the machine-learning model, we developed a Deep Convolutional Neural Network (DCNN) model using a TB-specific CXR dataset of one population (National Library of Medicine Shenzhen No.3 Hospital) and tested it with non-TB-specific CXR dataset of another population (National Institute of Health Clinical Centers). The findings suggested that a supervised deep learning model developed by using the training dataset from one population may not have the same diagnostic performance in another population. Technical specification of CXR images, disease severity distribution, overfitting, and overdiagnosis should be examined before implementation in other settings.


title: Many body study of $g$-factor in boron-like argon

abstract: Highly accurate measurements of the $g$-factor of boronlike Ar are currently implemented within the ARTEMIS experiment at GSI (Darmstadt, Germany) and within the ALPHATRAP experiment at the MPIK (Heidelberg, Germany). A comparison with the corresponding theoretical predictions will allow one to test the modern methods of bound-state QED. However, at least three different theoretical values of the \emph{g}-factor have been published up to date. The systematic study of the \emph{g} factor value of Ar$^{13+}$ in the ground $[(1s)^2(2s)^2 2p]^2P_{1/2}$ and the first excited $[(1s)^2(2s)^2 2p]^2P_{3/2}$ states is performed within the high order coupled cluster and configuration interaction theories up to the full configuration interaction treatment. Correlation contributions are discussed and results are compared with previous studies.


title: Saliency Supervision: An Intuitive and Effective Approach for Pain Intensity Regression

abstract: Getting pain intensity from face images is an important problem in autonomous nursing systems. However, due to the limitation in data sources and the subjectiveness in pain intensity values, it is hard to adopt modern deep neural networks for this problem without domain-specific auxiliary design. Inspired by human vision priori, we propose a novel approach called saliency supervision, where we directly regularize deep networks to focus on facial area that is discriminative for pain regression. Through alternative training between saliency supervision and global loss, our method can learn sparse and robust features, which is proved helpful for pain intensity regression. We verified saliency supervision with face-verification network backbone on the widely-used dataset, and achieved state-of-art performance without bells and whistles. Our saliency supervision is intuitive in spirit, yet effective in performance. We believe such saliency supervision is essential in dealing with ill-posed datasets, and has potential in a wide range of vision tasks.


title: Automated Pain Detection from Facial Expressions using FACS: A Review

abstract: Facial pain expression is an important modality for assessing pain, especially when the patient's verbal ability to communicate is impaired. The facial muscle-based action units (AUs), which are defined by the Facial Action Coding System (FACS), have been widely studied and are highly reliable as a method for detecting facial expressions (FE) including valid detection of pain. Unfortunately, FACS coding by humans is a very time-consuming task that makes its clinical use prohibitive. Significant progress on automated facial expression recognition (AFER) has led to its numerous successful applications in FACS-based affective computing problems. However, only a handful of studies have been reported on automated pain detection (APD), and its application in clinical settings is still far from a reality. In this paper, we review the progress in research that has contributed to automated pain detection, with focus on 1) the framework-level similarity between spontaneous AFER and APD problems; 2) the evolution of system design including the recent development of deep learning methods; 3) the strategies and considerations in developing a FACS-based pain detection framework from existing research; and 4) introduction of the most relevant databases that are available for AFER and APD studies. We attempt to present key considerations in extending a general AFER framework to an APD framework in clinical settings. In addition, the performance metrics are also highlighted in evaluating an AFER or an APD system.


title: A note on long rainbow arithmetic progressions

abstract: Jungi\'{c} et al (2003) defined $T_{k}$ as the minimal number $t \in \mathbb{N}$ such that there is a rainbow arithmetic progression of length $k$ in every equinumerous $t$-coloring of $[t n]$ for every $n \in \mathbb{N}$. They proved that for every $k \geq 3$, $\lfloor \frac{k^2}{4} \rfloor < T_{k} \leq \frac{k(k-1)^2}{2}$ and conjectured that $T_{k} = \Theta(k^2)$. We prove for all $\epsilon > 0$ that $T_{k} = O(k^{5/2+\epsilon})$ using the K\H{o}v\'{a}ri-S\'{o}s-Tur\'{a}n theorem and Wigert's bound on the divisor function.


title: Free-Space Optical Communications with Detector Arrays

abstract: Detector arrays are commonly used for free-space optical communications in deep space. Such detector arrays---by virtue of their size---help in the collection of the optical signal even when there is some misalignment between the transmitter and receiver systems. In this paper, we argue that for the common Gaussian beam profile, a detector array receiver is more useful for minimizing the probability of error than a single detector receiver of the same dimensions. Furthermore, the improvement in the error probability is more pronounced for low signal-to-noise ratio conditions, and the probability of error decreases monotonically as a function of the number of detectors in the array. However, communication with detector arrays results in a larger computational complexity at the receiver. Additionally, such detector arrays are also more advantageous for beam position tracking on the detector array in order to minimize the pointing loss.


title: Search for long-lived particles decaying into displaced jets in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A search for long-lived particles decaying into jets is presented. Data were collected with the CMS detector at the LHC from proton-proton collisions at a center-of-mass energy of 13 TeV in 2016, corresponding to an integrated luminosity of 35.9 fb$^{-1}$. The search examines the distinctive topology of displaced tracks and secondary vertices. The selected events are found to be consistent with standard model predictions. For a simplified model in which long-lived neutral particles are pair produced and decay to two jets, pair production cross sections larger than 0.2 fb are excluded at 95% confidence level for a long-lived particle mass larger than 1000 GeV and proper decay lengths between 3 and 130 mm. Several supersymmetry models with gauge-mediated supersymmetry breaking or $R$-parity violation, where pair-produced long-lived gluinos or top squarks decay to several final-state topologies containing displaced jets, are also tested. For these models, in the mass ranges above 200 GeV, gluino masses up to 2300-2400 GeV and top squark masses up to 1350-1600 GeV are excluded for proper decay lengths approximately between 10 and 100 mm. These are the most restrictive limits to date on these models.


title: Bounds of Gelfand-Tsetlin multiplicities and tableaux realizations of Verma modules

abstract: We introduce the notion of essential support of a simple Gelfand-Tsetlin $\mathfrak{gl}_n$-module as an important tool towards understanding the character formula of such module. This support detects the weights in the module having maximal possible Gelfand-Tsetlin multiplicities. Using combinatorial tools we describe the essential supports of the simple socles of the universal tableaux modules. We also prove that every simple Verma module appears as a socle of a universal tableaux module and hence obtain a description of the essential supports of all simple Verma modules. As a consequence, we prove the Strong Futorny-Ovsienko Conjecture on the sharpness of the upper bounds of the Gelfand-Tsetlin multiplicities. In addition we give a very explicit description of the support and essential support of the simple singular Verma module $M(-\rho)$


title: Generalized Zero-Shot Recognition based on Visually Semantic Embedding

abstract: We propose a novel Generalized Zero-Shot learning (GZSL) method that is agnostic to both unseen images and unseen semantic vectors during training. Prior works in this context propose to map high-dimensional visual features to the semantic domain, we believe contributes to the semantic gap. To bridge the gap, we propose a novel low-dimensional embedding of visual instances that is "visually semantic." Analogous to semantic data that quantifies the existence of an attribute in the presented instance, components of our visual embedding quantifies existence of a prototypical part-type in the presented instance. In parallel, as a thought experiment, we quantify the impact of noisy semantic data by utilizing a novel visual oracle to visually supervise a learner. These factors, namely semantic noise, visual-semantic gap and label noise lead us to propose a new graphical model for inference with pairwise interactions between label, semantic data, and inputs. We tabulate results on a number of benchmark datasets demonstrating significant improvement in accuracy over state-of-the-art under both semantic and visual supervision.


title: An ALMA archival study of the clump mass function in the Large Magellanic Cloud

abstract: We present 1.3 and 3.2 mm continuum maps of three star forming regions in the Large Magellanic Cloud (LMC) observed with the Atacama Large Millimeter/Submillimeter Array (ALMA). The data were taken as part of two projects retrieved from the ALMA public archive plus one project observed specifically for this work. We develop a technique to combine maps at these wavelengths to estimate dust-only emission corrected for free-free emission contamination. From these observations we identify 32 molecular clumps in the LMC and estimate their total mass from their dust emission to range from 205 to 5740 M$_{\odot}$. We derive a cumulative clump mass function ($N(\geq M) \propto M^{\alpha + 1}$) and fit it with a double power law to find $\alpha_{\mathrm{low}} = -1.76^{+0.04}_{-0.05}$, $\alpha_{\mathrm{high}} = -3.3 \pm 0.2$, and a break mass of 2500$^{+300}_{-200}$ M$_{\odot}$. A comparison to the 30 Doradus-10 mass function derived previously from CO (2-1) data reveals a consistent range of clump masses and good agreement between the fitted slopes. We also find that the low mass index of the LMC mass function agrees well with the high mass index for core and clump mass functions from several star forming regions in the Milky Way. This agreement may indicate an extension of the Milky Way power law to higher masses than previously observed.


title: Locally homogeneous connections on principal bundles over hyperbolic Riemann surfaces

abstract: Let $g$ be locally homogeneous (LH) Riemannian metric on a differentiable compact manifold $M$, and $K$ be a compact Lie group endowed with an $\mathrm {ad}$-invariant inner product on its Lie algebra $\mathfrak{k}$. A connection $A$ on a principal $K$-bundle $p:P\to M$ on $M$ is locally homogeneous if for any two points $x_1$, $x_2\in M$ there exists an isometry $\varphi:U_1\to U_2$ between open neighborhoods $U_i\ni x_i$ which sends $x_1$ to $x_2$ and admits a $\varphi$-covering bundle isomorphism preserving the connection $A$. This condition is invariant under the action of the automorphism group (gauge group) of the bundle, so the classification problem for LH connections leads to an interesting moduli problem: for fixed objects $(M,g,K)$ as above describe geometrically the moduli space of all LH connections on principal $K$-bundles on $M$ (up to bundle isomorphisms). Note that if $A$ is LH, then the associated connection metric $g_A$ on $P$ is locally homogenous, so it defines a geometric structure (in the sense of Thurston) on the total space of the bundle. Therefore this moduli problem is related to the classification of LH (geometric) Riemannian manifolds which admit a Riemannian submersion onto the given manifold $M$. Omitting the details, our moduli problem concerns the classification of geometric fibre bundles over a given geometric base. We develop a general method for describing moduli spaces of LH connections on a given base. Using our method we give explicit descriptions of these moduli spaces when the base manifold is a hyperbolic Riemann surface $(M,g)$ and $K\in\{S^1,PU(2)\}$. The case $K=S^1$ leads to a new construction of the moduli spaces of Yang-Mills $S^1$-connections on hyperbolic Riemann surfaces, and the case $K=PU(2)$ leads to a one-parameter family of compact, 5-dimensional geometric manifolds, which we study in detail.


title: A Smart System for Selection of Optimal Product Images in E-Commerce

abstract: In e-commerce, content quality of the product catalog plays a key role in delivering a satisfactory experience to the customers. In particular, visual content such as product images influences customers' engagement and purchase decisions. With the rapid growth of e-commerce and the advent of artificial intelligence, traditional content management systems are giving way to automated scalable systems. In this paper, we present a machine learning driven visual content management system for extremely large e-commerce catalogs. For a given product, the system aggregates images from various suppliers, understands and analyzes them to produce a superior image set with optimal image count and quality, and arranges them in an order tailored to the demands of the customers. The system makes use of an array of technologies, ranging from deep learning to traditional computer vision, at different stages of analysis. In this paper, we outline how the system works and discuss the unique challenges related to applying machine learning techniques to real-world data from e-commerce domain. We emphasize how we tune state-of-the-art image classification techniques to develop solutions custom made for a massive, diverse, and constantly evolving product catalog. We also provide the details of how we measure the system's impact on various customer engagement metrics.


title: The Topology of Mobility-Gapped Insulators

abstract: Studying deterministic operators, we define an appropriate topology on the space of mobility-gapped insulators such that topological invariants are continuous maps into discrete spaces, we prove that this is indeed the case for the integer quantum Hall effect, and lastly we show why our "insulator" condition makes sense from the point of view of the localization theory using the fractional moments method.


title: Generating a Training Dataset for Land Cover Classification to Advance Global Development

abstract: Semantic segmentation of land cover classes is fundamental for agricultural and economic development work, from sustainable forestry to urban planning, yet existing training datasets have significant limitations. To generate an open and comprehensive training library of high resolution Earth imagery and high quality land cover classifications, public Sentinel-2 data at 10 m spatial resolution was matched with accurate GlobeLand30 labels from 2010, which were filtered by agreement with an intermediary Sentinel-2 classification at 20 m produced during atmospheric correction. Scene-level classifications were predicted by Random Forests trained on valid reflectance data and the filtered labels, and achieved over 80% model accuracy for a variety of locations. Further work is required to aggregate individual scene classifications for annual labels and to test the approach in more locations, before crowdsourcing human validation. The goal is to create a sustained community-wide effort to generate image labels not only for land cover, but also very specific images for major agriculture crops across the world and other thematic categories of interest to the global development community.


title: Synthetic Lung Nodule 3D Image Generation Using Autoencoders

abstract: One of the challenges of using machine learning techniques with medical data is the frequent dearth of source image data on which to train. A representative example is automated lung cancer diagnosis, where nodule images need to be classified as suspicious or benign. In this work we propose an automatic synthetic lung nodule image generator. Our 3D shape generator is designed to augment the variety of 3D images. Our proposed system takes root in autoencoder techniques, and we provide extensive experimental characterization that demonstrates its ability to produce quality synthetic images.


title: Monotonicity Under Local Operations: Linear Entropic Formulas

abstract: All correlation measures, classical and quantum, must be monotonic under local operations. In this paper, we characterize monotonic formulas that are linear combinations of the von Neumann entropies associated with the quantum state of a physical system that has n parts. We show that these formulas form a polyhedral convex cone, which we call the monotonicity cone, and enumerate its facets. We illustrate its structure and prove that it is equivalent to the cone of monotonic formulas implied by strong subadditivity. We explicitly compute its extremal rays for n up to 5. We also consider the symmetric monotonicity cone, in which the formulas are required to be invariant under subsystem permutations. We describe this cone fully for all n. In addition, we show that these results hold even when states and operations are constrained to be classical.


title: Algebraic properties of expectation semirings

abstract: In this paper, we investigate the algebraic properties of the expectation semirings which are semiring version of the concept of trivial extension in ring theory. We discuss ideals, primes, maximals and primary ideals of these semirings. We also discuss the distinguished elements such as the units, idempotents, and zero-divisors of the expectations semirings. Similar to their counterparts in ring theory, we introduce pr\'{e}simplifiable, domainlike, clean, almost clean, and weakly clean semiring and see when an expectation semiring is one of these semirings.


title: DM+$b\bar b$ simulations with DMSimp: an update

abstract: Searches for dark matter (DM) produced using collider data probe wide regions of the allowed parameter space of many models and have become competitive with more traditional searches. The interpretations of the results can be efficiently performed in simplified models, which feature only a mediator and a DM candidate together with the interactions among them and the standard model particles. The DMSimp model in FeynRules currently features a wide set of $s$-channel simplified models and can be exploited by the MadGraph5_aMC@NLO framework to produce event samples including NLO QCD corrections for realistic simulations. Higher-order corrections typically have a sizeable impact on the total production rate and lead to a reduction of the theoretical uncertainties. In this short note we report on a recent update of the DMSimp model, which makes it possible to simulate dark matter production in association with bottom quarks in a mixed four-flavour scheme, where the $\overline{\rm MS}$ renormalisation for the bottom-quark Yukawa is employed, while the bottom quark mass is on shell. By comparing with five-flavour scheme, we show that the mixed four-flavor scheme provides reliable predictions for DM+$b\bar b$ final states in a wide range of DM masses.


title: Magnetic structure and magnetization of z-axis helical Heisenberg antiferromagnets with XY anisotropy in high magnetic fields transverse to the helix axis at zero temperature

abstract: A helix has a wavevector along the z axis with the magnetic moments ferromagnetically-aligned within xy planes with a turn angle kd between the moments in adjacent planes in transverse field Hx = 0. The magnetic structure and x-axis average magnetization per spin of this system in a classical XY anisotropy field HA is studied versus kd, HA, and large Hx at zero temperature. For values of HA below a kd-dependent maximum value, the xy helix phase transitions with increasing Hx into a spin-flop (SF) phase where the ordered moments have x, y, and z components. The moments in the SF phase are taken to be distributed on either one or two xyz spherical ellipses. The minor axes of the ellipses are oriented along the z axis and the major axes along the y axis where the ellipses are flattened along the z axis due to the presence of the XY anisotropy. From energy minimization of the SF spherical ellipse parameters for given values of kd, HA and Hx, four kd-dependent SF phases are found: either one or two xyz spherical ellipses and either one or two xy fans, in addition to the xy helix phase and the paramagnetic (PM) phase with all moments aligned along Hx. The PM phase occurs via second-order transitions from the xy fan and SF phases with increasing Hx. Phase diagrams in the Hx-HA plane are constructed by energy minimization with respect to the SF phases, the xy helix phase, and the xy fan phase for four kd values. One of these four phase diagrams is compared with the magnetic properties found experimentally for the model helical Heisenberg antiferromagnet EuCo2P2 and semiquantitative agreement is found.


title: Photorealistic Facial Synthesis in the Dimensional Affect Space

abstract: This paper presents a novel approach for synthesizing facial affect, which is based on our annotating 600,000 frames of the 4DFAB database in terms of valence and arousal. The input of this approach is a pair of these emotional state descriptors and a neutral 2D image of a person to whom the corresponding affect will be synthesized. Given this target pair, a set of 3D facial meshes is selected, which is used to build a blendshape model and generate the new facial affect. To synthesize the affect on the 2D neutral image, 3DMM fitting is performed and the reconstructed face is deformed to generate the target facial expressions. Last, the new face is rendered into the original image. Both qualitative and quantitative experimental studies illustrate the generation of realistic images, when the neutral image is sampled from a variety of well known databases, such as the Aff-Wild, AFEW, Multi-PIE, AFEW-VA, BU-3DFE, Bosphorus.


title: Implicit High-Order Gas Kinetic Scheme for Turbulence Simulation

abstract: In recent years, coupled with traditional turbulence models, the second-order gas-kinetic scheme (GKS) has been used in the turbulent flow simulations. At the same time, high-order GKS has been developed, such as the two-stage fourth-order scheme (S2O4) GKS, and used for laminar flow calculations. In this paper, targeting on the high-Reynolds number engineering turbulent flows, an implicit high-order GKS with Lower-Upper Symmetric Gauss-Seidel (LU-SGS) technique is developed under the S2O4 framework. Based on Vreman-type LES model and $k - \omega$ SST model, a turbulent relaxation time is obtained and used for an enlarged particle collision time in the implicit high-order GKS for the high-Reynolds number turbulent flows. Numerical experiments include incompressible decaying homogeneous isotropic turbulence, incompressible high-Reynolds number flat plate turbulent flow, incompressible turbulence around NACA0012 airfoil, transonic turbulence around RAE2822 airfoil, and transonic high-Reynolds number ARA M100 wing-body turbulence. Comparisons among the numerical solutions from current implicit high-order GKS, the explicit high-order GKS, the implicit second-order GKS, and experimental measurements have been conducted. Through these examples, it is concluded that the high-order GKS has high accuracy in space and time, especially for smooth flows, obtaining more accurate turbulent flow fields on coarse grids compared with second-order GKS. In addition, significant acceleration on computational efficiency, as well as super robustness in simulating complex flows are confirmed for current implicit high-order GKS. This study also indicates that turbulence modeling plays a dominant role in the capturing physical solution, such as in the transonic three-dimensional complex RANS simulation, in comparison with numerical discretization errors.


title: Non-invasive thermal comfort perception based on subtleness magnification and deep learning for energy efficiency

abstract: Human thermal comfort measurement plays a critical role in giving feedback signals for building energy efficiency. A non-invasive measuring method based on subtleness magnification and deep learning (NIDL) was designed to achieve a comfortable, energy efficient built environment. The method relies on skin feature data, e.g., subtle motion and texture variation, and a 315-layer deep neural network for constructing the relationship between skin features and skin temperature. A physiological experiment was conducted for collecting feature data (1.44 million) and algorithm validation. The non-invasive measurement algorithm based on a partly-personalized saturation temperature model (NIPST) was used for algorithm performance comparisons. The results show that the mean error and median error of the NIDL are 0.4834 Celsius and 0.3464 Celsius which is equivalent to accuracy improvements of 16.28% and 4.28%, respectively.


title: Quantum insights on Primordial Black Holes as Dark Matter

abstract: A recent understanding on how quantum effects may affect black-hole evolution opens new scenarios for dark matter, in connection with the presence of black holes in the very early universe. Quantum fluctuations of the geometry allow for black holes to decay into white holes via a tunnelling. This process yields to an explosion and possibly to a long remnant phase, that cures the information paradox. Primordial black holes undergoing this evolution constitute a peculiar kind of decaying dark matter, whose lifetime depends on their mass $M$ and can be as short as $M^2$. As smaller black holes explode earlier, the resulting signal have a peculiar fluence-distance relation. I discuss the different emission channels that can be expected from the explosion (sub-millimetre, radio, TeV) and their detection challenges. In particular, one of these channels produces an observed wavelength that scales with the redshift following a unique flattened wavelength-distance function, leaving a signature also in the resulting diffuse emission. I conclude presenting the first insights on the cosmological constraints, concerning both the explosive phase and the subsequent remnant phase.


title: End-to-End Retrieval in Continuous Space

abstract: Most text-based information retrieval (IR) systems index objects by words or phrases. These discrete systems have been augmented by models that use embeddings to measure similarity in continuous space. But continuous-space models are typically used just to re-rank the top candidates. We consider the problem of end-to-end continuous retrieval, where standard approximate nearest neighbor (ANN) search replaces the usual discrete inverted index, and rely entirely on distances between learned embeddings. By training simple models specifically for retrieval, with an appropriate model architecture, we improve on a discrete baseline by 8% and 26% (MAP) on two similar-question retrieval tasks. We also discuss the problem of evaluation for retrieval systems, and show how to modify existing pairwise similarity datasets for this purpose.


title: Scalable Logo Recognition using Proxies

abstract: Logo recognition is the task of identifying and classifying logos. Logo recognition is a challenging problem as there is no clear definition of a logo and there are huge variations of logos, brands and re-training to cover every variation is impractical. In this paper, we formulate logo recognition as a few-shot object detection problem. The two main components in our pipeline are universal logo detector and few-shot logo recognizer. The universal logo detector is a class-agnostic deep object detector network which tries to learn the characteristics of what makes a logo. It predicts bounding boxes on likely logo regions. These logo regions are then classified by logo recognizer using nearest neighbor search, trained by triplet loss using proxies. We also annotated a first of its kind product logo dataset containing 2000 logos from 295K images collected from Amazon called PL2K. Our pipeline achieves 97% recall with 0.6 mAP on PL2K test dataset and state-of-the-art 0.565 mAP on the publicly available FlickrLogos-32 test set without fine-tuning.


title: Stackelberg GAN: Towards Provable Minimax Equilibrium via Multi-Generator Architectures

abstract: We study the problem of alleviating the instability issue in the GAN training procedure via new architecture design. The discrepancy between the minimax and maximin objective values could serve as a proxy for the difficulties that the alternating gradient descent encounters in the optimization of GANs. In this work, we give new results on the benefits of multi-generator architecture of GANs. We show that the minimax gap shrinks to $\epsilon$ as the number of generators increases with rate $\widetilde{O}(1/\epsilon)$. This improves over the best-known result of $\widetilde{O}(1/\epsilon^2)$. At the core of our techniques is a novel application of Shapley-Folkman lemma to the generic minimax problem, where in the literature the technique was only known to work when the objective function is restricted to the Lagrangian function of a constraint optimization problem. Our proposed Stackelberg GAN performs well experimentally in both synthetic and real-world datasets, improving Fr\'echet Inception Distance by $14.61\%$ over the previous multi-generator GANs on the benchmark datasets.


title: Explain to Fix: A Framework to Interpret and Correct DNN Object Detector Predictions

abstract: Explaining predictions of deep neural networks (DNNs) is an important and nontrivial task. In this paper, we propose a practical approach to interpret decisions made by a DNN object detector that has fidelity comparable to state-of-the-art methods and sufficient computational efficiency to process large datasets. Our method relies on recent theory and approximates Shapley feature importance values. We qualitatively and quantitatively show that the proposed explanation method can be used to find image features which cause failures in DNN object detection. The developed software tool combined into the "Explain to Fix" (E2X) framework has a factor of 10 higher computational efficiency than prior methods and can be used for cluster processing using graphics processing units (GPUs). Lastly, we propose a potential extension of the E2X framework where the discovered missing features can be added into training dataset to overcome failures after model retraining.


title: A Comparative Study of Computational Aesthetics

abstract: Objective metrics model image quality by quantifying image degradations or estimating perceived image quality. However, image quality metrics do not model what makes an image more appealing or beautiful. In order to quantify the aesthetics of an image, we need to take it one step further and model the perception of aesthetics. In this paper, we examine computational aesthetics models that use hand-crafted, generic and hybrid descriptors. We show that generic descriptors can perform as well as state of the art hand-crafted aesthetics models that use global features. However, neither generic nor hand-crafted features is sufficient to model aesthetics when we only use global features without considering spatial composition or distribution. We also follow a visual dictionary approach similar to state of the art methods and show that it performs poorly without the spatial pyramid step.


title: Markov-Induced CM Model

abstract: Conditionally Markov (CM) sequences are powerful mathematical tools for modeling random phenomena. There are several classes of CM sequences one of which is the reciprocal sequence. Reciprocal sequences have been widely used in many areas including image processing, intelligent systems, and acausal systems. To use them in application, we need not only their applicable dynamic models, but also some general approaches to designing parameters of dynamic models. Dynamic models governing two important classes of nonsingular Gaussian (NG) CM sequences (called $CM_L$ and $CM_F$ models), and a dynamic model governing the NG reciprocal sequence (called reciprocal $CM_L$ model) were presented in our previous work. In this paper, these models are studied in more detail and general approaches are presented for their parameter design. It is shown that every reciprocal $CM_L$ model can be induced by a Markov model and parameters of the reciprocal $CM_L$ model can be obtained from those of the Markov model. Also, it is shown how NG CM sequences can be represented in terms of an NG Markov sequence and an independent NG vector. This representation provides a general approach for parameter design of $CM_L$ and $CM_F$ models. In addition, it leads to a better understanding of CM sequences, including the reciprocal sequence.


title: Devissage and Localization for the Grothendieck Spectrum of Varieties

abstract: We introduce a new perspective on the $K$-theory of exact categories via the notion of a CGW-category. CGW-categories are a generalization of exact categories that admit a Qullen $Q$-construction, but which also include examples such as finite sets and varieties. By analyzing Quillen's proofs of d\'evissage and localization we define ACGW-categories, an analogous generalization of abelian categories for which we prove theorems analogous to d\'evissage and localization. In particular, although the category of varieties is not quite ACGW, the category of reduced schemes of finite type is; applying d\'evissage and localization allows us to calculate a filtration on the $K$-theory of schemes of finite type. As an application of this theory we construct a comparison map showing that the two authors' definitions of the Grothendieck spectrum of varieties are equivalent.


title: Visual Font Pairing

abstract: This paper introduces the problem of automatic font pairing. Font pairing is an important design task that is difficult for novices. Given a font selection for one part of a document (e.g., header), our goal is to recommend a font to be used in another part (e.g., body) such that the two fonts used together look visually pleasing. There are three main challenges in font pairing. First, this is a fine-grained problem, in which the subtle distinctions between fonts may be important. Second, rules and conventions of font pairing given by human experts are difficult to formalize. Third, font pairing is an asymmetric problem in that the roles played by header and body fonts are not interchangeable. To address these challenges, we propose automatic font pairing through learning visual relationships from large-scale human-generated font pairs. We introduce a new database for font pairing constructed from millions of PDF documents available on the Internet. We propose two font pairing algorithms: dual-space k-NN and asymmetric similarity metric learning (ASML). These two methods automatically learn fine-grained relationships from large-scale data. We also investigate several baseline methods based on the rules from professional designers. Experiments and user studies demonstrate the effectiveness of our proposed dataset and methods.


title: Interfacial energy as a selection mechanism for minimizing gradient Young measures in a one-dimensional model problem

abstract: Energy functionals describing phase transitions in crystalline solids are often non-quasiconvex and minimizers might therefore not exist. On the other hand, there might be infinitely many gradient Young measures, modelling microstructures, generated by minimizing sequences, and it is an open problem how to select the physical ones. In this work we consider the problem of selecting minimizing sequences for a one-dimensional three-well problem $\mathcal{E}$. We introduce a regularization $\mathcal{E}^\varepsilon$ of $\mathcal{E}$ with an $\varepsilon$-small penalization of the second derivatives, and we obtain as $\varepsilon\downarrow 0$ its $\Gamma-$limit and, under some further assumptions, the $\Gamma-$limit of a suitably rescaled version of $\mathcal{E}^\varepsilon$. The latter selects a unique minimizing gradient Young measure of the former, which is supported just in two wells and not in three. We then show that some assumptions are necessary to derive the $\Gamma-$limit of the rescaled functional, but not to prove that minimizers of $\mathcal{E}^\varepsilon$ generate, as $\varepsilon\downarrow 0$, Young measures supported just in two wells and not in three.


title: A random compiler for fast Hamiltonian simulation

abstract: The dynamics of a quantum system can be simulated using a quantum computer by breaking down the unitary into a quantum circuit of one and two qubit gates. The most established methods are the Trotter-Suzuki decompositions, for which rigorous bounds on the circuit size depend on the number of terms $L$ in the system Hamiltonian and the size of the largest term in the Hamiltonian $\Lambda$. Consequently, Trotter-Suzuki is only practical for sparse Hamiltonians. Trotter-Suzuki is a deterministic compiler but it was recently shown that randomised compiling offers lower overheads. Here we present and analyse a randomised compiler for Hamiltonian simulation where gate probabilities are proportional to the strength of a corresponding term in the Hamiltonian. This approach requires a circuit size independent of $L$ and $\Lambda$, but instead depending on $\lambda$ the absolute sum of Hamiltonian strengths (the $\ell_1$ norm). Therefore, it is especially suited to electronic structure Hamiltonians relevant to quantum chemistry. Considering propane, carbon dioxide and ethane, we observe speed-ups compared to standard Trotter-Suzuki of between $306\times$ and $1591\times$ for physically significant simulation times at precision $10^{-3}$. Performing phase estimation at chemical accuracy, we report that the savings are similar.


title: General modeling framework for quantum photodetectors

abstract: Photodetection plays a key role in basic science and technology, with exquisite performance having been achieved down to the single photon level. Further improvements in photodetectors would open new possibilities across a broad range of scientific disciplines, and enable new types of applications. However, it is still unclear what is possible in terms of ultimate performance, and what properties are needed for a photodetector to achieve such performance. Here, we present a general modeling framework for photodetectors whereby the photon field, the absorption process, and the amplification process are all treated as one coupled quantum system. The formalism naturally handles field states with single or multiple photons as well as a variety of detector configurations, and includes a mathematical definition of ideal photodetector performance. The framework reveals how specific photodetector architectures introduce limitations and tradeoffs for various performance metrics, providing guidance for optimization and design.


title: Role action embeddings: scalable representation of network positions

abstract: We consider the question of embedding nodes with similar local neighborhoods together in embedding space, commonly referred to as "role embeddings." We propose RAE, an unsupervised framework that learns role embeddings. It combines a within-node loss function and a graph neural network (GNN) architecture to place nodes with similar local neighborhoods close in embedding space. We also propose a faster way of generating negative examples called neighbor shuffling, which quickly creates negative examples directly within batches. These techniques can be easily combined with existing GNN methods to create unsupervised role embeddings at scale. We then explore role action embeddings, which summarize the non-structural features in a node's neighborhood, leading to better performance on node classification tasks. We find that the model architecture proposed here provides strong performance on both graph and node classification tasks, in some cases competitive with semi-supervised methods.


title: Thermodynamic limits to energy conversion in solar thermal fuels

abstract: Solar thermal fuels (STFs) are an unconventional paradigm for solar energy conversion and storage which is attracting renewed attention. In this concept, a material absorbs sunlight and stores the energy chemically via an induced structural change, which can later be reversed to release the energy as heat. An example is the azobenzene molecule which has a cis-trans photoisomerization with these properties, and can be tuned by chemical substitution and attachment to templates such as carbon nanotubes, small molecules, or polymers. By analogy to the Shockley-Queisser limit for photovoltaics, we analyze the maximum attainable efficiency for STFs from fundamental thermodynamic considerations. Microscopic reversibility provides a bound on the quantum yield of photoisomerization due to fluorescence, regardless of details of photochemistry. We emphasize the importance of analyzing the free energy, not just enthalpy, of the metastable molecules, and find an efficiency limit for conversion to stored chemical energy equal to the Shockley-Queisser limit. STF candidates from a recent high-throughput search are analyzed in light of the efficiency limit.


title: CM Sequence based Trajectory Modeling with Destination

abstract: In some problems there is information about the destination of a moving object. An example is an airliner flying from an origin to a destination. Such problems have three main components: an origin, a destination, and motion in between. To emphasize that the motion trajectories end up at the destination, we call them \textit{destination-directed trajectories}. The Markov sequence is not flexible enough to model such trajectories. Given an initial density and an evolution law, the future of a Markov sequence is determined probabilistically. One class of conditionally Markov (CM) sequences, called the $CM_L$ sequence (including the Markov sequence as a special case), has the following main components: a joint endpoint density (i.e., an initial density and a final density conditioned on the initial) and a Markov-like evolution law. This paper proposes using the $CM_L$ sequence for modeling destination-directed trajectories. It is demonstrated how the $CM_L$ sequence enjoys several desirable properties for destination-directed trajectory modeling. Some simulations of trajectory modeling and prediction are presented for illustration.


title: Low-Scaling Algorithm for Nudged Elastic Band Calculations Using a Surrogate Machine Learning Model

abstract: We present the incorporation of a surrogate Gaussian Process Regression (GPR) atomistic model to greatly accelerate the rate of convergence of classical Nudged Elastic Band (NEB) calculations. In our surrogate model approach, the cost of converging the elastic band no longer scales with the number of moving images on the path. This provides a far more efficient and robust transition state search. In contrast to a conventional NEB calculation, the algorithm presented here eliminates any need for manipulating the number of images to obtain a converged result. This is achieved by inventing a new convergence criteria that exploits the probabilistic nature of the GPR to use uncertainty estimates of all images in combination with the force of the transition state in the analytic potential. Our method is an order of magnitude faster in terms of function evaluations than the conventional NEB method with no accuracy loss for the converged energy barrier values.


title: On the photometric detection of Internal Gravity Waves in upper main-sequence stars I. Methodology and application to CoRoT targets

abstract: Context. Main sequence stars with a convective core are predicted to stochastically excite Internal Gravity Waves (IGWs), which effectively transport angular momentum throughout the stellar interior and explain the observed near-uniform interior rotation rates of intermediate-mass stars. However, there are few detections of IGWs, and fewer still made using photometry, with more detections needed to constrain numerical simulations. Aims. We aim to formalise the detection and characterisation of IGWs in photometric observations of stars born with convective cores (M > 1.5 M$_{\odot}$) and parameterise the low-frequency power excess caused by IGWs. Methods. Using the most recent CoRoT light curves for a sample of O, B, A and F stars, we parameterise the morphology of the flux contribution of IGWs in Fourier space using an MCMC numerical scheme within a Bayesian framework. We compare this to predictions from IGW numerical simulations and investigate how the observed morphology changes as a function of stellar parameters. Results. We demonstrate that a common morphology for the low-frequency power excess is observed in early-type stars observed by CoRoT. Our study shows that a background frequency-dependent source of astrophysical signal is common, which we interpret as IGWs. We provide constraints on the amplitudes of IGWs and the shape of their detected frequency spectrum across a range of mass, which is the first ensemble study of stochastic variability in such a diverse sample of stars. Conclusions. The evidence of a low-frequency power excess across a wide mass range supports the interpretation of IGWs in photometry of O, B, A and F stars. We also discuss the prospects of observing hundreds of massive stars with the Transiting Exoplanet Survey Satellite (TESS) in the near future.


title: On the stability of solitary water waves with a point vortex

abstract: This paper investigates the stability of traveling wave solutions to the free boundary Euler equations with a submerged point vortex. We prove that sufficiently small-amplitude waves with small enough vortex strength are conditionally orbitally stable. In the process of obtaining this result, we develop a quite general stability/instability theory for bound state solutions of a large class of infinite-dimensional Hamiltonian systems in the presence of symmetry. This is in the spirit of the seminal work of Grillakis, Shatah, and Strauss, but with hypotheses that are relaxed in a number of ways necessary for the point vortex system, and for other hydrodynamical applications more broadly. In particular, we are able to allow the Poisson map to have merely dense range, as opposed to being surjective, and to be state-dependent. As a second application of the general theory, we consider a family of nonlinear dispersive PDEs that includes the generalized KdV and Benjamin--Ono equations. The stability/instability of solitary waves for these systems has been studied extensively, notably by Bona, Souganidis, and Strauss, who used a modification of the GSS method. We provide a new, more direct proof of these results that follows as a straightforward consequence of our abstract theory. At the same time, we extend them to fractional order dispersive equations.


title: Some Numerical radius inequalities

abstract: In this work, a pre-Gr\"{u}ss inequality for positive Hilbert space operators is proved. So that, some numerical radius inequalities are proved. On the other hand, based on a non-commutative Binomial formula, a non-commutative upper bound for the numerical radius of the summand of two bounded linear Hilbert space operators is proved. A commutative version is also obtained as well.


title: Simulating single-coil MRI from the responses of multiple coils

abstract: We convert the information-rich measurements of parallel and phased-array MRI into noisier data that a corresponding single-coil scanner could have taken. Specifically, we replace the responses from multiple receivers with a linear combination that emulates the response from only a single, aggregate receiver, replete with the low signal-to-noise ratio and phase problems of any single one of the original receivers (combining several receivers is necessary, however, since the original receivers usually have limited spatial sensitivity). This enables experimentation in the simpler context of a single-coil scanner prior to development of algorithms for the full complexity of multiple receiver coils.


title: Neural Lander: Stable Drone Landing Control using Learned Dynamics

abstract: Precise near-ground trajectory control is difficult for multi-rotor drones, due to the complex aerodynamic effects caused by interactions between multi-rotor airflow and the environment. Conventional control methods often fail to properly account for these complex effects and fall short in accomplishing smooth landing. In this paper, we present a novel deep-learning-based robust nonlinear controller (Neural Lander) that improves control performance of a quadrotor during landing. Our approach combines a nominal dynamics model with a Deep Neural Network (DNN) that learns high-order interactions. We apply spectral normalization (SN) to constrain the Lipschitz constant of the DNN. Leveraging this Lipschitz property, we design a nonlinear feedback linearization controller using the learned model and prove system stability with disturbance rejection. To the best of our knowledge, this is the first DNN-based nonlinear feedback controller with stability guarantees that can utilize arbitrarily large neural nets. Experimental results demonstrate that the proposed controller significantly outperforms a Baseline Nonlinear Tracking Controller in both landing and cross-table trajectory tracking cases. We also empirically show that the DNN generalizes well to unseen data outside the training domain.


title: Evidence for the decays of $\Lambda^+_{c}\to\Sigma^+\eta$ and $\Sigma^+\eta^\prime$

abstract: We study the hadronic decays of $\Lambda_{c}^{+}$ to the final states $\Sigma^{+}\eta$ and $\Sigma^+\eta^\prime$, using an $e^{+}e^{-}$ annihilation data sample of 567 pb$^{-1}$ taken at a center-of-mass energy of 4.6 GeV with the BESIII detector at the BEPCII collider. We find evidence for the decays $\Lambda_{c}^{+}\rightarrow\Sigma^{+}\eta$ and $\Sigma^+\eta^\prime$ with statistical significance of $2.5\sigma$ and $3.2\sigma$, respectively. Normalizing to the reference decays $\Lambda_c^+\to\Sigma^+\pi^0$ and $\Sigma^+\omega$, we obtain the ratios of the branching fractions $\frac{{\mathcal B}(\Lambda_c^+\to\Sigma^+\eta)}{{\mathcal B}(\Lambda_c^+\to\Sigma^+\pi^0)}$ and $\frac{{\mathcal B}(\Lambda_c^+\to\Sigma^+\eta^\prime)}{{\mathcal B}(\Lambda_c^+\to\Sigma^+\omega)}$ to be $0.35 \pm 0.16 \pm 0.03$ and $0.86 \pm 0.34 \pm 0.07$, respectively. The upper limits at the 90\% confidence level are set to be $\frac{{\mathcal B}(\Lambda_c^+\to\Sigma^+\eta)}{{\mathcal B}(\Lambda_c^+\to\Sigma^+\pi^0)}<0.58$ and $\frac{{\mathcal B}(\Lambda_c^+\to\Sigma^+\eta^\prime)}{{\mathcal B}(\Lambda_c^+\to\Sigma^+\omega)}<1.2$. Using BESIII measurements of the branching fractions of the reference decays, we determine $\mathcal B({\Lambda_{c}^{+}\rightarrow\Sigma^{+}\eta})=(0.41\pm0.19\pm0.05)\%$ ($<0.68\%$) and $\mathcal B({\Lambda_{c}^{+}\rightarrow\Sigma^{+}\eta'})=(1.34\pm0.53\pm0.21)\%$ ($<1.9\%$). Here, the first uncertainties are statistical and the second systematic. The obtained branching fraction of $\Lambda_c^+\to\Sigma^+\eta$ is consistent with the previous measurement, and the branching fraction of $\Lambda_{c}^{+}\rightarrow\Sigma^{+}\eta^{\prime}$ is measured for the first time.


title: Sound-Stream II: Towards Real-Time Gesture Controlled Articulatory Sound Synthesis

abstract: We present an interface involving four degrees-of-freedom (DOF) mechanical control of a two dimensional, mid-sagittal tongue through a biomechanical toolkit called ArtiSynth and a sound synthesis engine called JASS towards articulatory sound synthesis. As a demonstration of the project, the user will learn to produce a range of JASS vocal sounds, by varying the shape and position of the ArtiSynth tongue in 2D space through a set of four force-based sensors. In other words, the user will be able to physically play around with these four sensors, thereby virtually controlling the magnitude of four selected muscle excitations of the tongue to vary articulatory structure. This variation is computed in terms of Area Functions in ArtiSynth environment and communicated to the JASS based audio-synthesizer coupled with two-mass glottal excitation model to complete this end-to-end gesture-to-sound mapping.


title: Descartes Circle Theorem, Steiner Porism, and Spherical Designs

abstract: A Steiner chain of length k consists of k circles, tangent to two given non-intersecting circles (the parent circles) and tangent to each other in a cyclic pattern. The Steiner porism states that once a chain of k circles exists, there exists a 1-parameter family of such chains with the same parent circles that can be constructed starting with any initial circle, tangent to the parent circles. What do the circles in these 1-parameter family of Steiner chains of length k have in common? We prove that the first k-1 moments of their curvatures remain constant within a 1-parameter family. For k=3, this follows from the Descartes Circle Theorem. We extend our result to Steiner chains in the spherical and hyperbolic geometries and present a related more general theorem involving spherical designs.


title: Combinatorial modifications of Reeb graphs and the realization problem

abstract: We prove that, up to homeomorphism, any graph subject to natural necessary conditions on orientation and the cycle rank can be realized as the Reeb graph of a Morse function on a given closed manifold $M$. Along the way, we show that the Reeb number $\mathcal{R}(M)$, i.e. the maximum cycle rank among all Reeb graphs of functions on $M$, is equal to the corank of fundamental group $\pi_1(M)$, thus extending a previous result of Gelbukh to the non-orientable case.


title: See far with TPNET: a Tile Processor and a CNN Symbiosis

abstract: Throughout the evolution of the neural networks more specialized cells were added to the set of basic building blocks. These cells aim to improve training convergence, increase the overall performance, and reduce the number of required labels, all while preserving the expressive power of the universal network. Inspired by the partitioning of the human visual perception system between the eyes and the cerebral cortex, we present TPNET, which offloads universal and application-specific CNN from the bulk processing of the high resolution pixel data and performs the translation-variant image correction while delegating all non-linear decision making to the network. In this work, we explore application of TPNET to 3D perception with a narrow-baseline (0.0001-0.0025) quad stereo camera and prove that a trained network provides a disparity prediction from the 2D phase correlation output by the Tile Processor (TP) that is twice as accurate as the prediction from a carefully hand-crafted algorithm. The TP in turn reduces the dimensions of the input features of the network and provides instrument-invariant and translation-invariant data, making real-time high resolution stereo 3D perception feasible and easing the requirement to have a complete end-to-end network.


title: Tracking Control by the Newton-Raphson Flow: Applications to Autonomous Vehicles

abstract: This paper concerns applications of a recently-developed output-tracking technique to trajectory control of autonomous vehicles. The technique is based on three principles: Newton-Raphson flow for solving algebraic equations,output prediction, and controller speedup. Early applications of the technique, made to simple systems of an academic nature,were implemented by simple algorithms requiring modest computational efforts. In contrast, this paper tests it on commonly-used dynamic models to see if it can handle more complex control scenarios. Results are derived from simulations as well as a laboratory setting, and they indicate effective tracking convergence despite the simplicity of the control algorithm.


title: Predicting the Sparticle Spectrum from Partially-Composite Supersymmetry

abstract: We use the idea of partial compositeness in a minimal supersymmetric model to relate the fermion and sfermion masses. By assuming that the Higgs and third-generation matter is (mostly) elementary, while the first- and second-generation matter is (mostly) composite, the Yukawa coupling hierarchy can be explained by a linear mixing between elementary states and composite operators with large anomalous dimensions. If the composite sector also breaks supersymmetry, then composite sfermions such as selectrons are predicted to be much heavier than the lighter elementary stops. This inverted sfermion mass hierarchy is consistent with current experimental limits that prefer light stops ($\mathcal{O}(10)$ TeV) to accommodate the 125 GeV Higgs boson, while predicting heavy first- and second-generation sfermions (${\gtrsim 100}$ TeV) as indicated by flavor physics experiments. The underlying dynamics can be modelled by a dual 5D gravity theory that also predicts a gravitino dark matter candidate ($\gtrsim$ keV), together with gauginos and Higgsinos, ranging from 10-90 TeV, that are split from the heavier first- and second-generation sfermion spectrum. This intricate connection between the fermion and sfermion mass spectrum can be tested at future experiments.


title: Simultaneous 12-Lead Electrocardiogram Synthesis using a Single-Lead ECG Signal: Application to Handheld ECG Devices

abstract: Recent introduction of wearable single-lead ECG devices of diverse configurations has caught the intrigue of the medical community. While these devices provide a highly affordable support tool for the caregivers for continuous monitoring and to detect acute conditions, such as arrhythmia, their utility for cardiac diagnostics remains limited. This is because clinical diagnosis of many cardiac pathologies is rooted in gleaning patterns from synchronous 12-lead ECG. If synchronous 12-lead signals of clinical quality can be synthesized from these single-lead devices, it can transform cardiac care by substantially reducing the costs and enhancing access to cardiac diagnostics. However, prior attempts to synthesize synchronous 12-lead ECG have not been successful. Vectorcardiography (VCG) analysis suggests that cardiac axis synthesized from earlier attempts deviates significantly from that estimated from 12-lead and/or Frank lead measurements. This work is perhaps the first successful attempt to synthesize clinically equivalent synchronous 12-lead ECG from single-lead ECG. Our method employs a random forest machine learning model that uses a subject's historical 12-lead recordings to estimate the morphology including the actual timing of various ECG events (relative to the measured single-lead ECG) for all 11 missing leads of the subject. Our method was validated on two benchmark datasets as well as paper ECG and AliveCor-Kardia data obtained from the Heart, Artery, and Vein Center of Fresno, California. Results suggest that this approach can synthesize synchronous ECG with accuracies (R2) exceeding 90%. Accurate synthesis of 12-lead ECG from a single-lead device can ultimately enable its wider application and improved point-of-care (POC) diagnostics.


title: Happel's functor and homologically well-graded Iwanaga-Gorenstein algebras

abstract: Happel constructed a fully faithful functor $\mathcal{H} :\mathsf{D}^{\mathrm{b}}(\text{mod} \ \Lambda) \to \underline{\text{mod}}^{\Bbb{Z}} \ \text{T}(\Lambda)$ for a finite dimensional algebra $\Lambda$. He also showed that this functor $\mathcal{H}$ gives an equivalence precisely when $\text{gldim } \Lambda < \infty$. Thus if $\mathcal{H}$ gives an equivalence, then it provides a canonical tilting object $\mathcal{H} (\Lambda)$ of $\underline{\text{mod}}^{\mathbb{Z}} \ \text{T}(\Lambda)$. In this paper we generalize Happel's functor $\mathcal{H}$ in the case where $\text{T}(\Lambda)$ is replaced with a finitely graded IG algebra $A$. We study when this functor is fully faithful or gives an equivalence. For this purpose we introduce the notion of homologically well-graded (hwg) IG-algebra, which can be characterized as an algebra posses a homological symmetry which, a posteriori, guarantee that the algebra is IG. We prove that hwg IG-algebras is precisely the class of finitely graded IG-algebras that Happel's functor is fully faithful. We also identify the class that Happel's functor gives an equivalence. As a consequence of our result, we see that if $\mathcal{H}$ gives an equivalence, then it provides a canonical tilting object $\mathcal{H}(T)$ of $\underline{\text{CM}}^{\Bbb{Z}} A$. For some special classes of finitely graded IG algebras, our tilting objects $\mathcal{H}(T)$ coincide with tilting object constructed in previous works.


title: Properties of collective Rabi oscillations with two Rydberg atoms

abstract: Motivated by experimental advances [e.g. A. Ga{\"e}tan {\it et.al.} Nat. Phys. 5 115 (2009)] that the collective excitation of two Rydberg atoms was observed, we provide an elaborate theoretical study for the dynamical behavior of two-atom Rabi oscillations. In the large-intermediate-detuning case, the two-photon Rabi oscillation is found to be significantly affected by the strength of the interatomic van der Waals interaction. With a careful comparison of the exact numbers and values of the oscillation frequency, we propose a new way to determine the strength of excitation blockade, well agreeing with the previous universal criterion for full, partial and none blockade regions. In the small-intermediate-detuning case we find a blockade-like effect, but the collective enhancement factor is smaller than $\sqrt{2}$ due to the quantum interference of double optical transitions involving the intermediate state. Moreover, a fast two-photon Rabi oscillation in $ns$ timescale is manifested by employing intense lasers with an intensity of $\sim$MW/cm$^2$, offering a possibility of ultrafast control of quantum dynamics with Rydberg atoms.


title: Arbitrage Opportunities in CDS Term Structure: Theory and Implications for OTC Derivatives

abstract: Absence-of-Arbitrage (AoA) is the basic assumption underpinning derivatives pricing theory. As part of the OTC derivatives market, the CDS market not only provides a vehicle for participants to hedge and speculate on the default risks of corporate and sovereign entities, it also reveals important market-implied default-risk information concerning the counterparties with which financial institutions trade, and for which these financial institutions have to calculate various valuation adjustments (collectively referred to as XVA) as part of their pricing and risk management of OTC derivatives, to account for counterparty default risks. In this study, we derive No-arbitrage conditions for CDS term structures, first in a positive interest rate environment and then in an arbitrary one. Using an extensive CDS dataset which covers the 2007-09 financial crisis, we present a catalogue of 2,416 pairs of anomalous CDS contracts which violate the above conditions. Finally, we show in an example that such anomalies in the CDS term structure can lead to persistent arbitrage profits and to nonsensical default probabilities. The paper is a first systematic study on CDS-term-structure arbitrage providing model-free AoA conditions supported by ample empirical evidence.


title: Fenchel Lifted Networks: A Lagrange Relaxation of Neural Network Training

abstract: Despite the recent successes of deep neural networks, the corresponding training problem remains highly non-convex and difficult to optimize. Classes of models have been proposed that introduce greater structure to the objective function at the cost of lifting the dimension of the problem. However, these lifted methods sometimes perform poorly compared to traditional neural networks. In this paper, we introduce a new class of lifted models, Fenchel lifted networks, that enjoy the same benefits as previous lifted models, without suffering a degradation in performance over classical networks. Our model represents activation functions as equivalent biconvex constraints and uses Lagrange Multipliers to arrive at a rigorous lower bound of the traditional neural network training problem. This model is efficiently trained using block-coordinate descent and is parallelizable across data points and/or layers. We compare our model against standard fully connected and convolutional networks and show that we are able to match or beat their performance.


title: Unsupervised Pseudo-Labeling for Extractive Summarization on Electronic Health Records

abstract: Extractive summarization is very useful for physicians to better manage and digest Electronic Health Records (EHRs). However, the training of a supervised model requires disease-specific medical background and is thus very expensive. We studied how to utilize the intrinsic correlation between multiple EHRs to generate pseudo-labels and train a supervised model with no external annotation. Experiments on real-patient data validate that our model is effective in summarizing crucial disease-specific information for patients.


title: Accuracy and precision of industrial stellar abundances

abstract: There has been an incredibly large investment in obtaining high-resolution stellar spectra for determining chemical abundances of stars. This information is crucial to answer fundamental questions in Astronomy by constraining the formation and evolution scenarios of the Milky Way as well as the stars and planets residing in it. We have just entered a new era, in which chemical abundances of FGK-type stars are being produced at industrial scales, where the observations, reduction, and analysis of the data are automatically performed by machines. Here we review the latest human efforts to assess the accuracy and precision of such industrial abundances by providing insights in the steps and uncertainties associated with the process of determining stellar abundances. To do so, we highlight key issues in the process of spectral analysis for abundance determination, with special effort in disentangling sources of uncertainties. We also provide a description of current and forthcoming spectroscopic surveys, focusing on their reported abundances and uncertainties. This allows us to identify which elements and spectral lines are best and why. Finally, we make a brief selection of main scientific questions the community is aiming to answer with abundances.


title: A monotone data augmentation algorithm for multivariate nonnormal data: with applications to controlled imputations for longitudinal trials

abstract: An efficient monotone data augmentation (MDA) algorithm is proposed for missing data imputation for incomplete multivariate nonnormal data that may contain variables of different types, and are modeled by a sequence of regression models including the linear, binary logistic, multinomial logistic, proportional odds, Poisson, negative binomial, skew-normal, skew-t regressions or a mixture of these models. The MDA algorithm is applied to the sensitivity analyses of longitudinal trials with nonignorable dropout using the controlled pattern imputations that assume the treatment effect reduces or disappears after subjects in the experimental arm discontinue the treatment. We also describe a heuristic approach to implement the controlled imputation, in which the fully conditional specification method is used to impute the intermediate missing data to create a monotone missing pattern, and the missing data after dropout are then imputed according to the assumed nonignorable mechanisms. The proposed methods are illustrated by simulation and real data analyses.


title: Recurrent Iterative Gating Networks for Semantic Segmentation

abstract: In this paper, we present an approach for Recurrent Iterative Gating called RIGNet. The core elements of RIGNet involve recurrent connections that control the flow of information in neural networks in a top-down manner, and different variants on the core structure are considered. The iterative nature of this mechanism allows for gating to spread in both spatial extent and feature space. This is revealed to be a powerful mechanism with broad compatibility with common existing networks. Analysis shows how gating interacts with different network characteristics, and we also show that more shallow networks with gating may be made to perform better than much deeper networks that do not include RIGNet modules.


title: Inchworm Monte Carlo method for open quantum systems

abstract: We investigate in this work a recently proposed diagrammatic quantum Monte Carlo method --- the inchworm Monte Carlo method --- for open quantum systems. We establish its validity rigorously based on resummation of Dyson series. Moreover, we introduce an integro-differential equation formulation for open quantum systems, which illuminates the mathematical structure of the inchworm algorithm. This new formulation leads to an improvement of the inchworm algorithm by introducing classical deterministic time-integration schemes. The numerical method is validated by applications to the spin-boson model.


title: Coupled Recurrent Models for Polyphonic Music Composition

abstract: This paper introduces a novel recurrent model for music composition that is tailored to the structure of polyphonic music. We propose an efficient new conditional probabilistic factorization of musical scores, viewing a score as a collection of concurrent, coupled sequences: i.e. voices. To model the conditional distributions, we borrow ideas from both convolutional and recurrent neural models; we argue that these ideas are natural for capturing music's pitch invariances, temporal structure, and polyphony. We train models for single-voice and multi-voice composition on 2,300 scores from the KernScores dataset.


title: Multiparameter quantum metrology with postselection measurements

abstract: We analyze simultaneous quantum estimations of multiple parameters with postselection measurements in terms of a tradeoff relation. The system, or a sensor, is characterized by a set of parameters, interacts with a measurement apparatus (MA), and then is postselected onto a set of orthonormal final states. Measurements of the MA yield an estimation of the parameters. We first derive classical and quantum Cram\'er-Rao lower bounds and then discuss their archivable condition and the tradeoffs in the postselection measurements in general, including the case when a sensor is in mixed state. Its whole information can, in principle, be obtained via the MA which is not possible without postselection. We, then, apply the framework to simultaneous measurements of phase and its fluctuation as an example.


title: Optimizing System Quality of Service through Rejuvenation for Long-Running Applications with Real-Time Constraints

abstract: Reliability, longevity, availability, and deadline guarantees are the four most important metrics to measure the QoS of long-running safety-critical real-time applications. Software aging is one of the major factors that impact the safety of long-running real-time applications as the degraded performance and increased failure rate caused by software aging can lead to deadline missing and catastrophic consequences. Software rejuvenation is one of the most commonly used approaches to handle issues caused by software aging. In this paper, we study the optimal time when software rejuvenation shall take place so that the system's reliability, longevity, and availability are maximized, and application delays caused by software rejuvenation is minimized. In particular, we formally analyze the relationships between software rejuvenation frequency and system reliability, longevity, and availability. Based on the theoretic analysis, we develop approaches to maximizing system reliability, longevity, and availability, and use simulation to evaluate the developed approaches. In addition, we design the MIN-DELAY semi-priority-driven scheduling algorithm to minimize application delays caused by rejuvenation processes. The simulation experiments show that the developed semi-priority-driven scheduling algorithm reduces application delays by 9.01% and 14.24% over the earliest deadline first (EDF) and least release time (LRT) scheduling algorithms, respectively.


title: QuaRel: A Dataset and Models for Answering Questions about Qualitative Relationships

abstract: Many natural language questions require recognizing and reasoning with qualitative relationships (e.g., in science, economics, and medicine), but are challenging to answer with corpus-based methods. Qualitative modeling provides tools that support such reasoning, but the semantic parsing task of mapping questions into those models has formidable challenges. We present QuaRel, a dataset of diverse story questions involving qualitative relationships that characterize these challenges, and techniques that begin to address them. The dataset has 2771 questions relating 19 different types of quantities. For example, "Jenny observes that the robot vacuum cleaner moves slower on the living room carpet than on the bedroom carpet. Which carpet has more friction?" We contribute (1) a simple and flexible conceptual framework for representing these kinds of questions; (2) the QuaRel dataset, including logical forms, exemplifying the parsing challenges; and (3) two novel models for this task, built as extensions of type-constrained semantic parsing. The first of these models (called QuaSP+) significantly outperforms off-the-shelf tools on QuaRel. The second (QuaSP+Zero) demonstrates zero-shot capability, i.e., the ability to handle new qualitative relationships without requiring additional training data, something not possible with previous models. This work thus makes inroads into answering complex, qualitative questions that require reasoning, and scaling to new relationships at low cost. The dataset and models are available at http://data.allenai.org/quarel.


title: Quest for the Donor Star in the Magnetic Precataclysmic Variable V1082 Sgr

abstract: We obtained high-resolution spectra and multicolor photometry of V1082 Sgr to study the donor star in this 20.8 hr orbital period binary, which is assumed to be a detached system. We measured the rotational velocity (v sin i = 26.5+/-2.0 km/s), which, coupled with the constraints on the white dwarf mass from the X-ray spectroscopy, leads to the conclusion that the donor star barely fills 70% of its corresponding Roche lobe radius. It appears to be a slightly evolved K2-type star. This conclusion was further supported by a recently published distance to the binary system measured by the Gaia mission. At the same time, it becomes difficult to explain a very high (> 10e-9 Msun/yr) mass transfer and mass accretion rate in a detached binary via stellar wind and magnetic coupling.


title: Convergence of the mirror to a rational elliptic surface

abstract: The construction introduced by Gross, Hacking and Keel allows one to construct a formal mirror family to a pair $(S,D)$ where $S$ is a smooth rational projective surface and $D$ a certain type of Weil divisor supporting an ample or anti-ample class. In that paper they proved two convergence results. Firstly that if the intersection matrix of $D$ is not negative semi-definite then the family they construct lifts to an algebraic family. Secondly they prove that if the intersection matrix is negative definite then their construction lifts along certain analytic strata on the base, and then over a formal neighbourhood of this. In the original version of that paper they claimed that if the intersection matrix were negative semi-definite then family in fact extends over an analytic neighbourhood of the origin but gave an incorrect proof. In this paper we correct this error. We explain how the general Gross-Siebert program can be used to reduce construction of the mirror to such a surface to calculating certain relative Gromov-Witten invariants. We then relate these invariants to the invariants of a new space where we can find explicit formulae for the invariants. From this we deduce analytic convergence of the mirror family, at least when the original surface has an $I_4$ fibre.


title: Learning without Memorizing

abstract: Incremental learning (IL) is an important task aimed at increasing the capability of a trained model, in terms of the number of classes recognizable by the model. The key problem in this task is the requirement of storing data (e.g. images) associated with existing classes, while teaching the classifier to learn new classes. However, this is impractical as it increases the memory requirement at every incremental step, which makes it impossible to implement IL algorithms on edge devices with limited memory. Hence, we propose a novel approach, called `Learning without Memorizing (LwM)', to preserve the information about existing (base) classes, without storing any of their data, while making the classifier progressively learn the new classes. In LwM, we present an information preserving penalty: Attention Distillation Loss ($L_{AD}$), and demonstrate that penalizing the changes in classifiers' attention maps helps to retain information of the base classes, as new classes are added. We show that adding $L_{AD}$ to the distillation loss which is an existing information preserving loss consistently outperforms the state-of-the-art performance in the iILSVRC-small and iCIFAR-100 datasets in terms of the overall accuracy of base and incrementally learned classes.


title: Variance Reduction in Stochastic Particle-Optimization Sampling

abstract: Stochastic particle-optimization sampling (SPOS) is a recently-developed scalable Bayesian sampling framework that unifies stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) algorithms based on Wasserstein gradient flows. With a rigorous non-asymptotic convergence theory developed recently, SPOS avoids the particle-collapsing pitfall of SVGD. Nevertheless, variance reduction in SPOS has never been studied. In this paper, we bridge the gap by presenting several variance-reduction techniques for SPOS. Specifically, we propose three variants of variance-reduced SPOS, called SAGA particle-optimization sampling (SAGA-POS), SVRG particle-optimization sampling (SVRG-POS) and a variant of SVRG-POS which avoids full gradient computations, denoted as SVRG-POS$^+$. Importantly, we provide non-asymptotic convergence guarantees for these algorithms in terms of 2-Wasserstein metric and analyze their complexities. Remarkably, the results show our algorithms yield better convergence rates than existing variance-reduced variants of stochastic Langevin dynamics, even though more space is required to store the particles in training. Our theory well aligns with experimental results on both synthetic and real datasets.


title: Generating Classes of 3D Virtual Mandibles for AR-Based Medical Simulation

abstract: Simulation and modeling represent promising tools for several application domains from engineering to forensic science and medicine. Advances in 3D imaging technology convey paradigms such as augmented reality (AR) and mixed reality inside promising simulation tools for the training industry. Motivated by the requirement for superimposing anatomically correct 3D models on a Human Patient Simulator (HPS) and visualizing them in an AR environment, the purpose of this research effort is to derive method for scaling a source human mandible to a target human mandible. Results show that, given a distance between two same landmarks on two different mandibles, a relative scaling factor may be computed. Using this scaling factor, results show that a 3D virtual mandible model can be made morphometrically equivalent to a real target-specific mandible within a 1.30 millimeter average error bound. The virtual mandible may be further used as a reference target for registering other anatomical models, such as the lungs, on the HPS. Such registration will be made possible by physical constraints among the mandible and the spinal column in the horizontal normal rest position.


title: An algorithm for computing Grothendieck local residues II --- general case ---

abstract: Grothendieck local residue is considered in the context of symbolic computation. Based on the theory of holonomic D-modules, an effective method is proposed for computing Grothendieck local residues. The key is the notion of Noether operator associated to a local cohomology class. The resulting algorithm and an implementation are described with illustrations.


title: A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data

abstract: Nowadays, multivariate time series data are increasingly collected in various real world systems, e.g., power plants, wearable devices, etc. Anomaly detection and diagnosis in multivariate time series refer to identifying abnormal status in certain time steps and pinpointing the root causes. Building such a system, however, is challenging since it not only requires to capture the temporal dependency in each time series, but also need encode the inter-correlations between different pairs of time series. In addition, the system should be robust to noise and provide operators with different levels of anomaly scores based upon the severity of different incidents. Despite the fact that a number of unsupervised anomaly detection algorithms have been developed, few of them can jointly address these challenges. In this paper, we propose a Multi-Scale Convolutional Recurrent Encoder-Decoder (MSCRED), to perform anomaly detection and diagnosis in multivariate time series data. Specifically, MSCRED first constructs multi-scale (resolution) signature matrices to characterize multiple levels of the system statuses in different time steps. Subsequently, given the signature matrices, a convolutional encoder is employed to encode the inter-sensor (time series) correlations and an attention based Convolutional Long-Short Term Memory (ConvLSTM) network is developed to capture the temporal patterns. Finally, based upon the feature maps which encode the inter-sensor correlations and temporal information, a convolutional decoder is used to reconstruct the input signature matrices and the residual signature matrices are further utilized to detect and diagnose anomalies. Extensive empirical studies based on a synthetic dataset and a real power plant dataset demonstrate that MSCRED can outperform state-of-the-art baseline methods.


title: Gradient-Coherent Strong Regularization for Deep Neural Networks

abstract: Regularization plays an important role in generalization of deep neural networks, which are often prone to overfitting with their numerous parameters. L1 and L2 regularizers are common regularization tools in machine learning with their simplicity and effectiveness. However, we observe that imposing strong L1 or L2 regularization with stochastic gradient descent on deep neural networks easily fails, which limits the generalization ability of the underlying neural networks. To understand this phenomenon, we first investigate how and why learning fails when strong regularization is imposed on deep neural networks. We then propose a novel method, gradient-coherent strong regularization, which imposes regularization only when the gradients are kept coherent in the presence of strong regularization. Experiments are performed with multiple deep architectures on three benchmark data sets for image recognition. Experimental results show that our proposed approach indeed endures strong regularization and significantly improves both accuracy and compression (up to 9.9x), which could not be achieved otherwise.


title: Parallel Matrix Condensation for Calculating Log-Determinant of Large Matrix

abstract: Calculating the log-determinant of a matrix is useful for statistical computations used in machine learning, such as generative learning which uses the log-determinant of the covariance matrix to calculate the log-likelihood of model mixtures. The log-determinant calculation becomes challenging as the number of variables becomes large. Therefore, finding a practical speedup for this computation can be useful. In this study, we present a parallel matrix condensation algorithm for calculating the log-determinant of a large matrix. We demonstrate that in a distributed environment, Parallel Matrix Condensation has several advantages over the well-known Parallel Gaussian Elimination. The advantages include high data distribution efficiency and less data communication operations. We test our Parallel Matrix Condensation against self-implemented Parallel Gaussian Elimination as well as ScaLAPACK (Scalable Linear Algebra Package) on 1000 x1000 to 8000x8000 for 1,2,4,8,16,32,64 and 128 processors. The results show that Matrix Condensation yields the best speed-up among all other tested algorithms. The code is available on https://github.com/vbvg2008/MatrixCondensation


title: The branching-ruin number as critical parameter of random processes on trees

abstract: The branching-ruin number of a tree, which describes its asymptotic growth and geometry, can be seen as a polynomial version of the branching number. This quantity was defined by Collevecchio, Kious and Sidoravicius (2018) in order to understand the phase transitions of the once-reinforced random walk (ORRW) on trees. Strikingly, this number was proved to be equal to the critical parameter of ORRW on trees. In this paper, we continue the investigation of the link between the branching-ruin number and the criticality of random processes on trees. First, we study random walks on random conductances on trees, when the conductances have an heavy tail at $0$, parametrized by some $p>1$, where $1/p$ is the exponent of the tail. We prove a phase transition recurrence/transience with respect to $p$ and identify the critical parameter to be equal to the branching-ruin number of the tree. Second, we study a multi-excited random walk on trees where each vertex has $M$ cookies and each cookie has an infinite strength towards the root. Here again, we prove a phase transition recurrence/transience and identify the critical number of cookies to be equal to the branching-ruin number of the tree, minus 1. This result extends a conjecture of Volkov (2003). Besides, we study a generalized version of this process and generalize results of Basdevant and Singh (2009).


title: Sharp $H^1$-norm error estimates of two time-stepping schemes for reaction-subdiffusion problems

abstract: Due to the intrinsically initial singularity of solution and the discrete convolution form in numerical Caputo derivatives, the traditional $H^1$-norm analysis (corresponding to the case for a classical diffusion equation) to the time approximations of a fractional subdiffusion problem always leads to suboptimal error estimates (a loss of time accuracy). To recover the theoretical accuracy in time, we propose an improved discrete Gr\"{o}nwall inequality and apply it to the well-known L1 formula and a fractional Crank-Nicolson scheme. With the help of a time-space error-splitting technique and the global consistency analysis, sharp $H^1$-norm error estimates of the two nonuniform approaches are established for a reaction-subdiffusion problems. Numerical experiments are included to confirm the sharpness of our analysis.