title: Optimality Conditions and Exact Penalty for Mathematical Programs with Switching Constraints

abstract: In this paper, we give an overview on optimality conditions and exact penalization for the mathematical program with switching constraints (MPSC). MPSC is a new class of optimization problems which has some important applications. It is well-known that if MPSC is treated as a standard nonlinear program, some of the usual constraint qualifications may fail and to deal with this issue one could reformulate it as a mathematical program with disjunctive constraints (MPDC). In this paper we first survey recent results on constraint qualifications and optimality conditions for MPDC and then apply them to MPSC to obtain the corresponding constraint qualifications and optimality conditions. Moreover we provide two types of sufficient conditions for the local error bound and exact penalty results for MPSC. One comes from the directional quasi-normality for MPDC and the other is obtained by using the local decomposition approach.


title: Universal-to-Specific Framework for Complex Action Recognition

abstract: Video-based action recognition has recently attracted much attention in the field of computer vision. To solve more complex recognition tasks, it has become necessary to distinguish different levels of interclass variations. Inspired by a common flowchart based on the human decision-making process that first narrows down the probable classes and then applies a "rethinking" process for finer-level recognition, we propose an effective universal-to-specific (U2S) framework for complex action recognition. The U2S framework is composed of three subnetworks: a universal network, a category-specific network, and a mask network. The universal network first learns universal feature representations. The mask network then generates attention masks for confusing classes through category regularization based on the output of the universal network. The mask is further used to guide the category-specific network for class-specific feature representations. The entire framework is optimized in an end-to-end manner. Experiments on a variety of benchmark datasets, e.g., the Something-Something, UCF101, and HMDB51 datasets, demonstrate the effectiveness of the U2S framework; i.e., U2S can focus on discriminative spatiotemporal regions for confusing categories. We further visualize the relationship between different classes, showing that U2S indeed improves the discriminability of learned features. Moreover, the proposed U2S model is a general framework and may adopt any base recognition network.


title: Configurational Entropy of Folded Proteins and its Importance for Intrinsically Disordered Proteins

abstract: Many pairwise additive force fields are in active use for intrinsically disordered proteins (IDPs) and regions (IDRs), some of which modify energetic terms to improve description of IDPs/IDRs, but are largely in disagreement with solution experiments for the disordered states. We have evaluated representative pairwise and many-body protein and water force fields against experimental data on representative IDPs and IDRs, a peptide that undergoes a disorder-to-order transition, and for seven globular proteins ranging in size from 130-266 amino acids. We find that force fields with the largest statistical fluctuations consistent with the radius of gyration and universal Lindemann values for folded states simultaneously better describe IDPs and IDRs and disorder to order transitions. Hence the crux of what a force field should exhibit to well describe IDRs/IDPs is not just the balance between protein and water energetics, but the balance between energetic effects and configurational entropy of folded states of globular proteins.


title: MS-NAS: Multi-Scale Neural Architecture Search for Medical Image Segmentation

abstract: The recent breakthroughs of Neural Architecture Search (NAS) have motivated various applications in medical image segmentation. However, most existing work either simply rely on hyper-parameter tuning or stick to a fixed network backbone, thereby limiting the underlying search space to identify more efficient architecture. This paper presents a Multi-Scale NAS (MS-NAS) framework that is featured with multi-scale search space from network backbone to cell operation, and multi-scale fusion capability to fuse features with different sizes. To mitigate the computational overhead due to the larger search space, a partial channel connection scheme and a two-step decoding method are utilized to reduce computational overhead while maintaining optimization quality. Experimental results show that on various datasets for segmentation, MS-NAS outperforms the state-of-the-art methods and achieves 0.6-5.4% mIOU and 0.4-3.5% DSC improvements, while the computational resource consumption is reduced by 18.0-24.9%.


title: Radical Anion Functionalization of Two-Dimensional Materials as a Means of Engineering Simultaneously High Electronic and Ionic Conductivity Solids

abstract: A radical anion based functionalization of the basal plane of two-dimensional (2D) materials is proposed in the present study. Simple charge neutral radical functionalizations typically detach from the basal planes upon reduction. For example, epoxy oxygens irreversibly detach from graphene when reduced by an alkali metal. The radical anion functionalization of 2D materials results in a stable reduced state that can reversibly be oxidized and has high ionic conductivity due to the great mobility of the cations between the negatively charged functional groups on the surface. Depending on the oxidation state of these systems, a high concentration of hole states can also be realized allowing for good electronic conductivity. These properties can further allow for improved energy storage devices via transition metal free cathode active species, solid electrolytes, electroconductive additives, separators, coatings for metal anodes and heat conductors through a single material. One possible realization of the above principles is the 2D salt An(BN)2OBX3, where A is an alkali atom (Li, Na, etc; 0=<n=<2) or alkaline earth (Mg, etc; 0=<n=<1) and X is a halide (typically F or Cl). This material can be derived from the basal plane functionalization of hexagonal boron nitride, h-BN, with .OBX3^- radical anions in the presence of the A cations. One potential source of .OBX3^- radical anions is their recombined form, the [X3B-O-O-BX3]2- anion, which can be found in the Lewis adduct of an AnO2 ionic peroxide with BX3: An[X3B-O-O-BX3]. The individual radical anions can be obtained by thermally splitting the O-O bond in the recombined anion. Transition metal free all-solid-state batteries with Li, Na and Mg anodes, thermal stability and high energy and power densities may be realizable using An(BN)2OBX3.


title: AI Playground: Unreal Engine-based Data Ablation Tool for Deep Learning

abstract: Machine learning requires data, but acquiring and labeling real-world data is challenging, expensive, and time-consuming. More importantly, it is nearly impossible to alter real data post-acquisition (e.g., change the illumination of a room), making it very difficult to measure how specific properties of the data affect performance. In this paper, we present AI Playground (AIP), an open-source, Unreal Engine-based tool for generating and labeling virtual image data. With AIP, it is trivial to capture the same image under different conditions (e.g., fidelity, lighting, etc.) and with different ground truths (e.g., depth or surface normal values). AIP is easily extendable and can be used with or without code. To validate our proposed tool, we generated eight datasets of otherwise identical but varying lighting and fidelity conditions. We then trained deep neural networks to predict (1) depth values, (2) surface normals, or (3) object labels and assessed each network's intra- and cross-dataset performance. Among other insights, we verified that sensitivity to different settings is problem-dependent. We confirmed the findings of other studies that segmentation models are very sensitive to fidelity, but we also found that they are just as sensitive to lighting. In contrast, depth and normal estimation models seem to be less sensitive to fidelity or lighting and more sensitive to the structure of the image. Finally, we tested our trained depth-estimation networks on two real-world datasets and obtained results comparable to training on real data alone, confirming that our virtual environments are realistic enough for real-world tasks.


title: A comprehensive empirical power comparison of univariate goodness-of-fit tests for the Laplace distribution

abstract: In this paper we present the results from an empirical power comparison of 40 goodness-of-fit tests for the univariate Laplace distribution, carried out using Monte Carlo simulations with sample sizes $n = 20, 50, 100, 200$, significance levels $\alpha = 0.01, 0.05, 0.10$, and 400 alternatives consisting of asymmetric and symmetric light/heavy-tailed distributions taken as special cases from 11 models. In addition to the unmatched scope of our study, an interesting contribution is the proposal of an innovative design for the selection of alternatives. The 400 alternatives consist of 20 specific cases of 20 submodels drawn from the main 11 models. For each submodel, the 20 specific cases corresponded to parameter values chosen to cover the full power range. An analysis of the results leads to a recommendation of the best tests for five different groupings of the alternative distributions. A real-data example is also presented, where an appropriate test for the goodness-of-fit of the univariate Laplace distribution is applied to weekly log-returns of Amazon stock over a recent four-year period.


title: Are the spiral arms in the MWC 758 protoplanetary disc driven by a companion inside the cavity?

abstract: Spiral arms in protoplanetary discs are thought to be linked to the presence of companions. We test the hypothesis that the double spiral arm morphology observed in the transition disc MWC 758 can be generated by an $\approx 10$ M$_{\rm Jup}$ companion on an eccentric orbit internal to the spiral arms. Previous studies on MWC 758 have assumed an external companion. We compare simulated observations from three dimensional hydrodynamics simulations of disc-companion interaction to scattered light, infrared and CO molecular line observations, taking into account observational biases. The inner companion hypothesis is found to explain the double spiral arms, as well as several additional features seen in MWC 758 -- the arc in the northwest, substructures inside the spiral arms, the cavity in CO isotopologues, and the twist in the kinematics. Testable predictions include detection of fainter spiral structure, detection of a point source south-southeast of the primary, and proper motion of the spiral arms.


title: Deep Reinforced Attention Learning for Quality-Aware Visual Recognition

abstract: In this paper, we build upon the weakly-supervised generation mechanism of intermediate attention maps in any convolutional neural networks and disclose the effectiveness of attention modules more straightforwardly to fully exploit their potential. Given an existing neural network equipped with arbitrary attention modules, we introduce a meta critic network to evaluate the quality of attention maps in the main network. Due to the discreteness of our designed reward, the proposed learning method is arranged in a reinforcement learning setting, where the attention actors and recurrent critics are alternately optimized to provide instant critique and revision for the temporary attention representation, hence coined as Deep REinforced Attention Learning (DREAL). It could be applied universally to network architectures with different types of attention modules and promotes their expressive ability by maximizing the relative gain of the final recognition performance arising from each individual attention module, as demonstrated by extensive experiments on both category and instance recognition benchmarks.


title: Implementing the ICE Estimator in Multilayer Perceptron Classifiers

abstract: This paper describes the techniques used to implement the ICE estimator for a multilayer perceptron model, and reviews the performance of the resulting models. The ICE estimator is implemented in the Apache Spark MultilayerPerceptronClassifier, and shown in cross-validation to outperform the stock MultilayerPerceptronClassifier that uses unadjusted MLE (cross-entropy) loss. The resulting models have identical runtime performance, and similar fitting performance to the stock MLP implementations. Additionally, this approach requires no hyper-parameters, and is therefore viable as a drop-in replacement for cross-entropy optimizing multilayer perceptron classifiers wherever overfitting may be a concern.


title: Plasma Diagnostics of the Supernova Remnant N132D Using Deep XMM-Newton Observations with the Reflection Grating Spectrometer

abstract: We present XMM-Newton observations of N132D, the X-ray brightest supernova remnant (SNR) in the Large Magellanic Cloud (LMC), using the Reflection Grating Spectrometer (RGS) that enables high-resolution spectroscopy in the soft X-ray band. A dozen emission lines from L-shell transitions of various elements at intermediate charge states are newly detected in the RGS data integrating the ~200-ks on-axis observations. The 0.3-2.0-keV spectra require at least three components of thermal plasmas with different electron temperatures and indicate clear evidence of non-equilibrium ionization (NEI). Our detailed spectral diagnostics further reveal that the forbidden-to-resonance line ratios of O VII and Ne IX are both higher than expected for typical NEI plasmas. This enhancement could be attributed to either resonance scattering or emission induced by charge exchange in addition to a possible contribution from the superposition of multiple temperature components, although the lack of spatial information prevents us from concluding which is most likely.


title: Implicit Distributional Reinforcement Learning

abstract: To improve the sample efficiency of policy-gradient based reinforcement learning algorithms, we propose implicit distributional actor-critic (IDAC) that consists of a distributional critic, built on two deep generator networks (DGNs), and a semi-implicit actor (SIA), powered by a flexible policy distribution. We adopt a distributional perspective on the discounted cumulative return and model it with a state-action-dependent implicit distribution, which is approximated by the DGNs that take state-action pairs and random noises as their input. Moreover, we use the SIA to provide a semi-implicit policy distribution, which mixes the policy parameters with a reparameterizable distribution that is not constrained by an analytic density function. In this way, the policy's marginal distribution is implicit, providing the potential to model complex properties such as covariance structure and skewness, but its parameter and entropy can still be estimated. We incorporate these features with an off-policy algorithm framework to solve problems with continuous action space and compare IDAC with state-of-the-art algorithms on representative OpenAI Gym environments. We observe that IDAC outperforms these baselines in most tasks. Python code is provided.


title: Nested Dirichlet Process For Population Size Estimation From Multi-list Recapture Data

abstract: Heterogeneity of response patterns is important in estimating the size of a closed population from multiple recapture data when capture patterns are different over time and location. In this paper, we extend the non-parametric one layer latent class model for multiple recapture data proposed by Manrique-Vallier (2016) to a nested latent class model with the first layer modeling individual heterogeneity and the second layer modeling location-time differences. Location-time groups with similar recording patterns are in the same top layer latent class and individuals within each top layer class are dependent. The nested latent class model incorporates hierarchical heterogeneity into the modeling to estimate population size from multi-list recapture data. This approach leads to more accurate population size estimation and reduced uncertainty. We apply the method to estimating casualties from the Syrian conflict.


title: No almost simple sporadic group acts primitively on the points of a generalised quadrangle

abstract: A generalised quadrangle is a point-line incidence geometry G such that: (i) any two points lie on at most one line, and (ii) given a line L and a point p not incident with L, there is a unique point on L collinear with p. They are a specific case of the generalised polygons introduced by Tits, and these structures and their automorphism groups are of some importance in finite geometry. An integral part of understanding the automorphism groups of finite generalised quadrangles is knowing which groups can act primitively on their points, and in particular, which almost simple groups arise as automorphism groups. We show that no almost simple sporadic group can act primitively on the points of a finite (thick) generalised quadrangle. We also present two new ideas contributing towards analysing point-primitive groups acting on generalised quadrangles. The first is the outline and implementation of an algorithm for determining whether a given group can act primitively on the points of some generalised quadrangle. The second is the discussion of a conjecture resulting from observations made in the course of this work: any group acting primitively on the points of a generalised quadrangle must either act transitively on lines or have exactly two line-orbits, each containing half of the lines.


title: Do You Have the Right Scissors? Tailoring Pre-trained Language Models via Monte-Carlo Methods

abstract: It has been a common approach to pre-train a language model on a large corpus and fine-tune it on task-specific data. In practice, we observe that fine-tuning a pre-trained model on a small dataset may lead to over- and/or under-estimation problem. In this paper, we propose MC-Tailor, a novel method to alleviate the above issue in text generation tasks by truncating and transferring the probability mass from over-estimated regions to under-estimated ones. Experiments on a variety of text generation datasets show that MC-Tailor consistently and significantly outperforms the fine-tuning approach. Our code is available at this url.


title: Approximations of the Reproducing Kernel Hilbert Space (RKHS) Embedding Method over Manifolds

abstract: The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential equations (ODEs). While the original state estimate evolves in Euclidean space, the function estimate is constructed in an infinite-dimensional RKHS that must be approximated in practice. When a finite-dimensional approximation is constructed using a basis defined in terms of shifted kernel functions centered at the observations along a trajectory, the RKHS embedding method can be understood as a data-driven approach. This paper derives sufficient conditions that ensure that approximations of the unknown function converge in a Sobolev norm over a submanifold that supports the dynamics. Moreover, the rate of convergence for the finite-dimensional approximations is derived in terms of the fill distance of the samples in the embedded manifold. Numerical simulation of an example problem is carried out to illustrate the qualitative nature of convergence results derived in the paper.


title: Temporal decays and asymptotic behaviors for a Vlasov equation with a flocking term coupled to incompressible fluid flow

abstract: We are concerned with large-time behaviors of solutions for Vlasov--Navier--Stokes equations in two dimensions and Vlasov-Stokes system in three dimensions including the effect of velocity alignment/misalignment. We first revisit the large-time behavior estimate for our main system and refine assumptions on the dimensions and a communication weight function. In particular, this allows us to take into account the effect of the misalignment interactions between particles. We then use a sharp heat kernel estimate to obtain the exponential time decay of fluid velocity to its average in $L^\infty$-norm. For the kinetic part, by employing a certain type of Sobolev norm weighted by modulations of averaged particle velocity, we prove the exponential time decay of the particle distribution, provided that local particle distribution function is uniformly bounded. Moreover, we show that the support of particle distribution function in velocity shrinks to a point, which is the mean of averaged initial particle and fluid velocities, exponentially fast as time goes to infinity. This also provides that for any $p \in [1,\infty]$, the $p$-Wasserstein distance between the particle distribution function and the tensor product of the local particle distributions and Dirac measure at that point in velocity converges exponentially fast to zero as time goes to infinity.


title: Scattering below the ground state for the intercritical non-radial inhomogeneous NLS

abstract: We consider the focusing inhomogeneous nonlinear Schr\"odinger equation \[ i\partial_t u + \Delta u + |x|^{-b}|u|^\alpha u = 0\quad\text{on}\quad\mathbb{R}\times\mathbb{R}^N, \] with $N\geq 2$, $0<b<\min\{\tfrac{N}{2},2\}$, and $\tfrac{4-2b}{N}<\alpha<\tfrac{4-2b}{N-2}$. These constraints make the equation mass-supercritical and energy-subcritical. We extend the results of Farah-Guzm\'an and Miao-Murphy-Zheng and prove scattering below the ground state with general initial data.


title: Low to High Dimensional Modality Hallucination using Aggregated Fields of View

abstract: Real-world robotics systems deal with data from a multitude of modalities, especially for tasks such as navigation and recognition. The performance of those systems can drastically degrade when one or more modalities become inaccessible, due to factors such as sensors' malfunctions or adverse environments. Here, we argue modality hallucination as one effective way to ensure consistent modality availability and thereby reduce unfavorable consequences. While hallucinating data from a modality with richer information, e.g., RGB to depth, has been researched extensively, we investigate the more challenging low-to-high modality hallucination with interesting use cases in robotics and autonomous systems. We present a novel hallucination architecture that aggregates information from multiple fields of view of the local neighborhood to recover the lost information from the extant modality. The process is implemented by capturing a non-linear mapping between the data modalities and the learned mapping is used to aid the extant modality to mitigate the risk posed to the system in the adverse scenarios which involve modality loss. We also conduct extensive classification and segmentation experiments on UWRGBD and NYUD datasets and demonstrate that hallucination allays the negative effects of the modality loss. Implementation and models: https://github.com/kausic94/Hallucination


title: Local Editing in LZ-End Compressed Data

abstract: This paper presents an algorithm for the modification of data compressed using LZ-End, a derivate of LZ77, without prior decompression. The performance of the algorithm and the impact of the modifications on the compression ratio is evaluated. Finally, we discuss the importance of this work as a first step towards local editing in Lempel-Ziv compressed data.


title: Model Fusion with Kullback--Leibler Divergence

abstract: We propose a method to fuse posterior distributions learned from heterogeneous datasets. Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple assign-and-average approach. The components of the dataset posteriors are assigned to the proposed global model components by solving a regularized variant of the assignment problem. The global components are then updated based on these assignments by their mean under a KL divergence. For exponential family variational distributions, our formulation leads to an efficient non-parametric algorithm for computing the fused model. Our algorithm is easy to describe and implement, efficient, and competitive with state-of-the-art on motion capture analysis, topic modeling, and federated learning of Bayesian neural networks.


title: An Adversarial Approach to Structural Estimation

abstract: We propose a new simulation-based estimation method, adversarial estimation, for structural models. The estimator is formulated as the solution to a minimax problem between a generator (which generates simulated observations using the structural model) and a discriminator (which classifies whether an observation is simulated). The discriminator maximizes the accuracy of its classification while the generator minimizes it. We show that, with a sufficiently rich discriminator, the adversarial estimator attains parametric efficiency under correct specification and the parametric rate under misspecification. We advocate the use of a neural network as a discriminator that can exploit adaptivity properties and attain fast rates of convergence. We apply our method to the elderly's saving decision model and show that our estimator uncovers the bequest motive as an important source of saving across the wealth distribution, not only for the rich.

categories: econ.EM cs.LG math.ST stat.ME stat.ML stat.TH


title: Marginally trapped surfaces in a perturbed Schwarzschild spacetime

abstract: The concept of a marginally trapped surface is important in the theory of general relativity. In the Schwarzschild black hole spacetime, its event horizon is foliated by marginally trapped surfaces. In a more general black hole spacetime, the concept of a marginally trapped surface is closely related to various sorts of horizon, for example, the apparent horizon, the trapping boundary, the isolated horizon and the dynamical horizon. In this paper, we study the set of marginally trapped surfaces in a perturbed Schwarzschild spacetime. We show that for every incoming null hypersurface which is nearly spherically symmetric, there exists a unique embedded marginally trapped surface. In order to prove this result, we develop a general method to study the geometry of spacelike surfaces in a double null coordinate system, which can be applied to study other problems for spacelike surfaces in a Lorentzian manifold.


title: Quenching dynamics of the bright solitons and other localized states in spin-orbit coupled Bose-Einstein condensates

abstract: We study the dynamics of binary Bose-Einstein condensates made of ultracold and dilute alkali-metal atoms in a quasi-one-dimensional setting. Numerically solving the two coupled Gross-Pitaevskii equations which accurately describe the system dynamics, we demonstrate that the spin transport can be controlled by suitably quenching spin-orbit (SO) and Rabi coupling strengths. Moreover, we predict a variety of dynamical features induced by quenching: broken oscillations, breathers-like oscillating patterns, spin-mixing-demixing, miscible-immiscible transition, emerging dark-bright states, dark solitons, and spin-trapping dynamics. We also outline the experimental relevance of the present study in manipulating the spin states in $^{39}$K condensates.


title: Bottom-up mechanism and improved contract net protocol for the dynamic task planning of heterogeneous Earth observation resources

abstract: Earth observation resources are becoming increasingly indispensable in disaster relief, damage assessment and related domains. Many unpredicted factors, such as the change of observation task requirements, to the occurring of bad weather and resource failures, may cause the scheduled observation scheme to become infeasible. Therefore, it is crucial to be able to promptly and maybe frequently develop high-quality replanned observation schemes that minimize the effects on the scheduled tasks. A bottom-up distributed coordinated framework together with an improved contract net are proposed to facilitate the dynamic task replanning for heterogeneous Earth observation resources. This hierarchical framework consists of three levels, namely, neighboring resource coordination, single planning center coordination, and multiple planning center coordination. Observation tasks affected by unpredicted factors are assigned and treated along with a bottom-up route from resources to planning centers. This bottom-up distributed coordinated framework transfers part of the computing load to various nodes of the observation systems to allocate tasks more efficiently and robustly. To support the prompt assignment of large-scale tasks to proper Earth observation resources in dynamic environments, we propose a multiround combinatorial allocation (MCA) method. Moreover, a new float interval-based local search algorithm is proposed to obtain the promising planning scheme more quickly. The experiments demonstrate that the MCA method can achieve a better task completion rate for large-scale tasks with satisfactory time efficiency. It also demonstrates that this method can help to efficiently obtain replanning schemes based on original scheme in dynamic environments.


title: A pole-to-equator ocean overturning circulation on Enceladus

abstract: Enceladus is believed to have a saltwater global ocean with a mean depth of at least 30~km, heated from below at the ocean-core interface and cooled at the top, where the ocean loses heat to the icy lithosphere above. This scenario suggests an important role for vertical convection to influence the interior properties and circulation of Enceladus' ocean. Additionally, the ice shell that encompasses the ocean has dramatic meridional thickness variations that, in steady state, must be sustained against processes acting to remove these ice thickness anomalies. One mechanism that would maintain variations in the ice shell thickness involves spatially-separated regions of freezing and melting at the ocean-ice interface. Here, we use an idealized, dynamical ocean model forced by an observationally-guided density forcing at the ocean-ice interface to argue that Enceladus' interior ocean should support a meridional overturning circulation. This circulation establishes an interior density structure that is more complex than in studies that have focused only on convection, including a shallow freshwater lens in the polar regions. Spatially-separated sites of ice formation and melt enable Enceladus to sustain a significant vertical and horizontal stratification, which impacts interior heat transport, and is critical for understanding the relationship between a global ocean and the planetary energy budget. The presence of low salinity layers near the polar ocean-ice interface also influences whether samples measured from the plumes are representative of the global ocean.


title: Generating Fluent Adversarial Examples for Natural Languages

abstract: Efficiently building an adversarial attacker for natural language processing (NLP) tasks is a real challenge. Firstly, as the sentence space is discrete, it is difficult to make small perturbations along the direction of gradients. Secondly, the fluency of the generated examples cannot be guaranteed. In this paper, we propose MHA, which addresses both problems by performing Metropolis-Hastings sampling, whose proposal is designed with the guidance of gradients. Experiments on IMDB and SNLI show that our proposed MHA outperforms the baseline model on attacking capability. Adversarial training with MAH also leads to better robustness and performance.


title: Ensemble Kalman Inversion for Sparse Learning of Dynamical Systems from Time-Averaged Data

abstract: Enforcing sparse structure within learning has led to significant advances in the field of data-driven discovery of dynamical systems. However, such methods require access not only to time-series of the state of the dynamical system, but also to the time derivative. In many applications, the data are available only in the form of time-averages such as moments and autocorrelation functions. We propose a sparse learning methodology to discover the vector fields defining a (possibly stochastic or partial) differential equation, using only time-averaged statistics. Such a formulation of sparse learning naturally leads to a nonlinear inverse problem to which we apply the methodology of ensemble Kalman inversion (EKI). EKI is chosen because it may be formulated in terms of the iterative solution of quadratic optimization problems; sparsity is then easily imposed. We then apply the EKI-based sparse learning methodology to various examples governed by stochastic differential equations (a noisy Lorenz 63 system), ordinary differential equations (Lorenz 96 system and coalescence equations), and a partial differential equation (the Kuramoto-Sivashinsky equation). The results demonstrate that time-averaged statistics can be used for data-driven discovery of differential equations using sparse EKI. The proposed sparse learning methodology extends the scope of data-driven discovery of differential equations to previously challenging applications and data-acquisition scenarios.


title: Coarse scale representation of spiking neural networks: backpropagation through spikes and application to neuromorphic hardware

abstract: In this work we explore recurrent representations of leaky integrate and fire neurons operating at a timescale equal to their absolute refractory period. Our coarse time scale approximation is obtained using a probability distribution function for spike arrivals that is homogeneously distributed over this time interval. This leads to a discrete representation that exhibits the same dynamics as the continuous model, enabling efficient large scale simulations and backpropagation through the recurrent implementation. We use this approach to explore the training of deep spiking neural networks including convolutional, all-to-all connectivity, and maxpool layers directly in Pytorch. We found that the recurrent model leads to high classification accuracy using just 4-long spike trains during training. We also observed a good transfer back to continuous implementations of leaky integrate and fire neurons. Finally, we applied this approach to some of the standard control problems as a first step to explore reinforcement learning using neuromorphic chips.


title: SDSS-IV MaNGA: The [$\alpha$/Fe] of Early-Type Galaxies

abstract: The mean stellar alpha-to-iron abundance ratio ([$\alpha$/Fe]) of a galaxy is an indicator of galactic star formation timescale. It is important for understanding the star formation history of early-type galaxies (ETGs) as their star formation processes have basically stopped. Using the model templates which are made by Vazdekis et al., we apply the pPXF based spectral fitting method to estimate the [$\alpha$/Fe] of 196 high signal-to-noise ratio ETGs from the MaNGA survey. The velocity dispersions within 1R$_e$ ($\sigma_{e}$) range from 27 to 270 km/s. We find a flat relation between the mean [$\alpha$/Fe] within the 1R$_e^{maj}$ ellipses and log($\sigma_{e}$), even if limiting to the massive sample with log($\sigma_{e}$/km s$^{-1}$)$>$1.9. However, the relation becomes positive after we exclude the Mg$_1$ feature in our fits, which agrees with the results from the previous work with other stellar population models, albeit with relatively large scatter. It indicates that the spectral fits with Vazdekis models could give basically the consistent predictions of [$\alpha$/Fe] with previous studies when the Mg$_b$ index is used, but do not work well at the Mg$_1$ band when their $\alpha$-enhanced version is employed in the metal-rich regime. We suggest avoiding this rather wide index, which covers 471\AA, as it might suffer from other effects such as flux-calibration issues. For reference, we also measure the stellar population radial gradients within 1R$_e^{maj}$ ellipses. Due to the low resolution of age estimations for old objects and the Mg$_1$ issue, the uncertainties of these gradients cannot be neglected.


title: Bridging Maximum Likelihood and Adversarial Learning via $\alpha$-Divergence

abstract: Maximum likelihood (ML) and adversarial learning are two popular approaches for training generative models, and from many perspectives these techniques are complementary. ML learning encourages the capture of all data modes, and it is typically characterized by stable training. However, ML learning tends to distribute probability mass diffusely over the data space, $e.g.$, yielding blurry synthetic images. Adversarial learning is well known to synthesize highly realistic natural images, despite practical challenges like mode dropping and delicate training. We propose an $\alpha$-Bridge to unify the advantages of ML and adversarial learning, enabling the smooth transfer from one to the other via the $\alpha$-divergence. We reveal that generalizations of the $\alpha$-Bridge are closely related to approaches developed recently to regularize adversarial learning, providing insights into that prior work, and further understanding of why the $\alpha$-Bridge performs well in practice.


title: Multifidelity Computing for Coupling Full and Reduced Order Models

abstract: Hybrid physics-machine learning models are increasingly being used in simulations of transport processes. Many complex multiphysics systems relevant to scientific and engineering applications include multiple spatiotemporal scales and comprise a multifidelity problem sharing an interface between various formulations or heterogeneous computational entities. To this end, we present a robust hybrid analysis and modeling approach combining a physics-based full order model (FOM) and a data-driven reduced order model (ROM) to form the building blocks of an integrated approach among mixed fidelity descriptions toward predictive digital twin technologies. At the interface, we introduce a long short-term memory network to bridge these high and low-fidelity models in various forms of interfacial error correction or prolongation. The proposed interface learning approaches are tested as a new way to address ROM-FOM coupling problems solving nonlinear advection-diffusion flow situations with a bifidelity setup that captures the essence of a broad class of transport processes.


title: Combined sub-sampling and analytical integration for efficient large-scale $GW$ calculations for 2D systems

abstract: Accurate and efficient predictions of the quasiparticle properties of complex materials remain a major challenge due to the convergence issue and the unfavorable scaling of the computational cost with respect to the system size. Quasiparticle $GW$ calculations for two dimensional (2D) materials are especially difficult. The unusual analytical behaviors of the dielectric screening and the electron self-energy of 2D materials make the conventional Brillouin zone (BZ) integration approach rather inefficient and require an extremely dense $k$-grid to properly converge the calculated quasiparticle energies. In this work, we present a combined non-uniform sub-sampling and analytical integration method that can drastically improve the efficiency of the BZ integration in 2D $GW$ calculations. Our work is distinguished from previous work in that, instead of focusing on the intricate dielectric matrix or the screened Coulomb interaction matrix, we exploit the analytical behavior of various terms of the convolved self-energy $\Sigma(\mathbf{q})$ in the small $\mathbf{q}$ limit. This method, when combined with another accelerated $GW$ method that we developed recently, can drastically speed-up (by over three orders of magnitude) $GW$ calculations for 2D materials. Our method allows fully converged $GW$ calculations for complex 2D systems at a fraction of computational cost, facilitating future high throughput screening of the quasiparticle properties of 2D semiconductors for various applications. To demonstrate the capability and performance of our new method, we have carried out fully converged $GW$ calculations for monolayer C$_2$N, a recently discovered 2D material with a large unit cell, and investigate its quasiparticle band structure in detail.


title: Learning to Learn Parameterized Classification Networks for Scalable Input Images

abstract: Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To achieve efficient and flexible image classification at runtime, we employ meta learners to generate convolutional weights of main networks for various input scales and maintain privatized Batch Normalization layers per scale. For improved training performance, we further utilize knowledge distillation on the fly over model predictions based on different input resolutions. The learned meta network could dynamically parameterize main networks to act on input images of arbitrary size with consistently better accuracy compared to individually trained models. Extensive experiments on the ImageNet demonstrate that our method achieves an improved accuracy-efficiency trade-off during the adaptive inference process. By switching executable input resolutions, our method could satisfy the requirement of fast adaption in different resource-constrained environments. Code and models are available at https://github.com/d-li14/SAN.


title: One nanometer HfO$_2$-based ferroelectric tunnel junctions on silicon

abstract: In ferroelectric materials, spontaneous symmetry breaking leads to a switchable electric polarization, which offers significant promise for nonvolatile memories. In particular, ferroelectric tunnel junctions (FTJs) have emerged as a new resistive switching memory which exploit polarization-dependent tunnel current across a thin ferroelectric barrier. Here we demonstrate FTJs with CMOS-compatible Zr-doped HfO$_2$ (Zr:HfO$_2$) ferroelectric barriers of just 1 nm thickness, grown by atomic layer deposition on silicon. These 1 nm Zr:HfO$_2$ tunnel junctions exhibit large polarization-driven electroresistance (19000$\%$), the largest value reported for HfO$_2$-based FTJs. In addition, due to just a 1 nm ferroelectric barrier, these junctions provide large tunnel current (> 1 A/cm$^2$) at low read voltage, orders of magnitude larger than reported thicker HfO$_2$-based FTJs. Therefore, our proof-of-principle demonstration provides an approach to simultaneously overcome three major drawbacks of prototypical FTJs: a Si-compatible ultrathin ferroelectric, large electroresistance, and large read current for high-speed operation.


title: Data-driven geophysics: from dictionary learning to deep learning

abstract: Understanding the principles of geophysical phenomena is an essential and challenging task. "Model-driven" approaches have supported the development of geophysics for a long time; however, such methods suffer from the curse of dimensionality and may inaccurately model the subsurface. "Data-driven" techniques may overcome these issues with increasingly available geophysical data. In this article, we review the basic concepts of and recent advances in data-driven approaches from dictionary learning to deep learning in a variety of geophysical scenarios. Explorational geophysics including data processing, inversion and interpretation will be mainly focused. Artificial intelligence applications on geoscience involving deep Earth, earthquake, water resource, atmospheric science, satellite remoe sensing and space sciences are also reviewed. We present a coding tutorial and a summary of tips for beginners and interested geophysical readers to rapidly explore deep learning. Some promising directions are provided for future research involving deep learning in geophysics, such as unsupervised learning, transfer learning, multimodal deep learning, federated learning, uncertainty estimation, and activate learning.


title: Efficient Planning in Large MDPs with Weak Linear Function Approximation

abstract: Large-scale Markov decision processes (MDPs) require planning algorithms with runtime independent of the number of states of the MDP. We consider the planning problem in MDPs using linear value function approximation with only weak requirements: low approximation error for the optimal value function, and a small set of "core" states whose features span those of other states. In particular, we make no assumptions about the representability of policies or value functions of non-optimal policies. Our algorithm produces almost-optimal actions for any state using a generative oracle (simulator) for the MDP, while its computation time scales polynomially with the number of features, core states, and actions and the effective horizon.


title: Towards quantum computing for high-energy excited states in molecular systems: quantum phase estimations of core-level states

abstract: This paper explores the utility of the quantum phase estimation (QPE) in calculating high-energy excited states characterized by promotions of electrons occupying inner energy shells. These states have been intensively studied over the last few decades especially in supporting the experimental effort at light sources. Results obtained with the QPE are compared with various high-accuracy many-body techniques developed to describe core-level states. The feasibility of the quantum phase estimator in identifying classes of challenging shake-up states characterized by the presence of higher-order excitation effects is also discussed.


title: Highly polarized one-dimensional Fermi gases near a narrow $p-$wave resonance

abstract: Based on the recently developed interaction renormalization for the one-dimensional $p$-wave interaction, we study the problem of a single impurity immersed in a highly polarized Fermi sea. They interact through a narrow $p$-wave Feshbach resonance, so the effective range $r_{0}$ naturally appears in the system. We use the variational approach limited to single-particle-hole excitations on top of the unperturbed Fermi sea. The polaron exhibits two branches of solutions, namely, the attractive and repulsive branches, with varying scattering length across the resonance. We calculate the energy spectrum, residue and effective mass for each of the branches. We compare the polaronic energy with the energy of the dressed molecule, and find that the molecular state is energetically favored when increasing the interaction strength. The critical interaction strength for the polaron-to-molecule transition will shift to the BCS side of the $p$-wave resonance as the effective range increases.


title: Primal superlinear convergence of SQP methods in piecewise linear-quadratic composite optimization

abstract: This paper mainly concerns with the primal superlinear convergence of the quasi-Newton sequential quadratic programming (SQP) method for piecewise linear-quadratic composite optimization problems. We show that the latter primal superlinear convergence can be justified under the noncriticality of Lagrange multipliers and a version of the Dennis-More condition. Furthermore, we show that if we replace the noncriticality condition with the second-order sufficient condition, this primal superlinear convergence is equivalent with an appropriate version of the Dennis-More condition. We also recover Bonnans' result in [1] for the primal-dual superlinear of the basic SQP method for this class of composite problems under the second-order sufficient condition and the uniqueness of Lagrange multipliers. To achieve these goals, we first obtain an extension of the reduction lemma for convex Piecewise linear-quadratic functions and then provide a comprehensive analysis of the noncriticality of Lagrange multipliers for composite problems. We also establish certain primal estimates for KKT systems of composite problems, which play a significant role in our local convergence analysis of the quasi-Newton SQP method.


title: Modular symmetry by orbifolding magnetized $T^2\times T^2$: realization of double cover of $\Gamma_N$

abstract: We study the modular symmetry of zero-modes on $T_1^2 \times T_2^2$ and orbifold compactifications with magnetic fluxes, $M_1,M_2$, where modulus parameters are identified. This identification breaks the modular symmetry of $T^2_1 \times T^2_2$, $SL(2,\mathbb{Z})_1 \times SL(2,\mathbb{Z})_2$ to $SL(2,\mathbb{Z})\equiv\Gamma$. Each of the wavefunctions on $T^2_1 \times T^2_2$ and orbifolds behaves as the modular forms of weight 1 for the principal congruence subgroup $\Gamma$($N$), $N$ being 2 times the least common multiple of $M_1$ and $M_2$. Then, zero-modes transform each other under the modular symmetry as multiplets of double covering groups of $\Gamma_N$ such as the double cover of $S_4$.


title: Understanding Adversarial Examples from the Mutual Influence of Images and Perturbations

abstract: A wide variety of works have explored the reason for the existence of adversarial examples, but there is no consensus on the explanation. We propose to treat the DNN logits as a vector for feature representation, and exploit them to analyze the mutual influence of two independent inputs based on the Pearson correlation coefficient (PCC). We utilize this vector representation to understand adversarial examples by disentangling the clean images and adversarial perturbations, and analyze their influence on each other. Our results suggest a new perspective towards the relationship between images and universal perturbations: Universal perturbations contain dominant features, and images behave like noise to them. This feature perspective leads to a new method for generating targeted universal adversarial perturbations using random source images. We are the first to achieve the challenging task of a targeted universal attack without utilizing original training data. Our approach using a proxy dataset achieves comparable performance to the state-of-the-art baselines which utilize the original training dataset.


title: Pulsatile therapy for perovskite solar cells

abstract: The current utmost challenge for commercialization of perovskite solar cells is to ensure long-term operation stability. Here, we developed the pulsatile therapy which can prolong device lifetime by addressing accumulation of both charges and ions in the middle of maximum power point tracking (MPPT). In the technique, reverse biases are repeatedly applied for a very short time without any pause of operation, leading to stabilization of the working device. The observed efficacies of our pulsatile therapy are delaying irreversible degradation as well as restoring degraded photocurrent during MPPT operation. We suggest an integrated mechanism underlying the therapy, in which harmful deep-level defects can be prevented to form and already formed defects can be cured by driving charge-state transition. We demonstrated the therapy to maintain defect-tolerance continuously, leading to outstanding improvement of lifetime and harvesting power. The unique technique will open up new possibility to commercialize perovskite materials into a real market.


title: PSConv: Squeezing Feature Pyramid into One Compact Poly-Scale Convolutional Layer

abstract: Despite their strong modeling capacities, Convolutional Neural Networks (CNNs) are often scale-sensitive. For enhancing the robustness of CNNs to scale variance, multi-scale feature fusion from different layers or filters attracts great attention among existing solutions, while the more granular kernel space is overlooked. We bridge this regret by exploiting multi-scale features in a finer granularity. The proposed convolution operation, named Poly-Scale Convolution (PSConv), mixes up a spectrum of dilation rates and tactfully allocate them in the individual convolutional kernels of each filter regarding a single convolutional layer. Specifically, dilation rates vary cyclically along the axes of input and output channels of the filters, aggregating features over a wide range of scales in a neat style. PSConv could be a drop-in replacement of the vanilla convolution in many prevailing CNN backbones, allowing better representation learning without introducing additional parameters and computational complexities. Comprehensive experiments on the ImageNet and MS COCO benchmarks validate the superior performance of PSConv. Code and models are available at https://github.com/d-li14/PSConv.


title: Probabilistic bounds on neuron death in deep rectifier networks

abstract: Neuron death is a complex phenomenon with implications for model trainability: the deeper the network, the lower the probability of finding a valid initialization. In this work, we derive both upper and lower bounds on the probability that a ReLU network is initialized to a trainable point, as a function of model hyperparameters. We show that it is possible to increase the depth of a network indefinitely, so long as the width increases as well. Furthermore, our bounds are asymptotically tight under reasonable assumptions: first, the upper bound coincides with the true probability for a single-layer network with the largest possible input set. Second, the true probability converges to our lower bound as the input set shrinks to a single point, or as the network complexity grows under an assumption about the output variance. We confirm these results by numerical simulation, showing rapid convergence to the lower bound with increasing network depth. Then, motivated by the theory, we propose a practical sign flipping scheme which guarantees that the ratio of living data points in a $k$-layer network is at least $2^{-k}$. Finally, we show how these issues are mitigated by network design features currently seen in practice, such as batch normalization, residual connections, dense networks and skip connections. This suggests that neuron death may provide insight into the efficacy of various model architectures.


title: On spectral flow and Fermi arcs

abstract: We introduce spectral flow techniques to explain why the Fermi arcs of Weyl semimetals are topologically protected against boundary condition changes and perturbations. We first analyse the topology of a certain universal space of self-adjoint half-line massive Dirac Hamiltonians, and then exploit its non-trivial and homotopy invariant spectral flow structure by pulling it back to generic Weyl semimetal models. The homological perspective of using Dirac strings/Euler chains as global topological invariants of Weyl semimetals/Fermi arcs, is thereby analytically justified.

categories: math-ph cond-mat.mes-hall hep-th math.MP


title: Disentangling ferroelectric domain wall geometries and pathways in dynamic piezoresponse force microscopy via unsupervised machine learning

abstract: Domain switching pathways in ferroelectric materials visualized by dynamic Piezoresponse Force Microscopy (PFM) are explored via variational autoencoder (VAE), which simplifies the elements of the observed domain structure, crucially allowing for rotational invariance, thereby reducing the variability of local polarization distributions to a small number of latent variables. For small sampling window sizes the latent space is degenerate, and variability is observed only in the direction of a single latent variable that can be identified with the presence of domain wall. For larger window sizes, the latent space is 2D, and the disentangled latent variables can be generally interpreted as the degree of switching and complexity of domain structure. Applied to multiple consecutive PFM images acquired while monitoring domain switching, the polarization switching mechanism can thus be visualized in the latent space, providing insight into domain evolution mechanisms and their correlation with the microstructure.


title: Entropy of radical ideal of a tropical prevariety

abstract: The entropy of a tropical ideal is introduced. The radical of a tropical ideal consists of all tropical polynomials vanishing on the tropical prevariety determined by the ideal. We prove that the entropy of the radical of a tropical bivariate polynomial with vanishing coefficients equals zero. Also we prove that the entropy of a zero-dimensional tropical prevariety vanishes. An example of a non-radical tropical ideal having a positive entropy is exhibited.


title: Data from Model: Extracting Data from Non-robust and Robust Models

abstract: The essence of deep learning is to exploit data to train a deep neural network (DNN) model. This work explores the reverse process of generating data from a model, attempting to reveal the relationship between the data and the model. We repeat the process of Data to Model (DtM) and Data from Model (DfM) in sequence and explore the loss of feature mapping information by measuring the accuracy drop on the original validation dataset. We perform this experiment for both a non-robust and robust origin model. Our results show that the accuracy drop is limited even after multiple sequences of DtM and DfM, especially for robust models. The success of this cycling transformation can be attributed to the shared feature mapping existing in data and model. Using the same data, we observe that different DtM processes result in models having different features, especially for different network architecture families, even though they achieve comparable performance.


title: The Betti side of the double shuffle theory: a survey

abstract: This is a survey of arXiv:1803.10151v4, arXiv:1807.07786v2 and arXiv:1908.00444v2 by H. Furusho and the author. The purpose of this series of papers is: (1) to give a proof that associator relations imply double shuffle relations, alternative to Furusho's paper arXiv:0808.0319v3; (2) to make explicit the bitorsor structure on Racinet's torsor of double shuffle relations. The main tool is the interpretation of the harmonic coproduct in terms of the topology of the moduli spaces $\mathfrak M_{0,4}$ and $\mathfrak M_{0,5}$, introduced in Deligne and Terasoma's 2005 preprint, and its extension to the Betti setup.


title: Reducing Language Biases in Visual Question Answering with Visually-Grounded Question Encoder

abstract: Recent studies have shown that current VQA models are heavily biased on the language priors in the train set to answer the question, irrespective of the image. E.g., overwhelmingly answer "what sport is" as "tennis" or "what color banana" as "yellow." This behavior restricts them from real-world application scenarios. In this work, we propose a novel model-agnostic question encoder, Visually-Grounded Question Encoder (VGQE), for VQA that reduces this effect. VGQE utilizes both visual and language modalities equally while encoding the question. Hence the question representation itself gets sufficient visual-grounding, and thus reduces the dependency of the model on the language priors. We demonstrate the effect of VGQE on three recent VQA models and achieve state-of-the-art results on the bias-sensitive split of the VQAv2 dataset; VQA-CPv2. Further, unlike the existing bias-reduction techniques, on the standard VQAv2 benchmark, our approach does not drop the accuracy; instead, it improves the performance.


title: CheXphoto: 10,000+ Photos and Transformations of Chest X-rays for Benchmarking Deep Learning Robustness

abstract: Clinical deployment of deep learning algorithms for chest x-ray interpretation requires a solution that can integrate into the vast spectrum of clinical workflows across the world. An appealing approach to scaled deployment is to leverage the ubiquity of smartphones by capturing photos of x-rays to share with clinicians using messaging services like WhatsApp. However, the application of chest x-ray algorithms to photos of chest x-rays requires reliable classification in the presence of artifacts not typically encountered in digital x-rays used to train machine learning models. We introduce CheXphoto, a dataset of smartphone photos and synthetic photographic transformations of chest x-rays sampled from the CheXpert dataset. To generate CheXphoto we (1) automatically and manually captured photos of digital x-rays under different settings, and (2) generated synthetic transformations of digital x-rays targeted to make them look like photos of digital x-rays and x-ray films. We release this dataset as a resource for testing and improving the robustness of deep learning algorithms for automated chest x-ray interpretation on smartphone photos of chest x-rays.


title: Canonical blow-ups of Grassmann manifolds

abstract: We introduce certain canonical blow-ups $\mathcal T_{s,p,n}$, as well as their distinct submanifolds $\mathcal M_{s,p,n}$, of Grassmann manifolds $G(p,n)$ by partitioning the Pl\"ucker coordinates with respect to a parameter $s$. Various geometric aspects of $\mathcal T_{s,p,n}$ and $\mathcal M_{s,p,n}$ are studied, for instance, the smoothness, the holomorphic symmetries, the (semi-)positivity of the anti-canonical bundles, the existence of K\"ahler-Einstein metrics, the functoriality, etc. In particular, we introduce the notion of homeward compactification, of which $\mathcal T_{s,p,n}$ are examples, as a generalization of the wonderful compactification. Lastly, a generalization of $\mathcal T_{s,p,n}$ according to vector-valued parameters $\overline s$ is given, and open questions are raised.


title: The Blockchain Based Auditor on Secret key Life Cycle in Reconfigurable Platform

abstract: The growing sophistication of cyber attacks, vulnerabilities in high computing systems and increasing dependency on cryptography to protect our digital data make it more important to keep secret keys safe and secure. Few major issues on secret keys like incorrect use of keys, inappropriate storage of keys, inadequate protection of keys, insecure movement of keys, lack of audit logging, insider threats and non-destruction of keys can compromise the whole security system dangerously. In this article, we have proposed and implemented an isolated secret key memory which can log life cycle of secret keys cryptographically using blockchain (BC) technology. We have also implemented a special custom bus interconnect which receives custom crypto instruction from Processing Element (PE). During the execution of crypto instructions, the architecture assures that secret key will never come in the processor area and the movement of secret keys to various crypto core is recorded cryptographically after the proper authentication process controlled by proposed hardware based BC. To the best of our knowledge, this is the first work which uses blockchain based solution to address the issues of the life cycle of the secret keys in hardware platform. The additional cost of resource usage and timing complexity we spent to implement the proposed idea is very nominal. We have used Xilinx Vivado EDA tool and Artix 7 FPGA board.


title: Structured Policy Iteration for Linear Quadratic Regulator

abstract: Linear quadratic regulator (LQR) is one of the most popular frameworks to tackle continuous Markov decision process tasks. With its fundamental theory and tractable optimal policy, LQR has been revisited and analyzed in recent years, in terms of reinforcement learning scenarios such as the model-free or model-based setting. In this paper, we introduce the \textit{Structured Policy Iteration} (S-PI) for LQR, a method capable of deriving a structured linear policy. Such a structured policy with (block) sparsity or low-rank can have significant advantages over the standard LQR policy: more interpretable, memory-efficient, and well-suited for the distributed setting. In order to derive such a policy, we first cast a regularized LQR problem when the model is known. Then, our Structured Policy Iteration (S-PI) algorithm, which takes a policy evaluation step and a policy improvement step in an iterative manner, can solve this regularized LQR efficiently. We further extend the S-PI algorithm to the model-free setting where a smoothing procedure is adopted to estimate the gradient. In both the known-model and model-free setting, we prove convergence analysis under the proper choice of parameters. Finally, the experiments demonstrate the advantages of S-PI in terms of balancing the LQR performance and level of structure by varying the weight parameter.


title: Detailed balance and invariant measures for discrete KdV- and Toda-type systems

abstract: In order to study the invariant measures of discrete KdV- and Toda-type systems, this article focusses on models, discretely indexed in space and time, whose dynamics are deterministic and defined locally via lattice equations. A detailed balance criterion is presented that, amongst the measures that describe spatially independent and identically/alternately distributed configurations, characterizes those that are temporally invariant in distribution. A condition for establishing ergodicity of the dynamics is also given. These results are applied to various examples of discrete integrable systems, namely the ultra-discrete and discrete KdV equations, for which it is shown that the relevant invariant measures are of exponential/geometric and generalized inverse Gaussian form, respectively, as well as the ultra-discrete and discrete Toda lattice equations, for which the relevant invariant measures are found to be of exponential/geometric and gamma form. Ergodicity is demonstrated in the case of the KdV-type models. Links between the invariant measures of the different systems are presented, as are connections with stochastic integrable models and iterated random functions. Furthermore, a number of conjectures concerning the characterization of standard distributions are posed.


title: Sensor-Aided Learning for Wi-Fi Positioning with Beacon Channel State Information

abstract: Because each indoor site has its own radio propagation characteristics, a site survey process is essential to optimize a Wi-Fi ranging strategy for range-based positioning solutions. This paper studies an unsupervised learning technique that autonomously investigates the characteristics of the surrounding environment using sensor data accumulated while users use a positioning application. Using the collected sensor data, the device trajectory can be regenerated, and a Wi-Fi ranging module is trained to make the shape of the estimated trajectory using Wi-Fi similar to that obtained from sensors. In this process, the ranging module learns the way to identify the channel conditions from each Wi-Fi access point (AP) and produce ranging results accordingly. Furthermore, we collect the channel state information (CSI) from beacon frames and evaluate the benefit of using CSI in addition to received signal strength (RSS) measurements. When CSI is available, the ranging module can identify more diverse channel conditions from each AP, and thus more precise positioning results can be achieved. The effectiveness of the proposed learning technique is verified using a real-time positioning application implemented on a PC platform.


title: Electron pairing in the Hubbard model as a result of on-site repulsion fluctuations

abstract: We focus our quantitative analysis on the stability of the insulator state in the Hubbard model at a half-filling. Taking into account large-scale fluctuations (with a long relaxation time) of the on-site Coulomb repulsion, we consider the possibility of realizing a stabile state which is characterized by pairing for electrons. The pairing mechanism is as follows: due to fluctuations of on-site repulsion of electrons, holes, as excited states, are formed electron pairs. The bare values of on-site Coulomb repulsion and its fluctuations, for which the states with electron pairing are stable, are calculated. The proposed pairing mechanism is to some extent similar to the formation of a localized moment in the Wolf model. The calculations were performed for the chain, as well as square and cubic lattices.


title: Discrete integrable systems and Pitman's transformation

abstract: We survey recent work that relates Pitman's transformation to a variety of classical integrable systems, including the box-ball system, the ultra-discrete and discrete KdV equations, and the ultra-discrete and discrete Toda lattice equations. It is explained how this connection enables the dynamics of the integrable systems to be initiated from infinite configurations, which is important in the study of invariant measures. In the special case of spatially independent and identically distributed configurations, progress on the latter topic is also reported.


title: DinerDash Gym: A Benchmark for Policy Learning in High-Dimensional Action Space

abstract: It has been arduous to assess the progress of a policy learning algorithm in the domain of hierarchical task with high dimensional action space due to the lack of a commonly accepted benchmark. In this work, we propose a new light-weight benchmark task called Diner Dash for evaluating the performance in a complicated task with high dimensional action space. In contrast to the traditional Atari games that only have a flat structure of goals and very few actions, the proposed benchmark task has a hierarchical task structure and size of 57 for the action space and hence can facilitate the development of policy learning in complicated tasks. On top of that, we introduce Decomposed Policy Graph Modelling (DPGM), an algorithm that combines both graph modelling and deep learning to allow explicit domain knowledge embedding and achieves significant improvement comparing to the baseline. In the experiments, we have shown the effectiveness of the domain knowledge injection via a specially designed imitation algorithm as well as results of other popular algorithms.


title: Intersection cohomology of pure sheaf spaces using Kirwan's desingularization

abstract: Let $\mathbf{M}_n$ be the Simpson compactification of twisted ideal sheaves $\mathcal{I}_{L,Q}(1)$ where $Q$ is a rank $4$ quardric hypersurface in $\mathbb{P}^n$ and $L$ is a linear subspace of dimension $n-2$. This paper calculates the intersection Poincar\'e polynomial of $\mathbf{M}_n$ using Kirwan's desingularization method. We obtain the intersection Poincar\'e polynomial of the moduli space for one-dimensional sheaves on del Pezzo surfaces of degree $\geq 8$ by considering wall-crossings of stable pairs and complexes.


title: Technical feasibility of Magnetic Resonance Fingerprinting on a 1.5T MRI-Linac

abstract: Hybrid MRI-linac (MRL) systems enable daily multiparametric quantitative MRI to assess tumor response to radiotherapy. Magnetic Resonance Fingerprinting (MRF) may provide time efficient means of rapid multiparametric quantitative MRI. The accuracy of MRF, however, relies on adequate control over system imperfections, such as eddy currents and B1+, which are different and not as well established on MRL systems compared to diagnostic systems. In this study we investigate the technical feasibility of gradient spoiled 2D MRF on a 1.5T MRL. We show with phantom experiments that the MRL generates reliable MRF signals that are temporally stable during the day and have good agreement with spin-echo reference measurements. Subsequent in-vivo MRF scans in healthy volunteers and a patient with a colorectal liver metastasis showed good image quality, where the quantitative values of selected organs corresponded with the values reported in literature. Therefore we conclude that gradient spoiled 2D MRF is feasible on a 1.5T MRL with similar performance as on a diagnostic system. The precision and accuracy of the parametric maps are sufficient for further investigation of the clinical utility of MRF for online quantitatively MRI-guided radiotherapy.


title: Quantum metrology via chaos in a driven Bose-Josephson system

abstract: Entanglement preparation and signal accumulation are essential for quantum parameter estimation, which pose significant challenges to both theories and experiments. Here, we propose how to utilize chaotic dynamics in a periodically driven Bose-Josephson system for achieving a high-precision measurement beyond the standard quantum limit (SQL). Starting from an initial non-entangled state, the chaotic dynamics generates quantum entanglement and simultaneously encodes the parameter to be estimated. By using suitable chaotic dynamics, the ultimate measurement precision of the estimated parameter can beat the SQL. The sub-SQL measurement precision scaling can also be obtained via specific observables, such as population measurements, which can be realized with state-of-art techniques. Our study not only provides new insights for understanding quantum chaos and quantum-classical correspondence, but also is of promising applications in entanglement-enhanced quantum metrology.


title: Dirac quantum walks with conserved angular momentum

abstract: A Quantum Walk (QW) simulating the flat $(1 + 2)$D Dirac Eq.\ on a spatial polar grid is constructed. Because fermions are represented by spinors, which do not constitute a representation of the rotation group, but rather of its double cover, the QW can only be defined globally on an extended spacetime where the polar angle extends from $0$ to $4 \pi$. The coupling of the QW with arbitrary electromagnetic fields is also presented. Finally, the cylindrical relativistic Landau levels of the Dirac Eq.\ are computed explicitly and simulated by the QW.


title: Comparing the reflectivity of ungrouped carbonaceous chondrites with that of short period comets like 2P/Encke

abstract: Aims. The existence of asteroid complexes produced by the disruption of these comets suggests that evolved comets could also produce high-strength materials able to survive as meteorites. We chose as an example comet 2P/Encke, one of the largest object of the so-called Taurid complex. We compare the reflectance spectrum of this comet with the laboratory spectra of some Antarctic ungrouped carbonaceous chondrites to investigate whether some of these meteorites could be associated with evolved comets. Methods. We compared the spectral behaviour of 2P/Encke with laboratory spectra of carbonaceous chondrites. Different specimens of the common carbonaceous chondrite groups do not match the overall features and slope of comet 2P/Encke. Trying anomalous carbonaceous chondrites, we found two meteorites, Meteorite Hills 01017 and Grosvenor Mountains 95551, which could be good proxies for the dark materials forming this short-period comet. We hypothesise that these two meteorites could be rare surviving samples, either from the Taurid complex or another compositionally similar body. In any case, it is difficult to get rid of the effects of terrestrial weathering in these Antarctic finds, and further studies are needed. Future sample return from the so-called dormant comets could be also useful to establish a ground truth on the materials forming evolved short-period comets. Results. As a natural outcome, we think that identifying good proxies of 2P/Encke-forming materials might have interesting implications for future sample-return missions to evolved, potentially dormant or extinct comets. To understand the compositional nature of evolved comets is particularly relevant in the context of the future mitigation of impact hazard from these dark and dangerous projectiles.


title: Effects of magnetic fields on the Datta-Das spin field-effect transistor

abstract: A Datta-Das spin field-effect transistor is built of a heterostructure with a Rashba spin-orbit interaction (SOI) at the interface (or quantum well) separating two possibly magnetized reservoirs. The particle and spin currents between the two reservoirs are driven by chemical potentials that are (possibly) different for each spin direction. These currents are also tuned by varying the strength of the SOI, which changes the amount of the rotation of the spins of electrons crossing the heterostructure. Here we investigate the dependence of these currents on additional Zeeman fields on the heterostructure and on variations of the reservoir magnetizations. In contrast to the particle current, the spin currents are not necessarily conserved; an additional spin polarization is injected into the reservoirs. If a reservoir has a finite (equilibrium) magnetization, then we surprisingly find that the spin current into that reservoir can only have spins which are parallel to the reservoir magnetization, independent of all the other fields. This spin current can be enhanced by increasing the magnetization of the other reservoir, and can also be tuned by the SOI and the various magnetic fields. When only one reservoir is magnetized then the spin current into the other reservoir has arbitrary tunable size and direction. In particular, this spin current changes as the magnetization of the other reservoir is rotated. The optimal conditions for accumulating spin polarization on an unpolarized reservoir are to either apply a Zeeman field in addition to the SOI, or to polarize the other reservoir.


title: Non-linear equation in the re-summed next-to-leading order of perturbative QCD: the leading twist approximation

abstract: In this paper, we use the re-summation procedure, suggested in Refs.\cite{DIMST,SALAM,SALAM1,SALAM2}, to fix the BFKL kernel in the NLO. However, we suggest a different way to introduce th non-linear corrections in the saturation region, which is based on the leading twist non-linear equation. In the kinematic region:$\tau\,\equiv\,r^2 Q^2_s(Y)\,\leq\,1$ , where $r$ denotes the size of the dipole, $Y$ its rapidity and $Q_s$ the saturation scale, we found that the re-summation contributes mostly to the leading twist of the BFKL equation. Assuming that the scattering amplitude is small, we suggest using the linear evolution equation in this region. For $\tau \,>\,1$ we are dealing with the re-summation of $\Lb \bas \,\ln \tau\Rb^n$ and other corrections in NLO approximation for the leading twist.We find the BFKL kernel in this kinematic region and write the non-linear equation, which we solve analytically. We believe the new equation could be a basis for a consistent phenomenology based on the CGC approach.


title: Amalgamation and extensions of summand absorbing modules over a semiring

abstract: A submodule $W$ of $V$ is summand absorbing, if $x + y \in W$ implies $x \in W, \; y \in W $ for any $x, y \in V$. Such submodules often appear in modules over (additively) idempotent semirings, particularly in tropical algebra. This paper studies amalgamation and extensions of these submodules, and more generally of upper bound modules.


title: Search for helium in the upper atmosphere of the hot Jupiter WASP-127 b using Gemini/Phoenix

abstract: Large-scale exoplanet search surveys have shown evidence that atmospheric escape is a ubiquitous process that shapes the evolution and demographics of planets. However, we lack a detailed understanding of this process because very few exoplanets discovered to date could be probed for signatures of atmospheric escape. Recently, the metastable helium triplet at 1.083 $\mu$m has been shown to be a viable window for the presence of He-rich escaping envelopes around short-period exoplanets. Our objective is to use, for the first time, the Phoenix spectrograph to search for helium in the upper atmosphere of the inflated hot Jupiter WASP-127 b. We observed one transit and reduced the data manually since there is no pipeline available. We did not find a significant in-transit absorption signal indicative of the presence of helium around WASP-127 b, and set a 90% confidence upper limit for excess absorption at 0.87% in a 0.075 nm passband covering the He triplet. Given the large scale height of this planet, the lack of a detectable feature is likely due to unfavorable photoionization conditions to populate the metastable He triplet. This conclusion is supported by the inferred low coronal and chromospheric activity of the host star and the old age of the system, which result in a relatively mild high-energy environment around the planet.


title: Prolate-to-oblate transition and backbending along the yrast line induced by quasiparticle alignment

abstract: The yrast lines in Kr isotopes with $N=42$, 44, and 46 are investigated in a beyond mean field framework with both prolate-oblate coexistence and quasiparticle alignment taken into account. Quasiparticle orbitals with high-$j$ and low-$\Omega$ on the oblate side are shown to be responsible for the sharp backbending observed in $^{82}$Kr, by driving the yrast shape from prolate to oblate. This suggests that quasiparticle alignment may not be neglected in the investigation of the shape evolution along the yrast line.


title: Steps Towards Best Practices For Robot Videos

abstract: There are unwritten guidelines for how to make robot videos that researchers learn from their advisors and pass onto their students. We believe that it is important for the community to collaboratively discuss and develop a standard set of best practices when making robot. We suggest a starting set of maxims for best robot video practices, and highlight positive examples from the community and negative examples only from videos made by the authors of this article. In addition, we offer a checklist that we hope can act as an document that can be given to robotic researchers to inform them of how to make robot videos that truthfully characterize what a robot can and can not do. We consider this a first draft, and are looking for feedback from the community as we refine and grow our maxims and checklist.


title: Probing Magnetic Field Morphology in Galaxy Clusters with the Gradient Technique

abstract: Magnetic fields in the intracluster medium (ICM) affect the structure and the evolution of galaxy clusters. However, their properties are largely unknown, and measuring magnetic fields in galaxy clusters is challenging, especially on large-scales outside of individual radio sources. In this work, we probe the plane-of-the-sky orientation of magnetic fields in clusters using the intensity gradients. The technique is a branch of the Gradient Technique (GT) that employs emission intensity maps from turbulent gas. We utilize the Chandra X-ray images of the Perseus, M 87, Coma, and A2597 galaxy clusters, and the VLA radio observations of the synchrotron emission from Perseus. We find that the fields predominantly follow the sloshing arms in Perseus, which is in agreement with numerical simulations. The GT-predicted magnetic field shows signatures of magnetic draping around rising bubbles driven by supermassive black hole (SMBH) feedback in the centers of cool-core clusters, as well as draping around substructures merging with the Coma cluster. We calculate the mean-field orientation with respect to the radial direction in these clusters. In the central regions of cool-core clusters, the mean orientation of the magnetic fields is preferentially azimuthal. There is a broad agreement between the magnetic field of Perseus predicted using the X-ray and radio data. Further numerical studies and better future observations with higher resolution and the larger effective area will help reduce the uncertainties of this method.


title: The impact of stellar rotation on the black hole mass-gap from pair-instability supernovae

abstract: Models of pair-instability supernovae (PISNe) predict a gap in black hole (BH) masses between $\sim 45M_\odot-120M_\odot$, which is referred to as the upper BH mass-gap. With the advent of gravitational-wave astrophysics it has become possible to test this prediction, and there is an important associated effort to understand what theoretical uncertainties modify the boundaries of this gap. In this work we study the impact of rotation on the hydrodynamics of PISNe, which leave no compact remnant, as well as the evolution of pulsational-PISNe (PPISNe), which undergo thermonuclear eruptions before forming a compact object. We perform simulations of non-rotating and rapidly-rotating stripped helium stars in a metal poor environment $(Z_\odot/50)$ in order to resolve the lower edge of the upper mass-gap. We find that the outcome of our simulations is dependent on the efficiency of angular momentum transport, with models that include efficient coupling through the Spruit-Tayler dynamo shifting the lower edge of the mass-gap upwards by $\sim 4\%$, while simulations that do not include this effect shift it upwards by $\sim 15\%$. From this, we expect the lower edge of the upper mass-gap to be dependent on BH spin, which can be tested as the number of observed BH mergers increases. Moreover, we show that stars undergoing PPISNe have extended envelopes ($R\sim 10-1000~R_\odot$) at iron-core collapse, making them promising progenitors for ultra-long gamma-ray bursts.


title: Luminous supernovae associated with ultra-long gamma-ray bursts from hydrogen-free progenitors extended by pulsational pair-instability

abstract: We show that the luminous supernovae (SNe) associated with ultra-long gamma-ray bursts (GRBs) can be related to the slow cooling from the explosions of hydrogen-free progenitors extended by pulsational pair-instability. In the accompanying paper (Marchant & Moriya 2020), we have shown that some rapidly-rotating hydrogen-free GRB progenitors that experience pulsational pair-instability can keep an extended structure caused by pulsational pair-instability until the core collapse. Such progenitors have large radii exceeding 10 Rsun and they sometimes reach beyond 1000 Rsun at the time of the core collapse. They are, therefore, promising progenitors of ultra-long GRBs. We here perform the light-curve modeling of the explosions of one extended hydrogen-free progenitor with a radius of 1962 Rsun. Thanks to the large progenitor radius, the ejecta experience slow cooling after the shock breakout and they become rapidly evolving (<~ 10 days) luminous (>~ 1e43 erg/s) SNe in optical even without the energy input from the 56Ni nuclear decay when the explosion energy is more than 1e52 erg. The 56Ni decay energy input can affect the light curves after the optical light-curve peak and make the light-curve decay slow when the 56Ni mass is around 1 Msun. They also have fast photospheric velocity above 10,000 km/s and hot photospheric temperature above 10,000 K at around the peak luminosity. We find that the rapid rise and luminous peak found in the optical light curve of SN 2011kl, which is associated with the ultra-long GRB 111209A, can be explained as the cooling phase of the extended progenitor. The ultra-long GRB progenitors proposed in Marchant & Moriya (2020) can explain both the ultra-long GRB duration and the accompanying SN properties. When the GRB jet is off-axis or choked, the luminous SNe could be observed as fast blue optical transients without accompanying GRBs. (abridged)


title: Toward porting Astrophysics Visual Analytics Services to the European Open Science Cloud

abstract: The European Open Science Cloud (EOSC) aims to create a federated environment for hosting and processing research data to support science in all disciplines without geographical boundaries, such that data, software, methods and publications can be shared as part of an Open Science community of practice. This work presents the ongoing activities related to the implementation of visual analytics services, integrated into EOSC, towards addressing the diverse astrophysics user communities needs. These services rely on visualisation to manage the data life cycle process under FAIR principles, integrating data processing for imaging and multidimensional map creation and mosaicing, and applying machine learning techniques for detection of structures in large scale multidimensional maps.


title: Dynamics of cascades on burstiness-controlled temporal networks

abstract: Burstiness, the tendency of interaction events to be heterogeneously distributed in time, is critical to information diffusion in physical and social systems. However, an analytical framework capturing the effect of burstiness on generic dynamics is lacking. We develop a master equation formalism to study cascades on temporal networks with burstiness modelled by renewal processes. Supported by numerical and data-driven simulations, we describe the interplay between heterogeneous temporal interactions and models of threshold-driven and epidemic spreading. We find that increasing interevent time variance can both accelerate and decelerate spreading for threshold models, but can only decelerate epidemic spreading. When accounting for the skewness of different interevent time distributions, spreading times collapse onto a universal curve. Our framework uncovers a deep yet subtle connection between generic diffusion mechanisms and underlying temporal network structures that impacts on a broad class of networked phenomena, from spin interactions to epidemic contagion and language dynamics.


title: Sign of Fourier coefficients of half-integral weight modular forms in arithmetic progressions

abstract: Let $f$ be a half-integral weight cusp form of level $4N$ for odd and squarefree $N$ and let $a(n)$ denote its $n^{\rm th}$ normalized Fourier coefficient. Assuming that all the coefficients $a(n)$ are real, we study the sign of $a(n)$ when $n$ runs through an arithmetic progression. As a consequence, we establish a lower bound for the number of integers $n\le x$ such that $a(n)>n^{-\alpha}$ where $x$ and $\alpha$ are positive and $f$ is not necessarily a Hecke eigenform.


title: ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing

abstract: Computational biology and bioinformatics provide vast data gold-mines from protein sequences, ideal for Language Models taken from NLP. These LMs reach for new prediction frontiers at low inference costs. Here, we trained two auto-regressive models (Transformer-XL, XLNet) and four auto-encoder models (BERT, Albert, Electra, T5) on data from UniRef and BFD containing up to 393 billion amino acids. The LMs were trained on the Summit supercomputer using 5616 GPUs and TPU Pod up-to 1024 cores. Dimensionality reduction revealed that the raw protein LM-embeddings from unlabeled data captured some biophysical features of protein sequences. We validated the advantage of using the embeddings as exclusive input for several subsequent tasks. The first was a per-residue prediction of protein secondary structure (3-state accuracy Q3=81%-87%); the second were per-protein predictions of protein sub-cellular localization (ten-state accuracy: Q10=81%) and membrane vs. water-soluble (2-state accuracy Q2=91%). For the per-residue predictions the transfer of the most informative embeddings (ProtT5) for the first time outperformed the state-of-the-art without using evolutionary information thereby bypassing expensive database searches. Taken together, the results implied that protein LMs learned some of the grammar of the language of life. To facilitate future work, we released our models at https://github.com/agemagician/ProtTrans.


title: AMITE: A Novel Polynomial Expansion for Analyzing Neural Network Nonlinearities

abstract: Polynomial expansions are important in the analysis of neural network nonlinearities. They have been applied thereto addressing well-known difficulties in verification, explainability, and security. Existing approaches span classical Taylor and Chebyshev methods, asymptotics, and many numerical approaches. We find that while these individually have useful properties such as exact error formulas, adjustable domain, and robustness to undefined derivatives, there are no approaches that provide a consistent method yielding an expansion with all these properties. To address this, we develop an analytically modified integral transform expansion (AMITE), a novel expansion via integral transforms modified using derived criteria for convergence. We show the general expansion and then demonstrate application for two popular activation functions, hyperbolic tangent and rectified linear units. Compared with existing expansions (i.e., Chebyshev, Taylor, and numerical) employed to this end, AMITE is the first to provide six previously mutually exclusive desired expansion properties such as exact formulas for the coefficients and exact expansion errors (Table II). We demonstrate the effectiveness of AMITE in two case studies. First, a multivariate polynomial form is efficiently extracted from a single hidden layer black-box Multi-Layer Perceptron (MLP) to facilitate equivalence testing from noisy stimulus-response pairs. Second, a variety of Feed-Forward Neural Network (FFNN) architectures having between 3 and 7 layers are range bounded using Taylor models improved by the AMITE polynomials and error formulas. AMITE presents a new dimension of expansion methods suitable for analysis/approximation of nonlinearities in neural networks, opening new directions and opportunities for the theoretical analysis and systematic testing of neural networks.


title: Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detection

abstract: The main purpose of RGB-D salient object detection (SOD) is how to better integrate and utilize cross-modal fusion information. In this paper, we explore these issues from a new perspective. We integrate the features of different modalities through densely connected structures and use their mixed features to generate dynamic filters with receptive fields of different sizes. In the end, we implement a kind of more flexible and efficient multi-scale cross-modal feature processing, i.e. dynamic dilated pyramid module. In order to make the predictions have sharper edges and consistent saliency regions, we design a hybrid enhanced loss function to further optimize the results. This loss function is also validated to be effective in the single-modal RGB SOD task. In terms of six metrics, the proposed method outperforms the existing twelve methods on eight challenging benchmark datasets. A large number of experiments verify the effectiveness of the proposed module and loss function. Our code, model and results are available at \url{https://github.com/lartpang/HDFNet}.


title: Kinematics and dynamics of freely rising spheroids at high Reynolds numbers

abstract: We experimentally investigate the effect of geometrical anisotropy for buoyant ellipsoidal particles rising in a still fluid. All other parameters, such as the Galileo number $Ga \approx 6000$ and the particle density ratio $\Gamma \approx 0.53$ are kept constant. The geometrical aspect ratio, $\chi$, of the particle is varied systematically from $\chi$ = 0.2 (oblate) to 5 (prolate). Based on tracking all degrees of particle motion, we identify six regimes characterised by distinct rise dynamics. Firstly, for $0.83 \le \chi \le 1.20$, increased rotational dynamics are observed and the particle flips over semi-regularly in a "tumbling"-like motion. Secondly, for oblate particles with $0.29 \le \chi \le 0.75$, planar regular "zig-zag" motion is observed, where the drag coefficient is independent of $\chi$. Thirdly, for the most extreme oblate geometries ($\chi \le 0.25$) a "flutter"-like behaviour is found, characterised by precession of the oscillation plane and an increase in the drag coefficient. For prolate geometries, we observed two coexisting oscillation modes that contribute to complex trajectories: the first is related to oscillations of the pointing vector and the second corresponds to a motion perpendicular to the particle's symmetry axis. We identify a "longitudinal" regime ($1.33 \le \chi \le 2.5$), where both modes are active and a different one, the "broadside"-regime ($3 \le \chi\le 4$), where only the second mode is present. Remarkably, for the most prolate particles ($\chi = 5$), we observe an entirely different "helical" rise with completely unique features.


title: Deep Claim: Payer Response Prediction from Claims Data with Deep Learning

abstract: Each year, almost 10% of claims are denied by payers (i.e., health insurance plans). With the cost to recover these denials and underpayments, predicting payer response (likelihood of payment) from claims data with a high degree of accuracy and precision is anticipated to improve healthcare staffs' performance productivity and drive better patient financial experience and satisfaction in the revenue cycle (Barkholz, 2017). However, constructing advanced predictive analytics models has been considered challenging in the last twenty years. That said, we propose a (low-level) context-dependent compact representation of patients' historical claim records by effectively learning complicated dependencies in the (high-level) claim inputs. Built on this new latent representation, we demonstrate that a deep learning-based framework, Deep Claim, can accurately predict various responses from multiple payers using 2,905,026 de-identified claims data from two US health systems. Deep Claim's improvements over carefully chosen baselines in predicting claim denials are most pronounced as 22.21% relative recall gain (at 95% precision) on Health System A, which implies Deep Claim can find 22.21% more denials than the best baseline system.


title: Using LSTM for the Prediction of Disruption in ADITYA Tokamak

abstract: Major disruptions in tokamak pose a serious threat to the vessel and its surrounding pieces of equipment. The ability of the systems to detect any behavior that can lead to disruption can help in alerting the system beforehand and prevent its harmful effects. Many machine learning techniques have already been in use at large tokamaks like JET and ASDEX, but are not suitable for ADITYA, which is comparatively small. Through this work, we discuss a new real-time approach to predict the time of disruption in ADITYA tokamak and validate the results on an experimental dataset. The system uses selected diagnostics from the tokamak and after some pre-processing steps, sends them to a time-sequence Long Short-Term Memory (LSTM) network. The model can make the predictions 12 ms in advance at less computation cost that is quick enough to be deployed in real-time applications.