title: Stopping Active Learning based on Predicted Change of F Measure for Text Classification

abstract: During active learning, an effective stopping method allows users to limit the number of annotations, which is cost effective. In this paper, a new stopping method called Predicted Change of F Measure will be introduced that attempts to provide the users an estimate of how much performance of the model is changing at each iteration. This stopping method can be applied with any base learner. This method is useful for reducing the data annotation bottleneck encountered when building text classification systems.


title: Eigenvalues of quantum walk induced by recurrence properties of the underlying birth and death process: application to computation of an edge state

abstract: In this paper, we consider an extended coined Szegedy model and discuss the existence of the point spectrum of induced quantum walks in terms of recurrence properties of the underlying birth and death process. We obtain that if the underlying random walk is not null recurrent, then the point spectrum exists in the induced quantum walks. As an application, we provide a simple computational way of the dispersion relation of the edge state part for the topological phase model driven by quantum walk using the recurrence properties of underlying birth and death process.


title: Algebraic Systems for DNA Origami Motivated from Temperley-Lieb Algebras

abstract: We initiate an algebraic approach to study DNA origami structures by associating an element from a monoid to each structure. We identify two types of basic building blocks and describe an DNA origami structure with their composition. These building blocks are taken as generators of a monoid, called origami monoid, and, motivated by the well studied Temperley-Lieb algebras, we identify a set of relations that characterize the origami monoid. We also present several observations about the Green's relations for the origami monoid and study the relations to a cross product of Jones monoids that is a morphic image of an origami monoid.


title: Optimization along Families of Periodic and Quasiperiodic Orbits in Dynamical Systems with Delay

abstract: This paper generalizes a previously-conceived, continuation-based optimization technique for scalar objective functions on constraint manifolds to cases of periodic and quasiperiodic solutions of delay-differential equations. A Lagrange formalism is used to construct adjoint conditions that are linear and homogenous in the unknown Lagrange multipliers. As a consequence, it is shown how critical points on the constraint manifold can be found through several stages of continuation along a sequence of connected one-dimensional manifolds of solutions to increasing subsets of the necessary optimality conditions. Due to the presence of delayed and advanced arguments in the original and adjoint differential equations, care must be taken to determine the degree of smoothness of the Lagrange multipliers with respect to time. Such considerations naturally lead to a formulation in terms of multi-segment boundary-value problems (BVPs), including the possibility that the number of segments may change, or that their order may permute, during continuation. The methodology is illustrated using the software package coco on periodic orbits of both linear and nonlinear delay-differential equations, keeping in mind that closed-form solutions are not typically available even in the linear case. Finally, we demonstrate optimization on a family of quasiperiodic invariant tori in an example unfolding of a Hopf bifurcation with delay and parametric forcing. The quasiperiodic case is a further original contribution to the literature on optimization constrained by partial differential BVPs.


title: Large time behaviour of solutions to the 3D-NSE in $\mathcal X^{\sigma}$ spaces

abstract: In this paper we study the incompressible Navier-Stokes equations in $L^2(\mathbb R^3)\cap\mathcal X^{-1}(\mathbb R^3)$. In the global existence case, we establish that if the solution $u$ is in the space $C(\mathbb R^+,L^2\cap\mathcal X^{-1})$, then for $\sigma>-3/2$ the decay of $\|u(t)\|_{\mathcal X^\sigma}$ is at least of the order of $t^{-\frac{\sigma+\frac{3}{2}}{2}}$. Fourier analysis and standard techniques are used.


title: Kinematics of Circumgalactic Gas: Feeding Galaxies and Feedback

abstract: We present observations of 50 pairs of redshift z ~ 0.2 star-forming galaxies and background quasars. These sightlines probe the circumgalactic medium (CGM) out to half the virial radius, and we describe the circumgalactic gas kinematics relative to the reference frame defined by the galactic disks. We detect halo gas in MgII absorption, measure the equivalent-width-weighted Doppler shifts relative to each galaxy, and find that the CGM has a component of angular momentum that is aligned with the galactic disk. No net counter-rotation of the CGM is detected within 45 degrees of the major axis at any impact parameter. The velocity offset of the circumgalactic gas correlates with the projected rotation speed in the disk plane out to disk radii of roughly 70 kpc. We confirm previous claims that the MgII absorption becomes stronger near the galactic minor axis and show that the equivalent width correlates with the velocity range of the absorption. We cannot directly measure the location of any absorber along the sightline, but we explore the hypothesis that individual velocity components can be associated with gas orbiting in the disk plane or flowing radially outward in a conical outflow. We conclude that centrifugal forces partially support the low-ionization gas and galactic outflows kinematically disturb the CGM producing excess absorption. Our results firmly rule out schema for the inner CGM that lack rotation and suggest that angular momentum as well as galactic winds should be included in any viable model for the low-redshift CGM.


title: DeepSZ: A Novel Framework to Compress Deep Neural Networks by Using Error-Bounded Lossy Compression

abstract: DNNs have been quickly and broadly exploited to improve the data analysis quality in many complex science and engineering applications. Today's DNNs are becoming deeper and wider because of increasing demand on the analysis quality and more and more complex applications to resolve. The wide and deep DNNs, however, require large amounts of resources, significantly restricting their utilization on resource-constrained systems. Although some network simplification methods have been proposed to address this issue, they suffer from either low compression ratios or high compression errors, which may introduce a costly retraining process for the target accuracy. In this paper, we propose DeepSZ: an accuracy-loss bounded neural network compression framework, which involves four key steps: network pruning, error bound assessment, optimization for error bound configuration, and compressed model generation, featuring a high compression ratio and low encoding time. The contribution is three-fold. (1) We develop an adaptive approach to select the feasible error bounds for each layer. (2) We build a model to estimate the overall loss of accuracy based on the accuracy degradation caused by individual decompressed layers. (3) We develop an efficient optimization algorithm to determine the best-fit configuration of error bounds in order to maximize the compression ratio under the user-set accuracy constraint. Experiments show that DeepSZ can compress AlexNet and VGG-16 on the ImageNet by a compression ratio of 46X and 116X, respectively, and compress LeNet-300-100 and LeNet-5 on the MNIST by a compression ratio of 57X and 56X, respectively, with only up to 0.3% loss of accuracy. Compared with other state-of-the-art methods, DeepSZ can improve the compression ratio by up to 1.43X, the DNN encoding performance by up to 4.0X (with four Nvidia Tesla V100 GPUs), and the decoding performance by up to 6.2X.


title: The informal semantics of Answer Set Programming: A Tarskian perspective

abstract: In Knowledge Representation, it is crucial that knowledge engineers have a good understanding of the formal expressions that they write. What formal expressions state intuitively about the domain of discourse is studied in the theory of the informal semantics of a logic. In this paper we study the informal semantics of Answer Set Programming. The roots of answer set programming lie in the language of Extended Logic Programming, which was introduced initially as an epistemic logic for default and autoepistemic reasoning. In 1999, the seminal papers on answer set programming proposed to use this logic for a different purpose, namely, to model and solve search problems. Currently, the language is used primarily in this new role. However, the original epistemic intuitions lose their explanatory relevance in this new context. How answer set programs are connected to the specifications of problems they model is more easily explained in a classical Tarskian semantics, in which models correspond to possible worlds, rather than to belief states of an epistemic agent. In this paper, we develop a new theory of the informal semantics of answer set programming, which is formulated in the Tarskian setting and based on Frege's compositionality principle. It differs substantially from the earlier epistemic theory of informal semantics, providing a different view on the meaning of the connectives in answer set programming and on its relation to other logics, in particular classical logic.


title: The Use of Unlabeled Data versus Labeled Data for Stopping Active Learning for Text Classification

abstract: Annotation of training data is the major bottleneck in the creation of text classification systems. Active learning is a commonly used technique to reduce the amount of training data one needs to label. A crucial aspect of active learning is determining when to stop labeling data. Three potential sources for informing when to stop active learning are an additional labeled set of data, an unlabeled set of data, and the training data that is labeled during the process of active learning. To date, no one has compared and contrasted the advantages and disadvantages of stopping methods based on these three information sources. We find that stopping methods that use unlabeled data are more effective than methods that use labeled data.


title: Strong Equivalence and Program Structure in Arguing Essential Equivalence between Logic Programs

abstract: Answer set programming is a prominent declarative programming paradigm used in formulating combinatorial search problems and implementing different knowledge representation formalisms. Frequently, several related and yet substantially different answer set programs exist for a given problem. Sometimes these encodings may display significantly different performance. Uncovering precise formal links between these programs is often important and yet far from trivial. This paper presents formal results carefully relating a number of interesting program rewritings. It also provides the proof of correctness of system Projector concerned with automatic program rewritings for the sake of efficiency. Under consideration in Theory and Practice of Logic Programming (TPLP).


title: Language Model Pre-training for Hierarchical Document Representations

abstract: Hierarchical neural architectures are often used to capture long-distance dependencies and have been applied to many document-level tasks such as summarization, document segmentation, and sentiment analysis. However, effective usage of such a large context can be difficult to learn, especially in the case where there is limited labeled data available. Building on the recent success of language model pretraining methods for learning flat representations of text, we propose algorithms for pre-training hierarchical document representations from unlabeled data. Unlike prior work, which has focused on pre-training contextual token representations or context-independent {sentence/paragraph} representations, our hierarchical document representations include fixed-length sentence/paragraph representations which integrate contextual information from the entire documents. Experiments on document segmentation, document-level question answering, and extractive document summarization demonstrate the effectiveness of the proposed pre-training algorithms.


title: Optimal $k$-Coverage Charging Problem

abstract: Wireless rechargeable sensor networks, consisting of sensor nodes with rechargeable batteries and mobile chargers to replenish their batteries, have gradually become a promising solution to the bottleneck of energy limitation that hinders the wide deployment of wireless sensor networks (WSN). In this paper, we focus on the mobile charger scheduling and path optimization scenario in which the $k$-coverage ability of a network system needs to be maintained. We formulate the optimal $k$-coverage charging problem of finding a feasible path for a mobile charger to charge a set of sensor nodes within their estimated charging deadlines under the constraint of maintaining the $k$-coverage ability of the network system, with an objective of minimizing the energy consumption on traveling per tour. We show the hardness of the problem that even finding a feasible path for the trivial case of the problem is an NP-complete one. We model the problem and apply dynamic programming to design an algorithm that finds an exact solution to the optimal $k$-coverage charging problem. However, the computational complexity is still prohibitive for large size networks. We then introduce Deep Q-learning, a reinforcement learning algorithm to tackle the problem.


title: Rare Low-Energy Event Searches with the Majorana Demonstrator

abstract: The Majorana Demonstrator is currently searching for neutrinoless double-beta decay in $^{76}$Ge and will demonstrate the feasibility to deploy a tonne-scale experiment in a phased and modular fashion. It consists of two modular arrays of natural and $^{76}$Ge-enriched germanium detectors totaling 44.1 kg, of which 29.7 kg is enriched, located at the 4850' level of the Sanford Underground Research Facility in Lead, South Dakota, USA. The low-backgrounds and low trigger thresholds ($<$1 keV) achieved by the Demonstrator allow for additional rare-event searches at low-energies, e.g. searches for WIMPs, bosonic dark matter, and solar axions. In this work, we will present results and ongoing efforts related to these rare-event searches and discuss the future reach of Majorana.


title: Field-induced quantum spin liquid in the Kitaev-Heisenberg model and its relation to $\alpha$-RuCl$_3$

abstract: Recently considerable excitement has arisen due to the experimental observation of a field-induced spin liquid phase in the compound $\alpha$-RuCl$_3$. However, the nature of this putative spin liquid phase and the relevant microscopic model Hamiltonian remain still unclear. In this work, we address these questions by performing large-scale numerical simulations of a generalized Kitaev-Heisenberg model proposed to describe the physics of $\alpha$-RuCl$_3$. While there is no evidence for an intermediate phase for in-plane magnetic fields, our results strongly suggest that a stable intermediate spin liquid phase, sandwiched between a magnetically ordered phase at low fields and a high-field polarized phase, can be induced by out-of-plane magnetic fields. Moreover, we show that this field-induced spin liquid phase can be smoothly connected to a spin liquid possessing a spinon Fermi surface as proposed recently for the Kitaev model. The relevance of our results to $\alpha$-RuCl$_3$ is also discussed.


title: Transient growth analysis of oblique shock wave/boundary-layer interactions at Mach 5.92

abstract: We study physical mechanisms that trigger transient growth in a high-speed spatially-developing laminar boundary layer that interacts with an oblique shock wave. We utilize an approach based on power-iteration, with the global forward and adjoint linearized equations, to quantify the transient growth in compressible boundary layers with flow separation. For a Mach 5.92 boundary layer with no oblique shock wave, we show that the dominant transient response consists of oblique waves, which arise from the inviscid Orr mechanism, the lift-up effect, and the first-mode instability. We also demonstrate that the presence of the oblique shock wave significantly increases transient growth over short time intervals through a mechanism that is not related to a slowly growing global instability. The resulting response takes the form of spanwise periodic streamwise elongated streaks and our analysis of the linearized inviscid transport equations shows that base flow deceleration near the reattachment location contributes to their amplification. The large transient growth of streamwise streaks demonstrates the importance of non-modal effects in the amplification of flow perturbations and identifies a route for the emergence of similar spatial structures in transitional hypersonic flows with shock wave/boundary-layers interaction.


title: VQNet: Library for a Quantum-Classical Hybrid Neural Network

abstract: Deep learning is a modern approach to realize artificial intelligence. Many frameworks exist to implement the machine learning task; however, performance is limited by computing resources. Using a quantum computer to accelerate training is a promising approach. The variational quantum circuit (VQC) has gained a great deal of attention because it can be run on near-term quantum computers. In this paper, we establish a new framework that merges traditional machine learning tasks with the VQC. Users can implement a trainable quantum operation into a neural network. This framework enables the training of a quantum-classical hybrid task and may lead to a new area of quantum machine learning.


title: Stacking and stability

abstract: Stacking is a general approach for combining multiple models toward greater predictive accuracy. It has found various application across different domains, ensuing from its meta-learning nature. Our understanding, nevertheless, on how and why stacking works remains intuitive and lacking in theoretical insight. In this paper, we use the stability of learning algorithms as an elemental analysis framework suitable for addressing the issue. To this end, we analyze the hypothesis stability of stacking, bag-stacking, and dag-stacking and establish a connection between bag-stacking and weighted bagging. We show that the hypothesis stability of stacking is a product of the hypothesis stability of each of the base models and the combiner. Moreover, in bag-stacking and dag-stacking, the hypothesis stability depends on the sampling strategy used to generate the training set replicates. Our findings suggest that 1) subsampling and bootstrap sampling improve the stability of stacking, and 2) stacking improves the stability of both subbagging and bagging.


title: Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks

abstract: Much of the focus in the area of knowledge distillation has been on distilling knowledge from a larger teacher network to a smaller student network. However, there has been little research on how the concept of distillation can be leveraged to distill the knowledge encapsulated in the training data itself into a reduced form. In this study, we explore the concept of progressive label distillation, where we leverage a series of teacher-student network pairs to progressively generate distilled training data for learning deep neural networks with greatly reduced input dimensions. To investigate the efficacy of the proposed progressive label distillation approach, we experimented with learning a deep limited vocabulary speech recognition network based on generated 500ms input utterances distilled progressively from 1000ms source training data, and demonstrated a significant increase in test accuracy of almost 78% compared to direct learning.


title: Graphical-model based estimation and inference for differential privacy

abstract: Many privacy mechanisms reveal high-level information about a data distribution through noisy measurements. It is common to use this information to estimate the answers to new queries. In this work, we provide an approach to solve this estimation problem efficiently using graphical models, which is particularly effective when the distribution is high-dimensional but the measurements are over low-dimensional marginals. We show that our approach is far more efficient than existing estimation techniques from the privacy literature and that it can improve the accuracy and scalability of many state-of-the-art mechanisms.


title: On the topological structure of the Hahn field and convergence of power series

abstract: In this paper, we study the topological structure of the Hahn field whose elements are functions from the additive abelian group of rational numbers to the real numbers field, with well-ordered support. After reviewing the algebraic and order structures of the Hahn field, we introduce different vector topologies that are induced by families of semi-norms and all of which are weaker than the order or valuation topology. We compare those vector topologies and we identify the weakest one whose properties are similar to those of the weak topology on the Levi-Civita field. In particular, we state and prove a convergence criterion for power series that is similar to that for power series on the Levi-Civita field in its weak topology


title: On doubly robust estimation for logistic partially linear models

abstract: Consider a logistic partially linear model, in which the logit of the mean of a binary response is related to a linear function of some covariates and a nonparametric function of other covariates. We derive simple, doubly robust estimators of coefficient for the covariates in the linear component of the partially linear model. Such estimators remain consistent if either a nuisance model is correctly specified for the nonparametric component, or another nuisance model is correctly specified for the means of the covariates of interest given other covariates and the response at a fixed value. In previous works, conditional density models are needed for the latter purposes unless a scalar, binary covariate is handled. We also propose two specific doubly robust estimators: one is locally-efficient like in our class of doubly robust estimators and the other is numerically and statistically simpler and can achieve reasonable efficiency especially when the true coefficients are close to 0.


title: Evidence for bimodal orbital separations of white dwarf-red dwarf binary stars

abstract: We present the results of a radial velocity survey of 20 white dwarf plus M dwarf binaries selected as a follow up to a \textit{Hubble Space Telescope} study that aimed to spatially resolve suspected binaries. Our candidates are taken from the list of targets that were spatially unresolved with \textit{Hubble}. We have determined the orbital periods for 16 of these compact binary candidates. The period distribution ranges from 0.14 to 9.16\,d and peaks near 0.6\,d. The original sample therefore contains two sets of binaries, wide orbits ($\approx100-1000$\,au) and close orbits ($\lesssim1-10$\,au), with no systems found in the $\approx10-100$\,au range. This observational evidence confirms the bimodal distribution predicted by population models and is also similar to results obtained in previous studies. We find no binary periods in the months to years range, supporting the post common envelope evolution scenario. One of our targets, WD\,1504+546, was discovered to be an eclipsing binary with a period of 0.93\,d.


title: Detailed balance, local detailed balance, and global potential for stochastic chemical reaction networks

abstract: Detailed balance of a chemical reaction network can be defined in several different ways. Here we investigate the relationship among four types of detailed balance conditions: deterministic, stochastic, local, and zero-order local detailed balance. We show that the four types of detailed balance are equivalent when different reactions lead to different species changes and are not equivalent when some different reactions lead to the same species change. Under the condition of local detailed balance, we further show that the system has a global potential defined over the whole space, which plays the central role in the large deviation theory and the Freidlin-Wentzell-type metastability theory of chemical reaction networks. Finally, we provide a new sufficient condition for stochastic detailed balance, which is applied to construct a class of high-dimensional chemical reaction networks that both satisfies stochastic detailed balance and displays multistability.


title: Quantum vortex core and missing pseudogap in the multi-band BCS-BEC-crossover superconductor FeSe

abstract: FeSe is argued as a superconductor in the Bardeen-Cooper-Schrieffer Bose-Einstein-condensation crossover regime where the superconducting-gap size and the superconducting transition temperature Tc are comparable to the Fermi energy. In this regime, vortex bound states should be well quantized and the preformed pairs above Tc may yield a pseudogap in the quasiparticle-excitation spectrum. We performed spectroscopic-imaging scanning tunneling microscopy to search for these features. We found Friedel-like oscillations near the vortex, which manifest the quantized levels, whereas the pseudogap was not detected. These apparently conflicting observations may be related to the multi-band nature of FeSe.


title: The Excited Charmonium Production in $e^{+}e^{-}$ Annihilation

abstract: We calculate the form factor and cross section of the excited charmonium production process $e^{+}+e^{-}\rightarrow \psi \left ( 2S \right )+\eta _{c}$ by light-cone sum rules. In our method, the form factor depends on the distribution amplitude of $\eta _{c}$ meson. Experimentally, the energy scale of $e^{+}+e^{-}\rightarrow \psi \left ( 2S \right )+\eta _{c}$ process is much larger than the initial energy scale of $\eta _{c}$ meson in our BHL model. Therefore, we further consider the evolution of the distribution amplitude with the energy scale, and select the distribution amplitude as our input parameter when the final effective energy scale is $\mu=5.00\ GeV$. This treatment means that we have chosen the relativistic distribution amplitude. The results show that the relativistic effect contributes greatly to the form factor and cross section. Our results are consistent with Belle experimental data.


title: A Study on Neural Network Architecture Applied to the Prediction of Brazilian Stock Returns

abstract: In this paper we present a statistical analysis about the characteristics that we intend to influence in the performance of the neural networks in terms of assertiveness in the prediction of Brazilian stock returns. We created a population of architectures for analysis and extracted the sample that had the best assertive performance. It was verified how the characteristics of this sample stand out and affect the neural networks. In addition, we make inferences about what kind of influence the different architectures have on the performance of neural networks. In the study, the prediction of the return of a Brazilian stock traded on the stock exchange of S\~ao Paulo to measure the error committed by the different architectures of constructed neural networks. The results are promising and indicate that some aspects of the neural network architecture have a significant impact on the assertiveness of the model.


title: Probing cosmic acceleration by strong gravitational lensing systems

abstract: Recently, some divergent conclusions about cosmic acceleration were obtained using type Ia supernovae (SNe Ia), with opposite assumptions on the intrinsic luminosity evolution. In this paper, we use strong gravitational lensing systems to probe the cosmic acceleration. Since the theory of strong gravitational lensing is established certainly, and the Einstein radius is determined by stable cosmic geometry. We study two cosmological models, $\Lambda$CDM and power-law models, through 152 strong gravitational lensing systems, incorporating with 30 Hubble parameters $H(z)$ and 11 baryon acoustic oscillation (BAO) measurements. Bayesian evidence are introduced to make a one-on-one comparison between cosmological models. Basing on Bayes factors $\ln B$ of flat $\Lambda$CDM versus power-law and $R_{h}=ct$ models are $\ln B>5$, we find that the flat $\Lambda$CDM is strongly supported by the combination of the datasets. Namely, an accelerating cosmology with non power-law expansion is preferred by our numeration.


title: Volatility Models Applied to Geophysics and High Frequency Financial Market Data

abstract: This work is devoted to the study of modeling geophysical and financial time series. A class of volatility models with time-varying parameters is presented to forecast the volatility of time series in a stationary environment. The modeling of stationary time series with consistent properties facilitates prediction with much certainty. Using the GARCH and stochastic volatility model, we forecast one-step-ahead suggested volatility with +/- 2 standard prediction errors, which is enacted via Maximum Likelihood Estimation. We compare the stochastic volatility model relying on the filtering technique as used in the conditional volatility with the GARCH model. We conclude that the stochastic volatility is a better forecasting tool than GARCH (1, 1), since it is less conditioned by autoregressive past information.


title: End-to-End Multi-Task Denoising for joint SDR and PESQ Optimization

abstract: Supervised learning based on a deep neural network recently has achieved substantial improvement on speech enhancement. Denoising networks learn mapping from noisy speech to clean one directly, or to a spectrum mask which is the ratio between clean and noisy spectra. In either case, the network is optimized by minimizing mean square error (MSE) between ground-truth labels and time-domain or spectrum output. However, existing schemes have either of two critical issues: spectrum and metric mismatches. The spectrum mismatch is a well known issue that any spectrum modification after short-time Fourier transform (STFT), in general, cannot be fully recovered after inverse short-time Fourier transform (ISTFT). The metric mismatch is that a conventional MSE metric is sub-optimal to maximize our target metrics, signal-to-distortion ratio (SDR) and perceptual evaluation of speech quality (PESQ). This paper presents a new end-to-end denoising framework with the goal of joint SDR and PESQ optimization. First, the network optimization is performed on the time-domain signals after ISTFT to avoid spectrum mismatch. Second, two loss functions which have improved correlations with SDR and PESQ metrics are proposed to minimize metric mismatch. The experimental result showed that the proposed denoising scheme significantly improved both SDR and PESQ performance over the existing methods.


title: Robust p-orbital half-metallicity and high Curie-temperature in the hole-doped anisotropic TcS2 (X=S, Se) nanosheets

abstract: Here, we study the magnetism of the distorted 1T-TcX2 (X=S,Se) based on first-principles calculation. The magnetism originates from the hole doping due to the density of states near the valence band edge having van Hove singularity feature. The calculated results show that the TcS2 monolayer can develop an interesting ferromagnetic (FM) half-metallic phase with tunable spin-polarization orientation. The FM half-metallicity and magnetic moments of the hole-doped TcS2 monolayer are primarily derived from the p orbital of S atoms, then, a FM ground phase with a high Curie temperature (Tc) (larger than 800 K) is obtained due to the strong Sp-Sp direct exchange interaction. The magnetic order is robust against thermal excitations at finite temperatures because of magnetic anisotropic energy. In the TcS2 bilayer, the electrons near Fermi level are redistributed when introducing the interlayer interaction, which suppresses the ferromagnetism induced by hole doping. The ferromagnetism can be recovered when the interlayer interaction is weakened.


title: The Beauville-Narasimhan-Ramanan correspondence for twisted Higgs $V$-bundles and components of parabolic $\text{Sp}(2n,\mathbb{R})$-Higgs moduli Spaces

abstract: We generalize the classical Beauville-Narasimhan-Ramanan correspondence to the case of parabolic Higgs bundles with regular singularities and Higgs $V$-bundles. Using this correspondence along with Bott-Morse theoretic techniques we provide an exact component count for moduli spaces of maximal parabolic $\text{Sp}\left( 2n,\mathbb{R} \right)$-Higgs bundles with fixed parabolic structure.


title: Escaping Saddle Points with Adaptive Gradient Methods

abstract: Adaptive methods such as Adam and RMSProp are widely used in deep learning but are not well understood. In this paper, we seek a crisp, clean and precise characterization of their behavior in nonconvex settings. To this end, we first provide a novel view of adaptive methods as preconditioned SGD, where the preconditioner is estimated in an online manner. By studying the preconditioner on its own, we elucidate its purpose: it rescales the stochastic gradient noise to be isotropic near stationary points, which helps escape saddle points. Furthermore, we show that adaptive methods can efficiently estimate the aforementioned preconditioner. By gluing together these two components, we provide the first (to our knowledge) second-order convergence result for any adaptive method. The key insight from our analysis is that, compared to SGD, adaptive methods escape saddle points faster, and can converge faster overall to second-order stationary points.


title: On identifying magnetized anomalies using geomagnetic monitoring II. A Magnetohydrodynamic Model

abstract: This paper is a continuation and an extension of our recent work [13] on the identification of magnetized anomalies using geomagnetic monitoring, which aims to establish a rigorous mathematical theory for the geomagnetic detection technology. Suppose a collection of magnetized anomalies is presented in the shell of the Earth. By monitoring the variation of the magnetic field of the Earth due to the presence of the anomalies, we establish sufficient conditions for the unique recovery of those unknown anomalies. In [13], the geomagnetic model was described by a linear Maxwell system. In this paper, we consider a much more sophisticated and complicated magnetohydrodynamic model, which stems from the widely accepted dynamo theory of geomagnetics.


title: Critical Entanglement for the Half-Filled Extended Hubbard Model

abstract: We study the ground state of the one-dimensional extended Hubbard model at half-filling using the entanglement entropy calculated by Density Matrix Renormalization Group (DMRG) techniques. We apply a novel curve fitting and scaling method to accurately identify a $2^{nd}$ order critical point as well as a Berezinskii-Kosterlitz-Thouless (BKT) critical point. Using open boundary conditions and medium-sized lattices with very small truncation errors, we are able to achieve similar accuracy to previous authors. We also report observations of finite-size and boundary effects that can be remedied with careful pinning.


title: All optical detection of picosecond spin-wave dynamics in two-dimensional annular antidot lattice

abstract: Novel magnetic structures with precisely controlled dimensions and shapes at the nanoscale have potential applications in spin logic, spintronics and other spin-based communication devices. We report the fabrication of two-dimensional bi-structure magnonic crystal in the form of embedded nanodots in a periodic Ni80Fe20 antidot lattice structure (annular antidot) by focused ion-beam lithography. The spin-wave spectra of the annular antidot sample,studied for the first time by a time-resolved magneto-optic Kerr effect microscopy show a remarkable variation with bias field, which is important for the above device applications. The optically induced spin-wave spectra show multiple modes in the frequency range 14.7 GHz to 3.5 GHz due to collective interactions between the dots and antidots as well as the annular elements within the whole array. Numerical simulations qualitatively reproduce the experimental results, and simulated mode profiles reveal the spatial distribution of the spin wave modes and internal magnetic fields responsible for these observations. It is observed that the internal field strength increases by about 200 Oe inside each dot embedded within the hole of annular antidot lattice as compared to pure antidot lattice and pure dot lattice. The stray field for the annular antidot lattice is found to be significant (0.8kOe) as opposed to the negligible values of the same for the pure dot lattice and pure antidot lattice. Our findings open up new possibilities for development of novel artificial crystals.


title: Transverse bifurcation of viscous slow MHD shocks

abstract: We study by a combination of analytical and numerical Evans function techniques multi-D viscous and inviscid stability and associated transverse bifurcation of planar slow Lax MHD shocks in a channel with periodic boundary conditions. Notably, this includes the first multi-D numerical Evans function study for viscous MHD. Our results suggest that, rather than a planar shock, a nonplanar traveling wave with the same normal velocity is the typical mode of propagation in the slow Lax mode. Moreover, viscous and inviscid stability transitions appear to agree, answering (for this particular model and setting) an open question of Zumbrun and Serre.


title: Star Routing: Between Vehicle Routing and Vertex Cover

abstract: We consider an optimization problem posed by an actual newspaper company, which consists of computing a minimum length route for a delivery truck, such that the driver only stops at street crossings, each time delivering copies to all customers adjacent to the crossing. This can be modeled as an abstract problem that takes an unweighted simple graph $G = (V, E)$ and a subset of edges $X$ and asks for a shortest cycle, not necessarily simple, such that every edge of $X$ has an endpoint in the cycle. We show that the decision version of the problem is strongly NP-complete, even if $G$ is a grid graph. Regarding approximate solutions, we show that the general case of the problem is APX-hard, and thus no PTAS is possible unless P $=$ NP. Despite the hardness of approximation, we show that given any $\alpha$-approximation algorithm for metric TSP, we can build a $3\alpha$-approximation algorithm for our optimization problem, yielding a concrete $9/2$-approximation algorithm. The grid case is of particular importance, because it models a city map or some part of it. A usual scenario is having some neighborhood full of customers, which translates as an instance of the abstract problem where almost every edge of $G$ is in $X$. We model this property as $|E - X| = o(|E|)$, and for these instances we give a $(3/2 + \varepsilon)$-approximation algorithm, for any $\varepsilon > 0$, provided that the grid is sufficiently big.


title: Effects of Nanodots Shape and Lattice Constants on the Spin Wave Dynamics of Patterned Permalloy Dots

abstract: Micromagnetic simulations studies on Permalloy (Ni80Fe20) nanodot with different shape and edge-to-edge separation (s) down to 25nm arranged in square lattice are reported. We observe the significant variation of spin-wave (SW) dynamics of nanodots of different shapes (triangular, diamond and hexagon) and of fixed dot diameter 100nm with varying s. Modes for single dot are transformed in an array into multiple quantized, edge and centre modes for different shapes and edge-to-edge separations, with different spin wave frequencies and peak intensities. Specifically, in the triangular dot sample, a broad range of mode frequencies is observed with highest SW frequency 14.7 GHz. For separation less than 100nm, the SW frequencies undergoes significant modification due to the varying nature of the magnetostatic and dipolar interaction in the array while for separation above 100nm, the SW frequency mostly remain constant. The power profiles confirm the nature of the observed modes. The spatial profiles of magnetostatic field are determined by a combination of internal magnetic-field profiles within the nanodots and the magnetostatic fields within the lattice. The inter-dots interaction of magnetostatic field shows dipolar and quadrupole contributions for all the shapes. Interestingly, vortex states with shifted core and polarity are observed in the array for all the shapes at Hbias = 0. Our results provide important understanding about the tunability of SW spectra in the array of triangular, diamond and hexagon shaped nanoelements.


title: Human Pose Estimation using Motion Priors and Ensemble Models

abstract: Human pose estimation in images and videos is one of key technologies for realizing a variety of human activity recognition tasks (e.g., human-computer interaction, gesture recognition, surveillance, and video summarization). This paper presents two types of human pose estimation methodologies; 1) 3D human pose tracking using motion priors and 2) 2D human pose estimation with ensemble modeling.


title: A Reactive-Darwinian Model for the Ultimatum Game: On the Dominance of Moderation in High Diffusion

abstract: We consider a version of the ultimatum game which simultaneously combines reactive and Darwinian aspects with offers in [0,1]. By reactive aspects, we consider the effects that lead the player to change their offer given the previous result. On the other hand, Darwinian aspects correspond to copying a better strategy according to best game payoff when the current player compares with one of their neighbours. Therefore, we consider three different strategies, which govern how the players change their offers: greedy, moderate, and conservative. First, we provide an analytic study of a static version of game, where Darwinian aspects are not considered. Then, by using numerical simulations of a detailed and complete multi-agent system on a two dimensional lattice, we add an extra feature, in which players probabilistically scape from extreme offers (those close to 0 or 1) for obvious reasons. The players are also endowed reciprocity on their gains as proposers, which is reflected on their gains as responders. We also analyse the influence of the player's mobility effects. An analysis of the emergence of coexistence of strategies and changes on the dominant strategies are observed, which in turn depends on the player's mobility rate.


title: An Operad of Non-commutative Independences Defined by Trees

abstract: We study $N$-ary non-commutative notions of independence, which are given by trees and which generalize free, Boolean, and monotone independence. For every rooted subtree $\mathcal{T}$ of the $N$-regular tree, we define the $\mathcal{T}$-free product of $N$ non-commutative probability spaces and we define the $\mathcal{T}$-free additive convolution of $N$ non-commutative laws. These $N$-ary convolution operations form a topological symmetric operad which includes the free, Boolean, monotone, and anti-monotone convolutions, as well as the orthogonal and subordination convolutions. Using the operadic framework, the proof of convolution identities (such as the relation between free, monotone, and subordination convolutions studied by Lenczewski) can be reduced to combinatorial manipulations of trees. We also develop a theory of $\mathcal{T}$-free independence that closely parallels the free, Boolean, and monotone cases, provided that the root vertex has more than one neighbor. In particular, we study the case where the root vertex of $\mathcal{T}$ has $n$ children and each other vertex has $d$ children, and we relate the $\mathcal{T}$-free convolution powers to free and Boolean convolution powers and the Belinschi-Nica semigroup.


title: Causal order as a resource for quantum communication

abstract: In theories of communication, it is usually presumed that the involved parties perform actions in a fixed causal order. However, practical and fundamental reasons can induce uncertainties in the causal order. Here we show that a maximal uncertainty in the causal order forbids asymptotic quantum communication, while still enabling the noisy transfer of classical information. Therefore causal order, like shared entanglement, is an additional resource for communication. The result is formulated within an asymptotic setting for processes with no fixed causal order, which sets a basis for a quantum information theory in general quantum causal structures.


title: Observation of second sound in graphite at temperatures above 100 K

abstract: Wavelike thermal transport in solids, referred to as second sound, has until now been an exotic phenomenon limited to a handful of materials at low temperatures. This has restricted interest in its occurrence and in its potential applications. Through time-resolved optical measurements of thermal transport on 5-20 {\mu}m length scales in graphite, we have made direct observations of second sound at temperatures above 100 K. The results are in qualitative agreement with ab initio calculations that predict wavelike phonon hydrodynamics on ~ 1-{\mu}m length scale up to almost room temperature. The results suggest an important role of second sound in microscale transient heat transport in two-dimensional and layered materials in a wide temperature range.


title: Competitive Online Optimization under Inventory Constraints

abstract: This paper studies online optimization under inventory (budget) constraints. While online optimization is a well-studied topic, versions with inventory constraints have proven difficult. We consider a formulation of inventory-constrained optimization that is a generalization of the classic one-way trading problem and has a wide range of applications. We present a new algorithmic framework, \textsf{CR-Pursuit}, and prove that it achieves the minimal competitive ratio among all deterministic algorithms (up to a problem-dependent constant factor) for inventory-constrained online optimization. Our algorithm and its analysis not only simplify and unify the state-of-the-art results for the standard one-way trading problem, but they also establish novel bounds for generalizations including concave revenue functions. For example, for one-way trading with price elasticity, the \textsf{CR-Pursuit} algorithm achieves a competitive ratio that is within a small additive constant (i.e., 1/3) to the lower bound of $\ln \theta+1$, where $\theta$ is the ratio between the maximum and minimum base prices.


title: A domain decomposition preconditioning for the integral equation formulation of the inverse scattering problem

abstract: We propose domain decomposition preconditioners for the solution of an integral equation formulation of forward and inverse acoustic scattering problems with point scatterers. We study both forward and inverse problems and propose preconditioning techniques to accelerate the iterative solvers. For the forward scattering problem, we extend the domain decomposition based preconditioning techniques presented for partial differential equations in {\em "A restricted additive Schwarz preconditioner for general sparse linear systems", SIAM Journal on Scientific Computing, 21 (1999), pp. 792--797}, to integral equations. We combine this domain decomposition preconditioner with a low-rank correction, which is easy to construct, forming a new preconditioner. For the inverse scattering problem, we use the forward problem preconditioner as a building block for constructing a preconditioner for the Gauss-Newton Hessian. We present numerical results that demonstrate the performance of both preconditioning strategies.


title: Kerr-Newman-NUT-Kiselev black holes in Rastall theory of gravity and Kerr/CFT Correspondence

abstract: We present a new twisted rotating black hole solution by performing Demia{\'n}ski-Newman-Janis algorithm to the electrically and dyonically charged black hole with quintessence in Rastall theory of gravity. Using our black hole solution, we argue that Rastall gravity is not equivalent with Einstein gravity. For further explanation, the black hole properties such as the horizon and ergosphere are studied for which there are some different properties for those theories. Some thermodynamic properties of the black hole solution are also discussed. At the end, considering the Kerr/CFT correspondence is valid for our black hole solution, the central charge from the CFT of this extremal solution is derived.


title: Discrete and generalized phase space techniques in critical quantum spin chains

abstract: We apply the Wigner function formalism from quantum optics via two approaches, Wootters' discrete Wigner function and the generalized Wigner function, to detect quantum phase transitions in critical spin-$\tfrac{1}{2}$ systems. We develop a general formula relating the phase space techniques and the thermodynamical quantities of spin models, which we apply to single, bipartite and multi-partite systems governed by the $XY$ and the $XXZ$ models. Our approach allows us to introduce a novel way to represent, detect, and distinguish first-, second- and infinite-order quantum phase transitions. Furthermore, we show that the factorization phenomena of the $XY$ model is only directly detectable by quantities based on the square root of the bipartite reduced density matrix. We establish that phase space techniques provide a simple, experimentally promising tool in the study of many-body systems and we discuss their relation with measures of quantum correlations and quantum coherence.


title: GCN-GAN: A Non-linear Temporal Link Prediction Model for Weighted Dynamic Networks

abstract: In this paper, we generally formulate the dynamics prediction problem of various network systems (e.g., the prediction of mobility, traffic and topology) as the temporal link prediction task. Different from conventional techniques of temporal link prediction that ignore the potential non-linear characteristics and the informative link weights in the dynamic network, we introduce a novel non-linear model GCN-GAN to tackle the challenging temporal link prediction task of weighted dynamic networks. The proposed model leverages the benefits of the graph convolutional network (GCN), long short-term memory (LSTM) as well as the generative adversarial network (GAN). Thus, the dynamics, topology structure and evolutionary patterns of weighted dynamic networks can be fully exploited to improve the temporal link prediction performance. Concretely, we first utilize GCN to explore the local topological characteristics of each single snapshot and then employ LSTM to characterize the evolving features of the dynamic networks. Moreover, GAN is used to enhance the ability of the model to generate the next weighted network snapshot, which can effectively tackle the sparsity and the wide-value-range problem of edge weights in real-life dynamic networks. To verify the model's effectiveness, we conduct extensive experiments on four datasets of different network systems and application scenarios. The experimental results demonstrate that our model achieves impressive results compared to the state-of-the-art competitors.


title: Long-Range Longitudinal Electric Wave in Vacuum Radiated by Electric Dipole: Part III

abstract: In this paper, radiation due to standing wave currents are considered for the electric dipole. Assumptions that wavelength is much smaller than the dipole separation distance, which in turn is much smaller than the distance to the point of observation, were employed. Results indicate that the electric dipole, which now essentially is a linear antenna, emits both long range longitudinal electric and transverse electromagnetic waves. Two systems were considered: electric dipole with and without charge oscillations at its ends. Each system was further divided into two sub-systems: with even and odd number of half-wavelengths. For specific values of the system, longitudinal electric and transverse electromagnetic waves, total radiated power, longitudinal to transverse power ratio and radiation resistance were calculated and depicted.


title: Fast Periodicity Estimation and Reconstruction of hidden components from noisy periodic signal

abstract: Periodicity estimation from an arbitrary length noisy signal is computationally very costly. A recently developed Ramanujan Fat Dictionary is one of the ways to find the hidden components from an arbitrary length (non integral multiple of period) of the signal. This method suffers from high run time due to the lack of information about the period and effect of noise on the signal. We propose a new method that efficiently estimates the period of the signal and finding the hidden components thus becomes easy from it. Our method works well with significantly low SNR values and runs in O(n) time complexity, n being length of the signal. Comparision of run time analysis between our method for period estimation of a given signal and SVD method at various SNR values has been made and the corresponding hidden components are there by extracted by projecting onto the factor-Ramanujan Subspaces.


title: Scanning Tunneling Thermometry

abstract: Temperature imaging of nanoscale systems is a fundamental problem which has myriad potential technological applications. For example, nanoscopic cold spots can be used for spot cooling electronic components while hot spots could be used for precise activation of chemical or biological reactions. More fundamentally, imaging the temperature fields in quantum coherent conductors can provide a wealth of information on heat flow and dissipation at the smallest scales. However, despite significant technological advances, the spatial resolution of temperature imaging remains in the few nanometers range. Here we propose a method to map electronic temperature variations in operating nanoscale conductors by relying solely upon electrical tunneling current measurements. The scanning tunneling thermometer, owing to its operation in the tunneling regime, would be capable of mapping sub-angstrom temperature variations, thereby enhancing the resolution of scanning thermometry by some two orders of magnitude.


title: Learning Large Electrical Loads via Flexible Contracts with Commitment

abstract: Large electricity customers (e.g., large data centers) can exhibit huge and variable electricity demands, which poses significant challenges for the electricity suppliers to plan for sufficient capacity. Thus, it is desirable to design incentive and coordination mechanisms between the customers and the supplier to lower the capacity cost. This paper proposes a novel scheme based on flexible contracts. Unlike existing demand-side management schemes in the literature, a flexible contract leads to information revelation. That is, a customer committing to a flexible contract reveals valuable information about its future demand to the supplier. Such information revelation allows the customers and the supplier to share the risk of future demand uncertainty. On the other hand, the customer will still retain its autonomy in operation. We address two key challenges for the design of optimal flexible contracts: i) the contract design is a non-convex optimization problem and is intractable for a large number of customer types, and ii) the design should be robust to unexpected or adverse responses of the customers, i.e., a customer facing more than one contract yielding the same benefit may choose the contract less favorable to the supplier. We address these challenges by proposing sub-optimal contracts of low computational complexity that can achieve a provable fraction of the performance gain under the global optimum.


title: Spectral Calibration of K$-$M Giants from medium resolution near-infrared HK-band spectra

abstract: We present here new medium resolution spectra ($\lambda/\Delta\lambda$ $\sim$ 1200) of K$-$M giants covering wavelength range 1.50$-$1.80 and 1.95$-$2.45 $\mu$m. The sample includes 72 K0$-$M8 giants from our TIRSPEC observations and all available 35 giants in that spectral range from archival IRTF spectral library. We have calibrated here the empirical relations between fundamental parameters (e.g., effective temperature, surface gravity) and equivalent widths of some important spectral features like Si I, Na I, Ca I, $^{12}$CO. We find that the $^{12}$CO first overtone band at 2.29 $\mu$m and second overtone band at 1.62 $\mu$m are a reasonably good indicator of temperature above 3400 K and surface gravity. We show that the dispersion of empirical relations between $^{12}$CO and $T_{eff}$ significantly improve considering the effect of surface gravity.


title: Quantum dynamics of a few-photon parametric oscillator

abstract: Modulating the frequency of a harmonic oscillator at nearly twice its natural frequency leads to amplification and self-oscillation. Above the oscillation threshold, the field settles into a coherent oscillating state with a well-defined phase of either $0$ or $\pi$. We demonstrate a quantum parametric oscillator operating at microwave frequencies and drive it into oscillating states containing only a few photons. The small number of photons present in the system and the coherent nature of the nonlinearity prevents the environment from learning the randomly chosen phase of the oscillator. This allows the system to oscillate briefly in a quantum superposition of both phases at once - effectively generating a nonclassical Schr\"{o}dinger's cat state. We characterize the dynamics and states of the system by analyzing the output field emitted by the oscillator and implementing quantum state tomography suited for nonlinear resonators. By demonstrating a quantum parametric oscillator and the requisite techniques for characterizing its quantum state, we set the groundwork for new schemes of quantum and classical information processing and extend the reach of these ubiquitous devices deep into the quantum regime.


title: Galois quotients of metric graphs and invariant linear systems

abstract: For a map $\varphi : \varGamma \rightarrow \varGamma^{\prime}$ between metric graphs and an isometric action on $\varGamma$ by finite group $K$, $\varphi$ is a $K$-Galois covering on $\varGamma^{\prime}$ if $\varphi$ is a morphism, the degree of $\varphi$ coincides with the order of $K$ and $K$ induces a transitive action on every fibre. We prove that for a metric graph $\varGamma$ with an isometric action by finite group $K$, there exists a rational map, from $\varGamma$ to a tropical projective space, which induces a $K$-Galois covering on the image. By using this fact, we also prove that for a hyperelliptic metric graph without one valent points and with genus at least two, the invariant linear system of the hyperelliptic involution $\iota$ of the canonical linear system, the complete linear system associated to the canonical divisor, induces an $\langle \iota \rangle$-Galois covering on a tree. This is an analogy of the fact that a compact Riemann surface is hyperelliptic if and only if the canonical map, the rational map induced by the canonical linear system, is a double covering on a projective line $\boldsymbol{P}^1$.


title: Cyclic Szekeres Universes

abstract: We consider the Szekeres universe with an inhomogeneous dust fluid and a homogeneous and isotropic ghost matter source with equation of state $p_{g}=\left( \gamma-1\right) \rho_{g},$ where $\gamma$ is a constant. The field equations determine two families of spacetimes which describe homogeneous Kantowski-Sachs universes and inhomogeneous Friedmann universe. The ghost field Einstein permits static and cyclic solutions to exist. The stability of the Einstein static and cyclic solutions are studied with a critical point analysis.


title: Eficient Monte Carlo Simulation of the Left Tail of Positive Gaussian Quadratic Forms

abstract: Estimating the left tail of quadratic forms in Gaussian random vectors is of major practical importance in many applications. In this paper, we propose an efficient and robust importance sampling estimator that is endowed with the bounded relative error property. This property significantly reduces the number of simulation runs required by the proposed estimator compared to naive Monte Carlo. Thus, our importance sampling estimator is especially useful when the probability of interest is very small. Selected simulation results are presented to illustrate the efficiency of our estimator compared to naive Monte Carlo in both central and non-central cases, as well as both real and complex settings.


title: Hamilton cycles and perfect matchings in the KPKVB model

abstract: In this paper we consider the existence of Hamilton cycles and perfect matchings in a random graph model proposed by Krioukov et al.~in 2010. In this model, nodes are chosen randomly inside a disk in the hyperbolic plane and two nodes are connected if they are at most a certain hyperbolic distance from each other. It has been previously shown that this model has various properties associated with complex networks, including a power-law degree distribution, "short distances" and a strictly positive clustering coefficient. The model is specified using three parameters: the number of nodes $n$, which we think of as going to infinity, and $\alpha, \nu > 0$, which we think of as constant. Roughly speaking $\alpha$ controls the power law exponent of the degree sequence and $\nu$ the average degree. Here we show that for every $\alpha < 1/2$ and $\nu=\nu(\alpha)$ sufficiently small, the model does not contain a perfect matching with high probability, whereas for every $\alpha < 1/2$ and $\nu=\nu(\alpha)$ sufficiently large, the model contains a Hamilton cycle with high probability.


title: Uniform polynomial rates of convergence for a class of L\'evy-driven controlled SDEs arising in multiclass many-server queues

abstract: We study the ergodic properties of a class of controlled stochastic differential equations (SDEs) driven by $\alpha$-stable processes which arise as the limiting equations of multiclass queueing models in the Halfin-Whitt regime that have heavy-tailed arrival processes. When the safety staffing parameter is positive, we show that the SDEs are uniformly ergodic and enjoy a polynomial rate of convergence to the invariant probability measure in total variation, which is uniform over all stationary Markov controls resulting in a locally Lipschitz continuous drift. We also derive a matching lower bound on the rate of convergence (under no abandonment). On the other hand, when all abandonment rates are positive, we show that the SDEs are exponentially ergodic uniformly over the above-mentioned class of controls. Analogous results are obtained for L\'evy-driven SDEs arising from multiclass many-server queues under asymptotically negligible service interruptions. For these equations, we show that the aforementioned ergodic properties are uniform over all stationary Markov controls. We also extend a key functional central limit theorem concerning diffusion approximations so as to make it applicable to the models studied here.


title: An Optimized BBR for Multipath Real Time Video Streaming

abstract: The multipath transmission scheme can work as an effective way to provide better quality of experiments to end users. Two key research points in the multipath real time video transmission context are congestion control and packet scheduling. As Utility maximization theory shows, to provide better satisfaction to end users is to provide higher throughput and lower transmission delay. The congestion control is responsible to converge to the maximum available bandwidth and avoid leading the network into congestion. A delay response BBR (Delay-BBR) algorithm optimized for real time video transmission is proposed, and the main idea is to reduce sending rate when the link delay has exceeded certain threshold to let the intermediate routers drain the occupied buffer. It can achieve better transmission delay and lower packet loss rate compared with QUIC-BBR and WebRTC-BBR by experiment. And a packet scheduling algorithm induced from Utility maximization theory works on top of the congestion control algorithm is tested and achieves lower frame delivery delay further compared with benchmark algorithms.


title: A general model for plane-based clustering with loss function

abstract: In this paper, we propose a general model for plane-based clustering. The general model contains many existing plane-based clustering methods, e.g., k-plane clustering (kPC), proximal plane clustering (PPC), twin support vector clustering (TWSVC) and its extensions. Under this general model, one may obtain an appropriate clustering method for specific purpose. The general model is a procedure corresponding to an optimization problem, where the optimization problem minimizes the total loss of the samples. Thereinto, the loss of a sample derives from both within-cluster and between-cluster. In theory, the termination conditions are discussed, and we prove that the general model terminates in a finite number of steps at a local or weak local optimal point. Furthermore, based on this general model, we propose a plane-based clustering method by introducing a new loss function to capture the data distribution precisely. Experimental results on artificial and public available datasets verify the effectiveness of the proposed method.


title: Finite energy weak solution of 2d Boussinesq equation with diffusive temperature

abstract: We show the existence of finite kinetic energy solution with prescribed kinetic energy to the 2d Boussinesq equations with diffusive temperature on torus.


title: Credulous Acceptability, Poison Games and Modal Logic

abstract: The Poison Game is a two-player game played on a graph in which one player can influence which edges the other player is able to traverse. It operationalizes the notion of existence of credulously admissible sets in an argumentation framework or, in graph-theoretic terminology, the existence of non-trivial semi-kernels. We develop a modal logic (poison modal logic, PML) tailored to represent winning positions in such a game, thereby identifying the precise modal reasoning that underlies the notion of credulous admissibility in argumentation. We study model-theoretic and decidability properties of PML, and position it with respect to recently studied logics at the cross-road of modal logic, argumentation, and graph games.


title: Sparse evolutionary Deep Learning with over one million artificial neurons on commodity hardware

abstract: Artificial Neural Networks (ANNs) have emerged as hot topics in the research community. Despite the success of ANNs, it is challenging to train and deploy modern ANNs on commodity hardware due to the ever-increasing model size and the unprecedented growth in the data volumes. Particularly for microarray data, the very-high dimensionality and the small number of samples make it difficult for machine learning techniques to handle. Furthermore, specialized hardware such as Graphics Processing Unit (GPU) is expensive. Sparse neural networks are the leading approaches to address these challenges. However, off-the-shelf sparsity inducing techniques either operate from a pre-trained model or enforce the sparse structure via binary masks. The training efficiency of sparse neural networks cannot be obtained practically. In this paper, we introduce a technique allowing us to train truly sparse neural networks with fixed parameter count throughout training. Our experimental results demonstrate that our method can be applied directly to handle high dimensional data, while achieving higher accuracy than the traditional two phases approaches. Moreover, we have been able to create truly sparse MultiLayer Perceptrons (MLPs) models with over one million neurons and to train them on a typical laptop without GPU, this being way beyond what is possible with any state-of-the-art techniques.


title: Chiral excitation of spin waves in ferromagnetic films

abstract: We theoretically investigate the interlayer dipolar and exchange couplings for an array of metallic magnetic nanowires grown on top of an extended ultrathin yttrium iron garnet film. The calculated interlayer dipolar coupling agrees with observed anticrossings [Chen \emph{et al.}, Phys. Rev. Lett. \textbf{120}, 217202 (2018)], concluding that the interlayer exchange coupling is suppressed by a spacer layer between the nanowires and film. The Kittel mode in the nanowire array couples chirally to spin waves in the film, even though Damon-Eshbach surface modes do not exist. The chirality is suppressed when the interlayer exchange coupling becomes strong.


title: Generalized Alignment Chain: Improved Converse Results for Index Coding

abstract: In this paper, we study the information-theoretic converse for the index coding problem. We generalize the definition for the alignment chain, introduced by Maleki et al., to capture more flexible relations among interfering messages at each receiver. Based on this, we derive improved converse results for the single-server index coding problem. Compared to the maximum acyclic induced subgraph (MAIS) bound, the new bounds are always as tight and can strictly outperform the MAIS bound. They can also be useful for large problems, where the generally tighter polymatroidal bound is computationally impractical. We then extend these new bounds to the multi-server index coding problem. We also present a separate, but related result where we identify a smaller single-server index coding instance, compared to those identified in the literature, for which non-Shannon-type inequalities are necessary to give a tighter converse.


title: Action Robust Reinforcement Learning and Applications in Continuous Control

abstract: A policy is said to be robust if it maximizes the reward while considering a bad, or even adversarial, model. In this work we formalize two new criteria of robustness to action uncertainty. Specifically, we consider two scenarios in which the agent attempts to perform an action $a$, and (i) with probability $\alpha$, an alternative adversarial action $\bar a$ is taken, or (ii) an adversary adds a perturbation to the selected action in the case of continuous action space. We show that our criteria are related to common forms of uncertainty in robotics domains, such as the occurrence of abrupt forces, and suggest algorithms in the tabular case. Building on the suggested algorithms, we generalize our approach to deep reinforcement learning (DRL) and provide extensive experiments in the various MuJoCo domains. Our experiments show that not only does our approach produce robust policies, but it also improves the performance in the absence of perturbations. This generalization indicates that action-robustness can be thought of as implicit regularization in RL problems.


title: Packing without some pieces

abstract: Erd\H{o}s and Hanani proved that for every fixed integer $k \ge 2$, the complete graph $K_n$ can be almost completely packed with copies of $K_k$; that is, $K_n$ contains pairwise edge-disjoint copies of $K_k$ that cover all but an $o_n(1)$ fraction of its edges. Equivalently, elements of the set $\C(k)$ of all red-blue edge colorings of $K_k$ can be used to almost completely pack every red-blue edge coloring of $K_n$. The following strengthening of the aforementioned Erd\H{o}s-Hanani result is considered. Suppose $\C' \subset \C(k)$. Is it true that we can use elements only from $\C'$ and almost completely pack every red-blue edge coloring of $K_n$? An element $C \in \C(k)$ is {\em avoidable} if $\C'=\C(k) \setminus C$ has this property and a subset ${\cal F} \subset \C(k)$ is avoidable if $\C'=\C(k) \setminus {\cal F}$ has this property. It seems difficult to determine all avoidable graphs as well as all avoidable families. We prove some nontrivial sufficient conditions for avoidability. Our proofs imply, in particular, that (i) almost all elements of $\C(k)$ are avoidable (ii) all Eulerian elements of $\C(k)$ are avoidable and, in fact, the set of all Eulerian elements of $\C(k)$ is avoidable.


title: A magneto-optic trap using a reversible, solid-state alkali-metal source

abstract: We demonstrate a novel way to form and deplete a vapor-cell magneto-optic trap (MOT) using a reversible, solid-state alkali-metal source (AMS) via an applied polarized voltage. Using ~100 mW of electrical power, a trapped-atom number of 5x10^6 has been achieved starting from near zero and the timescales of the MOT formation and depletion of ~1 s. This fast, reversible, and low power alkali-atom source is desirable in both tabletop and portable cold-atom systems. The core technology of this device should translate readily to other alkali and alkaline-earth elements that could find a wide range of uses in cold-atom systems and instruments.


title: Discovery of Important Subsequences in Electrocardiogram Beats Using the Nearest Neighbour Algorithm

abstract: The classification of time series data is a well-studied problem with numerous practical applications, such as medical diagnosis and speech recognition. A popular and effective approach is to classify new time series in the same way as their nearest neighbours, whereby proximity is defined using Dynamic Time Warping (DTW) distance, a measure analogous to sequence alignment in bioinformatics. However, practitioners are not only interested in accurate classification, they are also interested in why a time series is classified a certain way. To this end, we introduce here the problem of finding a minimum length subsequence of a time series, the removal of which changes the outcome of the classification under the nearest neighbour algorithm with DTW distance. Informally, such a subsequence is expected to be relevant for the classification and can be helpful for practitioners in interpreting the outcome. We describe a simple but optimized implementation for detecting these subsequences and define an accompanying measure to quantify the relevance of every time point in the time series for the classification. In tests on electrocardiogram data we show that the algorithm allows discovery of important subsequences and can be helpful in detecting abnormalities in cardiac rhythms distinguishing sick from healthy patients.


title: On strict sub-Gaussianity, optimal proxy variance and symmetry for bounded random variables

abstract: We investigate the sub-Gaussian property for almost surely bounded random variables. If sub-Gaussianity per se is de facto ensured by the bounded support of said random variables, then exciting research avenues remain open. Among these questions is how to characterize the optimal sub-Gaussian proxy variance? Another question is how to characterize strict sub-Gaussianity, defined by a proxy variance equal to the (standard) variance? We address the questions in proposing conditions based on the study of functions variations. A particular focus is given to the relationship between strict sub-Gaussianity and symmetry of the distribution. In particular, we demonstrate that symmetry is neither sufficient nor necessary for strict sub-Gaussianity. In contrast, simple necessary conditions on the one hand, and simple sufficient conditions on the other hand, for strict sub-Gaussianity are provided. These results are illustrated via various applications to a number of bounded random variables, including Bernoulli, beta, binomial, uniform, Kumaraswamy, and triangular distributions.


title: Development of Systematic Image Preprocessing of LAPAN-A3/IPB Multispectral Images

abstract: As of any other satellite images, LAPAN-A3/IPB multispectral images suffered from both geometric and radiometric distortions which need to be corrected. LAPAN as satellite owner has developed image preprocessing algorithm to process raw image into systematically corrected image. This research aims to evaluate the performance of the developed algorithm, particularly the performance of lens vignetting and band co-registration correction as well as the performance of direct image georeferencing. Lens vignetting distortion occurs on image was corrected by using pre-flight calibration data, while calculation of direct georeferencing was done by using satellite metadata of satellite position and attitude. Meanwhile, band co-registration correction was conducted based entirely on the image being processed using image matching approach. Based on several results and analysis which have been done, lens vignetting effects on image can be suppressed significantly from about 40 percent down to 10 percent, band coregistration error can be reduced to below 2-3 pixels in average, and the calculated direct georeferencing has 3000 meter accuracy. The results show that the developed image preprocessing algorithm has moderately good performance to process LAPAN-A3/IPB multispectral images.


title: Tuneable superconducting effective gap in graphene-TMDC heterostructures

abstract: Growth of graphene on monolayer transition-metal dichalcogenides presents opening on band gap and giant spin-orbit coupling which paves the way to achieve a useful hybrid structure for electronics and spintronics applications. Increase of the atomic number of transition-metal results in a large SOC, where eventually a band inversion appears in graphene-$WSe_2$. We consider superconductor induction by proximity effect to the graphene-TMDC hybrid structure. As a necessity of formalism, we introduce a proper time-reversal and particle-hole symmetry operators, under which the $8 \times 8$ Dirac-Bogoliubov-de Gennes low-energy effective Hamiltonian is invariant. Resulting superconducting electron-hole excitations shows that, the essential dynamical parameters $\lambda_I^{A,B}$ and $\lambda_R$ have significant effect on superconducting excitations and, specifically, subgap energy. Dependence of the superconducting energy excitation on chemical potential is explored. The signature of spin triplet $p$-wave pairing symmetry in the system is found to increase the subgap superconducting energy, in comparing to $s$-wave symmetry.


title: On Roth type conditions, duality and central Birkhoff sums for i.e.m

abstract: We introduce two Diophantine conditions on rotation numbers of interval exchange maps (i.e.m) and translation surfaces: the \emph{absolute Roth type condition} is a weakening of the notion of Roth type i.e.m., while the \emph{dual Roth type} condition is a condition on the \emph{backward} rotation number of a translation surface. We show that results on the cohomological equation previously proved in \cite{MY} for restricted Roth type i.e.m. (on the solvability under finitely many obstructions and the regularity of the solutions) can be extended to restricted \emph{absolute} Roth type i.e.m. Under the dual Roth type condition, we associate to a class of functions with \emph{subpolynomial} deviations of ergodic averages (corresponding to relative homology classes) \emph{distributional} limit shapes, which are constructed in a similar way to the \emph{limit shapes} of Birkhoff sums associated in \cite{MMY3} to functions which correspond to positive Lyapunov exponents.


title: SelectiveNet: A Deep Neural Network with an Integrated Reject Option

abstract: We consider the problem of selective prediction (also known as reject option) in deep neural networks, and introduce SelectiveNet, a deep neural architecture with an integrated reject option. Existing rejection mechanisms are based mostly on a threshold over the prediction confidence of a pre-trained network. In contrast, SelectiveNet is trained to optimize both classification (or regression) and rejection simultaneously, end-to-end. The result is a deep neural network that is optimized over the covered domain. In our experiments, we show a consistently improved risk-coverage trade-off over several well-known classification and regression datasets, thus reaching new state-of-the-art results for deep selective classification.


title: Scene Text Synthesis for Efficient and Effective Deep Network Training

abstract: A large amount of annotated training images is critical for training accurate and robust deep network models but the collection of a large amount of annotated training images is often time-consuming and costly. Image synthesis alleviates this constraint by generating annotated training images automatically by machines which has attracted increasing interest in the recent deep learning research. We develop an innovative image synthesis technique that composes annotated training images by realistically embedding foreground objects of interest (OOI) into background images. The proposed technique consists of two key components that in principle boost the usefulness of the synthesized images in deep network training. The first is context-aware semantic coherence which ensures that the OOI are placed around semantically coherent regions within the background image. The second is harmonious appearance adaptation which ensures that the embedded OOI are agreeable to the surrounding background from both geometry alignment and appearance realism. The proposed technique has been evaluated over two related but very different computer vision challenges, namely, scene text detection and scene text recognition. Experiments over a number of public datasets demonstrate the effectiveness of our proposed image synthesis technique - the use of our synthesized images in deep network training is capable of achieving similar or even better scene text detection and scene text recognition performance as compared with using real images.


title: Thermodynamics of the pyrochlore-lattice quantum Heisenberg antiferromagnet

abstract: We use the rotation-invariant Green's function method (RGM) and the high-temperature expansion (HTE) to study the thermodynamic properties of the Heisenberg antiferromagnet on the pyrochlore lattice. We discuss the excitation spectra as well as various thermodynamic quantities, such as spin correlations, uniform susceptibility, specific heat and static and dynamical structure factors. For the ground state we present RGM data for arbitrary spin quantum numbers $S$. At finite temperatures we focus on the extreme quantum cases $S=1/2$ and $S=1$. We do not find indications for magnetic long-range order for any value of $S$. We discuss the width of the pinch point in the static structure factor in dependence on temperature and spin quantum number. We compare our data with experimental results for the pyrochlore compound NaCaNi$_2$F$_7$ ($S=1$). Thus, our results for the dynamical structure factor agree well with the experimentally observed features at 3 \ldots 8~meV for NaCaNi$_2$F$_7$. We analyze the static structure factor ${S}_{\bf q}$ to find regions of maximal ${S}_{\bf q}$. The high-temperature series of the ${S}_{\bf q}$ provide a fingerprint of weak {\it order by disorder} selection of a collinear spin structure, where (classically) the total spin vanishes on each tetrahedron and neighboring tetrahedra are dephased by $\pi$.


title: Variational approach to rare event simulation using least-squares regression

abstract: We propose an adaptive importance sampling scheme for the simulation of rare events when the underlying dynamics is given by a diffusion. The scheme is based on a Gibbs variational principle that is used to determine the optimal (i.e. zero-variance) change of measure and exploits the fact that the latter can be rephrased as a stochastic optimal control problem. The control problem can be solved by a stochastic approximation algorithm, using the Feynman-Kac representation of the associated dynamic programming equations, and we discuss numerical aspects for high-dimensional problems along with simple toy examples.


title: Nearly-degenerate $p_x+ip_y$ and $d_{x^2-y^2}$ pairing symmetry in the heavy fermion superconductor YbRh$_2$Si$_2$

abstract: Recent discovery of superconductivity in YbRh$_2$Si$_2$ has raised particular interest in its pairing mechanism and gap symmetry. Here we propose a phenomenological theory of its superconductivity and investigate possible gap structures by solving the multiband Eliashberg equations combining realistic Fermi surfaces from first-principles calculations and a quantum critical form of magnetic pairing interactions. The resulting gap symmetry shows sensitive dependence on the in-plane propagation wave vector of the quantum critical fluctuations, suggesting that superconductivity in YbRh$_2$Si$_2$ is located on the border of $(p_x+ip_y)$ and $d_{x^2-y^2}$-wave solutions. This leads to two candidate phase diagrams: one has only a spin-triplet $(p_x+ip_y)$-wave superconducting phase; the other contains multiple phases with a spin-singlet $d_{x^2-y^2}$-wave state at zero field and a field-induced spin-triplet $(p_x+ip_y)$-wave state. In addition, the electron pairing is found to be dominated by the `jungle-gym' Fermi surface rather than the `doughnut'-like one, in contrast to previous thought. This requests a more elaborate and renewed understanding of the electronic properties of YbRh$_2$Si$_2$.


title: Deep Convolutional Encoder-Decoders with Aggregated Multi-Resolution Skip Connections for Skin Lesion Segmentation

abstract: The prevalence of skin melanoma is rapidly increasing as well as the recorded death cases of its patients. Automatic image segmentation tools play an important role in providing standardized computer-assisted analysis for skin melanoma patients. Current state-of-the-art segmentation methods are based on fully convolutional neural networks, which utilize an encoder-decoder approach. However, these methods produce coarse segmentation masks due to the loss of location information during the encoding layers. Inspired by Pyramid Scene Parsing Network (PSP-Net), we propose an encoder-decoder model that utilizes pyramid pooling modules in the deep skip connections which aggregate the global context and compensate for the lost spatial information. We trained and validated our approach using ISIC 2018: Skin Lesion Analysis Towards Melanoma Detection grand challenge dataset. Our approach showed a validation accuracy with a Jaccard index of 0.837, which outperforms U-Net. We believe that with this reported reliable accuracy, this method can be introduced for clinical practice.


title: Substructures in galaxy clusters: a comparative X-ray and photometric analysis of the REXCESS sample

abstract: The main goals of the present work are (i) to study the substructure content of a representative, X-ray selected sample of 31 galaxy clusters, as traced by the spatial distribution of their red-sequence galaxies, and (ii) to compare it to that observed in the intracluster medium distribution. Our substructure indicators are the asymmetry test, $\beta$, the residuals of the galaxy surface density map, $\Delta_\Sigma$, and the Fourier elongation, $FE$. We probe the clusters core with secondary tests: the offset between the central brightest cluster galaxy and the X-ray emission peak, $\Delta r_{\mathrm{BCG-X}}$, the magnitude offset between the first and second brightest galaxies, $\Delta m_{12}$, and their radial offset, $\Delta r_{12}$. The main indicators exhibit continuous distributions, making a discrete classification difficult. A partition based on $\beta$ and $\Delta_\Sigma$ gives a fraction $\sim35\%$ of disturbed systems; $\sim65\%$ of the clusters are disturbed according to at least one of these two quantities. The main indicators poorly correlate with the secondary quantities, likely due to substructures observed prior core crossing. Nine of the 12 X-ray disturbed clusters are also flagged as such by either $\beta$ or $\Delta_\Sigma$. Cool cores are hosted by systems with higher optical concentrations, smaller $\Delta r_{\mathrm{BCG-X}}$, and larger $\Delta r_{12}$; however, both populations do not differ significantly in terms of their overall morphology probed by the main indicators. Our results show the necessity of using a variety of independent tests and data sets to obtain a clear picture of a cluster's morphology. Furthermore, we find that a cluster's dynamical state, consequence of its recent merger history, is not necessarily representative of a future mass assembly via accretion of substructures.


title: Robust Vector Perturbation Precoding Design for MIMO Broadcast Channel

abstract: We consider the vector perturbation (VP) precoder design for multiuser multiple-input single output (MU-MISO) broadcast channel systems which is robust to power scaling factor errors. VP precoding has so far been developed and analyzed under the assumption that receivers could have known the power scaling factor in advance of tranmission perfectly, which is hard to obtain due to the large dynamic range and limited feedforward. However, as demonstrated in our results the performance of VP precoding is quite sensitive to the accuracy of power scaling factor and always encounter an error floor at mid to high signal-to-noise ratio (SNR) regimes. Motivated by such observations, we propose a robust VP precoder based on the minimum mean square error (MMSE) criterion. Simulation results show that, the robust VP precoder outperforms conventional VP precoding designs, as less sensitive to power scaling factor errors.


title: Transverse momentum distributions of charmonium states with the statistical hadronization model

abstract: Calculations and predictions are presented within the framework of the statistical hadronization model for transverse momentum spectra of the charmonium states J/$\psi$, $\psi(2S)$ and $X(3872)$ produced in nucleus-nucleus collisions at LHC energies. The results are confronted with available data and exhibit very good agreement by using particle flow profiles from state-of-the-art hydrodynamic calculations. For $X(3872)$ production in Pb-Pb collisions we predict a transverse momentum distribution similar in shape to that for J/$\psi$ with a strong enhancement at low transverse momenta and a production yield of about 1\% relative to that for J/$\psi$.


title: On algebraic and uniqueness properties of 3d harmonic quaternion fields

abstract: Let $\Omega$ be a smooth compact oriented 3-dimensional Riemannian manifold with boundary. A quaternion field is a pair $q=\{\alpha,u\}$ of a function $\alpha$ and a vector field $u$ on $\Omega$. A field $q$ is {\it harmonic} if $\alpha, u$ are continuous in $\Omega$ and $\nabla\alpha={\rm rot\,}u,\,{\rm div\,}u=0$ holds into $\Omega$. The space ${\mathscr Q}(\Omega)$ of harmonic fields is a subspace of the Banach algebra $\mathscr C\left(\Omega\right)$ of continuous quaternion fields with the point-wise multiplication $qq'=\{\alpha\alpha'-u\cdot u',\,\alpha u'+\alpha'u+u\wedge u'\}$. We prove a Stone-Weierstrass type theorem: the subalgebra $\vee{\mathscr Q}(\Omega)$ generated by harmonic fields is dense in $\mathscr C\left(\Omega\right)$. Some results on 2-jets of harmonic functions and the uniqueness sets of harmonic fields are provided.


title: Theoretical Review of Charmonium Production with Different $p_T$ in the Hot Medium

abstract: Charmonia with different transverse momentum $p_T$ usually comes from different mechanisms in the relativistic heavy ion collisions. This work tries to review the theoretical studies on quarkonium evolutions in the deconfined medium produced in p-Pb and Pb-Pb collisions. The charmonia with high $p_T$ are mainly from the initial hadronic collisions, and therefore sensitive to the initial energy density of the bulk medium. For those charmonia within $0.1<p_T<5$ GeV/c at the energies of Large Hadron Collisions (LHC), They are mainly produced by the recombination of charm and anti-charm quarks in the medium. In the extremely low $p_T\sim 1/R_A$ ($R_A$ is the nuclear radius), additional contribution from the coherent interactions between electromagnetic fields generated by one nucleus and the target nucleus plays a non-negligible role in the $J/\psi$ production even in semi-central Pb-Pb collisions.


title: ACNN: a Full Resolution DCNN for Medical Image Segmentation

abstract: Deep Convolutional Neural Networks (DCNNs) are used extensively in medical image segmentation and hence 3D navigation for robot-assisted Minimally Invasive Surgeries (MISs). However, current DCNNs usually use down sampling layers for increasing the receptive field and gaining abstract semantic information. These down sampling layers decrease the spatial dimension of feature maps, which can be detrimental to image segmentation. Atrous convolution is an alternative for the down sampling layer. It increases the receptive field whilst maintains the spatial dimension of feature maps. In this paper, a method for effective atrous rate setting is proposed to achieve the largest and fully-covered receptive field with a minimum number of atrous convolutional layers. Furthermore, a new and full resolution DCNN - Atrous Convolutional Neural Network (ACNN), which incorporates cascaded atrous II-blocks, residual learning and Instance Normalization (IN) is proposed. Application results of the proposed ACNN to Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) image segmentation demonstrate that the proposed ACNN can achieve higher segmentation Intersection over Unions (IoUs) than U-Net and Deeplabv3+, but with reduced trainable parameters.


title: On the class of weakly almost contra-T*-continuous functions

abstract: The aim of this paper is to introduce and investigate a new class of functions called weakly almost contra-$T^*$-continuity which is defined as a function from an operator topological space $(X, \tau, T)$ into an arbitrary topological space $(Y, \delta)$. Furthermore, some new characterizations, several basic propositions are proved and some relevant counterexamples are provided.


title: Calculating the free energy of 2D materials on substrates

abstract: A method was developed to calculate the free energy of 2D materials on substrates and was demonstrated by the system of graphene and {\gamma}-graphyne on copper substrate. The method works at least 3 orders faster than state-of-the-art algorithms, and the accuracy was tested by molecular dynamics simulations, showing that the precision for calculations of the internal energy achieves up to 0.03% in a temperature range from 100 to 1300K. As expected, the calculated the free energy of a graphene sheet on Cu (111) or Ni (111) surface in a temperature range up to 3000K is always smaller than the one of a {\gamma}-graphyne sheet with the same number of C atoms, which is consistent with the fact that growth of graphene on the substrates is much easier than {\gamma}-graphyne.


title: Kernel-Guided Training of Implicit Generative Models with Stability Guarantees

abstract: Modern implicit generative models such as generative adversarial networks (GANs) are generally known to suffer from issues such as instability, uninterpretability, and difficulty in assessing their performance. If we see these implicit models as dynamical systems, some of these issues are caused by being unable to control their behavior in a meaningful way during the course of training. In this work, we propose a theoretically grounded method to guide the training trajectories of GANs by augmenting the GAN loss function with a kernel-based regularization term that controls local and global discrepancies between the model and true distributions. This control signal allows us to inject prior knowledge into the model. We provide theoretical guarantees on the stability of the resulting dynamical system and demonstrate different aspects of it via a wide range of experiments.


title: Probabilistic Recursive Reasoning for Multi-Agent Reinforcement Learning

abstract: Humans are capable of attributing latent mental contents such as beliefs or intentions to others. The social skill is critical in daily life for reasoning about the potential consequences of others' behaviors so as to plan ahead. It is known that humans use such reasoning ability recursively by considering what others believe about their own beliefs. In this paper, we start from level-$1$ recursion and introduce a probabilistic recursive reasoning (PR2) framework for multi-agent reinforcement learning. Our hypothesis is that it is beneficial for each agent to account for how the opponents would react to its future behaviors. Under the PR2 framework, we adopt variational Bayes methods to approximate the opponents' conditional policies, to which each agent finds the best response and then improve their own policies. We develop decentralized-training-decentralized-execution algorithms, namely PR2-Q and PR2-Actor-Critic, that are proved to converge in the self-play scenarios when there exists one Nash equilibrium. Our methods are tested on both the matrix game and the differential game, which have a non-trivial equilibrium where common gradient-based methods fail to converge. Our experiments show that it is critical to reason about how the opponents believe about what the agent believes. We expect our work to contribute a new idea of modeling the opponents to the multi-agent reinforcement learning community.


title: Intrinsically Sparse Long Short-Term Memory Networks

abstract: Long Short-Term Memory (LSTM) has achieved state-of-the-art performances on a wide range of tasks. Its outstanding performance is guaranteed by the long-term memory ability which matches the sequential data perfectly and the gating structure controlling the information flow. However, LSTMs are prone to be memory-bandwidth limited in realistic applications and need an unbearable period of training and inference time as the model size is ever-increasing. To tackle this problem, various efficient model compression methods have been proposed. Most of them need a big and expensive pre-trained model which is a nightmare for resource-limited devices where the memory budget is strictly limited. To remedy this situation, in this paper, we incorporate the Sparse Evolutionary Training (SET) procedure into LSTM, proposing a novel model dubbed SET-LSTM. Rather than starting with a fully-connected architecture, SET-LSTM has a sparse topology and dramatically fewer parameters in both phases, training and inference. Considering the specific architecture of LSTMs, we replace the LSTM cells and embedding layers with sparse structures and further on, use an evolutionary strategy to adapt the sparse connectivity to the data. Additionally, we find that SET-LSTM can provide many different good combinations of sparse connectivity to substitute the overparameterized optimization problem of dense neural networks. Evaluated on four sentiment analysis classification datasets, the results demonstrate that our proposed model is able to achieve usually better performance than its fully connected counterpart while having less than 4\% of its parameters.