title: High-energy gamma-ray emission from SNR G57.2+0.8 hosting SGR J1935+2154

abstract: In recent years some efforts have been made to identify active sources capable of accelerating particles up to $10^{15}$ eV, known as PeVatrons. Measurements of TeV ($10^{12}$ eV) gamma-rays from supernova remnants (SNRs) have shown that efficient particle acceleration can occur in SNR diffusive shocks. In this paper, we obtain the contribution to the high energy and very-high-energy gamma-ray (VHE, $E > 100$ GeV) emission due to cosmic-ray acceleration from SNR G57.2+0.8 hosting the Soft Gamma Repeater (SGR) J1935+2154 with the use of the GALPROP code. To do so, we take into account the SNR + SGR association as a single source close to the Galactic center. We propose that the above setting can provide a more comprehensive scenario for the generation of GeV-TeV gamma-rays. We also discuss the contribution from the SNR G57.2+0.8 and SGR J1935+2154 region to the diffusive TeV energy gamma-ray emission from the Galactic center.


title: Deep Source-Channel Coding for Sentence Semantic Transmission with HARQ

abstract: Recently, semantic communication has been brought to the forefront because of its great success in deep learning (DL), especially Transformer. Even if semantic communication has been successfully applied in the sentence transmission to reduce semantic errors, existing architecture is usually fixed in the codeword length and is inefficient and inflexible for the varying sentence length. In this paper, we exploit hybrid automatic repeat request (HARQ) to reduce semantic transmission error further. We first combine semantic coding (SC) with Reed Solomon (RS) channel coding and HARQ, called SC-RS-HARQ, which exploits the superiority of the SC and the reliability of the conventional methods successfully. Although the SC-RS-HARQ is easily applied in the existing HARQ systems, we also develop an end-to-end architecture, called SCHARQ, to pursue the performance further. Numerical results demonstrate that SCHARQ significantly reduces the required number of bits for sentence semantic transmission and sentence error rate. Finally, we attempt to replace error detection from cyclic redundancy check to a similarity detection network called Sim32 to allow the receiver to reserve the wrong sentences with similar semantic information and to save transmission resources.


title: An Adaptive Framework for Learning Unsupervised Depth Completion

abstract: We present a method to infer a dense depth map from a color image and associated sparse depth measurements. Our main contribution lies in the design of an annealing process for determining co-visibility (occlusions, disocclusions) and the degree of regularization to impose on the model. We show that regularization and co-visibility are related via the fitness (residual) of model to data and both can be unified into a single framework to improve the learning process. Our method is an adaptive weighting scheme that guides optimization by measuring the residual at each pixel location over each training step for (i) estimating a soft visibility mask and (ii) determining the amount of regularization. We demonstrate the effectiveness our method by applying it to several recent unsupervised depth completion methods and improving their performance on public benchmark datasets, without incurring additional trainable parameters or increase in inference time. Code available at: https://github.com/alexklwong/adaframe-depth-completion.


title: What to expect from dynamical modelling of cluster haloes I. The information content of different dynamical tracers

abstract: Using hydrodynamical simulations, we study how well the underlying gravitational potential of a galaxy cluster can be modelled dynamically with different types of tracers. In order to segregate different systematics and the effects of varying estimator performances, we first focus on applying a generic minimal assumption method (oPDF) to model the simulated haloes using the full 6-D phasespace information. We show that the halo mass and concentration can be recovered in an ensemble unbiased way, with a stochastic bias that varies from halo to halo, mostly reflecting deviations from steady state in the tracer distribution. The typical systematic uncertainty is $\sim 0.17$ dex in the virial mass and $\sim 0.17$ dex in the concentration as well when dark matter particles are used as tracers. The dynamical state of satellite galaxies are close to that of dark matter particles, while intracluster stars are less in a steady state, resulting in a $\sim$ 0.26 dex systematic uncertainty in mass. Compared with galactic haloes hosting Milky-Way-like galaxies, cluster haloes show a larger stochastic bias in the recovered mass profiles. We also test the accuracy of using intracluster gas as a dynamical tracer modelled through a generalised hydrostatic equilibrium equation, and find a comparable systematic uncertainty in the estimated mass to that using dark matter. Lastly, we demonstrate that our conclusions are largely applicable to other steady-state dynamical models including the spherical Jeans equation, by quantitatively segregating their statistical efficiencies and robustness to systematics. We also estimate the limiting number of tracers that leads to the systematics-dominated regime in each case.


title: On Irreversible Metropolis Sampling Related to Langevin Dynamics

abstract: There has been considerable interest in designing Markov chain Monte Carlo algorithms by exploiting numerical methods for Langevin dynamics, which includes Hamiltonian dynamics as a deterministic case. A prominent approach is Hamiltonian Monte Carlo (HMC), where a leapfrog discretization of Hamiltonian dynamics is employed. We investigate a recently proposed class of irreversible sampling algorithms, called Hamiltonian assisted Metropolis sampling (HAMS), which uses an augmented target density similarly as in HMC, but involves a flexible proposal scheme and a carefully formulated acceptance-rejection scheme to achieve generalized reversibility. We show that as the step size tends to 0, the HAMS proposal satisfies a class of stochastic differential equations including Langevin dynamics as a special case. We provide theoretical results for HAMS under the univariate Gaussian setting, including the stationary variance, the expected acceptance rate, and the spectral radius. From these results, we derive default choices of tuning parameters for HAMS, such that only the step size needs to be tuned in applications. Various relatively recent algorithms for Langevin dynamics are also shown to fall in the class of HAMS proposals up to negligible differences. Our numerical experiments on sampling high-dimensional latent variables confirm that the HAMS algorithms consistently achieve superior performance, compared with several Metropolis-adjusted algorithms based on popular integrators of Langevin dynamics.


title: Inverse design of two-dimensional materials with invertible neural networks

abstract: The ability to readily design novel materials with chosen functional properties on-demand represents a next frontier in materials discovery. However, thoroughly and efficiently sampling the entire design space in a computationally tractable manner remains a highly challenging task. To tackle this problem, we propose an inverse design framework (MatDesINNe) utilizing invertible neural networks which can map both forward and reverse processes between the design space and target property. This approach can be used to generate materials candidates for a designated property, thereby satisfying the highly sought-after goal of inverse design. We then apply this framework to the task of band gap engineering in two-dimensional materials, starting with MoS2. Within the design space encompassing six degrees of freedom in applied tensile, compressive and shear strain plus an external electric field, we show the framework can generate novel, high fidelity, and diverse candidates with near-chemical accuracy. We extend this generative capability further to provide insights regarding metal-insulator transition, important for memristive neuromorphic applications among others, in MoS2 which is not otherwise possible with brute force screening. This approach is general and can be directly extended to other materials and their corresponding design spaces and target properties.


title: Geometric sums, size biasing and zero biasing

abstract: The geometric sum plays a significant role in risk theory and reliability theory \cite{Kala97} and a prototypical example of the geometric sum is R\'enyi's theorem~\cite{Renyi56} saying a sequence of suitably parameterised geometric sums converges to the exponential distribution. There is extensive study of the accuracy of exponential distribution approximation to the geometric sum \cite{Sugakova95,Kala97,PekozRollin11} but there is little study on its natural counterpart of gamma distribution approximation to negative binomial sums. In this note, we show that a nonnegative random variable follows a gamma distribution if and only if its size biasing equals its zero biasing. We combine this characterisation with Stein's method to establish simple bounds for gamma distribution approximation to the sum of nonnegative independent random variables, a class of compound Poisson distributions and the negative binomial sum of random variables.


title: Learning proofs for the classification of nilpotent semigroups

abstract: Machine learning is applied to find proofs, with smaller or smallest numbers of nodes, for the classification of 4-nilpotent semigroups.


title: Topological Measurement of Deep Neural Networks Using Persistent Homology

abstract: The inner representation of deep neural networks (DNNs) is indecipherable, which makes it difficult to tune DNN models, control their training process, and interpret their outputs. In this paper, we propose a novel approach to investigate the inner representation of DNNs through topological data analysis (TDA). Persistent homology (PH), one of the outstanding methods in TDA, was employed for investigating the complexities of trained DNNs. We constructed clique complexes on trained DNNs and calculated the one-dimensional PH of DNNs. The PH reveals the combinational effects of multiple neurons in DNNs at different resolutions, which is difficult to be captured without using PH. Evaluations were conducted using fully connected networks (FCNs) and networks combining FCNs and convolutional neural networks (CNNs) trained on the MNIST and CIFAR-10 data sets. Evaluation results demonstrate that the PH of DNNs reflects both the excess of neurons and problem difficulty, making PH one of the prominent methods for investigating the inner representation of DNNs.


title: Topology of spaces of smooth functions and gradient-like flows with prescribed singularities on surfaces

abstract: By a gradient-like flow on a closed orientable surface $M$, we mean a closed 1-form $\beta$ defined on $M$ punctured at a finite set of points (sources and sinks of $\beta$) such that there exists a Morse function $f$ on $M$, called an energy function of $\beta$, whose critical points coincide with equilibria of $\beta$, and the pair $(f,\beta)$ has a canonical form near each critical point of $f$. Let $\mathcal{B}=\mathcal{B}(\beta_0)$ be the space of all gradient-like flows on $M$ having the same types of local singularities as a flow $\beta_0$, and $\mathcal{F}=\mathcal{F}(f_0)$ the space of all Morse functions on $M$ having the same types of local singularities as an energy function $f_0$ of $\beta_0$. We prove that the spaces $\mathcal{F}$ and $\mathcal{B}$, equipped with $C^\infty$ topologies, are homotopy equivalent to some manifold $\mathcal{M}_s$, moreover their decompositions into $\mathrm{Diff}^0(M)$-orbits are given by two transversal fibrations on $\mathcal{M}_s$. Similar results are proved for topological equivalence classes on $\mathcal{F}$ and $\mathcal{B}$, and for non-Morse singularities.


title: Towards Logging Noisiness Theory: quality aspects to characterize unwanted log entries

abstract: Context: Logging tasks track the system's functioning by keeping records of evidence that have been analyzed by monitoring and observability activities. For these activities to be effective, it is necessary to consider the quality of the consumed information. Problem: However, the presence of noise - unwanted information - compromises the log files' quality. The noisiness of a log file can be affected among other things by: (i) the wrong severity log choices, (ii) the production of duplicate entries, (iii) the incompleteness of the information, (iv) the inappropriate format of the entries, (v) the amount of information generated. Objective: This work aims to broadly define the concept of noise in the context of logging, proposing the initial steps of Logging Noisiness, a theory on quality aspects to characterize unwanted log entries.


title: Machine Learning Based Anxiety Detection in Older Adults using Wristband Sensors and Context Feature

abstract: This paper explores a novel method for anxiety detection in older adults using simple wristband sensors such as Electrodermal Activity (EDA) and Photoplethysmogram (PPG) and a context-based feature. The proposed method for anxiety detection combines features from a single physiological signal with an experimental context-based feature to improve the performance of the anxiety detection model. The experimental data for this work is obtained from a year-long experiment on 41 healthy older adults (26 females and 15 males) in the age range 60-80 with mean age 73.36+-5.25 during a Trier Social Stress Test (TSST) protocol. The anxiety level ground truth was obtained from State-Trait Anxiety Inventory (STAI), which is regarded as the gold standard to measure perceived anxiety. EDA and Blood Volume Pulse (BVP) signals were recorded using a wrist-worn EDA and PPG sensor respectively. 47 features were computed from EDA and BVP signal, out of which a final set of 24 significantly correlated features were selected for analysis. The phases of the experimental study are encoded as unique integers to generate the context feature vector. A combination of features from a single sensor with the context feature vector is used for training a machine learning model to distinguish between anxious and not-anxious states. Results and analysis showed that the EDA and BVP machine learning models that combined the context feature along with the physiological features achieved 3.37% and 6.41% higher accuracy respectively than the models that used only physiological features. Further, end-to-end processing of EDA and BVP signals was simulated for real-time anxiety level detection. This work demonstrates the practicality of the proposed anxiety detection method in facilitating long-term monitoring of anxiety in older adults using low-cost consumer devices.


title: Embracing Ambiguity: Shifting the Training Target of NLI Models

abstract: Natural Language Inference (NLI) datasets contain examples with highly ambiguous labels. While many research works do not pay much attention to this fact, several recent efforts have been made to acknowledge and embrace the existence of ambiguity, such as UNLI and ChaosNLI. In this paper, we explore the option of training directly on the estimated label distribution of the annotators in the NLI task, using a learning loss based on this ambiguity distribution instead of the gold-labels. We prepare AmbiNLI, a trial dataset obtained from readily available sources, and show it is possible to reduce ChaosNLI divergence scores when finetuning on this data, a promising first step towards learning how to capture linguistic ambiguity. Additionally, we show that training on the same amount of data but targeting the ambiguity distribution instead of gold-labels can result in models that achieve higher performance and learn better representations for downstream tasks.


title: SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

abstract: Three-dimensional face dense alignment and reconstruction in the wild is a challenging problem as partial facial information is commonly missing in occluded and large pose face images. Large head pose variations also increase the solution space and make the modeling more difficult. Our key idea is to model occlusion and pose to decompose this challenging task into several relatively more manageable subtasks. To this end, we propose an end-to-end framework, termed as Self-aligned Dual face Regression Network (SADRNet), which predicts a pose-dependent face, a pose-independent face. They are combined by an occlusion-aware self-alignment to generate the final 3D face. Extensive experiments on two popular benchmarks, AFLW2000-3D and Florence, demonstrate that the proposed method achieves significant superior performance over existing state-of-the-art methods.


title: Fisher-Pitman permutation tests based on nonparametric Poisson mixtures with application to single cell genomics

abstract: This paper investigates the theoretical and empirical performance of Fisher-Pitman-type permutation tests for assessing the equality of unknown Poisson mixture distributions. Building on nonparametric maximum likelihood estimators (NPMLEs) of the mixing distribution, these tests are theoretically shown to be able to adapt to complicated unspecified structures of count data and also consistent against their corresponding ANOVA-type alternatives; the latter is a result in parallel to classic claims made by Robinson (Robinson, 1973). The studied methods are then applied to a single-cell RNA-seq data obtained from different cell types from brain samples of autism subjects and healthy controls; empirically, they unveil genes that are differentially expressed between autism and control subjects yet are missed using common tests. For justifying their use, rate optimality of NPMLEs is also established in settings similar to nonparametric Gaussian (Wu and Yang, 2020a) and binomial mixtures (Tian et al., 2017; Vinayak et al., 2019).


title: Context-tree weighting for real-valued time series: Bayesian inference with hierarchical mixture models

abstract: Real-valued time series are ubiquitous in the sciences and engineering. In this work, a general, hierarchical Bayesian modelling framework is developed for building mixture models for times series. This development is based, in part, on the use of context trees, and it includes a collection of effective algorithmic tools for learning and inference. A discrete context (or 'state') is extracted for each sample, consisting of a discretised version of some of the most recent observations preceding it. The set of all relevant contexts are represented as a discrete context-tree. At the bottom level, a different real-valued time series model is associated with each context-state, i.e., with each leaf of the tree. This defines a very general framework that can be used in conjunction with any existing model class to build flexible and interpretable mixture models. Extending the idea of context-tree weighting leads to algorithms that allow for efficient, exact Bayesian inference in this setting. The utility of the general framework is illustrated in detail when autoregressive (AR) models are used at the bottom level, resulting in a nonlinear AR mixture model. The associated methods are found to outperform several state-of-the-art techniques on simulated and real-world experiments.


title: Causal aggregation: estimation and inference of causal effects by constraint-based data fusion

abstract: In causal inference, it is common to estimate the causal effect of a single treatment variable on an outcome. However, practitioners may also be interested in the effect of simultaneous interventions on multiple covariates of a fixed target variable. We propose a novel method that allows to estimate the effect of joint interventions using data from different experiments in which only very few variables are manipulated. If there is only little randomized data or no randomized data at all, one can use observational data sets if certain parental sets are known or instrumental variables are available. If the joint causal effect is linear, the proposed method can be used for estimation and inference of joint causal effects, and we characterize conditions for identifiability. In the overidentified case, we indicate how to leverage all the available causal information across multiple data sets to efficiently estimate the causal effects. If the dimension of the covariate vector is large, we may only have a few samples in each data set. Under a sparsity assumption, we derive an estimator of the causal effects in this high-dimensional scenario. In addition, we show how to deal with the case where a lack of experimental constraints prevents direct estimation of the causal effects. When the joint causal effects are non-linear, we characterize conditions under which identifiability holds, and propose a non-linear causal aggregation methodology for experimental data sets similar to the gradient boosting algorithm where in each iteration we combine weak learners trained on different datasets using only unconfounded samples. We demonstrate the effectiveness of the proposed method on simulated and semi-synthetic data.


title: Frequency chimera state induced by differing dynamical timescales

abstract: We report the occurrence of a self-emerging frequency chimera state in spatially extended systems of coupled oscillators, where the coherence and incoherence are defined with respect to the emergent frequency of the oscillations. This is generated by the local coupling among nonlinear oscillators evolving under differing dynamical timescales starting from random initial conditions. We show how they self-organize to structured patterns with spatial domains of coherence that are in frequency synchronization, coexisting with domains that are incoherent in frequencies. Our study has relevance in understanding such patterns observed in real-world systems like neuronal systems, power grids, social and ecological networks, where differing dynamical timescales is natural and realistic amongthe interacting systems.


title: Prediction of half-metallicity and spin-gapless semiconducting behavior in the new series of FeCr-based quaternary Heusler alloys: an ab initio study

abstract: This paper presents a detailed investigation of FeCr-based quaternary Heusler alloys. By using ultrasoft pseudopotential, electronic and magnetic properties of the compounds are studied within the framework of Density Functional Theory (DFT) by using the Quantum Espresso package. The thermodynamic, mechanical, and dynamical stability of the compounds is established through the comprehensive study of different mechanical parameters and phonon dispersion curves. The meticulous study of elastic parameters such as bulk, Young's, shear moduli, etc. is done to understand different mechanical properties. The FeCr-based compounds containing also Yttrium are studied to redress the contradictory electronic and magnetic properties observed in the literature. The interesting properties like half-metallicity and spin-gapless semiconducting (SGS) behavior are realized in the compounds under study.


title: Model Zoo: A Growing "Brain" That Learns Continually

abstract: This paper argues that continual learning methods can benefit by splitting the capacity of the learner across multiple models. We use statistical learning theory and experimental analysis to show how multiple tasks can interact with each other in a non-trivial fashion when a single model is trained on them. The generalization error on a particular task can improve when it is trained with synergistic tasks, but can also deteriorate when trained with competing tasks. This theory motivates our method named Model Zoo which, inspired from the boosting literature, grows an ensemble of small models, each of which is trained during one episode of continual learning. We demonstrate that Model Zoo obtains large gains in accuracy on a variety of continual learning benchmark problems. Code is available at https://github.com/grasp-lyrl/modelzoo_continual.


title: Collaborative Causal Discovery with Atomic Interventions

abstract: We introduce a new Collaborative Causal Discovery problem, through which we model a common scenario in which we have multiple independent entities each with their own causal graph, and the goal is to simultaneously learn all these causal graphs. We study this problem without the causal sufficiency assumption, using Maximal Ancestral Graphs (MAG) to model the causal graphs, and assuming that we have the ability to actively perform independent single vertex (or atomic) interventions on the entities. If the $M$ underlying (unknown) causal graphs of the entities satisfy a natural notion of clustering, we give algorithms that leverage this property and recovers all the causal graphs using roughly logarithmic in $M$ number of atomic interventions per entity. These are significantly fewer than $n$ atomic interventions per entity required to learn each causal graph separately, where $n$ is the number of observable nodes in the causal graph. We complement our results with a lower bound and discuss various extensions of our collaborative setting.


title: Planning Multimodal Exploratory Actions for Online Robot Attribute Learning

abstract: Robots frequently need to perceive object attributes, such as "red," "heavy," and "empty," using multimodal exploratory actions, such as "look," "lift," and "shake." Robot attribute learning algorithms aim to learn an observation model for each perceivable attribute given an exploratory action. Once the attribute models are learned, they can be used to identify attributes of new objects, answering questions, such as "Is this object red and empty?" Attribute learning and identification are being treated as two separate problems in the literature. In this paper, we first define a new problem called online robot attribute learning (On-RAL), where the robot works on attribute learning and attribute identification simultaneously. Then we develop an algorithm called information-theoretic reward shaping (ITRS) that actively addresses the trade-off between exploration and exploitation in On-RAL problems. ITRS was compared with competitive robot attribute learning baselines, and experimental results demonstrate ITRS' superiority in learning efficiency and identification accuracy.


title: Non-delay limit in the energy space from the nonlinear damped wave equation to the nonlinear heat equation

abstract: We consider a singular limit problem from the damped wave equation with a power type nonlinearity to the corresponding heat equation. We call our singular limit problem non-delay limit. Our proofs are based on the argument for non-relativistic limit from the nonlinear Klein-Gordon equation to the nonlinear Schr\"{o}dinger equation by the second author, Nakanishi, and Ozawa (2002), Nakanishi (2002), and Masmoudi and Nakanishi (2002). We can obtain better results for the non-delay limit problem than that for the non-relativistic limit problem due to the dissipation property. More precisely, we get the better convergence rate of the $L^2$-norm and we also obtain the global-in-time uniform convergence of the non-delay limit in the $L^2$-supercritical case.


title: Do Grammatical Error Correction Models Realize Grammatical Generalization?

abstract: There has been an increased interest in data generation approaches to grammatical error correction (GEC) using pseudo data. However, these approaches suffer from several issues that make them inconvenient for real-world deployment including a demand for large amounts of training data. On the other hand, some errors based on grammatical rules may not necessarily require a large amount of data if GEC models can realize grammatical generalization. This study explores to what extent GEC models generalize grammatical knowledge required for correcting errors. We introduce an analysis method using synthetic and real GEC datasets with controlled vocabularies to evaluate whether models can generalize to unseen errors. We found that a current standard Transformer-based GEC model fails to realize grammatical generalization even in simple settings with limited vocabulary and syntax, suggesting that it lacks the generalization ability required to correct errors from provided training examples.


title: Deep Particulate Matter Forecasting Model Using Correntropy-Induced Loss

abstract: Forecasting the particulate matter (PM) concentration in South Korea has become urgently necessary owing to its strong negative impact on human life. In most statistical or machine learning methods, independent and identically distributed data, for example, a Gaussian distribution, are assumed; however, time series such as air pollution and weather data do not meet this assumption. In this study, the maximum correntropy criterion for regression (MCCR) loss is used in an analysis of the statistical characteristics of air pollution and weather data. Rigorous seasonality adjustment of the air pollution and weather data was performed because of their complex seasonality patterns and the heavy-tailed distribution of data even after deseasonalization. The MCCR loss was applied to multiple models including conventional statistical models and state-of-the-art machine learning models. The results show that the MCCR loss is more appropriate than the conventional mean squared error loss for forecasting extreme values.


title: Graph Belief Propagation Networks

abstract: With the wide-spread availability of complex relational data, semi-supervised node classification in graphs has become a central machine learning problem. Graph neural networks are a recent class of easy-to-train and accurate methods for this problem that map the features in the neighborhood of a node to its label, but they ignore label correlation during inference and their predictions are difficult to interpret. On the other hand, collective classification is a traditional approach based on interpretable graphical models that explicitly model label correlations. Here, we introduce a model that combines the advantages of these two approaches, where we compute the marginal probabilities in a conditional random field, similar to collective classification, and the potentials in the random field are learned through end-to-end training, akin to graph neural networks. In our model, potentials on each node only depend on that node's features, and edge potentials are learned via a coupling matrix. This structure enables simple training with interpretable parameters, scales to large networks, naturally incorporates training labels at inference, and is often more accurate than related approaches. Our approach can be viewed as either an interpretable message-passing graph neural network or a collective classification method with higher capacity and modernized training.


title: Minibatch and Momentum Model-based Methods for Stochastic Weakly Convex Optimization

abstract: Stochastic model-based methods have received increasing attention lately due to their appealing robustness to the stepsize selection and provable efficiency guarantee. We make two important extensions for improving model-based methods on stochastic weakly convex optimization. First, we propose new minibatch model-based methods by involving a set of samples to approximate the model function in each iteration. For the first time, we show that stochastic algorithms achieve linear speedup over the batch size even for non-smooth and non-convex (particularly, weakly convex) problems. To this end, we develop a novel sensitivity analysis of the proximal mapping involved in each algorithm iteration. Our analysis appears to be of independent interests in more general settings. Second, motivated by the success of momentum stochastic gradient descent, we propose a new stochastic extrapolated model-based method, greatly extending the classic Polyak momentum technique to a wider class of stochastic algorithms for weakly convex optimization. The rate of convergence to some natural stationarity condition is established over a fairly flexible range of extrapolation terms. While mainly focusing on weakly convex optimization, we also extend our work to convex optimization. We apply the minibatch and extrapolated model-based methods to stochastic convex optimization, for which we provide a new complexity bound and promising linear speedup in batch size. Moreover, an accelerated model-based method based on Nesterov's momentum is presented, for which we establish an optimal complexity bound for reaching optimality.


title: Online Trading Models with Deep Reinforcement Learning in the Forex Market Considering Transaction Costs

abstract: In recent years, a wide range of investment models have been created using artificial intelligence. Automatic trading by artificial intelligence can expand the range of trading methods, such as by conferring the ability to operate 24 hours a day and the ability to trade with high frequency. Automatic trading can also be expected to trade with more information than is available to humans if it can sufficiently consider past data. In this paper, we propose an investment agent based on a deep reinforcement learning model, which is an artificial intelligence model. The model considers the transaction costs involved in actual trading and creates a framework for trading over a long period of time so that it can make a large profit on a single trade. In doing so, it can maximize the profit while keeping transaction costs low. In addition, in consideration of actual operations, we use online learning so that the system can continue to learn by constantly updating the latest online data instead of learning with static data. This makes it possible to trade in non-stationary financial markets by always incorporating current market trend information.


title: Real-Time Cognitive Evaluation of Online Learners through Automatically Generated Questions

abstract: With the increased adoption of E-learning platforms, keeping online learners engaged throughout a lesson is challenging. One approach to tackle this challenge is to probe learn-ers periodically by asking questions. The paper presents an approach to generate questions from a given video lecture automatically. The generated questions are aimed to evaluate learners' lower-level cognitive abilities. The approach automatically extracts text from video lectures to generates wh-kinds of questions. When learners respond with an answer, the proposed approach further evaluates the response and provides feedback. Besides enhancing learner's engagement, this approach's main benefits are that it frees instructors from design-ing questions to check the comprehension of a topic. Thus, instructors can spend this time productively on other activities.


title: RTNeural: Fast Neural Inferencing for Real-Time Systems

abstract: RTNeural is a neural inferencing library written in C++. RTNeural is designed to be used in systems with hard real-time constraints, with additional emphasis on speed, flexibility, size, and convenience. The motivation and design of the library are described, as well as real-world use-cases, and performance comparisons with other neural inferencing libraries.


title: Systematic study of surface properties for Ne, Na, Mg, Al and Si isotopes in a coherent density fluctuation model using the relativistic mean field formalism

abstract: We have systematically studied the surface properties, such as symmetric energy, neutron pressure, and symmetry energy curvature coefficient for Ne, Na, Mg, Al, and Si nuclei from the proton to neutron drip-lines. The Coherent Density Fluctuation Model (CDFM) is used to estimate these quantities taking the relativistic mean-field densities as inputs. The Br\"uckner energy density functional is taken for the nuclear matter binding energy and local density approximation is applied for its conversion to coordinate space. The symmetry energy again decomposed to the volume and surface components within the liquid drop model formalism to the volume and surface parts separately. Before calculating the surface properties of finite nuclei, the calculated bulk properties are compared with the experimental data, whenever available. The NL3* parameter set with the BCS pairing approach in an axially deformed frame-work is used to take care of the pairing correlation when needed. The deformed density is converted to its spherical equivalent with a two Gaussian fitting, which is used as an input for the calculation of weight function in the CDFM approximation. With the help of the symmetric energy for the recently isotopes $^{29}$F, $^{28}$Ne, $^{29,30}$Na and $^{31,35,36}$Mg are considered to be within the {\it island of inversion} emphasized {\bf [Phys. Lett. B 772, 529 (2017)]}. Although we get large symmetric energies corresponding to a few neutron numbers for this isotopic chain as expected, an irregular trend appears for all these considered nuclei. The possible reason behind this abnormal behavior of symmetry energy for these lighter mass nuclei is also included in the discussion, which gives a direction for future analysis.


title: Multi-facet Contextual Bandits: A Neural Network Perspective

abstract: Contextual multi-armed bandit has shown to be an effective tool in recommender systems. In this paper, we study a novel problem of multi-facet bandits involving a group of bandits, each characterizing the users' needs from one unique aspect. In each round, for the given user, we need to select one arm from each bandit, such that the combination of all arms maximizes the final reward. This problem can find immediate applications in E-commerce, healthcare, etc. To address this problem, we propose a novel algorithm, named MuFasa, which utilizes an assembled neural network to jointly learn the underlying reward functions of multiple bandits. It estimates an Upper Confidence Bound (UCB) linked with the expected reward to balance between exploitation and exploration. Under mild assumptions, we provide the regret analysis of MuFasa. It can achieve the near-optimal $\widetilde{ \mathcal{O}}((K+1)\sqrt{T})$ regret bound where $K$ is the number of bandits and $T$ is the number of played rounds. Furthermore, we conduct extensive experiments to show that MuFasa outperforms strong baselines on real-world data sets.


title: Discovery of Layered Software Architecture from Source Code Using Ego Networks

abstract: Software architecture refers to the high-level abstraction of a system including the configuration of the involved elements and the interactions and relationships that exist between them. Source codes can be easily built by referring to the software architectures. However, the reverse process i.e. derivation of the software architecture from the source code is a challenging task. Further, such an architecture consists of multiple layers, and distributing the existing elements into these layers should be done accurately and efficiently. In this paper, a novel approach is presented for the recovery of layered architectures from Java-based software systems using the concept of ego networks. Ego networks have traditionally been used for social network analysis, but in this paper, they are modified in a particular way and tuned to suit the mentioned task. Specifically, a dependency network is extracted from the source code to create an ego network. The ego network is processed to create and optimize ego layers in a particular structure. These ego layers when integrated and optimized together give the final layered architecture. The proposed approach is evaluated in two ways: on static versions of three open-source software, and a continuously evolving software system. The distribution of nodes amongst the proposed layers and the committed violations are observed on both class level and package level. The proposed method is seen to outperform the existing standard approaches over multiple performance metrics. We also carry out the analysis of variation in the results concerning the change in the node selection strategy and the frequency. The empirical observations show promising signs for recovering software architecture layers from source codes using this technique and also extending it further to other languages and software.


title: DAMSL: Domain Agnostic Meta Score-based Learning

abstract: In this paper, we propose Domain Agnostic Meta Score-based Learning (DAMSL), a novel, versatile and highly effective solution that delivers significant out-performance over state-of-the-art methods for cross-domain few-shot learning. We identify key problems in previous meta-learning methods over-fitting to the source domain, and previous transfer-learning methods under-utilizing the structure of the support set. The core idea behind our method is that instead of directly using the scores from a fine-tuned feature encoder, we use these scores to create input coordinates for a domain agnostic metric space. A graph neural network is applied to learn an embedding and relation function over these coordinates to process all information contained in the score distribution of the support set. We test our model on both established CD-FSL benchmarks and new domains and show that our method overcomes the limitations of previous meta-learning and transfer-learning methods to deliver substantial improvements in accuracy across both smaller and larger domain shifts.


title: Clone-Seeker: Effective Code Clone Search Using Annotations

abstract: Source code search plays an important role in software development, e.g. for exploratory development or opportunistic reuse of existing code from a code base. Often, exploration of different implementations with the same functionality is needed for tasks like automated software transplantation, software diversification, and software repair. Code clones, which are syntactically or semantically similar code fragments, are perfect candidates for such tasks. Searching for code clones involves a given search query to retrieve the relevant code fragments. We propose a novel approach called Clone-Seeker that focuses on utilizing clone class features in retrieving code clones. For this purpose, we generate metadata for each code clone in the form of a natural language document. The metadata includes a pre-processed list of identifiers from the code clones augmented with a list of keywords indicating the semantics of the code clone. This keyword list can be extracted from a manually annotated general description of the clone class, or automatically generated from the source code of the entire clone class. This approach helps developers to perform code clone search based on a search query written either as source code terms, or as natural language. In our quantitative evaluation, we show that (1) Clone-Seeker has a higher recall when searching for semantic code clones (i.e., Type-4) in BigCloneBench than the state-of-the-art; and (2) Clone-Seeker can accurately search for relevant code clones by applying natural language queries.


title: Occlusion-aware Unsupervised Learning of Depth from 4-D Light Fields

abstract: Depth estimation is a fundamental issue in 4-D light field processing and analysis. Although recent supervised learning-based light field depth estimation methods have significantly improved the accuracy and efficiency of traditional optimization-based ones, these methods rely on the training over light field data with ground-truth depth maps which are challenging to obtain or even unavailable for real-world light field data. Besides, due to the inevitable gap (or domain difference) between real-world and synthetic data, they may suffer from serious performance degradation when generalizing the models trained with synthetic data to real-world data. By contrast, we propose an unsupervised learning-based method, which does not require ground-truth depth as supervision during training. Specifically, based on the basic knowledge of the unique geometry structure of light field data, we present an occlusion-aware strategy to improve the accuracy on occlusion areas, in which we explore the angular coherence among subsets of the light field views to estimate initial depth maps, and utilize a constrained unsupervised loss to learn their corresponding reliability for final depth prediction. Additionally, we adopt a multi-scale network with a weighted smoothness loss to handle the textureless areas. Experimental results on synthetic data show that our method can significantly shrink the performance gap between the previous unsupervised method and supervised ones, and produce depth maps with comparable accuracy to traditional methods with obviously reduced computational cost. Moreover, experiments on real-world datasets show that our method can avoid the domain shift problem presented in supervised methods, demonstrating the great potential of our method.


title: Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction

abstract: The consistency of a response to a given post at semantic-level and emotional-level is essential for a dialogue system to deliver human-like interactions. However, this challenge is not well addressed in the literature, since most of the approaches neglect the emotional information conveyed by a post while generating responses. This article addresses this problem by proposing a unifed end-to-end neural architecture, which is capable of simultaneously encoding the semantics and the emotions in a post for generating more intelligent responses with appropriately expressed emotions. Extensive experiments on real-world data demonstrate that the proposed method outperforms the state-of-the-art methods in terms of both content coherence and emotion appropriateness.


title: Codazzi tensors and the quasi-statistical structure associated to affine connections on three-dimensional Lorentzian Lie groups

abstract: In this paper, we classify three-dimensional Lorentzian Lie groups on which Ricci tensors associated to Bott connections, canonical connections and Kobayashi-Nomizu connections are Codazzi tensors associated to these connections. We also classify three-dimensional Lorentzian Lie group with the quasi-statistical structure associated to Bott connections, canonical connections and Kobayashi-Nomizu connections.


title: Empowering Language Understanding with Counterfactual Reasoning

abstract: Present language understanding methods have demonstrated extraordinary ability of recognizing patterns in texts via machine learning. However, existing methods indiscriminately use the recognized patterns in the testing phase that is inherently different from us humans who have counterfactual thinking, e.g., to scrutinize for the hard testing samples. Inspired by this, we propose a Counterfactual Reasoning Model, which mimics the counterfactual thinking by learning from few counterfactual samples. In particular, we devise a generation module to generate representative counterfactual samples for each factual sample, and a retrospective module to retrospect the model prediction by comparing the counterfactual and factual samples. Extensive experiments on sentiment analysis (SA) and natural language inference (NLI) validate the effectiveness of our method.


title: Spectroscopy of $NbSe_2$ using Energy-Tunable Defect-Embedded Quantum Dots

abstract: Quantum dots have sharply defined energy levels, which can be used for high resolution energy spectroscopy when integrated in tunneling circuitry. Here we report dot-assisted spectroscopy measurements of the superconductor $NbSe_2$, using a van der Waals device consisting of a vertical stack of $graphene-MoS_2-NbSe_2$. The $MoS_2$ tunnel barriers host naturally occurring defects which function as quantum dots, allowing transport via resonant tunneling. The dot energies are tuned by an electric field exerted by a back-gate, which penetrates the graphene source electrode. Scanning the dot potential across the superconductor Fermi energy, we reproduce the $NbSe_2$ density of states which exhibits a well-resolved two-gap spectrum. Surprisingly, we find that the dot-assisted current is dominated by the lower energy feature of the two $NbSe_2$ gaps, possibly due to a selection rule which favors coupling between the dots and the orbitals which exhibit this gap.


title: How Did This Get Funded?! Automatically Identifying Quirky Scientific Achievements

abstract: Humor is an important social phenomenon, serving complex social and psychological functions. However, despite being studied for millennia humor is computationally not well understood, often considered an AI-complete problem. In this work, we introduce a novel setting in humor mining: automatically detecting funny and unusual scientific papers. We are inspired by the Ig Nobel prize, a satirical prize awarded annually to celebrate funny scientific achievements (example past winner: "Are cows more likely to lie down the longer they stand?"). This challenging task has unique characteristics that make it particularly suitable for automatic learning. We construct a dataset containing thousands of funny papers and use it to learn classifiers, combining findings from psychology and linguistics with recent advances in NLP. We use our models to identify potentially funny papers in a large dataset of over 630,000 articles. The results demonstrate the potential of our methods, and more broadly the utility of integrating state-of-the-art NLP methods with insights from more traditional disciplines.


title: Embedded vs. External Controllers in Software-Defined IoT Networks

abstract: The flexible and programmable architectural model offered by Software-Defined Networking (SDN) has re-imagined modern networks. Supported by powerful hardware and high-speed communications between devices and the controller, SDN provides a means to virtualize control functionality and enable rapid network reconfiguration in response to dynamic application requirements. However, recent efforts to apply SDN's centralized control model to the Internet of Things (IoT) have identified significant challenges due to the constraints faced by embedded low-power devices and networks that reside at the IoT edge. In particular, reliance on external SDN controllers on the backbone network introduces a performance bottleneck (e.g., latency). To this end, we advocate a case for supporting Software-Defined IoT networks through the introduction of lightweight SDN controllers directly on the embedded hardware. We firstly explore the performance of two popular SDN implementations for IoT mesh networks, $\mu$SDN and SDN-WISE, showing the former demonstrates considerable gains over the latter. We consequently employ $\mu$SDN to conduct a study of embedded vs. external SDN controller performance. We highlight how the advantage of an embedded controller is reduced as the network scales, and quantify a point at which an external controller should be used for larger networks.


title: Efficient Continuous Control with Double Actors and Regularized Critics

abstract: How to obtain good value estimation is one of the key problems in Reinforcement Learning (RL). Current value estimation methods, such as DDPG and TD3, suffer from unnecessary over- or underestimation bias. In this paper, we explore the potential of double actors, which has been neglected for a long time, for better value function estimation in continuous setting. First, we uncover and demonstrate the bias alleviation property of double actors by building double actors upon single critic and double critics to handle overestimation bias in DDPG and underestimation bias in TD3 respectively. Next, we interestingly find that double actors help improve the exploration ability of the agent. Finally, to mitigate the uncertainty of value estimate from double critics, we further propose to regularize the critic networks under double actors architecture, which gives rise to Double Actors Regularized Critics (DARC) algorithm. Extensive experimental results on challenging continuous control tasks show that DARC significantly outperforms state-of-the-art methods with higher sample efficiency.


title: ScheduleNet: Learn to solve multi-agent scheduling problems with reinforcement learning

abstract: We propose ScheduleNet, a RL-based real-time scheduler, that can solve various types of multi-agent scheduling problems. We formulate these problems as a semi-MDP with episodic reward (makespan) and learn ScheduleNet, a decentralized decision-making policy that can effectively coordinate multiple agents to complete tasks. The decision making procedure of ScheduleNet includes: (1) representing the state of a scheduling problem with the agent-task graph, (2) extracting node embeddings for agent and tasks nodes, the important relational information among agents and tasks, by employing the type-aware graph attention (TGA), and (3) computing the assignment probability with the computed node embeddings. We validate the effectiveness of ScheduleNet as a general learning-based scheduler for solving various types of multi-agent scheduling tasks, including multiple salesman traveling problem (mTSP) and job shop scheduling problem (JSP).


title: Brain Age Estimation From MRI Using Cascade Networks with Ranking Loss

abstract: Chronological age of healthy people is able to be predicted accurately using deep neural networks from neuroimaging data, and the predicted brain age could serve as a biomarker for detecting aging-related diseases. In this paper, a novel 3D convolutional network, called two-stage-age-network (TSAN), is proposed to estimate brain age from T1-weighted MRI data. Compared with existing methods, TSAN has the following improvements. First, TSAN uses a two-stage cascade network architecture, where the first-stage network estimates a rough brain age, then the second-stage network estimates the brain age more accurately from the discretized brain age by the first-stage network. Second, to our knowledge, TSAN is the first work to apply novel ranking losses in brain age estimation, together with the traditional mean square error (MSE) loss. Third, densely connected paths are used to combine feature maps with different scales. The experiments with $6586$ MRIs showed that TSAN could provide accurate brain age estimation, yielding mean absolute error (MAE) of $2.428$ and Pearson's correlation coefficient (PCC) of $0.985$, between the estimated and chronological ages. Furthermore, using the brain age gap between brain age and chronological age as a biomarker, Alzheimer's disease (AD) and Mild Cognitive Impairment (MCI) can be distinguished from healthy control (HC) subjects by support vector machine (SVM). Classification AUC in AD/HC and MCI/HC was $0.904$ and $0.823$, respectively. It showed that brain age gap is an effective biomarker associated with risk of dementia, and has potential for early-stage dementia risk screening. The codes and trained models have been released on GitHub: https://github.com/Milan-BUAA/TSAN-brain-age-estimation.


title: Anomalous Elasticity and Screening in Amorphous Solids

abstract: Amorphous solids appear to react elastically to small external strains, but in contrast to ideal elastic media, plastic responses abound immediately, at any value of the strain. Such plastic responses are quasi-localized in nature, with the ``cheapest" one being a quadrupolar source. The existence of such plastic responses results in {\em screened elasticity} in which strains and stresses can either quantitatively or qualitatively differ from the un-screened theory, depending on the specific screening mechanism. Here we offer a theory of such screening effects by plastic quadrupoles, dipoles and monopoles, explain their natural appearance, and point out the analogy to electrostatic screening by electric charges and dipoles. For low density of quadrupoles the effect is to normalize the elastic moduli without a qualitative change compared to pure elasticity theory; for higher density of quadrupoles the screening effects result in qualitative changes. Predictions for the spatial dependence of displacement fields caused by local sources of strains are provided and compared to numerical simulations. We find that anomalous elasticity is richer than electrostatics in having a screening mode that does not appear in the electrostatic analog


title: Thermal properties of structurally balanced systems on diluted and densified triangulations

abstract: The dynamics of social relations and the possibility of reaching the state of structural balance (Heider balance) are discussed for various networks of interacting actors under the influence of the temperature modeling the social noise level. For that purpose, two main types of lattices are considered. The first is created by removing some links from a regular triangular lattice to produce a diluted triangular lattice, and the second by adding more links to create an enhanced triangular lattice. In both those cases, the full range of possible graph densities is discussed, limited by the extreme cases of networks which consist of a small number of separated triads and fully connected networks. It is shown that the existence of the balanced state is not possible if the average node degree is too close to the value characterizing the regular triangular lattice. Otherwise, both balanced (or partially balanced) and imbalanced states are possible, depending on the temperature. However, only for graphs which are dense enough a phase transition of the first kind is observed, while less enhanced networks (and all diluted) indicate a smooth cross-over between the two states. The cross-over temperatures are size-independent only for the diluted triangular lattices and depend on the size of the system for the enhanced triangular lattices, as is the case also for the critical temperatures of the phase transition observed in denser enhanced lattices.


title: Amplification of gravitational wave by a Kerr black hole

abstract: Binary black hole may form near a supermassive black hole. The background black hole (BH) will affect the gravitational wave (GW) generated by the binary black hole. It is well known that the Penrose process may provide extra energy due to the ergosphere. In the present paper we investigate the energy amplification of the gravitational wave by a Kerr black hole background. In particular and different from the earlier studies, we compare the energies of the waves in the cases with and without a nearby Kerr BH. We find that only when the binary black hole is moving relative to the Kerr background can the GW energy be amplified. Otherwise, the energy will be suppressed by the background Kerr black hole. This finding is consistent with the inequality found by Wald for Penrose process. Taking into account realistic astrophysical scenarios, we find that the Kerr black hole background can amplify the GW energy by at most 5 times.


title: MURANA: A Generic Framework for Stochastic Variance-Reduced Optimization

abstract: We propose a generic variance-reduced algorithm, which we call MUltiple RANdomized Algorithm (MURANA), for minimizing a sum of several smooth functions plus a regularizer, in a sequential or distributed manner. Our method is formulated with general stochastic operators, which allow us to model various strategies for reducing the computational complexity. For example, MURANA supports sparse activation of the gradients, and also reduction of the communication load via compression of the update vectors. This versatility allows MURANA to cover many existing randomization mechanisms within a unified framework, which also makes it possible to design new methods as special cases.


title: Sharp lower bounds for moments of $\zeta'(\rho)$

abstract: We study the $2k$-th discrete moment of the derivative of the Riemann zeta-function at nontrivial zeros to establish sharp lower bounds for all real $k \geq 0$ under the Riemann hypothesis (RH).


title: Approximate Graph Propagation

abstract: Efficient computation of node proximity queries such as transition probabilities, Personalized PageRank, and Katz are of fundamental importance in various graph mining and learning tasks. In particular, several recent works leverage fast node proximity computation to improve the scalability of Graph Neural Networks (GNN). However, prior studies on proximity computation and GNN feature propagation are on a case-by-case basis, with each paper focusing on a particular proximity measure. In this paper, we propose Approximate Graph Propagation (AGP), a unified randomized algorithm that computes various proximity queries and GNN feature propagation, including transition probabilities, Personalized PageRank, heat kernel PageRank, Katz, SGC, GDC, and APPNP. Our algorithm provides a theoretical bounded error guarantee and runs in almost optimal time complexity. We conduct an extensive experimental study to demonstrate AGP's effectiveness in two concrete applications: local clustering with heat kernel PageRank and node classification with GNNs. Most notably, we present an empirical study on a billion-edge graph Papers100M, the largest publicly available GNN dataset so far. The results show that AGP can significantly improve various existing GNN models' scalability without sacrificing prediction accuracy.


title: Long-term and multi-wavelength evolution of a changing-look AGN Mrk 1018

abstract: The physical mechanism for triggering the changing-look phenomenon in active galactic nuclei (AGNs) is still unclear. We explore this issue based on the multi-wavelength spectral and flux variations for a changing-look AGN Mrk~1018 with long-term observations in the X-ray, optical/ultraviolet(UV), and radio bands. Both the optical and the X-ray emission experience rapid decay in changing-look phase during 2010--2015, where a re-flare appears in the optical/UV and X-ray bands. We find a time lag of $\sim 20 $ days of optical/UV behind X-ray variations in type 1.9 phase. The 5 GHz radio flux decreases by $\sim 20$\% in type 1.9 phase during 2016--2017. We find both X-ray photon index ($\Gamma$) and the optical-to-X-ray spectral index (\alphaox\,) are anti-correlated with the Eddington scaled 2--10~keV X-ray luminosity ($L_\mathrm{X}/L_\mathrm{Edd}$) in the type 1.9 phase. However, the type 1 phase deviates from these two anti-correlations, which suggests that the change of broad emission lines might be regulated by the evolution of accretion disk (e.g., disappearing of the inner cold disk in the type 1.9 phase).


title: Big-Five, MPTI, Eysenck or HEXACO: The Ideal Personality Model for Personality-aware Recommendation Systems

abstract: Personality-aware recommendation systems have been proven to achieve high accuracy compared to conventional recommendation systems. In addition to that, personality-aware recommendation systems could help alleviate cold start and data sparsity problems. Most of the existing works use Big-Five personality model to represent the user's personality, this is due to the popularity of Big-Five model in the literature of psychology. However, from personality computing perspective, the choice of the most suitable personality model that satisfy the requirements of the recommendation application and the recommended content type still needs further investigation. In this paper, we study and compare four personality-aware recommendation systems based on different personality models, namely Big-Five, Eysenck and HEXACO from the personality traits theory, and Myers-Briggs Type Indicator (MPTI) from the personality types theory. Following that, we propose a hybrid personality model for recommendation that takes advantage of the personality traits models, as well as the personality types models. Through extensive experiments on recommendation dataset, we prove the efficiency of the proposed model, especially in cold start settings.


title: Lawvere-Tierney topologies for computability theorists

abstract: In this article, we introduce certain kinds of computable reduction games with imperfect information. One can view such a game as an extension of the notion of Turing reduction, and generalized Weihrauch reduction as well. Based on the work by Lee and van Oosten, we utilize these games for providing a concrete description of the lattice of the Lawvere-Tierney topologies on the effective topos (equivalently, the subtoposes of the effective topos preordered by geometric inclusion). As an application, for instance, we show that there exists no minimal Lawvere-Tierney topology which is strictly above the identity topology on the effective topos.


title: On Training Sample Memorization: Lessons from Benchmarking Generative Modeling with a Large-scale Competition

abstract: Many recent developments on generative models for natural images have relied on heuristically-motivated metrics that can be easily gamed by memorizing a small sample from the true distribution or training a model directly to improve the metric. In this work, we critically evaluate the gameability of these metrics by designing and deploying a generative modeling competition. Our competition received over 11000 submitted models. The competitiveness between participants allowed us to investigate both intentional and unintentional memorization in generative modeling. To detect intentional memorization, we propose the ``Memorization-Informed Fr\'echet Inception Distance'' (MiFID) as a new memorization-aware metric and design benchmark procedures to ensure that winning submissions made genuine improvements in perceptual quality. Furthermore, we manually inspect the code for the 1000 top-performing models to understand and label different forms of memorization. Our analysis reveals that unintentional memorization is a serious and common issue in popular generative models. The generated images and our memorization labels of those models as well as code to compute MiFID are released to facilitate future studies on benchmarking generative models.


title: Cold atoms meet lattice gauge theory

abstract: The central idea of this review is to consider quantum field theory models relevant for particle physics and replace the fermionic matter in these models by a bosonic one. This is mostly motivated by the fact that bosons are more ``accessible'' and easier to manipulate for experimentalists, but this ``substitution'' also leads to new physics and novel phenomena. It allows us to gain new information about among other things confinement and the dynamics of the deconfinement transition. We will thus consider bosons in dynamical lattices corresponding to the bosonic Schwinger or Z$_2$ Bose-Hubbard models. Another central idea of this review concerns atomic simulators of paradigmatic models of particle physics theory such as the Creutz-Hubbard ladder, or Gross-Neveu-Wilson and Wilson-Hubbard models. Finally, we will briefly describe our efforts to design experimentally friendly simulators of these and other models relevant for particle physics.

categories: cond-mat.quant-gas cond-mat.str-el hep-lat quant-ph


title: Using GANs to Augment Data for Cloud Image Segmentation Task

abstract: While cloud/sky image segmentation has extensive real-world applications, a large amount of labelled data is needed to train a highly accurate models to perform the task. Scarcity of such volumes of cloud/sky images with corresponding ground-truth binary maps makes it highly difficult to train such complex image segmentation models. In this paper, we demonstrate the effectiveness of using Generative Adversarial Networks (GANs) to generate data to augment the training set in order to increase the prediction accuracy of image segmentation model. We further present a way to estimate ground-truth binary maps for the GAN-generated images to facilitate their effective use as augmented images. Finally, we validate our work with different statistical techniques.


title: Semantic-Enhanced Explainable Finetuning for Open-Domain Dialogues

abstract: This paper propose to combine pretrained language models with the modular dialogue paradigm for open-domain dialogue modeling. Our method, semantic-enhanced finetuning, instantiates conversation understanding, planning, and response generation as a language model finetuning task. At inference, we disentangle semantic and token variations by specifying sampling methods and constraints for each module separately. For training and evaluation, we present X-Weibo, a Chinese multi-turn open-domain dialogue dataset with automatic annotation for emotions, DAs, and topical words. Experiments show that semantic-enhanced finetuning outperforms strong baselines on non-semantic and semantic metrics, improves the human-evaluated relevance, coherence, and informativeness, and exhibits considerable controllability over semantic variables.


title: Efficient Secure State Estimation against Sparse Integrity Attack for System with Non-derogatory Dynamics

abstract: We consider the problem of estimating the state of a time-invariant linear Gaussian system in the presence of integrity attacks. The attacker can compromise $p$ out of $m$ sensors, the set of which is fixed over time and unknown to the system operator, and manipulate the measurements arbitrarily. Under the assumption that all the unstable eigenvalues of system matrix $A$ have geometric multiplicity 1 (unstable part of $A$ is non-derogatory), we propose a secure estimation scheme that is resilient to integrity attack as long as the system is $2p$-sparse detectable, which is proved to be the fundamental limit of secure dynamic estimation. In the absence of attack, the proposed estimation coincides with Kalman estimation with a certain probability that can be adjusted to trade-off between performance with and without attack. Furthermore, the detectability condition checking in the designing phase and the estimation computing in the online operating phase are both computationally efficient. A numerical example is provided to corroborate the results and illustrate the performance of the proposed estimator.


title: Engineering exotic second-order topological semimetals by periodic driving

abstract: Second-order topological semimetals (SOTSMs) are featured with hinge Fermi arcs. How to generate them in different systems has attracted much attention. We propose a scheme to create exotic SOTSMs by periodic driving. Novel Dirac SOTSMs, with a widely tunable number of nodes and hinge Fermi arcs, the adjacent nodes having the same chirality, and the coexisting nodal points and loops, are generated at ease by the periodic driving. When the time-reversal symmetry is broken, our scheme permits us to realize hybrid-order Weyl semimetals with the coexisting hinge and surface Fermi arcs. Our Weyl semimetals possess a rich hybrid of 2D sliced zero- and $\pi/T$-mode topological phases, which may be any combination of the normal insulator, Chern insulator, and second-order topological insulator. Enriching the family of topological semimetals, our scheme supplies a convenient way to artificially synthesize exotic topological phases by periodic driving.


title: Ultimate In-plane Magnetoresistance Ratio of Graphene by Controlling the Gapped Dirac Cone through Pseudospin

abstract: $\require{mediawiki-texvc}$ A theoretical study is presented on the in-plane conductance of graphene that is partially sandwiched by Ni(111) slabs with a finite size and atom-scale width of $\approx12.08 \AA$. In the sandwiched part, the gapped Dirac cone of graphene can be controlled via pseudospin by changing the magnetic alignment of the Ni(111) slabs. When the magnetic moments of the upper and lower Ni(111) slabs have antiparallel and parallel configurations, the bandgap at the Dirac cone is open and closed, respectively. The transmission probability calculation for the in-plane conductance of the system indicated that the antiparallel configuration would result in nearly zero conductance of $E-E_F=0.2$ eV. In the parallel configuration, the transmission probability calculation indicated that the system would have a profile similar to that of pristine graphene. A comparison of the transmission probabilities of the antiparallel and parallel configurations indicated that a high magnetoresistance of $1450\%$ could be achieved. An ultimate magnetoresistance can be expected if the Ni(111) slab widths are increased to the nanometer scale.


title: Multi-Level Graph Encoding with Structural-Collaborative Relation Learning for Skeleton-Based Person Re-Identification

abstract: Skeleton-based person re-identification (Re-ID) is an emerging open topic providing great value for safety-critical applications. Existing methods typically extract hand-crafted features or model skeleton dynamics from the trajectory of body joints, while they rarely explore valuable relation information contained in body structure or motion. To fully explore body relations, we construct graphs to model human skeletons from different levels, and for the first time propose a Multi-level Graph encoding approach with Structural-Collaborative Relation learning (MG-SCR) to encode discriminative graph features for person Re-ID. Specifically, considering that structurally-connected body components are highly correlated in a skeleton, we first propose a multi-head structural relation layer to learn different relations of neighbor body-component nodes in graphs, which helps aggregate key correlative features for effective node representations. Second, inspired by the fact that body-component collaboration in walking usually carries recognizable patterns, we propose a cross-level collaborative relation layer to infer collaboration between different level components, so as to capture more discriminative skeleton graph features. Finally, to enhance graph dynamics encoding, we propose a novel self-supervised sparse sequential prediction task for model pre-training, which facilitates encoding high-level graph semantics for person Re-ID. MG-SCR outperforms state-of-the-art skeleton-based methods, and it achieves superior performance to many multi-modal methods that utilize extra RGB or depth features. Our codes are available at https://github.com/Kali-Hac/MG-SCR.


title: Linear Rescaling to Accurately Interpret Logarithms

abstract: The standard approximation of a natural logarithm in statistical analysis interprets a linear change of \(p\) in \(\ln(X)\) as a \((1+p)\) proportional change in \(X\), which is only accurate for small values of \(p\). I suggest base-\((1+p)\) logarithms, where \(p\) is chosen ahead of time. A one-unit change in \(\log_{1+p}(X)\) is exactly equivalent to a \((1+p)\) proportional change in \(X\). This avoids an approximation applied too broadly, makes exact interpretation easier and less error-prone, improves approximation quality when approximations are used, makes the change of interest a one-log-unit change like other regression variables, and reduces error from the use of \(\log(1+X)\).


title: On the distribution of consecutive composite odd numbers and twin primes

abstract: We study pairs of consecutive odd numbers through a straightforward indexing. We focus in particular on twin primes and their distribution. With a counting argument, we calculate the limit of an alternating sum that is equal to 1 which means there are few twin primes. Finally, we show how to find the possible congruences for these prime numbers.


title: Seemingly Unrelated Multi-State processes: a Bayesian semiparametric approach

abstract: Many applications in medical statistics as well as in other fields can be described by transitions between multiple states (e.g. from health to disease) experienced by individuals over time. In this context, multi-state models are a popular statistical technique, in particular when the exact transition times are not observed. The key quantities of interest are the transition rates, capturing the instantaneous risk of moving from one state to another. The main contribution of this work is to propose a joint semiparametric model for several possibly related multi-state processes (Seemingly Unrelated Multi-State, SUMS, processes), assuming a Markov structure for the transitions over time. The dependence between different processes is captured by specifying a joint random effect distribution on the transition rates of each process. We assume a flexible random effect distribution, which allows for clustering of the individuals, overdispersion and outliers. Moreover, we employ a graph structure to describe the dependence among processes, exploiting tools from the Gaussian Graphical model literature. It is also possible to include covariate effects. We use our approach to model disease progression in mental health. Posterior inference is performed through a specially devised MCMC algorithm.


title: An Extremely-low Cost Ground-Based Whole Sky Imager

abstract: Ground-based Whole Sky Imagers (WSIs) are increasingly being used for various remote sensing applications. While the fundamental requirements of a WSI are to make it climate-proof with an ability to capture high resolution images, cost also plays a significant role for wider scale adoption. This paper proposes an extremely low-cost alternative to the existing WSIs. In the designed model, high resolution images are captured with auto adjusting shutter speeds based on the surrounding light intensity. Furthermore, a manual data backup option using a portable memory drive is implemented for remote locations with no internet access.


title: The correct sense of Faraday rotation

abstract: The phenomenon of Faraday rotation of linearly polarized synchrotron emission in a magneto-ionized medium has been understood and studied for decades. But since the sense of the rotation itself is irrelevant in most contexts, some uncertainty and inconsistencies have arisen in the literature about this detail. Here, we start from basic plasma theory to describe the propagation of polarized emission from a background radio source through a magnetized, ionized medium in order to rederive the correct sense of Faraday rotation. We present simple graphics to illustrate the decomposition of a linearly polarized wave into right and left circularly polarized modes, the temporal and spatial propagation of the phases of those modes, and the resulting physical rotation of the polarization orientation. We then re-examine the case of a medium that both Faraday-rotates and emits polarized radiation and show how a helical magnetic field can construct or destruct the Faraday rotation. This paper aims to resolve a source of confusion that has arisen between the plasma physics and radio astronomy communities and to help avoid common pitfalls when working with this unintuitive phenomenon.


title: DL-DDA -- Deep Learning based Dynamic Difficulty Adjustment with UX and Gameplay constraints

abstract: Dynamic difficulty adjustment ($DDA$) is a process of automatically changing a game difficulty for the optimization of user experience. It is a vital part of almost any modern game. Most existing DDA approaches concentrate on the experience of a player without looking at the rest of the players. We propose a method that automatically optimizes user experience while taking into consideration other players and macro constraints imposed by the game. The method is based on deep neural network architecture that involves a count loss constraint that has zero gradients in most of its support. We suggest a method to optimize this loss function and provide theoretical analysis for its performance. Finally, we provide empirical results of an internal experiment that was done on $200,000$ players and was found to outperform the corresponding manual heuristics crafted by game design experts.


title: A Convergence Theory for SVGD in the Population Limit under Talagrand's Inequality T1

abstract: Stein Variational Gradient Descent (SVGD) is an algorithm for sampling from a target density which is known up to a multiplicative constant. Although SVGD is a popular algorithm in practice, its theoretical study is limited to a few recent works. We study the convergence of SVGD in the population limit, (i.e., with an infinite number of particles) to sample from a non-logconcave target distribution satisfying Talagrand's inequality T1. We first establish the convergence of the algorithm. Then, we establish a dimension-dependent complexity bound in terms of the Kernelized Stein Discrepancy (KSD). Unlike existing works, we do not assume that the KSD is bounded along the trajectory of the algorithm. Our approach relies on interpreting SVGD as a gradient descent over a space of probability measures.


title: Higher integrability for measures satisfying a PDE constraint

abstract: We establish higher integrability estimates for constant-coefficient systems of linear PDEs \[ \mathcal{A} \mu = \sigma, \] where $\mu \in \mathcal{M}(\Omega;V)$ and $\sigma\in \mathcal{M}(\Omega;W)$ are vector measures and the polar $\frac{\mathrm{d} \mu}{\mathrm{d} |\mu|}$ is uniformly close to a convex cone of $V$ intersecting the wave cone of $\mathcal{A}$ only at the origin. More precisely, we prove local compensated compactness estimates of the form \[ \|\mu\|_{\mathrm{L}^p(\Omega')} \lesssim |\mu|(\Omega) + |\sigma|(\Omega), \qquad \Omega' \Subset \Omega. \] Here, the exponent $p$ belongs to the (optimal) range $1 \leq p < d/(d-k)$, $d$ is the dimension of $\Omega$, and $k$ is the order of $\mathcal{A}$. We also obtain the limiting case $p = d/(d-k)$ for canceling constant-rank operators. We consider applications to compensated compactness and {applications to the theory of} functions of bounded variation and bounded deformation.


title: A novel Deep Neural Network architecture for non-linear system identification

abstract: We present a novel Deep Neural Network (DNN) architecture for non-linear system identification. We foster generalization by constraining DNN representational power. To do so, inspired by fading memory systems, we introduce inductive bias (on the architecture) and regularization (on the loss function). This architecture allows for automatic complexity selection based solely on available data, in this way the number of hyper-parameters that must be chosen by the user is reduced. Exploiting the highly parallelizable DNN framework (based on Stochastic optimization methods) we successfully apply our method to large scale datasets.


title: Redefining measures of Layered Architecture

abstract: Layered architecture represents the software structure in the form of layers. Every element in the software is assigned to one of the layers such that the relationship amongst the elements is maintained. A set of design principles rules the process of construction of the layered architecture. Various statistical measures have been defined to check whether the layered architecture of a given software is following these design principles or not. In this paper, we redefine the measures of layered architecture based on the relationship between the software components. The measures check for the violations committed regarding the back calls, skip calls, and cyclic structures. Further, we also introduce a new measure to verify the logical separation amongst the layers. The system's current architecture is extracted from the source code and represented using a three-tier layered structure, which is the defacto standard architecture of Java applications. The redefined measures are applied to determine the conformance of layering principles in the system. We evaluate five different software systems for their architecture consistency. The results obtained on our redefined measures are compared to those obtained by applying the standard set of measures. A quantitative analysis of the proposed measures is performed, and we conclude that they can determine the consideration of layering principles followed during the development of a software system.


title: On minimal doubly resolving sets in graphs

abstract: Two vertices u,v of connected graph G are doubly resolved by x,y\in V(G)if d(v; x)-d(u; x)\neq d(v; y)-d(u; y): A set W of vertices of the graph G is a doubly resolving set for G if every two distinct vertices of G are doubly resolved by some two vertices of W. \psi(G) is the minimum cardinality of a doubly resolving set for the graph G. The aim of this paper is to investigate doubly resolving sets in graphs. An upper bound for \Psi(G) is obtained in terms of order and diameter of G. \psi (G) is computed for some important graphs and all graphs G of order n with the property \psi(G)=n-1 are characterized.


title: Approximate analytical description of the high latitude extinction

abstract: The distribution of visual interstellar extinction $A_V$ has been mapped in selected areas over the Northern sky, using available LAMOST DR5 and Gaia DR2/EDR3 data. $A_V$ was modelled as a barometric function of galactic latitude and distance. The function parameters were then approximated by spherical harmonics. The resulting analytical tridimensional model of the interstellar extinction can be used to predict $A_V$ values for stars with known parallaxes, as well as the total Galactic extinction in a given location in the sky.


title: Precision tomography of a three-qubit donor quantum processor in silicon

abstract: Nuclear spins were among the first physical platforms to be considered for quantum information processing, because of their exceptional quantum coherence and atomic-scale footprint. However, their full potential for quantum computing has not yet been realized, due to the lack of methods to link nuclear qubits within a scalable device combined with multi-qubit operations with sufficient fidelity to sustain fault-tolerant quantum computation. Here we demonstrate universal quantum logic operations using a pair of ion-implanted 31P donor nuclei in a silicon nanoelectronic device. A nuclear two-qubit controlled-Z gate is obtained by imparting a geometric phase to a shared electron spin, and used to prepare entangled Bell states with fidelities up to 94.2(2.7)%. The quantum operations are precisely characterised using gate set tomography (GST), yielding one-qubit average gate fidelities up to 99.95(2)%, two-qubit average gate fidelity of 99.37(11)% and two-qubit preparation/measurement fidelities of 98.95(4)%. These three metrics indicate that nuclear spins in silicon are approaching the performance demanded in fault-tolerant quantum processors. We then demonstrate entanglement between the two nuclei and the shared electron by producing a Greenberger-Horne-Zeilinger three-qubit state with 92.5(1.0)% fidelity. Since electron spin qubits in semiconductors can be further coupled to other electrons or physically shuttled across different locations, these results establish a viable route for scalable quantum information processing using donor nuclear and electron spins.


title: Arazy-Cwikel and Calder\'on-Mityagin type properties of the couples $(\ell^{p},\ell^{q})$, $0 \le p<q\le\infty$

abstract: We establish Arazy-Cwikel type properties for the family of couples $(\ell^{p},\ell^{q})$, $0\le p<q\le\infty$, and show that $(\ell^{p},\ell^{q}) $ is a Calder\'on-Mityagin couple if and only if $q\ge1$. Moreover, we identify interpolation orbits of elements with respect to this couple for all $p$ and $q$ such that $0\le p<q\le\infty$ and obtain a simple positive solution of a Levitina-Sukochev-Zanin problem, clarifying its connections with whether $(\ell^{p},\ell^{q})$ has the Calder\'on-Mityagin property or not.


title: Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction

abstract: Bilingual Lexicon Induction (BLI) aims to map words in one language to their translations in another, and is typically through learning linear projections to align monolingual word representation spaces. Two classes of word representations have been explored for BLI: static word embeddings and contextual representations, but there is no studies to combine both. In this paper, we propose a simple yet effective mechanism to combine the static word embeddings and the contextual representations to utilize the advantages of both paradigms. We test the combination mechanism on various language pairs under the supervised and unsupervised BLI benchmark settings. Experiments show that our mechanism consistently improves performances over robust BLI baselines on all language pairs by averagely improving 3.2 points in the supervised setting, and 3.1 points in the unsupervised setting.


title: An Ontology Model for Climatic Data Analysis

abstract: Recently ontologies have been exploited in a wide range of research areas for data modeling and data management. They greatly assists in defining the semantic model of the underlying data combined with domain knowledge. In this paper, we propose the Climate Analysis (CA) Ontology to model climate datasets used by remote sensing analysts. We use the data published by National Oceanic and Atmospheric Administration (NOAA) to further explore how ontology modeling can be used to facilitate the field of climatic data processing. The idea of this work is to convert relational climate data to the Resource Description Framework (RDF) data model, so that it can be stored in a graph database and easily accessed through the Web as Linked Data. Typically, this provides climate researchers, who are interested in datasets such as NOAA, with the potential of enriching and interlinking with other databases. As a result, our approach facilitates data integration and analysis of diverse climatic data sources and allows researchers to interrogate these sources directly on the Web using the standard SPARQL query language.


title: Testing the Kerr black hole hypothesis with GRS 1716-249 by combining the continuum-fitting and the iron-line methods

abstract: The continuum-fitting and the iron-line methods are currently the two leading techniques for measuring the spins of accreting black holes. In the past few years, these two methods have been developed for testing fundamental physics. In the present work, we employ state-of-the-art models to test black holes through the continuum-fitting and the iron-line methods and we analyze three NuSTAR observations of the black hole binary GRS 1716-249 during its outburst in 2016-2017. In these three observations, the source was in a hard-intermediate state and the spectra show both a strong thermal component and prominent relativistic reflection features. Our analysis confirms the Kerr nature of the black hole in GRS 1716-249 and provides quite stringent constraints on possible deviations from the predictions of general relativity.


title: Neural Implicit 3D Shapes from Single Images with Spatial Patterns

abstract: Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations of occlusions, views, and appearances exist from the image. To better encode image features, we study a geometry-aware convolutional kernel to leverage geometric relationships of point samplings by the proposed \emph{spatial pattern}, i.e., a structured point set. Specifically, the kernel operates at 2D projections of 3D points from the spatial pattern. Supported by the spatial pattern, the 2D kernel encodes geometric information that is crucial for 3D reconstruction tasks, while traditional ones mainly consider appearance information. Furthermore, to enable the network to discover more adaptive spatial patterns for further capturing non-local contextual information, the kernel is devised to be deformable manipulated by a spatial pattern generator. Experimental results on both synthetic and real datasets demonstrate the superiority of the proposed method. Pre-trained models, codes, and data are available at https://github.com/yixin26/SVR-SP.


title: Reducing the feature divergence of RGB and near-infrared images using Switchable Normalization

abstract: Visual pattern recognition over agricultural areas is an important application of aerial image processing. In this paper, we consider the multi-modality nature of agricultural aerial images and show that naively combining different modalities together without taking the feature divergence into account can lead to sub-optimal results. Thus, we apply a Switchable Normalization block to our DeepLabV3 segmentation model to alleviate the feature divergence. Using the popular symmetric Kullback Leibler divergence measure, we show that our model can greatly reduce the divergence between RGB and near-infrared channels. Together with a hybrid loss function, our model achieves nearly 10\% improvements in mean IoU over previously published baseline.


title: Referring Transformer: A One-step Approach to Multi-task Visual Grounding

abstract: As an important step towards visual reasoning, visual grounding (e.g., phrase localization, referring expression comprehension/segmentation) has been widely explored Previous approaches to referring expression comprehension (REC) or segmentation (RES) either suffer from limited performance, due to a two-stage setup, or require the designing of complex task-specific one-stage architectures. In this paper, we propose a simple one-stage multi-task framework for visual grounding tasks. Specifically, we leverage a transformer architecture, where two modalities are fused in a visual-lingual encoder. In the decoder, the model learns to generate contextualized lingual queries which are then decoded and used to directly regress the bounding box and produce a segmentation mask for the corresponding referred regions. With this simple but highly contextualized model, we outperform state-of-the-arts methods by a large margin on both REC and RES tasks. We also show that a simple pre-training schedule (on an external dataset) further improves the performance. Extensive experiments and ablations illustrate that our model benefits greatly from contextualized information and multi-task training.


title: Deep Matching Prior: Test-Time Optimization for Dense Correspondence

abstract: Conventional techniques to establish dense correspondences across visually or semantically similar images focused on designing a task-specific matching prior, which is difficult to model. To overcome this, recent learning-based methods have attempted to learn a good matching prior within a model itself on large training data. The performance improvement was apparent, but the need for sufficient training data and intensive learning hinders their applicability. Moreover, using the fixed model at test time does not account for the fact that a pair of images may require their own prior, thus providing limited performance and poor generalization to unseen images. In this paper, we show that an image pair-specific prior can be captured by solely optimizing the untrained matching networks on an input pair of images. Tailored for such test-time optimization for dense correspondence, we present a residual matching network and a confidence-aware contrastive loss to guarantee a meaningful convergence. Experiments demonstrate that our framework, dubbed Deep Matching Prior (DMP), is competitive, or even outperforms, against the latest learning-based methods on several benchmarks for geometric matching and semantic matching, even though it requires neither large training data nor intensive learning. With the networks pre-trained, DMP attains state-of-the-art performance on all benchmarks.


title: Regularization in ResNet with Stochastic Depth

abstract: Regularization plays a major role in modern deep learning. From classic techniques such as L1,L2 penalties to other noise-based methods such as Dropout, regularization often yields better generalization properties by avoiding overfitting. Recently, Stochastic Depth (SD) has emerged as an alternative regularization technique for residual neural networks (ResNets) and has proven to boost the performance of ResNet on many tasks [Huang et al., 2016]. Despite the recent success of SD, little is known about this technique from a theoretical perspective. This paper provides a hybrid analysis combining perturbation analysis and signal propagation to shed light on different regularization effects of SD. Our analysis allows us to derive principled guidelines for choosing the survival rates used for training with SD.


title: Ionization and transport in partially ionized multicomponent plasmas: Application to atmospheres of hot Jupiters

abstract: We study ionization and transport processes in partially ionized multicomponent plasmas. The plasma composition is calculated via a system of coupled mass action laws. The electronic transport properties are determined by the electron-ion and electron-neutral transport cross sections. The influence of electron-electron scattering is considered via a correction factor to the electron-ion contribution. Based on this data, the electrical and thermal conductivity as well as the Lorenz number are calculated. For the thermal conductivity, we consider also the contributions of the translational motion of neutral particles and of the dissociation, ionization, and recombination reactions. We apply our approach to a partially ionized plasma composed of hydrogen, helium, and a small fraction of metals (Li, Na, Ca, Fe, K, Rb, Cs) as typical for hot Jupiter atmospheres. We present results for the plasma composition and the transport properties as function of density and temperature and then along typical P-T profiles for the outer part of the hot Jupiter HD 209458b. The electrical conductivity profile allows revising the Ohmic heating power related to the fierce winds in the planet's atmosphere. We show that the higher temperatures suggested by recent interior models could boost the conductivity and thus the Ohmic heating power to values large enough to explain the observed inflation of HD 209458b.