title: Graph-based State Representation for Deep Reinforcement Learning

abstract: Deep RL approaches build much of their success on the ability of the deep neural network to generate useful internal representations. Nevertheless, they suffer from a high sample-complexity and starting with a good input representation can have a significant impact on the performance. In this paper, we exploit the fact that the underlying Markov decision process (MDP) represents a graph, which enables us to incorporate the topological information for effective state representation learning. Motivated by the recent success of node representations for several graph analytical tasks we specifically investigate the capability of node representation learning methods to effectively encode the topology of the underlying MDP in Deep RL. To this end we perform a comparative analysis of several models chosen from 4 different classes of representation learning algorithms for policy learning in grid-world navigation tasks, which are representative of a large class of RL problems. We find that all embedding methods outperform the commonly used matrix representation of grid-world environments in all of the studied cases. Moreoever, graph convolution based methods are outperformed by simpler random walk based methods and graph linear autoencoders.


title: Strongly-interacting massive particle and dark photon in the era of intensity frontier

abstract: A strongly interacting massive particle (SIMP) is an interesting candidate for dark matter (DM) because its self-interaction cross section can be naturally strong enough to address the astrophysical problem of small-scale structure formation. A simple model was proposed by assuming a monopole condensation, where composite SIMP comes from a "strongly interacting" U(1)$_{\rm d}$ gauge theory. In the original model, the DM relic abundance is determined by the $3\to2$ annihilation process via the Wess-Zumino-Witten term. In this letter, we discuss that the DM relic abundance is naturally determined also by a semi-annihilation process via a kinetic mixing between the hypercharge gauge boson and the dark U(1)$_{\rm d}$ gauge boson (dark photon). The dark photon can be discovered by LDMX-style missing momentum experiments in the near future.


title: Optimal designs for some bivariate cokriging models

abstract: This article focuses on the estimation and design aspects of a bivariate collocated cokriging experiment. For a large class of covariance matrices, a linear dependency criterion is identified, which allows the best linear unbiased estimator of the primary variable in a bivariate collocated cokriging setup to reduce to a univariate kriging estimator. Exact optimal designs for efficient prediction for such simple and ordinary reduced cokriging models with one-dimensional inputs are determined. Designs are found by minimizing the maximum and the integrated prediction variance, where the primary variable is an Ornstein-Uhlenbeck process. For simple and ordinary cokriging models with known covariance parameters, the equispaced design is shown to be optimal for both criterion functions. The more realistic scenario of unknown covariance parameters is addressed by assuming prior distributions on the parameter vector, thus adopting a Bayesian approach to the design problem. The equispaced design is proved to be the Bayesian optimal design for both criteria. The work is motivated by designing an optimal water monitoring system for an Indian river.


title: Multi-wave-mixing-induced nonlinear effects in an electromagnetically induced grating

abstract: We propose a multi-field-coupled atomic model that exhibits controllable $symmetric$ and $asymmetric$ evolution of significantly enhanced diffraction peaks in an opto-atomic grating at far-field regime. Such results are obtained by the linear and nonlinear modulation of the intensities of the diffraction peaks as a result of multi-wave-mixing-induced modification of spatially modulated coherence in a closed four-level atomic system. Novelty of the results lies in predicting super symmetric alignment of the diffraction peaks due to the dominance of the amplitude part of the grating-transfer-function at the condition of exact atom-field resonance, which is unique to the present model. Efficacy of the present scheme is to apply it in producing nonlinear light generated by four-wave-mixing-induced control of spatially modulated coherence effect. The work also finds its importance for its applicability in the field of high-precision atomic lithography.


title: Complementing Lexical Retrieval with Semantic Residual Embedding

abstract: This paper presents CLEAR, a retrieval model that seeks to complement classical lexical exact-match models such as BM25 with semantic matching signals from a neural embedding matching model. CLEAR explicitly trains the neural embedding to encode language structures and semantics that lexical retrieval fails to capture with a novel residual-based embedding learning method. Empirical evaluations demonstrate the advantages of CLEAR over state-of-the-art retrieval models, and that it can substantially improve the end-to-end accuracy and efficiency of reranking pipelines.


title: Directed Graph Convolutional Network

abstract: Graph Convolutional Networks (GCNs) have been widely used due to their outstanding performance in processing graph-structured data. However, the undirected graphs limit their application scope. In this paper, we extend spectral-based graph convolution to directed graphs by using first- and second-order proximity, which can not only retain the connection properties of the directed graph, but also expand the receptive field of the convolution operation. A new GCN model, called DGCN, is then designed to learn representations on the directed graph, leveraging both the first- and second-order proximity information. We empirically show the fact that GCNs working only with DGCNs can encode more useful information from graph and help achieve better performance when generalized to other models. Moreover, extensive experiments on citation networks and co-purchase datasets demonstrate the superiority of our model against the state-of-the-art methods.


title: Reduced Bond Graph via machine learning for nonlinear multiphysics dynamic systems

abstract: We propose a machine learning approach aiming at reducing Bond Graphs. The output of the machine learning is a hybrid modeling that contains a reduced Bond Graph coupled to a simple artificial neural network. The proposed coupling enables knowledge continuity in machine learning. In this paper, a neural network is obtained by a linear calibration procedure. We propose a method that contains two training steps. First, the method selects the components of the original Bond Graph that are kept in the Reduced Bond Graph. Secondly, the method builds an artificial neural network that supplements the reduced Bond Graph. Because the output of the machine learning is a hybrid model, not solely data, it becomes difficult to use a usual Backpropagation Through Time to calibrate the weights of the neural network. So, in a first attempt, a very simple neural network is proposed by following a model reduction approach. We consider the modeling of the automotive cabins thermal behavior. The data used for the training step are obtained via solutions of differential algebraic equations by using a design of experiment. Simple cooling simulations are run during the training step. We show a simulation speed-up when the reduced bond graph is used to simulate the driving cycle of the WLTP vehicles homologation procedure, while preserving accuracy on output variables. The variables of the original Bond Graph are split into a set of primary variables, a set of secondary variables and a set of tertiary variables. The reduced bond graph contains all the primary variables, but none of the tertiary variables. Secondary variables are coupled to primary ones via an artificial neural network. We discuss the extension of this coupling approach to more complex artificial neural networks.

categories: eess.SP cs.LG cs.NA cs.NE math.DS math.NA


title: Valid Explanations for Learning to Rank Models

abstract: Learning-to-rank (LTR) is a class of supervised learning techniques that apply to ranking problems dealing with a large number of features. The popularity and widespread application of LTR models in prioritizing information in a variety of domains makes their scrutability vital in today's landscape of fair and transparent learning systems. However, limited work exists that deals with interpreting the decisions of learning systems that output rankings. In this paper we propose a model agnostic local explanation method that seeks to identify a small subset of input features as explanation to a ranking decision. We introduce new notions of validity and completeness of explanations specifically for rankings, based on the presence or absence of selected features, as a way of measuring goodness. We devise a novel optimization problem to maximize validity directly and propose greedy algorithms as solutions. In extensive quantitative experiments we show that our approach outperforms other model agnostic explanation approaches across pointwise, pairwise and listwise LTR models in validity while not compromising on completeness.


title: Deep Transfer Learning For Plant Center Localization

abstract: Plant phenotyping focuses on the measurement of plant characteristics throughout the growing season, typically with the goal of evaluating genotypes for plant breeding. Estimating plant location is important for identifying genotypes which have low emergence, which is also related to the environment and management practices such as fertilizer applications. The goal of this paper is to investigate methods that estimate plant locations for a field-based crop using RGB aerial images captured using Unmanned Aerial Vehicles (UAVs). Deep learning approaches provide promising capability for locating plants observed in RGB images, but they require large quantities of labeled data (ground truth) for training. Using a deep learning architecture fine-tuned on a single field or a single type of crop on fields in other geographic areas or with other crops may not have good results. The problem of generating ground truth for each new field is labor-intensive and tedious. In this paper, we propose a method for estimating plant centers by transferring an existing model to a new scenario using limited ground truth data. We describe the use of transfer learning using a model fine-tuned for a single field or a single type of plant on a varied set of similar crops and fields. We show that transfer learning provides promising results for detecting plant locations.


title: Are papers addressing certain diseases perceived where these diseases are prevalent? The proposal to use Twitter data as social-spatial sensors

abstract: We propose to use Twitter data as social-spatial sensors. This study deals with the question whether research papers on certain diseases are perceived by people in regions (worldwide) that are especially concerned by the diseases. Since (some) Twitter data contain location information, it is possible to spatially map the activity of Twitter users referring to certain papers (e.g., dealing with tuberculosis). The resulting maps reveal whether heavy activity on Twitter is correlated with large numbers of people having certain diseases. In this study, we focus on tuberculosis, human immunodeficiency virus (HIV), and malaria, since the World Health Organization ranks these diseases as the top three causes of death worldwide by a single infectious agent. The results of the social-spatial Twitter maps (and additionally performed regression models) reveal the usefulness of the proposed sensor approach. One receives an impression of how research papers on the diseases have been perceived by people in regions that are especially concerned by the diseases. Our study demonstrates a promising approach for using Twitter data for research evaluation purposes beyond simple counting of tweets.


title: A cross-product free Jacobi-Davidson type method for computing a partial generalized singular value decomposition (GSVD) of a large matrix pair

abstract: A Cross-Product Free (CPF) Jacobi-Davidson (JD) type method is proposed to compute a partial generalized singular value decomposition (GSVD) of a large regular matrix pair $(A,B)$. It implicitly solves the mathematically equivalent generalized eigenvalue problem of $(A^TA,B^TB)$ but does not explicitly form the cross-product matrices and thus avoids the possible accuracy loss of the computed generalized singular values and generalized singular vectors. The method is an inner-outer iteration method, where the expansion of the right searching subspace forms the inner iterations that approximately solve the correction equations involved and the outer iterations extract approximate GSVD components with respect to the subspaces. Some convergence results are established for the inner and outer iterations, based on some of which practical stopping criteria are designed for the inner iterations. A thick-restart CPF-JDGSVD algorithm with deflation is developed to compute several GSVD components. Numerical experiments illustrate the efficiency of the algorithm.


title: Constraints on Newton's Constant from Cosmological Observations

abstract: Newton's constant has observational effects on both the CMB power spectra and the light curves of SNIa. We use Planck data, BAO data and the SNIa measurement to constrain the varying Newton's constant $G$ during the CMB epoch and the redshift ranges of PANTHEON samples, and find no evidence indicating that $G$ is varying with redshift. By extending the $\Lambda$CDM model with one free parameter $G$, we get $G =(6.65635_{-0.18560}^{+0.18766} ) \times 10^{-11} \rm m^3kg^{-1}s^{-2}$ and $H_0=67.62^{+1.24}_{-1.25} $ km s$^{-1}$ Mpc$^{-1}$ at 68$\%$ C.L. from Planck$+$BAO$+$uncalibrated PANTHEON. The results show the value of $G$ is consistent with CODATA 2018, but the $H_0$ tension can't be solved in this way.


title: Effective Human Activity Recognition Based on Small Datasets

abstract: Most recent work on vision-based human activity recognition (HAR) focuses on designing complex deep learning models for the task. In so doing, there is a requirement for large datasets to be collected. As acquiring and processing large training datasets are usually very expensive, the problem of how dataset size can be reduced without affecting recognition accuracy has to be tackled. To do so, we propose a HAR method that consists of three steps: (i) data transformation involving the generation of new features based on transforming of raw data, (ii) feature extraction involving the learning of a classifier based on the AdaBoost algorithm and the use of training data consisting of the transformed features, and (iii) parameter determination and pattern recognition involving the determination of parameters based on the features generated in (ii) and the use of the parameters as training data for deep learning algorithms to be used to recognize human activities. Compared to existing approaches, this proposed approach has the advantageous characteristics that it is simple and robust. The proposed approach has been tested with a number of experiments performed on a relatively small real dataset. The experimental results indicate that using the proposed method, human activities can be more accurately recognized even with smaller training data size.


title: Planted Models for the Densest $k$-Subgraph Problem

abstract: Given an undirected graph $G$, the Densest $k$-subgraph problem (DkS) asks to compute a set $S \subset V$ of cardinality $\left\lvert S\right\rvert \leq k$ such that the weight of edges inside $S$ is maximized. This is a fundamental NP-hard problem whose approximability, inspite of many decades of research, is yet to be settled. The current best known approximation algorithm due to Bhaskara et al. (2010) computes a $\mathcal{O}\left({n^{1/4 + \epsilon}}\right)$ approximation in time $n^{\mathcal{O}\left(1/\epsilon\right)}$, for any $\epsilon > 0$. We ask what are some "easier" instances of this problem? We propose some natural semi-random models of instances with a planted dense subgraph, and study approximation algorithms for computing the densest subgraph in them. These models are inspired by the semi-random models of instances studied for various other graph problems such as the independent set problem, graph partitioning problems etc. For a large range of parameters of these models, we get significantly better approximation factors for the Densest $k$-subgraph problem. Moreover, our algorithm recovers a large part of the planted solution.


title: Skeleton Focused Human Activity Recognition in RGB Video

abstract: The data-driven approach that learns an optimal representation of vision features like skeleton frames or RGB videos is currently a dominant paradigm for activity recognition. While great improvements have been achieved from existing single modal approaches with increasingly larger datasets, the fusion of various data modalities at the feature level has seldom been attempted. In this paper, we propose a multimodal feature fusion model that utilizes both skeleton and RGB modalities to infer human activity. The objective is to improve the activity recognition accuracy by effectively utilizing the mutual complemental information among different data modalities. For the skeleton modality, we propose to use a graph convolutional subnetwork to learn the skeleton representation. Whereas for the RGB modality, we will use the spatial-temporal region of interest from RGB videos and take the attention features from the skeleton modality to guide the learning process. The model could be either individually or uniformly trained by the back-propagation algorithm in an end-to-end manner. The experimental results for the NTU-RGB+D and Northwestern-UCLA Multiview datasets achieved state-of-the-art performance, which indicates that the proposed skeleton-driven attention mechanism for the RGB modality increases the mutual communication between different data modalities and brings more discriminative features for inferring human activities.


title: Measuring Information Propagation in Literary Social Networks

abstract: We present the task of modeling information propagation in literature, in which we seek to identify pieces of information passing from character A to character B to character C, only given a description of their activity in text. We describe a new pipeline for measuring information propagation in this domain and publish a new dataset for speaker attribution, enabling the evaluation of an important component of this pipeline on a wider range of literary texts than previously studied. Using this pipeline, we analyze the dynamics of information propagation in over 5,000 works of fiction, finding that information flows through characters that fill structural holes connecting different communities, and that characters who are women are depicted as filling this role much more frequently than characters who are men.


title: The Scharfetter--Gummel scheme for aggregation-diffusion equations

abstract: In this paper, we propose a finite-volume scheme for aggregation-diffusion equations based on a Scharfetter--Gummel approximation of the quadratic, nonlocal flux term. This scheme is analyzed concerning well-posedness and convergence towards solutions to the continuous problem. Also, it is proven that the numerical scheme has several structure-preserving features. More specifically, it is shown that the discrete solutions satisfy a free-energy dissipation relation analogous to the continuous model. Consequently, the numerical solutions converge in the large time limit to stationary solutions, for which we provide a thermodynamic characterization. Numerical experiments complement the study.


title: Complex Langevin analysis of 2D U(1) gauge theory on a torus with a $\theta$ term

abstract: Monte Carlo simulation of gauge theories with a $\theta$ term is known to be extremely difficult due to the sign problem. Recently there has been major progress in solving this problem based on the idea of complexifying dynamical variables. Here we consider the complex Langevin method (CLM), which is a promising approach for its low computational cost. The drawback of this method, however, is the existence of a condition that has to be met in order for the results to be correct. As a first step, we apply the method to 2D U(1) gauge theory on a torus with a $\theta$ term, which can be solved analytically. We find that a naive implementation of the method fails because of the topological nature of the $\theta$ term. In order to circumvent this problem, we simulate the same theory on a punctured torus, which is equivalent to the original model in the infinite volume limit for $ |\theta| < \pi$. Rather surprisingly, we find that the CLM works and reproduces the exact results for a punctured torus even at large $\theta$, where the link variables near the puncture become very far from being unitary.


title: Conditional Neural Generation using Sub-Aspect Functions for Extractive News Summarization

abstract: Much progress has been made in text summarization, fueled by neural architectures using large-scale training corpora. However, in the news domain, neural models easily overfit by leveraging position-related features due to the prevalence of the inverted pyramid writing style. In addition, there is an unmet need to generate a variety of summaries for different users. In this paper, we propose a neural framework that can flexibly control summary generation by introducing a set of sub-aspect functions (i.e. importance, diversity, position). These sub-aspect functions are regulated by a set of control codes to decide which sub-aspect to focus on during summary generation. We demonstrate that extracted summaries with minimal position bias is comparable with those generated by standard models that take advantage of position preference. We also show that news summaries generated with a focus on diversity can be more preferred by human raters. These results suggest that a more flexible neural summarization framework providing more control options could be desirable in tailoring to different user preferences, which is useful since it is often impractical to articulate such preferences for different applications a priori.


title: Combining Boundary-Conforming Finite Element Meshes on Moving Domains Using a Sliding Mesh Approach

abstract: For most finite element simulations, boundary-conforming meshes have significant advantages in terms of accuracy or efficiency. This is particularly true for complex domains. However, with increased complexity of the domain, generating a boundary-conforming mesh becomes more difficult and time consuming. One might therefore decide to resort to an approach where individual boundary-conforming meshes are pieced together in a modular fashion to form a larger domain. This paper presents a stabilized finite element formulation for fluid and temperature equations on sliding meshes. It couples the solution fields of multiple subdomains whose boundaries slide along each other on common interfaces. Thus, the method allows to use highly tuned boundary-conforming meshes for each subdomain that are only coupled at the overlapping boundary interfaces. In contrast to standard overlapping or fictitious domain methods the coupling is broken down to few interfaces with reduced geometric dimension. The formulation consists of the following key ingredients: the coupling of the solution fields on the overlapping surfaces is imposed weakly using a stabilized version of Nitsche's method. It ensures mass and energy conservation at the common interfaces. Additionally, we allow to impose weak Dirichlet boundary conditions at the non-overlapping parts of the interfaces. We present a detailed numerical study for the resulting stabilized formulation. It shows optimal convergence behavior for both Newtonian and generalized Newtonian material models. Simulations of flow of plastic melt inside single-screw as well as twin-screw extruders demonstrate the applicability of the method to complex and relevant industrial applications.


title: Motion Guided 3D Pose Estimation from Videos

abstract: We propose a new loss function, called motion loss, for the problem of monocular 3D Human pose estimation from 2D pose. In computing motion loss, a simple yet effective representation for keypoint motion, called pairwise motion encoding, is introduced. We design a new graph convolutional network architecture, U-shaped GCN (UGCN). It captures both short-term and long-term motion information to fully leverage the additional supervision from the motion loss. We experiment training UGCN with the motion loss on two large scale benchmarks: Human3.6M and MPI-INF-3DHP. Our model surpasses other state-of-the-art models by a large margin. It also demonstrates strong capacity in producing smooth 3D sequences and recovering keypoint motion.


title: Local limit theorems in relatively hyperbolic groups II : the non-spectrally degenerate case

abstract: This is the second of a series of two papers dealing with local limit theorems in relatively hyperbolic groups. In this second paper, we restrict our attention to non-spectrally degenerate random walks and we prove precise asymptotics of the probability $p_n(e, e)$ of going back to the origin at time $n$. We combine techniques adapted from thermodynamic formalism with the rough estimates of the Green function given by the first paper to show that $p_n(e, e) \sim CR^{-n} n^{-3/2}$ , where $R$ is the spectral radius of the random walk. This generalizes results of W. Woess for free products and results of Gou{\"e}zel for hyperbolic groups.


title: The deep composition of Uranus and Neptune from in situ exploration and thermochemical modeling

abstract: The distant ice giants of the Solar System, Uranus and Neptune, have only been visited by one space mission, Voyager 2. The current knowledge on their composition remains very limited despite some recent advances. A better characterization of their composition is however essential to constrain their formation and evolution, as a significant fraction of their mass is made of heavy elements, contrary to the gas giants Jupiter and Saturn. An in situ probe like Galileo would provide us with invaluable direct ground-truth composition measurements. However, some of the condensibles will remain out of the grasp of a shallow probe. While additional constraints could be obtained from a complementary orbiter, thermochemistry and diffusion modeling can further help us to increase the science return of an in situ probe.


title: Knowledgeable Dialogue Reading Comprehension on Key Turns

abstract: Multi-choice machine reading comprehension (MRC) requires models to choose the correct answer from candidate options given a passage and a question. Our research focuses dialogue-based MRC, where the passages are multi-turn dialogues. It suffers from two challenges, the answer selection decision is made without support of latently helpful commonsense, and the multi-turn context may hide considerable irrelevant information. This work thus makes the first attempt to tackle those two challenges by extracting substantially important turns and utilizing external knowledge to enhance the representation of context. In this paper, the relevance of each turn to the question are calculated to choose key turns. Besides, terms related to the context and the question in a knowledge graph are extracted as external knowledge. The original context, question and external knowledge are encoded with the pre-trained language model, then the language representation and key turns are combined together with a will-designed mechanism to predict the answer. Experimental results on a DREAM dataset show that our proposed model achieves great improvements on baselines.


title: Measurements of $\bar{\nu}_{\mu}$ and $\bar{\nu}_{\mu} + \nu_{\mu}$ charged-current cross-sections without detected pions nor protons on water and hydrocarbon at mean antineutrino energy of 0.86 GeV

abstract: We report measurements of the flux-integrated $\bar{\nu}_\mu$ and $\bar{\nu}_\mu+\nu_\mu$ charged-current cross-sections on water and hydrocarbon targets using the T2K anti-neutrino beam, with a mean neutrino energy of 0.86 GeV. The signal is defined as the (anti-)neutrino charged-current interaction with one induced $\mu^\pm$ and no detected charged pion nor proton. These measurements are performed using a new WAGASCI module recently added to the T2K setup in combination with the INGRID Proton module. The phase space of muons is restricted to the high-detection efficiency region, $p_{\mu}>400~{\rm MeV}/c$ and $\theta_{\mu}<30^{\circ}$, in the laboratory frame. Absence of pions and protons in the detectable phase space of "$p_{\pi}>200~{\rm MeV}/c$ and $\theta_{\pi}<70^{\circ}$", and "$p_{\rm p}>600~{\rm MeV}/c$ and $\theta_{\rm p}<70^{\circ}$" is required. In this paper, both of the $\bar{\nu}_\mu$ cross-sections and $\bar{\nu}_\mu+\nu_\mu$ cross-sections on water and hydrocarbon targets, and their ratios are provided by using D'Agostini unfolding method. The results of the integrated $\bar{\nu}_\mu$ cross-section measurements over this phase space are $\sigma_{\rm H_{2}O}\,=\,(1.082\pm0.068(\rm stat.)^{+0.145}_{-0.128}(\rm syst.)) \times 10^{-39}~{\rm cm^{2}/nucleon}$, $\sigma_{\rm CH}\,=\,(1.096\pm0.054(\rm stat.)^{+0.132}_{-0.117}(\rm syst.)) \times 10^{-39}~{\rm cm^{2}/nucleon}$, and $\sigma_{\rm H_{2}O}/\sigma_{\rm CH} = 0.987\pm0.078(\rm stat.)^{+0.093}_{-0.090}(\rm syst.)$. The $\bar{\nu}_\mu+\nu_\mu$ cross-section is $\sigma_{\rm H_{2}O} = (1.155\pm0.064(\rm stat.)^{+0.148}_{-0.129}(\rm syst.)) \times 10^{-39}~{\rm cm^{2}/nucleon}$, $\sigma_{\rm CH}\,=\,(1.159\pm0.049(\rm stat.)^{+0.129}_{-0.115}(\rm syst.)) \times 10^{-39}~{\rm cm^{2}/nucleon}$, and $\sigma_{\rm H_{2}O}/\sigma_{\rm CH}\,=\,0.996\pm0.069(\rm stat.)^{+0.083}_{-0.078}(\rm syst.)$.


title: The Dynamics and Geometry of Semi-Hyperbolic Rational Semigroups

abstract: We study skew-product dynamics for a large class of finitely-generated semi--hyperbolic semigroups of rational maps acting on the Riemann sphere, which generalizes both the theory of iteration of a single rational map of a single complex variable complex/holomorphic dynamics) and the theory of countable alphabet conformal iterated function systems (CIFSs). We construct the thermodynamic formalism for such dynamical systems and geometric potentials by developing the notion of nice families that extend to the case of our highly disconnected skew product phase space the powerful notion of nice sets due to Rivera--Letelier and Przytycki, and the allied earlier notion of $K(V)$ sets due to Denker and the last named author. We leverage out techniques to prove the existence and uniqueness of equilibrium states for a wide class of H\"older potentials, and concomitant statistical laws: central limit theorem, law of iterated logarithm, and exponential decay of correlations. We devote lots of space and effort to control (non-recurrent) critical points which is a notoriously challenging task even for a single rational function; more generators add qualitatively new challenges. Beyond dynamics, but still with dynamical methods, we advance the study of finer fractal geometrical properties of the intricate Julia sets associated to such systems and, in particular, via equilibrium states, we perform a multifractal analysis of Lyapunov exponents. We use the Nice Open Set Condition (NOSC) introduced by the last two authors, and apply our new techniques to settle a long-standing problem in the theory of rational semigroups by proving that for our class of semigroups the Hausdorff dimension of each fiber Julia set is strictly smaller than the Hausdorff dimension of the global Julia set of the semigroup.


title: On default priors for robust Bayesian estimation with divergences

abstract: This paper presents objective priors for robust Bayesian estimation against outliers based on divergences. The minimum $\gamma$-divergence estimator is well-known to work well estimation against heavy contamination. The robust Bayesian methods by using quasi-posterior distributions based on divergences have been also proposed in recent years. In objective Bayesian framework, the selection of default prior distributions under such quasi-posterior distributions is an important problem. In this study, we provide some properties of reference and moment matching priors under the quasi-posterior distribution based on the $\gamma$-divergence. In particular, we show that the proposed priors are approximately robust under the condition on the contamination distribution without assuming any conditions on the contamination ratio. Some simulation studies are also presented.


title: Retinal vessel segmentation by probing adaptive to lighting variations

abstract: We introduce a novel method to extract the vessels in eye fun-dus images which is adaptive to lighting variations. In the Logarithmic Image Processing framework, a 3-segment probe detects the vessels by probing the topographic surface of an image from below. A map of contrasts between the probe and the image allows to detect the vessels by a threshold. In a lowly contrasted image, results show that our method better extract the vessels than another state-of the-art method. In a highly contrasted image database (DRIVE) with a reference , ours has an accuracy of 0.9454 which is similar or better than three state-of-the-art methods and below three others. The three best methods have a higher accuracy than a manual segmentation by another expert. Importantly, our method automatically adapts to the lighting conditions of the image acquisition.

categories: cs.CV cs.NA eess.SP math.NA physics.med-ph


title: Lasing from multipole topological corner states

abstract: Topological photonics provides a fundamental framework for robust manipulation of light, including directional transport and localization with built-in immunity to disorder. Combined with an optical gain, active topological cavities hold special promise for a design of light-emitting devices. Most studies to date have focused on lasing at topological edges of finite systems or domain walls. Recently discovered higher-order topological phases enable strong high-quality confinement of light at the corners. Here we demonstrate lasing action of corner states in a nanophotonic topological cavity. We identify four multipole corner modes with distinct emission profiles via hyperspectral imaging and discern signatures of non-Hermitian radiative coupling of leaky topological states. In addition, depending on the pump position in a large-size cavity, we selectively generate lasing from either edge or corner states within the topological bandgap. Our findings introduce pathways to engineer collective resonances and tailor generation of light in active topological circuits.


title: Liquid Scintillators for Large Area Tracking System

abstract: We report on studies of non-toxic scintillating liquid useful for large surface detectors. Arrays of liquid scintillators offer a rather simple tool for detecting charged particles traversing a surface and tracking their path through a defined volume. Insertion of wavelength shifting fibres along the liquid scintillating containers significantly improves the light collection at the two ends of the scintillators. We have demonstrated that we can achieve timing resolution of O(1 ns) allowing good spatial resolution. Liquid scintillators with fibres read by Photo-multipliers or SiPMs provide an inexpensive alternative technology which suits well the requirement of the MATHUSLA experiment tracking system.


title: Off-axis optical trapping and transverse spinning of metallic microparticles with a linearly polarized Gaussian beam

abstract: Optical trapping of metallic microparticles remains a big challenge because of the strong scattering and absorption of light by the particles. In the paper, we report a new mechanism for stable trapping of metallic microparticles by using a tightly focused linearly polarized Gaussian spot. We theoretically and experimentally demonstrated that metallic microparticles were confined off the optical axis by such a trap. In the meanwhile, transverse spinning motion occurred as a consequence of the asymmetric force field acting on the particle by the trap. The off-axis trapping and transverse spinning of metallic microparticles provide new manners for the manipulation of metallic microparticles. The works reported in this paper are also of significance for a better understanding of the mechanical interaction between light and metallic particles.


title: Simulations Show that Vortex Flows could Heat the Chromosphere in Solar Plage

abstract: The relationship between vortex flows at different spatial scales and their contribution to the energy balance in the chromosphere is not yet fully understood. We perform three-dimensional (3D) radiation-magnetohydrodynamic (MHD) simulations of a unipolar solar plage region at a spatial resolution of 10 km using the MURaM code. We use the swirling-strength criterion that mainly detects the smallest vortices present in the simulation data. We additionally degrade our simulation data to smooth-out the smaller vortices, so that also the vortices at larger spatial scales can be detected. Vortex flows at various spatial scales are found in our simulation data for different effective spatial resolutions. We conclude that the observed large vortices are likely clusters of much smaller ones that are not yet resolved by observations. We show that the vertical Poynting flux decreases rapidly with reduced effective spatial resolutions and is predominantly carried by the horizontal plasma motions rather than vertical flows. Since the small-scale horizontal motions or the smaller vortices carry most of the energy, the energy transported by vortices deduced from low resolution data is grossly underestimated. In full resolution simulation data, the Poynting flux contribution due to vortices is more than adequate to compensate for the radiative losses in plage, indicating their importance for chromospheric heating.


title: End-to-End Design for Self-Reconfigurable Heterogeneous Robotic Swarms

abstract: More widespread adoption requires swarms of robots to be more flexible for real-world applications. Multiple challenges remain in complex scenarios where a large amount of data needs to be processed in real-time and high degrees of situational awareness are required. The options in this direction are limited in existing robotic swarms, mostly homogeneous robots with limited operational and reconfiguration flexibility. We address this by bringing elastic computing techniques and dynamic resource management from the edge-cloud computing domain to the swarm robotics domain. This enables the dynamic provisioning of collective capabilities in the swarm for different applications. Therefore, we transform a swarm into a distributed sensing and computing platform capable of complex data processing tasks, which can then be offered as a service. In particular, we discuss how this can be applied to adaptive resource management in a heterogeneous swarm of drones, and how we are implementing the dynamic deployment of distributed data processing algorithms. With an elastic drone swarm built on reconfigurable hardware and containerized services, it will be possible to raise the self-awareness, degree of intelligence, and level of autonomy of heterogeneous swarms of robots. We describe novel directions for collaborative perception, and new ways of interacting with a robotic swarm.


title: Adaptive tests for parameter changes in ergodic diffusion processes from discrete observations

abstract: We consider the adaptive test for the parameter change in discretely observed ergodic diffusion processes based on the cusum test. Using two test statistics based on the two quasi-log likelihood functions of the diffusion parameter and the drift parameter, we perform the change point tests for both diffusion and drift parameters of the diffusion process. It is shown that the test statistics have the limiting distribution of the sup of the norm of a Brownian bridge. Simulation results are illustrated for the 1-dimensional Ornstein-Uhlenbeck process.


title: Privacy-Preserving Distributed Optimization via Subspace Perturbation: A General Framework

abstract: As the modern world becomes increasingly digitized and interconnected, distributed signal processing has proven to be effective in processing its large volume of data. However, a main challenge limiting the broad use of distributed signal processing techniques is the issue of privacy in handling sensitive data. To address this privacy issue, we propose a novel yet general subspace perturbation method for privacy-preserving distributed optimization, which allows each node to obtain the desired solution while protecting its private data. In particular, we show that the dual variables introduced in each distributed optimizer will not converge in a certain subspace determined by the graph topology. Additionally, the optimization variable is ensured to converge to the desired solution, because it is orthogonal to this non-convergent subspace. We therefore propose to insert noise in the non-convergent subspace through the dual variable such that the private data are protected, and the accuracy of the desired solution is completely unaffected. Moreover, the proposed method is shown to be secure under two widely-used adversary models: passive and eavesdropping. Furthermore, we consider several distributed optimizers such as ADMM and PDMM to demonstrate the general applicability of the proposed method. Finally, we test the performance through a set of applications. Numerical tests indicate that the proposed method is superior to existing methods in terms of several parameters like estimated accuracy, privacy level, communication cost and convergence rate.


title: Three Cousins of Recaman's Sequence

abstract: Although 10^230 terms of Recaman's sequence have been computed, it remains a mystery. Here three distant cousins of that sequence are described, one of which is also mysterious. (i) {A(n), n >= 3} is defined as follows. Start with n, and add n+1, n+2, n+3, ..., stopping after adding n+k if the sum n + (n+1) + ... + (n+k) is divisible by n+k+1. Then A(n)=k. We determine A(n) and show that A(n) <= n^2 - 2n - 1. (ii) {B(n), n >= 1} is a multiplicative analog of {A(n)}. Start with n, and successively multiply by n+1, n+2, ..., stopping after multiplying by n+k if the product n(n+1)...(n+k) is divisible by n+k+1. Then B(n)=k. We conjecture that log^2 B(n) = (1/2 + o(1)) log n loglog n. (iii) The third sequence, {C(n), n >= 1}, is the most interesting, because the most mysterious. Concatenate the decimal digits of n, n+1, n+2, ... until the concatenation n||n+1||...||n+k is divisible by n+k+1. Then C(n)=k. If no such k exists we set C(n)=-1. We have found k for all n <= 1000 except for two cases. Some of the numbers involved are quite large. For example, C(92) = 218128159460, and the concatenation 92||93||...||(92+C(92)) is a number with about 2*10^12 digits. We have only a probabilistic argument that such a k exists for all n.


title: Linear Imperfections

abstract: This lecture gives an overview of the impacts on linear machine optics of machine imperfections due to incorrect field settings and misalignments. The effects of imperfections in dipole, quadrupole, and sextupole magnets are presented, along with beam observables and correction techniques that may be used to restore the nominal machine parameters. The main concepts of orbit correction are discussed in detail, because the principles underlying those techniques can be used for other corrections.


title: Convergence Analysis of Extended LOBPCG for Computing Extreme Eigenvalues

abstract: This paper is concerned with the convergence analysis of an extended variation of the locally optimal preconditioned conjugate gradient method (LOBPCG) for the extreme eigenvalue of a Hermitian matrix polynomial which admits some extended form of Rayleigh quotient. This work is a generalization of the analysis by Ovtchinnikov (SIAM J. Numer. Anal., 46(5):2567-2592, 2008). As instances, the algorithms for definite matrix pairs and hyperbolic quadratic matrix polynomials are shown to be globally convergent and to have an asymptotically local convergence rate. Also, numerical examples are given to illustrate the convergence.


title: The International Workshop on Osteoarthritis Imaging Knee MRI Segmentation Challenge: A Multi-Institute Evaluation and Analysis Framework on a Standardized Dataset

abstract: Purpose: To organize a knee MRI segmentation challenge for characterizing the semantic and clinical efficacy of automatic segmentation methods relevant for monitoring osteoarthritis progression. Methods: A dataset partition consisting of 3D knee MRI from 88 subjects at two timepoints with ground-truth articular (femoral, tibial, patellar) cartilage and meniscus segmentations was standardized. Challenge submissions and a majority-vote ensemble were evaluated using Dice score, average symmetric surface distance, volumetric overlap error, and coefficient of variation on a hold-out test set. Similarities in network segmentations were evaluated using pairwise Dice correlations. Articular cartilage thickness was computed per-scan and longitudinally. Correlation between thickness error and segmentation metrics was measured using Pearson's coefficient. Two empirical upper bounds for ensemble performance were computed using combinations of model outputs that consolidated true positives and true negatives. Results: Six teams (T1-T6) submitted entries for the challenge. No significant differences were observed across all segmentation metrics for all tissues (p=1.0) among the four top-performing networks (T2, T3, T4, T6). Dice correlations between network pairs were high (>0.85). Per-scan thickness errors were negligible among T1-T4 (p=0.99) and longitudinal changes showed minimal bias (<0.03mm). Low correlations (<0.41) were observed between segmentation metrics and thickness error. The majority-vote ensemble was comparable to top performing networks (p=1.0). Empirical upper bound performances were similar for both combinations (p=1.0). Conclusion: Diverse networks learned to segment the knee similarly where high segmentation accuracy did not correlate to cartilage thickness accuracy. Voting ensembles did not outperform individual networks but may help regularize individual models.


title: Benchmarking Robustness of Machine Reading Comprehension Models

abstract: Machine Reading Comprehension (MRC) is an important testbed for evaluating models' natural language understanding (NLU) ability. There has been rapid progress in this area, with new models achieving impressive performance on various benchmarks. However, existing benchmarks only evaluate models on in-domain test sets without considering their robustness under test-time perturbations or adversarial attacks. To fill this important gap, we construct AdvRACE (Adversarial RACE), a new model-agnostic benchmark for evaluating the robustness of MRC models under four different types of adversarial attacks, including our novel distractor extraction and generation attacks. We show that state-of-the-art (SOTA) models are vulnerable to all of these attacks. We conclude that there is substantial room for building more robust MRC models and our benchmark can help motivate and measure progress in this area. We release our data and code at https://github.com/NoviScl/AdvRACE .


title: Almost Kenmotsu manifolds admitting certain vector fields

abstract: In the present paper, we characterize almost Kenmotsu manifolds admitting holomorphically planar conformal vector (HPCV) fields. We have shown that if an almost Kenmotsu manifold $M^{2n+1}$ admits a non-zero HPCV field $V$ such that $\phi V = 0$, then $M^{2n+1}$ is locally a warped product of an almost Kaehler manifold and an open interval. As a corollary of this we obtain few classifications of an almost Kenmotsu manifold to be a Kenmotsu manifold and also prove that the integral manifolds of D are totally umbilical submanifolds of $M^{2n+1}$. Further, we prove that if an almost Kenmotsu manifold with positive constant $\xi$-sectional curvature admits a non-zero HPCV field $V$, then either $M^{2n+1}$ is locally a warped product of an almost Kaehler manifold and an open interval or isometric to a sphere. Moreover, a $(k,\mu)'$-almost Kenmotsu manifold admitting a HPCV field $V$ such that $\phi V = 0$ is either locally isometric to $\mathbb{H}^{n+1}(-4) \times \mathbb{R}^n$ or $V$ is an eigenvector of $h'$. Finally, an example is presented.


title: Excitation of $^{229m}$Th at Inelastic Scattering of Low Energy Electrons

abstract: Excitation of the anomalously low lying nuclear isomer $^{229m}$Th$(3/2^+, 8.28 \pm 0.17$ eV) in the process of inelastic electron scattering is studied theoretically in the framework of the perturbation theory for the quantum electrodynamics. The calculated cross sections of $^{229m}$Th by the extremely low energy electrons in the range 9 eV--12 eV for the Th atom and Th$^{1+,4+}$ ions lie in the range $10^{-25}$--$10^{-26}$ cm$^2$. Being so large, the cross section opens up new possibilities for the effective non-resonant excitation of $^{229m}$Th in experiments with an electron beam or electron (electric) current. This can be crucial, since the energy of the isomeric state is currently known with an accuracy insufficient for the resonant excitation by photons. In addition, the cross section of the time reversed process is also large, and as a consequence, the probability of the non-radiative $^{229m}$Th decay via the conduction electrons in metal is $\approx10^{6}$ s$^{-1}$, that is, close to the internal conversion probability in the Th atom.


title: Quelques \'el\'ements de combinatoire des matrices de $SL_{2}(\mathbb{Z})$

abstract: A Theorem of V.Ovsienko characterizes sequences of positive integers $(a_1,a_2,\ldots,a_n)$ such that the $(2\times2)$-matrix $\begin{pmatrix} a_n & -1 \\ 1 & 0 \end{pmatrix}\cdots \begin{pmatrix} a_1 & -1 \\ 1 & 0 \end{pmatrix}$ is equal to $\pm Id$. In this paper, we study this equation when we replace $\pm Id$ by $\pm M$. In particular, we give a combinatorial description of the solutions of this equation in terms of dissections of convex polygons in the cases $M=\begin{pmatrix} 0 & -1 \\ 1 & 0 \end{pmatrix}$ and $M=\begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix}$.


title: Filtering Noisy Dialogue Corpora by Connectivity and Content Relatedness

abstract: Large-scale dialogue datasets have recently become available for training neural dialogue agents. However, these datasets have been reported to contain a non-negligible number of unacceptable utterance pairs. In this paper, we propose a method for scoring the quality of utterance pairs in terms of their connectivity and relatedness. The proposed scoring method is designed based on findings widely shared in the dialogue and linguistics research communities. We demonstrate that it has a relatively good correlation with the human judgment of dialogue quality. Furthermore, the method is applied to filter out potentially unacceptable utterance pairs from a large-scale noisy dialogue corpus to ensure its quality. We experimentally confirm that training data filtered by the proposed method improves the quality of neural dialogue agents in response generation.


title: Targeted Principal Components Regression

abstract: We propose a principal components regression method based on maximizing a joint pseudo-likelihood for responses and predictors. Our method uses both responses and predictors to select linear combinations of the predictors relevant for the regression, thereby addressing an oft-cited deficiency of conventional principal components regression. The proposed estimator is shown to be consistent in a wide range of settings, including ones with non-normal and dependent observations; conditions on the first and second moments suffice if the number of predictors ($p$) is fixed and the number of observations ($n$) tends to infinity and dependence is weak, while stronger distributional assumptions are needed when $p \to \infty$ with $n$. We obtain the estimator's asymptotic distribution as the projection of a multivariate normal random vector onto a tangent cone of the parameter set at the true parameter, and find the estimator is asymptotically more efficient than competing ones. In simulations our method is substantially more accurate than conventional principal components regression and compares favorably to partial least squares and predictor envelopes. The method's practical usefulness is illustrated in a data example with cross-sectional prediction of stock returns.


title: Counting of Grapevine Berries in Images via Semantic Segmentation using Convolutional Neural Networks

abstract: The extraction of phenotypic traits is often very time and labour intensive. Especially the investigation in viticulture is restricted to an on-site analysis due to the perennial nature of grapevine. Traditionally skilled experts examine small samples and extrapolate the results to a whole plot. Thereby different grapevine varieties and training systems, e.g. vertical shoot positioning (VSP) and semi minimal pruned hedges (SMPH) pose different challenges. In this paper we present an objective framework based on automatic image analysis which works on two different training systems. The images are collected semi automatic by a camera system which is installed in a modified grape harvester. The system produces overlapping images from the sides of the plants. Our framework uses a convolutional neural network to detect single berries in images by performing a semantic segmentation. Each berry is then counted with a connected component algorithm. We compare our results with the Mask-RCNN, a state-of-the-art network for instance segmentation and with a regression approach for counting. The experiments presented in this paper show that we are able to detect green berries in images despite of different training systems. We achieve an accuracy for the berry detection of 94.0% in the VSP and 85.6% in the SMPH.


title: Lagrangian-space Gaussian ansatz for the matter redshift-space power spectrum and correlation function

abstract: We study the predictions for the matter redshift-space power spectrum and correlation function of a Lagrangian-space Gaussian ansatz introduced in a previous work. This model is a natural extension of the Zeldovich approximation, where the displacement and velocity power spectra are determined by the equations of motion, instead of being set equal to the linear power spectrum. It does not contain any free parameter. As for the real-space statistics, we find that this Lagrangian-space approach is much more efficient for the correlation functions than for the power spectra. The damping of the BAO oscillations is well recovered but there is a large smooth drift from the simulations in the power spectra. The multipoles of the correlation functions are well recovered on BAO scales, with an accuracy of $2\%$ for $\xi^s_0$ down to $10 h^{-1}$ Mpc, and of $3\%$ for $\xi^s_2$ down to $26 h^{-1}$ Mpc, at $z \geq 0.35$.


title: Holographic transform for tensor product of holomorphic discrete series

abstract: We study holographic operators associated with Rankin-Cohen brackets which are symmetry breaking operators for the restriction of tensor products of holomorphic discrete series of SL2(R). Furthermore, we investigate a geometrical interpretation of these operators and their relations to classical Jacobi polynomials.


title: Unified theory to characterize Floquet topological phases by quench dynamics

abstract: The conventional characterization of periodically driven systems usually necessitates the time-domain information beyond Floquet bands, hence lacking universal and direct schemes of measuring Floquet topological invariants. Here we propose a unified theory based on quantum quenches to characterize generic $d$-dimensional ($d$D) Floquet topological phases, in which the topological invariants are constructed with only minimal information of the static Floquet bands. For a $d$D phase which is initially static and trivial, we introduce the quench dynamics by suddenly turning on the periodic driving, and show that the quench dynamics exhibits emergent topological patterns in ($d-1$)D momentum subspaces where Floquet bands cross, from which the Floquet topological invariants are directly obtained. This prediction provides a simple and unified characterization, in which one can not only extract the number of conventional and anomalous Floquet boundary modes, but also identify the topologically protected singularities in the phase bands. The applications are illustrated with 1D and 2D models which are readily accessible in cold atom experiments. Our study opens a new framework for the characterization of Floquet topological phases.


title: Versatile Black-Box Optimization

abstract: Choosing automatically the right algorithm using problem descriptors is a classical component of combinatorial optimization. It is also a good tool for making evolutionary algorithms fast, robust and versatile. We present Shiwa, an algorithm good at both discrete and continuous, noisy and noise-free, sequential and parallel, black-box optimization. Our algorithm is experimentally compared to competitors on YABBOB, a BBOB comparable testbed, and on some variants of it, and then validated on several real world testbeds.


title: Finite-time ruin probability for correlated Brownian motions

abstract: Let $(W_1(s), W_2(t)), s,t\ge 0$ be a bivariate Brownian motion with standard Brownian motion marginals and constant correlation $\rho \in (-1,1)$ and define the joint survival probability of both supremum functionals $\pi_\rho(c_1,c_2; u, v)$ by $$\pi_\rho(c_1,c_2; u, v)=\mathbb{P}\left(\sup_{s \in [0,1]} \left(W_1(s)-c_1s\right)>u,\sup_{t \in [0,1]} \left(W_2(t)-c_2t\right)>v\right) ,$$ where $c_1,c_2 \in \mathbb{R}$ and $u,v$ are given positive constants. Approximation of $\pi_\rho(c_1,c_2; u, v) $ is of interest for the analysis of ruin probability in bivariate Brownian risk model as well as in the study of bivariate test statistics. In this contribution we derive tight bounds for $\pi_\rho(c_1,c_2; u, v)$ in the case $\rho \in (0,1)$ and obtain precise approximations by letting $u\to \infty$ and taking $v= au$ for some fixed positive constant $a$ and $\rho \in (-1,1).$


title: Multi-Decoder RNN Autoencoder Based on Variational Bayes Method

abstract: Clustering algorithms have wide applications and play an important role in data analysis fields including time series data analysis. However, in time series analysis, most of the algorithms used signal shape features or the initial value of hidden variable of a neural network. Little has been discussed on the methods based on the generative model of the time series. In this paper, we propose a new clustering algorithm focusing on the generative process of the signal with a recurrent neural network and the variational Bayes method. Our experiments show that the proposed algorithm not only has a robustness against for phase shift, amplitude and signal length variations but also provide a flexible clustering based on the property of the variational Bayes method.


title: Interaction of hydrogen peroxide molecules with non-specific DNA recognition sites

abstract: Ion beam therapy is one of the most progressive methods in cancer treatment. Studies of the water radiolysis process show that the most long-living species that occur in the medium of a biological cell under the action of ionizing irradiation are hydrogen peroxide (H$_2$O$_2$) molecules. But the role of H$_2$O$_2$ molecules in the DNA deactivation of cancer cells in ion beam therapy has not been determined yet. In the present paper, the competitive interaction of hydrogen peroxide and water molecules with atomic groups of non-specific DNA recognition sites (phosphate groups PO$_4$) is investigated. The interaction energies and optimized spatial configurations of the considered molecular complexes are calculated with the help of molecular mechanics method and quantum chemistry approach. The results show that the H$_2$O$_2$ molecule can form a complex with the PO$_4$ group (with and without a sodium counterion) that is more energetically stable than the same complex with the water molecule. Formation of such complexes can block genetic information transfer processes in cancer cells and can be an important factor during ion beam therapy treatment.


title: Demonstration of non-Markovian process characterisation and control on a quantum processor

abstract: In the scale-up of quantum computers, the framework underpinning fault-tolerance generally relies on the strong assumption that environmental noise affecting qubit logic is uncorrelated (Markovian). However, as physical devices progress well into the complex multi-qubit regime, attention is turning to understanding the appearance and mitigation of correlated -- or non-Markovian -- noise, which poses a serious challenge to the progression of quantum technology. This error type has previously remained elusive to characterisation techniques. Here, we develop a framework for characterising non-Markovian dynamics in quantum systems and experimentally test it on multi-qubit superconducting quantum devices. Where noisy processes cannot be accounted for using standard Markovian techniques, our reconstruction predicts the behaviour of the devices with an infidelity of $10^{-3}$. Our results show this characterisation technique leads to superior quantum control and extension of coherence time by effective decoupling from the non-Markovian environment. This framework, validated by our results, is applicable to any controlled quantum device and offers a significant step towards optimal device operation and noise reduction.


title: A deep X-ray spectral imaging of the bow-shock pulsar wind nebula associated with PSR B1929+10

abstract: In this work, we study the X-ray bow-shock nebula powered by the mature pulsar PSR B1929+10 using data from XMM-Newton, with an effective exposure of $\sim$ 300 ks, offering the deepest investigation of this system thus far. We found the X-ray axial outflow extends as long as $\sim$ 8 arc minute behind the proper motion direction, which is a factor of two longer than the result reported in the previous study. Furthermore, we found evidence of two faint lateral outflows extending laterally with respect to the proper motion. We also found indications of spectral hardening along the axial outflow, suggesting that certain acceleration processes might occur along this feature.


title: Caramel: Accelerating Decentralized Distributed Deep Learning with Computation Scheduling

abstract: The method of choice for parameter aggregation in Deep Neural Network (DNN) training, a network-intensive task, is shifting from the Parameter Server model to decentralized aggregation schemes (AllReduce) inspired by theoretical guarantees of better performance. However, current implementations of AllReduce overlook the interdependence of communication and computation, resulting in significant performance degradation. In this paper, we develop Caramel, a system that accelerates decentralized distributed deep learning through model-aware computation scheduling and communication optimizations for AllReduce. Caramel achieves this goal through (a) computation DAG scheduling that expands the feasible window of transfer for each parameter (transfer boundaries), and (b) network optimizations for smoothening of the load including adaptive batching and pipelining of parameter transfers. Caramel maintains the correctness of the dataflow model, is hardware-independent, and does not require any user-level or framework-level changes. We implement Caramel over TensorFlow and show that the iteration time of DNN training can be improved by up to 3.62x in a cloud environment.


title: Multiscale Collaborative Deep Models for Neural Machine Translation

abstract: Recent evidence reveals that Neural Machine Translation (NMT) models with deeper neural networks can be more effective but are difficult to train. In this paper, we present a MultiScale Collaborative (MSC) framework to ease the training of NMT models that are substantially deeper than those used previously. We explicitly boost the gradient back-propagation from top to bottom levels by introducing a block-scale collaboration mechanism into deep NMT models. Then, instead of forcing the whole encoder stack directly learns a desired representation, we let each encoder block learns a fine-grained representation and enhance it by encoding spatial dependencies using a context-scale collaboration. We provide empirical evidence showing that the MSC nets are easy to optimize and can obtain improvements of translation quality from considerably increased depth. On IWSLT translation tasks with three translation directions, our extremely deep models (with 72-layer encoders) surpass strong baselines by +2.2~+3.1 BLEU points. In addition, our deep MSC achieves a BLEU score of 30.56 on WMT14 English-German task that significantly outperforms state-of-the-art deep NMT models.


title: A Canonical Form for Positive Definite Matrices

abstract: We exhibit an explicit, deterministic algorithm for finding a canonical form for a positive definite matrix under unimodular integral transformations. We use characteristic sets of short vectors and partition-backtracking graph software. The algorithm runs in a number of arithmetic operations that is exponential in the dimension $n$, but it is practical and more efficient than canonical forms based on Minkowski reduction.


title: Internal conversion of the low energy $^{229m}$Th isomer in the Thorium anion

abstract: A process of the decay of the anomalously low lying nuclear isomer $^{229m}$Th$(3/2^+,8.28 \pm 0.17$ eV) in the Thorium anion (Th$^-$) via the internal conversion (IC) channel is studied. We show that the half life of the nuclear isomer in the $6d_{3/2}^37s_{1/2}^2$ ground state and in the $6d_{3/2}^2 7s_{1/2}^2 7p_{1/2}^1$ excited state of Th$^-$ is $\approx1.5$ and $\approx1.1$ times bigger than in the $6d_{3/2}^2 7s_{1/2}^2$ ground state of the Th atom. The IC probabilities in the anion decreases despite the decay via the additional $6d_{3/2}$ or $7p_{1/2}$ electrons. This counterintuitive result is a consequence: a) of a decrease in the amplitudes of the $6d_{3/2}$ and $7s_{1/2}$ wave functions near the nucleus due to an increase in their diffuseness of upon the addition of extra electron, b) of mutual compensation in the IC probability due to a kinematic factor, which depends on the energy of the conversion electron in the continuum as $E_c^{-1/2}$, and the $E_c^{1/4}$ growth of the amplitudes of the electron wave functions.


title: Deep Learning for High Speed Optical Coherence Elastography

abstract: Mechanical properties of tissue provide valuable information for identifying lesions. One approach to obtain quantitative estimates of elastic properties is shear wave elastography with optical coherence elastography (OCE). However, given the shear wave velocity, it is still difficult to estimate elastic properties. Hence, we propose deep learning to directly predict elastic tissue properties from OCE data. We acquire 2D images with a frame rate of 30 kHz and use convolutional neural networks to predict gelatin concentration, which we use as a surrogate for tissue elasticity. We compare our deep learning approach to predictions from conventional regression models, using the shear wave velocity as a feature. Mean absolut prediction errors for the conventional approaches range from 1.32$\pm$0.98 p.p. to 1.57$\pm$1.30 p.p. whereas we report an error of 0.90$\pm$0.84 p.p for the convolutional neural network with 3D spatio-temporal input. Our results indicate that deep learning on spatio-temporal data outperforms elastography based on explicit shear wave velocity estimation.


title: Multi-View Attention Network for Visual Dialog

abstract: Visual dialog is a challenging vision-language task in which a series of questions visually grounded by a given image are answered. To resolve the visual dialog task, a high-level understanding of various multimodal inputs (e.g., question, dialog history, and image) is required. Specifically, it is necessary for an agent to 1) determine the semantic intent of question and 2) align question-relevant textual and visual contents among heterogeneous modality inputs. In this paper, we propose Multi-View Attention Network (MVAN), which leverages multiple views about heterogeneous inputs based on attention mechanisms. MVAN effectively captures the question-relevant information from the dialog history with two complementary modules (i.e., Topic Aggregation and Context Matching), and builds multimodal representations through sequential alignment processes (i.e., Modality Alignment). Experimental results on VisDial v1.0 dataset show the effectiveness of our proposed model, which outperforms the previous state-of-the-art methods with respect to all evaluation metrics.


title: Extended Coopetitive Soft Gating Ensemble

abstract: This article is about an extension of a recent ensemble method called Coopetitive Soft Gating Ensemble (CSGE) and its application on power forecasting as well as motion primitive forecasting of cyclists. The CSGE has been used successfully in the field of wind power forecasting, outperforming common algorithms in this domain. The principal idea of the CSGE is to weight the models regarding their observed performance during training on different aspects. Several extensions are proposed to the original CSGE within this article, making the ensemble even more flexible and powerful. The extended CSGE (XCSGE as we term it), is used to predict the power generation on both wind- and solar farms. Moreover, the XCSGE is applied to forecast the movement state of cyclists in the context of driver assistance systems. Both domains have different requirements, are non-trivial problems, and are used to evaluate various facets of the novel XCSGE. The two problems differ fundamentally in the size of the data sets and the number of features. Power forecasting is based on weather forecasts that are subject to fluctuations in their features. In the movement primitive forecasting of cyclists, time delays contribute to the difficulty of the prediction. The XCSGE reaches an improvement of the prediction performance of up to 11% for wind power forecasting and 30% for solar power forecasting compared to the worst performing model. For the classification of movement primitives of cyclists, the XCSGE reaches an improvement of up to 28%. The evaluation includes a comparison with other state-of-the-art ensemble methods. We can verify that the XCSGE results are significantly better using the Nemenyi post-hoc test.


title: Decay of the low-energy nuclear $^{229m}$Th isomer via atomic Rydberg states

abstract: In the paper, a unique process of the decay of the $^{229m}$Th($3/2^+,8.28\pm 0.17$ eV) low energy nuclear isomer via the internal conversion (IC) channel on Rydberg states is considered for the first time. The Rydberg atom $^{229m}$Th$^{+}+e^-_{Ry}$ is a unique object where IC is possible exclusively on the Rydberg electron $e^-_{Ry}$. It is shown that in the $^{229m}$Th$^{4+}+e^-_{Ry}$ system a) IC on the electron states with relatively small values of the principal quantum number $n$ and the orbital moment $l$ is practically completely suppressed, b) IC probability, $W_{IC}$, on the $\psi_{ns_{1/2}}({\bf{r}})$ states is proportional to $|\psi_{ns_{1/2}}(0)|^2$ and can be related with the energy of the hyperfine interaction of the Rydberg electron with the nucleus, c) $W_{IC}$ decreases rapidly with the increase of $n$ in the range from 10 to 50, and in the range $n\gtrsim 150$ $W_{IC}$ changes as ${\text{Const}}/n^3$ typical for hydrogen-like ions, d) at $n\thickapprox 10$--30, $W_{IC}$ as a function of $l$ has a characteristic "knee" between $l=3$ and $l=4$, i.e. a three order of magnitude decrease of $W_{IC}$ due to the qualitative change in the ratio between the centrifugal and shielding potentials.


title: The Operating Diagram for a Two-Step Anaerobic Digestion Model

abstract: The Anaerobic Digestion Model No. 1 (ADM1) is a complex model which is widely accepted as a common platform for anaerobic process modeling and simulation. However, it has a large number of parameters and states that hinder its analytical study. Here, we consider the two-step reduced model of anaerobic digestion (AM2) which is a four-dimensional system of ordinary differential equations. The AM2 model is able to adequately capture the main dynamical behavior of the full anaerobic digestion model ADM1 and has the advantage that a complete analysis for the existence and local stability of its steady states is available. We describe its operating diagram, which is the bifurcation diagram which gives the behavior of the system with respect to the operating parameters represented by the dilution rate and the input concentrations of the substrates. This diagram, is very useful to understand the model from both the mathematical and biological points of view.


title: A Fast Radio Burst discovered in FAST drift scan survey

abstract: We report the discovery of a highly dispersed fast radio burst, FRB~181123, from an analysis of $\sim$1500~hr of drift-scan survey data taken using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The pulse has three distinct emission components, which vary with frequency across our 1.0--1.5~GHz observing band. We measure the peak flux density to be $>0.065$~Jy and the corresponding fluence $>0.2$~Jy~ms. Based on the observed dispersion measure of 1812~cm$^{-3}$~pc, we infer a redshift of $\sim 1.9$. From this, we estimate the peak luminosity and isotropic energy to be $\lesssim 2\times10^{43}$~erg~s$^{-1}$ and $\lesssim 2\times10^{40}$~erg, respectively. With only one FRB from the survey detected so far, our constraints on the event rate are limited. We derive a 95\% confidence lower limit for the event rate of 900 FRBs per day for FRBs with fluences $>0.025$~Jy~ms. We performed follow-up observations of the source with FAST for four hours and have not found a repeated burst. We discuss the implications of this discovery for our understanding of the physical mechanisms of FRBs.


title: First principles calculations of steady-state voltage-controlled magnetism: application to x-ray absorption spectroscopy experiment

abstract: Recent x-ray absorption experiments have demonstrated the possibility to accurately monitor the magnetism of metallic hetero-structures controlled via a time-independent perturbation caused for example by a static electric field. Using a first-principles, non-equilibrium Green function scheme, we show how the measured dichroic signal for the corresponding steady-state situation can be related to the underlying electronic structure and its response to the external stimulus. The suggested approach works from the infinitesimal limit of linear response to the regime of strong electric field effects, which is realized in present experimental high sensitivity investigations.


title: A generalized kernel machine approach to identify higher-order composite effects in multi-view datasets

abstract: In recent years, a comprehensive study of multi-view datasets (e.g., multi-omics and imaging scans) has been a focus and forefront in biomedical research. State-of-the-art biomedical technologies are enabling us to collect multi-view biomedical datasets for the study of complex diseases. While all the views of data tend to explore complementary information of a disease, multi-view data analysis with complex interactions is challenging for a deeper and holistic understanding of biological systems. In this paper, we propose a novel generalized kernel machine approach to identify higher-order composite effects in multi-view biomedical datasets. This generalized semi-parametric (a mixed-effect linear model) approach includes the marginal and joint Hadamard product of features from different views of data. The proposed kernel machine approach considers multi-view data as predictor variables to allow more thorough and comprehensive modeling of a complex trait. The proposed method can be applied to the study of any disease model, where multi-view datasets are available. We applied our approach to both synthesized datasets and real multi-view datasets from adolescence brain development and osteoporosis study, including an imaging scan dataset and five omics datasets. Our experiments demonstrate that the proposed method can effectively identify higher-order composite effects and suggest that corresponding features (genes, region of interests, and chemical taxonomies) function in a concerted effort. We show that the proposed method is more generalizable than existing ones.


title: Sampling the flow of a bandlimited function

abstract: We analyze the problem of reconstruction of a bandlimited function $f$ from the space-time samples of its states $f_t=\phi_t\ast f$ resulting from the convolution with a kernel $\phi_t$. It is well-known that, in natural phenomena, uniform space-time samples of $f$ are not sufficient to reconstruct $f$ in a stable way. To enable stable reconstruction, a space-time sampling with periodic nonuniformly spaced samples must be used as was shown by Lu and Vetterli. We show that the stability of reconstruction, as measured by a condition number, controls the maximal gap between the spacial samples. We provide a quantitative statement of this result. In addition, instead of irregular space-time samples, we show that uniform dynamical samples at sub-Nyquist spatial rate allow one to stably reconstruct the function $\widehat f$ away from certain, explicitly described blind spots. We also consider several classes of finite dimensional subsets of bandlimited functions in which the stable reconstruction is possible, even inside the blind spots. We obtain quantitative estimates for it using Remez-Tur\'an type inequalities. En route, we obtain a Remez-Tur\'an inequality for prolate spheroidal wave functions. To illustrate our results, we present some numerics and explicit estimates for the heat flow problem.


title: AuthSC: Mind the Gap between Web and Smart Contracts

abstract: Although almost all information about Smart Contract addresses is shared via websites, emails, or other forms of digital communication, Blockchains and distributed ledger technology are unable to establish secure bindings between websites and corresponding Smart Contracts. For a user, it is impossible to differentiate whether a website links to a legitimate Smart Contract set up by owners of a business or to an illicit contract aiming to steal users' funds. Surprisingly, current attempts to solve this issue mostly comprise of information redundancy, e.g., displaying contract addresses multiple times in varying forms of images and texts. These processes are burdensome, as the user is responsible for verifying the correctness of an address. More importantly, they do not address the core issue, as the contract itself does not contain information about its authenticity. To solve current issues for these applications and increase security, we propose a solution that facilitates publicly issued SSL/TLS-certificates of Fully-Qualified Domain Names (FQDN) to ensure the authenticity of Smart Contracts and their owners. Our approach combines on-chain identity assertion utilizing signatures from the respective certificate and off-chain authentication of the Smart Contract stored on the Blockchain. This approach allows to tackle the aforementioned issue and further enables applications such as the identification of consortia members in permissioned networks. The system is open and transparent, as the only requirement for usage is ownership of an SSL/TLS-certificate. To enable privacy-preserving authenticated Smart Contracts, we allow one-way and two-way binding between website and contract. Further, low creation and maintenance costs, a widely accepted public key infrastructure and user empowerment will drive potential adaption of Ethereum Authenticated Smart Contracts (AuthSC).


title: Emerging Relation Network and Task Embedding for Multi-Task Regression Problems

abstract: Multi-task learning (mtl) provides state-of-the-art results in many applications of computer vision and natural language processing. In contrast to single-task learning (stl), mtl allows for leveraging knowledge between related tasks improving prediction results on the main task (in contrast to an auxiliary task) or all tasks. However, there is a limited number of comparative studies on applying mtl architectures for regression and time series problems taking recent advances of mtl into account. An interesting, non-linear problem is the forecast of the expected power generation for renewable power plants. Therefore, this article provides a comparative study of the following recent and important mtl architectures: Hard parameter sharing, cross-stitch network, sluice network (sn). They are compared to a multi-layer perceptron model of similar size in an stl setting. Additionally, we provide a simple, yet effective approach to model task specific information through an embedding layer in an multi-layer perceptron, referred to as task embedding. Further, we introduce a new mtl architecture named emerging relation network (ern), which can be considered as an extension of the sluice network. For a solar power dataset, the task embedding achieves the best mean improvement with 14.9%. The mean improvement of the ern and the sn on the solar dataset is of similar magnitude with 14.7% and 14.8%. On a wind power dataset, only the ern achieves a significant improvement of up to 7.7%. Results suggest that the ern is beneficial when tasks are only loosely related and the prediction problem is more non-linear. Contrary, the proposed task embedding is advantageous when tasks are strongly correlated. Further, the task embedding provides an effective approach with reduced computational effort compared to other mtl architectures.


title: The Holy Grail of Quantum Artificial Intelligence: Major Challenges in Accelerating the Machine Learning Pipeline

abstract: We discuss the synergetic connection between quantum computing and artificial intelligence. After surveying current approaches to quantum artificial intelligence and relating them to a formal model for machine learning processes, we deduce four major challenges for the future of quantum artificial intelligence: (i) Replace iterative training with faster quantum algorithms, (ii) distill the experience of larger amounts of data into the training process, (iii) allow quantum and classical components to be easily combined and exchanged, and (iv) build tools to thoroughly analyze whether observed benefits really stem from quantum properties of the algorithm.


title: Insights on Training Neural Networks for QUBO Tasks

abstract: Current hardware limitations restrict the potential when solving quadratic unconstrained binary optimization (QUBO) problems via the quantum approximate optimization algorithm (QAOA) or quantum annealing (QA). Thus, we consider training neural networks in this context. We first discuss QUBO problems that originate from translated instances of the traveling salesman problem (TSP): Analyzing this representation via autoencoders shows that there is way more information included than necessary to solve the original TSP. Then we show that neural networks can be used to solve TSP instances from both QUBO input and autoencoders' hiddenstate representation. We finally generalize the approach and successfully train neural networks to solve arbitrary QUBO problems, sketching means to use neuromorphic hardware as a simulator or an additional co-processor for quantum computing.


title: Self-similar sets with super-exponential close cylinders

abstract: S. Baker (2019), B. B\'ar\'any and A. K\"{a}enm\"{a}ki (2019) independently showed that there exist iterated function systems without exact overlaps and there are super-exponentially close cylinders at all small levels. We adapt the method of S. Baker and obtain further examples of this type. We prove that for any algebraic number $\beta\ge 2$ there exist real numbers $s, t$ such that the iterated function system $$ \left \{\frac{x}{\beta}, \frac{x+1}{\beta}, \frac{x+s}{\beta}, \frac{x+t}{\beta}\right \} $$ satisfies the above property.


title: Structure, phonons, and orbital degrees of freedom in Fe$_2$Mo$_3$O$_8$

abstract: We report on the structural and spectroscopic characterization of the multiferroic Fe$_2$Mo$_3$O$_8$. Synchrotron x-ray and neutron diffraction, as well as thermal expansion measurements reveal a lattice anomaly at $T_{\mathrm{N}}\simeq 60\,$K but do not show any symmetry lowering in the magnetically ordered state. The lattice parameter $c$ exhibits a non-monotonic behavior with a pronounced minimum around $200\,$K, which is also reflected in an anomalous behavior of some of the observed infrared-active optical excitations and parallels the onset of short-range magnetic order. The infrared reflectivity spectra measured between 5 and 300$\,$K in the frequency range of $100-8000\,$cm$^{-1}$ reveal most of the expected phonon modes in comparison with the eigenfrequencies obtained by density-functional calculations. The $A_1$ phonons show an overall hardening upon cooling, whereas a non-monotonic behavior is observed for some of the $E_1$ modes. These modes also show a strongly increased phonon lifetime below $T_\mathrm{N}$, which we associate with the quenched direction of the orbital moment in the magnetically ordered state. A similar increase is observed in the lifetime of the higher-lying $d$-$d$ excitations of the tetrahedral Fe$^{2+}$ site, which become clearly visible below $T_\mathrm{N}$ only.


title: Half-Integer Shapiro Steps in a Short Ballistic InAs Nanowire Josephson Junction

abstract: We report on half-integer Shapiro steps observed in an InAs nanowire Josephson junction. We observed the Shapiro steps of the short ballistic InAs nanowire Josephson junction and found anomalous half-integer steps in addition to the conventional integer steps. The half-integer steps disappear as the temperature increases or transmission of the junction decreases. These experimental results agree closely with numerical calculation of the Shapiro response for the skewed current phase relation in a short ballistic Josephson junction.


title: Rings and arcs around evolved stars. II. The Carbon Star AFGL 3068 and the Planetary Nebulae NGC 6543, NGC 7009 and NGC 7027

abstract: We present a detailed comparative study of the arcs and fragmented ring-like features in the haloes of the planetary nebulae (PNe) NGC 6543, NGC 7009, and NGC 7027 and the spiral pattern around the carbon star AFGL 3068 using high-quality multi-epoch HST images. This comparison allows us to investigate the connection and possible evolution between the regular patterns surrounding AGB stars and the irregular concentric patterns around PNe. The radial proper motion of these features, ~15 km/s, are found to be consistent with the AGB wind and their linear sizes and inter-lapse times (500-1900 yr) also agree with those found around AGB stars, suggesting a common origin. We find evidence using radiative-hydrodynamic simulations that regular patterns produced at the end of the AGB phase become highly distorted by their interactions with the expanding PN and the anisotropic illumination and ionization patterns caused by shadow instabilities. These processes will disrupt the regular (mostly spiral) patterns around AGB stars, plausibly becoming the arcs and fragmented rings observed in the haloes of PNe.


title: Electromagnetic induction heating as a driver of volcanic activity on massive rocky planets

abstract: Aims. We investigate possible driving mechanisms of volcanic activity on rocky super-Earths with masses exceeding 3-4 Mearth. Due to high gravity and pressures in the mantles of these planets, melting in deep mantle layers can be suppressed, even if the energy releae due to tidal heating and radioactive decay is substantial. Here we investigate whether a newly identified heating mechanism, namely induction heating by the star's magnetic field, can drive volcanic activity on these planets due to its unique heating pattern in the very upper part of the mantle. In this region the pressure is not yet high enough to preclude the melt formation. Methods. Using the super-Earth HD 3167b as an example, we calculate induction heating in the planet's interiors assuming an electrical conductivity profile typical of a hot rocky planet and a moderate stellar magnetic field typical of an old inactive star. Then we use a mantle convection code (CHIC) to simulate the evolution of volcanic outgassing with time. Results. We show that although in most cases volcanic outgassing on HD 3167b is not very significant in the absence of induction heating, including this heating mechanism changes the picture and leads to a substantial increase in the outgassing from the planet's mantle. This result shows that induction heating combined with a high surface temperature is capable of driving volcanism on massive super-Earths, which has important observational implications.


title: The local and global properties of different types of supernova host galaxies

abstract: By using Data Analysis Pipeline (DAP) products of Mapping Nearby Galaxies at Apache Point Observatory (MaNGA), which are publicly available from the SDSS Data Release 15, we analyze the local properties at the SN explosion sites and global properties of different types of SN host galaxies to explore the explosion environments of different types of SNe. In our sample, there are 67 SN host galaxies in the field of view of MaNGA, including 32 Type Ia, 29 CCSNe, 1 super-luminous SN (SLSN), 1 Type I and 4 unclassified type of SNe, with which we can perform the K-S test for analysis and derive statistically robust results. Due to the limited sample size, we couldn't remove the mass dependence in this work, which is likely the true driver of the trends for the properties presented in this work. The global star formation rate (SFR) and EW(H$\alpha$) for SN Ia hosts is slightly lower than that for CCSN hosts on average. SN Ia host galaxies are $\sim$ 0.3 dex more massive than CCSN hosts, which implies that the number ratio of CCSNe to Type Ia SNe will decrease with the increasing of stellar mass of host galaxies. The stellar population age of SN Ia host galaxies is older than that of CCSN hosts on average. There is no significant difference between different types of SN hosts for some properties, including local SFR density ($\Sigma \rm SFR$), local and global gas-phase oxygen abundance. For most galaxies in our sample, the global gas-phase oxygen abundance estimated from the integrated spectra of SN hosts can represent the local gas-phase oxygen abundance at the SN explosion sites with small bias.


title: Single-Side Domain Generalization for Face Anti-Spoofing

abstract: Existing domain generalization methods for face anti-spoofing endeavor to extract common differentiation features to improve the generalization. However, due to large distribution discrepancies among fake faces of different domains, it is difficult to seek a compact and generalized feature space for the fake faces. In this work, we propose an end-to-end single-side domain generalization framework (SSDG) to improve the generalization ability of face anti-spoofing. The main idea is to learn a generalized feature space, where the feature distribution of the real faces is compact while that of the fake ones is dispersed among domains but compact within each domain. Specifically, a feature generator is trained to make only the real faces from different domains undistinguishable, but not for the fake ones, thus forming a single-side adversarial learning. Moreover, an asymmetric triplet loss is designed to constrain the fake faces of different domains separated while the real ones aggregated. The above two points are integrated into a unified framework in an end-to-end training manner, resulting in a more generalized class boundary, especially good for samples from novel domains. Feature and weight normalization is incorporated to further improve the generalization ability. Extensive experiments show that our proposed approach is effective and outperforms the state-of-the-art methods on four public databases.


title: Signatures of an Atomic Crystal in the Band Structure of a Molecular Thin Film

abstract: Transport phenomena in molecular materials are intrinsically linked to the orbital character and the degree of localization of the valence states. Here, we combine angle-resolved photoemission with photoemission tomography to determine the spatial distribution of all molecular states of the valence band structure of a C$_{60}$ thin film. While the two most frontier valence states exhibit a strong band dispersion, the states at larger binding energies are characterized by distinct emission patterns in energy and momentum space. Our findings demonstrate the formation of an atomic crystal-like band structure in a molecular solid with delocalized $\pi$-like valence states and strongly localized $\sigma$-states at larger binding energies.


title: Toroidal b-divisors and Monge-Amp\`ere measures

abstract: We generalize the intersection theory of nef toric (Weil) b-divisors on smooth and complete toric varieties to the case of smooth and complete toroidal embeddings. As a key ingredient we show the existence of a limit measure, supported on the weakly embedded rational conical polyhedral space attached to the toroidal embedding, which arises as a limit of discrete measures defined via tropical intersection theory on the polyhedral space. We prove that the intersection theory of nef toroidal Cartier b-divisors can be extended continuously to nef toroidal Weil b-divisors and that their degree can be computed as an integral with respect to this limit measure. As an application, we show that a Hilbert--Samuel type formula holds for big and nef toroidal Weil b-divisors.


title: Reducing catastrophic forgetting with learning on synthetic data

abstract: Catastrophic forgetting is a problem caused by neural networks' inability to learn data in sequence. After learning two tasks in sequence, performance on the first one drops significantly. This is a serious disadvantage that prevents many deep learning applications to real-life problems where not all object classes are known beforehand; or change in data requires adjustments to the model. To reduce this problem we investigate the use of synthetic data, namely we answer a question: Is it possible to generate such data synthetically which learned in sequence does not result in catastrophic forgetting? We propose a method to generate such data in two-step optimisation process via meta-gradients. Our experimental results on Split-MNIST dataset show that training a model on such synthetic data in sequence does not result in catastrophic forgetting. We also show that our method of generating data is robust to different learning scenarios.


title: Frozen Patterns of Impacted Droplets: From Conical Tips to Toroidal Shapes

abstract: We report frozen patterns for the water droplets impacting on a cold substrate through fast-speed images. These patterns can be manipulated by several physical parameters (the droplet size, falling height, and substrate temperature), and the scaling analysis has a remarkable agreement with the phase diagram. The observed double-concentric toroidal shape is attributed to the correlation between the impacting dynamics and freezing process, as confirmed by the spatiotemporal evolution of the droplet temperature, the identified timescale associated with the morphology and solidification ($t_{inn}\simeq \tau_{sol}$), and the ice front-advection model. These results for frozen patterns provide insight into the complex interplay of the rapid impacting hydrodynamics, the transient heat transfer, and the intricate solidification process.


title: On Feedback Control in Kelly Betting: An Approximation Approach

abstract: In this paper, we consider a simple discrete-time optimal betting problem using the celebrated Kelly criterion, which calls for maximization of the expected logarithmic growth of wealth. While the classical Kelly betting problem can be solved via standard concave programming technique, an alternative but attractive approach is to invoke a Taylor-based approximation, which recasts the problem into quadratic programming and obtain the closed-form approximate solution. The focal point of this paper is to fill some voids in the existing results by providing some interesting properties when such an approximate solution is used. Specifically, the best achievable betting performance, positivity of expected cumulative gain or loss and its associated variance, expected growth property, variance of logarithmic growth, and results related to the so-called survivability (no bankruptcy) are provided.


title: Some snarks are worse than others

abstract: Many conjectures and open problems in graph theory can either be reduced to cubic graphs or are directly stated for cubic graphs. Furthermore, it is known that for a lot of problems, a counterexample must be a snark, i.e. a bridgeless cubic graph which is not 3--edge-colourable. In this paper we deal with the fact that the family of potential counterexamples to many interesting conjectures can be narrowed even further to the family ${\cal S}_{\geq 5}$ of bridgeless cubic graphs whose edge set cannot be covered with four perfect matchings. The Cycle Double Cover Conjecture, the Shortest Cycle Cover Conjecture and the Fan-Raspaud Conjecture are examples of statements for which ${\cal S}_{\geq 5}$ is crucial. In this paper, we study parameters which have the potential to further refine ${\cal S}_{\geq 5}$ and thus enlarge the set of cubic graphs for which the mentioned conjectures can be verified. We show that ${\cal S}_{\geq 5}$ can be naturally decomposed into subsets with increasing complexity, thereby producing a natural scale for proving these conjectures. More precisely, we consider the following parameters and questions: given a bridgeless cubic graph, (i) how many perfect matchings need to be added, (ii) how many copies of the same perfect matching need to be added, and (iii) how many 2--factors need to be added so that the resulting regular graph is Class I? We present new results for these parameters and we also establish some strong relations between these problems and some long-standing conjectures.