title: Renyi Differentially Private ADMM for Non-Smooth Regularized Optimization

abstract: In this paper we consider the problem of minimizing composite objective functions consisting of a convex differentiable loss function plus a non-smooth regularization term, such as $L_1$ norm or nuclear norm, under R\'enyi differential privacy (RDP). To solve the problem, we propose two stochastic alternating direction method of multipliers (ADMM) algorithms: ssADMM based on gradient perturbation and mpADMM based on output perturbation. Both algorithms decompose the original problem into sub-problems that have closed-form solutions. The first algorithm, ssADMM, applies the recent privacy amplification result for RDP to reduce the amount of noise to add. The second algorithm, mpADMM, numerically computes the sensitivity of ADMM variable updates and releases the updated parameter vector at the end of each epoch. We compare the performance of our algorithms with several baseline algorithms on both real and simulated datasets. Experimental results show that, in high privacy regimes (small $\epsilon$), ssADMM and mpADMM outperform other baseline algorithms in terms of classification and feature selection performance, respectively.


title: Self-boosted Time-series Forecasting with Multi-task and Multi-view Learning

abstract: A robust model for time series forecasting is highly important in many domains, including but not limited to financial forecast, air temperature and electricity consumption. To improve forecasting performance, traditional approaches usually require additional feature sets. However, adding more feature sets from different sources of data is not always feasible due to its accessibility limitation. In this paper, we propose a novel self-boosted mechanism in which the original time series is decomposed into multiple time series. These time series played the role of additional features in which the closely related time series group is used to feed into multi-task learning model, and the loosely related group is fed into multi-view learning part to utilize its complementary information. We use three real-world datasets to validate our model and show the superiority of our proposed method over existing state-of-the-art baseline methods.


title: Predicting Electricity Consumption using Deep Recurrent Neural Networks

abstract: Electricity consumption has increased exponentially during the past few decades. This increase is heavily burdening the electricity distributors. Therefore, predicting the future demand for electricity consumption will provide an upper hand to the electricity distributor. Predicting electricity consumption requires many parameters. The paper presents two approaches with one using a Recurrent Neural Network (RNN) and another one using a Long Short Term Memory (LSTM) network, which only considers the previous electricity consumption to predict the future electricity consumption. These models were tested on the publicly available London smart meter dataset. To assess the applicability of the RNN and the LSTM network to predict electricity consumption, they were tested to predict for an individual house and a block of houses for a given time period. The predictions were done for daily, trimester and 13 months, which covers short term, mid-term and long term prediction. Both the RNN and the LSTM network have achieved an average Root Mean Square error of 0.1.


title: A local-global theorem for $p$-adic supercongruences

abstract: Let ${\mathbb Z}_p$ denote the ring of all $p$-adic integers and call $${\mathcal U}=\{(x_1,\ldots,x_n):\,a_1x_1+\ldots+a_nx_n+b=0\}$$ a hyperplane over ${\mathbb Z}_p^n$, where at least one of $a_1,\ldots,a_n$ is not divisible by $p$. We prove that if a sufficiently regular $n$-variable function is zero modulo $p^r$ over some suitable collection of $r$ hyperplanes, then it is zero modulo $p^r$ over the whole ${\mathbb Z}_p^n$. We provide various applications of this general criterion by establishing several $p$-adic analogues of hypergeometric identities.


title: Transfer Learning with Dynamic Adversarial Adaptation Network

abstract: The recent advances in deep transfer learning reveal that adversarial learning can be embedded into deep networks to learn more transferable features to reduce the distribution discrepancy between two domains. Existing adversarial domain adaptation methods either learn a single domain discriminator to align the global source and target distributions or pay attention to align subdomains based on multiple discriminators. However, in real applications, the marginal (global) and conditional (local) distributions between domains are often contributing differently to the adaptation. There is currently no method to dynamically and quantitatively evaluate the relative importance of these two distributions for adversarial learning. In this paper, we propose a novel Dynamic Adversarial Adaptation Network (DAAN) to dynamically learn domain-invariant representations while quantitatively evaluate the relative importance of global and local domain distributions. To the best of our knowledge, DAAN is the first attempt to perform dynamic adversarial distribution adaptation for deep adversarial learning. DAAN is extremely easy to implement and train in real applications. We theoretically analyze the effectiveness of DAAN, and it can also be explained in an attention strategy. Extensive experiments demonstrate that DAAN achieves better classification accuracy compared to state-of-the-art deep and adversarial methods. Results also imply the necessity and effectiveness of the dynamic distribution adaptation in adversarial transfer learning.


title: Learned-SBL: A Deep Learning Architecture for Sparse Signal Recovery

abstract: In this paper, we present a computationally efficient sparse signal recovery scheme using Deep Neural Networks (DNN). The architecture of the introduced neural network is inspired from sparse Bayesian learning (SBL) and named as Learned-SBL (L-SBL). We design a common architecture to recover sparse as well as block sparse vectors from single measurement vector (SMV) or multiple measurement vectors (MMV) depending on the nature of the training data. In the MMV model, the L-SBL network can be trained to learn any underlying sparsity pattern among the vectors including joint sparsity, block sparsity, etc. In particular, for block sparse recovery, learned-SBL does not require any prior knowledge of block boundaries. In each layer of the L-SBL, an estimate of the signal covariance matrix is obtained as the output of a neural network. Then a maximum a posteriori (MAP) estimator of the unknown sparse vector is implemented with non-trainable parameters. In many applications, the measurement matrix may be time-varying. The existing DNN based sparse signal recovery schemes demand the retraining of the neural network using current measurement matrix. The architecture of L-SBL allows it to accept the measurement matrix as an input to the network, and thereby avoids the need for retraining. We also evaluate the performance of Learned-SBL in the detection of an extended target using a multiple-input multiple-output (MIMO) radar. Simulation results illustrate that the proposed approach offers superior sparse recovery performance compared to the state-of-the-art methods.


title: Dynamic Characterization of Arrows through Stochastic Perturbation

abstract: Current arrow spine measurements rely on statically hanging a known weight at the shaft center and measuring the maximum deflection. This archaic method of measuring arrow stiffness ignores dynamic nature of the arrow when released from the bow. For this project, we built an apparatus to measure the dynamic characteristics of the arrow to better indicate arrow performance. Using stochastic perturbations from a voice coil actuator and displacement measurements, we successfully estimated the natural frequency, damping parameter, and mechanical stiffness of carbon, wood, and aluminum arrows of varying spines. Parameter estimates using a second order parameterized model showed agreement with the manufacturer rated spine values. In addition, high cycle fatigue testing was completed on each arrow material but showed no significant changes in arrow parameters.


title: Learning to Generate Questions with Adaptive Copying Neural Networks

abstract: Automatic question generation is an important problem in natural language processing. In this paper we propose a novel adaptive copying recurrent neural network model to tackle the problem of question generation from sentences and paragraphs. The proposed model adds a copying mechanism component onto a bidirectional LSTM architecture to generate more suitable questions adaptively from the input data. Our experimental results show the proposed model can outperform the state-of-the-art question generation methods in terms of BLEU and ROUGE evaluation scores.


title: Fiber Nonlinearity Mitigation via the Parzen Window Classifier for Dispersion Managed and Unmanaged Links

abstract: Machine learning techniques have recently received significant attention as promising approaches to deal with the optical channel impairments, and in particular, the nonlinear effects. In this work, a machine learning-based classification technique, known as the Parzen window (PW) classifier, is applied to mitigate the nonlinear effects in the optical channel. The PW classifier is used as a detector with improved nonlinear decision boundaries more adapted to the nonlinear fiber channel. Performance improvement is observed when applying the PW in the context of dispersion managed and dispersion unmanaged systems.


title: Two Computational Models for Analyzing Political Attention in Social Media

abstract: Understanding how political attention is divided and over what subjects is crucial for research on areas such as agenda setting, framing, and political rhetoric. Existing methods for measuring attention, such as manual labeling according to established codebooks, are expensive and can be restrictive. We describe two computational models that automatically distinguish topics in politicians' social media content. Our models---one supervised classifier and one unsupervised topic model---provide different benefits. The supervised classifier reduces the labor required to classify content according to pre-determined topic list. However, tweets do more than communicate policy positions. Our unsupervised model uncovers both political topics and other Twitter uses (e.g., constituent service). These models are effective, inexpensive computational tools for political communication and social media research. We demonstrate their utility and discuss the different analyses they afford by applying both models to the tweets posted by members of the 115th U.S. Congress.


title: PixelHop: A Successive Subspace Learning (SSL) Method for Object Classification

abstract: A new machine learning methodology, called successive subspace learning (SSL), is introduced in this work. SSL contains four key ingredients: 1) successive near-to-far neighborhood expansion; 2) unsupervised dimension reduction via subspace approximation; 3) supervised dimension reduction via label-assisted regression (LAG); and 4) feature concatenation and decision making. An image-based object classification method, called PixelHop, is proposed to illustrate the SSL design. It is shown by experimental results that the PixelHop method outperforms the classic CNN model of similar model complexity in three benchmarking datasets (MNIST, Fashion MNIST and CIFAR-10). Although SSL and deep learning (DL) have some high-level concept in common, they are fundamentally different in model formulation, the training process and training complexity. Extensive discussion on the comparison of SSL and DL is made to provide further insights into the potential of SSL.


title: Exploring Scholarly Data by Semantic Query on Knowledge Graph Embedding Space

abstract: The trends of open science have enabled several open scholarly datasets which include millions of papers and authors. Managing, exploring, and utilizing such large and complicated datasets effectively are challenging. In recent years, the knowledge graph has emerged as a universal data format for representing knowledge about heterogeneous entities and their relationships. The knowledge graph can be modeled by knowledge graph embedding methods, which represent entities and relations as embedding vectors in semantic space, then model the interactions between these embedding vectors. However, the semantic structures in the knowledge graph embedding space are not well-studied, thus knowledge graph embedding methods are usually only used for knowledge graph completion but not data representation and analysis. In this paper, we propose to analyze these semantic structures based on the well-studied word embedding space and use them to support data exploration. We also define the semantic queries, which are algebraic operations between the embedding vectors in the knowledge graph embedding space, to solve queries such as similarity and analogy between the entities on the original datasets. We then design a general framework for data exploration by semantic queries and discuss the solution to some traditional scholarly data exploration tasks. We also propose some new interesting tasks that can be solved based on the uncanny semantic structures of the embedding space.


title: Scattering-Induced Disk Polarization By Millimeter-Sized Grains

abstract: Spatially resolved (sub)millimeter polarization has been detected by ALMA in an increasing number of disks around young stellar objects. The majority of the observations show polarization patterns that are consistent with self-scattering, especially at ALMA Band 7. The inferred sizes of the grains are typically of order 100 microns, which is very different from the millimeter size commonly inferred from the dust opacity index beta. In an effort to resolve this discrepancy, we first introduced the so-called "Coplanar Isotropic Radiation Field" approximation, which enables the computation of the (signed) polarization fraction analytically. With an oft-adopted dust composition (used, e.g., by DSHARP), we find that models with big dust grains produce very small polarization with reversed orientation, which hasn't been observed. The semi-analytic results are validated through Monte Carlo radiative transfer simulations. In these models, the "correct" polarization orientation and the small beta index are mutually exclusive. To resolve this tension, we explore a wide range of dust models, parameterized by their complex refractive index. We find that both the fraction of the polarization and whether it is reversed or not depend on the refractive index in a complex way, and this dependence is mapped out on an n-k plane for a representative dust size distribution (MRN with amax=3mm) and wavelength of 870 microns. In particular, refractory organics dust grains produce reversed polarization, whereas grains of the same size but made of absorptive carbonaceous materials can produce a percent-level polarization that is not reversed; the latter may alleviate the tension between the grain sizes inferred from the scattering-induced polarization and the opacity index beta. We conclude that scattering-induced polarization has the potential to probe not only the sizes of the grains but also their composition.


title: Extensions of the Shannon Entropy and the Chaos Game Algorithm to Hyperbolic Numbers Plane

abstract: In this paper we provide extensions to hyperbolic numbers plane of the classical Chaos game algorithm and the Shannon entropy. Both notions connected with that of probability with values in hyperbolic number, introduced by D. Alpay et al \cite{eluna}. Within this context, particular attention has been paid to the interpretation of the hyperbolic valued probabilities and the hyperbolic extension of entropy as well.


title: A multipartite generalization of quantum discord

abstract: A generalization of quantum discord to multipartite systems is proposed. A key feature of our formulation is its consistency with the conventional definition of discord in bipartite systems. It is by construction zero only for systems with classically correlated subsystems and is a non-negative quantity, giving a measure of the total non-classical correlations in the multipartite system with respect to a fixed measurement ordering. For the tripartite case, we show that the discord can be decomposed into contributions resulting from changes induced by non-classical correlation breaking measurements in the conditional mutual information and tripartite mutual information. The former gives a measure of the bipartite non-classical correlations and is a non-negative quantity, while the latter is related to the monogamy of the non-classical correlations.


title: On Periodic Decompositions, One-sided Nonexpansive Directions and Nivat's Conjecture

abstract: Nivat's conjecture is a famous open problem in symbolic dynamics. The existence of nonexpansive lines that when endowed with a given orientation are one-sided nonexpansive directions is at the heart of some advances. In his Ph.D. thesis, Michal Szabados conjectured that for a minimal periodic decomposition the nonexpansive lines are exactly the lines that contain a period of some periodic configuration in such decomposition. In this paper, we provide conditions where (i) Szabados's conjecture holds and (ii) a given line is nonexpansive if and only if the same line endowed with a given orientation is a one-sided nonexpansive direction. As a corollary of our main result, we get that Nivat's conjecture holds for low convex complexity configurations if and only if it holds for low convex complexity configurations satisfying (i) and (ii).


title: Graded composition Cd$_x$Zn$_{1-x}$Te films grown by Isothermal Close Space Sublimation technique

abstract: Graded composition CdxZn1-xTe films were prepared by growing several alternate layers of CdTe and ZnTe by the Isothermal Close Space Sublimation technique. The thickness of both kinds of layers was modified along the structure to produce an increase of the average concentration of CdTe towards the surface of the films. Due to Zn/Cd inter-diffusion during the growth process the sequence of layers was converted into a relatively smooth graded composition film. According to X- ray diffraction characterization the layers grew coherently with the (100) oriented GaAs substrates although they showed a relatively high mosaicity. Theta-2theta plots show very wide diffraction peaks as expected from variable composition samples. The band gap grading effect in light absorption was also verified through transmission measurements, using transparent substrates. Graded composition profiles of the thin films were confirmed by x-ray photoelectron and secondary ion mass spectroscopies. Moreover, quantitative Cd, Zn and Te profiles were obtained by the analysis of Rutherford backscattering spectra of the samples. This analysis showed a CdTe molar fraction profile ranging from approximately x = 0.8 at the surface of the sample and x = 0.35 at the interface with the substrate. The possibility of growing graded composition layers using a simple and cost-effective procedure was demonstrated. This could be interesting in technological applications like CdxZn1-xTe layers of variable composition in CdS/CdTe solar cells


title: The DireXeno Experiment -- Measuring Correlated Scintillation Signatures in Liquid Xenon

abstract: We present a detector apparatus, DireXeno (DIRectinal Xenon), designed to measure the spatial and temporal properties of scintillation in liquid xenon to very high accuracy. The properties of scintillation are of primary importance for dark matter and neutrinoless double beta decay experiments, however the complicated microphysics involved limits theoretical predictions. We will explore the possibility that scintillation emission exhibits correlation in light emission such as super-radiance, which depends on the type of interaction. Such properties of scintillation light may open a new window for background rejection as well as directionality measurements. We present the technical design and the concepts driving it, and demonstrate that statistical treatment will enable detecting anisotropy of as little as 10% of the photons. We show results from commissioning runs in which the detector operated for over 44 days in stable conditions. The time resolution for individual photons in different PMTs was measured to be $\lesssim1.3$ ns FWHM, corresponding to $\lesssim0.55$ ns (1 $\sigma$).


title: Chemically driven isothermal closed space vapor transport of MoO$_2$: thin films, flakes and in-situ tellurization

abstract: A novel procedure, based in a closed space vapor transport (CSVT) configuration, has been devised to grow films or flakes of pure MoO2 in a reductive atmosphere, at relatively low temperature and using MoO3 as the source. In contrast with conventional CSVT technique, in the proposed method a temperature gradient is not required for the growth to take place, which occurs through an intermediate volatile transport species that is produced in the complex reduction reaction of MoO3. An added value of this simple method is the possibility of transforming the MoO2 into MoTe2, one of the most interesting members of the transition metal dichalcogenide family. This is achieved in a sequential process that includes the growth of Mo oxide and its (in-situ) tellurization in two consecutive steps.


title: LQ Stars : Modifying the Tolman -- Oppenheimer -- Volkoff equations a la LQC

abstract: We rewrite the Tolman -- Oppenheimer -- Volkoff (TOV) equations for four and higher dimensional static spherically symmetric stars so that they resemble the equations for anisotropic cosmology. This becomes possible by treating the curvature terms of the sphere as part of the matter sector. Comparing then with the effective equations in the Loop Quantum Cosmology -- inspired models, we propose analogous modifications to the TOV equations which contain one arbitrary function. A linear function gives the TOV equations. If the function and all its derivatives are finite then the solutions are non singular. For $sin \; x \;$, an `image star' appears beyond the central region of maximal pressures in the original star. This is evocative of a bouncing universe in Loop Quantum Cosmology. We discuss possible observational consequences of these features.


title: Vision-based Multi-MAV Localization with Anonymous Relative Measurements Using Coupled Probabilistic Data Association Filter

abstract: We address the localization of robots in a multi-MAV system where external infrastructure like GPS or motion capture systems may not be available. Our approach lends itself to implementation on platforms with several constraints on size, weight, and power (SWaP). Particularly, our framework fuses the onboard VIO with the anonymous, visual-based robot-to-robot detection to estimate all robot poses in one common frame, addressing three main challenges: 1) the initial configuration of the robot team is unknown, 2) the data association between each vision-based detection and robot targets is unknown, and 3) the vision-based detection yields false negatives, false positives, inaccurate, and provides noisy bearing, distance measurements of other robots. Our approach extends the Coupled Probabilistic Data Association Filter (CPDAF)[1] to cope with nonlinear measurements. We demonstrate the superior performance of our approach over a simple VIO-based method in a simulation with the measurement models statistically modeled using the real experimental data. We also show how onboard sensing, estimation, and control can be used for formation flight.


title: Derived length of zero entropy groups acting on projective varieties in arbitrary characteristic -- A remark to a paper of Dinh-Oguiso-Zhang

abstract: Let $X$ be a projective variety of dimension $n\ge1$ over an algebraically closed field of arbitrary characteristic. We prove a Fujiki-Lieberman type theorem on the structure of the automorphism group of $X$. Let $G$ be a group of zero entropy automorphisms of $X$ and $G_0$ the set of elements in $G$ which are isotopic to the identity. We show that after replacing $G$ by a suitable finite-index subgroup, $G/G_0$ is a unipotent group of the derived length at most $n-1$. This result was first proved by Dinh, Oguiso and Zhang for compact K\"ahler manifolds.


title: Rapid and efficient mass collection by a supersonic cloud-cloud collision as a major mechanism of high-mass star formation

abstract: A supersonic cloud-cloud collision produces a shock-compressed layer which leads to formation of high-mass stars via gravitational instability. We carried out a detailed analysis of the layer by using the numerical simulations of magneto-hydrodynamics which deal with colliding molecular flows at a relative velocity of 20 km s$^{-1}$ (Inoue & Fukui 2013). Maximum density in the layer increases from 1000 cm$^{-3}$ to more than $10^{5}$ cm$^{-3}$ within 0.3 Myrs by compression, and the turbulence and the magnetic field in the layer are amplified by a factor of $\sim 5$, increasing the mass accretion rate by two orders of magnitude to more than $10^{-4}$ $M_{\odot}$ yr$^{-1}$. The layer becomes highly filamentary due to gas flows along the magnetic field lines, and dense cores are formed in the filaments. The massive dense cores have size and mass of 0.03 -- 0.8 pc and 8 -- 50 $M_{\odot}$ and they are usually gravitationally unstable. The mass function of the dense cores is significantly top-heavy as compared with the universal IMF, indicating that the cloud-cloud collision triggers preferentially the formation of O and early B stars. We argue that the cloud-cloud collision is a versatile mechanism which creates a variety of stellar clusters from a single O star like RCW120 and M20 to tens of O stars of a super star cluster like RCW38 and a mini-starburst W43. The core mass function predicted by the present model is consistent with the massive dense cores obtained by recent ALMA observations in RCW38 (Torii et al. 2019) and W43 (Motte et al. 2018) considering the increasing evidence for collision-triggered high-mass star formation, we argue that cloud-cloud collision is a major mechanism of high mass star formation.


title: Dual Adversarial Co-Learning for Multi-Domain Text Classification

abstract: In this paper we propose a novel dual adversarial co-learning approach for multi-domain text classification (MDTC). The approach learns shared-private networks for feature extraction and deploys dual adversarial regularizations to align features across different domains and between labeled and unlabeled data simultaneously under a discrepancy based co-learning framework, aiming to improve the classifiers' generalization capacity with the learned features. We conduct experiments on multi-domain sentiment classification datasets. The results show the proposed approach achieves the state-of-the-art MDTC performance.


title: Chandra survey of nearby highly inclined disk galaxies -- V: emission structure and origin of galactic coronae

abstract: The origin of the extended soft X-ray emission around nearby highly inclined disk galaxies (often called as X-ray corona) remains uncertain. The emission could arise from volume-filling hot gas and/or its interaction with cool gas. Morphological properties of the X-ray emission can provide additional information to distinguish these different origins. We define model-independent parameters H50, H75, and H95 - vertical scales that enclose 50%, 75%, and 95% of the total flux of the emission, respectively. We study the correlation of these parameters with galaxy properties inferred from infrared observations of a sample of nearby highly inclined disk galaxies with high-quality Chandra data. We find weak negative correlations between H50or H75and the surface star formation rate (ISFR) and no correlation for H95. However, we detect strong, negative correlations of the vertical concentration of the emission, defined as H50/H95 or H75/H95, with ISFR. Our findings suggest that the X-ray emission around disk galaxies is likely comprised of two components: the extended, weak emission, characterized by H95, is influenced by the outflowing hot gas entrained in star formation driven winds, whereas the strong emission close to the disk which is often rich in cool gas characterized by H50 or H75, is largely impacted by cool-hot gas interaction.


title: Adaptive Graphical Model Network for 2D Handpose Estimation

abstract: In this paper, we propose a new architecture called Adaptive Graphical Model Network (AGMN) to tackle the task of 2D hand pose estimation from a monocular RGB image. The AGMN consists of two branches of deep convolutional neural networks for calculating unary and pairwise potential functions, followed by a graphical model inference module for integrating unary and pairwise potentials. Unlike existing architectures proposed to combine DCNNs with graphical models, our AGMN is novel in that the parameters of its graphical model are conditioned on and fully adaptive to individual input images. Experiments show that our approach outperforms the state-of-the-art method used in 2D hand keypoints estimation by a notable margin on two public datasets. Code can be found at https://github.com/deyingk/agmn.


title: The Generalized Bregman Distance

abstract: Recently, a new distance has been introduced for the graphs of two point-to-set operators, one of which is maximally monotone. When both operators are the subdifferential of a proper lower semicontinuous convex function, this distance specializes under modest assumptions to the classical Bregman distance. We name this new distance the generalized Bregman distance, and we shed light on it with examples that utilize the other two most natural representative functions: the Fitzpatrick function and its conjugate. We provide sufficient conditions for convexity, coercivity, and supercoercivity: properties that are essential for implementation in proximal point type algorithms. We establish these results for both the left and right variants of this new distance. We construct examples closely related to the Kullback--Leibler divergence, which was previously considered in the context of Bregman distances, and whose importance in information theory is well known. In so doing, we demonstrate how to compute a difficult Fitzpatrick conjugate function, and we discover natural occurrences of the Lambert $\W$ function, whose importance in optimization is of growing interest.


title: Comment on "An improved upper limit on the neutrino mass from a direct kinematic method by KATRIN"

abstract: We note that the central value of the KATRIN measurement has negative mass squared, and wonder why the statistical analysis excludes such values a priori.


title: An axiomatic measure of one-way quantum information

abstract: I introduce an algorithm to detect one-way quantum information between two interacting quantum systems, i.e. the direction and orientation of the information transfer in arbitrary quantum dynamics. I then build an information-theoretic quantifier of one-way information which satisfies a set of desirable axioms. In particular, it correctly evaluates whether correlation implies one-way quantum information, and when the latter is transferred between uncorrelated systems. In the classical scenario, the quantity measures information transfer between random variables. I also generalize the method to identify and rank concurrent sources of quantum information flow in many-body dynamics, enabling to reconstruct causal patterns in complex networks.


title: On a conjecture about a class of permutation quadrinomials

abstract: Very recently, Tu et al. presented a sufficient condition about $(a_1,a_2,a_3)$, see Theorem 1.1, such that $f(x) = x^{3\cdot 2^m} + a_1 x^{2^{m+1}+1}+ a_2 x^{2^m+2} + a_3 x^3$ is a class of permutation polynomials over $\gf_{2^{n}}$ with $n=2m$ and $m$ odd. In this present paper, we prove that the sufficient condition is also necessary.


title: Data Mapping and Finite Difference Learning

abstract: Restricted Boltzmann machine (RBM) is a two-layer neural network constructed as a probabilistic model and its training is to maximize a product of probabilities by the contrastive divergence (CD) scheme. In this paper a data mapping is proposed to describe the relationship between the visible and hidden layers and the training is to minimize a squared error on the visible layer by a finite difference learning. This paper presents three new properties in using the RBM: 1) nodes on the visible and hidden layers can take real-valued matrix data without a probabilistic interpretation; 2) the famous CD1 is a finite difference approximation of the gradient descent; 3) the activation can take non-sigmoid functions such as identity, relu and softsign. The data mapping provides a unified framework on the dimensionality reduction, the feature extraction and the data representation pioneered and developed by Hinton and his colleagues. As an approximation of the gradient descent, the finite difference learning is applicable to both directed and undirected graphs. Numerical experiments are performed to verify these new properties on the very low dimensionality reduction, the collinearity of timer series data and the use of flexible activations.


title: Modeling Conversation Structure and Temporal Dynamics for Jointly Predicting Rumor Stance and Veracity

abstract: Automatically verifying rumorous information has become an important and challenging task in natural language processing and social media analytics. Previous studies reveal that people's stances towards rumorous messages can provide indicative clues for identifying the veracity of rumors, and thus determining the stances of public reactions is a crucial preceding step for rumor veracity prediction. In this paper, we propose a hierarchical multi-task learning framework for jointly predicting rumor stance and veracity on Twitter, which consists of two components. The bottom component of our framework classifies the stances of tweets in a conversation discussing a rumor via modeling the structural property based on a novel graph convolutional network. The top component predicts the rumor veracity by exploiting the temporal dynamics of stance evolution. Experimental results on two benchmark datasets show that our method outperforms previous methods in both rumor stance classification and veracity prediction.


title: Symmetry and its breaking in path integral approach to quantum Brownian motion

abstract: We study the Caldeira-Leggett model where a quantum Brownian particle interacts with an environment or a bath consisting of a collection of harmonic oscillators in the path integral formalism. Compared to the contours that the paths take in the conventional Schwinger-Keldysh formalism, the paths in our study are deformed in the complex time plane as suggested by the recent study [C. Aron, G. Biroli and L. F. Cugliandolo, SciPost Phys.\ {\bf 4}, 008 (2018)]. This is done to investigate the connection between the symmetry properties in the Schwinger-Keldysh action and the equilibrium or non-equilibrium nature of the dynamics in an open quantum system. We derive the influence functional explicitly in this setting, which captures the effect of the coupling to the bath. We show that in equilibrium the action and the influence functional are invariant under a set of transformations of path integral variables. The fluctuation-dissipation relation is obtained as a consequence of this symmetry. When the system is driven by an external time-dependent protocol, the symmetry is broken. From the terms that break the symmetry, we derive a quantum Jarzynski-like equality for quantum mechanical work given as a function of fluctuating quantum trajectory. In the classical limit, the transformations becomes those used in the functional integral formalism of the classical stochastic thermodynamics to derive the classical fluctuation theorem.


title: Sample-specific repetitive learning for photo aesthetic assessment and highlight region extraction

abstract: Aesthetic assessment is subjective, and the distribution of the aesthetic levels is imbalanced. In order to realize the auto-assessment of photo aesthetics, we focus on retraining the CNN-based aesthetic assessment model by dropping out the unavailable samples in the middle levels from the training data set repetitively to overcome the effect of imbalanced aesthetic data on classification. Further, the method of extracting aesthetics highlight region of the photo image by using the two repetitively trained models is presented. Therefore, the correlation of the extracted region with the aesthetic levels is analyzed to illustrate what aesthetics features influence the aesthetic quality of the photo. Moreover, the testing data set is from the different data source called 500px. Experimental results show that the proposed method is effective.


title: Disentangling the effects of doping, strain and defects in monolayer WS2 by optical spectroscopy

abstract: Monolayers of transition metal dichalcogenides (TMdC) are promising candidates for realization of a new generation of optoelectronic devices. The optical properties of these two-dimensional materials, however, vary from flake to flake, or even across individual flakes, and change over time, all of which makes control of the optoelectronic properties challenging. There are many different perturbations that can alter the optical properties, including charge doping, defects, strain, oxidation, and water intercalation. Identifying which perturbations are present is usually not straightforward and requires multiple measurements using multiple experimental modalities, which presents barriers when attempting to optimise preparation of these materials. Here, we apply highresolution photoluminescence and differential reflectance hyperspectral imaging in situ to CVD-grown WS2 monolayers. By combining these two optical measurements and using a statistical correlation analysis we are able to disentangle three contributions modulating optoelectronic properties of these materials: electron doping, strain and defects. In separating these contributions, we also observe that the B-exciton energy is less sensitive to variations in doping density than A-excitons.


title: Computational multiscale methods for first-order wave equation using mixed CEM-GMsFEM

abstract: In this paper, we consider a pressure-velocity formulation of the heterogeneous wave equation and employ the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) to solve this problem. The proposed method provides a flexible framework to construct crucial multiscale basis functions for approximating the pressure and velocity. These basis functions are constructed by solving a class of local auxiliary optimization problems over the eigenspaces that contain local information on the heterogeneity. Techniques of oversampling are adapted to enhance the computational performance. The first-order convergence of the proposed method is proved and illustrated by several numerical tests.


title: CrackGAN: Pavement Crack Detection Using Partially Accurate Ground Truths Based on Generative Adversarial Learning

abstract: Fully convolutional network is a powerful tool for per-pixel semantic segmentation/detection. However, it is problematic when coping with crack detection using partially accurate ground truths (GTs): the network may easily converge to the status that treats all the pixels as background (BG) and still achieves a very good loss, named "All Black" phenomenon, due to the unavailability of accurate GTs and the data imbalance. To tackle this problem, we propose crack-patch-only (CPO) supervised generative adversarial learning for end-to-end training, which forces the network to always produce crack-GT images while reserves both crack and BG-image translation abilities by feeding a larger-size crack image into an asymmetric U-shape generator to overcome the "All Black" issue. The proposed approach is validated using four crack datasets; and achieves state-of-the-art performance comparing with that of the recently published works in efficiency and accuracy.


title: Improving Natural Language Inference with a Pretrained Parser

abstract: We introduce a novel approach to incorporate syntax into natural language inference (NLI) models. Our method uses contextual token-level vector representations from a pretrained dependency parser. Like other contextual embedders, our method is broadly applicable to any neural model. We experiment with four strong NLI models (decomposable attention model, ESIM, BERT, and MT-DNN), and show consistent benefit to accuracy across three NLI benchmarks.


title: Towards a model independent extraction of the Boer-Mulders function

abstract: At present, the Boer-Mulders function for a given quark flavour has been extracted from data on semi-inclusive deep inelastic scattering using the simplifying, but theoretically inconsistent, assumption that it is proportional to the Sivers function for each quark flavour. In this paper, using the latest semi-inclusive deep inelastic COMPASS deuteron data on the $\langle\cos\phi_h\rangle$ and $\langle\cos 2 \phi_h\rangle$ asymmetries we extract the collinear $x_B$-dependence of the Boer-Mulders function for the sum of the valence quarks $Q_V=u_V + d_V$ in an essentially model independent way, and find a significant disagreement with the published results. Our analysis also yields interesting information on the transverse momentum dependence of the unpolarized quark distribution and fragmentation functions.


title: Performance of Recommender Systems: Based on Content Navigator and Collaborative Filtering

abstract: In the world of big data, many people find it difficult to access the information they need quickly and accurately. In order to overcome this, research on the system that recommends information accurately to users is continuously conducted. Collaborative Filtering is one of the famous algorithms among the most used in the industry. However, collaborative filtering is difficult to use in online systems because user recommendation is highly volatile in recommendation quality and requires computation using large matrices. To overcome this problem, this paper proposes a method similar to database queries and a clustering method (Contents Navigator) originating from a complex network.


title: A Signal Separation Method for Exceeding the Channel Capacity of BPSK Input

abstract: The field of the coded modulations witnessed its golden era as the simulated achievable bit rates (ABRs) were getting close to the channel capacities of the finite alphabet inputs. However, when working at a single channel, the previous researches are mostly restricted in scope of single input and single output. In contrast, for achieving higher spectral efficiency, the present authors propose a method that builds upon the parallel transmission of two signals that are separated at the receiver. The signal separation is enabled by, so called, the double mapping modulation working through Hamming- to Euclidean space. Consequently, the ABR summation of the two signals is found higher the channel capacity of BPSK input. Both the theoretical- and simulation result confirm this approach.


title: Quasiregular curves

abstract: We extend the notion of a pseudoholomorphic vector of Iwaniec, Verchota, and Vogel to mappings between Riemannian manifolds. Since this class of mappings contains both quasiregular mappings and (pseudo)holomorphic curves, we call them quasiregular curves. Let $n\le m$ and let $M$ be an oriented Riemannian $n$-manifold, $N$ a Riemannian $m$-manifold, and $\omega \in \Omega^n(N)$ a smooth closed non-vanishing $n$-form on $N$. A continuous Sobolev map $f\colon M \to N$ in $W^{1,n}_{\mathrm{loc}}(M,N)$ is a $K$-quasiregular $\omega$-curve for $K\ge 1$ if $f$ satisfies the distortion inequality $(\lVert\omega\rVert\circ f)\lVert Df\rVert^n \le K (\star f^* \omega)$ almost everywhere in $M$. We prove that quasiregular curves satisfy Gromov's quasiminimality condition and a version of Liouville's theorem stating that bounded quasiregular curves $\mathbb R^n \to \mathbb R^m$ are constant. We also prove a limit theorem that a locally uniform limit $f\colon M \to N$ of $K$-quasiregular $\omega$-curves $(f_j \colon M\to N)$ is also a $K$-quasiregular $\omega$-curve. We also show that a non-constant quasiregular $\omega$-curve $f\colon M \to N$ is discrete and satisfies $\star f^*\omega >0$ almost everywhere, if one of the following additional conditions hold: the form $\omega$ is simple or the map $f$ is $C^1$-smooth.


title: An operational test for existence of a consistent increasing quasi-concave value function

abstract: Existence of an increasing quasi-concave value function consistent with given preference information is an important issue in various fields including Economics, Multiple Criteria Decision Making, and Applied Mathematics. In this paper, we establish necessary and sufficient conditions for existence of a value function satisfying aforementioned properties. This leads to an operational, tractable and easy to use test for checking the existence of a desirable value function. In addition to developing the existence test, we construct consistent linear and non-linear desirable value functions.


title: Diversified Arbitrary Style Transfer via Deep Feature Perturbation

abstract: Image style transfer is an underdetermined problem, where a large number of solutions can satisfy the same constraint (the content and style). Although there have been some efforts to improve the diversity of style transfer by introducing an alternative diversity loss, they have restricted generalization, limited diversity and poor scalability. In this paper, we tackle these limitations and propose a simple yet effective method for diversified arbitrary style transfer. The key idea of our method is an operation called deep feature perturbation (DFP), which uses an orthogonal random noise matrix to perturb the deep image feature maps while keeping the original style information unchanged. Our DFP operation can be easily integrated into many existing WCT (whitening and coloring transform)-based methods, and empower them to generate diverse results for arbitrary styles. Experimental results demonstrate that this learning-free and universal method can greatly increase the diversity while maintaining the quality of stylization.


title: The Variant-Rule, Another Logically Universal Rule

abstract: The Variant-rule derives from the Precursor-rule by interchanging two classes of its 28 isotropic mappings. Although this small mutation conserves most glider types and stable blocks, glider-gun engines are changed, as are most large scale pattern behaviors, illustrating both the robustness and fragility of evolution. We demonstrate these newly discovered structures and dynamics, and utilising two different glider types, build the logical gates required for universality in the logical sence.


title: Symmetry breaking and entropy production during the evolution of spinor Bose-Einstein condensate driven by coherent atom beam

abstract: The spinor condensate with spin states degenerated in the ground spin-space provides a unique platform for investigating the edge of quantum mechanics and statistical physics. We study the evolution of the condensate under the scattering of a coherent atom beam. The time-dependent magnetization, entanglement entropy, thermal entropy and the entropy production rate are calculated. A novel spontaneous symmetry breaking is found during the evolution, It is shown that the stationary spin distribution can be controlled by the incoming coherent spin state of the incident atom beam, therefore the atom-condensate scattering provides a new way to probe the spin distribution of the condensate


title: Eigenvalues of two-state quantum walks induced by the Hadamard walk

abstract: Existence of the eigenvalues of the discrete-time quantum walks is deeply related to localization of the walks. We revealed the distributions of the eigenvalues given by the splitted generating function method (the SGF method) of the quantum walks we had treated in our previous studies. In particular, we focused on two kinds of the Hadamard walk with one defect models and the two-phase QWs that have phases at the non-diagonal elements of the unitary transition operators. As a result, we clarified the characteristic parameter dependence for the distributions of the eigenvalues with the aid of numerical simulation.


title: Deep UV plasmonic enhancement of single protein autofluorescence in zero-mode waveguides

abstract: Single molecule detection provides detailed information about molecular structures and functions, but it generally requires the presence of a fluorescent marker which can interfere with the activity of the target molecule or complicate the sample production. Detecting a single protein with its natural UV autofluorescence is an attractive approach to avoid all the issues related to fluorescence labelling. However, the UV autofluorescence signal from a single protein is generally extremely weak. Here, we use aluminum plasmonics to enhance the tryptophan autofluorescence emission of single proteins in the UV range. Zero-mode waveguides nanoapertures enable observing the UV fluorescence of single label-free beta-galactosidase proteins with increased brightness, microsecond transit times and operation at micromolar concentrations. We demonstrate quantitative measurements of the local concentration, diffusion coefficient and hydrodynamic radius of the label-free protein over a broad range of zero-mode waveguide diameters. While the plasmonic fluorescence enhancement has generated a tremendous interest in the visible and near-infrared parts of the spectrum, this work pushes further the limits of plasmonic-enhanced single molecule detection into the UV range and constitutes a major step forward in our ability to interrogate single proteins in their native state at physiological concentrations.


title: Memory-Efficient Hierarchical Neural Architecture Search for Image Denoising

abstract: Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards employing NAS to automatically design effective neural network architectures for image denoising. HiNAS adopts gradient based search strategies and employs operations with adaptive receptive field to build an flexible hierarchical search space. During the search stage, HiNAS shares cells across different feature levels to save memory and employ an early stopping strategy to avoid the collapse issue in NAS, and considerably accelerate the search speed. The proposed HiNAS is both memory and computation efficient, which takes only about 4.5 hours for searching using a single GPU. We evaluate the effectiveness of our proposed HiNAS on two different datasets, namely an additive white Gaussian noise dataset BSD500, and a realistic noise dataset SIM1800. Experimental results show that the architecture found by HiNAS has fewer parameters and enjoys a faster inference speed, while achieving highly competitive performance compared with state-of-the-art methods. We also present analysis on the architectures found by NAS. HiNAS also shows good performance on experiments for image de-raining.


title: Pre-trained Language Model for Biomedical Question Answering

abstract: The recent success of question answering systems is largely attributed to pre-trained language models. However, as language models are mostly pre-trained on general domain corpora such as Wikipedia, they often have difficulty in understanding biomedical questions. In this paper, we investigate the performance of BioBERT, a pre-trained biomedical language model, in answering biomedical questions including factoid, list, and yes/no type questions. BioBERT uses almost the same structure across various question types and achieved the best performance in the 7th BioASQ Challenge (Task 7b, Phase B). BioBERT pre-trained on SQuAD or SQuAD 2.0 easily outperformed previous state-of-the-art models. BioBERT obtains the best performance when it uses the appropriate pre-/post-processing strategies for questions, passages, and answers.


title: Prolog Coding Guidelines: Status and Tool Support

abstract: The importance of coding guidelines is generally accepted throughout developers of every programming language. Naturally, Prolog makes no exception. However, establishing coding guidelines is fraught with obstacles: Finding common ground on kind and selection of rules is matter of debate; once found, adhering to or enforcing rules is complicated as well, not least because of Prolog's flexible syntax without keywords. In this paper, we evaluate the status of coding guidelines in the Prolog community and discuss to what extent they can be automatically verified. We implemented a linter for Prolog and applied it to several packages to get a hold on the current state of the community.


title: Exploiting Partial Knowledge in Declarative Domain-Specific Heuristics for ASP

abstract: Domain-specific heuristics are an important technique for solving combinatorial problems efficiently. We propose a novel semantics for declarative specifications of domain-specific heuristics in Answer Set Programming (ASP). Decision procedures that are based on a partial solution are a frequent ingredient of existing domain-specific heuristics, e.g., for placing an item that has not been placed yet in bin packing. Therefore, in our novel semantics negation as failure and aggregates in heuristic conditions are evaluated on a partial solver state. State-of-the-art solvers do not allow such a declarative specification. Our implementation in the lazy-grounding ASP system Alpha supports heuristic directives under this semantics. By that, we also provide the first implementation for incorporating declaratively specified domain-specific heuristics in a lazy-grounding setting. Experiments confirm that the combination of ASP solving with lazy grounding and our novel heuristics can be a vital ingredient for solving industrial-size problems.


title: A Three-Valued Semantics for Typed Logic Programming

abstract: Types in logic programming have focused on conservative approximations of program semantics by regular types, on one hand, and on type systems based on a prescriptive semantics defined for typed programs, on the other. In this paper, we define a new semantics for logic programming, where programs evaluate to true, false, and to a new semantic value called wrong, corresponding to a run-time type error. We then have a type language with a separated semantics of types. Finally, we define a type system for logic programming and prove that it is semantically sound with respect to a semantic relation between programs and types where, if a program has a type, then its semantics is not wrong. Our work follows Milner's approach for typed functional languages where the semantics of programs is independent from the semantic of types, and the type system is proved to be sound with respect to a relation between both semantics.


title: Epistemic Logic Programs: A Different World View

abstract: Epistemic Logic Programs (ELPs), an extension of Answer Set Programming (ASP) with epistemic operators, have received renewed attention from the research community in recent years. Classically, evaluating an ELP yields a set of world views, with each being a set of answer sets. In this paper, we propose an alternative definition of world views that represents them as three-valued assignments, where each atom can be either always true, always false, or neither. Based on several examples, we show that this definition is natural and intuitive. We also investigate relevant computational properties of these new semantics, and explore how other notions, like strong equivalence, are affected.


title: Value of Information in Probabilistic Logic Programs

abstract: In medical decision making, we have to choose among several expensive diagnostic tests such that the certainty about a patient's health is maximized while remaining within the bounds of resources like time and money. The expected increase in certainty in the patient's condition due to performing a test is called the value of information (VoI) for that test. In general, VoI relates to acquiring additional information to improve decision-making based on probabilistic reasoning in an uncertain system. This paper presents a framework for acquiring information based on VoI in uncertain systems modeled as Probabilistic Logic Programs (PLPs). Optimal decision-making in uncertain systems modeled as PLPs have already been studied before. But, acquiring additional information to further improve the results of making the optimal decision has remained open in this context. We model decision-making in an uncertain system with a PLP and a set of top-level queries, with a set of utility measures over the distributions of these queries. The PLP is annotated with a set of atoms labeled as "observable"; in the medical diagnosis example, the observable atoms will be results of diagnostic tests. Each observable atom has an associated cost. This setting of optimally selecting observations based on VoI is more general than that considered by any prior work. Given a limited budget, optimally choosing observable atoms based on VoI is intractable in general. We give a greedy algorithm for constructing a "conditional plan" of observations: a schedule where the selection of what atom to observe next depends on earlier observations. We show that, preempting the algorithm anytime before completion provides a usable result, the result improves over time, and, in the absence of a well-defined budget, converges to the optimal solution.


title: Information Extraction Tool Text2ALM: From Narratives to Action Language System Descriptions

abstract: In this work we design a narrative understanding tool Text2ALM. This tool uses an action language ALM to perform inferences on complex interactions of events described in narratives. The methodology used to implement the Text2ALM system was originally outlined by Lierler, Inclezan, and Gelfond (2017) via a manual process of converting a narrative to an ALM model. It relies on a conglomeration of resources and techniques from two distinct fields of artificial intelligence, namely, natural language processing and knowledge representation and reasoning. The effectiveness of system Text2ALM is measured by its ability to correctly answer questions from the bAbI tasks published by Facebook Research in 2015. This tool matched or exceeded the performance of state-of-the-art machine learning methods in six of the seven tested tasks. We also illustrate that the Text2ALM approach generalizes to a broader spectrum of narratives.


title: A Tractable Logic for Molecular Biology

abstract: We introduce a logic for knowledge representation and reasoning on protein-protein interactions. Modulo a theory, formulas describe protein structures and dynamic changes. They can be composed in order to add or remove static and dynamic observations. A second-order circumscription operator then enables nonmonotonic reasoning on the changes implied by a formula. We introduce deduction rules that produce formulas which are, up to equivalence, in a first-order fragment with decidable satisfiability and validity. Importantly, the rules can produce circumscribed formulas.


title: Diffusion-Based Molecular Communication Channel in Presence of a Probabilistic Absorber: Single Receptor Model and Congestion Analysis

abstract: In this paper, a diffusion-based molecular communication channel is modeled in presence of a probabilistic absorber. The probabilistic absorber is an absorber which absorbs molecules upon collision with probability q. With random walk analysis, the discrete probability function of particle location in the presence of a probabilistic absorber can be found. Then, a continuous probability function is fitted to this Markov-based results with introducing several fitting parameters to the known probability function of particle location in an unbounded environment without an absorbing barrier. With this approach, a single receptor is modeled as an M/M/1/1 queue in which q represents the complementary blocking probability and the mean service time is the mean trafficking time. Therefore, we are able to model the stochastic nature of ligand-receptor binding, which comes from the incapability of a receptor to receive all molecules in its space; and also known as receptor occupancy. The proper consideration of the absorption effect leads to the accurate calculation of the concentration at the desired site, which is definitely less than the concentration obtained when neglecting it. These findings can have a crucial role in designing drug delivery systems in which determining the optimal rate of the drug transmitting nanomachines is critical to avoid toxicity while maintaining effectiveness.


title: On the Strong Equivalences of LPMLN Programs

abstract: By incorporating the methods of Answer Set Programming (ASP) and Markov Logic Networks (MLN), LPMLN becomes a powerful tool for non-monotonic, inconsistent and uncertain knowledge representation and reasoning. To facilitate the applications and extend the understandings of LPMLN, we investigate the strong equivalences between LPMLN programs in this paper, which is regarded as an important property in the field of logic programming. In the field of ASP, two programs P and Q are strongly equivalent, iff for any ASP program R, the programs P and Q extended by R have the same stable models. In other words, an ASP program can be replaced by one of its strong equivalent without considering its context, which helps us to simplify logic programs, enhance inference engines, construct human-friendly knowledge bases etc. Since LPMLN is a combination of ASP and MLN, the notions of strong equivalences in LPMLN is quite different from that in ASP. Firstly, we present the notions of p-strong and w-strong equivalences between LPMLN programs. Secondly, we present a characterization of the notions by generalizing the SE-model approach in ASP. Finally, we show the use of strong equivalences in simplifying LPMLN programs, and present a sufficient and necessary syntactic condition that guarantees the strong equivalence between a single LPMLN rule and the empty program.


title: RestKB: A Library of Commonsense Knowledge about Dining at a Restaurant

abstract: This paper presents a library of commonsense knowledge, RestKB, developed in modular action language ALM and containing background knowledge relevant to the understanding of restaurant narratives, including stories that describe exceptions to the normal unfolding of such scenarios. We highlight features that KR languages must possess in order to be able to express pertinent knowledge, and expand action language ALM as needed. We show that encoding the knowledge base in ALM facilitates its piecewise construction and testing, and improves the generality and quality of the captured information, in comparison to an initial ASP encoding. The knowledge base was used in a system for reasoning about stereotypical activities, evaluated on the restaurant domain.


title: Mutex Graphs and Multicliques: Reducing Grounding Size for Planning

abstract: We present an approach to representing large sets of mutual exclusions, also known as mutexes or mutex constraints. These are the types of constraints that specify the exclusion of some properties, events, processes, and so on. They are ubiquitous in many areas of applications. The size of these constraints for a given problem can be overwhelming enough to present a bottleneck for the solving efficiency of the underlying solver. In this paper, we propose a novel graph-theoretic technique based on multicliques for a compact representation of mutex constraints and apply it to domain-independent planning in ASP. As computing a minimum multiclique covering from a mutex graph is NP-hard, we propose an efficient approximation algorithm for multiclique covering and show experimentally that it generates substantially smaller grounding size for mutex constraints in ASP than the previously known work in SAT.


title: Most General Variant Unifiers

abstract: Equational unification of two terms consists of finding a substitution that, when applied to both terms, makes them equal modulo some equational properties. Equational unification is of special relevance to automated deduction, theorem proving, protocol analysis, partial evaluation, model checking, etc. Several algorithms have been developed in the literature for specific equational theories, such as associative-commutative symbols, exclusive-or, Diffie-Hellman, or Abelian Groups. Narrowing was proved to be complete for unification and several cases have been studied where narrowing provides a decidable unification algorithm. A new narrowing-based equational unification algorithm relying on the concept of the variants of a term has been developed and it is available in the most recent version of Maude, version 2.7.1, which provides quite sophisticated unification features. A variant of a term t is a pair consisting of a substitution sigma and the canonical form of tsigma. Variant-based unification is decidable when the equational theory satisfies the finite variant property. However, it may compute many more unifiers than the necessary and, in this paper, we explore how to strengthen the variant-based unification algorithm implemented in Maude to produce a minimal set of most general variant unifiers. Our experiments suggest that this new adaptation of the variant-based unification is more efficient both in execution time and in the number of computed variant unifiers than the original algorithm available in Maude.


title: Generating Local Search Neighborhood with Synthesized Logic Programs

abstract: Local Search meta-heuristics have been proven a viable approach to solve difficult optimization problems. Their performance depends strongly on the search space landscape, as defined by a cost function and the selected neighborhood operators. In this paper we present a logic programming based framework, named Noodle, designed to generate bespoke Local Search neighborhoods tailored to specific discrete optimization problems. The proposed system consists of a domain specific language, which is inspired by logic programming, as well as a genetic programming solver, based on the grammar evolution algorithm. We complement the description with a preliminary experimental evaluation, where we synthesize efficient neighborhood operators for the traveling salesman problem, some of which reproduce well-known results.


title: Quantified Constraint Handling Rules

abstract: We shift the QCSP (Quantified Constraint Satisfaction Problems) framework to the QCHR (Quantified Constraint Handling Rules) framework by enabling dynamic binder and access to user-defined constraints. QCSP offers a natural framework to express PSPACE problems as finite two-players games. But to define a QCSP model, the binder must be formerly known and cannot be built dynamically even if the worst case won't occur. To overcome this issue, we define the new QCHR formalism that allows to build the binder dynamically during the solving. Our QCHR models exhibit state-of-the-art performances on static binder and outperforms previous QCSP approaches when the binder is dynamic.


title: Entanglement Sustainability in Quantum Radar

abstract: Quantum radar is generally defined as a detection sensor that utilizes the microwave photons like a classical radar. At the same time, it employs quantum phenomena to improve detection, identification, and resolution capabilities. However, the entanglement is so fragile, unstable, and difficult to create and to preserve for a long time. Also, more importantly, the entangled states have a tendency to leak away as a result of noise. The points mentioned above enforces that the entangled states should be carefully studied at each step of the quantum radar detection processes as follows. Firstly, the creation of the entanglement between microwave and optical photons into the tripartite system is realized. Secondly, the entangled microwave photons are intensified. Thirdly, the intensified photons are propagated into the atmosphere (attenuation medium) and reflected from a target. Finally, the backscattered photons are intensified before the detection. At each step, the parameters related to the real mediums and target material can affect the entangled states to leak away easily. In this article, the entanglement behavior of a designed quantum radar is specifically investigated. In this study, the quantum electrodynamics theory is generally utilized to analyze the quantum radar system to define the parameters influencing the entanglement behavior. The tripartite system dynamics of equations of motions are derived using the quantum canonical conjugate method. The results of simulations indicate that the features of the tripartite system and the amplifier are designed in such a way to lead the detected photons to remain entangled with the optical modes.


title: Towards Shape Biased Unsupervised Representation Learning for Domain Generalization

abstract: It is known that, without awareness of the process, our brain appears to focus on the general shape of objects rather than superficial statistics of context. On the other hand, learning autonomously allows discovering invariant regularities which help generalization. In this work, we propose a learning framework to improve the shape bias property of self-supervised methods. Our method learns semantic and shape biased representations by integrating domain diversification and jigsaw puzzles. The first module enables the model to create a dynamic environment across arbitrary domains and provides a domain exploration vs. exploitation trade-off, while the second module allows the model to explore this environment autonomously. This universal framework does not require prior knowledge of the domain of interest. Extensive experiments are conducted on several domain generalization datasets, namely, PACS, Office-Home, VLCS, and Digits. We show that our framework outperforms state-of-the-art domain generalization methods by a large margin.


title: Extended Magic for Negation: Efficient Demand-Driven Evaluation of Stratified Datalog with Precise Complexity Guarantees

abstract: Given a set of Datalog rules, facts, and a query, answers to the query can be inferred bottom-up starting from the facts or top-down starting from the query. For efficiency, top-down evaluation is extended with memoization of inferred facts, and bottom-up evaluation is performed after transformations to make rules driven by the demand from the query. Prior work has shown their precise complexity analysis and relationships. However, when Datalog is extended with even stratified negation, which has a simple and universally accepted semantics, transformations to make rules demand-driven may result in non-stratified negation, which has had many complex semantics and evaluation methods. This paper presents (1) a simple extension to demand transformation, a transformation to make rules demand-driven for Datalog without negation, to support stratified negation, and (2) a simple extension to an optimal bottom-up evaluation method for Datalog with stratified negation, to handle non-stratified negation in the resulting rules. We show that the method provides precise complexity guarantees. It is also optimal in that only facts needed for top-down evaluation of the query are inferred and each firing of a rule to infer such a fact takes worst-case constant time. We extend the precise relationship between top-down evaluation and demand-driven bottom-up evaluation to Datalog with stratified negation. Finally, we show experimental results for performance, as well as applications to previously challenging examples.


title: Google vs IBM: A Constraint Solving Challenge on the Job-Shop Scheduling Problem

abstract: The job-shop scheduling is one of the most studied optimization problems from the dawn of computer era to the present day. Its combinatorial nature makes it easily expressible as a constraint satisfaction problem. In this paper, we compare the performance of two constraint solvers on the job-shop scheduling problem. The solvers in question are: OR-Tools, an open-source solver developed by Google and winner of the last MiniZinc Challenge, and CP Optimizer, a proprietary IBM constraint solver targeted at industrial scheduling problems. The comparison is based on the goodness of the solutions found and the time required to solve the problem instances. First, we target the classic benchmarks from the literature, then we carry out the comparison on a benchmark that was created with known optimal solution, with size comparable to real-world industrial problems.


title: A Rule-Based System for Explainable Donor-Patient Matching in Liver Transplantation

abstract: In this paper we present web-liver, a rule-based system for decision support in the medical domain, focusing on its application in a liver transplantation unit for implementing policies for donor-patient matching. The rule-based system is built on top of an interpreter for logic programs with partial functions, called lppf, that extends the paradigm of Answer Set Programming (ASP) adding two main features: (1) the inclusion of partial functions and (2) the computation of causal explanations for the obtained solutions. The final goal of web-liver is assisting the medical experts in the design of new donor-patient matching policies that take into account not only the patient severity but also the transplantation utility. As an example, we illustrate the tool behaviour with a set of rules that implement the utility index called SOFT.


title: BigData Applications from Graph Analytics to Machine Learning by Aggregates in Recursion

abstract: In the past, the semantic issues raised by the non-monotonic nature of aggregates often prevented their use in the recursive statements of logic programs and deductive databases. However, the recently introduced notion of Pre-mappability (PreM) has shown that, in key applications of interest, aggregates can be used in recursion to optimize the perfect-model semantics of aggregate-stratified programs. Therefore we can preserve the declarative formal semantics of such programs while achieving a highly efficient operational semantics that is conducive to scalable implementations on parallel and distributed platforms. In this paper, we show that with PreM, a wide spectrum of classical algorithms of practical interest, ranging from graph analytics and dynamic programming based optimization problems to data mining and machine learning applications can be concisely expressed in declarative languages by using aggregates in recursion. Our examples are also used to show that PreM can be checked using simple techniques and templatized verification strategies. A wide range of advanced BigData applications can now be expressed declaratively in logic-based languages, including Datalog, Prolog, and even SQL, while enabling their execution with superior performance and scalability.


title: Natural Language Generation for Non-Expert Users

abstract: Motivated by the difficulty in presenting computational results, especially when the results are a collection of atoms in a logical language, to users, who are not proficient in computer programming and/or the logical representation of the results, we propose a system for automatic generation of natural language descriptions for applications targeting mainstream users. Differently from many earlier systems with the same aim, the proposed system does not employ templates for the generation task. It assumes that there exist some natural language sentences in the application domain and uses this repository for the natural language description. It does not require, however, a large corpus as it is often required in machine learning approaches. The systems consist of two main components. The first one aims at analyzing the sentences and constructs a Grammatical Framework (GF) for given sentences and is implemented using the Stanford parser and an answer set program. The second component is for sentence construction and relies on GF Library. The paper includes two use cases to demostrate the capability of the system. As the sentence construction is done via GF, the paper includes a use case evaluation showing that the proposed system could also be utilized in addressing a challenge to create an abstract Wikipedia, which is recently discussed in the BlueSky session of the 2018 International Semantic Web Conference.


title: An ASP-based Approach for Attractor Enumeration in Synchronous and Asynchronous Boolean Networks

abstract: Boolean networks are conventionally used to represent and simulate gene regulatory networks. In the analysis of the dynamic of a Boolean network, the attractors are the objects of a special attention. In this work, we propose a novel approach based on Answer Set Programming (ASP) to express Boolean networks and simulate the dynamics of such networks. Our work focuses on the identification of the attractors, it relies on the exhaustive enumeration of all the attractors of synchronous and asynchronous Boolean networks. We applied and evaluated the proposed approach on real biological networks, and the obtained results indicate that this novel approach is promising.


title: Encoding Selection for Solving Hamiltonian Cycle Problems with ASP

abstract: It is common for search and optimization problems to have alternative equivalent encodings in ASP. Typically none of them is uniformly better than others when evaluated on broad classes of problem instances. We claim that one can improve the solving ability of ASP by using machine learning techniques to select encodings likely to perform well on a given instance. We substantiate this claim by studying the hamiltonian cycle problem. We propose several equivalent encodings of the problem and several classes of hard instances. We build models to predict the behavior of each encoding, and then show that selecting encodings for a given instance using the learned performance predictors leads to significant performance gains.


title: A dynamical Borel-Cantelli lemma via improvements to Dirichlet's theorem

abstract: Let $X\cong \operatorname{SL}_2(\mathbb R)/\operatorname{SL}_2(\mathbb Z)$ be the space of unimodular lattices in $\mathbb R^2$, and for any $r\ge 0$ denote by $K_r\subset X$ the set of lattices such that all its nonzero vectors have supremum norm at least $e^{-r}$. These are compact nested subset{s} of $X$, with $K_0 = {\bigcap}_{r}K_r$ being the union of two closed horocycles. We use an explicit second moment formula for the Siegel transform of the indicator functions of squares in $\mathbb R^2$ centered at the origin to derive an asymptotic formula for the volume of sets $K_r$ as $r\to 0$. Combined with a zero-one law for the set of the $\psi$-Dirichlet numbers established by Kleinbock and Wadleigh, this gives a new dynamical Borel-Cantelli lemma for the geodesic flow on $X$ with respect to the family of shrinking targets $\{K_r\}$.


title: Advances in Big Data Bio Analytics

abstract: Delivering effective data analytics is of crucial importance to the interpretation of the multitude of biological datasets currently generated by an ever increasing number of high throughput techniques. Logic programming has much to offer in this area. Here, we detail advances that highlight two of the strengths of logical formalisms in developing data analytic solutions in biological settings: access to large relational databases and building analytical pipelines collecting graph information from multiple sources. We present significant advances on the bio_db package which serves biological databases as Prolog facts that can be served either by in-memory loading or via database backends. These advances include modularising the underlying architecture and the incorporation of datasets from a second organism (mouse). In addition, we introduce a number of data analytics tools that operate on these datasets and are bundled in the analysis package: bio_analytics. Emphasis in both packages is on ease of installation and use. We highlight the general architecture of our components based approach. An experimental graphical user interface via SWISH for local installation is also available. Finally, we advocate that biological data analytics is a fertile area which can drive further innovation in applied logic programming.


title: Towards Ethical Machines Via Logic Programming

abstract: Autonomous intelligent agents are playing increasingly important roles in our lives. They contain information about us and start to perform tasks on our behalves. Chatbots are an example of such agents that need to engage in a complex conversations with humans. Thus, we need to ensure that they behave ethically. In this work we propose a hybrid logic-based approach for ethical chatbots.


title: A Temporal Module for Logical Frameworks

abstract: In artificial intelligence, multi agent systems constitute an interesting typology of society modeling, and have in this regard vast fields of application, which extend to the human sciences. Logic is often used to model such kind of systems as it is easier to verify than other approaches, and provides explainability and potential validation. In this paper we define a time module suitable to add time to many logic representations of agents.


title: Reasoning about Qualitative Direction and Distance between Extended Objects using Answer Set Programming

abstract: In this thesis, we introduce a novel formal framework to represent and reason about qualitative direction and distance relations between extended objects using Answer Set Programming (ASP). We take Cardinal Directional Calculus (CDC) as a starting point and extend CDC with new sorts of constraints which involve defaults, preferences and negation. We call this extended version as nCDC. Then we further extend nCDC by augmenting qualitative distance relation and name this extension as nCDC+. For CDC, nCDC, nCDC+, we introduce an ASP-based general framework to solve consistency checking problems, address composition and inversion of qualitative spatial relations, infer unknown or missing relations between objects, and find a suitable configuration of objects which fulfills a given inquiry.


title: Conversational AI : Open Domain Question Answering and Commonsense Reasoning

abstract: Our research is focused on making a human-like question answering system which can answer rationally. The distinguishing characteristic of our approach is that it will use automated common sense reasoning to truly "understand" dialogues, allowing it to converse like a human. Humans often make many assumptions during conversations. We infer facts not told explicitly by using our common sense. Incorporating commonsense knowledge in a question answering system will simply make it more robust.


title: Design of a Solver for Multi-Agent Epistemic Planning

abstract: As the interest in Artificial Intelligence continues to grow it is becoming more and more important to investigate formalization and tools that allow us to exploit logic to reason about the world. In particular, given the increasing number of multi-agents systems that could benefit from techniques of automated reasoning, exploring new ways to define not only the world's status but also the agents' information is constantly growing in importance. This type of reasoning, i.e., about agents' perception of the world and also about agents' knowledge of her and others' knowledge, is referred to as epistemic reasoning. In our work we will try to formalize this concept, expressed through epistemic logic, for dynamic domains. In particular we will attempt to define a new action-based language for multi-agent epistemic planning and to implement an epistemic planner based on it. This solver should provide a tool flexible enough to be able to reason on different domains, e.g., economy, security, justice and politics, where reasoning about others' beliefs could lead to winning strategies or help in changing a group of agents' view of the world.


abstract: The aim of my Ph.D. thesis concerns Reasoning in Highly Reactive Environments. As reasoning in highly reactive environments, we identify the setting in which a knowledge-based agent, with given goals, is deployed in an environment subject to repeated, sudden and possibly unknown changes. This is for instance the typical setting in which, e.g., artificial agents for video-games (the so called "bots"), cleaning robots, bomb clearing robots, and so on are deployed. In all these settings one can follow the classical approach in which the operations of the agent are distinguished in "sensing" the environment with proper interface devices, "thinking", and then behaving accordingly using proper actuators. In order to operate in an highly reactive environment, an artificial agent needs to be: 1. Responsive -> The agent must be able to react repeatedly and in a reasonable amount of time; 2. Elastic -> The agent must stay reactive also under varying workload; 3. Resilient -> The agent must stay responsive also in case of internal failure or failure of one of the programmed actions in the environment. Nowadays, thanks to new technologies in the field of Artificial Intelligence, it is already technically possible to create AI agents that are able to operate in reactive environments. Nevertheless, several issues stay unsolved, and are subject of ongoing research.


title: Research Report on Automatic Synthesis of Local Search Neighborhood Operators

abstract: Constraint Programming (CP) and Local Search (LS) are different paradigms for dealing with combinatorial search and optimization problems. Their complementary features motivated researchers to create hybrid CP/LS solutions, maintaining both the modeling capabilities of CP and the computational advantages of the heuristic-based LS approach. Research presented in this report is focused on developing a novel method to infer an efficient LS neighborhood operator based on the problem structure, as modeled in the CP paradigm. We consider a limited formal language that we call a Neighborhood Definition Language, used to specify the neighborhood operators in a fine-grained and declarative manner. Together with Logic Programming runtime called Noodle, it allows to automatically synthesize complex operators using a Grammar Evolution algorithm.


title: The convex-set algebra and the toric b-Chow group

abstract: In \cite{botero}, a top intersection product of toric b-divisors on a smooth complete toric variety is defined. It is shown that a nef toric b-divisor corresponds to a convex set and that its top intersection number equals the volume of this convex set. The goal of this article is to extend this result and define an intersection product of sufficiently positive toric b-classes of arbitrary codimension. For this, we extend the polytope algebra of McMullen (\cite{McM1}, \cite{McM2}, \cite{McM3}) to the so called \emph{convex-set algebra} and we show that it embeds in the toric b-Chow group. In this way, the convex-set algebra can be viewed as a ring for an intersection theory for sufficiently positive toric b-classes. As an application, we show that some Hodge type inequalities are satisfied for the convex-set algebra.


title: Distributed Answer Set Coloring: Stable Models Computation via Graph Coloring

abstract: Answer Set Programming (ASP) is a famous logic language for knowledge representation, which has been really successful in the last years, as witnessed by the great interest into the development of efficient solvers for ASP. Yet, the great request of resources for certain types of problems, as the planning ones, still constitutes a big limitation for problem solving. Particularly, in the case the program is grounded before the resolving phase, an exponential blow up of the grounding can generate a huge ground file, infeasible for single machines with limited resources, thus preventing even the discovering of a single non-optimal solution. To address this problem, in this paper we present a distributed approach to ASP solving, exploiting distributed computation benefits in order to overcome the just explained limitations. The here presented tool, which is called Distributed Answer Set Coloring (DASC), is a pure solver based on the well-known Graph Coloring algorithm. DASC is part of a bigger project aiming to bring logic programming into a distributed system, started in 2017 by Federico Igne with mASPreduce and continued in 2018 by Pietro Totis with a distributed grounder. In this paper we present a low level implementation of the Graph Coloring algorithm, via the Boost and MPI libraries for C++. Finally, we provide a few results of the very first working version of our tool, at the moment without any strong optimization or heuristic.


title: Expected dust grain size distributions in galaxies detected by ALMA at $z>7$

abstract: The dust properties in high-redshift galaxies provide clues to the origin of dust in the Universe. Although dust has been detected in galaxies at redshift $z>7$, it is difficult to constrain the dominant dust sources only from the total dust amount. Thus, we calculate the evolution of grain size distribution, expecting that different dust sources predict different grain size distributions. Using the star formation time-scale and the total baryonic mass constrained by the data in the literature, we calculate the evolution of grain size distribution. To explain the total dust masses in ALMA-detected $z>7$ galaxies, the following two solutions are possible: (i) high dust condensation efficiency in stellar ejecta, and (ii) efficient accretion (dust growth by accreting the gas-phase metals in the interstellar medium). We find that these two scenarios predict significantly different grain size distributions: in (i), the dust is dominated by large grains ($a\gtrsim 0.1~\mu$m, where $a$ is the grain radius), while in (ii), the small-grain ($a\lesssim 0.01~\mu$m) abundance is significantly enhanced by accretion. Accordingly, extinction curves are expected to be much steeper in (ii) than in (i). Thus, we conclude that extinction curves provide a viable way to distinguish the dominant dust sources in the early phase of galaxy evolution.


title: Manipulation of a Micro-object Using Topological Hydrodynamic Tweezers

abstract: Manipulating micro-scale object plays paramount roles in a wide range of fundamental researches and applications. At micro-scale, various methods have been developed in the past decades, including optical, electric, magnetic, aerodynamic and acoustic methods. However, these non-contact forces are susceptible to external disturbance, and so finding a way to make micro-scale object manipulation immune to external perturbations is challenging and remains elusive. Here we demonstrate a method based on new trapping mechanism to manipulate micro-scale object in a gas flow at ambient conditions. We first show that the micro-droplet is entrapped into a trapping ring constructed by a particular toroidal vortex. The vortex works as tweezers to control the position of the micro-droplet. We then show that the micro-droplet can be transported along the trapping ring. By virtue of the topological character of the gas flow, the transport path is able to bypass external strong perturbations automatically. We further demonstrate a topological transfer process of the micro-droplet between two hydrodynamic tweezers. Our method provides an integrated toolbox to manipulate a micro-scale object, with an intrinsic mechanism that protects the target object from external disturbances.


title: Long-range donor-acceptor electron transport mediated by alpha-helices

abstract: We study the long-range electron and energy transfer mediated by a polaron on an $\alpha$-helix polypeptide chain coupled to donor and acceptor molecules at opposite ends of the chain. We show that for specific parameters of the system, an electron initially located on the donor can tunnel onto the $\alpha$-helix, forming a polaron which then travels to the other extremity of the polypeptide chain where it is captured by the acceptor. We consider three families of couplings between the donor, acceptor and the chain, and show that one of them can lead to a 90\% efficiency of the electron transport from donor to acceptor. We also show that this process remains stable at physiological temperatures in the presence of thermal fluctuations in the system.


title: An NMPC Approach using Convex Inner Approximations for Online Motion Planning with Guaranteed Collision Avoidance

abstract: Even though mobile robots have been around for decades, trajectory optimization and continuous time collision avoidance remain subject of active research. Existing methods trade off between path quality, computational complexity, and kinodynamic feasibility. This work approaches the problem using a nonlinear model predictive control (NMPC) framework, that is based on a novel convex inner approximation of the collision avoidance constraint. The proposed Convex Inner ApprOximation (CIAO) method finds kinodynamically feasible and continuous time collision free trajectories, in few iterations, typically one. For a feasible initialization, the approach is guaranteed to find a feasible solution, i.e. it preserves feasibility. Our experimental evaluation shows that CIAO outperforms state of the art baselines in terms of planning efficiency and path quality. Experiments on a robot with 12 states show that it also scales to high-dimensional systems. Furthermore real-world experiments demonstrate its capability of unifying trajectory optimization and tracking for safe motion planning in dynamic environments.


title: A VLA Polarimetric Study of the Galactic Center Radio Arc: Characterizing Polarization, Rotation Measure, and Magnetic Field Properties

abstract: The Radio Arc is one of the brightest systems of non-thermal filaments (NTFs) in the Galactic Center, located near several prominent HII regions (Sickle and Pistol) and the Quintuplet stellar cluster. We present observations of the Arc NTFs using the S-, C-, and X-bands of the Very Large Array interferometer. Our images of total intensity reveal large-scale helical features that surround the Arc NTFs, very narrow sub-filamentation, and compact sources along the NTFs. The distribution of polarized intensity is confined to a relatively small area along the NTFs. There are elongated polarized structures that appear to lack total intensity counterparts. We detect a range of rotation measure values from -1000 to -5800 rad m$\rm^{-2}$, likely caused by external Faraday rotation along the line of sight. After correcting for Faraday rotation, the intrinsic magnetic field orientation is found to generally trace the extent of the NTFs. However, the intrinsic magnetic field in several regions of the Arc NTFs shows an ordered pattern that is rotated with respect to the extent of the NTFs. We suggest this changing pattern may be caused by an additional magnetized source along the line of sight, so that we observe two field systems superposed in our observations. We suggest that the large scale helical segments near the Radio Arc could be components of such a source causing these changes in intrinsic magnetic field, and some variations in the polarization and rotation measure values along the NTFs.


title: Exploring Reciprocal Attention for Salient Object Detection by Cooperative Learning

abstract: Typically, objects with the same semantics are not always prominent in images containing different backgrounds. Motivated by this observation that accurately salient object detection is related to both foreground and background, we proposed a novel cooperative attention mechanism that jointly considers reciprocal relationships between background and foreground for efficient salient object detection. Concretely, we first aggregate the features at each side-out of traditional dilated FCN to extract the initial foreground and background local responses respectively. Then taking these responses as input, reciprocal attention module adaptively models the nonlocal dependencies between any two pixels of the foreground and background features, which is then aggregated with local features in a mutual reinforced way so as to enhance each branch to generate more discriminative foreground and background saliency map. Besides, cooperative losses are particularly designed to guide the multi-task learning of foreground and background branches, which encourages our network to obtain more complementary predictions with clear boundaries. At last, a simple but effective fusion strategy is utilized to produce the final saliency map. Comprehensive experimental results on five benchmark datasets demonstrate that our proposed method performs favorably against the state-of-the-art approaches in terms of all compared evaluation metrics.


title: Rates of convergence in invariance principles for random walks on linear groups via martingale methods

abstract: In this paper, we give explicit rates in the central limit theorem and in the almost sure invariance principle for general R d-valued cocycles that appear in the study of the left random walk on linear groups. Our method of proof lies on a suitable martingale approximation and on a careful estimation of some coupling coefficients linked with the underlying Markov structure. Concerning the martingale part, the available results in the literature are not accurate enough to give almost optimal rates whether in the central limit theorem for the Wasserstein distance, or in the strong approximation. A part of this paper is devoted to circumvent this issue. We then exhibit near optimal rates both in the central limit theorem in terms of Wasserstein distance and in the almost sure invariance principle for R d-valued martingales with stationary increments having moments of order p $\in$]2, 3] (the case of sequences of reversed martingale differences is also considered). Note also that, as an application of our results for general R d-valued cocycles, a special attention is paid to the Iwasawa cocycle and the Cartan projection for reductive Lie groups.