title: Efficient Adaptation of Pretrained Transformers for Abstractive Summarization

abstract: Large-scale learning of transformer language models has yielded improvements on a variety of natural language understanding tasks. Whether they can be effectively adapted for summarization, however, has been less explored, as the learned representations are less seamlessly integrated into existing neural text production architectures. In this work, we propose two solutions for efficiently adapting pretrained transformer language models as text summarizers: source embeddings and domain-adaptive training. We test these solutions on three abstractive summarization datasets, achieving new state of the art performance on two of them. Finally, we show that these improvements are achieved by producing more focused summaries with fewer superfluous and that performance improvements are more pronounced on more abstractive datasets.


title: Region-specific Diffeomorphic Metric Mapping

abstract: We introduce a region-specific diffeomorphic metric mapping (RDMM) registration approach. RDMM is non-parametric, estimating spatio-temporal velocity fields which parameterize the sought-for spatial transformation. Regularization of these velocity fields is necessary. However, while existing non-parametric registration approaches, e.g., the large displacement diffeomorphic metric mapping (LDDMM) model, use a fixed spatially-invariant regularization our model advects a spatially-varying regularizer with the estimated velocity field, thereby naturally attaching a spatio-temporal regularizer to deforming objects. We explore a family of RDMM registration approaches: 1) a registration model where regions with separate regularizations are pre-defined (e.g., in an atlas space), 2) a registration model where a general spatially-varying regularizer is estimated, and 3) a registration model where the spatially-varying regularizer is obtained via an end-to-end trained deep learning (DL) model. We provide a variational derivation of RDMM, show that the model can assure diffeomorphic transformations in the continuum, and that LDDMM is a particular instance of RDMM. To evaluate RDMM performance we experiment 1) on synthetic 2D data and 2) on two 3D datasets: knee magnetic resonance images (MRIs) of the Osteoarthritis Initiative (OAI) and computed tomography images (CT) of the lung. Results show that our framework achieves state-of-the-art image registration performance, while providing additional information via a learned spatio-temoporal regularizer. Further, our deep learning approach allows for very fast RDMM and LDDMM estimations. Our code will be open-sourced. Code is available at https://github.com/uncbiag/registration.


title: Fast Algorithm for K-Truss Discovery on Public-Private Graphs

abstract: In public-private graphs, users share one public graph and have their own private graphs. A private graph consists of personal private contacts that only can be visible to its owner, e.g., hidden friend lists on Facebook and secret following on Sina Weibo. However, existing public-private analytic algorithms have not yet investigated the dense subgraph discovery of k-truss, where each edge is contained in at least k-2 triangles. This paper aims at finding k-truss efficiently in public-private graphs. The core of our solution is a novel algorithm to update k-truss with node insertions. We develop a classification-based hybrid strategy of node insertions and edge insertions to incrementally compute k-truss in public-private graphs. Extensive experiments validate the superiority of our proposed algorithms against state-of-the-art methods on real-world datasets.


title: Multi-Turn Beam Search for Neural Dialogue Modeling

abstract: In neural dialogue modeling, a neural network is trained to predict the next utterance, and at inference time, an approximate decoding algorithm is used to generate next utterances given previous ones. While this autoregressive framework allows us to model the whole conversation during training, inference is highly suboptimal, as a wrong utterance can affect future utterances. While beam search yields better results than greedy search does, we argue that it is still greedy in the context of the entire conversation, in that it does not consider future utterances. We propose a novel approach for conversation-level inference by explicitly modeling the dialogue partner and running beam search across multiple conversation turns. Given a set of candidates for next utterance, we unroll the conversation for a number of turns and identify the candidate utterance in the initial hypothesis set that gives rise to the most likely sequence of future utterances. We empirically validate our approach by conducting human evaluation using the Persona-Chat dataset, and find that our multi-turn beam search generates significantly better dialogue responses. We propose three approximations to the partner model, and observe that more informed partner models give better performance.


title: A Technique for Finding Optimal Program Launch Parameters Targeting Manycore Accelerators

abstract: In this paper, we present a new technique to dynamically determine the values of program parameters in order to optimize the performance of a multithreaded program P. To be precise, we describe a novel technique to statically build another program, say, R, that can dynamically determine the optimal values of program parameters to yield the best program performance for P given values for its data and hardware parameters. While this technique can be applied to parallel programs in general, we are particularly interested in programs targeting manycore accelerators. Our technique has successfully been employed for GPU kernels using the MWP-CWP performance model for CUDA.


title: $I$-Cohen Macaulay modules

abstract: A finitely generated module $M$ over a commutative Noetherian ring $R$ is called an $I$-Cohen Macaulay module, if \[ \grade(I,M) + \dim(M/IM)= \dim(M), \] where $I$ is a proper ideal of $R$. The aim of this paper is to study the structure of this class of modules. It is discovered that $I$-Cohen Macaulay modules enjoy many interesting properties which are analogous to those of Cohen Macaulay modules. Also, various characterizations of $I$-Cohen Macaulay modules are presented here.


title: Theorems of the Alternative for Conic Integer Programming

abstract: Farkas' Lemma is a foundational result in linear programming, with implications in duality, optimality conditions, and stochastic and bilevel programming. Its generalizations are known as theorems of the alternative. There exist theorems of the alternative for integer programming and conic programming. We present theorems of the alternative for conic integer programming. We provide a nested procedure to construct a function that characterizes feasibility over right-hand sides and can determine which statement in a theorem of the alternative holds.


title: DiffQue: Estimating Relative Difficulty of Questions in Community Question Answering Services

abstract: Automatic estimation of relative difficulty of a pair of questions is an important and challenging problem in community question answering (CQA) services. There are limited studies which addressed this problem. Past studies mostly leveraged expertise of users answering the questions and barely considered other properties of CQA services such as metadata of users and posts, temporal information and textual content. In this paper, we propose DiffQue, a novel system that maps this problem to a network-aided edge directionality prediction problem. DiffQue starts by constructing a novel network structure that captures different notions of difficulties among a pair of questions. It then measures the relative difficulty of two questions by predicting the direction of a (virtual) edge connecting these two questions in the network. It leverages features extracted from the network structure, metadata of users/posts and textual description of questions and answers. Experiments on datasets obtained from two CQA sites (further divided into four datasets) with human annotated ground-truth show that DiffQue outperforms four state-of-the-art methods by a significant margin (28.77% higher F1 score and 28.72% higher AUC than the best baseline). As opposed to the other baselines, (i) DiffQue appropriately responds to the training noise, (ii) DiffQue is capable of adapting multiple domains (CQA datasets), and (iii) DiffQue can efficiently handle 'cold start' problem which may arise due to the lack of information for newly posted questions or newly arrived users.


title: The CPT-violating effects on neutrons' gravitational bound state

abstract: In this work, the CPT-violating (CPTV) interactions on neutrons' gravitational bound state are studied. With simple analytical solutions, we provide a preliminary investigation on the Lorentz-violation (LV) induced spin precession due to the $\vec{\sigma}\cdot\vec{\tilde{b}}(1+gz)$ and $\bar{b}/m_{_I}\vec{\sigma}\cdot\hat{\vec{p}}$ couplings, where $\vec{\tilde{b}}$ and $\bar{b}$ represent LV coefficients. The helicity-dependent couplings can induce unusual phase evolutions with position and momentum dependence. As $\vec{\tilde{b}}$ varies with time due to the Earth's motion, the spin polarization also shows a sidereal time dependence, and it may be enhanced with time for ultra-stable polarized state of neutrons. The inseparability of the spin-momentum coupling of the $\bar{b}$-term can also lead to motional dependent polarization state. With the precisely measured transition frequency between different gravitational bound states, we get a rough bound $|\vec{\tilde{b}}|<3.9\times10^{-3}$GeV for unpolarized neutrons. If the spin-flip transition frequency can reach comparable precision in the future, the bound can be improved to the level of $10^{-24}$GeV. The test of weak equivalence principle with polarized atom may also improve it significantly.


title: Optical tweezers microrheology maps the dynamics of strain-induced local inhomogeneities in entangled polymers

abstract: Optical tweezers microrheology (OTM) offers a powerful approach to probe the nonlinear response of complex soft matter systems, such as networks of entangled polymers, over wide-ranging spatiotemporal scales. OTM can also uniquely characterize the microstructural dynamics that lead to the intriguing nonlinear rheological properties that these systems exhibit. However, the strain in OTM measurements, applied by optically forcing a micro-probe through the material, induces network inhomogeneities in and around the strain path, and the resultant flow field complicates the measured response of the system. Through a robust set of custom-designed OTM protocols, coupled with modeling and analytical calculations, we characterize the time-varying inhomogeneity fields induced by OTM measurements. We show that post-strain homogenization does not interfere with the intrinsic stress relaxation dynamics of the system, rather it manifests as an independent component in the stress decay, even in highly nonlinear regimes such as with the microrheological-LAOS (mLAOS) protocols we introduce. Our specific results show that Rouse-like elastic retraction, rather than disentanglement and disengagement, dominates the nonlinear stress relaxation of entangled polymers at micro- and meso- scales. Thus, our study opens up possibilities of performing precision nonlinear microrheological measurements, such as mLAOS, on a wide range of complex macromolecular systems.


title: SHE: A Fast and Accurate Deep Neural Network for Encrypted Data

abstract: Homomorphic Encryption (HE) is one of the most promising security solutions to emerging Machine Learning as a Service (MLaaS). Leveled-HE (LHE)-enabled Convolutional Neural Networks (LHECNNs) are proposed to implement MLaaS to avoid large bootstrapping overhead. However, prior LHECNNs have to pay significant computing overhead but achieve only low inference accuracy, due to their polynomial approximation activations and poolings. Stacking many polynomial approximation activation layers in a network greatly reduces inference accuracy, since the polynomial approximation activation errors lead to a low distortion of the output distribution of the next batch normalization layer. So the polynomial approximation activations and poolings have become the obstacle to a fast and accurate LHECNN model. In this paper, we propose a Shift-accumulation-based LHE-enabled deep neural network (SHE) for fast and accurate inferences on encrypted data. We use the binary-operation-friendly Leveled Fast Homomorphic Encryption over Torus (LTFHE) encryption scheme to implement ReLU activations and max poolings. We also adopt the logarithmic quantization to accelerate inferences by replacing expensive LTFHE multiplications with cheap LTFHE shifts. We propose a mixed bitwidth accumulator to accelerate accumulations. Since the LTFHE ReLU activations, max poolings, shifts and accumulations have small multiplicative depth overhead, SHE can implement much deeper network architectures with more convolutional and activation layers. Our experimental results show SHE achieves the state-of-the-art inference accuracy and reduces the inference latency by 76.21% ~ 94.23% over prior LHECNNs on MNIST and CIFAR-10. The source code of SHE is available at https://github.com/qianlou/SHE.


title: Littlewood-Paley Theory for Matrix-Weighted Function Spaces

abstract: We define the vector-valued, matrix-weighted function spaces $\dot{F}^{\alpha q}_p(W)$ (homogeneous) and $F^{\alpha q}_p(W)$ (inhomogeneous) on $\mathbb{R}^n$, for $\alpha \in \mathbb{R}$, $0<p<\infty$, $0<q \leq \infty$, with the matrix weight $W$ belonging to the $A_p$ class. For $1<p<\infty$, we show that $L^p(W) = \dot{F}^{0 2}_p(W)$, and, for $k \in \mathbb{N}$, that $F^{k 2}_p(W)$ coincides with the matrix-weighted Sobolev space $L^p_k(W)$, thereby obtaining Littlewood-Paley characterizations of $L^p(W)$ and $L^p_k (W)$. We show that a vector-valued function belongs to $\dot{F}^{\alpha q}_p(W)$ if and only if its wavelet or $\varphi$-transform coefficients belong to an associated sequence space $\dot{f}^{\alpha q}_p(W)$. We also characterize these spaces in terms of reducing operators associated to $W$.


title: Why Not to Use Zero Imputation? Correcting Sparsity Bias in Training Neural Networks

abstract: Handling missing data is one of the most fundamental problems in machine learning. Among many approaches, the simplest and most intuitive way is zero imputation, which treats the value of a missing entry simply as zero. However, many studies have experimentally confirmed that zero imputation results in suboptimal performances in training neural networks. Yet, none of the existing work has explained what brings such performance degradations. In this paper, we introduce the variable sparsity problem (VSP), which describes a phenomenon where the output of a predictive model largely varies with respect to the rate of missingness in the given input, and show that it adversarially affects the model performance. We first theoretically analyze this phenomenon and propose a simple yet effective technique to handle missingness, which we refer to as Sparsity Normalization (SN), that directly targets and resolves the VSP. We further experimentally validate SN on diverse benchmark datasets, to show that debiasing the effect of input-level sparsity improves the performance and stabilizes the training of neural networks.


title: Topological bands and localized vibration modes in quasiperiodic beams

abstract: We investigate a family of quasiperiodic continuous elastic beams, the topological properties of their vibrational spectra, and their relation to the existence of localized modes. We specifically consider beams featuring arrays of ground springs at locations determined by projecting from a circle onto an underlying periodic system. A family of periodic and quasiperiodic structures is obtained by smoothly varying a parameter defining such projection. Numerical simulations show the existence of vibration modes that first localize at a boundary, and then migrate into the bulk as the projection parameter is varied. Explicit expressions predicting the change in the density of states of the bulk define topological invariants that quantify the number of modes spanning a gap of a finite structure. We further demonstrate how modulating the phase of the ground springs distribution causes the topological states to undergo an edge-to-edge transition. The considered configurations and topological studies provide a framework for inducing localized modes in continuous elastic structural components through globally spanning, deterministic perturbations of periodic patterns defined by the considered projection operations.


title: Thermal Conductivity Enhancement by Surface Electromagnetic Waves Propagating along Multilayered Structures with Asymmetric Surrounding Media

abstract: Enhancement of thermal conductivity via surface electromagnetic waves (SEWs) supported in nanostructures has recently drawn attention as a remedy for issues raised due to the reduction of thermal conductivity in nanoscale confinement. Among them, multilayered structures on a substrate are prevalent in nano-sized systems, such as electronic nanodevices, meaning that analysis on those structures is indispensable. In this work, three basic multilayered structures are selected and the analytical expressions for SEWs supported in each structure are derived. This analytical approach enables us to figure out which factors are crucial for enhancing SEW thermal conductivity using multilayers. It is also found that the solution can be extended to various materials and provide the guidelines on which configurations are desirable for increasing the thermal conductivity. Furthermore, the analytical solutions reduce the calculation time significantly such that the optimal configuration, which can additionally yield SEW thermal conductivity of 1.27 W/m$\cdot$K corresponding to 90\% of the thermal conductivity of bulk glass, is found with the genetic algorithm. This study thus provides a new method for efficiently managing thermal issues in nano-sized devices.


title: Fallback accretion powered supernova light curves based on a neutrino-driven explosion simulation of a 40 Msun star

abstract: We present synthetic light curves of fallback-powered supernovae based on a neutrino-driven explosion of a 40 Msun zero-metallicity star with significant fallback accretion onto a black hole that was previously simulated by Chan et al. (2018) until shock breakout. Here, we investigate the light curve properties of the explosion after shock breakout for various fallback models. Without extra power from fallback accretion, the light curve is that of a Type IIP supernova with a plateau magnitude of around -14 mag and a plateau duration of 40 days. With extra power for the light curve from fallback accretion, however, we find that the transient can be significantly more luminous. The light-curve shape can be SN 1987A-like or Type IIP-like, depending on the efficiency of the fallback engine. If the accretion disk forms soon after the collapse and more than 1% of the accretion energy is released as the central engine, fallback accretion powered supernovae become as luminous as superluminous supernovae. We suggest that Type II superluminous supernovae with broad hydrogen features could be related to such hydrogen-rich supernovae powered by fallback accretion. In the future, such superluminous supernovae powered by fallback accretion might be found among the supernovae from the first stars in addition to pair-instability supernovae and pulstational pair-instability supernovae.


title: Cohomology ring of the flag variety vs Chow cohomology ring of the Gelfand-Zetlin toric variety

abstract: We compare the cohomology ring of the flag variety $FL_n$ and the Chow cohomology ring of the Gelfand-Zetlin toric variety $X_{GZ}$. We show that $H^*(FL_n, \mathbb{Q})$ is the Gorenstein quotient of the subalgebra $L$ of $A^*(X_{GZ}, \mathbb{Q})$ generated by degree $1$ elements. We compute these algebras for $n=3$ to see that, in general, the subalgebra $L$ does not have Poincare duality.


title: Coherent ac spin current transmission across an antiferromagnetic CoO insulator

abstract: The recent discovery of spin-current transmission through antiferromagnetic (AFM) insulating materials opens up unprecedented opportunities for fundamental physics and spintronics applications. The great mystery currently surrounding this topic is: how could THz AFM magnons mediate a GHz spin current? This mis-match of frequencies becomes particularly critical for the case of coherent ac spin-current, raising the fundamental question of whether a GHz ac spin-current can ever keep its coherence inside an AFM insulator and so drive the spin precession of another FM layer coherently? Utilizing element- and time-resolved x-ray pump-probe measurements on Py/Ag/CoO/Ag/Fe75Co25/MgO(001) heterostructures, we demonstrate that a coherent GHz ac spin current pumped by the permalloy (Py) ferromagnetic resonance (FMR) can transmit coherently across an antiferromagnetic CoO insulating layer to drive a coherent spin precession of the FM Fe75Co25 layer. Further measurement results favor thermal magnons rather than evanescent spin waves as the mediator of the coherent ac spin current in CoO.


title: Promotion of Answer Value Measurement with Domain Effects in Community Question Answering Systems

abstract: In the area of community question answering (CQA), answer selection and answer ranking are two tasks which are applied to help users quickly access valuable answers. Existing solutions mainly exploit the syntactic or semantic correlation between a question and its related answers (Q&A), where the multi-facet domain effects in CQA are still underexplored. In this paper, we propose a unified model, Enhanced Attentive Recurrent Neural Network (EARNN), for both answer selection and answer ranking tasks by taking full advantages of both Q&A semantics and multi-facet domain effects (i.e., topic effects and timeliness). Specifically, we develop a serialized LSTM to learn the unified representations of Q&A, where two attention mechanisms at either sentence-level or word-level are designed for capturing the deep effects of topics. Meanwhile, the emphasis of Q&A can be automatically distinguished. Furthermore, we design a time-sensitive ranking function to model the timeliness in CQA. To effectively train EARNN, a question-dependent pairwise learning strategy is also developed. Finally, we conduct extensive experiments on a real-world dataset from Quora. Experimental results validate the effectiveness and interpretability of our proposed EARNN model.


title: Modeling accretion disk emission with generalized temperature profile and its effect on AGN spectral energy distribution

abstract: The broadband spectral energy distribution (SED) of Active Galactic Nuclei (AGN) is investigated for a well-selected sample composed of $23$ Seyfert 1 galaxies observed simultaneously in the optical/UV and X-ray bands with the Neil Gehrels {\it Swift} Observatory. The optical to UV continuum spectra are modeled, for the first time, with emission from an accretion disk with a generalized radial temperature profile, in order to account for the intrinsic spectra which are found to be generally redder than the model prediction of the standard Shakura-Sunyaev disk (SSD) ($F_\nu\propto\nu^{+1/3}$). The power-law indices of the radial temperature profile ($T_{\rm eff}(R)\propto R^{-p}$, $R$ is the radius of the accretion disk) are inferred to be $p=0.5$ -- $0.75$ (a median of $0.63$), deviating from the canonical $p=0.75$ for the SSD model as widely adopted in previous studies. A marginal correlation of a flatter radial temperature profile (a smaller $p$ value) with increasing the Eddington ratio is suggested. Such a model produces generally a lower peak of accretion disk emission and thus a smaller bolometric luminosity in some of the AGN, particularly those with high Eddington ratios, than that based on the SSD model by a factor of several. The broadband SED, the bolometric correction factors and their dependence on some of the AGN parameters are re-visited. We suggest that such non-standard SSD disks may operate in AGN and are at least partly responsible for the reddened optical/UV spectra as observed. One possible explanation for these flattened temperature profiles is the mass loss process in form of disk winds/outflows.


title: Patch Learning

abstract: There have been different strategies to improve the performance of a machine learning model, e.g., increasing the depth, width, and/or nonlinearity of the model, and using ensemble learning to aggregate multiple base/weak learners in parallel or in series. This paper proposes a novel strategy called patch learning (PL) for this problem. It consists of three steps: 1) train an initial global model using all training data; 2) identify from the initial global model the patches which contribute the most to the learning error, and train a (local) patch model for each such patch; and, 3) update the global model using training data that do not fall into any patch. To use a PL model, we first determine if the input falls into any patch. If yes, then the corresponding patch model is used to compute the output. Otherwise, the global model is used. We explain in detail how PL can be implemented using fuzzy systems. Five regression problems on 1D/2D/3D curve fitting, nonlinear system identification, and chaotic time-series prediction, verified its effectiveness. To our knowledge, the PL idea has not appeared in the literature before, and it opens up a promising new line of research in machine learning.


title: Stochastic energetics and thermodynamics at small scales

abstract: At very small scales, thermodynamic energy exchanges like work and heat become comparable to thermal energy of the system, which leads to unusual phenomena like the transient violations of Second Law. We explore the generic characters of such systems using the framework of Stochastic Thermodynamics and provide a preliminary overview of the basic concepts. Here we have attempted to put into simple terms some actively pursued topics like the arrow of time, effect of information gain on Second Law, explanation of origin of life using Crooks theorem and the thermodynamic uncertainty relations.


title: Single full gap with mixed type-I and type-II superconductivity on surface of the type-II Dirac semimetal PdTe2 by point-contact spectroscopy

abstract: We report our point-contact spectroscopy (PCS) study on the superconducting state of the type-II Dirac semimetal PdTe$_2$ with a superconducting transition temperature $T\rm_c \sim$ 1.65 K. Both mechanical- and soft- PCS differential conductance curves at 0.3 K show a consistent double-peak structure and they can be perfectly fitted by a single s-wave gap based on the Blonder-Tinkham-Klapwijk model. The gap follows a typical Bardeen-Cooper-Schrieffer temperature behavior, yielding $\Delta_0 \sim$ 0.29 meV and 2$\Delta_0$/$k\rm_{B}$$T\rm_{c}$ = 4.15 in the strong coupling regime. A sudden suppression of the superconducting gap in magnetic field around $H{\rm_{c1}}$ $\sim$ 130 Oe is observed for most point-contacts on PdTe$_2$, characteristic of a first-order transition for type-I superconductor in field. However, for other contacts, a smooth evolution of the PCS conductance persists up to $H{\rm_{c2}}$ $\sim$ 600 Oe, signaling a local type-II superconductivity. The observed admixture of type-I and type-II superconductivity can possibly arise from an inhomogeneous electron mean free path on the surface of PdTe$_2$ due to its topological surface states.


title: Temporally Coherent Full 3D Mesh Human Pose Recovery from Monocular Video

abstract: Advances in Deep Learning have recently made it possible to recover full 3D meshes of human poses from individual images. However, extension of this notion to videos for recovering temporally coherent poses still remains unexplored. A major challenge in this regard is the lack of appropriately annotated video data for learning the desired deep models. Existing human pose datasets only provide 2D or 3D skeleton joint annotations, whereas the datasets are also recorded in constrained environments. We first contribute a technique to synthesize monocular action videos with rich 3D annotations that are suitable for learning computational models for full mesh 3D human pose recovery. Compared to the existing methods which simply "texture-map" clothes onto the 3D human pose models, our approach incorporates Physics based realistic cloth deformations with the human body movements. The generated videos cover a large variety of human actions, poses, and visual appearances, whereas the annotations record accurate human pose dynamics and human body surface information. Our second major contribution is an end-to-end trainable Recurrent Neural Network for full pose mesh recovery from monocular video. Using the proposed video data and LSTM based recurrent structure, our network explicitly learns to model the temporal coherence in videos and imposes geometric consistency over the recovered meshes. We establish the effectiveness of the proposed model with quantitative and qualitative analysis using the proposed and benchmark datasets.


title: Bistability of Sequestration Networks

abstract: We solve a conjecture on multiple nondegenerate steady states, and prove bistability for sequestration networks. More specifically, we prove that for any odd number of species, and for any production factor, the fully open extension of a sequestration network admits three nondegenerate positive steady states, two of which are locally asymptotically stable. In addition, we provide a non-empty open set in the parameter space where a sequestration network admits bistability.


title: Synthesizing Datalog Programs Using Numerical Relaxation

abstract: The problem of learning logical rules from examples arises in diverse fields, including program synthesis, logic programming, and machine learning. Existing approaches either involve solving computationally difficult combinatorial problems, or performing parameter estimation in complex statistical models. In this paper, we present Difflog, a technique to extend the logic programming language Datalog to the continuous setting. By attaching real-valued weights to individual rules of a Datalog program, we naturally associate numerical values with individual conclusions of the program. Analogous to the strategy of numerical relaxation in optimization problems, we can now first determine the rule weights which cause the best agreement between the training labels and the induced values of output tuples, and subsequently recover the classical discrete-valued target program from the continuous optimum. We evaluate Difflog on a suite of 34 benchmark problems from recent literature in knowledge discovery, formal verification, and database query-by-example, and demonstrate significant improvements in learning complex programs with recursive rules, invented predicates, and relations of arbitrary arity.


title: Fragments of plane filling curves of degree $q+2$ over the finite field of $q$ elements, and of affine-plane filling curves of degree $q+1$

abstract: Nonsingular plane curves over a finite field $\mathbb{F}_q$ of degree $q+2$ passing through all the $\mathbb{F}_q$-points of the plane admita representation by $3\times 3$ matrices over $\mathbb{F}_q$. We classify their degenerations by means of the matrix representation, and also discuss the similar problem for the affine-plane filling curves of degree $q+1$.


title: Two-layer Residual Sparsifying Transform Learning for Image Reconstruction

abstract: Signal models based on sparsity, low-rank and other properties have been exploited for image reconstruction from limited and corrupted data in medical imaging and other computational imaging applications. In particular, sparsifying transform models have shown promise in various applications, and offer numerous advantages such as efficiencies in sparse coding and learning. This work investigates pre-learning a two-layer extension of the transform model for image reconstruction, wherein the transform domain or filtering residuals of the image are further sparsified in the second layer. The proposed block coordinate descent optimization algorithms involve highly efficient updates. Preliminary numerical experiments demonstrate the usefulness of a two-layer model over the previous related schemes for CT image reconstruction from low-dose measurements.


title: A Longitudinal Analysis of Online Ad-Blocking Blacklists

abstract: Websites employ third-party ads and tracking services leveraging cookies and JavaScript code, to deliver ads and track users' behavior, causing privacy concerns. To limit online tracking and block advertisements, several ad-blocking (black) lists have been curated consisting of URLs and domains of well-known ads and tracking services. Using Internet Archive's Wayback Machine in this paper, we collect a retrospective view of the Web to analyze the evolution of ads and tracking services and evaluate the effectiveness of ad-blocking blacklists. We propose metrics to capture the efficacy of ad-blocking blacklists to investigate whether these blacklists have been reactive or proactive in tackling the online ad and tracking services. We introduce a stability metric to measure the temporal changes in ads and tracking domains blocked by ad-blocking blacklists, and a diversity metric to measure the ratio of new ads and tracking domains detected. We observe that ads and tracking domains in websites change over time, and among the ad-blocking blacklists that we investigated, our analysis reveals that some blacklists were more informed with the existence of ads and tracking domains, but their rate of change was slower than other blacklists. Our analysis also shows that Alexa top 5K websites in the US, Canada, and the UK have the most number of ads and tracking domains per website, and have the highest proactive scores. This suggests that ad-blocking blacklists are updated by prioritizing ads and tracking domains reported in the popular websites from these countries.


title: Carbon nanotube synthesis from propane decomposition on a pre-treated Ni overlayer

abstract: Growth of carbon nanotubes (CNTs) was performed by atmospheric pressure chemical vapour deposition (APCVD) of propane on Si(111) with a pre-treated Ni overlayer acting as a catalyst. Prior to the growth of CNTs, a thin film of Ni was deposited on Si(111) substrate by evaporation and heat treated at 900{\deg}C. The growth of nanotubes was carried out at 850{\deg}C using propane as a source of carbon. Distribution of the catalyst particles over the Si substrate was analysed before and after heat treatment by atomic force microscopy (AFM). The X-ray diffraction (XRD) pattern of the grown material revealed that they are graphitic in nature. Field emission scanning electron microscopy (FESEM) was used to investigate the growth process and it was found that a catalytic particle was always situated at the tip of the tube thus implying a tip growth mechanism. Evidence for the presence of radial breathing mode from multi-wall nanotubes (MWNTs) in the grown sample was obtained from micro-Raman analysis. Finally, high-resolution transmission electron microscopic (HRTEM) analysis confirmed that the graphene layers of the CNTs are well ordered with typical 0.34 nm spacing.


title: Statistical analysis of the water level of Huang He river (Yellow river) in China

abstract: Very high water levels of the large rivers are extremely dangerous events that can lead to large floods and loss of property and thousands and even tens of thousands human lives. The information from the systematical monitoring of the water levels allows us to obtain probability distributions for the extremely high values of the water levels of the rivers of interest. In this article we study time series containing information from more than 10 years of satellite observation of the water level of the Huang He river (Yellow river) in China. We show that the corresponding extreme values distribution is the Weibull distribution and determine the parameters of the distribution. The obtained results may help for evaluation of risks associated with floods for the population and villages in the corresponding region of the Huang He river.


title: Magnetism in spin crossover systems: short-range order and effects beyond the Heisenberg model

abstract: To study non-Heisenberg effects in the vicinity of spin crossover in strongly correlated electron systems we derive an effective low-energy Hamiltonian for the two-band Kanamori model. It contains Heisenberg high-spin term proportional to exchange constant as well as low-spin term proportional to spin gap parameter $\varepsilon_s$. Using cluster mean field theory we obtain several non-Heisenberg effects. Near critical value of spin gap $\varepsilon^c_s$ there is a magnetic phase transition of first order. In the vicinity of $\varepsilon^c_s$ in the paramagnetic phase we observe non trivial behavior of the Curie constant in the paramagnetic susceptibility in the wide range of temperature. Reentrant temperature behavior of nearest-neighbor spin-spin correlations is observed at $\varepsilon_s > \varepsilon^c_s$. Finally, pressure-temperature magnetic phase diagram for ferroperriclase is obtained using the effective Hamiltonian.


title: Automated Machine Learning with Monte-Carlo Tree Search

abstract: The AutoML task consists of selecting the proper algorithm in a machine learning portfolio, and its hyperparameter values, in order to deliver the best performance on the dataset at hand. Mosaic, a Monte-Carlo tree search (MCTS) based approach, is presented to handle the AutoML hybrid structural and parametric expensive black-box optimization problem. Extensive empirical studies are conducted to independently assess and compare: i) the optimization processes based on Bayesian optimization or MCTS; ii) its warm-start initialization; iii) the ensembling of the solutions gathered along the search. Mosaic is assessed on the OpenML 100 benchmark and the Scikit-learn portfolio, with statistically significant gains over Auto-Sklearn, winner of former international AutoML challenges.


title: Radiation hardness of a p-channel notch CCD developed for the X-ray CCD camera onboard the XRISM satellite

abstract: We report the radiation hardness of a p-channel CCD developed for the X-ray CCD camera onboard the XRISM satellite. This CCD has basically the same characteristics as the one used in the previous Hitomi satellite, but newly employs a notch structure of potential for signal charges by increasing the implant concentration in the channel. The new device was exposed up to approximately $7.9 \times 10^{10} \mathrm{~protons~cm^{-2}}$ at 100 MeV. The charge transfer inefficiency was estimated as a function of proton fluence with an ${}^{55} \mathrm{Fe}$ source. A device without the notch structure was also examined for comparison. The result shows that the notch device has a significantly higher radiation hardness than those without the notch structure including the device adopted for Hitomi. This proves that the new CCD is radiation tolerant for space applications with a sufficient margin.


title: Equivariant Grothendieck-Riemann-Roch theorem via formal deformation theory

abstract: We use the formalism of traces in higher categories to prove a common generalization of the holomorphic Atiyah-Bott fixed point formula and the Grothendieck-Riemann-Roch theorem. The proof is quite different from the original one proposed by Grothendieck et al.: it relies on the interplay between self dualities of quasi- and ind- coherent sheaves on $X$ and formal deformation theory of Gaitsgory-Rozenblyum. In particular, we give a description of the Todd class in terms of the difference of two formal group structures on the derived loop scheme $\mathcal LX$. The equivariant case is reduced to the non-equivariant one by a variant of the Atiyah-Bott localization theorem.


title: SILVERRUSH. IX. Lya Intensity Mapping with Star-Forming Galaxies at z=5.7 and 6.6: A Possible Detection of Extended Lya Emission at $\gtrsim$100 comoving kpc around and beyond the Virial-Radius Scale of Galaxy Dark Matter Halos

abstract: We present results of the cross-correlation Ly$\alpha$ intensity mapping with Subaru/Hyper Suprime-Cam (HSC) ultra-deep narrowband images and Ly$\alpha$ emitters (LAEs) at $z=5.7$ and $6.6$ in a total area of $4$ deg$^2$. Although overwhelming amount of data quality controls have been performed for the narrowband images, we further conduct extensive analysis evaluating systematics of large-scale point-spread-function wings, sky subtractions, and unknown errors based on physically uncorrelated signals and sources found in real HSC images and object catalogs, respectively. Removing the systematics, we carefully calculate cross-correlations between Ly$\alpha$ intensity of the narrowband images and the LAEs. We tentatively identify very diffuse Ly$\alpha$ emission with the $\simeq 3\sigma$ ($\simeq 2\sigma$) significance at $\gtrsim$ 100 comoving kpc (ckpc) far from the LAEs at $z=5.7$ ($6.6$), around and probably even beyond a virial radius of star-forming galaxies with $M_\mathrm{h}\sim10^{11}M_\odot$. The diffuse Ly$\alpha$ emission possibly extends up to $1$,$000$ ckpc with the surface brightness of $10^{-20}$-$10^{-19}$ erg s$^{-1}$ cm$^{-2}$ arcsec$^{-2}$. We confirm that the small-scale ($<150$ ckpc) Ly$\alpha$ radial profiles of LAEs are consistent with those obtained by recent MUSE observations. Comparisons with numerical simulations suggest that the large-scale ($\sim150$-$1$,$000$ ckpc) Ly$\alpha$ emission are not explained by unresolved faint neighboring galaxies including satellites, but by a combination of Ly$\alpha$ photons emitted from the central LAE and other unknown sources, such as cold-gas streams and galactic outflow. We find no evolution in the Ly$\alpha$ radial profiles of our LAEs from $z=5.7$ to $6.6$, where theoretical models predict a flattening of the profile slope made by cosmic reionization, albeit with our moderately large observational errors.


title: Ultralow lattice thermal conductivity and electronic properties of monolayer 1T phase semimetal SiTe2 and SnTe2

abstract: 2H phase (trigonal prismatic D3h) of layered two-dimensional (2D) transition metal dichalcogenides (TMDs) have attracted a lot of interests due to the superior electronic and optoelectronic properties. However, flexible electronic devices and thermoelectric performances based on 2H phase have been potentially limited by the strain sensitive electronic band gap and high lattice thermal conductivity (kappa_L). Here, we predict and calculate two 1T (octahedral Oh) phase monolayer telluride materials SnTe2 and SiTe2 with soft mechanics, ultralow kappa_L and electronic properties. The calculated in-plane Young's modulus of monolayer SnTe2 is softer than most of 1T-MX2 compounds. Furthermore, monolayer SiTe2 and SnTe2 also have relatively flexible electronic properties under large biaxial strain, indicating potential flexible electrode materials. Meanwhile, monolayer SiTe2 and SnTe2 both exhibit ultralow \k{appa}_L (2.27 W/mK of SiTe2 and 1.62 W/mK of SnTe2) at room temperature. Considering both acoustic and polar optical phonon scattering of the electronic relaxation time, the figure of merit (ZT) can achieve 0.46 at 600 K and 0.71 at 900 K for monolayer SiTe2 and SnTe2 respectively.


title: The structure of cold neutron star with a quark core within the MIT and NJL models

abstract: Neutron star due to their high interior matter density are expected to be composed of a quark core, a mixed quark-hadron matter, and a layer of hadronic matter. Thus, in this paper, we compute the equation of state of these parts of neutron star to evaluate its structure properties. We use two models for describing EOS of quark matter, NJL and MIT bag models, and employ three approaches in this work. A density dependent bag constant satisfy the quark confinement in the simple MIT bag model. We also study the interaction behavior of quarks, firstly one gluon exchange within MIT bag model and the secondly dynamical mass will be held as effective interaction that roles between particles. Density dependence of quark mass is obtained from NJL self consistent model. NJL model is a effective manner for justify the chiral symmetry. Applying the Gibbs conditions the equation of state of the quarks and hadrons mixed phase is obtained. Since the hadronic matter is under the influence of strong force of nucleons, we calculate the equation of state of this phase using a powerful variational many-body technique. Finally, we calculate the mass and radius of a cold neutron star with a quark core by numerically solving the TOV equation. To check our used EOS, we compare our results with the recent observational data. Our results are in a good agreement with some observed compact objects such as $SAXJ1748.9-2021$, $4U1608-52$ and $Vela X-1$.


title: Dark matter search in missing energy events with NA64

abstract: A search for sub-GeV dark matter production mediated by a new vector boson $A'$, called dark photon, is performed by the NA64 experiment in missing energy events from 100 GeV electron interactions in an active beam dump at the CERN SPS. From the analysis of the data collected in the years 2016, 2017, and 2018 with $2.84\times10^{11}$ electrons on target no evidence of such a process has been found. The most stringent constraints on the $A'$ mixing strength with photons and the parameter space for the scalar and fermionic dark matter in the mass range $\lesssim 0.2$ GeV are derived, thus demonstrating the power of the active beam dump approach for the dark matter search.


title: Exact Optimization: Part I

abstract: Nonlinear programming is explicitly analyzed via a novel perspective/method and from a bottom-up manner. The philosophy is based on the recent findings on convex quadratic equation (CQE), which help clarify a geometric interpretation that relates CQE to convex quadratic function (CQF). More specifically, regarding the solvability of CQE, its necessary and sufficient condition as well as a unified parameterization of all the solutions has recently been analytically formulated. Moving forward, the understanding of CQE is utilized to describe the geometric structure of CQF, and the CQE-CQF relation. All these results are shown closely related to a basis in the optimization literature, namely quadratic programming (QP). For the first time from this viewpoint, the QPs subject to equality, inequality, equality-and-inequality, and extended constraints can be algebraically solved in derivative-free closed formulae, respectively. All the results are derived without knowing a feasible point, a priori and any time during the process.


title: High Thermoelectric Performance in Two-Dimensional Tellurium: An Ab Initio Study

abstract: In 2016, bulk tellurium was experimentally observed as a remarkable thermoelectric material. Recently, two-dimensional (2D) tellurium, called tellurene, has been synthesized and has exhibited unexpected electronic properties compared with the 2D MoS$_2$. They have also been fabricated into air-stable and high efficient field-effect transistors. There are two stable 2D tellurene phases. One ($\beta$-Te) has been confirmed with an ultralow lattice thermal conductivity ($\kappa_L$). However, the study of the transport properties of the other more stable phase, $\alpha$-Te, is still lacking. Here, we report the thermoelectric performance and phonon properties of $\alpha$-Te using Boltzmann transport theory and first principle calculations. A maximum ZT value of 0.83 is achieved under reasonable hole concentration, suggesting that the monolayer $\alpha$-Te is a potential competitor in the thermoelectric field.


title: Enriching Ontology-based Data Access with Provenance (Extended Version)

abstract: Ontology-based data access (OBDA) is a popular paradigm for querying heterogeneous data sources by connecting them through mappings to an ontology. In OBDA, it is often difficult to reconstruct why a tuple occurs in the answer of a query. We address this challenge by enriching OBDA with provenance semirings, taking inspiration from database theory. In particular, we investigate the problems of (i) deciding whether a provenance annotated OBDA instance entails a provenance annotated conjunctive query, and (ii) computing a polynomial representing the provenance of a query entailed by a provenance annotated OBDA instance. Differently from pure databases, in our case these polynomials may be infinite. To regain finiteness, we consider idempotent semirings, and study the complexity in the case of DL-Lite ontologies. We implement Task (ii) in a state-of-the-art OBDA system and show the practical feasibility of the approach through an extensive evaluation against two popular benchmarks.


title: Siamese recurrent networks learn first-order logic reasoning and exhibit zero-shot compositional generalization

abstract: Can neural nets learn logic? We approach this classic question with current methods, and demonstrate that recurrent neural networks can learn to recognize first order logical entailment relations between expressions. We define an artificial language in first-order predicate logic, generate a large dataset of sample 'sentences', and use an automatic theorem prover to infer the relation between random pairs of such sentences. We describe a Siamese neural architecture trained to predict the logical relation, and experiment with recurrent and recursive networks. Siamese Recurrent Networks are surprisingly successful at the entailment recognition task, reaching near perfect performance on novel sentences (consisting of known words), and even outperforming recursive networks. We report a series of experiments to test the ability of the models to perform compositional generalization. In particular, we study how they deal with sentences of unseen length, and sentences containing unseen words. We show that set-ups using LSTMs and GRUs obtain high scores on these tests, demonstrating a form of compositionality.


title: Learning to Transfer: Unsupervised Meta Domain Translation

abstract: Unsupervised domain translation has recently achieved impressive performance with Generative Adversarial Network (GAN) and sufficient (unpaired) training data. However, existing domain translation frameworks form in a disposable way where the learning experiences are ignored and the obtained model cannot be adapted to a new coming domain. In this work, we take on unsupervised domain translation problems from a meta-learning perspective. We propose a model called Meta-Translation GAN (MT-GAN) to find good initialization of translation models. In the meta-training procedure, MT-GAN is explicitly trained with a primary translation task and a synthesized dual translation task. A cycle-consistency meta-optimization objective is designed to ensure the generalization ability. We demonstrate effectiveness of our model on ten diverse two-domain translation tasks and multiple face identity translation tasks. We show that our proposed approach significantly outperforms the existing domain translation methods when each domain contains no more than ten training samples.


title: Average-case Analysis of the Assignment Problem with Independent Preferences

abstract: The fundamental assignment problem is in search of welfare maximization mechanisms to allocate items to agents when the private preferences over indivisible items are provided by self-interested agents. The mainstream mechanism \textit{Random Priority} is asymptotically the best mechanism for this purpose, when comparing its welfare to the optimal social welfare using the canonical \textit{worst-case approximation ratio}. Despite its popularity, the efficiency loss indicated by the worst-case ratio does not have a constant bound. Recently, [Deng, Gao, Zhang 2017] show that when the agents' preferences are drawn from a uniform distribution, its \textit{average-case approximation ratio} is upper bounded by 3.718. They left it as an open question of whether a constant ratio holds for general scenarios. In this paper, we offer an affirmative answer to this question by showing that the ratio is bounded by $1/\mu$ when the preference values are independent and identically distributed random variables, where $\mu$ is the expectation of the value distribution. This upper bound also improves the upper bound of 3.718 in [Deng, Gao, Zhang 2017] for the Uniform distribution. Moreover, under mild conditions, the ratio has a \textit{constant} bound for any independent random values. En route to these results, we develop powerful tools to show the insights that in most instances the efficiency loss is small.


title: Relay-Aided Channel Estimation for mmWave Systems with Imperfect Antenna Arrays

abstract: Compressed Sensing (CS) based channel estimation techniques have recently emerged as an effective way to acquire the channel of millimeter-wave (mmWave) systems with a small number of measurements. These techniques, however, are based on prior knowledge of transmit and receive array manifolds, and assume perfect antenna arrays at both the transmitter and the receiver. In the presence of antenna imperfections, the geometry and response of the arrays are modified. This distorts the CS measurement matrix and results in channel estimation errors. This paper studies the effects of both transmit and receive antenna imperfections on the mmWave channel estimate. A relay-aided solution which corrects for errors caused by faulty transmit arrays is then proposed. Simulation results demonstrate the effectiveness of the proposed solution and show that comparable channel estimates can be obtained when compared to systems with perfect antennas without the need for additional training overhead.


title: ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translation

abstract: Image-to-image translation models have shown remarkable ability on transferring images among different domains. Most of existing work follows the setting that the source domain and target domain keep the same at training and inference phases, which cannot be generalized to the scenarios for translating an image from an unseen domain to another unseen domain. In this work, we propose the Unsupervised Zero-Shot Image-to-image Translation (UZSIT) problem, which aims to learn a model that can translate samples from image domains that are not observed during training. Accordingly, we propose a framework called ZstGAN: By introducing an adversarial training scheme, ZstGAN learns to model each domain with domain-specific feature distribution that is semantically consistent on vision and attribute modalities. Then the domain-invariant features are disentangled with an shared encoder for image generation. We carry out extensive experiments on CUB and FLO datasets, and the results demonstrate the effectiveness of proposed method on UZSIT task. Moreover, ZstGAN shows significant accuracy improvements over state-of-the-art zero-shot learning methods on CUB and FLO.


title: Embedding topological spaces into Hausdorff $\kappa$-bounded spaces

abstract: Let $\kappa$ be an infinite cardinal. A topological space $X$ is $\kappa$-bounded if the closure of any subset of cardinality $\le\kappa$ in $X$ is compact. We discuss the problem of embeddability of topological spaces into Hausdorff (Urysohn, regular) $\kappa$-bounded spaces, and present a canonical construction of such an embedding. Also we construct a (consistent) example of a sequentially compact separable regular space that cannot be embedded into a Hausdorff $\omega$-bounded space.


title: On the Fairness Performance of NOMA-based Wireless Powered Communication Networks

abstract: The near-far problem causes severe throughput unfairness in wireless powered communication networks (WPCN). In this paper, we exploit non-orthogonal multiple access (NOMA) technology and propose a fairness-aware NOMA-based scheduling scheme to mitigate the near-far effect and to enhance the max-min fairness. Specifically, we sort all users according to their channel conditions and divide them into two groups, the interference group with high channel gains and the noninterference group with low channel gains. The power station (PS) concurrently transmits energy signals with the data transmissions of the users in the interference group. Thus, the users in the noninterference group can harvest more energy and achieve a higher throughput, while the users in the interference group degrade their performance due to the interfering signals from the PS. We then apply order statistic theory to analyze the achievable rates of ordered users, based on which all users are appropriately grouped for NOMA transmission to achieve the max-min fairness of the system. Meanwhile, the optimal number of interfered users that determines the set of users in each group, is derived. Our simulation results validate the significant improvement of both network fairness and throughput via the fairness-aware NOMA-based scheduling scheme.


title: The orthogonal complement of the Hilbert space associated to holomorphic Hermite polynomials

abstract: We study the orthogonal complement of the Hilbert subspace considered by by van Eijndhoven and Meyers in [J. Math. Anal. Appl. 146 (1990), no. 1, 89--98} and associated to holomorphic Hermite polynomials. A polyanalytic orthonormal basis is given and the explicit expressions of the corresponding reproducing kernel functions and Segal--Bargmann integral transforms are provided.


title: The pairwise hydrodynamic interactions of synchronized spermatozoa

abstract: The journey of mammalian spermatozoa in nature is well-known to be reliant on their individual motility. Often swimming in crowded microenvironments, the progress of any single swimmer is likely dependent on their interactions with other nearby swimmers. Whilst the complex dynamics of lone spermatozoa have been well-studied, the detailed effects of hydrodynamic interactions between neighbors remain unclear, with inherent nonlinearity in the governing hydrodynamics and potential dependence on the details of swimmer morphology. In this study we will attempt to elucidate the pairwise swimming behaviors of virtual spermatozoa, forming a computational representation of an unbound swimming pair and evaluating the details of their interactions via a high-accuracy boundary element method. We have explored extensive regions of parameter space to determine the pairwise interactions of synchronized spermatozoa, with synchronized swimmers often being noted in experimental observations, and have found that two-dimensional reduced autonomous dynamical systems capture the anisotropic nature of the swimming speed and stability arising from near-field hydrodynamic interactions. Focusing on two configurations of spermatozoa, namely those with swimmers located side-by-side or above and below one another, we have found that side-by-side cells attract each other, and the trajectories in the phase plane are well captured by a recently-proposed coarse-graining method of microswimmer dynamics via superposed regularised Stokeslets. In contrast, the above-below pair exhibit a remarkable stable pairwise swimming behavior, corresponding to a stable configuration of the plane autonomous system with swimmers lying approximately parallel to one another....


title: Are Anchor Points Really Indispensable in Label-Noise Learning?

abstract: In label-noise learning, \textit{noise transition matrix}, denoting the probabilities that clean labels flip into noisy labels, plays a central role in building \textit{statistically consistent classifiers}. Existing theories have shown that the transition matrix can be learned by exploiting \textit{anchor points} (i.e., data points that belong to a specific class almost surely). However, when there are no anchor points, the transition matrix will be poorly learned, and those current consistent classifiers will significantly degenerate. In this paper, without employing anchor points, we propose a \textit{transition-revision} ($T$-Revision) method to effectively learn transition matrices, leading to better classifiers. Specifically, to learn a transition matrix, we first initialize it by exploiting data points that are similar to anchor points, having high \textit{noisy class posterior probabilities}. Then, we modify the initialized matrix by adding a \textit{slack variable}, which can be learned and validated together with the classifier by using noisy data. Empirical results on benchmark-simulated and real-world label-noise datasets demonstrate that without using exact anchor points, the proposed method is superior to the state-of-the-art label-noise learning methods.


title: Neural Replicator Dynamics

abstract: Policy gradient and actor-critic algorithms form the basis of many commonly used training techniques in deep reinforcement learning. Using these algorithms in multiagent environments poses problems such as nonstationarity and instability. In this paper, we first demonstrate that standard softmax-based policy gradient can be prone to poor performance in the presence of even the most benign nonstationarity. By contrast, it is known that the replicator dynamics, a well-studied model from evolutionary game theory, eliminates dominated strategies and exhibits convergence of the time-averaged trajectories to interior Nash equilibria in zero-sum games. Thus, using the replicator dynamics as a foundation, we derive an elegant one-line change to policy gradient methods that simply bypasses the gradient step through the softmax, yielding a new algorithm titled Neural Replicator Dynamics (NeuRD). NeuRD reduces to the exponential weights/Hedge algorithm in the single-state all-actions case. Additionally, NeuRD has formal equivalence to softmax counterfactual regret minimization, which guarantees convergence in the sequential tabular case. Importantly, our algorithm provides a straightforward way of extending the replicator dynamics to the function approximation setting. Empirical results show that NeuRD quickly adapts to nonstationarities, outperforming policy gradient significantly in both tabular and function approximation settings, when evaluated on the standard imperfect information benchmarks of Kuhn Poker, Leduc Poker, and Goofspiel.


title: On problems related to crossing families

abstract: Given a set of points in the plane, a \emph{crossing family} is a collection of segments, each joining two of the points, such that every two segments intersect internally. Aronov et al. [Combinatorica,~14(2):127-134,~1994] proved that any set of $n$ points contains a crossing family of size $\Omega(\sqrt{n})$. They also mentioned that there exist point sets whose maximum crossing family uses at most $\frac{n}{2}$ of the points. We improve the upper bound on the size of crossing families to $5\lceil \frac{n}{24} \rceil$. We also introduce a few generalizations of crossing families, and give several lower and upper bounds on our generalized notions.


title: Closed-Form Analysis of Non-Linear Age-of-Information in Status Updates with an Energy Harvesting Transmitter

abstract: Timely status updates are crucial to enabling applications in massive Internet of Things (IoT). This paper measures the data-freshness performance of a status update system with an energy harvesting transmitter, considering the randomness in information generation, transmission and energy harvesting. The performance is evaluated by a non-linear function of age of information (AoI) that is defined as the time elapsed since the generation of the most up-to-date status information at the receiver. The system is formulated as two queues with status packet generation and energy arrivals both assumed to be Poisson processes. With negligible service time, both First-Come-First-Served (FCFS) and Last-Come-First-Served (LCFS) disciplines for arbitrary buffer and battery capacities are considered, and a method for calculating the average penalty with non-linear penalty functions is proposed. The average AoI, the average penalty under exponential penalty function, and AoI's threshold violation probability are obtained in closed form. When the service time is assumed to follow exponential distribution, matrix geometric method is used to obtain the average peak AoI. The results illustrate that under the FCFS discipline, the status update frequency needs to be carefully chosen according to the service rate and energy arrival rate in order to minimize the average penalty.


title: A mean-field limit for certain deep neural networks

abstract: Understanding deep neural networks (DNNs) is a key challenge in the theory of machine learning, with potential applications to the many fields where DNNs have been successfully used. This article presents a scaling limit for a DNN being trained by stochastic gradient descent. Our networks have a fixed (but arbitrary) number $L\geq 2$ of inner layers; $N\gg 1$ neurons per layer; full connections between layers; and fixed weights (or "random features" that are not trained) near the input and output. Our results describe the evolution of the DNN during training in the limit when $N\to +\infty$, which we relate to a mean field model of McKean-Vlasov type. Specifically, we show that network weights are approximated by certain "ideal particles" whose distribution and dependencies are described by the mean-field model. A key part of the proof is to show existence and uniqueness for our McKean-Vlasov problem, which does not seem to be amenable to existing theory. Our paper extends previous work on the $L=1$ case by Mei, Montanari and Nguyen; Rotskoff and Vanden-Eijnden; and Sirignano and Spiliopoulos. We also complement recent independent work on $L>1$ by Sirignano and Spiliopoulos (who consider a less natural scaling limit) and Nguyen (who nonrigorously derives similar results).


title: Search for $\Omega(2012)\to K\Xi(1530) \to K\pi\Xi$ at Belle

abstract: Using data samples of $e^+e^-$ collisions collected at the $\Upsilon(1S)$, $\Upsilon(2S)$, and $\Upsilon(3S)$ resonances with the Belle detector, we search for the three-body decay of the $\Omega(2012)$ baryon to $K\pi\Xi$. This decay is predicted to dominate for models describing the $\Omega(2012)$ as a $K\Xi(1530)$ molecule. No significant $\Omega(2012)$ signals are observed in the studied channels, and 90\% credibility level upper limits on the ratios of the branching fractions relative to $K \Xi$ decay modes are obtained.


title: Multivariate, Multistep Forecasting, Reconstruction and Feature Selection of Ocean Waves via Recurrent and Sequence-to-Sequence Networks

abstract: This article explores the concepts of ocean wave multivariate multistep forecasting, reconstruction and feature selection. We introduce recurrent neural network frameworks, integrated with Bayesian hyperparameter optimization and Elastic Net methods. We consider both short- and long-term forecasts and reconstruction, for significant wave height and output power of the ocean waves. Sequence-to-sequence neural networks are being developed for the first time to reconstruct the missing characteristics of ocean waves based on information from nearby wave sensors. Our results indicate that the Adam and AMSGrad optimization algorithms are the most robust ones to optimize the sequence-to-sequence network. For the case of significant wave height reconstruction, we compare the proposed methods with alternatives on a well-studied dataset. We show the superiority of the proposed methods considering several error metrics. We design a new case study based on measurement stations along the east coast of the United States and investigate the feature selection concept. Comparisons substantiate the benefit of utilizing Elastic Net. Moreover, case study results indicate that when the number of features is considerable, having deeper structures improves the performance.


title: Magnetic Skyrmion Annihilation by Quantum Mechanical Tunneling

abstract: Magnetic skyrmions are nano-scale magnetic states that could be used in various spintronics devices. A central issue is the mechanism and rate of various possible annihilation processes and the lifetime of metastable skyrmions. While most studies have focused on classical over-the-barrier mechanism for annihilation, it is also possible that quantum mechanical tunneling through the energy barrier takes place. Calculations of the lifetime of magnetic skyrmions in a two-dimensional lattice are presented and the rate of tunneling compared with the classical annihilation rate. A remarkably strong variation in the crossover temperature and the lifetime of the skyrmion is found as a function of the values of parameters in the extended Heisenberg Hamiltonian, i.e. the out-of-plane anisotropy, Dzyaloshinskii-Moriya interaction (DMI) and applied magnetic field. Materials parameters and conditions are identified where the onset of tunneling could be observed on a laboratory time scale. In particular, it is predicted that skyrmion tunneling could be observed in the PdFe/Ir(111) system when an external magnetic field on the order of 6 T is applied.


title: Probabilistic QoS-aware Placement of VNF chains at the Edge

abstract: Deploying IoT-enabled Virtual Network Function (VNF) chains to Cloud-Edge infrastructures requires determining a placement for each VNF that satisfies all set deployment requirements as well as a software-defined routing of traffic flows between consecutive functions that meets all set communication requirements. In this article, we present a declarative solution, EdgeUsher, to the problem of how to best place VNF chains to Cloud-Edge infrastructures. EdgeUsher can determine all eligible placements for a set of VNF chains to a Cloud-Edge infrastructure so to satisfy all of their hardware, IoT, security, bandwidth, and latency requirements. It exploits probability distributions to model the dynamic variations in the available Cloud-Edge infrastructure, and to assess output eligible placements against those variations.


title: nprobust: Nonparametric Kernel-Based Estimation and Robust Bias-Corrected Inference

abstract: Nonparametric kernel density and local polynomial regression estimators are very popular in Statistics, Economics, and many other disciplines. They are routinely employed in applied work, either as part of the main empirical analysis or as a preliminary ingredient entering some other estimation or inference procedure. This article describes the main methodological and numerical features of the software package nprobust, which offers an array of estimation and inference procedures for nonparametric kernel-based density and local polynomial regression methods, implemented in both the R and Stata statistical platforms. The package includes not only classical bandwidth selection, estimation, and inference methods (Wand and Jones, 1995; Fan and Gijbels, 1996), but also other recent developments in the statistics and econometrics literatures such as robust bias-corrected inference and coverage error optimal bandwidth selection (Calonico, Cattaneo and Farrell, 2018, 2019). Furthermore, this article also proposes a simple way of estimating optimal bandwidths in practice that always delivers the optimal mean square error convergence rate regardless of the specific evaluation point, that is, no matter whether it is implemented at a boundary or interior point. Numerical performance is illustrated using an empirical application and simulated data, where a detailed numerical comparison with other R packages is given.


title: Bayesian Deconditional Kernel Mean Embeddings

abstract: Conditional kernel mean embeddings form an attractive nonparametric framework for representing conditional means of functions, describing the observation processes for many complex models. However, the recovery of the original underlying function of interest whose conditional mean was observed is a challenging inference task. We formalize deconditional kernel mean embeddings as a solution to this inverse problem, and show that it can be naturally viewed as a nonparametric Bayes' rule. Critically, we introduce the notion of task transformed Gaussian processes and establish deconditional kernel means as their posterior predictive mean. This connection provides Bayesian interpretations and uncertainty estimates for deconditional kernel mean embeddings, explains their regularization hyperparameters, and reveals a marginal likelihood for kernel hyperparameter learning. These revelations further enable practical applications such as likelihood-free inference and learning sparse representations for big data.


title: Design, Fabrication and 3D Volumetric Characterization Criteria for Plasmonic Bullseye Structures

abstract: In this report, certain claims regarding the design criteria and characterizations of plasmonic bullseye (BE) structures are investigated. Does the matching of the grating's periodicity to the wavelength of surface waves results in a strong collimated beam along the optical axis of the device? What are the requirements for such devices if they are set to enhance the radiative decay rate of a quantum emitter? These questions are answered by proposing and modelling a new bullseye structure, optimized based on maximization of the far-field intensity along the optical axis. Dimensions and the performance of the proposed BE are then compared to that reported by another author. The other question to be answered is the characterizations techniques. What is the best approach in characterizing such devices? How many focal points are there along the optical axis? What are the strengths and depths of focus at each point? How collimated is the output beam? Techniques proposed by other authors are debated and a technique based on 3D confocal microscopy is proposed and applied experimentally to the alternative proposed device.


title: On the enlargement of habitable zones around binary stars in hostile environments

abstract: We investigate the hypothesis that the size of the habitable zone around hardened binaries in dense star-forming regions increases. Our results indicate that this hypothesis is essentially incorrect. Although certain binary star configurations permit extended habitable zones, such setups typically require all orbits in a system to be near circular. In all other cases planets can only remain habitable if they display an extraordinarily high climate inertia.


title: lspartition: Partitioning-Based Least Squares Regression

abstract: Nonparametric partitioning-based least squares regression is an important tool in empirical work. Common examples include regressions based on splines, wavelets, and piecewise polynomials. This article discusses the main methodological and numerical features of the R software package lspartition, which implements modern estimation and inference results for partitioning-based least squares (series) regression estimation. This article discusses the main methodological and numerical features of the R software package lspartition, which implements results for partitioning-based least squares (series) regression estimation and inference from Cattaneo and Farrell (2013) and Cattaneo, Farrell, and Feng (2019). These results cover the multivariate regression function as well as its derivatives. First, the package provides data-driven methods to choose the number of partition knots optimally, according to integrated mean squared error, yielding optimal point estimation. Second, robust bias correction is implemented to combine this point estimator with valid inference. Third, the package provides estimates and inference for the unknown function both pointwise and uniformly in the conditioning variables. In particular, valid confidence bands are provided. Finally, an extension to two-sample analysis is developed, which can be used in treatment-control comparisons and related problems


title: Statistical properties of the velocity field for the 3D hydrodynamic turbulence onset

abstract: We study the statistical correlation functions for the three-dimensional hydrodynamic turbulence onset when the dynamics is dominated by the pancake-like high-vorticity structures. With extensive numerical simulations, we systematically examine the two-points structure functions (moments) of velocity. We observe formation of the power-law scaling for both the longitudinal and the transversal moments in the same interval of scales as for the energy spectrum. The scaling exponents for the velocity structure functions demonstrate the same key properties as for the stationary turbulence case. In particular, the exponents depend on the order of the moment non-trivially, indicating the intermittency and the anomalous scaling, and the longitudinal exponents turn out to be slightly larger than the transversal ones. When the energy spectrum has power-law scaling close to the Kolmogorov's one, the longitudinal third-order moment shows close to linear scaling with the distance, in line with the Kolmogorov's 4/5-law despite the strong anisotropy.


title: Perceptual Evaluation of Adversarial Attacks for CNN-based Image Classification

abstract: Deep neural networks (DNNs) have recently achieved state-of-the-art performance and provide significant progress in many machine learning tasks, such as image classification, speech processing, natural language processing, etc. However, recent studies have shown that DNNs are vulnerable to adversarial attacks. For instance, in the image classification domain, adding small imperceptible perturbations to the input image is sufficient to fool the DNN and to cause misclassification. The perturbed image, called \textit{adversarial example}, should be visually as close as possible to the original image. However, all the works proposed in the literature for generating adversarial examples have used the $L_{p}$ norms ($L_{0}$, $L_{2}$ and $L_{\infty}$) as distance metrics to quantify the similarity between the original image and the adversarial example. Nonetheless, the $L_{p}$ norms do not correlate with human judgment, making them not suitable to reliably assess the perceptual similarity/fidelity of adversarial examples. In this paper, we present a database for visual fidelity assessment of adversarial examples. We describe the creation of the database and evaluate the performance of fifteen state-of-the-art full-reference (FR) image fidelity assessment metrics that could substitute $L_{p}$ norms. The database as well as subjective scores are publicly available to help designing new metrics for adversarial examples and to facilitate future research works.


title: Effective dimension reduction with mode transformations: Simulating two-dimensional fermionic condensed matter systems

abstract: Tensor network methods have progressed from variational techniques based on matrix-product states able to compute properties of one-dimensional condensed-matter lattice models into methods rooted in more elaborate states such as projected entangled pair states aimed at simulating the physics of two-dimensional models. In this work, we advocate the paradigm that for two-dimensional fermionic models, matrix-product states are still applicable to significantly higher accuracy levels than direct embeddings into one-dimensional systems allow for. To do so, we exploit schemes of fermionic mode transformations and overcome the prejudice that one-dimensional embeddings need to be local. This approach takes the insight seriously that the suitable exploitation of both the manifold of matrix-product states and the unitary manifold of mode transformations can more accurately capture the natural correlation structure. By demonstrating the residual low levels of entanglement in emerging modes, we show that matrix-product states can describe ground states strikingly well. The power of the approach is exemplified by investigating a phase transition of spin-less fermions for lattice sizes up to 10x10.


title: A self-adjointness criterion for the Schr\"odinger operator with infinitely many point interactions and its application to random operators

abstract: We prove the Schr\"odinger operator with infinitely many point interactions in $\mathbb{R}^d$ $(d=1,2,3)$ is self-adjoint if the support of the interactions is decomposed into uniformly discrete clusters. Using this fact, we prove the self-adjointness of the Schr\"odinger operator with point interactions on a random perturbation of a lattice or on the Poisson configuration. We also determine the spectrum of the Schr\"odinger operators with random point interactions of Poisson--Anderson type.


title: SO(8) Supergravity and the Magic of Machine Learning

abstract: Using de Wit-Nicolai $D=4\;\mathcal{N}=8\;SO(8)$ supergravity as an example, we show how modern Machine Learning software libraries such as Google's TensorFlow can be employed to greatly simplify the analysis of high-dimensional scalar sectors of some M-Theory compactifications. We provide detailed information on the location, symmetries, and particle spectra and charges of 192 critical points on the scalar manifold of SO(8) supergravity, including one newly discovered $\mathcal{N}=1$ vacuum with $SO(3)$ residual symmetry, one new potentially stabilizable non-supersymmetric solution, and examples for "Galois conjugate pairs" of solutions, i.e. solution-pairs that share the same gauge group embedding into~$SO(8)$ and minimal polynomials for the cosmological constant. Where feasible, we give analytic expressions for solution coordinates and cosmological constants. As the authors' aspiration is to present the discussion in a form that is accessible to both the Machine Learning and String Theory communities and allows adopting our methods towards the study of other models, we provide an introductory overview over the relevant Physics as well as Machine Learning concepts. This includes short pedagogical code examples. In particular, we show how to formulate a requirement for residual Supersymmetry as a Machine Learning loss function and effectively guide the numerical search towards supersymmetric critical points. Numerical investigations suggest that there are no further supersymmetric vacua beyond this newly discovered fifth solution.


title: RGB and LiDAR fusion based 3D Semantic Segmentation for Autonomous Driving

abstract: LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is degraded. LiDAR perception is gradually becoming mature for algorithms including object detection and SLAM. However, semantic segmentation algorithm remains to be relatively less explored. Motivated by the fact that semantic segmentation is a mature algorithm on image data, we explore sensor fusion based 3D segmentation. Our main contribution is to convert the RGB image to a polar-grid mapping representation used for LiDAR and design early and mid-level fusion architectures. Additionally, we design a hybrid fusion architecture that combines both fusion algorithms. We evaluate our algorithm on KITTI dataset which provides segmentation annotation for cars, pedestrians and cyclists. We evaluate two state-of-the-art architectures namely SqueezeSeg and PointSeg and improve the mIoU score by 10 % in both cases relative to the LiDAR only baseline.


title: Continuum-wise expansive Non-Autonomous Discrete Systems

abstract: In this paper, we study continuum-wise expansive non-autonomous discrete dynamical systems. We discuss various properties of such non-autonomous systems. We further obtain results for cw-expansive non-autonomous systems with shadowing property and obtain an important equivalence. \keywords{Non-autonomous dynamical systems, continuum-wise expansive, shadowing property


title: Theory of skyrmion, meron, anti-skyrmion and anti-meron in chiral magnets

abstract: We find closed-form solution of the Euler equation for a chiral magnet in terms of a skyrmion or a meron depending on the relative strengths of magnetic anisotropy and magnetic field. We show that the relevant length scales for these solutions primarily depend on the strengths of Dzyaloshinskii-Moriya interaction through its ratios, respectively, with magnetic field and magnetic anisotropy. We thus unambiguously determine the parameter dependencies on the radius of the topological structures particularly of the skyrmions, showing an excellent agreement with experiments and first-principle studies. An anisotropic Dzyaloshinskii-Moriya interaction suitable for thin films made with $C_{nv}$ symmetric materials is found to stabilize anti-skyrmion and anti-meron, which are prototypical for $D_{2d}$ symmetric systems, depending on the degree of anisotropy. Based on these solutions, we obtain phase diagram by comparing the energies of various collinear and non-collinear competing phases.


title: Multi-reference factor analysis: low-rank covariance estimation under unknown translations

abstract: We consider the problem of estimating the covariance matrix of a random signal observed through unknown translations (modeled by cyclic shifts) and corrupted by noise. Solving this problem allows to discover low-rank structures masked by the existence of translations (which act as nuisance parameters), with direct application to Principal Components Analysis (PCA). We assume that the underlying signal is of length $L$ and follows a standard factor model with mean zero and $r$ normally-distributed factors. To recover the covariance matrix in this case, we propose to employ the second- and fourth-order shift-invariant moments of the signal known as the $\textit{power spectrum}$ and the $\textit{trispectrum}$. We prove that they are sufficient for recovering the covariance matrix (under a certain technical condition) when $r<\sqrt{L}$. Correspondingly, we provide a polynomial-time procedure for estimating the covariance matrix from many (translated and noisy) observations, where no explicit knowledge of $r$ is required, and prove the procedure's statistical consistency. While our results establish that covariance estimation is possible from the power spectrum and the trispectrum for low-rank covariance matrices, we prove that this is not the case for full-rank covariance matrices. We conduct numerical experiments that corroborate our theoretical findings, and demonstrate the favorable performance of our algorithms in various settings, including in high levels of noise.


title: Caesium fallout in Tokyo on 15th March, 2011 is dominated by highly radioactive, caesium-rich microparticles

abstract: In order to understand the chemical properties and environmental impacts of low-solubility Cs-rich microparticles (CsMPs) derived from the FDNPP, the CsMPs collected from Tokyo were investigated at the atomic scale using high-resolution transmission electron microscopy (HRTEM) and dissolution experiments were performed on the air filters. Remarkably, CsMPs 0.58-2.0 micrometer in size constituted 80%-89% of the total Cs radioactivity during the initial fallout events on 15th March, 2011. The CsMPs from Tokyo and Fukushima exhibit the same texture at the nanoscale: aggregates of Zn-Fe-oxide nanoparticles embedded in amorphous SiO2 glass. The Cs is associated with Zn-Fe-oxide nanoparticles or in the form of nanoscale inclusions of intrinsic Cs species,rather than dissolved in the SiO2 matrix. The Cs concentration in CsMPs from Tokyo (0.55-10.9 wt%) is generally less than that in particles from Fukushima (8.5-12.9 wt%).The radioactivity per unit mass of CsMPs from Tokyo is still as high as 1E11 Bq/g, which is extremely high for particles originating from nuclear accidents. Thus, inhalation of the low-solubility CsMPs would result in a high localized energy deposition by beta (0.51-12)*1E-3 Gy/h within the 100-micrometer-thick water layer on the CsMP surface) and may have longer-term effects compared with those predicted for soluble Cs-species.


title: Production and optical properties of liquid scintillator for the JSNS$^{2}$ experiment

abstract: The JSNS$^{2}$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) experiment will search for neutrino oscillations over a 24 m short baseline at J-PARC. The JSNS$^{2}$ inner detector will be filled with 17 tons of gadolinium-loaded liquid scintillator (LS) with an additional 31 tons of unloaded LS in the intermediate $\gamma$-catcher and outer veto volumes. JSNS$^{2}$ has chosen Linear Alkyl Benzene (LAB) as an organic solvent because of its chemical properties. The unloaded LS was produced at a refurbished facility, originally used for scintillator production by the RENO experiment. JSNS$^{2}$ plans to use ISO tanks for the storage and transportation of the LS. In this paper, we describe the LS production, and present measurements of its optical properties and long term stability. Our measurements show that storing the LS in ISO tanks does not result in degradation of its optical properties.


title: Harnessing Reinforcement Learning for Neural Motion Planning

abstract: Motion planning is an essential component in most of today's robotic applications. In this work, we consider the learning setting, where a set of solved motion planning problems is used to improve the efficiency of motion planning on different, yet similar problems. This setting is important in applications with rapidly changing environments such as in e-commerce, among others. We investigate a general deep learning based approach, where a neural network is trained to map an image of the domain, the current robot state, and a goal robot state to the next robot state in the plan. We focus on the learning algorithm, and compare supervised learning methods with reinforcement learning (RL) algorithms. We first establish that supervised learning approaches are inferior in their accuracy due to insufficient data on the boundary of the obstacles, an issue that RL methods mitigate by actively exploring the domain. We then propose a modification of the popular DDPG RL algorithm that is tailored to motion planning domains, by exploiting the known model in the problem and the set of solved plans in the data. We show that our algorithm, dubbed DDPG-MP, significantly improves the accuracy of the learned motion planning policy. Finally, we show that given enough training data, our method can plan significantly faster on novel domains than off-the-shelf sampling based motion planners. Results of our experiments are shown in https://youtu.be/wHQ4Y4mBRb8.


title: Space-Time Modulated Loaded-Wire Metagratings for Magnetless Nonreciprocity and Near-Complete Frequency Conversion

abstract: In recent years a significant progress has been made in the development of magnet-less nonreciprocity using space-time modulation, both in electromagnetics and acoustics. This approach has so far resulted in a plethora of non-reciprocal devices, such as isolators and circulators, over different parts of the spectrum, for guided waves. On the other hand, very little work has been performed on non-reciprocal devices for waves propagating in free space, which can also have many practical applications. For example, it was shown theoretically that non-reciprocal scattering by a metasurface can be obtained if the surface-impedance operator is continuously modulated in space and time. However, the main challenge in the realization of such a metasurface is due to the high complexity required to modulate in space and time many sub-wavelength unit-cells of which the metasurface consists. In this paper we show that spatiotemporally modulated metagratings can lead to strong nonreciprocal responses, despite the fact that they are based on electrically-large unit cells. We specifically focus on wire metagratings loaded with time-modulated capacitances. We use the discrete-dipole-approximation and an ad-hoc generalization of the theory of polarizability for time-modulated particles, and demonstrate an effective nonreciprocal anomalous reflection (diffraction) with an efficient frequency conversion. Thus, our work opens a venue towards a practical design and implementation of highly non-reciprocal magnet-less metasurfaces in electromagnetics and acoustics.


title: Robust Learning Under Label Noise With Iterative Noise-Filtering

abstract: We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to them or completely removing them from the training set. In the first case the model however still learns from noisy labels; in the latter approach, good training data can be lost. In this paper, we propose an iterative semi-supervised mechanism for robust learning which excludes noisy labels but is still able to learn from the corresponding samples. To this end, we add an unsupervised loss term that also serves as a regularizer against the remaining label noise. We evaluate our approach on common classification tasks with different noise ratios. Our robust models outperform the state-of-the-art methods by a large margin. Especially for very large noise ratios, we achieve up to 20 % absolute improvement compared to the previous best model.


title: Abstract Predicate Entailment over Points-To Heaplets is Syntax Recognition

abstract: Abstract predicates are considered in this paper as abstraction technique for heap-separated configurations, and as genuine Prolog predicates which are translated straight into a corresponding formal language grammar used as validation scheme for intermediate heap states. The approach presented is rule-based because the abstract predicates are rule-based, the parsing technique can be interpreted as an automated fold/unfold of the corresponding heap graph.


title: $\mathbb{Z}_Q$ Berry Phase for Higher-Order Symmetry-Protected Topological Phases

abstract: We propose the $\mathbb{Z}_Q$ Berry phase as a topological invariant for higher-order symmetry-protected topological (HOSPT) phases for two- and three-dimensional systems. It is topologically stable for electron-electron interactions assuming the gap remains open. As a concrete example, we show that the Berry phase is quantized in $\mathbb{Z}_4$ and characterizes the HOSPT phase of the extended Benalcazar-Bernevig-Hughes (BBH) model, which contains the next-nearest neighbor hopping and the intersite Coulomb interactions. In addition, we introduce the $\mathbb{Z}_4$ Berry phase for the spin-model-analog of the BBH model, whose topological invariant has not been found so far. Furthermore, we demonstrate the Berry phase is quantized in $\mathbb{Z}_4$ for the three-dimensional version of the BBH model. We also confirm the bulk-corner correspondence between the $\mathbb{Z}_4$ Berry phase and the corner states in the HOSPT phases.


title: Probabilistic Top-k Dominating Query Monitoring over Multiple Uncertain IoT Data Streams in Edge Computing Environments

abstract: Extracting the valuable features and information in Big Data has become one of the important research issues in Data Science. In most Internet of Things (IoT) applications, the collected data are uncertain and imprecise due to sensor device variations or transmission errors. In addition, the sensing data may change as time evolves. We refer an uncertain data stream as a dataset that has velocity, veracity, and volume properties simultaneously. This paper employs the parallelism in edge computing environments to facilitate the top-k dominating query process over multiple uncertain IoT data streams. The challenges of this problem include how to quickly update the result for processing uncertainty and reduce the computation cost as well as provide highly accurate results. By referring to the related existing papers for certain data, we provide an effective probabilistic top-k dominating query process on uncertain data streams, which can be parallelized easily. After discussing the properties of the proposed approach, we validate our methods through the complexity analysis and extensive simulated experiments. In comparison with the existing works, the experimental results indicate that our method can improve almost 60% computation time, reduce nearly 20% communication cost between servers, and provide highly accurate results in most scenarios.


title: Cooperative Downlink Interference Transmission and Cancellation for Cellular-Connected UAV: A Divide-and-Conquer Approach

abstract: The line-of-sight dominant air-ground channels have posed critical interference issues in cellular-connected unmanned aerial vehicle (UAV) communications. In this paper, we propose a new base station (BS) cooperative beamforming (CB) technique for the cellular downlink to mitigate the strong interference caused by the co-channel terrestrial transmissions to the UAV. Besides the conventional CB by cooperatively transmitting the UAV's message, the serving BSs of the UAVs exploit a novel interference transmission scheme to effectively suppress the terrestrial interference to the UAV. Specifically, the co-channel terrestrial users' messages are shared with the UAV's serving BSs and transmitted via CB to cancel their resultant interference at the UAV. To balance between the CB gains for UAV signal enhancement and interference cancellation, we aim to maximize the UAV's receive signal-to-interference-plus-noise ratio by jointly optimizing the power allocations at all of its serving BSs for transmitting the UAV's and co-channel terrestrial users' messages. First, we derive the closed-form optimal solution to this problem in a special case and draw useful insights. Then, we propose an algorithm to solve the problem optimally in the general case. As the optimal solution requires centralized implementation with exorbitant message/channel information exchanges among the BSs, we further propose a distributed algorithm that is amenable to practical implementation, based on a new divide-and-conquer approach, whereby each co-channel BS divides its perceived interference to the UAV into multiple portions, each to be canceled by a different serving BS of the UAV with its best effort. Numerical results show that the proposed centralized and distributed CB schemes with interference transmission and cancellation (ITC) can both significantly outperform the conventional CB without applying ITC.