title: Polytopic Discontinuous Galerkin methods for the numerical modelling of flow in porous media with networks of intersecting fractures

abstract: We present a numerical approximation of Darcy's flow through a porous medium that incorporates networks of fractures with non empty intersection. Our scheme employs PolyDG methods, i.e. discontinuous Galerkin methods on general polygonal and polyhedral (polytopic, for short) grids, featuring elements with edges/faces that may be in arbitrary number (potentially unlimited) and whose measure may be arbitrarily small. Our approach is then very well suited to tame the geometrical complexity featured by most of applications in the computational geoscience field. From the modelling point of view, we adopt a reduction strategy that treats fractures as manifolds of codimension one and we employ the primal version of Darcy's law to describe the flow in both the bulk and the fracture network. In addition, some physically consistent conditions couple the two problems, allowing for jump of pressure at their interface, and they as well prescribe the behaviour of the fluid along the intersections, imposing pressure continuity and flux conservation. Both the bulk and fracture discretizations are obtained employing the Symmetric Interior Penalty DG method extended to the polytopic setting. The key instrument to obtain a polyDG approximation of the problem in the fracture network is the generalization of the concepts of jump and average at the intersection, so that the contribution from all the fractures is taken into account. We prove the well-posedness of the discrete formulation and perform an error analysis obtaining a priori hp-error estimates. All our theoretical results are validated performing preliminary numerical tests with known analytical solution.


title: Kruskal-based approximation algorithm for the multi-level Steiner tree problem

abstract: We study the multi-level Steiner tree problem: a generalization of the Steiner tree problem in graphs where terminals $T$ require varying priority, level, or quality of service. In this problem, we seek to find a minimum cost tree containing edges of varying rates such that any two terminals $u$, $v$ with priorities $P(u)$, $P(v)$ are connected using edges of rate $\min\{P(u),P(v)\}$ or better. The case where edge costs are proportional to their rate is approximable to within a constant factor of the optimal solution. For the more general case of non-proportional costs, this problem is hard to approximate with ratio $c \log \log n$, where $n$ is the number of vertices in the graph. A simple greedy algorithm by Charikar et al., however, provides a $\min\{2(\ln |T|+1), \ell \rho\}$-approximation in this setting, where $\rho$ is an approximation ratio for a heuristic solver for the Steiner tree problem and $\ell$ is the number of priorities or levels (Byrka et al. give a Steiner tree algorithm with $\rho\approx 1.39$, for example). In this paper, we describe a natural generalization to the multi-level case of the classical (single-level) Steiner tree approximation algorithm based on Kruskal's minimum spanning tree algorithm. We prove that this algorithm achieves an approximation ratio at least as good as Charikar et al., and experimentally performs better with respect to the optimum solution. We develop an integer linear programming formulation to compute an exact solution for the multi-level Steiner tree problem with non-proportional edge costs and use it to evaluate the performance of our algorithm on both random graphs and multi-level instances derived from SteinLib.


title: Some new Liouville-type results for fully nonlinear PDEs on the Heisenberg group

abstract: We prove new (sharp) Liouville-type properties via degenerate Hadamard three-sphere theorems for fully nonlinear equations structured over Heisenberg vector fields. As model examples, we cover the case of Pucci's extremal operators perturbed by suitable semilinear and gradient terms, extending to the Heisenberg setting known contributions valid in the Euclidean framework.


title: Scale-Invariant Multi-Oriented Text Detection in Wild Scene Images

abstract: Automatic detection of scene texts in the wild is a challenging problem, particularly due to the difficulties in handling (i) occlusions of varying percentages, (ii) widely different scales and orientations, (iii) severe degradations in the image quality etc. In this article, we propose a fully convolutional neural network architecture consisting of a novel Feature Representation Block (FRB) capable of efficient abstraction of information. The proposed network has been trained using curriculum learning with respect to difficulties in image samples and gradual pixel-wise blurring. It is capable of detecting texts of different scales and orientations suffered by blurring from multiple possible sources, non-uniform illumination as well as partial occlusions of varying percentages. Text detection performance of the proposed framework on various benchmark sample databases including ICDAR 2015, ICDAR 2017 MLT, COCO-Text and MSRA-TD500 improves respective state-of-the-art results significantly. Source code of the proposed architecture will be made available at github.


title: Deeper Task-Specificity Improves Joint Entity and Relation Extraction

abstract: Multi-task learning (MTL) is an effective method for learning related tasks, but designing MTL models necessitates deciding which and how many parameters should be task-specific, as opposed to shared between tasks. We investigate this issue for the problem of jointly learning named entity recognition (NER) and relation extraction (RE) and propose a novel neural architecture that allows for deeper task-specificity than does prior work. In particular, we introduce additional task-specific bidirectional RNN layers for both the NER and RE tasks and tune the number of shared and task-specific layers separately for different datasets. We achieve state-of-the-art (SOTA) results for both tasks on the ADE dataset; on the CoNLL04 dataset, we achieve SOTA results on the NER task and competitive results on the RE task while using an order of magnitude fewer trainable parameters than the current SOTA architecture. An ablation study confirms the importance of the additional task-specific layers for achieving these results. Our work suggests that previous solutions to joint NER and RE undervalue task-specificity and demonstrates the importance of correctly balancing the number of shared and task-specific parameters for MTL approaches in general.


title: In-plane terahertz surface plasmon-polaritons coupler based on adiabatic following

abstract: We propose a robust and broadband integrated terahertz (THz) coupler based on the in-plane surface plasmon polaritons (SPPs) waveguides, conducted with the quantum coherent control -- Stimulated Raman Adiabatic Passage (STIRAP). Our coupler consists of two asymmetric specific curved corrugated metallic structures working as the input and output SPPs waveguides, and one straight corrugated metallic structure functioning as the middle SPPs waveguide. From the theoretical and simulated results, we demonstrate that the SPPs can be efficiently transfered from the input to the output waveguides. Our device is robust against the perturbations of geometric parameters, and meanwhile it manifests broadband performance (from 0.3 THz to 0.8 THz) with the high transmission rate over 70$\%$. The in-plane THz coupler can largely simplify the fabrication process, which will make contribution to develop compact and robust integrated THz devices and promote the future applications in all optical network and THz communications.


title: On Induction for Twisted Representations of Conformal Nets

abstract: For a given finite index inclusion of conformal nets $\mathcal{B}\subset \mathcal{A}$ and a group $G < \mathrm{Aut}(\mathcal{A}, \mathcal{B})$, we consider the induction and the restriction procedures for $G$-twisted representations. We define two induction procedures for $G$-twisted representations, which generalize the $\alpha^{\pm}$-induction for DHR endomorphisms. One is defined with the opposite braiding on the category of $G$-twisted representations as in $\alpha^-$-induction. The other is also defined with the braiding, but additionally with the $G$-equivariant structure on the Q-system associated with $\mathcal{B}\subset \mathcal{A}$ and the action of $G$. We derive some properties and formulas for these induced endomorphisms in a similar way to the case of ordinary $\alpha$-induction. We also show the version of $\alpha\sigma$-reciprocity formula for our setting.


title: Upgraded Electronics of the ATLAS Hadronic Tile Calorimeter for the High Luminosity LHC

abstract: The ATLAS hadronic Tile Calorimeter will undergo major upgrades to the on- and off-detector electronics in preparation for the High Luminosity program of the Large Hadron Collider (HL-LHC) in 2026, so that the system can cope with the HL-LHC increased radiation levels and out-of-time pileup. The on-detector electronics of the upgraded system will continuously digitize and transmit all photo-multiplier signals to the off-detector systems at a 40 MHz rate. The off-detector electronics will store the data in pipeline buffers, produce digital hadronic tower sums for the ATLAS Level-0 trigger system, and read out selected events. The modular on-detector electronics feature radiation-tolerant commercial off-the-shelf components and redundant design to minimize single points of failure. The timing, control and communication interface with the off-detector electronics is implemented with modern Field Programmable Gate Arrays and high speed fibre optic links running up to 9.6 Gbps.


title: On a family of hypergeometric Sobolev orthogonal polynomials on the unit circle

abstract: In this paper we study the following family of hypergeometric polynomials: $y_n(x) = \frac{ (-1)^\rho }{ n! } x^n {}_2 F_0(-n,\rho;-;-\frac{1}{x})$, depending on a parameter $\rho\in\mathbb{N}$. Differential equations of orders $\rho+1$ and $2$ for these polynomials are given. A recurrence relation for $y_n$ is derived as well. Polynomials $y_n$ are Sobolev orthogonal polynomials on the unit circle with an explicit matrix measure.


title: An End-to-End Framework for Unsupervised Pose Estimation of Occluded Pedestrians

abstract: Pose estimation in the wild is a challenging problem, particularly in situations of (i) occlusions of varying degrees and (ii) crowded outdoor scenes. Most of the existing studies of pose estimation did not report the performance in similar situations. Moreover, pose annotations for occluded parts of human figures have not been provided in any of the relevant standard datasets which in turn creates further difficulties to the required studies for pose estimation of the entire figure of occluded humans. Well known pedestrian detection datasets such as CityPersons contains samples of outdoor scenes but it does not include pose annotations. Here, we propose a novel multi-task framework for end-to-end training towards the entire pose estimation of pedestrians including in situations of any kind of occlusion. To tackle this problem for training the network, we make use of a pose estimation dataset, MS-COCO, and employ unsupervised adversarial instance-level domain adaptation for estimating the entire pose of occluded pedestrians. The experimental studies show that the proposed framework outperforms the SOTA results for pose estimation, instance segmentation and pedestrian detection in cases of heavy occlusions (HO) and reasonable + heavy occlusions (R + HO) on the two benchmark datasets.


title: Real-time Accelerator Diagnostic Tools for the MAX IV Storage Rings

abstract: In this paper, beam diagnostic and monitoring tools developed by the MAX IV Operations Group are discussed. In particular, new beam position monitoring and accelerator tunes visualization software tools, as well as tools that directly influence the beam quality and stability are introduced. An availability and downtime monitoring application is also presented.


title: Ultrabroadband Polarization Insensitive Hybrid using Multiplane Light Conversion

abstract: We designed, fabricated and tested an optical hybrid that supports an octave of bandwidth (900-1800 nm) and below 4-dB insertion loss using multiplane light conversion. Measured phase errors are below 3-degree across a measurement bandwidth of 390 nm.


title: PDDLGym: Gym Environments from PDDL Problems

abstract: We present PDDLGym, a framework that automatically constructs OpenAI Gym environments from PDDL domains and problems. Observations and actions in PDDLGym are relational, making the framework particularly well-suited for research in relational reinforcement learning and relational sequential decision-making. PDDLGym is also useful as a generic framework for rapidly building numerous, diverse benchmarks from a concise and familiar specification language. We discuss design decisions and implementation details, and also illustrate empirical variations between the 20 built-in environments in terms of planning and model-learning difficulty. We hope that PDDLGym will facilitate bridge-building between the reinforcement learning community (from which Gym emerged) and the AI planning community (which produced PDDL). We look forward to gathering feedback from all those interested and expanding the set of available environments and features accordingly. Code: https://github.com/tomsilver/pddlgym


title: On the existence of small antichains for definable quasi-orders

abstract: We generalize Kada's definable strengthening of Dilworth's characterization of the class of quasi-orders admitting an antichain of a given finite cardinality.


title: The Warm Gas in the MW: A Kinematical Model

abstract: We develop a kinematical model for the Milky Way Si IV-bearing gas to determine its density distribution and kinematics. This model is constrained by a column density line shape sample extracted from the {\it HST}/COS archival data, which contains 186 AGN sight lines. We find that the Si IV ion density distribution is dominated by an extended disk along the $z$-direction (above or below the midplane), i.e., $n(z)=n_0\exp(-(z/z_0)^{0.82})$, where $z_0$ is the scale height of $6.3_{-1.5}^{+1.6}$ kpc (northern hemisphere) and $3.6_{-0.9}^{+1.0}$ kpc (southern hemisphere). The density distribution of the disk in the radial direction shows a sharp edge at $15-20$ kpc given by, $n(r_{\rm XY})=n_0\exp(-(r_{\rm XY}/r_0)^{3.36})$, where $r_0 \approx 12.5\pm0.6$ kpc. The difference of density distributions over $r_{\rm XY}$ and $z$ directions indicates that the warm gas traced by \ion{Si}{4} is mainly associated with disk processes (e.g., feedback or cycling gas) rather than accretion. We estimate the mass of the warm gas (within 50 kpc) is $\log (M(50 {\rm kpc})/M_\odot)\approx8.1$ (assuming $Z\approx0.5Z_\odot$), and a $3\sigma$ upper limit of $\log (M(250 {\rm kpc})/M_\odot)\approx9.1$ (excluding the Magellanic system). Kinematically, the warm gas disk is nearly co-rotating with the stellar disk at $v_{\rm rot}=215\pm3\rm~km~s^{-1}$, which lags the midplane rotation by about $8\rm~km~s^{-1}~kpc^{-1}$ (within 5 kpc). Meanwhile, we note that the warm gas in the northern hemisphere has significant accretion with $v_{\rm acc}$ of $69\pm 7\rm ~km~s^{-1}$ at 10 kpc (an accretion rate of $-0.60_{-0.13}^{+0.11}~M_\odot\rm~yr^{-1}$), while in the southern hemisphere, there is no measurable accretion, with an upper limit of $0.4~M_\odot\rm~yr^{-1}$.


title: New and improved rotational periods of magnetic CP stars from ASAS-3, KELT and MASCARA data

abstract: Magnetic chemically peculiar (mCP) stars allow the investigation of such diverse phenomena as atomic diffusion, magnetic fields and stellar rotation. The aim of the present investigation is to enhance our knowledge of the rotational properties of mCP stars by increasing the sample of objects with accurately determined rotational periods. To this end, archival photometric time-series data from the ASAS-3, KELT and MASCARA surveys were employed to improve existing rotational period information and derive rotational periods for mCP stars hitherto not known to be photometric variables. Our final sample consists of 294 mCP stars, a considerable amount of which (more than 40%) are presented here as photometric variables for the first time. In addition, we identified 24 mCP star candidates that show light variability in agreement with rotational modulation but lack spectroscopic confirmation. The rotational period distribution of our sample agrees well with the literature.Most stars are between 100Myr and 1Gyr old, with an apparent lack of very young stars. No objects were found on the zero age main sequence; several stars seem to have evolved to the subgiant stage, albeit well before the first dredge-up. We identified four eclipsing binaries (HD 244391, HD 247441, HD 248784 and HD 252519), which potentially host an mCP star. This is of great interest because mCP stars are very rarely found in close binary systems, particularly eclipsing ones. Using archival spectra, we find strong evidence that the HD 252519 system indeed harbours an mCP star component.


title: MRRC: Multiple Role Representation Crossover Interpretation for Image Captioning With R-CNN Feature Distribution Composition (FDC)

abstract: While image captioning through machines requires structured learning and basis for interpretation, improvement requires multiple context understanding and processing in a meaningful way. This research will provide a novel concept for context combination and will impact many applications to deal visual features as an equivalence of descriptions of objects, activities and events. There are three components of our architecture: Feature Distribution Composition (FDC) Layer Attention, Multiple Role Representation Crossover (MRRC) Attention Layer and the Language Decoder. FDC Layer Attention helps in generating the weighted attention from RCNN features, MRRC Attention Layer acts as intermediate representation processing and helps in generating the next word attention, while Language Decoder helps in estimation of the likelihood for the next probable word in the sentence. We demonstrated effectiveness of FDC, MRRC, regional object feature attention and reinforcement learning for effective learning to generate better captions from images. The performance of our model enhanced previous performances by 35.3\% and created a new standard and theory for representation generation based on logic, better interpretability and contexts.


title: Dynamical behavior of the Universe: an entropic force scenario

abstract: Entropic force originates in the assumption that there is a horizon for the universe. This horizon gives rise to additional terms in the equations of motion. Using dynamical system calculations, our results show that in the presence of dark energy for certain conditions, the last attractor of this theory will be dark energy epoch, but in the absence of dark energy, entropic force energy portion will have the lead role in the late time universe and is responsible for accelerated expansion of that. Interestingly, assuming both entropic force terms and dark energy to have their share of energy density of the universe, we have found that, in certain conditions entropic force dominated epoch is a stable fixed point while the dark energy epoch is a saddle point.


title: Symmetries and Supersymmetries of Generalized Schr\"odinger equations

abstract: In this survey the contemporary results concerning supersymmetries in generalized Schr\"odinger equations are presented. Namely, position dependent mass Sch\"odinger equations are discussed as well as the equations with matrix potentials. An extended number of realistic quantum mechanical problems admitting extended supersymmetries is described, an extended class of matrix potentials is classified.


title: Further Inference on Categorical Data -- A Bayesian Approach

abstract: Three different inferential problems related to a two dimensional categorical data from a Bayesian perspective have been discussed in this article. Conjugate prior distribution with symmetric and asymmetric hyper parameters are considered. Newly conceived asymmetric prior is based on perceived preferences of categories. An extension of test of independence by introducing a notion of measuring association between the parameters has been shown using correlation matrix. Probabilities of different parametric combinations have been estimated from the posterior distribution using closed form integration, Monte-Carlo integration and MCMC methods to draw further inference from categorical data. Bayesian computation is done using R programming language and illustrated with appropriate data sets. Study has highlighted the application of Bayesian inference exploiting the distributional form of underlying parameters.


title: Federated Learning with Matched Averaging

abstract: Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud. We propose Federated matched averaging (FedMA) algorithm designed for federated learning of modern neural network architectures e.g. convolutional neural networks (CNNs) and LSTMs. FedMA constructs the shared global model in a layer-wise manner by matching and averaging hidden elements (i.e. channels for convolution layers; hidden states for LSTM; neurons for fully connected layers) with similar feature extraction signatures. Our experiments indicate that FedMA not only outperforms popular state-of-the-art federated learning algorithms on deep CNN and LSTM architectures trained on real world datasets, but also reduces the overall communication burden.


title: Hyperstability of orthogonally 3-Lie homomorphism: an orthogonally fixed point approach

abstract: In this paper, by using the orthogonally fixed point method, we prove the Hyers-Ulam stability and the hyperstability of orthogonally 3-Lie homomorphisms for additive $\rho$-functional equation in 3-Lie algebras.\\ Indeed, we investigate the Hyers-Ulam stability and the hyperstability of the system of functional equations \begin{eqnarray*} \left\{ \begin{array}{ll} f(x+y)-f(x)-f(y)= \rho(2f(\frac{x+y}{2})+ f(x)+ f(y)),\\ f([[x,y],z])=[[f(x),f(y)],f(z)] \end{array} \right. \end{eqnarray*} in 3-Lie algebras (where $\rho$ is a fixed real number with $\rho \ne 1$).


title: Monotonic Cardinality Estimation of Similarity Selection: A Deep Learning Approach

abstract: Due to the outstanding capability of capturing underlying data distributions, deep learning techniques have been recently utilized for a series of traditional database problems. In this paper, we investigate the possibilities of utilizing deep learning for cardinality estimation of similarity selection. Answering this problem accurately and efficiently is essential to many data management applications, especially for query optimization. Moreover, in some applications the estimated cardinality is supposed to be consistent and interpretable. Hence a monotonic estimation w.r.t. the query threshold is preferred. We propose a novel and generic method that can be applied to any data type and distance function. Our method consists of a feature extraction model and a regression model. The feature extraction model transforms original data and threshold to a Hamming space, in which a deep learning-based regression model is utilized to exploit the incremental property of cardinality w.r.t. the threshold for both accuracy and monotonicity. We develop a training strategy tailored to our model as well as techniques for fast estimation. We also discuss how to handle updates. We demonstrate the accuracy and the efficiency of our method through experiments, and show how it improves the performance of a query optimizer.


title: Hausdorff dimension of measures with arithmetically restricted spectrum

abstract: We provide an estimate from below for the lower Hausdorff dimension of measures on the unit circle based on the arithmetic properties of their spectra. We obtain our bounds via application of a general result for abstract $q$-regular martingales to the Gundy--Varopoulos backwards martingale. To show the sharpness of our method, we improve the best known numerical lower bound for the Hausdorff dimension of certain Riesz products.


title: Bryant-Salamon $\mathrm{G}_2$ manifolds and coassociative fibrations

abstract: Bryant-Salamon constructed three 1-parameter families of complete manifolds with holonomy $\mathrm{G}_2$ which are asymptotically conical to a holonomy $\mathrm{G}_2$ cone. For each of these families, including their asymptotic cone, we construct a fibration by asymptotically conical and conically singular coassociative 4-folds. We show that these fibrations are natural generalizations of the following three well-known coassociative fibrations on $\mathbb R^7$: the trivial fibration by 4-planes, the product of the standard Lefschetz fibration of $\mathbb C^3$ with a line, and the Harvey-Lawson coassociative fibration. In particular, we describe coassociative fibrations of the bundle of anti-self-dual 2-forms over the 4-sphere $\mathcal{S}^4$, and the cone on $\mathbb C \mathbb P^3$, whose smooth fibres are $T^*\mathcal{S}^2$, and whose singular fibres are $\mathbb R^4/\{\pm 1\}$. We relate these fibrations to hypersymplectic geometry, Donaldson's work on Kovalev-Lefschetz fibrations, harmonic 1-forms and the Joyce--Karigiannis construction of holonomy $\mathrm{G}_2$ manifolds, and we construct vanishing cycles and associative "thimbles" for these fibrations.


title: Presenting and Evaluating the Impact of Experiential Learning in Computing Accessibility Education

abstract: Studies indicate that much of the software created today is not accessible to all users, indicating that developers don't see the need to devote sufficient resources to creating accessible software. Compounding this problem, there is a lack of robust, easily adoptable educational accessibility material available to instructors for inclusion in their curricula. To address these issues, we have created five Accessibility Learning Labs (ALL) using an experiential learning structure. The labs are designed to educate and create awareness of accessibility needs in computing. The labs enable easy classroom integration by providing instructors with complete educational materials including lecture slides, activities, and quizzes. The labs are hosted on our servers and require only a browser to be utilized. To demonstrate the benefit of our material and the potential benefits of our experiential lab format with empathy-creating material, we conducted a study involving 276 students in ten sections of an introductory computing course. Our findings include: (I) The demonstrated potential of the proposed experiential learning format and labs are effective in motivating and educating students about the importance of accessibility (II) The labs are effective in informing students about foundational accessibility topics (III) Empathy-creating material is demonstrated to be a beneficial component in computing accessibility education, supporting students in placing a higher value on the importance of creating accessible software. Created labs and project materials are publicly available on the project website: http://all.rit.edu


title: Constraints on the muon fraction and density profile in neutron stars

abstract: Muons in neutron stars (NSs) play especially important roles in addressing several interesting new physics questions associated with detecting as well as understanding interactions and astrophysical effects of muonphilic dark matter particles. The key model inputs for studying the latter are the total muon mass $M_{\mu}$, the muon mass fraction $M_{\mu}/M_{\rm NS}$ over the NS mass $M_{\rm NS}$ and the muon radial density profile $\rho_{\mu}(r)$ in NSs of varying masses. We investigate these quantities within a minimum model for the core of NSs consisting of neutrons, protons, electrons, and muons using an explicitly isospin-dependent parametric Equation of State (EOS) constrained by available nuclear laboratory experiments and the latest astrophysical observations of NS masses, radii and tidal deformabilities. We found that the absolutely maximum muon mass $M_{\mu}$ and its mass fraction $M_{\mu}/M_{\rm NS}$ in the most massive NSs allowed by causality are about 0.025 $M_\odot$ and 1.1\%, respectively. For the most massive NS of mass 2.14 $M_\odot$ observed so far, they reduce to about 0.020 $M_\odot$ and 0.9\%, respectively. We also study respective effects of individual parameters describing the EOS of high-density neutron-rich nucleonic matter on the muon contents in NSs with varying masses. We found that the most important but uncertain nuclear physics ingredient for determining the muon contents in NSs is the high-density nuclear symmetry energy.


title: Small ball probabilities, metric entropy and Gaussian rough paths

abstract: We study the Small Ball Probabilities (SBPs) of Gaussian rough paths. While many works on rough paths study the Large Deviations Principles (LDPs) for stochastic processes driven by Gaussian rough paths, it is a noticeable gap in the literature that SBPs have not been extended to the rough path framework. LDPs provide macroscopic information about a measure for establishing Integrability type properties. SBPs provide microscopic information and are used to establish a locally accurate approximation for a measure. Given the compactness of a Reproducing Kernel Hilbert space (RKHS) ball, its metric entropy provides invaluable information on how to approximate the law of a Gaussian rough path. As an application, we are able to find upper and lower bounds for the rate of convergence of an empirical rough Gaussian measure to its true law in pathspace.


title: Measuring Abuse in Web Push Advertising

abstract: The rapid growth of online advertising has fueled the growth of ad-blocking software, such as new ad-blocking and privacy-oriented browsers or browser extensions. In response, both ad publishers and ad networks are constantly trying to pursue new strategies to keep up their revenues. To this end, ad networks have started to leverage the Web Push technology enabled by modern web browsers. As web push notifications (WPNs) are relatively new, their role in ad delivery has not been yet studied in depth. Furthermore, it is unclear to what extent WPN ads are being abused for malvertising (i.e., to deliver malicious ads). In this paper, we aim to fill this gap. Specifically, we propose a system called PushAdMiner that is dedicated to (1) automatically registering for and collecting a large number of web-based push notifications from publisher websites, (2) finding WPN-based ads among these notifications, and (3) discovering malicious WPN-based ad campaigns. Using PushAdMiner, we collected and analyzed 21,541 WPN messages by visiting thousands of different websites. Among these, our system identified 572 WPN ad campaigns, for a total of 5,143 WPN-based ads that were pushed by a variety of ad networks. Furthermore, we found that 51% of all WPN ads we collected are malicious, and that traditional ad-blockers and malicious URL filters are remarkably ineffective against WPN-based malicious ads, leaving a significant abuse vector unchecked.


title: Extrasolar planets: from dust to new worlds

abstract: Thousands of exoplanets have been discovered and the search for life outside Earth is at the forefront of astrophysical research. The planets we observe show a mind-blowing diversity that current theories strive to explain as part of the quest to assess the chances of finding life outside the Earth.


title: Supervised Phrase-boundary Embeddings

abstract: We propose a new word embedding model, called SPhrase, that incorporates supervised phrase information. Our method modifies traditional word embeddings by ensuring that all target words in a phrase have exactly the same context. We demonstrate that including this information within a context window produces superior embeddings for both intrinsic evaluation tasks and downstream extrinsic tasks.


title: Symmetric Arithmetic Circuits

abstract: We introduce symmetric arithmetic circuits, i.e. arithmetic circuits with a natural symmetry restriction. In the context of circuits computing polynomials defined on a matrix of variables, such as the determinant or the permanent, the restriction amounts to requiring that the shape of the circuit is invariant under simultaneous row and column permutations of the matrix. We establish unconditional exponential lower bounds on the size of any symmetric circuit for computing the permanent. In contrast, we show that there are polynomial-size symmetric circuits for computing the determinant over fields of characteristic zero.


title: On the Search for Tight Frames of Low Coherence

abstract: We introduce a projective Riesz $s$-kernel for the unit sphere $\mathbb{S}^{d-1}$ and investigate properties of $N$-point energy minimizing configurations for such a kernel. We show that these configurations, for $s$ and $N$ sufficiently large, form frames that are well-separated (have low coherence) and are nearly tight. Our results suggest an algorithm for computing well-separated tight frames which is illustrated with numerical examples.


title: Channel Estimation for RIS-Aided mmWave MIMO Channels

abstract: A reconfigurable intelligent surface (RIS) can shape the radio propagation by passively changing the directions of impinging electromagnetic waves. The optimal control of the RIS requires perfect channel state information (CSI) of all the links connecting the base station (BS) and the mobile station (MS) via the RIS. Thereby the channel (parameter) estimation at the BS/MS and the related message feedback mechanism are needed. In this paper, we adopt a two-stage channel estimation scheme for the RIS-aided millimeter wave (mmWave) MIMO channels using an iterative reweighted method to sequentially estimate the channel parameters. We evaluate the average spectrum efficiency (SE) and the RIS beamforming gain of the proposed scheme and demonstrate that it achieves high-resolution estimation with the average SE comparable to that with perfect CSI.


title: Structural order matters: Enhanced electronic coupling in self assembled micro-crystals of Au-nanoclusters

abstract: We report an easy and broadly applicable method for the controlled self-assembly of atomically precise Au32(nBu3P)12Cl8 nanoclusters into micro-crystals. This enables the determination of emergent optoelectronic properties resulting from long-range order in such assemblies. Compared to the same nanoclusters in glassy, polycrystalline ensembles, we find a 100-fold increase in the electric conductivity and charge carrier mobility as well as additional optical transitions. We show that these effects are due to a vanishing energetic disorder and a drastically reduced activation energy to charge transport in the highly ordered assemblies. This first structure-transport correlation on self-assembled superstructures of atomically precise gold nanoclusters paves the way towards functional materials with novel collective optoelectronic properties.


title: The Exponential of the S^1 Trace of the Free Field and Verblunsky Coefficients

abstract: An identity of Szego, and a volume calculation, heuristically suggest a simple expression for the distribution of Verblunsky coefficients with respect to the (normalized) exponential of the $S^1$ trace of the Gaussian free field. This heuristic expression is not quite correct. A proof of the correct formula has been found by Chhaibi and Najnudel. Their proof uses random matrix theory and overcomes many difficult technical issues. In addition to presenting the Szego perspective, we show that the Chhaibi and Najnudel theorem implies a family of combinatorial identities (for moments of measures) which are of intrinsic interest.


title: Avoiding the sign-problem in lattice field theory

abstract: In lattice field theory, the interactions of elementary particles can be computed via high-dimensional integrals. Markov-chain Monte Carlo (MCMC) methods based on importance sampling are normally efficient to solve most of these integrals. But these methods give large errors for oscillatory integrands, exhibiting the so-called sign-problem. We developed new quadrature rules using the symmetry of the considered systems to avoid the sign-problem in physical one-dimensional models for the resulting high-dimensional integrals. This article gives a short introduction to integrals used in lattice QCD where the interactions of gluon and quark elementary particles are investigated, explains the alternative integration methods we developed and shows results of applying them to models with one physical dimension. The new quadrature rules avoid the sign-problem and can therefore be used to perform simulations at until now not reachable regions in parameter space, where the MCMC errors are too big for affordable sample sizes. However, it is still a challenge to develop these techniques further for applications with physical higher-dimensional systems.


title: Data-Driven Variational Multiscale Reduced Order Models

abstract: We propose a new data-driven reduced order model (ROM) framework that centers around the hierarchical structure of the variational multiscale (VMS) methodology and utilizes data to increase the ROM accuracy at a modest computational cost. The VMS methodology is a natural fit for the hierarchical structure of the ROM basis: In the first step, we use the ROM projection to separate the scales into three categories: (i) resolved large scales, (ii) resolved small scales, and (iii) unresolved scales. In the second step, we explicitly identify the VMS-ROM closure terms, i.e., the terms representing the interactions among the three types of scales. In the third step, we use available data to model the VMS-ROM closure terms. Thus, instead of phenomenological models used in VMS for standard numerical discretizations (e.g., eddy viscosity models), we utilize available data to construct new structural VMS-ROM closure models. Specifically, we build ROM operators (vectors, matrices, and tensors) that are closest to the true ROM closure terms evaluated with the available data. We test the new data-driven VMS-ROM in the numerical simulation of four test cases: (i) the 1D Burgers equation with viscosity coefficient $\nu = 10^{-3}$; (ii) a 2D flow past a circular cylinder at Reynolds numbers $Re=100$, $Re=500$, and $Re=1000$; (iii) the quasi-geostrophic equations at Reynolds number $Re=450$ and Rossby number $Ro=0.0036$; and (iv) a 2D flow over a backward facing step at Reynolds number $Re=1000$. The numerical results show that the data-driven VMS-ROM is significantly more accurate than standard ROMs.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: Theory of nonreciprocal Josephson effect

abstract: The hetero junction between the different materials often gives the rectification effect; e.g., pn junction is used for diode. On the other hand, the Josephson junction between the two superconductors is assumed to show symmetric response between the two directions of the current, i.e., the voltage drop $V$ is anti-symmetric with respect to the sign change of the current $I$. However, there should be an asymmetry between the states of charge accumulation on right and left sides of the Josephson junction, which can lead to the nonreciprocal responses. Here we demonstrate theoretically that nonreciprocal $I$-$V$ characteristic appears due to this charging energy difference both in the classical and quantum regimes. This result will pave a route to design and develop the Josephson diode.


title: Generalizing separability, precompactness and narrowness in topological groups

abstract: We discuss various modifications of separability, precompactnmess and narrowness in topological groups and test those modifications in the permutation groups $S(X)$ and $S_{<\omega}(X)$.


title: HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagery

abstract: Generative deep learning has sparked a new wave of Super-Resolution (SR) algorithms that enhance single images with impressive aesthetic results, albeit with imaginary details. Multi-frame Super-Resolution (MFSR) offers a more grounded approach to the ill-posed problem, by conditioning on multiple low-resolution views. This is important for satellite monitoring of human impact on the planet -- from deforestation, to human rights violations -- that depend on reliable imagery. To this end, we present HighRes-net, the first deep learning approach to MFSR that learns its sub-tasks in an end-to-end fashion: (i) co-registration, (ii) fusion, (iii) up-sampling, and (iv) registration-at-the-loss. Co-registration of low-resolution views is learned implicitly through a reference-frame channel, with no explicit registration mechanism. We learn a global fusion operator that is applied recursively on an arbitrary number of low-resolution pairs. We introduce a registered loss, by learning to align the SR output to a ground-truth through ShiftNet. We show that by learning deep representations of multiple views, we can super-resolve low-resolution signals and enhance Earth Observation data at scale. Our approach recently topped the European Space Agency's MFSR competition on real-world satellite imagery.


title: A Generation Criterion for Subsets of $SL_n(\mathbb{F}_q)$

abstract: Let $G_0$ be a either $SL_n(\mathbb{F}_q)$, the special linear group over the finite field with $q$ elements, or $PSL_n(\mathbb{F}_q)$, its projective quotient, and let $\Sigma$ be a symmetric subset of $G_0$, namely, if $x \in \Sigma$ then $x^{-1} \in \Sigma$. We find a certain set $\mathcal{R}(G_0)$ of irreducible representations of $G_0$ whose size is at most $5$, such that $\Sigma$ generates $G_0$ if and only if $\left\lvert\Sigma\right\rvert$ is not an eigenvalue of ${\sum_{\sigma \in \Sigma} \rho(\sigma)}$ for every $\rho \in \mathcal{R}(G_0)$. To achieve this result, let $G$ be either $GL_n(\mathbb{F}_q)$ or $PGL_n(\mathbb{F}_q)$. We consider $\mathcal{X}(G)$, some set of irreducible nontrivial characters of $G$, whose size is at most $5$. We show that for every subgroup $K \le G$ that does not contain $G_0$, the restriction to $K$ of at least one of the characters in $\mathcal{X}(G)$ contains the trivial character as an irreducible summand. We then restrict the characters to $G_0$ and use standard arguments about the Cayley graph of $G$ to imply the result. In addition, we obtain slightly weaker results about the generation of symmetric subsets of $G$. We finish by considering $S_{n}$, the symmetric group on $n$ elements, and presenting $\mathcal{R}(S_{n})$, a set of eight irreducible nontrivial representations of $S_{n}$, such that a symmetric subset $\Sigma \subseteq S_{n}$ generates $S_{n}$ if and only if $\left\lvert\Sigma\right\rvert$ is not an eigenvalue of ${\sum_{\sigma \in \Sigma} \rho(\sigma)}$ for every $\rho \in \mathcal{R}(S_{n})$, which is an improvement upon the previously known set of $12$ irreducible nontrivial representations of $S_{n}$ that satisfies this condition.


title: Pump induced motion of an interface between competing orders

abstract: We study the motion of an interface separating two regions with different electronic orders following a short duration pump that drives the system out of equilibrium. Using a generalized Ginzburg-Landau approach and assuming that the main effect of the nonequilibrium drive is to transiently heat the system we address the question of the direction of interface motion; in other words, which ordered region expands and which contracts after the pump. Our analysis includes the effects of differences in free energy landscape and in order parameter dynamics and identifies circumstances in which the drive may act to increase the volume associated with the subdominant order, for example when the subdominant order has a second order free energy landscape while the dominant order has a first order one.


title: Security of HyperLogLog (HLL) Cardinality Estimation: Vulnerabilities and Protection

abstract: Count distinct or cardinality estimates are widely used in network monitoring for security. They can be used, for example, to detect the malware spread, network scans, or a denial of service attack. There are many algorithms to estimate cardinality. Among those, HyperLogLog (HLL) has been one of the most widely adopted. HLL is simple, provides good cardinality estimates over a wide range of values, requires a small amount of memory, and allows merging of estimates from different sources. However, as HLL is increasingly used to detect attacks, it can itself become the target of attackers that want to avoid being detected. To the best of our knowledge, the security of HLL has not been studied before. In this letter, we take an initial step in its study by first exposing a vulnerability of HLL that allows an attacker to manipulate its estimate. This shows the importance of designing secure HLL implementations. In the second part of the letter, we propose an efficient protection technique to detect and avoid the HLL manipulation. The results presented strongly suggest that the security of HLL should be further studied given that it is widely adopted in many networking and computing applications.


title: Stationary BGK models for chemically reacting gas in a slab

abstract: We study the boundary value problem of two stationary BGK-type models - the BGK model for fast chemical reaction and the BGK model for slow chemical reaction - and provide a unified argument to establish the existence and uniqueness of stationary flows of reactive BGK models in a slab. For both models, the main difficulty arises in the uniform control of the reactive parameters from above and below, since, unlike the BGK models for non-reactive gases, the reactive parameters for the reactive BGK models are defined through highly nonlinear relations. To overcome this difficulty, we introduce several nonlinear functionals that capture essential structures of such nonlinear relations such as the monotonicity in specific variables, that enable one to derive necessary estimates for the reactive equilibrium coefficients.


title: Information-Flow Interfaces

abstract: Contract-based design is a promising methodology for taming the complexity of developing sophisticated systems. A formal contract distinguishes between assumptions, which are constraints that the designer of a component puts on the environments in which the component can be used safely, and guarantees, which are promises that the designer asks from the team that implements the component. A theory of formal contracts can be formalized as an interface theory, which supports the composition and refinement of both assumptions and guarantees. Although there is a rich landscape of contract-based design methods that address functional and extra-functional properties, we present the first interface theory that is designed for ensuring system-wide security properties, thus paving the way for a science of safety and security co-engineering. Our framework provides a refinement relation and a composition operation that support both incremental design and independent implementability. We develop our theory for both stateless and stateful interfaces. We illustrate the applicability of our framework with an example inspired from the automotive domain. Finally, we provide three plausible trace semantics to stateful information-flow interfaces and we show that only two correspond to temporal logics for specifying hyperproperties, while the third defines a new class of hyperproperties that lies between the other two classes.


title: Coupled Thermal and Compositional Evolution of Photo Evaporating Planet Envelopes

abstract: Photo-evaporative mass loss sculpts the atmospheric evolution of tightly-orbiting sub-Neptune-mass exoplanets. To date, models of the mass loss from warm Neptunes have assumed that the atmospheric abundances remain constant throughout the planet's evolution. However, the cumulative effects of billions of years of escape modulated by diffusive separation and preferential loss of hydrogen can lead to planetary envelopes that are enhanced in helium and metals relative to hydrogen (Hu et al. 2015). We have performed the first self-consistent calculations of the coupled thermal, mass-loss, and compositional evolution of hydrogen-helium envelopes surrounding sub-Neptune mass planets. We extended the MESA (Modules for Experiments in Stellar Astrophysics) stellar evolution code to model the evolving envelope abundances of photo-evaporating planets. We find that GJ 436b, the planet that originally inspired Hu et al. (2015) to propose the formation of helium enhanced planetary atmospheres, requires a primordial envelope that is too massive to become helium enhanced. Nonetheless, we show that helium enhancement is possible for planets with masses similar to GJ 436b after only several Gyr of mass loss. These planets have $R_p\lesssim 3.00~R_\oplus$, initial $f_{\rm env} < 0.5\%$, irradiation flux $\sim$10$^1$-10$^3$ times that of Earth, and obtain final helium fractions in excess of Y=0.40 in our models. The results of preferential envelope loss may have observable consequences on mass-radius relations and atmospheric spectra for sub-Neptune populations.


title: Holes in Bayesian Statistics

abstract: Every philosophy has holes, and it is the responsibility of proponents of a philosophy to point out these problems. Here are a few holes in Bayesian data analysis: (1) the usual rules of conditional probability fail in the quantum realm, (2) flat or weak priors lead to terrible inferences about things we care about, (3) subjective priors are incoherent, (4) Bayesian decision picks the wrong model, (5) Bayes factors fail in the presence of flat or weak priors, (6) for Cantorian reasons we need to check our models, but this destroys the coherence of Bayesian inference. Some of the problems of Bayesian statistics arise from people trying to do things they shouldn't be trying to do, but other holes are not so easily patched. In particular, it may be a good idea to avoid flat, weak, or conventional priors, but such advice, if followed, would go against the vast majority of Bayesian practice and requires us to confront the fundamental incoherence of Bayesian inference. This does not mean that we think Bayesian inference is a bad idea, but it does mean that there is a tension between Bayesian logic and Bayesian workflow which we believe can only be resolved by considering Bayesian logic as a tool, a way of revealing inevitable misfits and incoherences in our model assumptions, rather than as an end in itself.


title: A Multiple Decoder CNN for Inverse Consistent 3D Image Registration

abstract: The recent application of deep learning technologies in medical image registration has exponentially decreased the registration time and gradually increased registration accuracy when compared to their traditional counterparts. Most of the learning-based registration approaches considers this task as a one directional problem. As a result, only correspondence from the moving image to the target image is considered. However, in some medical procedures bidirectional registration is required to be performed. Unlike other learning-based registration, we propose a registration framework with inverse consistency. The proposed method simultaneously learns forward transformation and backward transformation in an unsupervised manner. We perform training and testing of the method on the publicly available LPBA40 MRI dataset and demonstrate strong performance than baseline registration methods.


title: On Coresets for Support Vector Machines

abstract: We present an efficient coreset construction algorithm for large-scale Support Vector Machine (SVM) training in Big Data and streaming applications. A coreset is a small, representative subset of the original data points such that a models trained on the coreset are provably competitive with those trained on the original data set. Since the size of the coreset is generally much smaller than the original set, our preprocess-then-train scheme has potential to lead to significant speedups when training SVM models. We prove lower and upper bounds on the size of the coreset required to obtain small data summaries for the SVM problem. As a corollary, we show that our algorithm can be used to extend the applicability of any off-the-shelf SVM solver to streaming, distributed, and dynamic data settings. We evaluate the performance of our algorithm on real-world and synthetic data sets. Our experimental results reaffirm the favorable theoretical properties of our algorithm and demonstrate its practical effectiveness in accelerating SVM training.


title: Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning

abstract: Uncertainty estimation and ensembling methods go hand-in-hand. Uncertainty estimation is one of the main benchmarks for assessment of ensembling performance. At the same time, deep learning ensembles have provided state-of-the-art results in uncertainty estimation. In this work, we focus on in-domain uncertainty for image classification. We explore the standards for its quantification and point out pitfalls of existing metrics. Avoiding these pitfalls, we perform a broad study of different ensembling techniques. To provide more insight in this study, we introduce the deep ensemble equivalent score (DEE) and show that many sophisticated ensembling techniques are equivalent to an ensemble of only few independently trained networks in terms of test performance.


title: Minimax Optimal Nonparametric Estimation of Heterogeneous Treatment Effects

abstract: A central goal of causal inference is to detect and estimate the treatment effects of a given treatment or intervention on an outcome variable of interest, where a member known as the heterogeneous treatment effect (HTE) is of growing popularity in recent practical applications such as the personalized medicine. In this paper, we model the HTE as a smooth nonparametric difference between two less smooth baseline functions, and determine the tight statistical limits of the nonparametric HTE estimation as a function of the covariate geometry. In particular, a two-stage nearest-neighbor-based estimator throwing away observations with poor matching quality is near minimax optimal. We also establish the tight dependence on the density ratio without the usual assumption that the covariate densities are bounded away from zero, where a key step is to employ a novel maximal inequality which could be of independent interest.


title: First Robin Eigenvalue of the $p$-Laplacian on Riemannian Manifolds

abstract: We consider the first Robin eigenvalue $\l_p(M,\a)$ for the $p$-Laplacian on a compact Riemannian manifold $M$ with nonempty smooth boundary, with $\a \in \R$ being the Robin parameter. Firstly, we prove eigenvalue comparison theorems of Cheng type for $\l_p(M,\a)$. Secondly, when $\a>0$ we establish sharp lower bound of $\l_p(M,\a)$ in terms of dimension, inradius, Ricci curvature lower bound and boundary mean curvature lower bound, via comparison with an associated one-dimensional eigenvalue problem. The lower bound becomes an upper bound when $\a<0$. Our results cover corresponding comparison theorems for the first Dirichlet eigenvalue of the $p$-Laplacian when letting $\a \to +\infty$.


title: Universal Value Density Estimation for Imitation Learning and Goal-Conditioned Reinforcement Learning

abstract: This work considers two distinct settings: imitation learning and goal-conditioned reinforcement learning. In either case, effective solutions require the agent to reliably reach a specified state (a goal), or set of states (a demonstration). Drawing a connection between probabilistic long-term dynamics and the desired value function, this work introduces an approach which utilizes recent advances in density estimation to effectively learn to reach a given state. As our first contribution, we use this approach for goal-conditioned reinforcement learning and show that it is both efficient and does not suffer from hindsight bias in stochastic domains. As our second contribution, we extend the approach to imitation learning and show that it achieves state-of-the art demonstration sample-efficiency on standard benchmark tasks.


title: Is Deadline Oblivious Scheduling Efficient for Controlling Real-Time Traffic in Cellular Downlink Systems?

abstract: The emergence of bandwidth-intensive latency-critical traffic in 5G Networks, such as Virtual Reality, has motivated interest in wireless resource allocation problems for flows with hard-deadlines. Attempting to solve this problem brings about two challenges: (i) The flow arrival and the channel state are not known to the Base Station (BS) apriori, thus, the allocation decisions need to be made online. (ii) Wireless resource allocation algorithms that attempt to maximize a reward will likely be unfair, causing unacceptable service for some users. We model the problem as an online convex optimization problem. We propose a primal-dual Deadline-Oblivious (DO) algorithm, and show it is approximately 3.6-competitive. Furthermore, we show via simulations that our algorithm tracks the prescient offline solution very closely, significantly outperforming several existing algorithms. In the second part, we impose a stochastic constraint on the allocation, requiring a guarantee that each user achieves a certain timely throughput (amount of traffic delivered within the deadline over a period of time). We propose the Long-term Fair Deadline Oblivious (LFDO) algorithm for that setup. We combine the Lyapunov framework with analysis of online algorithms, to show that LFDO retains the high-performance of DO, while satisfying the long-term stochastic constraints.


title: An Andean Deep-Valley Detector for High-Energy Tau Neutrinos

abstract: High-energy astrophysical neutrinos, recently discovered by IceCube up to energies of several PeV, opened a new window to the high-energy Universe. Yet much remains to be known. IceCube has excellent muon flavor identification, but tau flavor identification is challenging. This limits its ability to probe neutrino physics and astrophysics. To address this limitation, we present a concept for a large-scale observatory of astrophysical tau neutrinos in the 1-100 PeV range, where a flux is guaranteed to exist. Its detection would allow us to characterize the neutrino sources observed by IceCube, to discover new ones, and test neutrino physics at high energies. The deep-valley air-shower array concept that we present provides highly background-suppressed neutrino detection with pointing resolution <1 degree, allowing us to begin the era of high-energy tau-neutrino astronomy.


title: Follow the Neurally-Perturbed Leader for Adversarial Training

abstract: Game-theoretic models of learning are a powerful set of models that optimize multi-objective architectures. Among these models are zero-sum architectures that have inspired adversarial learning frameworks. An important shortcoming of these zeros-sum architectures is that gradient-based training leads to weak convergence and cyclic dynamics. We propose a novel follow the leader training algorithm for zeros-sum architectures that guarantees convergence to mixed Nash equilibrium without cyclic behaviors. It is a special type of follow the perturbed leader algorithm where perturbations are the result of a neural mediating agent. We validate our theoretical results by applying this training algorithm to games with convex and non-convex loss as well as generative adversarial architectures. Moreover, we customize the implementation of this algorithm for adversarial imitation learning applications. At every step of the training, the mediator agent perturbs the observations with generated codes. As a result of these mediating codes, the proposed algorithm is also efficient for learning in environments with various factors of variations. We validate our assertion by using a procedurally generated game environment as well as synthetic data. Github implementation is available.


title: Metamaterials for Active Colloid Transport

abstract: Transport phenomena in out-of-equilibrium systems is immensely important in a myriad of applications in biology, engineering and physics. Complex environments, such as the cytoplasm or porous media, can substantially affect the transport properties of such systems. In particular, recent interest has focused on how such environments affect the motion of active systems, such as colloids and organisms propelled by directional driving forces. Nevertheless, the transport of active matter with non-directional (rotational) activity is yet to be understood, despite the ubiquity of rotating modes of motion in synthetic and natural systems. Here, we report on the discovery of spatiotemporal metamaterial systems that are able to dictate the transport of spinning colloids in exquisite ways based on solely two parameters: frequency of spin modulation in time and the symmetry of the metamaterial. We demonstrate that dynamic modulations of the amplitude of spin on a colloid in lattices with rotational symmetry give rise to non-equilibrium ballistic transport bands, reminiscent of those in Floquet-Bloch systems. By coupling these temporal modulations with additional symmetry breaking in the lattice, we show selective control from 4-way to 2-way to unidirectional motion. Our results provide critical new insights into the motion of spinning matter in complex (biological) systems. Furthermore, our work can also be used for designing systems with novel and unique transport properties for application in, for example, smart channel-less microfluidics, micro-robotics, or colloidal separations.


title: Learning to Group: A Bottom-Up Framework for 3D Part Discovery in Unseen Categories

abstract: We address the problem of discovering 3D parts for objects in unseen categories. Being able to learn the geometry prior of parts and transfer this prior to unseen categories pose fundamental challenges on data-driven shape segmentation approaches. Formulated as a contextual bandit problem, we propose a learning-based agglomerative clustering framework which learns a grouping policy to progressively group small part proposals into bigger ones in a bottom-up fashion. At the core of our approach is to restrict the local context for extracting part-level features, which encourages the generalizability to unseen categories. On the large-scale fine-grained 3D part dataset, PartNet, we demonstrate that our method can transfer knowledge of parts learned from 3 training categories to 21 unseen testing categories without seeing any annotated samples. Quantitative comparisons against four shape segmentation baselines shows that our approach achieve the state-of-the-art performance.


title: The Hubble Space Telescope UV Legacy Survey of Galactic Globular Clusters. XXI. Binaries among multiple stellar populations

abstract: A number of scenarios for the formation of multiple populations in globular clusters (GCs) predict that second generation (2G) stars form in a compact and dense subsystem embedded in a more extended first-generation (1G) system. If these scenarios are accurate, a consequence of the denser 2G formation environment is that 2G binaries should be more significantly affected by stellar interactions and disrupted at a larger rate than 1G binaries. The fractions and properties of binary stars can thus provide a dynamical fingerprint of the formation epoch of multiple-population GCs and their subsequent dynamical evolution. We investigate the connection between binaries and multiple populations in five GCs, NGC 288, NGC 6121 (M 4), NGC 6352, NGC 6362, and NGC 6838 (M 71). To do this, we introduce a new method based on the comparison of Hubble Space Telescope observations of binaries in the F275W, F336W, F438W, F606W and F814W filters with a large number of simulated binaries. In the inner regions probed by our data we do not find large differences between the local 1G and the 2G binary incidences in four of the studied clusters, the only exception being M 4 where the 1G binary incidence is about three times larger than the 2G incidence. The results found are in general agreement with the results of simulations predicting significant differences in the global 1G and 2G incidences and in the local values in the clusters' outer regions but similar incidences in the inner regions. The significant difference found in M 4 is consistent with simulations with a larger fraction of wider binaries. Our analysis also provides the first evidence of mixed (1G-2G) binaries, a population predicted by numerical simulations to form in a cluster's inner regions as a result of stellar encounters during which one component of a binary is replaced by a star of a different population.


title: Preparation and operation of SiW-ECAL technological prototype for DESY test beam 2019

abstract: We are developing SiW-ECAL technological prototypes with the aim of optimizing readout structure for $e^+e^-$ linear collider application. Developments are being carried out under the cooperation of LAL, LLR and Kyushu University. In this paper, we report the development status of FEV13, the latest version of the technological prototypes, following improvements from the previous versions. Several beam tests have been conducted so far for this FEV13 performance test. Most recently, beam test was conducted with electron beam (1-5 GeV) at DESY in Germany from June to July 2019. We mainly report on the setup and various operation tests of FEV13 during this beam test.


title: Performance Analysis of RSU-based Multihomed Multilane Vehicular Networks

abstract: Motivated by the potentially high downlink traffic demands of commuters in future autonomous vehicles, we study a network architecture where vehicles use Vehicle-to-Vehicle (V2V) links to form relay network clusters, which in turn use Vehicle-to-Infrastructure (V2I) links to connect to one or more Road Side Units (RSUs). Such cluster-based multihoming offers improved performance, e.g., in coverage and per user shared rate, but depends on the penetration of V2V-V2I capable vehicles and possible blockage, by legacy vehicles, of line of sight based V2V links, such as those based on millimeter-wave and visible light technologies. This paper provides a performance analysis of a typical vehicle's connectivity and throughput on a highway in the free-flow regime, exploring its dependence on vehicle density, sensitivity to blockages, number of lanes and heterogeneity across lanes. The results show that, even with moderate vehicle densities and penetration of V2V-V2I capable vehicles, such architectures can achieve substantial improvements in connectivity and reduction in per-user rate variability as compared to V2I based networks. The typical vehicle's performance is also shown to improve considerably in the multilane highway setting as compared to a single lane road. This paper also sheds light on how the network performance is affected when vehicles can control their relative positions, by characterizing the connectivity-throughput tradeoff faced by the clusters of vehicles.


title: Learning Adaptive Loss for Robust Learning with Noisy Labels

abstract: Robust loss minimization is an important strategy for handling robust learning issue on noisy labels. Current robust loss functions, however, inevitably involve hyperparameter(s) to be tuned, manually or heuristically through cross validation, which makes them fairly hard to be generally applied in practice. Besides, the non-convexity brought by the loss as well as the complicated network architecture makes it easily trapped into an unexpected solution with poor generalization capability. To address above issues, we propose a meta-learning method capable of adaptively learning hyperparameter in robust loss functions. Specifically, through mutual amelioration between robust loss hyperparameter and network parameters in our method, both of them can be simultaneously finely learned and coordinated to attain solutions with good generalization capability. Four kinds of SOTA robust loss functions are attempted to be integrated into our algorithm, and comprehensive experiments substantiate the general availability and effectiveness of the proposed method in both its accuracy and generalization performance, as compared with conventional hyperparameter tuning strategy, even with carefully tuned hyperparameters.


title: Face Recognition: Too Bias, or Not Too Bias?

abstract: We reveal critical insights into problems of bias in state-of-the-art facial recognition (FR) systems using a novel Balanced Faces In the Wild (BFW) dataset: data balanced for gender and ethnic groups. We show variations in the optimal scoring threshold for face-pairs across different subgroups. Thus, the conventional approach of learning a global threshold for all pairs resulting in performance gaps among subgroups. By learning subgroup-specific thresholds, we not only mitigate problems in performance gaps but also show a notable boost in the overall performance. Furthermore, we do a human evaluation to measure the bias in humans, which supports the hypothesis that such a bias exists in human perception. For the BFW database, source code, and more, visit github.com/visionjo/facerec-bias-bfw.


title: A Multimodal Dialogue System for Conversational Image Editing

abstract: In this paper, we present a multimodal dialogue system for Conversational Image Editing. We formulate our multimodal dialogue system as a Partially Observed Markov Decision Process (POMDP) and trained it with Deep Q-Network (DQN) and a user simulator. Our evaluation shows that the DQN policy outperforms a rule-based baseline policy, achieving 90\% success rate under high error rates. We also conducted a real user study and analyzed real user behavior.


title: Cooper instability and superconductivity on the Penrose lattice

abstract: Bulk superconductivity (SC) has recently been observed in the Al-Zn-Mg quasicrystal (QC). To settle several fundamental issues of the SC on the QC, we use an attractive Hubbard model to perform a systematic study on the Penrose lattice. The first issue is the Cooper instability of the QC, i.e., no Fermi surface under an infinitesimal attractive interaction. Starting from the two-electron problem outside the filled Fermi-sea, we analytically prove that an infinitesimal Hubbard attraction can lead to the Cooper instability as long as the density of state is nonzero at the Fermi level, which provides the basis of the SC on the QC. Our numerical results yield that the Cooper pairing always takes place between the two time-reversal states, satisfying the Anderson's theorem. On this theorem, we perform a mean-field (MF) study at both zero and finite temperatures. The MF study also shows that an arbitrarily weak attraction can lead to the pairing order, with the resulted pairing state being well described by the BCS theory and the thermal dynamic behaviors being well consistent with experimental results. The second issue is about the superfluid density on the QC without translational symmetry. It's clarified that although the normal state of the system locates at the critical point of the metal-insulator transition, the pairing state exhibits real SC, carrying finite superfluid density that can be verified by the Meissner effect, consistent with experiment also. These revealed properties of the SC on the Penrose lattice are universal for all QCs.


title: Possible counterintuitive enhancement of superconductivity in ladder-type cuprates by longitudinal compression

abstract: We theoretically study the effect of uniaxial deformation of ladder-type cuprate superconductors. Model construction based on first principles calculation shows that the rung-to-leg ratio of the nearest neighbor hoppings counterintuitively increases when the lattice is compressed in the longitudinal (leg) direction. This leads to an enhancement of the superconducting transition temperature, which intuitively is expected when compressed in the rung direction. Such a trend is traced back to the on-site hybridization between Cu$4s$ and Cu$d_{x^2-y^2}$ orbitals, which varies and changes sign upon lattice deformation.


title: Maxmin Q-learning: Controlling the Estimation Bias of Q-learning

abstract: Q-learning suffers from overestimation bias, because it approximates the maximum action value using the maximum estimated action value. Algorithms have been proposed to reduce overestimation bias, but we lack an understanding of how bias interacts with performance, and the extent to which existing algorithms mitigate bias. In this paper, we 1) highlight that the effect of overestimation bias on learning efficiency is environment-dependent; 2) propose a generalization of Q-learning, called \emph{Maxmin Q-learning}, which provides a parameter to flexibly control bias; 3) show theoretically that there exists a parameter choice for Maxmin Q-learning that leads to unbiased estimation with a lower approximation variance than Q-learning; and 4) prove the convergence of our algorithm in the tabular case, as well as convergence of several previous Q-learning variants, using a novel Generalized Q-learning framework. We empirically verify that our algorithm better controls estimation bias in toy environments, and that it achieves superior performance on several benchmark problems.


title: Convex Optimization on Functionals of Probability Densities

abstract: In information theory, some optimization problems result in convex optimization problems on strictly convex functionals of probability densities. In this note, we study these problems and show conditions of minimizers and the uniqueness of the minimizer if there exist a minimizer.


title: On the light-front wave functions of quarkonia

abstract: The light-front wave functions of hadrons allow us to calculate a wide range of physical observables; however, the wave functions themselves cannot be measured. We discuss recent results for quarkonia obtained in basis light-front quantization using an effective Hamiltonian with a confining model in both the transverse and longitudinal directions and with explicit one-gluon exchange. In particular, we focus on the numerical convergence of the basis expansion, as well as the asymptotic behavior of the light-front wave functions. We also illustrate that, for mesons with unequal quark masses, the maxima of the light-front wave functions depend in a non-trivial way on the valence quark-mass difference.


title: Vector network analysis based on wideband direct photonic digitizing

abstract: Vector network analyzers (VNAs) have become one of the indispensable tools in various fields, such as medicine, material, geology, communication, and etc, due to the capacity of measuring and analyzing the response of the object under test. Conventional VNAs, commonly based on mixing architecture, have to make compromises among accuracy, dynamic range, and bandwidth. In this paper, we propose a wideband photonic vector network analyzer (PVNA) based on wideband direct photonic digitizing. Ultrastable optical trains directly undersample the response signals from objects under test, followed by electrooptic conversion and quantization, obviating the intricate downconversion procedures in traditional VNAs. Adopting existing commercial devices, the proposed PVNA can not only extend the measurement frequency range to 110 GHz or higher but also achieve a high linearity and accuracy performance. To validate the theoretical analysis, we establish an experimental PVNA, realizing a measurable frequency span of up to 40 GHz and a dynamic range of more than 120 dB. A measured scattering parameters of a bandpass filter The experimental result is well consistent with that of a commercial network analyzer.


title: Blissard's trigonometric series with closed-form sums

abstract: This is a summary and verification of an elementary note written by John Blissard in 1862 for the Messenger of Mathematics. A general method of discovering trigonometric series having a closed-form sum is explained and illustrated with examples.


title: Image formation for extended sources with the solar gravitational lens

abstract: We study the image formation process with the solar gravitational lens (SGL) in the case of an extended, resolved source. An imaging telescope, modeled as a convex lens, is positioned within the image cylinder formed by the light received from the source. In the strong interference region of the SGL, this light is greatly amplified, forming the Einstein ring around the Sun, representing a distorted image of the extended source. We study the intensity distribution within the Einstein ring observed in the focal plane of the convex lens. For any particular telescope position in the image plane, we model light received from the resolved source as a combination of two signals: light received from the directly imaged region of the source and light from the rest of the source. We also consider the case when the telescope points away from the extended source or, equivalently, it observes light from sources in sky positions that are some distance away from the extended source, but still in its proximity. At even larger distances from the optical axis, in the weak interference or geometric optics regions, our approach recovers known models related to microlensing, but now obtained via the wave-optical treatment. We then derive the power of the signal and related photon fluxes within the annulus that contains the Einstein ring of the extended source, as seen by the imaging telescope. We discuss the properties of the deconvolution process, especially its effects on noise in the recovered image. We compare anticipated signals from realistic exoplanetary targets against estimates of noise from the solar corona and estimate integration times needed for the recovery of high-quality images of faint sources. The results demonstrate that the SGL offers a unique, realistic capability to obtain resolved images of exoplanets in our galactic neighborhood.

categories: astro-ph.IM astro-ph.EP gr-qc physics.ins-det physics.optics


title: Handover Probability in Drone Cellular Networks

abstract: This letter analyzes the handover probability in a drone cellular network where the initial positions of drone base stations (DBSs) serving a set of user equipment (UE) on the ground are modeled by a homogeneous Poisson point process (PPP). Inspired by the mobility model considered in the third generation partnership project (3GPP) studies, we assume that all the DBSs move along straight lines in random directions. We further consider two different scenarios for the DBS speeds: (i) same speed model (SSM), and (ii) different speed model (DSM). Assuming nearest-neighbor association policy for the UEs on the ground, we characterize the handover probability of this network for both mobility scenarios. For the SSM, we compute the exact handover probability by establishing equivalence with a single-tier terrestrial cellular network, in which the base stations (BSs) are static while the UEs are mobile. We then derive a lower bound for the handover probability in the DSM by characterizing the evolution of the spatial distribution of the DBSs over time.


title: Compositional Synthesis via a Convex Parameterization of Assume-Guarantee Contracts

abstract: We develop an assume-guarantee framework for control of large scale linear (time-varying) systems from finite-time reach and avoid or infinite-time invariance specifications. The contracts describe the admissible set of states and controls for individual subsystems. A set of contracts compose correctly if mutual assumptions and guarantees match in a way that we formalize. We propose a rich parameterization of contracts such that the set of parameters that compose correctly is convex. Moreover, we design a potential function of parameters that describes the distance of contracts from a correct composition. Thus, the verification and synthesis for the aggregate system are broken to solving small convex programs for individual subsystems, where correctness is ultimately achieved in a compositional way. Illustrative examples demonstrate the scalability of our method.


title: Blind Adversarial Network Perturbations

abstract: Deep Neural Networks (DNNs) are commonly used for various traffic analysis problems, such as website fingerprinting and flow correlation, as they outperform traditional (e.g., statistical) techniques by large margins. However, deep neural networks are known to be vulnerable to adversarial examples: adversarial inputs to the model that get labeled incorrectly by the model due to small adversarial perturbations. In this paper, for the first time, we show that an adversary can defeat DNN-based traffic analysis techniques by applying \emph{adversarial perturbations} on the patterns of \emph{live} network traffic.


title: Single-cycle THz signal accompanying laser wake in photoionized plasmas and plasma channels

abstract: Photoionization by a femtosecond, terawatt laser pulse generates a plasma column in a neutral ambient gas. Velocity of electrons, pushed by the laser ponderomotive force along the column surface, couples to the the radial density gradient at the column boundary, generating an azimuthally polarized THz rotational current (RC). The same mechanism produces the low-frequency RC in a leaky plasma channel. Applying external voltage to the channel induces a radially non-uniform electron flow (direct current) and a constant, azimuthally polarized magnetic field. Coupling them to the electron density perturbations adds two more terms to the RC. The surface RC in the plasma column supports a broadband, evanescent THz signal accompanying the wake. A few millimeters away from the column, rapid evanescence of high-frequency components turns this THz signal into a radially polarized, single-cycle pulse.


title: Effect of skin-to-skin contact on stimulation threshold and dosimetry

abstract: The human dosimetry for electromagnetic field exposure is an essential task to develop exposure guidelines/standards for human safety as well as product safety assessment. At frequencies from a few hundred Hz to 10 MHz, the adverse effect to be protected is the stimulation of the peripheral nervous system. The in situ electric field in the skin is used as a surrogate of nerve activation. In the low-frequency dosimetry, a high but inaccurate in situ electric field has been reported at positions where a skin-to-skin contact exists, whose relation to the stimulation is controversial. One of the reasons for high electric fields may be attributable to the current resolution of anatomical models. In this study, we first evaluate the stimulation threshold at postures of skin-to-skin contact experimentally for different hand/finger positions to represent skin touching/non-touching scenarios. We confirm that the skin-to-skin contact does not lower the threshold current of magnetic stimulation devices needed to induce pain. Second, a new method is proposed for hand modeling to configure different finger positions using static hand models with similar postures to the experiments. We compute the in situ electric field at skin-to-skin contact for the different hand posture scenarios that indicate an excessive raise of the electric field in skin-to-skin regions that is not justified by the experiments. The comparison suggests that a high in situ electric field in the skin would be caused by poor modeling of the skin layers, which is not enough to represent in a resolution of the order of a millimeter. This skin-to-skin contact should not be considered to set the restriction in the international exposure guidelines/standards as well as product safety assessment.


title: Snapshot Models of Undocumented Immigration

abstract: The Mexican Migration Project (MMP) is a study that includes samples of undocumented Mexican immigrants to the United States after their return to Mexico. Of particular interest are the departure and return dates of a sampled migrant's most recent sojourn in the United States, and the total number of such journeys undertaken by that migrant household, for these data enable the construction of data-driven undocumented immigration models. However, such data are subject to an extreme physical bias, for to be included in such a sample, a migrant must have returned to Mexico by the time of the survey, excluding those undocumented immigrants still in the US. In our analysis, we account for this bias by jointly modeling trip timing and duration to produce the likelihood of observing the data in such a "snapshot" sample. Our analysis characterizes undocumented migration flows including single visit migrants, repeat visitors, and "retirement" from circular migration. Starting with 1987, we apply our models to 30 annual random snapshot surveys of returned undocumented Mexican migrants accounting for undocumented Mexican migration from 1980-2016. Contrary to published estimates based on these same data, our results imply migrants remain in the US much longer than previously estimated based on analysis that ignored the physical snapshot bias. Scaling to population quantities, we produce lower bounds on the total number of undocumented immigrants that are much larger than conventional estimates based on US-based census-linked surveys, and broadly consistent with the estimates reported by Fazel-Zarandi, Feinstein and Kaplan (2018).


title: Demystifying the Performance of HPC Scientific Applications on NVM-based Memory Systems

abstract: The emergence of high-density byte-addressable non-volatile memory (NVM) is promising to accelerate data- and compute-intensive applications. Current NVM technologies have lower performance than DRAM and, thus, are often paired with DRAM in a heterogeneous main memory. Recently, byte-addressable NVM hardware becomes available. This work provides a timely evaluation of representative HPC applications from the "Seven Dwarfs" on NVM-based main memory. Our results quantify the effectiveness of DRAM-cached-NVM for accelerating HPC applications and enabling large problems beyond the DRAM capacity. On uncached-NVM, HPC applications exhibit three tiers of performance sensitivity, i.e., insensitive, scaled, and bottlenecked. We identify write throttling and concurrency control as the priorities in optimizing applications. We highlight that concurrency change may have a diverging effect on read and write accesses in applications. Based on these findings, we explore two optimization approaches. First, we provide a prediction model that uses datasets from a small set of configurations to estimate performance at various concurrency and data sizes to avoid exhaustive search in the configuration space. Second, we demonstrate that write-aware data placement on uncached-NVM could achieve $2$x performance improvement with a 60% reduction in DRAM usage.


title: The Formation of the Double Gaussian Line Profiles of the Symbiotic Star AG Peg

abstract: We analyze high dispersion emission lines of the symbiotic nova AG Peg, observed in 1998, 2001, and 2002. The H$\alpha$ and H$\beta$ lines show three components, two narrow and one underlying broad line components, but most other lines, such as HI, HeI, and HeII lines, show two blue- and red-shifted components only. A recent study by Lee & Hyung (2018) suggested that the double Gaussian lines emitted from a bipolar conic shell is likely to form Raman scattering lines observed in 1998. In this study, we show that the bipolar cone with an opening angle of 74$^{o}$, which expands at a velocity of 70 kms$^{-1}$ along the polar axis of the white dwarf, can accommodate the observed double line profiles in 1998, 2001, and 2002. We conclude that the emission zone of the bipolar conic shell, which formed along the bipolar axis of the white dwarf due to the collimation by the accretion disk, is responsible for the double Gaussian profiles.


title: Convex Fairness Constrained Model Using Causal Effect Estimators

abstract: Recent years have seen much research on fairness in machine learning. Here, mean difference (MD) or demographic parity is one of the most popular measures of fairness. However, MD quantifies not only discrimination but also explanatory bias which is the difference of outcomes justified by explanatory features. In this paper, we devise novel models, called FairCEEs, which remove discrimination while keeping explanatory bias. The models are based on estimators of causal effect utilizing propensity score analysis. We prove that FairCEEs with the squared loss theoretically outperform a naive MD constraint model. We provide an efficient algorithm for solving FairCEEs in regression and binary classification tasks. In our experiment on synthetic and real-world data in these two tasks, FairCEEs outperformed an existing model that considers explanatory bias in specific cases.


title: Refined Belief Propagation Decoding of Sparse-Graph Quantum Codes

abstract: Quantum stabilizer codes constructed from sparse matrices have good performance and can be efficiently decoded by belief propagation (BP). A conventional BP decoding algorithm treats binary stabilizer codes as additive codes over GF(4). This algorithm has a relatively complex process of handling check-node messages, which incurs higher decoding complexity. Moreover, BP decoding of a stabilizer code usually suffers a performance loss due to the many short cycles in the underlying Tanner graph. In this paper, we propose a refined BP decoding algorithm for quantum codes with complexity roughly the same as binary BP. For a given error syndrome, this algorithm decodes to the same output as the conventional quaternary BP but the passed node-to-node messages are single-valued, unlike the quaternary BP, where multivalued node-to-node messages are required. Furthermore, the techniques of message strength normalization can naturally be applied to these single-valued messages to improve the performance. Another observation is that the message-update schedule affects the performance of BP decoding against short cycles. We show that running BP with message strength normalization according to a serial schedule (or other schedules) may significantly improve the decoding performance and error floor in computer simulation.


title: Statistical Simulator for the Engine Knock

abstract: This paper proposes a statistical simulator for the engine knock based on the Mixture Density Network (MDN) and the accept-reject method. The proposed simulator can generate the random knock intensity signal corresponding to the input signal. The generated knock intensity has a consistent probability distribution with the real engine. Firstly, the statistical analysis is conducted with the experimental data. From the analysis results, some important assumptions on the statistical properties of the knock intensity are made. Regarding the knock intensity as a random variable on the discrete-time index, it is independent and identically distributed if the input of the engine is identical. The probability distribution of the knock intensity under identical input can be approximated by the Gaussian Mixture Model(GMM). The parameter of the GMM is a function of the input. Based on these assumptions, two sub-problems for establishing the statistical simulator are formulated: One is to approximate the function from input to the parameters of the knock intensity distribution with an absolutely continuous function; The other one is to design a random number generator that outputs the random data consistent with the given distribution. The MDN is applied to approximate the probability density of the knock intensity and the accept-reject algorithm is used for the random number generator design. The proposed method is evaluated in experimental data-based validation.


title: Differentiable Top-k Operator with Optimal Transport

abstract: The top-k operation, i.e., finding the k largest or smallest elements from a collection of scores, is an important model component, which is widely used in information retrieval, machine learning, and data mining. However, if the top-k operation is implemented in an algorithmic way, e.g., using bubble algorithm, the resulting model cannot be trained in an end-to-end way using prevalent gradient descent algorithms. This is because these implementations typically involve swapping indices, whose gradient cannot be computed. Moreover, the corresponding mapping from the input scores to the indicator vector of whether this element belongs to the top-k set is essentially discontinuous. To address the issue, we propose a smoothed approximation, namely the SOFT (Scalable Optimal transport-based diFferenTiable) top-k operator. Specifically, our SOFT top-k operator approximates the output of the top-k operation as the solution of an Entropic Optimal Transport (EOT) problem. The gradient of the SOFT operator can then be efficiently approximated based on the optimality conditions of EOT problem. We apply the proposed operator to the k-nearest neighbors and beam search algorithms, and demonstrate improved performance.


title: A closer look at the approximation capabilities of neural networks

abstract: The universal approximation theorem, in one of its most general versions, says that if we consider only continuous activation functions $\sigma$, then a standard feedforward neural network with one hidden layer is able to approximate any continuous multivariate function $f$ to any given approximation threshold $\varepsilon$, if and only if $\sigma$ is non-polynomial. In this paper, we give a direct algebraic proof of the theorem. Furthermore we shall explicitly quantify the number of hidden units required for approximation. Specifically, if $X\subseteq \mathbb{R}^n$ is compact, then a neural network with $n$ input units, $m$ output units, and a single hidden layer with $\binom{n+d}{d}$ hidden units (independent of $m$ and $\varepsilon$), can uniformly approximate any polynomial function $f:X \to \mathbb{R}^m$ whose total degree is at most $d$ for each of its $m$ coordinate functions. In the general case that $f$ is any continuous function, we show there exists some $N\in \mathcal{O}(\varepsilon^{-n})$ (independent of $m$), such that $N$ hidden units would suffice to approximate $f$. We also show that this uniform approximation property (UAP) still holds even under seemingly strong conditions imposed on the weights. We highlight several consequences: (i) For any $\delta > 0$, the UAP still holds if we restrict all non-bias weights $w$ in the last layer to satisfy $|w| < \delta$. (ii) There exists some $\lambda>0$ (depending only on $f$ and $\sigma$), such that the UAP still holds if we restrict all non-bias weights $w$ in the first layer to satisfy $|w|>\lambda$. (iii) If the non-bias weights in the first layer are \emph{fixed} and randomly chosen from a suitable range, then the UAP holds with probability $1$.


abstract: In reinforcement learning, an agent attempts to learn high-performing behaviors through interacting with the environment, such behaviors are often quantified in the form of a reward function. However some aspects of behavior-such as ones which are deemed unsafe and to be avoided-are best captured through constraints. We propose a novel approach called First Order Constrained Optimization in Policy Space (FOCOPS) which maximizes an agent's overall reward while ensuring the agent satisfies a set of cost constraints. Using data generated from the current policy, FOCOPS first finds the optimal update policy by solving a constrained optimization problem in the nonparameterized policy space. FOCOPS then projects the update policy back into the parametric policy space. Our approach has an approximate upper bound for worst-case constraint violation throughout training and is first-order in nature therefore simple to implement. We provide empirical evidence that our simple approach achieves better performance on a set of constrained robotics locomotive tasks.


title: Coordinate-free Circumnavigation of a Moving Target via a PD-like Controller

abstract: This paper proposes a coordinate-free controller for a nonholonomic vehicle to circumnavigate a fully-actuated moving target by using range-only measurements. If the range rate is available, our Proportional Derivative (PD)-like controller has a simple structure as the standard PD controller, except the design of an additive constant bias and a saturation function in the error feedback. We show that if the target is stationary, the vehicle asymptotically encloses the target with a predefined radius at an exponential convergence rate, i.e., an exact circumnavigation pattern can be completed. For a moving target, the circumnavigation error converges to a small region whose size is shown proportional to the maneuverability of the target, e.g., the maximum linear speed and acceleration. Moreover, we design a second-order sliding mode (SOSM) filter to estimate the range rate and show that the SOSM filter can recover the range rate in a finite time. Finally, the effectiveness and advantages of our controller are validated via both numerical simulations and real experiments.


title: Multi-Class Classification from Noisy-Similarity-Labeled Data

abstract: A similarity label indicates whether two instances belong to the same class while a class label shows the class of the instance. Without class labels, a multi-class classifier could be learned from similarity-labeled pairwise data by meta classification learning. However, since the similarity label is less informative than the class label, it is more likely to be noisy. Deep neural networks can easily remember noisy data, leading to overfitting in classification. In this paper, we propose a method for learning from only noisy-similarity-labeled data. Specifically, to model the noise, we employ a noise transition matrix to bridge the class-posterior probability between clean and noisy data. We further estimate the transition matrix from only noisy data and build a novel learning system to learn a classifier which can assign noise-free class labels for instances. Moreover, we theoretically justify how our proposed method generalizes for learning classifiers. Experimental results demonstrate the superiority of the proposed method over the state-of-the-art method on benchmark-simulated and real-world noisy-label datasets.