title: Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation

abstract: In the past decade the mathematical theory of machine learning has lagged far behind the triumphs of deep neural networks on practical challenges. However, the gap between theory and practice is gradually starting to close. In this paper I will attempt to assemble some pieces of the remarkable and still incomplete mathematical mosaic emerging from the efforts to understand the foundations of deep learning. The two key themes will be interpolation, and its sibling, over-parameterization. Interpolation corresponds to fitting data, even noisy data, exactly. Over-parameterization enables interpolation and provides flexibility to select a right interpolating model. As we will see, just as a physical prism separates colors mixed within a ray of light, the figurative prism of interpolation helps to disentangle generalization and optimization properties within the complex picture of modern Machine Learning. This article is written with belief and hope that clearer understanding of these issues brings us a step closer toward a general theory of deep learning and machine learning.


title: Temporal Minimal-World Semantics for Sparse ABoxes

abstract: Ontology-mediated query answering is a popular paradigm for enriching answers to user queries with background knowledge. For querying the absence of information, however, there exist only few ontology-based approaches. Moreover, these proposals conflate the closed-domain and closed-world assumption, and therefore are not suited to deal with the anonymous objects that are common in ontological reasoning. Many real-world applications, like processing electronic health records (EHRs), also contain a temporal dimension, and require efficient reasoning algorithms. Moreover, since medical data is not recorded on a regular basis, reasoners must deal with sparse data with potentially large temporal gaps. Our contribution consists of two main parts: In the first part we introduce a new closed-world semantics for answering conjunctive queries with negation over ontologies formulated in the description logic ELHb, which is based on the minimal canonical model. We propose a rewriting strategy for dealing with negated query atoms, which shows that query answering is possible in polynomial time in data complexity. In the second part, we extend this minimal-world semantics for answering metric temporal conjunctive queries with negation over the lightweight temporal logic TELHb and obtain similar rewritability and complexity results. This paper is under consideration in Theory and Practice of Logic Programming (TPLP).


title: BAAI-VANJEE Roadside Dataset: Towards the Connected Automated Vehicle Highway technologies in Challenging Environments of China

abstract: As the roadside perception plays an increasingly significant role in the Connected Automated Vehicle Highway(CAVH) technologies, there are immediate needs of challenging real-world roadside datasets for bench marking and training various computer vision tasks such as 2D/3D object detection and multi-sensor fusion. In this paper, we firstly introduce a challenging BAAI-VANJEE roadside dataset which consist of LiDAR data and RGB images collected by VANJEE smart base station placed on the roadside about 4.5m high. This dataset contains 2500 frames of LiDAR data, 5000 frames of RGB images, including 20% collected at the same time. It also contains 12 classes of objects, 74K 3D object annotations and 105K 2D object annotations. By providing a real complex urban intersections and highway scenes, we expect the BAAI-VANJEE roadside dataset will actively assist the academic and industrial circles to accelerate the innovation research and achievement transformation in the field of intelligent transportation in big data era.


title: Fine-Tuning the Odds in Bayesian Networks

abstract: This paper proposes various new analysis techniques for Bayes networks in which conditional probability tables (CPTs) may contain symbolic variables. The key idea is to exploit scalable and powerful techniques for synthesis problems in parametric Markov chains. Our techniques are applicable to arbitrarily many, possibly dependent parameters that may occur in various CPTs. This lifts the severe restrictions on parameters, e.g., by restricting the number of parametrized CPTs to one or two, or by avoiding parameter dependencies between several CPTs, in existing works for parametric Bayes networks (pBNs). We describe how our techniques can be used for various pBN synthesis problems studied in the literature such as computing sensitivity functions (and values), simple and difference parameter tuning, ratio parameter tuning, and minimal change tuning. Experiments on several benchmarks show that our prototypical tool built on top of the probabilistic model checker Storm can handle several hundreds of parameters.


title: Ten Quick Tips for Deep Learning in Biology

abstract: Machine learning is a modern approach to problem-solving and task automation. In particular, machine learning is concerned with the development and applications of algorithms that can recognize patterns in data and use them for predictive modeling. Artificial neural networks are a particular class of machine learning algorithms and models that evolved into what is now described as deep learning. Given the computational advances made in the last decade, deep learning can now be applied to massive data sets and in innumerable contexts. Therefore, deep learning has become its own subfield of machine learning. In the context of biological research, it has been increasingly used to derive novel insights from high-dimensional biological data. To make the biological applications of deep learning more accessible to scientists who have some experience with machine learning, we solicited input from a community of researchers with varied biological and deep learning interests. These individuals collaboratively contributed to this manuscript's writing using the GitHub version control platform and the Manubot manuscript generation toolset. The goal was to articulate a practical, accessible, and concise set of guidelines and suggestions to follow when using deep learning. In the course of our discussions, several themes became clear: the importance of understanding and applying machine learning fundamentals as a baseline for utilizing deep learning, the necessity for extensive model comparisons with careful evaluation, and the need for critical thought in interpreting results generated by deep learning, among others.


title: Sentiment analysis in tweets: an assessment study from classical to modern text representation models

abstract: With the growth of social medias, such as Twitter, plenty of user-generated data emerge daily. The short texts published on Twitter -- the tweets -- have earned significant attention as a rich source of information to guide many decision-making processes. However, their inherent characteristics, such as the informal, and noisy linguistic style, remain challenging to many natural language processing (NLP) tasks, including sentiment analysis. Sentiment classification is tackled mainly by machine learning-based classifiers. The literature has adopted word representations from distinct natures to transform tweets to vector-based inputs to feed sentiment classifiers. The representations come from simple count-based methods, such as bag-of-words, to more sophisticated ones, such as BERTweet, built upon the trendy BERT architecture. Nevertheless, most studies mainly focus on evaluating those models using only a small number of datasets. Despite the progress made in recent years in language modelling, there is still a gap regarding a robust evaluation of induced embeddings applied to sentiment analysis on tweets. Furthermore, while fine-tuning the model from downstream tasks is prominent nowadays, less attention has been given to adjustments based on the specific linguistic style of the data. In this context, this study fulfils an assessment of existing language models in distinguishing the sentiment expressed in tweets by using a rich collection of 22 datasets from distinct domains and five classification algorithms. The evaluation includes static and contextualized representations. Contexts are assembled from Transformer-based autoencoder models that are also fine-tuned based on the masked language model task, using a plethora of strategies.


title: Efficient treatment of molecular excitations in the liquid phase environment via stochastic many-body theory

abstract: Accurate predictions of charge excitation energies of molecules in the disordered condensed phase are central to the chemical reactivity, stability, and optoelectronic properties of molecules and critically depend on the specific environment. Herein, we develop a stochastic GW method for calculating these charge excitation energies. The approach employs maximally localized electronic states to define the electronic subspace of a molecule and the rest of the system, both of which are randomly sampled. We test the method on three solute-solvent systems: phenol, thymine, and phenylalanine in water. The results are in excellent agreement with the previous high-level calculations and available experimental data. The stochastic calculations for supercells representing the solvated systems are inexpensive and require $\sim 1000$ CPU$\cdot$hrs. We find that the coupling with the environment accounts for $\sim40\%$ of the total correlation energy. The solvent-to-solute feedback mechanism incorporated in the molecular correlation term causes up to 0.6 eV destabilization of the QP energy. Simulated photo-emission spectra exhibit red shifts, state-degeneracy lifting, and lifetime shortening. Our method provides an efficient approach for an accurate study of excitations of large molecules in realistic condensed phase environments.


title: Three-loop soft anomalous dimensions for top-quark processes

abstract: I present results for soft anomalous dimensions through three loops for several processes involving the production of top quarks. In particular, I discuss single-top and top-pair production. I also present some numerical results for double-differential distributions in $t{\bar t}$ production through approximate N$^3$LO.


title: Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis

abstract: The rapid advances in deep generative models over the past years have led to highly {realistic media, known as deepfakes,} that are commonly indistinguishable from real to human eyes. These advances make assessing the authenticity of visual data increasingly difficult and pose a misinformation threat to the trustworthiness of visual content in general. Although recent work has shown strong detection accuracy of such deepfakes, the success largely relies on identifying frequency artifacts in the generated images, which will not yield a sustainable detection approach as generative models continue evolving and closing the gap to real images. In order to overcome this issue, we propose a novel fake detection that is designed to re-synthesize testing images and extract visual cues for detection. The re-synthesis procedure is flexible, allowing us to incorporate a series of visual tasks - we adopt super-resolution, denoising and colorization as the re-synthesis. We demonstrate the improved effectiveness, cross-GAN generalization, and robustness against perturbations of our approach in a variety of detection scenarios involving multiple generators over CelebA-HQ, FFHQ, and LSUN datasets. Source code is available at https://github.com/SSAW14/BeyondtheSpectrum.


title: Diagnosing Barren Plateaus with Tools from Quantum Optimal Control

abstract: Variational Quantum Algorithms (VQAs) have received considerable attention due to their potential for achieving near-term quantum advantage. However, more work is needed to understand their scalability. One known scaling result for VQAs is barren plateaus, where certain circumstances lead to exponentially vanishing gradients. It is common folklore that problem-inspired ansatzes avoid barren plateaus, but in fact, very little is known about their gradient scaling. In this work we employ tools from quantum optimal control to develop a framework that can diagnose the presence or absence of barren plateaus for problem-inspired ansatzes. Such ansatzes include the Quantum Alternating Operator Ansatz (QAOA), the Hamiltonian Variational Ansatz (HVA), and others. With our framework, we prove that avoiding barren plateaus for these ansatzes is not always guaranteed. Specifically, we show that the gradient scaling of the VQA depends on the degree of controllability of the system, and hence can be diagnosed through the dynamical Lie algebra $\mathfrak{g}$ obtained from the generators of the ansatz. We analyze the existence of barren plateaus in QAOA and HVA ansatzes, and we highlight the role of the input state, as different initial states can lead to the presence or absence of barren plateaus. Taken together, our results provide a framework for trainability-aware ansatz design strategies that do not come at the cost of extra quantum resources. Moreover, we prove no-go results for obtaining ground states with variational ansatzes for controllable system such as spin glasses. Our work establishes a link between the existence of barren plateaus and the scaling of the dimension of $\mathfrak{g}$.


title: The Partition Function of Log-Gases with Multiple Odd Charges

abstract: We use techniques in the shuffle algebra to present a formula for the partition function of a one-dimensional log-gas comprised of particles of (possibly) different integer charges at certain inverse temperature $\beta$ in terms of the Berezin integral of an associated non-homogeneous alternating tensor. This generalizes previously known results by removing the restriction on the number of species of odd charge. Our methods provide a unified framework extending the de Bruijn integral identities from classical $\beta$-ensembles ($\beta$ = 1, 2, 4) to multicomponent ensembles, as well as to iterated integrals of more general determinantal integrands.


title: The Carter tensor and the physical-space analysis in perturbations of Kerr-Newman spacetime

abstract: The Carter tensor is a Killing tensor of the Kerr-Newman spacetime, and its existence implies the separability of the wave equation. Nevertheless, the Carter operator is known to commute with the D'Alembertian only in the case of a Ricci-flat metric. We show that, even though the Kerr-Newman spacetime satisfies the non-vacuum Einstein-Maxwell equations, its curvature and electromagnetic tensors satisfy peculiar properties which imply that the Carter operator still commutes with the wave equation. This feature allows to adapt to Kerr-Newman the physical-space analysis of the wave equation in Kerr by Andersson-Blue, which avoids frequency decomposition of the solution by precisely making use of the commutation with the Carter operator. We also extend the mathematical framework of physical-space analysis to the case of the Einstein-Maxwell equations on Kerr-Newman spacetime, representing coupled electromagnetic-gravitational perturbations of the rotating charged black hole. The physical-space analysis is crucial in this setting as the coupling of spin-1 and spin-2 fields in the axially symmetric background prevents the separation in modes as observed by Chandrasekhar, and therefore represents an important step towards an analytical proof of the stability of the Kerr-Newman black hole.


title: Transmission Delay Minimization via Joint Power Control and Caching in Wireless HetNets

abstract: A fundamental challenge in wireless heterogeneous networks (HetNets) is to effectively utilize the limited transmission and storage resources in the presence of increasing deployment density and backhaul capacity constraints. To alleviate bottlenecks and reduce resource consumption, we design optimal caching and power control algorithms for multi-hop wireless HetNets. We formulate a joint optimization framework to minimize the average transmission delay as a function of the caching variables and the signal-to-interference-plus-noise ratios (SINR) which are determined by the transmission powers, while explicitly accounting for backhaul connection costs and the power constraints. Using convex relaxation and rounding, we obtain a reduced-complexity formulation (RCF) of the joint optimization problem, which can provide a constant factor approximation to the globally optimal solution. We then solve RCF in two ways: 1) alternating optimization of the power and caching variables by leveraging biconvexity, and 2) joint optimization of power control and caching. We characterize the necessary (KKT) conditions for an optimal solution to RCF, and use strict quasi-convexity to show that the KKT points are Pareto optimal for RCF. We then devise a subgradient projection algorithm to jointly update the caching and power variables, and show that under appropriate conditions, the algorithm converges at a linear rate to the local minima of RCF, under general SINR conditions. We support our analytical findings with results from extensive numerical experiments.


title: Formally Validating a Practical Verification Condition Generator (extended version)

abstract: A program verifier produces reliable results only if both the logic used to justify the program's correctness is sound, and the implementation of the program verifier is itself correct. Whereas it is common to formally prove soundness of the logic, the implementation of a verifier typically remains unverified. Bugs in verifier implementations may compromise the trustworthiness of successful verification results. Since program verifiers used in practice are complex, evolving software systems, it is generally not feasible to formally verify their implementation. In this paper, we present an alternative approach: we validate successful runs of the widely-used Boogie verifier by producing a certificate which proves correctness of the obtained verification result. Boogie performs a complex series of program translations before ultimately generating a verification condition whose validity should imply the correctness of the input program. We show how to certify three of Boogie's core transformation phases: the elimination of cyclic control flow paths, the (SSA-like) replacement of assignments by assumptions using fresh variables (passification), and the final generation of verification conditions. Similar translations are employed by other verifiers. Our implementation produces certificates in Isabelle, based on a novel formalisation of the Boogie language.


title: Asset volatility forecasting:The optimal decay parameter in the EWMA model

abstract: The exponentially weighted moving average (EMWA) could be labeled as a competitive volatility estimator, where its main strength relies on computation simplicity, especially in a multi-asset scenario, due to dependency only on the decay parameter, $\lambda$. But, what is the best election for $\lambda$ in the EMWA volatility model? Through a large time-series data set of historical returns of the top US large-cap companies; we test empirically the forecasting performance of the EWMA approach, under different time horizons and varying the decay parameter. Using a rolling window scheme, the out-of-sample performance of the variance-covariance matrix is computed following two approaches. First, if we look for a fixed decay parameter for the full sample, the results are in agreement with the RiskMetrics suggestion for 1-month forecasting. In addition, we provide the full-sample optimal decay parameter for the weekly and bi-weekly forecasting horizon cases, confirming two facts: i) the optimal value is as a function of the forecasting horizon, and ii) for lower forecasting horizons the short-term memory gains importance. In a second way, we also evaluate the forecasting performance of EWMA, but this time using the optimal time-varying decay parameter which minimizes the in-sample variance-covariance estimator, arriving at better accuracy than the use of a fixed-full-sample optimal parameter.


title: Gradient-Free Neural Network Training via Synaptic-Level Reinforcement Learning

abstract: An ongoing challenge in neural information processing is: how do neurons adjust their connectivity to improve task performance over time (i.e., actualize learning)? It is widely believed that there is a consistent, synaptic-level learning mechanism in specific brain regions that actualizes learning. However, the exact nature of this mechanism remains unclear. Here we propose an algorithm based on reinforcement learning (RL) to generate and apply a simple synaptic-level learning policy for multi-layer perceptron (MLP) models. In this algorithm, the action space for each MLP synapse consists of a small increase, decrease, or null action on the synapse weight, and the state for each synapse consists of the last two actions and reward signals. A binary reward signal indicates improvement or deterioration in task performance. The static policy produces superior training relative to the adaptive policy and is agnostic to activation function, network shape, and task. Trained MLPs yield character recognition performance comparable to identically shaped networks trained with gradient descent. 0 hidden unit character recognition tests yielded an average validation accuracy of 88.28%, 1.86$\pm$0.47% higher than the same MLP trained with gradient descent. 32 hidden unit character recognition tests yielded an average validation accuracy of 88.45%, 1.11$\pm$0.79% lower than the same MLP trained with gradient descent. The robustness and lack of reliance on gradient computations opens the door for new techniques for training difficult-to-differentiate artificial neural networks such as spiking neural networks (SNNs) and recurrent neural networks (RNNs). Further, the method's simplicity provides a unique opportunity for further development of local rule-driven multi-agent connectionist models for machine intelligence analogous to cellular automata.


title: Directional field-dependence of tunable magnetic domains in noncentrosymmetric ferromagnetic Weyl semimetal CeAlSi

abstract: Dynamics and textures of magnetic domain walls (DWs) may largely alter the electronic behaviors in a Weyl semimetal system via emergent gauge fields. However, very little is known about even the basic properties of these domain walls in Weyl materials. In this work, we imaged the spontaneous magnetization and magnetic susceptibility of a ferromagnetic (FM) Weyl semimetal CeAlSi using scanning SQUID microscopy. We observed the ferromagnetic DWs lined-up with the [100] direction (or other degenerate directions). We also discovered the coexistence of stable and metastable domain phases, which arise likely due to magnetoelastic and magnetostriction effects and are expected to be highly tunable with small strains. We applied an in-plane external field as the CeAlSi sample was cooled down to below the magnetic phase transition of 8.3K, showing that the pattern of FM domains is strongly correlated with both the amplitude and the orientation of the external field even for weak fields of a few Gauss. The area of stable domains increases with field and reaches maximum when the field is parallel to the main crystallographic axes of the CeAlSi crystal. Our results suggest that the manipulation of these heterogeneous phases can provide a practical way to study the interplay between magnetism and electronic properties in Weyl systems, and that these systems can even serve as a new platform for magnetic sensors.


title: On Centralized and Distributed Mirror Descent: Convergence Analysis Using Quadratic Constraints

abstract: Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the convergence rate of MD in centralized and distributed settings under both strongly convex and non-strongly convex assumptions. We view MD with a dynamical system lens and leverage quadratic constraints (QCs) to provide explicit convergence rates based on Lyapunov stability. For centralized MD under strongly convex assumption, we develop a SDP that certifies exponential convergence rates. We prove that the SDP always has a feasible solution that recovers the optimal GD rate as a special case. We complement our analysis by providing the $O(1/k)$ convergence rate for convex problems. Next, we analyze the convergence of distributed MD and characterize the rate using SDP. To the best of our knowledge, the numerical rate of distributed MD has not been previously reported in the literature. We further prove an $O(1/k)$ convergence rate for distributed MD in the convex setting. Our numerical experiments on strongly convex problems indicate that our framework certifies superior convergence rates compared to the existing rates for distributed GD.


title: Liouville theorems for semilinear differential inequalities on sub-Riemannian manifolds

abstract: In this paper, we generalize Liouville type theorems for some semilinear partial differential inequalities to sub-Riemannian manifolds satisfying a nonnegative generalized curvature-dimension inequality introduced by Baudoin and Garofalo in [5]. In particular, our results apply to all Sasakian manifolds with nonnegative horizontal Webster-Tanaka-Ricci curvature. The key ingredient is to construct a class of "good" cut-off functions. We also provide some upper bounds for lifespan to parabolic and hyperbolic inequalities.


title: Phenomenology of the Hidden SU(2) Vector Dark Matter Model

abstract: We investigate the phenomenology of an extension of the Standard Model (SM) by a non-abelian gauge group $SU(2)_{HS}$ where all SM particles are singlets under this gauge group, and a new scalar representation $\phi$ that is singlet under SM gauge group and doublet under $SU(2)_{HS}$. In this model, the dark matter (DM) candidates are the three mass degenerate dark photons $A_{i}$ $(i=1,2,3)$ of $SU(2)_{HS}$; and the hidden sector interacts with the (SM) particles through the Higgs portal interactions. Consequently, there will be a new CP-even scalar $\eta$ that could be either heavier or lighter than the SM-like Higgs. By taking into account all theoretical and experimental constraints such as perturbativity, unitarity, vacuum stability, non-SM Higgs decays, DM direct detection, DM relic density, we found viable DM is possible in the range from GeV to TeV. Within the viable parameters space, the both of the triple Higgs coupling and the di-Higgs production at LHC14 could be enhanced or reduced depending on the scalar mixing and the mass of the scalar particle $\eta$.


title: Dynamic Placement in Refugee Resettlement

abstract: Employment outcomes of resettled refugees depend strongly on where they are placed inside the host country. Each week, a resettlement agency is assigned a batch of refugees by the United States government. The agency must place these refugees in its local affiliates, while respecting the affiliates' yearly capacities. We develop an allocation system that suggests where to place an incoming refugee, in order to improve total employment success. Our algorithm is based on two-stage stochastic programming and achieves over 98 percent of the hindsight-optimal employment, compared to under 90 percent of current greedy-like approaches. This dramatic improvement persists even when we incorporate a vast array of practical features of the refugee resettlement process including indivisible families, batching, and uncertainty with respect to the number of future arrivals. Our algorithm is now part of the Annie MOORE optimization software used by a leading American refugee resettlement agency.


title: Observation of Higher-Order Topological States in Acoustic Twisted Moir\'e Superlattice

abstract: Twisted moir\'e superlattices (TMSs) are fascinating materials with exotic physical properties. Despite tremendous studies on electronic, photonic and phononic TMSs, it has never been witnessed that TMSs can exhibit higher-order band topology. Here, we report on the experimental observation of higher-order topological states in acoustic TMSs. By introducing moir\'e twisting in bilayer honeycomb lattices of coupled acoustic resonators, we find a regime with designed interlayer couplings where a sizable band gap with higher-order topology emerges. This higher-order topological phase host unique topological edge and corner states, which can be understood via the Wannier centers of the acoustic Bloch bands below the band gap. We confirm experimentally the higher-order band topology by characterizing the edge and corner states using acoustic pump-probe measurements. With complementary theory and experiments, our study opens a pathway toward band topology in TMSs.


title: Please repeat: Strong lensing of gravitational waves as a probe of compact binary and galaxy populations

abstract: Strong gravitational lensing of gravitational wave sources offers a novel probe of both the lens galaxy and the binary source population. In particular, the strong lensing event rate and the time delay distribution of multiply-imaged gravitational-wave binary coalescence events can be used to constrain the mass distribution of the lenses as well as the intrinsic properties of the source population. We calculate the strong lensing event rate for a range of second (2G) and third generation (3G) detectors, including Advanced LIGO/Virgo, A+, Einstein Telescope (ET), and Cosmic Explorer (CE). For 3G detectors, we find that {$\sim0.1\%$} of observed events are expected to be strongly lensed. We predict detections of {$\sim 1$} lensing pair per year with A+, and {$\sim 50$} pairs {per year} with ET/CE. These rates are highly sensitive to the characteristic galaxy velocity dispersion, $\sigma_*$, implying that observations of the rates will be a sensitive probe of lens properties. We explore using the time delay distribution between multiply-imaged gravitational-wave sources to constrain properties of the lenses. We find that 3G detectors would constrain $\sigma_*$ to {$\sim21\%$ after 5 years}. Finally, we show that the presence or absence of strong lensing {within the detected population} provides useful insights into the source redshift and mass distribution out to redshifts beyond the peak of the star formation rate, which can be used to constrain formation channels and their relation to the star formation rate and delay time distributions for these systems.


title: Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domains

abstract: Tracking the 6D pose of objects in video sequences is important for robot manipulation. This work presents se(3)-TrackNet, a data-driven optimization approach for long term, 6D pose tracking. It aims to identify the optimal relative pose given the current RGB-D observation and a synthetic image conditioned on the previous best estimate and the object's model. The key contribution in this context is a novel neural network architecture, which appropriately disentangles the feature encoding to help reduce domain shift, and an effective 3D orientation representation via Lie Algebra. Consequently, even when the network is trained solely with synthetic data can work effectively over real images. Comprehensive experiments over multiple benchmarks show se(3)-TrackNet achieves consistently robust estimates and outperforms alternatives, even though they have been trained with real images. The approach runs in real time at 90.9Hz. Code, data and supplementary video for this project are available at https://github.com/wenbowen123/iros20-6d-pose-tracking


title: Pimples reduce and dimples enhance flat dielectric surface image repulsion

abstract: Near solid-liquid or liquid-liquid interfaces with dielectric contrast, charged particles interact with the induced polarization charge of the interface. These interactions contribute to an effective self-energy of the bulk ions and mediate ion-ion interactions. For flat interfaces, the self-energy and the mediated interaction are neatly constructed by the image charge method. For other geometries, explicit results are scarce and the problem must be treated via approximations or direct computation. This article provides analytical results, valid to first order in perturbation theory, for the self-energy of particles near a deformed near-flat interface. Explicit formulas are provided for the case of a sinusoidal deformation; generic deformations can then be treated by superposition. In addition to results for the self-energy, the surface polarization charge due to a single ion is presented as a quadrature. The interaction between an ion and the deformed surface is modified by the change in relative distance as well as by the curvature of the surface. Solid walls with a lower dielectric constant than the liquid repel all ions. We show here, however, that the repulsion is reduced by local convexity and enhanced by concavity; dimples are more repulsive than pimples.


title: The Granger-Johansen representation theorem for integrated time series on Banach space

abstract: We prove an extended Granger-Johansen representation theorem (GJRT) for finite or infinite order integrated autoregressive time series on Banach space. We assume only that the resolvent of the autoregressive polynomial for the series is analytic on and inside the unit circle except for an isolated singularity at unity. If the singularity is a pole of finite order the time series is integrated of the same order. If the singularity is an essential singularity the time series is integrated of order infinity. When there is no deterministic forcing the value of the series at each time is the sum of an almost surely convergent stochastic trend, a deterministic term depending on the initial conditions and a finite sum of embedded white noise terms in the prior observations. This is the extended GJRT. In each case the original series is the sum of two separate autoregressive time series on complementary subspaces--a singular component which is integrated of the same order as the original series and a regular component which is not integrated. The extended GJRT applies to all integrated autoregressive processes irrespective of the spatial dimension, the number of stochastic trends and cointegrating relations in the system, and the order of integration.


title: Asymptotic Normality of the Posterior Distributions in a Class of Hidden Markov Models

abstract: We show that the posterior distribution of parameters in a hidden Markov model with parametric emission distributions and discrete and known state space is asymptotically normal. The main novelty of our proof is that it is based on a testing condition and the sequence of test functions is obtained using an optimal transportation inequality.


title: Divide-and-Conquer Bayesian Inference in Hidden Markov Models

abstract: Divide-and-conquer Bayesian methods consist of three steps: dividing the data into smaller computationally manageable subsets, running a sampling algorithm in parallel on all the subsets, and combining parameter draws from all the subsets. The combined parameter draws are used for efficient posterior inference in massive data settings. A major restriction of existing divide-and-conquer methods is that their first two steps assume that the observations are independent. We address this problem by developing a divide-and-conquer method for Bayesian inference in parametric hidden Markov models, where the state space is known and finite. Our main contributions are two-fold. First, after partitioning the data into smaller blocks of consecutive observations, we modify the likelihood for performing posterior computations on the subsets such that the posterior variances of the subset and true posterior distributions have the same asymptotic order. Second, if the number of subsets is chosen appropriately depending on the mixing properties of the hidden Markov chain, then we show that the subset posterior distributions defined using the modified likelihood are asymptotically normal as the subset sample size tends to infinity. The latter result also implies that we can use any existing combination algorithm in the third step. We show that the combined posterior distribution obtained using one such algorithm is close to the true posterior distribution in 1-Wasserstein distance under widely used regularity assumptions. Our numerical results show that the proposed method provides an accurate approximation of the true posterior distribution than its competitors in diverse simulation studies and a real data analysis.


title: SyReNets: Symbolic Residual Neural Networks

abstract: Despite successful seminal works on passive systems in the literature, learning free-form physical laws for controlled dynamical systems given experimental data is still an open problem. For decades, symbolic mathematical equations and system identification were the golden standards. Unfortunately, a set of assumptions about the properties of the underlying system is required, which makes the model very rigid and unable to adapt to unforeseen changes in the physical system. Neural networks, on the other hand, are known universal function approximators but are prone to over-fit, limited accuracy, and bias problems, which makes them alone unreliable candidates for such tasks. In this paper, we propose SyReNets, an approach that leverages neural networks for learning symbolic relations to accurately describe dynamic physical systems from data. It explores a sequence of symbolic layers that build, in a residual manner, mathematical relations that describes a given desired output from input variables. We apply it to learn the symbolic equation that describes the Lagrangian of a given physical system. We do this by only observing random samples of position, velocity, and acceleration as input and torque as output. Therefore, using the Lagrangian as a latent representation from which we derive torque using the Euler-Lagrange equations. The approach is evaluated using a simulated controlled double pendulum and compared with neural networks, genetic programming, and traditional system identification. The results demonstrate that, compared to neural networks and genetic programming, SyReNets converges to representations that are more accurate and precise throughout the state space. Despite having slower convergence than traditional system identification, similar to neural networks, the approach remains flexible enough to adapt to an unforeseen change in the physical system structure.


title: On the Number of Edges of the Frechet Mean and Median Graphs

abstract: The availability of large datasets composed of graphs creates an unprecedented need to invent novel tools in statistical learning for graph-valued random variables. To characterize the average of a sample of graphs, one can compute the sample Frechet mean and median graphs. In this paper, we address the following foundational question: does a mean or median graph inherit the structural properties of the graphs in the sample? An important graph property is the edge density; we establish that edge density is an hereditary property, which can be transmitted from a graph sample to its sample Frechet mean or median graphs, irrespective of the method used to estimate the mean or the median. Because of the prominence of the Frechet mean in graph-valued machine learning, this novel theoretical result has some significant practical consequences.

categories: math.CO cs.SI physics.data-an stat.AP stat.ML


title: Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking

abstract: Injecting external domain-specific knowledge (e.g., UMLS) into pretrained language models (LMs) advances their capability to handle specialised in-domain tasks such as biomedical entity linking (BEL). However, such abundant expert knowledge is available only for a handful of languages (e.g., English). In this work, by proposing a novel cross-lingual biomedical entity linking task (XL-BEL) and establishing a new XL-BEL benchmark spanning 10 typologically diverse languages, we first investigate the ability of standard knowledge-agnostic as well as knowledge-enhanced monolingual and multilingual LMs beyond the standard monolingual English BEL task. The scores indicate large gaps to English performance. We then address the challenge of transferring domain-specific knowledge in resource-rich languages to resource-poor ones. To this end, we propose and evaluate a series of cross-lingual transfer methods for the XL-BEL task, and demonstrate that general-domain bitext helps propagate the available English knowledge to languages with little to no in-domain data. Remarkably, we show that our proposed domain-specific transfer methods yield consistent gains across all target languages, sometimes up to 20 Precision@1 points, without any in-domain knowledge in the target language, and without any in-domain parallel data.


title: Enhanced Isotropy Maximization Loss: Seamless and High-Performance Out-of-Distribution Detection Simply Replacing the SoftMax Loss

abstract: Current out-of-distribution detection approaches usually present special requirements (e.g., collecting outlier data and hyperparameter validation) and produce side effects (e.g., classification accuracy drop and slow/inefficient inferences). Recently, entropic out-of-distribution detection has been proposed as a seamless approach (i.e., a solution that avoids all previously mentioned drawbacks). The entropic out-of-distribution detection solution uses the IsoMax loss for training and the entropic score for out-of-distribution detection. The IsoMax loss works as a drop-in replacement of the SoftMax loss (i.e., the combination of the output linear layer, the SoftMax activation, and the cross-entropy loss) because swapping the SoftMax loss with the IsoMax loss requires no changes in the model's architecture or training procedures/hyperparameters. In this paper, we perform what we call an isometrization of the distances used in the IsoMax loss. Additionally, we propose replacing the entropic score with the minimum distance score. Experiments showed that these modifications significantly increase out-of-distribution detection performance while keeping the solution seamless. Besides being competitive with or outperforming all major current approaches, the proposed solution avoids all their current limitations, in addition to being much easier to use because only a simple loss replacement for training the neural network is required. The code to replace the SoftMax loss with the IsoMax+ loss and reproduce the results is available at https://github.com/dlmacedo/entropic-out-of-distribution-detection.


title: Charge injection into the atmosphere by explosive volcanic eruptions through triboelectrification and fragmentation charging

abstract: Volcanic eruptions are associated with a wide range of electrostatic effects. Increasing evidence suggests that high-altitude discharges (lightning) in maturing plumes are driven by electrification processes that require the formation of ice (analogous to processes underpinning meteorological thunderstorms). However, electrical discharges are also common at or near the volcanic vent. A number of "ice-free" electrification mechanisms have been proposed to account for this activity: fractocharging, triboelectric charging, radioactive charging, and charging through induction. Yet, the degree to which each mechanism contributes to a jet's total electrification and how electrification in the gas-thrust region influences electrostatic processes aloft remains poorly constrained. Here, we use a shock-tube to simulate overpressured volcanic jets capable of producing spark discharges in the absence of ice. These discharges may be representative of the continual radio frequency (CRF) emissions observed at a number of eruptions. Using a suite of electrostatic sensors, we demonstrate the presence of size-dependent bipolar charging (SDBC) in a discharge-bearing flow for the first time. SDBC has been readily associated with triboelectric charging in other contexts and provides direct evidence that contact and frictional electrification play significant roles in electrostatic processes in the vent and near-vent regions of an eruption. Additionally, we find that particles leaving the region where discharges occur remain moderately electrified. This degree of electrification may be sufficient to drive near-vent lightning higher in the column. Thus, near-vent discharges may be underpinned by the same electrification mechanisms driving CRF, albeit involving greater degrees of charge separation.

categories: physics.geo-ph astro-ph.EP astro-ph.IM physics.ao-ph


title: A Tapered Floating Point Extension for the Redundant Signed Radix 2 System Using the Canonical Recoding

abstract: A tapered floating point encoding is proposed which uses the redundant signed radix 2 system and is based on the canonical recoding. By making use of ternary technology, the encoding has a dynamic range exceeding that of the recently-proposed Posit number system and the IEEE 754-1985 Standard for Floating Point Arithmetic (IEEE-754-1985), and precision equal to or better than that of the IEEE-754-1985 system and the recently proposed Posit system when equal input sizes are compared. In addition, the encoding is capable of supporting several proposed extensions, including extensions to integers, boolean values, complex numbers, higher number systems, low-dimensional vectors, and system artifacts such as machine instructions. A detailed analytic comparison is provided between the proposed encoding, the IEEE-754-1985 system, and the recently proposed Posit number system.


title: Asymptotics for Bergman projections with smooth weights: a direct approach

abstract: We adapt the direct approach to the semiclassical Bergman kernel asymptotics, developed recently by A. Deleporte, J. Sj\"ostrand, and the first-named author for real analytic exponential weights, to the smooth case. Similar to that work, our approach avoids the use of the Kuranishi trick and it allows us to construct the amplitude of the asymptotic Bergman projection by means of an asymptotic inversion of an explicit Fourier integral operator.


title: Re-evaluating Word Mover's Distance

abstract: The word mover's distance (WMD) is a fundamental technique for measuring the similarity of two documents. As the crux of WMD, it can take advantage of the underlying geometry of the word space by employing an optimal transport formulation. The original study on WMD reported that WMD outperforms classical baselines such as bag-of-words (BOW) and TF-IDF by significant margins in various datasets. In this paper, we point out that the evaluation in the original study could be misleading. We re-evaluate the performances of WMD and the classical baselines and find that the classical baselines are competitive with WMD if we employ an appropriate preprocessing, i.e., L1 normalization. In addition, we introduce an analogy between WMD and L1-normalized BOW and find that not only the performance of WMD but also the distance values resemble those of BOW in high dimensional spaces.


title: On Quasineutral Plasma Flow in the Magnetic Nozzle

abstract: Exact solutions for quasineutral plasma acceleration of magnetized plasma in the paraxial magnetic nozzle are obtained. It is shown that the non-monotonic magnetic field with a local maximum of the magnetic field is a necessary condition for the formation of the quasineutral accelerating potential structure. A global nature of the accelerating potential that occurs as a result of the constraint due to the regularity condition at the sonic point is emphasized and properties of such solutions are discussed for the case of general polytropic equation of state for electrons.


title: IoTAthena: Unveiling IoT Device Activities from Network Traffic

abstract: The recent spate of cyber attacks towards Internet of Things (IoT) devices in smart homes calls for effective techniques to understand, characterize, and unveil IoT device activities. In this paper, we present a new system, named IoTAthena, to unveil IoT device activities from raw network traffic consisting of timestamped IP packets. IoTAthena characterizes each IoT device activity using an activity signature consisting of an ordered sequence of IP packets with inter-packet time intervals. IoTAthena has two novel polynomial time algorithms, sigMatch and actExtract. For any given signature, sigMatch can capture all matches of the signature in the raw network traffic. Using sigMatch as a subfunction, actExtract can accurately unveil the sequence of various IoT device activities from the raw network traffic. Using the network traffic of heterogeneous IoT devices collected at the router of a real-world smart home testbed and a public IoT dataset, we demonstrate that IoTAthena is able to characterize and generate activity signatures of IoT device activities and accurately unveil the sequence of IoT device activities from raw network traffic.


title: A splitting Hamiltonian Monte Carlo method for efficient sampling

abstract: We propose a splitting Hamiltonian Monte Carlo (SHMC) algorithm, which can be computationally efficient when combined with the random mini-batch strategy. By splitting the potential energy into numerically nonstiff and stiff parts, one makes a proposal using the nonstiff part of $U$, followed by a Metropolis rejection step using the stiff part that is often easy to compute. The splitting allows efficient sampling from systems with singular potentials (or distributions with degenerate points) and/or with multiple potential barriers. In our SHMC algorithm, the proposal only based on the nonstiff part in the splitting is generated by the Hamiltonian dynamics, which can be potentially more efficient than the overdamped Langevin dynamics. We also use random batch strategies to reduce the computational cost to $\mathcal{O}(1)$ per time step in generating the proposals for problems arising from many-body systems and Bayesian inference, and prove that the errors of the Hamiltonian induced by the random batch approximation is $\mathcal{O}(\sqrt{\Delta t})$ in the strong and $\mathcal{O}(\Delta t)$ in the weak sense, where $\Delta t$ is the time step. Numerical experiments are conducted to verify the theoretical results and the computational efficiency of the proposed algorithms in practice.


title: Neutron drop trapped in axially deformed external fields

abstract: The neutron drop is firstly investigated in an axially symmetric harmonic oscillator (ASHO) field, whose potential strengths of different directions can be controlled artificially. The shape of the neutron drop will change from spherical to oblate or prolate according to the anisotropy of the external field. With the potential strength increasing in the axial direction, the neutron prefers to occupy the orbital perpendicular to the symmetry axis. On the contrary, the neutron likes to stay in the orbital parallel to the symmetry axis when the potential strength increases in the radial direction. Meanwhile, when the potential strength of one direction disappears, the neutron drop cannot bind together. These investigations are not only helpful to simulate the properties of neutrons in finite nuclei but also provide the theoretical predictions to the future artificial operations on the nuclei like the ultracold atom system, for a deeper realization of quantum many-body systems.


title: PPT: A Privacy-Preserving Global Model Training Protocol for Federated Learning in P2P Networks

abstract: The concept of Federated Learning (FL) has emerged as a convergence of machine learning, information, and communication technology. It is vital to the development of machine learning, which is expected to be fully decentralized, privacy-preserving, secure, and robust. However, general federated learning settings with a central server can't meet requirements in decentralized environment. In this paper, we propose a decentralized, secure and privacy-preserving global model training protocol, named PPT, for federated learning in Peer-to-peer (P2P) Networks. PPT uses a one-hop communication form to aggregate local model update parameters and adopts the symmetric cryptosystem to ensure security. It is worth mentioning that PPT modifies the Eschenauer-Gligor (E-G) scheme to distribute keys for encryption. In terms of privacy preservation, PPT generates random noise to disturb local model update parameters. The noise is eliminated ultimately, which ensures the global model performance compared with other noise-based privacy-preserving methods in FL, e.g., differential privacy. PPT also adopts Game Theory to resist collusion attacks. Through extensive analysis, we demonstrate that PPT various security threats and preserve user privacy. Ingenious experiments demonstrate the utility and efficiency as well.


title: A Matrix Autoencoder Framework to Align the Functional and Structural Connectivity Manifolds as Guided by Behavioral Phenotypes

abstract: We propose a novel matrix autoencoder to map functional connectomes from resting state fMRI (rs-fMRI) to structural connectomes from Diffusion Tensor Imaging (DTI), as guided by subject-level phenotypic measures. Our specialized autoencoder infers a low dimensional manifold embedding for the rs-fMRI correlation matrices that mimics a canonical outer-product decomposition. The embedding is simultaneously used to reconstruct DTI tractography matrices via a second manifold alignment decoder and to predict inter-subject phenotypic variability via an artificial neural network. We validate our framework on a dataset of 275 healthy individuals from the Human Connectome Project database and on a second clinical dataset consisting of 57 subjects with Autism Spectrum Disorder. We demonstrate that the model reliably recovers structural connectivity patterns across individuals, while robustly extracting predictive and interpretable brain biomarkers in a cross-validated setting. Finally, our framework outperforms several baselines at predicting behavioral phenotypes in both real-world datasets.


title: Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures

abstract: This is the second paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation (RTE). In our previous work \cite{huang2021gradient}, we proposed an approach to directly learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, the ML moment closure model in \cite{huang2021gradient} is not able to guarantee hyperbolicity and long time stability. We propose in this paper a method to enforce the global hyperbolicity of the ML closure model. The main idea is to seek a symmetrizer (a symmetric positive definite matrix) for the closure system, and derive constraints such that the system is globally symmetrizable hyperbolic. It is shown that the new ML closure system inherits the dissipativeness of the RTE and preserves the correct diffusion limit as the Knunsden number goes to zero. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, long time stability and generalizability of our globally hyperbolic ML closure model.


title: Membranes in Optic Nerve Models

abstract: Membranes are present in all cells and tissues. Mathematical models of cells and tissues need a compact mathematical description of membranes with a resolution of about 1 nm. Membranes isolate cells because ions have difficulty penetrating the dielectric barrier they create. Here we introduce a dielectric mathematical membrane condition to replace a condition that did not include dielectric properties. Our mathematical membrane condition includes a dielectric lipid bilayer punctured by channels that conduct ions selectively.


title: An improved LogNNet classifier for IoT application

abstract: In the age of neural networks and Internet of Things (IoT), the search for new neural network architectures capable of operating on devices with limited computing power and small memory size is becoming an urgent agenda. Designing suitable algorithms for IoT applications is an important task. The paper proposes a feed forward LogNNet neural network, which uses a semi-linear Henon type discrete chaotic map to classify MNIST-10 dataset. The model is composed of reservoir part and trainable classifier. The aim of the reservoir part is transforming the inputs to maximize the classification accuracy using a special matrix filing method and a time series generated by the chaotic map. The parameters of the chaotic map are optimized using particle swarm optimization with random immigrants. As a result, the proposed LogNNet/Henon classifier has higher accuracy and the same RAM usage, compared to the original version of LogNNet, and offers promising opportunities for implementation in IoT devices. In addition, a direct relation between the value of entropy and accuracy of the classification is demonstrated.


title: Phonon Boltzmann equation non-local in space and time: the partial failure of the generalized Fourier law

abstract: The purpose of this note is to clarify the solution of the non-local Peierls Boltzmann equation found by Hua and Lindsay (Phys. Rev. B 102, 104310 (2020)). They used methods of Cepellotti and Marzari. The response function "thermal distributor" is discussed. The new, "non-Fourier" term $\vec{B}$ [$\vec{J}_{\rm th}=-\kappa \vec{\nabla}T +\vec{B}]$ that occurs in non-local situations, gives rise also to a new term in the thermal distributor.


title: Meta-nilpotent knot invariants and symplectic automorphism groups of free nilpotent groups

abstract: We develop nilpotently $p$-localization of knot groups in terms of the (symplectic) automorphism groups of free nilpotent groups. We show that any map from the set of conjugacy classes of the outer automorphism groups yields a knot invariant. We also investigate the automorphism groups and compute the resulting knot invariants.


title: Experimental Observation of Localized Interfacial Phonon Modes

abstract: Interfaces impede heat flow in micro/nanostructured systems. Conventional theories for interfacial thermal transport were derived based on bulk phonon properties of the materials making up the interface without explicitly considering the atomistic interfacial details, which are found critical to correctly describing thermal boundary conductance (TBC). Recent theoretical studies predicted the existence of localized phonon modes at the interface which can play an important role in understanding interfacial thermal transport. However, experimental validation is still lacking. Through a combination of Raman spectroscopy and high-energy resolution electron energy-loss spectroscopy (EELS) in a scanning transmission electron microscope, we report the first experimental observation of localized interfacial phonon modes at ~12 THz at a high-quality epitaxial Si-Ge interface. These modes are further confirmed using molecular dynamics simulations with a high-fidelity neural network interatomic potential, which also yield TBC agreeing well with that measured from time-domain thermoreflectance (TDTR) experiments. Simulations find that the interfacial phonon modes have obvious contribution to the total TBC. Our findings may significantly contribute to the understanding of interfacial thermal transport physics and have impact on engineering TBC at interfaces in applications such as electronics thermal management and thermoelectric energy conversion.


title: Communication efficient privacy-preserving distributed optimization using adaptive differential quantization

abstract: Privacy issues and communication cost are both major concerns in distributed optimization. There is often a trade-off between them because the encryption methods required for privacy-preservation often incur expensive communication bandwidth. To address this issue, we, in this paper, propose a quantization-based approach to achieve both communication efficient and privacy-preserving solutions in the context of distributed optimization. By deploying an adaptive differential quantization scheme, we allow each node in the network to achieve its optimum solution with a low communication cost while keeping its private data unrevealed. Additionally, the proposed approach is general and can be applied in various distributed optimization methods, such as the primal-dual method of multipliers (PDMM) and the alternating direction method of multipliers (ADMM). Moveover, we consider two widely used adversary models: passive and eavesdropping. Finally, we investigate the properties of the proposed approach using different applications and demonstrate its superior performance in terms of several parameters including accuracy, privacy, and communication cost.


title: Overparameterization of deep ResNet: zero loss and mean-field analysis

abstract: Finding parameters in a deep neural network (NN) that fit training data is a nonconvex optimization problem, but a basic first-order optimization method (gradient descent) finds a global optimizer with perfect fit (zero-loss) in many practical situations. We examine this phenomenon for the case of Residual Neural Networks (ResNet) with smooth activation functions in a limiting regime in which both the number of layers (depth) and the number of weights in each layer (width) go to infinity. First, we use a mean-field-limit argument to prove that the gradient descent for parameter training becomes a gradient flow for a probability distribution that is characterized by a partial differential equation (PDE) in the large-NN limit. Next, we show that under certain assumptions, the solution to the PDE converges in the training time to a zero-loss solution. Together, these results suggest that the training of the ResNet gives a near-zero loss if the ResNet is large enough. We give estimates of the depth and width needed to reduce the loss below a given threshold, with high probability.


title: Virtual element approximation of two-dimensional parabolic variational inequalities

abstract: We design a virtual element method for the numerical treatment of the two-dimensional parabolic variational inequality problem on unstructured polygonal meshes. Due to the expected low regularity of the exact solution, the virtual element method is based on the lowest-order virtual element space that contains the subspace of the linear polynomials defined on each element. The connection between the nonnegativity of the virtual element functions and the nonnegativity of the degrees of freedom, i.e., the values at the mesh vertices, is established by applying the Maximum and Minimum Principle Theorem. The mass matrix is computed through an approximate L 2 polynomial projection, whose properties are carefully investigated in the paper. We prove the well-posedness of the resulting scheme in two different ways that reveal the contractive nature of the VEM and its connection with the minimization of quadratic functionals. The convergence analysis requires the existence of a nonnegative quasi-interpolation operator, whose construction is also discussed in the paper. The variational crime introduced by the virtual element setting produces five error terms that we control by estimating a suitable upper bound. Numerical experiments confirm the theoretical convergence rate for the refinement in space and time on three different mesh families including distorted squares, nonconvex elements, and Voronoi tesselations.


title: Spectral analysis of bilateral birth-death processes: some new explicit examples

abstract: We consider the spectral analysis of several examples of bilateral birth-death processes and compute explicitly the spectral matrix and the corresponding orthogonal polynomials. We also use the spectral representation to study some probabilistic properties of the processes, like recurrence, the invariant distribution (if it exists) or the probability current.


title: Comparing two perfect bases

abstract: We study a class of varieties which generalize the classical orbital varieties of Joseph. We show that our generalized orbital varieties are the irreducible components of a Mirkovic-Vybornov slice to a nilpotent orbit, and can be labeled by semistandard Young tableaux. Furthermore, we prove that Mirkovic-Vilonen cycles are obtained by applying the Mirkovic-Vybornov isomorphism to generalized orbital varieties and taking a projective closure, refining Mirkovic and Vybornov's result. As a consequence, we are able to use the Lusztig datum of a Mirkovic--Vilonen cycle to determine the tableau labeling the generalized orbital variety which maps to it, and, hence, the ideal of the generalized orbital variety itself. By homogenizing we obtain equations for the cycle we started with, which is useful for computing various equivariant invariants such as equivariant multiplicity and multidegree. As an application, we show that in type $A_5$ the Mirkovic-Vilonen basis and Lusztig's dual semicanonical basis are not equal as perfect bases of the coordinate ring of the unipotent subgroup. This is significant because it shows that perfect bases are not unique. Our comparison relies heavily on the theory of measures developed in Baumann, Kamnitzer, and Knutson's MV Basis and DH Measures (2019), and we include what we need to be self-contained. Finally, we state a conjectural combinatorial "formula" for the ideal of a generalized orbital variety in terms of its tableau.


title: VersatileGait: A Large-Scale Synthetic Gait Dataset Towards in-the-Wild Simulation

abstract: Gait recognition has a rapid development in recent years. However, gait recognition in the wild is not well explored yet. An obvious reason could be ascribed to the lack of diverse training data from the perspective of intrinsic and extrinsic factors. To remedy this problem, we propose to construct a large-scale gait dataset with the help of controllable computer simulation. In detail, to diversify the intrinsic factors of gait, we generate numerous characters with diverse attributes and empower them with various types of walking styles. To diversify the extrinsic factors of gait, we build a complicated scene with a dense camera layout. Finally, we design an automated generation toolkit under Unity3D for simulating the walking scenario and capturing the gait data automatically. As a result, we obtain an in-the-wild gait dataset, called VersatileGait, which has more than one million silhouette sequences of 10,000 subjects with diverse scenarios. VersatileGait possesses several nice properties, including huge dataset size, diverse pedestrian attributes, complicated camera layout, high-quality annotations, small domain gap with the real one, good scalability for new demands, and no privacy issues. Based on VersatileGait, we propose series of experiments and applications for both research exploration of gait in the wild and practical applications. Our dataset and its corresponding generation toolkit will be publicly available for further studies.


title: Periodic-GP: Learning Periodic World with Gaussian Process Bandits

abstract: We consider the sequential decision optimization on the periodic environment, that occurs in a wide variety of real-world applications when the data involves seasonality, such as the daily demand of drivers in ride-sharing and dynamic traffic patterns in transportation. In this work, we focus on learning the stochastic periodic world by leveraging this seasonal law. To deal with the general action space, we use the bandit based on Gaussian process (GP) as the base model due to its flexibility and generality, and propose the Periodic-GP method with a temporal periodic kernel based on the upper confidence bound. Theoretically, we provide a new regret bound of the proposed method, by explicitly characterizing the periodic kernel in the periodic stationary model. Empirically, the proposed algorithm significantly outperforms the existing methods in both synthetic data experiments and a real data application on Madrid traffic pollution.


title: Enumerating Fair Packages for Group Recommendations

abstract: Package-to-group recommender systems recommend a set of unified items to a group of people. Different from conventional settings, it is not easy to measure the utility of group recommendations because it involves more than one user. In particular, fairness is crucial in group recommendations. Even if some members in a group are substantially satisfied with a recommendation, it is undesirable if other members are ignored to increase the total utility. Many methods for evaluating and applying the fairness of group recommendations have been proposed in the literature. However, all these methods maximize the score and output only one package. This is in contrast to conventional recommender systems, which output several (e.g., top-$K$) candidates. This can be problematic because a group can be dissatisfied with the recommended package owing to some unobserved reasons, even if the score is high. To address this issue, we propose a method to enumerate fair packages efficiently. Our method furthermore supports filtering queries, such as top-$K$ and intersection, to select favorite packages when the list is long. We confirm that our algorithm scales to large datasets and can balance several aspects of the utility of the packages.


title: Gaze Estimation using Transformer

abstract: Recent work has proven the effectiveness of transformers in many computer vision tasks. However, the performance of transformers in gaze estimation is still unexplored. In this paper, we employ transformers and assess their effectiveness for gaze estimation. We consider two forms of vision transformer which are pure transformers and hybrid transformers. We first follow the popular ViT and employ a pure transformer to estimate gaze from images. On the other hand, we preserve the convolutional layers and integrate CNNs as well as transformers. The transformer serves as a component to complement CNNs. We compare the performance of the two transformers in gaze estimation. The Hybrid transformer significantly outperforms the pure transformer in all evaluation datasets with less parameters. We further conduct experiments to assess the effectiveness of the hybrid transformer and explore the advantage of self-attention mechanism. Experiments show the hybrid transformer can achieve state-of-the-art performance in all benchmarks with pre-training.To facilitate further research, we release codes and models in https://github.com/yihuacheng/GazeTR.


title: Feynman Amplitudes in Periodically Compactified Spaces -- Spin 0

abstract: We propose an extension of the Schwinger parametric representation for Feynman amplitudes in $D$ euclidean dimensions to a scenario where $d$ dimensions are compactified ($d<D$) through the introduction of periodic boundary conditions in space. We obtain two valid representations, one useful near the bulk (large compactification length) and another useful near the dimensional reduction (small compactification length). Also, to illustrate, we exhibit some Feynman amplitudes up to three loops in a compactified scalar field theory.


abstract: Tables present important information concisely in many scientific documents. Visual features like mathematical symbols, equations, and spanning cells make structure and content extraction from tables embedded in research documents difficult. This paper discusses the dataset, tasks, participants' methods, and results of the ICDAR 2021 Competition on Scientific Table Image Recognition to LaTeX. Specifically, the task of the competition is to convert a tabular image to its corresponding LaTeX source code. We proposed two subtasks. In Subtask 1, we ask the participants to reconstruct the LaTeX structure code from an image. In Subtask 2, we ask the participants to reconstruct the LaTeX content code from an image. This report describes the datasets and ground truth specification, details the performance evaluation metrics used, presents the final results, and summarizes the participating methods. Submission by team VCGroup got the highest Exact Match accuracy score of 74% for Subtask 1 and 55% for Subtask 2, beating previous baselines by 5% and 12%, respectively. Although improvements can still be made to the recognition capabilities of models, this competition contributes to the development of fully automated table recognition systems by challenging practitioners to solve problems under specific constraints and sharing their approaches; the platform will remain available for post-challenge submissions at https://competitions.codalab.org/competitions/26979 .


title: Concurrent Composition of Differential Privacy

abstract: We initiate a study of the composition properties of interactive differentially private mechanisms. An interactive differentially private mechanism is an algorithm that allows an analyst to adaptively ask queries about a sensitive dataset, with the property that an adversarial analyst's view of the interaction is approximately the same regardless of whether or not any individual's data is in the dataset. Previous studies of composition of differential privacy have focused on non-interactive algorithms, but interactive mechanisms are needed to capture many of the intended applications of differential privacy and a number of the important differentially private primitives. We focus on concurrent composition, where an adversary can arbitrarily interleave its queries to several differentially private mechanisms, which may be feasible when differentially private query systems are deployed in practice. We prove that when the interactive mechanisms being composed are pure differentially private, their concurrent composition achieves privacy parameters (with respect to pure or approximate differential privacy) that match the (optimal) composition theorem for noninteractive differential privacy. We also prove a composition theorem for interactive mechanisms that satisfy approximate differential privacy. That bound is weaker than even the basic (suboptimal) composition theorem for noninteractive differential privacy, and we leave closing the gap as a direction for future research, along with understanding concurrent composition for other variants of differential privacy.


title: DAGNN: Demand-aware Graph Neural Networks for Session-based Recommendation

abstract: Session-based recommendations have been widely adopted for various online video and E-commerce Websites. Most existing approaches are intuitively proposed to discover underlying interests or preferences out of the anonymous session data. This apparently ignores the fact these sequential behaviors usually reflect session user's potential demand, i.e., a semantic level factor, and therefore how to estimate underlying demands from a session is challenging. To address aforementioned issue, this paper proposes a demand-aware graph neural networks (DAGNN). Particularly, a demand modeling component is designed to first extract session demand and the underlying multiple demands of each session is estimated using the global demand matrix. Then, the demand-aware graph neural network is designed to extract session demand graph to learn the demand-aware item embedddings for the later recommendations. The mutual information loss is further designed to enhance the quality of the learnt embeddings. Extensive experiments are evaluated on several real-world datasets and the proposed model achieves the SOTA model performance.


title: Deformation Control of a Deformable Object Based on Visual and Tactile Feedback

abstract: In this paper, we presented a new method for deformation control of deformable objects, which utilizes both visual and tactile feedback. At present, manipulation of deformable objects is basically formulated by assuming positional constraints. But in fact, in many situations manipulation has to be performed under actively applied force constraints. This scenario is considered in this research. In the proposed scheme a tactile feedback is integrated to ensure a stable contact between the robot end-effector and the soft object to be manipulated. The controlled contact force is also utilized to regulate the deformation of the soft object with its shape measured by a vision sensor. The effectiveness of the proposed method is demonstrated by a book page turning and shaping experiment.


title: Rethinking the constraints of multimodal fusion: case study in Weakly-Supervised Audio-Visual Video Parsing

abstract: For multimodal tasks, a good feature extraction network should extract information as much as possible and ensure that the extracted feature embedding and other modal feature embedding have an excellent mutual understanding. The latter is often more critical in feature fusion than the former. Therefore, selecting the optimal feature extraction network collocation is a very important subproblem in multimodal tasks. Most of the existing studies ignore this problem or adopt an ergodic approach. This problem is modeled as an optimization problem in this paper. A novel method is proposed to convert the optimization problem into an issue of comparative upper bounds by referring to the general practice of extreme value conversion in mathematics. Compared with the traditional method, it reduces the time cost. Meanwhile, aiming at the common problem that the feature similarity and the feature semantic similarity are not aligned in the multimodal time-series problem, we refer to the idea of contrast learning and propose a multimodal time-series contrastive loss(MTSC). Based on the above issues, We demonstrated the feasibility of our approach in the audio-visual video parsing task. Substantial analyses verify that our methods promote the fusion of different modal features.


title: Contact Mode Guided Motion Planning for Quasidynamic Dexterous Manipulation in 3D

abstract: This paper presents Contact Mode Guided Manipulation Planning (CMGMP) for 3D quasistatic and quasidynamic rigid body motion planning in dexterous manipulation. The CMGMP algorithm generates hybrid motion plans including both continuous state transitions and discrete contact mode switches, without the need for pre-specified contact sequences or pre-designed motion primitives. The key idea is to use automatically enumerated contact modes of environment-object contacts to guide the tree expansions during the search. Contact modes automatically synthesize manipulation primitives, while the sampling-based planning framework sequences those primitives into a coherent plan. We test our algorithm on fourteen 3D manipulation tasks, and validate our models by executing some plans open-loop on a real robot-manipulator system


title: TransMatcher: Deep Image Matching Through Transformers for Generalizable Person Re-identification

abstract: Transformers have recently gained increasing attention in computer vision. However, existing studies mostly use Transformers for feature representation learning, e.g. for image classification and dense predictions, and the generalizability of Transformers is unknown. In this work, we further investigate the possibility of applying Transformers for image matching and metric learning given pairs of images. We find that the Vision Transformer (ViT) and the vanilla Transformer with decoders are not adequate for image matching due to their lack of image-to-image attention. Thus, we further design two naive solutions, i.e. query-gallery concatenation in ViT, and query-gallery cross-attention in the vanilla Transformer. The latter improves the performance, but it is still limited. This implies that the attention mechanism in Transformers is primarily designed for global feature aggregation, which is not naturally suitable for image matching. Accordingly, we propose a new simplified decoder, which drops the full attention implementation with the softmax weighting, keeping only the query-key similarity computation. Additionally, global max pooling and a multilayer perceptron (MLP) head are applied to decode the matching result. This way, the simplified decoder is computationally more efficient, while at the same time more effective for image matching. The proposed method, called TransMatcher, achieves state-of-the-art performance in generalizable person re-identification, with up to 6.1% and 5.7% performance gains in Rank-1 and mAP, respectively, on several popular datasets. Code is available at https://github.com/ShengcaiLiao/QAConv.


title: Time Optimal Control Studies on COVID-19 Incorporating Adverse Events of the Antiviral Drugs

abstract: In this study, we first develop SIV model by incorporating the intercellular time delay and analyze the stability of the equilibrium points. The model dynamics admits disease-free equilibrium and the infected equilibrium with their stability, based on the value of basic reproduction number $R_0$. We then frame an optimal control problem with antiviral drugs and second-line drugs as control measures and study their roles in reducing the infected cell count and the viral load. The comparative study done in the optimal control problem suggests that when the first line antiviral drugs shows adverse events, considering these drugs in reduced quantity along with the second line drug would be highly effective in reducing the infected cell and viral load in a COVID infected patients. Later, we formulate a time-optimal control problem with the objective to drive the system from any given initial state to the desired infection-free equilibrium state in minimal time. Using Pontryagin's Minimum Principle the optimal control strategy is shown to be of bang-bang type with possibility of switches between two extreme values of the optimal controls. Numerically, it is shown that the desired infection-free state is achieved in less time when the higher values of both the optimal controls are chosen.


title: Provable superior accuracy in machine learned quantum models

abstract: In modelling complex processes, the potential past data that influence future expectations are immense. Models that track all this data are not only computationally wasteful but also shed little light on what past data most influence the future. There is thus enormous interest in dimensional reduction-finding automated means to reduce the memory dimension of our models while minimizing its impact on its predictive accuracy. Here we construct dimensionally reduced quantum models by machine learning methods that can achieve greater accuracy than provably optimal classical counterparts. We demonstrate this advantage on present-day quantum computing hardware. Our algorithm works directly off classical time-series data and can thus be deployed in real-world settings. These techniques illustrate the immediate relevance of quantum technologies to time-series analysis and offer a rare instance where the resulting quantum advantage can be provably established.


title: Convergence of Datalog over (Pre-) Semirings

abstract: Recursive queries have been traditionally studied in the framework of datalog, a language that restricts recursion to monotone queries over sets, which is guaranteed to converge in polynomial time in the size of the input. But modern big data systems require recursive computations beyond the Boolean space. In this paper we study the convergence of datalog when it is interpreted over an arbitrary semiring. We consider an ordered semiring, define the semantics of a datalog program as a least fixpoint in this semiring, and study the number of steps required to reach that fixpoint, if ever. We identify algebraic properties of the semiring that correspond to certain convergence properties of datalog programs. Finally, we describe a class of ordered semirings on which one can use the semi-na\"ive evaluation algorithm on any datalog program.


title: Non-P\'{o}lya bi-quadratic fields with an Euclidean ideal class

abstract: For an integral domain $R$, the {\it ring of integer-valued polynomials} over $R$ consists of all polynomials $f(X) \in R[X]$ such that $f(R) \subseteq R$. An interesting case to study is when $R$ is a Dedekind domain, in particular when $R$ is the ring of integers of an algebraic number field. An algebraic number field $K$ with ring of integers $\mathcal{O}_{K}$ is said to be a P\'{o}lya field if the $\mathcal{O}_{K}$-module of integer-valued polynomials on $K$ admits a regular basis. Associated to $K$ is a subgroup $Po(K)$ of the ideal class group $Cl_{K}$, known as the {\it P\'{o}lya group of $K$}, that measures the failure of $K$ from being a P\'{o}lya field. In this paper, we prove the existence of three pairwise distinct totally real bi-quadratic fields, each having P\'{o}lya group isomorphic to $\mathbb{Z}/2\mathbb{Z}$. This extends the previously known families of number fields considered by Heidaryan and Rajaei in \cite{rajaei-jnt} and \cite{rajaei}. Our results also establish that under mild assumptions, the possibly infinite families of bi-quadratic fields having a non-principal Euclidean ideal class, considered in \cite{self-jnt}, fail to be P\'{o}lya fields.


title: Valley-related multiple Hall effect in single-layer VSi2P4

abstract: 2D materials with valley-related multiple Hall effect are both fundamentally intriguing and practically appealing to explore novel phenomena and applications, but have been largely overlooked up to date. Here, using first-principles calculations, we present that valley related multiple Hall effect can exist in single-layer VSi2P4. We identify single-layer VSi2P4 as a ferromagnetic semiconductor with out-of-plane magnetization and valley physics. Arising from the joint effect of inversion symmetry breaking and time reversal symmetry breaking, the exotic spontaneous valley polarization occurs in single-layer VSi2P4, thus facilitating the observation of anomalous valley Hall effect. Moreover, under external strain, band inversion can occur at only one of the valleys of single-layer VSi2P4, enabling the long-sought valley-polarized quantum anomalous Hall effect, and meanwhile the anomalous valley Hall effect is well preserved.. Our work not only enriches the research on valley-related multiple Hall effect, but also opens a new avenue for exploring valley-polarized quantum anomalous Hall effect.


title: Hitting times for second-order random walks

abstract: A second-order random walk on a graph or network is a random walk where transition probabilities depend not only on the present node but also on the previous one. A notable example is the non-backtracking random walk, where the walker is not allowed to revisit a node in one step. Second-order random walks can model physical diffusion phenomena in a more realistic way than traditional random walks and have been very successfully used in various network mining and machine learning settings. However, numerous questions are still open for this type of stochastic processes. In this work we extend well-known results concerning mean hitting and return times of standard random walks to the second-order case. In particular, we provide simple formulas that allow us to compute these numbers by solving suitable systems of linear equations. Moreover, by introducing the "pullback" first-order stochastic process of a second-order random walk, we provide second-order versions of the renowned Kac's and random target lemmas.


title: Permutation-generated maps between Dyck paths

abstract: In 2003, Deutsch and Elizalde defined a family of bijective maps between the set of Dyck paths to itself which is induced by some particular permutations. In this paper, we extend the construction of the maps by allowing the permutation to be arbitrary. We characterise the permutations which generate the same map and find all permutations generating a bijection among Dyck paths. Consequently, we give a new combinatorial interpretation of the quantity $(2n-1)!!$ as well as some new statistics of Dyck paths which are equidistributed to some known height statistics via our generalised maps.


title: Nonlinear dynamics of a self-mixing thin-slice solid-state laser subjected to Doppler shifted optical feedback

abstract: Chaotic oscillations of a linearly polarized single longitudinal-mode thin-slice Nd:GdVO4 laser placed in a self-mixing laser Doppler velocity scheme were dynamic characterized in terms the intensity probability distribution, joint time-frequency analysis and short-term Fourier transformation of temporal evolutions, and the degree of disorder in the amplitude and phase of the long-term temporal evolutions. The transition from chaotic relaxation oscillations (RO) to chaotic spiking oscillations (SO) was explored via the chaotic itinerancy (CI) regime by increasing the feedback ratio toward the laser from a rotating scattering object. The intensity probability distribution was found to change from an exponential decay in the RO regime to an inverse power law in the SO regime, which manifests itself in self-organized critical behavior, while stochastic subharmonic frequency locking among the two periodicities of RO and SO takes place in the CI regime featuring quantum-noise (spontaneous emission)-induced order in the amplitude and phase of the spiking oscillations. All of the experimental results were reproduced by numerical simulations of a model equation of a single-mode self-mixing solid-state laser subjected to Doppler-shifted optical feedback from a rotating scattering object.


title: Logspace Sequential Quadratic Programming for Design Optimization

abstract: A novel approach to exploiting the log-convex structure present in many design problems is developed by modifying the classical Sequential Quadratic Programming (SQP) algorithm. The modified algorithm, Logspace Sequential Quadratic Programming (LSQP), inherits some of the computational efficiency exhibited by log-convex methods such as Geometric Programing and Signomial Programing, but retains the the natural integration of black box analysis methods from SQP. As a result, significant computational savings is achieved without the need to invasively modify existing black box analysis methods prevalent in practical design problems. In the cases considered here, the LSQP algorithm shows a 40-70% reduction in number of iterations compared to SQP.


title: Reuse Distance-based Copy-backs of Clean Cache Lines to Lower-level Caches

abstract: Cache plays a critical role in reducing the performance gap between CPU and main memory. A modern multi-core CPU generally employs a multi-level hierarchy of caches, through which the most recently and frequently used data are maintained in each core's local private caches while all cores share the last-level cache (LLC). For inclusive caches, clean cache lines replaced in higher-level caches are not necessarily copied back to lower levels, as the inclusiveness implies their existences in lower levels. For exclusive and non-inclusive caches that are widely utilized by Intel, AMD, and ARM today, either indiscriminately copying back all or none of replaced clean cache lines to lower levels raises no violation to exclusiveness and non-inclusiveness definitions. We have conducted a quantitative study and found that, copying back all or none of clean cache lines to lower-level cache of exclusive caches entails suboptimal performance. The reason is that only a part of cache lines would be reused and others turn to be dead in a long run. This observation motivates us to selectively copy back some clean cache lines to LLC in an architecture of exclusive or non-inclusive caches. We revisit the concept of reuse distance of cache lines. In a nutshell, a clean cache line with a shorter reuse distance is copied back to lower-level cache as it is likely to be re-referenced in the near future, while cache lines with much longer reuse distances would be discarded or sent to memory if they are dirty. We have implemented and evaluated our proposal with non-volatile (STT-MRAM) LLC. Experimental results with gem5 and SPEC CPU 2017 benchmarks show that on average our proposal yields up to 12.8% higher throughput of IPC (instructions per cycle) than the least-recently-used (LRU) replacement policy with copying back all clean cache lines for STT-MRAM LLC.


title: Design of distant retrograde orbits based on a higher order analytical solution

abstract: Because the distant retrograde orbits dynamics inherently depends on special functions, approximate analytical solutions in the literature are commonly constrained to providing rough approximations of the qualitative behavior. We rely on perturbation methods and succeed in computing a higher order analytical solution that extends the range of applicability of previous solutions to the problem of relative, quasi-satellite orbits with large librations. Besides, the analytical solution provides two design parameters that are effectively used in the computation of periodic, distant retrograde orbits without constraining to the typical 1:1 resonance.


title: NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search

abstract: While pre-trained language models (e.g., BERT) have achieved impressive results on different natural language processing tasks, they have large numbers of parameters and suffer from big computational and memory costs, which make them difficult for real-world deployment. Therefore, model compression is necessary to reduce the computation and memory cost of pre-trained models. In this work, we aim to compress BERT and address the following two challenging practical issues: (1) The compression algorithm should be able to output multiple compressed models with different sizes and latencies, in order to support devices with different memory and latency limitations; (2) The algorithm should be downstream task agnostic, so that the compressed models are generally applicable for different downstream tasks. We leverage techniques in neural architecture search (NAS) and propose NAS-BERT, an efficient method for BERT compression. NAS-BERT trains a big supernet on a search space containing a variety of architectures and outputs multiple compressed models with adaptive sizes and latency. Furthermore, the training of NAS-BERT is conducted on standard self-supervised pre-training tasks (e.g., masked language model) and does not depend on specific downstream tasks. Thus, the compressed models can be used across various downstream tasks. The technical challenge of NAS-BERT is that training a big supernet on the pre-training task is extremely costly. We employ several techniques including block-wise search, search space pruning, and performance approximation to improve search efficiency and accuracy. Extensive experiments on GLUE and SQuAD benchmark datasets demonstrate that NAS-BERT can find lightweight models with better accuracy than previous approaches, and can be directly applied to different downstream tasks with adaptive model sizes for different requirements of memory or latency.


title: Modeling Text-visual Mutual Dependency for Multi-modal Dialog Generation

abstract: Multi-modal dialog modeling is of growing interest. In this work, we propose frameworks to resolve a specific case of multi-modal dialog generation that better mimics multi-modal dialog generation in the real world, where each dialog turn is associated with the visual context in which it takes place. Specifically, we propose to model the mutual dependency between text-visual features, where the model not only needs to learn the probability of generating the next dialog utterance given preceding dialog utterances and visual contexts, but also the probability of predicting the visual features in which a dialog utterance takes place, leading the generated dialog utterance specific to the visual context. We observe significant performance boosts over vanilla models when the mutual dependency between text and visual features is modeled. Code is available at https://github.com/ShannonAI/OpenViDial.


title: Phantom maps and rational homotopy

abstract: We generalize theorems of McGibbon-Roitberg, Iriye, and Meier on the relations between phantom maps and rational homotopy, and apply them to provide new calculational examples of the homotopy sets Ph(X, Y ) of phantom maps and the subsets SPh(X, Y ) of special phantom maps.


title: EPSANet: An Efficient Pyramid Squeeze Attention Block on Convolutional Neural Network

abstract: Recently, it has been demonstrated that the performance of a deep convolutional neural network can be effectively improved by embedding an attention module into it. In this work, a novel lightweight and effective attention method named Pyramid Squeeze Attention (PSA) module is proposed. By replacing the 3x3 convolution with the PSA module in the bottleneck blocks of the ResNet, a novel representational block named Efficient Pyramid Squeeze Attention (EPSA) is obtained. The EPSA block can be easily added as a plug-and-play component into a well-established backbone network, and significant improvements on model performance can be achieved. Hence, a simple and efficient backbone architecture named EPSANet is developed in this work by stacking these ResNet-style EPSA blocks. Correspondingly, a stronger multi-scale representation ability can be offered by the proposed EPSANet for various computer vision tasks including but not limited to, image classification, object detection, instance segmentation, etc. Without bells and whistles, the performance of the proposed EPSANet outperforms most of the state-of-the-art channel attention methods. As compared to the SENet-50, the Top-1 accuracy is improved by 1.93% on ImageNet dataset, a larger margin of +2.7 box AP for object detection and an improvement of +1.7 mask AP for instance segmentation by using the Mask-RCNN on MS-COCO dataset are obtained. Our source code is available at:https://github.com/murufeng/EPSANet.


title: Revisiting Quantum Mysteries

abstract: In this article we argue that in quantum mechanics, and in opposition to classical physics, it is impossible to say that an isolated quantum system "owns" a physical property. Some properties of the system, its mass for example, belong to it in a sense close to that of classical physics; but most often a property must be attributed to the system within a context. We give simple motivations for adopting this point of view, and show that it clarifies many issues in quantum physics.