title: On an alternative quantization of R-NS strings

abstract: We investigate an alternative quantization of R-NS string theory. In the alternative quantization, we define the distinct vacuum for the left-moving mode and the right-moving mode by exchanging the role of creation operators and annihilation operators in the left-moving sector. The resulting string theory has only a finite number of propagating degrees of freedom. We show that an appropriate choice of the GSO projection makes the theory tachyon free. The spectrum coincides with the massless sector of type IIA or type IIB superstring theory without any massive excitations.


title: A mono-material Nernst thermopile with hermaphroditic legs

abstract: A large transverse thermoelectric response, known as anomalous Nernst effect (ANE) has been recently observed in several topological magnets. Building a thermopile employing this effect has been the subject of several recent propositions. Here, we design and build a thermopile with an array of tilted adjacent crystals of Mn$_3$Sn. The design employs a single material and replaces pairs of P and N thermocouples of the traditional design with hermaphroditic legs. The design exploits the large lag angle between the applied field and the magnetization, which we attribute to the interruption of magnetic octupoles at the edge of $xy$-plane. Eliminating extrinsic contacts between legs will boost the efficiency, simplify the process and pave the way for a new generation of thermopiles.


title: Depth from Camera Motion and Object Detection

abstract: This paper addresses the problem of learning to estimate the depth of detected objects given some measurement of camera motion (e.g., from robot kinematics or vehicle odometry). We achieve this by 1) designing a recurrent neural network (DBox) that estimates the depth of objects using a generalized representation of bounding boxes and uncalibrated camera movement and 2) introducing the Object Depth via Motion and Detection Dataset (ODMD). ODMD training data are extensible and configurable, and the ODMD benchmark includes 21,600 examples across four validation and test sets. These sets include mobile robot experiments using an end-effector camera to locate objects from the YCB dataset and examples with perturbations added to camera motion or bounding box data. In addition to the ODMD benchmark, we evaluate DBox in other monocular application domains, achieving state-of-the-art results on existing driving and robotics benchmarks and estimating the depth of objects using a camera phone.


title: Proton-induced activation cross sections in the energy range below 1 GeV

abstract: (Abridged) Modern studies and industrial applications related to the design, radiation protection, and reliability of nuclear facilities, medical applications, as well as space research and exploration are relying on extensive simulations and modeling. Computer codes realizing semi-classical and quantum molecular dynamics (QMD) approaches are often employed to make up for the lack of accelerator data on many nuclear reactions at intermediate and high energies (>10s of MeV/n) and are in high demand. This contribution focuses on the methodology of generating reliable proton-induced cross sections in the energy range below 1 GeV. We developed a problem-oriented computer framework based on MCNPX and CASCADE/INPE codes to calculate activation cross section data at intermediate and high energies. Goodness of the fits of nucleon-nucleus interaction models to the existing data is evaluated based on elaborated algorithms. The method is based on the analysis of a large set of data and calculated cross sections for different targets and residual nuclei in a wide range of proton energies using numerous criteria. In practice, this could be done by tuning the model parameters and algorithms to fit required experimental data subset, or through achieving unification and consistency of fundamental parameters for all considered reactions. The presented framework is pursuing the latter approach. We use proton-induced reactions on Si and Fe nuclei to illustrate the application of the developed multi-criteria algorithm, where we use all data below 1 GeV available from the EXFOR data library and the IAEA CRP "Benchmark of Spallation Models." We show that the analysis of the predictive power of various intermediate and high-energy models based on the multi-criteria algorithm allows more sophisticated selection of appropriate models in a given energy range and residual nuclei domain.


title: Network Cluster-Robust Inference

abstract: Since network data commonly consists of observations from a single large network, researchers often partition the network into clusters in order to apply cluster-robust inference methods. Existing such methods require clusters to be asymptotically independent. Under mild conditions, we prove that, for this requirement to hold for network-dependent data, it is necessary and sufficient that clusters have low conductance, the ratio of edge boundary size to volume. This yields a simple measure of cluster quality. We find in simulations that when clusters have low conductance, cluster-robust methods control size better than HAC estimators. However, for important classes of networks lacking low-conductance clusters, the former can exhibit substantial size distortion. To determine the number of low-conductance clusters and construct them, we draw on results in spectral graph theory that connect conductance to the spectrum of the graph Laplacian. Based on these results, we propose to use the spectrum to determine the number of low-conductance clusters and spectral clustering to construct them.


title: On the Connectivity and Giant Component Size of Random K-out Graphs Under Randomly Deleted Nodes

abstract: Random K-out graphs, denoted $\mathbb{H}(n;K)$, are generated by each of the $n$ nodes drawing $K$ out-edges towards $K$ distinct nodes selected uniformly at random, and then ignoring the orientation of the arcs. Recently, random K-out graphs have been used in applications as diverse as random (pairwise) key predistribution in ad-hoc networks, anonymous message routing in crypto-currency networks, and differentially-private federated averaging. In many applications, connectivity of the random K-out graph when some of its nodes are dishonest, have failed, or have been captured is of practical interest. We provide a comprehensive set of results on the connectivity and giant component size of $\mathbb{H}(n;K_n,\gamma_n)$, i.e., random K-out graph when $\gamma_n$ of its nodes, selected uniformly at random, are deleted. First, we derive conditions for $K_n$ and $n$ that ensure, with high probability (whp), the connectivity of the remaining graph when the number of deleted nodes is $\gamma_n=\Omega(n)$ and $\gamma_n=o(n)$, respectively. Next, we derive conditions for $\mathbb{H}(n;K_n,\gamma_n)$ to have a giant component, i.e., a connected subgraph with $\Omega(n)$ nodes, whp. This is also done for different scalings of $\gamma_n$ and upper bounds are provided for the number of nodes outside the giant component. Simulation results are presented to validate the usefulness of the results in the finite node regime.


title: TweetCOVID: A System for Analyzing Public Sentiments and Discussions about COVID-19 via Twitter Activities

abstract: The COVID-19 pandemic has created widespread health and economical impacts, affecting millions around the world. To better understand these impacts, we present the TweetCOVID system that offers the capability to understand the public reactions to the COVID-19 pandemic in terms of their sentiments, emotions, topics of interest and controversial discussions, over a range of time periods and locations, using public tweets. We also present three example use cases that illustrates the usefulness of our proposed TweetCOVID system.


title: Phase transition of an open quantum walk

abstract: It has been discovered that open quantum walks diffusively distribute in space, since they were introduced in 2012. Indeed, some limit distributions have been demonstrated and most of them are described by Gaussian distributions. We operate an open quantum walk on $\mathbb{Z}=\left\{0, \pm 1, \pm 2,\ldots\right\}$ with parameterized operations in this paper, and study its 1st and 2nd moments so that we find its standard deviation. The standard deviation tells us whether the open quantum walker shows diffusive or ballistic behavior, which results in a phase transition of the walker.


title: On Estimating Recommendation Evaluation Metrics under Sampling

abstract: Since the recent study (Krichene and Rendle 2020) done by Krichene and Rendle on the sampling-based top-k evaluation metric for recommendation, there has been a lot of debates on the validity of using sampling to evaluate recommendation algorithms. Though their work and the recent work (Li et al.2020) have proposed some basic approaches for mapping the sampling-based metrics to their global counterparts which rank the entire set of items, there is still a lack of understanding and consensus on how sampling should be used for recommendation evaluation. The proposed approaches either are rather uninformative (linking sampling to metric evaluation) or can only work on simple metrics, such as Recall/Precision (Krichene and Rendle 2020; Li et al. 2020). In this paper, we introduce a new research problem on learning the empirical rank distribution, and a new approach based on the estimated rank distribution, to estimate the top-k metrics. Since this question is closely related to the underlying mechanism of sampling for recommendation, tackling it can help better understand the power of sampling and can help resolve the questions of if and how should we use sampling for evaluating recommendation. We introduce two approaches based on MLE (MaximalLikelihood Estimation) and its weighted variants, and ME(Maximal Entropy) principals to recover the empirical rank distribution, and then utilize them for metrics estimation. The experimental results show the advantages of using the new approaches for evaluating recommendation algorithms based on top-k metrics.


title: Apples, Oranges & Fruits -- Understanding Similarity of Software Projects Through The Lens of Dissimilar Artifacts

abstract: The growing availability of open source projects has facilitated developers to reuse existing software artifacts and leverage them to develop new software. However, it is hard to understand the notion of similarity as it varies from developer to developer. Some developers might search for repositories with similar source code, while some might be in search of repositories with similar requirements or issues. Existing approaches tend to find similar projects by comparing similar artifacts such as source-code to source-code, API usage to API usage, documentation to documentation, and so on. Even though there is a dissimilarity between two similar artifacts, there could be a similarity between two dissimilar artifacts. Hence, in this paper, we aim to answer the question - Can we find similarity of software repositories through dissimilar artifacts?. To this end, we conduct an experiment to find similarities between three repositories, two similar and one different project comparing similar and dissimilar artifacts (documentation, commits, and source-code). We observed similarities between dissimilar artifacts such as Commits, Source Code, and Readme Files in the context of both similar and different repositories.


title: Time-Optimal Navigation in Uncertain Environments with High-Level Specifications

abstract: Mixed observable Markov decision processes (MOMDPs) are a modeling framework for autonomous systems described by both fully and partially observable states. In this work, we study the problem of synthesizing a control policy for MOMDPs that minimizes the expected time to complete the control task while satisfying syntactically co-safe Linear Temporal Logic (scLTL) specifications. First, we present an exact dynamic programming update to compute the value function. Afterwards, we propose a point-based approximation, which allows us to compute a lower bound of the closed-loop probability of satisfying the specifications. The effectiveness of the proposed approach and comparisons with standard strategies are shown on high-fidelity navigation tasks with partially observable static obstacles.


title: The Yamabe operator and invariants on octonionic contact manifolds and convex cocompact subgroups of ${\rm F}_{4(-20)}$

abstract: An octonionic contact (OC) manifold is always spherical. We construct the OC Yamabe operator on an OC manifold and prove its transformation formula under conformal OC transformations. An OC manifold is scalar positive, negative or vanishing if and only if its OC Yamabe invariant is positive, negative or zero, respectively. On a scalar positive OC manifold, we can construct the Green function of the OC Yamabe operator, and apply it to construct a conformally invariant tensor. It becomes an OC metric if the OC positive mass conjecture is true. We also show the connected sum of two scalar positive OC manifolds to be scalar positive if the neck is sufficiently long. On the OC manifold constructed from a convex cocompact subgroup of ${\rm F}_{4(-20)}$, we construct a Nayatani type Carnot-Carath\'eodory metric. As a corollary, such an OC manifold is scalar positive, negative or vanishing if and only if the Poincar\'e critical exponent of the subgroup is less than, greater than or equal to $10,$ respectively.


title: Unbound spectra of neutron-rich oxygen isotopes predicted by the Gamow shell model

abstract: The Gamow shell model has shown to efficiently describe weakly bound and unbound nuclear systems, as internucleon correlations and continuum coupling are both taken into account in this model. In the present work, we study neutron-dripline oxygen isotopes. It is hereby demonstrated that the presence of continuum coupling is important for the description of oxygen isotopes at dripline, and especially to assess the eventual bound or unbound character of $^{28}$O. Our results suggest that the ground state of $^{28}$O is weakly unbound and is similar to the narrow resonant $^{26}$O ground state. Predictions of weakly bound and resonance excited states in $^{24\text-26}$O are also provided. The asymptotes of the studied many-body states are analyzed via one-body densities, whereby the different radial properties of well bound, loosely bound, resonance states are clearly depicted.


title: Statistical Post-Processing for Gridded Temperature Prediction Using Encoder-Decoder-Based Deep Convolutional Neural Networks

abstract: The Japan Meteorological Agency operates gridded temperature guidance to predict two-dimensional snowfall amounts and precipitation types, e.g., rain and snow, because surface temperature is one of the key elements to predict them. Operational temperature guidance is based on the Kalman filter, which uses temperature observation and numerical weather prediction (NWP) outputs only around observation sites. Correcting a temperature field when NWP models incorrectly predict a front's location or when observed temperatures are extremely cold or hot has been challenging. In this study, an encoder-decoder-based convolutional neural network has been proposed to predict gridded temperatures at the surface around the Kanto region in Japan. Verification results showed that the proposed model greatly improves the operational guidance and can correct NWP model biases, such as a positional error of fronts and extreme temperatures.


title: Observation of $e^{+}e^{-}\rightarrow\eta\psi(2S)$ at center-of-mass energies from 4.236 to 4.600 GeV

abstract: Using a total of $5.25~{\rm fb}^{-1}$ of $e^{+}e^{-}$ collision data with center-of-mass energies from 4.236 to 4.600 GeV, we report the first observation of the process $e^{+}e^{-}\to \eta\psi(2S)$ with a statistical significance of $5\sigma$. The data sets were collected by the BESIII detector operating at the BEPCII storage ring. We measure the yield of events integrated over center-of-mass energies and also present the energy dependence of the measured cross section.


title: Tempered Fractional LES Modeling

abstract: The presence of nonlocal interactions and intermittent signals in the homogeneous isotropic turbulence grant multi-point statistical functions a key role in formulating a new generation of large-eddy simulation (LES) models of higher fidelity. We establish a tempered fractional-order modeling framework for developing nonlocal LES subgrid-scale models, starting from the kinetic transport. We employ a tempered L\'evy-stable distribution to represent the source of turbulent effects at the kinetic level, and we rigorously show that the corresponding turbulence closure term emerges as the tempered fractional Laplacian, $(\Delta+\lambda)^{\alpha} (\cdot)$, for $\alpha \in (0,1)$, $\alpha \neq \frac{1}{2}$, and $\lambda>0$ in the filtered Navier-Stokes equations. Moreover, we prove the frame invariant properties of the proposed model, complying with the subgrid-scale stresses. To characterize the optimum values of model parameters and infer the enhanced efficiency of the tempered fractional subgrid-scale model, we develop a robust algorithm, involving two-point structure functions and conventional correlation coefficients. In an a priori statistical study, we evaluate the capabilities of the developed model in fulfilling the closed essential requirements, obtained for a weaker sense of the ideal LES model (Meneveau 1994). Finally, the model undergoes the a posteriori analysis to ensure the numerical stability and pragmatic efficiency of the model.


title: Multipole optimization of light focusing by silicon nanosphere structures

abstract: We investigate the applicability of the coupled multipole model and its modification in the framework of the zero-order Born approximation for modeling of light focusing by finite-size nanostructures of silicon nanospheres, supporting electric and magnetic dipole and quadrupole resonances. The results based on the analytical approximations are verified by comparison with the numerical simulations performed by the T-matrix method. Using the evolutionary algorithm optimization, we apply the developed approach to design the silicon nanosphere metalenses with predefined focusing properties. The obtained results demonstrate a strong optimization potential of the suggested calculation scheme for engineering ultra-thin metalenses.


title: Entropy function from the Einstein boundary term

abstract: We show using the entropy function formalism developed by Sen \cite{Sen:2005wa} that the boundary term which arises from the Einstein-Hilbert action is sufficient to yield the Bekenstein-Hawking entropy of a static extremal black hole which is asymptotically flat. However, for asymptotically $AdS$ black holes, the bulk term also plays an important role due to the presence of the cosmological constant. Further, we show that for extremal rotating black holes, both the boundary and the bulk terms contribute non-vanishing pieces to the entropy.


title: Online Orthogonal Dictionary Learning Based on Frank-Wolfe Method

abstract: Dictionary learning is a widely used unsupervised learning method in signal processing and machine learning. Most existing works of dictionary learning are in an offline manner. There are mainly two offline ways for dictionary learning. One is to do an alternative optimization of both the dictionary and the sparse code; the other way is to optimize the dictionary by restricting it over the orthogonal group. The latter one is called orthogonal dictionary learning which has a lower complexity implementation, hence, it is more favorable for lowcost devices. However, existing schemes on orthogonal dictionary learning only work with batch data and can not be implemented online, which is not applicable for real-time applications. This paper proposes a novel online orthogonal dictionary scheme to dynamically learn the dictionary from streaming data without storing the historical data. The proposed scheme includes a novel problem formulation and an efficient online algorithm design with convergence analysis. In the problem formulation, we relax the orthogonal constraint to enable an efficient online algorithm. In the algorithm design, we propose a new Frank-Wolfe-based online algorithm with a convergence rate of O(ln t/t^(1/4)). The convergence rate in terms of key system parameters is also derived. Experiments with synthetic data and real-world sensor readings demonstrate the effectiveness and efficiency of the proposed online orthogonal dictionary learning scheme.


title: Holographic topological defects and local gauge symmetry: clusters of strongly coupled equal-sign vortices

abstract: Gauge invariance plays an important role in forming topological defects. In this work, from the AdS/CFT correspondence, we realize the clusters of equal-sign vortices during the course of critical dynamics of a strongly coupled superconductor. This is the first time to achieve the equal-sign vortex clusters in strongly coupled systems, considering that vortices with equal sign repel. The appearance of clusters of equal-sign vortices is a typical character of flux trapping mechanism, distinct from Kibble-Zurek mechanism which merely presents vortex-antivortex pair distributions resulting from global symmetry breaking. Numerical results of spatial correlations and net fluxes of the equal-sign vortex clusters quantitatively support the positive correlations between vortices. The linear dependence between the vortex number and the amplitude of magnetic field at the `trapping' time demonstrates the flux trapping mechanism very well.


title: Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition

abstract: Visual Place Recognition is a challenging task for robotics and autonomous systems, which must deal with the twin problems of appearance and viewpoint change in an always changing world. This paper introduces Patch-NetVLAD, which provides a novel formulation for combining the advantages of both local and global descriptor methods by deriving patch-level features from NetVLAD residuals. Unlike the fixed spatial neighborhood regime of existing local keypoint features, our method enables aggregation and matching of deep-learned local features defined over the feature-space grid. We further introduce a multi-scale fusion of patch features that have complementary scales (i.e. patch sizes) via an integral feature space and show that the fused features are highly invariant to both condition (season, structure, and illumination) and viewpoint (translation and rotation) changes. Patch-NetVLAD outperforms both global and local feature descriptor-based methods with comparable compute, achieving state-of-the-art visual place recognition results on a range of challenging real-world datasets, including winning the Facebook Mapillary Visual Place Recognition Challenge at ECCV2020. It is also adaptable to user requirements, with a speed-optimised version operating over an order of magnitude faster than the state-of-the-art. By combining superior performance with improved computational efficiency in a configurable framework, Patch-NetVLAD is well suited to enhance both stand-alone place recognition capabilities and the overall performance of SLAM systems.


title: The Difficulty in Scaling Blockchains: A Simple Explanation

abstract: Blockchains have become immensely popular and are high on the list of national and international research and innovation agenda's. This is partly caused by the numerous interesting applications, combined with the promise of full decentralization and high scalability (among others). Keeping that promise, however, is technically extremely demanding and has already required substantial scientific efforts, which so far have not been overwhelmingly successful. In this paper, we provide a laymen's description of what may turn out to be a fundamental hurdle in attaining blockchains that combine scalability, high transaction processing capabilities, and are indeed fully decentralized.


title: Multi-Level Attention Pooling for Graph Neural Networks: Unifying Graph Representations with Multiple Localities

abstract: Graph neural networks (GNNs) have been widely used to learn vector representation of graph-structured data and achieved better task performance than conventional methods. The foundation of GNNs is the message passing procedure, which propagates the information in a node to its neighbors. Since this procedure proceeds one step per layer, the range of the information propagation among nodes is small in the lower layers, and it expands toward the higher layers. Therefore, a GNN model has to be deep enough to capture global structural information in a graph. On the other hand, it is known that deep GNN models suffer from performance degradation because they lose nodes' local information, which would be essential for good model performance, through many message passing steps. In this study, we propose multi-level attention pooling (MLAP) for graph-level classification tasks, which can adapt to both local and global structural information in a graph. It has an attention pooling layer for each message passing step and computes the final graph representation by unifying the layer-wise graph representations. The MLAP architecture allows models to utilize the structural information of graphs with multiple levels of localities because it preserves layer-wise information before losing them due to oversmoothing. Results of our experiments show that the MLAP architecture improves the graph classification performance compared to the baseline architectures. In addition, analyses on the layer-wise graph representations suggest that aggregating information from multiple levels of localities indeed has the potential to improve the discriminability of learned graph representations.


title: Mind Mappings: Enabling Efficient Algorithm-Accelerator Mapping Space Search

abstract: Modern day computing increasingly relies on specialization to satiate growing performance and efficiency requirements. A core challenge in designing such specialized hardware architectures is how to perform mapping space search, i.e., search for an optimal mapping from algorithm to hardware. Prior work shows that choosing an inefficient mapping can lead to multiplicative-factor efficiency overheads. Additionally, the search space is not only large but also non-convex and non-smooth, precluding advanced search techniques. As a result, previous works are forced to implement mapping space search using expert choices or sub-optimal search heuristics. This work proposes Mind Mappings, a novel gradient-based search method for algorithm-accelerator mapping space search. The key idea is to derive a smooth, differentiable approximation to the otherwise non-smooth, non-convex search space. With a smooth, differentiable approximation, we can leverage efficient gradient-based search algorithms to find high-quality mappings. We extensively compare Mind Mappings to black-box optimization schemes used in prior work. When tasked to find mappings for two important workloads (CNN and MTTKRP), the proposed search finds mappings that achieve an average $1.40\times$, $1.76\times$, and $1.29\times$ (when run for a fixed number of steps) and $3.16\times$, $4.19\times$, and $2.90\times$ (when run for a fixed amount of time) better energy-delay product (EDP) relative to Simulated Annealing, Genetic Algorithms and Reinforcement Learning, respectively. Meanwhile, Mind Mappings returns mappings with only $5.32\times$ higher EDP than a possibly unachievable theoretical lower-bound, indicating proximity to the global optima.


title: Abstract Processes and Conflicts in Place/Transition Systems

abstract: For one-safe Petri nets or condition/event-systems, a process as defined by Carl Adam Petri provides a notion of a run of a system where causal dependencies are reflected in terms of a partial order. Goltz and Reisig have generalised this concept for nets where places carry multiple tokens, by distinguishing tokens according to their causal history. However, this so-called individual token interpretation is often considered too detailed. Here we identify a subclass of Petri nets, called structural conflict nets, where no interplay between conflict and concurrency due to token multiplicity occurs. For this subclass, we define abstract processes as equivalence classes of Goltz-Reisig processes. We justify this approach by showing that there is a largest abstract process if and only if the underlying net is conflict-free with respect to a canonical notion of conflict.


title: Cryogenic single-port calibration for superconducting microwave resonator measurements

abstract: Superconducting circuit testing and materials loss characterization requires robust and reliable methods for the extraction of internal and coupling quality factors of microwave resonators. A common method, imposed by limitations on the device design or experimental configuration, is the single-port reflection geometry, i.e. reflection-mode. However, impedance mismatches in cryogenic systems must be accounted for through calibration of the measurement chain while it is at low temperatures. In this paper, we demonstrate a data-based, single-port calibration using commercial microwave standards and a vector network analyzer (VNA) with samples at millikelvin temperature in a dilution refrigerator, making this method useful for measurements of quantum phenomena. Finally, we cross reference our data-based, single-port calibration and reflection measurement with over-coupled 2D- and 3D-resonators against well established two-port techniques corroborating the validity of our method.


title: 2{\pi} scaling law during inviscid fluid pinch-off and satellite droplets formation

abstract: Pinch-off and satellite droplets formation during breakup of near-inviscid liquid bridge sandwiched between two given equal and coaxial circular plates have been investigated. The breakup always results in the formation of a spindle shape which is the precursor of the satellite droplet at the moment of pinch-off. Interestingly, the slenderness of this spindle is always bigger than 2{\pi} and always results in the formation of only one satellite droplet regardless of the surface tension and the slenderness of the liquid bridge. We predict the cone angle of this spindle formed during the pinch-off of inviscid fluids should be 18.086122158...{\deg}. After pinch-off, the satellite droplets will drift out of the pinch-off regions in the case of symmetrical short bridge, and merge again with the sessile drop in the case of unsymmetrical long bridge. We demonstrate that the velocity of the satellite droplet is consistent with a scaling model based on a balance between capillary forces and the inertia at the pinch-off region.


title: The interaction of elementary waves for nonisentropic flow in a variable cross-section duct

abstract: The interaction of elementary waves for isentropic flow in a variable cross-section duct is obtained (\cite{ShengZhang}). The authors have discussed rarefaction wave or shock wave interacts with stationary wave. In this paper, we extend their results to the nonisentropic flow. It can be proved that if one changes $(u,\rho)$ plane in isentropic flow with $(u,p)$ plane in nonisentropic case, the interaction results of rarefaction wave or shock wave with stationary wave can be moved parallel from the isentropic case when contact discontinuity is involved. Thus we mainly focus on the interactions between contact discontinuity and stationary wave. Some numerical results are given to verify our analysis. The results can apply to the interaction of more complicated wave patterns.


title: Resolving resonance effects in the theory of single particle photothermal imaging

abstract: Photothermal spectroscopy and microscopy provides a route to measure the spectral and spatial properties of individual nanoscopic absorbers, independent from scattering, extinction, and emission. The approach relies upon use of two light sources, one that resonantly excites and heats the target and its surrounding environment and a second off-resonant probe that scatters from the resulting volume of thermally modified refractive index. Over the past twenty years, considerable effort has been extended to apply photothermal methods to detect, spatially resolve, and perform absorption spectroscopy on single non-emissive molecules and other absorbers like plasmonic nanoparticles at room temperature conditions. Companion theoretical models have been developed to interpret these experimental advances, yet it is not clear how they are related to each other nor how the effects of lock-in detection modify the theory. For larger target systems that host their own intrinsic scattering resonances as well as for background media that do not instantaneously thermalize with the absorbing target, additional dependencies arise that are yet to be explored theoretically. The aim of this Perspective is to overview the theory of photothermal spectroscopy and microscopy and present a unifying theoretical approach that recovers past models in certain limits while explicitly including the effects of target scattering resonances, thermal and optical retardation, and lock-in detection. Focus is made on plasmonic particles to interpret the photothermal signal, yet all results are applicable equally to individual molecules or nanoparticle absorbers. Consequently, we expect this review to provide a useful foundation for the understanding of photothermal measurements independent of target identity.


title: Task-Adaptive Neural Network Search with Meta-Contrastive Learning

abstract: Most conventional Neural Architecture Search (NAS) approaches are limited in that they only generate architectures without searching for the optimal parameters. While some NAS methods handle this issue by utilizing a supernet trained on a large-scale dataset such as ImageNet, they may be suboptimal if the target tasks are highly dissimilar from the dataset the supernet is trained on. To address such limitations, we introduce a novel problem of \emph{Neural Network Search} (NNS), whose goal is to search for the optimal pretrained network for a novel dataset and constraints (e.g. number of parameters), from a model zoo. Then, we propose a novel framework to tackle the problem, namely \emph{Task-Adaptive Neural Network Search} (TANS). Given a model-zoo that consists of network pretrained on diverse datasets, we use a novel amortized meta-learning framework to learn a cross-modal latent space with contrastive loss, to maximize the similarity between a dataset and a high-performing network on it, and minimize the similarity between irrelevant dataset-network pairs. We validate the effectiveness and efficiency of our method on ten real-world datasets, against existing NAS/AutoML baselines. The results show that our method instantly retrieves networks that outperform models obtained with the baselines with significantly fewer training steps to reach the target performance, thus minimizing the total cost of obtaining a task-optimal network. Our code and the model-zoo are available at https://github.com/wyjeong/TANS.


title: DPlis: Boosting Utility of Differentially Private Deep Learning via Randomized Smoothing

abstract: Deep learning techniques have achieved remarkable performance in wide-ranging tasks. However, when trained on privacy-sensitive datasets, the model parameters may expose private information in training data. Prior attempts for differentially private training, although offering rigorous privacy guarantees, lead to much lower model performance than the non-private ones. Besides, different runs of the same training algorithm produce models with large performance variance. To address these issues, we propose DPlis--Differentially Private Learning wIth Smoothing. The core idea of DPlis is to construct a smooth loss function that favors noise-resilient models lying in large flat regions of the loss landscape. We provide theoretical justification for the utility improvements of DPlis. Extensive experiments also demonstrate that DPlis can effectively boost model quality and training stability under a given privacy budget.


title: Mean field limit of point vortices with environmental noises to deterministic 2D Navier-Stokes equations

abstract: We consider point vortex systems on the two dimensional torus perturbed by environmental noise. It is shown that, under a suitable scaling of the noises, weak limit points of the empirical measures are solutions to the vorticity formulation of deterministic 2D Navier-Stokes equations.


title: A Survey On Universal Adversarial Attack

abstract: The intriguing phenomenon of adversarial examples has attracted significant attention in machine learning and what might be more surprising to the community is the existence of universal adversarial perturbations (UAPs), i.e. a single perturbation to fool the target DNN for most images. With the focus on UAP against deep classifiers, this survey summarizes the recent progress on universal adversarial attacks, discussing the challenges from both the attack and defense sides, as well as the reason for the existence of UAP. We aim to extend this work as a dynamic survey that will regularly update its content to follow new works regarding UAP or universal attack in a wide range of domains, such as image, audio, video, text, etc. Relevant updates will be discussed at: https://bit.ly/2SbQlLG. We welcome authors of future works in this field to contact us for including your new finding.


title: Demystifying Batch Normalization in ReLU Networks: Equivalent Convex Optimization Models and Implicit Regularization

abstract: Batch Normalization (BN) is a commonly used technique to accelerate and stabilize training of deep neural networks. Despite its empirical success, a full theoretical understanding of BN is yet to be developed. In this work, we analyze BN through the lens of convex optimization. We introduce an analytic framework based on convex duality to obtain exact convex representations of weight-decay regularized ReLU networks with BN, which can be trained in polynomial-time. Our analyses also show that optimal layer weights can be obtained as simple closed-form formulas in the high-dimensional and/or overparameterized regimes. Furthermore, we find that Gradient Descent provides an algorithmic bias effect on the standard non-convex BN network, and we design an approach to explicitly encode this implicit regularization into the convex objective. Experiments with CIFAR image classification highlight the effectiveness of this explicit regularization for mimicking and substantially improving the performance of standard BN networks.


title: LoBSTr: Real-time Lower-body Pose Prediction from Sparse Upper-body Tracking Signals

abstract: With the popularization of game and VR/AR devices, there is a growing need for capturing human motion with a sparse set of tracking data. In this paper, we introduce a deep neural-network (DNN) based method for real-time prediction of the lower-body pose only from the tracking signals of the upper-body joints. Specifically, our Gated Recurrent Unit (GRU)-based recurrent architecture predicts the lower-body pose and feet contact probability from past sequence of tracking signals of the head, hands and pelvis. A major feature of our method is that the input signal is represented with the velocity of tracking signals. We show that the velocity representation better models the correlation between the upper-body and lower-body motions and increase the robustness against the diverse scales and proportions of the user body than position-orientation representations. In addition, to remove foot-skating and floating artifacts, our network predicts feet contact state, which is used to post-process the lower-body pose with inverse kinematics to preserve the contact. Our network is lightweight so as to run in real-time applications. We show the effectiveness of our method through several quantitative evaluations against other architectures and input representations, with respect to wild tracking data obtained from commercial VR devices.


title: Avoiding Degeneracy for Monocular Visual SLAM with Point and Line Features

abstract: In this paper, a degeneracy avoidance method for a point and line based visual SLAM algorithm is proposed. Visual SLAM predominantly uses point features. However, point features lack robustness in low texture and illuminance variant environments. Therefore, line features are used to compensate the weaknesses of point features. In addition, point features are poor in representing discernable features for the naked eye, meaning mapped point features cannot be recognized. To overcome the limitations above, line features were actively employed in previous studies. However, since degeneracy arises in the process of using line features, this paper attempts to solve this problem. First, a simple method to identify degenerate lines is presented. In addition, a novel structural constraint is proposed to avoid the degeneracy problem. At last, a point and line based monocular SLAM system using a robust optical-flow based lien tracking method is implemented. The results are verified using experiments with the EuRoC dataset and compared with other state-of-the-art algorithms. It is proven that our method yields more accurate localization as well as mapping results.


title: On Energy Allocation and Data Scheduling in Backscatter Networks with Multi-antenna Readers

abstract: In this paper, we study the throughput utility functions in buffer-equipped monostatic backscatter communication networks with multi-antenna Readers. In the considered model, the backscatter nodes (BNs) store the data in their buffers before transmission to the Reader. We investigate three utility functions, namely, the sum, the proportional and the common throughput. We design online admission policies, corresponding to each utility function, to determine how much data can be admitted in the buffers. Moreover, we propose an online data link control policy for jointly controlling the transmit and receive beamforming vectors as well as the reflection coefficients of the BNs. The proposed policies for data admission and data link control jointly optimize the throughput utility, while stabilizing the buffers. We adopt the min-drift-plus-penalty (MDPP) method in designing the control policies. Following the MDPP method, we cast the optimal data link control and the data admission policies as solutions of two independent optimization problems which should be solved in each time slot. The optimization problem corresponding to the data link control is non-convex and does not have a trivial solution. Using Lagrangian dual and quadratic transforms, we find a closed-form iterative solution. Finally, we use the results on the achievable rates of finite blocklength codes to study the system performance in the cases with short packets. As demonstrated, the proposed policies achieve optimal utility and stabilize the data buffers in the BNs.


title: Coded Computing via Binary Linear Codes: Designs and Performance Limits

abstract: We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed nodes. The goal is to reduce the average execution time of the computational job. We provide a connection between the problem of characterizing the average execution time of a coded distributed computing system and the problem of analyzing the error probability of codes of length $n$ used over erasure channels. Accordingly, we present closed-form expressions for the execution time using binary random linear codes and the best execution time any linear-coded distributed computing system can achieve. It is also shown that there exist \textit{good} binary linear codes that not only attain (asymptotically) the best performance that any linear code (not necessarily binary) can achieve but also are numerically stable against the inevitable rounding errors in practice. We then develop a low-complexity algorithm for decoding Reed-Muller (RM) codes over erasure channels. Our decoder only involves additions, subtractions, {and inversion of relatively small matrices of dimensions at most $\log n+1$}, and enables coded computation over real-valued data. Extensive numerical analysis of the fundamental results as well as RM- and polar-coded computing schemes demonstrate the excellence of the RM-coded computation in achieving close-to-optimal performance while having a low-complexity decoding and explicit construction. The proposed framework in this paper enables efficient designs of distributed computing systems given the rich literature in the channel coding theory.


title: Spin state and moment of inertia of Venus

abstract: Fundamental properties of the planet Venus, such as its internal mass distribution and variations in length of day, have remained unknown. We used Earth-based observations of radar speckles tied to the rotation of Venus obtained in 2006-2020 to measure its spin axis orientation, spin precession rate, moment of inertia, and length-of-day variations. Venus is tilted by 2.6392 $\pm$ 0.0008 degrees ($1\sigma$) with respect to its orbital plane. The spin axis precesses at a rate of 44.58 $\pm$ 3.3 arcseconds per year ($1\sigma$), which gives a normalized moment of inertia of 0.337 $\pm$ 0.024 and yields a rough estimate of the size of the core. The average sidereal day on Venus in the 2006-2020 interval is 243.0226 $\pm$ 0.0013 Earth days ($1\sigma$). The spin period of the solid planet exhibits variations of 61 ppm ($\sim$20 minutes) with a possible diurnal or semidiurnal forcing. The length-of-day variations imply that changes in atmospheric angular momentum of at least $\sim$4% are transferred to the solid planet.


title: Low-redshift compact star-forming galaxies as analogues of high-redshift star-forming galaxies

abstract: We compare the relations among various integrated characteristics of ~25,000 low-redshift (z<1.0) compact star-forming galaxies (CSFGs) from Data Release 16 (DR16) of the Sloan Digital Sky Survey (SDSS) and of high-redshift (z>1.5) star-forming galaxies (SFGs) with respect to oxygen abundances, stellar masses M*, far-UV absolute magnitudes M(FUV), star-formation rates SFR and specific star-formation rates sSFR, Lyman-continuum photon production efficiencies (xi_ion), UV continuum slopes \beta, [OIII]5007/[OII]3727 and [NeIII]3868/[OII]3727 ratios, and emission-line equivalent widths EW([OII]3727), EW([OIII]5007), and EW(H\alpha). We find that the relations for low-z CSFGs with high equivalent widths of the H\beta emission line, EW(H\beta)>100A, and high-z SFGs are very similar, implying close physical properties in these two categories of galaxies. Thus, CSFGs are likely excellent proxies for the SFGs in the high-z Universe. They also extend to galaxies with lower stellar masses, down to ~10^6 Msun, and to absolute FUV magnitudes as faint as -14 mag. Thanks to their proximity, CSFGs can be studied in much greater detail than distant SFGs. Therefore, the relations between the integrated characteristics of the large sample of CSFGs studied here can prove very useful for our understanding of high-z dwarf galaxies in future observations with large ground-based and space telescopes.


title: Heimdall: an AI-based infrastructure for traffic monitoring and anomalies detection

abstract: Since their appearance, Smart Cities have aimed at improving the daily life of people, helping to make public services smarter and more efficient. Several of these services are often intended to provide better security conditions for citizens and drivers. In this vein, we present Heimdall, an AI-based video surveillance system for traffic monitoring and anomalies detection. The proposed system features three main tiers: a ground level, consisting of a set of smart lampposts equipped with cameras and sensors, and an advanced AI unit for detecting accidents and traffic anomalies in real time; a territorial level, which integrates and combines the information collected from the different lampposts, and cross-correlates it with external data sources, in order to coordinate and handle warnings and alerts; a training level, in charge of continuously improving the accuracy of the modules that have to sense the environment. Finally, we propose and discuss an early experimental approach for the detection of anomalies, based on a Faster R-CNN, and adopted in the proposed infrastructure.


title: Arnold Conjecture and Morava K-theory

abstract: We prove that the rank of the cohomology of a closed symplectic manifold with coefficients in a field of characteristic $p$ is smaller than the number of periodic orbits of any non-degenerate Hamiltonian flow. Following Floer, the proof relies on constructing a homology group associated to each such flow, and comparing it with the homology of the ambient symplectic manifold. The proof does not proceed by constructing a version of Floer's complex with characteristic $p$ coefficients, but uses instead the canonical (stable) complex orientations of moduli spaces of Floer trajectories to construct a version of Floer homology with coefficients in Morava's $K$-theories, and can thus be seen as an implementation of Cohen, Jones, and Segal's vision for a Floer homotopy theory. The key feature of Morava K-theory that allows the construction to be carried out is the fact that the corresponding homology and cohomology groups of classifying spaces of finite groups satisfy Poincar\'e duality.


title: Star-critical Gallai-Ramsey numbers of graphs

abstract: The Gallai-Ramsey number $gr_{k}(K_{3}: H_{1}, H_{2}, \cdots, H_{k})$ is the smallest integer $n$ such that every $k$-edge-colored $K_{n}$ contains either a rainbow $K_3$ or a monochromatic $H_{i}$ in color $i$ for some $i\in [k]$. We find the largest star that can be removed from $K_n$ such that the underlying graph is still forced to have a rainbow $K_3$ or a monochromatic $H_{i}$ in color $i$ for some $i\in [k]$. Thus, we define the star-critical Gallai-Ramsey number $gr_{k}^{*}(K_3: H_{1}, H_{2}, \cdots, H_{k})$ as the smallest integer $s$ such that every $k$-edge-colored $K_{n}-K_{1, n-1-s}$ contains either a rainbow $K_3$ or a monochromatic $H_{i}$ in color $i$ for some $i\in [k]$. When $H=H_{1}=\cdots=H_{k}$, we simply denote $gr_{k}^{*}(K_{3}: H_{1}, H_{2}, \cdots, H_{k})$ by $gr_{k}^{*}(K_{3}: H)$. We determine the star-critical Gallai-Ramsey numbers for complete graphs and some small graphs. Furthermore, we show that $gr_{k}^{*}(K_3: H)$ is exponential in $k$ if $H$ is not bipartite, linear in $k$ if $H$ is bipartite but not a star and constant (not depending on $k$) if $H$ is a star.


title: Hecke operators and analytic Langlands correspondence for curves over local fields

abstract: We construct analogues of the Hecke operators for the moduli space of G-bundles on a curve X over a local field F with parabolic structures at finitely many points. We conjecture that they define commuting compact normal operators on the Hilbert space of half-densities on this moduli space. In the case F=C, we also conjecture that their joint spectrum is in a natural bijection with the set of opers on X for the Langlands dual group with real monodromy. This may be viewed as an analytic version of the Langlands correspondence for complex curves. Furthermore, we conjecture an explicit formula relating the eigenvalues of the Hecke operators and the global differential operators studied in our previous paper arXiv:1908.09677. Assuming the compactness conjecture, this formula follows from a certain system of differential equations satisfied by the Hecke operators, which we prove in this paper for G=PGL(n).


title: Shortening X-ray Pulse Duration via Saturable Absorption

abstract: To shorten the duration of x-ray pulses, we present a nonlinear optical technique using atoms with core-hole vacancies (core-hole atoms) generated by inner-shell photoionization. The weak Coulomb screening in the core-hole atoms results in decreased absorption at photon energies immediately above the absorption edge. By employing this phenomenon, referred to as saturable absorption, we successfully reduce the duration of x-ray free-electron laser pulses (photon energy: 9.000 keV, duration: 6-7 fs, fluence: 2.0-3.5$\times$10$^5$ J/cm$^2$) by $\sim$35%. This finding that core-hole atoms are applicable to nonlinear x-ray optics is an essential stepping stone for extending nonlinear technologies commonplace at optical wavelengths to the hard x-ray region.


title: Multi-label Classification via Adaptive Resonance Theory-based Clustering

abstract: This paper proposes a multi-label classification algorithm capable of continual learning by applying an Adaptive Resonance Theory (ART)-based clustering algorithm and the Bayesian approach for label probability computation. The ART-based clustering algorithm adaptively and continually generates prototype nodes corresponding to given data, and the generated nodes are used as classifiers. The label probability computation independently counts the number of label appearances for each class and calculates the Bayesian probabilities. Thus, the label probability computation can cope with an increase in the number of labels. Experimental results with synthetic and real-world multi-label datasets show that the proposed algorithm has competitive classification performance to other well-known algorithms while realizing continual learning.


title: A model consistent with LQCD data on $\rho$-meson screening mass

abstract: Recently, state-of-art LQCD calculations were done for $\pi$-meson and $\rho$-meson screening mass, ${M_{\pi}^{\rm scr}}(T)$ and ${M_{\rho}^{\rm scr}}(T)$. We consider the two-flavor system, and focus on temperature dependence $T$ of ${M_{\pi}^{\rm scr}}(T)$ and ${M_{\rho}^{\rm scr}}(T)$. Our aim is to construct a model consistent with LQCD data on ${M_{\rho}^{\rm scr}}(T)$ and ${M_{\pi}^{\rm scr}}(T)$.


title: Computing foaming flows across scales: from breaking waves to microfluidics

abstract: Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage and rupture of the microscopic liquid films at their interface. We present a novel multilayer simulation framework (Multi-VOF) that advances the state of the art in simulation capabilities of foamy flows. The framework introduces a novel scheme for the distinct handling of multiple neighboring bubbles and a new regularization method that produces sharp interfaces and removes spurious fragments. Multi-VOF is verified and validated with experimental results and complemented with open source, efficient scalable software. We demonstrate capturing of bubble crystalline structures in realistic microfluidics devices and foamy flows involving tens of thousands of bubbles in a waterfall. The present multilayer framework extends the classical volume-of-fluid methodology and allows for unprecedented large scale, predictive simulations of flows with multiple interfaces.

categories: physics.comp-ph cs.CE cs.NA math.NA physics.flu-dyn


title: Lyman continuum leakage from low-mass galaxies with Mstar < 1.E8 Msun

abstract: We present observations with the Cosmic Origins Spectrograph onboard the Hubble Space Telescope of nine low-mass star-forming galaxies at redshifts, z, in the range 0.3179-0.4524, with stellar masses Mstar < 10^8 M and veruny high specific star-formation rates sSFR~150-630 Gyr^{-1}, aiming to study the dependence of leaking Lyman continuum (LyC) emission on stellar mass and some other characteristics of the galaxy. We detect LyC emission in four out of nine galaxies with escape fractions, fesc(LyC), in the range of 11-35 per cent, and establish upper limits for fesc(LyC) in the remaining five galaxies. We observe a narrow Ly-alpha emission line with two peaks in seven galaxies and likely more complex Ly-alpha profiles in the two remaining galaxies. The velocity separation between the peaks Vsep varies in the range from ~229 km/s to ~512 km/s. Our additional data on low-mass galaxies confirm and strengthen the tight anti-correlation between fesc(LyC) and Vsep found for previous low-redshift galaxy samples with higher stellar masses. Vsep remains the best indirect indicator of LyC leakage. It is better than O32 on which fesc(LyC) depends weakly, with a large scatter. Finally, contrary to expectations, we find no increase of fesc(LyC) with decreasing galaxy stellar mass Mstar.


title: Evidence of a coupled electron-phonon liquid in NbGe$_2$

abstract: Whereas electron-phonon scattering typically relaxes the electron's momentum in metals, a perpetual exchange of momentum between phonons and electrons conserves total momentum and can lead to a coupled electron-phonon liquid with unique transport properties. This theoretical idea was proposed decades ago and has been revisited recently, but the experimental signatures of an electron-phonon liquid have been rarely reported. We present evidence of such a behavior in a transition metal ditetrelide, NbGe$_2$, from three different experiments. First, quantum oscillations reveal an enhanced quasiparticle mass, which is unexpected in NbGe$_2$ due to weak electron-electron correlations, hence pointing at electron-phonon interactions. Second, resistivity measurements exhibit a discrepancy between the experimental data and calculated curves within a standard Fermi liquid theory. Third, Raman scattering shows anomalous temperature dependence of the phonon linewidths which fits an empirical model based on phonon-electron coupling. We discuss structural factors, such as chiral symmetry, short metallic bonds, and a low-symmetry coordination environment as potential sources of coupled electron-phonon liquids.


title: Private Stochastic Convex Optimization: Optimal Rates in $\ell_1$ Geometry

abstract: Stochastic convex optimization over an $\ell_1$-bounded domain is ubiquitous in machine learning applications such as LASSO but remains poorly understood when learning with differential privacy. We show that, up to logarithmic factors the optimal excess population loss of any $(\varepsilon,\delta)$-differentially private optimizer is $\sqrt{\log(d)/n} + \sqrt{d}/\varepsilon n.$ The upper bound is based on a new algorithm that combines the iterative localization approach of~\citet{FeldmanKoTa20} with a new analysis of private regularized mirror descent. It applies to $\ell_p$ bounded domains for $p\in [1,2]$ and queries at most $n^{3/2}$ gradients improving over the best previously known algorithm for the $\ell_2$ case which needs $n^2$ gradients. Further, we show that when the loss functions satisfy additional smoothness assumptions, the excess loss is upper bounded (up to logarithmic factors) by $\sqrt{\log(d)/n} + (\log(d)/\varepsilon n)^{2/3}.$ This bound is achieved by a new variance-reduced version of the Frank-Wolfe algorithm that requires just a single pass over the data. We also show that the lower bound in this case is the minimum of the two rates mentioned above.


title: Invariant bilinear forms under the rigid motions of a regular polygon

abstract: In this paper, for n a positve integer, we compute the number of n degree representations for a dihedral group G of order 2m, m \geq 3 and the dimensions of the corresponding spaces of G invariant bilinear forms over a complex field C. We explicitly discuss about the existence of a non-degenerate invariant bilinear form. The results are important due to their applications in the studies of physical sciences.


title: Natural interaction with traffic control cameras through multimodal interfaces

abstract: Human-Computer Interfaces have always played a fundamental role in usability and commands' interpretability of the modern software systems. With the explosion of the Artificial Intelligence concept, such interfaces have begun to fill the gap between the user and the system itself, further evolving in Adaptive User Interfaces (AUI). Meta Interfaces are a further step towards the user, and they aim at supporting the human activities in an ambient interactive space; in such a way, the user can control the surrounding space and interact with it. This work aims at proposing a meta user interface that exploits the Put That There paradigm to enable the user to fast interaction by employing natural language and gestures. The application scenario is a video surveillance control room, in which the speed of actions and reactions is fundamental for urban safety and driver and pedestrian security. The interaction is oriented towards three environments: the first is the control room itself, in which the operator can organize the views of the monitors related to the cameras on site by vocal commands and gestures, as well as conveying the audio on the headset or in the speakers of the room. The second one is related to the control of the video, in order to go back and forth to a particular scene showing specific events, or zoom in/out a particular camera; the third allows the operator to send rescue vehicle in a particular street, in case of need. The gestures data are acquired through a Microsoft Kinect 2 which captures pointing and gestures allowing the user to interact multimodally thus increasing the naturalness of the interaction; the related module maps the movement information to a particular instruction, also supported by vocal commands which enable its execution. (cont...)


title: Hessian Eigenspectra of More Realistic Nonlinear Models

abstract: Given an optimization problem, the Hessian matrix and its eigenspectrum can be used in many ways, ranging from designing more efficient second-order algorithms to performing model analysis and regression diagnostics. When nonlinear models and non-convex problems are considered, strong simplifying assumptions are often made to make Hessian spectral analysis more tractable. This leads to the question of how relevant the conclusions of such analyses are for more realistic nonlinear models. In this paper, we exploit deterministic equivalent techniques from random matrix theory to make a \emph{precise} characterization of the Hessian eigenspectra for a broad family of nonlinear models, including models that generalize the classical generalized linear models, without relying on strong simplifying assumptions used previously. We show that, depending on the data properties, the nonlinear response model, and the loss function, the Hessian can have \emph{qualitatively} different spectral behaviors: of bounded or unbounded support, with single- or multi-bulk, and with isolated eigenvalues on the left- or right-hand side of the bulk. By focusing on such a simple but nontrivial nonlinear model, our analysis takes a step forward to unveil the theoretical origin of many visually striking features observed in more complex machine learning models.


title: When Age-Invariant Face Recognition Meets Face Age Synthesis: A Multi-Task Learning Framework

abstract: To minimize the effects of age variation in face recognition, previous work either extracts identity-related discriminative features by minimizing the correlation between identity- and age-related features, called age-invariant face recognition (AIFR), or removes age variation by transforming the faces of different age groups into the same age group, called face age synthesis (FAS); however, the former lacks visual results for model interpretation while the latter suffers from artifacts compromising downstream recognition. Therefore, this paper proposes a unified, multi-task framework to jointly handle these two tasks, termed MTLFace, which can learn age-invariant identity-related representation while achieving pleasing face synthesis. Specifically, we first decompose the mixed face feature into two uncorrelated components -- identity- and age-related feature -- through an attention mechanism, and then decorrelate these two components using multi-task training and continuous domain adaption. In contrast to the conventional one-hot encoding that achieves group-level FAS, we propose a novel identity conditional module to achieve identity-level FAS, with a weight-sharing strategy to improve the age smoothness of synthesized faces. In addition, we collect and release a large cross-age face dataset with age and gender annotations to advance the development of the AIFR and FAS. Extensive experiments on five benchmark cross-age datasets demonstrate the superior performance of our proposed MTLFace over existing state-of-the-art methods for AIFR and FAS. We further validate MTLFace on two popular general face recognition datasets, showing competitive performance for face recognition in the wild. The source code and dataset are available at~\url{https://github.com/Hzzone/MTLFace}.


title: On the Memory Mechanism of Tensor-Power Recurrent Models

abstract: Tensor-power (TP) recurrent model is a family of non-linear dynamical systems, of which the recurrence relation consists of a p-fold (a.k.a., degree-p) tensor product. Despite such the model frequently appears in the advanced recurrent neural networks (RNNs), to this date there is limited study on its memory property, a critical characteristic in sequence tasks. In this work, we conduct a thorough investigation of the memory mechanism of TP recurrent models. Theoretically, we prove that a large degree p is an essential condition to achieve the long memory effect, yet it would lead to unstable dynamical behaviors. Empirically, we tackle this issue by extending the degree p from discrete to a differentiable domain, such that it is efficiently learnable from a variety of datasets. Taken together, the new model is expected to benefit from the long memory effect in a stable manner. We experimentally show that the proposed model achieves competitive performance compared to various advanced RNNs in both the single-cell and seq2seq architectures.


title: Dynamical Evolution of Voids with Surrounding Gravitational Tidal Field

abstract: The void ellipticity distribution today can be well explained by the tidal field. Going a step further from the overall distribution, we investigate individuality on the tidal response of void shape in non-linear dynamical evolution. We perform an N-body simulation and trace individual voids using particle ID. The voids are defined based on Voronoi tessellation and watershed algorithm, using public code VIDE. A positive correlation is found between the time variation of void ellipticity and tidal field around a void if the void maintains its constituent particles. Such voids tend to have smaller mass densities. Conversely, not a few voids significantly deform by particle exchange, rather than the tidal field. Those voids may prevent us from correctly proving a quadrupole field of gravity out of a void shape.


title: Thermal stress around a smooth cavity in a plate subjected to uniform heat flux

abstract: The two-dimensional thermoelastic problem of an adiabatic cavity in an infinite isotropic homogeneous medium subjected to uniform heat flux is studied, where the shape of the cavity is characterized by the Laurent polynomial. By virtue of a novel tactics, the obtained K-M potentials can be explicitly worked out to satisfy the boundary conditions precisely, and the possible translation of the cavity is also available. The new and explicit analytical solutions are compared with the those reported in literature and some serious problems are found and corrected. Finally, some discussions on the thermal stress concentration around the tips of three typical cavities are provided.


title: Feature-Align Network with Knowledge Distillation for Efficient Denoising

abstract: We propose an efficient neural network for RAW image denoising. Although neural network-based denoising has been extensively studied for image restoration, little attention has been given to efficient denoising for compute limited and power sensitive devices, such as smartphones and smartwatches. In this paper, we present a novel architecture and a suite of training techniques for high quality denoising in mobile devices. Our work is distinguished by three main contributions. (1) Feature-Align layer that modulates the activations of an encoder-decoder architecture with the input noisy images. The auto modulation layer enforces attention to spatially varying noise that tend to be "washed away" by successive application of convolutions and non-linearity. (2) A novel Feature Matching Loss that allows knowledge distillation from large denoising networks in the form of a perceptual content loss. (3) Empirical analysis of our efficient model trained to specialize on different noise subranges. This opens additional avenue for model size reduction by sacrificing memory for compute. Extensive experimental validation shows that our efficient model produces high quality denoising results that compete with state-of-the-art large networks, while using significantly fewer parameters and MACs. On the Darmstadt Noise Dataset benchmark, we achieve a PSNR of 48.28dB, while using 263 times fewer MACs, and 17.6 times fewer parameters than the state-of-the-art network, which achieves 49.12dB.


title: On minimal generating sets for the mapping class group of a punctured surface

abstract: Let $\Sigma_{g,p}$ be a oriented connected surface of genus $g$ with $p$ punctures. We denote by $\mathcal{M}_{g,p}$ and $\mathcal{M}_{g,p}^\pm$ the mapping class group and the extended mapping class group of $\Sigma_{g,p}$, respectively. In this paper, we show that $\mathcal{M}_{g,p}$ and $\mathcal{M}_{g,p}^\pm$ are generated by two element for $g\geq 3$ and $p\geq 0$.


title: Laplacian-P-splines for Bayesian inference in the mixture cure model

abstract: The mixture cure model for analyzing survival data is characterized by the assumption that the population under study is divided into a group of subjects who will experience the event of interest over some finite time horizon and another group of cured subjects who will never experience the event irrespective of the duration of follow-up. When using the Bayesian paradigm for inference in survival models with a cure fraction, it is common practice to rely on Markov chain Monte Carlo (MCMC) methods to sample from posterior distributions. Although computationally feasible, the iterative nature of MCMC often implies long sampling times to explore the target space with chains that may suffer from slow convergence and poor mixing. An alternative strategy for fast and flexible sampling-free Bayesian inference in the mixture cure model is suggested in this paper by combining Laplace approximations and penalized B-splines. A logistic regression model is assumed for the cure proportion and a Cox proportional hazards model with a P-spline approximated baseline hazard is used to specify the conditional survival function of susceptible subjects. Laplace approximations to the conditional latent vector are based on analytical formulas for the gradient and Hessian of the log-likelihood, resulting in a substantial speed-up in approximating posterior distributions. The statistical performance and computational efficiency of the proposed Laplacian-P-splines mixture cure (LPSMC) model is assessed in a simulation study. Results show that LPSMC is an appealing alternative to classic MCMC for approximate Bayesian inference in standard mixture cure models. Finally, the novel LPSMC approach is illustrated on three applications involving real survival data.


title: ActiveGuard: An Active DNN IP Protection Technique via Adversarial Examples

abstract: The training of Deep Neural Networks (DNN) is costly, thus DNN can be considered as the intellectual properties (IP) of model owners. To date, most of the existing protection works focus on verifying the ownership after the DNN model is stolen, which cannot resist piracy in advance. To this end, we propose an active DNN IP protection method based on adversarial examples against DNN piracy, named ActiveGuard. ActiveGuard aims to achieve authorization control and users' fingerprints management through adversarial examples, and can provide ownership verification. Specifically, ActiveGuard exploits the elaborate adversarial examples as users' fingerprints to distinguish authorized users from unauthorized users. Legitimate users can enter fingerprints into DNN for identity authentication and authorized usage, while unauthorized users will obtain poor model performance due to an additional control layer. In addition, ActiveGuard enables the model owner to embed a watermark into the weights of DNN. When the DNN is illegally pirated, the model owner can extract the embedded watermark and perform ownership verification. Experimental results show that, for authorized users, the test accuracy of LeNet-5 and Wide Residual Network (WRN) models are 99.15% and 91.46%, respectively, while for unauthorized users, the test accuracy of the two DNNs are only 8.92% (LeNet-5) and 10% (WRN), respectively. Besides, each authorized user can pass the fingerprint authentication with a high success rate (up to 100%). For ownership verification, the embedded watermark can be successfully extracted, while the normal performance of the DNN model will not be affected. Further, ActiveGuard is demonstrated to be robust against fingerprint forgery attack, model fine-tuning attack and pruning attack.


title: Nested Vehicle Routing Problem: Optimizing Drone-Truck Surveillance Operations

abstract: Unmanned aerial vehicles or drones are becoming increasingly popular due to their low cost and high mobility. In this paper we address the routing and coordination of a drone-truck pairing where the drone travels to multiple locations to perform specified observation tasks and rendezvous periodically with the truck to swap its batteries. We refer to this as the Nested-Vehicle Routing Problem (Nested-VRP) and develop a Mixed Integer Quadratically Constrained Programming (MIQCP) formulation with critical operational constraints, including drone battery capacity and synchronization of both vehicles during scheduled rendezvous. An enhancement of the MIQCP model for the Nested-VRP is achieved by deriving the equivalent Mixed Integer Linear Programming (MILP) formulation as well as leveraging lifting and Reformulation-Linearization techniques to strengthen the subtour elimination constraints of the drone. Given the NP-hard nature of the Nested-VRP, we further propose an efficient neighborhood search (NS) heuristic where we generate and improve on a good initial solution by iteratively solving the Nested-VRP on a local scale. We provide comparisons of both the exact approaches based on MIQCP or its enhanced formulations and NS heuristic methods with a relaxation lower bound in the cases of small and large problem sizes, and present the results of a computational study to show the effectiveness of the MIQCP model and its variants as well as the efficiency of the NS heuristic, including for a real-life instance with 631 locations. We envision that this framework will facilitate the planning and operations of combined drone-truck missions.


title: Coupling Stokes flow with inhomogeneous poroelasticity

abstract: We investigate the behaviour of flux-driven flow through a single-phase fluid domain coupled to a biphasic poroelastic domain. The fluid domain consists of an incompressible Newtonian viscous fluid while the poroelastic domain consists of a linearly elastic solid filled with the same viscous fluid. The material properties of the poroelastic domain, i.e. permeability and elastic parameters, depend on the inhomogeneous initial porosity field. We identify the dimensionless parameters governing the behaviour of the coupled problem: the ratio between the magnitudes of the driving velocity and the Darcy flows in the poroelastic domain, and the ratio between the viscous pressure scale and the size of the elastic stresses in the poroelastic domain. We consider a perfusion system, where flow is forced to pass from the single-phase fluid to the biphasic poroelastic domain. We focus on a simplified two dimensional geometry with small aspect ratio, and perform an asymptotic analysis to derive analytical solutions. The slender geometry is divided in four regions, two outer domains that describe the regions away from the interface and two inner domains that are the regions across the interface. Our analysis advances the quantitative understanding of the role of heterogeneous material properties of a poroelastic domain on its mechanical response when coupled with a fluid domain. The analysis reveals that, in the interfacial zone, the fluid and the elastic behaviours of this coupled Stokes - poroelastic problem can be treated separately via (i) a Stokes - Darcy coupling and (ii) the solid skeleton being stress free.


title: A Pose-only Solution to Visual Reconstruction and Navigation

abstract: Visual navigation and three-dimensional (3D) scene reconstruction are essential for robotics to interact with the surrounding environment. Large-scale scenes and critical camera motions are great challenges facing the research community to achieve this goal. We raised a pose-only imaging geometry framework and algorithms that can help solve these challenges. The representation is a linear function of camera global translations, which allows for efficient and robust camera motion estimation. As a result, the spatial feature coordinates can be analytically reconstructed and do not require nonlinear optimization. Experiments demonstrate that the computational efficiency of recovering the scene and associated camera poses is significantly improved by 2-4 orders of magnitude. This solution might be promising to unlock real-time 3D visual computing in many forefront applications.


title: Intelligent Spectrum Learning for Wireless Networks with Reconfigurable Intelligent Surfaces

abstract: Reconfigurable intelligent surface (RIS) has become a promising technology for enhancing the reliability of wireless communications, which is capable of reflecting the desired signals through appropriate phase shifts. However, the intended signals that impinge upon an RIS are often mixed with interfering signals, which are usually dynamic and unknown. In particular, the received signal-to-interference-plus-noise ratio (SINR) may be degraded by the signals reflected from the RISs that originate from non-intended users. To tackle this issue, we introduce the concept of intelligent spectrum learning (ISL), which uses an appropriately trained convolutional neural network (CNN) at the RIS controller to help the RISs infer the interfering signals directly from the incident signals. By capitalizing on the ISL, a distributed control algorithm is proposed to maximize the received SINR by dynamically configuring the active/inactive binary status of the RIS elements. Simulation results validate the performance improvement offered by deep learning and demonstrate the superiority of the proposed ISL-aided approach.


title: Fast matrix-free methods for model-based personalized synthetic MR imaging

abstract: Synthetic Magnetic Resonance (MR) imaging predicts images at new design parameter settings from a few observed MR scans. Model-based methods, that use both the physical and statistical properties underlying the MR signal and its acquisition, can predict images at any setting from as few as three scans, allowing it to be used in individualized patient- and anatomy-specific contexts. However, the estimation problem in model-based synthetic MR imaging is ill-posed and so regularization, in the form of correlated Gaussian Markov Random Fields, is imposed on the voxel-wise spin-lattice relaxation time, spin-spin relaxation time and the proton density underlying the MR image. We develop theoretically sound but computationally practical matrix-free estimation methods for synthetic MR imaging. Our evaluations demonstrate superior performance of our methods in currently-used clinical settings when compared to existing model-based and deep learning methods. Moreover, unlike deep learning approaches, our fast methodology can synthesize needed images during patient visits, with good estimation and prediction accuracy and consistency. An added strength of our model-based approach, also developed and illustrated here, is the accurate estimation of standard errors of regional contrasts in the synthesized images. A R package $symr$ implements our methodology.


title: Explicit Construction of Minimum Bandwidth Rack-Aware Regenerating Codes

abstract: In large data centers, storage nodes are organized in racks, and the cross-rack transmission dominates the bandwidth cost. For the repair of single node failures, codes achieving the tradeoff between the storage redundancy and cross-rack repair bandwidth are called rack-aware regenerating codes (RRCs). In this work, we give the first explicit construction of RRCs with the minimum repair bandwidth (i.e., the cross-rack bandwidth equals the storage size per node). Our construction applies to all admissible parameters and has the lowest sub-packetization level. Moreover, the underlying finite fields are of size comparable to the number of storage nodes, which makes our codes more implementable in practice. Finally, for the convenience of practical use, we also establish a transformation to convert our codes into systematic codes.


title: Towards Efficiently Diversifying Dialogue Generation via Embedding Augmentation

abstract: Dialogue generation models face the challenge of producing generic and repetitive responses. Unlike previous augmentation methods that mostly focus on token manipulation and ignore the essential variety within a single sample using hard labels, we propose to promote the generation diversity of the neural dialogue models via soft embedding augmentation along with soft labels in this paper. Particularly, we select some key input tokens and fuse their embeddings together with embeddings from their semantic-neighbor tokens. The new embeddings serve as the input of the model to replace the original one. Besides, soft labels are used in loss calculation, resulting in multi-target supervision for a given input. Our experimental results on two datasets illustrate that our proposed method is capable of generating more diverse responses than raw models while remains a similar n-gram accuracy that ensures the quality of generated responses.


title: Benchmarking quantum tomography completeness and fidelity with machine learning

abstract: We train convolutional neural networks to predict whether or not a set of measurements is informationally complete to uniquely reconstruct any given quantum state with no prior information. In addition, we perform fidelity benchmarking based on this measurement set without explicitly carrying out state tomography. The networks are trained to recognize the fidelity and a reliable measure for informational completeness. By gradually accumulating measurements and data, these trained convolutional networks can efficiently establish a compressive quantum-state characterization scheme by accelerating runtime computation and greatly reducing systematic drifts in experiments. We confirm the potential of this machine-learning approach by presenting experimental results for both spatial-mode and multiphoton systems of large dimensions. These predictions are further shown to improve when the networks are trained with additional bootstrapped training sets from real experimental data. Using a realistic beam-profile displacement error model for Hermite-Gaussian sources, we further demonstrate numerically that the orders-of-magnitude reduction in certification time with trained networks greatly increases the computation yield of a large-scale quantum processor using these sources, before state fidelity deteriorates significantly.


title: Concepts for future missions to search for technosignatures

abstract: New and unique opportunities now exist to look for technosignatures (TS) beyond traditional SETI radio searches, motivated by tremendous advances in exoplanet science and observing capabilities in recent years. Space agencies, both public and private, may be particularly interested in learning about the community's views as to the optimal methods for future TS searches with current or forthcoming technology. This report is an effort in that direction. We put forward a set of possible mission concepts designed to search for TS, although the data supplied by such missions would also benefit other areas of astrophysics. We introduce a novel framework to analyze a broad diversity of TS in a quantitative manner. This framework is based on the concept of ichnoscale, which is a new parameter related to the scale of a TS cosmic footprint, together with the number of potential targets where such TS can be searched for, and whether or not it is continuous in time.


title: Few-shot Open-set Recognition by Transformation Consistency

abstract: In this paper, we attack a few-shot open-set recognition (FSOSR) problem, which is a combination of few-shot learning (FSL) and open-set recognition (OSR). It aims to quickly adapt a model to a given small set of labeled samples while rejecting unseen class samples. Since OSR requires rich data and FSL considers closed-set classification, existing OSR and FSL methods show poor performances in solving FSOSR problems. The previous FSOSR method follows the pseudo-unseen class sample-based methods, which collect pseudo-unseen samples from the other dataset or synthesize samples to model unseen class representations. However, this approach is heavily dependent on the composition of the pseudo samples. In this paper, we propose a novel unknown class sample detector, named SnaTCHer, that does not require pseudo-unseen samples. Based on the transformation consistency, our method measures the difference between the transformed prototypes and a modified prototype set. The modified set is composed by replacing a query feature and its predicted class prototype. SnaTCHer rejects samples with large differences to the transformed prototypes. Our method alters the unseen class distribution estimation problem to a relative feature transformation problem, independent of pseudo-unseen class samples. We investigate our SnaTCHer with various prototype transformation methods and observe that our method consistently improves unseen class sample detection performance without closed-set classification reduction.


title: Memory Reclamation for Recoverable Mutual Exclusion

abstract: Mutual exclusion (ME) is a commonly used technique to handle conflicts in concurrent systems. With recent advancements in non-volatile memory technology, there is an increased focus on the problem of recoverable mutual exclusion (RME), a special case of ME where processes can fail and recover. However, in order to ensure that the problem of RME is also of practical interest, and not just a theoretical one, memory reclamation poses as a major obstacle in several RME algorithms. Often RME algorithms need to allocate memory dynamically, which increases the memory footprint of the algorithm over time. These algorithms are typically not equipped with suitable garbage collection due to concurrency and failures. In this work, we present the first "general" recoverable algorithm for memory reclamation in the context of recoverable mutual exclusion. Our algorithm can be plugged into any RME algorithm very easily and preserves all correctness property and most desirable properties of the algorithm. The space overhead of our algorithm is $\mathcal{O}(n^2 * sizeof(node)\ )$, where $n$ is the total number of processes in the system. In terms of remote memory references (RMRs), our algorithm is RMR-optimal, i.e, it has a constant RMR overhead per passage. Our RMR and space complexities are applicable to both $CC$ and $DSM$ memory models.


title: Finite-size scaling analysis of eigenstate thermalization

abstract: We study the fluctuations of eigenstate expectation values in a microcanonical ensemble. Assuming the eigenstate thermalization hypothesis, an analytical formula for the finite-size scaling of the fluctuations is derived. The same problem was studied by Beugeling et al. [Phys. Rev. E 89, 042112 (2014)]. We compare our results with theirs.


title: Star Chromatic Index of Halin Graphs

abstract: A star edge coloring of a graph $G$ is a proper edge coloring of $G$ such that every path and cycle of length four in $G$ uses at least three different colors. The star chromatic index of $G$, is the smallest integer $k$ for which $G$ admits a star edge coloring with $k$ colors. In this paper, we obtain tight upper bound $\left\lfloor\frac{3\Delta}{2}\right\rfloor+2$ for the star chromatic index of every Halin graph, that proves the conjecture of Dvo{\v{r}}{\'a}k et al. (J Graph Theory, 72 (2013), 313--326) for cubic Halin graphs.


title: The success probability in Lionel Levine's hat problem is strictly decreasing with the number of players, and this is related to interesting questions regarding Hamming powers of Kneser graphs and independent sets in random subgraphs

abstract: Lionel Levine's hat challenge has $t$ players, each with a (very large, or infinite) stack of hats on their head, each hat independently colored at random black or white. The players are allowed to coordinate before the random colors are chosen, but not after. Each player sees all hats except for those on her own head. They then proceed to simultaneously try and each pick a black hat from their respective stacks. They are proclaimed successful only if they are all correct. Levine's conjecture was the success probability tends to zero when the number of players grows. We prove that this success probability is strictly decreasing in the number of players, and present some connections to questions in graph theory.


title: TransTailor: Pruning the Pre-trained Model for Improved Transfer Learning

abstract: The increasing of pre-trained models has significantly facilitated the performance on limited data tasks with transfer learning. However, progress on transfer learning mainly focuses on optimizing the weights of pre-trained models, which ignores the structure mismatch between the model and the target task. This paper aims to improve the transfer performance from another angle - in addition to tuning the weights, we tune the structure of pre-trained models, in order to better match the target task. To this end, we propose TransTailor, targeting at pruning the pre-trained model for improved transfer learning. Different from traditional pruning pipelines, we prune and fine-tune the pre-trained model according to the target-aware weight importance, generating an optimal sub-model tailored for a specific target task. In this way, we transfer a more suitable sub-structure that can be applied during fine-tuning to benefit the final performance. Extensive experiments on multiple pre-trained models and datasets demonstrate that TransTailor outperforms the traditional pruning methods and achieves competitive or even better performance than other state-of-the-art transfer learning methods while using a smaller model. Notably, on the Stanford Dogs dataset, TransTailor can achieve 2.7% accuracy improvement over other transfer methods with 20% fewer FLOPs.


title: On chromatic symmetric homology and planarity of graphs

abstract: Sazdanovic and Yip defined a categorification of Stanley's chromatic function called the chromatic symmetric homology. In this paper we prove that (as conjectured by Chandler, Sazdanovic, Stella and Yip), if a graph $G$ is non-planar, then its chromatic symmetric homology in bidegree (1,0) contains $\mathbb{Z}_2$-torsion. Our proof follows a recursive argument based on Kuratowsky's theorem.


title: An End-to-End Network for Emotion-Cause Pair Extraction

abstract: The task of Emotion-Cause Pair Extraction (ECPE) aims to extract all potential clause-pairs of emotions and their corresponding causes in a document. Unlike the more well-studied task of Emotion Cause Extraction (ECE), ECPE does not require the emotion clauses to be provided as annotations. Previous works on ECPE have either followed a multi-stage approach where emotion extraction, cause extraction, and pairing are done independently or use complex architectures to resolve its limitations. In this paper, we propose an end-to-end model for the ECPE task. Due to the unavailability of an English language ECPE corpus, we adapt the NTCIR-13 ECE corpus and establish a baseline for the ECPE task on this dataset. On this dataset, the proposed method produces significant performance improvements (~6.5 increase in F1 score) over the multi-stage approach and achieves comparable performance to the state-of-the-art methods.


title: Quantum entanglement in the anisotropic Heisenberg model with multicomponent DM and KSEA interactions

abstract: Using group-theoretical approach we found a family of four nine-parameter quantum states for the two-spin-1/2 Heisenberg system in an external magnetic field and with multiple components of Dzyaloshinsky-Moriya (DM) and Kaplan-Shekhtman-Entin-Wohlman-Aharony (KSEA) interactions. Exact analytical formulas are derived for the entanglement of formation for the quantum states found. The influence of DM and KSEA interactions on the behavior of entanglement and on the shape of disentangled region is studied. A connection between the two-qubit quantum states and the reduced density matrices of many-particle systems is discussed.


title: Real Masks and Spoof Faces: On the Masked Face Presentation Attack Detection

abstract: Face masks have become one of the main methods for reducing the transmission of COVID-19. This makes face recognition (FR) a challenging task because masks hide several discriminative features of faces. Moreover, face presentation attack detection (PAD) is crucial to ensure the security of FR systems. In contrast to the growing number of masked FR studies, the impact of face masked attacks on PAD has not been explored. Therefore, we present novel attacks with real face masks placed on presentations and attacks with subjects wearing masks to reflect the current real-world situation. Furthermore, this study investigates the effect of masked attacks on PAD performance by using seven state-of-the-art PAD algorithms under different experimental settings. We also evaluate the vulnerability of FR systems to masked attacks. The experiments show that real masked attacks pose a serious threat to the operation and security of FR systems.


title: Tachyonic and Plasma Instabilities of $\eta$-Pairing States Coupled to Electromagnetic Fields

abstract: Cooper pairs featuring a nonzero center-of-mass crystal momentum ${\boldsymbol Q}=(\pi,\pi, \dots)$ and an off-diagonal long-range order ($\eta$-pairing states) constitute exact eigenstates of a Hubbard model [C. N. Yang, Phys. Rev. Lett. 63, 2144 (1989)]. Here we show that the $\eta$-pairing states are rendered dynamically unstable via coupling to dynamical electromagnetic fields. The instability is caused by "tachyonic" electromagnetic fields and unstable plasma modes for attractive and repulsive interactions, respectively. The typical time scale of the growth of the instability is of the order of femtoseconds for electron systems in solids, which places a strict bound on the lifetime of the $\eta$-pairing states. The decay of the $\eta$-pairing states leads to enhanced light emission with frequencies shifted from the Hubbard interaction strength for the repulsive case and unattenuated electromagnetic penetration for the attractive case.


title: PFA: Privacy-preserving Federated Adaptation for Effective Model Personalization

abstract: Federated learning (FL) has become a prevalent distributed machine learning paradigm with improved privacy. After learning, the resulting federated model should be further personalized to each different client. While several methods have been proposed to achieve personalization, they are typically limited to a single local device, which may incur bias or overfitting since data in a single device is extremely limited. In this paper, we attempt to realize personalization beyond a single client. The motivation is that during FL, there may exist many clients with similar data distribution, and thus the personalization performance could be significantly boosted if these similar clients can cooperate with each other. Inspired by this, this paper introduces a new concept called federated adaptation, targeting at adapting the trained model in a federated manner to achieve better personalization results. However, the key challenge for federated adaptation is that we could not outsource any raw data from the client during adaptation, due to privacy concerns. In this paper, we propose PFA, a framework to accomplish Privacy-preserving Federated Adaptation. PFA leverages the sparsity property of neural networks to generate privacy-preserving representations and uses them to efficiently identify clients with similar data distributions. Based on the grouping results, PFA conducts an FL process in a group-wise way on the federated model to accomplish the adaptation. For evaluation, we manually construct several practical FL datasets based on public datasets in order to simulate both the class-imbalance and background-difference conditions. Extensive experiments on these datasets and popular model architectures demonstrate the effectiveness of PFA, outperforming other state-of-the-art methods by a large margin while ensuring user privacy. We will release our code at: https://github.com/lebyni/PFA.


title: Anti-self-dual connections over the $5$D Heisenberg group and the twistor method

abstract: In this paper, we introduce notions of $\alpha$-planes in $5$D complex Heisenberg group and the twistor space as the moduli space of all $\alpha$-planes. So we can define an anti-self-dual (ASD) connection as a connection flat over all $\alpha$-planes. This geometric approach allows us to establish Penrose-Ward correspondence between ASD connections over $5$D complex Heisenberg group and a class of holomorphic vector bundles on the twistor space. By Atiyah-Ward ans\"{a}tz, we also construct a family of ASD connections on $5$D complex Heisenberg group. When restricted to $5$D real Heisenberg group, the flat model of $5$D contact manifolds, an ASD connection satisfies the horizontal part of the contact instanton equation introduced by physicists.