title: FLAME: Differentially Private Federated Learning in the Shuffle Model

abstract: Federated Learning (FL) is a promising machine learning paradigm that enables the analyzer to train a model without collecting users' raw data. To ensure users' privacy, differentially private federated learning has been intensively studied. The existing works are mainly based on the \textit{curator model} or \textit{local model} of differential privacy. However, both of them have pros and cons. The curator model allows greater accuracy but requires a trusted analyzer. In the local model where users randomize local data before sending them to the analyzer, a trusted analyzer is not required but the accuracy is limited. In this work, by leveraging the \textit{privacy amplification} effect in the recently proposed shuffle model of differential privacy, we achieve the best of two worlds, i.e., accuracy in the curator model and strong privacy without relying on any trusted party. We first propose an FL framework in the shuffle model and a simple protocol (SS-Simple) extended from existing work. We find that SS-Simple only provides an insufficient privacy amplification effect in FL since the dimension of the model parameter is quite large. To solve this challenge, we propose an enhanced protocol (SS-Double) to increase the privacy amplification effect by subsampling. Furthermore, for boosting the utility when the model size is greater than the user population, we propose an advanced protocol (SS-Topk) with gradient sparsification techniques. We also provide theoretical analysis and numerical evaluations of the privacy amplification of the proposed protocols. Experiments on real-world dataset validate that SS-Topk improves the testing accuracy by 60.7\% than the local model based FL.


title: Utterance-level Intent Recognition from Keywords

abstract: This paper focuses on wake on intent (WOI) techniques for platforms with limited compute and memory. Our approach of utterance-level intent classification is based on a sequence of keywords in the utterance instead of a single fixed key phrase. The keyword sequence is transformed into four types of input features, namely acoustics, phones, word2vec and speech2vec for individual intent learning and then fused decision making. If a wake intent is detected, it will trigger the power-costly ASR afterwards. The system is trained and tested on a newly collected internal dataset in Intel called AMIE, which will be reported in this paper for the first time. It is demonstrated that our novel technique with the representation of the key-phrases successfully achieved a noise robust intent classification in different domains including in-car human-machine communications. The wake on intent system will be low-power and low-complexity, which makes it suitable for always on operations in real life hardware-based applications.


title: Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning

abstract: Pre-trained large-scale language models have increasingly demonstrated high accuracy on many natural language processing (NLP) tasks. However, the limited weight storage and computational speed on hardware platforms have impeded the popularity of pre-trained models, especially in the era of edge computing. In this work, we propose an efficient transformer-based large-scale language representation using hardware-friendly block structure pruning. We incorporate the reweighted group Lasso into block-structured pruning for optimization. Besides the significantly reduced weight storage and computation, the proposed approach achieves high compression rates. Experimental results on different models (BERT, RoBERTa, and DistilBERT) on the General Language Understanding Evaluation (GLUE) benchmark tasks show that we achieve up to 5.0x with zero or minor accuracy degradation on certain task(s). Our proposed method is also orthogonal to existing compact pre-trained language models such as DistilBERT using knowledge distillation, since a further 1.79x average compression rate can be achieved on top of DistilBERT with zero or minor accuracy degradation. It is suitable to deploy the final compressed model on resource-constrained edge devices.


title: Unicity on entire function concerning its differential-difference operators

abstract: In this paper, we study the uniqueness of the differential-difference polynomials of entire functions on $\mathbb{C}^{n}$. We prove the following result: Let $f(z)$ be a transcendental entire function on $\mathbb{C}^{n}$ of hyper-order less than $1$ and $g(z)=b_{-1}+\sum_{i=0}^{n}b_{i}f^{(k_{i})}(z+\eta_{i})$, where $b_{-1}$ and $b_{i} (i=0\ldots,n)$ are small meromorphic functions of $f$ on $\mathbb{C}^{n}$, $k_{i}\geq0 (i=0\ldots,n)$ are integers, and $\eta_{i} (i=0\ldots,n)$ are finite values. Let $a_{1}(z)\not\equiv\infty, a_{2}(z)\not\equiv\infty$ be two distinct small meromorphic functions of $f(z)$ on $\mathbb{C}^{n}$. If $f(z)$ and $g(z)$ share $a_{1}(z)$ CM, and $a_{2}(z)$ IM. Then either $f(z)\equiv g(z)$ or $a_{1}=2a_{2}=2$, $$f(z)\equiv e^{2p}-2e^{p}+2,$$ and $$g(z)\equiv e^{p},$$ where $p(z)$ is a non-constant entire function on $\mathbb{C}^{n}$. Especially, in the case of $g(z)=(\Delta_{\eta}^{n}f(z))^{k}$, we obtain $f(z)\equiv (\Delta_{\eta}^{n}f(z))^{k}$.


title: Uniqueness of Meromorphic Functions With Respect To Their Shifts Concerning Derivatives

abstract: An example in the article shows that the first derivative of $f(z)=\frac{2}{1-e^{-2z}}$ sharing $0$ CM and $1,\infty$ IM with its shift $\pi i$ cannot obtain they are equal. In this paper, we study the uniqueness of meromorphic function sharing small functions with their shifts concerning its $k-th$ derivatives. We use a different method from Qi and Yang \cite {qy} to improves entire function to meromorphic function, the first derivative to the $k-th$ derivatives, and also finite values to small functions. As for $k=0$, we obtain: Let $f(z)$ be a transcendental meromorphic function of $\rho_{2}(f)<1$, let $c$ be a nonzero finite value, and let $a(z)\not\equiv\infty, b(z)\not\equiv\infty\in \hat{S}(f)$ be two distinct small functions of $f(z)$ such that $a(z)$ is a periodic function with period $c$ and $b(z)$ is any small function of $f(z)$. If $f(z)$ and $f(z+c)$ share $a(z),\infty$ CM, and share $b(z)$ IM, then either $f(z)\equiv f(z+c)$ or $$e^{p(z)}\equiv \frac{f(z+c)-a(z+c)}{f(z)-a(z)}\equiv \frac{b(z+c)-a(z+c)}{b(z)-a(z)},$$ where $p(z)$ is a non-constant entire function of $\rho(p)<1$ such that $e^{p(z+c)}\equiv e^{p(z)}$.


title: MAMMOTH: Confirmation of Two Massive Galaxy Overdensities at $z=2.24$ with H$\alpha$ Emitters

abstract: Massive galaxy overdensities at the peak epoch of cosmic star formation provide ideal testbeds for the formation theories of galaxies and large-scale structure. We report the confirmation of two massive galaxy overdensities at $z=2.24$, BOSS1244 and BOSS1542, selected from the MAMMOTH project using Ly$\alpha$ absorption from the intergalactic medium over the scales of 15$-$30 $h^{-1}$ Mpc imprinted on the quasar spectra. We use H$\alpha$ emitters (HAEs) as the density tracer and identify them using deep narrowband $H_2S1$ and broadband $K_{\rm s}$ imaging data obtained with CFHT/WIRCam. In total, 244 and 223 line emitters are detected in these two fields, and $196\pm 2$ and $175\pm 2$ are expected to be HAEs with an H$\alpha$ flux of $> 2.5\times 10^{-17}$ erg s$^{-1}$ cm$^{-2}$ (corresponding to an SFR of $>$5 M$_\odot$ yr$^{-1}$). The detection rate of HAE candidates suggests an overdensity factor of $\delta_{\rm gal}=5.6\pm0.3$ and $4.9\pm0.3$ over the volume of $54\times32\times32$ cMpc$^3$. The overdensity factor increases $2-3$ times when focusing on the high-density regions of scales $10-15$ cMpc. Interestingly, the HAE density maps reveal that BOSS1244 contains a dominant structure, while BOSS1542 manifests as a giant filamentary structure. We measure the H$\alpha$ luminosity functions (HLF), finding that BOSS1244's HLF is nearly identical to that of the general field at the same epoch, while BOSS1542 shows an excess of HAEs with high H$\alpha$ luminosity, indicating the presence of enhanced star formation or AGN activity. We conclude that the two massive MAMMOTH overdensities are undergoing a rapid galaxy mass assembly.


title: Lipschitz estimates in quasi-Banach Schatten ideals

abstract: We study the class of functions $f$ on $\mathbb{R}$ satisfying a Lipschitz estimate in the Schatten ideal $\mathcal{L}_p$ for $0 < p \leq 1$. The corresponding problem with $p\geq 1$ has been extensively studied, but the quasi-Banach range $0 < p < 1$ is by comparison poorly understood. Using techniques from wavelet analysis, we prove that Lipschitz functions belonging to the homogeneous Besov class $\dot{B}^{\frac{1}{p}}_{\frac{p}{1-p},p}(\mathbb{R})$ obey the estimate $$ \|f(A)-f(B)\|_{p} \leq C_{p}(\|f'\|_{L_{\infty}(\mathbb{R})}+\|f\|_{\dot{B}^{\frac{1}{p}}_{\frac{p}{1-p},p}(\mathbb{R})})\|A-B\|_{p} $$ for all bounded self-adjoint operators $A$ and $B$ with $A-B\in \mathcal{L}_p$. In the case $p=1$, our methods recover and provide a new perspective on a result of Peller that $f \in \dot{B}^1_{\infty,1}$ is sufficient for a function to be Lipschitz in $\mathcal{L}_1$. We also provide related H\"older-type estimates, extending results of Aleksandrov and Peller. In addition, we prove the surprising fact that non-constant periodic functions on $\mathbb{R}$ are not Lipschitz in $\mathcal{L}_p$ for any $0 < p < 1$. This gives counterexamples to a 1991 conjecture of Peller that $f \in \dot{B}^{1/p}_{\infty,p}(\mathbb{R})$ is sufficient for $f$ to be Lipschitz in $\mathcal{L}_p$.


title: On the Transferability of Minimal Prediction Preserving Inputs in Question Answering

abstract: Recent work (Feng et al., 2018) establishes the presence of short, uninterpretable input fragments that yield high confidence and accuracy in neural models. We refer to these as Minimal Prediction Preserving Inputs (MPPIs). In the context of question answering, we investigate competing hypotheses for the existence of MPPIs, including poor posterior calibration of neural models, lack of pretraining, and "dataset bias" (where a model learns to attend to spurious, non-generalizable cues in the training data). We discover a perplexing invariance of MPPIs to random training seed, model architecture, pretraining, and training domain. MPPIs demonstrate remarkable transferability across domains achieving significantly higher performance than comparably short queries. Additionally, penalizing over-confidence on MPPIs fails to improve either generalization or adversarial robustness. These results suggest the interpretability of MPPIs is insufficient to characterize generalization capacity of these models. We hope this focused investigation encourages more systematic analysis of model behavior outside of the human interpretable distribution of examples.


title: Ridge Regression Revisited: Debiasing, Thresholding and Bootstrap

abstract: The success of the Lasso in the era of high-dimensional data can be attributed to its conducting an implicit model selection, i.e., zeroing out regression coefficients that are not significant. By contrast, classical ridge regression can not reveal a potential sparsity of parameters, and may also introduce a large bias under the high-dimensional setting. Nevertheless, recent work on the Lasso involves debiasing and thresholding, the latter in order to further enhance the model selection. As a consequence, ridge regression may be worth another look since -- after debiasing and thresholding -- it may offer some advantages over the Lasso, e.g., it can be easily computed using a closed-form expression. % and it has similar performance to threshold Lasso. In this paper, we define a debiased and thresholded ridge regression method, and prove a consistency result and a Gaussian approximation theorem. We further introduce a wild bootstrap algorithm to construct confidence regions and perform hypothesis testing for a linear combination of parameters. In addition to estimation, we consider the problem of prediction, and present a novel, hybrid bootstrap algorithm tailored for prediction intervals. Extensive numerical simulations further show that the debiased and thresholded ridge regression has favorable finite sample performance and may be preferable in some settings.


title: Layer-stacked Attention for Heterogeneous Network Embedding

abstract: The heterogeneous network is a robust data abstraction that can model entities of different types interacting in various ways. Such heterogeneity brings rich semantic information but presents nontrivial challenges in aggregating the heterogeneous relationships between objects - especially those of higher-order indirect relations. Recent graph neural network approaches for representation learning on heterogeneous networks typically employ the attention mechanism, which is often only optimized for predictions based on direct links. Furthermore, even though most deep learning methods can aggregate higher-order information by building deeper models, such a scheme can diminish the degree of interpretability. To overcome these challenges, we explore an architecture - Layer-stacked ATTention Embedding (LATTE) - that automatically decomposes higher-order meta relations at each layer to extract the relevant heterogeneous neighborhood structures for each node. Additionally, by successively stacking layer representations, the learned node embedding offers a more interpretable aggregation scheme for nodes of different types at different neighborhood ranges. We conducted experiments on several benchmark heterogeneous network datasets. In both transductive and inductive node classification tasks, LATTE can achieve state-of-the-art performance compared to existing approaches, all while offering a lightweight model. With extensive experimental analyses and visualizations, the framework can demonstrate the ability to extract informative insights on heterogeneous networks.


title: Hydride growth mechanism in Zircaloy-4: investigation of the partitioning of alloying elements

abstract: The long-term safety of water-based nuclear reactors relies in part on the reliability of zirconium-based nuclear fuel. Yet the progressive ingress of hydrogen during service makes zirconium alloys subject to delayed hydride cracking. Here, we use a combination of electron back-scattered diffraction and atom probe tomography to investigate specific microstructural features from the as-received sample and in the blocky-alpha microstructure, before and after electrochemical charging with hydrogen or deuterium followed by a low temperature heat treatment at 400C for 5 hours followed by furnace cooling at a rate of 0. 5C per min. Specimens for atom probe were prepared at cryogenic temperature to avoid the formation of spurious hydrides. We report on the compositional evolution of grains and grain boundaries over the course of the sample's thermal history, as well as the ways the growth of the hydrides modifies locally the composition and the structure of the alloy. We observe a significant amount of deuterium left in the matrix, even after the slow cooling and growth of the hydrides. Stacking faults form ahead of the growth front and Sn segregates at the hydride-matrix interface and on these faults. We propose that this segregation may facilitate further growth of the hydride. Our systematic investigation enables us discuss how the solute distribution affects the evolution of the alloy's properties during its service lifetime.


title: Hysteresis and Linear Stability Analysis on Multiple Steady-State Solutions to the Poisson--Nernst--Planck equations with Steric Interactions

abstract: In this work, we numerically study linear stability of multiple steady-state solutions to a type of steric Poisson--Nernst--Planck (PNP) equations with Dirichlet boundary conditions, which are applicable to ion channels. With numerically found multiple steady-state solutions, we obtain $S$-shaped current-voltage and current-concentration curves, showing hysteretic response of ion conductance to voltages and boundary concentrations with memory effects. Boundary value problems are proposed to locate bifurcation points and predict the local bifurcation diagram near bifurcation points on the $S$-shaped curves. Numerical approaches for linear stability analysis are developed to understand the stability of the steady-state solutions that are only numerically available. Finite difference schemes are proposed to solve a derived eigenvalue problem involving differential operators. The linear stability analysis reveals that the $S$-shaped curves have two linearly stable branches of different conductance levels and one linearly unstable intermediate branch, exhibiting classical bistable hysteresis. As predicted in the linear stability analysis, transition dynamics, from a steady-state solution on the unstable branch to a one on the stable branches, are led by perturbations associated to the mode of the dominant eigenvalue. Further numerical tests demonstrate that the finite difference schemes proposed in the linear stability analysis are second-order accurate. Numerical approaches developed in this work can be applied to study linear stability of a class of time-dependent problems around their steady-state solutions that are computed numerically.


title: Covariant density functional theory for nuclear chirality in $^{135}$Nd

abstract: The three-dimensional tilted axis cranking covariant density functional theory (3D-TAC CDFT) is used to study the chiral modes in $^{135}$Nd. By modeling the motion of the nucleus in rotating mean field as the interplay between the single-particle motions of several valence particle(s) and hole(s) and the collective motion of a core-like part, a classical Routhian is extracted. This classical Routhian gives qualitative agreement with the 3D-TAC CDFT result for the critical frequency corresponding to the transition from planar to aplanar rotation. Based on this investigation a possible understanding of tilted rotation appearing in a microscopic theory is provided.


title: A positivity-preserving, energy stable and convergent numerical scheme for the Poisson-Nernst-Planck system

abstract: In this paper we propose and analyze a finite difference numerical scheme for the Poisson-Nernst-Planck equation (PNP) system. To understand the energy structure of the PNP model, we make use of the Energetic Variational Approach (EnVarA), so that the PNP system could be reformulated as a non-constant mobility $H^{-1}$ gradient flow, with singular logarithmic energy potentials involved. To ensure the unique solvability and energy stability, the mobility function is explicitly treated, while both the logarithmic and the electric potential diffusion terms are treated implicitly, due to the convex nature of these two energy functional parts. The positivity-preserving property for both concentrations, $n$ and $p$, is established at a theoretical level. This is based on the subtle fact that the singular nature of the logarithmic term around the value of $0$ prevents the numerical solution reaching the singular value, so that the numerical scheme is always well-defined. In addition, an optimal rate convergence analysis is provided in this work, in which many highly non-standard estimates have to be involved, due to the nonlinear parabolic coefficients. The higher order asymptotic expansion (up to third order temporal accuracy and fourth order spatial accuracy), the rough error estimate (to establish the $\ell^\infty$ bound for $n$ and $p$), and the refined error estimate have to be carried out to accomplish such a convergence result. In our knowledge, this work will be the first to combine the following three theoretical properties for a numerical scheme for the PNP system: (i) unique solvability and positivity, (ii) energy stability, and (iii) optimal rate convergence. A few numerical results are also presented in this article, which demonstrates the robustness of the proposed numerical scheme.


title: Stochastic Optimization using Polynomial Chaos Expansions

abstract: Polynomial chaos based methods enable the efficient computation of output variability in the presence of input uncertainty in complex models. Consequently, they have been used extensively for propagating uncertainty through a wide variety of physical systems. These methods have also been employed to build surrogate models for accelerating inverse uncertainty quantification (infer model parameters from data) and construct transport maps. In this work, we explore the use of polynomial chaos based approaches for optimizing functions in the presence of uncertainty. These methods enable the fast propagation of uncertainty through smooth systems. If the dimensionality of the random parameters is low, these methods provide orders of magnitude acceleration over Monte Carlo sampling. We construct a generalized polynomial chaos based methodology for optimizing smooth functions in the presence of random parameters that are drawn from \emph{known} distributions. By expanding the optimization variables using orthogonal polynomials, the stochastic optimization problem reduces to a deterministic one that provides estimates for all moments of the output distribution. Thus, this approach enables one to avoid computationally expensive random sampling based approaches such as Monte Carlo and Quasi-Monte Carlo. In this work, we develop the overall framework, derive error bounds, construct the framework for the inclusion of constraints, analyze various properties of the approach, and demonstrate the proposed technique on illustrative examples.


title: Photoelectric heating effects on the evolution of luminous disk galaxies

abstract: Photoelectric heating (PEH) influences the temperature and density of the interstellar medium (ISM), and potentially also affecting star formation. PEH is expected to have a stronger effect on massive galaxies, as they host larger dust reservoirs compared to dwarf systems. Accordingly, in this paper, we study PEH effects in Milky Way-like galaxies using smoothed particle hydrodynamics (SPH) code which self-consistently implements the evolution of the gas, dust, and interstellar radiation field (ISRF). Dust evolution includes dust formation by stars, destruction by SNe, and growth in dense media. We find that PEH suppresses star formation due to the excess heating that reduces the ISM density. This suppression is seen across the entire range of gas fractions, star formation recipes, dust models, and PEH efficiencies investigated by our code. The suppression ranges from negligible values to approximately a factor of five depending on the specific implementation. Galaxy models having higher gas fraction experience higher star formation suppression. The adopted dust model also alters the extent of star formation suppression. Moreover, when PEH is switched on, galaxy models show higher gas outflow rates and have higher loading factors indicative of enhanced SNe feedback. In gas-rich models (i.e. a gas fraction of 0.5), we also find that PEH suppresses the formation of disk clumps via violent disk instabilities, and thus suppresses bulge formation via clumps migration to the central regions.


title: Magnetic Gradient Fluctuations from Quadrupolar $^{73}$Ge in Si/SiGe Exchange-Only Qubits

abstract: We study the time-fluctuating magnetic gradient noise mechanisms in pairs of Si/SiGe quantum dots using exchange echo noise spectroscopy. We find through a combination of spectral inversion and correspondence to theoretical modeling that quadrupolar precession of the $^{73}$Ge nuclei play a key role in the spin-echo decay time $T_2$, with a characteristic dependence on magnetic field and the width of the Si quantum well. The $^{73}$Ge noise peaks appear at the fundamental and first harmonic of the $^{73}$Ge Larmor resonance, superimposed over $1/f$ noise due to $^{29}$Si dipole-dipole dynamics, and are dependent on material epitaxy and applied magnetic field. These results may inform the needs of dynamical decoupling when using Si/SiGe quantum dots as qubits in quantum information processing devices.


title: The Djorgovski-Gurzadyan dark energy integral equation and the Hubble diagram

abstract: We consider the observational aspects of the value of dark energy density from quantum vacuum fluctuations based initially on the Gurzadyan-Xue model. We reduce the Djorgovski-Gurzadyan integral equation to a differential equation for the co-moving horizon and then, by means of the obtained explicit form for the luminosity distance, we construct the Hubble diagram for two classes of observational samples. For supernova and gamma-ray burst data we show that this approach provides viable predictions for distances up to $z \simeq 9$, quantitatively at least as good as those provided by the lambda cold dark matter ($\Lambda$CDM) model. The Hubble parameter dependence $H(z)$ of the two models also reveals mutual crossing at $z=0.4018$, the interpretation of which is less evident.


title: Resource Allocation and Dithering of Bayesian Parameter Estimation Using Mixed-Resolution Data

abstract: Quantization of signals is an integral part of modern signal processing applications, such as sensing, communication, and inference. While signal quantization provides many physical advantages, it usually degrades the subsequent estimation performance that is based on quantized data. In order to maintain physical constraints and simultaneously bring substantial performance gain, in this work we consider systems with mixed-resolution, 1-bit quantized and continuous-valued, data. First, we describe the linear minimum mean-squared error (LMMSE) estimator and its associated mean-squared error (MSE) for the general mixed-resolution model. However, the MSE of the LMMSE requires matrix inversion in which the number of measurements defines the matrix dimensions and thus, is not a tractable tool for optimization and system design. Therefore, we present the linear Gaussian orthonormal (LGO) measurement model and derive a closed-form analytic expression for the MSE of the LMMSE estimator under this model. In addition, we present two common special cases of the LGO model: 1) scalar parameter estimation and 2) channel estimation in mixed-ADC multiple-input multiple-output (MIMO) communication systems. We then solve the resource allocation optimization problem of the LGO model with the proposed tractable form of the MSE as an objective function and under a power constraint using a one-dimensional search. Moreover, we present the concept of dithering for mixed-resolution models and optimize the dithering noise as part of the resource allocation optimization problem for two dithering schemes: 1) adding noise only to the quantized measurements and 2) adding noise to both measurement types. Finally, we present simulations that demonstrate the advantages of using mixed-resolution measurements and the possible improvement introduced with dithering and resource allocation.


title: Path integral of neutrino oscillations

abstract: We propose an idea of the constrained Feynman amplitude for the scattering of the charged lepton and the virtual W-boson, $l_{\beta} + W_{\rho} \rightarrow l_{\alpha} + W_{\lambda}$, from which the conventional Pontecorvo oscillation formula of relativistic neutrinos is readily obtained using plane waves for all the particles involved. In a path integral picture, the neutrino propagates forward in time between the production and detection vertices, which are constrained respectively on the 3-dimensional spacelike hypersurfaces separated by a macroscopic positive time $\tau$. The covariant Feynman amplitude is formally recovered if one sums over all possible values of $\tau$ (including negative $\tau$).


title: Crossing You in Style: Cross-modal Style Transfer from Music to Visual Arts

abstract: Music-to-visual style transfer is a challenging yet important cross-modal learning problem in the practice of creativity. Its major difference from the traditional image style transfer problem is that the style information is provided by music rather than images. Assuming that musical features can be properly mapped to visual contents through semantic links between the two domains, we solve the music-to-visual style transfer problem in two steps: music visualization and style transfer. The music visualization network utilizes an encoder-generator architecture with a conditional generative adversarial network to generate image-based music representations from music data. This network is integrated with an image style transfer method to accomplish the style transfer process. Experiments are conducted on WikiArt-IMSLP, a newly compiled dataset including Western music recordings and paintings listed by decades. By utilizing such a label to learn the semantic connection between paintings and music, we demonstrate that the proposed framework can generate diverse image style representations from a music piece, and these representations can unveil certain art forms of the same era. Subjective testing results also emphasize the role of the era label in improving the perceptual quality on the compatibility between music and visual content.


title: Magnetoelectric near fields

abstract: We consider near field topological singularities originated from magnetic dipolar mode oscillations in ferrite disk particles.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph physics.optics


title: Vortex unpinning due to crustquake initiated neutron excitation and pulsar glitches

abstract: Pulsars undergoing crustquake release strain energy, which can be absorbed in a small region inside the inner crust of the star and excite the free superfluid neutrons therein. The scattering of these neutrons with the surrounding pinned vortices may unpin a large number of vortices and effectively reduce the pinning force on vortex lines. Such unpinning by neutron scattering can produce glitches for Crab like pulsars and Vela pulsar of size in the range $\sim 10^{-8} - 10^{-7}$, and $\sim 10^{-9} - 10^{-8}$, respectively. Although we discuss here the crustquake initiated excitation, the proposal is very generic and equally applicable for any other sources, which can excite the free superfluid neutrons, or can be responsible for superfluid - normal phase transition of neutron superfluid in the inner crust of a pulsar.


title: Gravitational wave echoes induced by a point mass plunging to a black hole

abstract: Recently, the possibility of detecting gravitational wave echoes in the data stream subsequent to the binary black hole mergers observed by LIGO was suggested. Motivated by this suggestion, we presented templates of echoes based on black hole perturbations in our previous work. There, we assumed that the incident waves resulting in echoes are similar to the ones that directly escape to the asymptotic infinity. In this work, to extract more reliable information on the waveform of echoes without using the naive assumption on the incident waves, we investigate gravitational waves induced by a point mass plunging into a Kerr black hole. We solve the linear perturbation equation sourced by the plunging mass under the purely outgoing boundary condition at infinity and a hypothetical reflection boundary condition near the horizon. We find that the low frequency component below the threshold of the super-radiant instability is highly suppressed, which is consistent with the incident waveform assumed in the previous analysis. We also find that the high frequency mode excitation is significantly larger than the one used in the previous analysis, if we adopt the perfectly reflective boundary condition independently of the frequency. When we use a simple template in which the same waveform as the direct emissions to infinity is repeated with the decreasing amplitude, the correlation between the expected signal and the template turns out to decrease very rapidly.


title: Urban Traffic Flow Forecast Based on FastGCRNN

abstract: Traffic forecasting is an important prerequisite for the application of intelligent transportation systems in urban traffic networks. The existing works adopted RNN and CNN/GCN, among which GCRN is the state of art work, to characterize the temporal and spatial correlation of traffic flows. However, it is hard to apply GCRN to the large scale road networks due to high computational complexity. To address this problem, we propose to abstract the road network into a geometric graph and build a Fast Graph Convolution Recurrent Neural Network (FastGCRNN) to model the spatial-temporal dependencies of traffic flow. Specifically, We use FastGCN unit to efficiently capture the topological relationship between the roads and the surrounding roads in the graph with reducing the computational complexity through importance sampling, combine GRU unit to capture the temporal dependency of traffic flow, and embed the spatiotemporal features into Seq2Seq based on the Encoder-Decoder framework. Experiments on large-scale traffic data sets illustrate that the proposed method can greatly reduce computational complexity and memory consumption while maintaining relatively high accuracy.


title: Code-switching pre-training for neural machine translation

abstract: This paper proposes a new pre-training method, called Code-Switching Pre-training (CSP for short) for Neural Machine Translation (NMT). Unlike traditional pre-training method which randomly masks some fragments of the input sentence, the proposed CSP randomly replaces some words in the source sentence with their translation words in the target language. Specifically, we firstly perform lexicon induction with unsupervised word embedding mapping between the source and target languages, and then randomly replace some words in the input sentence with their translation words according to the extracted translation lexicons. CSP adopts the encoder-decoder framework: its encoder takes the code-mixed sentence as input, and its decoder predicts the replaced fragment of the input sentence. In this way, CSP is able to pre-train the NMT model by explicitly making the most of the cross-lingual alignment information extracted from the source and target monolingual corpus. Additionally, we relieve the pretrain-finetune discrepancy caused by the artificial symbols like [mask]. To verify the effectiveness of the proposed method, we conduct extensive experiments on unsupervised and supervised NMT. Experimental results show that CSP achieves significant improvements over baselines without pre-training or with other pre-training methods.


title: Quantile-based Iterative Methods for Corrupted Systems of Linear Equations

abstract: Often in applications ranging from medical imaging and sensor networks to error correction and data science (and beyond), one needs to solve large-scale linear systems in which a fraction of the measurements have been corrupted. We consider solving such large-scale systems of linear equations $\mathbf{A}\mathbf{x}=\mathbf{b}$ that are inconsistent due to corruptions in the measurement vector $\mathbf{b}$. We develop several variants of iterative methods that converge to the solution of the uncorrupted system of equations, even in the presence of large corruptions. These methods make use of a quantile of the absolute values of the residual vector in determining the iterate update. We present both theoretical and empirical results that demonstrate the promise of these iterative approaches.


title: Logical Signal Processing: a Fourier Analysis of Temporal Logic

abstract: What is the frequency content of temporal logic formulas? That is, when we monitor a signal against a formula, which frequency bands of the signal are relevant to the logic and should be preserved, and which can be safely discarded? This question is relevant whenever signals are filtered or compressed before being monitored, which is almost always the case for analog signals. To answer this question, we focus on monitors that measure the robustness of a signal relative to a specification in Signal Temporal Logic. We prove that robustness monitors can be modeled using Volterra series. We then study the Fourier transforms of these Volterra representations, and provide a method to derive the Fourier transforms of entire formulas. We also make explicit the measurement process in temporal logic and re-define it on the basis of distributions to make it compatible with measurements in signal processing. Experiments illustrate these results. Beyond compression, this work enables the integration of temporal logic monitoring into common signal processing toolchains as just another signal processing operation, and enables a common formalism to study both logical and non-logical operations in the frequency domain, which we refer to as Logical Signal Processing.


title: Spin-wave focusing induced skyrmion generation

abstract: We propose a new method to generate magnetic skyrmions through spin-wave focusing in chiral ferromagnets.A lens is constructed to focus spin waves by a curved interface between two ferromagnetic thin films with different perpendicular magnetic anisotropies. Based on the principle of identical magnonic path length, we derive the lens contour that can be either elliptical or hyperbolical depending on the magnon refractive index. Micromagnetic simulations are performed to verify the theoretical design. It is found that under proper condition magnetic skyrmions emerge near the focus point of the lens where the spin-wave intensity has been significantly enhanced. A close investigation shows that a magnetic droplet first forms and then converts to the skyrmion accompanying with a change of topological charge. Phase diagram about the amplitude and duration-time of the exciting field for skyrmion generation is obtained. Our findings would be helpful for designing novel spintronic devices combining the advantages of skyrmionics and magnonics.


title: Distributional Generalization: A New Kind of Generalization

abstract: We introduce a new notion of generalization -- Distributional Generalization -- which roughly states that outputs of a classifier at train and test time are close *as distributions*, as opposed to close in just their average error. For example, if we mislabel 30% of dogs as cats in the train set of CIFAR-10, then a ResNet trained to interpolation will in fact mislabel roughly 30% of dogs as cats on the *test set* as well, while leaving other classes unaffected. This behavior is not captured by classical generalization, which would only consider the average error and not the distribution of errors over the input domain. Our formal conjectures, which are much more general than this example, characterize the form of distributional generalization that can be expected in terms of problem parameters: model architecture, training procedure, number of samples, and data distribution. We give empirical evidence for these conjectures across a variety of domains in machine learning, including neural networks, kernel machines, and decision trees. Our results thus advance our empirical understanding of interpolating classifiers.


title: An early prediction of covid-19 associated hospitalization surge using deep learning approach

abstract: The global pandemic caused by COVID-19 affects our lives in all aspects. As of September 11, more than 28 million people have tested positive for COVID-19 infection, and more than 911,000 people have lost their lives in this virus battle. Some patients can not receive appropriate medical treatment due the limits of hospitalization volume and shortage of ICU beds. An estimated future hospitalization is critical so that medical resources can be allocated as needed. In this study, we propose to use 4 recurrent neural networks to infer hospitalization change for the following week compared with the current week. Results show that sequence to sequence model with attention achieves a high accuracy of 0.938 and AUC of 0.850 in the hospitalization prediction. Our work has the potential to predict the hospitalization need and send a warning to medical providers and other stakeholders when a re-surge initializes.


title: Detection & imaging with Leak Microstructures

abstract: Results obtained with a new very compact detector for imaging with a matrix of Leak Microstructures (LM)are reported. Spatial linearity and spatial resolution obtained by scanning as well as the detection of alpha particles with 100% efficiency, when compared with a silicon detector, are stressed. Preliminary results recently obtained in detecting single electrons emitted by heated filament (Ec < 1 eV) at 1-3 mbar of propane are reported.


title: On the Sign of Fermion-Mediated Interactions

abstract: We develop a unified framework for understanding the sign of fermion-mediated interactions by exploiting the symmetry classification of Green's functions. In particular, we establish a theorem regarding the sign of fermion-mediated interactions in systems with chiral symmetry. The strength of the theorem is demonstrated within multiple examples with an emphasis on electron-mediated interactions in materials.


title: Collective Free Electron Excitations in Half-Space Configuration

abstract: Current research presents an innovative model of half-space plasmon excitations for electron gas of arbitrary degeneracy in an ambient jellium-like positive background . The linearized Schr\"{o}dinger-Poisson system is used to derive effective coupled pseudoforce and damped pseudoforce system of second-order differential equations from which the state functions such as the electron probability density and electrostatic potential energy are calculated and the appropriate half-space equilibrium plasmon excitation wave-functions are constructed. Current model of half-space finite temperature electron plasmon reveals many interesting features not present in previous studies. This model benefits a dual length scale character of quantum plasmon excitations taking into account the detailed electrostatic interactions between single electrons and their collective entity in an unmagnetized arbitrary degeneracy electron gas. The interaction of these length scales is remarked to lead to the formation of well defined miniature periodic density fringes in the gas which are modulated over the envelop density pattern and causes the presence of an electron halo in front of the physical jellium boundary of the system. A novel attractive Lennard-Jones-like potential energy forms in front of the boundary for parametric density-temperature region relevant to the strongly doped N-type semiconductors as well as metallic surfaces. The later effect may appropriately explain the Casimir-Polder-like forces between parallel metallic plates in vacuum.


title: An Extension of Fano's Inequality for Characterizing Model Susceptibility to Membership Inference Attacks

abstract: Deep neural networks have been shown to be vulnerable to membership inference attacks wherein the attacker aims to detect whether specific input data were used to train the model. These attacks can potentially leak private or proprietary data. We present a new extension of Fano's inequality and employ it to theoretically establish that the probability of success for a membership inference attack on a deep neural network can be bounded using the mutual information between its inputs and its activations. This enables the use of mutual information to measure the susceptibility of a DNN model to membership inference attacks. In our empirical evaluation, we show that the correlation between the mutual information and the susceptibility of the DNN model to membership inference attacks is 0.966, 0.996, and 0.955 for CIFAR-10, SVHN and GTSRB models, respectively.


title: Effect of Dynamic Ions on Band Structure of Plasmon Excitations

abstract: In this paper we develop a new method to study the plasmon energy band structure in multispecies plasmas. Using this method, we investigate plasmon dispersion band structure of different plasma systems with arbitrary degenerate electron fluid. The linearized Schr\"{o}dinger-Poisson model is used to derive appropriate coupled pseudoforce system from which the energy dispersion structure is calculated. It is shown that the introduction of ion mobility, beyond the jellium (static ion) model with a wide plasmon energy band gap, can fundamentally modify the plasmon dispersion character leading to a new form of low-level energy band, due to the electron-ion band structure mixing. The effects ionic of charge state and chemical potential of the electron fluid on the plasmonic band structure indicate many new features and reveal the fundamental role played by ions in the phonon assisted plasmon excitations in the electron-ion plasma system. Moreover, our study reveals that ion charge screening has a significant impact on the plasmon excitations in ion containing plasmas. The energy band structure of pair plasmas confirm the unique role of ions on the plasmon excitations in many all plasma environments. Current research helps to better understand the underlying mechanisms of collective excitations in charged environment and the important role of heavy species on the elementary plasmon quasiparticles. The method developed in this research may also be extended for complex multispecies and magnetized quantum plasmas as well as to investigation the surface plasmon-polariton interactions in nanometallic structures.


title: Observation of a resonant structure in $e^{+}e^{-} \to \omega\eta$ and another in $e^{+}e^{-} \to \omega\pi^{0}$ at center-of-mass energies between 2.00 and 3.08 GeV

abstract: Born cross sections for the processes $e^+e^- \to \omega\eta$ and $e^+e^- \to \omega\pi^{0}$ have been determined for center-of-mass energies between 2.00 and 3.08 GeV with the BESIII detector at the BEPCII collider. The results obtained in this work are consistent with previous measurements but with improved precision. Two resonant structures are observed. In the $e^{+}e^{-} \to \omega\eta$ cross sections, a resonance with a mass of $(2179 \pm 21 \pm 3)\text{MeV}/c^2$ and a width of $(89 \pm 28 \pm 5)\text{MeV}$ is observed with a significance of 6.1$\sigma$. Its properties are consistent with the $\phi(2170)$. In the $e^{+}e^{-} \to\omega\pi^{0}$ cross sections, a resonance denoted $Y(2040)$ is observed with a significance of more than 10$\sigma$. Its mass and width are determined to be $(2034 \pm 13 \pm 9)\text{MeV}/c^2$ and $(234 \pm 30 \pm 25)\text{MeV}$, respectively, where the first uncertainties are statistical and the second ones are systematic.


title: How-to Present News on Social Media: A Causal Analysis of Editing News Headlines for Boosting User Engagement

abstract: To reach a broader audience and optimize traffic toward news articles, media outlets commonly run social media accounts and share their content with a short text summary. Despite its importance of writing a compelling message in sharing articles, the research community does not own a sufficient understanding of what kinds of editing strategies effectively promote audience engagement. In this study, we aim to fill the gap by analyzing media outlets' current practices using a data-driven approach. We first build a parallel corpus of original news articles and their corresponding tweets that eight media outlets shared. Then, we explore how those media edited tweets against original headlines and the effects of such changes. To estimate the effects of editing news headlines for social media sharing in audience engagement, we present a systematic analysis that incorporates a causal inference technique with deep learning; using propensity score matching, it allows for estimating potential (dis-)advantages of an editing style compared to counterfactual cases where a similar news article is shared with a different style. According to the analyses of various editing styles, we report common and differing effects of the styles across the outlets. To understand the effects of various editing styles, media outlets could apply our easy-to-use tool by themselves.


title: Attracting Sets in Perceptual Networks

abstract: This document gives a specification for the model used in [1]. It presents a simple way of optimizing mutual information between some input and the attractors of a (noisy) network, using a genetic algorithm. The nodes of this network are modeled as simplified versions of the structures described in the "interface theory of perception" [2]. Accordingly, the system is referred to as a "perceptual network". The present paper is an edited version of technical parts of [1] and serves as accompanying text for the Python implementation PerceptualNetworks, freely available under [3]. 1. Prentner, R., and Fields, C.. Using AI methods to Evaluate a Minimal Model for Perception. OpenPhilosophy 2019, 2, 503-524. 2. Hoffman, D. D., Prakash, C., and Singh, M.. The Interface Theory of Perception. Psychonomic Bulletin and Review 2015, 22, 1480-1506. 3. Prentner, R.. PerceptualNetworks. https://github.com/RobertPrentner/PerceptualNetworks. (accessed September 17 2020)


title: Time series forecasting with Gaussian Processes needs priors

abstract: Automatic forecasting is the task of receiving a time series and returning a forecast for the next time steps without any human intervention. Gaussian Processes (GPs) are a powerful tool for modeling time series, but so far there are no competitive approaches for automatic forecasting based on GPs. We propose practical solutions to two problems: automatic selection of the optimal kernel and reliable estimation of the hyperparameters. We propose a fixed composition of kernels, which contains the components needed to model most time series: linear trend, periodic patterns, and other flexible kernel for modeling the non-linear trend. Not all components are necessary to model each time series; during training the unnecessary components are automatically made irrelevant via automatic relevance determination (ARD). We moreover assign priors to the hyperparameters, in order to keep the inference within a plausible range; we design such priors through an empirical Bayes approach. We present results on many time series of different types; our GP model is more accurate than state-of-the-art time series models. Thanks to the priors, a single restart is enough the estimate the hyperparameters; hence the model is also fast to train.


title: The Advanced Virgo Photon Calibrators

abstract: As the sensitivities of LIGO, Virgo and KAGRA detectors improve, calibration of the interferometers output is becoming more and more important and may impact scientific results. For the observing run O3, Virgo used for the first time photon calibrators (PCal) to calibrate the interferometer, using radiation pressure of a modulated auxiliary laser beam impinging on the Advanced Virgo end mirrors. Those optical devices, also used in LIGO, are now the calibration reference for the global gravitational wave detectors network. The intercalibration of LIGO and Virgo PCals, based on the same absolute reference called the Gold Standard, has allowed to remove a systematic bias of 3.92% that would have been present in Virgo calibration using the PCal. The uncertainty budget on the PCal-induced displacement of the end mirrors (NE and WE) of Advanced Virgo has been estimated to be 1.36% for O3a and 1.40% on NE PCal (resp. 1.74% on WE PCal) for O3b. This uncertainty is the limiting one for the global calibration of Advanced Virgo. It is expected to be reduced below 1% for the next observing runs.


title: Bounds on neutrino-scalar nonstandard interactions from big bang nucleosynthesis

abstract: Coherent forward scattering processes by neutrino-scalar nonstandard interactions (SNSI) induce an effective neutrino mass. In the Early Universe, a large neutrino effective mass restricts the production of neutrinos. The SNSI effect is modulated by two effective couplings, these account for the coupling between neutrinos and electrons/positrons, $G_{\rm eff}$, and the neutrino self-interaction, $G_{\rm S}$. These parameters are directly related to the effective number of relativistic species and non-zero values imply a smaller than expected $N_{\rm eff}$. We employ big bang nucleosynthesis to constraint the SNSI effect. We find that $ G_{\rm eff }< 1.2$ MeV$^{-2}$ and $ G_{\rm S }< 2.0 \times 10^{7}$ MeV$^{-2}$ at 68\% CL. For a scalar mass in the range $10^{-15} {\rm eV}\lesssim m_{\phi}\lesssim 10^{-5}{\rm eV}$, our neutrino-scalar coupling constraint is more restrictive than any previous result.


title: All van der Waals Integrated Nanophotonics

abstract: Integrated optics is at the heart of a wide range of systems from remote sensing and communications to computing and quantum information processing. Demand for smaller and more energy efficient structures stimulates search for more advanced material platforms. Here, we propose a concept of an all van der Waals photonics, where we show that electronically bulk transition metal dichalcogenide (TMDC) semiconductors are well fitted for the design of key optical components for nanoscale and integrated photonics. Specifically, we demonstrate theoretically that owing to low optical loss and high refractive index across near-infrared and telecom frequency bands, components made of bulk TMDCs can potentially outperform counterparts made of conventional 3D semiconductors, such as Si and III/Vs. We discuss several key quantum and classical optical components and show that bulk TMDCs may pave the way to smaller footprint devices, more energy efficient electro-optical modulators, and stronger quantum light-materials interaction. Enhanced optical performance, ease of integration, and a wide selection of materials suggest that bulk TMDCs may complement and, potentially, replace existing integrated photonics systems.


title: Discrete Vortex Filaments on Arrays of Coupled Oscillators in the Nonlinear Resonant Mode

abstract: Numerical simulation has indicated that vortex structures can exist for a long time in the form of quantized filaments on arrays of coupled weakly dissipative nonlinear oscillators in a finite three-dimensional domain under a resonant external force applied at the boundary of the domain. Ranges of the parameters of the system and an external signal favorable for the formation of modulationally stable quasi-uniform energy background, which is a decisive factor for the occurrence of this phenomenon, have been qualitatively revealed.


title: Few-Shot Unsupervised Continual Learning through Meta-Examples

abstract: In real-world applications, data do not reflect the ones commonly used for neural networks training, since they are usually few, unlabeled and can be available as a stream. Hence many existing deep learning solutions suffer from a limited range of applications, in particular in the case of online streaming data that evolve over time. To narrow this gap, in this work we introduce a novel and complex setting involving unsupervised meta-continual learning with unbalanced tasks. These tasks are built through a clustering procedure applied to a fitted embedding space. We exploit a meta-learning scheme that simultaneously alleviates catastrophic forgetting and favors the generalization to new tasks. Moreover, to encourage feature reuse during the meta-optimization, we exploit a single inner loop taking advantage of an aggregated representation achieved through the use of a self-attention mechanism. Experimental results on few-shot learning benchmarks show competitive performance even compared to the supervised case. Additionally, we empirically observe that in an unsupervised scenario, the small tasks and the variability in the clusters pooling play a crucial role in the generalization capability of the network. Further, on complex datasets, the exploitation of more clusters than the true number of classes leads to higher results, even compared to the ones obtained with full supervision, suggesting that a predefined partitioning into classes can miss relevant structural information.


title: Fixed Effects Binary Choice Models with Three or More Periods

abstract: We consider fixed effects binary choice models with a fixed number of periods $T$ and regressors without a large support. If the time-varying unobserved terms are i.i.d. with known distribution $F$, \cite{chamberlain2010} shows that the common slope parameter is point identified if and only if $F$ is logistic. However, he only considers in his proof $T=2$. We show that the result does not generalize to $T\geq 3$: the common slope parameter can be identified when $F$ belongs to a family including the logit distribution. Identification is based on a conditional moment restriction. Under restrictions on the covariates, these moment conditions lead to point identification of relative effects. If $T=3$ and mild conditions hold, GMM estimators based on these conditional moment restrictions reach the semiparametric efficiency bound. Finally, we illustrate our method by revisiting Brender and Drazen (2008).


title: Machine learning for beam dynamics studies at the CERN Large Hadron Collider

abstract: Machine learning entails a broad range of techniques that have been widely used in Science and Engineering since decades. High-energy physics has also profited from the power of these tools for advanced analysis of colliders data. It is only up until recently that Machine Learning has started to be applied successfully in the domain of Accelerator Physics, which is testified by intense efforts deployed in this domain by several laboratories worldwide. This is also the case of CERN, where recently focused efforts have been devoted to the application of Machine Learning techniques to beam dynamics studies at the Large Hadron Collider (LHC). This implies a wide spectrum of applications from beam measurements and machine performance optimisation to analysis of numerical data from tracking simulations of non-linear beam dynamics. In this paper, the LHC-related applications that are currently pursued are presented and discussed in detail, paying also attention to future developments.


title: Online Alternate Generator against Adversarial Attacks

abstract: The field of computer vision has witnessed phenomenal progress in recent years partially due to the development of deep convolutional neural networks. However, deep learning models are notoriously sensitive to adversarial examples which are synthesized by adding quasi-perceptible noises on real images. Some existing defense methods require to re-train attacked target networks and augment the train set via known adversarial attacks, which is inefficient and might be unpromising with unknown attack types. To overcome the above issues, we propose a portable defense method, online alternate generator, which does not need to access or modify the parameters of the target networks. The proposed method works by online synthesizing another image from scratch for an input image, instead of removing or destroying adversarial noises. To avoid pretrained parameters exploited by attackers, we alternately update the generator and the synthesized image at the inference stage. Experimental results demonstrate that the proposed defensive scheme and method outperforms a series of state-of-the-art defending models against gray-box adversarial attacks.


title: Reward Maximisation through Discrete Active Inference

abstract: Active inference is a probabilistic framework for modelling the behaviour of biological and artificial agents, which derives from the principle of minimising free energy. In recent years, this framework has successfully been applied to a variety of situations where the goal was to maximise reward, offering comparable and sometimes superior performance to alternative approaches. In this paper, we clarify the connection between reward maximisation and active inference by demonstrating how and when active inference agents perform actions that are optimal for maximising reward. Precisely, we show the conditions under which active inference produces the optimal solution to the Bellman equation--a formulation that underlies several approaches to model-based reinforcement learning and control. On partially observed Markov decision processes, the standard active inference scheme can produce Bellman optimal actions for planning horizons of 1, but not beyond. In contrast, a recently developed recursive active inference scheme (sophisticated inference) can produce Bellman optimal actions on any finite temporal horizon. We append the analysis with a discussion of the broader relationship between active inference and reinforcement learning.


title: Stern-Gerlach Interferometry with the Atom Chip

abstract: In this invited review in honor of 100 years since the Stern-Gerlach (SG) experiments, we describe a decade of SG interferometry on the atom chip. The SG effect has been a paradigm of quantum mechanics throughout the last century, but there has been surprisingly little evidence that the original scheme, with freely propagating atoms exposed to gradients from macroscopic magnets, is a fully coherent quantum process. Specifically, no full-loop SG interferometer (SGI) has been realized with the scheme as envisioned decades ago. Furthermore, several theoretical studies have explained why it is a formidable challenge. Here we provide a review of our SG experiments over the last decade. We describe several novel configurations such as that giving rise to the first SG spatial interference fringes, and the first full-loop SGI realization. These devices are based on highly accurate magnetic fields, originating from an atom chip, that ensure coherent operation within strict constraints described by previous theoretical analyses. Achieving this high level of control over magnetic gradients is expected to facilitate technological applications such as probing of surfaces and currents, as well as metrology. Fundamental applications include the probing of the foundations of quantum theory, gravity, and the interface of quantum mechanics and gravity. We end with an outlook describing possible future experiments.


title: A path formula for the sock sorting problem

abstract: Suppose $n$ different pairs of socks are put in a tumble dryer. When the dryer is finished socks are taken out one by one, if a sock matches one of the socks on the sorting table both are removed, otherwise it is put on the table until its partner emerges from the dryer. We note the number of socks on the table after each of the $2n$ socks is taken from the dryer and give an explicit formula for the probability that this sequence equals a given sequence of length $2n$.


title: A Deep Learning Approach to Geographical Candidate Selection through Toponym Matching

abstract: Recognizing toponyms and resolving them to their real-world referents is required for providing advanced semantic access to textual data. This process is often hindered by the high degree of variation in toponyms. Candidate selection is the task of identifying the potential entities that can be referred to by a toponym previously recognized. While it has traditionally received little attention in the research community, it has been shown that candidate selection has a significant impact on downstream tasks (i.e. entity resolution), especially in noisy or non-standard text. In this paper, we introduce a flexible deep learning method for candidate selection through toponym matching, using state-of-the-art neural network architectures. We perform an intrinsic toponym matching evaluation based on several new realistic datasets, which cover various challenging scenarios (cross-lingual and regional variations, as well as OCR errors). We report its performance on candidate selection in the context of the downstream task of toponym resolution, both on existing datasets and on a new manually-annotated resource of nineteenth-century English OCR'd text.


title: A Probabilistic End-To-End Task-Oriented Dialog Model with Latent Belief States towards Semi-Supervised Learning

abstract: Structured belief states are crucial for user goal tracking and database query in task-oriented dialog systems. However, training belief trackers often requires expensive turn-level annotations of every user utterance. In this paper we aim at alleviating the reliance on belief state labels in building end-to-end dialog systems, by leveraging unlabeled dialog data towards semi-supervised learning. We propose a probabilistic dialog model, called the LAtent BElief State (LABES) model, where belief states are represented as discrete latent variables and jointly modeled with system responses given user inputs. Such latent variable modeling enables us to develop semi-supervised learning under the principled variational learning framework. Furthermore, we introduce LABES-S2S, which is a copy-augmented Seq2Seq model instantiation of LABES. In supervised experiments, LABES-S2S obtains strong results on three benchmark datasets of different scales. In utilizing unlabeled dialog data, semi-supervised LABES-S2S significantly outperforms both supervised-only and semi-supervised baselines. Remarkably, we can reduce the annotation demands to 50% without performance loss on MultiWOZ.


title: Lensing rates of gravitational wave signals displaying beat patterns detectable by DECIGO and B-DECIGO

abstract: The coherent nature of gravitational wave emanating from a compact binary system makes it possible to detect some interference patterns in two (or more) signals registered simultaneously by the detector. Gravitational lensing effect can be used to bend trajectories of gravitational waves, which might reach the detector at the same time. Once this happens, a beat pattern may form, and can be used to obtain the luminosity distance of the source, the lens mass, and cosmological parameters such as the Hubble constant. Crucial question is how many such kind of events could be detected. In this work, we study this issue for the future space-borne detectors: DECIGO and its downscale version, B-DECIGO. It is found out that there can be a few tens to a few hundreds of lensed gravitational wave events with the beat pattern observed by DECIGO and B-DECIGO per year, depending on the evolution scenario leading to the formation of double compact objects. In particular, black hole-black hole binaries are dominating population of lensed sources in which beat patterns may reveal. However, DECIGO could also register a considerable amount of lensed signals from binary neutron stars, which might be accompanied by electromagnetic counterparts. Our results suggest that, in the future, lensed gravitational wave signal with the beat pattern could play an important role in cosmology and astrophysics.


title: The achromatic number of $K_6\square K_7$ is $18$

abstract: A vertex colouring $f:V(G)\to C$ of a graph $G$ is complete if for any two distinct colours $c_1,c_2\in C$ there is an edge $\{v_1,v_2\}\in E(G)$ such that $f(v_i)=c_i$, $i=1,2$. The achromatic number of $G$ is the maximum number $\mathrm{achr}(G)$ of colours in a proper complete vertex colouring of $G$. In the paper it is proved that $\mathrm{achr}(K_6\square K_7)=18$. This result finalises the determination of $\mathrm{achr}(K_6\square K_q)$.


title: Effect of imposed shear on the dynamics of a contaminated two-layer film flow down a slippery incline

abstract: The linear instability of a surfactant-laden two-layer falling film over an inclined slippery wall is analyzed under an influence of external shear which is imposed on the top surface of the flow. The free surface of the flow as well as the interface among the fluids are contaminated by insoluble surfactants. Dynamics of both the layers are governed by the Navier--Stokes equations, and the surfactant transport equation regulates the motion of the insoluble surfactants at the interface and free surface. Instability mechanisms are compared by imposing the external shear along and opposite to the flow direction. A coupled Orr--Sommerfeld system of equations for the considered problem is derived using the perturbation technique and normal mode analysis. The eigenmodes corresponding to the Orr--Sommerfeld eigenvalue problem are obtained by employing the spectral collocation method. The numerical results imply that the stronger external shear destabilizes the interface mode instability. However, a stabilizing impact of the external shear on the surface mode is noticed if the shear is imposed in the flow direction, which is in contrast to the role of imposed external shear on the surface mode for a surfactant laden single layer falling film. Moreover, the impression of shear mode on the primary instability is analyzed in the high Reynolds number regime with sufficiently low inclination angle. Under such configuration, dominance of the shear mode over the surface mode is observed due to the weaker impact of the gravitation force on the surface instability. The shear mode can also be stabilized by applying the external shear in the counter direction of the streamwise flow. Conclusively, the extra imposed shear on the stratified two-layer falling film plays an active role to control the attitude of the instabilities.


title: Collaborative Training between Region Proposal Localization and Classification for Domain Adaptive Object Detection

abstract: Object detectors are usually trained with large amount of labeled data, which is expensive and labor-intensive. Pre-trained detectors applied to unlabeled dataset always suffer from the difference of dataset distribution, also called domain shift. Domain adaptation for object detection tries to adapt the detector from labeled datasets to unlabeled ones for better performance. In this paper, we are the first to reveal that the region proposal network (RPN) and region proposal classifier~(RPC) in the endemic two-stage detectors (e.g., Faster RCNN) demonstrate significantly different transferability when facing large domain gap. The region classifier shows preferable performance but is limited without RPN's high-quality proposals while simple alignment in the backbone network is not effective enough for RPN adaptation. We delve into the consistency and the difference of RPN and RPC, treat them individually and leverage high-confidence output of one as mutual guidance to train the other. Moreover, the samples with low-confidence are used for discrepancy calculation between RPN and RPC and minimax optimization. Extensive experimental results on various scenarios have demonstrated the effectiveness of our proposed method in both domain-adaptive region proposal generation and object detection. Code is available at https://github.com/GanlongZhao/CST_DA_detection.


title: Finding Effective Security Strategies through Reinforcement Learning and Self-Play

abstract: We present a method to automatically find security strategies for the use case of intrusion prevention. Following this method, we model the interaction between an attacker and a defender as a Markov game and let attack and defense strategies evolve through reinforcement learning and self-play without human intervention. Using a simple infrastructure configuration, we demonstrate that effective security strategies can emerge from self-play. This shows that self-play, which has been applied in other domains with great success, can be effective in the context of network security. Inspection of the converged policies show that the emerged policies reflect common-sense knowledge and are similar to strategies of humans. Moreover, we address known challenges of reinforcement learning in this domain and present an approach that uses function approximation, an opponent pool, and an autoregressive policy representation. Through evaluations we show that our method is superior to two baseline methods but that policy convergence in self-play remains a challenge.


title: Evidence of strong relationship between hemispheric asymmetry in solar coronal rotation and solar activity during solar cycle 24

abstract: In this article, we report an evidence of very high and statistically significant relationship between hemispheric asymmetry in solar coronal rotation rate and solar activity. Our approach is based on cross correlation of hemispheric asymmetry index (AI) in rotation rate with annual solar activity indicators. To obtain hemispheric asymmetry in solar rotation rate, we use solar full disc (SFD) images at 30.4 nm, 19.5 nm, and 28.4 nm wavelengths for 24th Solar Cycle i.e., for the period from 2008 to 2018, as recorded by the Solar Terrestrial Relations Observatory (STEREO) space mission. Our analysis shows that hemispheric asymmetry in rotation rate is high during the solar maxima from 2011 to 2014. On the other hand, hemispheric asymmetry drops gradually on both sides (i.e., from 2008 to 2011 and from 2014 to 2018). The results show that asymmetry index (AI) leads sunspot numbers by ~1.56 years. This gives a clear indication that hemispheric asymmetry triggers the formation of sunspots working together with the differential rotation of the Sun.


title: Nanomechanics of Antimonene Allotropes

abstract: Monolayer antimonene has drawn the attention of research communities due to its promising physical properties. But mechanical properties of antimonene is still largely unexplored. In this work, we investigate the mechanical properties and fracture mechanisms of two stable phases of monolayer antimonene -- the ${\alpha}$ antimonene (${\alpha}$-Sb) and the ${\beta}$ antimonene (${\beta}$-Sb), through molecular dynamics (MD) simulations. Our simulations reveal that stronger chiral effect results in a greater anisotropic elastic behavior in ${\beta}$-antimonene than in ${\alpha}$-antimonene. In this paper we focus on crack-tip stress distribution using local volume averaged virial stress definition and derive the fracture toughness from the crack-line stress. Our calculated crack tip stress distribution ensures the applicability of linear elastic fracture mechanics (LEFM) for cracked antimonene allotropes with considerable accuracy up to a pristine structure. We evaluate the effect of temperature, strain rate, crack-length and point-defect concentration on the strength and elastic properties. Tensile strength goes through significant degradation with the increment of temperature, crack length and defect percentage. Elastic modulus is less susceptible to temperature variation but is largely affected by the defect concentration. Strain rate induces a power law relation between strength and fracture strain. Finally, we discuss the fracture mechanisms in the light of crack propagation and establish the links between the fracture mechanism and the observed anisotropic properties.


title: DLBCL-Morph: Morphological features computed using deep learning for an annotated digital DLBCL image set

abstract: Diffuse Large B-Cell Lymphoma (DLBCL) is the most common non-Hodgkin lymphoma. Though histologically DLBCL shows varying morphologies, no morphologic features have been consistently demonstrated to correlate with prognosis. We present a morphologic analysis of histology sections from 209 DLBCL cases with associated clinical and cytogenetic data. Duplicate tissue core sections were arranged in tissue microarrays (TMAs), and replicate sections were stained with H&E and immunohistochemical stains for CD10, BCL6, MUM1, BCL2, and MYC. The TMAs are accompanied by pathologist-annotated regions-of-interest (ROIs) that identify areas of tissue representative of DLBCL. We used a deep learning model to segment all tumor nuclei in the ROIs, and computed several geometric features for each segmented nucleus. We fit a Cox proportional hazards model to demonstrate the utility of these geometric features in predicting survival outcome, and found that it achieved a C-index (95% CI) of 0.635 (0.574,0.691). Our finding suggests that geometric features computed from tumor nuclei are of prognostic importance, and should be validated in prospective studies.


title: Charge Density Waves beyond the Pauli paramagnetic limit in 2D systems

abstract: Two-dimensional materials are ideal candidates to host Charge density waves (CDWs) that exhibit paramagnetic limiting behavior, similarly to the well known case of superconductors. Here we study how CDWs in two-dimensional systems can survive beyond the Pauli limit when they are subjected to a strong magnetic field by developing a generalized mean-field theory of CDWs under Zeeman fields that includes incommensurability, imperfect nesting and temperature effects and the possibility of a competing or coexisting Spin density wave (SDW) order. Our numerical calculations yield rich phase diagrams with distinct high-field phases above the Pauli limiting field. For perfectly nested commensurate CDWs, a $q$-modulated CDW phase that is completely analogous to the superconducting Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) phase appears at high-fields. In the more common case of imperfect nesting, the commensurate CDW groundstate undergoes a series of magnetic-field-induced phase transitions first into a phase where commensurate CDW and SDW coexist and subsequently into another phase where CDW and SDW acquire a $q$-modulation that is however distinct from the pure FFLO CDW phase. The commensurate CDW+SDW phase occurs for fields comparable to but less than the Pauli limit and survives above it. Thus this phase provides a plausible mechanism for the CDW to survive at high fields without the need of forming the more fragile FFLO phase. We suggest that the recently discovered 2D materials like the transition metal dichalcogenides offer a promising platform for observing such exotic field induced CDW phenomena.


title: Support posets of some monomial ideals

abstract: The support poset of a monomial ideal $I\subseteq\mathbf{k}[x_1,\dots,x_n]$ encodes the relation between the variables $x_1,\dots,x_n$ and the minimal monomial generators of $I$. It is known that not every poset is realizable as the support poset of some monomial ideal. We describe some posets $P$ for which we can explicitly find at least one monomial ideal $I_P$ such that $P$ is the support poset of $I_P$. Also, for some families of monomial ideals we describe their support posets and study their properties. As an example of application we examine the relation between forests and series-parallel ideals.


title: Z production in pPb collisions at LHCb

abstract: This article presents results of the Z boson production in the proton-lead collisions at $\sqrt{s_{\rm NN}} = 5.02$ TeV and $\sqrt{s_{\rm NN}}= 8.16$ TeV collected in 2013 and 2016, respectively, by the LHCb detector at the LHC in forward and backward rapidity. The great precision of the 2016 data are found compatible with nPDFs theoretical predictions within large theoretical uncertainties, and can be useful to constraint new predictions.


title: Addressing Cognitive Biases in Augmented Business Decision Systems

abstract: How do algorithmic decision aids introduced in business decision processes affect task performance? In a first experiment, we study effective collaboration. Faced with a decision, subjects alone have a success rate of 72%; Aided by a recommender that has a 75% success rate, their success rate reaches 76%. The human-system collaboration had thus a greater success rate than each taken alone. However, we noted a complacency/authority bias that degraded the quality of decisions by 5% when the recommender was wrong. This suggests that any lingering algorithmic bias may be amplified by decision aids. In a second experiment, we evaluated the effectiveness of 5 presentation variants in reducing complacency bias. We found that optional presentation increases subjects' resistance to wrong recommendations. We conclude by arguing that our metrics, in real usage scenarios, where decision aids are embedded as system-wide features in Business Process Management software, can lead to enhanced benefits.


title: Multi$^2$OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERT

abstract: In this paper, we propose Multi$^2$OIE, which performs open information extraction (open IE) by combining BERT with multi-head attention. Our model is a sequence-labeling system with an efficient and effective argument extraction method. We use a query, key, and value setting inspired by the Multimodal Transformer to replace the previously used bidirectional long short-term memory architecture with multi-head attention. Multi$^2$OIE outperforms existing sequence-labeling systems with high computational efficiency on two benchmark evaluation datasets, Re-OIE2016 and CaRB. Additionally, we apply the proposed method to multilingual open IE using multilingual BERT. Experimental results on new benchmark datasets introduced for two languages (Spanish and Portuguese) demonstrate that our model outperforms other multilingual systems without training data for the target languages.


title: Conformal Measure Ensembles and Planar Ising Magnetization: A Review

abstract: We provide a review of results on the critical and near-critical scaling limit of the planar Ising magnetization field obtained in the past dozen years. The results are presented in the framework of coupled loop and measure ensembles, and some new proofs are provided.


title: On attainability of Kendall's tau matrices and concordance signatures

abstract: Methods are developed for checking and completing systems of bivariate and multivariate Kendall's tau concordance measures in applications where only partial information about dependencies between variables is available. The concept of a concordance signature of a multivariate continuous distribution is introduced; this is the vector of concordance probabilities for margins of all orders. It is shown that every attainable concordance signature is equal to the concordance signature of a unique mixture of the extremal copulas, that is the copulas with extremal correlation matrices consisting exclusively of 1's and -1's. A method of estimating an attainable concordance signature from data is derived and shown to correspond to using standard estimates of Kendall's tau in the absence of ties. The set of attainable Kendall rank correlation matrices of multivariate continuous distributions is proved to be identical to the set of convex combinations of extremal correlation matrices, a set known as the cut polytope. A methodology for testing the attainability of concordance signatures using linear optimization and convex analysis is provided. The elliptical copulas are shown to yield a strict subset of the attainable concordance signatures as well as a strict subset of the attainable Kendall rank correlation matrices; the Student t copula is seen to converge, as the degrees of freedom tend to zero, to a mixture of extremal copulas sharing its concordance signature with all elliptical distributions that have the same correlation matrix. A characterization of the attainable signatures of equiconcordant copulas is given.


title: Localization and delocalization of light in photonic moire lattices

abstract: Moire lattices consist of two identical periodic structures overlaid with a relative rotation angle. Present even in everyday life, moire lattices have been also produced, e.g., with coupled graphene-hexagonal boron nitride monolayers, graphene-graphene layers, and layers on a silicon carbide surface.A fundamental question that remains unexplored is the evolution of waves in the potentials defined by the moire lattices. Here we experimentally create two-dimensional photonic moire lattices, which, unlike their material predecessors, have readily controllable parameters and symmetry allowing to explore transitions between structures with fundamentally different geometries: periodic, general aperiodic and quasi-crystal ones. Equipped with such realization, we observe localization of light in deterministic linear lattices. Such localization is based on at band physics, in contrast to previous schemes based on light difusion in optical quasicrystals,where disorder is required for the onset of Anderson localization. Using commensurable and incommensurable moire patterns, we report the first experimental demonstration of two-dimensional localization-delocalization-transition (LDT) of light. Moire lattices may feature almost arbitrary geometry that is consistent with the crystallographic symmetry groups of the sublattices, and therefore afford a powerful tool to control the properties of light patterns, to explore the physics of transitions between periodic and aperiodic phases, and two-dimensional wavepacket phenomena relevant to several areas of science.


title: Database Generation for Deep Learning Inversion of 2.5D Borehole Electromagnetic Measurements using Refined Isogeometric Analysis

abstract: Borehole resistivity measurements are routinely inverted in real-time during geosteering operations. The inversion process can be efficiently performed with the help of advanced artificial intelligence algorithms such as deep learning. These methods require a large dataset that relates multiple earth models with the corresponding borehole resistivity measurements. In here, we propose to use an advanced numerical method --refined isogeometric analysis (rIGA)-- to perform rapid and accurate 2.5D simulations and generate databases when considering arbitrary 2D earth models. Numerical results show that we can generate a meaningful synthetic database composed of 100,000 earth models with the corresponding measurements in 56 hours using a workstation equipped with two CPUs.


title: Probing the Meta-Stability of Oxide Core/Shell Nanoparticle Systems at Atomic Resolution

abstract: Hybrid nanoparticles allow exploiting the interplay of confinement, proximity between different materials and interfacial effects. However, to harness their properties an in-depth understanding of their (meta)stability and interfacial characteristics is crucial. This is especially the case of nanosystems based on functional oxides working under reducing conditions, which may severely impact their properties. In this work, the in-situ electron-induced selective reduction of Mn3O4 to MnO is studied in magnetic Fe3O4/Mn3O4 and Mn3O4/Fe3O4 core/shell nanoparticles by means of high-resolution scanning transmission electron microscopy combined with electron energy-loss spectroscopy. Such in-situ transformation allows mimicking the actual processes in operando environments. A multi-stage image analysis using geometric phase analysis combined with particle image velocity enables direct monitoring of the relationship between structure, chemical composition and strain relaxation during the Mn3O4 reduction. In the case of Fe3O4/Mn3O4 core/shell the transformation occurs smoothly without the formation of defects. However, for the inverse Mn3O4/Fe3O4 core/shell configuration the electron beam-induced transformation occurs in different stages that include redox reactions and void formation followed by strain field relaxation via formation of defects. This study highlights the relevance of understanding the local dynamics responsible for changes in the particle composition in order to control stability and, ultimately, macroscopic functionality.


title: Interaction induced doublons and embedded topological subspace in a complete flat-band system

abstract: In this work, we investigate effects of weak interactions on a bosonic complete flat-band system. By employing a band projection method, the flat-band Hamiltonian with weak interactions is mapped to an effective Hamiltonian. The effective Hamiltonian indicates that doublons behave as well-defined quasi-particles, which acquire itinerancy through the hopping induced by interactions. When we focus on a two-particle system, from the effective Hamiltonian, an effective subspace spanned only by doublon bases emerges. The effective subspace induces spreading of a single doublon and we find an interesting property: The dynamics of a single doublon keeps short-range density-density correlation in sharp contrast to a conventional two-particle spreading. Furthermore, when introducing a modulated weak interaction, we find an interaction induced topological subspace embedded in the full Hilbert space. We elucidate the embedded topological subspace by observing the dynamics of a single doublon, and show that the embedded topological subspace possesses a bulk topological invariant. We further expect that for the system with open boundary the embedded topological subspace has an interaction induced topological edge mode described by the doublon. The bulk--edge--correspondence holds even for the embedded topological subspace.

categories: cond-mat.quant-gas cond-mat.stat-mech cond-mat.str-el cond-mat.supr-con


title: Variational phase-field continuum model uncovers adhesive wear mechanisms in asperity junctions

abstract: Wear is well known for causing material loss in a sliding interface. Available macroscopic approaches are bound to empirical fitting parameters, which range several orders of magnitude. Major advances in tribology have recently been achieved via Molecular Dynamics, although its use is strongly limited by computational cost. Here, we propose a study of the physical processes that lead to wear at the scale of the surface roughness, where adhesive junctions are formed between the asperities on the surface of the materials. Using a brittle formulation of the variational phase-field approach to fracture, we demonstrate that the failure mechanisms of an adhesive junction can be linked to its geometry. By imposing specific couplings between the damage and the elastic energy, we further investigate the triggering processes underlying each failure mechanism. We show that a large debris formation is mostly triggered by tensile stresses while shear stresses lead to small or no particle formation. We also study groups of junctions and discuss how microcontact interactions can be favored in some geometries to form macro-particles. This leads us to propose a classification in terms of macroscopic wear rate. Although based on a continuum approach, our phase-field calculations are able to effectively capture the failure of adhesive junctions, as observed through discrete Molecular Dynamics simulations.


title: Multidimensional Scaling, Sammon Mapping, and Isomap: Tutorial and Survey

abstract: Multidimensional Scaling (MDS) is one of the first fundamental manifold learning methods. It can be categorized into several methods, i.e., classical MDS, kernel classical MDS, metric MDS, and non-metric MDS. Sammon mapping and Isomap can be considered as special cases of metric MDS and kernel classical MDS, respectively. In this tutorial and survey paper, we review the theory of MDS, Sammon mapping, and Isomap in detail. We explain all the mentioned categories of MDS. Then, Sammon mapping, Isomap, and kernel Isomap are explained. Out-of-sample embedding for MDS and Isomap using eigenfunctions and kernel mapping are introduced. Then, Nystrom approximation and its use in landmark MDS and landmark Isomap are introduced for big data embedding. We also provide some simulations for illustrating the embedding by these methods.


title: Topological edge states of nonequilibrium polaritons in hollow honeycomb arrays

abstract: We address topological currents in polariton condensates excited by uniform resonant pumps in finite honeycomb arrays of microcavity pillars with a hole in the center. Such currents arise under combined action of the spin-orbit coupling and the Zeeman splitting that break the time-reversal symmetry and open a topological gap in the spectrum of the structure. The most representative feature of this structure is the presence of two interfaces, inner and outer ones, where the directions of topological currents are opposite. Due to the finite size of the structure polariton-polariton interactions lead to the coupling of the edge states at the inner and outer interfaces, which depends on the size of the hollow region. Moreover, switching between currents can be realized by tuning the pump frequency. We illustrate that currents in this finite structure can be stable and study bistability effects arising due to the resonant character of the pump.


title: FewJoint: A Few-shot Learning Benchmark for Joint Language Understanding

abstract: Few-shot learning (FSL) is one of the key future steps in machine learning and has raised a lot of attention. However, in contrast to the rapid development in other domains, such as Computer Vision, the progress of FSL in Nature Language Processing (NLP) is much slower. One of the key reasons for this is the lacking of public benchmarks. NLP FSL researches always report new results on their own constructed few-shot datasets, which is pretty inefficient in results comparison and thus impedes cumulative progress. In this paper, we present FewJoint, a novel Few-Shot Learning benchmark for NLP. Different from most NLP FSL research that only focus on simple N-classification problems, our benchmark introduces few-shot joint dialogue language understanding, which additionally covers the structure prediction and multi-task reliance problems. This allows our benchmark to reflect the real-word NLP complexity beyond simple N-classification. Our benchmark is used in the few-shot learning contest of SMP2020-ECDT task-1. We also provide a compatible FSL platform to ease experiment set-up.


title: First NNLO fragmentation functions of $K_S^0$ and $\Lambda/\bar{\Lambda}$ and their uncertainties in the presence of hadron mass corrections

abstract: The current paper presents a determination of $K^0_S$ and $\Lambda/\bar{\Lambda}$ fragmentation functions (FFs) from QCD analysis of single-inclusive electron-positron annihilation process (SIA). Our FFs determinations are performed at next-to-leading order (NLO), and for the first time, at next-to-next-to-leading order (NNLO) accuracy in perturbative Quantum Chromodynamics (pQCD) which is designated as {\tt SAK20} FFs. Each of these FFs is accompanied by their uncertainties which are determined using the `Hessian' method. Considering the hadron mass corrections, we clearly investigate the reliability of our results upon the inclusion of higher-order QCD correction. We provide comparisons of {\tt SAK20} FFs set with the available analysis from another group, finding in general a reasonable agreement, and also considerable differences. In order to judge the fit quality, our theoretical predictions are compared with the analyzed SIA datasets. {\tt SAK20} FFs at NLO and NNLO accuracy along with their uncertainties are made available in the standard {\tt LHAPDF} format in order to use for predictions of present and future measurements in high-energy collisions such as LHC and RHIC.


title: POMP: Pomcp-based Online Motion Planning for active visual search in indoor environments

abstract: In this paper we focus on the problem of learning an optimal policy for Active Visual Search (AVS) of objects in known indoor environments with an online setup. Our POMP method uses as input the current pose of an agent (e.g. a robot) and a RGB-D frame. The task is to plan the next move that brings the agent closer to the target object. We model this problem as a Partially Observable Markov Decision Process solved by a Monte-Carlo planning approach. This allows us to make decisions on the next moves by iterating over the known scenario at hand, exploring the environment and searching for the object at the same time. Differently from the current state of the art in Reinforcement Learning, POMP does not require extensive and expensive (in time and computation) labelled data so being very agile in solving AVS in small and medium real scenarios. We only require the information of the floormap of the environment, an information usually available or that can be easily extracted from an a priori single exploration run. We validate our method on the publicly available AVD benchmark, achieving an average success rate of 0.76 with an average path length of 17.1, performing close to the state of the art but without any training needed. Additionally, we show experimentally the robustness of our method when the quality of the object detection goes from ideal to faulty.


title: Chiral condensates in a polariton hexagonal ring

abstract: We model generation of vortex modes in exciton-polariton condensates in semiconductor micropillars, arranged into a hexagonal ring molecule, in the presence of TE-TM splitting. This splitting lifts the degeneracy of azimuthally modulated vortex modes with opposite topological charges supported by this structure, so that a number of non-degenerate vortex states characterized by different combinations of topological charges in two polarization components appears. We present a full bifurcation picture for such vortex modes and show that because they have different energies, they can be selectively excited by coherent pump beams with specific frequencies and spatial configurations. At high pumping intensity, polariton-polariton interactions give rise to the coupling of different vortex resonances and a bistable regime is achieved.


title: Online Algorithms for Estimating Change Rates of Web Pages

abstract: A search engine maintains local copies of different web pages to provide quick search results. This local cache is kept up-to-date by a web crawler that frequently visits these different pages to track changes in them. Ideally, the local copy should be updated as soon as a page changes on the web. However, finite bandwidth availability and server restrictions limit how frequently different pages can be crawled. This brings forth the following optimization problem: maximize the freshness of the local cache subject to the crawling frequencies being within prescribed bounds. While tractable algorithms do exist to solve this problem, these either assume the knowledge of exact page change rates or use inefficient methods such as MLE for estimating the same. We address this issue here. We provide three novel schemes for online estimation of page change rates, all of which have extremely low running times per iteration. The first is based on the law of large numbers and the second on stochastic approximation. The third is an extension of the second and includes a heavy-ball momentum term. All these schemes only need partial information about the page change process, i.e., they only need to know if the page has changed or not since the last crawled instance. Our main theoretical results concern asymptotic convergence and convergence rates of these three schemes. In fact, our work is the first to show convergence of the original stochastic heavy-ball method when neither the gradient nor the noise variance is uniformly bounded. We also provide some numerical experiments (based on real and synthetic data) to demonstrate the superiority of our proposed estimators over existing ones such as MLE. We emphasize that our algorithms are also readily applicable to the synchronization of databases and network inventory management.