title: Josephson-junction infrared single-photon detector

abstract: Josephson junctions (JJs) are ubiquitous superconducting devices, enabling high sensitivity magnetometers and voltage amplifiers, as well as forming the basis of high performance cryogenic computer and superconducting quantum computers. While JJ performance can be degraded by quasiparticles (QPs) formed from broken Cooper pairs, this phenomenon also opens opportunities to sensitively detect electromagnetic radiation. Here we demonstrate single near-infrared photon detection by coupling photons to the localized surface plasmons of a graphene-based JJ. Using the photon-induced switching statistics of the current-biased JJ, we reveal the critical role of QPs generated by the absorbed photon in the detection mechanism. The photon-sensitive JJ will enable a high-speed, low-power optical interconnect for future JJ-based computing architectures.

categories: quant-ph cond-mat.mes-hall cond-mat.supr-con physics.app-ph physics.optics


title: Matrix Product Wave Function of the Ground State and Elementary Excitation in the Spin-1/2 Chain

abstract: We present a variational matrix product state (vMPS) for the ground state of the spin-1/2 Heisenberg model. The MPS effectively organizes the various dimer configurations, in faithful reflection of the resonating valence bond (RVB) picture of the spin liquid, with the energy only 0.024% higher than the exact value given by Bethe ansatz. Building on the ground-state vMPS, the one-spin wave function is constructed in a simple manner with the dispersion that matches well with the exact spectrum. The vMPS scheme is applied to the family of Hamiltonian extrapolating between the Heisenberg model and the Majumdar-Ghosh model.


title: HDPython: A High Level Python Based Object-Oriented HDL Framework

abstract: We present a High-Level Python-based Hardware Description Language (HDPython), It uses Python as its source language and converts it to standard VHDL. Compared to other approaches of building converters from a high-level programming language into a hardware description language, this new approach aims to maintain an object-oriented paradigm throughout the entire process. Instead of removing all the high-level features from Python to make it into an HDL, this approach goes the opposite way. It tries to show how certain features from a high-level language can be implemented in an HDL, providing the corresponding benefits of high-level programming for the user.


title: Revealing the Structure and Internal Rotation of the Sagittarius Dwarf Spheroidal Galaxy with Gaia and Machine Learning

abstract: We present a detailed study of the internal structure and kinematics of the core of the Sagittarius dwarf spheroidal galaxy (Sgr). Using machine-learning techniques, we have combined the information provided by 3300 RR Lyrae stars, more than 2000 spectroscopically observed stars, and the Gaia second data release to derive the full phase space, i.e. 3D positions and kinematics, of more than $1.2\times10^5$ member stars in the core of the galaxy. Our results show that Sgr has a bar structure $\sim 2.5$ kpc long, and that tidal tails emerge from its tips to form what it is known as the Sgr stream. The main body of the galaxy, strongly sheared by tidal forces, is a triaxial (almost prolate) ellipsoid with its longest principal axis of inertia inclined $43^\circ\pm6^\circ$ with respect to the plane of the sky and axis ratios of 1:0.67:0.60. Its external regions are expanding mainly along its longest principal axis, yet the galaxy conserves an inner core of about $500\times330\times300$ pc that shows no net expansion and is rotating at $v_{\rm rot} = 4.13 \pm 0.16$ ${\rm{ km \ s^{-1}}}$. The internal angular momentum of Sgr forms an angle $\theta = 18^\circ\pm6^\circ$ with respect to its orbital angular momentum, meaning that the galaxy is in an inclined prograde orbit around the Milky Way. We compared our results with predictions from $N$-body models with spherical, pressure-supported progenitors and a model whose progenitor is a flattened rotating disk. Only the rotating model, based on preexisting simulations aimed at reproducing the line-of-sight velocity gradients observed in Sgr, was able to reproduce the observed properties in the core of the galaxy.


title: Local most-probable routes and classic-quantum correspondence in strong-field two-dimensional tunneling ionization

abstract: We study ionization of atoms in strong two-dimensional (2D) laser fields with various forms, numerically and analytically. We focus on the local most-probable tunneling routes (some specific electron trajectories) which are corresponding to the local maxima of photoelectron momentum distributions (PMDs). By making classic-quantum correspondence, we obtain a condition for these routes characterized by the electron position at the tunnel exit. With comparing the identified routes with the classical limit and the partial-decoupling approximation where it is assumed that tunneling is dominated by the main component of the 2D field, some semiclassical properties of 2D tunneling are addressed. The local maxima of PMD related to the local most-probable routes can be used as one of the preferred observables in ultrafast measurements.


title: Quantum kinetic theory for spin-1/2 fermions in Wigner function formalism

abstract: We give a brief overview of the kinetic theory for spin-1/2 fermions in Wigner function formulism. The chiral and spin kinetic equations can be derived from equations for Wigner functions. A general Wigner function has 16 components which satisfy 32 coupled equations. For massless fermions, the number of independent equations can be significantly reduced due to the decoupling of left-handed and right-handed particles. It can be proved that out of many components of Wigner functions and their coupled equations, only one kinetic equation for the distribution function is independent. This is called the disentanglement theorem for Wigner functions of chiral fermions. For massive fermions, it turns out that one particle distribution function and three spin distribution functions are independent and satisfy four kinetic equations. Various chiral and spin effects such as chiral magnetic and votical effects, the chiral seperation effect, spin polarization effects can be consistently described in the formalism.


title: Sharp inequalities for maximal operators on finite graphs, II

abstract: Let $M_{G}$ be the centered Hardy-Littlewood maximal operator on a finite graph $G$. We find $\underset{p\to \infty}{\lim}\|M_{G}\|_{p}^{p }$ when $G$ is the start graph ($S_n$) and the complete graph ($K_n$), and we fully describe $\|M_{S_n}\|_{p}$ and the corresponding extremizers for $p\in (1,2)$. We prove that $\underset{p\to \infty}{\lim}\|M_{S_n}\|_{p}^{p }=\frac{1+\sqrt{n}}{2}$ when $n\ge 25$. Also, we compute the best constant ${\bf C}_{S_n,2}$ such that for every $f:V\to \mathbb{R}$ we have $Var_{2}M_{S_n}f\le {\bf C}_{S_n,2} Var_{2}f$. We prove that ${\bf C}_{S_n,2}=\frac{(n^2-n-1)^{1/2}}{n}$ for all $n\geq 3$ and characterize the extremizers. Moreover, when $M$ is the Hardy-Littlewood maximal operator on $\mathbb{Z}$, we compute the best constant ${\bf C}_{p}$ such that $Var_{p}Mf\le {\bf C}_{p}\|f\|_{p}$ for $p\in (\frac{1}{2},1)$ and we describe the extremizers.


title: Lets Play Music: Audio-driven Performance Video Generation

abstract: We propose a new task named Audio-driven Per-formance Video Generation (APVG), which aims to synthesizethe video of a person playing a certain instrument guided bya given music audio clip. It is a challenging task to gener-ate the high-dimensional temporal consistent videos from low-dimensional audio modality. In this paper, we propose a multi-staged framework to achieve this new task to generate realisticand synchronized performance video from given music. Firstly,we provide both global appearance and local spatial informationby generating the coarse videos and keypoints of body and handsfrom a given music respectively. Then, we propose to transformthe generated keypoints to heatmap via a differentiable spacetransformer, since the heatmap offers more spatial informationbut is harder to generate directly from audio. Finally, wepropose a Structured Temporal UNet (STU) to extract bothintra-frame structured information and inter-frame temporalconsistency. They are obtained via graph-based structure module,and CNN-GRU based high-level temporal module respectively forfinal video generation. Comprehensive experiments validate theeffectiveness of our proposed framework.


title: Quark-sector Lorentz violation in $Z$-boson production

abstract: Quark-sector Lorentz violation is studied in the context of Drell-Yan dilepton production including effects from Z-boson exchange. We show the chiral nature of the weak interactions enables parity-violating and spin-dependent effects to be studied using unpolarized initial states. Constraints are placed on dimensionless and CPT-even coefficients for Lorentz violation for the first two generations of quarks using measurements from the Large Hadron Collider.


title: Separability in (strongly) topological gyrogroups

abstract: Separability is one of the most basic and important topological properties. In this paper, the separability in (strongly) topological gyrogroups is studied. It is proved that every first-countable left {\omega}-narrow strongly topological gyrogroup is separable. Furthermore, it is shown that if a feathered strongly topological gyrogroup G is isomorphic to a subgyrogroup of a separable strongly topological gyrogroup, then G is separable. Therefore, if a metrizable strongly topological gyrogroup G is isomorphic to a subgyrogroup of a separable strongly topological gyrogroup, then G is separable, and if a locally compact strongly topological gyrogroup G is isomorphic to a subgyrogroup of a separable strongly topological gyrogroup, then G is separable.


title: Fast logic with slow qubits: microwave-activated controlled-Z gate on low-frequency fluxoniums

abstract: We demonstrate a controlled-Z gate between capacitively coupled fluxonium qubits with transition frequencies $72.3~\textrm{MHz}$ and $136.3~\textrm{MHz}$. The gate is activated by a $61.6~\textrm{ns}$ long pulse at the frequency between non-computational transitions $|10\rangle - |20\rangle$ and $|11\rangle - |21\rangle$, during which the qubits complete only $4$ and $8$ Larmor periods, respectively. The measured gate error of $(8\pm1)\times 10^{-3}$ is limited by decoherence in the non-computational subspace, which will likely improve in the next generation devices. Although our qubits are about fifty times slower than transmons, the two-qubit gate is faster than microwave-activated gates on transmons, and the gate error is on par with the lowest reported. Architectural advantages of low-frequency fluxoniums include long qubit coherence time, weak hybridization in the computational subspace, suppressed residual $ZZ$-coupling rate (here $46~\mathrm{kHz}$), and absence of either excessive parameter matching or complex pulse shaping requirements.


title: GPR-based Model Reconstruction System for Underground Utilities Using GPRNet

abstract: Ground Penetrating Radar (GPR) is one of the most important non-destructive evaluation (NDE) instruments to detect and locate underground objects (i.e., rebars, utility pipes). Many previous researches focus on GPR image-based feature detection only, and none can process sparse GPR measurements to successfully reconstruct a very fine and detailed 3D model of underground objects for better visualization. To address this problem, this paper presents a novel robotic system to collect GPR data, localize the underground utilities, and reconstruct the underground objects' dense point cloud model. This system is composed of three modules: 1) visual-inertial-based GPR data collection module, which tags the GPR measurements with positioning information provided by an omnidirectional robot; 2) a deep neural network (DNN) migration module to interpret the raw GPR B-scan image into a cross-section of object model; 3) a DNN-based 3D reconstruction module, i.e., GPRNet, to generate underground utility model with the fine 3D point cloud. In this paper, both the quantitative and qualitative experiment results verify our method that can generate a dense and complete point cloud model of pipe-shaped utilities based on a sparse input, i.e., GPR raw data incompleteness and various noise. The experiment results on synthetic data and field test data further support the effectiveness of our approach.


title: The distances of 61 PGCCs in the Second Galactic Quadrant

abstract: Determining the distances to the Planck Galactic cold clumps (PGCCs) is crucial for the measurement of their physical parameters and the study of their Galactic distribution. Based on two large catalogues of stars with robust distances and reddening estimates from the literature, we have estimated accurate distances to 61 PGCCs in the second Galactic quadrant. For this purpose, we have selected stars along the sightlines overlapping with the cores of the sample clumps and fitted the reddening profiles with a simple reddening model. The typical uncertainties of the resultant distances of these PGCCs are less than 8 per cent. The new estimates differ significantly from the kinematic values, well known to suffer from large errors. With the new distances, we have updated the physical properties including the radii, masses and virial parameters of the cores of the PGCCs.


title: Thermodynamical $u$-formalism I: measures of maximal $u$-entropy for maps that factor over Anosov

abstract: We construct measures of maximal $u$-entropy for any partially hyperbolic diffeomorphism that factors over an Anosov torus automorphism and has mostly contracting center direction. The space of such measures has a finite dimension, and its extreme points are ergodic measures with pairwise disjoint supports.


title: Towards Disentangling Latent Space for Unsupervised Semantic Face Editing

abstract: Facial attributes in StyleGAN generated images are entangled in the latent space which makes it very difficult to independently control a specific attribute without affecting the others. Supervised attribute editing requires annotated training data which is difficult to obtain and limits the editable attributes to those with labels. Therefore, unsupervised attribute editing in an disentangled latent space is key to performing neat and versatile semantic face editing. In this paper, we present a new technique termed Structure-Texture Independent Architecture with Weight Decomposition and Orthogonal Regularization (STIA-WO) to disentangle the latent space for unsupervised semantic face editing. By applying STIA-WO to GAN, we have developed a StyleGAN termed STGAN-WO which performs weight decomposition through utilizing the style vector to construct a fully controllable weight matrix to regulate image synthesis, and employs orthogonal regularization to ensure each entry of the style vector only controls one independent feature matrix. To further disentangle the facial attributes, STGAN-WO introduces a structure-texture independent architecture which utilizes two independently and identically distributed (i.i.d.) latent vectors to control the synthesis of the texture and structure components in a disentangled way. Unsupervised semantic editing is achieved by moving the latent code in the coarse layers along its orthogonal directions to change texture related attributes or changing the latent code in the fine layers to manipulate structure related ones. We present experimental results which show that our new STGAN-WO can achieve better attribute editing than state of the art methods.


title: Ancient finite entropy flows by powers of curvature in $\mathbb{R}^2$

abstract: We show the existence of non-homothetic ancient flows by powers of curvature embedded in $\mathbb{R}^2$ whose entropy is finite. We determine the Morse indices and kernels of the linearized operator of shrinkers to the flows and construct ancient flows by using unstable eigenfunctions of the linearized operator.


title: Exclusive J/Psi and Psi(2s) photo-production as a probe of QCD low x evolution equations

abstract: We investigate photo-production of vector mesons J/Psi and Psi(2s), based on both HERA and LHC data, using 2 fits of unintegrated gluon distributions. The latter are subject to non-linear Balitsky-Kovchegov evolution (Kutak-Sapeta gluon; KS) and linear next-to-leading order Balitsky-Kuraev-Fadin-Lipatov evolution (Hentschinski-Sabio Vera-Salas; HSS gluon) respectively. Apart from extending previous studies to the case of radially excited charmonium Psi(2s), we further use an improved set of charmonium wave functions and provide an estimate of the uncertainties associated with the HSS gluon. While we observe that the difference between linear and non-linear evolution somehow diminishes and a clear distinction between both HSS and KS gluon is no longer possible using the currently available data-set, we find that the differences between both gluon distributions are enhanced for the ratio of the photo-production cross-sections of Psi(2s) and J/Psi vector mesons.


title: Timing and emission variation of PSR J1733-3716

abstract: We present analysis of the timing noise in PSR J1733-3716, which combines data from Parkes 64-m radio telescope and nearly 15 years of timing data obtained from the Nanshan 25-m radio telescope. The variations in the spin frequency and frequency derivative are determined. The fluctuation in the spin frequency is obvious with an amplitude of 1.94(7)*10 -9 Hz. Variations of the integrated profile at 1369 MHz are detected with the changes occur in the relative peak intensity from the right profile component. From analysis of the single pulse data at 1382 MHz, we detect weak emission states that account for 63% of the whole data, and its duration distribution can be fitted with a power law. The pulsar also exhibits strong emission states, during which the emission shows multiple modes. This includes the normal mode, left mode and the right mode, with the time scales spanning between one and seventeen pulse periods. Such short term variability in pulses contributes to the variation of the integrated profile. Examination of the correlations between the spin parameters and the integrated profiles shows likelihood of a random distribution, which reveals that there is probably no obvious relationship between spin-down rate variations and changes of emission in this pulsar.


title: Tailoring Dzyaloshinskii-Moriya interaction in a transition metal dichalcogenide by dual-intercalation

abstract: Dzyaloshinskii-Moriya interaction (DMI) is vital to form various chiral spin textures, novel behaviors of magnons and permits their potential applications in energy-efficient spintronic devices. Here, we realize a sizable bulk DMI in a transition metal dichalcogenide (TMD) 2H-TaS2 by intercalating Fe atoms, which form the chiral supercells with broken spatial inversion symmetry and also act as the source of magnetic orderings. Using a newly developed protonic gate technology, gate-controlled protons intercalation could further change the carrier density and intensely tune DMI via the Ruderman-Kittel-Kasuya-Yosida mechanism. The resultant giant topological Hall resistivity of 1.4 uohm.cm at -5.2V (about 460% of the zero-bias value) is larger than most of the known magnetic materials. Theoretical analysis indicates that such a large topological Hall effect originates from the two-dimensional Bloch-type chiral spin textures stabilized by DMI, while the large anomalous Hall effect comes from the gapped Dirac nodal lines by spin-orbit interaction. Dual-intercalation in 2HTaS2 provides a model system to reveal the nature of DMI in the large family of TMDs and a promising way of gate tuning of DMI, which further enables an electrical control of the chiral spin textures and related electromagnetic phenomena.


title: Strong in-plane magnetic field induced reemergent superconductivity in the van der Waals heterointerface of NbSe2 and CrCl3

abstract: A magnetic field is generally considered to be incompatible with superconductivity as it tends to spin-polarize electrons and breaks apart the opposite-spin singlet superconducting Cooper pairs. Here, an experimental phenomenon is observed that an intriguing reemergent superconductivity evolves from a conventional superconductivity undergoing a hump-like intermediate phase with a finite electric resistance in the van der Waals heterointerface of layered NbSe2 and CrCl3 flakes. This phenomenon merely occurred when the applied magnetic field is parallel to the sample plane and perpendicular to the electric current direction as compared to the reference sample of a NbSe2 thin flake. The strong anisotropy of the reemergent superconducting phase is pointed to the nature of the Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) state driven by the strong interfacial spin-orbit coupling between NbSe2 and CrCl3 layers. The theoretical picture of FFLO state nodes induced by Josephson vortices collectively pinning is presented for well understanding the experimental observation of the reemergent superconductivity. This finding sheds light on an opportunity to search for the exotic FFLO state in the van der Waals heterostructures with strong interfacial spin-orbit coupling.


title: Unsupervised Learning for Asynchronous Resource Allocation in Ad-hoc Wireless Networks

abstract: We consider optimal resource allocation problems under asynchronous wireless network setting. Without explicit model knowledge, we design an unsupervised learning method based on Aggregation Graph Neural Networks (Agg-GNNs). Depending on the localized aggregated information structure on each network node, the method can be learned globally and asynchronously while implemented locally. We capture the asynchrony by modeling the activation pattern as a characteristic of each node and train a policy-based resource allocation method. We also propose a permutation invariance property which indicates the transferability of the trained Agg-GNN. We finally verify our strategy by numerical simulations compared with baseline methods.


title: Classical calculation of radiative decay rates of hydrogenic Stark states

abstract: The Kepler-Coulomb problem is solved in parabolic coordinates and the Larmor radiation problem is analyzed to complement a previous study performed for the usual representation in spherical polar coordinates. A comparison with quantum spontaneous decay rates shows that for azimuthal quantum number $m = 0$ states only transitions to nearby $n-\Delta n$ principal quantum number states are described properly by the Wentzel-Kramers-Brillouin quantized classical motions, but that for $m > 0$ reasonable results emerge for many values of $\Delta n$. A simple approximate expression for the lifetime of $m \ne 0$ states emerges from the semi-classical analysis.


title: Mathematical modelling of an unstable bent flow using the selective frequency damping method

abstract: The selective frequency damping method was applied to a bent flow. The method was used in an adaptive formulation. The most dangerous frequency was determined by solving an eigenvalue problem. It was found that one of the patterns, steady-state or pulsating, may exist at some relatively high Reynolds numbers. The periodic flow occurs due to the instability of the steady-state flow. This numerical method is easy to use but requires a great deal of time for calculations.


title: An Ultra-High-Vacuum Rotating Sample Manipulator with Cryogenic Cooling

abstract: We report a homebuilt ultra-high-vacuum (UHV) rotating sample manipulator with cryogenic cooling. The sample holder is thermally anchored to a built-in cryogenic cold head through flexible copper beryllium strips, permitting continuous sample rotation. A similar contact mechanism is implemented for the electrical wiring to the sample holder for thermometry. The apparatus thus enables continuous sample rotation at regulated cryogenic temperatures in a UHV environment. We discuss the potential applications of this apparatus for cryogenic sputtering.


title: Estimation of Dynamical Systems in Noisy Conditions and with Constraints

abstract: When measurements from dynamical systems are noisy, it is useful to have estimation algorithms that have low sensitivity to measurement noises and outliers. In the first set of results described in this paper we obtain optimal estimators for linear dynamical systems with $\epsilon$ insensitive loss functions. The $\epsilon$ insensitive loss function, which is often used in Support Vector Machines, provides greater robustness when the measurements are biased and very noisy as the algorithm tolerates small errors in prediction which in turn makes the estimates less sensitive to measurement noises. Apart from $\epsilon$ insensitive quadratic loss function, estimation algorithms are also derived for $\epsilon$ insensitive Huber M loss function which provides robustness in presence of both small noises as well as outliers. Robustness in presence of outliers is achieved with Huber cost function based estimator as the error penalty function switches from quadratic to linear for errors beyond certain threshold. The second set of results in the paper describe algorithms for estimation when apart from general description of dynamics of the system, one also has additional information about states and exogenous signals such as known range of some states or prior information about the maximum magnitude of noises/disturbances. While the proposed approaches have similarities to Kalman-Bucy or $\mathcal{H}_2$ smoothing algorithm, the algorithms are not linear in measurements but are easily implemented as optimal estimates are obtained by solving a standard quadratic optimization problem with linear constraints. For all cases, algorithms are proposed not only for filtering and smoothing but also for prediction of future states.


title: Regular $m$-gonal forms

abstract: In this paper, we show that for a fixed rank $n$, there are only finitely many $m$ for which there is a regular $m$-gonal form of rank $n$ and determine every type of the (generalized) regular $m$-gonal form for every sufficiently large $m$.


title: A finiteness theorem for universal $m$-gonal forms

abstract: In this paper, we study the set of positive integers that characterize the universality of $m$-gonal form.


title: Heider Balance under Disordered Triadic Interactions

abstract: The Heider balance addresses three-body interactions with the assumption that triads are equally important in the dynamics of the network. In many networks, the relations do not have the same strength so, triads are differently weighted. Now, the question is how social networks evolve to reduce the number of unbalanced triangles when they are weighted? Are the results foreseeable based on what we have already learned from the unweighted balance? To find the solution, we consider a fully connected network in which triads are assigned with different random weights. Weights are coming from Gaussian probability distribution with mean $\mu$ and variance $\sigma$. We study this system in two regimes : (\RN{1}) the ratio of $\frac{\mu}{\sigma} \ge 1 $ corresponds to weak disorder (small variance) that triads' weight are approximately the same, (\RN{2}) $\frac{\mu}{\sigma} < 1 $ counts for strong disorder (big variance) and weights are remarkably diverse. Investigating the structural evolution of such a network is our intention. We see disorder plays a key role in determining the critical temperature of the system. Using the mean-field method to present an analytic solution for the system represents that the system undergoes a first-order phase transition. For weak disorder, our simulation results display the system reaches the global minimum as temperature decreases whereas for high disorder we manage to see a seudo-Kondo effect in triadic interactions. The Kondo effect explains the anomalous increase in electrical resistivity of metals due to magnetic impurities at low temperatures. Similar behavior is seen in the energy versus temperature in our work for the second regime and the system does not reach a global minimum.


title: Random Activations in Primal-Dual Splittings for Monotone Inclusions with a priori Information

abstract: In this paper, we propose a numerical approach for solving composite primal-dual monotone inclusions with a priori information. The underlying a priori information set is represented by the intersection of fixed point sets of a finite number of operators, and we propose and algorithm that activates the corresponding set by following a finite-valued random variable at each iteration. Our formulation is flexible and includes, for instance, deterministic and Bernoulli activations over cyclic schemes, and Kaczmarz-type random activations. The almost sure convergence of the algorithm is obtained by means of properties of stochastic Quasi-Fej\'er sequences. We also recover several primal-dual algorithms for monotone inclusions in the context without a priori information and classical algorithms for solving convex feasibility problems and linear systems. In the context of convex optimization with inequality constraints, any selection of the constraints defines the a priori information set, in which case the operators involved are simply projections onto half spaces. By incorporating random projections onto a selection of the constraints to classical primal-dual schemes, we obtain faster algorithms as we illustrate by means of a numerical application to a stochastic arc capacity expansion problem in a transport network.


title: On the Analysis of Spatially Constrained Power of Two Choice Policies

abstract: We consider a class of power of two choice based assignment policies for allocating users to servers, where both users and servers are located on a two-dimensional Euclidean plane. In this framework, we investigate the inherent tradeoff between the communication cost, and load balancing performance of different allocation policies. To this end, we first design and evaluate a Spatial Power of two (sPOT) policy in which each user is allocated to the least loaded server among its two geographically nearest servers sequentially. When servers are placed on a two-dimensional square grid, sPOT maps to the classical Power of two (POT) policy on the Delaunay graph associated with the Voronoi tessellation of the set of servers. We show that the associated Delaunay graph is 4-regular and provide expressions for asymptotic maximum load using results from the literature. For uniform placement of servers, we map sPOT to a classical balls and bins allocation policy with bins corresponding to the Voronoi regions associated with the second order Voronoi diagram of the set of servers. We provide expressions for the lower bound on the asymptotic expected maximum load on the servers and prove that sPOT does not achieve POT load balancing benefits. However, experimental results suggest the efficacy of sPOT with respect to expected communication cost. Finally, we propose two non-uniform server sampling based POT policies that achieve the best of both the performance metrics. Experimental results validate the effctiveness of our proposed policies.


title: Superconvergent Non-Polynomial Approximations

abstract: In this paper, we introduce a superconvergent approximation method that employs radial basis functions (RBFs) in the numerical solution of conservation laws. The use of RBFs for interpolation and approximation is a well developed area of research. Of particular interest in this work is the development of high order finite volume (FV) weighted essentially non-oscillatory (WENO) methods, which utilize RBF approximations to obtain required data at cell interfaces. Superconvergence is addressed through an analysis of the truncation error, resulting in expressions for the shape parameters that lead to improvements in the accuracy of the approximations. This study seeks to address the practical elements of the approach, including the evaluations of shape parameters as well as hybrid implementation. To highlight the effectiveness of the non-polynomial basis, in shock-capturing, the proposed methods are applied to one-dimensional hyperbolic and weakly hyperbolic systems of conservation laws and compared with several well-known FV WENO schemes in the literature. In the case of the non-smooth, weakly hyperbolic test problem, notable improvements are observed in predicting the location and height of the finite time blowup. The convergence results demonstrate that the proposed schemes attain notable improvements in accuracy, as indicated by the analysis of the reconstructions. We also include a discussion regarding extensions to higher dimensional problems, along with convergence results for a nonlinear scalar problem.


title: Utilizing Every Image Object for Semi-supervised Phrase Grounding

abstract: Phrase grounding models localize an object in the image given a referring expression. The annotated language queries available during training are limited, which also limits the variations of language combinations that a model can see during training. In this paper, we study the case applying objects without labeled queries for training the semi-supervised phrase grounding. We propose to use learned location and subject embedding predictors (LSEP) to generate the corresponding language embeddings for objects lacking annotated queries in the training set. With the assistance of the detector, we also apply LSEP to train a grounding model on images without any annotation. We evaluate our method based on MAttNet on three public datasets: RefCOCO, RefCOCO+, and RefCOCOg. We show that our predictors allow the grounding system to learn from the objects without labeled queries and improve accuracy by 34.9\% relatively with the detection results.


title: A Sufficient condition for compactness of Hankel operators

abstract: Let $\Omega$ be a bounded convex domain in $\mathbb{C}^{n}$. We show that if $\varphi \in C^{1}(\overline{\Omega})$ is holomorphic along analytic varieties in $b\Omega$, then $H^{q}_{\varphi}$, the Hankel operator with symbol $\varphi$, is compact. We have shown the converse earlier, so that we obtain a characterization of compactness of these operators in terms of the behavior of the symbol relative to analytic structure in the boundary. A corollary is that Toeplitz operators with these symbols are Fredholm (of index zero).


title: Statistics on Lefschetz thimbles: Bell/Leggett-Garg inequalities and the classical-statistical approximation

abstract: Inspired by Lefschetz thimble theory, we treat Quantum Field Theory as a statistical theory with a complex Probability Distribution Function (PDF). Such complex-valued PDFs permit the violation of Bell-type inequalities, which cannot be violated by a real-valued, non-negative PDF. In this paper, we consider the Classical-Statistical approximation in the context of Bell-type inequalities, viz. the familiar (spatial) Bell inequalities and the temporal Leggett-Garg inequalities. We show that the Classical-Statistical approximation does not violate temporal Bell-type inequalities, even though it is in some sense exact for a free theory, whereas the full quantum theory does. We explain the origin of this discrepancy, and point out the key difference between the spatial and temporal Bell-type inequalities. We comment on the import of this work for applications of the Classical-Statistical approximation.


title: Compositional Scalable Object SLAM

abstract: We present a fast, scalable, and accurate Simultaneous Localization and Mapping (SLAM) system that represents indoor scenes as a graph of objects. Leveraging the observation that artificial environments are structured and occupied by recognizable objects, we show that a compositional scalable object mapping formulation is amenable to a robust SLAM solution for drift-free large scale indoor reconstruction. To achieve this, we propose a novel semantically assisted data association strategy that obtains unambiguous persistent object landmarks, and a 2.5D compositional rendering method that enables reliable frame-to-model RGB-D tracking. Consequently, we deliver an optimized online implementation that can run at near frame rate with a single graphics card, and provide a comprehensive evaluation against state of the art baselines. An open source implementation will be provided at https://placeholder.


title: The GALAH Survey: Accreted stars also inhabit the Spite Plateau

abstract: The ESA Gaia astrometric mission has enabled the remarkable discovery that a large fraction of the stars near the Solar neighbourhood appear to be debris from a single in-falling system, the so-called Gaia-Enceladus-Sausage (GSE). One exciting feature of this result is that it gives astronomers for the first time a large sample of easily observable unevolved stars that formed in an extra-Galactic environment, which can be compared to stars that formed within our Milky Way. Here we use these stars to investigate the "Spite Plateau" -- the near-constant lithium abundance observed in metal-poor dwarf stars across a wide range of metallicities (-3<[Fe/H]<-1). In particular our aim is to test whether the stars that formed in the GSE show a different Spite Plateau to other Milky Way stars that inhabit the disk and halo. Individual galaxies could have different Spite Plateaus -- e.g., the ISM could be more depleted in lithium in a lower galactic mass system due to it having a smaller reservoir of gas. We identified 76 GSE dwarf stars observed and analyzed by the GALactic Archeology with HERMES (GALAH) survey as part of its Third Data Release. Orbital actions were used to select samples of Gaia-Enceladus stars, and comparison samples of halo and disk stars. We find that the Gaia-Enceladus stars show the same lithium abundance as other likely accreted stars and in situ Milky Way stars, strongly suggesting that the "lithium problem" is not a consequence of the formation environment. This result fits within the growing consensus that the Spite Plateau, and more generally the "cosmological lithium problem" -- the observed discrepancy between the amount of lithium in warm, metal-poor dwarf stars in our Galaxy, and the amount of lithium predicted to have been produced by Big Bang Nucleosynthesis -- is the result of lithium depletion processes within stars.


title: A method of potential scaling in the study of pseudoconvex domains with noncompact automorphism group

abstract: The affine scaling method has been a typical approach to study complex domains with noncompact automorphism group. In this article, we will introduce an alternative approach, so called, the method of potential scaling to construct a certain class of potential functions of the K\"ahler-Einstein metric. We will also prove that if a bounded pseudoconvex domain admits a potential function of the K\"ahler-Einstein metric whose differential has constant length, then there is an $1$-parameter family of automorphisms.


title: Knowledge-Base Practicality for Cybersecurity Research Ethics Evaluation

abstract: Research ethics in Information and Communications Technology has seen a resurgence in popularity in recent years. Although a number of general ethics standards have been issued, cyber security specifically has yet to see one. Furthermore, such standards are often abstract, lacking in guidance on specific practices. In this paper we compare peer-reviewed ethical analyses of condemned research papers to analyses derived from a knowledge base (KB) of concrete cyber security research ethics best practices. The KB we employ was compiled in prior work from a large random survey of research papers. We demonstrate preliminary evidence that such a KB can be used to yield comparable or more extensive ethical analyses of published cyber security research than expert application of standards like the Menlo Report. We extend the ethical analyses of the reviewed manuscripts, and calculate measures of the efficiency with which the expert versus KB methods yield ethical insights.


title: Generating Large-Scale Trajectories Efficiently using Double Descriptions of Polynomials

abstract: For quadrotor trajectory planning, describing a polynomial trajectory through coefficients and end-derivatives both enjoy their own convenience in energy minimization. We name them double descriptions of polynomial trajectories. The transformation between them, causing most of the inefficiency and instability, is formally analyzed in this paper. Leveraging its analytic structure, we design a linear-complexity scheme for both jerk/snap minimization and parameter gradient evaluation, which possesses efficiency, stability, flexibility, and scalability. With the help of our scheme, generating an energy optimal (minimum snap) trajectory only costs 1 $\mu s$ per piece at the scale up to 1,000,000 pieces. Moreover, generating large-scale energy-time optimal trajectories is also accelerated by an order of magnitude against conventional methods.


title: Quantum transient heat transport in the hyper-parametric oscillator

abstract: We explore nonequilibrium quantum heat transport in nonlinear bosonic systems in the presence of a non-Kerr-type interaction governed by hyper-parametric oscillation due to two-photon hopping between the two cavities. We estimate the thermodynamic response analytically by constructing the $su(2)$ algebra of the nonlinear Hamiltonian and predict that the system exhibits a negative excitation mode. Consequently, this specific form of interaction enables the cooling of the system by inducing a ground state transition when the number of particles increases, even though the interaction strength is small. We demonstrate a transition of the heat current numerically in the presence of symmetric coupling between the system and bath and show long relaxation times in the cooling phase. We compare with the Kerr-type Bose-Hubbard form of interaction induced via cross-phase modulation, which does not exhibit any such transition. We further compute the nonequilibrium heat current in the presence of two baths at different temperatures and observe that the cooling effect for the non-Kerr-type interaction persists. Our findings may help in the manipulation of quantum states using the system's interactions to induce cooling.


title: Restless-UCB, an Efficient and Low-complexity Algorithm for Online Restless Bandits

abstract: We study the online restless bandit problem, where the state of each arm evolves according to a Markov chain, and the reward of pulling an arm depends on both the pulled arm and the current state of the corresponding Markov chain. In this paper, we propose Restless-UCB, a learning policy that follows the explore-then-commit framework. In Restless-UCB, we present a novel method to construct offline instances, which only requires $O(N)$ time-complexity ($N$ is the number of arms) and is exponentially better than the complexity of existing learning policy. We also prove that Restless-UCB achieves a regret upper bound of $\tilde{O}((N+M^3)T^{2\over 3})$, where $M$ is the Markov chain state space size and $T$ is the time horizon. Compared to existing algorithms, our result eliminates the exponential factor (in $M,N$) in the regret upper bound, due to a novel exploitation of the sparsity in transitions in general restless bandit problems. As a result, our analysis technique can also be adopted to tighten the regret bounds of existing algorithms. Finally, we conduct experiments based on real-world dataset, to compare the Restless-UCB policy with state-of-the-art benchmarks. Our results show that Restless-UCB outperforms existing algorithms in regret, and significantly reduces the running time.


title: Adversarial Context Aware Network Embeddings for Textual Networks

abstract: Representation learning of textual networks poses a significant challenge as it involves capturing amalgamated information from two modalities: (i) underlying network structure, and (ii) node textual attributes. For this, most existing approaches learn embeddings of text and network structure by enforcing embeddings of connected nodes to be similar. Then for achieving a modality fusion they use the similarities between text embedding of a node with the structure embedding of its connected node and vice versa. This implies that these approaches require edge information for learning embeddings and they cannot learn embeddings of unseen nodes. In this paper we propose an approach that achieves both modality fusion and the capability to learn embeddings of unseen nodes. The main feature of our model is that it uses an adversarial mechanism between text embedding based discriminator, and structure embedding based generator to learn efficient representations. Then for learning embeddings of unseen nodes, we use the supervision provided by the text embedding based discriminator. In addition this, we propose a novel architecture for learning text embedding that can combine both mutual attention and topological attention mechanism, which give more flexible text embeddings. Through extensive experiments on real-world datasets, we demonstrate that our model makes substantial gains over several state-of-the-art benchmarks. In comparison with previous state-of-the-art, it gives up to 7% improvement in performance in predicting links among nodes seen in the training and up to 12% improvement in performance in predicting links involving nodes not seen in training. Further, in the node classification task, it gives up to 2% improvement in performance.


title: Deep Active Learning with Augmentation-based Consistency Estimation

abstract: In active learning, the focus is mainly on the selection strategy of unlabeled data for enhancing the generalization capability of the next learning cycle. For this, various uncertainty measurement methods have been proposed. On the other hand, with the advent of data augmentation metrics as the regularizer on general deep learning, we notice that there can be a mutual influence between the method of unlabeled data selection and the data augmentation-based regularization techniques in active learning scenarios. Through various experiments, we confirmed that consistency-based regularization from analytical learning theory could affect the generalization capability of the classifier in combination with the existing uncertainty measurement method. By this fact, we propose a methodology to improve generalization ability, by applying data augmentation-based techniques to an active learning scenario. For the data augmentation-based regularization loss, we redefined cutout (co) and cutmix (cm) strategies as quantitative metrics and applied at both model training and unlabeled data selection steps. We have shown that the augmentation-based regularizer can lead to improved performance on the training step of active learning, while that same approach can be effectively combined with the uncertainty measurement metrics proposed so far. We used datasets such as FashionMNIST, CIFAR10, CIFAR100, and STL10 to verify the performance of the proposed active learning technique for multiple image classification tasks. Our experiments show consistent performance gains for each dataset and budget scenario.


title: The Darcy problem with porosity depending exponentially on the pressure

abstract: We consider the flow of a viscous incompressible fluid through a porous medium. We allow the permeability of the medium to depend exponentially on the pressure and provide an analysis for this model. We study a splitting formulation where a convection diffusion problem is used to define the permeability, which is then used in a linear Darcy equation. We also study a discretization of this problem, and provide an error analysis for it.


title: Periodic points on the regular and double $n$-gon surfaces

abstract: Using the transfer principle, we classify the periodic points on the regular $n$-gon and double $n$-gon translation surfaces and deduce consequences for the finite blocking problem on rational triangles that unfold to these surfaces.


title: Learning to Utilize Shaping Rewards: A New Approach of Reward Shaping

abstract: Reward shaping is an effective technique for incorporating domain knowledge into reinforcement learning (RL). Existing approaches such as potential-based reward shaping normally make full use of a given shaping reward function. However, since the transformation of human knowledge into numeric reward values is often imperfect due to reasons such as human cognitive bias, completely utilizing the shaping reward function may fail to improve the performance of RL algorithms. In this paper, we consider the problem of adaptively utilizing a given shaping reward function. We formulate the utilization of shaping rewards as a bi-level optimization problem, where the lower level is to optimize policy using the shaping rewards and the upper level is to optimize a parameterized shaping weight function for true reward maximization. We formally derive the gradient of the expected true reward with respect to the shaping weight function parameters and accordingly propose three learning algorithms based on different assumptions. Experiments in sparse-reward cartpole and MuJoCo environments show that our algorithms can fully exploit beneficial shaping rewards, and meanwhile ignore unbeneficial shaping rewards or even transform them into beneficial ones.


title: A Black-Box Approach to Post-Quantum Zero-Knowledge in Constant Rounds

abstract: In a recent seminal work, Bitansky and Shmueli (STOC '20) gave the first construction of a constant round zero-knowledge argument for NP secure against quantum attacks. However, their construction has several drawbacks compared to the classical counterparts. Specifically, their construction only achieves computational soundness, requires strong assumptions of quantum hardness of learning with errors (QLWE assumption) and the existence of quantum fully homomorphic encryption (QFHE), and relies on non-black-box simulation. In this paper, we resolve these issues at the cost of weakening the notion of zero-knowledge to what is called $\epsilon$-zero-knowledge. Concretely, we construct the following protocols: - We construct a constant round interactive proof for NP that satisfies statistical soundness and black-box $\epsilon$-zero-knowledge against quantum attacks assuming the existence of collapsing hash functions, which is a quantum counterpart of collision-resistant hash functions. Interestingly, this construction is just an adapted version of the classical protocol by Goldreich and Kahan (JoC '96) though the proof of $\epsilon$-zero-knowledge property against quantum adversaries requires novel ideas. - We construct a constant round interactive argument for NP that satisfies computational soundness and black-box $\epsilon$-zero-knowledge against quantum attacks only assuming the existence of post-quantum one-way functions. At the heart of our results is a new quantum rewinding technique that enables a simulator to extract a committed message of a malicious verifier while simulating verifier's internal state in an appropriate sense.


title: HILONet: Hierarchical Imitation Learning from Non-Aligned Observations

abstract: It is challenging learning from demonstrated observation-only trajectories in a non-time-aligned environment because most imitation learning methods aim to imitate experts by following the demonstration step-by-step. However, aligned demonstrations are seldom obtainable in real-world scenarios. In this work, we propose a new imitation learning approach called Hierarchical Imitation Learning from Observation(HILONet), which adopts a hierarchical structure to choose feasible sub-goals from demonstrated observations dynamically. Our method can solve all kinds of tasks by achieving these sub-goals, whether it has a single goal position or not. We also present three different ways to increase sample efficiency in the hierarchical structure. We conduct extensive experiments using several environments. The results show the improvement in both performance and learning efficiency.


title: Stochastic Approximation for High-frequency Observations in Data Assimilation

abstract: With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but their frequency results in a plethora of computational problems in data assimilation tasks. The high-frequency of these observations has been traditionally dealt with by using data modification strategies such as accumulation, averaging, and sampling. However, these data modification strategies will reduce the quality of the estimates, which may be untenable for many systems. Therefore, to ensure high-quality estimates, we adapt stochastic approximation methods to address the unique challenges of high-frequency observations in data assimilation. As a result, we are able to produce estimates that leverage all of the observations in a manner that avoids the aforementioned computational problems and preserves the statistical accuracy of the estimates.


title: Tracking Counterfeit Cryptocurrency End-to-end

abstract: The production of counterfeit money has a long history. It refers to the creation of imitation currency that is produced without the legal sanction of government. With the growth of the cryptocurrency ecosystem, there is expanding evidence that counterfeit cryptocurrency has also appeared. In this paper, we empirically explore the presence of counterfeit cryptocurrencies on Ethereum and measure their impact. By analyzing over 190K ERC-20 tokens (or cryptocurrencies) on Ethereum, we have identified 2, 117 counterfeit tokens that target 94 of the 100 most popular cryptocurrencies. We perform an end-to-end characterization of the counterfeit token ecosystem, including their popularity, creators and holders, fraudulent behaviors and advertising channels. Through this, we have identified two types of scams related to counterfeit tokens and devised techniques to identify such scams. We observe that over 7,104 victims were deceived in these scams, and the overall financial loss sums to a minimum of $ 17 million (74,271.7 ETH). Our findings demonstrate the urgency to identify counterfeit cryptocurrencies and mitigate this threat.


title: AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection

abstract: Recent studies have shown that the performance of forgery detection can be improved with diverse and challenging Deepfakes datasets. However, due to the lack of Deepfakes datasets with large variance in appearance, which can be hardly produced by recent identity swapping methods, the detection algorithm may fail in this situation. In this work, we provide a new identity swapping algorithm with large differences in appearance for face forgery detection. The appearance gaps mainly arise from the large discrepancies in illuminations and skin colors that widely exist in real-world scenarios. However, due to the difficulties of modeling the complex appearance mapping, it is challenging to transfer fine-grained appearances adaptively while preserving identity traits. This paper formulates appearance mapping as an optimal transport problem and proposes an Appearance Optimal Transport model (AOT) to formulate it in both latent and pixel space. Specifically, a relighting generator is designed to simulate the optimal transport plan. It is solved via minimizing the Wasserstein distance of the learned features in the latent space, enabling better performance and less computation than conventional optimization. To further refine the solution of the optimal transport plan, we develop a segmentation game to minimize the Wasserstein distance in the pixel space. A discriminator is introduced to distinguish the fake parts from a mix of real and fake image patches. Extensive experiments reveal that the superiority of our method when compared with state-of-the-art methods and the ability of our generated data to improve the performance of face forgery detection.


title: Defense-friendly Images in Adversarial Attacks: Dataset and Metrics for Perturbation Difficulty

abstract: Dataset bias is a problem in adversarial machine learning, especially in the evaluation of defenses. An adversarial attack or defense algorithm may show better results on the reported dataset than can be replicated on other datasets. Even when two algorithms are compared, their relative performance can vary depending on the dataset. Deep learning offers state-of-the-art solutions for image recognition, but deep models are vulnerable even to small perturbations. Research in this area focuses primarily on adversarial attacks and defense algorithms. In this paper, we report for the first time, a class of robust images that are both resilient to attacks and that recover better than random images under adversarial attacks using simple defense techniques. Thus, a test dataset with a high proportion of robust images gives a misleading impression about the performance of an adversarial attack or defense. We propose three metrics to determine the proportion of robust images in a dataset and provide scoring to determine the dataset bias. We also provide an ImageNet-R dataset of 15000+ robust images to facilitate further research on this intriguing phenomenon of image strength under attack. Our dataset, combined with the proposed metrics, is valuable for unbiased benchmarking of adversarial attack and defense algorithms.


title: Variations of helioseismic parameters due to magnetic field generated by a flux transport model

abstract: The change of sound speed has been found at the base of the convection during the solar cycles, which can be used to constrain the solar internal magnetic field. We aim to check whether the magnetic field generated by the solar dynamo can lead to the cyclic variation of the sound speed detected through helioseismology. The basic configuration of magnetic field in the solar interior was obtained by using a Babcock-Leighton (BL) type flux transport dynamo. We reconstructed one-dimensional solar models by assimilating magnetic field generated by an established dynamo and examined their influences on the structural variables. The results show that magnetic field generated by the dynamo is able to cause noticeable change of the sound speed profile at the base of the convective zone during a solar cycle. Detailed features of this theoretical prediction are also similar to those of the helioseismic results in solar cycle 23 by adjusting the free parameters of the dynamo model.


title: The causal foundations of applied probability and statistics

abstract: Statistical science (as opposed to mathematical statistics) involves far more than probability theory, for it requires realistic causal models of data generators - even for purely descriptive goals. Statistical decision theory requires more causality: Rational decisions are actions taken to minimize costs while maximizing benefits, and thus require explication of causes of loss and gain. Competent statistical practice thus integrates logic, context, and probability into scientific inference and decision using narratives filled with causality. This reality was seen and accounted for intuitively by the founders of modern statistics, but was not well recognized in the ensuing statistical theory (which focused instead on the causally inert properties of probability measures). Nonetheless, both statistical foundations and basic statistics can and should be taught using formal causal models. The causal view of statistical science fits within a broader information-processing framework which illuminates and unifies frequentist, Bayesian, and related probability-based foundations of statistics. Causality theory can thus be seen as a key component connecting computation to contextual information, not extra-statistical but instead essential for sound statistical training and applications.


title: BW-EDA-EEND: Streaming End-to-End Neural Speaker Diarization for a Variable Number of Speakers

abstract: We present a novel online end-to-end neural diarization system, BW-EDA-EEND, that processes data incrementally for a variable number of speakers. The system is based on the Encoder-Decoder-Attractor (EDA) architecture of Horiguchi et al., but utilizes the incremental Transformer encoder, attending only to its left contexts and using block-level recurrence in the hidden states to carry information from block to block, making the algorithm complexity linear in time. We propose two variants: For unlimited-latency BW-EDA-EEND, which processes inputs in linear time, we show only moderate degradation for up to two speakers using a context size of 10 seconds compared to offline EDA-EEND. With more than two speakers, the accuracy gap between online and offline grows, but the algorithm still outperforms a baseline offline clustering diarization system for one to four speakers with unlimited context size, and shows comparable accuracy with context size of 10 seconds. For limited-latency BW-EDA-EEND, which produces diarization outputs block-by-block as audio arrives, we show accuracy comparable to the offline clustering-based system.


title: A Multi-resolution Model for Histopathology Image Classification and Localization with Multiple Instance Learning

abstract: Histopathological images provide rich information for disease diagnosis. Large numbers of histopathological images have been digitized into high resolution whole slide images, opening opportunities in developing computational image analysis tools to reduce pathologists' workload and potentially improve inter- and intra- observer agreement. Most previous work on whole slide image analysis has focused on classification or segmentation of small pre-selected regions-of-interest, which requires fine-grained annotation and is non-trivial to extend for large-scale whole slide analysis. In this paper, we proposed a multi-resolution multiple instance learning model that leverages saliency maps to detect suspicious regions for fine-grained grade prediction. Instead of relying on expensive region- or pixel-level annotations, our model can be trained end-to-end with only slide-level labels. The model is developed on a large-scale prostate biopsy dataset containing 20,229 slides from 830 patients. The model achieved 92.7% accuracy, 81.8% Cohen's Kappa for benign, low grade (i.e. Grade group 1) and high grade (i.e. Grade group >= 2) prediction, an area under the receiver operating characteristic curve (AUROC) of 98.2% and an average precision (AP) of 97.4% for differentiating malignant and benign slides. The model obtained an AUROC of 99.4% and an AP of 99.8% for cancer detection on an external dataset.


title: Multi-task learning for electronic structure to predict and explore molecular potential energy surfaces

abstract: We refine the OrbNet model to accurately predict energy, forces, and other response properties for molecules using a graph neural-network architecture based on features from low-cost approximated quantum operators in the symmetry-adapted atomic orbital basis. The model is end-to-end differentiable due to the derivation of analytic gradients for all electronic structure terms, and is shown to be transferable across chemical space due to the use of domain-specific features. The learning efficiency is improved by incorporating physically motivated constraints on the electronic structure through multi-task learning. The model outperforms existing methods on energy prediction tasks for the QM9 dataset and for molecular geometry optimizations on conformer datasets, at a computational cost that is thousand-fold or more reduced compared to conventional quantum-chemistry calculations (such as density functional theory) that offer similar accuracy.


title: Implications of inertial subrange scaling for stably stratified mixing

abstract: The effects of turbulent dynamic range on scalar mixing in stably stratified turbulence are investigated by an adaptation of the theoretical passive scalar modelling arguments of Beguier et al. (1978) and demonstrated statistically using direct numerical simulations of statistically stationary homogeneous stratified and sheared turbulence (SHSST). By analysis of inertial and inertial-convective subrange scaling, we show that the relationship between active scalar and turbulence time scales is predicted by the ratio of the Kolmogorov and Oboukhov-Corrsin constants provided there is sufficient scale separation for inertial and inertial-convective subrange scalings to be valid. With this analysis, we show that the turbulent mixing coefficient, $\Gamma \equiv \chi/\epsilon$, that is, within this context defined to be the ratio of available potential energy ($E_p$) and turbulent kinetic energy ($E_k$) dissipation rates, can be estimated by $E_p,E_k$ and a universal constant provided a Reynolds number is sufficiently high, observed here at $Re_b \equiv \epsilon / \nu N^2 \gtrapprox 300$ where $\nu$ is the kinematic viscosity and $N$ is the characteristic buoyancy frequency. We propose a model for diapycnal mixing with robust theoretical parametrisation and asymptotic behaviour in this high-$Re_b$ limit.


title: Cumulative effects of collision integral, strong magnetic field, and quasiparticle description on charge and heat transport in thermal QCD medium

abstract: Our first aim is to explore the effect of the collision integral with the insurance of instantaneous conservation of particle number on charge and heat transport in a thermal QCD medium. The second aim is to see how the dimensional reduction due to strong magnetic field (B) modulates the transport through the entangled effects, {\em such as} collision-time and occupation probability etc. in collision integral. The final aim is to check how the quasiparticle description through dispersion relation of thermal QCD in strong B, alters the aforesaid conclusions. We observe that modified collision term expedites both transport, which is manifested by large magnitudes of electrical ($\sigma_{\rm el}$) and thermal ($\kappa$) conductivities, in comparison to relaxation-collision term. As a corollary, Lorenz number is dominated by the later and Knudsen number is by the former. However, strong B not only flips the dominance of collision term in heat transport, it also causes drastic enhancement of both $\sigma_{\rm el}$ and $\kappa$ and reduction in specific heat. As a result, the equilibration factor, Knudsen number becomes much larger than one, which defies physical interpretation. Finally, quasiparticle description in the absence of strong B impedes the transport of charge and heat, resulting in the meagre decrease of conductivities, however, strong B does noticeable observations: conductivities now gets reduced to physically plausible values, T-dependence of $\sigma_{\rm el}$ gets reversed, {\em i.e.} it now decreases with T, effect of collision integral gets smeared in $\kappa$ etc. Knudsen number thus becomes much smaller than one, implying that the system be remained in equilibrium. These findings attribute to the fact that the collective modes in the dispersion relation of thermal QCD in strong B sets in much larger scale, manifested by large in-medium masses.

categories: hep-ph cond-mat.soft cond-mat.stat-mech cond-mat.str-el nucl-th


title: Nonparametric Variable Screening with Optimal Decision Stumps

abstract: Decision trees and their ensembles are endowed with a rich set of diagnostic tools for ranking and screening variables in a predictive model. Despite the widespread use of tree based variable importance measures, pinning down their theoretical properties has been challenging and therefore largely unexplored. To address this gap between theory and practice, we derive finite sample performance guarantees for variable selection in nonparametric models using a single-level CART decision tree (a decision stump). Under standard operating assumptions in variable screening literature, we find that the marginal signal strength of each variable and ambient dimensionality can be considerably weaker and higher, respectively, than state-of-the-art nonparametric variable selection methods. Furthermore, unlike previous marginal screening methods that attempt to directly estimate each marginal projection via a truncated basis expansion, the fitted model used here is a simple, parsimonious decision stump, thereby eliminating the need for tuning the number of basis terms. Thus, surprisingly, even though decision stumps are highly inaccurate for estimation purposes, they can still be used to perform consistent model selection.


title: Design of the Compact Processing Module for the ATLAS Tile Calorimeter

abstract: The LHC will undergo a major upgrade starting in 2025 towards the High Luminosity LHC (HL-LHC) to increase the instantaneous luminosity by a factor of 5 to 7 compared to the nominal value. The Phase-II Upgrade (2025-2027) will require the trigger and readout electronics of the ATLAS experiment to operate with the stringent conditions imposed by the HL-LHC. During this upgrade, both on- and off-detector readout electronics of TileCal will be completely replaced with a new data acquisition which will provide full-granularity information to the ATLAS trigger system. The Compact Processing Modules are responsible for the LHC bunch-crossing clock distribution towards the detector, configuration of the on-detector electronics, data acquisition, cell energy reconstruction, and data transmission to the TDAQ interface (TDAQi). The CPM has been designed as an AMC form-factor board equipped with 8 Samtec FireFly modules for communication with the detector, a Xilinx Kintex UltraScale FPGA for data acquisition and processing, a Xilinx Artix 7 FPGA for slow control and monitoring, and other subsystems to generate high-quality clocks for the FPGAs and communications. The high-speed communication with the on-detector electronics is implemented via 32 GigaBit Transceiver links receiving detector data at 9.6 Gbps and transmitting commands and the LHC clock at 4.8 Gbps, while the reconstructed cell energies are transmitted to TDAQi via 4 FULL-mode links. Triggered data is transmitted through a FULL-mode link to the ATLAS TDAQ system via the FELIX network. This paper introduces the design of the Compact Processing Modules for the ATLAS Tile Calorimeter Phase-II Upgrade and the results and experiences with the first prototypes.


title: Positivity and divisibility of alternating descent polynomials

abstract: The alternating descent statistic on permutations was introduced by Chebikin as a variant of the descent statistic. We show that the alternating descent polynomials on permutations are unimodal via a five-term recurrence relation. We also found a quadratic recursion for the alternating major index $q$-analog of the alternating descent polynomials. As an interesting application of this quadratic recursion, we show that $(1+q)^{\lfloor n/2\rfloor}$ divides $\sum_{\pi\in\mathfrak{S}_n}q^{\rm{altmaj}(\pi)}$, where $\mathfrak{S}_n$ is the set of all permutations of $\{1,2,\ldots,n\}$ and $\rm{altmaj}(\pi)$ is the alternating major index of $\pi$. This leads us to discover a $q$-analog of $n!=2^{\ell}m$, $m$ odd, using the statistic of alternating major index. Moreover, we study the $\gamma$-vectors of the alternating descent polynomials by using these two recursions and the ${\textbf{cd}}$-index. Further intriguing conjectures are formulated, which indicate that the alternating descent statistic deserves more work.


title: Investigating Societal Biases in a Poetry Composition System

abstract: There is a growing collection of work analyzing and mitigating societal biases in language understanding, generation, and retrieval tasks, though examining biases in creative tasks remains underexplored. Creative language applications are meant for direct interaction with users, so it is important to quantify and mitigate societal biases in these applications. We introduce a novel study on a pipeline to mitigate societal biases when retrieving next verse suggestions in a poetry composition system. Our results suggest that data augmentation through sentiment style transfer has potential for mitigating societal biases.


title: Context-Aware Answer Extraction in Question Answering

abstract: Extractive QA models have shown very promising performance in predicting the correct answer to a question for a given passage. However, they sometimes result in predicting the correct answer text but in a context irrelevant to the given question. This discrepancy becomes especially important as the number of occurrences of the answer text in a passage increases. To resolve this issue, we propose \textbf{BLANC} (\textbf{BL}ock \textbf{A}ttentio\textbf{N} for \textbf{C}ontext prediction) based on two main ideas: context prediction as an auxiliary task in multi-task learning manner, and a block attention method that learns the context prediction task. With experiments on reading comprehension, we show that BLANC outperforms the state-of-the-art QA models, and the performance gap increases as the number of answer text occurrences increases. We also conduct an experiment of training the models using SQuAD and predicting the supporting facts on HotpotQA and show that BLANC outperforms all baseline models in this zero-shot setting.


title: Heterogeneity in General Multinomial Choice Models

abstract: Different voters behave differently, different governments make different decisions, or different organizations are ruled differently. Many research questions important to political scientists concern choice behavior, which involves dealing with nominal-scale dependent variables. Drawing on the principle of maximum random utility, we propose a flexible and general heterogeneous multinomial logit model for studying differences in choice behavior. The model systematically accounts for heterogeneity that is not captured by classical models, indicates the strength of heterogeneity, and permits examining which explanatory variables cause heterogeneity. As the proposed approach allows incorporating theoretical expectations about heterogeneity into the analysis of nominal dependent variables, it can be applied to a wide range of research problems. Our empirical example uses data on multiparty elections to demonstrate the benefits of the model in the study of heterogeneity in spatial voting.


title: On Interacting Higher Spin Bosonic Gauge Fields in BRST-antifield Formalism

abstract: We examine interacting bosonic higher spin gauge fields in the BRST-antifield formalism. Assuming that an interacting action $S$ is a deformation of the free action with a deformation parameter $g$, we solve the master equation $(S,S)=0$ from the lower orders in $g$. It is shown that choosing a certain cubic interaction as the first order deformation, we can solve the master equation and obtain an action containing all orders in $g$. The anti-ghost number of the obtained action is less than or equal to two. Furthermore we show that the obtained action is lifted to that of interacting bosonic higher spin gauge fields on anti-de Sitter spaces.


title: Entity Linking in 100 Languages

abstract: We propose a new formulation for multilingual entity linking, where language-specific mentions resolve to a language-agnostic Knowledge Base. We train a dual encoder in this new setting, building on prior work with improved feature representation, negative mining, and an auxiliary entity-pairing task, to obtain a single entity retrieval model that covers 100+ languages and 20 million entities. The model outperforms state-of-the-art results from a far more limited cross-lingual linking task. Rare entities and low-resource languages pose challenges at this large-scale, so we advocate for an increased focus on zero- and few-shot evaluation. To this end, we provide Mewsli-9, a large new multilingual dataset (http://goo.gle/mewsli-dataset) matched to our setting, and show how frequency-based analysis provided key insights for our model and training enhancements.


title: Two-parameter counter-diabatic driving in quantum annealing

abstract: We introduce a two-parameter approximate counter-diabatic term into the Hamiltonian of the transverse-field Ising model for quantum annealing to accelerate convergence to the solution, generalizing an existing single-parameter approach. The protocol is equivalent to unconventional diabatic control of the longitudinal and transverse fields in the transverse-field Ising model and thus makes it more feasible for experimental realization than an introduction of new terms such as non-stoquastic catalysts toward the same goal of performance enhancement. We test the idea for the $p$-spin model with $p=3$, which has a first-order quantum phase transition, and show that our two-parameter approach leads to significantly larger ground-state fidelity and lower residual energy than those by traditional quantum annealing as well as by the single-parameter method. We also find a scaling advantage in terms of the time to solution as a function of the system size in a certain range of parameters as compared to the traditional methods.


title: Binary Neural Network Aided CSI Feedback in Massive MIMO System

abstract: In massive multiple-input multiple-output (MIMO) system, channel state information (CSI) is essential for the base station to achieve high performance gain. Recently, deep learning is widely used in CSI compression to fight against the growing feedback overhead brought by massive MIMO in frequency division duplexing system. However, applying neural network brings extra memory and computation cost, which is non-negligible especially for the resource limited user equipment (UE). In this paper, a novel binarization aided feedback network named BCsiNet is introduced. Moreover, BCsiNet variants are designed to boost the performance under customized training and inference schemes. Experiments shows that BCsiNet offers over 30$\times$ memory saving and around 2$\times$ inference acceleration for encoder at UE compared with CsiNet. Furthermore, the feedback performance of BCsiNet is comparable with original CsiNet. The key results can be reproduced with https://github.com/Kylin9511/BCsiNet.


title: Detector blinding attacks on counterfactual quantum key distribution

abstract: Counterfactual quantum key distribution protocols allow two sides to establish a common secret key using an insecure channel and authenticated public communication. As opposed to many other quantum key distribution protocols, part of the quantum state used to establish each bit never leaves the transmitting side, which hinders some attacks. We show how to adapt detector blinding attacks to this setting. In blinding attacks, gated avalanche photodiode detectors are disabled or forced to activate using bright light pulses. We present two attacks that use this ability to compromise the security of counterfactual quantum key distribution. The first is a general attack but technologically demanding (the attacker must be able to reduce the channel loss by half). The second attack could be deployed with easily accessible technology and works for implementations where single photon sources are approximated by attenuated coherent states. The attack is a combination of a photon number splitting attack and the first blinding attack which could be deployed with easily accessible technology. The proposed attacks show counterfactual quantum key distribution is vulnerable to detector blinding and that experimental implementations should include explicit countermeasures against it.


title: Video Big Data Analytics in the Cloud: Research Issues and Challenges

abstract: On the rise of distributed computing technologies, video big data analytics in the cloud have attracted researchers and practitioners' attention. The current technology and market trends demand an efficient framework for video big data analytics. However, the current work is too limited to provide an architecture on video big data analytics in the cloud, including managing and analyzing video big data, the challenges, and opportunities. This study proposes a service-oriented layered reference architecture for intelligent video big data analytics in the cloud. Finally, we identify and articulate several open research issues and challenges, which have been raised by the deployment of big data technologies in the cloud for video big data analytics. This paper provides the research studies and technologies advancing video analyses in the era of big data and cloud computing. This is the first study that presents the generalized view of the video big data analytics in the cloud to the best of our knowledge.


title: Accelerated Additive Schwarz Methods for Convex Optimization with Adaptive Restart

abstract: Based on an observation that additive Schwarz methods for general convex optimization can be interpreted as gradient methods, we propose an acceleration scheme for additive Schwarz methods. Adopting acceleration techniques developed for gradient methods such as momentum and adaptive restarting, the convergence rate of additive Schwarz methods is greatly improved. The proposed acceleration scheme does not require any a priori information on the levels of smoothness and sharpness of a target energy functional, so that it can be applied to various convex optimization problems. Numerical results for linear elliptic problems, nonlinear elliptic problems, nonsmooth problems, and nonsharp problems are provided to highlight the superiority and the broad applicability of the proposed scheme.


title: Amortized Conditional Normalized Maximum Likelihood: Reliable Out of Distribution Uncertainty Estimation

abstract: While deep neural networks provide good performance for a range of challenging tasks, calibration and uncertainty estimation remain major challenges, especially under distribution shift. In this paper, we propose the amortized conditional normalized maximum likelihood (ACNML) method as a scalable general-purpose approach for uncertainty estimation, calibration, and out-of-distribution robustness with deep networks. Our algorithm builds on the conditional normalized maximum likelihood (CNML) coding scheme, which has minimax optimal properties according to the minimum description length principle, but is computationally intractable to evaluate exactly for all but the simplest of model classes. We propose to use approximate Bayesian inference technqiues to produce a tractable approximation to the CNML distribution. Our approach can be combined with any approximate inference algorithm that provides tractable posterior densities over model parameters. We demonstrate that ACNML compares favorably to a number of prior techniques for uncertainty estimation in terms of calibration on out-of-distribution inputs.


title: Center-wise Local Image Mixture For Contrastive Representation Learning

abstract: Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new kind of contrastive learning method, named CLIM, which uses positives from other samples in the dataset. This is achieved by searching local similar samples of the anchor, and selecting samples that are closer to the corresponding cluster center, which we denote as center-wise local image selection. The selected samples are instantiated via an data mixture strategy, which performs as a smoothing regularization. As a result, CLIM encourages both local similarity and global aggregation in a robust way, which we find is beneficial for feature representation. Besides, we introduce \emph{multi-resolution} augmentation, which enables the representation to be scale invariant. We reach 75.5% top-1 accuracy with linear evaluation over ResNet-50, and 59.3% top-1 accuracy when fine-tuned with only 1% labels.


title: A Comparison Study on Infant-Parent Voice Diarization

abstract: We design a framework for studying prelinguistic child voicefrom 3 to 24 months based on state-of-the-art algorithms in di-arization. Our system consists of a time-invariant feature ex-tractor, a context-dependent embedding generator, and a clas-sifier. We study the effect of swapping out different compo-nents of the system, as well as changing loss function, to findthe best performance. We also present a multiple-instancelearning technique that allows us to pre-train our parame-ters on larger datasets with coarser segment boundary labels.We found that our best system achieved 43.8% DER on testdataset, compared to 55.4% DER achieved by LENA soft-ware. We also found that using convolutional feature extrac-tor instead of logmel features significantly increases the per-formance of neural diarization.


title: Cloud-RAN Factory: Instantiating virtualized mobile networks with ONAP

abstract: In this demo, we exhibit the negotiation based on the TM Forum framework (Customer Facing Service and Resource Facing Service) and the deployment of a fully virtualized end-to-end mobile network (including a RAN desegregated into Remote Unit, Distributed Unit and Centralized Unit) by using ONAP, an open-source network automation platform. The various components of mobile network are containerized and deployed by ONAP on top of Kubernetes. The demo is the first illustration of an end-to-end mobile network, which is fully virtualized up to the remote unit, whose architecture is compatible with the Open-RAN framework, and which implements a PHY layer on the basis of 3GPP 7.3 functional split in Open Air Interface code.


title: Exact Phase Transitions of Model RB with Slower-Growing Domains

abstract: The second moment method has always been an effective tool to lower bound the satisfiability threshold of many random constraint satisfaction problems. However, the calculation is usually hard to carry out and as a result, only some loose results can be obtained. In this paper, based on a delicate analysis which fully exploit the power of the second moment method, we prove that random RB instances can exhibit exact phase transition under more relaxed conditions, especially slower-growing domain size. These results are the best by using the second moment method, and new tools should be introduced for any better results.


title: A Black-Box Attack Model for Visually-Aware Recommender Systems

abstract: Due to the advances in deep learning, visually-aware recommender systems (RS) have recently attracted increased research interest. Such systems combine collaborative signals with images, usually represented as feature vectors outputted by pre-trained image models. Since item catalogs can be huge, recommendation service providers often rely on images that are supplied by the item providers. In this work, we show that relying on such external sources can make an RS vulnerable to attacks, where the goal of the attacker is to unfairly promote certain pushed items. Specifically, we demonstrate how a new visual attack model can effectively influence the item scores and rankings in a black-box approach, i.e., without knowing the parameters of the model. The main underlying idea is to systematically create small human-imperceptible perturbations of the pushed item image and to devise appropriate gradient approximation methods to incrementally raise the pushed item's score. Experimental evaluations on two datasets show that the novel attack model is effective even when the contribution of the visual features to the overall performance of the recommender system is modest.


title: Exciton vortices in two-dimensional hybrid perovskite monolayers

abstract: We study theoretically the exciton Bose-Einstein condensation and exciton vortices in a two-dimensional (2D) perovskite (PEA)2PbI4 monolayer. Combining the first-principles calculations and the Keldysh model, the exciton binding energy of (PEA)2PbI4 in a monolayer can approach hundreds meV, which make it possible to observe the excitonic effect at room temperature. Due to the large exciton binding energy, and hence the high density of excitons, we find that the critical temperature of the exciton condensation could approach the liquid nitrogen regime. In presence of perpendicular electric fields, the dipole-dipole interaction between excitons is found to drive the condensed excitons into patterned vortices, as the evolution time of vortex patterns is comparable to the exciton lifetime.


title: Magnetoacoustic Resonance to Probe Quadrupole-Strain Coupling in a Diamond Nitrogen-Vacancy Center as a Spin-Triplet System

abstract: A theory of magnetoacoustic resonance is proposed to measure quadrupole-strain couplings in a spin-triplet state with the $C_{3v}$ point group symmetry, considering the spin-strain interaction in a diamond nitrogen-vacancy (NV) center. Based on the Floquet theory, we demonstrate how the single- and two-phonon transition probabilities depend on the change in the longitudinal and transverse quadrupole couplings, which can be controlled by rotating an applied magnetic field, around the threefold axis. The obtained quadrupole dynamics results are useful for realizing mechanical or ac strain-control of the NV spin as an alternative to the conventional magnetic control by spin resonance.


title: Micro-plasticity in a fragile model binary glass

abstract: Atomistic deformation simulations in the nominally elastic regime are performed for a model binary glass with strain rates as low as $10^{4}$/sec (corresponding to 0.01 shear strain per 1$\mu$sec). A robust elasticity is revealed that exhibits only minor elastic softening, despite quite different degrees of structural relaxation occurring over the four orders of magnitude strain rates considered. A closer inspection of the atomic-scale structure indicates the material response is distinctly different for two types of local atomic environments. A system spanning iscosahedrally coordinated substructure responds purely elastically, whereas the remaining substructure also admits microplastic evolution. This leads to a heterogeneous internal stress distribution which, upon unloading, results in negative creep and complete residual-strain recovery. A detailed structural analysis in terms of local stress, atomic displacement, and SU(2) local bonding topology shows such microscopic processes can result in large changes in local stress and are more likely to occur in geometrically frustrated regions characterized by higher free volume and softer elastic stiffness. These insights shed atomistic light onto the structural origins that may govern recent experimental observations of significant structural evolution in response to elastic loading protocols.


title: Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources

abstract: In order to facilitate natural language understanding, the key is to engage commonsense or background knowledge. However, how to engage commonsense effectively in question answering systems is still under exploration in both research academia and industry. In this paper, we propose a novel question-answering method by integrating multiple knowledge sources, i.e. ConceptNet, Wikipedia, and the Cambridge Dictionary, to boost the performance. More concretely, we first introduce a novel graph-based iterative knowledge retrieval module, which iteratively retrieves concepts and entities related to the given question and its choices from multiple knowledge sources. Afterward, we use a pre-trained language model to encode the question, retrieved knowledge and choices, and propose an answer choice-aware attention mechanism to fuse all hidden representations of the previous modules. Finally, the linear classifier for specific tasks is used to predict the answer. Experimental results on the CommonsenseQA dataset show that our method significantly outperforms other competitive methods and achieves the new state-of-the-art. In addition, further ablation studies demonstrate the effectiveness of our graph-based iterative knowledge retrieval module and the answer choice-aware attention module in retrieving and synthesizing background knowledge from multiple knowledge sources.


title: Quantum limit-cycles and the Rayleigh and van der Pol oscillators

abstract: Self-oscillating systems, described in classical dynamics as limit cycles, are emerging as canonical models for driven dissipative nonequilibrium open quantum systems, and as key elements in quantum technology. We consider a family of models that interpolates between the classical textbook examples of the Rayleigh and the van der Pol oscillators, and follow their transition from the classical to the quantum domain, while properly formulating their corresponding quantum descriptions. We derive an exact analytical solution for the steady-state quantum dynamics of the simplest of these models, applicable to any bosonic system---whether mechanical, optical, or otherwise---that is coupled to its environment via single-boson and double-boson emission and absorption. Our solution is a generalization to arbitrary temperature of existing solutions for very-low, or zero, temperature, often misattributed to the quantum van der Pol oscillator. We closely explore the classical to quantum transition of the bifurcation to self-oscillations of this oscillator, while noting changes in the dynamics and identifying features that are uniquely quantum.


title: Dynamically Sampled Nonlocal Gradients for Stronger Adversarial Attacks

abstract: The vulnerability of deep neural networks to small and even imperceptible perturbations has become a central topic in deep learning research. Although several sophisticated defense mechanisms have been introduced, most were later shown to be ineffective. However, a reliable evaluation of model robustness is mandatory for deployment in safety-critical scenarios. To overcome this problem we propose a simple yet effective modification to the gradient calculation of state-of-the-art first-order adversarial attacks. Normally, the gradient update of an attack is directly calculated for the given data point. This approach is sensitive to noise and small local optima of the loss function. Inspired by gradient sampling techniques from non-convex optimization, we propose Dynamically Sampled Nonlocal Gradient Descent (DSNGD). DSNGD calculates the gradient direction of the adversarial attack as the weighted average over past gradients of the optimization history. Moreover, distribution hyperparameters that define the sampling operation are automatically learned during the optimization scheme. We empirically show that by incorporating this nonlocal gradient information, we are able to give a more accurate estimation of the global descent direction on noisy and non-convex loss surfaces. In addition, we show that DSNGD-based attacks are on average 35% faster while achieving 0.9% to 27.1% higher success rates compared to their gradient descent-based counterparts.


title: Extensions of the noncommutative Standard Model and the weak order one condition

abstract: In the derivation of the Standard Model from the axioms of Noncommutative Geometry, the scalar sector is given by a finite Dirac operator which has to satisfy the so-called \emph{first-order condition}. However, the general solution to this constraint still has unphysical terms which must be fine-tuned to zero. Moreover, the first-order condition generally does not survive in extensions to models with gauge groups larger that $U(1)\times SU(2)\times SU(3)$. In this paper we show that in the $U(1)_{\rm B-L}$-extension one can implement a weaker form of the first-order condition which we argue is necessary in order for Noncommutative Gauge Theory to make sense at all, and that this condition reduce the amount of fine-tuning to the off-diagonal terms in the Yukawa mass matrices for the leptons and quarks. We also show that this condition eliminates the Majorana mass terms for right-handed neutrinos when it is applied to the Pati-Salam model.


title: DTGAN: Dual Attention Generative Adversarial Networks for Text-to-Image Generation

abstract: Most existing text-to-image generation methods adopt a multi-stage modular architecture which has three significant problems: 1) Training multiple networks increases the run time and affects the convergence and stability of the generative model; 2) These approaches ignore the quality of early-stage generator images; 3) Many discriminators need to be trained. To this end, we propose the Dual Attention Generative Adversarial Network (DTGAN) which can synthesize high-quality and semantically consistent images only employing a single generator/discriminator pair. The proposed model introduces channel-aware and pixel-aware attention modules that can guide the generator to focus on text-relevant channels and pixels based on the global sentence vector and to fine-tune original feature maps using attention weights. Also, Conditional Adaptive Instance-Layer Normalization (CAdaILN) is presented to help our attention modules flexibly control the amount of change in shape and texture by the input natural-language description. Furthermore, a new type of visual loss is utilized to enhance the image resolution by ensuring vivid shape and perceptually uniform color distributions of generated images. Experimental results on benchmark datasets demonstrate the superiority of our proposed method compared to the state-of-the-art models with a multi-stage framework. Visualization of the attention maps shows that the channel-aware attention module is able to localize the discriminative regions, while the pixel-aware attention module has the ability to capture the globally visual contents for the generation of an image.


title: On positivity of orthogonal series and its applications in probability

abstract: We give necessary and sufficient conditions for an orthogonal series to converge in the mean-squares to a nonnegative function. We present many examples and applications, in analysis and probability. In particular, we give necessary and sufficient conditions for a Lancaster-type of expansion $% \sum_{n\geq 0}c_{n}\alpha _{n}(x)\beta _{n}(y)$ with two sets of orthogonal polynomials $\left\{ \alpha _{n}\right\} $ and $\left\{ \beta _{n}\right\} $ to converge in means-squares to a nonnegative bivariate function. In particular, we study the properties of the set $C(\alpha ,\beta )$ of the sequences $\left\{ c_{n}\right\} ,$ for which the above-mentioned series converge to a nonnegative function and give conditions for the membership to it. Further we show that the class of bivariate distributions for which a Lancaster type expansion can be found, is the same as the class of distributions having all conditional moments in the form of polynomials in the conditioning random variable.