title: Online Residential Demand Response via Contextual Multi-Armed Bandits

abstract: Residential loads have great potential to enhance the efficiency and reliability of electricity systems via demand response (DR) programs. One major challenge in residential DR is to handle the unknown and uncertain customer behaviors. Previous works use learning techniques to predict customer DR behaviors, while the influence of time-varying environmental factors is generally neglected, which may lead to inaccurate prediction and inefficient load adjustment. In this paper, we consider the residential DR problem where the load service entity (LSE) aims to select an optimal subset of customers to maximize the expected load reduction with a financial budget. To learn the uncertain customer behaviors under the environmental influence, we formulate the residential DR as a contextual multi-armed bandit (MAB) problem, and the online learning and selection (OLS) algorithm based on Thompson sampling is proposed to solve it. This algorithm takes the contextual information into consideration and is applicable to complicated DR settings. Numerical simulations are performed to demonstrate the learning effectiveness of the proposed algorithm.


title: The Atmospheres of Rocky Exoplanets I. Outgassing of Common Rock and the Stability of Liquid Water

abstract: Little is known about the interaction between atmospheres and crusts of exoplanets so far, but future space missions and ground-based instruments are expected to detect molecular features in the spectra of hot rocky exoplanets. We aim to understand the composition of the gas in an exoplanet atmosphere which is in equilibrium with a planetary crust. Methods. The molecular composition of the gas above a surface made of a mixture of solid and liquid materials is determined by assuming phase equilibrium for given pressure, temperature and element abundances. We study total element abundances that represent different parts of the Earth's crust (Continental Crust, Bulk Silicate Earth, Mid Oceanic Ridge Basalt), CI chondrites and abundances measured in polluted white dwarfs. For temperatures between 600K and 3500K, the near-crust atmospheres of all considered total element abundances are mainly composed of H2O, CO2, SO2 and in some cases of O2 and H2. For temperatures 500K, only N2-rich or CH4-rich atmospheres remain. For 3500K, the atmospheric gas is mainly composed of atoms (O, Na, Mg, Fe), metal oxides (SiO, NaO, MgO, CaO, AlO, FeO) and some metal hydroxides (KOH, NaOH). The inclusion of phyllosilicates as potential condensed species is crucial for lower temperatures, as they can remove water from the gas phase below about 700K and inhibit the presence of liquid water. Measurements of the atmospheric composition could, in principle, characterise the rock composition of exoplanet crusts. H2O, O2 and CH4 are natural products from the outgassing of different kinds of rocks that had time to equilibrate. These are discussed as biomarkers, but do emerge naturally as result of the thermodynamic interaction between crust and atmosphere. Only the simultaneous detection of all three molecules might be a sufficient biosignature, as it is inconsistent with chemical equilibrium.


title: Getting Better from Worse: Augmented Bagging and a Cautionary Tale of Variable Importance

abstract: As the size, complexity, and availability of data continues to grow, scientists are increasingly relying upon black-box learning algorithms that can often provide accurate predictions with minimal a priori model specifications. Tools like random forests have an established track record of off-the-shelf success and even offer various strategies for analyzing the underlying relationships among variables. Here, motivated by recent insights into random forest behavior, we introduce the simple idea of augmented bagging (AugBagg), a procedure that operates in an identical fashion to classical bagging and random forests, but which operates on a larger, augmented space containing additional randomly generated noise features. Surprisingly, we demonstrate that this simple act of including extra noise variables in the model can lead to dramatic improvements in out-of-sample predictive accuracy, sometimes outperforming even an optimally tuned traditional random forest. As a result, intuitive notions of variable importance based on improved model accuracy may be deeply flawed, as even purely random noise can routinely register as statistically significant. Numerous demonstrations on both real and synthetic data are provided along with a proposed solution.


title: Account for axial vector mesons in the $\eta\to\pi^+\pi^-\gamma$ and $\eta' \to\pi^+\pi^-\gamma$ decays

abstract: The rates and spectra of the anomalous $\eta\to\pi^+\pi^-\gamma$ and $\eta' \to\pi^+\pi^-\gamma$ decays are calculated. The approach is based on the effective meson Lagrangian obtained in the Nambu-Jona-Lasinio model with vector and axial-vector mesons by integrating out quark fields. The resulting action is affected by mixing between members of pseudoscalar $J^{PC}=0^{-+}$ and axial-vector $1^{++}$ nonets that violates some low-energy theorems. In this note we point out that a gauge covariant procedure to diagonalize this mixing allows for consistent description of the $\eta\to\pi^+\pi^-\gamma$ and $\eta' \to\pi^+\pi^-\gamma$ decays.


title: Limit theorems for random expanding or hyperbolic dynamical systems and vector-valued observables

abstract: The purpose of this paper is twofold. In one direction, we extend the spectral method for random piecewise expanding and hyperbolic dynamics developed by the first author \textit{et al}. to establish quenched versions of the large deviation principle, central limit theorem and the local central limit theorem for \emph{vector-valued} observables. We stress that the previous works considered exclusively the case of scalar-valued observables. In another direction, we show that this method can be used to establish a variety of new limit laws (either for scalar or vector-valued observables) that have not been discussed previously in the literature for the classes of dynamics we consider. More precisely, we establish the moderate deviation principle, concentration inequalities, Berry-Esseen estimates as well as Edgeworth and large deviation expansions. Although our techniques rely on the approach developed in the previous works of the first author \textit{et al}., we emphasize that our arguments require several nontrivial adjustments as well as new ideas.


title: Complexity of Planning

abstract: This is a chapter in the Encyclopedia of Robotics. It is devoted to the study of complexity of complete (or exact) algorithms for robot motion planning. The term ``complete'' indicates that an approach is guaranteed to find the correct solution (a motion path or trajectory in our setting), or to report that none exists otherwise (in case that for instance, no feasible path exists). Complexity theory is a fundamental tool in computer science for analyzing the performance of algorithms, in terms of the amount of resources they require. (While complexity can express different quantities such as space and communication effort, our focus in this chapter is on time complexity.) Moreover, complexity theory helps to identify ``hard'' problems which require excessive amount of computation time to solve. In the context of motion planning, complexity theory can come in handy in various ways, some of which are illustrated here.


title: AL2: Progressive Activation Loss for Learning General Representations in Classification Neural Networks

abstract: The large capacity of neural networks enables them to learn complex functions. To avoid overfitting, networks however require a lot of training data that can be expensive and time-consuming to collect. A common practical approach to attenuate overfitting is the use of network regularization techniques. We propose a novel regularization method that progressively penalizes the magnitude of activations during training. The combined activation signals produced by all neurons in a given layer form the representation of the input image in that feature space. We propose to regularize this representation in the last feature layer before classification layers. Our method's effect on generalization is analyzed with label randomization tests and cumulative ablations. Experimental results show the advantages of our approach in comparison with commonly-used regularizers on standard benchmark datasets.


title: The redshift and the host galaxy of the neutrino candidate 4FGL J0955.1+3551 (3HSP J095507.9+355101)

abstract: The BL Lac object 4FGLJ0955.1+3551 has been suggested as a possible source of ultra energetic neutrinos detected by the Icecube observatory. The target was observed in January 2020 at the Large Binocular Telescope. Our spectroscopy (4100-8500 Ang) yields a firm redshift z = 0.557 as deduced by the absorption lines of the host galaxy. The upper limit of the minimum equivalent width on emission lines is 0.3 Ang. From the source image we are able to resolve the host galaxy for which we measure an absolute magnitude M(R) = -22.9 and Re = 8 kpc, that is values which are typical of the host galaxies of BL Lacs.


title: Measurement of coupled spatiotemporal coherence of parametric down-conversion under negative group velocity dispersion

abstract: We present a direct measurement of the spatiotemporal coherence of parametric down-conversion in the range of negative group-velocity dispersion. In this case, the frequency-angular spectra are ring-shaped and temporal coherence is coupled to spatial coherence. Correspondingly, the lack of coherence due to spatial displacement can be compensated with the introduction of time delay. We show a simple technique, based on a modified Mach-Zehnder interferometer, which allowed us to measure time coherence and near-field space coherence simultaneously, with complete control of both variables. This technique will be also suitable for the measurement of second-order coherence, where the main applications are related to the two-photon spectroscopy.


title: NuZZ: numerical Zig-Zag sampling for general models

abstract: Markov chain Monte Carlo (MCMC) is a key algorithm in computational statistics, and as datasets grow larger and models grow more complex, many popular MCMC algorithms become too computationally expensive to be practical. Recent progress has been made on this problem through development of MCMC algorithms based on Piecewise Deterministic Markov Processes (PDMPs), irreversible processes that can be engineered to converge at a rate which is independent of the size of data. While there has understandably been a surge of theoretical studies following these results, PDMPs have so far only been implemented for models where certain gradients can be bounded, which is not possible in many statistical contexts. Focusing on the Zig-Zag process, we present the Numerical Zig-Zag (NuZZ) algorithm, which is applicable to general statistical models without the need for bounds on the gradient of the log posterior. This allows us to perform numerical experiments on: (i) how the Zig-Zag dynamics behaves on some test problems with common challenging features; and (ii) how the error between the target and sampled distributions evolves as a function of computational effort for different MCMC algorithms including NuZZ. Moreover, due to the specifics of the NuZZ algorithms, we are able to give an explicit bound on the Wasserstein distance between the exact posterior and its numerically perturbed counterpart in terms of the user-specified numerical tolerances of NuZZ.


title: Holographic Space-time, Newton`s Law, and the Dynamics of Horizons

abstract: We revisit the construction of models of quantum gravity in d dimensional Minkowski space in terms of random tensor models, and correct some mistakes in our previous treatment of the subject. We find a large class of models in which the large impact parameter scattering scales with energy and impact parameter like Newton`s law. The scattering amplitudes in these models describe scattering of jets of particles, and also include amplitudes for the production of highly meta-stable states with all the parametric properties of black holes. These models have emergent energy, momentum and angular conservation laws, despite being based on time dependent Hamiltonians. The scattering amplitudes in which no intermediate black holes are produced have a time-ordered Feynman diagram space-time structure: local interaction vertices connected by propagation of free particles (really Sterman-Weinberg jets of particles). However, there are also amplitudes where jets collide to form large meta-stable objects, with all the scaling properties of black holes: energy, entropy and temperature, as well as the characteristic time scale for the decay of perturbations. We generalize the conjecture of Sekino and Susskind, to claim that all of these models are fast scramblers. The rationale for this claim is that the interactions are invariant under fuzzy subgroups of the group of volume preserving diffeomorphisms, so that they are highly non-local on the holographic screen. We review how this formalism resolves the Firewall Paradox.


title: Minimizing the number of optimizations for efficient community dynamic flux balance analysis

abstract: Dynamic flux balance analysis uses a quasi-steady state assumption to calculate an organism's metabolic activity at each time-step of a dynamic simulation, using the well-known technique of flux balance analysis. For microbial communities, this calculation is especially costly and involves solving a linear constrained optimization problem for each member of the community at each time step. However, this is unnecessary and inefficient, as prior solutions can be used to inform future time steps. Here, we show that a basis for the space of internal fluxes can be chosen for each microbe in a community and this basis can be used to simulate forward by solving a relatively inexpensive system of linear equations at most time steps. We can use this solution as long as the resulting metabolic activity remains within the optimization problem's constraints (i.e. the solution to the linear system of equations remains a feasible to the linear program). As the solution becomes infeasible, it first becomes a feasible but degenerate solution to the optimization problem, and we can solve a different but related optimization problem to choose an appropriate basis to continue forward simulation. We demonstrate the efficiency and robustness of our method by comparing with currently used methods on a four species community, and show that our method requires at least $91\%$ fewer optimizations to be solved. For reproducibility, we prototyped the method using Python. Source code is available at \verb|https://github.com/jdbrunner/surfin_fba|.


title: Classification of minimally unsatisfiable 2-CNFs

abstract: We consider minimally unsatisfiable 2-CNFs (short 2-MUs). Characterisations of 2-MUs in the literature have been restricted to the nonsingular case (where every variable occurs positively and negatively at least twice), and those with a unit-clause. We provide the full classification of 2-MUs F. The main tool is the implication digraph, and we show that the implication digraph of F is a "weak double cycle" (WDC), a big cycle of small cycles (with possible overlaps). Combining logical and graph-theoretical methods, we prove that WDCs have at most one skew-symmetry, and thus we obtain that the isomorphisms between 2-MUs F, F' are exactly the isomorphisms between their implication digraphs. We obtain a variety of applications. For fixed deficiency k, the difference of the number of clauses of F and the number n of variables of F, the automorphism group of F is a subgroup of the Dihedral group with 4k elements. The isomorphism problem restricted to 2-MUs F is decidable in linear time for fixed k. The number of isomorphism types of 2-MUs for fixed k is Theta(n^(3k-1)). The smoothing (removal of linear vertices) of skew-symmetric WDCs corresponds exactly to the canonical normal form of F obtained by 1-singular DP-reduction, a restricted form of DP-reduction (or "variable elimination") only reducing variables of degree 2. The isomorphism types of these normal forms, i.e., the homeomorphism types of skew-symmetric WDCs, are in one-to-one correspondence with binary bracelets (or "turnover necklaces") of length k.


title: Polarization and Vorticity in the Quark Gluon Plasma

abstract: The quark-gluon plasma produced by collisions between ultra-relativistic heavy nuclei is well described in the language of hydrodynamics. Non-central collisions are characterized by very large angular momentum, which in a fluid system manifests as flow vorticity. This rotational structure can lead to a spin polarization of the hadrons that eventually emerge from the plasma, providing experimental access to flow substructure at unprecedented detail. Recently, first observations of $\Lambda$ hyperon polarization along the direction of collisional angular momentum have been reported. These measurements are in broad agreement with hydrodynamic and transport-based calculations and reveal that the QGP is the most vortical fluid ever observed. However, there remain important tensions between theory and observation which might be fundamental in nature. In the relatively mature field of heavy ion physics, the discovery of global hyperon polarization and three-dimensional simulations of the collision have opened an entirely new direction of research. We discuss the current status of this rapidly developing area and directions for future research.


title: Lorentz Invariant Quantum Concurrence for SU(2) x SU(2) spin-parity states

abstract: The quantum concurrence of $SU(2) \otimes SU(2)$ spin-parity states is shown to be invariant under $SO(1,3)$ Lorentz boosts and $O(3)$ rotations when the density matrices are constructed in consonance with the covariant probabilistic distribution of Dirac massive particles. Similar invariance properties are obtained for the quantum purity and for the trace of unipotent density matrix operators. The reported invariance features -- obtained in the scope of the $SU(2) \otimes SU(2)$ corresponding to just one of the inequivalent representations enclosed by the $SL(2,\mathbb{C})\otimes SL(2,\mathbb{C})$ symmetry -- set a more universal and kinematical-independent meaning for the quantum entanglement encoded in systems containing not only information about spin polarization but also the correlated information about intrinsic parity. Such a covariant framework is used for computing the Lorentz invariant spin-parity entanglement of spinorial particles coupled to a magnetic field, through which the extensions to more general Poincar\'e classes of spinor interactions are straightforwardly depicted.


title: Degree of Sublattice Noncompensation of Antiferromagnet at the Antiferromagnet/Ferromagnet Interface

abstract: A degree of sublattice noncompensation of antiferromagnet (DSNA) can play a crucial role in the designing of a diagonal-like and curvilinear geometry at interfaces of antiferromagnet (AFM) with other magnetic media because of the exchange interaction both between AFM sublattices and with neighboring material. We present a conceptually advanced theory which uses a variable DSNA to describe the behavior of spin waves (SWs) propagation through any designed AFM/FM interface. We propose the boundary conditions for any case of the DSNA. We demonstrate the dependency of transmittance, reflectance and corresponding phase shifts at the interface on the DSNA according to the reasonable SW wavelength.


title: On the number and location of critical points of solutions of nonlinear elliptic equations in domains with a small hole

abstract: In this paper we study the following problem \begin{equation} \begin{cases} -\Delta u=f(u)~&\mbox{in}\ \Omega_\varepsilon,\\ u>0~&\mbox{in}\ \Omega_\varepsilon,\\ u=0~&\mbox{on}\ \partial\Omega_\varepsilon, \end{cases} \end{equation} where $\Omega_\varepsilon=\Omega\backslash B(P,\varepsilon)$, $\Omega\subset R^N$ with $N\geq 2$ is a smooth bounded domain, $B(P,\varepsilon)$ is the ball centered at $P$ and radius $\varepsilon>0$ and $f$ is a smooth nonlinearity. By some computations involving the Green function and degree theory, we compute the number and location of critical points of solutions for small $\varepsilon>0$.


title: Inferring Spatial Uncertainty in Object Detection

abstract: The availability of real-world datasets is the prerequisite for developing object detection methods for autonomous driving. While ambiguity exists in object labels due to error-prone annotation process or sensor observation noises, current object detection datasets only provide deterministic annotations without considering their uncertainty. This precludes an in-depth evaluation among different object detection methods, especially for those that explicitly model predictive probability. In this work, we propose a generative model to estimate bounding box label uncertainties from LiDAR point clouds, and define a new representation of the probabilistic bounding box through spatial distribution. Comprehensive experiments show that the proposed model represents uncertainties commonly seen in driving scenarios. Based on the spatial distribution, we further propose an extension of IoU, called the Jaccard IoU (JIoU), as a new evaluation metric that incorporates label uncertainty. Experiments on the KITTI and the Waymo Open Datasets show that JIoU is superior to IoU when evaluating probabilistic object detectors.


title: Generating Emotionally Aligned Responses in Dialogues using Affect Control Theory

abstract: State-of-the-art neural dialogue systems excel at syntactic and semantic modelling of language, but often have a hard time establishing emotional alignment with the human interactant during a conversation. In this work, we bring Affect Control Theory (ACT), a socio-mathematical model of emotions for human-human interactions, to the neural dialogue generation setting. ACT makes predictions about how humans respond to emotional stimuli in social situations. Due to this property, ACT and its derivative probabilistic models have been successfully deployed in several applications of Human-Computer Interaction, including empathetic tutoring systems, assistive healthcare devices and two-person social dilemma games. We investigate how ACT can be used to develop affect-aware neural conversational agents, which produce emotionally aligned responses to prompts and take into consideration the affective identities of the interactants.


title: Longtime dynamics of a semilinear Lam\'e system

abstract: This paper is concerned with longtime dynamics of semilinear Lam\'e systems $$ \partial^2_t u - \mu \Delta u - (\lambda + \mu) \nabla {\rm div} u + \alpha \partial_t u + f(u) = 0, $$ defined in bounded domains of $\mathbb{R}^3$ with Dirichlet boundary condition. Firstly, we establish the existence of finite dimensional global attractors subjected to critical forcings $f(u)$. Writing $\lambda + \mu$ as a positive parameter $\varepsilon$, we discuss some physical aspects of the limit case $\varepsilon \to 0$. Then, we show the upper-semicontinuity of attractors with respect to the parameter when $\varepsilon \to 0$. To our best knowledge, the analysis of attractors for dynamics of Lam\'e systems has not been studied before.


title: Martin boundary of random walks in convex cones

abstract: We determine the asymptotic behavior of the Green function for zero-drift random walks confined to multidimensional convex cones. As a consequence, we prove that there is a unique positive discrete harmonic function for these processes (up to a multiplicative constant); in other words, the Martin boundary reduces to a singleton.


title: Quantum tunneling rate of dilute axion stars close to the maximum mass

abstract: We compute the quantum tunneling rate of dilute axion stars close to the maximum mass [P.H. Chavanis, Phys. Rev. D {\bf 84}, 043531 (2011)] using the theory of instantons. We confirm that the lifetime of metastable states is extremely long, scaling as $t_{\rm life}\sim e^N\, t_D$ (except close to the critical point), where $N$ is the number of axions in the system and $t_D$ is the dynamical time ($N\sim 10^{57}$ and $t_D\sim 10\, {\rm hrs}$ for typical QCD axion stars; $N\sim 10^{96}$ and $t_D\sim 100\, {\rm Myrs}$ for the quantum core of a dark matter halo made of ultralight axions). Therefore, metastable equilibrium states can be considered as stable equilibrium states in practice. We develop a finite size scaling theory close to the maximum mass and predict that the collapse time at criticality scales as $t_{\rm coll}\sim N^{1/5}t_D$ instead of being infinite as when fluctuations are neglected. The collapse time is smaller than the age of the universe for QCD axion stars and larger than the age of the universe for dark matter cores made of ultralight axions. We also consider the thermal tunneling rate and reach the same conclusions. We compare our results with similar results obtained for Bose-Einstein condensates in laboratory, globular clusters in astrophysics, and quantum field theory in the early Universe.


title: Ensemble Binary Segmentation for irregularly spaced data with change-points

abstract: We propose a new technique for consistent estimation of the number and locations of the change-points in the structure of an irregularly spaced time series. The core of the segmentation procedure is the Ensemble Binary Segmentation method (EBS), a technique in which a large number of multiple change-point detection tasks using the Binary Segmentation (BS) method are applied on sub-samples of the data of differing lengths, and then the results are combined to create an overall answer. We do not restrict the total number of change-points a time series can have, therefore, our proposed method works well when the spacings between change-points are short. Our main change-point detection statistic is the time-varying Autoregressive Conditional Duration model on which we apply a transformation process in order to decorrelate it. To examine the performance of EBS we provide a simulation study for various types of scenarios. A proof of consistency is also provided. Our methodology is implemented in the R package eNchange, available to download from CRAN.


title: Entanglement sudden birth and sudden death in a system of two distant atoms coupled via an optical element

abstract: An investigation is reported of the collective effects and the dynamics of atom atom entanglement in a system of two distant two level atoms which are coupled via an optical element. In the system under consideration, the two atoms, which are trapped in the foci of a lens, are coupled to a common environment being in the vacuum state and they emit photons spontaneously. A fraction of the emitted photons from each atom is thus focused on the position of the other atom. The presence of optical element between two distant atoms leads to the occurrence of delayed collective effects, such as delayed dipole dipole interaction and delayed collective spontaneous emission, which play the crucial role in the dynamical behavior of the entanglement. We discuss the phenomena of entanglement sudden birth, entanglement sudden death, and revival of entanglement for both cases of initial one photon and initial two photon unentangled atomic states. We show that the evolution of the entanglement is sensitive not only to the interatomic distance but also to the initial state of the system as well as to the properties of the optical element.


title: Convergence of ergodic-martingale paraproducts

abstract: In this note we introduce a sequence of bilinear operators that unify ergodic averages and backward martingales in a nontrivial way. We establish its convergence in a range of $L^p$-norms and leave its a.s. convergence as an open problem. This problem shares some similarities with a well-known unresolved conjecture on a.s. convergence of double ergodic averages with respect to two commuting transformations.


title: On the theorem of Rubinstein

abstract: We study distribution of zeros of a complex polynomial whose coefficients has been modified. We give a new proof of the theorem of Rubinstein, and with similar method we prove a new theorem that is not generalization of the previous theorem, but is more efficient in the most number of cases.


title: SalsaNext: Fast, Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving

abstract: In this paper, we introduce SalsaNext for the uncertainty-aware semantic segmentation of a full 3D LiDAR point cloud in real-time. SalsaNext is the next version of SalsaNet [1] which has an encoder-decoder architecture where the encoder unit has a set of ResNet blocks and the decoder part combines upsampled features from the residual blocks. In contrast to SalsaNet, we introduce a new context module, replace the ResNet encoder blocks with a new residual dilated convolution stack with gradually increasing receptive fields and add the pixel-shuffle layer in the decoder. Additionally, we switch from stride convolution to average pooling and also apply central dropout treatment. To directly optimize the Jaccard index, we further combine the weighted cross-entropy loss with Lovasz-Softmax loss [2]. We finally inject a Bayesian treatment to compute the epistemic and aleatoric uncertainties for each point in the cloud. We provide a thorough quantitative evaluation on the Semantic-KITTI dataset [3], which demonstrates that the proposed SalsaNext outperforms other state-of-the-art semantic segmentation networks and ranks first on the Semantic-KITTI leaderboard. We also release our source code https://github.com/TiagoCortinhal/SalsaNext.


title: Discovering linguistic (ir)regularities in word embeddings through max-margin separating hyperplanes

abstract: We experiment with new methods for learning how related words are positioned relative to each other in word embedding spaces. Previous approaches learned constant vector offsets: vectors that point from source tokens to target tokens with an assumption that these offsets were parallel to each other. We show that the offsets between related tokens are closer to orthogonal than parallel, and that they have low cosine similarities. We proceed by making a different assumption; target tokens are linearly separable from source and un-labeled tokens. We show that a max-margin hyperplane can separate target tokens and that vectors orthogonal to this hyperplane represent the relationship between source and targets. We find that this representation of the relationship obtains the best results in dis-covering linguistic regularities. We experiment with vector space models trained by a variety of algorithms (Word2vec: CBOW/skip-gram, fastText, or GloVe), and various word context choices such as linear word-order, syntax dependency grammars, and with and without knowledge of word position. These experiments show that our model, SVMCos, is robust to a range of experimental choices when training word embeddings.


title: Heavy Traffic Scaling Limits for shortest remaining processing time queues with heavy tailed processing time distributions

abstract: We study a single server queue operating under the shortest remaining processing time (SRPT) scheduling policy; that is, the server preemptively serves the job with the shortest remaining processing time first. In this work we are interested in studying the asymptotic behavior of suitably scaled measure-valued state descriptors that describe the evolution of a sequence of SRPT queuing systems. Gromoll, Kruk, and Puha (2011) have studied this problem under diffusive scaling. In the setting where the processing time distributions have unbounded support, under suitable conditions, they show that the diffusion scaled measures converge in distribution to the process that is identically zero. In Puha (2015) for the setting where the processing time distributions have unbounded support and light tails, a non-standard scaling of the queue length process is shown to give rise to a form of state space collapse that results in a nonzero limit. In the current work we consider the case where processing time distributions have finite second moments and regularly varying tails. We show that the measure valued process, under a non-standard scaling, converges in distribution in the space of paths of measures. In sharp contrast with previous results, there is no state space collapse. Nevertheless, the description of the limit is simple and given explicitly in terms of a certain $\mathbb{R}_+$ valued random field which is determined from a single Brownian motion. Along the way we establish convergence of suitably scaled workload and queue length processes. We also show that as the tail of the distribution of job processing times becomes lighter in an appropriate fashion, the difference between the limiting queue length process and the limiting workload process converges to zero, thereby approaching the behavior of state space collapse.


title: Arcs in $\mathbb F_q^2$

abstract: An arc is a subset of $\mathbb F_q^2$ which does not contain any collinear triples. Let $A(q,k)$ denote the number of arcs in $\mathbb F_q^2$ with cardinality $k$. This paper is primarily concerned with estimating the size of $A(q,k)$ when $k$ is relatively large, namely $k=q^t$ for some $t>0$. Trivial estimates tell us that \[ {q \choose k} \leq A(q,k) \leq {q^2 \choose k}. \] We show that the behaviour of $A(q,k)$ changes significantly close to $t=1/2$. Below this threshold an elementary argument is used to prove that the trivial upper bound above cannot be improved significantly. On the other hand, for $t \geq 1/2+\delta$, we use the theory of hypergraph containers to get an improved upper bound \[ A(q,k) \leq {q^{2-t+2\delta} \choose k}. \] This technique is also used to give an upper bound for the size of the largest arc in a random subset of $\mathbb F_q^2$ which holds with high probability. For example, we prove that a $p$-random subset $Q \subset \mathbb F_q^2$ with $q^{-3/2}<p<q^{-1}$ contains an arc of size $\Omega(q^{1/2})$ with high probability. The result is optimal for this range of $p$. Finally, this optimal bound for arcs in random sets is used to prove a finite field analogue of a result of Balogh and Solymosi, with a better exponent: there exists a subset $P \subset \mathbb F_q^2$ which does not contain any collinear quadruples, but with the property that for every $P' \subset P$ with $|P'| \geq |P|^{3/4+o(1)}$, $P'$ contains a collinear triple.


title: Prediction with Spatio-temporal Point Processes with Self Organizing Decision Trees

abstract: We study the spatio-temporal prediction problem, which has attracted the attention of many researchers due to its critical real-life applications. In particular, we introduce a novel approach to this problem. Our approach is based on the Hawkes process, which is a non-stationary and self-exciting point process. We extend the formulations of a standard point process model that can represent time-series data to represent a spatio-temporal data. We model the data as nonstationary in time and space. Furthermore, we partition the spatial region we are working on into subregions via an adaptive decision tree and model the source statistics in each subregion with individual but mutually interacting point processes. We also provide a gradient based joint optimization algorithm for the point process and decision tree parameters. Thus, we introduce a model that can jointly infer the source statistics and an adaptive partitioning of the spatial region. Finally, we provide experimental results on real-life data, which provides significant improvement due to space adaptation and joint optimization compared to standard well-known methods in the literature.


title: Securing LSB embedding against structural steganalysis

abstract: This work explores the extent to which LSB embedding can be made secure against structural steganalysis through a modification of cover image statistics prior to message embedding. Natural images possess symmetries that are expressed through approximately equal cardinalities of certain sets of $k$-tuples of consecutive pixels. LSB embedding disturbs this balance and a $k^{\rm th}$-order structural attack infers the presence of a hidden message with a length in proportion to the size of the imbalance amongst sets of $k$-tuples. To protect against $k^{\rm th}$-order structural attacks, cover modifications involve the redistribution of $k$-tuples among the different sets so that symmetries of the cover image are broken, then repaired through the act of LSB embedding so that the stego image bears the statistics of the original cover. To protect against all orders up to some order $k$, the statistics of $n$-tuples must be preserved where $n$ is the least common multiple of all orders $\leq k$. We find that this is only feasible for securing against up to $3^{\rm rd}$-order attacks (Sample Pairs and Triples analyses) since higher-order protections result in virtually zero embedding capacities. Securing up to $3^{\rm rd}$-order requires redistribution of sextuplets: rather than perform these $6^{\rm th}$-order cover modifications, which result in tiny embedding capacities, we reduce the problem to the redistribution of triplets in a manner that also preserves the statistics of pairs. This is done by embedding into only certain pixels of each sextuplet, constraining the maximum embedding rate to be $\leq 2/3$ bits per channel. Testing on a variety of image formats, we report best performance for JPEG-compressed images with a mean maximum embedding rate undetectable by $2^{\rm nd}$- and $3^{\rm rd}$-order attacks of 0.21 bits per channel.


title: Relative desingularization and principalization of ideals

abstract: In characteristic zero, we construct relative principalization of ideals for logarithmically regular morphisms of logarithmic schemes, and use it to construct logarithmically regular desingularization of morphisms. These constructions are relatively canonical and even functorial with respect to logarithmically regular morphisms and arbitrary base changes. Relative canonicity means, that the principalization requires a fine enough non-canonical modification of the base, and once it is chosen the process is canonical. As a consequence we deduce the semistable reduction theorem over arbitrary valuation rings. In another our work in progress, the same problems will be solved canonically in the case of proper morphisms.


title: Temperature Dependent Energy Gain of Bifacial PV Farms: A Global Perspective

abstract: Bifacial solar panels are perceived to be the technology of choice for next generation solar farms for their increased energy yield at marginally increased cost. As the bifacial farms proliferate around the world, it is important to investigate the role of temperature-dependent energy-yield and levelized cost of energy (LCOE) of bifacial solar farms relative to monofacial farms, stand-alone bifacial modules, and various competing bifacial technologies. In this work, we integrate irradiance and light collection models with experimentally validated, physics-based temperature-dependent efficiency models to compare the energy yield and LCOE reduction of various bifacial technologies across the world. We find that temperature-dependent efficiency changes the energy yield and LCOE by approximately -10 to 15%. Indeed, the results differ significantly depending on the location of the farm (which defines the illumination and ambient temperature), elevation of the module (increases incident energy), as well as the temperature-coefficients of various bifacial technologies. The analysis presented in this paper will allow us to realistically assess location-specific relative advantage and economic viability of the next generation bifacial solar farms.


title: Small gaps between almost primes, the parity problem, and some conjectures of Erd\H{o}s on consecutive integers II

abstract: This paper is intended as a sequel to a paper arXiv:0803.2636 written by four of the coauthors here. In the paper, they proved a stronger form of the Erd\H{o}s-Mirksy conjecture which states that there are infinitely many positive integers $x$ such that $d(x)=d(x+1)$ where $d(x)$ denotes the number of divisors of $x$. This conjecture was first proven by Heath-Brown in 1984, but the method did not reveal the nature of the set of values $d(x)$ for such $x$. In particular, one could not conclude that there was any particular value $A$ for which $d(x)=d(x+1)=A$ infinitely often. In the previous paper arXiv:0803.2636, the authors showed that there are infinitely many positive integers $x$ such that both $x$ and $x+1$ have exponent pattern $\{2,1,1,1\}$, so $d(x)=d(x+1)=24$. Similar results were known for certain shifts $n$, i.e., $x$ and $x+n$ have the same fixed exponent pattern infinitely often. This was done for shifts $n$ which are either even or not divisible by the product of a pair of twin primes. The goal of this paper is to give simple proofs of results on exponent patterns for an arbitrary shift $n$.


title: Extracting Information Overlap in Simultaneous OH-PLIF and PIV Fields with Neural Networks

abstract: Simultaneous measurements, such as the combination of particle image velocimetry (PIV) for velocity fields with planar laser induced fluorescence (PLIF) for species fields, are widely used in experimental turbulent combustion applications for the analysis of a plethora of complex physical processes. Such physical analyses are driven by the interpretation of spatial correlations between these fields by the experimenter. However, these correlations also imply some amount of intrinsic redundancy; the simultaneous fields contain overlapping information content. The goal of this work lies in the quantitative extraction of this overlapping information content in simultaneous field measurements. Specifically, the amount of PIV information contained in simultaneously measured OH-PLIF fields in the domain of a swirl-stabilized combustor is sought. This task is accomplished using machine learning techniques based on artificial neural networks designed to optimize PLIF-to-PIV mappings. It was found that most of the velocity information content could be retrieved when considering linear combinations of neighborhoods of OH-PLIF signal spanning roughly two integral lengthscales (half of the considered domain), and that PLIF signal interactions contained in smaller, local regions (less than half of the domain) contained no PIV information. Further, by visualizing the coherent structures contained within the neural network parameters, the role of multi-scale interactions related to velocity field retrieval from the OH-PLIF signal became more apparent. Overall, this study reveals a useful pathway (in the form of overlapping information content extraction) to develop diagnostic tools that capture more information using the same experimental resources by minimizing redundancy.


title: ATHAFI: Agile Threat Hunting And Forensic Investigation

abstract: Attackers rapidly change their attacks to evade detection. Even the most sophisticated Intrusion Detection Systems that are based on artificial intelligence and advanced data analytic cannot keep pace with the rapid development of new attacks. When standard detection mechanisms fail or do not provide sufficient forensic information to investigate and mitigate attacks, targeted threat hunting performed by competent personnel is used. Unfortunately, many organization do not have enough security analysts to perform threat hunting tasks and today the level of automation of threat hunting is low. In this paper we describe a framework for agile threat hunting and forensic investigation (ATHAFI), which automates the threat hunting process at multiple levels. Adaptive targeted data collection, attack hypotheses generation, hypotheses testing, and continuous threat intelligence feeds allow to perform simple investigations in a fully automated manner. The increased level of automation will significantly boost the analyst's productivity during investigation of the harshest cases. Special Workflow Generation module adapts the threat hunting procedures either to the latest Threat Intelligence obtained from external sources (e.g. National CERT) or to the likeliest attack hypotheses generated by the Attack Hypotheses Generation module. The combination of Attack Hypotheses Generation and Workflows Generation enables intelligent adjustment of workflows, which react to emerging threats effectively.


title: Quasi-random words and limits of word sequences

abstract: Words are sequences of letters over a finite alphabet. We study two intimately related topics for this object: quasi-randomness and limit theory. With respect to the first topic we investigate the notion of uniform distribution of letters over intervals, and in the spirit of the famous Chung--Graham--Wilson theorem for graphs we provide a list of word properties which are equivalent to uniformity. In particular, we show that uniformity is equivalent to counting 3-letter subsequences. Inspired by graph limit theory we then investigate limits of convergent word sequences, those in which all subsequence densities converge. We show that convergent word sequences have a natural limit, namely Lebesgue measurable functions of the form $f:[0,1]\to[0,1]$. Via this theory we show that every hereditary word property is testable, address the problem of finite forcibility for word limits and establish as a byproduct a new model of random word sequences. Along the lines of the proof of the existence of word limits, we can also establish the existence of limits for higher dimensional structures. In particular, we obtain an alternative proof of the result by Hoppen, Kohayakawa, Moreira, R\'ath and Sampaio [{\it J. Combin. Theory Ser. B 103(1):93--113, 2013}] establishing the existence of permutons.


title: Harmonic quasiconformal mappings between $\mathscr{C}^1$ smooth Jordan domains

abstract: We prove the following result. If $f$ is a harmonic quasiconformal mapping between two Jordan domains $D$ and $\Omega$ having $\mathscr{C}^1$ boundaries, then the function $f$ is globally H\"older continuous for every $\alpha<1$ but it is not Lipschitz in general. This extends and improves a classical theorem of S. Warschawski for conformal mappings.


title: Multi-task Learning Based Neural Bridging Reference Resolution

abstract: We propose a multi task learning-based neural model for resolving bridging references tackling two key challenges. The first challenge is the lack of large corpora annotated with bridging references. To address this, we use multi-task learning to help bridging reference resolution with coreference resolution. We show that substantial improvements of up to 8 p.p. can be achieved on full bridging resolution with this architecture. The second challenge is the different definitions of bridging used in different corpora, meaning that hand-coded systems or systems using special features designed for one corpus do not work well with other corpora. Our neural model only uses a small number of corpus independent features, thus can be applied to different corpora. Evaluations with very different bridging corpora (ARRAU, ISNOTES, BASHI and SCICORP) suggest that our architecture works equally well on all corpora, and achieves the SoTA results on full bridging resolution for all corpora, outperforming the best reported results by up to 36.3 p.p..


title: The growing amplification of social media: Measuring temporal and social contagion dynamics for over 150 languages on Twitter for 2009-2020

abstract: Working from a dataset of 118 billion messages running from the start of 2009 to the end of 2019, we identify and explore the relative daily use of over 150 languages on Twitter. We find that eight languages comprise 80% of all tweets, with English, Japanese, Spanish, and Portuguese being the most dominant. To quantify social spreading in each language over time, we compute the 'contagion ratio': The balance of retweets to organic messages. We find that for the most common languages on Twitter there is a growing tendency, though not universal, to retweet rather than share new content. By the end of 2019, the contagion ratios for half of the top 30 languages, including English and Spanish, had reached above 1 -- the naive contagion threshold. In 2019, the top 5 languages with the highest average daily ratios were, in order, Thai (7.3), Hindi, Tamil, Urdu, and Catalan, while the bottom 5 were Russian, Swedish, Esperanto, Cebuano, and Finnish (0.26). Further, we show that over time, the contagion ratios for most common languages are growing more strongly than those of rare languages.


title: High-dimensional, multiscale online changepoint detection

abstract: We introduce a new method for high-dimensional, online changepoint detection in settings where a $p$-variate Gaussian data stream may undergo a change in mean. The procedure works by performing likelihood ratio tests against simple alternatives of different scales in each coordinate, and then aggregating test statistics across scales and coordinates. The algorithm is online in the sense that both its storage requirements and worst-case computational complexity per new observation are independent of the number of previous observations; in practice, it may even be significantly faster than this. We prove that the patience, or average run length under the null, of our procedure is at least at the desired nominal level, and provide guarantees on its response delay under the alternative that depend on the sparsity of the vector of mean change. Simulations confirm the practical effectiveness of our proposal, which is implemented in the R package 'ocd', and we also demonstrate its utility on a seismology data set.


title: Adaptive Offline Quintuplet Loss for Image-Text Matching

abstract: Existing image-text matching approaches typically leverage triplet loss with online hard negatives to train the model. For each image or text anchor in a training mini-batch, the model is trained to distinguish between a positive and the most confusing negative of the anchor mined from the mini-batch (i.e. online hard negative). This strategy improves the model's capacity to discover fine-grained correspondences and non-correspondences between image and text inputs. However, the above approach has the following drawbacks: (1) the negative selection strategy still provides limited chances for the model to learn from very hard-to-distinguish cases. (2) The trained model has weak generalization capability from the training set to the testing set. (3) The penalty lacks hierarchy and adaptiveness for hard negatives with different "hardness" degrees. In this paper, we propose solutions by sampling negatives offline from the whole training set. It provides "harder" offline negatives than online hard negatives for the model to distinguish. Based on the offline hard negatives, a quintuplet loss is proposed to improve the model's generalization capability to distinguish positives and negatives. In addition, a novel loss function that combines the knowledge of positives, offline hard negatives and online hard negatives is created. It leverages offline hard negatives as the intermediary to adaptively penalize them based on their distance relations to the anchor. We evaluate the proposed training approach on three state-of-the-art image-text models on the MS-COCO and Flickr30K datasets. Significant performance improvements are observed for all the models, proving the effectiveness and generality of our approach. Code is available at https://github.com/sunnychencool/AOQ


title: Discovering Strategic Behaviors for Collaborative Content-Production in Social Networks

abstract: Some social networks provide explicit mechanisms to allocate social rewards such as reputation based on user activity, while the mechanism is more opaque in other networks. Nonetheless, there are always individuals who obtain greater rewards and reputation than their peers. An intuitive yet important question to ask is whether these successful users employ strategic behaviors to become influential. It might appear that the influencers have gamed the system. However, it remains difficult to conclude the rationality of their actions due to factors like the combinatorial strategy space, inability to determine payoffs, and resource limitations faced by individuals. The challenging nature of this question has drawn attention from both the theory and data mining communities. Therefore, in this paper, we are motivated to investigate if resource-limited individuals discover strategic behaviors associated with high payoffs when producing collaborative or interactive content in social networks. We propose a novel framework of Dynamic Dual Attention Networks or DDAN which models content production strategies of users through a generative process, under the influence of social interactions involved in the process. Extensive experimental results illustrate the effectiveness of our model in modeling user behavior. We make three strong empirical findings. Different strategies give rise to different social payoffs, the best performing individuals exhibit stability in their preference over the discovered strategies, which indicates the emergence of strategic behavior, and the stability of strategy preference is correlated with high payoffs.


title: Modeling of Spatio-Temporal Hawkes Processes with Randomized Kernels

abstract: We investigate spatio-temporal event analysis using point processes. Inferring the dynamics of event sequences spatiotemporally has many practical applications including crime prediction, social media analysis, and traffic forecasting. In particular, we focus on spatio-temporal Hawkes processes that are commonly used due to their capability to capture excitations between event occurrences. We introduce a novel inference framework based on randomized transformations and gradient descent to learn the process. We replace the spatial kernel calculations by randomized Fourier feature-based transformations. The introduced randomization by this representation provides flexibility while modeling the spatial excitation between events. Moreover, the system described by the process is expressed within closed-form in terms of scalable matrix operations. During the optimization, we use maximum likelihood estimation approach and gradient descent while properly handling positivity and orthonormality constraints. The experiment results show the improvements achieved by the introduced method in terms of fitting capability in synthetic and real datasets with respect to the conventional inference methods in the spatio-temporal Hawkes process literature. We also analyze the triggering interactions between event types and how their dynamics change in space and time through the interpretation of learned parameters.


title: Machine learning based non-Newtonian fluid model with molecular fidelity

abstract: We introduce a machine-learning-based framework for constructing continuum non-Newtonian fluid dynamics model directly from a micro-scale description. Dumbbell polymer solutions are used as examples to demonstrate the essential ideas. To faithfully retain molecular fidelity, we establish a micro-macro correspondence via a set of encoders for the micro-scale polymer configurations and their macro-scale counterparts, a set of nonlinear conformation tensors. The dynamics of these conformation tensors can be derived from the micro-scale model and the relevant terms can be parametrized using machine learning. The final model named the deep non-Newtonian model (DeePN$^2$), takes the form of conventional non-Newtonian fluid dynamics models, with a new form of the objective tensor derivative. Both the formulation of the dynamic equation and the neural network representation rigorously preserve the rotational invariance, which ensures the admissibility of the constructed model. Numerical results demonstrate the accuracy of DeePN$^2$, where models based on empirical closures show limitations.

categories: physics.comp-ph cs.NA math.NA physics.flu-dyn stat.ML


title: The number of positive solutions to the Brezis-Nirenberg problem

abstract: In this paper we are concerned with the well-known Brezis-Nirenberg problem \begin{equation*} \begin{cases} -\Delta u= u^{\frac{N+2}{N-2}}+\varepsilon u, &{\text{in}~\Omega},\\ u>0, &{\text{in}~\Omega},\\ u=0, &{\text{on}~\partial \Omega}. \end{cases} \end{equation*} The existence of multi-peak solutions to the above problem for small $\varepsilon>0$ was obtained by Musso and Pistoia. However, the uniqueness or the exact number of positive solutions to the above problem is still unknown. Here we focus on the local uniqueness of multi-peak solutions and the exact number of positive solutions to the above problem for small $\varepsilon>0$. By using various local Pohozaev identities and blow-up analysis, we first detect the relationship between the profile of the blow-up solutions and the Green's function of the domain $\Omega$ and then obtain a type of local uniqueness results of blow-up solutions. At last we give a description of the number of positive solutions for small positive $\varepsilon$, which depends also on the Green's function.


title: Error Correction with Systematic RLNC in Multi-Channel THz Communication Systems

abstract: The terahertz (THz) frequency band (0.3-10THz) has the advantage of large available bandwidth and is a candidate to satisfy the ever increasing mobile traffic in wireless communications. However, the THz channels are often absorbed by molecules in the atmosphere, which can decrease the signal quality resulting in high bit error rate of received data. In this paper, we study the usage of systematic random linear network coding (sRLNC) for error correction in generic THz systems with with 2N parallel channels, whereby N main high-bitrate channels are used in parallel with N auxiliary channels with lower bit rate. The idea behind this approach is to use coded low-bit rate channels to carry redundant information from high-bit rate channels, and thus compensate for errors in THz transmission. The analytical results evaluate and compare the different scenarios of the THz system in term of the amount of coding redundancy, a code rate, transmission rate of auxiliary channels, the number of THz channels, the modulation format and transmission distance as required system configurations for a fault tolerant THz transmission.


title: Dynamic Backdoor Attacks Against Machine Learning Models

abstract: Machine learning (ML) has made tremendous progress during the past decade and is being adopted in various critical real-world applications. However, recent research has shown that ML models are vulnerable to multiple security and privacy attacks. In particular, backdoor attacks against ML models have recently raised a lot of awareness. A successful backdoor attack can cause severe consequences, such as allowing an adversary to bypass critical authentication systems. Current backdooring techniques rely on adding static triggers (with fixed patterns and locations) on ML model inputs which are prone to detection by the current backdoor detection mechanisms. In this paper, we propose the first class of dynamic backdooring techniques against deep neural networks (DNN), namely Random Backdoor, Backdoor Generating Network (BaN), and conditional Backdoor Generating Network (c-BaN). Triggers generated by our techniques can have random patterns and locations, which reduce the efficacy of the current backdoor detection mechanisms. In particular, BaN and c-BaN based on a novel generative network are the first two schemes that algorithmically generate triggers. Moreover, c-BaN is the first conditional backdooring technique that given a target label, it can generate a target-specific trigger. Both BaN and c-BaN are essentially a general framework which renders the adversary the flexibility for further customizing backdoor attacks. We extensively evaluate our techniques on three benchmark datasets: MNIST, CelebA, and CIFAR-10. Our techniques achieve almost perfect attack performance on backdoored data with a negligible utility loss. We further show that our techniques can bypass current state-of-the-art defense mechanisms against backdoor attacks, including ABS, Februus, MNTD, Neural Cleanse, and STRIP.


title: Towards Solving Large-scale Expensive Optimization Problems Efficiently Using Coordinate Descent Algorithm

abstract: Many real-world problems are categorized as large-scale problems, and metaheuristic algorithms as an alternative method to solve large-scale problem; they need the evaluation of many candidate solutions to tackle them prior to their convergence, which is not affordable for practical applications since the most of them are computationally expensive. In other words, these problems are not only large-scale but also computationally expensive, that makes them very difficult to solve. There is no efficient surrogate model to support large-scale expensive global optimization (LSEGO) problems. As a result, the algorithms should address LSEGO problems using a limited computational budget to be applicable in real-world applications. Coordinate Descent (CD) algorithm is an optimization strategy based on the decomposition of a n-dimensional problem into n one-dimensional problem. To the best our knowledge, there is no significant study to assess benchmark functions with various dimensions and landscape properties to investigate CD algorithm. In this paper, we propose a modified Coordinate Descent algorithm (MCD) to tackle LSEGO problems with a limited computational budget. Our proposed algorithm benefits from two leading steps, namely, finding the region of interest and then shrinkage of the search space by folding it into the half with exponential speed. One of the main advantages of the proposed algorithm is being free of any control parameters, which makes it far from the intricacies of the tuning process. The proposed algorithm is compared with cooperative co-evolution with delta grouping on 20 benchmark functions with dimension 1000. Also, we conducted some experiments on CEC-2017, D=10, 30, 50, and 100, to investigate the behavior of MCD algorithm in lower dimensions. The results show that MCD is beneficial not only in large-scale problems, but also in low-scale optimization problems.


title: An Intent-based Task-aware Shared Control Framework for Intuitive Hands Free Telemanipulation

abstract: Shared control in teleoperation for providing robot assistance to accomplish object manipulation, called telemanipulation, is a new promising yet challenging problem. This has unique challenges--on top of teleoperation challenges in general--due to difficulties of physical discrepancy between human hands and robot hands as well as the fine motion constraints to constitute task success. We present an intuitive shared-control strategy where the focus is on generating robotic grasp poses which are better suited for human perception of successful teleoperated object manipulation and feeling of being in control of the robot, rather than developing objective stable grasp configurations for task success or following the human motion. The former is achieved by understanding human intent and autonomously taking over control on that inference. The latter is achieved by considering human inputs as hard motion constraints which the robot must abide. An arbitration of these two enables a trade-off for the subsequent robot motion to balance accomplishing the inferred task and motion constraints imposed by the operator. The arbitration framework adapts to the level of physical discrepancy between the human and different robot structures, enabling the assistance to indicate and appear to intuitively follow the user. To understand how users perceive good arbitration in object telemanipulation, we have conducted a user study with a hands-free telemanipulation setup to analyze the effect of factors including task predictability, perceived following, and user preference. The hands-free telemanipulation scene is chosen as the validation platform due to its more urgent need of intuitive robotics assistance for task success.


title: Online Dynamic Motion Planning and Control for Wheeled Biped Robots

abstract: Wheeled-legged robots combine the efficiency of wheeled robots when driving on suitably flat surfaces and versatility of legged robots when stepping over or around obstacles. This paper introduces a planning and control framework to realise dynamic locomotion for wheeled biped robots. We propose the Cart-Linear Inverted Pendulum Model (Cart-LIPM) as a template model for the rolling motion and the under-actuated LIPM for contact changes while walking. The generated motion is then tracked by an inverse dynamic whole-body controller which coordinates all joints, including the wheels. The framework has a hierarchical structure and is implemented in a model predictive control (MPC) fashion. To validate the proposed approach for hybrid motion generation, two scenarios involving different types of obstacles are designed in simulation. To the best of our knowledge, this is the first time that such online dynamic hybrid locomotion has been demonstrated on wheeled biped robots.


title: Greedy Finite-Horizon Covariance Steering for Discrete-Time Stochastic Nonlinear Systems Based on the Unscented Transform

abstract: In this work, we consider the problem of steering the first two moments of the uncertain state of a discrete time nonlinear stochastic system to prescribed goal quantities at a given final time. In principle, the latter problem can be formulated as a density tracking problem, which seeks for a feedback policy that will keep the probability density function of the state of the system close, in terms of an appropriate metric, to the goal density. The solution to the latter infinite-dimensional problem can be, however, a complex and computationally expensive task. Instead, we propose a more tractable and intuitive approach which relies on a greedy control policy. The latter control policy is comprised of the first elements of the control policies that solve a sequence of corresponding linearized covariance steering problems. Each of these covariance steering problems relies only on information available about the state mean and state covariance at the current stage and can be formulated as a tractable (finite-dimensional) convex program. At each stage, the information on the state statistics is updated by computing approximations of the predicted state mean and covariance of the resulting closed-loop nonlinear system at the next stage by utilizing the (scaled) unscented transform. Numerical simulations that illustrate the key ideas of our approach are also presented.


title: Spin-dependent Pomeron and Odderon in elastic proton-proton scattering

abstract: We introduce a new model of near-forward elastic proton-(anti)proton scattering at high energy based on the modern formulation of Pomeron and Odderon in terms of Wilson lines and generalized TMDs (GTMDs). We compute the helicity-dependent elastic amplitudes $\phi_{1,2,3,4,5}$ in this model and study their energy dependence from the nonlinear small-$x$ evolution equations. While both Pomeron and Odderon contribute to helicity-flip processes in general, in the forward limit $t=0$ only the double helicity-flip amplitude $\phi_2$, dominated by the spin-dependent Odderon, survives. This may affect the extraction of the $\rho$ parameter as well as the total cross section in the LHC energy domain and beyond.


title: Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems

abstract: This paper develops a model-free volt-VAR optimization (VVO) algorithm via multi-agent deep reinforcement learning (MADRL) in unbalanced distribution systems. This method is novel since we cast the VVO problem in unbalanced distribution networks to an intelligent deep Q-network (DQN) framework, which avoids solving a specific optimization model directly when facing time-varying operating conditions of the systems. We consider statuses/ratios of switchable capacitors, voltage regulators, and smart inverters installed at distributed generators as the action variables of the DQN agents. A delicately designed reward function guides these agents to interact with the distribution system, in the direction of reinforcing voltage regulation and power loss reduction simultaneously. The forward-backward sweep method for radial three-phase distribution systems provides accurate power flow results within a few iterations to the DQN environment. Finally, the proposed multi-objective MADRL method realizes the dual goals for VVO. We test this algorithm on the unbalanced IEEE 13-bus and 123-bus systems. Numerical simulations validate the excellent performance of this method in voltage regulation and power loss reduction.


title: Travelling waves for discrete stochastic bistable equations

abstract: Many physical, chemical and biological systems have an inherent discrete spatial structure that strongly influences their dynamical behaviour. Similar remarks apply to internal or external noise, as well as to nonlocal coupling. In this paper we study the combined effect of nonlocal spatial discretization and stochastic perturbations on travelling waves in the Nagumo equation, which is a prototypical model for bistable reaction-diffusion partial differential equations (PDEs). We prove that under suitable parameter conditions, various discrete-stochastic variants of the Nagumo equation have solutions, which stay close on long time scales to the classical monotone Nagumo front with high probability if the noise level and spatial discretization are sufficiently small.


title: Advanced Receiver Architectures for Millimeter Wave Communications with Low-Resolution ADCs

abstract: Employing low-resolution analog-to-digital converters (ADCs) for millimeter wave receivers with large antenna arrays provides opportunity to efficiently reduce power consumption of the receiver. Reducing ADC resolution, however, results in performance degradation due to non-negligible quantization error. In addition, the large number of radio frequency (RF) chains is still not desirable. Accordingly, conventional low-resolution ADC systems require more efficient designs to minimize the cost and complexity while maximizing performance. In this article, we discuss advanced low-resolution ADC receiver architectures that further improve the spectral and energy efficiency tradeoff. To reduce both the numbers of RF chains and ADC bits, hybrid analog-and-digital beamforming is jointly considered with low-resolution ADCs. We explore the challenges in designing such receivers and present key insights on how the advanced architectures overcome such challenges. As an alternative low-resolution ADC receiver, we also introduce receivers with learning-based detection. The receiver does not require explicit channel estimation, thereby is suitable for one-bit ADC systems. Finally, future challenges and research issues are discussed.


title: Time-periodic quantum states of weakly interacting bosons in a harmonic trap

abstract: We consider identical quantum bosons with weak contact interactions in a two-dimensional isotropic harmonic trap, and focus on states at the Lowest Landau Level (LLL). At linear order in the coupling parameter $g$, we exploit the rich algebraic structure of the problem to give an explicit construction of a large family of quantum states with energies of the form $E_0+gE_1/4+O(g^2)$, where $E_0$ and $E_1$ are integers. As a result, any superposition of these states evolves periodically with a period of at most $8\pi/g$ until, at much longer time scales of order $1/g^2$, corrections to the energies of order $g^2$ become important and may upset this perfectly periodic behavior. We further construct coherent-like combinations of these states that naturally connect to classical dynamics in an appropriate regime, and explain how our findings relate to the known time-periodic features of the corresponding weakly nonlinear classical theory. We briefly comment on possible generalizations of our analysis to other numbers of spatial dimensions and other analogous physical systems.

categories: cond-mat.quant-gas hep-th math-ph math.MP quant-ph


title: Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasets

abstract: The paper introduces a novel conditional independence (CI) based method for linear and nonlinear, lagged and contemporaneous causal discovery from observational time series in the causally sufficient case. Existing CI-based methods such as the PC algorithm and also common methods from other frameworks suffer from low recall and partially inflated false positives for strong autocorrelation which is an ubiquitous challenge in time series. The novel method, PCMCI$^+$, extends PCMCI [Runge et al., 2019b] to include discovery of contemporaneous links. PCMCI$^+$ improves the reliability of CI tests by optimizing the choice of conditioning sets and even benefits from autocorrelation. The method is order-independent and consistent in the oracle case. A broad range of numerical experiments demonstrates that PCMCI$^+$ has higher adjacency detection power and especially more contemporaneous orientation recall compared to other methods while better controlling false positives. Optimized conditioning sets also lead to much shorter runtimes than the PC algorithm. PCMCI$^+$ can be of considerable use in many real world application scenarios where often time resolutions are too coarse to resolve time delays and strong autocorrelation is present.


title: Flight restrictions from China during the COVID-2019 Coronavirus outbreak

abstract: This short note provides estimates of the number of passengers that travel from China to all world airports in the period October 2019 - March 2020 on the basis of historical data. From this baseline we subtract the expected reduction in the number of passengers taking into account the temporary ban of some routes which was put in place since 23 January 2020 following the COVID-2019 Coronavirus outbreak. The results indicate a reduction of the number of passengers in the period January - March 2020 of -2.5%. This calculation considers only the complete closure of routes (not just direct flights) and not the reduction in the number of passengers on still active direct and indirect connections. At the moment of writing, with such partial information it is premature to quantify economic losses on the civil air transport and tourism industry. This note is meant to provide a baseline that be extended to all countries of origin and updated as more recent data will become available.


title: Some Geometrical and Topological Properties of DNNs' Decision Boundaries

abstract: Geometry and topology of decision regions are closely related with classification performance and robustness against adversarial attacks. In this paper, we use differential geometry to theoretically explore the geometrical and topological properties of decision regions produced by deep neural networks (DNNs). The goal is to obtain some geometrical and topological properties of decision boundaries for given DNN models, and provide some principled guidance to design and regularization of DNNs. First, we present the curvatures of decision boundaries in terms of network parameters, and give sufficient conditions on network parameters for producing flat or developable decision boundaries. Based on the Gauss-Bonnet-Chern theorem in differential geometry, we then propose a method to compute the Euler characteristics of compact decision boundaries, and verify it with experiments.


title: Gabriel-Krull dimension and minimal atoms in Grothendieck categories

abstract: Let $\mathcal{A}$ be a Grothendieck category and let $M$ be an object of $\mathcal{A}$. In this paper, we define a dimension over $M$ via chain of atoms in ASupp$M$ and we show that it is a lower bound of Gabriel-Krull dimension of $M$ and in the case where ASpec$\mathcal{A}$ is an Alexandroff topological space, they are the same. We also show that this dimension establishes a new characterization for those categories $\mathcal{A}$ which ASpec$\mathcal{A}$ are Alexandroff topological spaces. We study the minimal atoms of a noetherian object and we give a sufficient condition for finiteness of the number of minimal atoms of a noetherian object.


title: Inverse Feature Learning: Feature learning based on Representation Learning of Error

abstract: This paper proposes inverse feature learning as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to learn the representation of error as high-level features, while current representation learning methods interpret error by loss functions which are obtained as a function of differences between the true labels and the predicted ones. One advantage of such learning method is that the learned features for each class are independent of learned features for other classes; therefore, this method can learn simultaneously meaning that it can learn new classes without retraining. Error representation learning can also help with generalization and reduce the chance of over-fitting by adding a set of impactful features to the original data set which capture the relationships between each instance and different classes through an error generation and analysis process. This method can be particularly effective in data sets, where the instances of each class have diverse feature representations or the ones with imbalanced classes. The experimental results show that the proposed method results in significantly better performance compared to the state-of-the-art classification techniques for several popular data sets. We hope this paper can open a new path to utilize the proposed perspective of error representation learning in different feature learning domains.


title: On the singular points approached by the medial axis

abstract: This paper develops the notion of superquadracity defined by L.Birbrair and M.Denkowski for subsets of R^n. In this regard, the main theorem of the paper establishes the relation between the superquadracity and non-empty intersection of the set and the closure of its medial axis. The further investigation concerns non C1 smooth points of the set.


title: Angle-Based Cost-Sensitive Multicategory Classification

abstract: Many real-world classification problems come with costs which can vary for different types of misclassification. It is thus important to develop cost-sensitive classifiers which minimize the total misclassification cost. Although binary cost-sensitive classifiers have been well-studied, solving multicategory classification problems is still challenging. A popular approach to address this issue is to construct K classification functions for a K-class problem and remove the redundancy by imposing a sum-to-zero constraint. However, such method usually results in higher computational complexity and inefficient algorithms. In this paper, we propose a novel angle-based cost-sensitive classification framework for multicategory classification without the sum-to-zero constraint. Loss functions that included in the angle-based cost-sensitive classification framework are further justified to be Fisher consistent. To show the usefulness of the framework, two cost-sensitive multicategory boosting algorithms are derived as concrete instances. Numerical experiments demonstrate that proposed boosting algorithms yield competitive classification performances against other existing boosting approaches.


title: Isolation Mondrian Forest for Batch and Online Anomaly Detection

abstract: We propose a new method, named isolation Mondrian forest (iMondrian forest), for batch and online anomaly detection. The proposed method is a novel hybrid of isolation forest and Mondrian forest which are existing methods for batch anomaly detection and online random forest, respectively. iMondrian forest takes the idea of isolation, using the depth of a node in a tree, and implements it in the Mondrian forest structure. The result is a new data structure which can accept streaming data in an online manner while being used for anomaly detection. Our experiments show that iMondrian forest mostly performs better than isolation forest in batch settings and has better or comparable performance against other batch and online anomaly detection methods.


title: On the Solution of the Nonsymmetric T-Riccati Equation

abstract: The nonsymmetric T-Riccati equation is a quadratic matrix equation where the linear part corresponds to the so-called T-Sylvester or T-Lyapunov operator that has previously been studied in the literature. It has applications in macroeconomics and policy dynamics. So far, it presents an unexplored problem in numerical analysis, and both, theoretical results and computational methods, are lacking in the literature. In this paper we provide some sufficient conditions for the existence and uniqueness of a nonnegative minimal solution and its efficient computation is deeply analyzed. Both the small-scale and the large-scale setting are addressed and Newton-Kleinman-like methods are derived. The convergence of these procedures to the minimal solution is proved and several numerical results illustrate the computational efficiency of the proposed methods.


title: Bandgap Control in Two-Dimensional Semiconductors via Coherent Doping of Plasmonic Hot Electrons

abstract: Bandgap control is of central importance for semiconductor technologies. The traditional means of control is to dope the lattice chemically, electrically or optically with charge carriers. Here, we demonstrate for the first time a widely tunable bandgap (renormalisation up to 650 meV at room-temperature) in two-dimensional (2D) semiconductors by coherently doping the lattice with plasmonic hot electrons. In particular, we integrate tungsten-disulfide (WS$_2$) monolayers into a self-assembled plasmonic crystal, which enables coherent coupling between semiconductor excitons and plasmon resonances. Accompanying this process, the plasmon-induced hot electrons can repeatedly fill the WS$_2$ conduction band, leading to population inversion and a significant reconstruction in band structures and exciton relaxations. Our findings provide an innovative and effective measure to engineer optical responses of 2D semiconductors, allowing a great flexiblity in design and optimisation of photonic and optoelectronic devices.


title: Progressive Growing of Neural ODEs

abstract: Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades substantially when applied to real-world data, especially long-term data with complex behaviors (e.g., long-term trend across years, mid-term seasonality across months, and short-term local variation across days). To address the modeling of such complex data with different behaviors at different frequencies (time spans), we propose a novel progressive learning paradigm of NODEs for long-term time series forecasting. Specifically, following the principle of curriculum learning, we gradually increase the complexity of data and network capacity as training progresses. Our experiments with both synthetic data and real traffic data (PeMS Bay Area traffic data) show that our training methodology consistently improves the performance of vanilla NODEs by over 64%.


title: Quantum ergodicity and localization of plasmon resonances

abstract: We are concerned with the geometric properties of the surface plasmon resonance (SPR). SPR is a non-radiative electromagnetic surface wave that propagates in a direction parallel to the negative permittivity/dielectric material interface. It is known that the SPR oscillation is very sensitive to the material interface. However, we show that the SPR oscillation asymptotically localizes at places with high magnitude of curvature in a certain sense. Our work leverages the Heisenberg picture of quantization and quantum ergodicity first derived by Shnirelman, Zelditch, Colin de Verdi\`ere and Helffer-Martinez-Robert, as well as certain novel and more general ergodic properties of the Neumann-Poincar\'e operator to analyze the SPR field, which are of independent interest to the spectral theory and the potential theory.

categories: math.AP math-ph math.MP math.SP physics.optics


title: FedLoc: Federated Learning Framework for Data-Driven Cooperative Localization and Location Data Processing

abstract: In this overview paper, data-driven learning model-based cooperative localization and location data processing are considered, in line with the emerging machine learning and big data methods. We first review (1) state-of-the-art algorithms in the context of federated learning, (2) two widely used learning models, namely the deep neural network model and the Gaussian process model, and (3) various distributed model hyper-parameter optimization schemes. Then, we demonstrate various practical use cases that are summarized from a mixture of standard, newly published, and unpublished works, which cover a broad range of location services, including collaborative static localization/fingerprinting, indoor target tracking, outdoor navigation using low-sampling GPS, and spatio-temporal wireless traffic data modeling and prediction. Experimental results show that near centralized data fitting- and prediction performance can be achieved by a set of collaborative mobile users running distributed algorithms. All the surveyed use cases fall under our newly proposed Federated Localization (FedLoc) framework, which targets on collaboratively building accurate location services without sacrificing user privacy, in particular, sensitive information related to their geographical trajectories. Future research directions are also discussed at the end of this paper.

categories: cs.DC cs.LG cs.SY eess.SP eess.SY stat.AP


title: A review of shaped colloidal particles in fluids: Anisotropy and chirality

abstract: This review treats asymmetric colloidal particles moving through their host fluid under the action of some form of propulsion. The propulsion can come from an external body force or from external shear flow. It may also come from externally-induced stresses at the surface, arising from imposed chemical, thermal or electrical gradients. The resulting motion arises jointly from the driven particle and the displaced fluid. If the objects are asymmetric, every aspect of their motion and interaction depends on the orientation of the objects. This orientation in turn changes in response to the driving. The objects' shape can thus lead to a range of emergent anisotropic and chiral motion not possible with isotropic spherical particles. We first consider what aspects of a body's asymmetry can affect its drift through a fluid, especially chiral motion. We next discuss driving by injecting external force or torque into the particles. Then we consider driving without injecting force or torque. This includes driving by shear flow and driving by surface stresses, such as electrophoresis. We consider how time-dependent driving can induce collective orientational order and coherent motion. We show how a given particle shape can be represented using an assembly of point forces called a Stokeslet object. We next consider the interactions between anisotropic propelled particles, the symmetries governing the interactions, and the possibility of bound pairs of particles. Finally we show how the collective hydrodynamics of a suspension can be qualitatively altered by the particles' shapes. The asymmetric responses discussed here are broadly relevant also for swimming propulsion of active micron-scale objects such as microorganisms.


title: Removing Disparate Impact of Differentially Private Stochastic Gradient Descent on Model Accuracy

abstract: When we enforce differential privacy in machine learning, the utility-privacy trade-off is different w.r.t. each group. Gradient clipping and random noise addition disproportionately affect underrepresented and complex classes and subgroups, which results in inequality in utility loss. In this work, we analyze the inequality in utility loss by differential privacy and propose a modified differentially private stochastic gradient descent (DPSGD), called DPSGD-F, to remove the potential disparate impact of differential privacy on the protected group. DPSGD-F adjusts the contribution of samples in a group depending on the group clipping bias such that differential privacy has no disparate impact on group utility. Our experimental evaluation shows how group sample size and group clipping bias affect the impact of differential privacy in DPSGD, and how adaptive clipping for each group helps to mitigate the disparate impact caused by differential privacy in DPSGD-F.


title: Dynamical Phase Transitions and their Relation to Thermodynamic Glass Physics

abstract: We review recent developments in structural-dynamical phase transitions in trajectory space. An open question is how the dynamic facilitation theory of the glass transition may be reconciled with thermodynamic theories that posit a vanishing configurational entropy. Dynamic facilitation theory invokes a dynamical phase transition, between an active phase (close to the normal liquid) and an inactive phase which is glassy, whose order parameter is either dynamic or a time-averaged structural quantity. In particular, the dynamical phase transition in systems with non-trivial thermodynamics manifests signatures of a lower critical point, which lies close to the putative Kauzmann temperature, where any thermodynamic phase transition to an ideal glass state might occur. We discuss these findings, and suggest that the lower critical point of the structural-dynamical phase transition may be related to the large drop in configurational entropy that occurs in the inactive phase of the dynamical phase transition. Increasing supercooling thus brings configurational entropy of the normal liquid much lower, along with the temperature.


title: Unifying Specialist Image Embedding into Universal Image Embedding

abstract: Deep image embedding provides a way to measure the semantic similarity of two images. It plays a central role in many applications such as image search, face verification, and zero-shot learning. It is desirable to have a universal deep embedding model applicable to various domains of images. However, existing methods mainly rely on training specialist embedding models each of which is applicable to images from a single domain. In this paper, we study an important but unexplored task: how to train a single universal image embedding model to match the performance of several specialists on each specialist's domain. Simply fusing the training data from multiple domains cannot solve this problem because some domains become overfitted sooner when trained together using existing methods. Therefore, we propose to distill the knowledge in multiple specialists into a universal embedding to solve this problem. In contrast to existing embedding distillation methods that distill the absolute distances between images, we transform the absolute distances between images into a probabilistic distribution and minimize the KL-divergence between the distributions of the specialists and the universal embedding. Using several public datasets, we validate that our proposed method accomplishes the goal of universal image embedding.


title: A microscopic model for spontaneous fission: validity of the adiabatic approximation

abstract: We investigate microscopically the tunneling dynamics in spontaneous fission of atomic nuclei. To this end, we employ a schematic solvable model with a pairing-plus-quadrupole interaction. The spontaneous decay of a system is simulated by introducing a small imaginary part to the energy of a fission doorway state. We show that the many-body Hamiltonian can be reduced to an effective 2$\times$2 Hamiltonian, from which one can derive a simple approximate formula for the decay width. We particularly investigate the applicability of the adiabatic approximation, which has often been used in the literature. With typical value of the parameters, we find that the adiabatic approximation works within a factor of around 5 for the decay width.


title: Transferring Cross-domain Knowledge for Video Sign Language Recognition

abstract: Word-level sign language recognition (WSLR) is a fundamental task in sign language interpretation. It requires models to recognize isolated sign words from videos. However, annotating WSLR data needs expert knowledge, thus limiting WSLR dataset acquisition. On the contrary, there are abundant subtitled sign news videos on the internet. Since these videos have no word-level annotation and exhibit a large domain gap from isolated signs, they cannot be directly used for training WSLR models. We observe that despite the existence of a large domain gap, isolated and news signs share the same visual concepts, such as hand gestures and body movements. Motivated by this observation, we propose a novel method that learns domain-invariant visual concepts and fertilizes WSLR models by transferring knowledge of subtitled news sign to them. To this end, we extract news signs using a base WSLR model, and then design a classifier jointly trained on news and isolated signs to coarsely align these two domain features. In order to learn domain-invariant features within each class and suppress domain-specific features, our method further resorts to an external memory to store the class centroids of the aligned news signs. We then design a temporal attention based on the learnt descriptor to improve recognition performance. Experimental results on standard WSLR datasets show that our method outperforms previous state-of-the-art methods significantly. We also demonstrate the effectiveness of our method on automatically localizing signs from sign news, achieving 28.1 for AP@0.5.


title: On Cohen-Jones isomorphism in string topology

abstract: The loop product is an operation in string topology. Cohen and Jones gave a homotopy theoretic realization of the loop product as a classical ring spectrum $LM^{-TM}$ for a manifold $M$. Using this, they presented a proof of the statement that the loop product is isomorphic to the Gerstenhaber cup product on the Hochschild cohomology $HH^*(C^*(M)\,;C^*(M))$ for simply connected $M$. However, some parts of their proof are technically difficult to justify. The main aim of the present paper is to give detailed modification to a geometric part of their proof. To do so, we set up an "up to higher homotopy" version of McClure-Smith's cosimplicial product. We prove a structured version of Cohen-Jones isomorphism in the category of symmetric spectra.


title: Observation of the $Y(4220)$ and $Y(4360)$ in the process $e^{+}e^{-} \to \eta J/\psi$

abstract: The cross sections of the process $e^{+}e^{-} \to \eta J/\psi$ at center-of-mass energies ($\sqrt{s}$) between 3.81 and 4.60 GeV are measured with high precision by using data samples collected with the BESIII detector operating at the BEPCII storage ring. Three structures are observed by analyzing the lineshape of the measured cross sections, and a maximum-likelihood fit including three resonances is performed by assuming the lowest lying structure is the $\psi(4040)$. For the other resonances, we obtain masses of $(4218.7 \pm 4.0 \pm 2.5)$ and $(4380.4 \pm 14.2 \pm 1.8)$ MeV/c$^{2}$ with corresponding widths of $(82.5 \pm 5.9 \pm 0.5)$ and $(147.0 \pm 63.0 \pm 25.8)$ MeV, respectively, where the first uncertainties are statistical and the second ones systematic. The measured resonant parameters are consistent with those of the $Y(4220)$ and $Y(4360)$ from pr evious measurements of different final states. For the first time, we observe the decays of the $Y(4220)$ and $Y(4360)$ into $\eta J/\psi$ final states.


title: Equivalence of Besov spaces on p.c.f. self-similar sets

abstract: On p.c.f. self-similar sets, of which the walk dimensions of heat kernels are in general larger than 2, we find a sharp region where two classes of Besov spaces, the heat Besov spaces $B^{p,q}_\sigma(K)$ and the Lipschitz-Besov spaces $\Lambda^{p,q}_\sigma(K)$, are identitical. In particular, we provide concrete examples that $B^{p,q}_\sigma(K)=\Lambda^{p,q}_\sigma(K)$ with $\sigma>1$. Our method is purely analytical, and does not involve any heat kernel estimate.


title: Adaptive Semantic-Visual Tree for Hierarchical Embeddings

abstract: Merchandise categories inherently form a semantic hierarchy with different levels of concept abstraction, especially for fine-grained categories. This hierarchy encodes rich correlations among various categories across different levels, which can effectively regularize the semantic space and thus make predictions less ambiguous. However, previous studies of fine-grained image retrieval primarily focus on semantic similarities or visual similarities. In a real application, merely using visual similarity may not satisfy the need of consumers to search merchandise with real-life images, e.g., given a red coat as a query image, we might get a red suit in recall results only based on visual similarity since they are visually similar. But the users actually want a coat rather than suit even the coat is with different color or texture attributes. We introduce this new problem based on photoshopping in real practice. That's why semantic information are integrated to regularize the margins to make "semantic" prior to "visual". To solve this new problem, we propose a hierarchical adaptive semantic-visual tree (ASVT) to depict the architecture of merchandise categories, which evaluates semantic similarities between different semantic levels and visual similarities within the same semantic class simultaneously. The semantic information satisfies the demand of consumers for similar merchandise with the query while the visual information optimizes the correlations within the semantic class. At each level, we set different margins based on the semantic hierarchy and incorporate them as prior information to learn a fine-grained feature embedding. To evaluate our framework, we propose a new dataset named JDProduct, with hierarchical labels collected from actual image queries and official merchandise images on an online shopping application. Extensive experimental results on the public CARS196 and CUB-