title: On dynamical ordering in a 2D electron crystal confined in a narrow channel geometry

abstract: We present both time-averaged and time-resolved transport measurements of a two-dimensional electron (Wigner) crystal on the surface of superfluid helium confined in a narrow microchannel. We find that the field-current characteristics of the driven crystal obtained by the time-averaged measurements exhibit oscillations and negative differential conductivity. This unusual transport behavior was observed previously by Glasson et al. [Phys. Rev. Lett. 87, 176802 (2001)] and was attributed to a nonequilibrium transition of the electron system to a novel dynamically ordered phase of current filaments aligned along the channels. Contrarily to this explanation, our time-resolved transport measurements reveal that oscillating field-current characteristics appear due to dynamical decoupling (slipping) and recoupling (sticking) of the uniform electron crystal to the liquid helium substrate. Our result demonstrates that this unusual non-linear transport effect is intrinsic, does not depend on the device geometry, and is associated with the dynamical interaction of Wigner crystal with the surface excitations of the liquid substrate.


title: PCA Initialization for Approximate Message Passing in Rotationally Invariant Models

abstract: We study the problem of estimating a rank-$1$ signal in the presence of rotationally invariant noise-a class of perturbations more general than Gaussian noise. Principal Component Analysis (PCA) provides a natural estimator, and sharp results on its performance have been obtained in the high-dimensional regime. Recently, an Approximate Message Passing (AMP) algorithm has been proposed as an alternative estimator with the potential to improve the accuracy of PCA. However, the existing analysis of AMP requires an initialization that is both correlated with the signal and independent of the noise, which is often unrealistic in practice. In this work, we combine the two methods, and propose to initialize AMP with PCA. Our main result is a rigorous asymptotic characterization of the performance of this estimator. Both the AMP algorithm and its analysis differ from those previously derived in the Gaussian setting: at every iteration, our AMP algorithm requires a specific term to account for PCA initialization, while in the Gaussian case, PCA initialization affects only the first iteration of AMP. The proof is based on a two-phase artificial AMP that first approximates the PCA estimator and then mimics the true AMP. Our numerical simulations show an excellent agreement between AMP results and theoretical predictions, and suggest an interesting open direction on achieving Bayes-optimal performance.

categories: stat.ML cs.IT cs.LG math.IT math.ST stat.TH


title: Adiabatic Quantum Feature Selection for Sparse Linear Regression

abstract: Linear regression is a popular machine learning approach to learn and predict real valued outputs or dependent variables from independent variables or features. In many real world problems, its beneficial to perform sparse linear regression to identify important features helpful in predicting the dependent variable. It not only helps in getting interpretable results but also avoids overfitting when the number of features is large, and the amount of data is small. The most natural way to achieve this is by using `best subset selection' which penalizes non-zero model parameters by adding $\ell_0$ norm over parameters to the least squares loss. However, this makes the objective function non-convex and intractable even for a small number of features. This paper aims to address the intractability of sparse linear regression with $\ell_0$ norm using adiabatic quantum computing, a quantum computing paradigm that is particularly useful for solving optimization problems faster. We formulate the $\ell_0$ optimization problem as a Quadratic Unconstrained Binary Optimization (QUBO) problem and solve it using the D-Wave adiabatic quantum computer. We study and compare the quality of QUBO solution on synthetic and real world datasets. The results demonstrate the effectiveness of the proposed adiabatic quantum computing approach in finding the optimal solution. The QUBO solution matches the optimal solution for a wide range of sparsity penalty values across the datasets.


title: Synchronization of chiral vortex nano-oscillators

abstract: The development of spintronic oscillators is driven by their potential applications in radio frequency telecommunication and neuromorphic computing. In this work, we propose a spintronic oscillator based on the chiral coupling in thin magnetic films with patterned anisotropy. With an in-plane magnetized disk imprinted on an out-of-plane magnetized slab, the oscillator takes a polar vortex-like magnetic structure in the disk stabilized by a strong Dzyaloshinskii-Moriya interaction. By means of micromagnetic simulations, we investigate its oscillatory properties under applied spin current and, by placing an ensemble of oscillators in the near vicinity, we demonstrate their synchronization with different resonant frequencies. Finally, we show their potential application in neuromorphic computing using a network with six oscillators.


title: How Good Is NLP? A Sober Look at NLP Tasks through the Lens of Social Impact

abstract: Recent years have seen many breakthroughs in natural language processing (NLP), transitioning it from a mostly theoretical field to one with many real-world applications. Noting the rising number of applications of other machine learning and AI techniques with pervasive societal impact, we anticipate the rising importance of developing NLP technologies for social good. Inspired by theories in moral philosophy and global priorities research, we aim to promote a guideline for social good in the context of NLP. We lay the foundations via the moral philosophy definition of social good, propose a framework to evaluate the direct and indirect real-world impact of NLP tasks, and adopt the methodology of global priorities research to identify priority causes for NLP research. Finally, we use our theoretical framework to provide some practical guidelines for future NLP research for social good. Our data and code are available at http://github.com/zhijing-jin/nlp4sg_acl2021. In addition, we curate a list of papers and resources on NLP for social good at https://github.com/zhijing-jin/NLP4SocialGood_Papers.


title: Neutron diffraction of field-induced magnon condensation in the spin-dimerized antiferromagnet Sr$_{3}$Cr$_{2}$O$_{8}$

abstract: In this work, we investigate the evolution and settling of magnon condensation in the spin-1/2 dimer system Sr$_{3}$Cr$_{2}$O$_{8}$ using a combination of magnetostriction in pulsed fields and inelastic neutron scattering in a continuous magnetic field. The magnetic structure in the Bose-Einstein condensation (BEC) phase was probed by neutron diffraction in pulsed magnetic fields up to 39~T. The magnetic structure in this phase was confirmed to be an XY-antiferromagnetic structure validated by irreducible representational analysis. The magnetic phase diagram as a function of an applied magnetic field for this system is presented. Furthermore, zero-field neutron diffraction results indicate that dimerization plays an important role in stabilizing the low-temperature crystal structure.


title: Facade-X: an opinionated approach to SPARQL anything

abstract: The Semantic Web research community understood since its beginning how crucial it is to equip practitioners with methods to transform non-RDF resources into RDF. Proposals focus on either engineering content transformations or accessing non-RDF resources with SPARQL. Existing solutions require users to learn specific mapping languages (e.g. RML), to know how to query and manipulate a variety of source formats (e.g. XPATH, JSON-Path), or to combine multiple languages (e.g. SPARQL Generate). In this paper, we explore an alternative solution and contribute a general-purpose meta-model for converting non-RDF resources into RDF: Facade-X. Our approach can be implemented by overriding the SERVICE operator and does not require to extend the SPARQL syntax. We compare our approach with the state of art methods RML and SPARQL Generate and show how our solution has lower learning demands and cognitive complexity, and it is cheaper to implement and maintain, while having comparable extensibility and efficiency.


title: Requirements for beneficial electrochemical restructuring: A model study on a cobalt oxide in selected electrolytes

abstract: The requirements for beneficial materials restructuring into a higher performance OER electrocatalyst are still a largely open question. Here we use Erythrite (Co$_3$(AsO$_4$)$_2\cdot$8H$_2$O) as a Co-based OER electrocatalyst to evaluate its catalytic properties during in-situ restructuring into an amorphous Co-based catalyst in four different electrolytes at pH 7. Using diffraction, microscopy and spectroscopy, we observed a strong effect in the restructuring kinetics depending of the anions in the electrolyte. Only carbonate electrolyte could activate the catalyst electrode, which we relate to its slow restructuring kinetics. While its turnover frequency (TOF) reduced from 2.84 O$_2$ Co$^{-1}$ s$^{-1}$ to a constant value of 0.10 O$_2$ Co$^{-1}$ s$^{-1}$ after 300 cycles, the number of redox active sites continuously increased, which explained the current increase of around 100%. The final activated material owns an adequate local order, a high Co oxidation state and a high number of redox-active Co ions, which we identify as the trinity for enhancing the OER activity. Thus, this work provides new insights into for the rational design of high-performance OER catalysts by electrochemical restructuring.


title: Learning Slice-Aware Representations with Mixture of Attentions

abstract: Real-world machine learning systems are achieving remarkable performance in terms of coarse-grained metrics like overall accuracy and F-1 score. However, model improvement and development often require fine-grained modeling on individual data subsets or slices, for instance, the data slices where the models have unsatisfactory results. In practice, it gives tangible values for developing such models that can pay extra attention to critical or interested slices while retaining the original overall performance. This work extends the recent slice-based learning (SBL)~\cite{chen2019slice} with a mixture of attentions (MoA) to learn slice-aware dual attentive representations. We empirically show that the MoA approach outperforms the baseline method as well as the original SBL approach on monitored slices with two natural language understanding (NLU) tasks.


title: varycoef: An R Package for Gaussian Process-based Spatially Varying Coefficient Models

abstract: Gaussian processes (GPs) are well-known tools for modeling dependent data with applications in spatial statistics, time series analysis, or econometrics. In this article, we present the R package varycoef that implements estimation, prediction, and variable selection of linear models with spatially varying coefficients (SVC) defined by GPs, so called GP-based SVC models. Such models offer a high degree of flexibility while being relatively easy to interpret. Using varycoef, we show versatile applications of (spatially) varying coefficient models on spatial and time series data. This includes model and coefficient estimation with predictions and variable selection. The package uses state-of-the-art computational statistics techniques like parallelization, model-based optimization, and covariance tapering. This allows the user to work with (S)VC models in a computationally efficient manner, i.e., model estimation on large data sets is possible in a feasible amount of time.


title: A note on the invertibility of the Gabor frame operator on certain modulation spaces

abstract: We consider Gabor frames generated by a general lattice and a window function that belongs to one of the following spaces: the Sobolev space $V_1 = H^1(\mathbb R^d)$, the weighted $L^2$-space $V_2 = L_{1 + |x|}^2(\mathbb R^d)$, and the space $V_3 = \mathbb H^1(\mathbb R^d) = V_1 \cap V_2$ consisting of all functions with finite uncertainty product; all these spaces can be described as modulation spaces with respect to suitable weighted $L^2$ spaces. In all cases, we prove that the space of Bessel vectors in $V_j$ is mapped bijectively onto itself by the Gabor frame operator. As a consequence, if the window function belongs to one of the three spaces, then the canonical dual window also belongs to the same space. In fact, the result not only applies to frames, but also to frame sequences.


title: Physical Properties of Massive Compact Starburst Galaxies with Extreme Outflows

abstract: We present results on the nature of extreme ejective feedback episodes and the physical conditions of a population of massive ($\rm M_* \sim 10^{11} M_{\odot}$), compact starburst galaxies at z = 0.4-0.7. We use data from Keck/NIRSPEC, SDSS, Gemini/GMOS, MMT, and Magellan/MagE to measure rest-frame optical and near-IR spectra of 14 starburst galaxies with extremely high star formation rate surface densities (mean $\rm \Sigma_{SFR} \sim 3000 \,M_{\odot} yr^{-1} kpc^{-2}$) and powerful galactic outflows (maximum speeds v$_{98} \sim$ 1000-3000 km s$^{-1}$). Our unique data set includes an ensemble of both emission [OII]$\lambda\lambda$3726,3729, H$\beta$, [OIII]$\lambda\lambda$4959,5007, H$\alpha$, [NII]$\lambda\lambda$6548,6583, and [SII]$\lambda\lambda$6716,6731) and absorption MgII$\lambda\lambda$2796,2803, and FeII$\lambda$2586) lines that allow us to investigate the kinematics of the cool gas phase (T$\sim$10$^4$ K) in the outflows. Employing a suite of line ratio diagnostic diagrams, we find that the central starbursts are characterized by high electron densities (median n$_e \sim$ 530 cm$^{-3}$), and high metallicity (solar or super-solar). We show that the outflows are most likely driven by stellar feedback emerging from the extreme central starburst, rather than by an AGN. We also present multiple intriguing observational signatures suggesting that these galaxies may have substantial Lyman continuum (LyC) photon leakage, including weak [SII] nebular emission lines. Our results imply that these galaxies may be captured in a short-lived phase of extreme star formation and feedback where much of their gas is violently blown out by powerful outflows that open up channels for LyC photons to escape.


title: Logarithmic Schr{\"o}dinger equation with quadratic potential

abstract: We analyze dynamical properties of the logarithmic Schr{\"o}dinger equation under a quadratic potential. The sign of the nonlinearity is such that it is known that in the absence of external potential, every solution is dispersive, with a universal asymptotic profile. The introduction of a harmonic potential generates solitary waves, corresponding to generalized Gaussons. We prove that they are orbitally stable, using an inequality related to relative entropy, which may be thought of as dual to the classical logarithmic Sobolev inequality. In the case of a partial confinement, we show a universal dispersive behavior for suitable marginals. For repulsive harmonic potentials, the dispersive rate is dictated by the potential, and no universal behavior must be expected.


title: Global existence, uniform boundedness, and stabilization in a chemotaxis system with density-suppressed motility and nutrient consumption

abstract: Well-posedness and uniform-in-time boundedness of classical solutions are investigated for a three-component parabolic system which describes the dynamics of a population of cells interacting with a chemoattractant and a nutrient. The former induces a chemotactic bias in the diffusive motion of the cells and is accounted for by a density-suppressed motility. Well-posedness is first established for generic positive and non-increasing motility functions vanishing at infinity. Growth conditions on the motility function guaranteeing the uniform-in-time boundedness of solutions are next identified. Finally, for sublinearly decaying motility functions, convergence to a spatially homogeneous steady state is shown, with an exponential rate for consumption rates behaving linearly near zero.


title: ToyADMOS2: Another dataset of miniature-machine operating sounds for anomalous sound detection under domain shift conditions

abstract: This paper proposes a new large-scale dataset called "ToyADMOS2" for anomaly detection in machine operating sounds (ADMOS). As did for our previous ToyADMOS dataset, we collected a large number of operating sounds of miniature machines (toys) under normal and anomaly conditions by deliberately damaging them but extended with providing controlled depth of damages in anomaly samples. Since typical application scenarios of ADMOS often require robust performance under domain-shift conditions, the ToyADMOS2 dataset is designed for evaluating systems under such conditions. The released dataset consists of two sub-datasets for machine-condition inspection: fault diagnosis of machines with geometrically fixed tasks and fault diagnosis of machines with moving tasks. Domain shifts are represented by introducing several differences in operating conditions, such as the use of the same machine type but with different machine models and parts configurations, different operating speeds, microphone arrangements, etc. Each sub-dataset contains over 27 k samples of normal machine-operating sounds and over 8 k samples of anomalous sounds recorded with five to eight microphones. The dataset is freely available for download at https://github.com/nttcslab/ToyADMOS2-dataset and https://doi.org/10.5281/zenodo.4580270.


title: Uncertainty in Position Estimation Using Machine Learning

abstract: UE localization has proven its implications on multitude of use cases ranging from emergency call localization to new and emerging use cases in industrial IoT. To support plethora of use cases Radio Access Technology (RAT)-based positioning has been supported by 3GPP since Release 9 of its specifications that featured basic positioning methods based on Cell Identity (CID) and Enhanced-CID (E-CID). Since then, multiple positioning techniques and solutions are proposed and integrated in to the 3GPP specifications. When it comes to evaluating performance of the positioning techniques, achievable accuracy (2-Dimensional or 3-Dimensional) has, so far, been the primary metric. With the advent of Release 16 New Radio (NR) positioning, it is possible to configure Positioning Reference Signal (PRS) with wide bandwidth that naturally helps improving the positioning accuracy. However, the improvement is evident when the conditions are ideal for positioning. In practice where the conditions are non-ideal and the positioning accuracy is severely impacted, estimating the uncertainty in position estimation becomes important and can provide significant insight on how reliable a position estimation is. In order to determine the uncertainty in position estimation we resort to Machine Learning (ML) techniques that offer ways to determine the uncertainty/reliability of the predictions for a trained model. Hence, in this work we propose to combine ML methods such as Gaussian Process (GP) and Random Forest (RF) with RAT-based positioning measurements to predict the location of a UE and in the meantime also assess the uncertainty of the estimated position. The results show that both GP and RF not only achieve satisfactory positioning accuracy but also give a reliable uncertainty assessment of the predicted position of the UE.


title: Cupid's Invisible Hand: Social Surplus and Identification in Matching Models

abstract: We investigate a model of one-to-one matching with transferable utility and general unobserved heterogeneity. Under a separability assumption that generalizes Choo and Siow (2006), we first show that the equilibrium matching maximizes a social gain function that trades off exploiting complementarities in observable characteristics and matching on unobserved characteristics. We use this result to derive simple closed-form formulae that identify the joint matching surplus and the equilibrium utilities of all participants, given any known distribution of unobserved heterogeneity. We provide efficient algorithms to compute the stable matching and to estimate parametric versions of the model. Finally, we revisit Choo and Siow's empirical application to illustrate the potential of our more general approach.


title: Nonlinear Reduction using the Extended Group Finite Element Method

abstract: In this paper, we develop a nonlinear reduction framework based on our recently introduced extended group finite element method. By interpolating nonlinearities onto approximation spaces defined with the help of finite elements, the extended group finite element formulation achieves a noticeable reduction in the computational overhead associated with nonlinear finite element problems. However, the problem's size still leads to long solution times in most applications. Aiming to make real-time and/or many-query applications viable, we apply model order reduction and complexity reduction techniques in order to reduce the problem size and efficiently handle the reduced nonlinear terms, respectively. For this work, we focus on the proper orthogonal decomposition and discrete empirical interpolation methods. While similar approaches based on the group finite element method only focus on semilinear problems, our proposed framework is also compatible with quasilinear problems. Compared to existing methods, our reduced models prove to be superior in many different aspects as demonstrated in three numerical benchmark problems.


title: A topological characterisation of the Kashiwara-Vergne groups

abstract: In 2017 Bar-Natan and the first author showed that solutions to the Kashiwara--Vergne equations are in bijection with certain knot invariants: homomorphic expansions of welded foams. Welded foams are a class of knotted tubes in $\mathbb{R}^4$, which can be finitely presented algebraically as a circuit algebra, or, equivalently, a wheeled prop. In this paper we describe the Kashiwara-Vergne groups $\mathsf{KV}$ and $\mathsf{KRV}$ -- the symmetry groups of Kashiwara-Vergne solutions -- as automorphisms of the completed circuit algebras of welded foams, and their associated graded circuit algebra of arrow diagrams, respectively. Finally, we provide a description of the graded Grothendieck-Teichm\"uller group $\mathsf{GRT}_1$ as automorphisms of arrow diagrams.


title: Coordination of operational planning and real-time optimization in microgrids

abstract: Hierarchical microgrid control levels range from distributed device level controllers that run at a high frequency to centralized controllers optimizing market integration that run much less frequently. Centralized controllers are often subdivided into operational planning controllers that optimize decisions over a time horizon of one or several days, and real-time optimization controllers that deal with actions in the current market period. The coordination of these levels is of paramount importance. In this paper, we propose a value function-based approach as a way to propagate information from operational planning to real-time optimization. We apply this method to an environment where operational planning, using day-ahead forecasts, optimizes at a market period resolution the decisions to minimize the total energy cost and revenues, the peak consumption and injection-related costs, and plans for reserve requirements. While real-time optimization copes with the forecast errors and yields implementable actions based on real-time measurements. The approach is compared to a rule-based controller on three use cases, and its sensitivity to forecast error is assessed.


title: Excluding false negative error in certification of quantum channels

abstract: Certification of quantum channels is based on quantum hypothesis testing and involves also preparation of an input state and choosing the final measurement. This work primarily focuses on the scenario when the false negative error cannot occur, even if it leads to the growth of the probability of false positive error. We establish a condition when it is possible to exclude false negative error after a finite number of queries to the quantum channel in parallel, and we provide an upper bound on the number of queries. On top of that, we found a class of channels which allow for excluding false negative error after a finite number of queries in parallel, but cannot be distinguished unambiguously. Moreover, it will be proved that parallel certification scheme is always sufficient, however the number of steps may be decreased by the use of adaptive scheme. Finally, we consider examples of certification of various classes of quantum channels and measurements.


title: First demonstration of C + L band CDCROADM with simple node configuration using multiband switching devices

abstract: While ultrahigh-baud-rate optical signals are effective for extending the transmission distance of large capacity signals, they also reduce the number of wavelengths that can be arranged in a band because of their wider bandwidth. This reduces the flexibility of optical path configuration in reconfigurable optical add/drop multiplexing (ROADM) networks. In colorless, directionless and contentionless (CDC)-ROADM in particular, the effect reduces the add/drop ratio at a node. Multiband ROADM systems are an effective countermeasure for overcoming this issue, but they make the node configuration more complicated and its operation more difficult. In this paper, we analyze the challenges of C + L band CDC-ROADM and show that optical switch devices that operate over multiple bands are effective in meeting them. For this purpose, we built a C + L band CDC-ROADM node based on C + L band wavelength selective switches (WSSs) and multicast switches (MCSs) and confirmed its effectiveness experimentally. In particular, to simplify the node configuration, we propose a reduction in the number of optical amplifiers used for node loss compensation and experimentally verify its feasibility.


title: A Survey on Deep Domain Adaptation for LiDAR Perception

abstract: Scalable systems for automated driving have to reliably cope with an open-world setting. This means, the perception systems are exposed to drastic domain shifts, like changes in weather conditions, time-dependent aspects, or geographic regions. Covering all domains with annotated data is impossible because of the endless variations of domains and the time-consuming and expensive annotation process. Furthermore, fast development cycles of the system additionally introduce hardware changes, such as sensor types and vehicle setups, and the required knowledge transfer from simulation. To enable scalable automated driving, it is therefore crucial to address these domain shifts in a robust and efficient manner. Over the last years, a vast amount of different domain adaptation techniques evolved. There already exists a number of survey papers for domain adaptation on camera images, however, a survey for LiDAR perception is absent. Nevertheless, LiDAR is a vital sensor for automated driving that provides detailed 3D scans of the vehicle's surroundings. To stimulate future research, this paper presents a comprehensive review of recent progress in domain adaptation methods and formulates interesting research questions specifically targeted towards LiDAR perception.


title: Efficient Predictive Monitoring of Linear Time-Invariant Systems Under Stealthy Attacks

abstract: Attacks on Industrial Control Systems (ICS) can lead to significant physical damage. While offline safety and security assessments can provide insight into vulnerable system components, they may not account for stealthy attacks designed to evade anomaly detectors during long operational transients. In this paper, we propose a predictive online monitoring approach to check the safety of the system under potential stealthy attacks. Specifically, we adapt previous results in reachability analysis for attack impact assessment to provide an efficient algorithm for online safety monitoring for Linear Time-Invariant (LTI) systems. The proposed approach relies on an offline computation of symbolic reachable sets in terms of the estimated physical state of the system. These sets are then instantiated online, and safety checks are performed by leveraging ideas from ellipsoidal calculus. We illustrate and evaluate our approach using the Tennessee-Eastman process. We also compare our approach with the baseline monitoring approaches proposed in previous work and assess its efficiency and scalability. Our evaluation results demonstrate that our approach can predict in a timely manner if a false data injection attack will be able to cause damage, while remaining undetected. Thus, our approach can be used to provide operators with real-time early warnings about stealthy attacks.


title: Global stable splittings of Stiefel manifolds

abstract: We prove global equivariant refinements of Miller's stable splittings of the infinite orthogonal, unitary and symplectic groups, and more generally of the spaces $O/O(m)$, $U/U(m)$ and $Sp/Sp(m)$. As such, our results encode compatible equivariant stable splittings, for all compact Lie groups, of specific equivariant refinements of these spaces. In the unitary and symplectic case, we also take the actions of the Galois groups into account. To properly formulate these Galois-global statements, we introduce a generalization of global stable homotopy theory in the presence of an extrinsic action of an additional topological group.


title: Revealing Collective Emission in the Single-to-Bulk Transition of Quantum Emitters in Nanodiamond Agglomerates

abstract: Individual quantum emitters form a fundamental building block for emerging quantum technologies. Collective effects of such emitters might improve the performance of applications even further. When scaling materials to larger sizes, however, collective effects might be covered by transitions to bulk properties. Here, we probe the optical properties of Nitrogen Vacancy (NV) centers in agglomerates of nanodiamonds. We quantify the transition from individual emitters to bulk emission by fluorescence lifetime measurements, and find a transition to occur on a length scale of $\sim 3$ wavelengths around the emitter. While our lifetime measurements are consistent with superradiant decay, the second-order correlation function, which is a standard measure to reveal collective properties, fails to probe collective effects for our case of an ensemble of collectively contributing domains to the emission. Therefore, we propose and apply a new measure to trace collective effects based on the fluctuation statistics of the emitted light. Our work points toward systematically studying collective effects in a scalable solid-state quantum system, and using them for quantum optical applications in agglomerates of highly-doped nanodiamonds.


title: Membership in random ratio sets

abstract: Let $\mathcal{A}$ be a random set constructed by picking independently each element of $\{1, \dots, n\}$ with probability $\alpha \in (0, 1)$. We give a formula for the probability that a rational number $q$ belong to the random ratio set $\mathcal{A} /\! \mathcal{A} := \{a / b : a,b \in \mathcal{A}\}$. This generalizes a previous result of Cilleruelo and Guijarro-Ord\'o\~nez. Moreover, we make some considerations about formulas for the probability of the event $\bigvee_{i=1}^k\!\big(q_i \in \mathcal{A} /\! \mathcal{A}\big)$, where $q_1, \dots, q_k$ are rational numbers, showing that they are related to the study of the connected components of certain graphs. In particular, we give formulas for the probability that $q^e \in \mathcal{A} /\! \mathcal{A}$ for some $e \in \mathcal{E}$, where $\mathcal{E}$ is a finite or cofinite set of positive integers with $1 \in \mathcal{E}$.


title: Annotation Curricula to Implicitly Train Non-Expert Annotators

abstract: Annotation studies often require annotators to familiarize themselves with the task, its annotation scheme, and the data domain. This can be overwhelming in the beginning, mentally taxing, and induce errors into the resulting annotations; especially in citizen science or crowd sourcing scenarios where domain expertise is not required and only annotation guidelines are provided. To alleviate these issues, we propose annotation curricula, a novel approach to implicitly train annotators. Our goal is to gradually introduce annotators into the task by ordering instances that are annotated according to a learning curriculum. To do so, we first formalize annotation curricula for sentence- and paragraph-level annotation tasks, define an ordering strategy, and identify well-performing heuristics and interactively trained models on three existing English datasets. We then conduct a user study with 40 voluntary participants who are asked to identify the most fitting misconception for English tweets about the Covid-19 pandemic. Our results show that using a simple heuristic to order instances can already significantly reduce the total annotation time while preserving a high annotation quality. Annotation curricula thus can provide a novel way to improve data collection. To facilitate future research, we further share our code and data consisting of 2,400 annotations.


title: PoDT: A Secure Multi-chains Consensus Scheme Against Diverse Miners Behaviors Attacks in Blockchain Networks

abstract: As cross-chain technologies make the interactions among different blockchains (hereinafter "chains") possible, multi-chains consensus is becoming more and more important in blockchain networks. However, more attention has been paid to the single-chain consensus schemes. The multi-chains consensus with trusted miners participation has been not considered, thus offering opportunities for malicious users to launch Diverse Miners Behaviors (DMB) attacks on different chains. DMB attackers can be friendly in the consensus process of some chains called mask-chains to enhance trust value, while on other chains called kill-chains they engage in destructive behaviors of network. In this paper, we propose a multi-chains consensus scheme named as Proof-of-DiscTrust (PoDT) to defend against DMB attacks. Distinctive trust idea (DiscTrust) is introduced to evaluate the trust value of each user concerning different chains. A dynamic behaviors prediction scheme is designed to strengthen DiscTrust to prevent intensive DMB attackers who maintain high trust by alternately creating true or false blocks on kill-chains. On this basis, a trusted miners selection algorithm for multi-chains can be achieved at a round of block creation. Experimental results show that PoDT is secure against DMB attacks and more effective than traditional consensus schemes in multi-chains environments.


title: New Massive JT Multi-Gravity and N-Replica of SYK Models

abstract: We study a series of powerful correspondences among new multi-gravity extensions of the Jackiw-Teitelboim model, multi-SYK models and multi-Schwarzian quantum mechanics, in the $\rm{(A)dS_{2}/CFT}$ arena. Deploying a $BF$-like formulation of the model, we discuss the counting of the degrees of freedom for some specific classes of multi-gravity potentials, and unveil connections among a variety of apparently different models. Quantization of multi-gravity models can be then achieved from both the Hartle-Hawking no-boundary proposal, the SYK partition function and the spin-foam approaches. We comment on the SYK quantization procedure, and deepen in the appendix the quantization scheme naturally achieved in the $BF$ framework. The new multi-gravity theory hence recovered presents intriguing applications for analogue gravitational models developed for condensed matter physics, including graphene, endowed with defects and high intensity magnetic fields.


title: Controlling False Positive/Negative Rates for Deep-Learning-Based Prostate Cancer Detection on Multiparametric MR images

abstract: Prostate cancer (PCa) is one of the leading causes of death for men worldwide. Multi-parametric magnetic resonance (mpMR) imaging has emerged as a non-invasive diagnostic tool for detecting and localising prostate tumours by specialised radiologists. These radiological examinations, for example, for differentiating malignant lesions from benign prostatic hyperplasia in transition zones and for defining the boundaries of clinically significant cancer, remain challenging and highly skill-and-experience-dependent. We first investigate experimental results in developing object detection neural networks that are trained to predict the radiological assessment, using these high-variance labels. We further argue that such a computer-assisted diagnosis (CAD) system needs to have the ability to control the false-positive rate (FPR) or false-negative rate (FNR), in order to be usefully deployed in a clinical workflow, informing clinical decisions without further human intervention. This work proposes a novel PCa detection network that incorporates a lesion-level cost-sensitive loss and an additional slice-level loss based on a lesion-to-slice mapping function, to manage the lesion- and slice-level costs, respectively. Our experiments based on 290 clinical patients concludes that 1) The lesion-level FNR was effectively reduced from 0.19 to 0.10 and the lesion-level FPR was reduced from 1.03 to 0.66 by changing the lesion-level cost; 2) The slice-level FNR was reduced from 0.19 to 0.00 by taking into account the slice-level cost; (3) Both lesion-level and slice-level FNRs were reduced with lower FP/FPR by changing the lesion-level or slice-level costs, compared with post-training threshold adjustment using networks without the proposed cost-aware training.


title: Bornological quantum groups as locally compact quantum groups

abstract: Bornological quantum groups were introduced by Voigt in order to generalize the theory of algebraic quantum groups in the sense of van Daele. In particular the class of bornological quantum groups contains all classical locally compact groups. In this paper we prove that a bornological quantum group gives rise to a locally compact quantum group, in a similar way to Kustermans and van Daele's result for algebraic quantum groups. We show that the bornological quantum groups, although more general than the algebraic ones, share most of their nice properties. We also argue that bornological quantum groups, when they occur as dense subalgebras of locally compact quantum groups, are useful tools for studying locally compact quantum groups. For instance, we show that the simple definition of a bornological closed quantum subgroup yields a closed subgroup of the locally compact quantum group in the sense of Vaes or Wooronowicz.


title: EEG changes and motor deficits in Parkinson's disease patients: Correlation of motor scales and EEG power bands

abstract: Over the years motor deficit in Parkinson's Disease (PD) patients was largely studied, however, no consistent pattern of relations between quantitative electroencephalography (qEEG) and motor scales emerged. There is a general lack of information on the relation between EEG changes and scales related to specific motor deficits. Therefore, the study aimed to investigate the relation between brain oscillatory activity alterations (EEG power bands) and most used PD-related motor deficit scales. A positive correlation was found between the freezing of the gait questionnaire (FOGQ) and delta spectral power band (rho=0.67; p=0.008), while a negative correlation with the same scale was observed in the alpha spectral power band (rho=-0.59, p=0.027). Additionally, motor scores measure by motor part of Unified Parkinson's Disease Rating Scale (UPDRS) correlated directly with theta (rho=0.55, p=0.040) and inversely with beta EEG power band (rho=-0.77, p=0.001). No significant correlation was found between spectral powers and Hoehn and Yahr (H&Y), BERG (Berg K. et. al. 1995), Modified Parkinson Activity Scale (MPAS), Six-Minute Walk Test (6MWT) and Timed Up and Go Test (TUG). In conclusion, our study supports the earlier findings suggesting a link between EEG slowing and motor decline, providing more insight into the relation between EEG alteration and deficits in different motor domains. These findings indicate that EEG assessment may be a useful biomarker for objective monitoring of progression and neurophysiological effect of rehabilitation approaches in PD's.


title: Gravitational collapse from cold uniform asymmetric initial conditions

abstract: Using controlled numerical N-body experiments, we show how, in the collapse dynamics of an initially cold and uniform distribution of particles with a generic asymmetric shape, finite $N$ fluctuations and perturbations induced by the anisotropic gravitational field compete to determine the physical properties of the asymptotic quasi-stationary state. When finite $N$ fluctuations dominate the dynamics, the particle energy distribution changes greatly and the final density profile {decays outside its core} as $r^{-4}$ with an $N$-dependent amplitude. On the other hand, in the limit where the anisotropic perturbations dominate, the collapse is softer and the density profile shows a decay as $r^{-3}$, as is typical of halos in cosmological simulations. However, even in this limit, convergence with $N$ of the macroscopic properties of the virialized system, such as the particle energy distributions, the bound mass, and the density profile, is very slow and not clearly established, including for our largest simulations (with $N \sim 10^6$). Our results illustrate the challenges of accurately simulating the first collapsing structures in standard-type cosmological models


title: The sine kernel, two corresponding operator identities, and random matrices

abstract: In the present paper, we consider the integral operator, which acts in Hilbert space and has sine kernel. This operator generates two operator identities and two corresponding canonical differential systems. We find the asymptotics of the corresponding resolvent and Hamiltonians. We use both the method of operator identities and the theory of random matrices.

categories: math.CA math.FA math.PR math.SP math.ST stat.TH


title: Online reinforcement learning with sparse rewards through an active inference capsule

abstract: Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered reward functions, but which often struggle to learn in sparse-reward environments, generally require many environmental interactions to perform well, and are typically computationally very expensive. Active inference is a model-based approach that directs agents to explore uncertain states while adhering to a prior model of their goal behaviour. This paper introduces an active inference agent which minimizes the novel free energy of the expected future. Our model is capable of solving sparse-reward problems with a very high sample efficiency due to its objective function, which encourages directed exploration of uncertain states. Moreover, our model is computationally very light and can operate in a fully online manner while achieving comparable performance to offline RL methods. We showcase the capabilities of our model by solving the mountain car problem, where we demonstrate its superior exploration properties and its robustness to observation noise, which in fact improves performance. We also introduce a novel method for approximating the prior model from the reward function, which simplifies the expression of complex objectives and improves performance over previous active inference approaches.


title: Data-Driven Control Design with LMIs and Dynamic Programming

abstract: The goal of this paper is to develop data-driven control design and evaluation strategies based on linear matrix inequalities (LMIs) and dynamic programming. We consider deterministic discrete-time LTI systems, where the system model is unknown. We propose efficient data collection schemes from the state-input trajectories together with data-driven LMIs to design state-feedback controllers for stabilization and linear quadratic regulation (LQR) problem. In addition, we investigate theoretically guaranteed exploration schemes to acquire valid data from the trajectories under different scenarios. In particular, we prove that as more and more data is accumulated, the collected data becomes valid for the proposed algorithms with higher probability. Finally, data-driven dynamic programming algorithms with convergence guarantees are then discussed.


title: Ambulatory blood pressure monitoring versus office blood pressure measurement: Are there sex differences?

abstract: The accurate measurement of blood pressure (BP) is an important prerequisite for the reliable diagnosis and efficient management of hypertension and other medical conditions. Office Blood Pressure Measurement (OBP) is a technique performed in-office with the sphygmomanometer, while Ambulatory Blood Pressure Monitoring (ABPM) is a technique that measures blood pressure during 24h. The BP fluctuations also depend on other factors such as physical activity, temperature, mood, age, sex, any pathologies, a hormonal activity that may intrinsically influence the differences between OBP and ABPM. The aim of this study is to examine the possible influence of sex on the discrepancies between OBP and ABPM in 872 subjects with known or suspected hypertension. A significant correlation was observed between OBP and ABPM mean values calculated during the day, night and 24h (ABPMday, ABPMnight, ABPM24h) in both groups (p<0.0001). The main finding of this study is that no difference between sexes was observed in the relation between OBP and mean ABMP values except between systolic OBP and systolic ABPM during the night. In addition, this study showed a moderate correlation between BPs obtained with the two approaches with a great dispersion around the regression line which suggests that the two approaches cannot be used interchangeably.


title: Multitask Online Mirror Descent

abstract: We introduce and analyze MT-OMD, a multitask generalization of Online Mirror Descent (OMD) which operates by sharing updates between tasks. We prove that the regret of MT-OMD is of order $\sqrt{1 + \sigma^2(N-1)}\sqrt{T}$, where $\sigma^2$ is the task variance according to the geometry induced by the regularizer, $N$ is the number of tasks, and $T$ is the time horizon. Whenever tasks are similar, that is $\sigma^2 \le 1$, our method improves upon the $\sqrt{NT}$ bound obtained by running independent OMDs on each task. We further provide a matching lower bound, and show that our multitask extensions of Online Gradient Descent and Exponentiated Gradient, two major instances of OMD, enjoy closed-form updates, making them easy to use in practice. Finally, we present experiments which support our theoretical findings.


title: On the Strategyproofness of the Geometric Median

abstract: The geometric median, an instrumental component of the secure machine learning toolbox, is known to be effective when robustly aggregating models (or gradients), gathered from potentially malicious (or strategic) users. What is less known is the extent to which the geometric median incentivizes dishonest behaviors. This paper addresses this fundamental question by quantifying its strategyproofness. While we observe that the geometric median is not even approximately strategyproof, we prove that it is asymptotically $\alpha$-strategyproof: when the number of users is large enough, a user that misbehaves can gain at most a multiplicative factor $\alpha$, which we compute as a function of the distribution followed by the users. We then generalize our results to the case where users actually care more about specific dimensions, determining how this impacts $\alpha$. We also show how the skewed geometric medians can be used to improve strategyproofness.


title: DOCTOR: A Simple Method for Detecting Misclassification Errors

abstract: Deep neural networks (DNNs) have shown to perform very well on large scale object recognition problems and lead to widespread use for real-world applications, including situations where DNN are implemented as "black boxes". A promising approach to secure their use is to accept decisions that are likely to be correct while discarding the others. In this work, we propose DOCTOR, a simple method that aims to identify whether the prediction of a DNN classifier should (or should not) be trusted so that, consequently, it would be possible to accept it or to reject it. Two scenarios are investigated: Totally Black Box (TBB) where only the soft-predictions are available and Partially Black Box (PBB) where gradient-propagation to perform input pre-processing is allowed. Empirically, we show that DOCTOR outperforms all state-of-the-art methods on various well-known images and sentiment analysis datasets. In particular, we observe a reduction of up to $4\%$ of the false rejection rate (FRR) in the PBB scenario. DOCTOR can be applied to any pre-trained model, it does not require prior information about the underlying dataset and is as simple as the simplest available methods in the literature.


title: A Learning-based Optimal Market Bidding Strategy for Price-Maker Energy Storage

abstract: Load serving entities with storage units reach sizes and performances that can significantly impact clearing prices in electricity markets. Nevertheless, price endogeneity is rarely considered in storage bidding strategies and modeling the electricity market is a challenging task. Meanwhile, model-free reinforcement learning such as the Actor-Critic are becoming increasingly popular for designing energy system controllers. Yet implementation frequently requires lengthy, data-intense, and unsafe trial-and-error training. To fill these gaps, we implement an online Supervised Actor-Critic (SAC) algorithm, supervised with a model-based controller -- Model Predictive Control (MPC). The energy storage agent is trained with this algorithm to optimally bid while learning and adjusting to its impact on the market clearing prices. We compare the supervised Actor-Critic algorithm with the MPC algorithm as a supervisor, finding that the former reaps higher profits via learning. Our contribution, thus, is an online and safe SAC algorithm that outperforms the current model-based state-of-the-art.


title: On Classifying Continuous Constraint Satisfaction Problems

abstract: A continuous constraint satisfaction problem (CCSP) is a constraint satisfaction problem (CSP) with an interval domain $U \subset \mathbb{R}$. We engage in a systematic study to classify CCSPs that are complete of the Existential Theory of the Reals, i.e., ER-complete. To define this class, we first consider the problem ETR, which also stands for Existential Theory of the Reals. In an instance of this problem we are given some sentence of the form $\exists x_1, \ldots, x_n \in \mathbb{R} : \Phi(x_1, \ldots, x_n)$, where $\Phi$ is a well-formed quantifier-free formula consisting of the symbols $\{0, 1, +, \cdot, \geq, >, \wedge, \vee, \neg\}$, the goal is to check whether this sentence is true. Now the class ER is the family of all problems that admit a polynomial-time many-one reduction to ETR. It is known that NP $\subseteq$ ER $\subseteq$ PSPACE. We restrict our attention on CCSPs with addition constraints ($x + y = z$) and some other mild technical conditions. Previously, it was shown that multiplication constraints ($x \cdot y = z$), squaring constraints ($x^2 = y$), or inversion constraints ($x\cdot y = 1$) are sufficient to establish ER-completeness. We extend this in the strongest possible sense for equality constraints as follows. We show that CCSPs (with addition constraints and some other mild technical conditions) that have any one well-behaved curved equality constraint ($f(x,y) = 0$) are ER-complete. We further extend our results to inequality constraints. We show that any well-behaved convexly curved and any well-behaved concavely curved inequality constraint ($f(x,y) \geq 0$ and $g(x,y) \geq 0$) imply ER-completeness on the class of such CCSPs.


title: Strategyproof Learning: Building Trustworthy User-Generated Datasets

abstract: We prove in this paper that, perhaps surprisingly, incentivizing data misreporting is not a fatality. By leveraging a careful design of the loss function, we propose Licchavi, a global and personalized learning framework with provable strategyproofness guarantees. Essentially, we prove that no user can gain much by replying to Licchavi's queries with answers that deviate from their true preferences. Interestingly, Licchavi also promotes the desirable "one person, one unit-force vote" fairness principle. Furthermore, our empirical evaluation of its performance showcases Licchavi's real-world applicability. We believe that our results are critical for the safety of any learning scheme that leverages user-generated data.


title: Prediction or Comparison: Toward Interpretable Qualitative Reasoning

abstract: Qualitative relationships illustrate how changing one property (e.g., moving velocity) affects another (e.g., kinetic energy) and constitutes a considerable portion of textual knowledge. Current approaches use either semantic parsers to transform natural language inputs into logical expressions or a "black-box" model to solve them in one step. The former has a limited application range, while the latter lacks interpretability. In this work, we categorize qualitative reasoning tasks into two types: prediction and comparison. In particular, we adopt neural network modules trained in an end-to-end manner to simulate the two reasoning processes. Experiments on two qualitative reasoning question answering datasets, QuaRTz and QuaRel, show our methods' effectiveness and generalization capability, and the intermediate outputs provided by the modules make the reasoning process interpretable.


title: A Deep Local and Global Scene-Graph Matching for Image-Text Retrieval

abstract: Conventional approaches to image-text retrieval mainly focus on indexing visual objects appearing in pictures but ignore the interactions between these objects. Such objects occurrences and interactions are equivalently useful and important in this field as they are usually mentioned in the text. Scene graph presentation is a suitable method for the image-text matching challenge and obtained good results due to its ability to capture the inter-relationship information. Both images and text are represented in scene graph levels and formulate the retrieval challenge as a scene graph matching challenge. In this paper, we introduce the Local and Global Scene Graph Matching (LGSGM) model that enhances the state-of-the-art method by integrating an extra graph convolution network to capture the general information of a graph. Specifically, for a pair of scene graphs of an image and its caption, two separate models are used to learn the features of each graph's nodes and edges. Then a Siamese-structure graph convolution model is employed to embed graphs into vector forms. We finally combine the graph-level and the vector-level to calculate the similarity of this image-text pair. The empirical experiments show that our enhancement with the combination of levels can improve the performance of the baseline method by increasing the recall by more than 10% on the Flickr30k dataset.


title: Entity Concept-enhanced Few-shot Relation Extraction

abstract: Few-shot relation extraction (FSRE) is of great importance in long-tail distribution problem, especially in special domain with low-resource data. Most existing FSRE algorithms fail to accurately classify the relations merely based on the information of the sentences together with the recognized entity pairs, due to limited samples and lack of knowledge. To address this problem, in this paper, we proposed a novel entity CONCEPT-enhanced FEw-shot Relation Extraction scheme (ConceptFERE), which introduces the inherent concepts of entities to provide clues for relation prediction and boost the relations classification performance. Firstly, a concept-sentence attention module is developed to select the most appropriate concept from multiple concepts of each entity by calculating the semantic similarity between sentences and concepts. Secondly, a self-attention based fusion module is presented to bridge the gap of concept embedding and sentence embedding from different semantic spaces. Extensive experiments on the FSRE benchmark dataset FewRel have demonstrated the effectiveness and the superiority of the proposed ConceptFERE scheme as compared to the state-of-the-art baselines. Code is available at https://github.com/LittleGuoKe/ConceptFERE.


title: Evolutionary relations between different types of Magnetized Compact Objects

abstract: The numerous compact sources associated with neutron stars and white dwarfs discovered in recent decades are analyzed in terms of the Gravimagnetic Rotator model (GMR paradigm - Lipunov, 1987a; Lipunov, 1992). We offer the instrument for understanding of various observed features and evolutionary relationships of neutron stars and white dwarfs. We depict in a single diagram all objects from radio pulsars and dwarf novae to ultra luminous X-ray sources and a radio pulsating white dwarf. This diagram directly demonstrates the genetic link between different types of compact sources thereby making it possible to confirm and illustrate clearly the established evolutionary connections - such as that between bulge X-ray sources and millisecond pulsars. This approach allows us to understand the evolutionary status of Ultra Luminous X-ray sources. In addition, we propose an additional evolutionary branch of the formation of Magnetars. When our work was completed, an article by Kirsten et al.2021, was published, which reports the localization of FRB 20200120 in one of the globular clusters of the galaxy M81. This shows that the accretion-induced collapse scenario of the white dwarf (Lipunov and Postnov, 1985), considered in detail in this work, is a possible genealogical branch of Magnetar production.


title: Structure of Gibbs measures for planar FK-percolation and Potts models

abstract: We prove that all Gibbs measures of the $q$-state Potts model on $\mathbb{Z}^2$ are linear combinations of the extremal measures obtained as thermodynamic limits under free or monochromatic boundary conditions. In particular all Gibbs measures are invariant under translations. This statement is new at points of first-order phase transition, that is at $T=T_{c}(q)$ when $q>4$. In this case the structure of Gibbs measures is the most complex in the sense that there exist $q+1$ distinct extremal measures. Most of the work is devoted to the FK-percolation model on $\mathbb{Z}^{2}$ with $q\geq 1$, where we prove that every Gibbs measure is a linear combination of the free and wired ones. The arguments are non-quantitative and follow the spirit of the seminal works of Aizenman and Higuchi, which established the Gibbs structure for the two-dimensional Ising model. Infinite-range dependencies in FK-percolation (i.e., a weaker spatial Markov property) pose serious additional difficulties compared to the case of the Ising model. For example, it is not automatic, albeit true, that thermodynamic limits are Gibbs. The result for the Potts model is then derived using the Edwards-Sokal coupling and auto-duality. The latter ingredient is necessary since applying the Edwards-Sokal procedure to a Gibbs measure for the Potts model does not automatically produce a Gibbs measure for FK-percolation. Finally, the proof is generic enough to adapt to the FK-percolation and Potts models on the triangular and hexagonal lattices and to the loop $O(n)$ model in the range of parameters for which its spin representation is positively associated.


title: The Herglotz principle and vakonomic dynamics

abstract: In this paper we study vakonomic dynamics on contact systems with nonlinear constraints. In order to obtain the dynamics, we consider a space of admisible paths, which are the ones tangent to a given submanifold. Then, we find the critical points of the Herglotz action on this space of paths. This dynamics can be also obtained through an extended Lagrangian, including Lagrange multiplier terms. This theory has important applications in optimal control theory for Herglotz control problems, in which the cost function is given implicitly, through an ODE, instead of by a definite integral. Indeed, these control problems can be considered as particular cases of vakonomic contact systems, and we can use the Lagrangian theory of contact systems in order to understand their symmetries and dynamics.


title: A Guidance and Maneuvering Control System Design with Anti-collision Using Stream Functions with Vortex Flows for Autonomous Marine Vessels

abstract: Autonomous marine vessels are expected to avoid inter-vessel collisions and comply with the international regulations for safe voyages. This paper presents a stepwise path planning method using stream functions. The dynamic flow of fluids is used as a guidance model, where the collision avoidance in static environments is achieved by applying the circular theorem in the sink flow. We extend this method to dynamic environments by adding vortex flows in the flow field. The stream function is recursively updated to enable on the fly waypoint decisions. The vessel avoids collisions and also complies with several rules of the Convention on the International Regulations for Preventing Collisions at Sea. The method is conceptually and computationally simple and convenient to tune, and yet versatile to handle complex and dense marine traffic with multiple dynamic obstacles. The ship dynamics are taken into account, by using B\'{e}zier curves to generate a sufficiently smooth path with feasible curvature. Numerical simulations are conducted to verify the proposed method.


title: Solid/Liquid Phase Transition and Heat Engine in Asymptotically Flat Schwarzschild Black Hole via the R\'enyi Extended Phase Space Approach

abstract: Recently, it has been found that, with the R\'enyi statistics, the asymptotically flat Schwarzschild black hole can be in thermal equilibrium with infinite heat reservior at a fixed temperature when its event horizon radius is larger than the characteristic length scale $L_\lambda=1/\sqrt{\pi \lambda}$, where $\lambda$ is the nonextensivity parameter. In the R\'enyi extended phase space with the $PdV$ work term, an off-shell free energy in the canonical ensemble with the thermodynamic volume as an order parameter is considered to identify a first-order Hawking-Page (HP) phase transition as a solid/liquid phase transition. It has the latent heat of fusion from solid (corresponding to thermal radiation) to liquid (corresponding to black hole) in the form of $\sim 1/\sqrt{\lambda}$; this is evident of the absence of the HP phase transition in the case of asymptotically flat Schwarzschild black hole from the GB statistics ($\lambda=0$). Moreover, we investigate the generalized second law of black hole thermodynamics (GSL) in R\'enyi statistics by considering the black hole as a working substance in heat engine. Interestingly, an efficiency $\eta$ of the black hole in a Carnot cycle takes the form $\eta_c=1-T_\text{C}/T_\text{H}$. This confirms the validity of the GSL in the R\'enyi extended phase space.


title: Driving skyrmions with low threshold current density in Pt/CoFeB thin film

abstract: Magnetic skyrmions are topologically stable spin swirling particle like entities which are appealing for next generation spintronic devices. The expected low critical current density for the motion of skyrmions makes them potential candidates for future energy efficient electronic devices. Several heavy metal/ferromagnetic (HM/FM) systems have been explored in the past decade to achieve faster skyrmion velocity at low current densities. In this context, we have studied Pt/CoFeB/MgO heterostructures in which skyrmions have been stabilized at room temperature (RT). It has been observed that the shape of the skyrmions are perturbed even by the small stray field arising from low moment magnetic tips while performing the magnetic force microscopy (MFM), indicating presence of low pinning landscape in the samples. This hypothesis is indeed confirmed by the low threshold current density to drive the skyrmions in our sample, at velocities of few 10m/s.


title: On supercritical divergence-free drifts

abstract: For second-order elliptic or parabolic equations with subcritical or critical drifts, it is well-known that the Harnack inequality holds and their bounded weak solutions are H\"older continuous. We construct time-independent supercritical drifts in $L^{n-\lambda}(\mathbb{R}^n)$ with arbitrarily small $\lambda>0$ such that the Harnack inequality and the H\"older continuity fail in both the elliptic and the parabolic cases, thus confirming a conjecture by Seregin, Silvestre, Sverak and Zlatos. These results are sharp, and they also apply to a toy model of the axi-symmetric Navier-Stokes equations in space dimension $3$.


title: On the role of nonlinear correlations in reduced-order modeling

abstract: A major goal for reduced-order models of unsteady fluid flows is to uncover and exploit latent low-dimensional structure. Proper orthogonal decomposition (POD) provides an energy-optimal linear basis to represent the flow kinematics, but converges slowly for advection-dominated flows and tends to overestimate the number of dynamically relevant variables. We show that nonlinear correlations in the temporal POD coefficients can be exploited to identify the underlying attractor, characterized by a minimal set of driving modes and a manifold equation for the remaining modes. By viewing these nonlinear correlations as an invariant manifold reduction, this least-order representation can be used to stabilize POD-Galerkin models or as a state space for data-driven model identification. In the latter case, we use sparse polynomial regression to learn a compact, interpretable dynamical system model from the time series of the active modal coefficients. We demonstrate this perspective on a quasiperiodic shear-driven cavity flow and show that the dynamics evolve on a torus generated by two independent Stuart-Landau oscillators. These results emphasize the importance of nonlinear dimensionality reduction to reveal underlying structure in complex flows.


title: Rotationally invariant isospinning baby-skyrmions dressed by fermions

abstract: We couple Fermions to the isospinning (2+1) baby-skyrme model. We show that consistent rotationally invariant localised solutions can be found but the Fermionic solutions to the equations of motion are not in general eigenstates of the Hamiltonian. These do however become full eigenstates in a particular limit. We also find the corresponding Fermionic eigenstates of the Hamiltonian, for which our Fermion ansatz is also well suited. For localised Fermionic states, a novel constraint on the internal isospin frequency exists. Throughout our studies, we include the backreaction of the Fermions on the baby-skyrmion.


title: Parametrized K\"{a}hler class and Zariski dense orbital 1-cohomology

abstract: Let $\Gamma$ be a finitely generated group and let $(X,\mu_X)$ be an ergodic standard Borel probability $\Gamma$-space. Suppose that $G$ is the connected component of the identity of the isometry group of a Hermitian symmetric space. Given a Zariski dense measurable cocycle $\sigma:\Gamma \times X \rightarrow G$, we define the notion of parametrized K\"{a}hler class and we show that it completely determines the cocycle up to cohomology.x


title: Resource Allocation in Disaggregated Data Centre Systems with Reinforcement Learning

abstract: Resource-disaggregated data centres (RDDC) propose a resource-centric, and high-utilisation architecture for data centres (DC), avoiding resource fragmentation and enabling arbitrarily sized resource pools to be allocated to tasks, rather than server-sized ones. RDDCs typically impose greater demand on the network, requiring more infrastructure and increasing cost and power, so new resource allocation algorithms that co-manage both server and networks resources are essential to ensure that allocation is not bottlenecked by the network, and that requests can be served successfully with minimal networking resources. We apply reinforcement learning (RL) to this problem for the first time and show that an RL policy based on graph neural networks can learn resource allocation policies end-to-end that outperform previous hand-engineered heuristics by up to 22.0\%, 42.6\% and 22.6\% for acceptance ratio, CPU and memory utilisation respectively, maintain performance when scaled up to RDDC topologies with $10^2\times$ more nodes than those seen during training and can achieve comparable performance to the best baselines while using $5.3\times$ less network resources.


title: Dynamical properties of different models of elastic polymer rings: confirming the link between deformation and fragility

abstract: We report extensive numerical simulations of different models of 2D polymer rings with internal elasticity. We monitor the dynamical behavior of the rings as a function of the packing fraction, to address the effects of particle deformation on the collective response of the system. In particular, we compare three different models: (i) a recently investigated model [Gnan \& Zaccarelli, Nat. Phys. 15, 683 (2019)], where an inner hertzian field providing the internal elasticity acts on the monomers of the ring, (ii) the same model where the effect of such a field on the center of mass is balanced by opposite forces and (iii) a semi-flexible model where an angular potential between adjacent monomers induces strong particle deformations. By analyzing the dynamics of the three models, we find that, in all cases, there exists a direct link between the system fragility and particle asphericity. Among the three, only the first model displays anomalous dynamics in the form of a super-diffusive behavior of the mean squared displacement and of a compressed exponential relaxation of the density auto-correlation function. We show that this is due to the combination of internal elasticity and the out-of-equilibrium force self-generated by each ring, both of which are necessary ingredients to induce such peculiar behavior often observed in experiments of colloidal gels. These findings reinforce the role of particle deformation, connected to internal elasticity, in driving the dynamical response of dense soft particles.


title: Black-hole kicks: a tool to measure the accuracy of gravitational-wave models

abstract: Asymmetric binary systems radiate linear momentum through gravitational waves, leading to the recoil of the merger remnant. Black-hole kicks have attracted much attention because of their astrophysical implications. However, little information can be extracted from the observations made by LIGO and Virgo so far. In this work, we discuss how the gravitational recoil, an effect that is encoded in the gravitational signal, can be used to test the accuracy of waveform models. Gravitational-wave models of merging binary systems have become fundamental to detect potential signals and infer the parameters of observed sources. But, as the interferometers' sensitivity is enhanced in current and future detectors, gravitational waveform models will have to be further improved. We find that the kick is highly sensitive to waveform inaccuracies and can therefore be a useful diagnostic test. Furthermore, we observe that current higher-mode waveform models are not consistent in their kick predictions. For this reason, we discuss whether measuring and improving waveform accuracy can, in turn, allow us to extract meaningful information about the kick in future observations.


title: What is fair? Exploring the artists' perspective on the fairness of music streaming platforms

abstract: Music streaming platforms are currently among the main sources of music consumption, and the embedded recommender systems significantly influence what the users consume. There is an increasing interest to ensure that those platforms and systems are fair. Yet, we first need to understand what fairness means in such a context. Although artists are the main content providers for music platforms, there is a research gap concerning the artists' perspective. To fill this gap, we conducted interviews with music artists to understand how they are affected by current platforms and what improvements they deem necessary. Using a Qualitative Content Analysis, we identify the aspects that the artists consider relevant for fair platforms. In this paper, we discuss the following aspects derived from the interviews: fragmented presentation, reaching an audience, transparency, influencing users' listening behavior, popularity bias, artists' repertoire size, quotas for local music, gender balance, and new music. For some topics, our findings do not indicate a clear direction about the best way how music platforms should act and function; for other topics, though, there is a clear consensus among our interviewees: for these, the artists have a clear idea of the actions that should be taken so that music platforms will be fair also for the artists.


title: Braid group and $q$-Racah polynomials

abstract: The irreducible representations of two intermediate Casimir elements associated to the recoupling of three identical irreducible representations of $U_q(\mathfrak{sl}_2)$ are considered. It is shown that these intermediate Casimirs are related by a conjugation involving braid group representations. Consequently, the entries of the braid group matrices are explicitly given in terms of the $q$-Racah polynomials which appear as $6j$-symbols in the Racah problem for $U_q(\mathfrak{sl}_2)$. Formulas for these polynomials are derived from the algebraic relations satisfied by the braid group representations.


title: Approximate Fixed-Points in Recurrent Neural Networks

abstract: Recurrent neural networks are widely used in speech and language processing. Due to dependency on the past, standard algorithms for training these models, such as back-propagation through time (BPTT), cannot be efficiently parallelised. Furthermore, applying these models to more complex structures than sequences requires inference time approximations, which introduce inconsistency between inference and training. This paper shows that recurrent neural networks can be reformulated as fixed-points of non-linear equation systems. These fixed-points can be computed using an iterative algorithm exactly and in as many iterations as the length of any given sequence. Each iteration of this algorithm adds one additional Markovian-like order of dependencies such that upon termination all dependencies modelled by the recurrent neural networks have been incorporated. Although exact fixed-points inherit the same parallelization and inconsistency issues, this paper shows that approximate fixed-points can be computed in parallel and used consistently in training and inference including tasks such as lattice rescoring. Experimental validation is performed in two tasks, Penn Tree Bank and WikiText-2, and shows that approximate fixed-points yield competitive prediction performance to recurrent neural networks trained using the BPTT algorithm.


title: Explicit no arbitrage domain for sub-SVIs via reparametrization

abstract: The no Butterfly arbitrage domain of Gatheral SVI 5-parameters formula for the volatility smile has been recently described. It requires in general a numerical minimization of 2 functions altogether with a few root finding procedures. We study here the case of some sub-SVIs (all with 3 parameters): the Symmetric SVI, the Vanishing Upward/Downward SVI, and SSVI, for which we provide an explicit domain, with no numerical procedure required.


title: Emergent spatial patterns of coexistence in species-rich plant communities

abstract: Statistical Physics has proved essential to analyze multi-agent environments. Motivated by the empirical observation of various non-equilibrium features in Barro Colorado and other ecological systems, we analyze a plant-species abundance model, presenting analytical evidence of scale-invariant plant clusters and non-trivial emergent modular correlations. Such first theoretical confirmation of a scale-invariant region, based on percolation processes, reproduces the key features in actual ecological ecosystems and can confer the most stable equilibrium for ecosystems with vast biodiversity.

categories: cond-mat.stat-mech cond-mat.dis-nn physics.bio-ph q-bio.PE


title: An Intelligent Resource Reservation for Crowdsourced Live Video Streaming Applications in Geo-Distributed Cloud Environment

abstract: Crowdsourced live video streaming (livecast) services such as Facebook Live, YouNow, Douyu and Twitch are gaining more momentum recently. Allocating the limited resources in a cost-effective manner while maximizing the Quality of Service (QoS) through real-time delivery and the provision of the appropriate representations for all viewers is a challenging problem. In our paper, we introduce a machine-learning based predictive resource allocation framework for geo-distributed cloud sites, considering the delay and quality constraints to guarantee the maximum QoS for viewers and the minimum cost for content providers. First, we present an offline optimization that decides the required transcoding resources in distributed regions near the viewers with a trade-off between the QoS and the overall cost. Second, we use machine learning to build forecasting models that proactively predict the approximate transcoding resources to be reserved at each cloud site ahead of time. Finally, we develop a Greedy Nearest and Cheapest algorithm (GNCA) to perform the resource allocation of real-time broadcasted videos on the rented resources. Extensive simulations have shown that GNCA outperforms the state-of-the art resource allocation approaches for crowdsourced live streaming by achieving more than 20% gain in terms of system cost while serving the viewers with relatively lower latency.


title: Rademacher-Gaussian tail comparison for complex coefficients and related problems

abstract: We provide a generalisation of Pinelis' Rademacher-Gaussian tail comparison to complex coefficients. We also establish uniform bounds on the probability that the magnitude of weighted sums of independent random vectors uniform on Euclidean spheres with matrix coefficients exceeds its second moment.


title: Classification of Audio Segments in Call Center Recordings using Convolutional Recurrent Neural Networks

abstract: Detailed statistical analysis of call center recordings is critical in the customer relationship management point of view. With the recent advances in artificial intelligence, many tasks regarding the calculation of call statistics are now performed automatically. This work proposes a neural network framework where the aim is to correctly identify audio segments and classify them as either customer or agent sections. Accurately identifying these sections gives a fair metric for evaluating agents' performances. We inherited the convolutional recurrent neural network (CRNN) architecture commonly used for such problems as music genre classification. We also tested the same architecture's performance, where the previous class information and the gender information of speakers are also added to the training data labels. We saw that CRNN could generalize the training data and perform well on validation data for this problem with and without the gender information. Moreover, even the training was performed using Turkish speech samples; the trained network was proven to achieve high accuracy for call center recordings in other languages like German and English.


title: A generalisation of Amitsur's A-polynomials

abstract: We find examples of polynomials $f\in D[t;\sigma,\delta]$ whose eigenring $\mathcal{E}(f)$ is a central simple algebra over the field $F = C \cap {\rm Fix}(\sigma) \cap {\rm Const}(\delta)$.


title: Contour Moments Based Manipulation of Composite Rigid-Deformable Objects with Finite Time Model Estimation and Shape/Position Control

abstract: The robotic manipulation of composite rigid-deformable objects (i.e. those with mixed non-homogeneous stiffness properties) is a challenging problem with clear practical applications that, despite the recent progress in the field, it has not been sufficiently studied in the literature. To deal with this issue, in this paper we propose a new visual servoing method that has the capability to manipulate this broad class of objects (which varies from soft to rigid) with the same adaptive strategy. To quantify the object's infinite-dimensional configuration, our new approach computes a compact feedback vector of 2D contour moments features. A sliding mode control scheme is then designed to simultaneously ensure the finite-time convergence of both the feedback shape error and the model estimation error. The stability of the proposed framework (including the boundedness of all the signals) is rigorously proved with Lyapunov theory. Detailed simulations and experiments are presented to validate the effectiveness of the proposed approach. To the best of the author's knowledge, this is the first time that contour moments along with finite-time control have been used to solve this difficult manipulation problem.


title: Stochastic and deterministic formulations for capacity firming nominations

abstract: This paper addresses the energy management of a grid-connected photovoltaic plant coupled with a battery energy storage device, within the capacity firming specifications of the French Energy Regulatory Commission. The paper contributions are positioned in the continuity of the studies adopting stochastic models for optimizing the bids of renewable energy sources in a day-ahead market by considering a storage device. The proposed deterministic and stochastic approaches are optimization problems formulated as quadratic problems with linear constraints. The case study is a real microgrid with PV production monitored on-site. The results demonstrate the validity of the stochastic formulation by using an ideal predictor that produces unbiased PV scenarios.


title: NMS-Loss: Learning with Non-Maximum Suppression for Crowded Pedestrian Detection

abstract: Non-Maximum Suppression (NMS) is essential for object detection and affects the evaluation results by incorporating False Positives (FP) and False Negatives (FN), especially in crowd occlusion scenes. In this paper, we raise the problem of weak connection between the training targets and the evaluation metrics caused by NMS and propose a novel NMS-Loss making the NMS procedure can be trained end-to-end without any additional network parameters. Our NMS-Loss punishes two cases when FP is not suppressed and FN is wrongly eliminated by NMS. Specifically, we propose a pull loss to pull predictions with the same target close to each other, and a push loss to push predictions with different targets away from each other. Experimental results show that with the help of NMS-Loss, our detector, namely NMS-Ped, achieves impressive results with Miss Rate of 5.92% on Caltech dataset and 10.08% on CityPersons dataset, which are both better than state-of-the-art competitors.


title: Hong-Ou-Mandel interference of two independent continuous-wave coherent photons

abstract: Interference between two completely independent photons lies at the heart of many photonic quantum information applications such as quantum repeaters, teleportation, and quantum key distribution. Here, we report the observation of Hong-Ou-Mandel (HOM) interference with two independent continuous-wave coherent light sources that are neither synchronized nor share any common reference. To prepare highly indistinguishable photons from two independent laser sources, we employ high-precision frequency-stabilization techniques using the 5S1/2(F=3)-5P1/2(F'=3) transition line of 85Rb atoms. We successfully observe a HOM interference fringe with two independent continuous-wave coherent photons originating from either the frequency-locked and frequency-modulated lasers. An interference fringe involving two-photon beating is also observed when the frequency difference between the two interfering photons is beyond the spectral bandwidth of the individual coherent photons. We carry out further experiments to verify the robustness of the source preparation regardless of the separation distance between the two independent photon sources.


title: Unveiling the mechanism of bulk spin-orbit torques within chemically disordered Fe$_x$Pt$_{1-x}$ single layers

abstract: Recent discovery of spin-orbit torques (SOTs) within magnetic single-layers has attracted attention in the field of spintronics. However, it has remained elusive as to how to understand and how to tune the SOTs. Here, utilizing the single layers of chemically disordered Fe$_x$Pt$_{1-x}$, we unveil the mechanism of the "unexpected" bulk SOTs by studying their dependence on the introduction of a controlled vertical composition gradient and on temperature. We find that the bulk damping like SOT arises from an imbalanced internal spin current that is transversely polarized and independent of the magnetization orientation. The torque can be strong only in the presence of a vertical composition gradient and the SOT efficiency per electric field is insensitive to temperature but changes sign upon reversal of the orientation of the composition gradient, which are in analogue to behaviors of the strain. From these characteristics we conclude that the imbalanced internal spin current originates from a bulk spin Hall effect and that the associated inversion asymmetry that allows for a non-zero net torque is most likely a strain non-uniformity induced by the composition gradient. The fieldlike SOT is a relatively small bulk effect compared to the dampinglike SOT. This work points to the possibility of developing low-power single-layer SOT devices by strain engineering.


title: Distortion measure of spectrograms for classification of respiratory diseases

abstract: A new method for the classification of respiratory diseases is presented. The method is based on a novel class of features, extracted from pulmonary sounds, by parameterizing their spectrograms that are represented as surfaces, and by utilizing geometrical distortions defined with reference to these surfaces. This method yields a set of highly descriptive features for the analysis of pulmonary sound recordings. Furthermore, by combining these features with Mel-frequency cepstral coefficients, we introduce a powerful model for the automatic diagnosis of common respiratory pathologies. Compared with baseline methods, our model achieves superior results for binary and multi-class classifications of common respiratory diseases. Our new approach to the classification of one-dimensional signals is applicable to other signals in the context of their representations in combined spaces or manifolds.


title: H$_2$S observations in young stellar disks in Taurus

abstract: Context. Studying gas chemistry in protoplanetary disks is key to understanding the process of planet formation. Sulfur chemistry in particular is poorly understood in interstellar environments, and the location of the main reservoirs remains unknown. Protoplanetary disks in Taurus are ideal targets for studying the evolution of the composition of planet forming systems. Aims. We aim to elucidate the chemical origin of sulfur-bearing molecular emission in protoplanetary disks, with a special focus on H$_2$S emission, and to identify candidate species that could become the main molecular sulfur reservoirs in protoplanetary systems. Methods. We used IRAM 30m observations of nine gas-rich young stellar objects (YSOs) in Taurus to perform a survey of sulfur-bearing and oxygen-bearing molecular species. In this paper we present our results for the CS 3-2 ($\nu_0$ = 146.969 GHz), H$_2$CO 2$_{11}$-1$_{10}$ ($\nu_0$ = 150.498 GHz), and H$_2$S 1$_{10}$-1$_{01}$ ($\nu_0$ = 168,763 GHz) emission lines. Results. We detected H$_2$S emission in four sources out of the nine observed, significantly increasing the number of detections toward YSOs. We also detected H$_2$CO and CS in six out of the nine. We identify a tentative correlation between H$_2$S 1$_{10}$-1$_{01}$ and H$_2$CO 2$_{11}$-1$_{10}$ as well as a tentative correlation between H$_2$S 1$_{10}$-1$_{01}$ and H$_2$O 8$_{18}$-7$_{07}$. By assuming local thermodynamical equilibrium, we computed column densities for the sources in the sample, with N(o-H$_2$S) values ranging between $2.6\times10^{12}$ cm$^{-2}$ and $1.5\times10^{13}$ cm$^{-2}$.


title: Anti-symmetric Compton scattering in LiNiPO$_4$: Towards a direct probe of the magneto-electric multipole moment

abstract: We present a combined theoretical and experimental investigation of the anti-symmetric Compton profile in LiNiPO$_4$ as a possible probe for magneto-electric toroidal moments. Understanding as well as detecting such magneto-electric multipoles is an active area of research in condensed matter physics. Our calculations, based on density functional theory, indicate an anti-symmetric Compton profile in the direction of the $t_y$ toroidal moment in momentum space, with the computed anti-symmetric profile around four orders of magnitude smaller than the total profile. The difference signal that we measure is consistent with the computed profile, but of the same order of magnitude as the statistical errors and systematic uncertainties of the experiment. Our results motivate further theoretical work to understand the factors that influence the size of the anti-symmetric Compton profile, and to identify materials exhibiting larger effects.


title: Authentication of Metropolitan Quantum Key Distribution Network with Post-quantum Cryptography

abstract: Quantum key distribution (QKD) provides information theoretically secures key exchange requiring authentication of the classic data processing channel via pre-sharing of symmetric private keys. In previous studies, the lattice-based post-quantum digital signature algorithm Aigis-Sig, combined with public-key infrastructure (PKI) was used to achieve high-efficiency quantum security authentication of QKD, and its advantages in simplifying the MAN network structure and new user entry were demonstrated. This experiment further integrates the PQC algorithm into the commercial QKD system, the Jinan field metropolitan QKD network comprised of 14 user nodes and 5 optical switching nodes. The feasibility, effectiveness and stability of the post-quantum cryptography (PQC) algorithm and advantages of replacing trusted relays with optical switching brought by PQC authentication large-scale metropolitan area QKD network were verified. QKD with PQC authentication has potential in quantum-secure communications, specifically in metropolitan QKD networks.


title: A Novel Semi-supervised Framework for Call Center Agent Malpractice Detection via Neural Feature Learning

abstract: This work presents a practical solution to the problem of call center agent malpractice. A semi-supervised framework comprising of non-linear power transformation, neural feature learning and k-means clustering is outlined. We put these building blocks together and tune the parameters so that the best performance was obtained. The data used in the experiments is obtained from our in-house call center. It is made up of recorded agent-customer conversations which have been annotated using a convolutional neural network based segmenter. The methods provided a means of tuning the parameters of the neural network to achieve a desirable result. We show that, using our proposed framework, it is possible to significantly reduce the malpractice classification error of a k-means-only clustering model which would serve the same purpose. Additionally, by presenting the amount of silence per call as a key performance indicator, we show that the proposed system has enhanced agents performance at our call center since deployment.


title: Time-resolved two-photon interference of weak coherent pulses

abstract: The observation of the Hong-Ou-Mandel (HOM)-type two-photon interference (TPI) has played an important role in the development of photonic quantum technologies. The time-resolved coincidence-detection technique has been effectively used to identify and characterize the TPI phenomena of long-coherence optical fields. Here, we report on the experimental demonstration of the TPI of two phase-randomized weak coherent pulses with time-resolved coincidence detection. The mutual coherence time between the two weak coherent lights is determined by applying a frequency noise to one of the two interfering lights. We analyze the HOM-type TPI-fringe visibility according to the ratio of the coherence time to the pulse duration.


title: You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient

abstract: Despite superior performance on various natural language processing tasks, pre-trained models such as BERT are challenged by deploying on resource-constraint devices. Most existing model compression approaches require re-compression or fine-tuning across diverse constraints to accommodate various hardware deployments. This practically limits the further application of model compression. Moreover, the ineffective training and searching process of existing elastic compression paradigms[4,27] prevents the direct migration to BERT compression. Motivated by the necessity of efficient inference across various constraints on BERT, we propose a novel approach, YOCO-BERT, to achieve compress once and deploy everywhere. Specifically, we first construct a huge search space with 10^13 architectures, which covers nearly all configurations in BERT model. Then, we propose a novel stochastic nature gradient optimization method to guide the generation of optimal candidate architecture which could keep a balanced trade-off between explorations and exploitation. When a certain resource constraint is given, a lightweight distribution optimization approach is utilized to obtain the optimal network for target deployment without fine-tuning. Compared with state-of-the-art algorithms, YOCO-BERT provides more compact models, yet achieving 2.1%-4.5% average accuracy improvement on the GLUE benchmark. Besides, YOCO-BERT is also more effective, e.g.,the training complexity is O(1)for N different devices. Code is availablehttps://github.com/MAC-AutoML/YOCO-BERT.


title: Stochastic Multi-Armed Bandits with Unrestricted Delay Distributions

abstract: We study the stochastic Multi-Armed Bandit (MAB) problem with random delays in the feedback received by the algorithm. We consider two settings: the reward-dependent delay setting, where realized delays may depend on the stochastic rewards, and the reward-independent delay setting. Our main contribution is algorithms that achieve near-optimal regret in each of the settings, with an additional additive dependence on the quantiles of the delay distribution. Our results do not make any assumptions on the delay distributions: in particular, we do not assume they come from any parametric family of distributions and allow for unbounded support and expectation; we further allow for infinite delays where the algorithm might occasionally not observe any feedback.


title: Frustration enhanced by Kitaev exchange in a $\boldsymbol{\tilde{j}_{\text{eff}}=\frac12}$ triangular antiferromagnet

abstract: Triangular Heisenberg antiferromagnets are prototypes of geometric frustration, even if for nearest-neighbor interactions quantum fluctuations are not usually strong enough to destroy magnetic ordering: stronger frustration is required to stabilize a spin-liquid phase. On the basis of static magnetization and electron spin resonance measurements, we demonstrate the emergence of ${\tilde{j}_{\text{eff}}=\frac12}$ moments in the triangular-lattice magnet Na$_2$BaCo(PO$_4$)$_2$. These moments are subject to an extra source of frustration that causes magnetic correlations to set in far above both the magnetic ordering and Weiss temperatures. Corroborating the $\tilde{j}_{\text{eff}}=\frac12$ ground state, theory identifies ferromagnetic Kitaev exchange anisotropy as additional frustrating agent, altogether putting forward Na$_2$BaCo(PO$_4$)$_2$ as a promising Kitaev spin-liquid material.


title: New Turan-type bounds for Johnson graphs

abstract: In this paper, we consider the Johnson's graphs. We study the extremal properties of the Johnson's graphs. Namely, we investigate the number of edges in an arbitrary subgraph of this graph. Namely, in this article we prove analogs of Turan's 1941 theorem.