title: Minor Sparsifiers and the Distributed Laplacian Paradigm

abstract: We study distributed algorithms built around minor-based vertex sparsifiers, and give the first algorithm in the CONGEST model for solving linear systems in graph Laplacian matrices to high accuracy. Our Laplacian solver has a round complexity of $O(n^{o(1)}(\sqrt{n}+D))$, and thus almost matches the lower bound of $\widetilde{\Omega}(\sqrt{n}+D)$, where $n$ is the number of nodes in the network and $D$ is its diameter. We show that our distributed solver yields new sublinear round algorithms for several cornerstone problems in combinatorial optimization. This is achieved by leveraging the powerful algorithmic framework of Interior Point Methods (IPMs) and the Laplacian paradigm in the context of distributed graph algorithms, which entails numerically solving optimization problems on graphs via a series of Laplacian systems. Problems that benefit from our distributed algorithmic paradigm include exact mincost flow, negative weight shortest paths, maxflow, and bipartite matching on sparse directed graphs. For the maxflow problem, this is the first exact distributed algorithm that applies to directed graphs, while the previous work by [Ghaffari et al. SICOMP'18] considered the approximate setting and works only for undirected graphs. For the mincost flow and the negative weight shortest path problems, our results constitute the first exact distributed algorithms running in a sublinear number of rounds. Given that the hybrid between IPMs and the Laplacian paradigm has proven useful for tackling numerous optimization problems in the centralized setting, we believe that our distributed solver will find future applications.


title: Thouless Energy Across Many-Body Localization Transition in Floquet Systems

abstract: The notion of Thouless energy plays a central role in the theory of Anderson localization. We investigate the scaling of Thouless energy across the many-body localization (MBL) transition in a Floquet model. We use a combination of methods that are reliable on the ergodic side of the transition (e.g., spectral form factor) and methods that work on the MBL side (e.g. typical matrix elements of local operators) to obtain a complete picture of the Thouless energy behavior across the transition. On the ergodic side, the Thouless energy tends to a value independent of system size, while at the transition it becomes comparable to the level spacing. Different probes yield consistent estimates of the Thouless energy in their overlapping regime of applicability, giving the location of the transition point nearly free of finite-size drift. This work establishes a connection between different definitions of Thouless energy in a many-body setting, and yields new insights into the MBL transition in Floquet systems.

categories: cond-mat.dis-nn cond-mat.mes-hall cond-mat.str-el quant-ph


title: String Dualities at Order $\alpha'^{\,3}$

abstract: We compute the cosmological reduction of the fourth powers of the Riemann tensor claimed to arise in string theory at order $\alpha'^{\,3}$, with overall coefficient proportional to $\zeta(3)$, and show that it is compatible with an $O(9,9)$ symmetry. This confirms the general result in string theory, due to Sen, that classical string theory with $d$-dimensional translation invariance admits an $O(d,d)$ symmetry to all orders in $\alpha'$.


title: On Gaussian Approximation for M-Estimator

abstract: This study develops a non-asymptotic Gaussian approximation theory for distributions of M-estimators, which are defined as maximizers of empirical criterion functions. In existing mathematical statistics literature, numerous studies have focused on approximating the distributions of the M-estimators for statistical inference. In contrast to the existing approaches, which mainly focus on limiting behaviors, this study employs a non-asymptotic approach, establishes abstract Gaussian approximation results for maximizers of empirical criteria, and proposes a Gaussian multiplier bootstrap approximation method. Our developments can be considered as extensions of the seminal works (Chernozhukov, Chetverikov and Kato (2013, 2014, 2015)) on the approximation theory for distributions of suprema of empirical processes toward their maximizers. Through this work, we shed new lights on the statistical theory of M-estimators. Our theory covers not only regular estimators, such as the least absolute deviations, but also some non-regular cases where it is difficult to derive or to approximate numerically the limiting distributions such as non-Donsker classes and cube root estimators.


title: Linear-in-$T$ resistivity from semiholographic non-Fermi liquid models

abstract: We construct a semiholographic effective theory in which the electron of a two-dimensional band hybridizes with a fermionic operator of a critical holographic sector, while also interacting with other bands that preserve quasiparticle characteristics. Besides the scaling dimension $\nu$ of the fermionic operator in the holographic sector, the effective theory has two {dimensionless} couplings $\alpha$ and $\gamma$ determining the holographic and Fermi-liquid-type contributions to the self-energy respectively. We find that irrespective of the choice of the holographic critical sector, there exists a ratio of the effective couplings for which we obtain linear-in-$T$ resistivity for a wide range of temperatures. This scaling persists to arbitrarily low temperatures when $\nu$ approaches unity in which limit we obtain a marginal Fermi liquid with a specific temperature dependence of the self-energy.


title: Unsupervised Monocular Depth Reconstruction of Non-Rigid Scenes

abstract: Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no literature addressing the same for dynamic and deformable scenes. In this work, we present an unsupervised monocular framework for dense depth estimation of dynamic scenes, which jointly reconstructs rigid and non-rigid parts without explicitly modelling the camera motion. Using dense correspondences, we derive a training objective that aims to opportunistically preserve pairwise distances between reconstructed 3D points. In this process, the dense depth map is learned implicitly using the as-rigid-as-possible hypothesis. Our method provides promising results, demonstrating its capability of reconstructing 3D from challenging videos of non-rigid scenes. Furthermore, the proposed method also provides unsupervised motion segmentation results as an auxiliary output.


title: Exploring a strongly non-Markovian animal behavior

abstract: A freely walking fly visits roughly 100 stereotyped states in a strongly non-Markovian sequence. To explore these dynamics, we develop a generalization of the information bottleneck method, compressing the large number of behavioral states into a more compact description that maximally preserves the correlations between successive states. Surprisingly, preserving these short time correlations with a compression into just two states captures the long ranged correlations seen in the raw data. Having reduced the behavior to a binary sequence, we describe the distribution of these sequences by an Ising model with pairwise interactions, which is the maximum entropy model that matches the two-point correlations. Matching the correlation function at longer and longer times drives the resulting model toward the Ising model with inverse square interactions and near zero magnetic field. The emergence of this statistical physics problem from the analysis real data on animal behavior is unexpected.


title: A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters

abstract: Few-shot crosslingual transfer has been shown to outperform its zero-shot counterpart with pretrained encoders like multilingual BERT. Despite its growing popularity, little to no attention has been paid to standardizing and analyzing the design of few-shot experiments. In this work, we highlight a fundamental risk posed by this shortcoming, illustrating that the model exhibits a high degree of sensitivity to the selection of few shots. We conduct a large-scale experimental study on 40 sets of sampled few shots for six diverse NLP tasks across up to 40 languages. We provide an analysis of success and failure cases of few-shot transfer, which highlights the role of lexical features. Additionally, we show that a straightforward full model finetuning approach is quite effective for few-shot transfer, outperforming several state-of-the-art few-shot approaches. As a step towards standardizing few-shot crosslingual experimental designs, we make our sampled few shots publicly available.


title: Target space entanglement in Matrix Models

abstract: We study target space entanglement in gauged multi-matrix models as models of entanglement between groups of D-branes separated by a planar entangling surface, paying close attention to the implementation of gauge invariance. We open with a review of target space entanglement between identical particles, which shares some important features (specifically a gauged permutation symmetry) with our main problem. For our matrix models, we implement a gauge fixing well-adapted to the entangling surface. In this gauge, we map the matrix model problem to that of entanglement of a $U(1)$ gauge theory on a complete or all-to-all lattice. Matrix elements corresponding to open strings stretching across the entangling surface in the target space lead to interesting contributions to the entanglement entropy.


title: Simulation and Control of Deformable Autonomous Airships in Turbulent Wind

abstract: Abstract. Fixed wing and multirotor UAVs are common in the field of robotics. Solutions for simulation and control of these vehicles are ubiquitous. This is not the case for airships, a simulation of which needs to address unique properties, i) dynamic deformation in response to aerodynamic and control forces, ii) high susceptibility to wind and turbulence at low airspeed, iii) high variability in airship designs regarding placement, direction and vectoring of thrusters and control surfaces. We present a flexible framework for modeling, simulation and control of airships, based on the Robot operating system (ROS), simulation environment (Gazebo) and commercial off the shelf (COTS) electronics, both of which are open source. Based on simulated wind and deformation, we predict substantial effects on controllability, verified in real world flight experiments. All our code is shared as open source, for the benefit of the community and to facilitate lighter-than-air vehicle (LTAV) research. https://github.com/robot-perception-group/airship_simulation


title: A Survey on Deep Learning-based Single Image Crowd Counting: Network Design, Loss Function and Supervisory Signal

abstract: Single image crowd counting is a challenging computer vision problem with wide applications in public safety, city planning, traffic management, etc. With the recent development of deep learning techniques, crowd counting has aroused much attention and achieved great success in recent years. This survey is to provide a comprehensive summary of recent advances on deep learning-based crowd counting techniques via density map estimation by systematically reviewing and summarizing more than 200 works in the area since 2015. Our goals are to provide an up-to-date review of recent approaches, and educate new researchers in this field the design principles and trade-offs. After presenting publicly available datasets and evaluation metrics, we review the recent advances with detailed comparisons on three major design modules for crowd counting: deep neural network designs, loss functions, and supervisory signals. We study and compare the approaches using the public datasets and evaluation metrics. We conclude the survey with some future directions.


title: Robust Data-Driven Error Compensation for a Battery Model

abstract: - This work has been submitted to IFAC for possible publication - Models of traction batteries are an essential tool throughout the development of automotive drivetrains. Surprisingly, today's massively collected battery data is not yet used for more accurate and reliable simulations. Primarily, the non-uniform excitation during regular battery operations prevent a consequent utilization of such measurements. Hence, there is a need for methods which enable robust models based on large datasets. For that reason, a data-driven error model is introduced enhancing an existing physically motivated model. A neural network compensates the existing dynamic error and is further limited based on a description of the underlying data. This paper tries to verify the effectiveness and robustness of the general setup and additionally evaluates a one-class support vector machine as the proposed model for the training data distribution. Based on a five datasets it is shown, that gradually limiting the data-driven error compensation outside the boundary leads to a similar improvement and an increased overall robustness.


title: Holographic approach of the spinodal instability to criticality

abstract: A smoking gun signature for a first-order phase transition with negative speed of sound squared $c_s^2$ is the occurrence of a spinodal instability. In the gauge/gravity duality it corresponds to a Gregory-Laflamme type instability, which can be numerically simulated as the evolution of unstable planar black branes. Making use of holography its dynamics is studied far from and near a critical point with the following results. Near a critical point the interface between cold and hot stable phases, given by its width and surface tension, is found to feature a wider phase separation and a smaller surface tension. Far away from a critical point the formation time of the spinodal instability is reduced. Across softer and harder phase transitions, it is demonstrated that mergers of equilibrated peaks and unstable plateaux lead to the preferred final single phase separated solution. Finally, a new atypical setup with dissipation of a peak into a plateau is discovered. In order to distinguish the inhomogeneous states I propose a new criterium based on the maximum of the transverse pressure at the interface which encodes phase-mixed peaks versus fully phase separated plateaux.


title: ERNIE-Doc: A Retrospective Long-Document Modeling Transformer

abstract: Transformers are not suited for processing long documents, due to their quadratically increasing memory and time consumption. Simply truncating a long document or applying the sparse attention mechanism will incur the context fragmentation problem or lead to an inferior modeling capability against comparable model sizes. In this paper, we propose ERNIE-Doc, a document-level language pretraining model based on Recurrence Transformers. Two well-designed techniques, namely the retrospective feed mechanism and the enhanced recurrence mechanism, enable ERNIE-Doc, which has a much longer effective context length, to capture the contextual information of a complete document. We pretrain ERNIE-Doc to explicitly learn the relationships among segments with an additional document-aware segment-reordering objective. Various experiments were conducted on both English and Chinese document-level tasks. ERNIE-Doc improved the state-of-the-art language modeling result of perplexity to 16.8 on WikiText-103. Moreover, it outperformed competitive pretraining models by a large margin on most language understanding tasks, such as text classification and question answering.


title: Airy eigenstates and their relation to coordinate eigenstates

abstract: We study the eigenvalue problem for a linear potential Hamiltonian and, by writing Airy equation in terms of momentum and position operators define Airy states. We give a solution of the Schr\"odinger equation for the symmetrical linear potential in terms of the squeeze and displacement operators. Finally, we write the unit operator in terms of Airy states and find a relation between them and position and momentum eigenstates.


title: Push-pull operators on convex polytopes

abstract: A classical result of Schubert calculus is an inductive description of Schubert cycles using divided difference (or push-pull) operators in Chow rings. We define convex geometric analogs of push-pull operators and describe their applications to the theory of Newton-Okounkov convex bodies. Convex geometric push-pull operators yield an inductive construction of Newton-Okounkov polytopes of Bott-Samelson varieties. In particular, we construct a Minkowski sum of Feigin-Fourier-Littelmann-Vinberg polytopes using convex geometric push-pull operators in type A.


title: Quantum error-correcting codes from matrix-product codes related to quasi-orthogonal and quasi-unitary matrices

abstract: Matrix-product codes over finite fields are an important class of long linear codes by combining several commensurate shorter linear codes with a defining matrix over finite fields. The construction of matrix-product codes with certain self-orthogonality over finite fields is an effective way to obtain good $q$-ary quantum codes of large length. This article has two purposes: the first is to summarize some results of this topic obtained by the author of this article and his cooperators in [10-12]; the second is to add some new results on quasi-orthogonal matrices (resp. quasi-unitary matrices), Euclidean dual-containing (resp. Hermitian dual-containing) matrix-product codes and $q$-ary quantum codes derived from these matrix-product codes.


title: NeuralMagicEye: Learning to See and Understand the Scene Behind an Autostereogram

abstract: An autostereogram, a.k.a. magic eye image, is a single-image stereogram that can create visual illusions of 3D scenes from 2D textures. This paper studies an interesting question that whether a deep CNN can be trained to recover the depth behind an autostereogram and understand its content. The key to the autostereogram magic lies in the stereopsis - to solve such a problem, a model has to learn to discover and estimate disparity from the quasi-periodic textures. We show that deep CNNs embedded with disparity convolution, a novel convolutional layer proposed in this paper that simulates stereopsis and encodes disparity, can nicely solve such a problem after being sufficiently trained on a large 3D object dataset in a self-supervised fashion. We refer to our method as ``NeuralMagicEye''. Experiments show that our method can accurately recover the depth behind autostereograms with rich details and gradient smoothness. Experiments also show the completely different working mechanisms for autostereogram perception between neural networks and human eyes. We hope this research can help people with visual impairments and those who have trouble viewing autostereograms. Our code is available at \url{https://jiupinjia.github.io/neuralmagiceye/}.


title: Asymptotic freedom and higher derivative gauge theories

abstract: The ultraviolet completion of gauge theories by higher derivative terms can dramatically change their behavior at high energies. The requirement of asymptotic freedom imposes very stringent constraints that are only satisfied by a small family of higher derivative theories. If the number of derivatives is large enough ($n > 4$) the theory is strongly interacting both at extreme infrared and ultraviolet regimes whereas it remains asymptotically free for a low number of extra derivatives ($n \leqslant 4$). In all cases the theory improves its ultraviolet behavior leading in some cases to ultraviolet finite theories with vanishing $\beta$-function. The usual consistency problems associated to the presence of extra ghosts in higher derivative theories may not harm asymptotically free theories because in that case the effective masses of such ghosts are running to infinity in the ultraviolet limit.


title: Shifting Spin on the Celestial Sphere

abstract: We explore conformal primary wavefunctions for all half integer spins up to the graviton. Half steps are related by supersymmetry, integer steps by the classical double copy. The main results are as follows: we 1) introduce a convenient spin frame and null tetrad to organize all radiative modes of varying spin; 2) identify the massless spin-3/2 conformal primary wavefunction as well as the conformally soft Goldstone mode corresponding to large supersymmetry transformations; 3) indicate how to express a conformal primary of arbitrary spin in terms of differential operators acting on a scalar primary; 4) demonstrate that conformal primary metrics satisfy the double copy in a variety of forms -- operator, Weyl, and Kerr-Schild -- and are exact, albeit complex, solutions to the fully non-linear Einstein equations of Petrov type N; 5) propose a novel generalization of conformal primary wavefunctions; and 6) show that this generalization includes a large class of physically interesting metrics corresponding to ultra-boosted black holes, shockwaves and more.


title: EfficientNet-Absolute Zero for Continuous Speech Keyword Spotting

abstract: Keyword spotting is a process of finding some specific words or phrases in recorded speeches by computers. Deep neural network algorithms, as a powerful engine, can handle this problem if they are trained over an appropriate dataset. To this end, the football keyword dataset (FKD), as a new keyword spotting dataset in Persian, is collected with crowdsourcing. This dataset contains nearly 31000 samples in 18 classes. The continuous speech synthesis method proposed to made FKD usable in the practical application which works with continuous speeches. Besides, we proposed a lightweight architecture called EfficientNet-A0 (absolute zero) by applying the compound scaling method on EfficientNet-B0 for keyword spotting task. Finally, the proposed architecture is evaluated with various models. It is realized that EfficientNet-A0 and Resnet models outperform other models on this dataset.


title: Effect of Oxygen Mole Fraction on Static Properties of Pressure-Sensitive Paint

abstract: The effects of oxygen mole fraction on the static properties of pressure-sensitive paint (PSP) were investigated. Sample coupon tests using a calibration chamber were conducted for polymer-based PSP (PHFIPM-PSP), polymer/ceramic PSP (PC-PSP), and anodized-aluminium PSP (AA-PSP). The oxygen mole fraction was set to be between 0.1-100% and the ambient pressure was set to be between 0.5-140 kPa. The localized Stern-Volmer coefficient $B_{\rm local}$ once increases and then decreases as the oxygen mole fraction increases. The value of $B_{\rm local}$ depends on both ambient pressure and oxygen mole fraction, but the effect of this parameter can be characterized as a function of the partial pressure of oxygen. The value of $B_{\rm local}$ of AA-PSP and PHFIPM-PSP, which are low-pressure type and relatively low-pressure type PSP, have a peak at the relatively low partial pressure of oxygen, and $B_{\rm local}$ of PC-PSP, which are atmospheric pressure type PSP, has a peak at the relatively high partial pressure of oxygen. The peak of the intensity change with respect to pressure fluctuation proportional to the ambient pressure $S_{\mathcal{PR}}$ appears at the lower partial pressure of oxygen than that of $B_{\rm local}$. This is because the intensity of PSP becomes quite low at the high partial pressure of oxygen even if $B_{\rm local}$ is higher. Hence, an optimal partial oxygen mole fraction exists depending on the type of PSP and ambient pressure range of the experiment, and its optimal value can be found based on the partial pressure of oxygen.


title: Interactive SARS-CoV-2 mutation timemaps

abstract: As the year 2020 draws to an end, several new strains have been reported for the SARS-CoV-2 coronavirus, the agent responsible for the COVID-19 pandemic that has afflicted us all this past year. However, it is difficult to comprehend the scale, in sequence space, geographical location and time, at which SARS-CoV-2 mutates and evolves in its human hosts. To get an appreciation for the rapid evolution of the coronavirus, we built interactive scalable vector graphics maps that show daily nucleotide variations in genomes from the six most populated continents compared to that of the initial, ground-zero SARS-CoV-2 isolate sequenced at the beginning of the year. Availability: Mutation time maps are available from https://bcgsc.github.io/SARS2/


title: Real Spectral Triples on Crossed Products

abstract: Given a spectral triple on a unital $C^{*}$-algebra $A$ and an equicontinuous action of a discrete group $G$ on $A$, a spectral triple on the reduced crossed product $C^{*}$-algebra $A\rtimes_r G$ was constructed by Hawkins, Skalski, White and Zacharias in [On spectral triples on crossed products arising from equicontinuous actions, Math. Scand. 113(2) (2013) 262-291], extending the construction by Belissard, Marcolli and Reihani in [Dynamical systems on spectral metric spaces, preprint (2010), arXiv:1008.4617], by using the Kasparov product to make an ansatz for the Dirac operator. Supposing that the triple on $A$ is equivariant for an action of $G$, we show that the triple on $A\rtimes_r G$ is equivariant for the dual coaction of $G$. If moreover an equivariant real structure $J$ is given for the triple on $A$, we give constructions for two inequivalent real structures on the triple $A\rtimes_rG$. We compute the KO-dimension with respect to each real structure in terms of the KO-dimension of $J$ and show that the first and the second order conditions are preserved. Lastly, we characterise an equivariant orientation cycle on the triple on $A\rtimes_rG$ coming from an equivariant orientation cycle on the triple on $A$. We show, along the paper, that our constructions generalize the respective constructions of the equivariant spectral triple on the noncommutative $2$-torus.


title: Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning

abstract: Pretrained language models (PLMs) perform poorly under adversarial attacks. To improve the adversarial robustness, adversarial data augmentation (ADA) has been widely adopted to cover more search space of adversarial attacks by adding textual adversarial examples during training. However, the number of adversarial examples for text augmentation is still extremely insufficient due to the exponentially large attack search space. In this work, we propose a simple and effective method to cover a much larger proportion of the attack search space, called Adversarial and Mixup Data Augmentation (AMDA). Specifically, AMDA linearly interpolates the representations of pairs of training samples to form new virtual samples, which are more abundant and diverse than the discrete text adversarial examples in conventional ADA. Moreover, to fairly evaluate the robustness of different models, we adopt a challenging evaluation setup, which generates a new set of adversarial examples targeting each model. In text classification experiments of BERT and RoBERTa, AMDA achieves significant robustness gains under two strong adversarial attacks and alleviates the performance degradation of ADA on the clean data. Our code is available at: https://github.com/thunlp/MixADA .


title: Relational Deep Reinforcement Learning for Routing in Wireless Networks

abstract: While routing in wireless networks has been studied extensively, existing protocols are typically designed for a specific set of network conditions and so cannot accommodate any drastic changes in those conditions. For instance, protocols designed for connected networks cannot be easily applied to disconnected networks. In this paper, we develop a distributed routing strategy based on deep reinforcement learning that generalizes to diverse traffic patterns, congestion levels, network connectivity, and link dynamics. We make the following key innovations in our design: (i) the use of relational features as inputs to the deep neural network approximating the decision space, which enables our algorithm to generalize to diverse network conditions, (ii) the use of packet-centric decisions to transform the routing problem into an episodic task by viewing packets, rather than wireless devices, as reinforcement learning agents, which provides a natural way to propagate and model rewards accurately during learning, and (iii) the use of extended-time actions to model the time spent by a packet waiting in a queue, which reduces the amount of training data needed and allows the learning algorithm to converge more quickly. We evaluate our routing algorithm using a packet-level simulator and show that the policy our algorithm learns during training is able to generalize to larger and more congested networks, different topologies, and diverse link dynamics. Our algorithm outperforms shortest path and backpressure routing with respect to packets delivered and delay per packet.


title: BinaryBERT: Pushing the Limit of BERT Quantization

abstract: The rapid development of large pre-trained language models has greatly increased the demand for model compression techniques, among which quantization is a popular solution. In this paper, we propose BinaryBERT, which pushes BERT quantization to the limit by weight binarization. We find that a binary BERT is hard to be trained directly than a ternary counterpart due to its complex and irregular loss landscape. Therefore, we propose ternary weight splitting, which initializes BinaryBERT by equivalently splitting from a half-sized ternary network. The binary model thus inherits the good performance of the ternary one, and can be further enhanced by fine-tuning the new architecture after splitting. Empirical results show that our BinaryBERT has only a slight performance drop compared with the full-precision model while being 24x smaller, achieving the state-of-the-art compression results on the GLUE and SQuAD benchmarks.


title: Optimising SARS-CoV-2 pooled testing strategies on social networks for low-resource settings

abstract: Controlling the COVID-19 pandemic is an urgent global challenge. The rapid geographic spread of SARS-CoV-2 directly reflects the social structure. Before effective vaccines and treatments are widely available, we have to rely on alternative, non-pharmaceutical interventions, including frequency testing, contact tracing, social distancing, mask wearing, and hand-washing, as public health practises to slow down the spread of the disease. However frequent testing is the key in the absence of any alternative. We propose a network approach to determine the optimal low resources setting oriented pool testing strategies that identifies infected individuals in a small number of tests and few rounds of testing, at low prevalence of the virus. We simulate stochastic infection curves on societies under quarantine. Allowing some social interaction is possible to keep the COVID-19 curve flat. However, similar results can be strategically obtained searching and isolating infected persons to preserve a healthier social structure. Here, we analyze which are the best strategies to contain the virus applying an algorithm that combine samples and testing them in groups [1]. A relevant parameter to keep infection curves flat using this algorithm is the dairy frequency of testing at zones where a high infection rate is reported. On the other hand, the algorithm efficiency is low for random search of infected people.


title: Super Tannakian hulls

abstract: We consider essentially small rigid tensor categories (not necessarily abelian) which have a faithful tensor functor to a category of super vector spaces over a field of characteristic 0. It is shown how to construct for each such tensor category a super Tannakian hull, which is a universal faithful tensor functor to a super Tannakian category over a field of characteristic 0. The construction is analogous to the passage from an integral domain to its field of fractions.


title: A Detailed Account of The Inconsistent Labelling Problem of Stutter-Preserving Partial-Order Reduction

abstract: One of the most popular state-space reduction techniques for model checking is partial-order reduction (POR). Of the many different POR implementations, stubborn sets are a very versatile variant and have thus seen many different applications over the past 32 years. One of the early stubborn sets works shows how the basic conditions for reduction can be augmented to preserve stutter-trace equivalence, making stubborn sets suitable for model checking of linear-time properties. In this paper, we identify a flaw in the reasoning and show with a counter-example that stutter-trace equivalence is not necessarily preserved. We propose a stronger reduction condition and provide extensive new correctness proofs to ensure the issue is resolved. Furthermore, we analyse in which formalisms the problem may occur. The impact on practical implementations is limited, since they all compute a correct approximation of the theory.


title: A Bayesian viewpoint on the price formation process

abstract: We introduce a simple framework in which market participants update their prior about an efficient price with a model-based learning process. We show that exponential intensities for the arrival of aggressive orders arise naturally in this setting. Our approach allows us to fully describe market dynamics in the case with Brownian efficient price and informed market takers. We are also able to revisit the emergence of market impact due to meta-order splitting, making several connections with existing literature.


title: Diamond magnetometry and gradiometry towards subpicotesla DC field measurement

abstract: Nitrogen vacancy (NV) centers in diamond have developed into a powerful solid-state platform for compact quantum sensors. However, high sensitivity measurements usually come with additional constraints on the pumping intensity of the laser and the pulse control applied. Here, we demonstrate high sensitivity NV ensemble based magnetic field measurements with low-intensity optical excitation. DC magnetometry methods like, e.g., continuous-wave optically detected magnetic resonance and continuously excited Ramsey measurements combined with lock-in detection, are compared to get an optimization. Gradiometry is also investigated as a step towards unshielded measurements of unknown gradients. The magnetometer demonstrates a minimum detectable field of 0.3-0.7 pT in a 73 s measurement by further applying a flux guide with a sensing dimension of 2 mm, corresponding to a magnetic field sensitivity of 2.6-6 pT/Hz^0.5. Combined with our previous efforts on the diamond AC magnetometry, the diamond magnetometer is promising to perform wide bandwidth magnetometry with picotesla sensitivity and a cubic-millimeter sensing volume under ambient conditions.


title: Abelian envelopes of exact categories and highest weight categories

abstract: We define admissible and weakly admissible subcategories in exact categories and prove that the former induce semi-orthogonal decompositions on the derived categories. We develop the theory of thin exact categories, an exact-category analogue of triangulated categories generated by exceptional collections. The right and left abelian envelopes of exact categories are introduced, an example being the category of coherent sheaves on a scheme as the right envelope of the category of vector bundles. The existence of right (left) abelian envelopes is proved for exact categories with projectively (injectively) generating subcategories with weak (co)kernels. We show that highest weight categories are precisely the right/left envelopes of thin categories. Ringel duality is interpreted as a duality between the right and left abelian envelopes of a thin exact category. The duality for thin exact categories is introduced by means of derived categories and Serre functor on them.


title: Geometry of the Wiman-Edge monodromy

abstract: The Wiman-Edge pencil is a pencil of genus $6$ curves for which the generic member has automorphism group the alternating group $\mathfrak{A}_5$. There is a unique smooth member, the Wiman sextic, with automorphism group the symmetric group $\mathfrak{S}_5$. Farb and Looijenga proved that the monodromy of the Wiman-Edge pencil is commensurable with the Hilbert modular group $\mathrm{SL}_2(\mathbb{Z}[\sqrt{5}])$. In this note, we give a complete description of the monodromy by congruence conditions modulo $4$ and $5$. The congruence condition modulo $4$ is new, and this answers a question of Farb-Looijenga. We also show that the smooth resolution of the Baily-Borel compactification of the locally symmetric manifold associated with the monodromy is a projective surface of general type. Lastly, we give new information about the image of the period map for the pencil.


title: Discovery of unconventional chiral charge order in kagome superconductor KV3Sb5

abstract: Intertwining quantum order and nontrivial topology is at the frontier of condensed matter physics. A charge density wave (CDW) like order with orbital currents has been proposed as a powerful resource for achieving the quantum anomalous Hall effect in topological materials and for the hidden phase in cuprate high-temperature superconductors. However, the experimental realization of such an order is challenging. Here we use high-resolution scanning tunnelling microscopy (STM) to discover an unconventional charge order in a kagome material KV3Sb5, with both a topological band structure and a superconducting ground state. Through both topography and spectroscopic imaging, we observe a robust 2x2 superlattice. Spectroscopically, an energy gap opens at the Fermi level, across which the 2x2 charge modulation exhibits an intensity reversal in real-space, signaling charge ordering. At impurity-pinning free region, the strength of intrinsic charge modulations further exhibits chiral anisotropy with unusual magnetic field response. Theoretical analysis of our experiments suggests a tantalizing unconventional chiral CDW in the frustrated kagome lattice, which can not only lead to large anomalous Hall effect with orbital magnetism, but also be a precursor of unconventional superconductivity.


title: Revisiting Robust Neural Machine Translation: A Transformer Case Study

abstract: Transformers (Vaswani et al., 2017) have brought a remarkable improvement in the performance of neural machine translation (NMT) systems but they could be surprisingly vulnerable to noise. In this work, we try to investigate how noise breaks Transformers and if there exist solutions to deal with such issues. There is a large body of work in the NMT literature on analyzing the behavior of conventional models for the problem of noise but Transformers are relatively understudied in this context. Motivated by this, we introduce a novel data-driven technique called Target Augmented Fine-tuning (TAFT) to incorporate noise during training. This idea is comparable to the well-known fine-tuning strategy. Moreover, we propose two other novel extensions to the original Transformer: Controlled Denoising (CD) and Dual-Channel Decoding (DCD), that modify the neural architecture as well as the training process to handle noise. One important characteristic of our techniques is that they only impact the training phase and do not impose any overhead at inference time. We evaluated our techniques to translate the English--German pair in both directions and observed that our models have a higher tolerance to noise. More specifically, they perform with no deterioration where up to 10% of entire test words are infected by noise.


title: Topological solitons and bulk polarization switch in collinear type II multiferroics

abstract: We introduce a microscopic model for collinear multiferroics capable to reproduce, as a consequence of magnetic frustration and easy-axis anisotropy, the so-called "uudd" (or antiphase) magnetic ordering observed in several type II multiferroic materials. The crucial role of lattice distortions in the multiferroic character of these materials is entered into the model via an indirect magnetoelectric coupling, mediated by elastic degrees of freedom through a pantograph mechanism. Long range dipolar interactions set electric dipoles in the antiferroelectric order. We investigate this model by means of extensive DMRG computations and complementary analytical methods. We show that a lattice dimerization induces a spontaneous Z2 ferrielectric bulk polarization, with a sharp switch off produced by a magnetic field above a critical value. The topological character of the magnetic excitations makes this mechanism robust.


title: Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection

abstract: Recent advances on 3D object detection heavily rely on how the 3D data are represented, \emph{i.e.}, voxel-based or point-based representation. Many existing high performance 3D detectors are point-based because this structure can better retain precise point positions. Nevertheless, point-level features lead to high computation overheads due to unordered storage. In contrast, the voxel-based structure is better suited for feature extraction but often yields lower accuracy because the input data are divided into grids. In this paper, we take a slightly different viewpoint -- we find that precise positioning of raw points is not essential for high performance 3D object detection and that the coarse voxel granularity can also offer sufficient detection accuracy. Bearing this view in mind, we devise a simple but effective voxel-based framework, named Voxel R-CNN. By taking full advantage of voxel features in a two stage approach, our method achieves comparable detection accuracy with state-of-the-art point-based models, but at a fraction of the computation cost. Voxel R-CNN consists of a 3D backbone network, a 2D bird-eye-view (BEV) Region Proposal Network and a detect head. A voxel RoI pooling is devised to extract RoI features directly from voxel features for further refinement. Extensive experiments are conducted on the widely used KITTI Dataset and the more recent Waymo Open Dataset. Our results show that compared to existing voxel-based methods, Voxel R-CNN delivers a higher detection accuracy while maintaining a real-time frame processing rate, \emph{i.e}., at a speed of 25 FPS on an NVIDIA RTX 2080 Ti GPU. The code is available at \url{https://github.com/djiajunustc/Voxel-R-CNN}.


title: Kamino: Constraint-Aware Differentially Private Data Synthesis

abstract: Organizations are increasingly relying on data to support decisions. When data contains private and sensitive information, the data owner often desires to publish a synthetic database instance that is similarly useful as the true data, while ensuring the privacy of individual data records. Existing differentially private data synthesis methods aim to generate useful data based on applications, but they fail in keeping one of the most fundamental data properties of the structured data -- the underlying correlations and dependencies among tuples and attributes (i.e., the structure of the data). This structure is often expressed as integrity and schema constraints, or with a probabilistic generative process. As a result, the synthesized data is not useful for any downstream tasks that require this structure to be preserved. This work presents Kamino, a data synthesis system to ensure differential privacy and to preserve the structure and correlations present in the original dataset. Kamino takes as input of a database instance, along with its schema (including integrity constraints), and produces a synthetic database instance with differential privacy and structure preservation guarantees. We empirically show that while preserving the structure of the data, Kamino achieves comparable and even better usefulness in applications of training classification models and answering marginal queries than the state-of-the-art methods of differentially private data synthesis.


title: Testing the GFCCSD impurity solver on real materials within the self-energy embedding theory framework

abstract: We apply the Green's function coupled cluster singles and doubles (GFCCSD) impurity solver to realistic impurity problems arising for strongly correlated solids within the self-energy embedding theory (SEET) framework. We describe the details of our GFCC solver implementation, investigate its performance, and highlight potential advantages and problems on examples of impurities created during the self-consistent SEET for antiferromagnetic MnO and paramagnetic SrMnO$_{3}$. GFCCSD provides satisfactory descriptions for weakly and moderately correlated impurities with sizes that are intractable by existing accurate impurity solvers such as exact diagonalization (ED). However, our data also shows that when correlations become strong, the singles and doubles approximation used in GFCC could lead to instabilities in searching for the particle number present in impurity problems. These instabilities appears especially severe when the impurity size gets larger and multiple degenerate orbitals with strong correlations are present. We conclude that to fully check the reliability of GFCCSD results and use them in fully {\em ab initio} calculations in the absence of experiments, a verification from a GFCC solver with higher order excitations is necessary.


title: Beyond Offline Mapping: Learning Cross Lingual Word Embeddings through Context Anchoring

abstract: Recent research on cross-lingual word embeddings has been dominated by unsupervised mapping approaches that align monolingual embeddings. Such methods critically rely on those embeddings having a similar structure, but it was recently shown that the separate training in different languages causes departures from this assumption. In this paper, we propose an alternative approach that does not have this limitation, while requiring a weak seed dictionary (e.g., a list of identical words) as the only form of supervision. Rather than aligning two fixed embedding spaces, our method works by fixing the target language embeddings, and learning a new set of embeddings for the source language that are aligned with them. To that end, we use an extension of skip-gram that leverages translated context words as anchor points, and incorporates self-learning and iterative restarts to reduce the dependency on the initial dictionary. Our approach outperforms conventional mapping methods on bilingual lexicon induction, and obtains competitive results in the downstream XNLI task.


title: Assessing Sensitivity to Unconfoundedness: Estimation and Inference

abstract: This paper provides a set of methods for quantifying the robustness of treatment effects estimated using the unconfoundedness assumption (also known as selection on observables or conditional independence). Specifically, we estimate and do inference on bounds on various treatment effect parameters, like the average treatment effect (ATE) and the average effect of treatment on the treated (ATT), under nonparametric relaxations of the unconfoundedness assumption indexed by a scalar sensitivity parameter c. These relaxations allow for limited selection on unobservables, depending on the value of c. For large enough c, these bounds equal the no assumptions bounds. Using a non-standard bootstrap method, we show how to construct confidence bands for these bound functions which are uniform over all values of c. We illustrate these methods with an empirical application to effects of the National Supported Work Demonstration program. We implement these methods in a companion Stata module for easy use in practice.


title: FGraDA: A Dataset and Benchmark for Fine-Grained Domain Adaptation in Machine Translation

abstract: Previous research for adapting a general neural machine translation (NMT) model into a specific domain usually neglects the diversity in translation within the same domain, which is a core problem for domain adaptation in real-world scenarios. One representative of such challenging scenarios is to deploy a translation system for a conference with a specific topic, e.g., global warming or coronavirus, where there are usually extremely less resources due to the limited schedule. To motivate wider investigation in such a scenario, we present a real-world fine-grained domain adaptation task in machine translation (FGraDA). The FGraDA dataset consists of Chinese-English translation task for four sub-domains of information technology: autonomous vehicles, AI education, real-time networks, and smart phone. Each sub-domain is equipped with a development set and test set for evaluation purposes. To be closer to reality, FGraDA does not employ any in-domain bilingual training data but provides bilingual dictionaries and wiki knowledge base, which can be easier obtained within a short time. We benchmark the fine-grained domain adaptation task and present in-depth analyses showing that there are still challenging problems to further improve the performance with heterogeneous resources.


title: Shuffle polygraphic resolutions for operads

abstract: Shuffle operads were introduced to forget the symmetric group actions on symmetric operads while preserving all possible operadic compositions. Rewriting methods were then applied to symmetric operads via shuffle operads: in particular, a notion of Gr\"obner basis was introduced for shuffle operads with respect to a total order on tree monomials. In this article, we introduce the structure of shuffle polygraphs as a categorical model for rewriting in shuffle operads, which generalizes the Gr\"obner bases approach by removing the constraint of a monomial order for the orientation of the rewriting rules. We define w-operads as internal w-categories in the category of shuffle operads. We show how to extend a convergent shuffle polygraph into a shuffle polygraphic resolution generated by the overlapping branchings of the original polygraph. Finally, we prove that a shuffle operad presented by a quadratic convergent shuffle polygraph is Koszul.


title: Ioffe-Regel criterion and viscoelastic properties of amorphous solids

abstract: We show that viscoelastic effects play a crucial role in the damping of vibrational modes in harmonic amorphous solids. The relaxation of a given plane wave is described by a memory function of a semi-infinite one-dimensions mass-spring chain. The initial vibrational energy spreads from the first site of the chain to infinity. In the beginning of the chain, there is a barrier, which significantly reduces the decay of vibrational energy below the Ioffe-Regel frequency. To obtain the parameters of the chain, we present a numerically stable method, based on the Chebyshev expansion of the local vibrational density of states.


title: A Liouville theorem for M\"{o}bius invariant equations

abstract: In this paper we classify M\"{o}bius invariant differential operators of second order in two dimensional Euclidean space, and establish a Liouville type theorem for general M\"{o}bius invariant elliptic equations.


title: Coded Machine Unlearning

abstract: There are applications that may require removing the trace of a sample from the system, e.g., a user requests their data to be deleted, or corrupted data is discovered. Simply removing a sample from storage units does not necessarily remove its entire trace since downstream machine learning models may store some information about the samples used to train them. A sample can be perfectly unlearned if we retrain all models that used it from scratch with that sample removed from their training dataset. When multiple such unlearning requests are expected to be served, unlearning by retraining becomes prohibitively expensive. Ensemble learning enables the training data to be split into smaller disjoint shards that are assigned to non-communicating weak learners. Each shard is used to produce a weak model. These models are then aggregated to produce the final central model. This setup introduces an inherent trade-off between performance and unlearning cost, as reducing the shard size reduces the unlearning cost but may cause degradation in performance. In this paper, we propose a coded learning protocol where we utilize linear encoders to encode the training data into shards prior to the learning phase. We also present the corresponding unlearning protocol and show that it satisfies the perfect unlearning criterion. Our experimental results show that the proposed coded machine unlearning provides a better performance versus unlearning cost trade-off compared to the uncoded baseline.


title: Finding large expanders in graphs: from topological minors to induced subgraphs

abstract: In this paper, we consider a structural and geometric property of graphs, namely the presence of large expanders. The problem of finding such structures was first considered by Krivelevich [SIAM J. Disc. Math. 32 1 (2018)]. Here, we show that the problem of finding a large induced subgraph that is an expander can be reduced to the simpler problem of finding a topological minor that is an expander. Our proof is constructive, which is helpful in an algorithmic setting. We also show that every large subgraph of an expander graph contains a large subgraph which is itself an expander.


title: Making Pre-trained Language Models Better Few-shot Learners

abstract: The recent GPT-3 model (Brown et al., 2020) achieves remarkable few-shot performance solely by leveraging a natural-language prompt and a few task demonstrations as input context. Inspired by their findings, we study few-shot learning in a more practical scenario, where we use smaller language models for which fine-tuning is computationally efficient. We present LM-BFF--better few-shot fine-tuning of language models--a suite of simple and complementary techniques for fine-tuning language models on a small number of annotated examples. Our approach includes (1) prompt-based fine-tuning together with a novel pipeline for automating prompt generation; and (2) a refined strategy for dynamically and selectively incorporating demonstrations into each context. Finally, we present a systematic evaluation for analyzing few-shot performance on a range of NLP tasks, including classification and regression. Our experiments demonstrate that our methods combine to dramatically outperform standard fine-tuning procedures in this low resource setting, achieving up to 30% absolute improvement, and 11% on average across all tasks. Our approach makes minimal assumptions on task resources and domain expertise, and hence constitutes a strong task-agnostic method for few-shot learning.


title: On Local and Integrated Stress-Tensor Commutators

abstract: We discuss some general aspects of commutators of local operators in Lorentzian CFTs, which can be obtained from a suitable analytic continuation of the Euclidean operator product expansion (OPE). Commutators only make sense as distributions, and care has to be taken to extract the right distribution from the OPE. We provide explicit computations in two and four-dimensional CFTs, focusing mainly on commutators of components of the stress-tensor. We rederive several familiar results, such as the canonical commutation relations of free field theory, the local form of the Poincar\'e algebra, and the Virasoro algebra of two-dimensional CFT. We then consider commutators of light-ray operators built from the stress-tensor. Using simplifying features of the light sheet limit in four-dimensional CFT we provide a direct computation of the BMS algebra formed by a specific set of light-ray operators in theories with no light scalar conformal primaries. In four-dimensional CFT we define a new infinite set of light-ray operators constructed from the stress-tensor, which all have well-defined matrix elements. These are a direct generalization of the two-dimensional Virasoro light-ray operators that are obtained from a conformal embedding of Minkowski space in the Lorentzian cylinder. They obey Hermiticity conditions similar to their two-dimensional analogues, and also share the property that a semi-infinite subset annihilates the vacuum.


title: Scalable Graph Neural Network-based framework for identifying critical nodes and links in Complex Networks

abstract: Identifying critical nodes and links in graphs is a crucial task. These nodes/links typically represent critical elements/communication links that play a key role in a system's performance. However, a majority of the methods available in the literature on the identification of critical nodes/links are based on an iterative approach that explores each node/link of a graph at a time, repeating for all nodes/links in the graph. Such methods suffer from high computational complexity and the resulting analysis is also network-specific. To overcome these challenges, this article proposes a scalable and generic graph neural network (GNN) based framework for identifying critical nodes/links in large complex networks. The proposed framework defines a GNN based model that learns the node/link criticality score on a small representative subset of nodes/links. An appropriately trained model can be employed to predict the scores of unseen nodes/links in large graphs and consequently identify the most critical ones. The scalability of the framework is demonstrated through prediction of nodes/links scores in large scale synthetic and real-world networks. The proposed approach is fairly accurate in approximating the criticality scores and offers a significant computational advantage over conventional approaches.


title: Refined bounds for randomized experimental design

abstract: Experimental design is an approach for selecting samples among a given set so as to obtain the best estimator for a given criterion. In the context of linear regression, several optimal designs have been derived, each associated with a different criterion: mean square error, robustness, \emph{etc}. Computing such designs is generally an NP-hard problem and one can instead rely on a convex relaxation that considers probability distributions over the samples. Although greedy strategies and rounding procedures have received a lot of attention, straightforward sampling from the optimal distribution has hardly been investigated. In this paper, we propose theoretical guarantees for randomized strategies on E and G-optimal design. To this end, we develop a new concentration inequality for the eigenvalues of random matrices using a refined version of the intrinsic dimension that enables us to quantify the performance of such randomized strategies. Finally, we evidence the validity of our analysis through experiments, with particular attention on the G-optimal design applied to the best arm identification problem for linear bandits.


title: Behavior and dynamics of the set of absolute nilpotent and idempotent elements of chain of evolution algebras depending on the time

abstract: In this paper we construct some families of three-dimensional evolution algebras which satisfies Chapman-Kolmogorov equation. For all of these chains we study the behavior of the baric property, the behavior of the set of absolute nilpotent elements and dynamics of the set of idempotent elements depending on the time.


title: Multi-Channel Sequential Behavior Networks for User Modeling in Online Advertising

abstract: Multiple content providers rely on native advertisement for revenue by placing ads within the organic content of their pages. We refer to this setting as ``queryless'' to differentiate from search advertisement where a user submits a search query and gets back related ads. Understanding user intent is critical because relevant ads improve user experience and increase the likelihood of delivering clicks that have value to our advertisers. This paper presents Multi-Channel Sequential Behavior Network (MC-SBN), a deep learning approach for embedding users and ads in a semantic space in which relevance can be evaluated. Our proposed user encoder architecture summarizes user activities from multiple input channels--such as previous search queries, visited pages, or clicked ads--into a user vector. It uses multiple RNNs to encode sequences of event sessions from the different channels and then applies an attention mechanism to create the user representation. A key property of our approach is that user vectors can be maintained and updated incrementally, which makes it feasible to be deployed for large-scale serving. We conduct extensive experiments on real-world datasets. The results demonstrate that MC-SBN can improve the ranking of relevant ads and boost the performance of both click prediction and conversion prediction in the queryless native advertising setting.


title: Silicene nanoribbons on an insulating thin film

abstract: Silicene, a new two-dimensional (2D) material has attracted intense research because of the ubiquitous use of silicon in modern technology. However, producing free-standing silicene has proved to be a huge challenge. Until now, silicene could be synthesized only on metal surfaces where it naturally forms strong interactions with the metal substrate that modify its electronic properties. Here, we report the first experimental evidence of silicene sheet on an insulating NaCl thin film. This work represents a major breakthrough; for the study of the intrinsic properties of silicene, and by extension to other 2D materials that have so far only been grown on metal surfaces.


title: Machine learning for adjoint vector in aerodynamic shape optimization

abstract: Adjoint method is widely used in aerodynamic design because only once solution of flow field is required for adjoint method to obtain the gradients of all design variables. However, the calculation cost of adjoint vector is approximately equal to that of flow computation. In order to accelerate the solution of adjoint vector and improve the adjoint-based optimization efficiency, machine learning for adjoint vector modeling is presented. Deep neural network (DNN) is employed to construct the mapping between the adjoint vector and the local flow variables. DNN can efficiently predict adjoint vector and its generalization is examined by a transonic drag reduction about NACA0012 airfoil. The results indicate that with negligible calculation cost of the adjoint vector, the proposed DNN-based adjoint method can achieve the same optimization results as the traditional adjoint method.


title: Persistence and Synchronization: Friends or Foes?

abstract: Emerging non-volatile memory (NVM) technologies promise memory speed byte-addressable persistent storage with a load/store interface. However, programming applications to directly manipulate NVM data is complex and error-prone. Applications generally employ libraries that hide the low-level details of the hardware and provide a transactional programming model to achieve crash-consistency. Furthermore, applications continue to expect correctness during concurrent executions, achieved through the use of synchronization. To achieve this, applications seek well-known ACID guarantees. However, realizing this presents designers of transactional systems with a range of choices in how to combine several low-level techniques, given target hardware features and workload characteristics. In this paper, we provide a comprehensive evaluation of the impact of combining existing crash-consistency and synchronization methods for achieving performant and correct NVM transactional systems. We consider different hardware characteristics, in terms of support for hardware transactional memory (HTM) and the boundaries of the persistence domain (transient or persistent caches). By characterizing persistent transactional systems in terms of their properties, we make it possible to better understand the tradeoffs of different implementations and to arrive at better design choices for providing ACID guarantees. We use both real hardware with Intel Optane DC persistent memory and simulation to evaluate a persistent version of hardware transactional memory, a persistent version of software transactional memory, and undo/redo logging. Through our empirical study, we show two major factors that impact the cost of supporting persistence in transactional systems: the persistence domain (transient or persistent caches) and application characteristics, such as transaction size and parallelism.


title: Improving Unsupervised Domain Adaptation by Reducing Bi-level Feature Redundancy

abstract: Reducing feature redundancy has shown beneficial effects for improving the accuracy of deep learning models, thus it is also indispensable for the models of unsupervised domain adaptation (UDA). Nevertheless, most recent efforts in the field of UDA ignores this point. Moreover, main schemes realizing this in general independent of UDA purely involve a single domain, thus might not be effective for cross-domain tasks. In this paper, we emphasize the significance of reducing feature redundancy for improving UDA in a bi-level way. For the first level, we try to ensure compact domain-specific features with a transferable decorrelated normalization module, which preserves specific domain information whilst easing the side effect of feature redundancy on the sequel domain-invariance. In the second level, domain-invariant feature redundancy caused by domain-shared representation is further mitigated via an alternative brand orthogonality for better generalization. These two novel aspects can be easily plugged into any BN-based backbone neural networks. Specifically, simply applying them to ResNet50 has achieved competitive performance to the state-of-the-arts on five popular benchmarks. Our code will be available at https://github.com/dreamkily/gUDA.


title: Bayesian Graph Neural Network for Fast identification of critical nodes in Uncertain Complex Networks

abstract: In the quest to improve efficiency, interdependence and complexity are becoming defining characteristics of modern complex networks representing engineered and natural systems. Graph theory is a widely used framework for modeling such complex networks and to evaluate their robustness to disruptions. Particularly, identification of critical nodes/links in a graph can facilitate the enhancement of graph (system) robustness and characterize crucial factors of system performance. Most existing methods of critical node identification are based on an iterative approach that explores each node/link of a graph. These methods suffer from high computational complexity and the resulting analysis is network specific. Additionally, uncertainty associated with the underlying graphical model further limits the potential value of these traditional approaches. To overcome these challenges, we propose a Bayesian graph neural network based node classification framework that is computationally efficient and systematically incorporates uncertainties. Instead of utilizing the observed graph for training the model, a MAP estimate of the graph is computed based on the observed topology and node target labels. Further, a Monte-Carlo (MC) dropout algorithm is incorporated to account for the epistemic uncertainty. The fidelity and the gain in computational complexity offered by the Bayesian framework is illustrated using simulation results.


title: Basketball Player's Value Evaluation by a Networks-based Variant Parameter Hidden Markov Model

abstract: Determining the value of basketball players through analyzing the players' behavior is important for the managers of modern basketball teams. However, conventional methods always utilize isolated statistical data, leading to ineffective and inaccurate evaluations. Existing models based on dynamic network theory offer major improvements to the results of such evaluations, but said models remain imprecise because they focus merely on evaluating the values of individual players rather than considering them within their current teams. To solve this problem, we propose an analysis and evaluation model based on networks and a hidden Markov model. To the best of our knowledge, we are the first to combine a network form representing the players who are playing with the use of a hidden Markov model to mine the network and generate the desired results. Applying our approach to SportVU data collected from the National Basketball Association shows that this analysis and evaluation model can effectively analyze the performance of each player in a game and provides an assistive tool for team managers.


title: Multi-dimensional $c$-almost periodic type functions and applications

abstract: In this paper, we analyze multi-dimensional Bohr $({\mathcal B},c)$-almost periodic type functions. The main structural characterizations for the introduced classes of Bohr $({\mathcal B},c)$-almost periodic type functions are established. Several applications of our abstract theoretical results to the abstract Volterra integro-differential equations in Banach spaces are provided, as well.


title: Abelian Theory

abstract: This exposition begins with a systematic account of the theory of group schemes, ultimately specializing to algebraic tori.


title: Design Of Two Stage CMOS Operational Amplifier in 180nm Technology

abstract: In this paper a CMOS two stage operational amplifier has been presented which operates at 1.8 V power supply at 0.18 micron (i.e., 180 nm) technology and whose input is depended on Bias Current. The op-amp provides a gain of 63dB and a bandwidth of 140 kHz for a load of 1 pF. This op-amp has a Common Mode gain of -25 dB, an output slew rate of 32 $V / \mu s$, and a output voltage swing. The power consumption for the op-amp is $300\mu W$.


title: Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences

abstract: In social settings, much of human behavior is governed by unspoken rules of conduct. For artificial systems to be fully integrated into social environments, adherence to such norms is a central prerequisite. We investigate whether contemporary NLG models can function as behavioral priors for systems deployed in social settings by generating action hypotheses that achieve predefined goals under moral constraints. Moreover, we examine if models can anticipate likely consequences of (im)moral actions, or explain why certain actions are preferable by generating relevant norms. For this purpose, we introduce 'Moral Stories', a crowd-sourced dataset of structured, branching narratives for the study of grounded, goal-oriented social reasoning. Finally, we propose decoding strategies that effectively combine multiple expert models to significantly improve the quality of generated actions, consequences, and norms compared to strong baselines, e.g. though abductive reasoning.


title: Uncertainty Bounds for Multivariate Machine Learning Predictions on High-Strain Brittle Fracture

abstract: Simulation of the crack network evolution on high strain rate impact experiments performed in brittle materials is very compute-intensive. The cost increases even more if multiple simulations are needed to account for the randomness in crack length, location, and orientation, which is inherently found in real-world materials. Constructing a machine learning emulator can make the process faster by orders of magnitude. There has been little work, however, on assessing the error associated with their predictions. Estimating these errors is imperative for meaningful overall uncertainty quantification. In this work, we extend the heteroscedastic uncertainty estimates to bound a multiple output machine learning emulator. We find that the response prediction is accurate within its predicted errors, but with a somewhat conservative estimate of uncertainty.


title: Poisoning Attacks on Cyber Attack Detectors for Industrial Control Systems

abstract: Recently, neural network (NN)-based methods, including autoencoders, have been proposed for the detection of cyber attacks targeting industrial control systems (ICSs). Such detectors are often retrained, using data collected during system operation, to cope with the natural evolution (i.e., concept drift) of the monitored signals. However, by exploiting this mechanism, an attacker can fake the signals provided by corrupted sensors at training time and poison the learning process of the detector such that cyber attacks go undetected at test time. With this research, we are the first to demonstrate such poisoning attacks on ICS cyber attack online NN detectors. We propose two distinct attack algorithms, namely, interpolation- and back-gradient based poisoning, and demonstrate their effectiveness on both synthetic and real-world ICS data. We also discuss and analyze some potential mitigation strategies.


title: LookHops: light multi-order convolution and pooling for graph classification

abstract: Convolution and pooling are the key operations to learn hierarchical representation for graph classification, where more expressive $k$-order($k>1$) method requires more computation cost, limiting the further applications. In this paper, we investigate the strategy of selecting $k$ via neighborhood information gain and propose light $k$-order convolution and pooling requiring fewer parameters while improving the performance. Comprehensive and fair experiments through six graph classification benchmarks show: 1) the performance improvement is consistent to the $k$-order information gain. 2) the proposed convolution requires fewer parameters while providing competitive results. 3) the proposed pooling outperforms SOTA algorithms in terms of efficiency and performance.


title: On the Categorization of Nanomaterials

abstract: In this paper, categorization of nanomaterials is examined from four perspectives; context, criteria for success, ensuring measurements are relevant, and the life cycle of a nanomaterial. For each perspective, its relevance to categorization is discussed as well as the difficulties it presents. For example, while the context of assessing potential harm to living things and the environment is clearly important, other contexts are often needed and require different categorization schemes. Understanding what success means for a categorization scheme, within its target context, is critical to making sure a categorization is actually useful. The complexity of nanomaterials and their interactions makes generating and collecting the required data and metadata to support categorization a challenge. Finally, the transformation a nanomaterial undergoes through its lifetime, including the testing process, present additional challenges to accurate categorization. How these factors impact development of usable categorization schemes is analyzed.


title: Information carried by electromagnetic radiation launched from accelerated polarization currents

abstract: We show experimentally that a continuous, linear, dielectric antenna in which a superluminal polarization-current distribution accelerates can be used to transmit a broadband signal that is reproduced in a comprehensible form at a chosen target distance and angle. The requirement for this exact correspondence between broadcast and received signals is that each moving point in the polarization-current distribution approaches the target at the speed of light at all times during its transit along the antenna. This results in a one-to-one correspondence between the time at which each point on the moving polarization current enters the antenna and the time at which {\it all} of the radiation emitted by this particular point during its transit through the antenna arrives simultaneously at the target. This has the effect of reproducing the desired time dependence of the original broadcast signal. For other observer/detector positions, the time dependence of the signal is scrambled, due to the non-trivial relationship between emission (retarded) time and reception time. This technique represents a contrast to conventional radio transmission methods; in most examples of the latter, signals are broadcast with little or no directivity, selectivity of reception being achieved through the use of narrow frequency bands. In place of this, the current paper uses a spread of frequencies to transmit information to a particular location; the signal is weaker and has a scrambled time dependence elsewhere. We point out the possible relevance of this mechanism to 5G neighbourhood networks. This work also constitutes a ground-based astrophysics experiment that gives strong clues towards the emission mechanism of pulsars.


title: Data-driven topology optimization of spinodoid metamaterials with seamlessly tunable anisotropy

abstract: We present a two-scale topology optimization framework for the design of macroscopic bodies with an optimized elastic response, which is achieved by means of a spatially-variant cellular architecture on the microscale. The chosen spinodoid topology for the cellular network on the microscale (which is inspired by natural microstructures forming during spinodal decomposition) admits a seamless spatial grading as well as tunable elastic anisotropy, and it is parametrized by a small set of design parameters associated with the underlying Gaussian random field. The macroscale boundary value problem is discretized by finite elements, which in addition to the displacement field continuously interpolate the microscale design parameters. By assuming a separation of scales, the local constitutive behavior on the macroscale is identified as the homogenized elastic response of the microstructure based on the local design parameters. As a departure from classical FE$^2$-type approaches, we replace the costly microscale homogenization by a data-driven surrogate model, using deep neural networks, which accurately and efficiently maps design parameters onto the effective elasticity tensor. The model is trained on homogenized stiffness data obtained from numerical homogenization by finite elements. As an added benefit, the machine learning setup admits automatic differentiation, so that sensitivities (required for the optimization problem) can be computed exactly and without the need for numerical derivatives - a strategy that holds promise far beyond the elastic stiffness. Therefore, this framework presents a new opportunity for multiscale topology optimization based on data-driven surrogate models.


title: About one matrix of composite numbers and her applications

abstract: Scientific paper is devoted to research of T-matrix - matrix of composite numbers 6h+1 v 6h-1 in special view, and to her application in number theory.


title: Octonionic Quadratic Equations

abstract: There are four division algebras over $\mathbb{R}$, namely real numbers, complex numbers, quaternions, and octonions. Lack of commutativity and associativity make it difficult to investigate algebraic and geometric properties of octonions. It does not make sense to ask, for example, whether the equation $x^2+1=0$ is solvable, without specifying the field in which we want the solutions to be lie. The equation $x^2+1=0$ has no solutions in $\mathbb{R}$, which is to say, there are no real numbers satisfying this equation. On the other hand, there are complex numbers which do satisfy this equation in the field $\mathbb{C}$ of all complex numbers. How about if we extend the same idea to other two normed division algebras quaternions and octonions. Liping Huang and Wasin So derive explicit formulas for computing the roots of quaternionic quadratic equations. We extend their work to octonionic case and solve monic left octonionic quadratic equation of the form $x^2+bx+c=0$, where $a,b$ are octonions in general.[ We called this form of quadratic equation as left octonion quadratic equation because we can consider $x^2+xb+c=0$ as a different case due to non-commutativity of octonions]. Finally, we represent the left spectrum of $2\times2$ octonionic matrix as a set of solutions to a corresponding octonionic quadratic equation, which is an application of deriving explicit formulas for computing the roots of octonionic quadratic equations.


title: Reprogrammable plasmonic topological insulators with ultrafast control

abstract: Topological photonics has revolutionized our understanding of light propagation, but most of current studies are focused on designing a static photonic structure. Developing a dynamic photonic topological platform to switch multiple topological functionalities at ultrafast speed is still a great challenge. Here we demonstrate an ultrafast reprogrammable plasmonic topological insulator, where the topological propagation route can be dynamically steered at nanosecond-level switching time, namely more than 10^7 times faster than the current state-of-the-art. This orders-of-magnitude improvement is achieved by using ultrafast electronic switches in an innovative way to implement the programmability. Due to the flexible programmability, many existing photonic topological functionalities can be integrated into this agile topological platform. Our work brings the current studies of photonic topological insulators to a digital and intelligent era, which could boost the development of intelligent and ultrafast photoelectric devices with built-in topological protection.


title: Digital Metasurface Based on Graphene: An Application to Beam Steering in Terahertz Plasmonic Antennas

abstract: Metasurfaces, the two-dimensional counterpart of metamaterials, have caught great attention thanks to their powerful capabilities on manipulation of electromagnetic waves. Recent times have seen the emergence of a variety of metasurfaces exhibiting not only countless functionalities, but also a reconfigurable response. Additionally, digital or coding metasurfaces have revolutionized the field by describing the device as a matrix of discrete building block states, thus drawing clear parallelisms with information theory and opening new ways to model, compose, and (re)program advanced metasurfaces. This paper joins the reconfigurable and digital approaches, and presents a metasurface that leverages the tunability of graphene to perform beam steering at terahertz frequencies. A comprehensive design methodology is presented encompassing technological, unit cell design, digital metamaterial synthesis, and programmability aspects. By setting up and dynamically adjusting a phase gradient along the metasurface plane, the resulting device achieves beam steering at all practical directions. The proposed design is studied through analytical models and validated numerically, showing beam widths and steering errors well below 10 degrees and 5% in most cases. Finally, design guidelines are extracted through a scalability analysis involving the metasurface size and number of unit cell states.


title: Incentivizing Routing Choices for Safe and Efficient Transportation in the Face of the COVID-19 Pandemic

abstract: The COVID-19 pandemic has severely affected many aspects of people's daily lives. While many countries are in a re-opening stage, some effects of the pandemic on people's behaviors are expected to last much longer, including how they choose between different transport options. Experts predict considerably delayed recovery of the public transport options, as people try to avoid crowded places. In turn, significant increases in traffic congestion are expected, since people are likely to prefer using their own vehicles or taxis as opposed to riskier and more crowded options such as the railway. In this paper, we propose to use financial incentives to set the tradeoff between risk of infection and congestion to achieve safe and efficient transportation networks. To this end, we formulate a network optimization problem to optimize taxi fares. For our framework to be useful in various cities and times of the day without much designer effort, we also propose a data-driven approach to learn human preferences about transport options, which is then used in our taxi fare optimization. Our user studies and simulation experiments show our framework is able to minimize congestion and risk of infection.


title: An analytic physically motivated model of the mammalian cochlea

abstract: We develop an analytic model of the mammalian cochlea. We use a mixed physical-phenomenological approach by utilizing existing work on the physics of classical box-representations of the cochlea, and behavior of recent data-derived wavenumber estimates. Spatial variation is incorporated through a single independent variable that combines space and frequency. We arrive at closed-form expressions for the organ of Corti velocity, its impedance, the pressure difference across the organ of Corti, and its wavenumber. We perform model tests using real and imaginary parts of chinchilla data from multiple locations and for multiple variables. The model also predicts impedances that are qualitatively consistent with current literature. For implementation, the model can leverage existing efforts for both filter bank and filter cascade models that target improved algorithmic or analog circuit efficiencies. The simplicity of the cochlear model, its small number of model constants, its ability to capture the variation of tuning, its closed-form expressions for physically-interrelated variables, and the form of these expressions that allows for easily determining one variable from another make the model appropriate for analytic and digital auditory filter implementations as discussed here, as well as for extracting macromechanical insights regarding how the cochlea works.


title: Ultrathin carpet cloak enabled by infinitely anisotropic medium

abstract: Thanks to the pioneering studies conducted on the fields of transformation optics (TO) and metasurfaces, many unprecedented devices such as invisibility cloaks have been recently realized. However, each of these methods has some drawbacks limiting the applicability of the designed devices for real-life scenarios. For instance, TO studies lead to bulky coating layer with the thickness that is comparable to, or even larger than the dimension of the concealed object. In this paper, based on the coordinate transformation, an ultrathin carpet cloak is proposed to hide objects with arbitrary shape and size using a thin anisotropic material, called as infinitely anisotropic medium (IAM). It is shown that unlike the previous metasurface-based carpet cloaks, the proposed IAM hides objects from all viewing incident angles while it is extremely thin compared with the object dimensions. This material also circumvents the conventional transformation optics complexities and could be easily implemented in practical scenarios. To demonstrate the capability of the proposed carpet cloak, several full-wave simulations are carried out. Finally, as a proof of concept, the IAM is implemented based on the effective medium theory which exhibits good agreement with the results obtained from the theoretical investigations. The introduced material not only constitutes a significant step towards the invisibility cloak but also can greatly promote the practical application of the other TO-based devices.


title: Some solutions of functional equation $I(I(y,x), I(x,y))=I(x,y)$ involving fuzzy implications

abstract: In this article, a functional equation(IE) involving fuzzy implications has been considered. Two different perspectives of this equation have been provided to realize its significance. As it is very difficult to find the solutions of (IE) in general, the investigation of solutions of (IE) is restricted to main families of fuzzy implications.


title: The Role of Referrals in Immobility, Inequality, and Inefficiency in Labor Markets

abstract: We study the consequences of job markets' heavy reliance on referrals. Referrals screen candidates and lead to better matches and increased productivity, but disadvantage job-seekers who have few or no connections to employed workers, leading to increased inequality. Coupled with homophily, referrals also lead to immobility: a demographic group's low current employment rate leads that group to have relatively low future employment as well. We identify conditions under which distributing referrals more evenly across a population not only reduces inequality, but also improves future productivity and economic mobility. We use the model to examine optimal policies, showing that one-time affirmative action policies involve short-run production losses, but lead to long-term improvements in equality, mobility, and productivity due to induced changes in future referrals. We also examine how the possibility of firing workers changes the effects of referrals.


title: Limitations of Deep Neural Networks: a discussion of G. Marcus' critical appraisal of deep learning

abstract: Deep neural networks have triggered a revolution in artificial intelligence, having been applied with great results in medical imaging, semi-autonomous vehicles, ecommerce, genetics research, speech recognition, particle physics, experimental art, economic forecasting, environmental science, industrial manufacturing, and a wide variety of applications in nearly every field. This sudden success, though, may have intoxicated the research community and blinded them to the potential pitfalls of assigning deep learning a higher status than warranted. Also, research directed at alleviating the weaknesses of deep learning may seem less attractive to scientists and engineers, who focus on the low-hanging fruit of finding more and more applications for deep learning models, thus letting short-term benefits hamper long-term scientific progress. Gary Marcus wrote a paper entitled Deep Learning: A Critical Appraisal, and here we discuss Marcus' core ideas, as well as attempt a general assessment of the subject. This study examines some of the limitations of deep neural networks, with the intention of pointing towards potential paths for future research, and of clearing up some metaphysical misconceptions, held by numerous researchers, that may misdirect them.


title: Am I Rare? An Intelligent Summarization Approach for Identifying Hidden Anomalies

abstract: Monitoring network traffic data to detect any hidden patterns of anomalies is a challenging and time-consuming task that requires high computing resources. To this end, an appropriate summarization technique is of great importance, where it can be a substitute for the original data. However, the summarized data is under the threat of removing anomalies. Therefore, it is vital to create a summary that can reflect the same pattern as the original data. Therefore, in this paper, we propose an INtelligent Summarization approach for IDENTifying hidden anomalies, called INSIDENT. The proposed approach guarantees to keep the original data distribution in summarized data. Our approach is a clustering-based algorithm that dynamically maps original feature space to a new feature space by locally weighting features in each cluster. Therefore, in new feature space, similar samples are closer, and consequently, outliers are more detectable. Besides, selecting representatives based on cluster size keeps the same distribution as the original data in summarized data. INSIDENT can be used both as the preprocess approach before performing anomaly detection algorithms and anomaly detection algorithm. The experimental results on benchmark datasets prove a summary of the data can be a substitute for original data in the anomaly detection task.


title: Mechanical Tuning of the Terahertz Photonic Bandgap of 3D-Printed One-Dimensional Photonic Crystals

abstract: Mechanical tuning of a 3D-printed, polymer-based one-dimensional photonic crystal was demonstrated in the terahertz spectral range. The investigated photonic crystal consists of 13 alternating compact and low-density layers and was fabricated through single-step stereolithography. While the compact layers are entirely polymethacrylate without any intentional internal structures, the low-density layers contain sub-wavelength sized slanted columnar inclusions to allow the mechanical compression in a direction normal to the layer interfaces of the photonic crystal. Terahertz transmission spectroscopy of the photonic crystal was performed in a spectral range from 83 to 124 GHz as a function of the compressive strain. The as-fabricated photonic crystal showed a distinct photonic bandgap centered at 109 GHz, which blue shifted under compressive stress. A maximum shift of 12 GHz in the bandgap center frequency was experimentally demonstrated. Stratified optical models incorporating simple homogeneous and inhomogeneous compression approximations were used to analyze the transmission data. A good agreement between the experimental and model-calculated transmission spectra was found.


title: On Bose-Einstein condensation in one-dimensional noninteracting Bose gases in the presence of soft Poisson obstacles

abstract: We study Bose-Einstein condensation (BEC) in one-dimensional noninteracting Bose gases in Poisson random potentials on $\mathbb R$ with single-site potentials that are nonnegative, compactly supported, and bounded measurable functions in the grand-canonical ensemble at positive temperatures in the thermodynamic limit. For particle densities that are larger than a critical one, we prove the following: With arbitrarily high probability when choosing the fixed strength of the random potential sufficiently large, BEC where only the ground state is macroscopically occupied occurs. If the strength of the Poisson random potential converges to infinity in a certain sense but arbitrarily slowly, then this kind of BEC occurs in probability and in the $r$th mean, $r \ge 1$. Furthermore, in Poisson random potentials of any fixed strength an arbitrarily high probability for type-I g-BEC is also obtained by allowing sufficiently many one-particle states to be macroscopically occupied.


title: Up-down ordered Chinese restaurant processes with two-sided immigration, emigration and diffusion limits

abstract: We introduce a three-parameter family of up-down ordered Chinese restaurant processes ${\rm PCRP}^{(\alpha)}(\theta_1,\theta_2)$, $\alpha\in(0,1)$, $\theta_1,\theta_2\ge 0$, generalising the two-parameter family of Rogers and Winkel. Our main result establishes self-similar diffusion limits, ${\rm SSIP}^{(\alpha)}(\theta_1,\theta_2)$-evolutions generalising existing families of interval partition evolutions. We use the scaling limit approach to extend stationarity results to the full three-parameter family, identifying an extended family of Poisson--Dirichlet interval partitions. Their ranked sequence of interval lengths has Poisson--Dirichlet distribution with parameters $\alpha\in(0,1)$ and $\theta:=\theta_1+\theta_2-\alpha\ge-\alpha$, including for the first time the usual range of $\theta>-\alpha$ rather than being restricted to $\theta\ge 0$. This has applications to Fleming--Viot processes, nested interval partition evolutions and tree-valued Markov processes, notably relying on the extended parameter range.


title: Radiative corrections for the decay $\Sigma^0\to\Lambda e^+e^-$

abstract: Electromagnetic form factors serve to explore the intrinsic structure of nucleons and their strangeness partners. For the decay $\Sigma^0\to\Lambda e^+e^-$, due to limited phase space, the effects caused by the Sigma-to-Lambda transition form factors compete with the QED radiative corrections. These corrections are addressed in the present work, evaluated beyond the soft-photon approximation, i.e., over the whole range of the Dalitz plot and with no restrictions on the energy of the radiative photon.


title: Lepton-flavour violation in hadronic tau decays and $\ell$-$\tau$ conversion in nuclei

abstract: Within the Standard Model Effective Field Theory framework, with operators up to dimension 6, we perform a model-independent analysis of the lepton-flavour-violating processes involving tau leptons. Namely, we study hadronic tau decays and $\ell$-$\tau$ conversion in nuclei ($\ell=e,\mu$). Based on available experimental limits, we establish constraints on the Wilson coefficients of the operators contributing to these processes. The related information from Belle II and foreseen future experiments can be easily incorporated into the resulting framework.


title: Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection

abstract: We present a human-and-model-in-the-loop process for dynamically generating datasets and training better performing and more robust hate detection models. We provide a new dataset of ~40,000 entries, generated and labelled by trained annotators over four rounds of dynamic data creation. It includes ~15,000 challenging perturbations and each hateful entry has fine-grained labels for the type and target of hate. Hateful entries make up 54% of the dataset, which is substantially higher than comparable datasets. We show that model performance is substantially improved using this approach. Models trained on later rounds of data collection perform better on test sets and are harder for annotators to trick. They also perform better on HateCheck, a suite of functional tests for online hate detection. We provide the code, dataset and annotation guidelines for other researchers to use. Accepted at ACL 2021.


title: Scaling Replicated State Machines with Compartmentalization [Technical Report]

abstract: State machine replication protocols, like MultiPaxos and Raft, are a critical component of many distributed systems and databases. However, these protocols offer relatively low throughput due to several bottlenecked components. Numerous existing protocols fix different bottlenecks in isolation but fall short of a complete solution. When you fix one bottleneck, another arises. In this paper, we introduce compartmentalization, the first comprehensive technique to eliminate state machine replication bottlenecks. Compartmentalization involves decoupling individual bottlenecks into distinct components and scaling these components independently. Compartmentalization has two key strengths. First, compartmentalization leads to strong performance. In this paper, we demonstrate how to compartmentalize MultiPaxos to increase its throughput by 6x on a write-only workload and 16x on a mixed read-write workload. Unlike other approaches, we achieve this performance without the need for specialized hardware. Second, compartmentalization is a technique, not a protocol. Industry practitioners can apply compartmentalization to their protocols incrementally without having to adopt a completely new protocol.