title: Symmetry-breaking effects of instantons in parton gauge theories

abstract: Compact quantum electrodynamics (CQED$_3$) with Dirac fermionic matter provides an adequate framework for elucidating the universal low-energy physics of a wide variety of (2+1)D strongly correlated systems. Fractionalized states of matter correspond to its deconfined phases, where the gauge field is effectively noncompact, while conventional broken-symmetry phases are associated with confinement triggered by the proliferation of monopole-instantons. While much attention has been devoted lately to the symmetry classification of monopole operators in massless CQED$_3$ and related 3D conformal field theories, explicit derivations of instanton dynamics in parton gauge theories with fermions have been lacking. In this work, we use semiclassical methods analogous to those used by 't Hooft in the solution of the $U(1)$ problem in 4D quantum chromodynamics (QCD) to explicitly demonstrate the symmetry-breaking effect of instantons in CQED$_3$ with massive fermions, motivated by a fermionic parton description of hard-core bosons on a lattice. By contrast with the massless case studied by Marston, we find that massive fermions possess Euclidean zero modes exponentially localized to the center of the instanton. Such Euclidean zero modes produce in turn an effective four-fermion interaction -- known as the 't Hooft vertex in QCD -- which naturally leads to two possible superfluid phases for the original microscopic bosons: a conventional single-particle condensate or an exotic boson pair condensate without single-particle condensation.


title: Supersonic Ramjet Engine Inlet for Jovian Flight

abstract: This paper discusses the analysis performed on a supersonic ramjet engine inlet for flight in the atmosphere of Jupiter. Since the Jovian atmosphere lacks oxygen, the thrust will be generated by nuclear fission heating in the heat chamber. The first task to solve in the design in a ramjet engine is to design the supersonic inlet. The developed design methodology utilizes theoretical calculations and Computational Fluid Dynamics (CFD) simulations. The analytical model used to calculate the gas parameters in front of the heat chamber, and the CFD analysis, used to define the inlet geometry, are discussed. The results from the analytical model and CFD are compared and used for validation of the design approach. The calculated pressure losses and the mass flow allow the determination of important parameters required for the design of the aircraft, such as the reactor power, the thrust, the maximum mass, and the overall external dimensions.


title: TICaM: A Time-of-flight In-car Cabin Monitoring Dataset

abstract: We present TICaM, a Time-of-flight In-car Cabin Monitoring dataset for vehicle interior monitoring using a single wide-angle depth camera. Our dataset addresses the deficiencies of currently available in-car cabin datasets in terms of the ambit of labeled classes, recorded scenarios and provided annotations; all at the same time. We record an exhaustive list of actions performed while driving and provide for them multi-modal labeled images (depth, RGB and IR), with complete annotations for 2D and 3D object detection, instance and semantic segmentation as well as activity annotations for RGB frames. Additional to real recordings, we provide a synthetic dataset of in-car cabin images with same multi-modality of images and annotations, providing a unique and extremely beneficial combination of synthetic and real data for effectively training cabin monitoring systems and evaluating domain adaptation approaches. The dataset is available at https://vizta-tof.kl.dfki.de/.


title: Error estimate of the Non Intrusive Reduced Basis method with finite volume schemes

abstract: The context of this paper is the simulation of parameter-dependent partial differential equations (PDEs). When the aim is to solve such PDEs for a large number of parameter values, Reduced Basis Methods (RBM) are often used to reduce computational costs of a classical high fidelity code based on Finite Element Method (FEM), Finite Volume (FVM) or Spectral methods. The efficient implementation of most of these RBM requires to modify this high fidelity code, which cannot be done, for example in an industrial context if the high fidelity code is only accessible as a "black-box" solver. The Non Intrusive Reduced Basis method (NIRB) has been introduced in the context of finite elements as a good alternative to reduce the implementation costs of these parameter-dependent problems. The method is efficient in other contexts than the FEM one, like with finite volume schemes, which are more often used in an industrial environment. In this case, some adaptations need to be done as the degrees of freedom in FV methods have different meenings. At this time, error estimates have only been studied with FEM solvers. In this paper, we present a generalisation of the NIRB method to Finite Volume schemes and we show that estimates established for FEM solvers also hold in the FVM setting. We first prove our results for the hybrid-Mimetic Finite Difference method (hMFD), which is part the Hybrid Mixed Mimetic methods (HMM) family. Then, we explain how these results apply more generally to other FV schemes. Some of them are specified, such as the Two Point Flux Approximation (TPFA).


title: Testing the performance of the Milankovi\'c telescope

abstract: We have undertaken a multi-band imaging campaign of several galaxies to study their low surface brightness features such as shells and streams. Using the 1.4-m Milankovi\'c telescope, we measured the surface brightness limits in various bands depending on the exposure time. Remarkably, within three to four hours of observations with the $L$-filter we reached the surface brightness limit of $\mu_g$=28.5-29.0 mag/arcsec$^2$. We have confirmed the faint stream of the elliptical galaxy NGC\,474 discovered with MegaCam. The comparison to other deep photometric surveys has revealed that within few hours of observations we can produce competitive results, showing that the Milankovi\'c telescope can be a valuable asset in the study of the low-surface brightness Universe.


title: Homotopy Epimorphisms and Derived Tate's Acyclicity for Commutative C*-algebras

abstract: We study homotopy epimorphisms and covers formulated in terms of derived Tate's acyclicity for commutative C*-algebras and their non-Archimedean counterparts. We prove that a homotopy epimorphism between commutative C*-algebras precisely corresponds to a closed immersion between the compact Hausdorff topological spaces associated to them, and a cover of a commutative C*-algebra precisely corresponds to a topological cover of the compact Hausdorff topological space associated to it by closed immersions admitting a finite subcover. This permits us to prove derived and non-derived descent for Banach modules over commutative C*-algebras.


title: Stable rank 3 vector bundles on $\mathbb{P}^3$ with $c_1 = 0$, $c_2 = 3$

abstract: We clarify the undecided case $c_2 = 3$ of a theorem of Ein, Hartshorne and Vogelaar [Math. Ann. 259 (1982), 541--569] about the restriction of a stable rank 3 vector bundle with $c_1 = 0$ on the projective 3-space to a general plane. It turns out that there are more exceptions to the stable restriction property than those conjectured by the three authors. One of them is a Schwarzenberger bundle (twisted by $-1$); it has $c_3 = 6$. There are also some exceptions with $c_3 = 2$ (plus, of course, their duals). We also prove, for completeness, the basic properties of the corresponding moduli spaces; they are all nonsingular and connected, of dimension 28.


title: Stability of radially symmetric, monotone vorticities of 2D Euler equations

abstract: We consider the incompressible Euler equations in $R^2$ when the initial vorticity is bounded, radially symmetric and non-increasing in the radial direction. Such a radial distribution is stationary, and we show that the monotonicity produces stability in some weighted norm related to the angular impulse. For instance, it covers the cases of circular vortex patches and Gaussian distributions. Our stability does not depend on $L^\infty$-bound or support size of perturbations. The proof is based on the fact that such a radial monotone distribution minimizes the impulse of functions having the same level set measure.


title: Determinants preserving maps on the spaces of symmetric matrices and skew-symmetric matrices

abstract: Denote $\Sigma_n$ and $Q_n$ the set of all $n \times n$ symmetric and skew-symmetric matrices over a field $\mathbb{F}$, respectively, where $char(\mathbb{F})\neq 2$ and $\lvert \mathbb{F} \rvert \geq n^2+1$. A characterization of $\phi,\psi:\Sigma_n \rightarrow \Sigma_n$, for which at least one of them is surjective, satisfying $$\det(\phi(x)+\psi(y))=\det(x+y)\qquad(x,y\in \Sigma_n)$$ is given. Furthermore, if $n$ is even and $\phi,\psi:Q_n \rightarrow Q_n$, for which $\psi$ is surjective and $\psi(0)=0$, satisfy $$\det(\phi(x)+\psi(y))=\det(x+y)\qquad(x,y\in Q_n),$$ then $\phi=\psi$ and $\psi$ must be a bijective linear map preserving the determinant.


title: SuSketch: Surrogate Models of Gameplay as a Design Assistant

abstract: This paper introduces SuSketch, a design tool for first person shooter levels. SuSketch provides the designer with gameplay predictions for two competing players of specific character classes. The interface allows the designer to work side-by-side with an artificially intelligent creator and to receive varied types of feedback such as path information, predicted balance between players in a complete playthrough, or a predicted heatmap of the locations of player deaths. The system also proactively designs alternatives to the level and class pairing, and presents them to the designer as suggestions that improve the predicted balance of the game. SuSketch offers a new way of integrating machine learning into mixed-initiative co-creation tools, as a surrogate of human play trained on a large corpus of artificial playtraces. A user study with 16 game developers indicated that the tool was easy to use, but also highlighted a need to make SuSketch more accessible and more explainable.


title: A New Efficient Numbering System : Application to Numbers Generation and Visual Markers Design

abstract: This short paper introduces a recently patented line based numbering system. The last allows a best concordance with decimal digits values, and open up new opportunities, which are not possible with the classical decimal numeration system. Proposed OILU symbolic allows generating a new type of number series, based on multi facets numbers splitting process. On the other hand, this new symbolic is used in the development of new visual markers, highly required in augmented reality and UAV's navigation applications.


title: On the Hill and Kolmogorov statistics and the K-function representation of judiciously modified Avrami kinetics

abstract: This study concerns the phase transformation kinetics and pertains to the processes of crystallisation of amorphous polymers, ceramics, and bulk metallic glasses (BMG), as well as solid state transformations by the nucleation and growth mechanism. It is also likely to be relevant to the description of dissolution and precipitation processes, and more generally chemical reaction kinetics, as well as biochemical processes such as ligand binding, haemoglobin oxygenation, etc. The mathematical framework is examined of the of the 'knee' function, or K-function, and its implications are explored.


title: Calibration of Spin-Light Coupling by Coherently Induced Faraday Rotation

abstract: Calibrating the strength of the light-matter interaction is an important experimental task in quantum information and quantum state engineering protocols. The strength of the off-resonant light-matter interaction in multi-atom spin oscillators can be characterized by the coupling rate $\Gamma_\text{S}$. Here we utilize the Coherently Induced Faraday Rotation (CIFAR) signal for determining the coupling rate. The method is suited for both continuous and pulsed readout of the spin oscillator, relying only on applying a known polarization modulation to the probe laser beam and detecting a known optical polarization component. Importantly, the method does not require changes to the optical and magnetic fields performing the state preparation and probing. The CIFAR signal is also independent of the probe beam photo-detection quantum efficiency, and allows direct extraction of other parameters of the interaction, such as the tensor coupling $\zeta_\text{S}$, and the damping rate $\gamma_\text{S}$. We verify this method in the continuous wave regime, probing a strongly coupled spin oscillator prepared in a warm cesium atomic vapour.


title: Reduced basis methods for numerical room acoustic simulations with parametrized boundaries

abstract: The use of model-based numerical simulation of wave propagation in rooms for engineering applications requires that acoustic conditions for multiple parameters are evaluated iteratively and this is computationally expensive. We present a reduced basis methods (RBM) to achieve a computational cost reduction relative to a traditional full order model (FOM), for wave-based room acoustic simulations with parametrized boundary conditions. In this study, the FOM solver is based on the spectral element method, however other numerical methods could be applied. The RBM reduces the computational burden by solving the problem in a low-dimensional subspace for parametrized frequency-independent and frequency-dependent boundary conditions. The problem is formulated and solved in the Laplace domain, which ensures the stability of the reduced order model based on the RBM approach. We study the potential of the proposed RBM framework in terms of computational efficiency, accuracy and storage requirements and we show that the RBM leads to 100-fold speed-ups for a 2D case with an upper frequency of 2kHz and around 1000-fold speed-ups for an analogous 3D case with an upper frequency of 1kHz. While the FOM simulations needed to construct the ROM are expensive, we demonstrate that despite this cost, the ROM has a potential of three orders of magnitude faster than the FOM when four different boundary conditions are simulated per room surface. Moreover, results show that the storage model for the ROM is relatively high but affordable for the presented 2D and 3D cases.


title: Meta-DETR: Image-Level Few-Shot Object Detection with Inter-Class Correlation Exploitation

abstract: Few-shot object detection has been extensively investigated by incorporating meta-learning into region-based detection frameworks. Despite its success, the said paradigm is constrained by several factors, such as (i) low-quality region proposals for novel classes and (ii) negligence of the inter-class correlation among different classes. Such limitations hinder the generalization of base-class knowledge for the detection of novel-class objects. In this work, we design Meta-DETR, a novel few-shot detection framework that incorporates correlational aggregation for meta-learning into DETR detection frameworks. Meta-DETR works entirely at image level without any region proposals, which circumvents the constraint of inaccurate proposals in prevalent few-shot detection frameworks. Besides, Meta-DETR can simultaneously attend to multiple support classes within a single feed-forward. This unique design allows capturing the inter-class correlation among different classes, which significantly reduces the misclassification of similar classes and enhances knowledge generalization to novel classes. Experiments over multiple few-shot object detection benchmarks show that the proposed Meta-DETR outperforms state-of-the-art methods by large margins. The implementation codes will be released at https://github.com/ZhangGongjie/Meta-DETR.


title: Accurate and efficient computation of optical absorption spectra of molecular crystals: the case of the polymorphs of ROY

abstract: When calculating the optical absorption spectra of molecular crystals from first principles, the influence of the crystalline environment on the excitations is of significant importance. For such systems, however, methods to describe the excitations accurately can be computationally prohibitive due to the relatively large system sizes involved. In this work, we demonstrate a method that allows optical absorption spectra to be computed both efficiently and at high accuracy. Our approach is based on the spectral warping method successfully applied to molecules in solvent. It involves calculating the absorption spectrum of a supercell of the full molecular crystal using semi-local TDDFT, before warping the spectrum using a transformation derived from smaller-scale semi-local and hybrid TDDFT calculations on isolated dimers. We demonstrate the power of this method on three polymorphs of the well known colour polymorphic compound ROY, and find that it outperforms both small-scale hybrid TDDFT dimer calculations and large-scale semi-local TDDFT supercell calculations, when compared to experiment.


title: The giant in random graphs is almost local

abstract: Local convergence techniques have become a key methodology to study sparse random graphs. However, convergence of many random graph properties does not directly follow from local convergence. A notable, and important, such random graph property is the size and uniqueness of the giant component. We provide a simple criterion that guarantees that local convergence of a random graph implies the convergence of the proportion of vertices in the maximal connected component. We further show that, when this condition holds, the local properties of the giant are also described by the local limit. We give several examples where this method gives rise to a novel law of large numbers for the giant, based on results proved in the literature. Aside from these examples, we apply our novel method to the configuration model as a proof of concept, reproving a well-established result. As a side result of this proof, we identify the small-world nature of the configuration model.


title: American options in the Volterra Heston model

abstract: We price American options using kernel-based approximations of the Volterra Heston model. We choose these approximations because they allow simulation-based techniques for pricing. We prove the convergence of American option prices in the approximating sequence of models towards the prices in the Volterra Heston model. A crucial step in the proof is to exploit the affine structure of the model in order to establish explicit formulas and convergence results for the conditional Fourier-Laplace transform of the log price and an adjusted version of the forward variance. We illustrate with numerical examples our convergence result and the behavior of American option prices with respect to certain parameters of the model.


title: The one-dimensional Long-Range Falikov-Kimball Model: Thermal Phase Transition and Disorder-Free Localisation

abstract: Disorder or interactions can turn metals into insulators. One of the simplest settings to study this physics is given by the Falikov-Kimball model, which describes itinerant fermions interacting with a classical Ising background field. Despite the translational invariance of the model, inhomogenous configurations of the background field give rise to effective disorder physics which lead to a rich phase diagram in two (or more) dimensions with finite temperature charge density wave (CDW) transitions and interaction-tuned Anderson versus Mott localized phases. Here, we propose a generalised Falikov-Kimball model in one dimension with long-range interactions which shows a similarly rich phase diagram. We use an exact Markov Chain Monte Carlo method to map the phase diagram and compute the energy resolved localisation properties of the fermions. We compare the behaviour of this transitionally invariant model to an Anderson model of uncorrelated binary disorder about a background CDW field which confirms that the fermionic sector only fully localizes for very large system sizes.


title: Automatic Pulmonary Artery-Vein Separation in CT Images using Twin-Pipe Network and Topology Reconstruction

abstract: With the development of medical computer-aided diagnostic systems, pulmonary artery-vein(A/V) separation plays a crucial role in assisting doctors in preoperative planning for lung cancer surgery. However, distinguishing arterial from venous irrigation in chest CT images remains a challenge due to the similarity and complex structure of the arteries and veins. We propose a novel method for automatic separation of pulmonary arteries and veins from chest CT images. The method consists of three parts. First, global connection information and local feature information are used to construct a complete topological tree and ensure the continuity of vessel reconstruction. Second, the Twin-Pipe network proposed can automatically learn the differences between arteries and veins at different levels to reduce classification errors caused by changes in terminal vessel characteristics. Finally, the topology optimizer considers interbranch and intrabranch topological relationships to maintain spatial consistency to avoid the misclassification of A/V irrigations. We validate the performance of the method on chest CT images. Compared with manual classification, the proposed method achieves an average accuracy of 96.2% on noncontrast chest CT. In addition, the method has been proven to have good generalization, that is, the accuracies of 93.8% and 94.8% are obtained for CT scans from other devices and other modes, respectively. The result of pulmonary artery-vein obtained by the proposed method can provide better assistance for preoperative planning of lung cancer surgery.


title: Linear elasticity of polymer gels in terms of negative energy elasticity

abstract: We recently found that the energy contribution to the linear elasticity of polymer gels in the as-prepared state can be a significant negative value; the shear modulus is not proportional to the absolute temperature [Y. Yoshikawa et al., Phys. Rev. X 11, 011045 (2021) (arXiv:1912.13191)]. Our finding challenges the conventional notion that the polymer-gel elasticity is mainly determined by the entropy contribution. Existing molecular models of classical rubber elasticity theories, including the affine, phantom, and junction affine network models, cannot be used to estimate the structural parameters of polymer gels. In this focus review, we summarize the experimental studies on the linear elasticity of polymer gels in the as-prepared state using tetra-arm poly(ethylene glycol) (PEG) hydrogels with a homogenous polymer network. We also provide a unified formula for the linear elasticity of polymer gels with various network topologies and densities. Using the unified formula, we reconcile the past experimental results that seemed to be inconsistent with each other. Finally, we mention that there are still fundamental unresolved problems involving the linear elasticity of polymer gels.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.chem-ph


title: Learning physical properties of anomalous random walks using graph neural networks

abstract: Single particle tracking allows probing how biomolecules interact physically with their natural environments. A fundamental challenge when analysing recorded single particle trajectories is the inverse problem of inferring the physical model or class of models of the underlying random walks. Reliable inference is made difficult by the inherent stochastic nature of single particle motion, by experimental noise, and by the short duration of most experimental trajectories. Model identification is further complicated by the fact that main physical properties of random walk models are only defined asymptotically, and are thus degenerate for short trajectories. Here, we introduce a new, fast approach to inferring random walk properties based on graph neural networks (GNNs). Our approach consists in associating a vector of features with each observed position, and a sparse graph structure with each observed trajectory. By performing simulation-based supervised learning on this construct [1], we show that we can reliably learn models of random walks and their anomalous exponents. The method can naturally be applied to trajectories of any length. We show its efficiency in analysing various anomalous random walks of biological relevance that were proposed in the AnDi challenge [2]. We explore how information is encoded in the GNN, and we show that it learns relevant physical features of the random walks. We furthermore evaluate its ability to generalize to types of trajectories not seen during training, and we show that the GNN retains high accuracy even with few parameters. We finally discuss the possibility to leverage these networks to analyse experimental data.

categories: cs.LG physics.bio-ph physics.data-an q-bio.QM


title: Mine Me but Don't Single Me Out: Differentially Private Event Logs for Process Mining

abstract: The applicability of process mining techniques hinges on the availability of event logs capturing the execution of a business process. In some use cases, particularly those involving customer-facing processes, these event logs may contain private information. Data protection regulations restrict the use of such event logs for analysis purposes. One way of circumventing these restrictions is to anonymize the event log to the extent that no individual can be singled out using the anonymized log. This paper addresses the problem of anonymizing an event log in order to guarantee that, upon disclosure of the anonymized log, the probability that an attacker may single out any individual represented in the original log, does not increase by more than a threshold. The paper proposes a differentially private disclosure mechanism, which oversamples the cases in the log and adds noise to the timestamps to the extent required to achieve the above privacy guarantee. The paper reports on an empirical evaluation of the proposed approach using 14 real-life event logs in terms of data utility loss and computational efficiency.


title: Privacy-aware Process Performance Indicators: Framework and Release Mechanisms

abstract: Process performance indicators (PPIs) are metrics to quantify the degree with which organizational goals defined based on business processes are fulfilled. They exploit the event logs recorded by information systems during the execution of business processes, thereby providing a basis for process monitoring and subsequent optimization. However, PPIs are often evaluated on processes that involve individuals, which implies an inevitable risk of privacy intrusion. In this paper, we address the demand for privacy protection in the computation of PPIs. We first present a framework that enforces control over the data exploited for process monitoring. We then show how PPIs defined based on the established PPINOT meta-model are instantiated in this framework through a set of data release mechanisms. These mechanisms are designed to provide provable guarantees in terms of differential privacy. We evaluate our framework and the release mechanisms in a series of controlled experiments. We further use a public event log to compare our framework with approaches based on privatization of event logs. The results demonstrate feasibility and shed light on the trade-offs between data utility and privacy guarantees in the computation of PPIs.


title: Proton-electron mass ratio by high-resolution optical spectroscopy of ion ensembles in the resolved-carrier regime

abstract: Optical spectroscopy in the gas phase is a key tool to elucidate the structure of atoms and molecules and of their interaction with external fields. The line resolution is usually limited by a combination of first-order Doppler broadening due to particle thermal motion and of a short transit time through the excitation beam. For trapped particles, suitable laser cooling techniques can lead to strong confinement (Lamb-Dicke regime, LDR) and thus to optical spectroscopy free of these effects. For non-laser coolable spectroscopy ions, this has so far only been achieved when trapping one or two atomic ions, together with a single laser-coolable atomic ion [1,2]. Here we show that one-photon optical spectroscopy free of Doppler and transit broadening can also be obtained with more easily prepared ensembles of ions, if performed with mid-infrared radiation. We demonstrate the method on molecular ions. We trap approximately 100 molecular hydrogen ions (HD$^{+}$) within a Coulomb cluster of a few thousand laser-cooled atomic ions and perform laser spectroscopy of the fundamental vibrational transition. Transition frequencies were determined with lowest uncertainty of 3.3$\times$10$^{-12}$ fractionally. As an application, we determine the proton-electron mass ratio by matching a precise ab initio calculation with the measured vibrational frequency.


title: Autonomous Flight in Unknown GNSS-denied Environments for Disaster Examination

abstract: Micro aerial vehicles (MAVs) have high potential for information gathering tasks to support situation awareness in search and rescue scenarios. Manually controlling MAVs in such scenarios requires experienced pilots and is error-prone, especially in stressful situations of real emergencies. The conditions of disaster scenarios are also challenging for autonomous MAV systems. The environment is usually not known in advance and GNSS might not always be available. We present a system for autonomous MAV flights in unknown environments which does not rely on global positioning systems. The method is evaluated in multiple search and rescue scenarios and allows for safe autonomous flights, even when transitioning between indoor and outdoor areas.


title: Calculation of the ground-state Stark effect in small molecules using the variational quantum eigensolver

abstract: As quantum computing approaches its first commercial implementations, quantum simulation emerges as a potentially ground-breaking technology for several domains, including Biology and Chemistry. However, taking advantage of quantum algorithms in Quantum Chemistry raises a number of theoretical and practical challenges at different levels, from the conception to its actual execution. We go through such challenges in a case study of a quantum simulation for the hydrogen (H2) and lithium hydride (LiH) molecules, at an actual commercially available quantum computer, the IBM Q. The former molecule has always been a playground for testing approximate calculation methods in Quantum Chemistry, while the latter is just a little bit more complex, lacking the mirror symmetry of the former. Using the Variational Quantum Eigensolver (VQE) method, we study the molecule's ground state energy versus interatomic distance, under the action of stationary electric fields (Stark effect). Additionally, we review the necessary calculations of the matrix elements of the second quantization Hamiltonian encompassing the extra terms concerning the action of electric fields, using STO-LG type atomic orbitals to build the minimal basis sets.


title: Large Motion Video Super-Resolution with Dual Subnet and Multi-Stage Communicated Upsampling

abstract: Video super-resolution (VSR) aims at restoring a video in low-resolution (LR) and improving it to higher-resolution (HR). Due to the characteristics of video tasks, it is very important that motion information among frames should be well concerned, summarized and utilized for guidance in a VSR algorithm. Especially, when a video contains large motion, conventional methods easily bring incoherent results or artifacts. In this paper, we propose a novel deep neural network with Dual Subnet and Multi-stage Communicated Upsampling (DSMC) for super-resolution of videos with large motion. We design a new module named U-shaped residual dense network with 3D convolution (U3D-RDN) for fine implicit motion estimation and motion compensation (MEMC) as well as coarse spatial feature extraction. And we present a new Multi-Stage Communicated Upsampling (MSCU) module to make full use of the intermediate results of upsampling for guiding the VSR. Moreover, a novel dual subnet is devised to aid the training of our DSMC, whose dual loss helps to reduce the solution space as well as enhance the generalization ability. Our experimental results confirm that our method achieves superior performance on videos with large motion compared to state-of-the-art methods.


title: On the $D_n$ Spin Vertex Models for Odd $n$

abstract: Solvable vertex models in two dimensions are of importance in conformal field theory, phase transitions and integrable models. We consider here the $D_n$ spin vertex models, for $n$ which is odd. The models involve also the anti--spinor representation. We describe here the Boltzmann weights for these representations using crossing symmetry from the previously known spinor representations. For calculation reasons we limit ourself to the $n=3$ and $n=5$ cases, which are described explicitly.


title: Evolving Continuous Optimisers from Scratch

abstract: This work uses genetic programming to explore the space of continuous optimisers, with the goal of discovering novel ways of doing optimisation. In order to keep the search space broad, the optimisers are evolved from scratch using Push, a Turing-complete, general-purpose, language. The resulting optimisers are found to be diverse, and explore their optimisation landscapes using a variety of interesting, and sometimes unusual, strategies. Significantly, when applied to problems that were not seen during training, many of the evolved optimisers generalise well, and often outperform existing optimisers. This supports the idea that novel and effective forms of optimisation can be discovered in an automated manner. This paper also shows that pools of evolved optimisers can be hybridised to further increase their generality, leading to optimisers that perform robustly over a broad variety of problem types and sizes.


title: Handling Missing Observations with an RNN-based Prediction-Update Cycle

abstract: In tasks such as tracking, time-series data inevitably carry missing observations. While traditional tracking approaches can handle missing observations, recurrent neural networks (RNNs) are designed to receive input data in every step. Furthermore, current solutions for RNNs, like omitting the missing data or data imputation, are not sufficient to account for the resulting increased uncertainty. Towards this end, this paper introduces an RNN-based approach that provides a full temporal filtering cycle for motion state estimation. The Kalman filter inspired approach, enables to deal with missing observations and outliers. For providing a full temporal filtering cycle, a basic RNN is extended to take observations and the associated belief about its accuracy into account for updating the current state. An RNN prediction model, which generates a parametrized distribution to capture the predicted states, is combined with an RNN update model, which relies on the prediction model output and the current observation. By providing the model with masking information, binary-encoded missing events, the model can overcome limitations of standard techniques for dealing with missing input values. The model abilities are demonstrated on synthetic data reflecting prototypical pedestrian tracking scenarios.


title: Forcing the $\Pi^1_n$-Uniformization Property

abstract: We generically construct a model in which the ${\Pi^1_3}$-uniformization property is true, thus lowering the best known consistency strength from the existence of $M_1^{\#}$ to just $\mathsf{ZFC}$. The forcing construction can be adapted to work over canonical inner models with Woodin cardinals, which yields, for the first time, universes where the $\Pi^1_{2n}$-uniformization property holds for $n >1$, thus producing models which contradict the natural $\mathsf{PD}$-induced pattern. It can also be used to obtain models for the $\Pi^1_1$-uniformization property in the generalized Baire space.


title: Simulation comparisons between Bayesian and de-biased estimators in low-rank matrix completion

abstract: In this paper, we study the low-rank matrix completion problem, a class of machine learning problems, that aims at the prediction of missing entries in a partially observed matrix. Such problems appear in several challenging applications such as collaborative filtering, image processing, and genotype imputation. We compare the Bayesian approaches and a recently introduced de-biased estimator which provides a useful way to build confidence intervals of interest. From a theoretical viewpoint, the de-biased estimator comes with a sharp minimax-optimal rate of estimation error whereas the Bayesian approach reaches this rate with an additional logarithmic factor. Our simulation studies show originally interesting results that the de-biased estimator is just as good as the Bayesian estimators. Moreover, Bayesian approaches are much more stable and can outperform the de-biased estimator in the case of small samples. In addition, we also find that the empirical coverage rate of the confidence intervals obtained by the de-biased estimator for an entry is absolutely lower than of the considered credible interval. These results suggest further theoretical studies on the estimation error and the concentration of Bayesian methods as they are quite limited up to present.


title: Catastrophic Forgetting in Deep Graph Networks: an Introductory Benchmark for Graph Classification

abstract: In this work, we study the phenomenon of catastrophic forgetting in the graph representation learning scenario. The primary objective of the analysis is to understand whether classical continual learning techniques for flat and sequential data have a tangible impact on performances when applied to graph data. To do so, we experiment with a structure-agnostic model and a deep graph network in a robust and controlled environment on three different datasets. The benchmark is complemented by an investigation on the effect of structure-preserving regularization techniques on catastrophic forgetting. We find that replay is the most effective strategy in so far, which also benefits the most from the use of regularization. Our findings suggest interesting future research at the intersection of the continual and graph representation learning fields. Finally, we provide researchers with a flexible software framework to reproduce our results and carry out further experiments.


title: Functional Pearl: Witness Me -- Constructive Arguments Must Be Guided with Concrete Witness

abstract: Beloved Curry--Howard correspondence tells that types are intuitionistic propositions, and in constructive math, a proof of proposition can be seen as some kind of a construction, or witness, conveying the information of the proposition. We demonstrate how useful this point of view is as the guiding principle for developing dependently-typed programs.


title: Double electron-positron pair production with two-electron capture in relativistic heavy-ion collisions

abstract: We calculated the cross section of double electron-positron pair production with two-electron capture for the collisions of Pb+Pb ions and we did our calculations at LHC energies. We applied a similar methodology for the calculation of bound-free electron-positron pair production. We used perturbation theory and implemented Monte Carlo integration techniques to calculate the lowest order Feynman diagrams. We also compared our double electron-positron pair production with two-electron capture cross section results obtained in the literature. These calculations may help us to learn more about strong QED.


title: To vote, or not to vote: on the epidemiological impact of electoral campaigns at the time of COVID-19

abstract: Elections are crucial for legitimating modern democracies, and giving all candidates the possibility to run a proper electoral campaign is necessary for elections' success in providing such legitimization. Yet, during a pandemic, the risk that electoral campaigns would enhance the spread of the disease exists and is substantive. In this work, we estimate the causal impact of electoral campaigns on the spread of COVID-19. Exploiting plausibly exogenous variation in the schedule of local elections across Italy, we show that the electoral campaign preceding this latter led to a significant worsening of the epidemiological situation related to the disease. Our results strongly highlight the importance of undertaking stringent measures along the entire electoral process to minimize its epidemiological consequences.


title: Supercriticality of the dynamo limits the memory of the polar field to one cycle

abstract: The polar magnetic field precursor is considered to be the most robust and physics-based method for the prediction of the next solar cycle strength. However, to make a reliable prediction of a cycle, is the polar field at the solar minimum of the previous cycle enough or we need the polar field of many previous cycles? To answer this question, we performed several simulations using Babcock-Leighton type flux transport dynamo models with the stochastically forced source for the poloidal field ($\alpha$ term). We show that when the dynamo is operating near the critical dynamo transition or only weakly supercritical, the polar field of the cycle n determines the amplitude of the next several cycles (at least three). However, when the dynamo is substantially supercritical, this correlation of the polar field is reduced to one cycle. This change in the memory of the polar field from multi- to one-cycle with the increase of the super-criticality of the dynamo is independent of the importance of various turbulent transport processes in the model. We further show that when the dynamo operates near the critical, it produces frequent extended episodes of weaker activity, resembling the solar grand minima. The occurrence of grand minima is accompanied by the multi-cycle correlation of polar field. The frequency of grand minima decreases with the increase of supercriticality of the dynamo.


title: From temporal network data to the dynamics of social relationships

abstract: Networks are well-established representations of social systems, and temporal networks are widely used to study their dynamics. Temporal network data often consist in a succession of static networks over consecutive time windows whose length, however, is arbitrary, not necessarily corresponding to any intrinsic timescale of the system. Moreover, the resulting view of social network evolution is unsatisfactory: short time windows contain little information, whereas aggregating over large time windows blurs the dynamics. Going from a temporal network to a meaningful evolving representation of a social network therefore remains a challenge. Here we introduce a framework to that purpose: transforming temporal network data into an evolving weighted network where the weights of the links between individuals are updated at every interaction. Most importantly, this transformation takes into account the interdependence of social relationships due to the finite attention capacities of individuals: each interaction between two individuals not only reinforces their mutual relationship but also weakens their relationships with others. We study a concrete example of such a transformation and apply it to several data sets of social interactions. Using temporal contact data collected in schools, we show how our framework highlights specificities in their structure and temporal organization. We then introduce a synthetic perturbation into a data set of interactions in a group of baboons to show that it is possible to detect a perturbation in a social group on a wide range of timescales and parameters. Our framework brings new perspectives to the analysis of temporal social networks.


title: Gravitational instability of solar prominence threads I. Curved magnetic fields without dips

abstract: Prominence threads are dense and cold structures lying on curved magnetic fields that can be suspended in the solar atmosphere against gravity. The gravitational stability of threads, in the absence of non-ideal effects, is comprehensively investigated in the present work by means of an elementary but effective model. Based on purely hydrodynamic equations in one spatial dimension and applying line-tying conditions at the footpoints of the magnetic field lines, we derive analytical expressions for the different feasible equilibria and the corresponding frequencies of oscillation. We find that the system allows for stable and unstable equilibrium solutions subject to the initial position of the thread, its density contrast and length, and the total length of the magnetic field lines. The transition between the two types of solutions is produced at specific bifurcation points that have been determined analytically in some particular cases. When the thread is initially at the top of the concave magnetic field, that is at the apex, we find a supercritical pitchfork bifurcation, while for a shifted initial thread position with respect to this point the symmetry is broken and the system is characterised by an S-shaped bifurcation. The plain results presented in this paper shed new light on the behaviour of threads in curved magnetic fields under the presence of gravity and help to interpret more complex numerical magnetohydrodynamics (MHD) simulations about similar structures.


title: Examining the Modeling Framework of Crime Hotspot Models in Predictive Policing

abstract: Predictive policing has its roots in crime hotspot modeling. In this paper we give an example of what goes into mathematical crime hot spot modeling and show that the modeling assumptions perpetuate systemic racism in policing. The goal of this paper is to raise objections to this field of research, not on its mathematical merit, but on the scope of the problem formation.


title: Modifying the service patterns of public transport vehicles to account for the COVID-19 capacity

abstract: As public transport operators try to resume their services, they have to operate under reduced capacities due to COVID-19. Because demand can exceed capacity at different areas and across different times of the day, drivers have to refuse passenger boardings at specific stops. Towards this goal, many public transport operators have modified their service routes by avoiding to serve stops with high passenger demand at specific times of the day. Given the urgent need to develop decision support tools that can prevent the overcrowding of vehicles, this study introduces a dynamic integer nonlinear program that proposes service patterns to individual vehicles that are ready to be dispatched. In addition to the objective of satisfying the imposed vehicle capacity due to COVID-19, the proposed service pattern model caters for the waiting time of passengers. Our model is tested in a bus line connecting the university of Twente with its surrounding cities demonstrating the improvement in terms of vehicle overcrowding, and analyzing the potential negative effects related to unserved passenger demand and excessive waiting times.


title: On how generalised entropies without parameters impact information optimisation processes

abstract: As an application of generalised statistical mechanics, it is studied a possible route toward a consistent generalised information theory in terms of a family of non-extensive, non-parametric entropies $H^\pm_D(P)$. Unlike other proposals based on non-extensive entropies with a parameter dependence, our scheme is asymptotically equivalent to the one formulated by Shannon, while it differs in regions where the density of states is reasonably small, which leads to information distributions constrained to their background. Two basic concepts are discussed to this aim. First, we prove two effective coding theorems for the entropies $H^\pm_D(P)$. Then we calculate the channel capacity of a binary symmetric channel (BSC) and a binary erasure channel (BEC) in terms of these entropies. We found that processes such as data compression and channel capacity maximisation can be improved in regions where there is a low density of states, whereas for high densities our results coincide with Shannon's formulation.


title: End-to-end Precoding Validation over a Live GEO Satellite Forward Link

abstract: In this paper we demonstrate end-to-end precoded multi-user multiple-input single-output (MU-MISO) communications over a live GEO satellite link. Precoded communications enable full frequency reuse (FFR) schemes in satellite communications (SATCOM) to achieve broader service availability and higher spectrum efficiency than with the conventional four-color (4CR) and two-color (2CR) reuse approaches. In this scope, we develop an over-the-air test-bed for end-to-end precoding validations. We use an actual multi-beam satellite to transmit and receive precoded signals using the DVB-S2X standard based gateway and user terminals. The developed system is capable of end-to-end real-time communications over the satellite link including channel measurements and precompensation. It is shown, that by successfully canceling inter-user interference in the actual satellite FFR link precoding brings gains in terms of enhanced SINR and increased system goodput.


title: Extracting Semantic Process Information from the Natural Language in Event Logs

abstract: Process mining focuses on the analysis of recorded event data in order to gain insights about the true execution of business processes. While foundational process mining techniques treat such data as sequences of abstract events, more advanced techniques depend on the availability of specific kinds of information, such as resources in organizational mining and business objects in artifact-centric analysis. However, this information is generally not readily available, but rather associated with events in an ad hoc manner, often even as part of unstructured textual attributes. Given the size and complexity of event logs, this calls for automated support to extract such process information and, thereby, enable advanced process mining techniques. In this paper, we present an approach that achieves this through so-called semantic role labeling of event data. We combine the analysis of textual attribute values, based on a state-of-the-art language model, with a novel attribute classification technique. In this manner, our approach extracts information about up to eight semantic roles per event. We demonstrate the approach's efficacy through a quantitative evaluation using a broad range of event logs and demonstrate the usefulness of the extracted information in a case study.


title: Complexity-based permutation entropies: from deterministic time series to white noise

abstract: This is a paper in the intersection of time series analysis and complexity theory that presents new results on permutation complexity in general and permutation entropy in particular. In this context, permutation complexity refers to the characterization of time series by means of ordinal patterns (permutations), entropic measures, decay rates of missing ordinal patterns, and more. Since the inception of this \textquotedblleft ordinal\textquotedblright\ methodology, its practical application to any type of scalar time series and real-valued processes have proven to be simple and useful. However, the theoretical aspects have remained limited to noiseless deterministic series and dynamical systems, the main obstacle being the super-exponential growth of visible permutations with length when randomness (also in form of observational noise) is present in the data. To overcome this difficulty, we take a new approach through complexity classes, which are precisely defined by the growth of visible permutations with length, regardless of the deterministic or noisy nature of the data. We consider three major classes: exponential, sub-factorial and factorial. The next step is to adapt the concept of Z-entropy to each of those classes, which we call permutation entropy because it coincides with the conventional permutation entropy on the exponential class. Z-entropies are a family of group entropies, each of them extensive on a given complexity class. The result is a unified approach to the ordinal analysis of deterministic and random processes, from dynamical systems to white noise, with new concepts and tools. Numerical simulations show that permutation entropy discriminates time series from all complexity classes.


title: Design and Performance Analysis of a Chaotic Pseudo Orthogonal Carriers Multi-Access Communication System

abstract: A Chaotic Pseudo Orthogonal Carriers Multi-Access (CPOCMA) communication based on Chaotic Pseudo Orthogonal Shape-forming Filter (CPOSF) bank, Chaotic Pseudo Orthogonal Matched Filter (CPOMF) bank and Chaotic Pseudo Orthogonal Correlation Filter (CPOCF) bank is proposed in this work. At the transmitter, the multiple CPOSFs are used to generate pseudo orthogonal signals. It provides a good trade-off between spectrum efficiency and high bit transmission rate. At the receiver, the CPOMF bank and CPOCF bank are used to maximize the Signal-to-Noise Ratio (SNR) and extract the received information from each sub-channel, respectively. The received signal is demodulated by averaging the sampled sequence from the matched filter bank output and sorting the sampling sequence from the CPOCF bank output to recover the transmitted information bits. The proposed CPOCMA communication system not only offers multiuser access with high reliability and high data transmission rate, but also achieves higher spectrum efficiency. Analytical Bit Error Rate (BER) expression is derived. The proposed communication system performance has been evaluated in Additive White Gaussian Noise (AWGN) channel and wireless channel by both numerical simulations and experiments based on a Wireless open-Access Research Platform (WARP), the results show the effectiveness and the superiority of the proposed method.


title: Transfer learning from High-Resource to Low-Resource Language Improves Speech Affect Recognition Classification Accuracy

abstract: Speech Affect Recognition is a problem of extracting emotional affects from audio data. Low resource languages corpora are rear and affect recognition is a difficult task in cross-corpus settings. We present an approach in which the model is trained on high resource language and fine-tune to recognize affects in low resource language. We train the model in same corpus setting on SAVEE, EMOVO, Urdu, and IEMOCAP by achieving baseline accuracy of 60.45, 68.05, 80.34, and 56.58 percent respectively. For capturing the diversity of affects in languages cross-corpus evaluations are discussed in detail. We find that accuracy improves by adding the domain target data into the training data. Finally, we show that performance is improved for low resource language speech affect recognition by achieving the UAR OF 69.32 and 68.2 for Urdu and Italian speech affects.


title: A General and Configurable Framework for Blockchain-based Marketplaces

abstract: The first generation of blockchain focused on digital currencies and secure storage, management and transfer of tokenized values. Thereafter, the focus has been shifting from currencies to a broader application space. In this paper, we systematically explore marketplace types and properties, and consider the mechanisms required to support those properties through blockchain. We propose a generic and configurable framework for blockchain-based marketplaces, and describe how popular marketplace types, price discovery policies, and other configuration parameters are implemented within the framework by presenting concrete event-based algorithms. Finally, we consider three use cases with widely diverging properties and show how the proposed framework supports them.


title: Fixes That Fail: Self-Defeating Improvements in Machine-Learning Systems

abstract: Machine-learning systems such as self-driving cars or virtual assistants are composed of a large number of machine-learning models that recognize image content, transcribe speech, analyze natural language, infer preferences, rank options, etc. Models in these systems are often developed and trained independently, which raises an obvious concern: Can improving a machine-learning model make the overall system worse? We answer this question affirmatively by showing that improving a model can deteriorate the performance of downstream models, even after those downstream models are retrained. Such self-defeating improvements are the result of entanglement between the models in the system. We perform an error decomposition of systems with multiple machine-learning models, which sheds light on the types of errors that can lead to self-defeating improvements. We also present the results of experiments which show that self-defeating improvements emerge in a realistic stereo-based detection system for cars and pedestrians.


title: Some variations on an extension of Caratheodory's normality criterion

abstract: In this note we give some variations on an extension of Caratheodory's normality criterion due to Grahl and Nevo.


title: Interplay between charge density wave and superconductivity in multi-band systems with inter-band Coulomb interaction

abstract: In this work we study the competition or coexistence between charge density wave (CDW) and superconductivity (SC) in a two-band model system in a square lattice. One of the bands has a net attractive interaction ($J_d$) that is responsible for SC. The model includes on-site Coulomb repulsion between quasi-particles in different bands ($U_{dc}$) and the hybridization ($V$) between them. We are interested in describing inter-metallic systems with a $d$-band of moderately correlated electrons, for which a mean-field approximation is adequate, coexisting with a large $sp$-band. For simplicity, all interactions and the hybridization $V$ are considered site-independent. We obtain the eigenvalues of the Hamiltonian numerically and minimize the free energy density with respect to the relevant parameters to obtain the phase diagrams as function of $J_d$, $U_{dc}$, $V$, composition ($n_{\mathrm{tot}}$) and the relative depth of the bands ($\epsilon_{d0}$). We consider two types of superconducting ground states coexisting with the CDW. One is a homogeneous ground state and the other is a pair density wave where the SC order parameter has the same spatial modulation of the CDW. Our results show that the CDW and SC orders compete, but depending on the parameters of the model these phases may coexist. The model reproduces most of the experimental features of high dimensionality ($d>1$) metals with competing CDW and SC states, including the existence of first and second-order phase transitions in their phase diagrams.


title: Test of lepton universality in beauty-quark decays

abstract: The Standard Model of particle physics currently provides our best description of fundamental particles and their interactions. The theory predicts that the different charged leptons, the electron, muon and tau, have identical electroweak interaction strengths. Previous measurements have shown a wide range of particle decays are consistent with this principle of lepton universality. This article presents evidence for the breaking of lepton universality in beauty-quark decays, with a significance of 3.1 standard deviations, based on proton-proton collision data collected with the LHCb detector at CERN's Large Hadron Collider. The measurements are of processes in which a beauty meson transforms into a strange meson with the emission of either an electron and a positron, or a muon and an antimuon. If confirmed by future measurements, this violation of lepton universality would imply physics beyond the Standard Model, such as a new fundamental interaction between quarks and leptons.


title: AdaSGN: Adapting Joint Number and Model Size for Efficient Skeleton-Based Action Recognition

abstract: Existing methods for skeleton-based action recognition mainly focus on improving the recognition accuracy, whereas the efficiency of the model is rarely considered. Recently, there are some works trying to speed up the skeleton modeling by designing light-weight modules. However, in addition to the model size, the amount of the data involved in the calculation is also an important factor for the running speed, especially for the skeleton data where most of the joints are redundant or non-informative to identify a specific skeleton. Besides, previous works usually employ one fix-sized model for all the samples regardless of the difficulty of recognition, which wastes computations for easy samples. To address these limitations, a novel approach, called AdaSGN, is proposed in this paper, which can reduce the computational cost of the inference process by adaptively controlling the input number of the joints of the skeleton on-the-fly. Moreover, it can also adaptively select the optimal model size for each sample to achieve a better trade-off between accuracy and efficiency. We conduct extensive experiments on three challenging datasets, namely, NTU-60, NTU-120 and SHREC, to verify the superiority of the proposed approach, where AdaSGN achieves comparable or even higher performance with much lower GFLOPs compared with the baseline method.


title: Unambiguously Resolving the Potential Neutrino Magnetic Moment Signal at Large Liquid Scintillator Detectors

abstract: Non-vanishing electromagnetic properties of the neutrinos have been predicted by many theories beyond the Standard Model, and an enhanced neutrino magnetic moment can have profound implications for fundamental physics. The XENON1T experiment recently detected an excess of electron recoil events in the 1-7 keV energy range, which can be compatible with solar neutrino magnetic moment interaction at a most probable value of $\mu_{\nu} = 2.1 \times 10^{-11} \mu_{\text{B}}$. However, tritium backgrounds and solar axion interaction in this energy window are equally plausible causes. Upcoming multi-tonne noble liquid detectors will test these scenarios more in depth, but will continue to face similar ambiguity. We report a unique capability of future large liquid scintillator detectors to help resolve the potential neutrino magnetic moment scenario. With a liquid scintillator exposure of $O$(100) kton$\cdot$year, a sensitivity of $\mu_{\nu} < 10^{-11} \mu_{\text{B}}$ can be reached at an energy threshold greater than 40 keV, where no tritium or solar axion events but only neutrino magnetic moment signal is still present.


title: The black hole of logistics costs of digitizing commodity money

abstract: In this paper, we reveal the depreciation mechanism of representative money (banknotes) from the perspective of logistics warehousing costs. Although it has long been the dream of economists to stabilize the buying power of the monetary units, the goal we have honest money always broken since the central bank depreciate the currency without limit. From the point of view of modern logistics, the key functions of money are the store of value and low logistics (circulation and warehouse) cost. Although commodity money (such as gold and silver) has the advantages of a wealth store, its disadvantage is the high logistics cost. In comparison to commodity money, credit currency and digital currency cannot protect wealth from loss over a long period while their logistics costs are negligible. We proved that there is not such honest money from the perspective of logistics costs, which is both the store of value like precious metal and without logistics costs in circulation like digital currency. The reason hidden in the back of the depreciation of banknotes is the black hole of storage charge of the anchor overtime after digitizing commodity money. Accordingly, it is not difficult to infer the inevitable collapse of the Bretton woods system. Therefore, we introduce a brand-new currency named honest devalued stable-coin and built a attenuation model of intrinsic value of the honest money based on the change mechanism of storage cost of anchor assets, like gold, which will lay the theoretical foundation for a stable monetary system.


title: Computationally Efficient Learning of Statistical Manifolds

abstract: Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of probability distributions rather than vector-valued variables are available or when data size is large. We resolve this problem by proposing a new method for approximation in statistical manifold learning. The novelty of our approximation is the strongly consistent distance estimators based on independent and identically distributed samples from probability distributions. By exploiting the connection between Hellinger/total variation distance for discrete distributions and the L2/L1 norm, we demonstrate that the proposed distance estimators, combined with approximate nearest neighbor searching, could largely improve the computational efficiency with little to no loss in the accuracy of manifold embedding. The result is robust to different manifold learning algorithms and different approximate nearest neighbor algorithms. The proposed method is applied to learning statistical manifolds of electricity usage. This application demonstrates how underlying structures in high dimensional data, including anomalies, can be visualized and identified, in a way that is scalable to large datasets.


abstract: Anomaly and outlier detection is a long-standing problem in machine learning. In some cases, anomaly detection is easy, such as when data are drawn from well-characterized distributions such as the Gaussian. However, when data occupy high-dimensional spaces, anomaly detection becomes more difficult. We present CLAM (Clustered Learning of Approximate Manifolds), a manifold mapping technique in any metric space. CLAM begins with a fast hierarchical clustering technique and then induces a graph from the cluster tree, based on overlapping clusters as selected using several geometric and topological features. Using these graphs, we implement CHAODA (Clustered Hierarchical Anomaly and Outlier Detection Algorithms), exploring various properties of the graphs and their constituent clusters to find outliers. CHAODA employs a form of transfer learning based on a training set of datasets, and applies this knowledge to a separate test set of datasets of different cardinalities, dimensionalities, and domains. On 24 publicly available datasets, we compare CHAODA (by measure of ROC AUC) to a variety of state-of-the-art unsupervised anomaly-detection algorithms. Six of the datasets are used for training. CHAODA outperforms other approaches on 16 of the remaining 18 datasets. CLAM and CHAODA scale to large, high-dimensional "big data" anomaly-detection problems, and generalize across datasets and distance functions. Source code to CLAM and CHAODA are freely available on GitHub at https://github.com/URI-ABD/clam.


title: Measuring and modeling the motor system with machine learning

abstract: The utility of machine learning in understanding the motor system is promising a revolution in how to collect, measure, and analyze data. The field of movement science already elegantly incorporates theory and engineering principles to guide experimental work, and in this review we discuss the growing use of machine learning: from pose estimation, kinematic analyses, dimensionality reduction, and closed-loop feedback, to its use in understanding neural correlates and untangling sensorimotor systems. We also give our perspective on new avenues where markerless motion capture combined with biomechanical modeling and neural networks could be a new platform for hypothesis-driven research.


title: Reforecasting two heavy-precipitation events with three convection-permitting ensembles

abstract: We investigate the potential added value of running three limited-area ensemble systems (with the WRF, Meso-NH and MOLOCH models and a grid spacing of approximately 2.5 km) for two heavy-precipitation events in Italy. Such high-resolution ensembles include an explicit treatment of convective processes and dynamically downscale the ECMWF global data, which have a grid spacing of approximately 18 km. The predictions are verified against rain-gauge data and their accuracy is evaluated over that of the driving coarser-resolution ensemble system. Furthermore, we compare the simulation speed (defined as the ratio of simulation length to wall-clock time) of the three limited-area models to estimate the computational effort for operational convection-permitting ensemble forecasting. We also study how the simulation wall-clock time scales with increasing numbers of computing elements (from 36 to 1152 cores). Objective verification methods generally show that convection-permitting forecasts outperform global forecasts for both events, although precipitation peaks remain largely underestimated for one of the two events. Comparing simulation speeds, the MOLOCH model is the fastest and the Meso-NH is the slowest one. The WRF model attains efficient scalability, whereas it is limited for the Meso-NH and MOLOCH models when using more than 288 cores. We finally demonstrate how the model simulation speed has the largest impact on a joint evaluation with the model performance because the accuracy of the three limited-area ensembles, amplifying the forecasting capability of the global predictions, does not differ substantially.


title: Automated Issue Assignment: Results and Insights from an Industrial Case

abstract: Softtech, being a subsidiary of the largest private bank in Turkey, called IsBank, receives an average of 350 issue reports from the field every day. Manually assigning the reported issues to the software development teams is costly and cumbersome. We automate the issue assignments using data mining approaches and share our experience gained by deploying the resulting system at Softtech/IsBank. Automated issue assignment has been studied in the literature. However, most of these works report the results obtained on open source projects and the remaining few, although they use commercial, closed source projects, carry out the assignments in a retrospective manner. We, on the other hand, deploy the proposed approach, which has been making all the assignments since Jan 12, 2018. This presents us with an unprecedented opportunity to observe the practical effects of automated issue assignment in the field and to carry out user studies, which have not been done before in this context. We observe that it is not just about deploying a system for automated issue assignment, but also about designing/changing the assignment process around the system; the accuracy of the assignments does not have to be higher than that of manual assignments in order for the system to be useful; deploying such a system requires the development of additional functionalities, such as detecting deteriorations in assignment accuracies in an online manner and creating human-readable explanations for the assignments; stakeholders do not necessarily resist change; and gradual transition can help stakeholders build confidence.


title: A Total-Variation Sparseness-Promoting Method for the Synthesis of Contiguously Clustered Linear Arrays

abstract: By exploiting an innovative total-variation compressive sensing (TV-CS) formulation, a new method for the synthesis of physically contiguous clustered linear arrays is presented. The computation of the feed network excitations is recast as the maximization of the gradient sparsity of the excitation vector subject to matching a user-defined pattern. The arising TV-CS functional is then optimized by means of a deterministic alternating direction algorithm. A selected set of representative numerical results, drawn from a wide validation, is reported to illustrate the potentialities and the limitations of the proposed approach when clustering arrays of both ideal and realistic antenna elements. Comparisons with some competitive state-of-the-art subarraying techniques are performed as well.


title: Evaluating a bot detection model on git commit messages

abstract: Detecting the presence of bots in distributed software development activity is very important in order to prevent bias in large-scale socio-technical empirical analyses. In previous work, we proposed a classification model to detect bots in GitHub repositories based on the pull request and issue comments of GitHub accounts. The current study generalises the approach to git contributors based on their commit messages. We train and evaluate the classification model on a large dataset of 6,922 git contributors. The original model based on pull request and issue comments obtained a precision of 0.77 on this dataset. Retraining the classification model on git commit messages increased the precision to 0.80. As a proof-of-concept, we implemented this model in BoDeGiC, an open source command-line tool to detect bots in git repositories.


title: Autoregressive Belief Propagation for Decoding Block Codes

abstract: We revisit recent methods that employ graph neural networks for decoding error correcting codes and employ messages that are computed in an autoregressive manner. The outgoing messages of the variable nodes are conditioned not only on the incoming messages, but also on an estimation of the SNR and on the inferred codeword and on two downstream computations: (i) an extended vector of parity check outcomes, (ii) the mismatch between the inferred codeword and the re-encoding of the information bits of this codeword. Unlike most learned methods in the field, our method violates the symmetry conditions that enable the other methods to train exclusively with the zero-word. Despite not having the luxury of training on a single word, and the inability to train on more than a small fraction of the relevant sample space, we demonstrate effective training. The new method obtains a bit error rate that outperforms the latest methods by a sizable margin.


title: Dynamic Metric Learning: Towards a Scalable Metric Space to Accommodate Multiple Semantic Scales

abstract: This paper introduces a new fundamental characteristic, \ie, the dynamic range, from real-world metric tools to deep visual recognition. In metrology, the dynamic range is a basic quality of a metric tool, indicating its flexibility to accommodate various scales. Larger dynamic range offers higher flexibility. In visual recognition, the multiple scale problem also exist. Different visual concepts may have different semantic scales. For example, ``Animal'' and ``Plants'' have a large semantic scale while ``Elk'' has a much smaller one. Under a small semantic scale, two different elks may look quite \emph{different} to each other . However, under a large semantic scale (\eg, animals and plants), these two elks should be measured as being \emph{similar}. %We argue that such flexibility is also important for deep metric learning, because different visual concepts indeed correspond to different semantic scales. Introducing the dynamic range to deep metric learning, we get a novel computer vision task, \ie, the Dynamic Metric Learning. It aims to learn a scalable metric space to accommodate visual concepts across multiple semantic scales. Based on three types of images, \emph{i.e.}, vehicle, animal and online products, we construct three datasets for Dynamic Metric Learning. We benchmark these datasets with popular deep metric learning methods and find Dynamic Metric Learning to be very challenging. The major difficulty lies in a conflict between different scales: the discriminative ability under a small scale usually compromises the discriminative ability under a large one, and vice versa. As a minor contribution, we propose Cross-Scale Learning (CSL) to alleviate such conflict. We show that CSL consistently improves the baseline on all the three datasets. The datasets and the code will be publicly available at https://github.com/SupetZYK/DynamicMetricLearning.


title: Reinforcement Learning Assisted Beamforming for Inter-cell Interference Mitigation in 5G Massive MIMO Networks

abstract: Beamforming is an essential technology in the 5G massive multiple-input-multiple-output (MMIMO) communications, which are subject to many impairments due to the nature of wireless transmission channel, i.e. the air. The inter-cell interference (ICI) is one of the main impairments faced by 5G communications due to frequency-reuse technologies. In this paper, we propose a reinforcement learning (RL) assisted full dynamic beamforming for ICI mitigation in 5G downlink. The proposed algorithm is a joint of beamforming and full dynamic Q-learning technology to minimize the ICI, and results in a low-complexity method without channel estimation. Performance analysis shows the quality of service improvement in terms of signal-to-interference-plus-noise-ratio (SINR) and computational complexity compared to other algorithms.


title: Various variational approximations of quantum dynamics

abstract: We investigate variational principles for the approximation of quantum dynamics that apply for approximation manifolds that do not have complex linear tangent spaces. The first one, dating back to McLachlan (1964) minimizes the residuum of the time-dependent Schr\"odinger equation, while the second one, originating from the lecture notes of Kramer--Saraceno (1981), imposes the stationarity of an action functional. We characterize both principles in terms of metric and a symplectic orthogonality conditions, consider their conservation properties, and derive an elementary a-posteriori error estimate. As an application, we revisit the time-dependent Hartree approximation and frozen Gaussian wave packets.


title: Towards Ultra-Resolution Neural Style Transfer via Thumbnail Instance Normalization

abstract: We present an extremely simple Ultra-Resolution Style Transfer framework, termed URST, to flexibly process arbitrary high-resolution images (e.g., 10000x10000 pixels) style transfer for the first time. Most of the existing state-of-the-art methods would fall short due to massive memory cost and small stroke size when processing ultra-high resolution images. URST completely avoids the memory problem caused by ultra-high resolution images by (1) dividing the image into small patches and (2) performing patch-wise style transfer with a novel Thumbnail Instance Normalization (TIN). Specifically, TIN can extract thumbnail features' normalization statistics and apply them to small patches, ensuring the style consistency among different patches. Overall, the URST framework has three merits compared to prior arts. (1) We divide input image into small patches and adopt TIN, successfully transferring image style with arbitrary high-resolution. (2) Experiments show that our URST surpasses existing SOTA methods on ultra-high resolution images benefiting from the effectiveness of the proposed stroke perceptual loss in enlarging the stroke size. (3) Our URST can be easily plugged into most existing style transfer methods and directly improve their performance even without training. Code is available at https://git.io/URST.


title: Entangled q-Convolutional Neural Nets

abstract: We introduce a machine learning model, the q-CNN model, sharing key features with convolutional neural networks and admitting a tensor network description. As examples, we apply q-CNN to the MNIST and Fashion MNIST classification tasks. We explain how the network associates a quantum state to each classification label, and study the entanglement structure of these network states. In both our experiments on the MNIST and Fashion-MNIST datasets, we observe a distinct increase in both the left/right as well as the up/down bipartition entanglement entropy during training as the network learns the fine features of the data. More generally, we observe a universal negative correlation between the value of the entanglement entropy and the value of the cost function, suggesting that the network needs to learn the entanglement structure in order the perform the task accurately. This supports the possibility of exploiting the entanglement structure as a guide to design the machine learning algorithm suitable for given tasks.


title: JPS-daprinfo: A Dataset for Japanese Dialog Act Analysis and People-related Information Detection

abstract: We conducted a labeling work on a spoken Japanese dataset (I-JAS) for the text classification, which contains 50 interview dialogues of two-way Japanese conversation that discuss the participants' past present and future. Each dialogue is 30 minutes long. From this dataset, we selected the interview dialogues of native Japanese speakers as the samples. Given the dataset, we annotated sentences with 13 labels. The labeling work was conducted by native Japanese speakers who have experiences with data annotation. The total amount of the annotated samples is 20130.


title: Competitive Perimeter Defense on a Line

abstract: We consider a perimeter defense problem in which a single vehicle seeks to defend a compact region from intruders in a one-dimensional environment parameterized by the perimeter size and the intruder-to-vehicle speed ratio. The intruders move inward with fixed speed and direction to reach the perimeter. We provide both positive and negative worst-case performance results over the parameter space using competitive analysis. We first establish fundamental limits by identifying the most difficult parameter combinations that admit no $c$-competitive algorithms for any constant $c\geq 1$ and slightly easier parameter combinations in which every algorithm is at best $2$-competitive. We then design three classes of algorithms and prove they are $1$, $2$, and $4$-competitive, respectively, for increasingly difficult parameter combinations. Finally, we present numerical studies that provide insights into the performance of these algorithms against stochastically generated intruders.


title: Testing gravity of a disformal Kerr black hole in quadratic degenerate higher-order scalar-tensor theories by quasi-periodic oscillations

abstract: By using the relativistic precession model, we have studied frequencies of quasi-periodic oscillations in the spacetime of a disformal Kerr black hole. This black hole owns an extra disformal parameter and belongs to a class of non-stealth solutions in quadratic degenerate higher-order scalar-tensor (DHOST) theories. Our result shows that only the periastron precession frequency is related to the disformal parameter, while the azimuthal frequency and the nodal precession frequency are identical with those in the usual Kerr black hole in general relativity. Combing with the observation data of GRO J1655-40, we fit parameters of the disformal Kerr black hole, and find that the disformal parameter $\alpha$ is almost negative in the range of $1 \sigma$, which implies the negative disformal parameter $\alpha$ is favored by the observation data of GRO J1655-40.


title: Time-Domain Hybrid PAM for Data-Rate and Distance Adaptive UWOC System

abstract: The challenge for next-generation underwater optical wireless communication systems is to develop optical transceivers that can operate with low power consumption by maximizing the transmission capacity according to the transmission distance between transmitters and receivers. This study proposes an underwater wireless optical communication (UWOC) system using an optical transceiver with an optimum transmission rate for the deep sea with near-pure water properties. As a method for actualizing an optical transceiver with an optimum transmission rate in a UWOC system, time-domain hybrid pulse amplitude modulation (PAM) (TDHP) using a transmission rate and distance-adaptive intensity modulation/direct detection optical transceiver is considered. In the TDHP method, variable transmission capacity is actualized while changing the generation ratio of two intensity-modulated signals with different noise immunities in the time domain. Three different color laser diodes (LDs), red, blue, and green are used in an underwater channel transmission transceiver that comprises the LD and a photodiode. The maximum transmission distance while changing the incidence of PAM 2 and PAM 4 signals that calibrate the TDHP in a pure transmission line and how the maximum transmission distance changes when the optical transmitter/receiver spatial optical system is altered from the optimum conditions are clarified based on numerical calculation and simulation. To the best knowledge of the authors, there is no other research on data-rate and distance adaptive UWOC system that applies the TDHP signal with power optimization between two modulation formats.


title: Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do

abstract: Artificial writing is permeating our lives due to recent advances in large-scale, transformer-based language models (LMs) such as BERT, its variants, GPT-2/3, and others. Using them as pre-trained models and fine-tuning them for specific tasks, researchers have extended state of the art for many NLP tasks and shown that they capture not only linguistic knowledge but also retain general knowledge implicitly present in the data. Unfortunately, LMs trained on unfiltered text corpora suffer from degenerated and biased behaviour. While this is well established, we show that recent LMs also contain human-like biases of what is right and wrong to do, some form of ethical and moral norms of the society -- they bring a "moral direction" to surface. That is, we show that these norms can be captured geometrically by a direction, which can be computed, e.g., by a PCA, in the embedding space, reflecting well the agreement of phrases to social norms implicitly expressed in the training texts and providing a path for attenuating or even preventing toxic degeneration in LMs. Being able to rate the (non-)normativity of arbitrary phrases without explicitly training the LM for this task, we demonstrate the capabilities of the "moral direction" for guiding (even other) LMs towards producing normative text and showcase it on RealToxicityPrompts testbed, preventing the neural toxic degeneration in GPT-2.


title: Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks

abstract: A novel framework of intelligent reflecting surface (IRS)-aided multiple-input single-output (MISO) non-orthogonal multiple access (NOMA) network is proposed, where a base station (BS) serves multiple clusters with unfixed number of users in each cluster. The goal is to maximize the sum rate of all users by jointly optimizing the passive beamforming vector at the IRS, decoding order, power allocation coefficient vector and number of clusters, subject to the rate requirements of users. In order to tackle the formulated problem, a three-step approach is proposed. More particularly, a long short-term memory (LSTM) based algorithm is first adopted for predicting the mobility of users. Secondly, a K-means based Gaussian mixture model (K-GMM) algorithm is proposed for user clustering. Thirdly, a deep Q-network (DQN) based algorithm is invoked for jointly determining the phase shift matrix and power allocation policy. Simulation results are provided for demonstrating that the proposed algorithm outperforms the benchmarks, while the throughput gain of 35% can be achieved by invoking NOMA technique instead of orthogonal multiple access (OMA).


title: Comparing the Performance of NLP Toolkits and Evaluation measures in Legal Tech

abstract: Recent developments in Natural Language Processing have led to the introduction of state-of-the-art Neural Language Models, enabled with unsupervised transferable learning, using different pretraining objectives. While these models achieve excellent results on the downstream NLP tasks, various domain adaptation techniques can improve their performance on domain-specific tasks. We compare and analyze the pretrained Neural Language Models, XLNet (autoregressive), and BERT (autoencoder) on the Legal Tasks. Results show that XLNet Model performs better on our Sequence Classification task of Legal Opinions Classification, whereas BERT produces better results on the NER task. We use domain-specific pretraining and additional legal vocabulary to adapt BERT Model further to the Legal Domain. We prepared multiple variants of the BERT Model, using both methods and their combination. Comparing our variants of the BERT Model, specializing in the Legal Domain, we conclude that both additional pretraining and vocabulary techniques enhance the BERT model's performance on the Legal Opinions Classification task. Additional legal vocabulary improves BERT's performance on the NER task. Combining the pretraining and vocabulary techniques further improves the final results. Our Legal-Vocab-BERT Model gives the best results on the Legal Opinions Task, outperforming the larger pretrained general Language Models, i.e., BERT-Base and XLNet-Base.


title: DeepOPF-V: Solving AC-OPF Problems Efficiently

abstract: AC optimal power flow (AC-OPF) problems need to be solved more frequently in the future to maintain stable and economic power system operation. To tackle this challenge, a deep neural network-based voltage-constrained approach (DeepOPF-V) is proposed to solve AC-OPF problems with high computational efficiency. Its unique design predicts voltages of all buses and then uses them to reconstruct the remaining variables without solving non-linear AC power flow equations. A fast post-processing process is developed to enforce the box constraints. The effectiveness of DeepOPF-V is validated by simulations on IEEE 118/300-bus systems and a 2000-bus test system. Compared with existing studies, DeepOPF-V achieves decent computation speedup up to four orders of magnitude and comparable performance in optimality gap and preserving the feasibility of the solution.


title: Graph Ensemble Learning over Multiple Dependency Trees for Aspect-level Sentiment Classification

abstract: Recent work on aspect-level sentiment classification has demonstrated the efficacy of incorporating syntactic structures such as dependency trees with graph neural networks(GNN), but these approaches are usually vulnerable to parsing errors. To better leverage syntactic information in the face of unavoidable errors, we propose a simple yet effective graph ensemble technique, GraphMerge, to make use of the predictions from differ-ent parsers. Instead of assigning one set of model parameters to each dependency tree, we first combine the dependency relations from different parses before applying GNNs over the resulting graph. This allows GNN mod-els to be robust to parse errors at no additional computational cost, and helps avoid overparameterization and overfitting from GNN layer stacking by introducing more connectivity into the ensemble graph. Our experiments on the SemEval 2014 Task 4 and ACL 14 Twitter datasets show that our GraphMerge model not only outperforms models with single dependency tree, but also beats other ensemble mod-els without adding model parameters.


title: Simpson's Bias in NLP Training

abstract: In most machine learning tasks, we evaluate a model $M$ on a given data population $S$ by measuring a population-level metric $F(S;M)$. Examples of such evaluation metric $F$ include precision/recall for (binary) recognition, the F1 score for multi-class classification, and the BLEU metric for language generation. On the other hand, the model $M$ is trained by optimizing a sample-level loss $G(S_t;M)$ at each learning step $t$, where $S_t$ is a subset of $S$ (a.k.a. the mini-batch). Popular choices of $G$ include cross-entropy loss, the Dice loss, and sentence-level BLEU scores. A fundamental assumption behind this paradigm is that the mean value of the sample-level loss $G$, if averaged over all possible samples, should effectively represent the population-level metric $F$ of the task, such as, that $\mathbb{E}[ G(S_t;M) ] \approx F(S;M)$. In this paper, we systematically investigate the above assumption in several NLP tasks. We show, both theoretically and experimentally, that some popular designs of the sample-level loss $G$ may be inconsistent with the true population-level metric $F$ of the task, so that models trained to optimize the former can be substantially sub-optimal to the latter, a phenomenon we call it, Simpson's bias, due to its deep connections with the classic paradox known as Simpson's reversal paradox in statistics and social sciences.


title: Nodeless superconductivity in the kagome metal CsV$_3$Sb$_5$

abstract: The recently discovered kagome metal series $A$V$_3$Sb$_5$ ($A$=K, Rb, Cs) exhibits topologically nontrivial band structures, chiral charge order and superconductivity, presenting a unique platform for realizing exotic electronic states. The nature of the superconducting state and the corresponding pairing symmetry are key questions that demand experimental clarification. Here, using a technique based on the tunneling diode oscillator, the magnetic penetration depth $\Delta\lambda(T)$ of CsV$_3$Sb$_5$ was measured down to 0.07 K. A clear exponential behavior in $\Delta\lambda(T)$ with marked deviations from a $T$ or $T^2$ temperature dependence is observed at low temperatures, indicating a deficiency of nodal quasiparticles. Temperature dependence of the superfluid density and electronic specific heat can be described by two-gap $s$-wave superconductivity, consistent with the presence of multiple Fermi surfaces in CsV$_3$Sb$_5$. These results evidence nodeless superconductivity in CsV$_3$Sb$_5$ under ambient pressure, and constrain the allowed pairing symmetry.


title: A novel technique for the existence of solutions to nonlinear fractional differential equation having a singularity of the critical order

abstract: This paper is devoted to a nonlinear singular Riemann-Liouville type fractional differential equation, the local existence of whose continuous solutions under the weakest condition remained as an open problem until now. The singularity of the equation arises from the discontinuity of the right-hand side function $f(x,\omega)$ at $x=0$, and its order of singularity is the same as the order of the fractional differential operator in the equation. The local existence of solutions to singular equations of such type cannot be established by a direct application of fixed point theorems only or other methods even though they are enough for the same purpose in the case of equations including a singularity of the order less than the order of the corresponding fractional R-L operator. For this reason, we here propose a novel technique with a result for continuous functions to establish a local existence theorem for the problem. Moreover, a continuation result is suggested for the local solutions to the problem and, thus, it will be revealed that in what circumstances their existing interval can be extended to larger ones. Thanks to this and the proposed technique, the global existence theorem for both sublinear and linear equations is achieved.


title: DeepStyle: User Style Embedding for Authorship Attribution of Short Texts

abstract: Authorship attribution (AA), which is the task of finding the owner of a given text, is an important and widely studied research topic with many applications. Recent works have shown that deep learning methods could achieve significant accuracy improvement for the AA task. Nevertheless, most of these proposed methods represent user posts using a single type of feature (e.g., word bi-grams) and adopt a text classification approach to address the task. Furthermore, these methods offer very limited explainability of the AA results. In this paper, we address these limitations by proposing DeepStyle, a novel embedding-based framework that learns the representations of users' salient writing styles. We conduct extensive experiments on two real-world datasets from Twitter and Weibo. Our experiment results show that DeepStyle outperforms the state-of-the-art baselines on the AA task.


title: DeepHate: Hate Speech Detection via Multi-Faceted Text Representations

abstract: Online hate speech is an important issue that breaks the cohesiveness of online social communities and even raises public safety concerns in our societies. Motivated by this rising issue, researchers have developed many traditional machine learning and deep learning methods to detect hate speech in online social platforms automatically. However, most of these methods have only considered single type textual feature, e.g., term frequency, or using word embeddings. Such approaches neglect the other rich textual information that could be utilized to improve hate speech detection. In this paper, we propose DeepHate, a novel deep learning model that combines multi-faceted text representations such as word embeddings, sentiments, and topical information, to detect hate speech in online social platforms. We conduct extensive experiments and evaluate DeepHate on three large publicly available real-world datasets. Our experiment results show that DeepHate outperforms the state-of-the-art baselines on the hate speech detection task. We also perform case studies to provide insights into the salient features that best aid in detecting hate speech in online social platforms.


title: AngryBERT: Joint Learning Target and Emotion for Hate Speech Detection

abstract: Automated hate speech detection in social media is a challenging task that has recently gained significant traction in the data mining and Natural Language Processing community. However, most of the existing methods adopt a supervised approach that depended heavily on the annotated hate speech datasets, which are imbalanced and often lack training samples for hateful content. This paper addresses the research gaps by proposing a novel multitask learning-based model, AngryBERT, which jointly learns hate speech detection with sentiment classification and target identification as secondary relevant tasks. We conduct extensive experiments to augment three commonly-used hate speech detection datasets. Our experiment results show that AngryBERT outperforms state-of-the-art single-task-learning and multitask learning baselines. We conduct ablation studies and case studies to empirically examine the strengths and characteristics of our AngryBERT model and show that the secondary tasks are able to improve hate speech detection.