title: Fluid dynamic limit of Boltzmann equation for granular hard--spheres in a nearly elastic regime

abstract: In this paper, we provide the first rigorous derivation of hydrodynamic equations from the Boltzmann equation for inelastic hard spheres with small inelasticity. The hydrodynamic system that we obtain is an incompressible Navier-Stokes-Fourier system with self-consistent forcing terms and is thus the first hydrodynamic system that properly describes rapid granular flows. To do that, we write our Boltzmann equation in nondimensional form introducing the dimensionless Knudsen number which is intended to tend to 0. The difficulties are then manyfold, the first one coming from the fact that the original Boltzmann equation is free-cooling and thus requires a self-similar change of variables to work with an equation that has an homogeneous steady state. The latter is not explicit and is heavy-tailed, which is a major obstacle to adapt energy estimates and spectral analysis. One of the main challenges here is to understand the relation between the restitution coefficient (which quantifies the loss of energy at the microscopic level) and the Knudsen number. This is done identifying the correct nearly elastic regime to capture nontrivial hydrodynamic behavior. We are then able to prove exponential stability uniformly with respect to the Knudsen number of the solution of our rescaled Boltzmann equation in a close to equilibrium regime. Finally, we prove that our solution to the Boltzmann equation converges in some very specific weak sense towards some hydrodynamic solution which depends on time and space variables only through macroscopic quantities. Such macroscopic quantities are solutions to a suitable modification of the incompressible Navier-Stokes-Fourier system which appears to be new in this context.


title: Information Verification for Humanitarians: A Critical Review

abstract: Quality humanitarian information is essential for efficient, effective and coordinated humanitarian responses. During crises, however, humanitarian responders rarely have access to quality information in order to provide the much-needed relief in a timely fashion. Traditional methods for the acquisition and evaluation of humanitarian information typically confront challenges such as poor accessibility, limited sources, and the capacity of monitoring and documentation. The more recent emergence of user generated content from online social platforms addressed some challenges faced by traditional methods, but it also raised many concerns regarding information quality and verifiability, among others, that affect both the public and humanitarian actors. This paper provides an overview of information verification methods in literature and reviews information collection and verification practices and tools used by news agencies and humanitarian organizations. Twenty crowd-sourced information projects in humanitarian and human rights nature are surveyed. We discuss the findings and give recommendations for future research.


title: Mask Detection and Breath Monitoring from Speech: on Data Augmentation, Feature Representation and Modeling

abstract: This paper introduces our approaches for the Mask and Breathing Sub-Challenge in the Interspeech COMPARE Challenge 2020. For the mask detection task, we train deep convolutional neural networks with filter-bank energies, gender-aware features, and speaker-aware features. Support Vector Machines follows as the back-end classifiers for binary prediction on the extracted deep embeddings. Several data augmentation schemes are used to increase the quantity of training data and improve our models' robustness, including speed perturbation, SpecAugment, and random erasing. For the speech breath monitoring task, we investigate different bottleneck features based on the Bi-LSTM structure. Experimental results show that our proposed methods outperform the baselines and achieve 0.746 PCC and 78.8% UAR on the Breathing and Mask evaluation set, respectively.


title: From Lieb-Thirring inequalities to spectral enclosures for the damped wave equation

abstract: Using a correspondence between the spectrum of the damped wave equation and non-self-adjoint Schroedinger operators, we derive various bounds on complex eigenvalues of the former. In particular, we establish a sharp result that the one-dimensional damped wave operator is similar to the undamped one provided that the L^1 norm of the (possibly complex-valued) damping is less than 2. It follows that these small dampings are spectrally undetectable.


title: Statistical Aspects of the Quantum Supremacy Demonstration

abstract: The notable claim of quantum supremacy presented by Google's team in 2019 consists of demonstrating the ability of a quantum circuit to generate, albeit with considerable noise, bitstrings from a distribution that is considered hard to simulate on classical computers. Verifying that the generated data is indeed from the claimed distribution and assessing the circuit's noise level and its fidelity is a purely statistical undertaking. The objective of this paper is to explain the relations between quantum computing and some of the statistical aspects involved in demonstrating quantum supremacy in terms that are accessible to statisticians, computer scientists, and mathematicians. Starting with the statistical analysis in Google's demonstration, which we explain, we study various estimators of the fidelity, and different approaches to testing the distributions generated by the quantum computer. We propose different noise models, and discuss their implications. A preliminary study of the Google data, focusing mostly on circuits of 12 and 14 qubits is discussed throughout the paper.


title: On Supercritical Branching Processes with Emigration

abstract: We study supercritical branching processes under the influence of an i.i.d. emigration component. We provide conditions, under which the lifetime of the process is finite respectively has a finite expectation. A new version of the Kesten-Stigum theorem is obtained and the extinction probability for a large initial population size is related to the tail behaviour of the emigration.


title: Modeling Inter-Aspect Dependencies with a Non-temporal Mechanism for Aspect-Based Sentiment Analysis

abstract: For multiple aspects scenario of aspect-based sentiment analysis (ABSA), existing approaches typically ignore inter-aspect relations or rely on temporal dependencies to process aspect-aware representations of all aspects in a sentence. Although multiple aspects of a sentence appear in a non-adjacent sequential order, they are not in a strict temporal relationship as natural language sequence, thus the aspect-aware sentence representations should not be treated as temporal dependency processing. In this paper, we propose a novel non-temporal mechanism to enhance the ABSA task through modeling inter-aspect dependencies. Furthermore, we focus on the well-known class imbalance issue on the ABSA task and address it by down-weighting the loss assigned to well-classified instances. Experiments on two distinct domains of SemEval 2014 task 4 demonstrate the effectiveness of our proposed approach.


title: Boosting Data Reduction for the Maximum Weight Independent Set Problem Using Increasing Transformations

abstract: Given a vertex-weighted graph, the maximum weight independent set problem asks for a pair-wise non-adjacent set of vertices such that the sum of their weights is maximum. The branch-and-reduce paradigm is the de facto standard approach to solve the problem to optimality in practice. In this paradigm, data reduction rules are applied to decrease the problem size. These data reduction rules ensure that given an optimum solution on the new (smaller) input, one can quickly construct an optimum solution on the original input. We introduce new generalized data reduction and transformation rules for the problem. A key feature of our work is that some transformation rules can increase the size of the input. Surprisingly, these so-called increasing transformations can simplify the problem and also open up the reduction space to yield even smaller irreducible graphs later throughout the algorithm. In experiments, our algorithm computes significantly smaller irreducible graphs on all except one instance, solves more instances to optimality than previously possible, is up to two orders of magnitude faster than the best state-of-the-art solver, and finds higher-quality solutions than heuristic solvers DynWVC and HILS on many instances. While the increasing transformations are only efficient enough for preprocessing at this time, we see this as a critical initial step towards a new branch-and-transform paradigm.


title: Holonomic implementation of CNOT gate on topological Majorana qubits

abstract: The CNOT gate is a two-qubit gate which is essential for universal quantum computation. A well-established approach to implement it within Majorana-based qubits relies on subsequent measurement of (joint) Majorana parities. We propose an alternative scheme which operates a protected CNOT gate via the holonomic control of a handful of system parameters, without requiring any measurement. We show how the adiabatic tuning of pair-wise couplings between Majoranas can robustly lead to the full entanglement of two qubits, insensitive with respect to small variations in the control of the parameters.


title: Layout and Image Recognition Driving Cross-Platform Automated Mobile Testing

abstract: The fragmentation problem has extended from Android to different platforms, such as iOS, mobile web, and even mini-programs within some applications (app). In such a situation, recording and replaying test scripts is a popular automated mobile app testing approaches. But such approach encounters severe problems when crossing platforms. Different versions of the same app need to be developed to support different platforms relying on different platform supports. Therefore, mobile app developers need to develop and maintain test scripts for multiple platforms aimed at completely the same test requirements, greatly increasing testing costs. However, we discover that developers adopt highly similar user interface layouts for versions of the same app on different platforms. Such a phenomenon inspires us to replay test scripts from the perspective of similar UI layouts. We propose an image-driven mobile app testing framework, utilizing Widget Feature Matching and Layout Characterization Matching. We use computer vision technologies to perform UI feature comparison and layout hierarchy extraction on app screenshots to obtain UI structures with rich contextual information, including coordinates, relative relationship, etc. Based on acquired UI structures, we can form a platform-independent test script, and then locate the target widgets under test. Thus, the proposed framework non-intrusively replays test scripts according to a novel platform-independent test script model. We also design and implement a tool named LIT to devote the proposed framework into practice, based on which, we conduct an empirical study to evaluate the effectiveness and usability of the proposed testing framework. Results show that the overall replay accuracy reaches around 63.39% on Android (14% improvement over state-of-the-art approaches) and 21.83% on iOS (98% improvement over state-of-the-art approaches).


title: Rigid germs of finite morphisms of smooth surfaces and rational Belyi pairs

abstract: In \cite{K-rig}, a map $\beta:\mathcal R\to\mathcal{B}el$ from the set $\mathcal R$ of equivalence classes of rigid germs of finite morphisms branched in germs of curves having $ADE$ singularity types onto the set $\mathcal{B}el$ of rational Belyi pairs $f:\mathbb P^1\to\mathbb P^1$ considered up to the action of $PGL(2,\mathbb C)$ was defined. In this article, the inverse images of this map are investigated in terms of monodromies of Belyi pairs.


title: On the prequantisation map for 2-plectic manifolds

abstract: For a manifold $M$ with an integral closed 3-form $\omega$, we construct a $PU(H)$-bundle and a Lie groupoid over its total space, together with a curving in the sense of gerbes. If the form is non-degenerate, we furthermore give a natural Lie 2-algebra quasi-isomorphism from the observables of $(M,\omega)$ to the weak symmetries of the above geometric structure, generalising the prequantisation map of Kostant and Souriau.


title: Physical parameters of active galactic nuclei derived from properties of jet geometry transition region

abstract: We use the observed jet boundary transition from parabolic to conical shape, which was earlier discovered as possibly a common effect in active galactic nuclei, to estimate a black hole, a jet and an ambient medium parameters. We explained earlier the geometry transition as a consequence of a change in the jet inner properties: a transition from a magnetically dominated to an equipartition regime. This interpretation allows us to estimate a black hole spin, a black hole mass and an ambient pressure amplitude, using the observed jet shape break position and the jet width at the transition point for 11 active galactic nuclei. The black hole spin values obtained using our method are consistent with the lower estimates for the sources with redshift $z<2$ from the spin evolution modelling. We find that the method of a black hole mass determination based on the relation between the broad-line region size and its luminosity may underestimate masses of the sources with large jet viewing angles. We propose a new method for the black hole mass determination, with the obtained masses being in interval $10^8-10^{10}\;M_{\odot}$. The range of the values of the ambient pressure amplitude points to the uniform medium conditions for the sources in our sample, with a tentative indication of higher pressure around FRII sources.


title: A short proof of the non-biplanarity of $K_9$

abstract: Battle, Harary, and Kodama (1962) and independently Tutte (1963) proved that the complete graph with nine vertices is not biplanar. Aiming towards simplicity and brevity, in this note we provide a short proof of this claim.


title: On the braid monodromy group of a polynomial in one variable

abstract: It is proved that the braid monodromy group $\Gamma_{P(z)}$ of a polynomial $P(z)\in\mathbb C[z]$, $\deg P(z)=n$, is the braid group $\text{Br}_n$ if the polynomial $P(z)$ has $n-1$ distinct critical values.


title: The Argument against Quantum Computers, the Quantum Laws of Nature, and Google's Supremacy Claims

abstract: My 2018 lecture at the ICA workshop in Singapore dealt with quantum computation as a meeting point of the laws of computation and the laws of quantum mechanics. We described a computational complexity argument against the feasibility of quantum computers: we identified a very low-level complexity class of probability distributions described by noisy intermediate-scale quantum computers, and explained why it would allow neither good-quality quantum error-correction nor a demonstration of "quantum supremacy," namely, the ability of quantum computers to make computations that are impossible or extremely hard for classical computers. We went on to describe general predictions arising from the argument and proposed general laws that manifest the failure of quantum computers. In October 2019, "Nature" published a paper describing an experimental work that took place at Google. The paper claims to demonstrate quantum (computational) supremacy on a 53-qubit quantum computer, thus clearly challenging my theory. In this paper, I will explain and discuss my work in the perspective of Google's supremacy claims.


title: Dispersed Federated Learning: Vision, Taxonomy, and Future Directions

abstract: The ongoing deployment of the Internet of Things (IoT)-based smart applications is spurring the adoption of machine learning as a key technology enabler. To overcome the privacy and overhead challenges of centralized machine learning, there has been a significant recent interest in the concept of federated learning. Federated learning offers on-device, privacy-preserving machine learning without the need to transfer end-devices data to a third party location. However, federated learning still has privacy concerns due to sensitive information inferring capability of the aggregation server using end-devices local learning models. Furthermore, the federated learning process might fail due to a failure in the aggregation server (e.g., due to a malicious attack or physical defect). Other than privacy and robustness issues, federated learning over IoT networks requires a significant amount of communication resources for training. To cope with these issues, we propose a novel concept of dispersed federated learning (DFL) that is based on the true decentralization. We opine that DFL will serve as a practical implementation of federated learning for various IoT-based smart applications such as smart industries and intelligent transportation systems. First, the fundamentals of the DFL are presented. Second, a taxonomy is devised with a qualitative analysis of various DFL schemes. Third, a DFL framework for IoT networks is proposed with a matching theory-based solution. Finally, an outlook on future research directions is presented.


title: Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Models

abstract: Pretrained Transformer models have emerged as state-of-the-art approaches that learn contextual information from text to improve the performance of several NLP tasks. These models, albeit powerful, still require specialized knowledge in specific scenarios. In this paper, we argue that context derived from a knowledge graph (in our case: Wikidata) provides enough signals to inform pretrained transformer models and improve their performance for named entity disambiguation (NED) on Wikidata KG. We further hypothesize that our proposed KG context can be standardized for Wikipedia, and we evaluate the impact of KG context on state-of-the-art NED model for the Wikipedia knowledge base. Our empirical results validate that the proposed KG context can be generalized (for Wikipedia), and providing KG context in transformer architectures considerably outperforms the existing baselines, including the vanilla transformer models.


title: Log-concave Ridge Estimation

abstract: We develop a density ridge search algorithm based on a novel density ridge definition. This definition is based on a conditional variance matrix and the mode in the lower dimensional subspace. It is compared to the subspace constraint mean shift algorithm, based on the gradient and Hessian of the underlying probability density function. We show the advantages of the new algorithm in a simulation study and estimate galaxy filaments from a data set of the Baryon Oscillation Spectroscopic Survey.


title: Lower-bounds on the growth of power-free languages over large alphabets

abstract: We study the growth rate of some power-free languages. For any integer $k$ and real $\beta>1$, we let $\alpha(k,\beta)$ be the growth rate of the number of $\beta$-free words of a given length over the alphabet $\{1,2,\ldots, k\}$. Shur studied the asymptotic behavior of $\alpha(k,\beta)$ for $\beta\ge2$ as $k$ goes to infinity. He suggested a conjecture regarding the asymptotic behavior of $\alpha(k,\beta)$ as $k$ goes to infinity when $1<\beta<2$. He showed that for $\frac{9}{8}\le\beta<2$ the asymptotic upper-bound holds of his conjecture holds. We show that the asymptotic lower-bound of his conjecture holds. This implies that the conjecture is true for $\frac{9}{8}\le\beta<2$.


title: Necessary and sufficient conditions for time reversal symmetry in presence of magnetic fields

abstract: Time reversal invariance (TRI) of particles systems has many consequences, among~which the celebrated Onsager reciprocal relations, a milestone in Statistical Mechanics dating back to 1931. Because for a long time it was believed that (TRI) dos not hold in presence of a magnetic field, a modification of such relations was proposed by Casimir in 1945. Only in the last decade, the~strict traditional notion of reversibility that led to Casimir's work has been questioned. It was then found that other symmetries can be used, which allow the Onsager reciprocal relations to hold without modification. In this paper we advance this investigation for classical Hamiltonian systems, substantially increasing the number of symmetries that yield TRI in presence of a magnetic field. We~first deduce the most general form of a generalized time reversal operation on the phase space of such a system; secondly, we express sufficient conditions on the magnetic field which ensure TRI. Finally, we examine common examples from statistical mechanics and molecular dynamics. Our main result is that TRI holds in a much wider generality than previously believed, partially explaining why no experimental violation of Onsager relations has so far been reported.


title: The nearby extreme accretion and feedback system PDS 456: finding a complex radio-emitting nucleus

abstract: When a black hole accretes close to the Eddington limit, the astrophysical jet is often accompanied by radiatively driven, wide-aperture and mildly relativistic winds. Powerful winds can produce significant non-thermal radio emission via shocks. Among the nearby critical accretion quasars, PDS 456 has a very massive black hole (about one billion solar masses), shows a significant star-forming activity (about seventy solar masses per year) and hosts exceptionally energetic X-ray winds (power up to twenty per cent of the Eddington luminosity). To probe the radio activity in this extreme accretion and feedback system, we performed very-long-baseline interferometric (VLBI) observations of PDS 456 at 1.66 GHz with the European VLBI Network (EVN) and the enhanced Multi-Element Remotely Linked Interferometry Network (e-MERLIN). We find a rarely-seen complex radio-emitting nucleus consisting of a collimated jet and an extended non-thermal radio emission region. The diffuse emission region has a size of about 360 pc and a radio luminosity about three times higher than the nearby extreme starburst galaxy Arp 220. The powerful nuclear radio activity could result from either a relic jet with a peculiar geometry (nearly along the line of sight) or more likely from diffuse shocks formed naturally by the existing high-speed winds impacting on high-density star-forming regions.


title: Competitive Demand Learning: A Non-cooperative Pricing Algorithm with Coordinated Price Experimentation

abstract: We consider a periodical equilibrium pricing problem for multiple firms over a planning horizon of T periods. At each period, firms set their selling prices and receive stochastic demand from consumers. Firms do not know their underlying demand curve, but they wish to determine the selling prices to maximize total revenue under competition. Hence, they have to do some price experiments such that the observed demand data are informative to make price decisions. However, uncoordinated price updating can render the demand information gathered by price experimentation less informative or inaccurate. We design a nonparametric learning algorithm to facilitate coordinated dynamic pricing, in which competitive firms estimate their demand functions based on observations and adjust their pricing strategies in a prescribed manner. We show that the pricing decisions, determined by estimated demand functions, converge to underlying equilibrium as time progresses. We obtain a bound of the revenue difference that has an order of O(F^2 T^3/4) and a regret bound that has an order of O(F T^1/2) with respect to the number of the competitive firms F and T . We also develop a modified algorithm to handle the situation where some firms may have the knowledge of the demand curve.


title: RAF-AU Database: In-the-Wild Facial Expressions with Subjective Emotion Judgement and Objective AU Annotations

abstract: Much of the work on automatic facial expression recognition relies on databases containing a certain number of emotion classes and their exaggerated facial configurations (generally six prototypical facial expressions), based on Ekman's Basic Emotion Theory. However, recent studies have revealed that facial expressions in our human life can be blended with multiple basic emotions. And the emotion labels for these in-the-wild facial expressions cannot easily be annotated solely on pre-defined AU patterns. How to analyze the action units for such complex expressions is still an open question. To address this issue, we develop a RAF-AU database that employs a sign-based (i.e., AUs) and judgement-based (i.e., perceived emotion) approach to annotating blended facial expressions in the wild. We first reviewed the annotation methods in existing databases and identified crowdsourcing as a promising strategy for labeling in-the-wild facial expressions. Then, RAF-AU was finely annotated by experienced coders, on which we also conducted a preliminary investigation of which key AUs contribute most to a perceived emotion, and the relationship between AUs and facial expressions. Finally, we provided a baseline for AU recognition in RAF-AU using popular features and multi-label learning methods.


title: Forms of almost homogeneous varieties over perfect fields

abstract: We study the k-forms of almost homogeneous varieties over perfect base fields k. First, we discuss criteria for the existence of k-forms in the homogeneous case. Then, we extend the Luna-Vust theory from algebraically closed fields to perfect fields to determine when a given k-form of the open orbit of an almost homogeneous variety extends to a k-form of the entire variety. Finally, in the last section, we apply these results to determine the real forms of complex almost homogeneous SL(2)-threefolds.


title: All-hadronic HHZ production at 3 TeV CLIC

abstract: In this note, $\mathrm{ZHH}$ production in the all-hadronic final state is studied in $\mathrm{e}^{+}\mathrm{e}^{-}$ collisions at the Compact Linear Collider at the 3 TeV stage. At this stage this Higgs boson pair production mode is sub-leading to the $\mathrm{W}^{+}\mathrm{W}^{-}$ fusion production cross-section of $\mathrm{e}^{+}\mathrm{e}^{-}\rightarrow\mathrm{HH}\nu\nu$. The events are characterised by a topology of six jets, where the masses of the three pair-wise combinations of two jets are compatible with originating from two $\mathrm{H}$ and one $\mathrm{Z}$ bosons. The event selection concentrates on the dominant $\mathrm{H}$ boson decays into two b-quarks by requiring a presence of multiple b-jets. The study is based on full simulation using the CLICdet model, including beam-induced backgrounds from $\gamma\gamma\rightarrow\mathrm{hadrons}$. Results on the measurement of the total $\mathrm{ZHH}$ cross section are given.


title: Existence results for some problems on Riemannian manifolds

abstract: By using variational techniques we provide new existence results for Yamabe-type equations with subcritical perturbations set on a compact $d$-dimensional ($d\geq 3$) Riemannian manifold without boundary. As a direct consequence of our main theorems, we prove the existence of at least one solution to the following singular Yamabe-type problem $$ \left\lbrace \begin{array}{ll} -\Delta_g w + \alpha(\sigma)w = \mu K(\sigma) w^\frac{d+2}{d-2} +\lambda \left( w^{r-1} + f(w)\right), \quad \sigma\in\mathcal{M} &\\ &\\ w\in H^2_\alpha(\mathcal{M}), \quad w>0 \ \ \mbox{in} \ \ \mathcal{M} & \end{array} \right.$$ where, as usual, $\Delta_g$ denotes the Laplace-Beltrami operator on $(\mathcal{M},g)$, $\alpha, K:\mathcal{M}\to\mathbb{R}$ are positive (essentially) bounded functions, $r\in(0,1)$, and $f:[0,+\infty)\to[0,+\infty)$ is a subcritical continuous function. Restricting ourselves to the unit sphere ${\mathbb{S}}^d$ via the stereographic projection, we also solve some parametrized Emden-Fowler equations in the Euclidean case.


title: Enhanced steady-state coherence via repeated system-bath interactions

abstract: The appearance of steady-state coherence (SSC) from system-bath interaction proves that quantum effects can appear without an external drive. Such SSC could become a resource to demonstrate quantum advantage in the applications. We predict the generation of SSC if the target system repeatedly interacts with independent and non-correlated bath elements. To describe their behavior, we use the collision model approach of system-bath interaction, where the system interacts with one bath element (initially in an incoherent state) at a time, asymptotically (in the fast-collision regime) mimicking a macroscopic Markovian bath coupled to the target system. Therefore, the SSC qualitatively appears to be the same as if the continuous Markovian bath would be used. We confirm that the presence of composite system-bath interactions under the rotating-wave approximation (RWA) is the necessary condition for the generation of SSC using thermal resources in collision models. Remarkably, we show that SSC substantially increases if the target system interacts collectively with more than one bath element at a time. Already few bath elements collectively interacting with the target system are sufficient to increase SSC at non-zero temperatures at the cost of tolerable lowering the final state purity. From the thermodynamic perspective, the SSC generation in our collision models is inevitably linked to a non zero power input (and thus heat dissipated to the bath) necessary to reach the steady-state, although such energetic cost can be lower compared to cases relying on SSC non generating interactions.


title: OCoR: An Overlapping-Aware Code Retriever

abstract: Code retrieval helps developers reuse the code snippet in the open-source projects. Given a natural language description, code retrieval aims to search for the most relevant code among a set of code. Existing state-of-the-art approaches apply neural networks to code retrieval. However, these approaches still fail to capture an important feature: overlaps. The overlaps between different names used by different people indicate that two different names may be potentially related (e.g., "message" and "msg"), and the overlaps between identifiers in code and words in natural language descriptions indicate that the code snippet and the description may potentially be related. To address these problems, we propose a novel neural architecture named OCoR, where we introduce two specifically-designed components to capture overlaps: the first embeds identifiers by character to capture the overlaps between identifiers, and the second introduces a novel overlap matrix to represent the degrees of overlaps between each natural language word and each identifier. The evaluation was conducted on two established datasets. The experimental results show that OCoR significantly outperforms the existing state-of-the-art approaches and achieves 13.1% to 22.3% improvements. Moreover, we also conducted several in-depth experiments to help understand the performance of different components in OCoR.


title: Representative Graph Neural Network

abstract: Non-local operation is widely explored to model the long-range dependencies. However, the redundant computation in this operation leads to a prohibitive complexity. In this paper, we present a Representative Graph (RepGraph) layer to dynamically sample a few representative features, which dramatically reduces redundancy. Instead of propagating the messages from all positions, our RepGraph layer computes the response of one node merely with a few representative nodes. The locations of representative nodes come from a learned spatial offset matrix. The RepGraph layer is flexible to integrate into many visual architectures and combine with other operations. With the application of semantic segmentation, without any bells and whistles, our RepGraph network can compete or perform favourably against the state-of-the-art methods on three challenging benchmarks: ADE20K, Cityscapes, and PASCAL-Context datasets. In the task of object detection, our RepGraph layer can also improve the performance on the COCO dataset compared to the non-local operation. Code is available at https://git.io/RepGraph.


title: The Wisdom and Persuadability of Threads

abstract: Online discussion threads are important means for individual decision-making and for aggregating collective judgments, e.g. the `wisdom of crowds'. Empirical investigations of the wisdom of crowds are currently ambivalent about the role played by social information. While some findings suggest that social information undermines crowd accuracy due to correlated judgment errors, others show that accuracy improves. We investigate experimentally the accuracy of threads in which participants make magnitude estimates of varying difficulty while seeing a varying number of previous estimates. We demonstrate that, for difficult tasks, seeing preceding estimates aids the wisdom of crowds. If, however, participants only see extreme estimates, wisdom quickly turns into folly. Using a Gaussian Mixture Model, we assign a persuadability score to each participant and show that persuadability increases with task difficulty and with the amount of social information provided. In filtered threads, we see an increasing gap between highly persuadable participants and skeptics.


title: Pixel-level Corrosion Detection on Metal Constructions by Fusion of Deep Learning Semantic and Contour Segmentation

abstract: Corrosion detection on metal constructions is a major challenge in civil engineering for quick, safe and effective inspection. Existing image analysis approaches tend to place bounding boxes around the defected region which is not adequate both for structural analysis and pre-fabrication, an innovative construction concept which reduces maintenance cost, time and improves safety. In this paper, we apply three semantic segmentation-oriented deep learning models (FCN, U-Net and Mask R-CNN) for corrosion detection, which perform better in terms of accuracy and time and require a smaller number of annotated samples compared to other deep models, e.g. CNN. However, the final images derived are still not sufficiently accurate for structural analysis and pre-fabrication. Thus, we adopt a novel data projection scheme that fuses the results of color segmentation, yielding accurate but over-segmented contours of a region, with a processed area of the deep masks, resulting in high-confidence corroded pixels.


title: How can contemporary climate research help to understand epidemic dynamics? -- Ensemble approach and snapshot attractors

abstract: Standard epidemic models based on compartmental differential equations are investigated under continuous parameter change as external forcing. We show that seasonal modulation of the contact parameter superimposed a monotonic decay needs a different description than that of the standard chaotic dynamics. The concept of snapshot attractors and their natural probability distribution has been adopted from the field of the latest climate-change-research to show the importance of transient effect and ensemble interpretation of disease spread. After presenting the extended bifurcation diagram of measles, the temporal change of the phase space structure is investigated. By defining statistical measures over the ensemble, we can interpret the internal variability of the epidemic as the onset of complex dynamics even for those values of contact parameter where regular behavior is expected. We argue that anomalous outbreaks of infectious class cannot die out until transient chaos is presented for various parameters. More important, that this fact becomes visible by using of ensemble approach rather than single trajectory representation. These findings are applicable generally in nonlinear dynamical systems such as standard epidemic models regardless of parameter values.


title: Lorentz and permutation invariants of particles III: constraining non-standard sources of parity violation

abstract: Comparisons of the positive and negative halves of the distributions of parity-odd event variables in particle-physics experimental data can provide sensitivity to sources of non-standard parity violation. Such techniques benefit from lacking first-order dependence on simulations or theoretical models, but have hitherto lacked systematic means of enumerating all discoverable signals. To address that issue this paper seeks to construct sets of parity-odd event variables which may be proved to be able to reveal the existence of any Lorentz-invariant source of non-standard parity violation which could be visible in data consisting of groups of real non space-like four-momenta exhibiting certain permutation symmetries.


title: Thermal and viscous dissipation in relativistic heavy ion collisions

abstract: We investigate the effects of finite baryon density and temperature on the bulk properties of matter formed in relativistic heavy ion collisions within second-order dissipative hydrodynamics. The relativistic fluid evolution equations for heat flow and shear stress tensor are derived from kinetic theory by using Grad's 14-moment approximation for the single-particle phase-space distribution function. The new equations provide a number of additional terms associated with heat-shear couplings as compared to the existing derivations based on entropy principle. The dissipative equations are encoded in non-boost-invariant hydrodynamic model simulation and studied for the evolution of high baryon density matter encountered at the beam energy scan program at RHIC. We find that thermal dissipation dominates shear pressure in defining the bulk observables at the low energy but its effect diminishes at ultra-relativistic energies.


title: Charmed and $\phi$ meson decay constants from 2+1-flavor lattice QCD

abstract: On a lattice with 2+1-flavor dynamical domain-wall fermions at the physical pion mass, we calculate the decay constants of $D_{s}^{(*)}$, $D^{(*)}$ and $\phi$. The lattice size is $48^3\times96$, which corresponds to a spatial extension of $\sim5.5$ fm with the lattice spacing $a\approx 0.114$ fm. For the valence light, strange and charm quarks, we use overlap fermions at several mass points close to their physical values. Our results at the physical point are $f_D=213(5)$ MeV, $f_{D_s}=249(7)$ MeV, $f_{D^*}=234(6)$ MeV, $f_{D_s^*}=274(7)$ MeV, and $f_\phi=241(9)$ MeV. The couplings of $D^*$ and $D_s^*$ to the tensor current ($f_V^T$) can be derived, respectively, from the ratios $f_{D^*}^T/f_{D^*}=0.91(4)$ and $f_{D_s^*}^T/f_{D_s^*}=0.92(4)$, which are the first lattice QCD results. We also obtain the ratios $f_{D^*}/f_D=1.10(3)$ and $f_{D_s^*}/f_{D_s}=1.10(4)$, which reflect the size of heavy quark symmetry breaking in charmed mesons. The ratios $f_{D_s}/f_{D}=1.16(3)$ and $f_{D_s^*}/f_{D^*}=1.17(3)$ can be taken as a measure of SU(3) flavor symmetry breaking.


title: Is MOOC Learning Different for Dropouts? A Visually-Driven, Multi-granularity Explanatory ML Approach

abstract: Millions of people have enrolled and enrol (especially in the Covid-19 pandemic world) in MOOCs. However, the retention rate of learners is notoriously low. The majority of the research work on this issue focuses on predicting the dropout rate, but very few use explainable learning patterns as part of this analysis. However, visual representation of learning patterns could provide deeper insights into learners' behaviour across different courses, whilst numerical analyses can -- and arguably, should -- be used to confirm the latter. Thus, this paper proposes and compares different granularity visualisations for learning patterns (based on clickstream data) for both course completers and non-completers. In the large-scale MOOCs we analysed, across various domains, our fine-grained, fish-eye visualisation approach showed that non-completers are more likely to jump forward in their learning sessions, often on a 'catch-up' path, whilst completers exhibit linear behaviour. For coarser, bird-eye granularity visualisation, we observed learners' transition between types of learning activity, obtaining typed transition graphs. The results, backed up by statistical significance analysis and machine learning, provide insights for course instructors to maintain engagement of learners by adapting the course design to not just 'dry' predicted values, but explainable, visually viable paths extracted.


title: Characterisation of the $b^3\Sigma^+, v=0$ State and Its Interaction with the $A^1\Pi$ State in Aluminium Monofluoride

abstract: Recently, we determined the detailed energy level structure of the $X^1\Sigma^+$, $A^1\Pi$ and $a^3\Pi$ states of AlF that are relevant to laser cooling and trapping experiments. Here, we investigate the $b^3\Sigma^+, v=0$ state of the AlF molecule. A rotationally-resolved (1+2)-REMPI spectrum of the $b^3\Sigma^+, v'=0 \leftarrow a^3\Pi, v''=0$ band is presented and the lifetime of the $b^3\Sigma^+, v=0$ state is measured to be 190(2)~ns. Hyperfine-resolved, laser-induced fluorescence spectra of the $b^3\Sigma^+, v'=0 \leftarrow X^1\Sigma^+, v''=1$ and the $b^3\Sigma^+, v'=0 \leftarrow a^3\Pi, v''=0$ bands are recorded to determine fine- and hyperfine structure parameters. The interaction between the $b^3\Sigma^+, v=0$ and the nearby $A^1\Pi$ state is studied and the magnitude of the spin-orbit coupling between the two electronic states is derived using three independent methods to give a consistent value of 10(1)~cm$^{-1}$. The triplet character of the $A$ state causes an $A\rightarrow a$ loss from the main $A-X$ laser cooling cycle below the 10$^{-6}$ level.


title: Weyl-Heisenberg frame operators and Kohn-Nirenberg symbols

abstract: An explicit expression for the Kohn-Nirenberg symbol of a Weyl- Heisenberg frame operator on $L^2(\mathbb{R})$ is obtained directly from the Gabor atom coming from new classes of window functions. This new approach, using only elementary Fourier analysis, is independent of the theory of distributions and works strictly inside $L^2(\mathbb{R})$. Kohn-Nirenberg operators are introduced and are shown to be Weyl-Heisenberg frame operators in suitable cases.


title: Interlayer Link Prediction in Multiplex Social Networks Based on Multiple Types of Consistency between Embedding Vectors

abstract: Online users are typically active on multiple social media networks (SMNs), which constitute a multiplex social network. It is becoming increasingly challenging to determine whether given accounts on different SMNs belong to the same user; this can be expressed as an interlayer link prediction problem in a multiplex network. To address the challenge of predicting interlayer links , feature or structure information is leveraged. Existing methods that use network embedding techniques to address this problem focus on learning a mapping function to unify all nodes into a common latent representation space for prediction; positional relationships between unmatched nodes and their common matched neighbors (CMNs) are not utilized. Furthermore, the layers are often modeled as unweighted graphs, ignoring the strengths of the relationships between nodes. To address these limitations, we propose a framework based on multiple types of consistency between embedding vectors (MulCEV). In MulCEV, the traditional embedding-based method is applied to obtain the degree of consistency between the vectors representing the unmatched nodes, and a proposed distance consistency index based on the positions of nodes in each latent space provides additional clues for prediction. By associating these two types of consistency, the effective information in the latent spaces is fully utilized. Additionally, MulCEV models the layers as weighted graphs to obtain representation. In this way, the higher the strength of the relationship between nodes, the more similar their embedding vectors in the latent representation space will be. The results of our experiments on several real-world datasets demonstrate that the proposed MulCEV framework markedly outperforms current embedding-based methods, especially when the number of training iterations is small.


title: Existence analysis of a degenerate diffusion system for heat-conducting fluids

abstract: The existence of global weak solutions to a parabolic energy-transport system in a bounded domain with no-flux boundary conditions is proved. The model can be derived in the diffusion limit from a kinetic equation with a linear collision operator involving a non-isothermal Maxwellian. The evolution of the local temperature is governed by a heat equation with a source term that depends on the energy of the distribution function. The limiting model consists of cross-diffusion equations with an entropy structure. The main difficulty is the nonstandard degeneracy, i.e., ellipticity is lost when the fluid density or temperature vanishes. The existence proof is based on a priori estimates coming from the entropy inequality and the $H^{-1}$ method and on techniques from mathematical fluid dynamics (renormalized formulation, div-curl lemma).


title: REMAX: Relational Representation for Multi-Agent Exploration

abstract: Training a multi-agent reinforcement learning (MARL) model with a sparse reward is generally difficult because numerous combinations of interactions among agents induce a certain outcome (i.e., success or failure). Earlier studies have tried to resolve this issue by employing an intrinsic reward to induce interactions that are helpful for learning an effective policy. However, this approach requires extensive prior knowledge for designing an intrinsic reward. To train the MARL model effectively without designing the intrinsic reward, we propose a learning-based exploration strategy to generate the initial states of a game. The proposed method adopts a variational graph autoencoder to represent a game state such that (1) the state can be compactly encoded to a latent representation by considering relationships among agents, and (2) the latent representation can be used as an effective input for a coupled surrogate model to predict an exploration score. The proposed method then finds new latent representations that maximize the exploration scores and decodes these representations to generate initial states from which the MARL model starts training in the game and thus experiences novel and rewardable states. We demonstrate that our method improves the training and performance of the MARL model more than the existing exploration methods.


title: Parity violation in proton-deuteron scattering

abstract: The effects of parity violation in the interaction of relativistic polarized protons and deuterons are discussed. Within Glauber's approach, estimates are obtained for P-odd asymmetries in the total and elastic scattering cross sections, in the deuteron dissociation cross section, and in the inelastic cross section with meson production in a final state. It is shown that, from the point of view of the magnitude of the P-odd effects, the interaction of polarized deuterons with unpolarized protons has an advantage over the interaction of polarized protons with unpolarized deuterons. A significant P-odd asymmetry was found in the dissociation channel of the polarized deuteron.


title: Channel-wise Subband Input for Better Voice and Accompaniment Separation on High Resolution Music

abstract: This paper presents a new input format, channel-wise subband input (CWS), for convolutional neural networks (CNN) based music source separation (MSS) models in the frequency domain. We aim to address the major issues in CNN-based high-resolution MSS model: high computational cost and weight sharing between distinctly different bands. Specifically, in this paper, we decompose the input mixture spectra into several bands and concatenate them channel-wise as the model input. The proposed approach enables effective weight sharing in each subband and introduces more flexibility between channels. For comparison purposes, we perform voice and accompaniment separation (VAS) on models with different scales, architectures, and CWS settings. Experiments show that the CWS input is beneficial in many aspects. We evaluate our method on musdb18hq test set, focusing on SDR, SIR and SAR metrics. Among all our experiments, CWS enables models to obtain 6.9% performance gain on the average metrics. With even a smaller number of parameters, less training data, and shorter training time, our MDenseNet with 8-bands CWS input still surpasses the original MMDenseNet with a large margin. Moreover, CWS also reduces computational cost and training time to a large extent.


title: Large-Scale Analysis of Iliopsoas Muscle Volumes in the UK Biobank

abstract: Psoas muscle measurements are frequently used as markers of sarcopenia and predictors of health. Manually measured cross-sectional areas are most commonly used, but there is a lack of consistency regarding the position of the measurementand manual annotations are not practical for large population studies. We have developed a fully automated method to measure iliopsoas muscle volume (comprised of the psoas and iliacus muscles) using a convolutional neural network. Magnetic resonance images were obtained from the UK Biobank for 5,000 male and female participants, balanced for age, gender and BMI. Ninety manual annotations were available for model training and validation. The model showed excellent performance against out-of-sample data (dice score coefficient of 0.912 +/- 0.018). Iliopsoas muscle volumes were successfully measured in all 5,000 participants. Iliopsoas volume was greater in male compared with female subjects. There was a small but significant asymmetry between left and right iliopsoas muscle volumes. We also found that iliopsoas volume was significantly related to height, BMI and age, and that there was an acceleration in muscle volume decrease in men with age. Our method provides a robust technique for measuring iliopsoas muscle volume that can be applied to large cohorts.


title: Assessing Intervention Strategies for Non Homogeneous Populations Using a Closed Form Formula for R0

abstract: A general stochastic model for susceptible -> infective -> recovered (SIR) epidemics in non homogeneous populations is considered. The heterogeneity is a very important aspect here since it allows more realistic but also more complex models. The basic reproduction number $R_0$, an indication of the probability of an outbreak for homogeneous populations does not indicate the probability of an outbreak for non homogeneous models anymore, because it changes with the initially infected case. Therefore, we use "individual $R_0$" that is the expected number of secondary cases for a given initially infected individual. Thus, the effectiveness of intervention strategies can be assessed by their capability to reduce individual $R_0$ values. Also an intelligent vaccination plan for fully heterogeneous populations is proposed. It is based on the recursive calculation of individual R0 values.


title: Direct imaging of current-induced antiferromagnetic switching revealing a pure thermomagnetoelastic switching mechanism

abstract: We unravel the origin of current-induced magnetic switching of insulating antiferromagnet/heavy metal systems. We utilize concurrent transport and magneto-optical measurements to image the switching of antiferromagnetic domains in specially engineered devices of NiO/Pt bilayers. Different electrical pulsing and device geometries reveal different final states of the switching with respect to the current direction. We can explain these through simulations of the temperature induced strain and we identify the thermomagnetoelastic switching mechanism combined with thermal excitations as the origin, in which the final state is defined by the strain distributions and heat is required to switch the antiferromagnetic domains. We show that such a potentially very versatile non-contact mechanism can explain the previously reported contradicting observations of the switching final state, which were attributed to spin-orbit torque mechanisms.


title: Scale Groups

abstract: Closed subgroups of the group of isometries of the regular tree $\treeq$ that fix an end of the tree and are vertex-transitive are shown to correspond, on one hand, to self-replicating groups acting on rooted trees and, on the other hand, to elements of totally disconnected, locally compact groups having positive scale.


title: Compression of Deep Learning Models for Text: A Survey

abstract: In recent years, the fields of natural language processing (NLP) and information retrieval (IR) have made tremendous progress thanksto deep learning models like Recurrent Neural Networks (RNNs), Gated Recurrent Units (GRUs) and Long Short-Term Memory (LSTMs)networks, and Transformer [120] based models like Bidirectional Encoder Representations from Transformers (BERT) [24], GenerativePre-training Transformer (GPT-2) [94], Multi-task Deep Neural Network (MT-DNN) [73], Extra-Long Network (XLNet) [134], Text-to-text transfer transformer (T5) [95], T-NLG [98] and GShard [63]. But these models are humongous in size. On the other hand,real world applications demand small model size, low response times and low computational power wattage. In this survey, wediscuss six different types of methods (Pruning, Quantization, Knowledge Distillation, Parameter Sharing, Tensor Decomposition, andSub-quadratic Transformer based methods) for compression of such models to enable their deployment in real industry NLP projects.Given the critical need of building applications with efficient and small models, and the large amount of recently published work inthis area, we believe that this survey organizes the plethora of work done by the 'deep learning for NLP' community in the past fewyears and presents it as a coherent story.


title: Multidimensional SDE with distributional drift and L\'evy noise

abstract: We solve multidimensional SDEs with distributional drift driven by symmetric, $\alpha$-stable L\'evy processes for $\alpha\in (1,2]$ by studying the associated (singular) martingale problem and by solving the Kolmogorov backward equation. We allow for drifts of regularity $(2-2\alpha)/3$, and in particular we go beyond the by now well understood "Young regime", where the drift must have better regularity than $(1-\alpha)/2$. The analysis of the Kolmogorov backward equation in the low regularity regime is based on paracontrolled distributions. As an application of our results we construct a Brox diffusion with L\'evy noise. Keywords: Singular diffusions, stable L\'evy noise, distributional drift, paracontrolled distributions, Brox diffusion


title: Bone Segmentation in Contrast Enhanced Whole-Body Computed Tomography

abstract: Segmentation of bone regions allows for enhanced diagnostics, disease characterisation and treatment monitoring in CT imaging. In contrast enhanced whole-body scans accurate automatic segmentation is particularly difficult as low dose whole body protocols reduce image quality and make contrast enhanced regions more difficult to separate when relying on differences in pixel intensities. This paper outlines a U-net architecture with novel preprocessing techniques, based on the windowing of training data and the modification of sigmoid activation threshold selection to successfully segment bone-bone marrow regions from low dose contrast enhanced whole-body CT scans. The proposed method achieved mean Dice coefficients of 0.979, 0.965, and 0.934 on two internal datasets and one external test dataset respectively. We have demonstrated that appropriate preprocessing is important for differentiating between bone and contrast dye, and that excellent results can be achieved with limited data.


title: CFHT MegaPrime/MegaCam $u$-band source catalogue of the $AKARI$ North Ecliptic Pole Wide field

abstract: The $AKARI$ infrared (IR) space telescope conducted two surveys (Deep and Wide) in the North Ecliptic Pole (NEP) field to find more than 100,000 IR sources using its Infrared Camera (IRC). IRC's 9 filters, which cover wavebands from 2 to 24 $\mu$m continuously, make $AKARI$ unique in comparison with other IR observatories such as $Spitzer$ or $WISE$. However, studies of the $AKARI$ NEP-Wide field sources had been limited due to the lack of follow-up observations in the ultraviolet (UV) and optical. In this work, we present the Canada-France-Hawaii Telescope (CFHT) MegaPrime/MegaCam $u$-band source catalogue of the $AKARI$ NEP-Wide field. The observations were taken in 7 nights in 2015 and 2016, resulting in 82 observed frames covering 3.6 deg$^2$. The data reduction, image processing and source extraction were performed in a standard procedure using the \textsc{Elixir} pipeline and the \textsc{AstrOmatic} software, and eventually 351,635 sources have been extracted. The data quality is discussed in two regions (shallow and deep) separately, due to the difference in the total integration time (4,520 and 13,910 seconds). The 5$\sigma$ limiting magnitude, seeing FWHM, and the magnitude at 50 per cent completeness are 25.38 mag (25.79 mag in the deep region), 0.82 arcsec (0.94 arcsec) and 25.06 mag (25.45 mag), respectively. The u-band data provide us with critical improvements to photometric redshifts and UV estimates of the precious infrared sources from the $AKARI$ space telescope.


title: A Zero-Shot Sketch-based Inter-Modal Object Retrieval Scheme for Remote Sensing Images

abstract: Conventional existing retrieval methods in remote sensing (RS) are often based on a uni-modal data retrieval framework. In this work, we propose a novel inter-modal triplet-based zero-shot retrieval scheme utilizing a sketch-based representation of RS data. The proposed scheme performs efficiently even when the sketch representations are marginally prototypical of the image. We conducted experiments on a new bi-modal image-sketch dataset called Earth on Canvas (EoC) conceived during this study. We perform a thorough bench-marking of this dataset and demonstrate that the proposed network outperforms other state-of-the-art methods for zero-shot sketch-based retrieval framework in remote sensing.


title: Tutorial of numerical continuation and bifurcation theory for systems and synthetic biology

abstract: Mathematical modelling allows us to concisely describe fundamental principles in biology. Analysis of models can help to both explain known phenomena, and predict the existence of new, unseen behaviours. Model analysis is often a complex task, such that we have little choice but to approach the problem with computational methods. Numerical continuation is a computational method for analysing the dynamics of nonlinear models by algorithmically detecting bifurcations. Here we aim to promote the use of numerical continuation tools by providing an introduction to nonlinear dynamics and numerical bifurcation analysis. Many numerical continuation packages are available, covering a wide range of system classes; a review of these packages is provided, to help both new and experienced practitioners in choosing the appropriate software tools for their needs.


title: High-order uniformly accurate time integrators for semilinear wave equations of Klein-Gordon type in the non-relativistic limit

abstract: We introduce a family of high-order time semi-discretizations for semilinear wave equations of Klein--Gordon type with arbitrary smooth nonlinerities that are uniformly accurate in the non-relativistic limit where the speed of light goes to infinity. Our schemes do not require pre-computations that are specific to the nonlinearity and have no restrictions in step size. Instead, they rely upon a general oscillatory quadrature rule developed in a previous paper (Mohamad and Oliver, arXiv:1909.04616).


title: Optimal to-do list gamification

abstract: What should I work on first? What can wait until later? Which projects should I prioritize and which tasks are not worth my time? These are challenging questions that many people face every day. People's intuitive strategy is to prioritize their immediate experience over the long-term consequences. This leads to procrastination and the neglect of important long-term projects in favor of seemingly urgent tasks that are less important. Optimal gamification strives to help people overcome these problems by incentivizing each task by a number of points that communicates how valuable it is in the long-run. Unfortunately, computing the optimal number of points with standard dynamic programming methods quickly becomes intractable as the number of a person's projects and the number of tasks required by each project increase. Here, we introduce and evaluate a scalable method for identifying which tasks are most important in the long run and incentivizing each task according to its long-term value. Our method makes it possible to create to-do list gamification apps that can handle the size and complexity of people's to-do lists in the real world.


title: A Torelli theorem for moduli spaces of parabolic vector bundles over an elliptic curve

abstract: Let $C$ be an elliptic curve, $w\in C$, and let $S\subset C$ be a finite subset of cardinality at least $3$. We prove a Torelli type theorem for the moduli space of rank two parabolic vector bundles with determinant line bundle $\mathcal O_C(w)$ over $(C,S)$ which are semistable with respect to a weight vector $\big(\frac{1}{2}, \dots, \frac{1}{2}\big)$.


title: Defending Adversarial Examples via DNN Bottleneck Reinforcement

abstract: This paper presents a DNN bottleneck reinforcement scheme to alleviate the vulnerability of Deep Neural Networks (DNN) against adversarial attacks. Typical DNN classifiers encode the input image into a compressed latent representation more suitable for inference. This information bottleneck makes a trade-off between the image-specific structure and class-specific information in an image. By reinforcing the former while maintaining the latter, any redundant information, be it adversarial or not, should be removed from the latent representation. Hence, this paper proposes to jointly train an auto-encoder (AE) sharing the same encoding weights with the visual classifier. In order to reinforce the information bottleneck, we introduce the multi-scale low-pass objective and multi-scale high-frequency communication for better frequency steering in the network. Unlike existing approaches, our scheme is the first reforming defense per se which keeps the classifier structure untouched without appending any pre-processing head and is trained with clean images only. Extensive experiments on MNIST, CIFAR-10 and ImageNet demonstrate the strong defense of our method against various adversarial attacks.


title: Fine-grained Visual Textual Alignment for Cross-Modal Retrieval using Transformer Encoders

abstract: Despite the evolution of deep-learning-based visual-textual processing systems, precise multi-modal matching remains a challenging task. In this work, we tackle the task of cross-modal retrieval through image-sentence matching based on word-region alignments, using supervision only at the global image-sentence level. Specifically, we present a novel approach called Transformer Encoder Reasoning and Alignment Network (TERAN). TERAN enforces a fine-grained match between the underlying components of images and sentences, i.e., image regions and words, respectively, in order to preserve the informative richness of both modalities. TERAN obtains state-of-the-art results on the image retrieval task on both MS-COCO and Flickr30k datasets. Moreover, on MS-COCO, it also outperforms current approaches on the sentence retrieval task. Focusing on scalable cross-modal information retrieval, TERAN is designed to keep the visual and textual data pipelines well separated. Cross-attention links invalidate any chance to separately extract visual and textual features needed for the online search and the offline indexing steps in large-scale retrieval systems. In this respect, TERAN merges the information from the two domains only during the final alignment phase, immediately before the loss computation. We argue that the fine-grained alignments produced by TERAN pave the way towards the research for effective and efficient methods for large-scale cross-modal information retrieval. We compare the effectiveness of our approach against relevant state-of-the-art methods. On the MS-COCO 1K test set, we obtain an improvement of 5.7% and 3.5% respectively on the image and the sentence retrieval tasks on the Recall@1 metric. The code used for the experiments is publicly available on GitHub at https://github.com/mesnico/TERAN.


title: Learning to Detect Anomalous Wireless Links in IoT Networks

abstract: After decades of research, the Internet of Things (IoT) is finally permeating real-life and helps improve the efficiency of infrastructures and processes as well as our health. As a massive number of IoT devices are deployed, they naturally incur great operational costs to ensure intended operations. To effectively handle such intended operations in massive IoT networks, automatic detection of malfunctioning, namely anomaly detection, becomes a critical but challenging task. In this paper, motivated by a real-world experimental IoT deployment, we introduce four types of wireless network anomalies that are identified at the link layer. We study the performance of threshold- and machine learning (ML)-based classifiers to automatically detect these anomalies. We examine the relative performance of three supervised and three unsupervised ML techniques on both non-encoded and encoded (autoencoder) feature representations. Our results demonstrate that; i) selected supervised approaches are able to detect anomalies with F1 scores of above 0.98, while unsupervised ones are also capable of detecting the said anomalies with F1 scores of, on average, 0.90, and ii) OC-SVM outperforms all the other unsupervised ML approaches reaching at F1 scores of 0.99 for SuddenD, 0.95 for SuddenR, 0.93 for InstaD and 0.95 for SlowD.


title: Dipole model at Next-to-Leading Order meets HERA data

abstract: Deep inelastic scattering (DIS) total cross section data at small-x as measured by the HERA experiments is well described by Balitsky-Kovchegov (BK) evolution in the leading order dipole picture. Recently the full Next-to-Leading Order (NLO) dipole picture total cross sections have become available for DIS, and a working factorization scheme has been devised which subtracts the soft gluon divergence present at NLO. We report our recently published work in which we make the first comparisons of the NLO DIS total cross sections to HERA data. The non-perturbative initial condition to BK evolution is fixed by fitting the HERA reduced cross section data. As the NLO results for the DIS total cross section are currently available only in the massless quark limit, we also fit a light-quark-only cross section constructed with a parametrization of published total and heavy quark data. We find an excellent description of the HERA data. Since the full NLO BK equation is computationally expensive, we use a number of beyond LO prescriptions for the evolution that include most important higher order corrections enhanced by large transverse logarithms, including the recent version of the equation formulated in terms of the target momentum fraction.


title: Experimental Estimation of Quantum State Properties from Classical Shadows

abstract: Full quantum tomography of high-dimensional quantum systems is experimentally infeasible due to the exponential scaling of the number of required measurements on the number of qubits in the system. However, several ideas were proposed recently for predicting the limited number of features for these states, or estimating the expectation values of operators, without the need for full state reconstruction. These ideas go under the general name of shadow tomography. Here we provide an experimental demonstration of property estimation based on classical shadows proposed in [H.-Y. Huang, R. Kueng, J. Preskill. Nat. Phys. https://doi.org/10.1038/s41567-020-0932-7 (2020)] and study its performance in the quantum optical experiment with high-dimensional spatial states of photons. We show on experimental data how this procedure outperforms conventional state reconstruction in fidelity estimation from a limited number of measurements.


title: On convergence of Baum-Katz series for elements of linear autoregression

abstract: We study complete convergence and closely related Hsu-Robbins-Erd\H{o}s-Spitzer-Baum-Katz series for sums whose terms are elements of linear autoregression sequences. We obtain criterions for convergence of this series expressed in moment assumptions, which for "weakly dependent" sequences are the same as in classical results concerning independent case.


title: Stabilization of a honeycomb lattice of IrO$_6$ octahedra in superlattices with ilmenite-type MnTiO$_3$

abstract: In the quest for quantum spin liquids, thin films are expected to open the way for the control of intricate magnetic interactions in actual materials by exploiting epitaxial strain and two-dimensionality. However, materials compatible with conventional thin-film growth methods have largely remained undeveloped. As a promising candidate towards the materialization of quantum spin liquids in thin films, we here present a robust ilmenite-type oxide with a honeycomb lattice of edge-sharing IrO$_6$ octahedra artificially stabilized by superlattice formation with an ilmenite-type antiferromagnetic oxide MnTiO$_3$. The stabilized sub-unit-cell-thick Mn-Ir-O layer is isostructural to MnTiO$_3$, having the atomic arrangement corresponding to ilmenite-type MnTiO$_3$ not discovered yet. By spin Hall magnetoresistance measurements, we found that antiferromagnetic ordering in the ilmenite Mn sublattice is suppressed by modified magnetic interactions in the MnO$_6$ planes via the IrO$_6$ planes. These findings lay the foundation for the creation of two-dimensional Kitaev candidate materials, accelerating the discovery of exotic physics and applications specific to quantum spin liquids.


title: Lattice dynamics and spontaneous magnetodielectric effect in ilmenite CoTiO$_3$

abstract: Ilmenite-type crystals find a variety of technological applications due to their intriguing physical properties. We present the results of the lattice dynamics studies of honeycomb antiferromagnetic ilmenite CoTiO$_3$ single crystal by the complementary polarized infrared, Raman, and dielectric spectroscopic techniques that are supplemented by the DFT calculations. The frequencies and symmetries of all predicted infrared and Raman active phonons were uniquely identified. Furthermore, it was found that the dielectric permittivity demonstrates distinct changes below antiferromagnetic ordering temperature in zero magnetic field due to spontaneous magnetodielectric effect. Our results establish the reliable basis for further investigation of the coupling of phonons with spins, magnetic excitations and other physical phenomena of this promising material.


title: Low-coherence optical diffraction tomography using a ferroelectric liquid crystal spatial light modulator

abstract: Optical diffraction tomography (ODT) is a three-dimensional (3D) label-free imaging technique. The 3D refractive index distribution of a sample can be reconstructed from multiple two-dimensional optical field images via ODT. Herein, we introduce a temporally low-coherence ODT technique using a ferroelectric liquid crystal spatial light modulator (FLC SLM). The fast binary-phase modulation provided by the FLC SLM ensures a high spatiotemporal resolution with considerably reduced coherent noise. We demonstrate the performance of the proposed system using various samples, including colloidal microspheres and live epithelial cells.


title: A Knowledge Graph for Assessing Aggressive Tax Planning Strategies

abstract: The taxation of multi-national companies is a complex field, since it is influenced by the legislation of several states. Laws in different states may have unforeseen interaction effects, which can be exploited by allowing multinational companies to minimize taxes, a concept known as tax planning. In this paper, we present a knowledge graph of multinational companies and their relationships, comprising almost 1.5M business entities. We show that commonly known tax planning strategies can be formulated as subgraph queries to that graph, which allows for identifying companies using certain strategies. Moreover, we demonstrate that we can identify anomalies in the graph which hint at potential tax planning strategies, and we show how to enhance those analyses by incorporating information from Wikidata using federated queries.


title: Walking on TacTip toes: A tactile sensing foot for walking robots

abstract: Little research into tactile feet has been done for walking robots despite the benefits such feedback could give when walking on uneven terrain. This paper describes the development of a simple, robust and inexpensive tactile foot for legged robots based on a high-resolution biomimetic TacTip tactile sensor. Several design improvements were made to facilitate tactile sensing while walking, including the use of phosphorescent markers to remove the need for internal LED lighting. The usefulness of the foot is verified on a quadrupedal robot performing a beam walking task and it is found the sensor prevents the robot falling off the beam. Further, this capability also enables the robot to walk along the edge of a curved table. This tactile foot design can be easily modified for use with any legged robot, including much larger walking robots, enabling stable walking in challenging terrain.


title: Rule-based Anomaly Detection for Railway Signalling Networks

abstract: We propose a rule-based anomaly detection system for railway signalling that mitigates attacks by a Dolev-Yao attacker who is able to inject control commands and to perform semantic attacks. The system as well mitigates the effects of a compromised signal box that an attacker uses to issue licit but mistimed control messages. We consider an attacker that could cause train derailments and collisions, if our countermeasure is not employed. We apply safety principles of railway operation to a distributed anomaly detection system that inspects incoming commands on the signals and points. The proposed anomaly detection system detects all attacks of our model without producing false positives, while it requires only a small amount of overhead in terms of network communication and latency compared to normal train operation.


title: PAM:Point-wise Attention Module for 6D Object Pose Estimation

abstract: 6D pose estimation refers to object recognition and estimation of 3D rotation and 3D translation. The key technology for estimating 6D pose is to estimate pose by extracting enough features to find pose in any environment. Previous methods utilized depth information in the refinement process or were designed as a heterogeneous architecture for each data space to extract feature. However, these methods are limited in that they cannot extract sufficient feature. Therefore, this paper proposes a Point Attention Module that can efficiently extract powerful feature from RGB-D. In our Module, attention map is formed through a Geometric Attention Path(GAP) and Channel Attention Path(CAP). In GAP, it is designed to pay attention to important information in geometric information, and CAP is designed to pay attention to important information in Channel information. We show that the attention module efficiently creates feature representations without significantly increasing computational complexity. Experimental results show that the proposed method outperforms the existing methods in benchmarks, YCB Video and LineMod. In addition, the attention module was applied to the classification task, and it was confirmed that the performance significantly improved compared to the existing model.


title: Efficient construction of tensor-network representations of many-body Gaussian states

abstract: We present a procedure to construct tensor-network representations of many-body Gaussian states efficiently and with a controllable error. These states include the ground and thermal states of bosonic and fermionic quadratic Hamiltonians, which are essential in the study of quantum many-body systems. The procedure improves computational time requirements for constructing many-body Gaussian states by up to five orders of magnitude for reasonable parameter values, thus allowing simulations beyond the range of what was hitherto feasible. Our procedure combines ideas from the theory of Gaussian quantum information with tensor-network based numerical methods thereby opening the possibility of exploiting the rich tool-kit of Gaussian methods in tensor-network simulations.


title: The Orbital Mechanics of Space Elevator Launch Systems

abstract: The construction of a space elevator would be an inspiring feat of planetary engineering of immense cost and risk. But would the benefit outweigh the costs and risks? What, precisely, is the purpose for building such a structure? For example, what if the space elevator could provide propellant-free (free release) orbital transfer to every planet in the solar system and beyond on a daily basis? In our view, this benefit might outweigh the costs and risks. But can a space elevator provide such a service? In this manuscript, we examine 3 tiers of space elevator launch system design and provide a detailed mathematical analysis of the orbital mechanics of spacecraft utilizing such designs. We find the limiting factor in all designs is the problem of transition to the ecliptic plane. For Tiers 1 and 2, we find that free release transfers to all the outer planets is possible, achieving velocities far beyond the ability of current Earth-based rocket technology, but with significant gaps in coverage due to planetary alignment. For Tier 3 elevators, however, we find that fast free release transfers to all planets in the solar system is possible on a daily basis. Finally, we show that Tier 2 and 3 space elevators can potentially use counterweights to perform staged slingshot maneuvers, providing a velocity multiplier which could dramatically reduce transit times to outer planets and interstellar destinations.


title: Covid-19 and Flattening the Curve: a Feedback Control Perspective

abstract: Many of the control policies that were put into place during the Covid-19 pandemic had a common goal: to flatten the curve of the number of infected people so that its peak remains under a critical threshold. This letter considers the challenge of engineering a strategy that enforces such a goal using control theory. We introduce a simple formulation of the optimal flattening problem, and provide a closed form solution.This is augmented through nonlinear closed loop tracking of the nominal solution, with the aim of ensuring close-to-optimal performance under uncertain conditions. A key contribution ofthis paper is to provide validation of the method with extensive and realistic simulations in a Covid-19 scenario, with particular focus on the case of Codogno - a small city in Northern Italy that has been among the most harshly hit by the pandemic.


title: Thermodynamics of dilute Bose gases: Beyond mean-field theory for binary mixtures of Bose-Einstein condensate

abstract: We study the thermodynamic properties of binary Bose mixtures, by developing a beyond mean-field Popov theory which properly includes the effects of quantum and thermal fluctuations in both the density and spin channels. Results for key thermodynamic quantities, such as the isothermal compressibility and the magnetic susceptibility, are derived from a perturbative calculation of the grand-canonical potential. We find that thermal fluctuations can play a crucial role on the miscibility condition of a binary mixture, favoring phase separation at finite temperature even if the mixture is soluble at zero temperature, as already anticipated in a previous work [Ota et al., Phys. Rev. Lett. 123, 075301 (2019)]. We further investigate the miscibility condition for binary mixtures in the presence of asymmetry in the intra-species interactions, as well as in the masses of the two components. Furthermore, we discuss the superfluid behavior of the mixture and the temperature dependence of the Andreev-Bashkin effect.


title: Learning to Learn from Mistakes: Robust Optimization for Adversarial Noise

abstract: Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most compelling defense, adversarial training, requires a substantial increase in processing time and it has been shown to overfit on the training data. In this paper, we aim to overcome these limitations by training robust models in low data regimes and transfer adversarial knowledge between different models. We train a meta-optimizer which learns to robustly optimize a model using adversarial examples and is able to transfer the knowledge learned to new models, without the need to generate new adversarial examples. Experimental results show the meta-optimizer is consistent across different architectures and data sets, suggesting it is possible to automatically patch adversarial vulnerabilities.


title: Null-sampling for Interpretable and Fair Representations

abstract: We propose to learn invariant representations, in the data domain, to achieve interpretability in algorithmic fairness. Invariance implies a selectivity for high level, relevant correlations w.r.t. class label annotations, and a robustness to irrelevant correlations with protected characteristics such as race or gender. We introduce a non-trivial setup in which the training set exhibits a strong bias such that class label annotations are irrelevant and spurious correlations cannot be distinguished. To address this problem, we introduce an adversarially trained model with a null-sampling procedure to produce invariant representations in the data domain. To enable disentanglement, a partially-labelled representative set is used. By placing the representations into the data domain, the changes made by the model are easily examinable by human auditors. We show the effectiveness of our method on both image and tabular datasets: Coloured MNIST, the CelebA and the Adult dataset.


title: Enhanced energy storage density by reversible domain switching in acceptor doped ferroelectrics

abstract: Typical ferroelectrics possess a large spontaneous polarization Ps but simultaneously a large remnant polarization Pr as well, resulting in an inferior energy storage density.A mechanism that can reduce the Pr while maintain the Ps is demanded to enhance the energy storage property of ferroelectrics.In the present study, it is shown that after acceptor doping and aging treatment, the domain switching in ferroelectrics becomes reversible, giving rise to a pinched double hysteresis loop. The pinched loop with a large Ps and a small Pr thus results in an enhanced energy storage density. The physics behind is a defect induced internal field that provides a restoring force for the domains to switch back.The idea is demonstrated through a time-dependent Ginzburg-Landau simulation as well as experimental measurements in BaTiO$_3$ based single crystal and ceramics. The mechanism is general and can be applied to various ferroelectrics, especially the environment-friendly ones.


title: Optimizing fire allocation in a NCW-type model

abstract: In this paper, we introduce a non-linear Lanchester model of NCW-type and investigate an optimization problem for this model, where only the Red force is supplied by several supply agents. Optimal fire allocation of the Blue force is sought in the form of a piece-wise constant function of time. A threatening rate is computed for the Red force and each of its supply agents at the beginning of each stage of the combat. These rates can be used to derive the optimal decision for the Blue force to focus its firepower to the Red force itself or one of its supply agents. This optimal fire allocation is derived and proved by considering an optimization problem of number of Blue force troops. Numerical experiments are included to demonstrate the theoretical results.


title: Assisted Teleoperation in Changing Environments with a Mixture of Virtual Guides

abstract: Haptic guidance is a powerful technique to combine the strengths of humans and autonomous systems for teleoperation. The autonomous system can provide haptic cues to enable the operator to perform precise movements; the operator can interfere with the plan of the autonomous system leveraging his/her superior cognitive capabilities. However, providing haptic cues such that the individual strengths are not impaired is challenging because low forces provide little guidance, whereas strong forces can hinder the operator in realizing his/her plan. Based on variational inference, we learn a Gaussian mixture model (GMM) over trajectories to accomplish a given task. The learned GMM is used to construct a potential field which determines the haptic cues. The potential field smoothly changes during teleoperation based on our updated belief over the plans and their respective phases. Furthermore, new plans are learned online when the operator does not follow any of the proposed plans, or after changes in the environment. User studies confirm that our framework helps users perform teleoperation tasks more accurately than without haptic cues and, in some cases, faster. Moreover, we demonstrate the use of our framework to help a subject teleoperate a 7 DoF manipulator in a pick-and-place task.


title: Vortical Reflection and Spiraling Fermi Arcs with Weyl Metamaterials

abstract: Scatterings and transport in Weyl semimetals have caught growing attention in condensed matter physics, with observables including chiral zero modes and the associated magnetoresistance and chiral magnetic effects. Measurement of electrical conductance is usually performed in these studies, which, however, cannot resolve the momentum of electrons, preventing direct observation of the phase singularities in scattering matrix associated with Weyl point. Here we experimentally demonstrate a helical phase distribution in the angle (momentum) resolved scattering matrix of electromagnetic waves in a photonic Weyl metamaterial. It further leads to spiraling Fermi arcs in an air gap sandwiched between a Weyl metamaterial and a metal plate. Benefiting from the alignment-free feature of angular vortical reflection, our findings establish a new platform in manipulating optical angular momenta with photonic Weyl systems.


title: On the number of point of given order on odd degree hyperelliptic curves

abstract: For integers $N\geq 3$ and $g\geq 1$, we study bounds on the cardinality of the set of points of order dividing $N$ lying on a hyperelliptic curve of genus $g$ embedded in its jacobian using a Weierstrass point as base point. This leads us to revisit division polynomials introduced by Cantor in 1995 and strengthen a divisibility result proved by him. Several examples are discussed.


title: Nonlinear static isogeometric analysis of arbitrarily curved Kirchhoff-Love shells

abstract: The geometrically rigorous nonlinear analysis of elastic shells is considered in the context of finite, but small, strain theory. The research is focused on the introduction of the full shell metric and examination of its influence on the nonlinear structural response. The exact relation between the reference and equidistant strains is employed and the complete analytic elastic constitutive relation between energetically conjugated forces and strains is derived via the reciprocal shift tensor. Utilizing these strict relations, the geometric stiffness matrix is derived explicitly by the variation of the unknown metric. Moreover, a compact form of this matrix is presented. Despite the linear displacement distribution due to the Kirchhoff-Love hypothesis, a nonlinear strain distribution arises along the shell thickness. This fact is sometimes disregarded for the nonlinear analysis of thin shells based on the initial geometry, thereby ignoring the strong curviness of a shell at some subsequent configuration. We show that the curviness of a shell at each configuration determines the appropriate shell formulation. For shells that become strongly curved at some configurations during deformation, the nonlinear distribution of strain throughout the thickness must be considered in order to obtain accurate results. We investigate four computational models: one based on the full analytical constitutive relation, and three simplified ones. Robustness, efficiency and accuracy of the presented formulation are examined via selected numerical experiments. Our main finding is that the employment of the full metric is often required when the complete response of the shells is sought, even for the initially thin shells. Finally, the simplified model that provided the best balance between efficiency and accuracy is suggested for the nonlinear analysis of strongly curved shells.


title: Identity-Aware Attribute Recognition via Real-Time Distributed Inference in Mobile Edge Clouds

abstract: With the development of deep learning technologies, attribute recognition and person re-identification (re-ID) have attracted extensive attention and achieved continuous improvement via executing computing-intensive deep neural networks in cloud datacenters. However, the datacenter deployment cannot meet the real-time requirement of attribute recognition and person re-ID, due to the prohibitive delay of backhaul networks and large data transmissions from cameras to datacenters. A feasible solution thus is to employ mobile edge clouds (MEC) within the proximity of cameras and enable distributed inference. In this paper, we design novel models for pedestrian attribute recognition with re-ID in an MEC-enabled camera monitoring system. We also investigate the problem of distributed inference in the MEC-enabled camera network. To this end, we first propose a novel inference framework with a set of distributed modules, by jointly considering the attribute recognition and person re-ID. We then devise a learning-based algorithm for the distributions of the modules of the proposed distributed inference framework, considering the dynamic MEC-enabled camera network with uncertainties. We finally evaluate the performance of the proposed algorithm by both simulations with real datasets and system implementation in a real testbed. Evaluation results show that the performance of the proposed algorithm with distributed inference framework is promising, by reaching the accuracies of attribute recognition and person identification up to 92.9% and 96.6% respectively, and significantly reducing the inference delay by at least 40.6% compared with existing methods.


title: On Segal--Sugawara vectors and Casimir elements for classical Lie algebras

abstract: We consider the centers of the affine vertex algebras at the critical level associated with simple Lie algebras. We derive new formulas for generators of the centers in the classical types. We also give a new formula for the Capelli-type determinant for the symplectic Lie algebras and calculate the Harish-Chandra images of the Casimir elements arising from the characteristic polynomial of the matrix of generators of each classical Lie algebra.


title: Mechanical pressure and work cycle of confined active Brownian particles

abstract: We derive an analytic expression for the mechanical pressure of a generic one-dimensional model of confined active Brownian particles (ABPs) that is valid for all values of Peclet number Pe and all confining scenarios. Our model reproduces the known scaling of bulk pressure with Pe^2 while in strong confinement pressure scales with Pe. Our analytic results are very well reproduced by simulations of ABPs in 2D. We use the pressure formula to calculate both the work performed by an active engine and its efficiency. In particular, efficiency is maximized for work cycles with finite period and not in the limit of infinitely slow cycles as in thermodynamic engines.


title: Guided Collaborative Training for Pixel-wise Semi-Supervised Learning

abstract: We investigate the generalization of semi-supervised learning (SSL) to diverse pixel-wise tasks. Although SSL methods have achieved impressive results in image classification, the performances of applying them to pixel-wise tasks are unsatisfactory due to their need for dense outputs. In addition, existing pixel-wise SSL approaches are only suitable for certain tasks as they usually require to use task-specific properties. In this paper, we present a new SSL framework, named Guided Collaborative Training (GCT), for pixel-wise tasks, with two main technical contributions. First, GCT addresses the issues caused by the dense outputs through a novel flaw detector. Second, the modules in GCT learn from unlabeled data collaboratively through two newly proposed constraints that are independent of task-specific properties. As a result, GCT can be applied to a wide range of pixel-wise tasks without structural adaptation. Our extensive experiments on four challenging vision tasks, including semantic segmentation, real image denoising, portrait image matting, and night image enhancement, show that GCT outperforms state-of-the-art SSL methods by a large margin. Our code available at: https://github.com/ZHKKKe/PixelSSL.


title: Emotion Profile Refinery for Speech Emotion Classification

abstract: Human emotions are inherently ambiguous and impure. When designing systems to anticipate human emotions based on speech, the lack of emotional purity must be considered. However, most of the current methods for speech emotion classification rest on the consensus, e.g., one single hard label for an utterance. This labeling principle imposes challenges for system performance considering emotional impurity. In this paper, we recommend the use of emotional profiles (EPs), which provides a time series of segment-level soft labels to capture the subtle blends of emotional cues present across a specific speech utterance. We further propose the emotion profile refinery (EPR), an iterative procedure to update EPs. The EPR method produces soft, dynamically-generated, multiple probabilistic class labels during successive stages of refinement, which results in significant improvements in the model accuracy. Experiments on three well-known emotion corpora show noticeable gain using the proposed method.


title: Dictionary of 140k GDB and ZINC derived AMONs

abstract: We present all {\bf A}mons for {\bf G}DB and {\bf Z}inc data-bases using no more than 7 non-hydrogen atoms (AGZ7)---a calculated organic chemistry building-block dictionary based on the AMON approach [Huang and von Lilienfeld, {\em Nature Chemistry} (2020)]. AGZ7 records Cartesian coordinates of compositional and constitutional isomers, as well as properties for $\sim$140k small organic molecules obtained by systematically fragmenting all molecules of Zinc and the majority of GDB17 into smaller entities, saturating with hydrogens, and containing no more than 7 heavy atoms (excluding hydrogen atoms). AGZ7 cover the elements \{H, B, C, N, O, F, Si, P, S, Cl, Br, Sn and I\} and includes optimized geometries, total energy and its decomposition, Mulliken atomic charges, dipole moment vectors, quadrupole tensors, electronic spatial extent, eigenvalues of all occupied orbitals, LUMO, gap, isotropic polarizability, harmonic frequencies, reduced masses, force constants, IR intensity, normal coordinates, rotational constants, zero-point energy, internal energy, enthalpy, entropy, free energy, and heat capacity (all at ambient conditions) using B3LYP/cc-pVTZ (pseudopotentials were used for Sn and I) level of theory. We exemplify the usefulness of this data set with AMON based machine learning models of total potential energy predictions of seven of the most rigid GDB-17 molecules.


title: Vindication, Virtue and Vitriol: A study of online engagement and abuse toward British MPs during the COVID-19 Pandemic

abstract: COVID-19 has given rise to malicious content online, including online abuse and hate toward British MPs. In order to understand and contextualise the level of abuse MPs receive, we consider how ministers use social media to communicate about the crisis, and the citizen engagement that this generates. The focus of the paper is on a large-scale, mixed methods study of abusive and antagonistic responses to UK politicians during the pandemic from early February to late May 2020. We find that pressing subjects such as financial concerns attract high levels of engagement, but not necessarily abusive dialogue. Rather, criticising authorities appears to attract higher levels of abuse. In particular, those who carry the flame for subjects like racism and inequality, may be accused of virtue signalling or receive higher abuse levels due to the topics they are required by their role to address. This work contributes to the wider understanding of abusive language online, in particular that which is directed at public officials.


title: The Topology of Shapes Made with Points

abstract: In architecture, city planning, visual arts, and other design areas, shapes are often made with points, or with structural representations based on point-sets. Shapes made with points can be understood more generally as finite arrangements formed with elements (i.e. points) of the algebra of shapes $U_i$, for $i = 0$. This paper examines the kind of topology that is applicable to such shapes. From a mathematical standpoint, any "shape made with points" is equivalent to a finite space, so that topology on a shape made with points is no different than topology on a finite space: the study of topological structure naturally coincides with the study of preorder relations on the points of the shape. After establishing this fact, some connections between the topology of shapes made with points and the topology of "point-free" pictorial shapes (when $i > 0$) are discussed and the main differences between the two are summarized.