title: Model selection in the average of inconsistent data: an analysis of the measured Planck-constant values

abstract: When the data do not conform to the hypothesis of a known sampling-variance, the fitting of a constant to a set of measured values is a long debated problem. Given the data, fitting would require to find what measurand value is the most trustworthy. Bayesian inference is here reviewed, to assign probabilities to the possible measurand values. Different hypothesis about the data variance are tested by Bayesian model comparison. Eventually, model selection is exemplified in deriving an estimate of the Planck constant.


title: Maximal-entropy driven determination of weights in least-square approximation

abstract: We exploit the idea to use the maximal-entropy method, successfully tested in information theory and statistical thermodynamics, to determine approximating function's coefficients and squared errors' weights simultaneously as output of one single problem in least-square approximation. We provide evidence of the method's capabilities and performance through its application to representative test cases by working with polynomials as a first step. We conclude by formulating suggestions for future work to improve the version of the method we present in this paper.


title: 3D Computational Cannula Fluorescence Microscopy enabled by Artificial Neural Networks

abstract: Computational Cannula Microscopy (CCM) is a high-resolution widefield fluorescence imaging approach deep inside tissue, which is minimally invasive. Rather than using conventional lenses, a surgical cannula acts as a lightpipe for both excitation and fluorescence emission, where computational methods are used for image visualization. Here, we enhance CCM with artificial neural networks to enable 3D imaging of cultured neurons and fluorescent beads, the latter inside a volumetric phantom. We experimentally demonstrate transverse resolution of ~6um, field of view ~200um and axial sectioning of ~50um for depths down to ~700um, all achieved with computation time of ~3ms/frame on a laptop computer.


title: DDR-ID: Dual Deep Reconstruction Networks Based Image Decomposition for Anomaly Detection

abstract: One pivot challenge for image anomaly (AD) detection is to learn discriminative information only from normal class training images. Most image reconstruction based AD methods rely on the discriminative capability of reconstruction error. This is heuristic as image reconstruction is unsupervised without incorporating normal-class-specific information. In this paper, we propose an AD method called dual deep reconstruction networks based image decomposition (DDR-ID). The networks are trained by jointly optimizing for three losses: the one-class loss, the latent space constrain loss and the reconstruction loss. After training, DDR-ID can decompose an unseen image into its normal class and the residual components, respectively. Two anomaly scores are calculated to quantify the anomalous degree of the image in either normal class latent space or reconstruction image space. Thereby, anomaly detection can be performed via thresholding the anomaly score. The experiments demonstrate that DDR-ID outperforms multiple related benchmarking methods in image anomaly detection using MNIST, CIFAR-10 and Endosome datasets and adversarial attack detection using GTSRB dataset.


title: NGC 90: a hidden jelly-fish galaxy?

abstract: We study a peculiar galaxy NGC 90, a pair member of interacting system Arp 65 (NGC 90/93), using the long-slit spectral observations carried out at the Russian 6m telescope BTA and the available SDSS photometric data. This galaxy demonstrates two tidal tails containing young stellar population, being an extension of its `Grand Design' spiral arms. We obtained the distribution of velocity and oxygen abundance of emission gas (O/H) for two slit orientations. In the central part of the galaxy a significant role belongs to non-photoionization mechanism of line emission probably caused by shocks due to LINER-like activity of the nucleus. The O/H has a shallow abundance gradient, typical for interacting galaxies. The most intriguing peculiarity of the galaxy is the presence of the discovered earlier huge HI `cloud' containing about half of total mass of galaxy gas, which is strongly displaced outwards and has a velocity exceeding at about 340 km/s the central velocity of the main galaxy. We found traces of current star formation in the `cloud', even though the cloud is apparently not gravitationally bound with the galaxy. A possible nature of the `cloud' is discussed. We argue that it presents a flow of gas sweeping by ram pressure and elongated along a line of sight.


title: Volumetric Transformer Networks

abstract: Existing techniques to encode spatial invariance within deep convolutional neural networks (CNNs) apply the same warping field to all the feature channels. This does not account for the fact that the individual feature channels can represent different semantic parts, which can undergo different spatial transformations w.r.t. a canonical configuration. To overcome this limitation, we introduce a learnable module, the volumetric transformer network (VTN), that predicts channel-wise warping fields so as to reconfigure intermediate CNN features spatially and channel-wisely. We design our VTN as an encoder-decoder network, with modules dedicated to letting the information flow across the feature channels, to account for the dependencies between the semantic parts. We further propose a loss function defined between the warped features of pairs of instances, which improves the localization ability of VTN. Our experiments show that VTN consistently boosts the features' representation power and consequently the networks' accuracy on fine-grained image recognition and instance-level image retrieval.


title: Symplectic Induction, Prequantum Induction, and Prequantum Multiplicities

abstract: Frobenius reciprocity asserts that induction from a subgroup and restriction to it are adjoint functors in categories of unitary G-modules. In the 1980s, Guillemin and Sternberg established a parallel property of Hamiltonian G-spaces, which (as we show) unfortunately fails to mirror the situation where more than one G-module "quantizes" a given Hamiltonian G-space. This paper offers evidence that the situation is remedied by working in the category of *prequantum* G-spaces, where this ambiguity disappears; there, we define induction and multiplicity spaces, and establish Frobenius reciprocity as well as the "induction in stages" property.


title: Multilevel Motion Planning: A Fiber Bundle Formulation

abstract: High-dimensional motion planning problems can often be solved significantly faster by using multilevel abstractions. While there are various ways to formally capture multilevel abstractions, we formulate them in terms of fiber bundles. Fiber bundles essentially describe lower-dimensional projections of the state space using local product spaces, which allows us to concisely describe and derive novel algorithms in terms of bundle restrictions and bundle sections. Given such a structure and a corresponding admissible constraint function, we develop highly efficient and asymptotically-optimal sampling-based motion planning methods for high-dimensional state spaces. Those methods exploit the structure of fiber bundles through the use of bundle primitives. Those primitives are used to create novel bundle planners, the rapidly-exploring quotient-space trees (QRRT*), and the quotient-space roadmap planner (QMP*). Both planners are shown to be probabilistically complete and almost-surely asymptotically optimal. To evaluate our bundle planners, we compare them against classical sampling-based planners on benchmarks of four low-dimensional scenarios, and eight high-dimensional scenarios, ranging from 21 to 100 degrees of freedom, including multiple robots and nonholonomic constraints. Our findings show improvements up to 2 to 6 orders of magnitude and underline the efficiency of multilevel motion planners and the benefit of exploiting multilevel abstractions using the terminology of fiber bundles.


title: PaSh: Light-touch Data-Parallel Shell Processing

abstract: This paper presents {\scshape PaSh}, a system for parallelizing POSIX shell scripts. Given a script, {\scshape PaSh} converts it to a dataflow graph, performs a series of semantics-preserving program transformations that expose parallelism, and then converts the dataflow graph back into a script -- one that adds POSIX constructs to explicitly guide parallelism coupled with {\scshape PaSh}-provided {\scshape Unix}-aware runtime primitives for addressing performance- and correctness-related issues. A lightweight annotation language allows command developers to express key parallelizability properties about their commands. An accompanying parallelizability study of POSIX and GNU commands -- two large and commonly used groups -- guides the annotation language and optimized aggregator library that {\scshape PaSh} uses. Finally, {\scshape PaSh}'s {\scshape PaSh}'s extensive evaluation over 44 unmodified {\scshape Unix} scripts shows significant speedups ($0.89$--$61.1\times$, avg: $6.7\times$) stemming from the combination of its program transformations and runtime primitives.


title: The spring bounces back: Introducing the Strain Elevation Tension Spring embedding algorithm for network representation

abstract: This paper introduces the Strain Elevation Tension Spring embedding (SETSe) algorithm, a graph embedding method that uses a physics model to create node and edge embeddings in undirected attribute networks. Using a low-dimensional representation, SETSe is able to differentiate between graphs that are designed to appear identical using standard network metrics such as number of nodes, number of edges and assortativity. The embeddings generated position the nodes such that sub-classes, hidden during the embedding process, are linearly separable, due to the way they connect to the rest of the network. SETSe outperforms five other common graph embedding methods on both graph differentiation and sub-class identification. The technique is applied to social network data, showing its advantages over assortativity as well as SETSe's ability to quantify network structure and predict node type. The algorithm has a convergence complexity of around $\mathcal{O}(n^2)$, and the iteration speed is linear ($\mathcal{O}(n)$), as is memory complexity. Overall, SETSe is a fast, flexible framework for a variety of network and graph tasks, providing analytical insight and simple visualisation for complex systems.


title: Few-Shot Defect Segmentation Leveraging Abundant Normal Training Samples Through Normal Background Regularization and Crop-and-Paste Operation

abstract: In industrial product quality assessment, it is essential to determine whether a product is defect-free and further analyze the severity of anomality. To this end, accurate defect segmentation on images of products provides an important functionality. In industrial inspection tasks, it is common to capture abundant defect-free image samples but very limited anomalous ones. Therefore, it is critical to develop automatic and accurate defect segmentation systems using only a small number of annotated anomalous training images. This paper tackles the challenging few-shot defect segmentation task with sufficient normal (defect-free) training images but very few anomalous ones. We present two effective regularization techniques via incorporating abundant defect-free images into the training of a UNet-like encoder-decoder defect segmentation network. We first propose a Normal Background Regularization (NBR) loss which is jointly minimized with the segmentation loss, enhancing the encoder network to produce distinctive representations for normal regions. Secondly, we crop/paste defective regions to the randomly selected normal images for data augmentation and propose a weighted binary cross-entropy loss to enhance the training by emphasizing more realistic crop-and-pasted augmented images based on feature-level similarity comparison. Both techniques are implemented on an encoder-decoder segmentation network backboned by ResNet-34 for few-shot defect segmentation. Extensive experiments are conducted on the recently released MVTec Anomaly Detection dataset with high-resolution industrial images. Under both 1-shot and 5-shot defect segmentation settings, the proposed method significantly outperforms several benchmarking methods.


title: Minimal surfaces in three-dimensional Matsumoto space

abstract: In this paper we consider the Matsumoto metric $F=\frac{\alpha^2}{\alpha-\beta}$, on the three dimensional real vector space and obtain the partial differential equations that characterize the minimal surfaces which are graphs of smooth functions and then we prove that plane is the only such surface. We also obtain the partial differential equation that characterizes the minimal translation surfaces and show that again plane is the only such surface.


title: $\mathcal{O}$-Operators on Hom-Lie algebras

abstract: $\mathcal{O}$-operators (also known as relative Rota-Baxter operators) on Lie algebras have several applications in integrable systems and the classical Yang-Baxter equations. In this article, we study $\mathcal{O}$-operators on hom-Lie algebras. We define cochain complex for $\mathcal{O}$-operators on hom-Lie algebras with respect to a representation. Any $\mathcal{O}$-operator induces a hom-pre-Lie algebra structure. We express the cochain complex of an $\mathcal{O}$-operator in terms of certain hom-Lie algebra cochain complex of the sub-adjacent hom-Lie algebra associated with the induced hom-pre-Lie algebra. If the structure maps in a hom-Lie algebra and its representation are invertible, then we can extend the above cochain complex to a deformation complex for $\mathcal{O}$-operators by adding the space of zero cochains. Subsequently, we study linear and formal deformations of $\mathcal{O}$-operators on hom-Lie algebras in terms of the deformation cohomology. In the end, we deduce deformations of $s$-Rota-Baxter operators (of weight 0) and skew-symmetric $r$-matrices on hom-Lie algebras as particular cases of $\mathcal{O}$-operators on hom-Lie algebras.


title: Optimal Consensus for Uncertain High-order Multi-agent Systems by Output Feedback

abstract: The distributed optimal output consensus problem for high-order multi-agent systems has been studied recently. In this paper, we further focus on the same problem for high-order multi-agent systems subject to parametric uncertainties and aim at distributed robust controllers by measurement output feedback. We first develop a dynamic compensator to estimate the expected optimal consensus point and convert the problem into several decentralized robust tracking problems. Then, by combining the integral control technique and dirty derivative observer technique, we constructively propose a distributed output feedback integral controller to solve this problem under a mild graph connectivity condition.


title: Ground State Properties in the Quasi-Classical Regime

abstract: We study the ground state energy and ground states of systems coupling non-relativistic quantum particles and force-carrying Bose fields, such as radiation, in the quasi-classical approximation. The latter is very useful whenever the force-carrying field has a very large number of excitations,and thus behaves in a semiclassical way, while the non-relativistic particles, on the other hand, retain their microscopic features. We prove that the ground state energy of the fully microscopic model converges to the one of a nonlinear quasi-classical functional depending on both the particles' wave function and the classical configuration of the field. Equivalently, this energy can be interpreted as the lowest energy of a Pekar-like functional with an effective nonlinear interaction for the particles only. If the particles are confined, the ground state of the microscopic system converges as well, to a probability measure concentrated on the set of minimizers of the quasi-classical energy.


title: On Virtually Cohen-Macaulay Simplicial Complexes

abstract: We examine virtual resolutions of Stanley-Reisner ideals for a product of projective spaces. In particular, we provide sufficient conditions for a simplicial complex to be virtually Cohen-Macaulay (to have a virtual resolution with length equal to its codimension). We also show that all balanced simplicial complexes are virtually Cohen-Macaulay.


title: Categorification of VB-Lie algebroids and VB-Courant algebroids

abstract: In this paper, first we introduce the notion of a $\VB$-Lie $2$-algebroid, which can be viewed as the categorification of a $\VB$-Lie algebroid. The tangent prolongation of a Lie $2$-algebroid is a $\VB$-Lie $2$-algebroid naturally. We show that after choosing a splitting, there is a one-to-one correspondence between $\VB$-Lie $2$-algebroids and flat superconnections of a Lie 2-algebroid on a 3-term complex of vector bundles. Then we introduce the notion of a $\VB$-$\LWX$ 2-algebroid, which can be viewed as the categorification of a $\VB$-Courant algebroid. We show that there is a one-to-one correspondence between split Lie 3-algebroids and split $\VB$-$\LWX$ 2-algebroids. The notion of a $\VB$-Lie $2$-bialgebroid is introduced and the double of a $\VB$-Lie $2$-bialgebroid is a $\VB$-$\LWX$ 2-algebroid. Finally, we introduce the notion of an $E$-$\LWX$ 2-algebroid and show that associated to a $\VB$-$\LWX$ 2-algebroid, there is an $E$-$\LWX$ 2-algebroid structure on the graded fat bundle naturally. By this result, we give a construction of a Lie 3-algebra from a given Lie 3-algebra, which provides interesting examples of Lie 3-algebras including the higher analogue of the string Lie 2-algebra.


title: Structure Mapping for Transferability of Causal Models

abstract: Human beings learn causal models and constantly use them to transfer knowledge between similar environments. We use this intuition to design a transfer-learning framework using object-oriented representations to learn the causal relationships between objects. A learned causal dynamics model can be used to transfer between variants of an environment with exchangeable perceptual features among objects but with the same underlying causal dynamics. We adapt continuous optimization for structure learning techniques to explicitly learn the cause and effects of the actions in an interactive environment and transfer to the target domain by categorization of the objects based on causal knowledge. We demonstrate the advantages of our approach in a gridworld setting by combining causal model-based approach with model-free approach in reinforcement learning.


title: Global Existence of Weak Solutions to a Signal-dependent Keller-Segel Model for Local Sensing Chemotaxis

abstract: This paper is devoted to global existence of weak solutions to the following degenerate kinetic model of chemotaxis \begin{equation} \begin{cases}\label{chemo0} u_t=\Delta (\gamma (v)u) \tau v_{t}=\Delta v-v+u \end{cases} \end{equation}in a smooth bounded domain with no-flux boundary conditions. The problem features a positive signal-dependent motility function $\gamma(\cdot)$ which may vanish as $v$ becomes unbounded. In this paper, we first modify the comparison approach developed recently in \cite{GM,GM2} to derive the upper bounds of $v$ under weakened assumptions on $\gamma(\cdot)$. Then by introducing a suitable approximation scheme which is compatible with the comparison method, we establish the global existence of weak solutions in any spatial dimension via compactness argument. Our weak solution has higher regularity than those obtained in previous literature.


title: Holographic immunoassays

abstract: The size of a probe bead reported by holographic particle characterization depends on the proportion of the surface area covered by bound target molecules and so can be used as an assay for molecular binding. We validate this technique by measuring the kinetics of irreversible binding for the antibodies immunoglobulin G (IgG) and immunoglobulin M (IgM) as they attach to micrometer-diameter colloidal beads coated with protein A. These measurements yield the antibodies' binding rates and can be inverted to obtain the concentration of antibodies in solution. Holographic molecular binding assays therefore can be used to perform fast quantitative immunoassays that are complementary to conventional serological tests.


title: Towards Emergent Language Symbolic Semantic Segmentation and Model Interpretability

abstract: Recent advances in methods focused on the grounding problem have resulted in techniques that can be used to construct a symbolic language associated with a specific domain. Inspired by how humans communicate complex ideas through language, we developed a generalized Symbolic Semantic ($\text{S}^2$) framework for interpretable segmentation. Unlike adversarial models (e.g., GANs), we explicitly model cooperation between two agents, a Sender and a Receiver, that must cooperate to achieve a common goal. The Sender receives information from a high layer of a segmentation network and generates a symbolic sentence derived from a categorical distribution. The Receiver obtains the symbolic sentences and co-generates the segmentation mask. In order for the model to converge, the Sender and Receiver must learn to communicate using a private language. We apply our architecture to segment tumors in the TCGA dataset. A UNet-like architecture is used to generate input to the Sender network which produces a symbolic sentence, and a Receiver network co-generates the segmentation mask based on the sentence. Our Segmentation framework achieved similar or better performance compared with state-of-the-art segmentation methods. In addition, our results suggest direct interpretation of the symbolic sentences to discriminate between normal and tumor tissue, tumor morphology, and other image characteristics.


title: A generalization of the Newton-Puiseux algorithm for semistable models

abstract: In this paper we give an algorithm that calculates the skeleton of a tame covering of curves over a complete discretely valued field. The algorithm relies on the {{tame simultaneous semistable reduction theorem}}, for which we give a short proof. To use this theorem in practice, we show that we can find extensions of chains of prime ideals in normalizations using compatible power series. This allows us to reconstruct the skeleton of the covering. In studying the connections between power series and extensions of prime ideals, we obtain generalizations of classical theorems from number theory such as the Kummer-Dedekind theorem and Dedekind's theorem for cycles in Galois groups.


title: Analysis of Bayesian Networks via Prob-Solvable Loops

abstract: Prob-solvable loops are probabilistic programs with polynomial assignments over random variables and parametrised distributions, for which the full automation of moment-based invariant generation is decidable. In this paper we extend Prob-solvable loops with new features essential for encoding Bayesian networks (BNs). We show that various BNs, such as discrete, Gaussian, conditional linear Gaussian and dynamic BNs, can be naturally encoded as Prob-solvable loops. Thanks to these encodings, we can automatically solve several BN related problems, including exact inference, sensitivity analysis, filtering and computing the expected number of rejecting samples in sampling-based procedures. We evaluate our work on a number of BN benchmarks, using automated invariant generation within Prob-solvable loop analysis.


title: Feature Pyramid Transformer

abstract: Feature interactions across space and scales underpin modern visual recognition systems because they introduce beneficial visual contexts. Conventionally, spatial contexts are passively hidden in the CNN's increasing receptive fields or actively encoded by non-local convolution. Yet, the non-local spatial interactions are not across scales, and thus they fail to capture the non-local contexts of objects (or parts) residing in different scales. To this end, we propose a fully active feature interaction across both space and scales, called Feature Pyramid Transformer (FPT). It transforms any feature pyramid into another feature pyramid of the same size but with richer contexts, by using three specially designed transformers in self-level, top-down, and bottom-up interaction fashion. FPT serves as a generic visual backbone with fair computational overhead. We conduct extensive experiments in both instance-level (i.e., object detection and instance segmentation) and pixel-level segmentation tasks, using various backbones and head networks, and observe consistent improvement over all the baselines and the state-of-the-art methods.


title: Achieving Optimal Output Consensus for Discrete-time Linear Multi-agent Systems with Disturbance Rejection

abstract: In this paper, an optimal output consensus problem is studied for discrete-time linear multiagent systems subject to external disturbances. Each agent is assigned with a local cost function which is known only to itself. Distributed protocols are to be designed to guarantee an output consensus for these high-order agents and meanwhile minimize the aggregate cost as the sum of these local costs. To overcome the difficulties brought by high-order dynamics and external disturbances, we develop an embedded design and constructively present a distributed rule to solve this problem. The proposed control includes three terms: an optimal signal generator under a directed information graph, an observer-based compensator to reject these disturbances, and a reference tracking controller for these linear agents. It is shown to solve the formulated problem with some mild assumptions. A numerical example is also provided to illustrate the effectiveness of our proposed distributed control laws.


title: Robust Image Classification Using A Low-Pass Activation Function and DCT Augmentation

abstract: Convolutional Neural Network's (CNN's) performance disparity on clean and corrupted datasets has recently come under scrutiny. In this work, we analyse common corruptions in the frequency domain, i.e., High Frequency corruptions (HFc, e.g., noise) and Low Frequency corruptions (LFc, e.g., blur). Although a simple solution to HFc is low-pass filtering, ReLU -- a widely used Activation Function (AF), does not have any filtering mechanism. In this work, we instill low-pass filtering into the AF (LP-ReLU) to improve robustness against HFc. To deal with LFc, we complement LP-ReLU with Discrete Cosine Transform based augmentation. LP-ReLU, coupled with DCT augmentation, enables a deep network to tackle the entire spectrum of corruption. We use CIFAR-10-C and Tiny ImageNet-C for evaluation and demonstrate improvements of 5% and 7.3% in accuracy respectively, compared to the State-Of-The-Art (SOTA). We further evaluate our method's stability on a variety of perturbations in CIFAR-10-P and Tiny ImageNet-P, achieving new SOTA in these experiments as well. To further strengthen our understanding regarding CNN's lack of robustness, a decision space visualisation process is proposed and presented in this work.


title: Face Super-Resolution Guided by 3D Facial Priors

abstract: State-of-the-art face super-resolution methods employ deep convolutional neural networks to learn a mapping between low- and high- resolution facial patterns by exploring local appearance knowledge. However, most of these methods do not well exploit facial structures and identity information, and struggle to deal with facial images that exhibit large pose variations. In this paper, we propose a novel face super-resolution method that explicitly incorporates 3D facial priors which grasp the sharp facial structures. Our work is the first to explore 3D morphable knowledge based on the fusion of parametric descriptions of face attributes (e.g., identity, facial expression, texture, illumination, and face pose). Furthermore, the priors can easily be incorporated into any network and are extremely efficient in improving the performance and accelerating the convergence speed. Firstly, a 3D face rendering branch is set up to obtain 3D priors of salient facial structures and identity knowledge. Secondly, the Spatial Attention Module is used to better exploit this hierarchical information (i.e., intensity similarity, 3D facial structure, and identity content) for the super-resolution problem. Extensive experiments demonstrate that the proposed 3D priors achieve superior face super-resolution results over the state-of-the-arts.


title: ICA-UNet: ICA Inspired Statistical UNet for Real-time 3D Cardiac Cine MRI Segmentation

abstract: Real-time cine magnetic resonance imaging (MRI) plays an increasingly important role in various cardiac interventions. In order to enable fast and accurate visual assistance, the temporal frames need to be segmented on-the-fly. However, state-of-the-art MRI segmentation methods are used either offline because of their high computation complexity, or in real-time but with significant accuracy loss and latency increase (causing visually noticeable lag). As such, they can hardly be adopted to assist visual guidance. In this work, inspired by a new interpretation of Independent Component Analysis (ICA) for learning, we propose a novel ICA-UNet for real-time 3D cardiac cine MRI segmentation. Experiments using the MICCAI ACDC 2017 dataset show that, compared with the state-of-the-arts, ICA-UNet not only achieves higher Dice scores, but also meets the real-time requirements for both throughput and latency (up to 12.6X reduction), enabling real-time guidance for cardiac interventions without visual lag.


title: On a Novel Application of Wasserstein-Procrustes for Unsupervised Cross-Lingual Learning

abstract: The emergence of unsupervised word embeddings, pre-trained on very large monolingual text corpora, is at the core of the ongoing neural revolution in Natural Language Processing (NLP). Initially introduced for English, such pre-trained word embeddings quickly emerged for a number of other languages. Subsequently, there have been a number of attempts to align the embedding spaces across languages, which could enable a number of cross-language NLP applications. Performing the alignment using unsupervised cross-lingual learning (UCL) is especially attractive as it requires little data and often rivals supervised and semi-supervised approaches. Here, we analyze popular methods for UCL and we find that often their objectives are, intrinsically, versions of the Wasserstein-Procrustes problem. Hence, we devise an approach to solve Wasserstein-Procrustes in a direct way, which can be used to refine and to improve popular UCL methods such as iterative closest point (ICP), multilingual unsupervised and supervised embeddings (MUSE) and supervised Procrustes methods. Our evaluation experiments on standard datasets show sizable improvements over these approaches. We believe that our rethinking of the Wasserstein-Procrustes problem could enable further research, thus helping to develop better algorithms for aligning word embeddings across languages. Our code and instructions to reproduce the experiments are available at https://github.com/guillemram97/wp-hungarian.


title: Compressed sensing of low-rank plus sparse matrices

abstract: Expressing a matrix as the sum of a low-rank matrix plus a sparse matrix is a flexible model capturing global and local features in data popularized as Robust PCA (Candes et al., 2011; Chandrasekaran et al., 2009). Compressed sensing, matrix completion, and their variants (Eldar and Kutyniok, 2012; Foucart and Rauhut, 2013) have established that data satisfying low complexity models can be efficiently measured and recovered from a number of measurements proportional to the model complexity rather than the ambient dimension. This manuscript develops similar guarantees showing that $m\times n$ matrices that can be expressed as the sum of a rank-$r$ matrix and a $s$-sparse matrix can be recovered by computationally tractable methods from $\mathcal{O}(r(m+n-r)+s)\log(mn/s)$ linear measurements. More specifically, we establish that the low-rank plus sparse matrix set is closed provided the incoherence of the low-rank component is upper bounded as $\mu<\sqrt{mn}/(r\sqrt{s})$, and subsequently, the restricted isometry constants for the aforementioned matrices remain bounded independent of problem size provided $p/mn$, $s/p$, and $r(m+n-r)/p$ remain fixed. Additionally, we show that semidefinite programming and two hard threshold gradient descent algorithms, NIHT and NAHT, converge to the measured matrix provided the measurement operator's RIC's are sufficiently small. These results also provably solve convex and non-convex formulation of Robust PCA with the asymptotically optimal fraction of corruptions $\alpha=\mathcal{O}\left(1/(\mu r) \right)$, where $s = \alpha^2 mn$, and improve the previously best known guarantees by not requiring that the fraction of corruptions is spread in every column and row by being upper bounded by $\alpha$. Numerical experiments illustrating these results are shown for synthetic problems, dynamic-foreground/static-background separation, and multispectral imaging.


title: Completeness of Exponentials and Beurling's Theorem on $\mathbb{R}^n$ and $\mathbb{T}^n$

abstract: A classical result of Arne Beurling states that the Fourier transform of a nonzero complex Borel measure $\mu$ on the real line cannot vanish on a set of positive Lebesgue measure if $\mu$ has certain decay. We prove a several variable analogue of Beurling's theorem by exploring its connection with the well-known problem concerning the density of linear span of exponentials in a certain weighted normed linear space of continuous functions. In the process, we also prove some new results of this genre and establish an equivalence between the above two problems. We also obtain a generalisation of Beurling's theorem and prove these results on the $n$-dimensional torus $\mathbb{T}^n.$


title: Georges Lemaitre and the Foundations of Big Bang Cosmology

abstract: Georges Lemaitre was a remarkable contributor to the advancement of cosmology in the heady years following two great revolutions in theoretical physics in the last century: general relativity and quantum mechanics. In the present century, the impact of his key publications has advanced from very little to enormous. The Big Bang universe has reigned supreme in cosmology for sixty years, during which time it has acquired paradigmatic status as the most important event in the entire history of cosmology. Lemaitre was the first cosmologist to estimate the rate of expansion of the universe, later known as the Hubble constant. In 2018 the International Astronomical Union renamed the Hubble law as the Hubble-Lemaitre law in acknowledgement of his foundational contribution to the theory of the expanding universe. This biographical review examines: (a) factors that influenced his approach to the philosophy of science, particularly cosmology; (b) his engagement with the network of contemporary cosmologists; and (c) the circumstances of his withdrawal from research in cosmology and the further promotion of the fireworks universe after the early 1930s.


title: Pristine quantum criticality in a Kondo semimetal

abstract: The observation of quantum criticality in diverse classes of strongly correlated electron systems has been instrumental in establishing ordering principles, discovering new phases, and identifying the relevant degrees of freedom and interactions. At focus so far have been insulators and metals. Semimetals, which are of great current interest as candidate phases with nontrivial topology, are much less explored in experiments. Here we study the Kondo semimetal CeRu$_4$Sn$_6$ by magnetic susceptibility, specific heat, and inelastic neutron scattering experiments. The power-law divergence of the magnetic Gr\"unesien ratio reveals that, surprisingly, this compound is quantum critical without tuning. The dynamical energy over temperature scaling in the neutron response, seen throughout the Brillouin zone, as well as the temperature dependence of the static uniform susceptibility indicate that temperature is the only energy scale in the criticality. Such behavior, which has been associated with Kondo destruction quantum criticality in metallic systems, may well be generic in the semimetal setting.


title: Controllability of reaction systems

abstract: Controlling a dynamical system is the ability of changing its configuration arbitrarily through a suitable choice of inputs. It is a very well studied concept in control theory, with wide ranging applications in medicine, biology, social sciences, engineering. We introduce in this article the concept of controllability of reaction systems as the ability of transitioning between any two states through a suitable choice of context sequences. We show that the problem is PSPACE-hard. We also introduce a model of oncogenic signalling based on reaction systems and use it to illustrate the intricacies of the controllability of reaction systems.


title: Long-time behaviors of mean-field interacting particle systems related to McKean-Vlasov equations

abstract: In this paper, we investigate gradient estimate of the Poisson equation and the exponential convergence in the Wasserstein metric $W_{1,d_{l^1}}$, uniform in the number of particles, and uniform-in-time propagation of chaos for the mean-field weakly interacting particle system related to McKean-Vlasov equation. By means of the known approximate componentwise reflection coupling and with the help of some new cost function, we obtain explicit estimates for those three problems, avoiding the technical conditions in the known results. Our results apply when the confinement potential $V$ has many wells, the interaction potential $W$ has bounded second mixed derivative $\nabla^2_{xy}W$ which should be not too big so that there is no phase transition. As an application, we obtain the concentration inequality of the mean-field interacting particle system with explicit and sharp constants, uniform in time. Several examples are provided to illustrate the results.


title: Dynamic renormalization group theory for open Floquet systems

abstract: We develop a comprehensive Renormalization Group (RG) approach to criticality in open Floquet systems, where dissipation enables the system to reach a well-defined Floquet steady state of finite entropy, and all observables are synchronized with the drive. We provide a detailed description of how to combine Keldysh and Floquet formalisms to account for the critical fluctuations in the weakly and rapidly driven regime. A key insight is that a reduction to the time-averaged, static sector, is not possible close to the critical point. This guides the design of a perturbative dynamic RG approach, which treats the time-dependent, dynamic sector associated to higher harmonics of the drive, on an equal footing with the time-averaged sector. Within this framework, we develop a weak drive expansion scheme, which enables to systematically truncate the RG flow equations in powers of the inverse drive frequency $\Omega^{-1}$. This allows us to show how a periodic drive inhibits scale invariance and critical fluctuations of second order phase transitions in rapidly driven open systems: Although criticality emerges in the limit $\Omega^{-1}=0$, any finite drive frequency produces a scale that remains finite all through the phase transition. This is a universal mechanism that relies on the competition of the critical fluctuations within the static and dynamic sectors of the problem.


title: A Bag of Visual Words Model for Medical Image Retrieval

abstract: Medical Image Retrieval is a challenging field in Visual information retrieval, due to the multi-dimensional and multi-modal context of the underlying content. Traditional models often fail to take the intrinsic characteristics of data into consideration, and have thus achieved limited accuracy when applied to medical images. The Bag of Visual Words (BoVW) is a technique that can be used to effectively represent intrinsic image features in vector space, so that applications like image classification and similar-image search can be optimized. In this paper, we present a MedIR approach based on the BoVW model for content-based medical image retrieval. As medical images as multi-dimensional, they exhibit underlying cluster and manifold information which enhances semantic relevance and allows for label uniformity. Hence, the BoVW features extracted for each image are used to train a supervised machine learning classifier based on positive and negative training images, for extending content based image retrieval. During experimental validation, the proposed model performed very well, achieving a Mean Average Precision of 88.89% during top-3 image retrieval experiments.


title: PSIGAN: Joint probabilistic segmentation and image distribution matching for unpaired cross-modality adaptation based MRI segmentation

abstract: We developed a new joint probabilistic segmentation and image distribution matching generative adversarial network (PSIGAN) for unsupervised domain adaptation (UDA) and multi-organ segmentation from magnetic resonance (MRI) images. Our UDA approach models the co-dependency between images and their segmentation as a joint probability distribution using a new structure discriminator. The structure discriminator computes structure of interest focused adversarial loss by combining the generated pseudo MRI with probabilistic segmentations produced by a simultaneously trained segmentation sub-network. The segmentation sub-network is trained using the pseudo MRI produced by the generator sub-network. This leads to a cyclical optimization of both the generator and segmentation sub-networks that are jointly trained as part of an end-to-end network. Extensive experiments and comparisons against multiple state-of-the-art methods were done on four different MRI sequences totalling 257 scans for generating multi-organ and tumor segmentation. The experiments included, (a) 20 T1-weighted (T1w) in-phase mdixon and (b) 20 T2-weighted (T2w) abdominal MRI for segmenting liver, spleen, left and right kidneys, (c) 162 T2-weighted fat suppressed head and neck MRI (T2wFS) for parotid gland segmentation, and (d) 75 T2w MRI for lung tumor segmentation. Our method achieved an overall average DSC of 0.87 on T1w and 0.90 on T2w for the abdominal organs, 0.82 on T2wFS for the parotid glands, and 0.77 on T2w MRI for lung tumors.


title: Cyberattacks on Miniature Brain Implants to Disrupt Spontaneous Neural Signaling

abstract: Brain-Computer Interfaces (BCI) arose as systems that merge computing systems with the human brain to facilitate recording, stimulation, and inhibition of neural activity. Over the years, the development of BCI technologies has shifted towards miniaturization of devices that can be seamlessly embedded into the brain and can target single neuron or small population sensing and control. We present a motivating example highlighting vulnerabilities of two promising micron-scale BCI technologies, demonstrating the lack of security and privacy principles in existing solutions. This situation opens the door to a novel family of cyberattacks, called neuronal cyberattacks, affecting neuronal signaling. This paper defines the first two neural cyberattacks, Neuronal Flooding (FLO) and Neuronal Scanning (SCA), where each threat can affect the natural activity of neurons. This work implements these attacks in a neuronal simulator to determine their impact over the spontaneous neuronal behavior, defining three metrics: number of spikes, percentage of shifts, and dispersion of spikes. Several experiments demonstrate that both cyberattacks produce a reduction of spikes compared to spontaneous behavior, generating a rise in temporal shifts and a dispersion increase. Mainly, SCA presents a higher impact than FLO in the metrics focused on the number of spikes and dispersion, where FLO is slightly more damaging, considering the percentage of shifts. Nevertheless, the intrinsic behavior of each attack generates a differentiation on how they alter neuronal signaling. FLO is adequate to generate an immediate impact on the neuronal activity, whereas SCA presents higher effectiveness for damages to the neural signaling in the long-term.


title: Black holes as Andreev reflecting mirrors

abstract: We propose a microscopic quantum description for Hawking radiation as Andreev reflections, which resolves the quantum information paradox at black hole event horizons. The detailed microscopic analysis presented here reveals how a black hole, treated as an Andreev reflecting mirror, provides a manifestly unitary description of an evaporating black hole, expanding our previous analysis presented in [PRD 96, 124011 (2017), PRD 98, 124043 (2018)]; In our analogy, a black hole resolves the information paradox by accepting particles -- pairing them with the infalling Hawking quanta into a Bardeen-Cooper-Schrieffer (BCS) like quantum ground state -- while Andreev reflecting the quantum information as encoded in outgoing Hawking radiation. The present approach goes beyond the black hole final state proposal by Horowitz and Maldacena [JHEP 02, 008 (2004)], by providing necessary microscopic details which allows us to circumvent important shortcomings of the black hole final state proposal. We also generalize the present Hamiltonian description to make an analogy to the apparent loss of quantum information possible in an Einstein-Rosen bridge, via crossed Andreev reflections.


title: Matchmaker Paxos: A Reconfigurable Consensus Protocol [Technical Report]

abstract: State machine replication protocols, like MultiPaxos and Raft, are at the heart of nearly every strongly consistent distributed database. To tolerate machine failures, these protocols must replace failed machines with live machines, a process known as reconfiguration. Reconfiguration has become increasingly important over time as the need for frequent reconfiguration has grown. Despite this, reconfiguration has largely been neglected in the literature. In this paper, we present Matchmaker Paxos and Matchmaker MultiPaxos, a reconfigurable consensus and state machine replication protocol respectively. Our protocols can perform a reconfiguration with little to no impact on the latency or throughput of command processing; they can perform a reconfiguration in one round trip (theoretically) and a few milliseconds (empirically); they provide a number of theoretical insights; and they present a framework that can be generalized to other replication protocols in a way that previous reconfiguration techniques can not. We provide proofs of correctness for the protocols and optimizations, and present empirical results from an open source implementation.


title: ESCELL: Emergent Symbolic Cellular Language

abstract: We present ESCELL, a method for developing an emergent symbolic language of communication between multiple agents reasoning about cells. We show how agents are able to cooperate and communicate successfully in the form of symbols similar to human language to accomplish a task in the form of a referential game (Lewis' signaling game). In one form of the game, a sender and a receiver observe a set of cells from 5 different cell phenotypes. The sender is told one cell is a target and is allowed to send one symbol to the receiver from a fixed arbitrary vocabulary size. The receiver relies on the information in the symbol to identify the target cell. We train the sender and receiver networks to develop an innate emergent language between themselves to accomplish this task. We observe that the networks are able to successfully identify cells from 5 different phenotypes with an accuracy of 93.2%. We also introduce a new form of the signaling game where the sender is shown one image instead of all the images that the receiver sees. The networks successfully develop an emergent language to get an identification accuracy of 77.8%.


title: Social Adaptive Module for Weakly-supervised Group Activity Recognition

abstract: This paper presents a new task named weakly-supervised group activity recognition (GAR) which differs from conventional GAR tasks in that only video-level labels are available, yet the important persons within each frame are not provided even in the training data. This eases us to collect and annotate a large-scale NBA dataset and thus raise new challenges to GAR. To mine useful information from weak supervision, we present a key insight that key instances are likely to be related to each other, and thus design a social adaptive module (SAM) to reason about key persons and frames from noisy data. Experiments show significant improvement on the NBA dataset as well as the popular volleyball dataset. In particular, our model trained on video-level annotation achieves comparable accuracy to prior algorithms which required strong labels.


title: Automated Phenotyping via Cell Auto Training (CAT) on the Cell DIVE Platform

abstract: We present a method for automatic cell classification in tissue samples using an automated training set from multiplexed immunofluorescence images. The method utilizes multiple markers stained in situ on a single tissue section on a robust hyperplex immunofluorescence platform (Cell DIVE, GE Healthcare) that provides multi-channel images allowing analysis at single cell/sub-cellular levels. The cell classification method consists of two steps: first, an automated training set from every image is generated using marker-to-cell staining information. This mimics how a pathologist would select samples from a very large cohort at the image level. In the second step, a probability model is inferred from the automated training set. The probabilistic model captures staining patterns in mutually exclusive cell types and builds a single probability model for the data cohort. We have evaluated the proposed approach to classify: i) immune cells in cancer and ii) brain cells in neurological degenerative diseased tissue with average accuracies above 95%.


title: Novel hydrogen clathrate hydrate

abstract: We report a new hydrogen clathrate hydrate synthesized at 1.2 GPa and 298 K documented by single-crystal X-ray diffraction, Raman spectroscopy, and first-principles calculations. The oxygen sublattice of the new clathrate hydrate matches that of ice II, while hydrogen molecules are in the ring cavities, which results in the trigonal R3c or R-3c space group (proton ordered or disordered, respectively) and the composition of (H2O)6H2. Raman spectroscopy and theoretical calculations reveal a hydrogen disordered nature of the new phase C1', distinct from the well-known ordered C1 clathrate, to which this new structure transforms upon compression and/or cooling. This new clathrate phase can be viewed as a realization of a disordered ice II, unobserved before, in contrast to all other ordered ice structures.


title: Strong lensing by DHOST black holes

abstract: The deflection of light in the strong field limit is an important test for alternative theories of gravity. However, solutions for the metric that allow for analytic computations are not always available. We implement a hybrid analytic-numerical approximation to determine the deflection angle in static, spherically symmetrics pacetimes. We apply this to a set of numerical black hole solutions within the class of theories known as Degenerate Higher Order Scalar-tensor Theories. Comparing our results to a more time consuming full numerical integration, we find that we can accurately describe the deflection angle for light rays passing at arbitrary distances from the photon sphere with a combination of two analytic-numerical approximations. Furthermore, we find a range of parameters where our DHOST black holes predict strong lensing effects whose size is comparable with the uncertainty in the properties of the supermassive black hole in M87 reported by the Event Horizon Telescope, showing that strong lensing is a viable alternative to put constraints on these models.


title: Donald Lynden-Bell: A Biographical Memoir

abstract: Donald Lynden-Bell's many contributions to astrophysics encompass general relativity, galactic dynamics, telescope design and observational astronomy. In the 1960s, his papers on stellar dynamics led to fundamental insights into the equilibria of elliptical galaxies, the growth of spiral patterns in disc galaxies and the stability of differentially rotating, self-gravitating flows. Donald introduced the ideas of `violent relaxation' and `the gravothermal catastrophe' in pioneering work on the thermodynamics of galaxies and negative heat capacities. He shared the inaugural Kavli Prize in Astrophysics in 2008 for his contributions to our understanding of quasars. His prediction that dead quasars or supermassive black holes may reside in the nuclei of nearby galaxies has been confirmed by multiple pieces of independent evidence. His work on accretion discs led to new insights into their workings, as well as the realisation that the infrared excess in T Tauri stars was caused by protostellar discs around these young stars. He introduced the influential idea of monolithic collapse of a gas cloud as a formation mechanism for the Milky Way Galaxy. As this gave way to modern ideas of merging and accretion as drivers of galaxy formation, Donald was the first to realise the importance of tidal streams as measures of the past history and present day gravity field of the Galaxy. Though primarily a theorist, Donald participated in one of the first observational programs to measure the large-scale streaming of nearby galaxies. This led to the discovery of the `Great Attractor'. The depth and versatility of his contributions mark Donald out as one of the most influential and pre-eminent astronomers of his day.


title: Geometrical Optics Formalism to Model Contrast in Dark-Field X-ray Microscopy

abstract: Dark-field X-ray microscopy is a new full-field imaging technique that nondestructively maps the structure and local strain inside deeply embedded crystalline elements in three dimensions. Placing an objective lens in the diffracted beam generates a magnified projection image of a local volume. We provide a general formalism based on geometrical optics for the diffraction imaging, valid for any crystallographic space group. This allows simulation of diffraction images based on micro-mechanical models. We present example simulations with the formalism, demonstrating how it may be used to design new experiments or interpret existing ones. In particular, we show how modifications to the experimental design may tailor the reciprocal-space resolution function to map specific components of the deformation gradient tensor. The formalism supports multi-length scale experiments, as it enables DFXM to be interfaced with 3DXRD. The formalism is demonstrated by comparison to experimental images of the strain field around a straight dislocation.


title: Solar Wind Turbulence Around Mars: Relation Between The Energy Cascade Rate And The Proton Cyclotron Waves Activity

abstract: The first estimation of the incompressible energy cascade rate at magnetohydrodynamic (MHD) scales is obtained in the plasma upstream of the Martian bow shock, using MAVEN observations and an exact relation derived for MHD turbulence. The energy cascade rate is computed for events with and without proton cyclotron wave (PCW) activity, for time intervals when MAVEN was in the solar wind with no magnetic connection to the bow shock. It is shown that the nonlinear cascade of energy at the MHD scales is slightly amplified when PCWs are present in the plasma. The analysis of the normalized cross helicity and residual energy for the turbulent fluctuations shows the presence of Alfv\'enic and non-Alfv\'enic fluctuations in a magnetic dominant regime for the majority of the cases.


title: Efficacy of Hydroxychloroquine as Prophylaxis for Covid-19

abstract: Limitations in the design of the experiment of Boulware et al[1] are considered in Cohen[2]. They are not subject to correction but they are reported for readers' consideration. However, they made an analysis for the incidence based on Fisher's hypothesis test for means while they published detailed time dependent data which were not analyzed, disregarding an important information. Here we make the analyses with this time dependent data adopting a simple regression analysis. We conclude their randomized, double-blind, placebo-controlled trial presents statistical evidence, at 99% confidence level, that the treatment of Covid-19 patients with hydroxychloroquine is effective in reducing the appearance of symptoms if used before or right after exposure to the virus. For 0 to 2 days after exposure to virus, the estimated relative reduction in symptomatic outcomes is 72% after 0 days, 48.9% after 1 day and 29.3% after 2 days. For 3 days after exposure, the estimated relative reduction is 15.7% but results are not statistically conclusive and for 4 or more days after exposure there is no statistical evidence that hydroxychloroquine is effective in reducing the appearance of symptoms. Our results show that the time elapsed between infection and the beginning of treatment is crucial for the efficacy of hydroxychloroquine as a treatment to Covid-19.


title: Classification of Diabetic Retinopathy via Fundus Photography: Utilization of Deep Learning Approaches to Speed up Disease Detection

abstract: In this paper, we propose two distinct solutions to the problem of Diabetic Retinopathy (DR) classification. In the first approach, we introduce a shallow neural network architecture. This model performs well on classification of the most frequent classes while fails at classifying the less frequent ones. In the second approach, we use transfer learning to re-train the last modified layer of a very deep neural network to improve the generalization ability of the model to the less frequent classes. Our results demonstrate superior abilities of transfer learning in DR classification of less frequent classes compared to the shallow neural network.


title: Deep Learning Based Brain Tumor Segmentation: A Survey

abstract: Brain tumor segmentation is one of the most challenging problems in medical image analysis. The goal of brain tumor segmentation is to generate accurate delineation of brain tumor regions. In recent years, deep learning methods have shown promising performance in solving various computer vision problems, such as image classification, object detection and semantic segmentation. A number of deep learning based methods have been applied to brain tumor segmentation and achieved promising results. Considering the remarkable breakthroughs made by state-of-the-art technologies, we use this survey to provide a comprehensive study of recently developed deep learning based brain tumor segmentation techniques. More than 100 scientific papers are selected and discussed in this survey, extensively covering technical aspects such as network architecture design, segmentation under imbalanced conditions, and multi-modality processes. We also provide insightful discussions for future development directions.


title: Inconsistencies and errors in traditional approaches to energy in our introductory courses

abstract: We present a critical analysis of the classical approaches to energy subjects, based on the work-energy theorem and the conservation of mechanical energy proposed in the courses of the first years of tertiary education. We show how these approaches present a series of inconsistencies and errors that are a source of conceptual difficulties among students. We then analyze a modern treatment of mechanical courses based on the results of research in physics education over the last 40 years. We place special emphasis on the principle of conservation of energy as one of the fundamental principles of nature, prioritizing the concepts of system, surrounding, and energy transfer and transformation.


title: Multifluid Modelling of Relativistic Radiation Hydrodynamics

abstract: The formulation of a universal theory for bulk viscosity and heat conduction represents a theoretical challenge for our understanding of relativistic fluid dynamics. Recently, it has been shown that the multifluid variational approach championed by Carter and collaborators has the potential to be a general and natural framework to derive (hyperbolic) hydrodynamic equations for relativistic dissipative systems. Furthermore, it also allows to keep direct contact with non-equilibrium thermodynamics, providing a clear microscopic interpretation of the elements of the theory. To provide an example of its universal applicability, in this paper we derive the fundamental equations of the radiation hydrodynamics directly in the context of Carter's multifluid theory. This operation unveils a novel set of thermodynamic constraints that must be respected by any microscopic model. Then, we prove that the radiation hydrodynamics becomes a multifluid model for bulk viscosity or heat conduction in some appropriate physical limits.


title: Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spotting

abstract: Recent end-to-end trainable methods for scene text spotting, integrating detection and recognition, showed much progress. However, most of the current arbitrary-shape scene text spotters use region proposal networks (RPN) to produce proposals. RPN relies heavily on manually designed anchors and its proposals are represented with axis-aligned rectangles. The former presents difficulties in handling text instances of extreme aspect ratios or irregular shapes, and the latter often includes multiple neighboring instances into a single proposal, in cases of densely oriented text. To tackle these problems, we propose Mask TextSpotter v3, an end-to-end trainable scene text spotter that adopts a Segmentation Proposal Network (SPN) instead of an RPN. Our SPN is anchor-free and gives accurate representations of arbitrary-shape proposals. It is therefore superior to RPN in detecting text instances of extreme aspect ratios or irregular shapes. Furthermore, the accurate proposals produced by SPN allow masked RoI features to be used for decoupling neighboring text instances. As a result, our Mask TextSpotter v3 can handle text instances of extreme aspect ratios or irregular shapes, and its recognition accuracy won't be affected by nearby text or background noise. Specifically, we outperform state-of-the-art methods by 21.9 percent on the Rotated ICDAR 2013 dataset (rotation robustness), 5.9 percent on the Total-Text dataset (shape robustness), and achieve state-of-the-art performance on the MSRA-TD500 dataset (aspect ratio robustness). Code is available at: https://github.com/MhLiao/MaskTextSpotterV3


title: Temporal Pointwise Convolutional Networks for Length of Stay Prediction in the Intensive Care Unit

abstract: The pressure of ever-increasing patient demand and budget restrictions make hospital bed management a daily challenge for clinical staff. Most critical is the efficient allocation of resource-heavy Intensive Care Unit (ICU) beds to the patients who need life support. Central to solving this problem is knowing for how long the current set of ICU patients are likely to stay in the unit. In this work, we propose a new deep learning model based on the combination of temporal convolution and pointwise (1x1) convolution, to solve the length of stay prediction task on the eICU and MIMIC-IV critical care datasets. The model - which we refer to as Temporal Pointwise Convolution (TPC) - is specifically designed to mitigate common challenges with Electronic Health Records, such as skewness, irregular sampling and missing data. In doing so, we have achieved significant performance benefits of 18-68% (metric and dataset dependent) over the commonly used Long-Short Term Memory (LSTM) network, and the multi-head self-attention network known as the Transformer. By adding mortality prediction as a side-task, we can improve performance further still, resulting in a mean absolute deviation of 1.55 days (eICU) and 2.28 days (MIMIC-IV) on predicting remaining length of stay.


title: Resummed Kinetic Field Theory: a model of coupled baryonic and dark matter

abstract: We present a new analytical description of cosmic structure formation in a mixture of dark and baryonic matter, using the framework of Kinetic Field Theory (KFT) -- a statistical field theory for classical particle dynamics. So far, KFT has only been able to describe a single type of particles, sufficient to consider structure growth due to the gravitational interactions between dark matter. However, the influence of baryonic gas dynamics becomes increasingly relevant when describing smaller scales. In this paper, we thus demonstrate how to extend the KFT formalism as well as a previously presented resummation scheme towards describing such mixtures of two particle species. Thereby, the gas dynamics of baryons are accounted for using the recently developed model of Mesoscopic Particle Hydrodynamics. Assuming a flat $\Lambda$CDM Universe and a simplified model for the thermal gas evolution, we demonstrate the validity of this approach by computing the linear evolution of the individual and total matter power spectra between the epoch of recombination and today. Our results correctly reproduce the expected behaviour, showing a suppression of both baryonic and dark matter structure growth on scales smaller than the baryonic Jeans length, in good agreement with results from the numerical Boltzmann solver CLASS. Nonlinear corrections within this approach will be investigated in upcoming works.


title: Sequencing seismograms: A panoptic view of scattering in the core-mantle boundary region

abstract: Scattering of seismic waves can reveal subsurface structures but usually in a piecemeal way focused on specific target areas. We used a manifold learning algorithm called "the Sequencer" to simultaneously analyze thousands of seismograms of waves diffracting along the core-mantle boundary and obtain a panoptic view of scattering across the Pacific region. In nearly half of the diffracting waveforms, we detected seismic waves scattered by three-dimensional structures near the core-mantle boundary. The prevalence of these scattered arrivals shows that the region hosts pervasive lateral heterogeneity. Our analysis revealed loud signals due to a plume root beneath Hawaii and a previously unrecognized ultralow-velocity zone beneath the Marquesas Islands. These observations illustrate how approaches flexible enough to detect robust patterns with little to no user supervision can reveal distinctive insights into the deep Earth.


title: The silence of binary Kerr

abstract: A non-trivial $\mathcal{S}$-matrix generally implies a production of entanglement: starting with an incoming pure state the scattering generally returns an outgoing state with non-vanishing entanglement entropy. It is then interesting to ask if there exists a non-trivial $\mathcal{S}$-matrix that generates no entanglement. In this letter, we argue that the answer is the scattering of classical black holes. We study the spin-entanglement in the scattering of arbitrary spinning particles. Augmented with Thomas-Wigner rotation factors, we derive the entanglement entropy from the gravitational induced $2\rightarrow 2$ amplitude. In the Eikonal limit, we find that the relative entanglement entropy, defined here as the \textit{difference} between the entanglement entropy of the \textit{in} and \textit{out}-states, is nearly zero for minimal coupling irrespective of the \textit{in}-state, and increases significantly for any non-vanishing spin multipole moments. This suggests that minimal couplings of spinning particles, whose classical limit corresponds to Kerr black hole, has the unique feature of generating near zero entanglement.


title: Identification of a New Ultraluminous X-ray Source in NGC 1316

abstract: In this study, we report identification of a new ultraluminous X-ray source (ULX) named as X-7 in NGC 1316, with an unabsorbed luminosity of 2.1$\times$10$^{39}$ erg s$^{-1}$ using the two recent Chandra archival observations. The X-7 was detected in the Chandra 2001 observation and was included in the source list of the NGC 1316 as CXOUJ032240.8-371224 with a luminosity of 5.7$\times$10$^{38}$ erg s$^{-1}$. Present luminosity implies a luminosity increase of a factor of $\sim$ 4. The best fit spectral model parameters indicate that X-7 has a relatively hot disk and hard spectra. If explained by a diskblackbody model, the mass of compact object is estimated as $\sim$ 8 M$\odot$ which is in the range of a stellar-mass black hole. The X-7 shows a relatively long-term count rate variability while no short-term variability is observed. We also identified a unique optical candidate within 0.22" error circle at 95\% confidence level for X-7 using the archival HST/ACS and HST/WFC3 data. Absolute magnitude (M$_{V}$) of this candidate is -7.8 mag. Its spectral energy distribution is adequately fitted a blackbody model with a temperature of 3100 K indicating an M type supergiant, assuming the donor star dominates the optical emission. In addition, we identified a transient ULX candidate (XT-1) located 6" away from X-7 has a (high) luminosity of $\sim$ 10$^{39}$ erg s$^{-1}$ with no visible optical candidate.


title: Languages for modeling the RED active queue management algorithms: Modelica vs. Julia

abstract: This work is devoted to the study of the capabilities of the Modelica and Julia programming languages for the implementation of a continuously discrete paradigm in modeling hybrid systems that contain both continuous and discrete aspects of behavior. A system consisting of an incoming stream that is processed according to the Transmission Control Protocol (TCP) and a router that processes traffic using the Random Early Detection (RED) algorithm acts as a simulated threshold system.


title: Adsorption transition of a grafted ferromagnetic filament controlled by external magnetic fields

abstract: Extensive Langevin dynamics simulations are used to characterize the adsorption transition of a flexible magnetic filament grafted onto an attractive planar surface. Our results identify different structural transitions at different ratios of the thermal energy to the surface attraction strength: filament straightening, adsorption and the magnetic flux closure. The adsorption temperature of a magnetic filament is found to be higher in comparison to an equivalent nonmagnetic chain. The adsorption has been also investigated under the application of a static homogeneous external magnetic field. We found that the strength and the orientation of the field can be used to control the adsorption process, providing a precise switching mechanism. Interestingly, we have observed that the characteristic field strength and tilt angle at the adsorption point are related by a simple power law.


title: DeepDive: An Integrative Algorithm/Architecture Co-Design for Deep Separable Convolutional Neural Networks

abstract: Deep Separable Convolutional Neural Networks (DSCNNs) have become the emerging paradigm by offering modular networks with structural sparsity in order to achieve higher accuracy with relatively lower operations and parameters. However, there is a lack of customized architectures that can provide flexible solutions that fit the sparsity of the DSCNNs. This paper introduces DeepDive, which is a fully-functional, vertical co-design framework, for power-efficient implementation of DSCNNs on edge FPGAs. DeepDive's architecture supports crucial heterogeneous Compute Units (CUs) to fully support DSCNNs with various convolutional operators interconnected with structural sparsity. It offers an FPGA-aware training and online quantization combined with modular synthesizable C++ CUs, customized for DSCNNs. The execution results on Xilinx's ZCU102 FPGA board, demonstrate 47.4 and 233.3 FPS/Watt for MobileNet-V2 and a compact version of EfficientNet, respectively, as two state-of-the-art depthwise separable CNNs. These comparisons showcase how DeepDive improves FPS/Watt by 2.2$\times$ and 1.51$\times$ over Jetson Nano high and low power modes, respectively. It also enhances FPS/Watt about 2.27$\times$ and 37.25$\times$ over two other FPGA implementations. The DeepDive output for MobileNetV2 is available at https://github.com/TeCSAR-UNCC/DeepDive.


title: On Grauert's examples of complete K\"{a}hler metrics

abstract: Grauert showed that the existence of a complete K\"{a}hler metric does not characterize domains of holomorphy by constructing such metrics on the complements of complex analytic sets in a domain of holomorphy. In this note, we study the holomorphic sectional curvatures of such metrics in two prototype cases namely, $\mathbb{C}^n \setminus \{0\}, n \ge 2$ and $\mathbb{B}^N \setminus A$, $N \ge 2$ and $A \subset \mathbb{B}^N$ is a hyperplane of codimension at least two. This is done by computing the Gaussian curvature of its restriction to the leaves of a suitable holomorphic foliation of these two examples. We also examine this metric on the punctured plane $\mathbb{C}^{\ast}$ and show that it behaves very differently in this case.


title: Separation of variables in Hamilton-Jacobi equation for a charged test particle in the Stackel spaces of type (2.0)

abstract: Found all equivalence classes for electromagnetic potentials and space-time metrics of Stackel spaces, provided that the equations of motion of the classical charged test particles are integrated by the method of complete separation of variables in the Hamilton- Jacobi equation. Separation is carried out using the complete sets of reciprocal-commuting integrals of motion of type (2.0), whereby in a privileged coordinate system the Hamilton- Jacobi equation turns into a nonparabolic type equation.


title: Deep Hough-Transform Line Priors

abstract: Classical work on line segment detection is knowledge-based; it uses carefully designed geometric priors using either image gradients, pixel groupings, or Hough transform variants. Instead, current deep learning methods do away with all prior knowledge and replace priors by training deep networks on large manually annotated datasets. Here, we reduce the dependency on labeled data by building on the classic knowledge-based priors while using deep networks to learn features. We add line priors through a trainable Hough transform block into a deep network. Hough transform provides the prior knowledge about global line parameterizations, while the convolutional layers can learn the local gradient-like line features. On the Wireframe (ShanghaiTech) and York Urban datasets we show that adding prior knowledge improves data efficiency as line priors no longer need to be learned from data. Keywords: Hough transform; global line prior, line segment detection.


title: Generalized Dualities and Higher Derivatives

abstract: Generalized dualities had an intriguing incursion into Double Field Theory (DFT) in terms of local $O(d,d)$ transformations. We review this idea and use the higher derivative formulation of DFT to compute the first order corrections to generalized dualities. Our main result is a unified expression that can be easily specified to any generalized T-duality (Abelian, non-Abelian, Poisson-Lie, etc.) or deformations such as Yang-Baxter, in any of the theories captured by the bi-parametric deformation (bosonic, heterotic strings and HSZ theory), in any supergravity scheme related by field redefinitions. The prescription allows further extensions to higher orders. As a check we recover some previously known particular examples.


title: A novel approach to sentiment analysis in Persian using discourse and external semantic information

abstract: Sentiment analysis attempts to identify, extract and quantify affective states and subjective information from various types of data such as text, audio, and video. Many approaches have been proposed to extract the sentiment of individuals from documents written in natural languages in recent years. The majority of these approaches have focused on English, while resource-lean languages such as Persian suffer from the lack of research work and language resources. Due to this gap in Persian, the current work is accomplished to introduce new methods for sentiment analysis which have been applied on Persian. The proposed approach in this paper is two-fold: The first one is based on classifier combination, and the second one is based on deep neural networks which benefits from word embedding vectors. Both approaches takes advantage of local discourse information and external knowledge bases, and also cover several language issues such as negation and intensification, andaddresses different granularity levels, namely word, aspect, sentence, phrase and document-levels. To evaluate the performance of the proposed approach, a Persian dataset is collected from Persian hotel reviews referred as hotel reviews. The proposed approach has been compared to counterpart methods based on the benchmark dataset. The experimental results approve the effectiveness of the proposed approach when compared to related works.


title: A coupled two-species model for the pair contact process with diffusion

abstract: The contact process with diffusion (PCPD) defined by the binary reactions 2 B -> 3 B, 2 B -> 0 and diffusive particle spreading exhibits an unusual active to absorbing phase transition whose universality class has long been disputed. Multiple studies have indicated that an explicit account of particle pair degrees of freedom may be required to properly capture this system's effective long-time, large-scale behavior. We introduce a two-species representation in which single particles B and pairs A are coupled according to the stochastic reactions B + B -> A, A -> A + B, A -> 0, and A -> B + B. Mean-field analysis reveals that the phase transition is driven by competition and balance between both species. We employ Monte Carlo simulations to demonstrate that this model captures the pertinent PCPD features. In the inactive phase, A particles rapidly go extinct, leaving the B species to undergo pure pair annihilation kinetics. At criticality, both A and B densities decay with the same exponents as the PCPD order parameters, and display mean-field scaling above the critical dimension 2. In one dimension, the critical exponents for the B species obtained from seed simulations agree well with previously reported exponent values. We demonstrate that the scaling properties of consecutive particle pairs in the PCPD are identical with that of the A species in the coupled model. This two-species picture resolves the conceptual difficulty for seed simulations in the original PCPD and naturally introduces multiple length and time scales, which cause strong corrections to scaling. The extracted moment ratios from our simulations indicate that our model displays the same temporal crossover behavior as the PCPD, which further corroborates its full dynamical equivalence with our coupled model.


title: Counting multiplicative groups with prescribed subgroups

abstract: We examine two counting problems that seem very group-theoretic on the surface but, on closer examination, turn out to concern integers with restrictions on their prime factors. First, given an odd prime $q$ and a finite abelian $q$-group $H$, we consider the set of integers $n\le x$ such that the Sylow $q$-subgroup of the multiplicative group $(\mathbb Z/n\mathbb Z)^\times$ is isomorphic to $H$. We show that the counting function of this set of integers is asymptotic to $K x(\log\log x)^\ell/(\log x)^{1/(q-1)}$ for explicit constants $K$ and $\ell$ depending on $q$ and $H$. Second, we consider the set of integers $n\le x$ such that the multiplicative group $(\mathbb Z/n\mathbb Z)^\times$ is "maximally non-cyclic", that is, such that all of its prime-power subgroups are elementary groups. We show that the counting function of this set of integers is asymptotic to $A x/(\log x)^{1-\xi}$ for an explicit constant $A$, where $\xi$ is Artin's constant. As it turns out, both of these group-theoretic problems can be reduced to problems of counting integers with restrictions on their prime factors, allowing them to be addressed by classical techniques of analytic number theory.


title: Uniqueness and positivity issues in a quasilinear indefinite problem

abstract: We consider the problem $$ (P_\lambda)\quad -\Delta_{p}u=\lambda u^{p-1}+a(x)u^{q-1},\quad u\geq0\quad\mbox{ in }\Omega $$ under Dirichlet or Neumann boundary conditions. Here $\Omega$ is a smooth bounded domain of $\mathbb{R}^{N}$ ($N\geq1$), $\lambda\in\mathbb{R}$, $1<q<p$, and $a\in C(\overline{\Omega})$ changes sign. These conditions enable the existence of dead core solutions for this problem, which may admit multiple nontrivial solutions. We show that for $\lambda<0$ the functional \[ I_{\lambda}(u):=\int_{\Omega}\left( \frac{1}{p}|\nabla u|^{p}-\frac{\lambda }{p}|u|^{p}-\frac{1}{q}a(x)|u|^{q}\right) , \] defined in $X=W_{0}^{1,p}(\Omega)$ or $X=W^{1,p}(\Omega)$, has \textit{exactly} one nonnegative global minimizer, and this one is the \textit{only} solution of $(P_{\lambda})$ being positive in $\Omega_{a}^{+}$ (the set where $a>0$). In particular, this problem has at most one positive solution for $\lambda<0$. Under some condition on $a$, the above uniqueness result fails for some values of $\lambda>0$ as we obtain, besides the ground state solution, a \textit{second} solution positive in $\Omega_{a}^{+}$. We also provide conditions on $\lambda$, $a$ and $q$ such that these solutions become positive in $\Omega$, and analyze the formation of dead cores for a generic solution.


title: Partition dimension and strong metric dimension of chain cycle

abstract: Let $G$ be a connected graph with vertex set $V(G)$ and edge set $E(G)$. For an ordered $k$-partition $\Pi=\{Q_1,\ldots,Q_k\}$ of $V(G)$, the representation of a vertex $v \in V(G)$ with respect to $\Pi$ is the $k$-vectors $r(v|\Pi)=(d(v,Q_1),\ldots,d(v,Q_k))$, where $d(v,Q_i)$ is the distance between $v$ and $Q_i$. The partition $\Pi$ is a resolving partition if $r(u|\Pi)\neq r(v|\Pi)$, for each pair of distinct vertices $u,v \in V(G)$. The minimum $k$ for which there is a resolving $k$-partition of $V(G)$ is the partition dimension of $G$. A vertex $w\in V(G)$ strongly resolves two distinct vertices $u,v \in V(G)$ if $u$ belongs to a shortest $v-w$ path or $v$ belongs to a shortest $u-w$ path. An ordered set $W=\{w_{1},\ldots, w_{t}\}\subseteq V(G)$ is a strong resolving set for $G$ if for every two distinct vertices $u$ and $v$ of $G$ there exists a vertex $w\in W$ which strongly resolves $u$ and $v$. A strong metric basis of $G$ is a strong resolving set of minimal cardinality. The cardinality of a strong metric basis is called strong metric dimension of $G$. In this paper, we determine the partition dimension and strong metric dimension of a chain cycle constructed by even cycles and a chain cycle constructed by odd cycles.


title: Domino tilings of cylinders: connected components under flips and normal distribution of the twist

abstract: We consider domino tilings of $3$-dimensional cubiculated regions. A three-dimensional domino is a 2x2x1 rectangular cuboid. We are particularly interested in regions of the form $R_N = D \times [0,N]$ where $D$ is a fixed quadriculated disk. In dimension 3, the twist associates to each tiling $t$ an integer $Tw(t)$. We prove that, when $N$ goes to infinity, the twist follows a normal distribution. A flip is a local move: two neighboring parallel dominoes are removed and placed back in a different position. The twist is invariant under flips. A quadriculated disk $D$ is regular if, whenever two tilings $t_0$ and $t_1$ of $R_N$ satisfy $Tw(t_0) = Tw(t_1)$, $t_0$ and $t_1$ can be joined by a sequence of flips provided some extra vertical space is allowed. Many large disks are regular, including rectangles $D = [0,L] \times [0,M]$ with $LM$ even and $L,M \ge 3$. For regular disks, we describe the larger connected components under flips of the set of tilings of the region $R_N = D \times [0,N]$. As a corollary, let $p_N$ be the probability that two random tilings $T_0$ and $T_1$ of $D \times [0,N]$ can be joined by a sequence of flips conditional to their twists being equal. Then $p_N$ tends to 1 if and only if $D$ is regular. Under a suitable equivalence relation, the set of tilings has a group structure, the domino group. These results illustrate the fact that the domino group dictates many properties of the space of tilings of the cylinder $R_N = D \times [0,N]$, particularly for large $N$.


title: A family of matrix-tree multijections

abstract: For a natural class of $r \times n$ integer matrices, we construct a non-convex polytope which periodically tiles $\mathbb R^n$. From this tiling, we provide a family of geometrically meaningful maps from a generalized sandpile group to a set of generalized spanning trees which give multijective proofs for several higher-dimensional matrix-tree theorems. In particular, these multijections can be applied to graphs, regular matroids, cell complexes with a torsion-free spanning forest, and representable arithmetic matroids with a multiplicity one basis. This generalizes a bijection given by Backman, Baker, and Yuen and extends work by Duval, Klivans, and Martin.


title: MIX'EM: Unsupervised Image Classification using a Mixture of Embeddings

abstract: We present MIX'EM, a novel solution for unsupervised image classification. MIX'EM generates representations that by themselves are sufficient to drive a general-purpose clustering algorithm to deliver high-quality classification. This is accomplished by building a mixture of embeddings module into a contrastive visual representation learning framework in order to disentangle representations at the category level. It first generates a set of embedding and mixing coefficients from a given visual representation, and then combines them into a single embedding. We introduce three techniques to successfully train MIX'EM and avoid degenerate solutions; (i) diversify mixture components by maximizing entropy, (ii) minimize instance conditioned component entropy to enforce a clustered embedding space, and (iii) use an associative embedding loss to enforce semantic separability. By applying (i) and (ii), semantic categories emerge through the mixture coefficients, making it possible to apply (iii). Subsequently, we run K-means on the representations to acquire semantic classification. We conduct extensive experiments and analyses on STL10, CIFAR10, and CIFAR100-20 datasets, achieving state-of-the-art classification accuracy of 78\%, 82\%, and 44\%, respectively. To achieve robust and high accuracy, it is essential to use the mixture components to initialize K-means. Finally, we report competitive baselines (70\% on STL10) obtained by applying K-means to the "normalized" representations learned using the contrastive loss.


title: Projections from surfaces of revolution in the Euclidean plane

abstract: For a specific class of surfaces of revolution S, the existence of a smooth map {\Phi} from a neighbourhood U of S to the Euclidean plane E2 preserving distances infinitesimally along the meridians and the parallels of S and sending the meridional arcs of U \ S to straight lines of E2; is proven.


title: Dynamical ${\frak{sl}}_2$ Bethe algebra and functions on pairs of quasi-polynomials

abstract: We consider the space $\text{Fun}_{\frak{sl}_2}V[0]$ of functions on the Cartan subalgebra of $\frak{sl}_2$ with values in the zero weight subspace $V[0]$ of a tensor product of irreducible finite-dimensional $\frak{sl}_2$-modules. We consider the algebra $\mathcal B$ of commuting differential operators on $\text{Fun}_{\frak{sl}_2}\,V[0]$, constructed by V.Rubtsov, A.Silantyev, D.Talalaev in 2009. We describe the relations between the action of $\mathcal B$ on $\text{Fun}_{\frak{sl}_2}V[0]$ and spaces of pairs of quasi-polynomials.


title: Social Learning and the Accuracy-Risk Trade-off in the Wisdom of the Crowd

abstract: How do we design and deploy crowdsourced prediction platforms for real-world applications where risk is an important dimension of prediction performance? To answer this question, we conducted a large online Wisdom of the Crowd study where participants predicted the prices of real financial assets (e.g. S&P 500). We observe a Pareto frontier between accuracy of prediction and risk, and find that this trade-off is mediated by social learning i.e. as social learning is increasingly leveraged, it leads to lower accuracy but also lower risk. We also observe that social learning leads to superior accuracy during one of our rounds that occurred during the high market uncertainty of the Brexit vote. Our results have implications for the design of crowdsourced prediction platforms: for example, they suggest that the performance of the crowd should be more comprehensively characterized by using both accuracy and risk (as is standard in financial and statistical forecasting), in contrast to prior work where risk of prediction has been overlooked.


title: Nijnehuis Geometry III: gl-regular Nijenhuis operators

abstract: We study Nijenhuis operators, that is, (1,1)-tensors with vanishing Nijenhuis torsion under the additional assumption that they are gl-regular, i.e., every eigenvalue has geometric multiplicity one. We prove the existence of a coordinate system in which the operator takes first or second companion form, and give a local describtion of such operators. We apply this local description to study singular points. In particular, we obtain their normal forms in dimension two and discover topological restrictions for the existence of gl-regular Nijenhuis operators on closed surfaces. This paper is an important step in the research programme suggested in arXiv:1903.04603 and arXiv:1903.06411.


title: Backpropagated Gradient Representations for Anomaly Detection

abstract: Learning representations that clearly distinguish between normal and abnormal data is key to the success of anomaly detection. Most of existing anomaly detection algorithms use activation representations from forward propagation while not exploiting gradients from backpropagation to characterize data. Gradients capture model updates required to represent data. Anomalies require more drastic model updates to fully represent them compared to normal data. Hence, we propose the utilization of backpropagated gradients as representations to characterize model behavior on anomalies and, consequently, detect such anomalies. We show that the proposed method using gradient-based representations achieves state-of-the-art anomaly detection performance in benchmark image recognition datasets. Also, we highlight the computational efficiency and the simplicity of the proposed method in comparison with other state-of-the-art methods relying on adversarial networks or autoregressive models, which require at least 27 times more model parameters than the proposed method.


title: Elliptic (p,q)-difference modules

abstract: We study finite dimensional vector spaces over fields of elliptic functions equipped with two commuting aotomorphisms \sigma and \tau induced by isogenies of relatively prime orders. We give a structure theorem for such objects, that reveals a connection to the classification of vector bundles on elliptic curves by Atiyah. As an application we prove an elliptic analogue of a conjecture of Loxton and van der Poorten which has been recently proved by Adamczewski and Bell.


title: Tracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targets

abstract: State-of-the-art multi-object tracking~(MOT) methods follow the tracking-by-detection paradigm, where object trajectories are obtained by associating per-frame outputs of object detectors. In crowded scenes, however, detectors often fail to obtain accurate detections due to heavy occlusions and high crowd density. In this paper, we propose a new MOT paradigm, tracking-by-counting, tailored for crowded scenes. Using crowd density maps, we jointly model detection, counting, and tracking of multiple targets as a network flow program, which simultaneously finds the global optimal detections and trajectories of multiple targets over the whole video. This is in contrast to prior MOT methods that either ignore the crowd density and thus are prone to errors in crowded scenes, or rely on a suboptimal two-step process using heuristic density-aware point-tracks for matching targets.Our approach yields promising results on public benchmarks of various domains including people tracking, cell tracking, and fish tracking.


title: FaceHop: A Light-Weight Low-Resolution Face Gender Classification Method

abstract: A light-weight low-resolution face gender classification method, called FaceHop, is proposed in this research. We have witnessed rapid progress in face gender classification accuracy due to the adoption of deep learning (DL) technology. Yet, DL-based systems are not suitable for resource-constrained environments with limited networking and computing. FaceHop offers an interpretable non-parametric machine learning solution. It has desired characteristics such as a small model size, a small training data amount, low training complexity, and low-resolution input images. FaceHop is developed with the successive subspace learning (SSL) principle and built upon the foundation of PixelHop++. The effectiveness of the FaceHop method is demonstrated by experiments. For gray-scale face images of resolution $32 \times 32$ in the LFW and the CMU Multi-PIE datasets, FaceHop achieves correct gender classification rates of 94.63% and 95.12% with model sizes of 16.9K and 17.6K parameters, respectively. It outperforms LeNet-5 in classification accuracy while LeNet-5 has a model size of 75.8K parameters.


title: Multi-Stage Hybrid Federated Learning over Large-Scale D2D-Enabled Fog Networks

abstract: Federated learning has generated significant interest, with nearly all works focused on a "star" topology where nodes/devices are each connected to a central server. We migrate away from this architecture and extend it through the network dimension to the case where there are multiple layers of nodes between the end devices and the server. Specifically, we develop multi-stage hybrid federated learning (MH-FL), a hybrid of intra- and inter-layer model learning that considers the network as a multi-layer cluster-based structure. MH-FL considers the topology structures among the nodes in the clusters, including local networks formed via device-to-device (D2D) communications, and presumes a semi-decentralized architecture for federated learning. It orchestrates the devices at different network layers in a collaborative/cooperative manner (i.e., using D2D interactions) to form local consensus on the model parameters and combines it with multi-stage parameter relaying between layers of the tree-shaped hierarchy. We derive the upper bound of convergence for MH-FL with respect to parameters of the network topology (e.g., the spectral radius) and the learning algorithm (e.g., the number of D2D rounds in different clusters). We obtain a set of policies for the D2D rounds at different clusters to guarantee either a finite optimality gap or convergence to the global optimum. We then develop a distributed control algorithm for MH-FL to tune the D2D rounds in each cluster over time to meet specific convergence criteria. Our experiments on real-world datasets verify our analytical results and demonstrate the advantages of MH-FL in terms of resource utilization metrics.


title: Active Deception using Factored Interactive POMDPs to Recognize Cyber Attacker's Intent

abstract: This paper presents an intelligent and adaptive agent that employs deception to recognize a cyber adversary's intent. Unlike previous approaches to cyber deception, which mainly focus on delaying or confusing the attackers, we focus on engaging with them to learn their intent. We model cyber deception as a sequential decision-making problem in a two-agent context. We introduce factored finitely nested interactive POMDPs (I-POMDPx) and use this framework to model the problem with multiple attacker types. Our approach models cyber attacks on a single honeypot host across multiple phases from the attacker's initial entry to reaching its adversarial objective. The defending I-POMDPx-based agent uses decoys to engage with the attacker at multiple phases to form increasingly accurate predictions of the attacker's behavior and intent. The use of I-POMDPs also enables us to model the adversary's mental state and investigate how deception affects their beliefs. Our experiments in both simulation and on a real host show that the I-POMDPx-based agent performs significantly better at intent recognition than commonly used deception strategies on honeypots.


title: Feature-level Rating System using Customer Reviews and Review Votes

abstract: This work studies how we can obtain feature-level ratings of the mobile products from the customer reviews and review votes to influence decision making, both for new customers and manufacturers. Such a rating system gives a more comprehensive picture of the product than what a product-level rating system offers. While product-level ratings are too generic, feature-level ratings are particular; we exactly know what is good or bad about the product. There has always been a need to know which features fall short or are doing well according to the customer's perception. It keeps both the manufacturer and the customer well-informed in the decisions to make in improving the product and buying, respectively. Different customers are interested in different features. Thus, feature-level ratings can make buying decisions personalized. We analyze the customer reviews collected on an online shopping site (Amazon) about various mobile products and the review votes. Explicitly, we carry out a feature-focused sentiment analysis for this purpose. Eventually, our analysis yields ratings to 108 features for 4k+ mobiles sold online. It helps in decision making on how to improve the product (from the manufacturer's perspective) and in making the personalized buying decisions (from the buyer's perspective) a possibility. Our analysis has applications in recommender systems, consumer research, etc.


title: Heights of points on elliptic curves over $\mathbb Q$

abstract: In this note we obtain effective lower bounds for the canonical heights of non-torsion points on $E(\mathbb{Q})$ by making use of suitable elliptic curve ideal class pairings $$\Psi_{E,-D}: E(\mathbb{Q})\times E_{-D}(\mathbb{Q})\mapsto \mathrm{CL}(-D).$$ In terms of the class number $H(-D)$ and $T_E(-D)$, a logarithmic function in $D$, we prove $$ \widehat{h}(P)> \frac{|E_{\mathrm{tor}}(\mathbb{Q})|^2}{\left( H(-D)+ |E_{\mathrm{tor}}(\mathbb{Q})|\right)^2}\cdot T_E(-D). $$