title: Gauge Symmetry Enhancement by Wilson Lines in Twisted Compactification

abstract: We point out a simple realization of gauge symmetry enhancement by Wilson lines in QFT with twisted compactification in extra dimensions. We illustrate this in the field contents taken from heterotic supergravity in arbitrary dimensions toroidally compactified.


title: On the hit problem for the Steenrod algebra in some generic degrees and applications

abstract: Let $\mathcal P_{n}:=H^{*}((\mathbb{R}P^{\infty})^{n}) \cong \mathbb F_2[x_{1},x_{2},\ldots,x_{n}]$ be the polynomial algebra over the prime field of two elements, $\mathbb F_2.$ We investigate the Peterson hit problem for the polynomial algebra $\mathcal P_{n},$ viewed as a graded left module over the mod-$2$ Steenrod algebra, $\mathcal{A}.$ For $n>4,$ this problem is still unsolved, even in the case of $n=5$ with the help of computers. The purpose of this paper is to continue our study of the hit problem by developing a result in \cite{ph31} for $\mathcal P_n$ in the generic degree $r(2^s-1)+m.2^s$ where $r=n=5,\ m=13,$ and $s$ is an arbitrary non-negative integer. Note that for $s=0,$ and $s=1,$ this problem has been studied by Phuc \cite{ph20ta}, and \cite{ph31}, respectively. As an application of these results, we get the dimension result for the polynomial algebra in the generic degree $d=(n-1).(2^{n+u-1}-1)+\ell.2^{n+u-1}$ where $u$ is an arbitrary non-negative integer, $\ell \in \{23, 67 \},$ and $n=6.$ One of the major applications of hit problem is in surveying a homomorphism introduced by Singer, which is a homomorphism $$Tr_n :\text{Tor}^{\mathcal A}_{n, n+d} (\mathbb F_2,\mathbb F_2) \longrightarrow (\mathbb{F}_{2}{\otimes}_{\mathcal{A}}\mathcal P_{n})_d^{GL(n; \mathbb F_2)}$$ from the homology of the Steenrod algebra to the subspace of $(\mathbb{F}_{2}{\otimes}_{\mathcal{A}}\mathcal P_{n})_d$ consisting of all the $GL(n; \mathbb F_2)$-invariant classes. It is a useful tool in describing the homology groups of the Steenrod algebra, $\text{Tor}^{\mathcal A}_{n, n+d}(\mathbb F_2,\mathbb F_2).$ The behavior of the fifth Singer algebraic transfer in degree $5(2^s-1)+13.2^s$ was also discussed at the end of this paper.


title: A mathematical perspective on edge-centric brain functional connectivity

abstract: Edge time series are increasingly used in brain functional imaging to study the node functional connectivity (nFC) dynamics at the finest temporal resolution while avoiding sliding windows. Here, we lay the mathematical foundations for the edge-centric analysis of neuroimaging time series, explaining why a few high-amplitude cofluctuations drive the nFC across datasets. Our exposition also constitutes a critique of the existing edge-centric studies, showing that their main findings can be derived from the nFC under a static null hypothesis that disregards temporal correlations. Testing the analytic predictions on functional MRI data from the Human Connectome Project confirms that the nFC can explain most variation in the edge FC matrix, the edge communities, the large cofluctuations, and the corresponding spatial patterns. We encourage the use of dynamic measures in future research, which exploit the temporal structure of the edge time series and cannot be replicated by static null models.


title: $*$-Conformal $\eta$-Ricci soliton within the framework of Kenmotsu manifolds

abstract: The goal of our present paper is to deliberate $*$-conformal $\eta$-Ricci soliton within the framework of Kenmotsu manifolds. Here we have shown that a Kenmotsu metric as a $*$-conformal $\eta$-Ricci soliton is Einstein metric if the soliton vector field is contact. Further, we have evolved the characterization of the Kenmotsu manifold or the nature of the potential vector field when the manifold satisfies gradient almost $*$-conformal $\eta$-Ricci soliton. Next, we have contrived $*$-conformal $\eta$-Ricci soliton admitting $(\kappa,\mu)^\prime$-almost Kenmotsu manifold and proved that the manifold is Ricci flat and is locally isometric to $\mathbb{H}^{n+1}(-4)\times\mathbb{R}^n$. Finally we have constructed some examples to illustrate the existence of $*$-conformal $\eta$-Ricci soliton, gradient almost $*$-conformal $\eta$-Ricci soliton on Kenmotsu manifold and $(\kappa,\mu)^\prime$-almost Kenmotsu manifolds.


title: Learning Signal Representations for EEG Cross-Subject Channel Selection and Trial Classification

abstract: EEG technology finds applications in several domains. Currently, most EEG systems require subjects to wear several electrodes on the scalp to be effective. However, several channels might include noisy information, redundant signals, induce longer preparation times and increase computational times of any automated system for EEG decoding. One way to reduce the signal-to-noise ratio and improve classification accuracy is to combine channel selection with feature extraction, but EEG signals are known to present high inter-subject variability. In this work we introduce a novel algorithm for subject-independent channel selection of EEG recordings. Considering multi-channel trial recordings as statistical units and the EEG decoding task as the class of reference, the algorithm (i) exploits channel-specific 1D-Convolutional Neural Networks (1D-CNNs) as feature extractors in a supervised fashion to maximize class separability; (ii) it reduces a high dimensional multi-channel trial representation into a unique trial vector by concatenating the channels' embeddings and (iii) recovers the complex inter-channel relationships during channel selection, by exploiting an ensemble of AutoEncoders (AE) to identify from these vectors the most relevant channels to perform classification. After training, the algorithm can be exploited by transferring only the parametrized subgroup of selected channel-specific 1D-CNNs to new signals from new subjects and obtain low-dimensional and highly informative trial vectors to be fed to any classifier.


title: Augmented 2D-TAN: A Two-stage Approach for Human-centric Spatio-Temporal Video Grounding

abstract: We propose an effective two-stage approach to tackle the problem of language-based Human-centric Spatio-Temporal Video Grounding (HC-STVG) task. In the first stage, we propose an Augmented 2D Temporal Adjacent Network (Augmented 2D-TAN) to temporally ground the target moment corresponding to the given description. Primarily, we improve the original 2D-TAN from two aspects: First, a temporal context-aware Bi-LSTM Aggregation Module is developed to aggregate clip-level representations, replacing the original max-pooling. Second, we propose to employ Random Concatenation Augmentation (RCA) mechanism during the training phase. In the second stage, we use pretrained MDETR model to generate per-frame bounding boxes via language query, and design a set of hand-crafted rules to select the best matching bounding box outputted by MDETR for each frame within the grounded moment.


title: FloorPP-Net: Reconstructing Floor Plans using Point Pillars for Scan-to-BIM

abstract: This paper presents a deep learning-based point cloud processing method named FloorPP-Net for the task of Scan-to-BIM (building information model). FloorPP-Net first converts the input point cloud of a building story into point pillars (PP), then predicts the corners and edges to output the floor plan. Altogether, FloorPP-Net establishes an end-to-end supervised learning framework for the Scan-to-Floor-Plan (Scan2FP) task. In the 1st International Scan-to-BIM Challenge held in conjunction with CVPR 2021, FloorPP-Net was ranked the second runner-up in the floor plan reconstruction track. Future work includes general edge proposals, 2D plan regularization, and 3D BIM reconstruction.


title: Cycles of paleomagnetic activity in the phanerozoic

abstract: Quasi-periodic changes of the paleointensity and geomagnetic polarity in the intervals of 170 Ma to the present time and of 550 Ma to the present time were studied, respectively. It is revealed that the spectrum of the basic variations in the paleointensity and of the duration of the polar intervals is discrete and includes quasi-periodic oscillations with characteristic times of 15 Ma, 8 Ma, 5 Ma, and 3 Ma. The characteristic time of these quasi-periodic changes of the geomagnetic field at the beginning and at the end of the Phanerozoic differed by no more than 10%. The spectral density of quasi-periodic variations of the geomagnetic field changed cyclically over geological time. The relation between the behaviors of the amplitude of paleointensity variations, the duration of the polar intervals, and their spectral density was shown. Quasi-periodic variations of the paleointensity (geomagnetic activity) had a relatively high spectral density in the interval of (150 - 40) Ma (in the Cretaceous - Early Paleogene). In this interval, both the amplitude of paleointensity variations and the duration of polar intervals increased. In the intervals of (170 - 150) Ma and of 30 Ma to the present, a quasi-periodic variation in the paleointensity practically did not detect against the background of its noise variations. At the same time, the amplitude of the paleointensity variations and duration of polar intervals decreased. An alternation of time intervals in which the paleointensity variations acquired either a quasi-periodic or noise character took place during the geomagnetic history.


title: More than Encoder: Introducing Transformer Decoder to Upsample

abstract: Medical image segmentation methods downsample images for feature extraction and then upsample them to restore resolution for pixel-level predictions. In such a schema, upsample technique is vital in restoring information for better performance. However, existing upsample techniques leverage little information from downsampling paths. The local and detailed feature from the shallower layer such as boundary and tissue texture is particularly more important in medical segmentation compared with natural image segmentation. To this end, we propose a novel upsample approach for medical image segmentation, Window Attention Upsample (WAU), which upsamples features conditioned on local and detailed features from downsampling path in local windows by introducing attention decoders of Transformer. WAU could serve as a general upsample method and be incorporated into any segmentation model that possesses lateral connections. We first propose the Attention Upsample which consists of Attention Decoder (AD) and bilinear upsample. AD leverages pixel-level attention to model long-range dependency and global information for a better upsample. Bilinear upsample is introduced as the residual connection to complement the upsampled features. Moreover, considering the extensive memory and computation cost of pixel-level attention, we further design a window attention scheme to restrict attention computation in local windows instead of the global range. We evaluate our method (WAU) on classic U-Net structure with lateral connections and achieve state-of-the-art performance on Synapse multi-organ segmentation, Medical Segmentation Decathlon (MSD) Brain, and Automatic Cardiac Diagnosis Challenge (ACDC) datasets. We also validate the effectiveness of our method on multiple classic architectures and achieve consistent improvement.


title: Dirac structures on the space of connections

abstract: We shall give a twisted Dirac structure on the space of irreducible connections on a SU(n)-bundle over a three-manifold, and give a family of twisted Dirac structures on the space of irreducible connections on the trivial SU(n)-bundle over a four-manifold. The twist is described by the Cartan 3-form on the space of connections. It vanishes over the subspace of flat connections. So the spaces of flat connections are endowed with ( non-twisted ) Dirac structures. The Dirac structure on the space of flat connections over the three-manifold is obtained as the boundary restriction of a corresponding Dirac structure over the four-manifold. We discuss also the action of the group of gauge transformations over these Dirac structures.


title: Self-energy corrected tight binding parameters for few p-block semiconductors in the hybridized atomic orbital basis constructed from first principles

abstract: We present self-energy corrected tight-binging(TB) parameters in the basis of the directed hybridised atomic orbitals constructed from first principles, for nano-diamonds as well as bulk diamond and zinc blende structures made of elements of group 13, 14 and 15 in the 2p, 3p and 4p blocks. With increasing principal quantum number of frontier orbitals, the lowering of self-energy corrections(SEC) to the band-gap and consequently to the dominant inter-atomic TB parameters, is much faster in bulk than in nano-diamonds and hence not transferable from bulks to nano-structures. However, TB parameters transfered from smaller nano-diamonds to much larger ones exclusively through mapping of neighbourhoods of atoms not limited to nearest neighbours, are found to render HOMO-LUMO gaps of the larger nano-diamonds with few hundreds of atoms in good agreement with their explicitly computed values at the DFT as well as DFT+G0W0 levels. TB parameters and their SEC are found to vary significantly from 2p to 3p block but negligibly from 3p to 4p, while varying rather slowly within each block, implying the possibility of transfer of SEC across block with increasing principal quantum number. The demonstrated easy transferability of self-energy corrected TB parameters in the hybrid orbital basis thus promises computationally inexpensive estimation of quasi-particle electronic structure of large finite systems with thousands of atoms.


title: Log-concavity in planar random walks

abstract: We prove log-concavity of exit probabilities of lattice random walks in certain planar regions.


title: Nuclei Grading of Clear Cell Renal Cell Carcinoma in Histopathological Image by Composite High-Resolution Network

abstract: The grade of clear cell renal cell carcinoma (ccRCC) is a critical prognostic factor, making ccRCC nuclei grading a crucial task in RCC pathology analysis. Computer-aided nuclei grading aims to improve pathologists' work efficiency while reducing their misdiagnosis rate by automatically identifying the grades of tumor nuclei within histopathological images. Such a task requires precisely segment and accurately classify the nuclei. However, most of the existing nuclei segmentation and classification methods can not handle the inter-class similarity property of nuclei grading, thus can not be directly applied to the ccRCC grading task. In this paper, we propose a Composite High-Resolution Network for ccRCC nuclei grading. Specifically, we propose a segmentation network called W-Net that can separate the clustered nuclei. Then, we recast the fine-grained classification of nuclei to two cross-category classification tasks, based on two high-resolution feature extractors (HRFEs) which are proposed for learning these two tasks. The two HRFEs share the same backbone encoder with W-Net by a composite connection so that meaningful features for the segmentation task can be inherited for the classification task. Last, a head-fusion block is applied to generate the predicted label of each nucleus. Furthermore, we introduce a dataset for ccRCC nuclei grading, containing 1000 image patches with 70945 annotated nuclei. We demonstrate that our proposed method achieves state-of-the-art performance compared to existing methods on this large ccRCC grading dataset.


title: Task Attended Meta-Learning for Few-Shot Learning

abstract: Meta-learning (ML) has emerged as a promising direction in learning models under constrained resource settings like few-shot learning. The popular approaches for ML either learn a generalizable initial model or a generic parametric optimizer through episodic training. The former approaches leverage the knowledge from a batch of tasks to learn an optimal prior. In this work, we study the importance of a batch for ML. Specifically, we first incorporate a batch episodic training regimen to improve the learning of the generic parametric optimizer. We also hypothesize that the common assumption in batch episodic training that each task in a batch has an equal contribution to learning an optimal meta-model need not be true. We propose to weight the tasks in a batch according to their "importance" in improving the meta-model's learning. To this end, we introduce a training curriculum motivated by selective focus in humans, called task attended meta-training, to weight the tasks in a batch. Task attention is a standalone module that can be integrated with any batch episodic training regimen. The comparisons of the models with their non-task-attended counterparts on complex datasets like miniImageNet and tieredImageNet validate its effectiveness.


title: Arithmetic of Ch\^atelet surface bundles revisited

abstract: We study arithmetic of the algebraic varieties defined over number fields by applying Lagrange interpolation to fibrations. Assuming the finiteness of the Tate-Shafarevich group of a certain elliptic curve, we show, for Ch\^atelet surface bundles over curves, that the violation of Hasse principle being accounted for by the Brauer-Manin obstruction is not invariant under an arbitrary finite extension of the ground field.


title: Generalizing the coupling between geometry and matter: $f(R,L_m,T)$ gravity

abstract: We generalize and unify the $f(R,T)$ and $f(R,L_m)$ type gravity models by assuming that the gravitational Lagrangian is given by an arbitrary function of the Ricci scalar $R$, of the trace of the energy-momentum tensor $T$, and of the matter Lagrangian $L_m$, so that $L_{grav}=f(R,L_m,T)$. We obtain the gravitational field equations in the metric formalism, the equations of motion for test particles, and the energy and momentum balance equations, which follow from the covariant divergence of the energy-momentum tensor. Generally, the motion is non-geodesic, and takes place in the presence of an extra force orthogonal to the four-velocity. The Newtonian limit of the equations of motion is also investigated, and the expression of the extra acceleration is obtained for small velocities and weak gravitational fields. The generalized Poisson equation is also obtained in the Newtonian limit, and the Dolgov-Kawasaki instability is also investigated. The cosmological implications of the theory are investigated for a homogeneous, isotropic and flat Universe for two particular choices of the Lagrangian density $f(R,L_m,T)$ of the gravitational field, with a multiplicative and additive algebraic structure in the matter couplings, respectively, and for two choices of the matter Lagrangian, by using both analytical and numerical methods.


title: Rational integrals of 2-dimensional geodesic flows: new examples

abstract: This paper is devoted to searching for Riemannian metrics on 2-surfaces whose geodesic flows admit a rational in momenta first integral with a linear numerator and denominator. The explicit examples of metrics and such integrals are constructed. Few superintegrable systems are found having both a polynomial and a rational integrals which are functionally independent of the Hamiltonian.


title: Non-integrability for $ \mathcal{N}=1 $ SCFTs in $ 5d $

abstract: We explore the \emph{Liouvillian} non-integrability criteria for long quiver gauge theories those preserve $ \mathcal{N}=1 $ SUSY in $ 5d $. We probe type IIB solutions with (an $ AdS_6 $ factor) semi-classical strings which capture the strong coupling dynamics of $ \mathcal{N}=1 $ SCFTs in $ 5d $. Our analysis reveals an underlying non-integrable structure within some sub-sector of these $ 5d $ SCFTs. To solidify our claim, we complement our analytic results through numerics. We estimate various chaos indicators for the phase space which confirm the onset of a \emph{chaotic} motion for these type IIB strings.


title: Universal functions for the Sharkovsky classes of maps

abstract: We exhibit a single interval map (called universal map) that admits all those orbit patterns which are available in the first Sharkovsky class. An interval map is said to be in the first Sharkovsky class if every periodic point of it is a fixed point. This provides a way to find universal maps in the class of contractions on interval. We also characterize all such universal maps in the first Sharkovsky class.


title: HapFIC: An Adaptive Force/Position Controller for Safe Environment Interaction in Articulated Systems

abstract: Haptic interaction is essential for the dynamic dexterity of animals, which seamlessly switch from an impedance to an admittance behaviour using the force feedback from their proprioception. However, this ability is extremely challenging to reproduce in robots, especially when dealing with complex interaction dynamics, distributed contacts, and contact switching. Current model-based controllers require accurate interaction modelling to account for contacts and stabilise the interaction. In this manuscript, we propose an adaptive force/position controller that exploits the fractal impedance controller's passivity and non-linearity to execute a finite search algorithm using the force feedback signal from the sensor at the end-effector. The method is computationally inexpensive, opening the possibility to deal with distributed contacts in the future. We evaluated the architecture in physics simulation and showed that the controller can robustly control the interaction with objects of different dynamics without violating the maximum allowable target forces or causing numerical instability even for very rigid objects. The proposed controller can also autonomously deal with contact switching and may find application in multiple fields such as legged locomotion, rehabilitation and assistive robotics.


title: CAMERAS: Enhanced Resolution And Sanity preserving Class Activation Mapping for image saliency

abstract: Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation with low resolution activation maps of the deeper layers, resulting in compromised image saliency. Remedifying this can lead to sanity failures. We propose CAMERAS, a technique to compute high-fidelity backpropagation saliency maps without requiring any external priors and preserving the map sanity. Our method systematically performs multi-scale accumulation and fusion of the activation maps and backpropagated gradients to compute precise saliency maps. From accurate image saliency to articulation of relative importance of input features for different models, and precise discrimination between model perception of visually similar objects, our high-resolution mapping offers multiple novel insights into the black-box deep visual models, which are presented in the paper. We also demonstrate the utility of our saliency maps in adversarial setup by drastically reducing the norm of attack signals by focusing them on the precise regions identified by our maps. Our method also inspires new evaluation metrics and a sanity check for this developing research direction. Code is available here https://github.com/VisMIL/CAMERAS


title: Chiral Magic-Angle Twisted Bilayer Graphene in a Magnetic Field: Landau Level Correspondence, Exact Wavefunctions and Fractional Chern Insulators

abstract: We show that the flat bands in the chiral model of magic-angle twisted bilayer graphene remain exactly flat in the presence of a perpendicular magnetic field. This is shown by an exact mapping between the model and the lowest Landau level wavefunctions at an effective magnetic field, in which the external field is either augmented or reduced by one flux quantum per unit cell. When the external field reaches one flux quantum per unit cell, the model exhibits a topological phase transition. These findings allow us to analyze a Jain-series of Fractional Chern Insulators states in the exactly flat band, and to point out an unconventional dependence of the energy gap on the magnetic field.


title: Implementing a Detection System for COVID-19 based on Lung Ultrasound Imaging and Deep Learning

abstract: The COVID-19 pandemic started in China in December 2019 and quickly spread to several countries. The consequences of this pandemic are incalculable, causing the death of millions of people and damaging the global economy. To achieve large-scale control of this pandemic, fast tools for detection and treatment of patients are needed. Thus, the demand for alternative tools for the diagnosis of COVID-19 has increased dramatically since accurated and automated tools are not available. In this paper we present the ongoing work on a system for COVID-19 detection using ultrasound imaging and using Deep Learning techniques. Furthermore, such a system is implemented on a Raspberry Pi to make it portable and easy to use in remote regions without an Internet connection.


title: TinyML: Analysis of Xtensa LX6 microprocessor for Neural Network Applications by ESP32 SoC

abstract: In recent decades, Machine Learning (ML) has become extremely important for many computing applications. The pervasiveness of ultra-low-power embedded devices such as ESP32 or ESP32 Cam with tiny Machine Learning (tinyML) applications will enable the mass proliferation of Artificial Intelligent powered Embedded IoT Devices. In the last few years, the microcontroller device (Espressif ESP32) became powerful enough to be used for small/tiny machine learning (tinyML) tasks. The ease of use of platforms like Arduino IDE, MicroPython and TensorFlow Lite (TF) with tinyML application make it an indispensable topic of research for mobile robotics, modern computer science and electrical engineering. The goal of this paper is to analyze the speed of the Xtensa dual core 32-bit LX6 microprocessor by running a neural network application. The different number of inputs (9, 36, 144 and 576) inputted through the different number of neurons in neural networks with one and two hidden layers. Xtensa LX6 microprocessor has been analyzed because it comes inside with Espressif ESP32 and ESP32 Cam which are very easy to use, plug and play IoT device. In this paper speed of the Xtensa LX6 microprocessor in feed-forward mode has been analyzed.


title: Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples

abstract: Training images with data transformations have been suggested as contrastive examples to complement the testing set for generalization performance evaluation of deep neural networks (DNNs). In this work, we propose a practical framework ContRE (The word "contre" means "against" or "versus" in French.) that uses Contrastive examples for DNN geneRalization performance Estimation. Specifically, ContRE follows the assumption in contrastive learning that robust DNN models with good generalization performance are capable of extracting a consistent set of features and making consistent predictions from the same image under varying data transformations. Incorporating with a set of randomized strategies for well-designed data transformations over the training set, ContRE adopts classification errors and Fisher ratios on the generated contrastive examples to assess and analyze the generalization performance of deep models in complement with a testing set. To show the effectiveness and the efficiency of ContRE, extensive experiments have been done using various DNN models on three open source benchmark datasets with thorough ablation studies and applicability analyses. Our experiment results confirm that (1) behaviors of deep models on contrastive examples are strongly correlated to what on the testing set, and (2) ContRE is a robust measure of generalization performance complementing to the testing set in various settings.


title: Encoder-Decoder Based Attractors for End-to-End Neural Diarization

abstract: This paper investigates an end-to-end neural diarization (EEND) method for an unknown number of speakers. In contrast to the conventional cascaded approach to speaker diarization, EEND methods are better in terms of speaker overlap handling. However, EEND still has a disadvantage in that it cannot deal with a flexible number of speakers. To remedy this problem, we introduce encoder-decoder-based attractor calculation module (EDA) to EEND. Once frame-wise embeddings are obtained, EDA sequentially generates speaker-wise attractors on the basis of a sequence-to-sequence method using an LSTM encoder-decoder. The attractor generation continues until a stopping condition is satisfied; thus, the number of attractors can be flexible. Diarization results are then estimated as dot products of the attractors and embeddings. The embeddings from speaker overlaps result in larger dot product values with multiple attractors; thus, this method can deal with speaker overlaps. Because the maximum number of output speakers is still limited by the training set, we also propose an iterative inference method to remove this restriction. Further, we propose a method that aligns the estimated diarization results with the results of an external speech activity detector, which enables fair comparison against cascaded approaches. Extensive evaluations on simulated and real datasets show that EEND-EDA outperforms the conventional cascaded approach.


title: Modern compressive tomography for quantum information science

abstract: This review serves as a concise introductory survey of modern compressive tomography developed since 2019. These are schemes meant for characterizing arbitrary low-rank quantum objects, be it an unknown state, a process or detector, using minimal measuring resources (hence compressive) without any \emph{a priori} assumptions (rank, sparsity, eigenbasis, \emph{etc}.) about the quantum object. This article contains a reasonable amount of technical details for the quantum-information community to start applying the methods discussed here. To facilitate the understanding of formulation logic and physics of compressive tomography, the theoretical concepts and important numerical results (both new and cross-referenced) shall be presented in a pedagogical manner.


title: TD-GEN: Graph Generation With Tree Decomposition

abstract: We propose TD-GEN, a graph generation framework based on tree decomposition, and introduce a reduced upper bound on the maximum number of decisions needed for graph generation. The framework includes a permutation invariant tree generation model which forms the backbone of graph generation. Tree nodes are supernodes, each representing a cluster of nodes in the graph. Graph nodes and edges are incrementally generated inside the clusters by traversing the tree supernodes, respecting the structure of the tree decomposition, and following node sharing decisions between the clusters. Finally, we discuss the shortcomings of standard evaluation criteria based on statistical properties of the generated graphs as performance measures. We propose to compare the performance of models based on likelihood. Empirical results on a variety of standard graph generation datasets demonstrate the superior performance of our method.


title: New directions for contact integrators

abstract: Contact integrators are a family of geometric numerical schemes which guarantee the conservation of the contact structure. In this work we review the construction of both the variational and Hamiltonian versions of these methods. We illustrate some of the advantages of geometric integration in the dissipative setting by focusing on models inspired by recent studies in celestial mechanics and cosmology.


title: Exploring Semantic Relationships for Unpaired Image Captioning

abstract: Recently, image captioning has aroused great interest in both academic and industrial worlds. Most existing systems are built upon large-scale datasets consisting of image-sentence pairs, which, however, are time-consuming to construct. In addition, even for the most advanced image captioning systems, it is still difficult to realize deep image understanding. In this work, we achieve unpaired image captioning by bridging the vision and the language domains with high-level semantic information. The motivation stems from the fact that the semantic concepts with the same modality can be extracted from both images and descriptions. To further improve the quality of captions generated by the model, we propose the Semantic Relationship Explorer, which explores the relationships between semantic concepts for better understanding of the image. Extensive experiments on MSCOCO dataset show that we can generate desirable captions without paired datasets. Furthermore, the proposed approach boosts five strong baselines under the paired setting, where the most significant improvement in CIDEr score reaches 8%, demonstrating that it is effective and generalizes well to a wide range of models.


title: Hole Detection and Healing in Hybrid Sensor Networks

abstract: Although monitoring and covering are fundamental goals of a wireless sensor network (WSN), the accidental death of sensors or the running out of their energy would result in holes in the WSN. Such holes have the potential to disrupt the primary functions of WSNs. This paper investigates the hole detection and healing problems in hybrid WSNs with non-identical sensor sensing ranges. In particular, we aim to propose centralized algorithms for detecting holes in a given region and maximizing the area covered by a WSN in the presence of environmental obstacles. To precisely identify the boundary of the holes, we use an additively weighted Voronoi diagram and a polynomial-time algorithm.Furthermore, since this problem is known to be computationally difficult, we propose a centralized greedy 1/2-approximation algorithm to maximize the area covered by sensors. Finally, we implement the algorithms and run simulations to show that our approximation algorithm efficiently covers the holes by moving the mobile sensors.


title: Bayesian inference for continuous-time hidden Markov models with an unknown number of states

abstract: We consider the modeling of data generated by a latent continuous-time Markov jump process with a state space of finite but unknown dimensions. Typically in such models, the number of states has to be pre-specified, and Bayesian inference for a fixed number of states has not been studied until recently. In addition, although approaches to address the problem for discrete-time models have been developed, no method has been successfully implemented for the continuous-time case. We focus on reversible jump Markov chain Monte Carlo which allows the trans-dimensional move among different numbers of states in order to perform Bayesian inference for the unknown number of states. Specifically, we propose an efficient split-combine move which can facilitate the exploration of the parameter space, and demonstrate that it can be implemented effectively at scale. Subsequently, we extend this algorithm to the context of model-based clustering, allowing numbers of states and clusters both determined during the analysis. The model formulation, inference methodology, and associated algorithm are illustrated by simulation studies. Finally, We apply this method to real data from a Canadian healthcare system in Quebec.


title: Effect of Plasmonic Coupling in Different Assembly of Gold Nanorods Studied by FDTD

abstract: The influence of the orientation of gold nanorods in different assemblies has been investigated using the Finite Difference Time Domain (FDTD) simulation method. To understand the relative orientation, we vary the size and angle in dimer geometries. Significant effects of plasmon coupling emerged in longitudinal resonances having end-to-end configurations of gold nanorods. The effect of orientational plasmon coupling in dimers gives rise to both bonding and anti-bonding plasmon modes. Effects of various geometries like primary monomer, dimer, trimer, and tetramer structures have been explored and compared with their higher nanorod ensembles. The asymmetric spectral response in a 4 * 4 gold nanorods array indicates a Fano-like resonance. The variation of gap distance in ordered arrays allowed modulation of the Fano resonance mode. The plasmon modes' resonance wavelength and field enhancement have been tuned by varying the gap distance, angular orientation, size irregularity between the nanorods, and nanorod numbers in an array. The integrated nanostructures studied here are not only significant for fundamental research but also applications in plasmon-based devices.


title: FedXGBoost: Privacy-Preserving XGBoost for Federated Learning

abstract: Federated learning is the distributed machine learning framework that enables collaborative training across multiple parties while ensuring data privacy. Practical adaptation of XGBoost, the state-of-the-art tree boosting framework, to federated learning remains limited due to high cost incurred by conventional privacy-preserving methods. To address the problem, we propose two variants of federated XGBoost with privacy guarantee: FedXGBoost-SMM and FedXGBoost-LDP. Our first protocol FedXGBoost-SMM deploys enhanced secure matrix multiplication method to preserve privacy with lossless accuracy and lower overhead than encryption-based techniques. Developed independently, the second protocol FedXGBoost-LDP is heuristically designed with noise perturbation for local differential privacy, and empirically evaluated on real-world and synthetic datasets.


title: A system of of Hamilton-Jacobi equations characterizing geodesic centroidal tessellations

abstract: We introduce a class of systems of Hamilton-Jacobi equations characterizing geodesic centroidal tessellations, i.e. tessellations of domains with respect to geodesic distances where generators and centroids coincide. Typical examples are given by geodesic centroidal Voronoi tessellations and geodesic centroidal power diagrams. An appropriate version of the Fast Marching method on unstructured grids allows computing the solution of the Hamilton-Jacobi system and therefore the associated tessellations. We propose various numerical examples to illustrate the features of the technique.


title: Designing flat-band tight-binding models with tunable multifold band touching points

abstract: Being dispersionless, flat bands on periodic lattices are solely characterized by their macroscopically degenerate eigenstates: compact localized states (CLSs) in real space and Bloch states in reciprocal space. Based on this property, this work presents a straightforward method to build flat-band tight-binding models with short-range hoppings \emph{on any periodic lattice}. The method consists in starting from a CLS and engineering families of Bloch Hamiltonians as quadratic (or linear) functions of the associated Bloch state. The resulting tight-binding models not only exhibit a flat band, but also multifold quadratic (or linear) band touching points (BTPs) whose number, location, and degeneracy can be controlled to a large extent. Quadratic flat-band models are ubiquitous: they can be built from any arbitrary CLS, on any lattice, in any dimension and with any number $N\geq2$ of bands. Linear flat-band models are rarer: they require $N\geq3$ and can only be built from CLSs that fulfill certain compatibility relations with the underlying lattice. Most flat-band models from the literature can be classified according to this scheme: Mielke's and Tasaki's models belong to the quadratic class, while the Lieb, dice and breathing Kagome models belong to the linear class. Many novel flat-band models are introduced, among which an $N=4$ bilayer honeycomb model with fourfold quadratic BTPs, an $N=5$ dice model with fivefold linear BTPs, and an $N=3$ Kagome model with BTPs that can be smoothly tuned from linear to quadratic.


title: Distributed Banach-Picard Iteration: Application to Distributed EM and Distributed PCA

abstract: In recent work, we proposed a distributed Banach-Picard iteration (DBPI) that allows a set of agents, linked by a communication network, to find a fixed point of a locally contractive (LC) map that is the average of individual maps held by said agents. In this work, we build upon the DBPI and its local linear convergence (LLC) guarantees to make several contributions. We show that Sanger's algorithm for principal component analysis (PCA) corresponds to the iteration of an LC map that can be written as the average of local maps, each map known to each agent holding a subset of the data. Similarly, we show that a variant of the expectation-maximization (EM) algorithm for parameter estimation from noisy and faulty measurements in a sensor network can be written as the iteration of an LC map that is the average of local maps, each available at just one node. Consequently, via the DBPI, we derive two distributed algorithms - distributed EM and distributed PCA - whose LLC guarantees follow from those that we proved for the DBPI. The verification of the LC condition for EM is challenging, as the underlying operator depends on random samples, thus the LC condition is of probabilistic nature.


title: On the R-matrix realization of quantum loop algebras

abstract: We consider $\rm R$-matrix realization of the quantum deformations of the loop algebras $\tilde{\mathfrak{g}}$ corresponding to non-exceptional affine Lie algebras of type $\hat{\mathfrak{g}}=A^{(1)}_{N-1}$, $B^{(1)}_n$, $C^{(1)}_n$, $D^{(1)}_n$, $A^{(2)}_{N-1}$. For each $U_q(\tilde{\mathfrak{g}})$ we investigate the commutation relations between Gauss coordinates of the fundamental $\mathbb{L}$-operators using embedding of the smaller algebra into bigger one. The new realization of these algebras in terms of the currents is given. The relations between all off-diagonal Gauss coordinates and certain projections from the ordered products of the currents are presented. These relations are important in applications to the quantum integrable models.


title: Overcharging Extremal Black Holes

abstract: The Weak Cosmic Censorship (WCC) conjecture can be used as a consistency criterion for any viable modification over general relativity (GR). We employ this idea to show that in contrast to the black holes in GR, it is indeed possible to overcharge modified extremal black hole solutions. Demanding the validity of WCC, we put some stringent constraints on various parameters of the theory. In particular, for charged Einstein-aether black hole, our method is strong enough to reproduce the identical bound on the parameter obtained previously from entirely different considerations.


title: Two dimensional liquid crystal droplet problem with tangential boundary condition

abstract: This paper studies a shape optimization problem which reduces to a nonlocal free boundary problem involving perimeter. It is motivated by a study of liquid crystal droplets with a tangential anchoring boundary condition and a volume constraint. We establish in 2D the existence of an optimal shape that has two cusps on the boundary. We also prove the boundary of the droplet is a chord-arc curve with its normal vector field in the VMO space. In fact, the boundary curves of such droplets belong to the so-called Weil-Petersson class. In addition, the asymptotic behavior of the optimal shape when the volume becomes extremely large or small is also studied.


title: Outlier Detection and Spatial Analysis Algorithms

abstract: Outlier detection is a significant area in data mining. It can be either used to pre-process the data prior to an analysis or post the processing phase (before visualization) depending on the effectiveness of the outlier and its importance. Outlier detection extends to several fields such as detection of credit card fraud, network intrusions, machine failure prediction, potential terrorist attacks, and so on. Outliers are those data points with characteristics considerably different. They deviate from the data set causing inconsistencies, noise and anomalies during analysis and result in modification of the original points However, a common misconception is that outliers have to be immediately eliminated or replaced from the data set. Such points could be considered useful if analyzed separately as they could be obtained from a separate mechanism entirely making it important to the research question. This study surveys the different methods of outlier detection for spatial analysis. Spatial data or geospatial data are those that exhibit geographic properties or attributes such as position or areas. An example would be weather data such as precipitation, temperature, wind velocity, and so on collected for a defined region.


title: Semileptonic decays $D\to\eta\pi e^+\nu_e$ in the $a_0(980)$ region

abstract: The mechanism of the four-quark production of the light scalar isovector four-quark state $a_0(980)$ in the $D\to\eta\pi e^+\nu_e$ decays is discussed. It is shown that the characteristic features of the shape of the $\eta\pi$ mass spectra expected in our scheme can serve as the indicator of the production mechanism and internal structure of the $a_0(980)$ resonance.


title: A compressive multi-kernel method for privacy-preserving machine learning

abstract: As the analytic tools become more powerful, and more data are generated on a daily basis, the issue of data privacy arises. This leads to the study of the design of privacy-preserving machine learning algorithms. Given two objectives, namely, utility maximization and privacy-loss minimization, this work is based on two previously non-intersecting regimes -- Compressive Privacy and multi-kernel method. Compressive Privacy is a privacy framework that employs utility-preserving lossy-encoding scheme to protect the privacy of the data, while multi-kernel method is a kernel based machine learning regime that explores the idea of using multiple kernels for building better predictors. The compressive multi-kernel method proposed consists of two stages -- the compression stage and the multi-kernel stage. The compression stage follows the Compressive Privacy paradigm to provide the desired privacy protection. Each kernel matrix is compressed with a lossy projection matrix derived from the Discriminant Component Analysis (DCA). The multi-kernel stage uses the signal-to-noise ratio (SNR) score of each kernel to non-uniformly combine multiple compressive kernels. The proposed method is evaluated on two mobile-sensing datasets -- MHEALTH and HAR -- where activity recognition is defined as utility and person identification is defined as privacy. The results show that the compression regime is successful in privacy preservation as the privacy classification accuracies are almost at the random-guess level in all experiments. On the other hand, the novel SNR-based multi-kernel shows utility classification accuracy improvement upon the state-of-the-art in both datasets. These results indicate a promising direction for research in privacy-preserving machine learning.


title: Image-guided Breast Biopsy of MRI-visible Lesions with a Hand-mounted Motorised Needle Steering Tool

abstract: A biopsy is the only diagnostic procedure for accurate histological confirmation of breast cancer. When sonographic placement is not feasible, a Magnetic Resonance Imaging(MRI)-guided biopsy is often preferred. The lack of real-time imaging information and the deformations of the breast make it challenging to bring the needle precisely towards the tumour detected in pre-interventional Magnetic Resonance (MR) images. The current manual MRI-guided biopsy workflow is inaccurate and would benefit from a technique that allows real-time tracking and localisation of the tumour lesion during needle insertion. This paper proposes a robotic setup and software architecture to assist the radiologist in targeting MR-detected suspicious tumours. The approach benefits from image fusion of preoperative images with intraoperative optical tracking of markers attached to the patient's skin. A hand-mounted biopsy device has been constructed with an actuated needle base to drive the tip toward the desired direction. The steering commands may be provided both by user input and by computer guidance. The workflow is validated through phantom experiments. On average, the suspicious breast lesion is targeted with a radius down to 2.3 mm. The results suggest that robotic systems taking into account breast deformations have the potentials to tackle this clinical challenge.


title: Two-Faced Humans on Twitter and Facebook: Harvesting Social Multimedia for Human Personality Profiling

abstract: Human personality traits are the key drivers behind our decision-making, influencing our life path on a daily basis. Inference of personality traits, such as Myers-Briggs Personality Type, as well as an understanding of dependencies between personality traits and users' behavior on various social media platforms is of crucial importance to modern research and industry applications. The emergence of diverse and cross-purpose social media avenues makes it possible to perform user personality profiling automatically and efficiently based on data represented across multiple data modalities. However, the research efforts on personality profiling from multi-source multi-modal social media data are relatively sparse, and the level of impact of different social network data on machine learning performance has yet to be comprehensively evaluated. Furthermore, there is not such dataset in the research community to benchmark. This study is one of the first attempts towards bridging such an important research gap. Specifically, in this work, we infer the Myers-Briggs Personality Type indicators, by applying a novel multi-view fusion framework, called "PERS" and comparing the performance results not just across data modalities but also with respect to different social network data sources. Our experimental results demonstrate the PERS's ability to learn from multi-view data for personality profiling by efficiently leveraging on the significantly different data arriving from diverse social multimedia sources. We have also found that the selection of a machine learning approach is of crucial importance when choosing social network data sources and that people tend to reveal multiple facets of their personality in different social media avenues. Our released social multimedia dataset facilitates future research on this direction.


title: Local-global compatibility of mod $p$ Langlands program for certain Shimura varieties

abstract: We generalize the local-global compatibility result in arXiv:1506.04022 to higher dimensional cases, by examining the relation between Scholze's functor and cohomology of Kottwitz-Harris-Taylor type Shimura varieties. Along the way we prove a cuspidality criterion from type theory. We also deal with compatibility for torsion classes in the case of semisimple mod $p$ Galois representations with distinct irreducible components under certain flatness hypotheses.


title: Temperature and Pressure-driven Spin transitions and Piezochromism in a Mn-based Hybrid Perovskite

abstract: Hybrid perovskites have been at the forefront of condensed matter research particularly in context of device applications primarily in relation to applications in the field of solar cells. In this article, we demonstrate that several new functionalities may be added to the arsenal of hybrid perovskites, in terms of external stimuli driven spin transitions as well as piezochromism. As an example, we study Dimethylammonium Manganese Formate (DMAMnF), a hybrid perovskite investigated quite extensively experimentally. We show by employing first principles DFT+U calculations with the aid of ab initio molecular dynamics calculations that DMAMnF shows temperature and pressure driven spin transitions, from a low spin $S=1/2$ to a high spin $S=5/2$ state. This transition is accompanied by a hysteresis, and we find that this hysteresis and the transition temperature are quite close to room temperature, which is desirable for device applications particularly in memory, display, and switching devices. The operating pressure is a few GPa, which is accessible in standard laboratory settings. We find that the cooperative behaviour showing up as hysteresis accompanying the transition is driven primarily by elastic interactions, assisted by magnetic superexchange between Mn atoms. Last but not least we demonstrate that the spin transition is associated with piezochromism which could also be important for applications.


title: Overall Behavioural Index (OBI) For Measuring Segregation

abstract: Segregation, defined as the degree of separation between two or more population groups, helps to understand a complex social environment and subsequently provides a basis for public policy intervention. To measure segregation, past works often propose indexes that are criticized for being over-simplified and over-reduced. In other words, these indexes use the highly aggregated information to measure segregation. In this paper, we propose three novel indexes to measure segregation, namely: (i) Individual Segregation Index (ISI), (ii) Individual Inclination Index (III), and (iii) Overall Behavioural Index (OBI). The ISI index measures individuals' segregation, and the III index reports the individuals' inclination towards other population groups. The OBI index, calculated using both III and ISI index, is non-simplified and not only recognizes individuals' connectivity behaviour but group's connectivity behavioural distribution as well. By considering commonly used Freeman's segregation and homophily index as baseline indexes, we compare the OBI index on real call data records (CDR) dataset of Estonia to show the effectiveness of the proposed indexes.


title: Bounds on Systoles and Homotopy Complexity

abstract: We give an elementary proof of a weak variant of the homotopy type conjecture from [Gel04]. The proof relies on Belolipetskys estimate on the systole in terms of the volume which is a consequence of Prasads volume formula. In particular we extend the estimate established in [B20] for hyperbolic manifolds to general arithmetic manifolds.


title: The role of AGN and its obscuration on the position of the host galaxy relative to Main Sequence

abstract: We use X-ray Active Galactic Nuclei (AGN) observed by the Chandra X-ray Observatory within the 9.3 deg$^2$ Bo$\rm \ddot{o}$tes field of the NDWFS to study whether there is a correlation between X-ray luminosity (L$_X$) and star formation rate (SFR) of the host galaxy, at $\rm 0.5<z<2.0$, with respect to the position of the galaxy to the main sequence (SFR$_{norm}$). About half of the sources in the X-ray sample have spectroscopic redshifts. We also construct a reference galaxy catalogue. For both datasets, we use photometric data from optical to the far infrared, compiled by the HELP project and apply spectral energy distribution (SED) fitting, using the X-CIGALE code. We exclude quiescent sources from both the X-ray and the reference samples. We also account for the mass completeness of our dataset, in different redshifts bins. Our analysis highlights the importance of studying the SFR-L$_X$ relation, in a uniform manner, taking into account the systematics and selection effects. Our results suggest that, in less massive galaxies ($\rm log\,[M_*(M_\odot)] \sim 11$), AGN enhances the SFR of the host galaxy by $\sim 50\%$ compared to non AGN systems. A flat relation is observed for the most massive galaxies. SFR$_{norm}$ does not evolve with redshift. The results, although tentative, are consistent with a scenario in which, in less massive systems, both AGN and star formation (SF) are fed by cold gas, supplied by a merger event. In more massive galaxies, the flat relation could be explained by a different SMBH fuelling mechanism that is decoupled from the star formation of the host galaxy (e.g. hot diffuse gas). Finally, we compare the host galaxy properties of X-ray absorbed and unabsorbed sources. Our results show no difference which suggests that X-ray absorption is not linked with the properties of the galaxy.


title: A Comprehensive Review on Non-Neural Networks Collaborative Filtering Recommendation Systems

abstract: Over the past two decades, recommender systems have attracted a lot of interest due to the explosion in the amount of data in online applications. A particular attention has been paid to collaborative filtering, which is the most widely used in applications that involve information recommendations. Collaborative filtering (CF) uses the known preference of a group of users to make predictions and recommendations about the unknown preferences of other users (recommendations are made based on the past behavior of users). First introduced in the 1990s, a wide variety of increasingly successful models have been proposed. Due to the success of machine learning techniques in many areas, there has been a growing emphasis on the application of such algorithms in recommendation systems. In this article, we present an overview of the CF approaches for recommender systems, their two main categories, and their evaluation metrics. We focus on the application of classical Machine Learning algorithms to CF recommender systems by presenting their evolution from their first use-cases to advanced Machine Learning models. We attempt to provide a comprehensive and comparative overview of CF systems (with python implementations) that can serve as a guideline for research and practice in this area.


title: Guiding vector fields in Paparazzi autopilot

abstract: This article is a technical report on the two different guidance systems based on vector fields that can be found in Paparazzi, a free sw/hw autopilot. Guiding vector fields allow autonomous vehicles to track paths described by the user mathematically. In particular, we allow two descriptions of the path with an implicit or a parametric function. Each description is associated with its corresponding guiding vector field algorithm. The implementations of the two algorithms are light enough to be run in a modern microcontroller. We will cover the basic theory on how they work, how a user can implement its own paths in Paparazzi, how to exploit them to coordinate multiple vehicles, and we finish with some experimental results. Although the presented implementation is focused on fixed-wing aircraft, the guidance is also applicable to other kinds of aerial vehicles such as rotorcraft.


title: Tag, Copy or Predict: A Unified Weakly-Supervised Learning Framework for Visual Information Extraction using Sequences

abstract: Visual information extraction (VIE) has attracted increasing attention in recent years. The existing methods usually first organized optical character recognition (OCR) results into plain texts and then utilized token-level entity annotations as supervision to train a sequence tagging model. However, it expends great annotation costs and may be exposed to label confusion, and the OCR errors will also significantly affect the final performance. In this paper, we propose a unified weakly-supervised learning framework called TCPN (Tag, Copy or Predict Network), which introduces 1) an efficient encoder to simultaneously model the semantic and layout information in 2D OCR results; 2) a weakly-supervised training strategy that utilizes only key information sequences as supervision; and 3) a flexible and switchable decoder which contains two inference modes: one (Copy or Predict Mode) is to output key information sequences of different categories by copying a token from the input or predicting one in each time step, and the other (Tag Mode) is to directly tag the input sequence in a single forward pass. Our method shows new state-of-the-art performance on several public benchmarks, which fully proves its effectiveness.


title: The Hrushovski-Lang-Weil estimates

abstract: In this work we give a geometric proof of Hrushovski's generalization of the Lang-Weil estimates on the number of points in the intersection of a correspondence with the graph of Frobenius.


title: Solution for Large-scale Long-tailed Recognition with Noisy Labels

abstract: This is a technical report for CVPR 2021 AliProducts Challenge. AliProducts Challenge is a competition proposed for studying the large-scale and fine-grained commodity image recognition problem encountered by worldleading ecommerce companies. The large-scale product recognition simultaneously meets the challenge of noisy annotations, imbalanced (long-tailed) data distribution and fine-grained classification. In our solution, we adopt stateof-the-art model architectures of both CNNs and Transformer, including ResNeSt, EfficientNetV2, and DeiT. We found that iterative data cleaning, classifier weight normalization, high-resolution finetuning, and test time augmentation are key components to improve the performance of training with the noisy and imbalanced dataset. Finally, we obtain 6.4365% mean class error rate in the leaderboard with our ensemble model.


title: Optimal personalised treatment computation through in silico clinical trials on patient digital twins

abstract: In Silico Clinical Trials (ISTC), i.e., clinical experimental campaigns carried out by means of computer simulations, hold the promise to decrease time and cost for the safety and efficacy assessment of pharmacological treatments, reduce the need for animal and human testing, and enable precision medicine. In this paper we present methods and an algorithm that, by means of extensive computer simulation--based experimental campaigns (ISTC) guided by intelligent search, optimise a pharmacological treatment for an individual patient (precision medicine). e show the effectiveness of our approach on a case study involving a real pharmacological treatment, namely the downregulation phase of a complex clinical protocol for assisted reproduction in humans.


title: MILP, pseudo-boolean, and OMT solvers for optimal fault-tolerant placements of relay nodes in mission critical wireless networks

abstract: In critical infrastructures like airports, much care has to be devoted in protecting radio communication networks from external electromagnetic interference. Protection of such mission-critical radio communication networks is usually tackled by exploiting radiogoniometers: at least three suitably deployed radiogoniometers, and a gateway gathering information from them, permit to monitor and localise sources of electromagnetic emissions that are not supposed to be present in the monitored area. Typically, radiogoniometers are connected to the gateway through relay nodes. As a result, some degree of fault-tolerance for the network of relay nodes is essential in order to offer a reliable monitoring. On the other hand, deployment of relay nodes is typically quite expensive. As a result, we have two conflicting requirements: minimise costs while guaranteeing a given fault-tolerance. In this paper, we address the problem of computing a deployment for relay nodes that minimises the relay node network cost while at the same time guaranteeing proper working of the network even when some of the relay nodes (up to a given maximum number) become faulty (fault-tolerance). We show that, by means of a computation-intensive pre-processing on a HPC infrastructure, the above optimisation problem can be encoded as a 0/1 Linear Program, becoming suitable to be approached with standard Artificial Intelligence reasoners like MILP, PB-SAT, and SMT/OMT solvers. Our problem formulation enables us to present experimental results comparing the performance of these three solving technologies on a real case study of a relay node network deployment in areas of the Leonardo da Vinci Airport in Rome, Italy.


title: Quality-Aware Memory Network for Interactive Volumetric Image Segmentation

abstract: Despite recent progress of automatic medical image segmentation techniques, fully automatic results usually fail to meet the clinical use and typically require further refinement. In this work, we propose a quality-aware memory network for interactive segmentation of 3D medical images. Provided by user guidance on an arbitrary slice, an interaction network is firstly employed to obtain an initial 2D segmentation. The quality-aware memory network subsequently propagates the initial segmentation estimation bidirectionally over the entire volume. Subsequent refinement based on additional user guidance on other slices can be incorporated in the same manner. To further facilitate interactive segmentation, a quality assessment module is introduced to suggest the next slice to segment based on the current segmentation quality of each slice. The proposed network has two appealing characteristics: 1) The memory-augmented network offers the ability to quickly encode past segmentation information, which will be retrieved for the segmentation of other slices; 2) The quality assessment module enables the model to directly estimate the qualities of segmentation predictions, which allows an active learning paradigm where users preferentially label the lowest-quality slice for multi-round refinement. The proposed network leads to a robust interactive segmentation engine, which can generalize well to various types of user annotations (e.g., scribbles, boxes). Experimental results on various medical datasets demonstrate the superiority of our approach in comparison with existing techniques.


title: Factoring strongly irreducible group shift actions onto full shifts of lower entropy

abstract: We show that if $G$ is a a countable amenable group with the comparison property, and $X$ is a strongly irreducible $G$-shift satisfying certain aperiodicity conditions, then $X$ factors onto the full $G$-shift over $N$ symbols, so long as the logarithm of $N$ is less than the topological entropy of $G$.


title: Geometric measure of entanglement of multi-qubit graph states and its detection on a quantum computer

abstract: Multi-qubit graph states generated by the action of controlled phase shift operators on a separable quantum state of a system, in which all the qubits are in arbitrary identical states, are examined. The geometric measure of entanglement of a qubit with other qubits is found for the graph states represented by arbitrary graphs. The entanglement depends on the degree of the vertex representing the qubit, the absolute values of the parameter of the phase shift gate, and the parameter of state the gate is acting on. Also, the geometric measure of entanglement of the graph states is quantified on the quantum computer $\textrm{ibmq\_athens}$. The results obtained on the quantum device are in good agreement with analytical ones.


title: NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction

abstract: We present a novel neural surface reconstruction method, called NeuS, for reconstructing objects and scenes with high fidelity from 2D image inputs. Existing neural surface reconstruction approaches, such as DVR and IDR, require foreground mask as supervision, easily get trapped in local minima, and therefore struggle with the reconstruction of objects with severe self-occlusion or thin structures. Meanwhile, recent neural methods for novel view synthesis, such as NeRF and its variants, use volume rendering to produce a neural scene representation with robustness of optimization, even for highly complex objects. However, extracting high-quality surfaces from this learned implicit representation is difficult because there are not sufficient surface constraints in the representation. In NeuS, we propose to represent a surface as the zero-level set of a signed distance function (SDF) and develop a new volume rendering method to train a neural SDF representation. We observe that the conventional volume rendering method causes inherent geometric errors (i.e. bias) for surface reconstruction, and therefore propose a new formulation that is free of bias in the first order of approximation, thus leading to more accurate surface reconstruction even without the mask supervision. Experiments on the DTU dataset and the BlendedMVS dataset show that NeuS outperforms the state-of-the-arts in high-quality surface reconstruction, especially for objects and scenes with complex structures and self-occlusion.


title: Genuine tripartite entanglement as a probe of quantum phase transitions in a spin-1 Heisenberg chain with single-ion anisotropy

abstract: We study the quantum phase transitions of spin-1 Heisenberg chains with an easy-axis anisotropy $\Delta$ and a uniaxial single-ion anisotropy $D$ using a multipartite entanglement approach. The genuine tripartite entanglement between the spin blocks, measured by the tripartite qutrit hyperdeterminant, is calculated within the quantum renormalization group method. Using this approach, the phase boundaries between the topological Haldane, large-D and anti-ferromagnetic N\'eel phases are determined in the half $\Delta-D$ plane with $\Delta>0$. When the size of the spin blocks increases, the genuine tripartite entanglement between the blocks exhibits a nonzero plateau in the topological Haldane phase, and experiences abrupt drops at both the phase boundaries between the Haldane--large-D and Haldane--N\'eel phases, which justifies the usage of genuine multipartite entanglement as a probe of topological phases in spin systems.


title: On the Catlin multitype of sums of squares domains

abstract: For a sum of squares domain of finite D'Angelo 1-type at the origin, we show that the polynomial model obtained from the computation of the Catlin multitype at the origin of such a domain is likewise a sum of squares domain. We also prove, under the same finite type assumption, that the multitype is an invariant of the ideal of holomorphic functions defining the domain. Both results are proven using Martin Kolar's algorithm for the computation of the multitype introduced in [13]. Given a sum of squares domain, we rewrite the Kolar algorithm in terms of ideals of holomorphic functions and also introduce an approach that explicitly constructs the homogeneous polynomial transformations used in the algorithm.


title: Parallel Statistical Model Checking for Safety Verification in Smart Grids

abstract: By using small computing devices deployed at user premises, Autonomous Demand Response (ADR) adapts users electricity consumption to given time-dependent electricity tariffs. This allows end-users to save on their electricity bill and Distribution System Operators to optimise (through suitable time-dependent tariffs) management of the electric grid by avoiding demand peaks. Unfortunately, even with ADR, users power consumption may deviate from the expected (minimum cost) one, e.g., because ADR devices fail to correctly forecast energy needs at user premises. As a result, the aggregated power demand may present undesirable peaks. In this paper we address such a problem by presenting methods and a software tool (APD-Analyser) implementing them, enabling Distribution System Operators to effectively verify that a given time-dependent electricity tariff achieves the desired goals even when end-users deviate from their expected behaviour. We show feasibility of the proposed approach through a realistic scenario from a medium voltage Danish distribution network.


title: Fast PDN Impedance Prediction Using Deep Learning

abstract: Modeling and simulating a power distribution network (PDN) for printed circuit boards (PCBs) with irregular board shapes and multi-layer stackup is computationally inefficient using full-wave simulations. This paper presents a new concept of using deep learning for PDN impedance prediction. A boundary element method (BEM) is applied to efficiently calculate the impedance for arbitrary board shape and stackup. Then over one million boards with different shapes, stackup, IC location, and decap placement are randomly generated to train a deep neural network (DNN). The trained DNN can predict the impedance accurately for new board configurations that have not been used for training. The consumed time using the trained DNN is only 0.1 seconds, which is over 100 times faster than the BEM method and 5000 times faster than full-wave simulations.


title: Life-cycle assessment for flutter probability of a long-span suspension bridge based on field monitoring data

abstract: Assessment of structural safety status is of paramount importance for existing bridges, where accurate evaluation of flutter probability is essential for long-span bridges. In current engineering practice, at the design stage, flutter critical wind speed is usually estimated by the wind tunnel test, which is sensitive to modal frequencies and damping ratios. After construction, structural properties of existing structures will change with time due to various factors, such as structural deteriorations and periodic environments. The structural dynamic properties, such as modal frequencies and damping ratios, cannot be considered as the same values as the initial ones, and the deteriorations should be included when estimating the life-cycle flutter probability. This paper proposes an evaluation framework to assess the life-cycle flutter probability of long-span bridges considering the deteriorations of structural properties, based on field monitoring data. The Bayesian approach is employed for modal identification of a suspension bridge with the main span of 1650 m, and the field monitoring data during 2010-2015 is analyzed to determine the deterioration functions of modal frequencies and damping ratios, as well as their inter-seasonal fluctuations. According to the historical trend, the long-term structural properties can be predicted, and the probability distributions of flutter critical wind speed for each year in the long term are calculated. Consequently, the life-cycle flutter probability is estimated, based on the predicted modal frequencies and damping ratios.


title: Bloch oscillations in the spin-1/2 XXZ chain

abstract: Under a perfect periodic potential, the electric current density induced by a constant electric field may exhibit nontrivial oscillations, so-called Bloch oscillations, with an amplitude that remains nonzero in the large system size limit. Such oscillations have been well studied for nearly noninteracting particles and observed in experiments. In this work, we revisit Bloch oscillations in strongly interacting systems. By analyzing the spin-1/2 XXZ chain, which can be mapped to a model of spinless electrons, we demonstrate that the current density at special values of the anisotropy parameter $\Delta=-\cos(\pi/p)$ ($p=3,4,5,\cdots$) in the ferromagnetic gapless regime behaves qualitatively the same as in the noninteracting case ($\Delta=0$) even in the weak electric field limit. When $\Delta$ deviates from these values, the amplitude of the oscillation under a weak electric field is suppressed by a factor of the system size. We estimate the strength of the electric field required to observe such a behavior using the Landau--Zener formula.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.other cond-mat.stat-mech quant-ph


title: Generative Model Adversarial Training for Deep Compressed Sensing

abstract: Deep compressed sensing assumes the data has sparse representation in a latent space, i.e., it is intrinsically of low-dimension. The original data is assumed to be mapped from a low-dimensional space through a low-to-high-dimensional generator. In this work, we propound how to design such a low-to-high dimensional deep learning-based generator suiting for compressed sensing, while satisfying robustness to universal adversarial perturbations in the latent domain. We also justify why the noise is considered in the latent space. The work is also buttressed with theoretical analysis on the robustness of the trained generator to adversarial perturbations. Experiments on real-world datasets are provided to substantiate the efficacy of the proposed \emph{generative model adversarial training for deep compressed sensing.}


title: Distributed strategy-updating rules for aggregative games of multi-integrator systems with coupled constraints

abstract: In this paper, we explore aggregative games over networks of multi-integrator agents with coupled constraints. To reach the general Nash equilibrium of an aggregative game, a distributed strategy-updating rule is proposed by a combination of the coordination of Lagrange multipliers and the estimation of the aggregator. Each player has only access to partial-decision information and communicates with his neighbors in a weight-balanced digraph which characterizes players' preferences as to the values of information received from neighbors. We first consider networks of double-integrator agents and then focus on multi-integrator agents. The effectiveness of the proposed strategy-updating rules is demonstrated by analyzing the convergence of corresponding dynamical systems via the Lyapunov stability theory, singular perturbation theory and passive theory. Numerical examples are given to illustrate our results.


title: Plant Disease Detection Using Image Processing and Machine Learning

abstract: One of the important and tedious task in agricultural practices is the detection of the disease on crops. It requires huge time as well as skilled labor. This paper proposes a smart and efficient technique for detection of crop disease which uses computer vision and machine learning techniques. The proposed system is able to detect 20 different diseases of 5 common plants with 93% accuracy.


title: A family of distal functions and multipliers for strict ergodicity

abstract: We give two proofs to an old result of E. Salehi, showing that the Weyl subalgebra $\mathcal{W}$ of $\ell^\infty(\mathbb{Z})$ is a proper subalgebra of $\mathcal{D}$, the algebra of distal functions. We also show that the family $\mathcal{S}^d$ of strictly ergodic functions in $\mathcal{D}$ does not form an algebra and hence in particular does not coincide with $\mathcal{W}$. We then use similar constructions to show that a function which is a multiplier for strict ergodicity, either within $\mathcal{D}$ or in general, is necessarily a constant. An example of a metric, strictly ergodic, distal flow is constructed which admits a non-strictly ergodic $2$-fold minimal self-joining. It then follows that the enveloping group of this flow is not strictly ergodic (as a $T$-flow). Finally we show that the distal, strictly ergodic Heisenberg nil-flow is relatively disjoint over its largest equicontinuous factor from $|\mathcal{W}|$.


title: On predicting research grants productivity

abstract: Understanding the reasons associated with successful proposals is of paramount importance to improve evaluation processes. In this context, we analyzed whether bibliometric features are able to predict the success of research grants. We extracted features aiming at characterizing the academic history of Brazilian researchers, including research topics, affiliations, number of publications and visibility. The extracted features were then used to predict grants productivity via machine learning in three major research areas, namely Medicine, Dentistry and Veterinary Medicine. We found that research subject and publication history play a role in predicting productivity. In addition, institution-based features turned out to be relevant when combined with other features. While the best results outperformed text-based attributes, the evaluated features were not highly discriminative. Our findings indicate that predicting grants success, at least with the considered set of bibliometric features, is not a trivial task.


title: Fusion of Complex Networks-based Global and Local Features for Texture Classification

abstract: To realize accurate texture classification, this article proposes a complex networks (CN)-based multi-feature fusion method to recognize texture images. Specifically, we propose two feature extractors to detect the global and local features of texture images respectively. To capture the global features, we first map a texture image as an undirected graph based on pixel location and intensity, and three feature measurements are designed to further decipher the image features, which retains the image information as much as possible. Then, given the original band images (BI) and the generated feature images, we encode them based on the local binary patterns (LBP). Therefore, the global feature vector is obtained by concatenating four spatial histograms. To decipher the local features, we jointly transfer and fine-tune the pre-trained VGGNet-16 model. Next, we fuse and connect the middle outputs of max-pooling layers (MP), and generate the local feature vector by a global average pooling layer (GAP). Finally, the global and local feature vectors are concatenated to form the final feature representation of texture images. Experiment results show that the proposed method outperforms the state-of-the-art statistical descriptors and the deep convolutional neural networks (CNN) models.


title: On the equality of de Rham depth and formal grade in characteristic zero

abstract: Let $Y \subset \mathbb{P}^n_k$ be a non-singular proper closed subset of projective $n$-space over a field $k$ of characteristic zero and let $I \subset R=k[x_0, \ldots, x_n]$ be the homogeneous defining ideal of $Y$. We show that in this case, the de Rham depth of $Y$ is the same as the so-called formal grade of $I$ in $R$.


title: Lattice construction of exotic invertible topological phases

abstract: In this paper, we provide state sum path integral definitions of exotic invertible topological phases proposed in the recent paper by Hsin, Ji, and Jian. The exotic phase has time reversal ($T$) symmetry, and depends on a choice of the spacetime structure called the Wu structure. The exotic phase cannot be captured by the classification of any bosonic or fermionic topological phases, and thus gives a novel class of invertible topological phases. When the $T$ symmetry defect admits a spin structure, our construction reduces to a sort of the decorated domain wall construction, in terms of a bosonic theory with $T$ symmetry defects decorated with a fermionic phase that depends on a spin structure of the $T$ symmetry defect. By utilizing our path integral, we propose a lattice construction for the exotic phase that generates the $\mathbb{Z}_8$ classification of the (3+1)d invertible phase based on the Wu structure. This generalizes the $\mathbb{Z}_8$ classification of the $T$-symmetric (1+1)d topological superconductor proposed by Fidkowski and Kitaev. On oriented spacetime, this (3+1)d invertible phase with a specific choice of Wu structure reduces to a bosonic Crane-Yetter TQFT which has a topological ordered state with a semion on its boundary. Moreover, we propose a subclass of $G$-SPT phases based on the Wu structure labeled by a pair of cohomological data in generic spacetime dimensions. This generalizes the Gu-Wen subclass of fermionic SPT phases.


title: Better Training using Weight-Constrained Stochastic Dynamics

abstract: We employ constraints to control the parameter space of deep neural networks throughout training. The use of customized, appropriately designed constraints can reduce the vanishing/exploding gradients problem, improve smoothness of classification boundaries, control weight magnitudes and stabilize deep neural networks, and thus enhance the robustness of training algorithms and the generalization capabilities of neural networks. We provide a general approach to efficiently incorporate constraints into a stochastic gradient Langevin framework, allowing enhanced exploration of the loss landscape. We also present specific examples of constrained training methods motivated by orthogonality preservation for weight matrices and explicit weight normalizations. Discretization schemes are provided both for the overdamped formulation of Langevin dynamics and the underdamped form, in which momenta further improve sampling efficiency. These optimization schemes can be used directly, without needing to adapt neural network architecture design choices or to modify the objective with regularization terms, and see performance improvements in classification tasks.


title: Automated Deepfake Detection

abstract: In this paper, we propose to utilize Automated Machine Learning to adaptively search a neural architecture for deepfake detection. This is the first time to employ automated machine learning for deepfake detection. Based on our explored search space, our proposed method achieves competitive prediction accuracy compared to previous methods. To improve the generalizability of our method, especially when training data and testing data are manipulated by different methods, we propose a simple yet effective strategy in our network learning process: making it to estimate potential manipulation regions besides predicting the real/fake labels. Unlike previous works manually design neural networks, our method can relieve us from the high labor cost in network construction. More than that, compared to previous works, our method depends much less on prior knowledge, e.g., which manipulation method is utilized or where exactly the fake image is manipulated. Extensive experimental results on two benchmark datasets demonstrate the effectiveness of our proposed method for deepfake detection.


title: Feedback Nash Equilibria in Differential Games with Impulse Control

abstract: We study a class of deterministic finite-horizon two-player nonzero-sum differential games where players are endowed with different kinds of controls. We assume that Player 1 uses piecewise-continuous controls, while Player 2 uses impulse controls. For this class of games, we seek to derive conditions for the existence of feedback Nash equilibrium strategies for the players. More specifically, we provide a verification theorem for identifying such equilibrium strategies, using the Hamilton-Jacobi-Bellman (HJB) equations for Player 1 and the quasi-variational inequalities (QVIs) for Player 2. Further, we show that the equilibrium number of interventions by Player 2 is upper bounded. Furthermore, we specialize the obtained results to a scalar two-player linear-quadratic differential game. In this game, Player 1's objective is to drive the state variable towards a specific target value, and Player 2 has a similar objective with a different target value. We provide, for the first time, an analytical characterization of the feedback Nash equilibrium in a linear-quadratic differential game with impulse control. We illustrate our results using numerical experiments.


title: Minimizing Delay in Network Function Visualization with Quantum Computing

abstract: Network function virtualization (NFV) is a crucial technology for the 5G network development because it can improve the flexibility of employing hardware and reduce the construction of base stations. There are vast service chains in NFV to meet users' requests, which are composed of a sequence of network functions. These virtual network functions (VNFs) are implemented in virtual machines by software and virtual environment. How to deploy VMs to process VNFs of the service chains as soon as possible when users' requests are received is very challenging to solve by traditional algorithms on a large scale. Compared with traditional algorithms, quantum computing has better computational performance because of quantum parallelism. We build an integer linear programming model of the VNF scheduling problem with the objective of minimizing delays and transfer it into the quadratic unconstrained binary optimization (QUBO) model. Our proposed heuristic algorithm employs a quantum annealer to solve the model. Finally, we evaluate the computational results and explore the feasibility of leveraging quantum computing to solve the VNFs scheduling problem.


title: Memory Augmented Optimizers for Deep Learning

abstract: Popular approaches for minimizing loss in data-driven learning often involve an abstraction or an explicit retention of the history of gradients for efficient parameter updates. The aggregated history of gradients nudges the parameter updates in the right direction even when the gradients at any given step are not informative. Although the history of gradients summarized in meta-parameters or explicitly stored in memory has been shown effective in theory and practice, the question of whether $all$ or only a subset of the gradients in the history are sufficient in deciding the parameter updates remains unanswered. In this paper, we propose a framework of memory-augmented gradient descent optimizers that retain a limited view of their gradient history in their internal memory. Such optimizers scale well to large real-life datasets, and our experiments show that the memory augmented extensions of standard optimizers enjoy accelerated convergence and improved performance on a majority of computer vision and language tasks that we considered. Additionally, we prove that the proposed class of optimizers with fixed-size memory converge under assumptions of strong convexity, regardless of which gradients are selected or how they are linearly combined to form the update step.


title: Spatial Covariance Matrix Reconstruction for DOA Estimation in Hybrid Massive MIMO Systems with Multiple Radio Frequency Chains

abstract: Multiple signal classification (MUSIC) has been widely applied in multiple-input multiple-output (MIMO) receivers for direction-of-arrival (DOA) estimation. To reduce the cost of radio frequency (RF) chains operating at millimeter-wave bands, hybrid analog-digital structure has been adopted in massive MIMO transceivers. In this situation, the received signals at the antennas are unavailable to the digital receiver, and as a consequence, the spatial covariance matrix (SCM), which is essential in MUSIC algorithm, cannot be obtained using traditional sample average approach. Based on our previous work, we propose a novel algorithm for SCM reconstruction in hybrid massive MIMO systems with multiple RF chains. By switching the analog beamformers to a group of predetermined DOAs, SCM can be reconstructed through the solutions of a set of linear equations. In addition, based on insightful analysis on that linear equations, a low-complexity algorithm, as well as a careful selection of the predetermined DOAs, will be also presented in this paper. Simulation results show that the proposed algorithms can reconstruct the SCM accurately so that MUSIC algorithm can be well used for DOA estimation in hybrid massive MIMO systems with multiple RF chains.


title: A New Signal Representation Using Complex Conjugate Pair Sums

abstract: This letter introduces a real valued summation known as Complex Conjugate Pair Sum (CCPS). The space spanned by CCPS and its one circular downshift is called {\em Complex Conjugate Subspace (CCS)}. For a given positive integer $N\geq3$, there exists $\frac{\varphi(N)}{2}$ CCPSs forming $\frac{\varphi(N)}{2}$ CCSs, where $\varphi(N)$ is the Euler's totient function. We prove that these CCSs are mutually orthogonal and their direct sum form a $\varphi(N)$ dimensional subspace $s_N$ of $\mathbb{C}^N$. We propose that any signal of finite length $N$ is represented as a linear combination of elements from a special basis of $s_d$, for each divisor $d$ of $N$. This defines a new transform named as Complex Conjugate Periodic Transform (CCPT). Later, we compared CCPT with DFT (Discrete Fourier Transform) and RPT (Ramanujan Periodic Transform). It is shown that, using CCPT we can estimate the period, hidden periods and frequency information of a signal. Whereas, RPT does not provide the frequency information. For a complex valued input signal, CCPT offers computational benefit over DFT. A CCPT dictionary based method is proposed to extract non-divisor period information.


title: Transfer Bayesian Meta-learning via Weighted Free Energy Minimization

abstract: Meta-learning optimizes the hyperparameters of a training procedure, such as its initialization, kernel, or learning rate, based on data sampled from a number of auxiliary tasks. A key underlying assumption is that the auxiliary tasks, known as meta-training tasks, share the same generating distribution as the tasks to be encountered at deployment time, known as meta-test tasks. This may, however, not be the case when the test environment differ from the meta-training conditions. To address shifts in task generating distribution between meta-training and meta-testing phases, this paper introduces weighted free energy minimization (WFEM) for transfer meta-learning. We instantiate the proposed approach for non-parametric Bayesian regression and classification via Gaussian Processes (GPs). The method is validated on a toy sinusoidal regression problem, as well as on classification using miniImagenet and CUB data sets, through comparison with standard meta-learning of GP priors as implemented by PACOH.


title: Solving for best linear approximates

abstract: Our goal is to finally settle the persistent problem in Diophantine Approximation of finding best linear approximates. Classical results from the theory of continued fractions provide the solution for the special homogeneous case in the form of a sequence of normal approximates. We develop numeration systems and real expansions allowing this notion of normality to percolate into the general inhomogeneous setting.


title: Adjustable propagating plasmons in $\alpha-\mathcal{T}_3$ lattice-based armchair nanoribbons

abstract: We have obtained and analyzed the electronic states, polarization function and the plasmon excitations for $\alpha - \mathcal{T}_3$-based nanoribbons with armchair termination. The calculated plasmon dispersions strongly depend on the number of the atomic rows across the ribbon, and the presence of the energy gap between the valence and conduction bands which is also determined by the nanoribbon geometry. The bandgap was proven to have the strongest effect on both the plasmon dispersions and their Landau damping. We have also demonstrated that for a small electron doping the plasmon dispersions do not depend on the relative hopping parameter $\alpha$ of the considered $\alpha - \mathcal{T}_3$ material in the long-wave limit and investigated the conditions when $\alpha$ becomes an important factor which strongly affects the plasmons. We believe that our new uncovered electronic and collective properties of nano-size $\alpha - \mathcal{T}_3$ribbons will find their applications in the field of modern electronics and nanodevices.


title: Quantum Machine Learning: Fad or Future?

abstract: For the last few decades, classical machine learning has allowed us to improve the lives of many through automation, natural language processing, predictive analytics and much more. However, a major concern is the fact that we're fast approach the threshold of the maximum possible computational capacity available to us by the means of classical computing devices including CPUs, GPUs and Application Specific Integrated Circuits (ASICs). This is due to the exponential increase in model sizes which now have parameters in the magnitude of billions and trillions, requiring a significant amount of computing resources across a significant amount of time, just to converge one single model. To observe the efficacy of using quantum computing for certain machine learning tasks and explore the improved potential of convergence, error reduction and robustness to noisy data, this paper will look forth to test and verify the aspects in which quantum machine learning can help improve over classical machine learning approaches while also shedding light on the likely limitations that have prevented quantum approaches to become the mainstream. A major focus will be to recreate the work by Farhi et al and conduct experiments using their theory of performing machine learning in a quantum context, with assistance from the Tensorflow Quantum documentation.


title: CPM-2: Large-scale Cost-effective Pre-trained Language Models

abstract: In recent years, the size of pre-trained language models (PLMs) has grown by leaps and bounds. However, efficiency issues of these large-scale PLMs limit their utilization in real-world scenarios. We present a suite of cost-effective techniques for the use of PLMs to deal with the efficiency issues of pre-training, fine-tuning, and inference. (1) We introduce knowledge inheritance to accelerate the pre-training process by exploiting existing PLMs instead of training models from scratch. (2) We explore the best practice of prompt tuning with large-scale PLMs. Compared with conventional fine-tuning, prompt tuning significantly reduces the number of task-specific parameters. (3) We implement a new inference toolkit, namely InfMoE, for using large-scale PLMs with limited computational resources. Based on our cost-effective pipeline, we pre-train two models: an encoder-decoder bilingual model with 11 billion parameters (CPM-2) and its corresponding MoE version with 198 billion parameters. In our experiments, we compare CPM-2 with mT5 on downstream tasks. Experimental results show that CPM-2 has excellent general language intelligence. Moreover, we validate the efficiency of InfMoE when conducting inference of large-scale models having tens of billions of parameters on a single GPU. All source code and model parameters are available at https://github.com/TsinghuaAI/CPM.


title: Machine learning in the social and health sciences

abstract: The uptake of machine learning (ML) approaches in the social and health sciences has been rather slow, and research using ML for social and health research questions remains fragmented. This may be due to the separate development of research in the computational/data versus social and health sciences as well as a lack of accessible overviews and adequate training in ML techniques for non data science researchers. This paper provides a meta-mapping of research questions in the social and health sciences to appropriate ML approaches, by incorporating the necessary requirements to statistical analysis in these disciplines. We map the established classification into description, prediction, and causal inference to common research goals, such as estimating prevalence of adverse health or social outcomes, predicting the risk of an event, and identifying risk factors or causes of adverse outcomes. This meta-mapping aims at overcoming disciplinary barriers and starting a fluid dialogue between researchers from the social and health sciences and methodologically trained researchers. Such mapping may also help to fully exploit the benefits of ML while considering domain-specific aspects relevant to the social and health sciences, and hopefully contribute to the acceleration of the uptake of ML applications to advance both basic and applied social and health sciences research.