title: Extending Memory Capacity in Consumer Devices with Emerging Non-Volatile Memory: An Experimental Study

abstract: The number and diversity of consumer devices are growing rapidly, alongside their target applications' memory consumption. Unfortunately, DRAM scalability is becoming a limiting factor to the available memory capacity in consumer devices. As a potential solution, manufacturers have introduced emerging non-volatile memories (NVMs) into the market, which can be used to increase the memory capacity of consumer devices by augmenting or replacing DRAM. Since entirely replacing DRAM with NVM in consumer devices imposes large system integration and design challenges, recent works propose extending the total main memory space available to applications by using NVM as swap space for DRAM. However, no prior work analyzes the implications of enabling a real NVM-based swap space in real consumer devices. In this work, we provide the first analysis of the impact of extending the main memory space of consumer devices using off-the-shelf NVMs. We extensively examine system performance and energy consumption when the NVM device is used as swap space for DRAM main memory to effectively extend the main memory capacity. For our analyses, we equip real web-based Chromebook computers with the Intel Optane SSD, which is a state-of-the-art low-latency NVM-based SSD device. We compare the performance and energy consumption of interactive workloads running on our Chromebook with NVM-based swap space, where the Intel Optane SSD capacity is used as swap space to extend main memory capacity, against two state-of-the-art systems: (i) a baseline system with double the amount of DRAM than the system with the NVM-based swap space; and (ii) a system where the Intel Optane SSD is naively replaced with a state-of-the-art (yet slower) off-the-shelf NAND-flash-based SSD, which we use as a swap space of equivalent size as the NVM-based swap space.


title: End-to-End Annotator Bias Approximation on Crowdsourced Single-Label Sentiment Analysis

abstract: Sentiment analysis is often a crowdsourcing task prone to subjective labels given by many annotators. It is not yet fully understood how the annotation bias of each annotator can be modeled correctly with state-of-the-art methods. However, resolving annotator bias precisely and reliably is the key to understand annotators' labeling behavior and to successfully resolve corresponding individual misconceptions and wrongdoings regarding the annotation task. Our contribution is an explanation and improvement for precise neural end-to-end bias modeling and ground truth estimation, which reduces an undesired mismatch in that regard of the existing state-of-the-art. Classification experiments show that it has potential to improve accuracy in cases where each sample is annotated only by one single annotator. We provide the whole source code publicly and release an own domain-specific sentiment dataset containing 10,000 sentences discussing organic food products. These are crawled from social media and are singly labeled by 10 non-expert annotators.


title: ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle

abstract: Over the past decades, the addition of hundreds of sensors to modern vehicles has led to an exponential increase in their capabilities. This allows for novel approaches to interaction with the vehicle that go beyond traditional touch-based and voice command approaches, such as emotion recognition, head rotation, eye gaze, and pointing gestures. Although gaze and pointing gestures have been used before for referencing objects inside and outside vehicles, the multimodal interaction and fusion of these gestures have so far not been extensively studied. We propose a novel learning-based multimodal fusion approach for referencing outside-the-vehicle objects while maintaining a long driving route in a simulated environment. The proposed multimodal approaches outperform single-modality approaches in multiple aspects and conditions. Moreover, we also demonstrate possible ways to exploit behavioral differences between users when completing the referencing task to realize an adaptable personalized system for each driver. We propose a personalization technique based on the transfer-of-learning concept for exceedingly small data sizes to enhance prediction and adapt to individualistic referencing behavior. Our code is publicly available at https://github.com/amr-gomaa/ML-PersRef.


title: A Linear Model for Distributed Flexibility Markets and DLMPs: A Comparison with the SOCP Formulation

abstract: This paper examines the performance trade-offs between an introduced linear flexibility market model for congestion management and a benchmark second-order cone programming (SOCP) formulation. The linear market model incorporates voltage magnitudes and reactive powers, while providing a simpler formulation than the SOCP model, which enables its practical implementation. The paper provides a structured comparison of the two formulations relying on developed deterministic and statistical Monte Carlo case analyses using two distribution test systems (the Matpower 69-bus and 141-bus systems). The case analyses show that with the increasing spread of offered flexibility throughout the system, the linear formulation increasingly preserves the reliability of the computed system variables as compared to the SOCP formulation, while more lenient imposed voltage limits can improve the approximation of prices and power flows at the expense of a less accurate computation of voltage magnitudes.


title: Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods

abstract: We introduce implicit Deep Adaptive Design (iDAD), a new method for performing adaptive experiments in real-time with implicit models. iDAD amortizes the cost of Bayesian optimal experimental design (BOED) by learning a design policy network upfront, which can then be deployed quickly at the time of the experiment. The iDAD network can be trained on any model which simulates differentiable samples, unlike previous design policy work that requires a closed form likelihood and conditionally independent experiments. At deployment, iDAD allows design decisions to be made in milliseconds, in contrast to traditional BOED approaches that require heavy computation during the experiment itself. We illustrate the applicability of iDAD on a number of experiments, and show that it provides a fast and effective mechanism for performing adaptive design with implicit models.


title: Geodesic statistics for random network families

abstract: A key task in the study of networked systems is to derive local and global properties that impact connectivity, synchronizability, and robustness. Computing shortest paths or geodesics in the network yields measures of node centrality and network connectivity that can contribute to explain such phenomena. We derive an analytic distribution of shortest path lengths, on the giant component in the supercritical regime or on small components in the subcritical regime, of any sparse (possibly directed) graph with conditionally independent edges, in the infinite-size limit. We provide specific results for widely used network families like stochastic block models, dot-product graphs, random geometric graphs, and graphons. The survival function of the shortest path length distribution possesses a simple closed-form lower bound which is asymptotically tight for finite lengths, has a natural interpretation of traversing independent geodesics in the network, and delivers novel insight in the above network families. Notably, the shortest path length distribution allows us to derive, for the network families above, important graph properties like the bond percolation threshold, size of the giant component, average shortest path length, and closeness and betweenness centralities. We also provide a corroborative analysis of a set of 20 empirical networks. This unifying framework demonstrates how geodesic statistics for a rich family of random graphs can be computed cheaply without having access to true or simulated networks, especially when they are sparse but prohibitively large.


title: LTD: Low Temperature Distillation for Robust Adversarial Training

abstract: Adversarial training has been widely used to enhance the robustness of neural network models against adversarial attacks. Despite the popularity of neural network models, a significant gap exists between the natural and robust accuracy of these models. In this paper, we identify one of the primary reasons for this gap is the common use of one-hot vectors as labels, which hinders the learning process for image recognition. Representing ambiguous images with one-hot vectors is imprecise and may lead the model to suboptimal solutions. To overcome this issue, we propose a novel method called Low Temperature Distillation (LTD) that generates soft labels using the modified knowledge distillation framework. Unlike previous approaches, LTD uses a relatively low temperature in the teacher model and fixed, but different temperatures for the teacher and student models. This modification boosts the model's robustness without encountering the gradient masking problem that has been addressed in defensive distillation. The experimental results demonstrate the effectiveness of the proposed LTD method combined with previous techniques, achieving robust accuracy rates of 58.19%, 31.13%, and 42.08% on CIFAR-10, CIFAR-100, and ImageNet data sets, respectively, without additional unlabeled data.


title: Chromatic Dynamics of an Electron Beam in a Plasma Based Accelerator

abstract: We present a theoretical investigation of the chromatic dynamics of the witness beam within a plasma based accelerator. We derive the single particle motion of an electron in an ion column within a nonlinear, blowout wake including adiabatic dampening and adiabatic variations in plasma density. Using this, we calculate the evolution of the beam moments and emittance for an electron beam. Our model can handle near arbitrary longitudinal phase space distributions. We include the effects of energy change in the beam, imperfect wake loading, initial transverse offsets of the beam, and mismatch between the beam and plasma. We use our model to derive analytic saturation lengths for the projected, longitudinal slice, and energy slice emittance under different beam loading conditions. Further, we show that the centroid oscillations and spot sizes vary between the slices and the variation depends strongly on the beam loading. Next, we show how a beam evolves in a full plasma source with density ramps and show that the integral of the plasma density along the ramp determines the impact on the beam. Finally, we derive several simple scaling laws that show how to design a plasma based injector to produce a target beam energy and energy spread.


title: HS3: Learning with Proper Task Complexity in Hierarchically Supervised Semantic Segmentation

abstract: While deeply supervised networks are common in recent literature, they typically impose the same learning objective on all transitional layers despite their varying representation powers. In this paper, we propose Hierarchically Supervised Semantic Segmentation (HS3), a training scheme that supervises intermediate layers in a segmentation network to learn meaningful representations by varying task complexity. To enforce a consistent performance vs. complexity trade-off throughout the network, we derive various sets of class clusters to supervise each transitional layer of the network. Furthermore, we devise a fusion framework, HS3-Fuse, to aggregate the hierarchical features generated by these layers, which can provide rich semantic contexts and further enhance the final segmentation. Extensive experiments show that our proposed HS3 scheme considerably outperforms vanilla deep supervision with no added inference cost. Our proposed HS3-Fuse framework further improves segmentation predictions and achieves state-of-the-art results on two large segmentation benchmarks: NYUD-v2 and Cityscapes.


title: Quantifying the Value of Iterative Experimentation

abstract: Over the past decade, most technology companies and a growing number of conventional firms have adopted online experimentation (or A/B testing) into their product development process. Initially, A/B testing was deployed as a static procedure in which an experiment was conducted by randomly splitting half of the users to see the control-the standard offering-and the other half the treatment-the new version. The results were then used to augment decision-making around which version to release widely. More recently, as experimentation has matured, firms have developed a more dynamic approach to experimentation in which a new version (the treatment) is gradually released to a growing number of units through a sequence of randomized experiments, known as iterations. In this paper, we develop a theoretical framework to quantify the value brought on by such dynamic or iterative experimentation. We apply our framework to seven months of LinkedIn experiments and show that iterative experimentation led to an additional 20% improvement in one of the firm's primary metrics.


title: Searching for clusters of targets under stochastic resetting

abstract: We consider diffusion under stochastic resetting to the origin in one dimension and compute the mean time to find both of two targets placed either side of the origin. A surprising result is that increasing the distance between two targets can decrease the overall search time. We compute the optimal arrangement of two targets in limiting cases. We generalise to obtain recursive expressions for the mean time to find all of multiple targets. We discuss the relevance to real-world problems of locating multiple targets such as proteins locating clusters of DNA lesions.


title: An Improved Algorithm for The $k$-Dyck Edit Distance Problem

abstract: A Dyck sequence is a sequence of opening and closing parentheses (of various types) that is balanced. The Dyck edit distance of a given sequence of parentheses $S$ is the smallest number of edit operations (insertions, deletions, and substitutions) needed to transform $S$ into a Dyck sequence. We consider the threshold Dyck edit distance problem, where the input is a sequence of parentheses $S$ and a positive integer $k$, and the goal is to compute the Dyck edit distance of $S$ only if the distance is at most $k$, and otherwise report that the distance is larger than $k$. Backurs and Onak [PODS'16] showed that the threshold Dyck edit distance problem can be solved in $O(n+k^{16})$ time. In this work, we design new algorithms for the threshold Dyck edit distance problem which costs $O(n+k^{4.544184})$ time with high probability or $O(n+k^{4.853059})$ deterministically. Our algorithms combine several new structural properties of the Dyck edit distance problem, a refined algorithm for fast $(\min,+)$ matrix product, and a careful modification of ideas used in Valiant's parsing algorithm.


title: Quasi-isometric embedding of Kerr poloidal sub-manifolds

abstract: We propose two approaches to obtain an isometric embedding of the poloidal Kerr sub-manifold. The first one relies on the convex integration process using the corrugation from a primitive embedding. This allows us to obtain one parameter family of embeddings reaching the limits of an isometric embedding. The second one consists in consecutive numerical resolutions of the Gauss-Codazzi-Mainardi and frame equations. This method requires geometric assumptions near the equatorial axis of the poloidal sub-manifold to get initial and boundary conditions. The second approach allows to understand some physical properties in the vicinity of a Kerr black hole, in particular the fast increasing ergoregion extent with angular momentum.


title: Drop, Swap, and Generate: A Self-Supervised Approach for Generating Neural Activity

abstract: Meaningful and simplified representations of neural activity can yield insights into how and what information is being processed within a neural circuit. However, without labels, finding representations that reveal the link between the brain and behavior can be challenging. Here, we introduce a novel unsupervised approach for learning disentangled representations of neural activity called Swap-VAE. Our approach combines a generative modeling framework with an instance-specific alignment loss that tries to maximize the representational similarity between transformed views of the input (brain state). These transformed (or augmented) views are created by dropping out neurons and jittering samples in time, which intuitively should lead the network to a representation that maintains both temporal consistency and invariance to the specific neurons used to represent the neural state. Through evaluations on both synthetic data and neural recordings from hundreds of neurons in different primate brains, we show that it is possible to build representations that disentangle neural datasets along relevant latent dimensions linked to behavior.


title: Prescription for finite oblique parameters $S$ and $U$ in extensions of the SM with $m_W \neq m_Z \cos{\theta_W}$

abstract: We consider extensions of the Standard Model with neutral scalars in multiplets of $SU(2)$ larger than doublets. When those scalars acquire vacuum expectation values, the resulting masses of the gauge bosons $W^\pm$ and $Z^0$ are not related by $m_W = m_Z \cos{\theta_W}$. In those extensions of the Standard Model the oblique parameters $S$ and $U$, when computed at the one-loop level, turn out to be either gauge-dependent or divergent. We show that one may eliminate this problem by modifying the Feynman rules of the Standard Model for some vertices containing the Higgs boson; the modifying factors are equal to $1$ in the limit $m_W = m_Z \cos{\theta_W}$. We give the result for $S$ in a model with arbitrary numbers of scalar $SU(2)$ triplets with weak hypercharges either $0$ or $1$.


title: A Kinetic Flux Difference Splitting Method for Compressible Flows

abstract: A low diffusive flux difference splitting based kinetic scheme is developed based on a discrete velocity Boltzmann equation, with a novel three velocity model. While two discrete velocities are used for upwinding, the third discrete velocity is utilized to introduce appropriate additional numerical diffusion only in the expansion regions, identified using relative entropy (Kullback-Liebler divergence) at the cell-interface, along with the estimation of physical entropy. This strategy provides an interesting alternative to entropy fix, which is typically needed for low diffusive schemes. Grid-aligned steady discontinuities are captured exactly by fixing the primary numerical diffusion such that flux equivalence leads to zero numerical diffusion across discontinuities. Results for bench-mark test problems are presented for inviscid and viscous compressible flows.


title: Lessons Learned on the Interface between Quantum and Conventional Networking

abstract: The future Quantum Internet is expected to be based on a hybrid architecture with core quantum transport capabilities complemented by conventional networking.Practical and foundational considerations indicate the need for conventional control and data planes that (i) utilize extensive existing telecommunications fiber infrastructure, and (ii) provide parallel conventional data channels needed for quantum networking protocols. We propose a quantum-conventional network (QCN) harness to implement a new architecture to meet these requirements. The QCN control plane carries the control and management traffic, whereas its data plane handles the conventional and quantum data communications. We established a local area QCN connecting three quantum laboratories over dedicated fiber and conventional network connections. We describe considerations and tradeoffs for layering QCN functionalities, informed by our recent quantum entanglement distribution experiments conducted over this network.


title: Direct data-driven control of LTV systems

abstract: Considering discrete-time linear time-varying systems with unknown dynamics, controllers guaranteeing bounded closed-loop trajectories, optimal performance and robustness to process and measurement noise are designed via convex feasibility and optimisation problems involving purely data-dependent linear matrix inequalities. For the special case of periodically time-varying systems, infinite-horizon guarantees are achieved based on finite-length data sequences.


title: An age-of-infection model with both symptomatic and asymptomatic infections

abstract: We formulate a general age-of-infection epidemic model with two pathways: the symptomatic infections and the asymptomatic infections. We then calculate the basic reproduction number $\mathcal{R}_0$ and establish the final size relation. It is shown that the ratio of accumulated counts of symptomatic patients and asymptomatic patients is determined by the symptomatic ratio $f$ which is defined as the probability of eventually becoming symptomatic after being infected. We also formulate and study a general age-of-infection model with disease deaths and with two infection pathways. The final size relation is investigated, and the upper and lower bounds for final epidemic size are given. Several numerical simulations are performed to verify the analytical results.


title: Inference of Microbial Interactions Using Copula Models with Mixture Margins

abstract: Quantification of microbial interactions from 16S rRNA and meta-genomic sequencing data is difficult due to their sparse nature, as well as the fact that the data only provides measures of relative abundance. In this paper, we propose using copula models with mixed zero-beta margins for estimation of taxon-taxon interactions using the normalized microbial relative abundances. Copulas allow for separate modeling of the dependence structure from the margins, marginal covariate adjustment, and uncertainty measurement. Our method shows that a two-stage maximum likelihood approach provides accurate estimation of the model parameters. A corresponding two-stage likelihood-ratio test for the dependence parameter is derived. Simulation studies show that the test is valid and more powerful than tests based upon Pearson's and rank correlations. Furthermore, we demonstrate that our method can be used to build biologically meaningful microbial networks based on the data set of the American Gut Project.


title: NISQ: Error Correction, Mitigation, and Noise Simulation

abstract: Error-correcting codes were invented to correct errors on noisy communication channels. Quantum error correction (QEC), however, may have a wider range of uses, including information transmission, quantum simulation/computation, and fault-tolerance. These invite us to rethink QEC, in particular, about the role that quantum physics plays in terms of encoding and decoding. The fact that many quantum algorithms, especially near-term hybrid quantum-classical algorithms, only use limited types of local measurements on quantum states, leads to various new techniques called Quantum Error Mitigation (QEM). This work examines the task of QEM from several perspectives. Using some intuitions built upon classical and quantum communication scenarios, we clarify some fundamental distinctions between QEC and QEM. We then discuss the implications of noise invertibility for QEM, and give an explicit construction called Drazin-inverse for non-invertible noise, which is trace preserving while the commonly-used Moore-Penrose pseudoinverse may not be. Finally, we study the consequences of having an imperfect knowledge about the noise, and derive conditions when noise can be reduced using QEM.


title: Slowly decaying real-time oscillations in instanton crystal

abstract: Instanton crystal is a fascinating phase which is encountered when the minimum of the free energy corresponds to a configuration with an imaginary-time-dependent order parameter in the form of a chain of alternating instantons and anti-instantons. We present the results of the investigation of the real-time correlation functions of the order parameter in the instanton crystal phase. In order to obtain the correlation functions in real-time, we formulate an original method of analytic continuation from imaginary times, which is easily adapted into an efficient numerical scheme for the computations. The resulting correlation functions exhibit non-trivial slowly decaying oscillations in real-time, which is reminiscent of prethermal time crystals.


title: The asymptotic approach to the continuum of lattice QCD spectral observables

abstract: We consider spectral quantities in lattice QCD and determine the asymptotic behavior of their discretization errors. Wilson fermion with O$(a)$-improvement, (M\"obius) Domain wall fermion (DWF), and overlap Dirac operators are considered in combination with the commonly used gauge actions. Wilson fermions and DWF with domain wall height $M_5=1+{\rm O}(g_0^2)$ have the same, approximate, form of the asymptotic cutoff effects: $ K\,a^2\left[\bar g^2(a^{-1})\right]^{0.760}$. A domain wall height $M_5=1.8$, as often used, introduces large mass-dependent $K'(m)\,a^2\left[\bar g^2(a^{-1})\right]^{0.518}$ effects. Massless twisted mass fermions have the same form as Wilson fermions when the Sheikholeslami-Wohlert term [1] is included. For their mass-dependent cutoff effects we have information on the exponents $\hat\Gamma_i$ of $\bar g^2(a^{-1})$ but not for the pre-factors. For staggered fermions there is only partial information on the exponents. We propose that tree-level ${\rm O}(a^2)$ improvement, which is easy to do [2], should be used in the future -- both for the fermion and the gauge action. It improves the asymptotic behavior in all cases.


title: A plastic feedthrough suitable for high-voltage DC femtosecond electron diffractometers

abstract: Highly energetic ultrashort electron bunches have the potential to reveal the ultrafast structural dynamics in relatively thicker in-liquid samples. However, direct current (DC) voltages higher than 100 kV are exponentially difficult to attain as surface and vacuum breakdown become an important problem as the electric field increases. One of the most demanding components in the design of a high-energy electrostatic ultrafast electron source is the high voltage feedthrough (HVFT), which must keep the electron gun from discharging against ground. Electrical discharges can cause irreversible component damage while voltage instabilities render the instrument inoperative. We report the design, manufacturing, and conditioning process for a new HVFT that utilizes ultra-high molecular weight polyethylene (UHMWPE) as the insulating material. Our HVFT is highly customizable, inexpensive, and has proven to be effective in high voltage applications. After a couple of weeks of gas and voltage conditioning, we achieved a maximum voltage of 180 kV with a progressively improved vacuum level of 1.8 x $10^{-8}$ Torr.


title: Chaos synchronization with coexisting global fields

abstract: We investigate the phenomenon of chaos synchronization in systems subject to coexisting autonomous and external global fields by employing a simple model of coupled maps. Two states of chaos synchronization are found: (i) complete synchronization, where the maps synchronize among themselves and to the external field, and (ii) generalized or internal synchronization, where the maps synchronize among themselves but not to the external global field. We show that the stability conditions for both states can be achieved for a system of minimum size of two maps. We consider local maps possessing robust chaos and characterize the synchronization states on the space of parameters of the system. The state of generalized synchronization of chaos arises even the drive and the local maps have the same functional form. This behavior is similar to the process of spontaneous ordering against an external field found in nonequilibrium systems.


title: Helium surface fluctuations investigated with superconducting coplanar waveguide resonator

abstract: Recent experiments on the coupling of the in-plane motional state of electrons floating on the surface of liquid helium to a microwave resonator have revealed the importance of helium surface fluctuations to the coherence of this motion. Here we investigate these surface fluctuations by studying the resonance properties of a superconducting coplanar waveguide (CPW) resonator filled with superfluid helium, where a significant fraction of the resonator's electromagnetic mode volume is coupled to the surface dynamics of the liquid. We present preliminary results on real-time CPW resonator frequency shifts driven by helium fluctuations, which are quantified via their power spectral density and compared with measurements using a commercial accelerometer. We find that a considerable contribution to the CPW resonator noise originates from the mechanical vibrations of the helium surface generated by the pulse tube (PT) cryocooler on the cryostat on which the experiments were performed.


title: Weight, Block or Unit? Exploring Sparsity Tradeoffs for Speech Enhancement on Tiny Neural Accelerators

abstract: We explore network sparsification strategies with the aim of compressing neural speech enhancement (SE) down to an optimal configuration for a new generation of low power microcontroller based neural accelerators (microNPU's). We examine three unique sparsity structures: weight pruning, block pruning and unit pruning; and discuss their benefits and drawbacks when applied to SE. We focus on the interplay between computational throughput, memory footprint and model quality. Our method supports all three structures above and jointly learns integer quantized weights along with sparsity. Additionally, we demonstrate offline magnitude based pruning of integer quantized models as a performance baseline. Although efficient speech enhancement is an active area of research, our work is the first to apply block pruning to SE and the first to address SE model compression in the context of microNPU's. Using weight pruning, we show that we are able to compress an already compact model's memory footprint by a factor of 42x from 3.7MB to 87kB while only losing 0.1 dB SDR in performance. We also show a computational speedup of 6.7x with a corresponding SDR drop of only 0.59 dB SDR using block pruning.


title: An Improved Bound of Acyclic Vertex-Coloring

abstract: The acyclic chromatic number of a graph is the least number of colors needed to properly color its vertices so that none of its cycles has only two colors. We show that for all $\alpha>2^{-1/3}$ there exists an integer $\Delta_{\alpha}$ such that if the maximum degree $\Delta$ of a graph is at least $\Delta_{\alpha}$, then the acyclic chromatic number of the graph is at most $\lceil\alpha {\Delta}^{4/3} \rceil +\Delta+ 1$. The previous best bound, due to Gon\c{c}alves et al (2020), was $(3/2) \Delta^{4/3} + O(\Delta)$.


title: Memory Association Networks

abstract: We introduce memory association networks(MANs) that memorize and remember any data. This neural network has two memories. One consists of a queue-structured short-term memory to solve the class imbalance problem and long-term memory to store the distribution of objects, introducing the contents of storing and generating various datasets.


title: Smooth Imitation Learning via Smooth Costs and Smooth Policies

abstract: Imitation learning (IL) is a popular approach in the continuous control setting as among other reasons it circumvents the problems of reward mis-specification and exploration in reinforcement learning (RL). In IL from demonstrations, an important challenge is to obtain agent policies that are smooth with respect to the inputs. Learning through imitation a policy that is smooth as a function of a large state-action ($s$-$a$) space (typical of high dimensional continuous control environments) can be challenging. We take a first step towards tackling this issue by using smoothness inducing regularizers on \textit{both} the policy and the cost models of adversarial imitation learning. Our regularizers work by ensuring that the cost function changes in a controlled manner as a function of $s$-$a$ space; and the agent policy is well behaved with respect to the state space. We call our new smooth IL algorithm \textit{Smooth Policy and Cost Imitation Learning} (SPaCIL, pronounced 'Special'). We introduce a novel metric to quantify the smoothness of the learned policies. We demonstrate SPaCIL's superior performance on continuous control tasks from MuJoCo. The algorithm not just outperforms the state-of-the-art IL algorithm on our proposed smoothness metric, but, enjoys added benefits of faster learning and substantially higher average return.


title: A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift Generalization

abstract: Covariate-shift generalization, a typical case in out-of-distribution (OOD) generalization, requires a good performance on the unknown test distribution, which varies from the accessible training distribution in the form of covariate shift. Recently, independence-driven importance weighting algorithms in stable learning literature have shown empirical effectiveness to deal with covariate-shift generalization on several learning models, including regression algorithms and deep neural networks, while their theoretical analyses are missing. In this paper, we theoretically prove the effectiveness of such algorithms by explaining them as feature selection processes. We first specify a set of variables, named minimal stable variable set, that is the minimal and optimal set of variables to deal with covariate-shift generalization for common loss functions, such as the mean squared loss and binary cross-entropy loss. Afterward, we prove that under ideal conditions, independence-driven importance weighting algorithms could identify the variables in this set. Analysis of asymptotic properties is also provided. These theories are further validated in several synthetic experiments.


title: Towards Sparse Federated Analytics: Location Heatmaps under Distributed Differential Privacy with Secure Aggregation

abstract: We design a scalable algorithm to privately generate location heatmaps over decentralized data from millions of user devices. It aims to ensure differential privacy before data becomes visible to a service provider while maintaining high data accuracy and minimizing resource consumption on users' devices. To achieve this, we revisit distributed differential privacy based on recent results in secure multiparty computation, and we design a scalable and adaptive distributed differential privacy approach for location analytics. Evaluation on public location datasets shows that this approach successfully generates metropolitan-scale heatmaps from millions of user samples with a worst-case client communication overhead that is significantly smaller than existing state-of-the-art private protocols of similar accuracy.


title: Multivariate feature ranking of gene expression data

abstract: Gene expression datasets are usually of high dimensionality and therefore require efficient and effective methods for identifying the relative importance of their attributes. Due to the huge size of the search space of the possible solutions, the attribute subset evaluation feature selection methods tend to be not applicable, so in these scenarios feature ranking methods are used. Most of the feature ranking methods described in the literature are univariate methods, so they do not detect interactions between factors. In this paper we propose two new multivariate feature ranking methods based on pairwise correlation and pairwise consistency, which we have applied in three gene expression classification problems. We statistically prove that the proposed methods outperform the state of the art feature ranking methods Clustering Variation, Chi Squared, Correlation, Information Gain, ReliefF and Significance, as well as feature selection methods of attribute subset evaluation based on correlation and consistency with multi-objective evolutionary search strategy.


title: VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts

abstract: We present a unified Vision-Language pretrained Model (VLMo) that jointly learns a dual encoder and a fusion encoder with a modular Transformer network. Specifically, we introduce Mixture-of-Modality-Experts (MoME) Transformer, where each block contains a pool of modality-specific experts and a shared self-attention layer. Because of the modeling flexibility of MoME, pretrained VLMo can be fine-tuned as a fusion encoder for vision-language classification tasks, or used as a dual encoder for efficient image-text retrieval. Moreover, we propose a stagewise pre-training strategy, which effectively leverages large-scale image-only and text-only data besides image-text pairs. Experimental results show that VLMo achieves state-of-the-art results on various vision-language tasks, including VQA, NLVR2 and image-text retrieval. The code and pretrained models are available at https://aka.ms/vlmo.


title: SVD-Embedded Deep Autoencoder for MIMO Communications

abstract: Using a deep autoencoder (DAE) for end-to-end communication in multiple-input multiple-output (MIMO) systems is a novel concept with significant potential. DAE-aided MIMO has been shown to outperform singular-value decomposition (SVD)-based precoded MIMO in terms of bit error rate (BER). This paper proposes embedding left- and right-singular vectors of the channel matrix into DAE encoder and decoder to further improve the performance of the MIMO DAE. SVDembedded DAE largely outperforms theoretic linear precoding in terms of BER. This is remarkable since it demonstrates that DAEs have significant potential to exceed the limits of current system design by treating the communication system as a single, end-to-end optimization block. Based on the simulation results, at SNR=10dB, the proposed SVD-embedded design can achieve a BER of about $10^{-5}$ and reduce the BER at least 10 times compared with existing DAE without SVD, and up to 18 times compared with theoretical linear precoding. We attribute this to the fact that the proposed DAE can match the input and output as an adaptive modulation structure with finite alphabet input. We also observe that adding residual connections to the DAE further improves the performance.


title: Subpixel Heatmap Regression for Facial Landmark Localization

abstract: Deep Learning models based on heatmap regression have revolutionized the task of facial landmark localization with existing models working robustly under large poses, non-uniform illumination and shadows, occlusions and self-occlusions, low resolution and blur. However, despite their wide adoption, heatmap regression approaches suffer from discretization-induced errors related to both the heatmap encoding and decoding process. In this work we show that these errors have a surprisingly large negative impact on facial alignment accuracy. To alleviate this problem, we propose a new approach for the heatmap encoding and decoding process by leveraging the underlying continuous distribution. To take full advantage of the newly proposed encoding-decoding mechanism, we also introduce a Siamese-based training that enforces heatmap consistency across various geometric image transformations. Our approach offers noticeable gains across multiple datasets setting a new state-of-the-art result in facial landmark localization. Code alongside the pretrained models will be made available at https://www.adrianbulat.com/face-alignment


title: Augmenting Edge Connectivity via Isolating Cuts

abstract: We give an algorithm for augmenting the edge connectivity of an undirected graph by using the isolating cuts framework (Li and Panigrahi, FOCS '20). Our algorithm uses poly-logarithmic calls to any max-flow algorithm, which yields a running time of $\tilde O(m + n^{3/2})$ and improves on the previous best time of $\tilde O(n^2)$ (Bencz\'ur and Karger, SODA '98) for this problem. We also obtain an identical improvement in the running time of the closely related edge splitting off problem in undirected graphs.


title: HmBlogs: A big general Persian corpus

abstract: This paper introduces the hmBlogs corpus for Persian, as a low resource language. This corpus has been prepared based on a collection of nearly 20 million blog posts over a period of about 15 years from a space of Persian blogs and includes more than 6.8 billion tokens. It can be claimed that this corpus is currently the largest Persian corpus that has been prepared independently for the Persian language. This corpus is presented in both raw and preprocessed forms, and based on the preprocessed corpus some word embedding models are produced. By the provided models, the hmBlogs is compared with some of the most important corpora available in Persian, and the results show the superiority of the hmBlogs corpus over the others. These evaluations also present the importance and effects of corpora, evaluation datasets, model production methods, different hyperparameters and even the evaluation methods. In addition to evaluating the corpus and its produced language models, this research also presents a semantic analogy dataset.


title: Deep Learning-based Non-Intrusive Multi-Objective Speech Assessment Model with Cross-Domain Features

abstract: In this study, we propose a cross-domain multi-objective speech assessment model called MOSA-Net, which can estimate multiple speech assessment metrics simultaneously. Experimental results show that MOSA-Net can improve the linear correlation coefficient (LCC) by 0.026 (0.990 vs 0.964 in seen noise environments) and 0.012 (0.969 vs 0.957 in unseen noise environments) in PESQ prediction, compared to Quality-Net, an existing single-task model for PESQ prediction, and improve LCC by 0.021 (0.985 vs 0.964 in seen noise environments) and 0.047 (0.836 vs 0.789 in unseen noise environments) in STOI prediction, compared to STOI-Net (based on CRNN), an existing single-task model for STOI prediction. Moreover, MOSA-Net, originally trained to assess objective scores, can be used as a pre-trained model to be effectively adapted to an assessment model for predicting subjective quality and intelligibility scores with a limited amount of training data. Experimental results show that MOSA-Net can improve LCC by 0.018 (0.805 vs 0.787) in MOS prediction, compared to MOS-SSL, a strong single-task model for MOS prediction. In light of the confirmed prediction capability, we further adopt the latent representations of MOSA-Net to guide the speech enhancement (SE) process and derive a quality-intelligibility (QI)-aware SE (QIA-SE) approach accordingly. Experimental results show that QIA-SE provides superior enhancement performance compared with the baseline SE system in terms of objective evaluation metrics and qualitative evaluation test. For example, QIA-SE can improve PESQ by 0.301 (2.953 vs 2.652 in seen noise environments) and 0.18 (2.658 vs 2.478 in unseen noise environments) over a CNN-based baseline SE model.


title: HoneyCar: A Framework to Configure Honeypot Vulnerabilities on the Internet of Vehicles

abstract: The Internet of Vehicles (IoV), whereby interconnected vehicles communicate with each other and with road infrastructure on a common network, has promising socio-economic benefits but also poses new cyber-physical threats. Data on vehicular attackers can be realistically gathered through cyber threat intelligence using systems like honeypots. Admittedly, configuring honeypots introduces a trade-off between the level of honeypot-attacker interactions and any incurred overheads and costs for implementing and monitoring these honeypots. We argue that effective deception can be achieved through strategically configuring the honeypots to represent components of the IoV and engage attackers to collect cyber threat intelligence. In this paper, we present HoneyCar, a novel decision support framework for honeypot deception in IoV. HoneyCar builds upon a repository of known vulnerabilities of the autonomous and connected vehicles found in the Common Vulnerabilities and Exposure (CVE) data within the National Vulnerability Database (NVD) to compute optimal honeypot configuration strategies. By taking a game-theoretic approach, we model the adversarial interaction as a repeated imperfect-information zero-sum game in which the IoV network administrator chooses a set of vulnerabilities to offer in a honeypot and a strategic attacker chooses a vulnerability of the IoV to exploit under uncertainty. Our investigation is substantiated by examining two different versions of the game, with and without the re-configuration cost to empower the network administrator to determine optimal honeypot configurations. We evaluate HoneyCar in a realistic use case to support decision makers with determining optimal honeypot configuration strategies for strategic deployment in IoV.


title: The Schur Expansion of Characteristic Polynomials and Random Matrices

abstract: We develop a new framework to compute the exact correlators of characteristic polynomials, and their inverses, in random matrix theory. Our results hold for general potentials and incorporate the effects of an external source. In matrix model realizations of string theory, these correspond to correlation functions of exponentiated "(anti-)branes" in a given background of "momentum branes". Our method relies on expanding the (inverse) determinants in terms of Schur polynomials, then re-summing their expectation values over the allowed representations of the symmetric group. Beyond unifying previous, seemingly disparate calculations, this powerful technique immediately delivers two new results: 1) the full finite $N$ answer for the correlator of inverse determinant insertions in the presence of a matrix source, and 2) access to an interesting, novel regime $M>N$, where the number of inverse determinant insertions $M$ exceeds the size of the matrix $N$.


title: Limit theorems for the realised semicovariances of multivariate Brownian semistationary processes

abstract: In this article we will introduce the realised semicovariance for Brownian semistationary (BSS) processes, which is obtained from the decomposition of the realised covariance matrix into components based on the signs of the returns, and study its in-fill asymptotic properties. More precisely, a weak convergence in the space of c\`adl\`ag functions endowed with the Skorohod topology for the realised semicovariance of a general Gaussian process with stationary increments is proved first. The methods are based on Breuer-Major theorems and on a moment bound for sums of products of Gaussian vector's functions. Furthermore, we establish a corresponding stable convergence. Finally, a weak law of large numbers and a central limit theorem for the realised semicovariance of multivariate BSS processes are established. These results extend the limit theorems for the realised covariation to a result for non-linear functionals.


title: Multistage Estimators for Missing Covariates and Incomplete Outcomes

abstract: We study problems with multiple missing covariates and partially observed responses. We develop a new framework to handle complex missing covariate scenarios via inverse probability weighting, regression adjustment, and a multiply-robust procedure. We apply our framework to three classical problems: the Cox model from survival analysis, missing response, and binary treatment from causal inference. We also discuss how to handle missing covariates in these scenarios, and develop associated identifying theories and asymptotic theories. We apply our procedure to simulations and an Alzheimer's disease dataset and obtain meaningful results.


title: Video Salient Object Detection via Contrastive Features and Attention Modules

abstract: Video salient object detection aims to find the most visually distinctive objects in a video. To explore the temporal dependencies, existing methods usually resort to recurrent neural networks or optical flow. However, these approaches require high computational cost, and tend to accumulate inaccuracies over time. In this paper, we propose a network with attention modules to learn contrastive features for video salient object detection without the high computational temporal modeling techniques. We develop a non-local self-attention scheme to capture the global information in the video frame. A co-attention formulation is utilized to combine the low-level and high-level features. We further apply the contrastive learning to improve the feature representations, where foreground region pairs from the same video are pulled together, and foreground-background region pairs are pushed away in the latent space. The intra-frame contrastive loss helps separate the foreground and background features, and the inter-frame contrastive loss improves the temporal consistency. We conduct extensive experiments on several benchmark datasets for video salient object detection and unsupervised video object segmentation, and show that the proposed method requires less computation, and performs favorably against the state-of-the-art approaches.


title: A direct approach to solving the hydrodynamic oseenlet

abstract: We present a new direct approach to obtain the Green's function of the Oseen equations, also known as the oseenlet. This approach is different in that it does not assume an initial form of the solution to begin with. The final solution is expressed in a new, simplified form that resembles the Oseen-Burger's tensor of the stokeslet equations, from which the contributions due to inertia are easily appreciable.


title: The solar corona as an active medium for magnetoacoustic waves

abstract: The presence and interplay of continuous cooling and heating processes maintaining the corona of the Sun at the observed one million K temperature were recently understood to have crucial effects on the dynamics and stability of magnetoacoustic waves. These essentially compressive waves perturb the coronal thermal equilibrium, leading to the phenomenon of a wave-induced thermal misbalance. Representing an additional natural mechanism for the exchange of energy between the plasma and the wave, thermal misbalance makes the corona an active medium for magnetoacoustic waves, so that the wave can not only lose but also gain energy from the coronal heating source (similarly to burning gases, lasers and masers). We review recent achievements in this newly emerging research field, focussing on the effects that slow-mode magnetoacoustic waves experience as a back-reaction of this perturbed coronal thermal equilibrium. The new effects include enhanced frequency-dependent damping or amplification of slow waves, and effective, not associated with the coronal plasma non-uniformity, dispersion. We also discuss the possibility to probe the unknown coronal heating function by observations of slow waves and linear theory of thermal instabilities. The manifold of the new properties that slow waves acquire from a thermodynamically active nature of the solar corona indicate a clear need for accounting for the effects of combined coronal heating/cooling processes not only for traditional problems of the formation and evolution of prominences and coronal rain, but also for an adequate modelling and interpretation of magnetohydrodynamic waves.


title: What Robot do I Need? Fast Co-Adaptation of Morphology and Control using Graph Neural Networks

abstract: The co-adaptation of robot morphology and behaviour becomes increasingly important with the advent of fast 3D-manufacturing methods and efficient deep reinforcement learning algorithms. A major challenge for the application of co-adaptation methods to the real world is the simulation-to-reality-gap due to model and simulation inaccuracies. However, prior work focuses primarily on the study of evolutionary adaptation of morphologies exploiting analytical models and (differentiable) simulators with large population sizes, neglecting the existence of the simulation-to-reality-gap and the cost of manufacturing cycles in the real world. This paper presents a new approach combining classic high-frequency deep neural networks with computational expensive Graph Neural Networks for the data-efficient co-adaptation of agents with varying numbers of degrees-of-freedom. Evaluations in simulation show that the new method can co-adapt agents within such a limited number of production cycles by efficiently combining design optimization with offline reinforcement learning, that it allows for the direct application to real-world co-adaptation tasks in future work


title: Parameter Estimation Procedures for Exponential-Family Random Graph Models on Count-Valued Networks: A Comparative Simulation Study

abstract: The exponential-family random graph models (ERGMs) have emerged as an important framework for modeling social networks for a wide variety of relational types. ERGMs for valued networks are less well-developed than their unvalued counterparts, and pose particular computational challenges. Network data with edge values on the non-negative integers (count-valued networks) is an important such case, with examples ranging from the magnitude of migration and trade flows between places to the frequency of interactions and encounters between individuals. Here, we propose an efficient parallelable subsampled maximum pseudo-likelihood estimation (MPLE) scheme for count-valued ERGMs, and compare its performance with existing Contrastive Divergence (CD) and Monte Carlo Maximum Likelihood Estimation (MCMLE) approaches via a simulation study based on migration flow networks in two U.S. states. Our results suggest that edge value variance is a key factor in method performance, while network size mainly influences their relative merits in computational time. For small-variance networks, all methods perform well in point estimations while CD greatly overestimates uncertainties, and MPLE underestimates them for dependence terms; all methods have fast estimation for small networks, but CD and subsampled multi-core MPLE provides speed advantages as network size increases. For large-variance networks, both MPLE and MCMLE offer high-quality estimates of coefficients and their uncertainty, but MPLE is significantly faster than MCMLE; MPLE is also a better seeding method for MCMLE than CD, as the latter makes MCMLE more prone to convergence failure.


title: Weakly saturated hypergraphs and a conjecture of Tuza

abstract: Given a fixed hypergraph $H$, let $\mbox{wsat}(n,H)$ denote the smallest number of edges in an $n$-vertex hypergraph $G$, with the property that one can sequentially add the edges missing from $G$, so that whenever an edge is added, a new copy of $H$ is created. The study of $\mbox{wsat}(n,H)$ was introduced by Bollob\'as in 1968, and turned out to be one of the most influential topics in extremal combinatorics. While for most $H$ very little is known regarding $\mbox{wsat}(n,H)$, Alon proved in 1985 that for every graph $H$ there is a limiting constant $C_H$ so that $\mbox{wsat}(n,H)=(C_H+o(1))n$. Tuza conjectured in 1992 that Alon's theorem can be (appropriately) extended to arbitrary $r$-uniform hypergraphs. In this paper we prove this conjecture.


title: Can I use this publicly available dataset to build commercial AI software? -- A Case Study on Publicly Available Image Datasets

abstract: Publicly available datasets are one of the key drivers for commercial AI software. The use of publicly available datasets is governed by dataset licenses. These dataset licenses outline the rights one is entitled to on a given dataset and the obligations that one must fulfil to enjoy such rights without any license compliance violations. Unlike standardized Open Source Software (OSS) licenses, existing dataset licenses are defined in an ad-hoc manner and do not clearly outline the rights and obligations associated with their usage. Further, a public dataset may be hosted in multiple locations and created from multiple data sources each of which may have different licenses. Hence, existing approaches on checking OSS license compliance cannot be used. In this paper, we propose a new approach to assessing the potential license compliance violations if a given publicly available dataset were to be used for building commercial AI software. We conduct a case study with our approach on 6 commonly used publicly available image datasets. Our results show that there exists potential risks of license violations associated with all of the studied datasets if they were used for commercial purposes.


title: Virus-MNIST: Machine Learning Baseline Calculations for Image Classification

abstract: The Virus-MNIST data set is a collection of thumbnail images that is similar in style to the ubiquitous MNIST hand-written digits. These, however, are cast by reshaping possible malware code into an image array. Naturally, it is poised to take on a role in benchmarking progress of virus classifier model training. Ten types are present: nine classified as malware and one benign. Cursory examination reveals unequal class populations and other key aspects that must be considered when selecting classification and pre-processing methods. Exploratory analyses show possible identifiable characteristics from aggregate metrics (e.g., the pixel median values), and ways to reduce the number of features by identifying strong correlations. A model comparison shows that Light Gradient Boosting Machine, Gradient Boosting Classifier, and Random Forest algorithms produced the highest accuracy scores, thus showing promise for deeper scrutiny.


title: Multiplicative Component GARCH Model of Intraday Volatility

abstract: This paper proposes a multiplicative component intraday volatility model. The intraday conditional volatility is expressed as the product of intraday periodic component, intraday stochastic volatility component and daily conditional volatility component. I extend the multiplicative component intraday volatility model of Engle (2012) and Andersen and Bollerslev (1998) by incorporating the durations between consecutive transactions. The model can be applied to both regularly and irregularly spaced returns. I also provide a nonparametric estimation technique of the intraday volatility periodicity. The empirical results suggest the model can successfully capture the interdependency of intraday returns.


title: Detection of quantum-vacuum field correlations outside the light cone

abstract: According to quantum field theory, empty space -- the ground state of the theory with all real excitations removed -- is not empty at all, but filled with quantum-vacuum fluctuations. Their presence can manifest itself through a series of phenomena such as the Casimir force, spontaneous emission, or dispersion forces. These fluctuating fields possess correlations between space-time points outside the light cone, i.e. between points which are causally disconnected according to special relativity. A counterintuitive consequence is that two initially uncorrelated quantum objects in empty space (the quantum vacuum) which are located in causally disconnected space-time regions, and therefore unable to exchange information, can become correlated. Using electro-optic sampling, we have experimentally demonstrated the existence of correlations of the vacuum fields for non-causally connected space-time points. This result is obtained by detecting and analyzing vacuum-induced correlations between two 195 fs laser pulses separated by a time of flight of 470 fs which propagate through a nonlinear crystal. Our theory reveals the vast majority of the correlations as stemming from space-time points outside the light cone. This work marks a first step in analyzing the space-time structure of vacuum correlations in quantum field theory.


title: Intrusion Detection: Machine Learning Baseline Calculations for Image Classification

abstract: Cyber security can be enhanced through application of machine learning by recasting network attack data into an image format, then applying supervised computer vision and other machine learning techniques to detect malicious specimens. Exploratory data analysis reveals little correlation and few distinguishing characteristics between the ten classes of malware used in this study. A general model comparison demonstrates that the most promising candidates for consideration are Light Gradient Boosting Machine, Random Forest Classifier, and Extra Trees Classifier. Convolutional networks fail to deliver their outstanding classification ability, being surpassed by a simple, fully connected architecture. Most tests fail to break 80% categorical accuracy and present low F1 scores, indicating more sophisticated approaches (e.g., bootstrapping, random samples, and feature selection) may be required to maximize performance.


title: Unique continuation from a crack's tip under Neumann boundary conditions

abstract: We derive local asymptotics of solutions to second order elliptic equations at the edge of a $(N-1)$-dimensional crack, with homogeneous Neumann boundary conditions prescribed on both sides of the crack. A combination of blow-up analysis and monotonicity arguments provides a classification of all possible asymptotic homogeneities of solutions at the crack's tip, together with a a strong unique continuation principle.


title: Photoionization modeling of the dusty nova V1280 Scorpii

abstract: We perform photoionization modeling of the dusty nova V1280 Scorpii (V1280 Sco) with an aim to study the changes in the physical and chemical parameters. We model pre and post dust phase, optical and near-Infrared (NIR), spectra using the photoionization code \textsc{cloudy}, v.17.02, considering a two-component (low density and high density region) model. From the best-fit model, we find that the temperature and luminosity of the central ionizing source in the pre-dust phase are in the range 1.32 - 1.50 $\times 10^4$ K and 2.95 - 3.16 $\times 10^{36}$ ergs$^{-1}$, respectively, which increase to 1.58 - 1.62 $\times 10^4$ K and 3.23 - 3.31 $\times 10^{36}$ ergs$^{-1}$, respectively, in the post-dust phase. It is found that a very high hydrogen density ($\sim 10^{13} - 10^{14}$ cm$^{-3}$) is required for the generation of spectra properly. Dust condensation conditions are achieved at high ejecta density ($\sim 3.16 \times 10^{8}$cm$^{-3}$) and low temperature ($\sim$2000 K) in the outer region of the ejecta. It is found that a mixture of small (0.005 - 0.25$\mu$m) amorphous carbon dust grains and large (0.03 - 3.0$\mu$m) astrophysical silicate dust grains iis present n the ejecta in the post-dust phase. Our model yields very high elemental abundance values as C/H = 13.5 - 20, N/H = 250, O/H = 27 - 35, by number, relative to solar in the ejecta, during the pre-dust phase, which decrease in the post-dust phase.


title: Truncations of random symplectic unitary matrices

abstract: This paper is concerned with complex eigenvalues of truncated unitary quaternion matrices equipped with the Haar measure. The joint eigenvalue probability density function is obtained for truncations of any size. We also obtain the spectral density and the eigenvalue correlation functions in various scaling limits. In the limit of strong non-unitarity the universal complex Ginibre form of the correlation functions is recovered in the spectral bulk off the real line after unfolding the spectrum. In the limit of weak non-unitarity we obtain the spectral density and eigenvalue correlation functions for all regions of interest. Off the real line the obtained expressions coincide with those previously obtained for truncations of Haar unitary complex matrices.


title: Multiband Detection of Repeating FRB 20180916B

abstract: We present a multiband study of FRB 20180916B, a repeating source with a 16.3 day periodicity. We report the detection of 4, 1 and 7 bursts from observations spanning 3 days using upgraded Giant Metrewave Radio Telescope (300-500 MHz), Canadian Hydrogen Intensity Mapping Experiment (400-800 MHz) and Green Bank Telescope (600-1000 MHz), respectively. We report the first-ever detection of the source in the 800-1000 MHz range along with one of the widest instantaneous bandwidth detection (200 MHz) at lower frequencies. We identify 30 $\mu$s wide structures in one of the bursts at 800 MHz, making it the lowest frequency detection of such structures for this FRB thus far. There is also a clear indication of high activity of the source at a higher frequency during earlier phases of the activity cycle. We identify a gradual decrease in the rotation measure over two years and no significant variations in the dispersion measure. We derive useful conclusions about progenitor scenarios, energy distribution, emission mechanisms, and variation of downward drift rate of emission with frequency. Our results reinforce that multiband observations are an effective approach to study repeaters and even one-off events to better understand their varying activity and spectral anomalies.


title: New Periodograms Separating Orbital Radial Velocities and Spectral Shape Variation

abstract: We present new periodograms that are effective in distinguishing Doppler shift from spectral shape variability in astronomical spectra. These periodograms, building upon the concept of partial distance correlation, separate the periodic radial velocity modulation induced by orbital motion from that induced by stellar activity. These tools can be used to explore large spectroscopic databases in search of targets in which spectral shape variations obscure the orbital motion; such systems include active planet-hosting stars or binary systems with an intrinsically variable component. We provide a detailed prescription for calculating the periodograms, demonstrate their performance via simulations and real-life case studies, and provide a public Python implementation.


title: The Boundary Schwarz lemma for harmonic and pluriharmonic mappings and some generalisations

abstract: The main purpose of this paper is to develop some methods to investigate the Schwarz type lemmas of holomorphic mappings and pluriharmonic mappings in Hilbert and Banach spaces. Initially, we extend the classical Schwarz lemmas of holomorphic mappings to Hilbert and Banach spaces. Furthermore, we improve and generalize the classical Schwarz lemmas of planar harmonic mappings into the sharp forms of Banach spaces, and present some applications to sharp boundary Schwarz type lemmas for pluriharmonic mappings in Hilbert and Banach spaces and the obtained results provide the improvements and generalizations of some latest corresponding results in this subject. In the last section we studied harmonic and hyperbolical-harmonic function mapping unit ball in Euclidial n-space, to unit ball in Euclidial m-space, taking prescribed value in the origin, which improved some previous results.


title: Discovering hydrodynamic equations of many-body quantum systems

abstract: Simulating and predicting dynamics of quantum many-body systems is extremely challenging, even for state-of-the-art computational methods, due to the spread of entanglement across the system. However, in the long-wavelength limit, quantum systems often admit a simplified description, which involves a small set of physical observables and requires only a few parameters such as sound velocity or viscosity. Unveiling the relationship between these hydrodynamic equations and the underlying microscopic theory usually requires a great effort by condensed matter theorists. In the present paper, we develop a new machine-learning framework for automated discovery of effective equations from a limited set of available data, thus bypassing complicated analytical derivations. The data can be generated from numerical simulations or come from experimental quantum simulator platforms. Using integrable models, where direct comparisons can be made, we reproduce previously known hydrodynamic equations, strikingly discover novel equations and provide their derivation whenever possible. We discover new hydrodynamic equations describing dynamics of interacting systems, for which the derivation remains an outstanding challenge. Our approach provides a new interpretable method to study properties of quantum materials and quantum simulators in non-perturbative regimes.

categories: quant-ph cond-mat.quant-gas cond-mat.str-el nlin.SI


title: New physics searches with the International Large Detector at the ILC

abstract: Although the LHC experiments have searched for and excluded many proposed new particles up to masses close to 1 TeV, there are many scenarios that are difficult to address at a hadron collider. This talk will review a number of these scenarios and present the expectations for searches at an electron-positron collider such as the International Linear Collider. The cases discussed include the light Higgsino, the \stau~ slepton in the coannihilation region relevant to dark matter, as well as other SUSY signatures. he studies are based on the ILD concept at the ILC.


title: An Empirical Study of Training End-to-End Vision-and-Language Transformers

abstract: Vision-and-language (VL) pre-training has proven to be highly effective on various VL downstream tasks. While recent work has shown that fully transformer-based VL models can be more efficient than previous region-feature-based methods, their performance on downstream tasks often degrades significantly. In this paper, we present METER, a Multimodal End-to-end TransformER framework, through which we investigate how to design and pre-train a fully transformer-based VL model in an end-to-end manner. Specifically, we dissect the model designs along multiple dimensions: vision encoders (e.g., CLIP-ViT, Swin transformer), text encoders (e.g., RoBERTa, DeBERTa), multimodal fusion module (e.g., merged attention vs. co-attention), architectural design (e.g., encoder-only vs. encoder-decoder), and pre-training objectives (e.g., masked image modeling). We conduct comprehensive experiments and provide insights on how to train a performant VL transformer. METER achieves an accuracy of 77.64% on the VQAv2 test-std set using only 4M images for pre-training, surpassing the state-of-the-art region-feature-based model by 1.04%, and outperforming the previous best fully transformer-based model by 1.6%. Notably, when further scaled up, our best VQA model achieves an accuracy of 80.54%. Code and pre-trained models are released at https://github.com/zdou0830/METER.


title: A Survey of Machine Learning Algorithms for Detecting Malware in IoT Firmware

abstract: This work explores the use of machine learning techniques on an Internet-of-Things firmware dataset to detect malicious attempts to infect edge devices or subsequently corrupt an entire network. Firmware updates are uncommon in IoT devices; hence, they abound with vulnerabilities. Attacks against such devices can go unnoticed, and users can become a weak point in security. Malware can cause DDoS attacks and even spy on sensitive areas like peoples' homes. To help mitigate this threat, this paper employs a number of machine learning algorithms to classify IoT firmware and the best performing models are reported. In a general comparison, the top three algorithms are Gradient Boosting, Logistic Regression, and Random Forest classifiers. Deep learning approaches including Convolutional and Fully Connected Neural Networks with both experimental and proven successful architectures are also explored.


title: On rank not only in NSOP1 theories

abstract: We introduce a family of local ranks DQ depending on a finite set Q of pairs of the form (\varphi(x,y),q(y)) where \varphi(x,y) is a formula and q(y) is a global type. We prove that in any NSOP1 theory these ranks satisfy some desirable properties; in particular, DQ(x=x)<\omega for any finite variable x and any Q, if q\supseteq p is a Kim-forking extension of types, then DQ(q)<DQ(p) for some Q, and if q\supseteq p is a Kim-non-forking extension, then DQ(q)=DQ(p) for every Q that involves only invariant types whose Morley powers are \ind^K-stationary. We give natural examples of families of invariant types satisfying this property in some NSOP1 theories. We also answer a question of Granger about equivalence of dividing and dividing finitely in the theory T_\infty of vector spaces with a generic bilinear form. We conclude that forking equals dividing in T_\infty, strengthening an earlier observation that T_\infty satisfies the existence axiom for forking independence. Finally, we slightly modify our definitions and go beyond NSOP1 to find out that our local ranks are bounded by the well-known ranks: the inp-rank (burden), and hence, in particular, by the dp-rank. Therefore, our local ranks are finite provided that the dp-rank is finite, for example if T is dp-minimal. Hence, our notion of ranks identifies a non-trivial class of theories containing all NSOP1 and NTP2 theories.


title: Incorporating Surrogate Information for Adaptive Subgroup Enrichment Design with Sample Size Re-estimation

abstract: Adaptive subgroup enrichment design is an efficient design framework that allows accelerated development for investigational treatments while also having flexibility in population selection within the course of the trial. The adaptive decision at the interim analysis is commonly made based on the conditional probability of trial success. However, one of the critical challenges for such adaptive designs is immature data for interim decisions, particularly in the targeted subgroup with a limited sample size at the first stage of the trial. In this paper, we improve the interim decision making by incorporating information from surrogate endpoints when estimating conditional power at the interim analysis, by predicting the primary treatment effect based on the observed surrogate endpoint and prior knowledge or historical data about the relationship between endpoints. Modified conditional power is developed for both selecting the patient population to be enrolled after the interim analysis and sample size re-estimation. In the simulation study, our proposed design shows a higher chance to make desirable interim decisions and achieves higher overall power, while controlling the overall type I error. This performance is robust over drift of prior knowledge from the true relationship between two endpoints. We also demonstrate the application of our proposed design in two case studies in oncology and vaccine trials.


title: Topologically-driven impossibility of superposing unknown states

abstract: Impossibilities that are unique to quantum mechanics, such as cloning, can deepen our physics understanding and lead to numerous applications. One of the most elementary classical operations is the addition of bit strings. As its quantum version we can take the task of creating a superposition $\alpha e^{i\phi(\left|u\right>,\left|v\right>)} \left|u\right>+\beta\left|v\right>$ from two unknown states $\left|u\right>,\left|v\right>\in\mathcal{H}$, where $\phi$ is some real function and $\alpha,\beta\in\mathbb{C}\setminus\{0\}$. Oszmaniec, Grudka, Horodecki and W{\'o}jcik [Phys. Rev. Lett. 116(11):110403, 2016] showed that a quantum circuit cannot create a superposition from a single copy of each state. But how many input copies suffice? Due to quantum tomography, the sample complexity seems at most exponential. Surprisingly, we prove that quantum circuits of any sample complexity cannot output a superposition for all input state-pairs $\left|u\right>,\left|v\right>\in\mathcal{H}$ - not even when postselection and approximations are allowed. We show explicitly the limitation on state tomography that precludes its use for superposition. Our result is an application of the topological "lower bound" method [arXiv:2011.10031], which matches any quantum circuit to a continuous function. We find topological arguments showing that no continuous function can output a superposition. This new use of the method offers further understanding of its applicability. Considering state tomography we suggest circumventing our impossibility by relaxing to random superposition or entangled superposition. Random superposition reveals a separation between two types of measurement. Entangled superposition could still be useful as a subroutine. However, both relaxations are inspired by the inefficient state tomography. Whether efficient implementations exist remains open.


title: A Comparison of Discrete and Soft Speech Units for Improved Voice Conversion

abstract: The goal of voice conversion is to transform source speech into a target voice, keeping the content unchanged. In this paper, we focus on self-supervised representation learning for voice conversion. Specifically, we compare discrete and soft speech units as input features. We find that discrete representations effectively remove speaker information but discard some linguistic content - leading to mispronunciations. As a solution, we propose soft speech units. To learn soft units, we predict a distribution over discrete speech units. By modeling uncertainty, soft units capture more content information, improving the intelligibility and naturalness of converted speech. Samples available at https://ubisoft-laforge.github.io/speech/soft-vc/. Code available at https://github.com/bshall/soft-vc/.


title: Electroweak bubble wall expansion: gravitational waves and baryogenesis in Standard Model-like thermal plasma

abstract: Computing the properties of the bubble wall of a cosmological first order phase transition at electroweak scale is of paramount importance for the correct prediction of the baryon asymmetry of the universe and the spectrum of gravitational waves. By means of the semi-classical formalism we calculate the velocity and thickness of the wall using as theoretical framework the scalar singlet extension of the SM with a parity symmetry and the SM effective field theory supplemented by a dimension six operator. We use these solutions to carefully predict the baryon asymmetry and the gravitational wave signals. The singlet scenario can easily accommodate the observed asymmetry but these solutions do not lead to observable effects at future gravity wave experiments. In contrast the effective field theory fails at explaining the baryon abundance due to the strict constraints from electric dipole moment experiments, however, the strongest solutions we found fall within the sensitivity of the LISA experiment. We provide a simple analytical approximation for the wall velocity which only requires calculation of the strength and temperature of the transition and works reasonably well in all models tested. We find that generically the weak transitions where the fluid approximation can be used to calculate the wall velocity and verify baryogenesis produce signals too weak to be observed in future gravitational wave experiments. Thus, we infer that GW signals produced by simple SM extensions visible in future experiments are likely to only be produced in strong transitions described by detonations with highly relativistic wall velocities.


title: FAST: Faster Arbitrarily-Shaped Text Detector with Minimalist Kernel Representation

abstract: We propose an accurate and efficient scene text detection framework, termed FAST (i.e., faster arbitrarily-shaped text detector). Different from recent advanced text detectors that used complicated post-processing and hand-crafted network architectures, resulting in low inference speed, FAST has two new designs. (1) We design a minimalist kernel representation (only has 1-channel output) to model text with arbitrary shape, as well as a GPU-parallel post-processing to efficiently assemble text lines with a negligible time overhead. (2) We search the network architecture tailored for text detection, leading to more powerful features than most networks that are searched for image classification. Benefiting from these two designs, FAST achieves an excellent trade-off between accuracy and efficiency on several challenging datasets, including Total Text, CTW1500, ICDAR 2015, and MSRA-TD500. For example, FAST-T yields 81.6% F-measure at 152 FPS on Total-Text, outperforming the previous fastest method by 1.7 points and 70 FPS in terms of accuracy and speed. With TensorRT optimization, the inference speed can be further accelerated to over 600 FPS. Code and models will be released at https://github.com/czczup/FAST.


title: Exact aggregate models for optimal management of heterogeneous fleets of storage devices

abstract: Future power grids will entail large fleets of storage devices capable of scheduling their charging/discharging profiles so as to achieve lower peak demand and reduce energy bills, by shifting absorption times in sync with the availability of renewable energy sources. Optimal management of such fleets entails large scale optimisation problems which are better dealt with in a hierarchical manner, by clustering together individual devices into fleets. Leveraging on recent results characterizing the set of aggregate demand profiles of a heterogeneous fleet of charging (or, respectively, discharging) devices we propose a way to achieve optimality, in a unit commitment problem, by adopting a simplified formulation with a number of constraints for the fleet that scales linearly in the number of time-slots considered and is independent of the size of the fleet. This is remarkable, as it shows that, under suitable conditions, a heterogeneous fleet of any size can effectively be treated as a single storage unit.


title: Simulations of Quantum Circuits with Approximate Noise using qsim and Cirq

abstract: We introduce multinode quantum trajectory simulations with qsim, an open source high performance simulator of quantum circuits. qsim can be used as a backend of Cirq, a Python software library for writing quantum circuits. We present a novel delayed inner product algorithm for quantum trajectories which can result in an order of magnitude speedup for low noise simulation. We also provide tools to use this framework in Google Cloud Platform, with high performance virtual machines in a single mode or multinode setting. Multinode configurations are well suited to simulate noisy quantum circuits with quantum trajectories. Finally, we introduce an approximate noise model for Google's experimental quantum computing platform and compare the results of noisy simulations with experiments for several quantum algorithms on Google's Quantum Computing Service.


title: A novel parameter for nonequilibrium analysis in reconstructed state spaces

abstract: Kernel methods are widely used for probability estimation by measuring the distribution of low-passed vector distances in reconstructed state spaces. However, the information conveyed by the vector distances that are greater than the threshold has received little attention. In this paper, we consider the probabilistic difference of the kernel transformation in reconstructed state spaces, and derive a novel nonequilibrium descriptor by measuring the fluctuations of the vector distance with respect to the tolerance. We verify the effectiveness of the proposed kernel probabilistic difference using three chaotic series (logistic, Henon, and Lorenz) and a first-order autoregressive series according to the surrogate theory, and we use the kernel parameter to analyze real-world heartbeat data. In the heartbeat analysis, the kernel probabilistic difference, particularly that based on the Kullback--Leibler divergence, effectively characterizes the physiological complexity loss related to reduced cardiac dynamics in the elderly and diseased heartbeat data. Overall, the kernel probabilistic difference provides a novel method for the quantification of nonequilibria by characterizing the fluctuation theorem in reconstructed state spaces, and enables reliable detection of cardiac physiological and pathological information from heart rates.


title: Transparency of Deep Neural Networks for Medical Image Analysis: A Review of Interpretability Methods

abstract: Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid increase in the available data and computational power. In order to conform to the principles of trustworthy AI, it is essential that the AI system be transparent, robust, fair and ensure accountability. Current deep neural solutions are referred to as black-boxes due to a lack of understanding of the specifics concerning the decision making process. Therefore, there is a need to ensure interpretability of deep neural networks before they can be incorporated in the routine clinical workflow. In this narrative review, we utilized systematic keyword searches and domain expertise to identify nine different types of interpretability methods that have been used for understanding deep learning models for medical image analysis applications based on the type of generated explanations and technical similarities. Furthermore, we report the progress made towards evaluating the explanations produced by various interpretability methods. Finally we discuss limitations, provide guidelines for using interpretability methods and future directions concerning the interpretability of deep neural networks for medical imaging analysis.


title: Learning Pruned Structure and Weights Simultaneously from Scratch: an Attention based Approach

abstract: As a deep learning model typically contains millions of trainable weights, there has been a growing demand for a more efficient network structure with reduced storage space and improved run-time efficiency. Pruning is one of the most popular network compression techniques. In this paper, we propose a novel unstructured pruning pipeline, Attention-based Simultaneous sparse structure and Weight Learning (ASWL). Unlike traditional channel-wise or weight-wise attention mechanism, ASWL proposed an efficient algorithm to calculate the pruning ratio through layer-wise attention for each layer, and both weights for the dense network and the sparse network are tracked so that the pruned structure is simultaneously learned from randomly initialized weights. Our experiments on MNIST, Cifar10, and ImageNet show that ASWL achieves superior pruning results in terms of accuracy, pruning ratio and operating efficiency when compared with state-of-the-art network pruning methods.


title: Deep AUC Maximization for Medical Image Classification: Challenges and Opportunities

abstract: In this extended abstract, we will present and discuss opportunities and challenges brought about by a new deep learning method by AUC maximization (aka \underline{\bf D}eep \underline{\bf A}UC \underline{\bf M}aximization or {\bf DAM}) for medical image classification. Since AUC (aka area under ROC curve) is a standard performance measure for medical image classification, hence directly optimizing AUC could achieve a better performance for learning a deep neural network than minimizing a traditional loss function (e.g., cross-entropy loss). Recently, there emerges a trend of using deep AUC maximization for large-scale medical image classification. In this paper, we will discuss these recent results by highlighting (i) the advancements brought by stochastic non-convex optimization algorithms for DAM; (ii) the promising results on various medical image classification problems. Then, we will discuss challenges and opportunities of DAM for medical image classification from three perspectives, feature learning, large-scale optimization, and learning trustworthy AI models.


title: Polarization-Based Reconfigurable Tags for Robust Ambient Backscatter Communications

abstract: Ambient backscatter communication is an emerging and promising low-energy technology for the Internet of Things. In such a system, a tag sends a binary message to a reader by backscattering a radio frequency signal generated by an ambient source. The tag can operate without battery and without generating additional radio waves. However, the tag-to-reader link suffers from the source-to-reader interference. In this paper, we propose a polarization-based reconfigurable antenna in order to improve the robustness of the tag-to-reader link against the source-to-reader direct interference. More precisely, we compare different types of tags' antennas, different tags' encoding schemes, and different detectors at the reader. By using analysis, numerical simulations, and experiments, we show that a polarization-based reconfigurable tag with four polarization directions significantly outperforms a non-reconfigurable tag, and provides almost the same performance as an ideal reconfigurable tag with a large number of reconfigurable polarization patterns.


title: Skin Cancer Classification using Inception Network and Transfer Learning

abstract: Medical data classification is typically a challenging task due to imbalance between classes. In this paper, we propose an approach to classify dermatoscopic images from HAM10000 (Human Against Machine with 10000 training images) dataset, consisting of seven imbalanced types of skin lesions, with good precision and low resources requirements. Classification is done by using a pretrained convolutional neural network. We evaluate the accuracy and performance of the proposal and illustrate possible extensions.


title: WORD: A large scale dataset, benchmark and clinical applicable study for abdominal organ segmentation from CT image

abstract: Whole abdominal organ segmentation is important in diagnosing abdomen lesions, radiotherapy, and follow-up. However, oncologists' delineating all abdominal organs from 3D volumes is time-consuming and very expensive. Deep learning-based medical image segmentation has shown the potential to reduce manual delineation efforts, but it still requires a large-scale fine annotated dataset for training, and there is a lack of large-scale datasets covering the whole abdomen region with accurate and detailed annotations for the whole abdominal organ segmentation. In this work, we establish a new large-scale \textit{W}hole abdominal \textit{OR}gan \textit{D}ataset (\textit{WORD}) for algorithm research and clinical application development. This dataset contains 150 abdominal CT volumes (30495 slices). Each volume has 16 organs with fine pixel-level annotations and scribble-based sparse annotations, which may be the largest dataset with whole abdominal organ annotation. Several state-of-the-art segmentation methods are evaluated on this dataset. And we also invited three experienced oncologists to revise the model predictions to measure the gap between the deep learning method and oncologists. Afterwards, we investigate the inference-efficient learning on the WORD, as the high-resolution image requires large GPU memory and a long inference time in the test stage. We further evaluate the scribble-based annotation-efficient learning on this dataset, as the pixel-wise manual annotation is time-consuming and expensive. The work provided a new benchmark for the abdominal multi-organ segmentation task, and these experiments can serve as the baseline for future research and clinical application development.


title: Detection of extremely low frequency gravitational wave using gravitational lens: The general case

abstract: The effect of gravitational wave of extremely low frequency on time delays between different locations on the Einstein ring in a lens system with an aligned source-deflector-observer configuration is investigated. The observer will observe an Einstein ring from the lens system aligned in a highly symmetric configuration. Time delays between different locations on the Einstein ring cannot emerge without gravitational wave of cosmological wavelength propagating through the lens system. Otherwise, different locations on the Einstein ring will show time delays. Our previous studies showed that time delays from different locations on the Einstein ring in the presence of gravitational wave of cosmological wavelength present a special relationship. But this result is limited to a specific aligned source-deflector-observer configuration where the source and the observer are equidistant from the deflector and the gravitational wave has special direction of propagation and polarization. In order to investigate the property in the general case, we extend to the general condition that the source and the observer aren't equidistant from the deflector and the direction and polarization of the gravitational wave is arbitrary in the present work. Results in this work show that time delays between different locations on the Einstein ring with the general condition present the same relationship as that in our previous studies.


title: Unsupervised embedding and similarity detection of microregions using public transport schedules

abstract: The role of spatial data in tackling city-related tasks has been growing in recent years. To use them in machine learning models, it is often necessary to transform them into a vector representation, which has led to the development in the field of spatial data representation learning. There is also a growing variety of spatial data types for which representation learning methods are proposed. Public transport timetables have so far not been used in the task of learning representations of regions in a city. In this work, a method is developed to embed public transport availability information into vector space. To conduct experiments on its application, public transport timetables were collected from 48 European cities. Using the H3 spatial indexing method, they were divided into micro-regions. A method was also proposed to identify regions with similar characteristics of public transport offers. On its basis, a multi-level typology of public transport offers in the regions was defined. This thesis shows that the proposed representation method makes it possible to identify micro-regions with similar public transport characteristics between the cities, and can be used to evaluate the quality of public transport available in a city.


title: Orbit determination with the Keplerian integrals

abstract: We review two initial orbit determination methods for too short arcs (TSAs) of optical observations of a solar system body. These methods employ the conservation laws of Kepler's problem, and allow to attempt the linkage of TSAs referring to quite far epochs, differing by even more than one orbital period of the observed object. The first method ({\tt Link2}) concerns the linkage of 2 TSAs, and leads to a univariate polynomial equation of degree 9. An optimal property of this polynomial is proved using Gr\"obner bases theory. The second method ({\tt Link3}) is thought for the linkage of 3 TSAs, and leads to a univariate polynomial equation of degree 8. A numerical test is shown for both algorithms.


title: A homological characterization of $Q_0$-Pr\"{u}fer $v$-multiplication rings

abstract: Let $R$ be a commutative ring. An $R$-module $M$ is called a semi-regular $w$-flat module if $\Tor_1^R(R/I,M)$ is $\GV$-torsion for any finitely generated semi-regular ideal $I$. In this article, we show that the class of semi-regular $w$-flat modules is a covering class. Utilizing these notions, we give some homological characterizations of $\WQ$-rings and $Q_0$-\PvMR s.


title: Partial supervision for the FeTA challenge 2021

abstract: This paper describes our method for our participation in the FeTA challenge2021 (team name: TRABIT). The performance of convolutional neural networks for medical image segmentation is thought to correlate positively with the number of training data. The FeTA challenge does not restrict participants to using only the provided training data but also allows for using other publicly available sources. Yet, open access fetal brain data remains limited. An advantageous strategy could thus be to expand the training data to cover broader perinatal brain imaging sources. Perinatal brain MRIs, other than the FeTA challenge data, that are currently publicly available, span normal and pathological fetal atlases as well as neonatal scans. However, perinatal brain MRIs segmented in different datasets typically come with different annotation protocols. This makes it challenging to combine those datasets to train a deep neural network. We recently proposed a family of loss functions, the label-set loss functions, for partially supervised learning. Label-set loss functions allow to train deep neural networks with partially segmented images, i.e. segmentations in which some classes may be grouped into super-classes. We propose to use label-set loss functions to improve the segmentation performance of a state-of-the-art deep learning pipeline for multi-class fetal brain segmentation by merging several publicly available datasets. To promote generalisability, our approach does not introduce any additional hyper-parameters tuning.


title: Breast Cancer Classification Using: Pixel Interpolation

abstract: Image Processing represents the backbone research area within engineering and computer science specialization. It is promptly growing technologies today, and its applications founded in various aspects of biomedical fields especially in cancer disease. Breast cancer is considered the fatal one of all cancer types according to recent statistics all over the world. It is the most commonly cancer in women and the second reason of cancer death between females. About 23% of the total cancer cases in both developing and developed countries. In this work, an interpolation process was used to classify the breast cancer into main types, benign and malignant. This scheme dependent on the morphologic spectrum of mammographic masses. Malignant tumors had irregular shape percent higher than the benign tumors. By this way the boundary of the tumor will be interpolated by additional pixels to make the boundary smoothen as possible, these needed pixels is proportional with irregularity shape of the tumor, so that the increasing in interpolated pixels meaning the tumor goes toward the malignant case. The proposed system is implemented using MATLAB programming and tested over several images taken from the Mammogram Image Analysis Society (MIAS) image database. The MIAS offers a regular classification for mammographic studies. The system works faster so that any radiologist can take a clear decision about the appearance of calcifications by visual inspection.