title: Depinning in the quenched Kardar-Parisi-Zhang class II: Field theory

abstract: There are two main universality classes for depinning of elastic interfaces in disordered media: quenched Edwards-Wilkinson (qEW), and quenched Kardar-Parisi-Zhang (qKPZ). The first class is relevant as long as the elastic force between two neighboring sites on the interface is purely harmonic, and invariant under tilting. The second class applies when the elasticity is non-linear, or the surface grows preferentially in its normal direction. It encompasses fluid imbibition, the Tang-Leschorn cellular automaton of 1992 (TL92), depinning with anharmonic elasticity (aDep), and qKPZ. While the field theory is well developed for qEW, there is no consistent theory for qKPZ. The aim of this paper is to construct this field theory within the Functional renormalization group (FRG) framework, based on large-scale numerical simulations in dimensions $d=1$, $2$ and $3$, presented in a companion paper. In order to measure the effective force correlator and coupling constants, the driving force is derived from a confining potential with curvature $m^2$. We show, that contrary to common belief this is allowed in the presence of a KPZ term. The ensuing field theory becomes massive, and can no longer be Cole-Hopf transformed. In exchange, it possesses an IR attractive stable fixed point at a finite KPZ non-linearity $\lambda$. Since there is neither elasticity nor a KPZ term in dimension $d=0$, qEW and qKPZ merge there. As a result, the two universality classes are distinguished by terms linear in $d$. This allows us to build a consistent field theory in dimension $d=1$, which loses some of its predictive powers in higher dimensions.


title: Direct measurement of vorticity using tracer particles with internal markers

abstract: Current experiment techniques for vorticity measurement suffer from limited spatial and temporal resolution to resolve the small-scale eddy dynamics in turbulence. In this study, we develop a new method for direct vorticity measurement in fluid flows based on digital inline holography (DIH). The DIH system utilizes a collimated laser beam to illuminate the tracers with internal markers and a digital sensor to record the generated holograms. The tracers made of the polydimethylsiloxane (PDMS) prepolymer mixed with internal markers are fabricated using a standard microfluidic droplet generator. A rotation measurement algorithm is developed based on the 3D location reconstruction and tracking of the internal markers and is assessed through synthetic holograms to identify the optimal parameter settings and measurement range (e.g., rotation rate from 0.3 to 0.7 rad/frame under numerical aperture of imaging of 0.25). Our proposed method based on DIH is evaluated by a calibration experiment of single tracer rotation, which yields the same optimal measurement range. Using von K\'arm\'an swirling flow setup, we further demonstrate the capability of the approach to simultaneously measure the Lagrangian rotation and translation of multiple tracers. Our method can measure vorticity in a small region on the order of 100 ${\mu}$m or less and can be potentially used to quantify the Kolmogorov-scale vorticity field in turbulent flows.


title: GM2Calc-2 for the 2HDM

abstract: GM2Calc is a leading tool for calculating precise contributions to $a_\mu$ in the Minimal Supersymmetric Standard Model. In this proceeding we detail GM2Calc version 2 where it is extended so it can calculate two-loop contributions to $a_\mu$ in the Two-Higgs Doublet Model (2HDM), based on the work in Ref. [1]. The 2HDM is a simple model, yet it is one of the few single field extensions of the Standard Model which is able to explain the muon $g-2$ anomaly. We demonstrate the powerful and flexible 2HDM capabilities of GM2Calc2, which include the most precise contributions in the literature and allow the user to work in their favourite type of the 2HDM as well as use complex and lepton flavour violating couplings. With its multiple interfaces and input flexibility, GM2Calc2 is a powerful tool both as a standalone code and as part of a larger code toolchain.


title: Instantaneous tunneling of relativistic massive spin-0 particles

abstract: The tunneling time problem earlier studied in Phys. Rev. Lett 108 170402 (2012) using a non-relativistic time-of-arrival (TOA) operator predicted that tunneling time is instantaneous. This raises the question on whether instantaneous tunneling time is a consequence of using a non-relativistic theory. Here, we extend the analysis by proposing a formalism on the construction of relativistic TOA-operators for spin-0 particles in the presence of an interaction potential via quantization. We then construct the corresponding barrier traversal time operator and impose the condition that the barrier height is less than the rest mass energy of the particle. We show that only the above-barrier energy components of the incident wavepacket's momentum distribution contribute to the barrier traversal time while the below-barrier components are transmitted instantaneously.


title: Deep Near-Infrared Survey Toward the W40 and Serpens South Region in Aquila Rift: A Comprehensive Catalog of Young Stellar Objects

abstract: Active star forming regions are excellent laboratories for studying the origins and evolution of young stellar object (YSO) clustering. The W40 - Serpens South region is such a region, and we compile a super near-and-mid-infrared catalog of point sources in it, based on deep NIR observations of CFHT in combination with 2MASS, UKIDSS, and Spitzer catalogs. From this catalog, we identify 832 YSOs, and classify 15, 135, 647, and 35 of them to be the deeply embedded sources, Class I, Class II YSOs, and transition disk sources, respectively. In general, these YSOs are well correlated with the filamentary structures of molecular clouds, especially the deeply embedded sources and the Class I YSOs. The W40 central region is dominated by Class II YSOs, but in the Serpens South region, a half of the YSOs are Class I. We further generate a minimum spanning tree (MST) for all the YSOs. Around the W40 cluster, there are eight prominent MST branches that may trace vestigial molecular gas filaments that once fed gas to the central natal gas clump. Of the eight, only two now include detectable filamentary gas in Herschel data and corresponding Class I YSOs, while the other six are exclusively populated with Class II. Four MST branches overlap with the Serpens South main filament, and where they intersect, molecular gas "hubs" and more Class I YSOs are found. Our results imply a mixture of YSO distributions composed of both primordial and somewhat evolved YSOs in this star forming region.


title: Hierarchical Structure of YSO Clusters in the W40 and Serpens South Region: Group Extraction and Comparison with Fractal Clusters

abstract: Young stellar clusters are believed to inherit the spatial distribution like hierarchical structures of their natal molecular cloud during their formation. However, the change of the structures between the cloud and the young clusters is not well constrained observationally. We select the W40 - Serpens South region (~ 7 $\times$ 9 pc$^{2}$) of the Aquila Rift as a testbed and investigate hierarchical properties of spatial distribution of young stellar objects (YSOs) in this region. We develop a minimum spanning tree (MST)-based method to group stars into several levels by successively cutting down edges longer than an algorithmically determined critical value. A total of 832 YSOs are divided into 5 levels with 23 groups. For describing the hierarchical properties in a controlled way, we construct a set of synthetic source distributions at various fractal dimensions, and apply the same method to explore their group characters. By comparing the $Q$ parameter and the surface density profiles of the observed and the synthetic data, we find that the YSO observation matches spatial patterns from multi-fractal dimensions. In the periphery region where the molecular clouds are more diffuse, the YSO structure is close to a fractal dimension of 2.0, while in the core regions the fractal dimensions are close to 1.6 and 1.4 for the W40 and the Serpens South regions, respectively. Therefore, the YSOs may inherit the fractal pattern of the dense part of the molecular clouds, but such pattern dissipates slowly in several Myr.


title: Infinite dimensional symplectic capacity and nonsqueezing property for the Zakharov system on the $1$-dimensional torus

abstract: We prove the invariant of the symplectic capacity for the Zakharov system on a torus. If the Zakharov solution map is well-defined, then it can be regarded as a symplectomorphism. Thus, we first show the global well-posedness via the local well-posedness and the conservation law. The invariant of the symplectic capacity can be obtained using an approximation method. Many authors use an approximation method to obtain the nonsqueezing theorem, instead of an invariant of the symplectic capacity. However, the conditions of the Hamiltonian system introduced by Kuksin can be relaxed by a new modified infinite dimensional Hamiltonian system. Thus we can back to the symplectic capacity which contains the nonsqueezing property. Heuristically, we obtain the invariant by using the Hamiltonian system which has linear flow at high frequencies and nonlinear flow at low frequencies.


title: Effects of different tumors on the steady-state heat distribution in the human eye using the 3D finite element method

abstract: In this paper, a three-dimensional finite element method is developed to simulate the heat distribution in the human eye with different types of tumors to understand the effect of tumors on heat distribution in the human eye. The human eye is modeled as a composition of several homogeneous regions and the physical and thermal properties of each region used in this study are more accurate than the models used in previous studies. By considering the exact and complicated geometry of all parts, the finite element method is a proper solution for solving the heat equation inside the human eye. There are two kinds of boundary conditions called the radiation condition and the Robin condition. The radiation boundary condition is modeled as a Robin boundary condition. For modeling eye tumors and their effect on heat distribution, we need information about eye tumor properties such as heat conductivity, density, specific heat, and so on. Thanks to no accurate reported information about eye tumor properties, the properties of other types of tumors such as skin, and bowel tumors are used. Simulation results with different parameters of eye tumors show the effect of eye tumors on heat distribution in the human eye.


title: ML-BPM: Multi-teacher Learning with Bidirectional Photometric Mixing for Open Compound Domain Adaptation in Semantic Segmentation

abstract: Open compound domain adaptation (OCDA) considers the target domain as the compound of multiple unknown homogeneous subdomains. The goal of OCDA is to minimize the domain gap between the labeled source domain and the unlabeled compound target domain, which benefits the model generalization to the unseen domains. Current OCDA for semantic segmentation methods adopt manual domain separation and employ a single model to simultaneously adapt to all the target subdomains. However, adapting to a target subdomain might hinder the model from adapting to other dissimilar target subdomains, which leads to limited performance. In this work, we introduce a multi-teacher framework with bidirectional photometric mixing to separately adapt to every target subdomain. First, we present an automatic domain separation to find the optimal number of subdomains. On this basis, we propose a multi-teacher framework in which each teacher model uses bidirectional photometric mixing to adapt to one target subdomain. Furthermore, we conduct an adaptive distillation to learn a student model and apply consistency regularization to improve the student generalization. Experimental results on benchmark datasets show the efficacy of the proposed approach for both the compound domain and the open domains against existing state-of-the-art approaches.


title: Dynamic Prototype Mask for Occluded Person Re-Identification

abstract: Although person re-identification has achieved an impressive improvement in recent years, the common occlusion case caused by different obstacles is still an unsettled issue in real application scenarios. Existing methods mainly address this issue by employing body clues provided by an extra network to distinguish the visible part. Nevertheless, the inevitable domain gap between the assistant model and the ReID datasets has highly increased the difficulty to obtain an effective and efficient model. To escape from the extra pre-trained networks and achieve an automatic alignment in an end-to-end trainable network, we propose a novel Dynamic Prototype Mask (DPM) based on two self-evident prior knowledge. Specifically, we first devise a Hierarchical Mask Generator which utilizes the hierarchical semantic to select the visible pattern space between the high-quality holistic prototype and the feature representation of the occluded input image. Under this condition, the occluded representation could be well aligned in a selected subspace spontaneously. Then, to enrich the feature representation of the high-quality holistic prototype and provide a more complete feature space, we introduce a Head Enrich Module to encourage different heads to aggregate different patterns representation in the whole image. Extensive experimental evaluations conducted on occluded and holistic person re-identification benchmarks demonstrate the superior performance of the DPM over the state-of-the-art methods. The code is released at https://github.com/stone96123/DPM.


title: Lateral predictive coding revisited: Internal model, symmetry breaking, and response time

abstract: Predictive coding is a promising theoretical framework in neuroscience for understanding information transmission and perception. It posits that the brain perceives the external world through internal models and updates these models under the guidance of prediction errors. Previous studies on predictive coding emphasized top-down feedback interactions in hierarchical multi-layered networks but largely ignored lateral recurrent interactions. We perform analytical and numerical investigations in this work on the effects of single-layer lateral interactions. We consider a simple predictive response dynamics and run it on the MNIST dataset of hand-written digits. We find that learning will generally break the interaction symmetry between peer neurons, and that high input correlation between two neurons does not necessarily bring strong direct interactions between them. The optimized network responds to familiar input signals much faster than to novel or random inputs, and it significantly reduces the correlations between the output states of pairs of neurons.


title: TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolation

abstract: Video frame interpolation (VFI) aims to synthesize an intermediate frame between two consecutive frames. State-of-the-art approaches usually adopt a two-step solution, which includes 1) generating locally-warped pixels by flow-based motion estimations, 2) blending the warped pixels to form a full frame through deep neural synthesis networks. However, due to the inconsistent warping from the two consecutive frames, the warped features for new frames are usually not aligned, which leads to distorted and blurred frames, especially when large and complex motions occur. To solve this issue, in this paper we propose a novel Trajectory-aware Transformer for Video Frame Interpolation (TTVFI). In particular, we formulate the warped features with inconsistent motions as query tokens, and formulate relevant regions in a motion trajectory from two original consecutive frames into keys and values. Self-attention is learned on relevant tokens along the trajectory to blend the pristine features into intermediate frames through end-to-end training. Experimental results demonstrate that our method outperforms other state-of-the-art methods in four widely-used VFI benchmarks. Both code and pre-trained models will be released soon.


title: RepBNN: towards a precise Binary Neural Network with Enhanced Feature Map via Repeating

abstract: Binary neural network (BNN) is an extreme quantization version of convolutional neural networks (CNNs) with all features and weights mapped to just 1-bit. Although BNN saves a lot of memory and computation demand to make CNN applicable on edge or mobile devices, BNN suffers the drop of network performance due to the reduced representation capability after binarization. In this paper, we propose a new replaceable and easy-to-use convolution module RepConv, which enhances feature maps through replicating input or output along channel dimension by $\beta$ times without extra cost on the number of parameters and convolutional computation. We also define a set of RepTran rules to use RepConv throughout BNN modules like binary convolution, fully connected layer and batch normalization. Experiments demonstrate that after the RepTran transformation, a set of highly cited BNNs have achieved universally better performance than the original BNN versions. For example, the Top-1 accuracy of Rep-ReCU-ResNet-20, i.e., a RepBconv enhanced ReCU-ResNet-20, reaches 88.97% on CIFAR-10, which is 1.47% higher than that of the original network. And Rep-AdamBNN-ReActNet-A achieves 71.342% Top-1 accuracy on ImageNet, a fresh state-of-the-art result of BNNs. Code and models are available at:https://github.com/imfinethanks/Rep_AdamBNN.


title: Don't Forget to Buy Milk: Contextually Aware Grocery Reminder Household Robot

abstract: Assistive robots operating in household environments would require items to be available in the house to perform assistive tasks. However, when these items run out, the assistive robot must remind its user to buy the missing items. In this paper, we present a computational architecture that can allow a robot to learn personalized contextual knowledge of a household through interactions with its user. The architecture can then use the learned knowledge to make predictions about missing items from the household over a long period of time. The architecture integrates state-of-the-art perceptual learning algorithms, cognitive models of memory encoding and learning, a reasoning module for predicting missing items from the household, and a graphical user interface (GUI) to interact with the user. The architecture is integrated with the Fetch mobile manipulator robot and validated in a large indoor environment with multiple contexts and objects. Our experimental results show that the robot can adapt to an environment by learning contextual knowledge through interactions with its user. The robot can also use the learned knowledge to correctly predict missing items over multiple weeks and it is robust against sensory and perceptual errors.


title: HICF: Hyperbolic Informative Collaborative Filtering

abstract: Considering the prevalence of the power-law distribution in user-item networks, hyperbolic space has attracted considerable attention and achieved impressive performance in the recommender system recently. The advantage of hyperbolic recommendation lies in that its exponentially increasing capacity is well-suited to describe the power-law distributed user-item network whereas the Euclidean equivalent is deficient. Nonetheless, it remains unclear which kinds of items can be effectively recommended by the hyperbolic model and which cannot. To address the above concerns, we take the most basic recommendation technique, collaborative filtering, as a medium, to investigate the behaviors of hyperbolic and Euclidean recommendation models. The results reveal that (1) tail items get more emphasis in hyperbolic space than that in Euclidean space, but there is still ample room for improvement; (2) head items receive modest attention in hyperbolic space, which could be considerably improved; (3) and nonetheless, the hyperbolic models show more competitive performance than Euclidean models. Driven by the above observations, we design a novel learning method, named hyperbolic informative collaborative filtering (HICF), aiming to compensate for the recommendation effectiveness of the head item while at the same time improving the performance of the tail item. The main idea is to adapt the hyperbolic margin ranking learning, making its pull and push procedure geometric-aware, and providing informative guidance for the learning of both head and tail items. Extensive experiments back up the analytic findings and also show the effectiveness of the proposed method. The work is valuable for personalized recommendations since it reveals that the hyperbolic space facilitates modeling the tail item, which often represents user-customized preferences or new products.


title: Balanced Contrastive Learning for Long-Tailed Visual Recognition

abstract: Real-world data typically follow a long-tailed distribution, where a few majority categories occupy most of the data while most minority categories contain a limited number of samples. Classification models minimizing cross-entropy struggle to represent and classify the tail classes. Although the problem of learning unbiased classifiers has been well studied, methods for representing imbalanced data are under-explored. In this paper, we focus on representation learning for imbalanced data. Recently, supervised contrastive learning has shown promising performance on balanced data recently. However, through our theoretical analysis, we find that for long-tailed data, it fails to form a regular simplex which is an ideal geometric configuration for representation learning. To correct the optimization behavior of SCL and further improve the performance of long-tailed visual recognition, we propose a novel loss for balanced contrastive learning (BCL). Compared with SCL, we have two improvements in BCL: class-averaging, which balances the gradient contribution of negative classes; class-complement, which allows all classes to appear in every mini-batch. The proposed balanced contrastive learning (BCL) method satisfies the condition of forming a regular simplex and assists the optimization of cross-entropy. Equipped with BCL, the proposed two-branch framework can obtain a stronger feature representation and achieve competitive performance on long-tailed benchmark datasets such as CIFAR-10-LT, CIFAR-100-LT, ImageNet-LT, and iNaturalist2018. Our code is available at https://github.com/FlamieZhu/BCL .


title: On $k$-layered numbers

abstract: A positive integer $n$ is said to be $k$-layered if its divisors can be partitioned into $k$ sets with equal sum. In this paper, we start the systematic study of these class of numbers. In particular, we state some algorithms to find some even $k$-layered numbers $n$ such that $2^{\alpha}n$ is a $k$-layered number for every positive integer $\alpha$. We also find the smallest $k$-layered number for $1\leq k\leq 8$. Furthermore, we study when $n!$ is a $3$-layered and when is a $4$-layered number. Moreover, we classify all $4$-layered numbers of the form $n=p^{\alpha}q^{\beta}rt$, where $\alpha$, $1\leq \beta\leq 3$, $p$, $q$, $r$, and $t$ are two positive integers and four primes, respectively. In addition, in this paper, some other results concerning these numbers and their relationship with $k$-multiperfect numbers, near-perfect numbers, and superabundant numbers are discussed. Also, we find an upper bound for the differences of two consecutive $k$-layered numbers for every positive integer $1\leq k\leq 5$. Finally, by assuming the smallest $k$-layered number, we find an upper bound for the difference of two consecutive $k$-layered numbers.


title: Towards a Low-SWaP 1024-beam Digital Array: A 32-beam Sub-system at 5.8 GHz

abstract: Millimeter wave communications require multibeam beamforming in order to utilize wireless channels that suffer from obstructions, path loss, and multi-path effects. Digital multibeam beamforming has maximum degrees of freedom compared to analog phased arrays. However, circuit complexity and power consumption are important constraints for digital multibeam systems. A low-complexity digital computing architecture is proposed for a multiplication-free 32-point linear transform that approximates multiple simultaneous RF beams similar to a discrete Fourier transform (DFT). Arithmetic complexity due to multiplication is reduced from the FFT complexity of $\mathcal{O}(N\: \log N)$ for DFT realizations, down to zero, thus yielding a 46% and 55% reduction in chip area and dynamic power consumption, respectively, for the $N=32$ case considered. The paper describes the proposed 32-point DFT approximation targeting a 1024-beams using a 2D array, and shows the multiplierless approximation and its mapping to a 32-beam sub-system consisting of 5.8 GHz antennas that can be used for generating 1024 digital beams without multiplications. Real-time beam computation is achieved using a Xilinx FPGA at 120 MHz bandwidth per beam. Theoretical beam performance is compared with measured RF patterns from both a fixed-point FFT as well as the proposed multiplier-free algorithm and are in good agreement.

categories: eess.SP cs.NA cs.SY eess.SY math.NA stat.ME


title: Box-supervised Instance Segmentation with Level Set Evolution

abstract: In contrast to the fully supervised methods using pixel-wise mask labels, box-supervised instance segmentation takes advantage of the simple box annotations, which has recently attracted a lot of research attentions. In this paper, we propose a novel single-shot box-supervised instance segmentation approach, which integrates the classical level set model with deep neural network delicately. Specifically, our proposed method iteratively learns a series of level sets through a continuous Chan-Vese energy-based function in an end-to-end fashion. A simple mask supervised SOLOv2 model is adapted to predict the instance-aware mask map as the level set for each instance. Both the input image and its deep features are employed as the input data to evolve the level set curves, where a box projection function is employed to obtain the initial boundary. By minimizing the fully differentiable energy function, the level set for each instance is iteratively optimized within its corresponding bounding box annotation. The experimental results on four challenging benchmarks demonstrate the leading performance of our proposed approach to robust instance segmentation in various scenarios. The code is available at: https://github.com/LiWentomng/boxlevelset.


title: Learning quantum dissipation by the neural ordinary differential equation

abstract: Quantum dissipation arises from the unavoidable coupling between a quantum system and its surrounding environment, which is known as a major obstacle in the quantum processing of information. Apart from its existence, how to trace the dissipation from observational data is a crucial topic that may stimulate manners to suppress the dissipation. In this paper, we propose to learn the quantum dissipation from dynamical observations using the neural ordinary differential equation, and then demonstrate this method concretely on two open quantum-spin systems -- a large spin system and a spin-1/2 chain. We also investigate the learning efficiency of the dataset, which provides useful guidance for data acquisition in experiments. Our work promisingly facilitates effective modeling and decoherence suppression in open quantum systems.

categories: quant-ph cond-mat.dis-nn cond-mat.quant-gas cond-mat.str-el


title: An Intelligent Trust Cloud Management Method for Secure Clustering in 5G enabled Internet of Medical Things

abstract: 5G edge computing enabled Internet of Medical Things (IoMT) is an efficient technology to provide decentralized medical services while Device-to-device (D2D) communication is a promising paradigm for future 5G networks. To assure secure and reliable communication in 5G edge computing and D2D enabled IoMT systems, this paper presents an intelligent trust cloud management method. Firstly, an active training mechanism is proposed to construct the standard trust clouds. Secondly, individual trust clouds of the IoMT devices can be established through fuzzy trust inferring and recommending. Thirdly, a trust classification scheme is proposed to determine whether an IoMT device is malicious. Finally, a trust cloud update mechanism is presented to make the proposed trust management method adaptive and intelligent under an open wireless medium. Simulation results demonstrate that the proposed method can effectively address the trust uncertainty issue and improve the detection accuracy of malicious devices.


title: Proceedings of the Second Workshop on Agents and Robots for reliable Engineered Autonomy

abstract: This volume contains the proceedings of the Second Workshop on Agents and Robots for reliable Engineered Autonomy (AREA 2022), co-located with the 31st International Joint Conference on Artificial Intelligence and the 25th European Conference on Artificial Intelligence (IJCAI-ECAI 2022). The AREA workshop brings together researchers from autonomous agents, software engineering and robotic communities, as combining knowledge coming from these research areas may lead to innovative approaches that solve complex problems related with the verification and validation of autonomous robotic systems.


title: Few-shot Open-set Recognition Using Background as Unknowns

abstract: Few-shot open-set recognition aims to classify both seen and novel images given only limited training data of seen classes. The challenge of this task is that the model is required not only to learn a discriminative classifier to classify the pre-defined classes with few training data but also to reject inputs from unseen classes that never appear at training time. In this paper, we propose to solve the problem from two novel aspects. First, instead of learning the decision boundaries between seen classes, as is done in standard close-set classification, we reserve space for unseen classes, such that images located in these areas are recognized as the unseen classes. Second, to effectively learn such decision boundaries, we propose to utilize the background features from seen classes. As these background regions do not significantly contribute to the decision of close-set classification, it is natural to use them as the pseudo unseen classes for classifier learning. Our extensive experiments show that our proposed method not only outperforms multiple baselines but also sets new state-of-the-art results on three popular benchmarks, namely tieredImageNet, miniImageNet, and Caltech-USCD Birds-200-2011 (CUB).


title: Data Science and Machine Learning in Education

abstract: The growing role of data science (DS) and machine learning (ML) in high-energy physics (HEP) is well established and pertinent given the complex detectors, large data, sets and sophisticated analyses at the heart of HEP research. Moreover, exploiting symmetries inherent in physics data have inspired physics-informed ML as a vibrant sub-field of computer science research. HEP researchers benefit greatly from materials widely available materials for use in education, training and workforce development. They are also contributing to these materials and providing software to DS/ML-related fields. Increasingly, physics departments are offering courses at the intersection of DS, ML and physics, often using curricula developed by HEP researchers and involving open software and data used in HEP. In this white paper, we explore synergies between HEP research and DS/ML education, discuss opportunities and challenges at this intersection, and propose community activities that will be mutually beneficial.

categories: physics.ed-ph cs.LG hep-ex physics.comp-ph


title: A-SFS: Semi-supervised Feature Selection based on Multi-task Self-supervision

abstract: Feature selection is an important process in machine learning. It builds an interpretable and robust model by selecting the features that contribute the most to the prediction target. However, most mature feature selection algorithms, including supervised and semi-supervised, fail to fully exploit the complex potential structure between features. We believe that these structures are very important for the feature selection process, especially when labels are lacking and data is noisy. To this end, we innovatively introduce a deep learning-based self-supervised mechanism into feature selection problems, namely batch-Attention-based Self-supervision Feature Selection(A-SFS). Firstly, a multi-task self-supervised autoencoder is designed to uncover the hidden structure among features with the support of two pretext tasks. Guided by the integrated information from the multi-self-supervised learning model, a batch-attention mechanism is designed to generate feature weights according to batch-based feature selection patterns to alleviate the impacts introduced by a handful of noisy data. This method is compared to 14 major strong benchmarks, including LightGBM and XGBoost. Experimental results show that A-SFS achieves the highest accuracy in most datasets. Furthermore, this design significantly reduces the reliance on labels, with only 1/10 labeled data needed to achieve the same performance as those state of art baselines. Results show that A-SFS is also most robust to the noisy and missing data.


title: On Isometric Embeddability of $S_q^m$ into $S_p^n$ as non-commutative Quasi-Banach space

abstract: The existence of isometric embedding of $S_q^m$ into $S_p^n$, where $1\leq p\neq q\leq \infty$ and $m,n\geq 2$ has been recently studied in \cite{JFA22}. In this article, we extend the study of isometric embeddability beyond the above mentioned range of $p$ and $q$. More precisely, we show that there is no isometric embedding of the commutative quasi-Banach space $\ell_q^m(\R)$ into $\ell_p^n(\R)$, where $(q,p)\in (0,\infty)\times (0,1)$ and $p\neq q$. As non-commutative quasi-Banach spaces, we show that there is no isometric embedding of $S_q^m$ into $S_p^n$, where $(q,p)\in (0,2)\setminus \{1\}\times (0,1)$ $\cup\, \{1\}\times (0,1)\setminus \{\frac{1}{n}:n\in\mathbb{N}\}$ $\cup\, \{\infty\}\times (0,1)\setminus \{\frac{1}{n}:n\in\mathbb{N}\}$ and $p\neq q$. Moreover, in some restrictive cases, we also show that there is no isometric embedding of $S_q^m$ into $S_p^n$, where $(q,p)\in [2, \infty)\times (0,1)$. A new tool in our paper is the non-commutative Clarkson's inequality for Schatten class operators. Other tools involved are the Kato-Rellich theorem and multiple operator integrals in perturbation theory, followed by intricate computations involving power-series analysis.


title: Algorithms for the Euclidean Bipartite Edge Cover Problem

abstract: Given a graph $G=(V,E)$ with costs on its edges, the minimum-cost edge cover problem consists of finding a subset of $E$ covering all vertices in $V$ at minimum cost. If $G$ is bipartite, this problem can be solved in time $O(|V|^3)$ via a well-known reduction to a maximum-cost matching problem on $G$. If in addition $V$ is a set of points on the Euclidean line, Collanino et al. showed that the problem can be solved in time $O(|V| \log |V|)$ and asked whether it can be solved in time $o(|V|^3)$ if $V$ is a set of points on the Euclidean plane. We answer this in the affirmative, giving an $O(|V|^{2.5} \log |V|)$ algorithm based on the Hungarian method using weighted Voronoi diagrams. We also propose some 2-approximation algorithms and give experimental results of our implementations.


title: Kodaira-type Vanishings via Non-abelian Hodge Theory

abstract: In this paper, we use non-abelian Hodge Theory to study Kodaira type vanishings and its generalizations. In particular, we generalize Saito vanishing using Mixed Twistor D-modules. We also generalize it to a Kawamata-Viehweg type vanishing using Q-divisors, and we also prove a relative version for a projective morphism.


title: Automated Black-Box Boundary Value Detection

abstract: The input domain of software systems can typically be divided into sub-domains for which the outputs are similar. To ensure high quality it is critical to test the software on the boundaries between these sub-domains. Consequently, boundary value analysis and testing has been part of the toolbox of software testers for long and is typically taught early to students. However, despite its many argued benefits, boundary value analysis for a given specification or piece of software is typically described in abstract terms which allow for variation in how testers apply it. Here we propose an automated, black-box boundary value detection method to support software testers in systematic boundary value analysis with consistent results. The method builds on a metric to quantify the level of boundariness of test inputs: the program derivative. By coupling it with search algorithms we find and rank pairs of inputs as good boundary candidates, i.e. inputs close together but with outputs far apart. We implement our AutoBVA approach and evaluate it on a curated dataset of example programs. Our results indicate that even with a simple and generic program derivative variant in combination with broad sampling over the input space, interesting boundary candidates can be identified.


title: Moment Centralization based Gradient Descent Optimizers for Convolutional Neural Networks

abstract: Convolutional neural networks (CNNs) have shown very appealing performance for many computer vision applications. The training of CNNs is generally performed using stochastic gradient descent (SGD) based optimization techniques. The adaptive momentum-based SGD optimizers are the recent trends. However, the existing optimizers are not able to maintain a zero mean in the first-order moment and struggle with optimization. In this paper, we propose a moment centralization-based SGD optimizer for CNNs. Specifically, we impose the zero mean constraints on the first-order moment explicitly. The proposed moment centralization is generic in nature and can be integrated with any of the existing adaptive momentum-based optimizers. The proposed idea is tested with three state-of-the-art optimization techniques, including Adam, Radam, and Adabelief on benchmark CIFAR10, CIFAR100, and TinyImageNet datasets for image classification. The performance of the existing optimizers is generally improved when integrated with the proposed moment centralization. Further, The results of the proposed moment centralization are also better than the existing gradient centralization. The analytical analysis using the toy example shows that the proposed method leads to a shorter and smoother optimization trajectory. The source code is made publicly available at \url{https://github.com/sumanthsadhu/MC-optimizer}.


title: Time Is MattEr: Temporal Self-supervision for Video Transformers

abstract: Understanding temporal dynamics of video is an essential aspect of learning better video representations. Recently, transformer-based architectural designs have been extensively explored for video tasks due to their capability to capture long-term dependency of input sequences. However, we found that these Video Transformers are still biased to learn spatial dynamics rather than temporal ones, and debiasing the spurious correlation is critical for their performance. Based on the observations, we design simple yet effective self-supervised tasks for video models to learn temporal dynamics better. Specifically, for debiasing the spatial bias, our method learns the temporal order of video frames as extra self-supervision and enforces the randomly shuffled frames to have low-confidence outputs. Also, our method learns the temporal flow direction of video tokens among consecutive frames for enhancing the correlation toward temporal dynamics. Under various video action recognition tasks, we demonstrate the effectiveness of our method and its compatibility with state-of-the-art Video Transformers.


title: PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search

abstract: While contextualized word embeddings have been a de-facto standard, learning contextualized phrase embeddings is less explored and being hindered by the lack of a human-annotated benchmark that tests machine understanding of phrase semantics given a context sentence or paragraph (instead of phrases alone). To fill this gap, we propose PiC -- a dataset of ~28K of noun phrases accompanied by their contextual Wikipedia pages and a suite of three tasks for training and evaluating phrase embeddings. Training on PiC improves ranking models' accuracy and remarkably pushes span-selection (SS) models (i.e., predicting the start and end index of the target phrase) near-human accuracy, which is 95% Exact Match (EM) on semantic search given a query phrase and a passage. Interestingly, we find evidence that such impressive performance is because the SS models learn to better capture the common meaning of a phrase regardless of its actual context. SotA models perform poorly in distinguishing two senses of the same phrase in two contexts (~60% EM) and in estimating the similarity between two different phrases in the same context (~70% EM).


title: Correcting for Measurement Error in Segmented Cox Model

abstract: Measurement error in the covariate of main interest (e.g. the exposure variable, or the risk factor) is common in epidemiologic and health studies. It can effect the relative risk estimator or other types of coefficients derived from the fitted regression model. In order to perform a measurement error analysis, one needs information about the error structure. Two sources of validation data are an internal subset of the main data, and external or independent study. For the both sources, the true covariate is measured (that is, without error), or alternatively, its surrogate, which is error-prone covariate, is measured several times (repeated measures). This paper compares the precision in estimation via the different validation sources in the Cox model with a changepoint in the main covariate, using the bias correction methods RC and RR. The theoretical properties under each validation source is presented. In a simulation study it is found that the best validation source in terms of smaller mean square error and narrower confidence interval is the internal validation with measure of the true covariate in a common disease case, and the external validation with repeated measures of the surrogate for a rare disease case. In addition, it is found that addressing the correlation between the true covariate and its surrogate, and the value of the changepoint, is needed, especially in the rare disease case.


title: Context Unaware Knowledge Distillation for Image Retrieval

abstract: Existing data-dependent hashing methods use large backbone networks with millions of parameters and are computationally complex. Existing knowledge distillation methods use logits and other features of the deep (teacher) model and as knowledge for the compact (student) model, which requires the teacher's network to be fine-tuned on the context in parallel with the student model on the context. Training teacher on the target context requires more time and computational resources. In this paper, we propose context unaware knowledge distillation that uses the knowledge of the teacher model without fine-tuning it on the target context. We also propose a new efficient student model architecture for knowledge distillation. The proposed approach follows a two-step process. The first step involves pre-training the student model with the help of context unaware knowledge distillation from the teacher model. The second step involves fine-tuning the student model on the context of image retrieval. In order to show the efficacy of the proposed approach, we compare the retrieval results, no. of parameters and no. of operations of the student models with the teacher models under different retrieval frameworks, including deep cauchy hashing (DCH) and central similarity quantization (CSQ). The experimental results confirm that the proposed approach provides a promising trade-off between the retrieval results and efficiency. The code used in this paper is released publicly at \url{https://github.com/satoru2001/CUKDFIR}.


title: Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks

abstract: Meta reinforcement learning (meta-RL) aims to learn a policy solving a set of training tasks simultaneously and quickly adapting to new tasks. It requires massive amounts of data drawn from training tasks to infer the common structure shared among tasks. Without heavy reward engineering, the sparse rewards in long-horizon tasks exacerbate the problem of sample efficiency in meta-RL. Another challenge in meta-RL is the discrepancy of difficulty level among tasks, which might cause one easy task dominating learning of the shared policy and thus preclude policy adaptation to new tasks. This work introduces a novel objective function to learn an action translator among training tasks. We theoretically verify that the value of the transferred policy with the action translator can be close to the value of the source policy and our objective function (approximately) upper bounds the value difference. We propose to combine the action translator with context-based meta-RL algorithms for better data collection and more efficient exploration during meta-training. Our approach empirically improves the sample efficiency and performance of meta-RL algorithms on sparse-reward tasks.


title: Classification of cosmic structures for galaxies with deep learning: connecting cosmological simulations with observations

abstract: We explore the capability of deep learning to classify cosmic structures. In cosmological simulations, cosmic volumes are segmented into voids, sheets, filaments and knots, according to the distribution and kinematics of dark matter (DM), and galaxies are also classified according to the segmentation. However, observational studies cannot adopt this classification method using DM. In this study, we demonstrate that deep learning can bridge the gap between simulations and observations. Our models are based on three-dimensional convolutional neural networks and trained with data of the distribution of galaxies in a simulation to deduce the structure classes from the galaxies rather than DM. Our model can predict the class labels as accurate as a previous study using DM distribution for the training and prediction. This means that galaxy distribution can be a substitution for DM for the cosmic-structure classification, and our models using galaxies can be directly applied to wide-field survey observations. When observational restrictions are ignored, our model can classify simulated galaxies into the four classes with an accuracy (macro-averaged $F_{\rm 1}$-score) of 64 per cent. If restrictions such as limiting magnitude are considered, our model can classify SDSS galaxies at $\sim100~{\rm Mpc}$ with an accuracy of 60 per cent. In the binary classification distinguishing void galaxies from the others, our model can achieve an accuracy of 88 per cent.


title: Viscoelasticity of suspension of red blood cells under oscillatory shear flow

abstract: We present a numerical analysis of the rheology of a suspension of red blood cells (RBCs) for different volume fractions in a wall-bounded, effectively inertialess, small amplitude oscillatory shear (SAOS) flow for a wide range of applied frequencies. The RBCs are modeled as biconcave capsules, whose membrane is an isotropic and hyperelastic material following the Skalak constitutive law. The frequency-dependent viscoelasticity in the bulk suspension is quantified by the complex viscosity, defined by the amplitude of the particle shear stress and the phase difference between the stress and shear. SAOS flow basically impedes the deformation of individual RBCs as well as the magnitude of fluid-membrane interactions, resulting in a lower specific viscosity and first and second normal stress differences than in steady shear flow. Although it is known that the RBC deformation alone is sufficient to give rise to shear-thinning, our results show that the complex viscosity weakly depends on the frequency-modulated deformations or orientations of individual RBCs, but rather depends on combinations of the frequency-dependent amplitude and phase difference. The effect of the viscosity ratio between the cytoplasm and plasma and of the capillary number are also assessed.


title: Incremental Task Learning with Incremental Rank Updates

abstract: Incremental Task learning (ITL) is a category of continual learning that seeks to train a single network for multiple tasks (one after another), where training data for each task is only available during the training of that task. Neural networks tend to forget older tasks when they are trained for the newer tasks; this property is often known as catastrophic forgetting. To address this issue, ITL methods use episodic memory, parameter regularization, masking and pruning, or extensible network structures. In this paper, we propose a new incremental task learning framework based on low-rank factorization. In particular, we represent the network weights for each layer as a linear combination of several rank-1 matrices. To update the network for a new task, we learn a rank-1 (or low-rank) matrix and add that to the weights of every layer. We also introduce an additional selector vector that assigns different weights to the low-rank matrices learned for the previous tasks. We show that our approach performs better than the current state-of-the-art methods in terms of accuracy and forgetting. Our method also offers better memory efficiency compared to episodic memory- and mask-based approaches. Our code will be available at https://github.com/CSIPlab/task-increment-rank-update.git


title: Field-orientation dependence of quantum phase transitions in the S=1/2 triangular-lattice antiferromagnet Ba$_3$CoSb$_2$O$_9$

abstract: Ba$_3$CoSb$_2$O$_9$ approximates the two-dimensional spin-1/2 triangular-lattice Heisenberg antiferromagnet. This compound displays magnetic-field-induced quantum phase transitions, including the 1/3-magnetization-plateau, but its magnetization processes for the magnetic field $H$ parallel and perpendicular to the $c$ axis are different due to the weak easy-plane anisotropy and the weak interlayer antiferromagnetic exchange interaction. To elucidate how the quantum phase transitions change between these two field directions, we measured the field-angle dependence of the magnetization process in Ba$_3$CoSb$_2$O$_9$ using pulsed high magnetic fields. We compared obtained magnetic field-field angle phase diagram with those obtained by the large-size cluster mean-field method combined with a scaling scheme and the semiclassical theory. We also found a narrow 1/3-magnetization plateau and a high-field transition with a small magnetization jump for $H\,{\parallel}\,c$, not observed in the previous studies.


title: Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluation

abstract: Some Transformer-based models can perform cross-lingual transfer learning: those models can be trained on a specific task in one language and give relatively good results on the same task in another language, despite having been pre-trained on monolingual tasks only. But, there is no consensus yet on whether those transformer-based models learn universal patterns across languages. We propose a word-level task-agnostic method to evaluate the alignment of contextualized representations built by such models. We show that our method provides more accurate translated word pairs than previous methods to evaluate word-level alignment. And our results show that some inner layers of multilingual Transformer-based models outperform other explicitly aligned representations, and even more so according to a stricter definition of multilingual alignment.


title: Discrete time crystal made of topological edge magnons

abstract: We report the emergence of time-crystalline behavior in the \pi-Berry phase protected edge states of a Heisenberg ferromagnet in the presence of an external driving field. The magnon amplification due to the external field spontaneously breaks the discrete time-translational symmetry, resulting in a discrete time crystal with a period that is twice that of the applied EM field. We discuss the nature and symmetry protection of the time crystalline edge states and their stability against various perturbations that are expected in real quantum magnets. We propose an experimental signature to unambiguously detect the time crystalline behavior and identify two recently discovered quasi-2D magnets as potential hosts. We present a first-of-its-kind realization of time crystals at topological edge states, which can be generalized and extrapolated to other bosonic quasi-particle systems that exhibit parametric pumping and topological edge states.


title: ILASR: Privacy-Preserving Incremental Learning for Automatic Speech Recognition at Production Scale

abstract: Incremental learning is one paradigm to enable model building and updating at scale with streaming data. For end-to-end automatic speech recognition (ASR) tasks, the absence of human annotated labels along with the need for privacy preserving policies for model building makes it a daunting challenge. Motivated by these challenges, in this paper we use a cloud based framework for production systems to demonstrate insights from privacy preserving incremental learning for automatic speech recognition (ILASR). By privacy preserving, we mean, usage of ephemeral data which are not human annotated. This system is a step forward for production levelASR models for incremental/continual learning that offers near real-time test-bed for experimentation in the cloud for end-to-end ASR, while adhering to privacy-preserving policies. We show that the proposed system can improve the production models significantly(3%) over a new time period of six months even in the absence of human annotated labels with varying levels of weak supervision and large batch sizes in incremental learning. This improvement is 20% over test sets with new words and phrases in the new time period. We demonstrate the effectiveness of model building in a privacy-preserving incremental fashion for ASR while further exploring the utility of having an effective teacher model and use of large batch sizes.


title: Interacting Dark Energy: New parametrization and observational constraints

abstract: We have re-investigated Cosmology involving interaction between Dark matter and Dark Energy in the light of a new parametrization. The new parametrization is based on the hypothesis that when Dark matter and Dark Energy will interact, Dark matter will dilute in a different manner than standard non-interacting scenario. We re-built the Cosmological equations with this new parametrization. Observational constraints on the traditional Cosmological parameters and new parameters has also been obtained by using supernova data from Pantheon and Hubble data. The parameter values obtained are $H_0$ = 69.023 $\pm$ 0.722, $M$ = -19.385 $\pm$ 0.019, $I$ = 2.901 $\pm$ 0.092 and $\Omega_{dm0}(1 - \frac{3}{I})\frac{1}{\kappa}$ = 0.254 $\pm$ 0.023 where $H_0$, $M$, $\Omega_{dm0}$ and $\kappa$ are Hubble constant, absolute magnitude of type 1a supernova, present day dark matter density and coupling parameter between dark matter and dark energy respectively while $I$ is a new parameter, dubbed dilution parameter which we introduced in the model representing the modified dilution of dark matter in the interacting scenario. The physical features of the model in regard to evolution of the Universe, deceleration parameter, age of Universe, particle physics implications of interacting scenario has also been explored in depth and conclusions has been drawn.


title: MUD-PQFed: Towards Malicious User Detection in Privacy-Preserving Quantized Federated Learning

abstract: Federated Learning (FL), a distributed machine learning paradigm, has been adapted to mitigate privacy concerns for customers. Despite their appeal, there are various inference attacks that can exploit shared-plaintext model updates to embed traces of customer private information, leading to serious privacy concerns. To alleviate this privacy issue, cryptographic techniques such as Secure Multi-Party Computation and Homomorphic Encryption have been used for privacy-preserving FL. However, such security issues in privacy-preserving FL are poorly elucidated and underexplored. This work is the first attempt to elucidate the triviality of performing model corruption attacks on privacy-preserving FL based on lightweight secret sharing. We consider scenarios in which model updates are quantized to reduce communication overhead in this case, where an adversary can simply provide local parameters outside the legal range to corrupt the model. We then propose the MUD-PQFed protocol, which can precisely detect malicious clients performing attacks and enforce fair penalties. By removing the contributions of detected malicious clients, the global model utility is preserved to be comparable to the baseline global model without the attack. Extensive experiments validate effectiveness in maintaining baseline accuracy and detecting malicious clients in a fine-grained manner


title: Generalizing Goal-Conditioned Reinforcement Learning with Variational Causal Reasoning

abstract: As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and discovering cause-and-effect relations. However, how to discover and represent causalities remains a huge gap that hinders the development of causal RL. In this paper, we augment Goal-Conditioned RL (GCRL) with Causal Graph (CG), a structure built upon the relation between objects and events. We novelly formulate the GCRL problem into variational likelihood maximization with CG as latent variables. To optimize the derived objective, we propose a framework with theoretical performance guarantees that alternates between two steps: using interventional data to estimate the posterior of CG; using CG to learn generalizable models and interpretable policies. Due to the lack of public benchmarks that verify generalization capability under reasoning, we design nine tasks and then empirically show the effectiveness of the proposed method against five baselines on these tasks. Further theoretical analysis shows that our performance improvement is attributed to the virtuous cycle of causal discovery, transition modeling, and policy training, which aligns with the experimental evidence in extensive ablation studies.


title: Detecting the non-Gaussianity of the 21-cm signal during reionisation with the Wavelet Scattering Transform

abstract: Detecting the 21-cm hyperfine transition from neutral hydrogen in the intergalactic medium is our best probe for understanding the astrophysical processes driving the Epoch of Reionisation (EoR). The primary means for a detection of this 21-cm signal is through a statistical measurement of the spatial fluctuations using the 21-cm power spectrum (PS). However, the 21-cm signal is non-Gaussian meaning the PS, which only measures the Gaussian fluctuations, is sub-optimal for characterising all of the available information. The upcoming Square Kilometre Array (SKA) will perform a deep, 1000 hr observation over 100 deg$.^{2}$ specifically designed to recover direct images of the 21-cm signal. In this work, we use the Wavelet Scattering Transform (WST) to extract the non-Gaussian information directly from these two-dimensional images of the 21-cm signal. The key advantage of the WST is its stability with respect to statistical noise for measuring non-Gaussian information, unlike the bispectrum whose statistical noise diverges. We introduce a novel method to isolate this non-Gaussian information from mock 21-cm images and demonstrate its detection at 150 (177)~MHz ($z\sim8.5$ and $\sim7$) for a fiducial model with signal-to-noise of $\sim$5~(8) assuming perfect foreground removal and $\sim2$~(3) assuming foreground wedge avoidance.


title: Relational Future Captioning Model for Explaining Likely Collisions in Daily Tasks

abstract: Domestic service robots that support daily tasks are a promising solution for elderly or disabled people. It is crucial for domestic service robots to explain the collision risk before they perform actions. In this paper, our aim is to generate a caption about a future event. We propose the Relational Future Captioning Model (RFCM), a crossmodal language generation model for the future captioning task. The RFCM has the Relational Self-Attention Encoder to extract the relationships between events more effectively than the conventional self-attention in transformers. We conducted comparison experiments, and the results show the RFCM outperforms a baseline method on two datasets.


title: Dual Adaptive Transformations for Weakly Supervised Point Cloud Segmentation

abstract: Weakly supervised point cloud segmentation, i.e. semantically segmenting a point cloud with only a few labeled points in the whole 3D scene, is highly desirable due to the heavy burden of collecting abundant dense annotations for the model training. However, existing methods remain challenging to accurately segment 3D point clouds since limited annotated data may lead to insufficient guidance for label propagation to unlabeled data. Considering the smoothness-based methods have achieved promising progress, in this paper, we advocate applying the consistency constraint under various perturbations to effectively regularize unlabeled 3D points. Specifically, we propose a novel DAT (\textbf{D}ual \textbf{A}daptive \textbf{T}ransformations) model for weakly supervised point cloud segmentation, where the dual adaptive transformations are performed via an adversarial strategy at both point-level and region-level, aiming at enforcing the local and structural smoothness constraints on 3D point clouds. We evaluate our proposed DAT model with two popular backbones on the large-scale S3DIS and ScanNet-V2 datasets. Extensive experiments demonstrate that our model can effectively leverage the unlabeled 3D points and achieve significant performance gains on both datasets, setting new state-of-the-art performance for weakly supervised point cloud segmentation.


title: Can You Fool AI by Doing a 180? $\unicode{x2013}$ A Case Study on Authorship Analysis of Texts by Arata Osada

abstract: This paper is our attempt at answering a twofold question covering the areas of ethics and authorship analysis. Firstly, since the methods used for performing authorship analysis imply that an author can be recognized by the content he or she creates, we were interested in finding out whether it would be possible for an author identification system to correctly attribute works to authors if in the course of years they have undergone a major psychological transition. Secondly, and from the point of view of the evolution of an author's ethical values, we checked what it would mean if the authorship attribution system encounters difficulties in detecting single authorship. We set out to answer those questions through performing a binary authorship analysis task using a text classifier based on a pre-trained transformer model and a baseline method relying on conventional similarity metrics. For the test set, we chose works of Arata Osada, a Japanese educator and specialist in the history of education, with half of them being books written before the World War II and another half in the 1950s, in between which he underwent a transformation in terms of political opinions. As a result, we were able to confirm that in the case of texts authored by Arata Osada in a time span of more than 10 years, while the classification accuracy drops by a large margin and is substantially lower than for texts by other non-fiction writers, confidence scores of the predictions remain at a similar level as in the case of a shorter time span, indicating that the classifier was in many instances tricked into deciding that texts written over a time span of multiple years were actually written by two different people, which in turn leads us to believe that such a change can affect authorship analysis, and that historical events have great impact on a person's ethical outlook as expressed in their writings.


title: MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Views

abstract: We propose MHR-Net, a novel method for recovering Non-Rigid Shapes from Motion (NRSfM). MHR-Net aims to find a set of reasonable reconstructions for a 2D view, and it also selects the most likely reconstruction from the set. To deal with the challenging unsupervised generation of non-rigid shapes, we develop a new Deterministic Basis and Stochastic Deformation scheme in MHR-Net. The non-rigid shape is first expressed as the sum of a coarse shape basis and a flexible shape deformation, then multiple hypotheses are generated with uncertainty modeling of the deformation part. MHR-Net is optimized with reprojection loss on the basis and the best hypothesis. Furthermore, we design a new Procrustean Residual Loss, which reduces the rigid rotations between similar shapes and further improves the performance. Experiments show that MHR-Net achieves state-of-the-art reconstruction accuracy on Human3.6M, SURREAL and 300-VW datasets.


title: Is Vertical Logistic Regression Privacy-Preserving? A Comprehensive Privacy Analysis and Beyond

abstract: We consider vertical logistic regression (VLR) trained with mini-batch gradient descent -- a setting which has attracted growing interest among industries and proven to be useful in a wide range of applications including finance and medical research. We provide a comprehensive and rigorous privacy analysis of VLR in a class of open-source Federated Learning frameworks, where the protocols might differ between one another, yet a procedure of obtaining local gradients is implicitly shared. We first consider the honest-but-curious threat model, in which the detailed implementation of protocol is neglected and only the shared procedure is assumed, which we abstract as an oracle. We find that even under this general setting, single-dimension feature and label can still be recovered from the other party under suitable constraints of batch size, thus demonstrating the potential vulnerability of all frameworks following the same philosophy. Then we look into a popular instantiation of the protocol based on Homomorphic Encryption (HE). We propose an active attack that significantly weaken the constraints on batch size in the previous analysis via generating and compressing auxiliary ciphertext. To address the privacy leakage within the HE-based protocol, we develop a simple-yet-effective countermeasure based on Differential Privacy (DP), and provide both utility and privacy guarantees for the updated algorithm. Finally, we empirically verify the effectiveness of our attack and defense on benchmark datasets. Altogether, our findings suggest that all vertical federated learning frameworks that solely depend on HE might contain severe privacy risks, and DP, which has already demonstrated its power in horizontal federated learning, can also play a crucial role in the vertical setting, especially when coupled with HE or secure multi-party computation (MPC) techniques.


title: XG-BoT: An Explainable Deep Graph Neural Network for Botnet Detection and Forensics

abstract: In this paper, we propose XG-BoT, an explainable deep graph neural network model for botnet node detection. The proposed model comprises a botnet detector and an explainer for automatic forensics. The XG-BoT detector can effectively detect malicious botnet nodes in large-scale networks. Specifically, it utilizes a grouped reversible residual connection with a graph isomorphism network to learn expressive node representations from botnet communication graphs. The explainer, based on the GNNExplainer and saliency map in XG-BoT, can perform automatic network forensics by highlighting suspicious network flows and related botnet nodes. We evaluated XG-BoT using real-world, large-scale botnet network graph datasets. Overall, XG-BoT outperforms state-of-the-art approaches in terms of key evaluation metrics. Additionally, we demonstrate that the XG-BoT explainers can generate useful explanations for automatic network forensics.


title: Balancing the trade-off between cost and reliability for wireless sensor networks: a multi-objective optimized deployment method

abstract: The deployment of the sensor nodes (SNs) always plays a decisive role in the system performance of wireless sensor networks (WSNs). In this work, we propose an optimal deployment method for practical heterogeneous WSNs which gives a deep insight into the trade-off between the reliability and deployment cost. Specifically, this work aims to provide the optimal deployment of SNs to maximize the coverage degree and connection degree, and meanwhile minimize the overall deployment cost. In addition, this work fully considers the heterogeneity of SNs (i.e. differentiated sensing range and deployment cost) and three-dimensional (3-D) deployment scenarios. This is a multi-objective optimization problem, non-convex, multimodal and NP-hard. To solve it, we develop a novel swarm-based multi-objective optimization algorithm, known as the competitive multi-objective marine predators algorithm (CMOMPA) whose performance is verified by comprehensive comparative experiments with ten other stateof-the-art multi-objective optimization algorithms. The computational results demonstrate that CMOMPA is superior to others in terms of convergence and accuracy and shows excellent performance on multimodal multiobjective optimization problems. Sufficient simulations are also conducted to evaluate the effectiveness of the CMOMPA based optimal SNs deployment method. The results show that the optimized deployment can balance the trade-off among deployment cost, sensing reliability and network reliability. The source code is available on https://github.com/iNet-WZU/CMOMPA.


title: Actor-Critic based Improper Reinforcement Learning

abstract: We consider an improper reinforcement learning setting where a learner is given $M$ base controllers for an unknown Markov decision process, and wishes to combine them optimally to produce a potentially new controller that can outperform each of the base ones. This can be useful in tuning across controllers, learnt possibly in mismatched or simulated environments, to obtain a good controller for a given target environment with relatively few trials. Towards this, we propose two algorithms: (1) a Policy Gradient-based approach; and (2) an algorithm that can switch between a simple Actor-Critic (AC) based scheme and a Natural Actor-Critic (NAC) scheme depending on the available information. Both algorithms operate over a class of improper mixtures of the given controllers. For the first case, we derive convergence rate guarantees assuming access to a gradient oracle. For the AC-based approach we provide convergence rate guarantees to a stationary point in the basic AC case and to a global optimum in the NAC case. Numerical results on (i) the standard control theoretic benchmark of stabilizing an cartpole; and (ii) a constrained queueing task show that our improper policy optimization algorithm can stabilize the system even when the base policies at its disposal are unstable.


title: Quench dynamics of mass-imbalanced three-body fermionic systems in a spherical trap

abstract: We consider a system of two identical fermions of general mass interacting with a third distinguishable particle via a contact interaction within an isotropic three-dimensional harmonic trap. We calculate time-dependent observables of the system after it is quenched in s-wave scattering length. To do this we use exact closed form mass-imbalanced hyperspherical solutions to the static three-body problem. These exact solutions enable us to calculate two time-dependent observables, the Ramsey signal and particle separation, after the system undergoes a quench from non-interacting to the unitary regime or vice-versa.


title: IoT Anomaly Detection Methods and Applications: A Survey

abstract: Ongoing research on anomaly detection for the Internet of Things (IoT) is a rapidly expanding field. This growth necessitates an examination of application trends and current gaps. The vast majority of those publications are in areas such as network and infrastructure security, sensor monitoring, smart home, and smart city applications and are extending into even more sectors. Recent advancements in the field have increased the necessity to study the many IoT anomaly detection applications. This paper begins with a summary of the detection methods and applications, accompanied by a discussion of the categorization of IoT anomaly detection algorithms. We then discuss the current publications to identify distinct application domains, examining papers chosen based on our search criteria. The survey considers 64 papers among recent publications published between January 2019 and July 2021. In recent publications, we observed a shortage of IoT anomaly detection methodologies, for example, when dealing with the integration of systems with various sensors, data and concept drifts, and data augmentation where there is a shortage of Ground Truth data. Finally, we discuss the present such challenges and offer new perspectives where further research is required.


title: Maximum entropy states of collisionless positron-electron plasma in a dipole magnetic field

abstract: We are developing a positron-electron plasma trap based on a dipole magnetic field generated by a levitated superconducting magnet to investigate the physics of magnetized plasmas with mass symmetry as well as antimatter components. Such laboratory magnetosphere is deemed essential for the understanding of pair plasmas in astrophysical environments, such as magnetars and blackholes, and represents a novel technology with potential applications in antimatter confinement and development of coherent gamma-ray lasers. The design of the device requires a preemptive analysis of the achievable self-organized steady states. In this study, we construct a theoretical model describing maximum entropy states of a collisionless positron-electron plasma confined by a dipole magnetic field, and demonstrate efficient confinement of both species under a wide range of physical parameters by analysing the effect of the three adiabatic invariants on the phase space distribution function. The theory is verified by numerical evaluation of spatial density, electrostatic potential, and toroidal rotation velocity for each species in correspondence of the maximum entropy state.


title: MoEC: Mixture of Expert Clusters

abstract: Sparsely Mixture of Experts (MoE) has received great interest due to its promising scaling capability with affordable computational overhead. MoE converts dense layers into sparse experts, and utilizes a gated routing network to make experts conditionally activated. However, as the number of experts grows, MoE with outrageous parameters suffers from overfitting and sparse data allocation. Such problems are especially severe on tasks with limited data, thus hindering the progress for MoE models to improve performance by scaling up. In this work, we propose Mixture of Expert Clusters - a general approach to enable expert layers to learn more diverse and appropriate knowledge by imposing variance-based constraints on the routing stage. We further propose a cluster-level expert dropout strategy specifically designed for the expert cluster structure. Our experiments reveal that MoEC could improve performance on machine translation and natural language understanding tasks, and raise the performance upper bound for scaling up experts under limited data. We also verify that MoEC plays a positive role in mitigating overfitting and sparse data allocation.


title: Secure Intelligent Reflecting Surface Aided Integrated Sensing and Communication

abstract: In this paper, an intelligent reflecting surface (IRS) is leveraged to enhance the physical layer security of an integrated sensing and communication (ISAC) system in which the IRS is deployed to not only assist the downlink communication for multiple users, but also create a virtual line-of-sight (LoS) link for target sensing. In particular, we consider a challenging scenario where the target may be a suspicious eavesdropper that potentially intercepts the communication-user information transmitted by the base station (BS). We investigate the joint design of the phase shifts at the IRS and the communication as well as radar beamformers at the BS to maximize the sensing beampattern gain towards the target, subject to the maximum information leakage to the eavesdropping target and the minimum signal-to-interference-plus-noise ratio (SINR) required by users. Based on the availability of perfect channel state information (CSI) of all involved user links and the accurate target location at the BS, two scenarios are considered and two different optimization algorithms are proposed. For the ideal scenario where the CSI of the user links and the target location are perfectly known at the BS, a penalty-based algorithm is proposed to obtain a high-quality solution. In particular, the beamformers are obtained with a semi-closed-form solution using Lagrange duality and the IRS phase shifts are solved for in closed form by applying the majorization-minimization (MM) method. On the other hand, for the more practical scenario where the CSI is imperfect and the target location is uncertain, a robust algorithm based on the $\cal S$-procedure and sign-definiteness approaches is proposed. Simulation results demonstrate the effectiveness of the proposed scheme in achieving a trade-off between the communication quality and the sensing quality.


title: Quantum Image Representation Methods Using Qutrits

abstract: Quantum Image Processing is a recent highlight in the quantum computing field. All previous methods for representing the images as quantum states were defined using qubits. One Quantum Image Representation (QIR) method using qutrits is present in the literature. Inspired by the qubit methods and the higher state-space available for qutrits, multiple QIR methods using qutrits are worked out in this paper. The ternary quantum gates required for the representations are described, and then the implementation details for five qutrit-based QIR methods are given. All the methods have been simulated in software, and example circuits are provided.


title: Lazy Estimation of Variable Importance for Large Neural Networks

abstract: As opaque predictive models increasingly impact many areas of modern life, interest in quantifying the importance of a given input variable for making a specific prediction has grown. Recently, there has been a proliferation of model-agnostic methods to measure variable importance (VI) that analyze the difference in predictive power between a full model trained on all variables and a reduced model that excludes the variable(s) of interest. A bottleneck common to these methods is the estimation of the reduced model for each variable (or subset of variables), which is an expensive process that often does not come with theoretical guarantees. In this work, we propose a fast and flexible method for approximating the reduced model with important inferential guarantees. We replace the need for fully retraining a wide neural network by a linearization initialized at the full model parameters. By adding a ridge-like penalty to make the problem convex, we prove that when the ridge penalty parameter is sufficiently large, our method estimates the variable importance measure with an error rate of $O(\frac{1}{\sqrt{n}})$ where $n$ is the number of training samples. We also show that our estimator is asymptotically normal, enabling us to provide confidence bounds for the VI estimates. We demonstrate through simulations that our method is fast and accurate under several data-generating regimes, and we demonstrate its real-world applicability on a seasonal climate forecasting example.


title: ReBoot: Distributed statistical learning via refitting bootstrap samples

abstract: In this paper, we propose a one-shot distributed learning algorithm via refitting bootstrap samples, which we refer to as ReBoot. ReBoot refits a new model to mini-batches of bootstrap samples that are continuously drawn from each of the locally fitted models. It requires only one round of communication of model parameters without much memory. Theoretically, we analyze the statistical error rate of ReBoot for generalized linear models (GLM) and noisy phase retrieval, which represent convex and non-convex problems, respectively. In both cases, ReBoot provably achieves the full-sample statistical rate. In particular, we show that the systematic bias of ReBoot, the error that is independent of the number of subsamples (i.e., the number of sites), is $O(n ^ {-2})$ in GLM, where $n$ is the subsample size (the sample size of each local site). This rate is sharper than that of model parameter averaging and its variants, implying the higher tolerance of ReBoot with respect to data splits to maintain the full-sample rate. Our simulation study demonstrates the statistical advantage of ReBoot over competing methods. Finally, we propose FedReBoot, an iterative version of ReBoot, to aggregate convolutional neural networks for image classification. FedReBoot exhibits substantial superiority over Federated Averaging (FedAvg) within early rounds of communication.


title: Analyzing Bagging Methods for Language Models

abstract: Modern language models leverage increasingly large numbers of parameters to achieve performance on natural language understanding tasks. Ensembling these models in specific configurations for downstream tasks show even further performance improvements. In this paper, we perform an analysis of bagging language models and compare single language models to bagged ensembles that are roughly equivalent in terms of final model size. We explore an array of model bagging configurations for natural language understanding tasks with final ensemble sizes ranging from 300M parameters to 1.5B parameters and determine that our ensembling methods are at best roughly equivalent to single LM baselines. We note other positive effects of bagging and pruning in specific scenarios according to findings in our experiments such as variance reduction and minor performance improvements.


title: Arithmetic purity of strong approximation for complete toric varieties

abstract: In this article, we establish the arithmetic purity of strong approximation for smooth loci of weighted projective spaces. By using this result and the descent method, we also prove that the arithmetic purity of strong approximation with Brauer-Manin obstruction holds for any smooth and complete toric variety.


title: Assessing quality of selection procedures: Lower bound of false positive rate as a function of inter-rater reliability

abstract: Inter-rater reliability (IRR) is one of the commonly used tools for assessing the quality of ratings from multiple raters. However, applicant selection procedures based on ratings from multiple raters usually result in a binary outcome; the applicant is either selected or not. This final outcome is not considered in IRR, which instead focuses on the ratings of the individual subjects or objects. We outline the connection between the ratings' measurement model (used for IRR) and a binary classification framework. We develop a simple way of approximating the probability of correctly selecting the best applicants which allows us to compute error probabilities of the selection procedure (i.e., false positive and false negative rate) or their lower bounds. We draw connections between the inter-rater reliability and the binary classification metrics, showing that binary classification metrics depend solely on the IRR coefficient and proportion of selected applicants. We assess the performance of the approximation in a simulation study and apply it in an example comparing the reliability of multiple grant peer review selection procedures. We also discuss possible other uses of the explored connections in other contexts, such as educational testing, psychological assessment, and health-related measurement and implement the computations in IRR2FPR R package.


title: Complexity of High-Dimensional Identity Testing with Coordinate Conditional Sampling

abstract: We study the identity testing problem for high-dimensional distributions. Given as input an explicit distribution $\mu$, an $\varepsilon>0$, and access to sampling oracle(s) for a hidden distribution $\pi$, the goal in identity testing is to distinguish whether the two distributions $\mu$ and $\pi$ are identical or are at least $\varepsilon$-far apart. When there is only access to full samples from the hidden distribution $\pi$, it is known that exponentially many samples (in the dimension) may be needed for identity testing, and hence previous works have studied identity testing with additional access to various "conditional" sampling oracles. We consider a significantly weaker conditional sampling oracle, which we call the $\mathsf{Coordinate\ Oracle}$, and provide a computational and statistical characterization of the identity testing problem in this new model. We prove that if an analytic property known as approximate tensorization of entropy holds for an $n$-dimensional visible distribution $\mu$, then there is an efficient identity testing algorithm for any hidden distribution $\pi$ using $\tilde{O}(n/\varepsilon)$ queries to the $\mathsf{Coordinate\ Oracle}$. Approximate tensorization of entropy is a pertinent condition as recent works have established it for a large class of high-dimensional distributions. We also prove a computational phase transition: for a well-studied class of $n$-dimensional distributions, specifically sparse antiferromagnetic Ising models over $\{+1,-1\}^n$, we show that in the regime where approximate tensorization of entropy fails, there is no efficient identity testing algorithm unless $\mathsf{RP}=\mathsf{NP}$. We complement our results with a matching $\Omega(n/\varepsilon)$ statistical lower bound for the sample complexity of identity testing in the $\mathsf{Coordinate\ Oracle}$ model.


title: Hybrid Belief Pruning with Guarantees for Viewpoint-Dependent Semantic SLAM

abstract: Semantic simultaneous localization and mapping is a subject of increasing interest in robotics and AI that directly influences the autonomous vehicles industry, the army industries, and more. One of the challenges in this field is to obtain object classification jointly with robot trajectory estimation. Considering view-dependent semantic measurements, there is a coupling between different classes, resulting in a combinatorial number of hypotheses. A common solution is to prune hypotheses that have a sufficiently low probability and to retain only a limited number of hypotheses. However, after pruning and renormalization, the updated probability is overconfident with respect to the original probability. This is especially problematic for systems that require high accuracy. If the prior probability of the classes is independent, the original normalization factor can be computed efficiently without pruning hypotheses. To the best of our knowledge, this is the first work to present these results. If the prior probability of the classes is dependent, we propose a lower bound on the normalization factor that ensures cautious results. The bound is calculated incrementally and with similar efficiency as in the independent case. After pruning and updating based on the bound, this belief is shown empirically to be close to the original belief.


title: Nonlinear Stefan Problem for one-phase generalized heat equation with heat flux and convective boundary condition

abstract: In this article we consider a mathematical model of an initial stage of closure electrical contact that involves a metallic vaporization after instantaneous exploding of contact due to arc ignition with power $P_0$ on fixed face $z=0$ and heat transfer in material with a variable cross section, when the radial component of the temperature gradient can be neglected in comparison with the axial component with heat flux and convective boundary conditions prescribed at the known free boundary $z = \alpha (t)$. The temperature field in the liquid region of such kind of material can be modelled by Stefan problem for the generalized heat equation. The method of solution is based on similarity variable, which enables us to reduce generalized heat equation to nonlinear ordinary differential equation. Moreover, we have to determine temperature solution for the liquid phase and location of melting interface. Existence and uniqueness of the solution is proved by using the fixed point Banach theorem. The solution for two cases of thermal coefficients, in particular, constant and linear thermal conductivity are represented, existence and uniqueness for each type of solution is proved.


title: DUQIM-Net: Probabilistic Object Hierarchy Representation for Multi-View Manipulation

abstract: Object manipulation in cluttered scenes is a difficult and important problem in robotics. To efficiently manipulate objects, it is crucial to understand their surroundings, especially in cases where multiple objects are stacked one on top of the other, preventing effective grasping. We here present DUQIM-Net, a decision-making approach for object manipulation in a setting of stacked objects. In DUQIM-Net, the hierarchical stacking relationship is assessed using Adj-Net, a model that leverages existing Transformer Encoder-Decoder object detectors by adding an adjacency head. The output of this head probabilistically infers the underlying hierarchical structure of the objects in the scene. We utilize the properties of the adjacency matrix in DUQIM-Net to perform decision making and assist with object-grasping tasks. Our experimental results show that Adj-Net surpasses the state-of-the-art in object-relationship inference on the Visual Manipulation Relationship Dataset (VMRD), and that DUQIM-Net outperforms comparable approaches in bin clearing tasks.


title: Explainable Human-in-the-loop Dynamic Data-Driven Digital Twins

abstract: Digital Twins (DT) are essentially dynamic data-driven models that serve as real-time symbiotic "virtual replicas" of real-world systems. DT can leverage fundamentals of Dynamic Data-Driven Applications Systems (DDDAS) bidirectional symbiotic sensing feedback loops for its continuous updates. Sensing loops can consequently steer measurement, analysis and reconfiguration aimed at more accurate modelling and analysis in DT. The reconfiguration decisions can be autonomous or interactive, keeping human-in-the-loop. The trustworthiness of these decisions can be hindered by inadequate explainability of the rationale, and utility gained in implementing the decision for the given situation among alternatives. Additionally, different decision-making algorithms and models have varying complexity, quality and can result in different utility gained for the model. The inadequacy of explainability can limit the extent to which humans can evaluate the decisions, often leading to updates which are unfit for the given situation, erroneous, compromising the overall accuracy of the model. The novel contribution of this paper is an approach to harnessing explainability in human-in-the-loop DDDAS and DT systems, leveraging bidirectional symbiotic sensing feedback. The approach utilises interpretable machine learning and goal modelling to explainability, and considers trade-off analysis of utility gained. We use examples from smart warehousing to demonstrate the approach.


title: MONet: Multi-scale Overlap Network for Duplication Detection in Biomedical Images

abstract: Manipulation of biomedical images to misrepresent experimental results has plagued the biomedical community for a while. Recent interest in the problem led to the curation of a dataset and associated tasks to promote the development of biomedical forensic methods. Of these, the largest manipulation detection task focuses on the detection of duplicated regions between images. Traditional computer-vision based forensic models trained on natural images are not designed to overcome the challenges presented by biomedical images. We propose a multi-scale overlap detection model to detect duplicated image regions. Our model is structured to find duplication hierarchically, so as to reduce the number of patch operations. It achieves state-of-the-art performance overall and on multiple biomedical image categories.


title: eCDT: Event Clustering for Simultaneous Feature Detection and Tracking-

abstract: Contrary to other standard cameras, event cameras interpret the world in an entirely different manner; as a collection of asynchronous events. Despite event camera's unique data output, many event feature detection and tracking algorithms have shown significant progress by making detours to frame-based data representations. This paper questions the need to do so and proposes a novel event data-friendly method that achieve simultaneous feature detection and tracking, called event Clustering-based Detection and Tracking (eCDT). Our method employs a novel clustering method, named as k-NN Classifier-based Spatial Clustering and Applications with Noise (KCSCAN), to cluster adjacent polarity events to retrieve event trajectories.With the aid of a Head and Tail Descriptor Matching process, event clusters that reappear in a different polarity are continually tracked, elongating the feature tracks. Thanks to our clustering approach in spatio-temporal space, our method automatically solves feature detection and feature tracking simultaneously. Also, eCDT can extract feature tracks at any frequency with an adjustable time window, which does not corrupt the high temporal resolution of the original event data. Our method achieves 30% better feature tracking ages compared with the state-of-the-art approach while also having a low error approximately equal to it.


title: Active-Learning-as-a-Service: An Automatic and Efficient MLOps System for Data-Centric AI

abstract: The success of today's AI applications requires not only model training (Model-centric) but also data engineering (Data-centric). In data-centric AI, active learning (AL) plays a vital role, but current AL tools 1) require users to manually select AL strategies, and 2) can not perform AL tasks efficiently. To this end, this paper presents an automatic and efficient MLOps system for AL, named ALaaS (Active-Learning-as-a-Service). Specifically, 1) ALaaS implements an AL agent, including a performance predictor and a workflow controller, to decide the most suitable AL strategies given users' datasets and budgets. We call this a predictive-based successive halving early-stop (PSHEA) procedure. 2) ALaaS adopts a server-client architecture to support an AL pipeline and implements stage-level parallelism for high efficiency. Meanwhile, caching and batching techniques are employed to further accelerate the AL process. In addition to efficiency, ALaaS ensures accessibility with the help of the design philosophy of configuration-as-a-service. Extensive experiments show that ALaaS outperforms all other baselines in terms of latency and throughput. Also, guided by the AL agent, ALaaS can automatically select and run AL strategies for non-expert users under different datasets and budgets. Our code is available at \url{https://github.com/MLSysOps/Active-Learning-as-a-Service}.


title: A hybrid discrete-continuum modelling approach to explore the impact of T-cell infiltration on anti-tumour immune response

abstract: We present a spatial hybrid discrete-continuum modelling framework for the interaction dynamics between tumour cells and cytotoxic T cells, which play a pivotal role in the immune response against tumours. In this framework, tumour cells and T cells are modelled as individual agents while chemokines that drive the chemotactic movement of T cells towards the tumour are modelled as a continuum. We formally derive the continuum counterpart of this model, which is given by a coupled system that comprises an integro-differential equation for the density of tumour cells, a partial differential equation for the density of T cells, and a partial differential equation for the concentration of chemokines. We report on computational results of the hybrid model and show that there is an excellent quantitative agreement between them and numerical solutions of the corresponding continuum model. These results shed light on the mechanisms that underlie the emergence of different levels of infiltration of T cells into the tumour and elucidate how T-cell infiltration shapes anti-tumour immune response. Moreover, to present a proof of concept for the idea that, exploiting the computational efficiency of the continuum model, extensive numerical simulations could be carried out, we investigate the impact of T-cell infiltration on the response of tumour cells to different types of anti-cancer immunotherapy.


title: Noise-induced network topologies

abstract: We analyze transport on a graph with multiple constraints and where the weight of the edges connecting the nodes is a dynamical variable. The network dynamics results from the interplay between a nonlinear function of the flow, dissipation, and Gaussian, additive noise. For a given set of parameters and finite noise amplitudes, the network self-organizes into one of several metastable configurations, according to a probability distribution that depends on the noise amplitude {\alpha}. At a finite value {\alpha}, we find a resonant-like behavior for which one network topology is the most probable stationary state. This specific topology maximizes the robustness and transport efficiency, it is reached with the maximal convergence rate, and it is not found by the noiseless dynamics. We argue that this behavior is a manifestation of noise-induced resonances in network self-organization. Our findings show that stochastic dynamics can boost transport on a nonlinear network and, further, suggest a change of paradigm about the role of noise in optimization algorithms.

categories: cond-mat.stat-mech nlin.AO physics.bio-ph q-bio.NC