title: Distances for Markov Chains, and Their Differentiation

abstract: (Directed) graphs with node attributes are a common type of data in various applications and there is a vast literature on developing metrics and efficient algorithms for comparing them. Recently, in the graph learning and optimization communities, a range of new approaches have been developed for comparing graphs with node attributes, leveraging ideas such as the Optimal Transport (OT) and the Weisfeiler-Lehman (WL) graph isomorphism test. Two state-of-the-art representatives are the OTC distance proposed in (O'Connor et al., 2022) and the WL distance in (Chen et al., 2022). Interestingly, while these two distances are developed based on different ideas, we observe that they both view graphs as Markov chains, and are deeply connected. Indeed, in this paper, we propose a unified framework to generate distances for Markov chains (thus including (directed) graphs with node attributes), which we call the Optimal Transport Markov (OTM) distances, that encompass both the OTC and the WL distances. We further introduce a special one-parameter family of distances within our OTM framework, called the discounted WL distance. We show that the discounted WL distance has nice theoretical properties and can address several limitations of the existing OTC and WL distances. Furthermore, contrary to the OTC and the WL distances, our new discounted WL distance can be differentiated after a entropy-regularization similar to the Sinkhorn distance, making it suitable to use in learning frameworks, e.g., as the reconstruction loss in a graph generative model.


title: Observation of Conventional Near Room Temperature Superconductivity in Carbonaceous Sulfur Hydride

abstract: The phenomenon of high temperature superconductivity, approaching room temperature, has been realized in a number of hydrogen-dominant alloy systems under high pressure conditions1-12. A significant discovery in reaching room temperature superconductivity is the photo-induced reaction of sulfur, hydrogen, and carbon that initially forms of van der Waals solids at sub-megabar pressures. Carbonaceous sulfur hydride has been demonstrated to be tunable with respect to carbon content, leading to different superconducting final states with different structural symmetries. A modulated AC susceptibility technique adapted for a diamond anvil cell confirms a Tc of 260 kelvin at 133 GPa in carbonaceous sulfur hydride. Furthermore, direct synchrotron infrared reflectivity measurements on the same sample under the same conditions reveal a superconducting gap of ~85 meV at 100 K in close agreement to the expected value from Bardeen-Cooper-Schrieffer (BCS) theory13-18. Additionally, x-ray diffraction in tandem with AC magnetic susceptibility measurements above and below the superconducting transition temperature, and as a function of pressure at 107-133 GPa, reveal the Pnma structure of the material is responsible for the close to room-temperature superconductivity at these pressures.


title: A Hybrid Chimp Optimization Algorithm and Generalized Normal Distribution Algorithm with Opposition-Based Learning Strategy for Solving Data Clustering Problems

abstract: This paper is concerned with data clustering to separate clusters based on the connectivity principle for categorizing similar and dissimilar data into different groups. Although classical clustering algorithms such as K-means are efficient techniques, they often trap in local optima and have a slow convergence rate in solving high-dimensional problems. To address these issues, many successful meta-heuristic optimization algorithms and intelligence-based methods have been introduced to attain the optimal solution in a reasonable time. They are designed to escape from a local optimum problem by allowing flexible movements or random behaviors. In this study, we attempt to conceptualize a powerful approach using the three main components: Chimp Optimization Algorithm (ChOA), Generalized Normal Distribution Algorithm (GNDA), and Opposition-Based Learning (OBL) method. Firstly, two versions of ChOA with two different independent groups' strategies and seven chaotic maps, entitled ChOA(I) and ChOA(II), are presented to achieve the best possible result for data clustering purposes. Secondly, a novel combination of ChOA and GNDA algorithms with the OBL strategy is devised to solve the major shortcomings of the original algorithms. Lastly, the proposed ChOAGNDA method is a Selective Opposition (SO) algorithm based on ChOA and GNDA, which can be used to tackle large and complex real-world optimization problems, particularly data clustering applications. The results are evaluated against seven popular meta-heuristic optimization algorithms and eight recent state-of-the-art clustering techniques. Experimental results illustrate that the proposed work significantly outperforms other existing methods in terms of the achievement in minimizing the Sum of Intra-Cluster Distances (SICD), obtaining the lowest Error Rate (ER), accelerating the convergence speed, and finding the optimal cluster centers.


title: InstructABSA: Instruction Learning for Aspect Based Sentiment Analysis

abstract: We introduce InstructABSA, an instruction learning paradigm for Aspect-Based Sentiment Analysis (ABSA) subtasks. Our method introduces positive, negative, and neutral examples to each training sample, and instruction tune the model (Tk-Instruct) for ABSA subtasks, yielding significant performance improvements. Experimental results on the Sem Eval 2014, 15, and 16 datasets demonstrate that InstructABSA outperforms the previous state-of-the-art (SOTA) approaches on Term Extraction (ATE), Sentiment Classification(ATSC) and Sentiment Pair Extraction (ASPE) subtasks. In particular, InstructABSA outperforms the previous state-of-the-art (SOTA) on the Rest14 ATE subtask by 5.69% points, the Rest15 ATSC subtask by 9.59% points, and the Lapt14 AOPE subtask by 3.37% points, surpassing 7x larger models. We also get competitive results on AOOE, AOPE, and AOSTE subtasks indicating strong generalization ability to all subtasks. Exploring sample efficiency reveals that just 50% train data is required to get competitive results with other instruction tuning approaches. Lastly, we assess the quality of instructions and observe that InstructABSA's performance experiences a decline of ~10% when adding misleading examples.


title: Another proof of Seymour's 6-flow theorem

abstract: In 1981 Seymour proved his famous 6-flow theorem asserting that every 2-edge-connected graph has a nowhere-zero flow in the group ${\mathbb Z}_2 \times {\mathbb Z}_3$ (in fact, he offers two proofs of this result). In this note we give a new short proof of a generalization of this theorem where ${\mathbb Z}_2 \times {\mathbb Z}_3$-valued functions are found subject to certain boundary constraints.


title: Role of Bias Terms in Dot-Product Attention

abstract: Dot-product attention is a core module in the present generation of neural network models, particularly transformers, and is being leveraged across numerous areas such as natural language processing and computer vision. This attention module is comprised of three linear transformations, namely query, key, and value linear transformations, each of which has a bias term. In this work, we study the role of these bias terms, and mathematically show that the bias term of the key linear transformation is redundant and could be omitted without any impact on the attention module. Moreover, we argue that the bias term of the value linear transformation has a more prominent role than that of the bias term of the query linear transformation. We empirically verify these findings through multiple experiments on language modeling, natural language understanding, and natural language generation tasks.


title: An Optimal Projection Framework for Structure-Preserving Model Reduction of Linear Systems

abstract: This paper presents a structure-preserving model reduction framework for linear systems, in which the $\mathcal{H}_2$ optimization is incorporated with the Petrov-Galerkin projection to preserve structural features of interest, including dissipativity, passivity, and bounded realness. The model reduction problem is formulated in a nonconvex optimization setting on a noncompact Stiefel manifold, aiming to minimize the $\mathcal{H}_2$ norm of the approximation error between the full-order and reduced-order models. The explicit expression for the gradient of the objective function is derived, and two gradient descent procedures are applied to seek for a (local) minimum, followed by a theoretical analysis on the convergence properties of the algorithms. Finally, the performance of the proposed method is demonstrated by two numerical examples which consider stability-preserving and passivity-preserving model reduction problems, respectively.


title: New measurement of the diffusion of carbon dioxide on non-porous amorphous solid water

abstract: The diffusion of molecules on interstellar grain surfaces is one of the most important driving forces for the molecular complexity in the interstellar medium. Due to the lack of laboratory measurements, astrochemical modeling of grain surface processes usually assumes a constant ratio between the diffusion energy barrier and the desorption energy. This over-simplification inevitably causes large uncertainty in model predictions. We present a new measurement of the diffusion of CO$_2$ molecules on the surface of non-porous amorphous solid water (np-ASW), an analog of the ice mantle that covers cosmic dust grains. A small coverage of CO$_2$ was deposited onto an np-ASW surface at 40~K, the subsequent warming of the ice activated the diffusion of CO$_2$ molecules, and a transition from isolated CO$_2$ to CO$_2$ clusters was seen in the infrared spectra. To obtain the diffusion energy barrier and pre-exponential factor simultaneously, a set of isothermal experiments were carried out. The values for the diffusion energy barrier and pre-exponential factor were found to be $1300\pm110$~K and $10^{7.6\pm0.8}$~s$^{-1}$. A comparison with prior laboratory measurements on diffusion is discussed.


title: Physics-based parameterized neural ordinary differential equations: prediction of laser ignition in a rocket combustor

abstract: In this work, we present a novel physics-based data-driven framework for reduced-order modeling of laser ignition in a model rocket combustor based on parameterized neural ordinary differential equations (PNODE). Deep neural networks are embedded as functions of high-dimensional parameters of laser ignition to predict various terms in a 0D flow model including the heat source function, pre-exponential factors, and activation energy. Using the governing equations of a 0D flow model, our PNODE needs only a limited number of training samples and predicts trajectories of various quantities such as temperature, pressure, and mass fractions of species while satisfying physical constraints. We validate our physics-based PNODE on solution snapshots of high-fidelity Computational Fluid Dynamics (CFD) simulations of laser-induced ignition in a prototype rocket combustor. We compare the performance of our physics-based PNODE with that of kernel ridge regression and fully connected neural networks. Our results show that our physics-based PNODE provides solutions with lower mean absolute errors of average temperature over time, thus improving the prediction of successful laser ignition with high-dimensional parameters.


title: Global Sensitivity Analysis of a coupled multiphysics model to predict surface evolution in fusion plasma-surface interactions

abstract: We construct a global sensitivity analysis framework for a coupled multiphysics model used to predict the changes in material properties and surface morphology of helium plasma-facing components in future fusion reactors. The model combines the particle dynamics simulator F-TRIDYN, that predicts the helium implantation profile, with the cluster dynamics simulator Xolotl, that predicts the growth and evolution of subsurface helium gas bubbles. In order to keep the sensitivity analysis tractable, we first construct a sparse, high-dimensional polynomial chaos expansion surrogate model for each output quantity of interest, which allows the efficient extraction of sensitivity information. The sensitivity analysis is performed for two problem settings: one for ITER-like conditions, and one that resembles conditions inside the PISCES-A linear plasma device. We present a systematic comparison of important parameters, for both F-TRIDYN and Xolotl in isolation as well as for the coupled model, and discuss the physical interpretation of these results.


title: Practical Contextual Bandits with Feedback Graphs

abstract: While contextual bandit has a mature theory, effectively leveraging different feedback patterns to enhance the pace of learning remains unclear. Bandits with feedback graphs, which interpolates between the full information and bandit regimes, provides a promising framework to mitigate the statistical complexity of learning. In this paper, we propose and analyze an approach to contextual bandits with feedback graphs based upon reduction to regression. The resulting algorithms are computationally practical and achieve established minimax rates, thereby reducing the statistical complexity in real-world applications.


title: jazznet: A Dataset of Fundamental Piano Patterns for Music Audio Machine Learning Research

abstract: This paper introduces the jazznet Dataset, a dataset of fundamental jazz piano music patterns for developing machine learning (ML) algorithms in music information retrieval (MIR). The dataset contains 162520 labeled piano patterns, including chords, arpeggios, scales, and chord progressions with their inversions, resulting in more than 26k hours of audio and a total size of 95GB. The paper explains the dataset's composition, creation, and generation, and presents an open-source Pattern Generator using a method called Distance-Based Pattern Structures (DBPS), which allows researchers to easily generate new piano patterns simply by defining the distances between pitches within the musical patterns. We demonstrate that the dataset can help researchers benchmark new models for challenging MIR tasks, using a convolutional recurrent neural network (CRNN) and a deep convolutional neural network. The dataset and code are available via: https://github.com/tosiron/jazznet.


title: Gaps in the support of canonical currents on projective K3 surfaces

abstract: We construct examples of canonical closed positive currents on projective K3 surfaces that are not fully supported on the complex points. The currents are the unique positive representatives in their cohomology classes and have vanishing self-intersection. The only previously known such examples were due to McMullen on non-projective K3 surfaces and were constructed using positive entropy automorphisms with a Siegel disk. Our construction is based on a Zassenhaus-type estimate for commutators of automorphisms.


title: Systematic research of low redshift optically selected SDSS Type-2 AGN but with apparent long-term optical variabilities from Catalina Sky Survey, I: data sample and basic results

abstract: The main objective of the paper, the first paper in a dedicated series, is to report basic results on systematic research of low-redshift optically selected SDSS Type-2 AGN but with apparent optical variabilities. For all the pipeline classified Type-2 AGN in SDSS DR16 with $z<0.3$ and $SN>10$, long-term optical V-band light curves are collected from Catalina Sky Survey. Through all light curves described by Damped Random Walk process with process parameters of $\sigma/(mag/days^{0.5})$ and $\tau/days$, 156 Type-2 AGN have apparent variabilities with process parameters at least three times larger than corresponding uncertainties and with $\ln(\sigma/(mag/days^{0.5}))>-4$, indicating central AGN activity regions directly in line-of-sight, leading the 156 Type-2 AGN as mis-classified Type-2 AGN. Furthermore, based on spectroscopic emission features around H$\alpha$, 31 out of the 156 AGN have broad H$\alpha$, indicating the 31 Type-2 AGN are actually Type-1.8/1.9 AGN. Meanwhile, 14 out of the 156 AGN have multi-epoch SDSS spectra. After checking multi-epoch spectra of the 14 objects, no clues for appearance/disappearance of broad lines indicate true Type-2 AGN rather than changing-look AGN are preferred in the collected Type-2 AGN with long-term variabilities. Moreover, a small sample of Type-2 AGN have long-term variabilities with features roughly described by theoretical TDEs expected $t^{-5/3}$, indicating probable central TDEs as further and strong evidence to support true Type-2 AGN.


title: Generative Causal Representation Learning for Out-of-Distribution Motion Forecasting

abstract: Conventional supervised learning methods typically assume i.i.d samples and are found to be sensitive to out-of-distribution (OOD) data. We propose Generative Causal Representation Learning (GCRL) which leverages causality to facilitate knowledge transfer under distribution shifts. While we evaluate the effectiveness of our proposed method in human trajectory prediction models, GCRL can be applied to other domains as well. First, we propose a novel causal model that explains the generative factors in motion forecasting datasets using features that are common across all environments and with features that are specific to each environment. Selection variables are used to determine which parts of the model can be directly transferred to a new environment without fine-tuning. Second, we propose an end-to-end variational learning paradigm to learn the causal mechanisms that generate observations from features. GCRL is supported by strong theoretical results that imply identifiability of the causal model under certain assumptions. Experimental results on synthetic and real-world motion forecasting datasets show the robustness and effectiveness of our proposed method for knowledge transfer under zero-shot and low-shot settings by substantially outperforming the prior motion forecasting models on out-of-distribution prediction. Our code is available at https://github.com/sshirahmad/GCRL.


title: On a Stable Method for Option Pricing: Discontinuous Petrov-Galerkin Method for Option Pricing and Sensitivity Analysis

abstract: The discontinuous Petrov Galerkin (DPG) methodology of Demkowicz and Gopalakrishnan introduced in their first paper has been widely used for problems in computational mechanics. In this investigation, we propose the DPG method for option pricing and sensitivity analysis under the basic Black-Scholes model. In this investigation, primal and ultra-weak formulation of the DPG method is derived for Vanilla options, American options, Asian options, and Barrier options. A wide range of standard numerical experiments is conducted to examine the convergence, stability, and efficiency of the proposed method for each one of the options separately. Besides, a C++ high performance (HPC) code for option pricing with the DPG method is developed which is available to the public to customize it for option pricing problems or other related problems.


title: High-frequency Matters: An Overwriting Attack and defense for Image-processing Neural Network Watermarking

abstract: In recent years, there has been significant advancement in the field of model watermarking techniques. However, the protection of image-processing neural networks remains a challenge, with only a limited number of methods being developed. The objective of these techniques is to embed a watermark in the output images of the target generative network, so that the watermark signal can be detected in the output of a surrogate model obtained through model extraction attacks. This promising technique, however, has certain limits. Analysis of the frequency domain reveals that the watermark signal is mainly concealed in the high-frequency components of the output. Thus, we propose an overwriting attack that involves forging another watermark in the output of the generative network. The experimental results demonstrate the efficacy of this attack in sabotaging existing watermarking schemes for image-processing networks, with an almost 100% success rate. To counter this attack, we devise an adversarial framework for the watermarking network. The framework incorporates a specially designed adversarial training step, where the watermarking network is trained to defend against the overwriting network, thereby enhancing its robustness. Additionally, we observe an overfitting phenomenon in the existing watermarking method, which can render it ineffective. To address this issue, we modify the training process to eliminate the overfitting problem.


title: Low Latency Video Denoising for Online Conferencing Using CNN Architectures

abstract: In this paper, we propose a pipeline for real-time video denoising with low runtime cost and high perceptual quality. The vast majority of denoising studies focus on image denoising. However, a minority of research works focusing on video denoising do so with higher performance costs to obtain higher quality while maintaining temporal coherence. The approach we introduce in this paper leverages the advantages of both image and video-denoising architectures. Our pipeline first denoises the keyframes or one-fifth of the frames using HI-GAN blind image denoising architecture. Then, the remaining four-fifths of the noisy frames and the denoised keyframe data are fed into the FastDVDnet video denoising model. The final output is rendered in the user's display in real-time. The combination of these low-latency neural network architectures produces real-time denoising with high perceptual quality with applications in video conferencing and other real-time media streaming systems. A custom noise detector analyzer provides real-time feedback to adapt the weights and improve the models' output.


title: Improving Transformer-based Networks With Locality For Automatic Speaker Verification

abstract: Recently, Transformer-based architectures have been explored for speaker embedding extraction. Although the Transformer employs the self-attention mechanism to efficiently model the global interaction between token embeddings, it is inadequate for capturing short-range local context, which is essential for the accurate extraction of speaker information. In this study, we enhance the Transformer with the enhanced locality modeling in two directions. First, we propose the Locality-Enhanced Conformer (LE-Confomer) by introducing depth-wise convolution and channel-wise attention into the Conformer blocks. Second, we present the Speaker Swin Transformer (SST) by adapting the Swin Transformer, originally proposed for vision tasks, into speaker embedding network. We evaluate the proposed approaches on the VoxCeleb datasets and a large-scale Microsoft internal multilingual (MS-internal) dataset. The proposed models achieve 0.75% EER on VoxCeleb 1 test set, outperforming the previously proposed Transformer-based models and CNN-based models, such as ResNet34 and ECAPA-TDNN. When trained on the MS-internal dataset, the proposed models achieve promising results with 14.6% relative reduction in EER over the Res2Net50 model.


title: Universal Three-Body Physics for Ultracold $^{87}$Rb-$^{40}$K Mixtures with Finite-range Interactions

abstract: The breakdown of Efimov universal relations between resonances and interference features in ultracold $^{40}$K-$^{87}$Rb mixtures has sparked much discussion. In this study, we investigate the atom-dimer elastic scattering and three-body recombination (TBR) rates with $J=0$ symmetry for a $^{87}$Rb-$^{87}$Rb-$^{40}$K system to understand the mechanisms underlying this breakdown. We use the R-matrix propagation method in a hyperspherical coordinate frame with the Lennard-Jones model potential describing the interactions between atoms. We extract the atom-dimer scattering length, cross sections and three-body recombination rates with a finite intraspecies scattering length. An atom-dimer elastic scattering resonance at negative interspecies scattering length is found, which is due to the presence of the near-threshold trimer state at the atom-dimer threshold ($^{40}$K + $^{87}$Rb$^{87}$Rb). In addition, we predict an Efimov recombination minima at positive interspecies scattering length, which is outside the range of previous measurements. Our calculations show that the breakdown of the universal relations predicted by zero-range theory can be attributed to the effective range corrections and finite intraspecies scattering length. The present results help elucidate the universal relations between Efimov features as well as the importance of finite-range corrections for mixed systems.


title: Transformer-based Generative Adversarial Networks in Computer Vision: A Comprehensive Survey

abstract: Generative Adversarial Networks (GANs) have been very successful for synthesizing the images in a given dataset. The artificially generated images by GANs are very realistic. The GANs have shown potential usability in several computer vision applications, including image generation, image-to-image translation, video synthesis, and others. Conventionally, the generator network is the backbone of GANs, which generates the samples and the discriminator network is used to facilitate the training of the generator network. The discriminator network is usually a Convolutional Neural Network (CNN). Whereas, the generator network is usually either an Up-CNN for image generation or an Encoder-Decoder network for image-to-image translation. The convolution-based networks exploit the local relationship in a layer, which requires the deep networks to extract the abstract features. Hence, CNNs suffer to exploit the global relationship in the feature space. However, recently developed Transformer networks are able to exploit the global relationship at every layer. The Transformer networks have shown tremendous performance improvement for several problems in computer vision. Motivated from the success of Transformer networks and GANs, recent works have tried to exploit the Transformers in GAN framework for the image/video synthesis. This paper presents a comprehensive survey on the developments and advancements in GANs utilizing the Transformer networks for computer vision applications. The performance comparison for several applications on benchmark datasets is also performed and analyzed. The conducted survey will be very useful to deep learning and computer vision community to understand the research trends \& gaps related with Transformer-based GANs and to develop the advanced GAN architectures by exploiting the global and local relationships for different applications.


title: Subjective Vertical Conflict Model with Visual Vertical: Predicting Motion Sickness on Autonomous Personal Mobility Vehicles

abstract: Passengers of level 3-5 autonomous personal mobility vehicles (APMV) can perform non-driving tasks, such as reading books and smartphones, while driving. It has been pointed out that such activities may increase motion sickness, especially when frequently avoiding pedestrians or obstacles in shared spaces. Many studies have been conducted to build countermeasures, of which various computational motion sickness models have been developed. Among them, models based on subjective vertical conflict (SVC) theory, which describes vertical changes in direction sensed by human sensory organs v.s. those expected by the central nervous system, have been actively developed. However, no current computational model can integrate visual vertical information with vestibular sensations. We proposed a 6 DoF SVC-VV model which added a visually perceived vertical block into a conventional 6 DoF SVC model to predict visual vertical directions from image data simulating the visual input of a human. In a driving experiment, 27 participants experienced an APMV with two visual conditions: looking ahead (LAD) and working with a tablet device (WAD). We verified that passengers got motion sickness while riding the APMV, and the symptom were severer when especially working on it, by simulating the frequent pedestrian avoidance scenarios of the APMV in the experiment. In addition, the results of the experiment demonstrated that the proposed 6 DoF SVC-VV model could describe the increased motion sickness experienced when the visual vertical and gravitational acceleration directions were different.


abstract: Spatio-temporal signals forecasting plays an important role in numerous domains, especially in neuroscience and transportation. The task is challenging due to the highly intricate spatial structure, as well as the non-linear temporal dynamics of the network. To facilitate reliable and timely forecast for the human brain and traffic networks, we propose the Fast Temporal Wavelet Graph Neural Networks (FTWGNN) that is both time- and memory-efficient for learning tasks on timeseries data with the underlying graph structure, thanks to the theories of multiresolution analysis and wavelet theory on discrete spaces. We employ Multiresolution Matrix Factorization (MMF) (Kondor et al., 2014) to factorize the highly dense graph structure and compute the corresponding sparse wavelet basis that allows us to construct fast wavelet convolution as the backbone of our novel architecture. Experimental results on real-world PEMS-BAY, METR-LA traffic datasets and AJILE12 ECoG dataset show that FTWGNN is competitive with the state-of-the-arts while maintaining a low computational footprint. Our PyTorch implementation is publicly available at https://github.com/HySonLab/TWGNN


title: Codes Correcting Burst and Arbitrary Erasures for Reliable and Low-Latency Communication

abstract: Motivated by modern network communication applications which require low latency, we study codes that correct erasures with low decoding delay. We provide a simple explicit construction that yields convolutional codes that can correct both burst and arbitrary erasures under a maximum decoding delay constraint $T$. Our proposed code has efficient encoding/decoding algorithms and requires a field size that is linear in $T$. We study the performance of our code over the Gilbert-Elliot channel; our simulation results show significant performance gains over low-delay codes existing in the literature.


title: Semantic Communications with Variable-Length Coding for Extended Reality

abstract: Wireless extended reality (XR) has attracted wide attentions as a promising technology to improve users' mobility and quality of experience. However, the ultra-high data rate requirement of wireless XR has hindered its development for many years. To overcome this challenge, we develop a semantic communication framework, where semantically-unimportant information is highly-compressed or discarded in semantic coders, significantly improving the transmission efficiency. Besides, considering the fact that some source content may have less amount of semantic information or have higher tolerance to channel noise, we propose a universal variable-length semantic-channel coding method. In particular, we first use a rate allocation network to estimate the best code length for semantic information and then adjust the coding process accordingly. By adopting some proxy functions, the whole framework is trained in an end-to-end manner. Numerical results show that our semantic system significantly outperforms traditional transmission methods and the proposed variable-length coding scheme is superior to the fixed-length coding methods.


title: AutoFed: Heterogeneity-Aware Federated Multimodal Learning for Robust Autonomous Driving

abstract: Object detection with on-board sensors (e.g., lidar, radar, and camera) play a crucial role in autonomous driving (AD), and these sensors complement each other in modalities. While crowdsensing may potentially exploit these sensors (of huge quantity) to derive more comprehensive knowledge, \textit{federated learning} (FL) appears to be the necessary tool to reach this potential: it enables autonomous vehicles (AVs) to train machine learning models without explicitly sharing raw sensory data. However, the multimodal sensors introduce various data heterogeneity across distributed AVs (e.g., label quantity skews and varied modalities), posing critical challenges to effective FL. To this end, we present AutoFed as a heterogeneity-aware FL framework to fully exploit multimodal sensory data on AVs and thus enable robust AD. Specifically, we first propose a novel model leveraging pseudo-labeling to avoid mistakenly treating unlabeled objects as the background. We also propose an autoencoder-based data imputation method to fill missing data modality (of certain AVs) with the available ones. To further reconcile the heterogeneity, we finally present a client selection mechanism exploiting the similarities among client models to improve both training stability and convergence rate. Our experiments on benchmark dataset confirm that AutoFed substantially improves over status quo approaches in both precision and recall, while demonstrating strong robustness to adverse weather conditions.


title: Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Hierarchical Structures

abstract: Contemporary graph learning algorithms are not well-defined for large molecules since they do not consider the hierarchical interactions among the atoms, which are essential to determine the molecular properties of macromolecules. In this work, we propose Multiresolution Graph Transformers (MGT), the first graph transformer architecture that can learn to represent large molecules at multiple scales. MGT can learn to produce representations for the atoms and group them into meaningful functional groups or repeating units. We also introduce Wavelet Positional Encoding (WavePE), a new positional encoding method that can guarantee localization in both spectral and spatial domains. Our proposed model achieves competitive results on two macromolecule datasets consisting of polymers and peptides, and one drug-like molecule dataset. Importantly, our model outperforms other state-of-the-art methods and achieves chemical accuracy in estimating molecular properties (e.g., GAP, HOMO and LUMO) calculated by Density Functional Theory (DFT) in the polymers dataset. Furthermore, the visualizations, including clustering results on macromolecules and low-dimensional spaces of their representations, demonstrate the capability of our methodology in learning to represent long-range and hierarchical structures. Our PyTorch implementation is publicly available at https://github.com/HySonLab/Multires-Graph-Transformer


title: Verification and Validation of a Rapid Design Tool for the Analysis of the Composite Y-Joint of the D8 Double-Bubble Aircraft

abstract: Polymer composite joints are critical aerospace components for reinforcing lightweight structures and achieving high eco-efficiency transportation standards. Optimizing complex structural joints is an iterative process. Fast and reliable numerical approaches are needed to overcome the runtime limitations of high-fidelity Finite Element (FE) modeling. This work proposes a computationally efficient approach based on the design tool, HyperX. Verification against FE models and experimental validation are presented for the composite Y-joint in the D8 double bubble fuselage. Results show that the failure load of the Y-joint is predicted within 10% of the experimental failure load recorded. Two parametric studies are performed to study the effects of the curvature of the joint (110{\deg} - 160{\deg}) and the skin thickness (16ply, 24ply, 32ply) in the failure load predictions using a stress-based failure criterion. The maximum failure load occurred for a Y-joint with 130{\deg} curvature. The 32ply skin Y-joint was predicted to have the highest failure load. Results prove the applicability of rapid joint optimization analysis for faster, computationally efficient design.


title: $(p-1)$-Bracket for D$p$-branes in Large R-R Field Background

abstract: The volume-preserving diffeomorphism is a key feature that characterizes the large constant R-R ($p-1$)-form field background in a D$p$-brane theory. It represents a symmetry of the theory that preserves the volume of space. To describe this symmetry, we introduce the concept of the ($p-1$)-bracket, which generates the volume-preserving diffeomorphism. The ($p-1$)-bracket is a mathematical operation that acts on ($p-1$)-forms and encodes the transformation of the background field under the symmetry. To generalize the ($p-1$)-bracket, we can apply it to the non-Abelian one-form gauge field, which is relevant in gauge theories with non-Abelian gauge groups. This allows us to extend the concept of volume-preserving diffeomorphism and its associated symmetry to non-Abelian gauge theories. When considering D-branes and T-duality, we introduce the transverse coordinates of the branes. By incorporating T-duality and the generalized bracket, a general expression for the action in D$p$-branes can be derived when $p\le 6$. This result connects the existing construction of D$p$-branes with our generalized bracket, illustrating the relationship between the symmetry and its associated transformations and the dynamics of the branes. In addition, we can discuss the non-Abelianization of the ($p-2$)-form gauge potential. This process involves generalizing the concept of non-Abelian gauge fields to higher-form gauge potentials. By extending the Lagrangian description of a single D-brane to multiple D-branes, a similar Lagrangian description can be established for both cases, highlighting the common underlying structure and symmetry properties. Our developments demonstrate the interplay between symmetries, gauge fields, and D-brane dynamics, providing a deeper understanding of the underlying principles within D-branes.


title: Gaussian-smoothed Imbalance Data Improves Speech Emotion Recognition

abstract: In speech emotion recognition tasks, models learn emotional representations from datasets. We find the data distribution in the IEMOCAP dataset is very imbalanced, which may harm models to learn a better representation. To address this issue, we propose a novel Pairwise-emotion Data Distribution Smoothing (PDDS) method. PDDS considers that the distribution of emotional data should be smooth in reality, then applies Gaussian smoothing to emotion-pairs for constructing a new training set with a smoother distribution. The required new data are complemented using the mixup augmentation. As PDDS is model and modality agnostic, it is evaluated with three SOTA models on the IEMOCAP dataset. The experimental results show that these models are improved by 0.2\% - 4.8\% and 1.5\% - 5.9\% in terms of WA and UA. In addition, an ablation study demonstrates that the key advantage of PDDS is the reasonable data distribution rather than a simple data augmentation.


title: A Statistical Fields Theory underlying the Thermodynamics of Ricci Flow and Gravity

abstract: The paper proposes a statistical fields theory of quantum reference frame underlying the Perelman's analogies between his formalism of the Ricci flow and the thermodynamics. The theory is based on a d=4-{\epsilon} quantum non-linear sigma model, interpreted as a quantum reference frame system which a to-be-studied quantum system is relative to. The statistic physics and thermodynamics of the quantum frame fields is studied by the density matrix obtained by the Gaussian approximation. The induced Ricci flow of the frame fields and the Ricci-DeTurck flow of the frame fields associated with the density matrix is deduced. In this framework, the diffeomorphism anomaly of the theory has a deep thermodynamic interpretation. The trace anomaly is related to a Shannon entropy in terms of the density matrix, which monotonically flows and achieves its maximal value at the flow limit, called the Gradient Shrinking Ricci Soliton (GSRS), corresponding to a thermal equilibrium state of spacetime. A relative Shannon entropy w.r.t. the maximal entropy gives a statistical interpretation to Perelman's partition function, which is also monotonic and gives an analogous H-theorem to the statistical frame fields system. A temporal static 3-space of a GSRS 4-spacetime is also a GSRS in lower 3-dimensional, we find that it is in a thermal equilibrium state, and Perelman's analogies between his formalism and the thermodynamics of the frame fields in equilibrium can be explicitly given in the framework. Extending the validity of the Equivalence Principle to the quantum level, the quantum frame fields theory at low energy gives an effective theory of gravity, a scale dependent Einstein-Hilbert action plus a cosmological constant is recovered. As a possible underlying microscopic theory of gravity, the theory is also applied to understand the thermodynamics of the Schwarzschild black hole.


title: Minimizing Dynamic Regret on Geodesic Metric Spaces

abstract: In this paper, we consider the sequential decision problem where the goal is to minimize the general dynamic regret on a complete Riemannian manifold. The task of offline optimization on such a domain, also known as a geodesic metric space, has recently received significant attention. The online setting has received significantly less attention, and it has remained an open question whether the body of results that hold in the Euclidean setting can be transplanted into the land of Riemannian manifolds where new challenges (e.g., curvature) come into play. In this paper, we show how to get optimistic regret bound on manifolds with non-positive curvature whenever improper learning is allowed and propose an array of adaptive no-regret algorithms. To the best of our knowledge, this is the first work that considers general dynamic regret and develops "optimistic" online learning algorithms which can be employed on geodesic metric spaces.


title: Neutral and Doubly-Charged Scalars at Future Lepton Colliders

abstract: Many new physics scenarios beyond the Standard Model (BSM) necessitate the existence of new neutral and/or charged scalar fields, which might couple to the SM charged leptons (but not hadrons), and thus, can give rise to BSM signals while evading strong constraints mostly coming from the hadronic sector. I show that future lepton colliders provide a clean environment to probe these leptophilic new scalars via multi-lepton final states, including some interesting lepton flavor violating (LFV) channels. I also study the kinematic distributions of the final state leptons to distinguish the BSM contributions from neutral and doubly-charged scalars giving rise to the same final state, as well as from the irreducible SM background.


title: Spark plasma sintering synthesis of ReB2-type medium-entropy diboride (W1/3Re1/3Ru1/3)B2 with high hardness

abstract: A new medium-entropy diboride (MEDB) (W1/3Re1/3Ru1/3)B2 has been synthesized by spark plasma sintering of elemental powders at 1600 oC. Despite the dissimilar structures of WB2, ReB2 and RuB2, the sintered MEDB consists of a single hexagonal ReB2-type phase (space group P63/mmc) with a relative density of 94.2% and an average grain size of 6.8 $\pm$ 2.2 um. Structural refinement and electron microscopy measurements show that the W, Re, and Ru atoms occupy the same crystallographic site and are distributed uniformly in the lattice. The (W1/3Re1/3Ru1/3)B2 MEDB has Vickers hardnesses of 30.7 GPa at a load of 0.49 N and 20.5 GPa at a load of 9.8 N, which are comparable or higher than those reported for individual binary counterparts.


title: Detection of entanglement for multipartite quantum states

abstract: We study genuine tripartite entanglement and multipartite entanglement of arbitrary $n$-partite quantum states by using the representations with generalized Pauli operators of a density matrices. While the usual Bloch representation of a density matrix uses three types of generators in the special unitary Lie algebra $\mathfrak{su}(d)$, the representation with generalized Pauli operators has one uniformed type of generators and it simplifies computation. In this paper, we take the advantage of this simplicity to derive useful and operational criteria to detect genuine tripartite entanglement. We also obtain a sufficient criterion to detect entanglement for multipartite quantum states in arbitrary dimensions. The new method can detect more entangled states than previous methods as backed by detailed examples.


title: Towards Efficient Alternating Current Optimal Power Flow Analysis on Graphical Processing Units

abstract: We present a solution of sparse alternating current optimal power flow (ACOPF) analysis on graphical processing unit (GPU). In particular, we discuss the performance bottlenecks and detail our efforts to accelerate the linear solver, a core component of ACOPF that dominates the computational time. ACOPF analyses of two large-scale systems, synthetic Northeast (25,000 buses) and Eastern (70,000 buses) U.S. grids [1], on GPU show promising speed-up compared to analyses on central processing unit (CPU) using a state-of-the-art solver. To our knowledge, this is the first result demonstrating a significant acceleration of sparse ACOPF on GPUs.


title: Late Accretion of Ceres-like Asteroids and Their Implantation into the Outer Main Belt

abstract: Low-albedo asteroids preserve a record of the primordial solar system planetesimals and the conditions in which the solar nebula was active. However, the origin and evolution of these asteroids are not well-constrained. Here we measured visible and near-infrared (0.5 - 4.0 microns) spectra of low-albedo asteroids in the mid-outer main belt. We show that numerous large (d > 100 km) and dark (geometric albedo < 0.09) asteroids exterior to the dwarf planet Ceres' orbit share the same spectral features, and presumably compositions, as Ceres. We also developed a thermal evolution model that demonstrates that these Ceres-like asteroids have highly-porous interiors, accreted relatively late at 1.5 - 3.5 Myr after the formation of calcium-aluminum-rich inclusions, and experienced maximum interior temperatures of < 900 K. Ceres-like asteroids are localized in a confined heliocentric region between 3.0 - 3.4 au but were likely implanted from more distant regions of the solar system during the giant planet's dynamical instability.


title: Online Spatio-Temporal Correlation-Based Federated Learning for Traffic Flow Forecasting

abstract: Traffic flow forecasting (TFF) is of great importance to the construction of Intelligent Transportation Systems (ITS). To mitigate communication burden and tackle with the problem of privacy leakage aroused by centralized forecasting methods, Federated Learning (FL) has been applied to TFF. However, existing FL-based approaches employ batch learning manner, which makes the pre-trained models inapplicable to subsequent traffic data, thus exhibiting subpar prediction performance. In this paper, we perform the first study of forecasting traffic flow adopting Online Learning (OL) manner in FL framework and then propose a novel prediction method named Online Spatio-Temporal Correlation-based Federated Learning (FedOSTC), aiming to guarantee performance gains regardless of traffic fluctuation. Specifically, clients employ Gated Recurrent Unit (GRU)-based encoders to obtain the internal temporal patterns inside traffic data sequences. Then, the central server evaluates spatial correlation among clients via Graph Attention Network (GAT), catering to the dynamic changes of spatial closeness caused by traffic fluctuation. Furthermore, to improve the generalization of the global model for upcoming traffic data, a period-aware aggregation mechanism is proposed to aggregate the local models which are optimized using Online Gradient Descent (OGD) algorithm at clients. We perform comprehensive experiments on two real-world datasets to validate the efficiency and effectiveness of our proposed method and the numerical results demonstrate the superiority of FedOSTC.


title: Uncertainty-aware Self-training for Low-resource Neural Sequence Labeling

abstract: Neural sequence labeling (NSL) aims at assigning labels for input language tokens, which covers a broad range of applications, such as named entity recognition (NER) and slot filling, etc. However, the satisfying results achieved by traditional supervised-based approaches heavily depend on the large amounts of human annotation data, which may not be feasible in real-world scenarios due to data privacy and computation efficiency issues. This paper presents SeqUST, a novel uncertain-aware self-training framework for NSL to address the labeled data scarcity issue and to effectively utilize unlabeled data. Specifically, we incorporate Monte Carlo (MC) dropout in Bayesian neural network (BNN) to perform uncertainty estimation at the token level and then select reliable language tokens from unlabeled data based on the model confidence and certainty. A well-designed masked sequence labeling task with a noise-robust loss supports robust training, which aims to suppress the problem of noisy pseudo labels. In addition, we develop a Gaussian-based consistency regularization technique to further improve the model robustness on Gaussian-distributed perturbed representations. This effectively alleviates the over-fitting dilemma originating from pseudo-labeled augmented data. Extensive experiments over six benchmarks demonstrate that our SeqUST framework effectively improves the performance of self-training, and consistently outperforms strong baselines by a large margin in low-resource scenarios


title: Improved Recursive Algorithms for V-BLAST to Save Computations and Memories

abstract: For vertical Bell Laboratories layered space-time architecture (V-BLAST), the original fast recursive algorithm was proposed, and then Improvements I-IV were introduced to further reduce the complexity. The existing recursive algorithm with speed advantage and that with memory saving incorporate Improvements I-IV and only Improvements III-IV into the original algorithm, respectively. This paper proposes Improvements V and VI to replace Improvements I and II, respectively. Instead of the lemma for inversion of partitioned matrix applied in Improvement I, Improvement V uses another lemma to speed up the matrix inversion step by 167%. Then the formulas adopted in our Improvement V are applied to deduce Improvement VI for interference cancellation, which saves memories without sacrificing speed compared to Improvement II. In the existing algorithm with speed advantage, the proposed algorithm I with speed advantage replaces Improvement I with Improvement V, while the proposed algorithm II with both speed advantage and memory saving replaces Improvements I and II with Improvements V and VI, respectively. Both proposed algorithms speed up the existing algorithm with speed advantage by 130%, while the proposed algorithm II achieves the speedup of 186% and saves about half memories, compared to the existing algorithm with memory saving.


title: Subsampling Suffices for Adaptive Data Analysis

abstract: Ensuring that analyses performed on a dataset are representative of the entire population is one of the central problems in statistics. Most classical techniques assume that the dataset is independent of the analyst's query and break down in the common setting where a dataset is reused for multiple, adaptively chosen, queries. This problem of \emph{adaptive data analysis} was formalized in the seminal works of Dwork et al. (STOC, 2015) and Hardt and Ullman (FOCS, 2014). We identify a remarkably simple set of assumptions under which the queries will continue to be representative even when chosen adaptively: The only requirements are that each query takes as input a random subsample and outputs few bits. This result shows that the noise inherent in subsampling is sufficient to guarantee that query responses generalize. The simplicity of this subsampling-based framework allows it to model a variety of real-world scenarios not covered by prior work. In addition to its simplicity, we demonstrate the utility of this framework by designing mechanisms for two foundational tasks, statistical queries and median finding. In particular, our mechanism for answering the broadly applicable class of statistical queries is both extremely simple and state of the art in many parameter regimes.


title: Find Beauty in the Rare: Contrastive Composition Feature Clustering for Nontrivial Cropping Box Regression

abstract: Automatic image cropping algorithms aim to recompose images like human-being photographers by generating the cropping boxes with improved composition quality. Cropping box regression approaches learn the beauty of composition from annotated cropping boxes. However, the bias of annotations leads to quasi-trivial recomposing results, which has an obvious tendency to the average location of training samples. The crux of this predicament is that the task is naively treated as a box regression problem, where rare samples might be dominated by normal samples, and the composition patterns of rare samples are not well exploited. Observing that similar composition patterns tend to be shared by the cropping boundaries annotated nearly, we argue to find the beauty of composition from the rare samples by clustering the samples with similar cropping boundary annotations, ie, similar composition patterns. We propose a novel Contrastive Composition Clustering (C2C) to regularize the composition features by contrasting dynamically established similar and dissimilar pairs. In this way, common composition patterns of multiple images can be better summarized, which especially benefits the rare samples and endows our model with better generalizability to render nontrivial results. Extensive experimental results show the superiority of our model compared with prior arts. We also illustrate the philosophy of our design with an interesting analytical visualization.


title: Performance comparison of the two reconstruction methods for stabilizer-based quantum secret sharing

abstract: Stabilizer-based quantum secret sharing has two methods to reconstruct a quantum secret: The erasure correcting procedure and the unitary procedure. It is known that the unitary procedure has a smaller circuit width. On the other hand, it is unknown which method has smaller depth and fewer circuit gates. In this paper, it is shown that the unitary procedure has smaller depth and fewer circuit gates when the circuits are designed for quantum secret sharing using $[[5, 1, 3]]$ binary stabilizer codes.


title: Socialz: Multi-Feature Social Fuzz Testing

abstract: Online social networks have become an integral aspect of our daily lives and play a crucial role in shaping our relationships with others. However, bugs and glitches, even minor ones, can cause anything from frustrating problems to serious data leaks that can have far-reaching impacts on millions of users. To mitigate these risks, fuzz testing, a method of testing with randomised inputs, can provide increased confidence in the correct functioning of a social network. However, implementing traditional fuzz testing methods can be prohibitively difficult or impractical for programmers outside of the network's development team. To tackle this challenge, we present Socialz, a novel approach to social fuzz testing that (1) characterises real users of a social network, (2) diversifies their interaction using evolutionary computation across multiple, non-trivial features, and (3) collects performance data as these interactions are executed. With Socialz, we aim to provide anyone with the capability to perform comprehensive social testing, thereby improving the reliability and security of online social networks used around the world.


title: Control of the magnon-polariton hybridization with a microwave pump

abstract: Pump-induced magnon modes (PIMs) are recently discovered elementary excitations in ferrimagnets that offer significant tunability to spin dynamics. Here, we investigate the coupling between a PIM and cavity magnon polaritons (CMPs) by driving a cavity magnonic system away from equilibrium with a microwave pump. In our experiment, the Walker mode simultaneously couples with the PIM and cavity photons and thus combines two strongly coherent coupling processes in a single cavity structure. Such a PIM-CMP hybridization system acquires complementary properties from both the PIM and CMPs, allowing it to be freely manipulated by the magnetic field, the pump power and the pump frequency. These coherent manipulations exhibit unique behaviors beyond the intrinsic properties limited by the material nature and electromagnetic boundary conditions, thereby creating opportunities for extending the control of hybrid devices.


title: Quantum computing for data science

abstract: I provide a perspective on the development of quantum computing for data science, including a dive into state-of-the-art for both hardware and algorithms and the potential for quantum machine learning


title: Neutron skin thickness of $^{116,118,120,122,124}$Sn determined from reaction cross sections of proton scattering

abstract: The cross sections of SDR in the Sb isotopes have been measured. Within the model used, the neutron-skin thicknesses $r_{\rm skin}({\rm exp})$ deduced $0.12 \pm 0.06$fm for $^{116}$Sn, $0.13 \pm 0.06$fm for $^{118}$Sn, $0.18 \pm 0.07$fm for $^{120}$Sn, $0.22 \pm 0.07$fm for $^{122}$Sn, $0.19 \pm 0.07$fm for $^{124}$Sn. We tested the chiral (Kyushu) $g$-matrix folding model for $^{12}$C+$^{12}$C scattering, and found that the Kyushu $g$-matrix folding model is reliable for reaction cross sections $\sigma_{\rm R}$ in $30 < E_{\rm in} < 100 $MeV and $250 < E_{\rm in} < 400$MeV. We determine neutron skin thickness $r_{\rm skin}({\rm exp})$, using measured $\sigma_{\rm R}$ of $^{4}$He+$^{116,120,224}$Sn scattering. The results are $r_{\rm skin}({\rm exp})=0.242 \pm 0.140$fm for $^{116}$Sn, $r_{\rm skin}({\rm exp})=0.377 \pm 0.140$fm for $^{120}$Sn, $r_{\rm skin}({\rm exp})=0.180 \pm 0.142$fm for $^{124}$Sn. The $\sigma_{\rm R}$ are available for proton scattering on $^{116,118,120,122,124}$Sn with high accuracy. Our aim is to determine $r_{\rm skin}({\rm exp})$ for $^{116,118,120,122,124}$Sn with small errors by using the Kyushu $g$-matrix folding model. Our model is the folding model with the densities scaled from the D1S-GHFB+AMP neutron density. The proton radii of D1S-GHFB+AMP agree with those calculated with the isotope shift method based on the electron scattering. We then scale the neutron densities so as to reproduce the $\sigma_{\rm R}({\rm exp})$. In $30 < E_{\rm in} < 65$MeV, we determine $r_{\rm skin}({\rm exp})$ from measured $\sigma_{\rm R}$. The values are $r_{\rm skin}({\rm exp})=0.118 \pm 0.021$~fm for $^{116}$Sn, $0.112 \pm 0.021$fm for $^{118}$Sn, $0.124 \pm 0.021$fm for $^{120}$Sn, $0.156 \pm 0.022$fm for $^{124}$Sn. As for $^{122}$Sn, the skin value in $30 < E_{\rm in} < 50$MeV is $0.122 \pm 0.024$fm. Our results are consistent with the previous values.


title: Epidemic control in networks with cliques

abstract: Social units, such as households and schools, can play an important role in controlling epidemic outbreaks. In this work, we study an epidemic model with a prompt quarantine measure on networks with cliques (a $clique$ is a fully connected subgraph representing a social unit). According to this strategy, newly infected individuals are detected and quarantined (along with their close contacts) with probability $f$. Numerical simulations reveal that epidemic outbreaks in networks with cliques are abruptly suppressed at a transition point $f_c$. However, small outbreaks show features of a second-order phase transition around $f_c$. Therefore, our model can exhibit properties of both discontinuous and continuous phase transitions. Next, we show analytically that the probability of small outbreaks goes continuously to 1 at $f_c$ in the thermodynamic limit. Finally, we find that our model exhibits a backward bifurcation phenomenon.


title: Learning to Forecast Aleatoric and Epistemic Uncertainties over Long Horizon Trajectories

abstract: Giving autonomous agents the ability to forecast their own outcomes and uncertainty will allow them to communicate their competencies and be used more safely. We accomplish this by using a learned world model of the agent system to forecast full agent trajectories over long time horizons. Real world systems involve significant sources of both aleatoric and epistemic uncertainty that compound and interact over time in the trajectory forecasts. We develop a deep generative world model that quantifies aleatoric uncertainty while incorporating the effects of epistemic uncertainty during the learning process. We show on two reinforcement learning problems that our uncertainty model produces calibrated outcome uncertainty estimates over the full trajectory horizon.


title: Cascaded information enhancement and cross-modal attention feature fusion for multispectral pedestrian detection

abstract: Multispectral pedestrian detection is a technology designed to detect and locate pedestrians in Color and Thermal images, which has been widely used in automatic driving, video surveillance, etc. So far most available multispectral pedestrian detection algorithms only achieved limited success in pedestrian detection because of the lacking take into account the confusion of pedestrian information and background noise in Color and Thermal images. Here we propose a multispectral pedestrian detection algorithm, which mainly consists of a cascaded information enhancement module and a cross-modal attention feature fusion module. On the one hand, the cascaded information enhancement module adopts the channel and spatial attention mechanism to perform attention weighting on the features fused by the cascaded feature fusion block. Moreover, it multiplies the single-modal features with the attention weight element by element to enhance the pedestrian features in the single-modal and thus suppress the interference from the background. On the other hand, the cross-modal attention feature fusion module mines the features of both Color and Thermal modalities to complement each other, then the global features are constructed by adding the cross-modal complemented features element by element, which are attentionally weighted to achieve the effective fusion of the two modal features. Finally, the fused features are input into the detection head to detect and locate pedestrians. Extensive experiments have been performed on two improved versions of annotations (sanitized annotations and paired annotations) of the public dataset KAIST. The experimental results show that our method demonstrates a lower pedestrian miss rate and more accurate pedestrian detection boxes compared to the comparison method. Additionally, the ablation experiment also proved the effectiveness of each module designed in this paper.


title: Search to Capture Long-range Dependency with Stacking GNNs for Graph Classification

abstract: In recent years, Graph Neural Networks (GNNs) have been popular in the graph classification task. Currently, shallow GNNs are more common due to the well-known over-smoothing problem facing deeper GNNs. However, they are sub-optimal without utilizing the information from distant nodes, i.e., the long-range dependencies. The mainstream methods in the graph classification task can extract the long-range dependencies either by designing the pooling operations or incorporating the higher-order neighbors, while they have evident drawbacks by modifying the original graph structure, which may result in information loss in graph structure learning. In this paper, by justifying the smaller influence of the over-smoothing problem in the graph classification task, we evoke the importance of stacking-based GNNs and then employ them to capture the long-range dependencies without modifying the original graph structure. To achieve this, two design needs are given for stacking-based GNNs, i.e., sufficient model depth and adaptive skip-connection schemes. By transforming the two design needs into designing data-specific inter-layer connections, we propose a novel approach with the help of neural architecture search (NAS), which is dubbed LRGNN (Long-Range Graph Neural Networks). Extensive experiments on five datasets show that the proposed LRGNN can achieve the best performance, and obtained data-specific GNNs with different depth and skip-connection schemes, which can better capture the long-range dependencies.


title: Multimodal Subtask Graph Generation from Instructional Videos

abstract: Real-world tasks consist of multiple inter-dependent subtasks (e.g., a dirty pan needs to be washed before it can be used for cooking). In this work, we aim to model the causal dependencies between such subtasks from instructional videos describing the task. This is a challenging problem since complete information about the world is often inaccessible from videos, which demands robust learning mechanisms to understand the causal structure of events. We present Multimodal Subtask Graph Generation (MSG2), an approach that constructs a Subtask Graph defining the dependency between a task's subtasks relevant to a task from noisy web videos. Graphs generated by our multimodal approach are closer to human-annotated graphs compared to prior approaches. MSG2 further performs the downstream task of next subtask prediction 85% and 30% more accurately than recent video transformer models in the ProceL and CrossTask datasets, respectively.


title: A Probabilistic Generative Model for Tracking Multi-Knowledge Concept Mastery Probability

abstract: Knowledge tracing aims to track students' knowledge status over time to predict students' future performance accurately. Markov chain-based knowledge tracking (MCKT) models can track knowledge concept mastery probability over time. However, as the number of tracked knowledge concepts increases, the time complexity of MCKT predicting student performance increases exponentially (also called explaining away problem. In addition, the existing MCKT models only consider the relationship between students' knowledge status and problems when modeling students' responses but ignore the relationship between knowledge concepts in the same problem. To address these challenges, we propose an inTerpretable pRobAbilistiC gEnerative moDel (TRACED), which can track students' numerous knowledge concepts mastery probabilities over time. To solve \emph{explain away problem}, we design Long and Short-Term Memory (LSTM)-based networks to approximate the posterior distribution, predict students' future performance, and propose a heuristic algorithm to train LSTMs and probabilistic graphical model jointly. To better model students' exercise responses, we proposed a logarithmic linear model with three interactive strategies, which models students' exercise responses by considering the relationship among students' knowledge status, knowledge concept, and problems. We conduct experiments with four real-world datasets in three knowledge-driven tasks. The experimental results show that TRACED outperforms existing knowledge tracing methods in predicting students' future performance and can learn the relationship among students, knowledge concepts, and problems from students' exercise sequences. We also conduct several case studies. The case studies show that TRACED exhibits excellent interpretability and thus has the potential for personalized automatic feedback in the real-world educational environment.


title: EnfoMax: Domain Entropy and Mutual Information Maximization for Domain Generalized Face Anti-spoofing

abstract: The face anti-spoofing (FAS) method performs well under intra-domain setups. However, its cross-domain performance is unsatisfactory. As a result, the domain generalization (DG) method has gained more attention in FAS. Existing methods treat FAS as a simple binary classification task and propose a heuristic training objective to learn domain-invariant features. However, there is no theoretical explanation of what a domain-invariant feature is. Additionally, the lack of theoretical support makes domain generalization techniques such as adversarial training lack training stability. To address these issues, this paper proposes the EnfoMax framework, which uses information theory to analyze cross-domain FAS tasks. This framework provides theoretical guarantees and optimization objectives for domain-generalized FAS tasks. EnfoMax maximizes the domain entropy and mutual information of live samples in source domains without using adversarial learning. Experimental results demonstrate that our approach performs well on extensive public datasets and outperforms state-of-the-art methods.


title: DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction

abstract: Document-level relation extraction (DocRE) is the task of identifying all relations between each entity pair in a document. Evidence, defined as sentences containing clues for the relationship between an entity pair, has been shown to help DocRE systems focus on relevant texts, thus improving relation extraction. However, evidence retrieval (ER) in DocRE faces two major issues: high memory consumption and limited availability of annotations. This work aims at addressing these issues to improve the usage of ER in DocRE. First, we propose DREEAM, a memory-efficient approach that adopts evidence information as the supervisory signal, thereby guiding the attention modules of the DocRE system to assign high weights to evidence. Second, we propose a self-training strategy for DREEAM to learn ER from automatically-generated evidence on massive data without evidence annotations. Experimental results reveal that our approach exhibits state-of-the-art performance on the DocRED benchmark for both DocRE and ER. To the best of our knowledge, DREEAM is the first approach to employ ER self-training.


title: Efficient Approximation of Certain and Possible Answers for Ranking and Window Queries over Uncertain Data (Extended version)

abstract: Uncertainty arises naturally inmany application domains due to, e.g., data entry errors and ambiguity in data cleaning. Prior work in incomplete and probabilistic databases has investigated the semantics and efficient evaluation of ranking and top-k queries over uncertain data. However, most approaches deal with top-k and ranking in isolation and do represent uncertain input data and query results using separate, incompatible datamodels. We present an efficient approach for under- and over-approximating results of ranking, top-k, and window queries over uncertain data. Our approach integrates well with existing techniques for querying uncertain data, is efficient, and is to the best of our knowledge the first to support windowed aggregation. We design algorithms for physical operators for uncertain sorting and windowed aggregation, and implement them in PostgreSQL.We evaluated our approach on synthetic and real world datasets, demonstrating that it outperforms all competitors, and often produces more accurate results.


title: Inverse-current quantum electro-oscillations in a charge-density wave insulator

abstract: Quantum magneto-oscillations have long been a vital subject in condensed matter physics, with ubiquitous quantum phenomena and diverse underlying physical mechanisms. Here, we demonstrate the intrinsic and reproducible DC-current-driven quantum electro-oscillations with a periodicity in the inverse of the current (1/I), in quasi-one-dimensional charge-density-wave (CDW) insulators (TaSe$_4$)$_2$I and TaS$_3$ nanowires. Such oscillations manifest in the nearly infinite Fr\"ohlich conductivity region where the undamped CDW flow forms in a finite electric current, and finally disappear after the oscillation index n reaches 1. A systematic investigation on the effect of temperature and magnetic field establishes that the observed electro-oscillations are a coherent quantum phenomenon. We discuss the possibilities of the physical mechanisms, including the formation of sliding-driven inherent Floquet sidebands. Our results introduce a new member in the family of quantum oscillations, and shed light on plausible avenues to explore novel physics and potential applications of coherent density-wave condensates.


title: Multi-Behavior Graph Neural Networks for Recommender System

abstract: Recommender systems have been demonstrated to be effective to meet user's personalized interests for many online services (e.g., E-commerce and online advertising platforms). Recent years have witnessed the emerging success of many deep learning-based recommendation models for augmenting collaborative filtering architectures with various neural network architectures, such as multi-layer perceptron and autoencoder. However, the majority of them model the user-item relationship with single type of interaction, while overlooking the diversity of user behaviors on interacting with items, which can be click, add-to-cart, tag-as-favorite and purchase. Such various types of interaction behaviors have great potential in providing rich information for understanding the user preferences. In this paper, we pay special attention on user-item relationships with the exploration of multi-typed user behaviors. Technically, we contribute a new multi-behavior graph neural network (MBRec), which specially accounts for diverse interaction patterns as well as the underlying cross-type behavior inter-dependencies. In the MBRec framework, we develop a graph-structured learning framework to perform expressive modeling of high-order connectivity in behavior-aware user-item interaction graph. After that, a mutual relation encoder is proposed to adaptively uncover complex relational structures and make aggregations across layer-specific behavior representations. Through comprehensive evaluation on real-world datasets, the advantages of our MBRec method have been validated under different experimental settings. Further analysis verifies the positive effects of incorporating the multi-behavioral context into the recommendation paradigm. Additionally, the conducted case studies offer insights into the interpretability of user multi-behavior representations.


title: Efficient application of the factorized form of the unitary coupled-cluster ansatz for the variational quantum eigensolver algorithm by using linear combination of unitaries

abstract: The variational quantum eigensolver is one of the most promising algorithms for near-term quantum computers. It has the potential to solve quantum chemistry problems involving strongly correlated electrons, which are otherwise difficult to solve on classical computers. The variational eigenstate is constructed from a number of factorized unitary coupled-cluster terms applied onto an initial (single-reference) state. Current algorithms for applying one of these operators to a quantum state require a number of operations that scales exponentially with the rank of the operator. We exploit a hidden SU($2$) symmetry to allow us to employ the linear combination of unitaries approach, Our \textsc{Prepare} subroutine uses $n+2$ ancilla qubits for a rank-$n$ operator. Our \textsc{Select}($\hat U$) scheme uses $\mathcal{O}(n)$ \textsc{Cnot} gates. This results in an full algorithm that scales like the cube of the rank of the operator $n^3$, a significant reduction in complexity for rank five or higher operators. This approach, when combined with other algorithms for lower-rank operators (when compared to the standard implementation, will make the factorized form of the unitary coupled-cluster approach much more efficient to implement on all types of quantum computers.


title: Modeling Polypharmacy and Predicting Drug-Drug Interactions using Deep Generative Models on Multimodal Graphs

abstract: Latent representations of drugs and their targets produced by contemporary graph autoencoder models have proved useful in predicting many types of node-pair interactions on large networks, including drug-drug, drug-target, and target-target interactions. However, most existing approaches model either the node's latent spaces in which node distributions are rigid or do not effectively capture the interrelations between drugs; these limitations hinder the methods from accurately predicting drug-pair interactions. In this paper, we present the effectiveness of variational graph autoencoders (VGAE) in modeling latent node representations on multimodal networks. Our approach can produce flexible latent spaces for each node type of the multimodal graph; the embeddings are used later for predicting links among node pairs under different edge types. To further enhance the models' performance, we suggest a new method that concatenates Morgan fingerprints, which capture the molecular structures of each drug, with their latent embeddings before preceding them to the decoding stage for link prediction. Our proposed model shows competitive results on three multimodal networks: (1) a multimodal graph consisting of drug and protein nodes, (2) a multimodal graph constructed from a subset of the DrugBank database involving drug nodes under different interaction types, and (3) a multimodal graph consisting of drug and cell line nodes. Our source code is publicly available at https://github.com/HySonLab/drug-interactions.


title: CarbonScaler: Leveraging Cloud Workload Elasticity for Optimizing Carbon-Efficiency

abstract: Cloud platforms are increasing their emphasis on sustainability and reducing their operational carbon footprint. A common approach for reducing carbon emissions is to exploit the temporal flexibility inherent to many cloud workloads by executing them in periods with the greenest energy and suspending them at other times. Since such suspend-resume approaches can incur long delays in job completion times, we present a new approach that exploits the elasticity of batch workloads in the cloud to optimize their carbon emissions. Our approach is based on the notion of "carbon scaling," similar to cloud autoscaling, where a job dynamically varies its server allocation based on fluctuations in the carbon cost of the grid's energy. We develop a greedy algorithm for minimizing a job's carbon emissions via carbon scaling that is based on the well-known problem of marginal resource allocation. We implement a CarbonScaler prototype in Kubernetes using its autoscaling capabilities and an analytic tool to guide the carbon-efficient deployment of batch applications in the cloud. We then evaluate CarbonScaler using real-world machine learning training and MPI jobs on a commercial cloud platform and show that it can yield i) 51% carbon savings over carbon-agnostic execution; ii) 37% over a state-of-the-art suspend-resume policy; and iii) 8% over the best static scaling policy.


title: Random Padding Data Augmentation

abstract: The convolutional neural network (CNN) learns the same object in different positions in images, which can improve the recognition accuracy of the model. An implication of this is that CNN may know where the object is. The usefulness of the features' spatial information in CNNs has not been well investigated. In this paper, we found that the model's learning of features' position information hindered the learning of the features' relationship. Therefore, we introduced Random Padding, a new type of padding method for training CNNs that impairs the architecture's capacity to learn position information by adding zero-padding randomly to half of the border of feature maps. Random Padding is parameter-free, simple to construct, and compatible with the majority of CNN-based recognition models. This technique is also complementary to data augmentations such as random cropping, rotation, flipping and erasing, and consistently improves the performance of image classification over strong baselines.


title: Animating Sand, Mud, and Snow

abstract: Computer animations often lack the subtle environmental changes that should occur due to the actions of the characters. Squealing car tires usually leave no skid marks, airplanes rarely leave jet trails in the sky, and most runners leave no footprints. In this paper, we describe a simulation model of ground surfaces that can be deformed by the impact of rigid body models of animated characters. To demonstrate the algorithms, we show footprints made by a runner in sand, mud, and snow as well as bicycle tire tracks, a bicycle crash, and a falling runner. The shapes of the footprints in the three surfaces are quite different, but the effects were controlled through only five essentially independent parameters. To assess the realism of the resulting motion, we compare the simulated footprints to human footprints in sand.


title: Entangling ferrimagnetic magnons with an atomic ensemble via opto-magnomechanics

abstract: We show how to prepare macroscopic entanglement between an atomic ensemble and a large number of magnons in a ferrimagnetic YIG crystal. Specifically, we adopt an opto-magnomechanical configuration where the magnetostriction-induced magnomechanical displacement couples to an optical cavity via radiation pressure, and the latter further couples to an ensemble of two-level atoms that are placed inside the cavity. We show that by properly driving the cavity and magnon modes, optomechanical entanglement is created which is further distributed to the atomic and magnonic systems, yielding stationary entanglement between atoms and magnons. The atom-magnon entanglement is a result of the combined effect of opto- and magnomechanical cooling and optomechanical parametric down-conversion interactions. A competition mechanism between two mechanical cooling channels is revealed. We further show that genuine tripartite entanglement of three massive subsystems, i.e., atoms, magnons and phonons, can also be achieved in the same system. Our results indicate that the hybrid opto-magnomechanical system may become a promising system for preparing macroscopic quantum states involving magnons, photons, phonons and atoms.

categories: quant-ph cond-mat.mes-hall physics.atom-ph physics.optics


title: Creative NFT-Copyrighted AR Face Mask Authoring Using Unity3D Editor

abstract: In this paper, we extend well-designed 3D face masks into AR face masks and demonstrate the possibility of transforming this into an NFT-copyrighted AR face mask that helps authenticate the ownership of the AR mask user so as to improve creative control, brand identification, and ID protection. The output of this project will not only potentially validate the value of the NFT technology but also explore how to combine the NFT technology with AR technology so as to be applied to e-commerce and e-business aspects of the multimedia industry.


title: The maximum Wiener index of a uniform hypergraph

abstract: The Wiener index of a (hyper)graph is calculated by summing up the distances between all pairs of vertices. We determine the maximum possible Wiener index of a connected $n$-vertex $k$-uniform hypergraph and characterize for every~$n$ all hypergraphs attaining the maximum Wiener index.


title: VEGETA: Vertically-Integrated Extensions for Sparse/Dense GEMM Tile Acceleration on CPUs

abstract: Deep Learning (DL) acceleration support in CPUs has recently gained a lot of traction, with several companies (Arm, Intel, IBM) announcing products with specialized matrix engines accessible via GEMM instructions. CPUs are pervasive and need to handle diverse requirements across DL workloads running in edge/HPC/cloud platforms. Therefore, as DL workloads embrace sparsity to reduce the computations and memory size of models, it is also imperative for CPUs to add support for sparsity to avoid under-utilization of the dense matrix engine and inefficient usage of the caches and registers. This work presents VEGETA, a set of ISA and microarchitecture extensions over dense matrix engines to support flexible structured sparsity for CPUs, enabling programmable support for diverse DL models with varying degrees of sparsity. Compared to the state-of-the-art (SOTA) dense matrix engine in CPUs, a VEGETA engine provides 1.09x, 2.20x, 3.74x, and 3.28x speed-ups when running 4:4 (dense), 2:4, 1:4, and unstructured (95%) sparse DNN layers.


title: Efficient Classification of SARS-CoV-2 Spike Sequences Using Federated Learning

abstract: This paper presents a federated learning (FL) approach to train an AI model for SARS-Cov-2 variant classification. We analyze the SARS-CoV-2 spike sequences in a distributed way, without data sharing, to detect different variants of this rapidly mutating coronavirus. Our method maintains the confidentiality of local data (that could be stored in different locations) yet allows us to reliably detect and identify different known and unknown variants of the novel coronavirus SARS-CoV-2. Using the proposed approach, we achieve an overall accuracy of $93\%$ on the coronavirus variant identification task. We also provide details regarding how the proposed model follows the main laws of federated learning, such as Laws of data ownership, data privacy, model aggregation, and model heterogeneity. Since the proposed model is distributed, it could scale on ``Big Data'' easily. We plan to use this proof-of-concept to implement a privacy-preserving pandemic response strategy.


title: Dynamic Spatial-temporal Hypergraph Convolutional Network for Skeleton-based Action Recognition

abstract: Skeleton-based action recognition relies on the extraction of spatial-temporal topological information. Hypergraphs can establish prior unnatural dependencies for the skeleton. However, the existing methods only focus on the construction of spatial topology and ignore the time-point dependence. This paper proposes a dynamic spatial-temporal hypergraph convolutional network (DST-HCN) to capture spatial-temporal information for skeleton-based action recognition. DST-HCN introduces a time-point hypergraph (TPH) to learn relationships at time points. With multiple spatial static hypergraphs and dynamic TPH, our network can learn more complete spatial-temporal features. In addition, we use the high-order information fusion module (HIF) to fuse spatial-temporal information synchronously. Extensive experiments on NTU RGB+D, NTU RGB+D 120, and NW-UCLA datasets show that our model achieves state-of-the-art, especially compared with hypergraph methods.


title: Error per single-qubit gate below $10^{-4}$ in a superconducting qubit

abstract: Implementing arbitrary single-qubit gates with near perfect fidelity is among the most fundamental requirements in gate-based quantum information processing. In this work, we fabric a transmon qubit with long coherence times and demonstrate single-qubit gates with the average gate error below $10^{-4}$, i.e. $(7.42\pm0.04)\times10^{-5}$ by randomized benchmarking (RB). To understand the error sources, we experimentally obtain an error budget, consisting of the decoherence errors lower bounded by $(4.62\pm0.04)\times10^{-5}$ and the leakage rate per gate of $(1.16\pm0.04)\times10^{-5}$. Moreover, we reconstruct the process matrices for the single-qubit gates by the gate set tomography (GST), with which we simulate RB sequences and obtain single-qubit fedlities consistent with experimental results. We also observe non-Markovian behavior in the experiment of long-sequence GST, which may provide guidance for further calibration. The demonstration extends the upper limit that the average fidelity of single-qubit gates can reach in a transmon-qubit system, and thus can be an essential step towards practical and reliable quantum computation in the near future.


title: Contest in Multitasking: An Evidence from Chinese County Officials' Promotion Assessment

abstract: Real-world observed contests often take the form of multi-task contests rather than single-task contests, and existing theories are insufficient to explain the incentive for extending the task dimension. This paper proposes a new effect of multi-task contests compared to single-tasking contests: the specialization effect (SE). By establishing a multi-task contest model with heterogeneous competitor costs, this paper shows that after expanding the new competition dimension, competitors will choose the dimension with greater relative comparative advantage rather than absolute advantage and pay more effort, which eventually leads to competitors choosing higher effort levels in both the original dimension and the extended dimension. The paper then uses staggered Difference-in-Difference (DID) method on China's county officers' promotion assessment from 2001 to 2022 as an entry point to discuss the empirical evidence for specialization effect. Through models and empirical studies, the specialization effect studied in this paper do exists in promotion assessments, and may also explain many other real-world scenarios, such as sports events, competition between corporate compensation and employee benefits and competition for R&D expenses.


title: SAM operates far from home: eigenvalue regularization as a dynamical phenomenon

abstract: The Sharpness Aware Minimization (SAM) optimization algorithm has been shown to control large eigenvalues of the loss Hessian and provide generalization benefits in a variety of settings. The original motivation for SAM was a modified loss function which penalized sharp minima; subsequent analyses have also focused on the behavior near minima. However, our work reveals that SAM provides a strong regularization of the eigenvalues throughout the learning trajectory. We show that in a simplified setting, SAM dynamically induces a stabilization related to the edge of stability (EOS) phenomenon observed in large learning rate gradient descent. Our theory predicts the largest eigenvalue as a function of the learning rate and SAM radius parameters. Finally, we show that practical models can also exhibit this EOS stabilization, and that understanding SAM must account for these dynamics far away from any minima.


title: On the limit distribution for stochastic differential equations driven by cylindrical non-symmetric $\alpha$-stable L\'{e}vy processes

abstract: This article deals with the limit distribution for a stochastic differential equation driven by a non-symmetric cylindrical $\alpha$-stable process. Under suitable conditions, it is proved that the solution of this equation converges weakly to that of a stochastic differential equation driven by a Brownian motion in the Skorohod space as $\alpha\rightarrow2$. Also, the rate of weak convergence, which depends on $ 2-\alpha$, for the solution towards the solution of the limit equation is obtained. For illustration, the results are applied to a simple one-dimensional stochastic differential equation, which implies the rate of weak convergence is optimal.


title: A Fourier spectral immersed boundary method with exact translation invariance, improved boundary resolution, and a divergence-free velocity field

abstract: This paper introduces a new immersed boundary (IB) method for viscous incompressible flow, based on a Fourier spectral method for the fluid solver and on the nonuniform fast Fourier transform (NUFFT) algorithm for coupling the fluid with the immersed boundary. The new Fourier spectral immersed boundary (FSIB) method gives improved boundary resolution in comparison to the standard IB method. The interpolated velocity field, in which the boundary moves, is analytically divergence-free. The FSIB method is gridless and has the meritorious properties of volume conservation, exact translation invariance, conservation of momentum, and conservation of energy. We verify these advantages of the FSIB method numerically both for the Stokes equations and for the Navier-Stokes equations in both two and three space dimensions. The FSIB method converges faster than the IB method. In particular, we observe second-order convergence in various problems for the Navier-Stokes equations in three dimensions. The FSIB method is also computationally efficient with complexity of $O(N^3\log(N))$ per time step for $N^3$ Fourier modes in three dimensions.


title: A Countable-Type Branching Process Model for the Tug-of-War Cancer Cell Dynamics

abstract: We consider a time-continuous Markov branching process of proliferating cells with a countable collection of types. Among-type transitions are inspired by the Tug-of-War process introduced in McFarland et al. as a mathematical model for competition of advantageous driver mutations and deleterious passenger mutations in cancer cells. We introduce a version of the model in which a driver mutation pushes the type of the cell $L$-units up, while a passenger mutation pulls it $1$-unit down. The distribution of time to divisions depends on the type (fitness) of cell, which is an integer. The extinction probability given any initial cell type is strictly less than $1$, which allows us to investigate the transition between types (type transition) in an infinitely long cell lineage of cells. The analysis leads to the result that under driver dominance, the type transition process escapes to infinity, while under passenger dominance, it leads to a limit distribution. Implications in cancer cell dynamics and population genetics are discussed.


title: OTFS -- A Mathematical Foundation for Communication and Radar Sensing in the Delay-Doppler Domain

abstract: Orthogonal time frequency space (OTFS) is a framework for communication and active sensing that processes signals in the delay-Doppler (DD) domain. This paper explores three key features of the OTFS framework, and explains their value to applications. The first feature is a compact and sparse DD domain parameterization of the wireless channel, where the parameters map directly to physical attributes of the reflectors that comprise the scattering environment, and as a consequence these parameters evolve predictably. The second feature is a novel waveform / modulation technique, matched to the DD channel model, that embeds information symbols in the DD domain. The relation between channel inputs and outputs is localized, non-fading and predictable, even in the presence of significant delay and Doppler spread, and as a consequence the channel can be efficiently acquired and equalized. By avoiding fading, the post equalization SNR remains constant across all information symbols in a packet, so that bit error performance is superior to contemporary multi-carrier waveforms. Further, the OTFS carrier waveform is a localized pulse in the DD domain, making it possible to separate reflectors along both delay and Doppler simultaneously, and to achieve a high-resolution delay-Doppler radar image of the environment. In other words, the DD parameterization provides a common mathematical framework for communication and radar. This is the third feature of the OTFS framework, and it is ideally suited to intelligent transportation systems involving self-driving cars and unmanned ground/aerial vehicles which are self/network controlled. The OTFS waveform is able to support stable and superior performance over a wide range of user speeds.


title: Output Voltage Regulation of a Fuel Cell/Boost Converter System: A PI-PBC Approach

abstract: In this paper we consider the problem of voltage regulation of a proton exchange membrane fuel cell connected to an uncertain load through a boost converter. We show that, in spite of the inherent nonlinearities in the current-voltage behaviour of the fuel cell, the voltage of a fuel cell/boost converter system can be regulated with a simple proportional-integral (PI) action designed following the {Passivity-based Control (PBC) approach. The system under consideration consists of a DC-DC converter interfacing a fuel cell with a resistive load. We show that the output voltage of the converter converges to its desired constant value for all the systems initial conditions -- with convergence ensured for all positive values of the PI gains. This latter feature facilitates the, usually difficult, task of tuning the gains of the PI. An Immersion and Invariance parameter estimator is afterwards proposed which allows the operation of the PI-PBC when the load is unknown, maintaining the output voltage at the desired level. The stable operation of the overall system is proved and the approach is validated with extensive numerical simulations considering real-life scenarios, where a robust behavior in spite of load variations is obtained.


title: Complex strengthening mechanisms in nanocrystalline Ni-Mo alloys revealed by a machine-learning interatomic potential

abstract: A nanocrystalline metal's strength increases significantly as its grain size decreases, a phenomenon known as the Hall-Petch relation. Such relation, however, breaks down when the grains become too small. Experimental studies have circumvented this problem in a set of Ni-Mo alloys by stabilizing the grain boundaries (GB). Here, using atomistic simulations with a machine learning-based interatomic potential (ML-IAP), we demonstrate that the inverse Hall-Petch relation can be correctly reproduced due to a change in the dominant deformation mechanism as the grain becomes small in the Ni-Mo polycrystals. It is found that the atomic von Mises strain can be significantly reduced by either solute doping and/or annealing for small-grain-size polycrystals, leading to the increased strength of the polycrystals. On the other hand, for large-grain-size polycrystals, annealing weakens the material due to the large atomic movements in GB regions. Over a broad range of grain size, the superposition of the solute and annealing effects on polycrystals enhances the strength of those with small grain size more than those with large ones, giving rise to the continuous strengthening at extremely small grain sizes. Overall, this study not only demonstrates the reliability of the ML-IAP, but also provides a comprehensive atomistic view of complex strengthening mechanisms in nanocrystals, opening up a new avenue to tailor their mechanical properties.


title: Measures for the colored circle

abstract: In recent work with Harman, we introduced a new notion of measure for oligomorphic groups, and showed how they can be used to produce interesting tensor categories. Determining the measures for an oligomorphic group is (in our view) an important and difficult combinatorial problem, which has only been solved in a handful of cases. The purpose of this paper is to solve this problem for a certain infinite family of oligomorphic groups, namely, the automorphism group of the $n$-colored circle (for each $n \ge 1$).