title: Feasible contact tracing

abstract: Contact tracing is one of the most important tools for preventing the spread of infectious diseases, but as the experience of COVID-19 showed, it is also next-to-impossible to implement when the disease is spreading rapidly. We show how to substantially improve the efficiency of contact tracing by combining standard microeconomic tools that measure heterogeneity in how infectious a sick person is with ideas from machine learning about sequential optimization. Our contributions are twofold. First, we incorporate heterogeneity in individual infectiousness in a multi-armed bandit to establish optimal algorithms. At the heart of this strategy is a focus on learning. In the typical conceptualization of contact tracing, contacts of an infected person are tested to find more infections. Under a learning-first framework, however, contacts of infected persons are tested to ascertain whether the infected person is likely to be a "high infector" and to find additional infections only if it is likely to be highly fruitful. Second, we demonstrate using three administrative contact tracing datasets from India and Pakistan during COVID-19 that this strategy improves efficiency. Using our algorithm, we find 80% of infections with just 40% of contacts while current approaches test twice as many contacts to identify the same number of infections. We further show that a simple strategy that can be easily implemented in the field performs at nearly optimal levels, allowing for, what we call, feasible contact tracing. These results are immediately transferable to contact tracing in any epidemic.

categories: stat.ME econ.GN q-bio.PE q-fin.EC stat.AP


title: DVANet: Disentangling View and Action Features for Multi-View Action Recognition

abstract: In this work, we present a novel approach to multi-view action recognition where we guide learned action representations to be separated from view-relevant information in a video. When trying to classify action instances captured from multiple viewpoints, there is a higher degree of difficulty due to the difference in background, occlusion, and visibility of the captured action from different camera angles. To tackle the various problems introduced in multi-view action recognition, we propose a novel configuration of learnable transformer decoder queries, in conjunction with two supervised contrastive losses, to enforce the learning of action features that are robust to shifts in viewpoints. Our disentangled feature learning occurs in two stages: the transformer decoder uses separate queries to separately learn action and view information, which are then further disentangled using our two contrastive losses. We show that our model and method of training significantly outperforms all other uni-modal models on four multi-view action recognition datasets: NTU RGB+D, NTU RGB+D 120, PKU-MMD, and N-UCLA. Compared to previous RGB works, we see maximal improvements of 1.5\%, 4.8\%, 2.2\%, and 4.8\% on each dataset, respectively.


title: Beyond Gradient and Priors in Privacy Attacks: Leveraging Pooler Layer Inputs of Language Models in Federated Learning

abstract: Language models trained via federated learning (FL) demonstrate impressive capabilities in handling complex tasks while protecting user privacy. Recent studies indicate that leveraging gradient information and prior knowledge can potentially reveal training samples within FL setting. However, these investigations have overlooked the potential privacy risks tied to the intrinsic architecture of the models. This paper presents a two-stage privacy attack strategy that targets the vulnerabilities in the architecture of contemporary language models, significantly enhancing attack performance by initially recovering certain feature directions as additional supervisory signals. Our comparative experiments demonstrate superior attack performance across various datasets and scenarios, highlighting the privacy leakage risk associated with the increasingly complex architectures of language models. We call for the community to recognize and address these potential privacy risks in designing large language models.


title: Learning Spatially-Continuous Fiber Orientation Functions

abstract: Our understanding of the human connectome is fundamentally limited by the resolution of diffusion MR images. Reconstructing a connectome's constituent neural pathways with tractography requires following a continuous field of fiber directions. Typically, this field is found with simple trilinear interpolation in low-resolution, noisy diffusion MRIs. However, trilinear interpolation struggles following fine-scale changes in low-quality data. Recent deep learning methods in super-resolving diffusion MRIs have focused on upsampling to a fixed spatial grid, but this does not satisfy tractography's need for a continuous field. In this work, we propose FENRI, a novel method that learns spatially-continuous fiber orientation density functions from low-resolution diffusion-weighted images. To quantify FENRI's capabilities in tractography, we also introduce an expanded simulated dataset built for evaluating deep-learning tractography models. We demonstrate that FENRI accurately predicts high-resolution fiber orientations from realistic low-quality data, and that FENRI-based tractography offers improved streamline reconstruction over the current use of trilinear interpolation.


title: A spatial multiscale mathematical model of Plasmodium vivax transmission

abstract: The epidemiological behavior of Plasmodium vivax malaria occurs across spatial scales including within-host, population, and metapopulation levels. On the within-host scale, P. vivax sporozoites inoculated in a host may form latent hypnozoites, the activation of which drives secondary infections and accounts for a large proportion of P. vivax illness; on the metapopulation level, the coupled human-vector dynamics characteristic of the population level are further complicated by the migration of human populations across patches with different malaria forces of (re-)infection. To explore the interplay of all three scales in a single two-patch model of Plasmodium vivax dynamics, we construct and study a system of eight integro-differential equations with periodic forcing (arising from the single-frequency sinusoidal movement of a human sub-population). Under the numerically-informed ansatz that the limiting solutions to the system are closely bounded by sinusoidal ones for certain regions of parameter space, we derive a single nonlinear equation from which all approximate limiting solutions may be drawn, and devise necessary and sufficient conditions for the equation to have only a disease-free solution. Our results illustrate the impact of movement on P. vivax transmission and suggest a need to focus vector control efforts on forest mosquito populations. The three-scale model introduced here provides a more comprehensive framework for studying the clinical, behavioral, and geographical factors underlying P. vivax malaria endemicity.


title: Resonant stratification in Titan's global ocean

abstract: Titan's ice shell floats on top of a global ocean revealed by the large tidal Love number $k_2 = 0.616\pm0.067$ registered by Cassini. The Cassini observation exceeds the predicted $k_2$ by one order of magnitude in the absence of an ocean, and is 3-$\sigma$ away from the predicted $k_2$ if the ocean is pure water resting on top of a rigid ocean floor. Previous studies demonstrate that an ocean heavily enriched in salts (salinity $S\gtrsim200$ g/kg) can explain the 3-$\sigma$ signal in $k_2$. Here we revisit previous interpretations of Titan's large $k_2$ using simple physical arguments and propose a new interpretation based on the dynamic tidal response of a stably stratified ocean in resonance with eccentricity tides raised by Saturn. Our models include inertial effects from a full consideration of the Coriolis force and the radial stratification of the ocean, typically neglected or approximated elsewhere. The stratification of the ocean emerges from a salinity profile where salt concentration linearly increases with depth. We find multiple salinity profiles that lead to the $k_2$ required by Cassini. In contrast with previous interpretations that neglect stratification, resonant stratification reduces the bulk salinity required by observations by an order of magnitude, reaching a salinity for Titan's ocean that is compatible with that of Earth's oceans and close to Enceladus' plumes. Consequently, no special process is required to enrich Titan's ocean to a high salinity as previously suggested.


title: Minimum-Time Trajectory Optimization With Data-Based Models: A Linear Programming Approach

abstract: In this paper, we develop a computationally-efficient approach to minimum-time trajectory optimization using input-output data-based models, to produce an end-to-end data-to-control solution to time-optimal planning/control of dynamic systems and hence facilitate their autonomous operation. The approach integrates a non-parametric data-based model for trajectory prediction and a continuous optimization formulation based on an exponential weighting scheme for minimum-time trajectory planning. The optimization problem in its final form is a linear program and is easy to solve. We validate the approach and illustrate its application with a spacecraft relative motion planning problem.


title: FP8-BERT: Post-Training Quantization for Transformer

abstract: Transformer-based models, such as BERT, have been widely applied in a wide range of natural language processing tasks. However, one inevitable side effect is that they require massive memory storage and inference cost when deployed in production. Quantization is one of the popularized ways to alleviate the cost. However, the previous 8-bit quantization strategy based on INT8 data format either suffers from the degradation of accuracy in a Post-Training Quantization (PTQ) fashion or requires an expensive Quantization-Aware Training (QAT) process. Recently, a new numeric format FP8 (i.e. floating-point of 8-bits) has been proposed and supported in commercial AI computing platforms such as H100. In this paper, we empirically validate the effectiveness of FP8 as a way to do Post-Training Quantization without significant loss of accuracy, with a simple calibration and format conversion process. We adopt the FP8 standard proposed by NVIDIA Corp. (2022) in our extensive experiments of BERT variants on GLUE and SQuAD v1.1 datasets, and show that PTQ with FP8 can significantly improve the accuracy upon that with INT8, to the extent of the full-precision model.


title: Accelerating Quadratic Transform and WMMSE

abstract: Fractional programming (FP) arises in various communications and signal processing problems because several key quantities in the field are fractionally structured, e.g., the Cram\'{e}r-Rao bound, the Fisher information, and the signal-to-interference-plus-noise ratio (SINR). A recently proposed method called the quadratic transform has been applied to the FP problems extensively. The main contributions of the present paper are two-fold. First, we investigate how fast the quadratic transform converges. To the best of our knowledge, this is the first work that analyzes the convergence rate for the quadratic transform as well as its special case the weighted minimum mean square error (WMMSE) algorithm. Second, we accelerate the existing quadratic transform via a novel use of Nesterov's extrapolation scheme [1]. Specifically, by generalizing the minorization-maximization (MM) approach in [2], we establish a nontrivial connection between the quadratic transform and the gradient projection, thereby further incorporating the gradient extrapolation into the quadratic transform to make it converge more rapidly. Moreover, the paper showcases the practical use of the accelerated quadratic transform with two frontier wireless applications: integrated sensing and communications (ISAC) and massive multiple-input multiple-output (MIMO).


title: Cyber-Physical Testbed Integrating RTAC with RTDS for Game-Theoretic Topology Control Under Load Altering Attacks

abstract: This paper introduces a cyber-physical testbed that integrates the Real-Time Digital Simulator (RTDS) with the Real-Time Automation Controller (RTAC) to enhance cybersecurity in electrical distribution networks. Focused on addressing vulnerabilities to cyber attacks, our testbed employs an advanced control algorithm developed in Python and executed through real-time controllers. Key to our approach is the seamless integration of the host PC machine, RTDS, and RTAC via the Modbus protocol. We present a game theory-based topology control strategy as an effective response to cyber attacks, specifically targeting smart meters. This testbed validates the efficacy of our method in fully eliminating voltage violations due to load altering attacks, showcasing substantial advancements in smart grid cybersecurity via the innovative use of RTDS and RTAC to simulate and counteract complex cyber threats.


title: Generators of the Poincar\'e Group for arbitrary tensors and spinor-tensors

abstract: In this work, we systematically derive explicit expressions for the Poincar\'e Group generators on arbitrary-rank tensors and spinor-tensors in $D=3+1$ and $D=2+1$ spacetimes, thus generalizing previous works in the literature for the groups $ISO(3,1)$ and $ISO(2,1)$. From the Casimir eigenvalue equations, we demonstrate in a model-independent way the Fierz-Pauli constraints for massive particles for spins $\mathfrak{s}=5/2$, 3, and 4 in $D=3+1$ and helicities $\alpha=5/2$, 3, and 4 in $D=2+1$ dimensions. We also comment on the demonstration of the Fierz-Pauli constraints for the general case of arbitrary spin (helicity).


title: Parameterized steering criteria via correlation matrices

abstract: We study the steerability for arbitrary dimensional bipartite systems based on the correlation matrices given by local special unitary groups. We present families of steering criteria for bipartite quantum states in terms of parameterized correlation matrices. We show that these steering criteria may detect more steerable states than the existing steering criteria. The results are illustrated by detailed examples.


title: AFL-Net: Integrating Audio, Facial, and Lip Modalities with a Two-step Cross-attention for Robust Speaker Diarization in the Wild

abstract: Speaker diarization in real-world videos presents significant challenges due to varying acoustic conditions, diverse scenes, the presence of off-screen speakers, etc. This paper builds upon a previous study (AVR-Net) and introduces a novel multi-modal speaker diarization system, AFL-Net. The proposed AFL-Net incorporates dynamic lip movement as an additional modality to enhance the identity distinction. Besides, unlike AVR-Net which extracts high-level representations from each modality independently, AFL-Net employs a two-step cross-attention mechanism to sufficiently fuse different modalities, resulting in more comprehensive information to enhance the performance. Moreover, we also incorporated a masking strategy during training, where the face and lip modalities are randomly obscured. This strategy enhances the impact of the audio modality on the system outputs. Experimental results demonstrate that AFL-Net outperforms state-of-the-art baselines, such as the AVR-Net and DyViSE.


title: Evidence that the Rate of Evolution of a Black Hole Interior Has a Holographic Dual

abstract: A ``large'' AdS black hole can attain equilibrium with its own Hawking radiation, and in that condition it is thought to be dual to a strongly coupled field theory, also at equilibrium. But the interior of the black hole is by no means static: the geometry of spatial sections lying inside the event horizon evolves at some rate. This prompts the obvious question: can this rate possibly have a holographic dual? We present circumstantial evidence that such a dual does exist. We do this by making concrete proposals for two objects: first, a rough measure (already suggested in the literature) of the rate at which the unitary evolution of the state vector describing equilibrated strongly coupled matter evolves; and, second, a rough measure of the rate at which the interior (just under the horizon) evolves (in the case of the AdS$_5$-Kerr black hole). We then study how these two very different objects change as two physical parameters describing the exterior of the bulk black hole (the specific angular momentum and the temperature) are varied. We find that they change in remarkably similar ways, as holographic duals should.


title: Reply to "Comment on `Generalized James' effective Hamiltonian method'"

abstract: In the preceding Comment [1] it was claimed that the third-order Hamiltonian obtained in our original paper [2] is not Hermitian for general situations when considering time-dependence and the way of deriving the effective third-order expansion is not very rigorous. To reply the comment we should emphasize the following three points: first of all, the third-order Hamiltonian given in our paper is exactly Hermitian under the conditions mentioned there. Secondly, the iterative method adopted in our paper to derive the generalized effective Hamiltonian is equivalent to the Dyson series, and its correctness can thus be guaranteed. Thirdly, although the truncated effective Hamiltonian is indeed non-Hermitian under the time-dependent situation as presented in the Comment, it corresponds exactly to the non-unitary truncated Dyson series. Considering the truncated Dyson series has been extensively utilized in the time-dependent perturbation theory, in our opinion, the non-Hermitian truncated effective Hamiltonian can still be treated as an approximation of the effective Hamiltonian.


title: DevBots can co-design APIs

abstract: DevBots are automated tools that perform various tasks in order to support software development. They are a growing trend and have been used in repositories to automate repetitive tasks, as code generators, and as collaborators in eliciting requirements and defining architectures. In this study, we analyzed 24 articles to investigate the state of the art of using DevBots in software development, trying to understand their characteristics, identify use cases, learn the relationship between DevBots and conversational software development, and discuss how prompt engineering can enable collaboration between human developers and bots. Additionally, we identified a gap to address by applying prompt engineering to collaborative API design between human designers and DevBots and proposed an experiment to assess what approach, between using Retrieval Augmented Generation or not, is more suitable. Our conclusion is that DevBots can collaborate with human API designers, but the two approaches have advantages and disadvantages.


title: A Duality Approach to Regularized Learning Problems in Banach Spaces

abstract: Learning methods in Banach spaces are often formulated as regularization problems which minimize the sum of a data fidelity term in a Banach norm and a regularization term in another Banach norm. Due to the infinite dimensional nature of the space, solving such regularization problems is challenging. We construct a direct sum space based on the Banach spaces for the data fidelity term and the regularization term, and then recast the objective function as the norm of a suitable quotient space of the direct sum space. In this way, we express the original regularized problem as an unregularized problem on the direct sum space, which is in turn reformulated as a dual optimization problem in the dual space of the direct sum space. The dual problem is to find the maximum of a linear function on a convex polytope, which may be solved by linear programming. A solution of the original problem is then obtained by using related extremal properties of norming functionals from a solution of the dual problem. Numerical experiments are included to demonstrate that the proposed duality approach leads to an implementable numerical method for solving the regularization learning problems.


title: A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning

abstract: Multi-modal conversation emotion recognition (MCER) aims to recognize and track the speaker's emotional state using text, speech, and visual information in the conversation scene. Analyzing and studying MCER issues is significant to affective computing, intelligent recommendations, and human-computer interaction fields. Unlike the traditional single-utterance multi-modal emotion recognition or single-modal conversation emotion recognition, MCER is a more challenging problem that needs to deal with more complex emotional interaction relationships. The critical issue is learning consistency and complementary semantics for multi-modal feature fusion based on emotional interaction relationships. To solve this problem, people have conducted extensive research on MCER based on deep learning technology, but there is still a lack of systematic review of the modeling methods. Therefore, a timely and comprehensive overview of MCER's recent advances in deep learning is of great significance to academia and industry. In this survey, we provide a comprehensive overview of MCER modeling methods and roughly divide MCER methods into four categories, i.e., context-free modeling, sequential context modeling, speaker-differentiated modeling, and speaker-relationship modeling. In addition, we further discuss MCER's publicly available popular datasets, multi-modal feature extraction methods, application areas, existing challenges, and future development directions. We hope that our review can help MCER researchers understand the current research status in emotion recognition, provide some inspiration, and develop more efficient models.


title: ASWT-SGNN: Adaptive Spectral Wavelet Transform-based Self-Supervised Graph Neural Network

abstract: Graph Comparative Learning (GCL) is a self-supervised method that combines the advantages of Graph Convolutional Networks (GCNs) and comparative learning, making it promising for learning node representations. However, the GCN encoders used in these methods rely on the Fourier transform to learn fixed graph representations, which is inherently limited by the uncertainty principle involving spatial and spectral localization trade-offs. To overcome the inflexibility of existing methods and the computationally expensive eigen-decomposition and dense matrix multiplication, this paper proposes an Adaptive Spectral Wavelet Transform-based Self-Supervised Graph Neural Network (ASWT-SGNN). The proposed method employs spectral adaptive polynomials to approximate the filter function and optimize the wavelet using contrast loss. This design enables the creation of local filters in both spectral and spatial domains, allowing flexible aggregation of neighborhood information at various scales and facilitating controlled transformation between local and global information. Compared to existing methods, the proposed approach reduces computational complexity and addresses the limitation of graph convolutional neural networks, which are constrained by graph size and lack flexible control over the neighborhood aspect. Extensive experiments on eight benchmark datasets demonstrate that ASWT-SGNN accurately approximates the filter function in high-density spectral regions, avoiding costly eigen-decomposition. Furthermore, ASWT-SGNN achieves comparable performance to state-of-the-art models in node classification tasks.


title: Multiple Threshold Schemes Under The Weak Secure Condition

abstract: In this paper, we consider the case that sharing many secrets among a set of participants using the threshold schemes. All secrets are assumed to be statistically independent and the weak secure condition is focused on. Under such circumstances we investigate the infimum of the (average) information ratio and the (average) randomness ratio for any structure pair which consists of the number of the participants and the threshold values of all secrets. For two structure pairs such that the two numbers of the participants are the same and the two arrays of threshold values have the subset relationship, two leading corollaries are proved following two directions. More specifically, the bound related to the lengths of shares, secrets and randomness for the complex structure pair can be truncated for the simple one; and the linear schemes for the simple structure pair can be combined independently to be a multiple threshold scheme for the complex one. The former corollary is useful for the converse part and the latter one is helpful for the achievability part. Three new bounds special for the case that the number of secrets corresponding to the same threshold value $ t $ is lager than $ t $ and two novel linear schemes modified from the Vandermonde matrix for two similar cases are presented. Then come the optimal results for the average information ratio, the average randomness ratio and the randomness ratio. We introduce a tiny example to show that there exists another type of bound that may be crucial for the information ratio, to which we only give optimal results in three cases.


title: FedReverse: Multiparty Reversible Deep Neural Network Watermarking

abstract: The proliferation of Deep Neural Networks (DNN) in commercial applications is expanding rapidly. Simultaneously, the increasing complexity and cost of training DNN models have intensified the urgency surrounding the protection of intellectual property associated with these trained models. In this regard, DNN watermarking has emerged as a crucial safeguarding technique. This paper presents FedReverse, a novel multiparty reversible watermarking approach for robust copyright protection while minimizing performance impact. Unlike existing methods, FedReverse enables collaborative watermark embedding from multiple parties after model training, ensuring individual copyright claims. In addition, FedReverse is reversible, enabling complete watermark removal with unanimous client consent. FedReverse demonstrates perfect covering, ensuring that observations of watermarked content do not reveal any information about the hidden watermark. Additionally, it showcases resistance against Known Original Attacks (KOA), making it highly challenging for attackers to forge watermarks or infer the key. This paper further evaluates FedReverse through comprehensive simulations involving Multi-layer Perceptron (MLP) and Convolutional Neural Networks (CNN) trained on the MNIST dataset. The simulations demonstrate FedReverse's robustness, reversibility, and minimal impact on model accuracy across varying embedding parameters and multiple client scenarios.


title: GAMC: An Unsupervised Method for Fake News Detection using Graph Autoencoder with Masking

abstract: With the rise of social media, the spread of fake news has become a significant concern, potentially misleading public perceptions and impacting social stability. Although deep learning methods like CNNs, RNNs, and Transformer-based models like BERT have enhanced fake news detection, they primarily focus on content, overlooking social context during news propagation. Graph-based techniques have incorporated this social context but are limited by the need for large labeled datasets. Addressing these challenges, this paper introduces GAMC, an unsupervised fake news detection technique using the Graph Autoencoder with Masking and Contrastive learning. By leveraging both the context and content of news propagation as self-supervised signals, our method negates the requirement for labeled datasets. We augment the original news propagation graph, encode these with a graph encoder, and employ a graph decoder for reconstruction. A unique composite loss function, including reconstruction error and contrast loss, is designed. The method's contributions are: introducing self-supervised learning to fake news detection, proposing a graph autoencoder integrating two distinct losses, and validating our approach's efficacy through real-world dataset experiments.


title: A GLSM realization of derived equivalence in $U(1) \times U(2)$ models

abstract: The paper [arXiv:1506.06999] has studied a derived equivalence between two Calabi-Yau fivefolds. In this paper, we propose a new understanding from the viewpoint of the GLSM, by realizing these two Calabi-Yau fivefolds in two different phases of a $U(1)\times U(2)$ GLSM. We find that this method can be generalized to construct other examples of derived equivalence. The functor for the equivalence can be realized by the brane transport along a path across different phases. To implement the brane transport, we compute the small window categories for anomalous $U(2)$ theories, extending previous results on window categories.


title: MISCA: A Joint Model for Multiple Intent Detection and Slot Filling with Intent-Slot Co-Attention

abstract: The research study of detecting multiple intents and filling slots is becoming more popular because of its relevance to complicated real-world situations. Recent advanced approaches, which are joint models based on graphs, might still face two potential issues: (i) the uncertainty introduced by constructing graphs based on preliminary intents and slots, which may transfer intent-slot correlation information to incorrect label node destinations, and (ii) direct incorporation of multiple intent labels for each token w.r.t. token-level intent voting might potentially lead to incorrect slot predictions, thereby hurting the overall performance. To address these two issues, we propose a joint model named MISCA. Our MISCA introduces an intent-slot co-attention mechanism and an underlying layer of label attention mechanism. These mechanisms enable MISCA to effectively capture correlations between intents and slot labels, eliminating the need for graph construction. They also facilitate the transfer of correlation information in both directions: from intents to slots and from slots to intents, through multiple levels of label-specific representations, without relying on token-level intent information. Experimental results show that MISCA outperforms previous models, achieving new state-of-the-art overall accuracy performances on two benchmark datasets MixATIS and MixSNIPS. This highlights the effectiveness of our attention mechanisms.


title: The Generalization Gap in Offline Reinforcement Learning

abstract: Despite recent progress in offline learning, these methods are still trained and tested on the same environment. In this paper, we compare the generalization abilities of widely used online and offline learning methods such as online reinforcement learning (RL), offline RL, sequence modeling, and behavioral cloning. Our experiments show that offline learning algorithms perform worse on new environments than online learning ones. We also introduce the first benchmark for evaluating generalization in offline learning, collecting datasets of varying sizes and skill-levels from Procgen (2D video games) and WebShop (e-commerce websites). The datasets contain trajectories for a limited number of game levels or natural language instructions and at test time, the agent has to generalize to new levels or instructions. Our experiments reveal that existing offline learning algorithms struggle to match the performance of online RL on both train and test environments. Behavioral cloning is a strong baseline, outperforming state-of-the-art offline RL and sequence modeling approaches when trained on data from multiple environments and tested on new ones. Finally, we find that increasing the diversity of the data, rather than its size, improves performance on new environments for all offline learning algorithms. Our study demonstrates the limited generalization of current offline learning algorithms highlighting the need for more research in this area.


title: Building Variable-sized Models via Learngene Pool

abstract: Recently, Stitchable Neural Networks (SN-Net) is proposed to stitch some pre-trained networks for quickly building numerous networks with different complexity and performance trade-offs. In this way, the burdens of designing or training the variable-sized networks, which can be used in application scenarios with diverse resource constraints, are alleviated. However, SN-Net still faces a few challenges. 1) Stitching from multiple independently pre-trained anchors introduces high storage resource consumption. 2) SN-Net faces challenges to build smaller models for low resource constraints. 3). SN-Net uses an unlearned initialization method for stitch layers, limiting the final performance. To overcome these challenges, motivated by the recently proposed Learngene framework, we propose a novel method called Learngene Pool. Briefly, Learngene distills the critical knowledge from a large pre-trained model into a small part (termed as learngene) and then expands this small part into a few variable-sized models. In our proposed method, we distill one pretrained large model into multiple small models whose network blocks are used as learngene instances to construct the learngene pool. Since only one large model is used, we do not need to store more large models as SN-Net and after distilling, smaller learngene instances can be created to build small models to satisfy low resource constraints. We also insert learnable transformation matrices between the instances to stitch them into variable-sized models to improve the performance of these models. Exhaustive experiments have been implemented and the results validate the effectiveness of the proposed Learngene Pool compared with SN-Net.


title: Characterization of Semiconducting Materials Using the Van der Pauw Method

abstract: Semiconductors are currently an active topic of study due to the endless range of applications in electronic hardware and computer engineering. In this experiment, the material properties (i.e. resistivity $\rho$, Hall coefficient $R_{H}$, and mobility $\mu$) of a doped GaAs sheet is described by utilizing Hall Effect and the Van der Pauw method with varying temperature $T$ and magnetic field values $B$. It is determined that the sample is an $n$-type semiconductor using the sign of $R_H$, which is measured to be $R_H = -2.9 \times 10^{-12} \pm 0.1 \times 10^{-14} ~ \text{m}^{3} \text{C}^{-1}$, at $T = 303 ~\text{K}$ and $B = 3.3 ~\text{kGs}$. Furthermore, the rate of change for the slope $R_H$ and $T$ is increasing along $B$ at the rate of $\Delta k/ \Delta B = \left(3.6 \pm 0.5 \right) \times 10^{-16} ~\text{m}^3 (\text{CK} \cdot \text{kGs})^{-1}$, meaning the charge accumulation caused by the current and Lorentz force is quadratic in $B$. It is also discovered that $\mu$, and therefore the electron drift velocity is reduced proportionally at higher $T$-values. This method provides a potential analogue in quantum scales with the Quantum Hall Effect and characterisation of quantum dots.


title: Open World Object Detection in the Era of Foundation Models

abstract: Object detection is integral to a bevy of real-world applications, from robotics to medical image analysis. To be used reliably in such applications, models must be capable of handling unexpected - or novel - objects. The open world object detection (OWD) paradigm addresses this challenge by enabling models to detect unknown objects and learn discovered ones incrementally. However, OWD method development is hindered due to the stringent benchmark and task definitions. These definitions effectively prohibit foundation models. Here, we aim to relax these definitions and investigate the utilization of pre-trained foundation models in OWD. First, we show that existing benchmarks are insufficient in evaluating methods that utilize foundation models, as even naive integration methods nearly saturate these benchmarks. This result motivated us to curate a new and challenging benchmark for these models. Therefore, we introduce a new benchmark that includes five real-world application-driven datasets, including challenging domains such as aerial and surgical images, and establish baselines. We exploit the inherent connection between classes in application-driven datasets and introduce a novel method, Foundation Object detection Model for the Open world, or FOMO, which identifies unknown objects based on their shared attributes with the base known objects. FOMO has ~3x unknown object mAP compared to baselines on our benchmark. However, our results indicate a significant place for improvement - suggesting a great research opportunity in further scaling object detection methods to real-world domains. Our code and benchmark are available at https://orrzohar.github.io/projects/fomo/.


title: A Scalable MARL Solution for Scheduling in Conflict Graphs

abstract: This paper proposes a fully scalable multi-agent reinforcement learning (MARL) approach for packet scheduling in conflict graphs, aiming to minimizing average packet delays. Each agent autonomously manages the schedule of a single link over one or multiple sub-bands, considering its own state and states of conflicting links. The problem can be conceptualized as a decentralized partially observable Markov decision process (Dec-POMDP). The proposed solution leverages an on-policy reinforcement learning algorithms multi-agent proximal policy optimization (MAPPO) within a multi-agent networked system, incorporating advanced recurrent structures in the neural network. The MARL design allows for fully decentralized training and execution, seamlessly scaling to very large networks. Extensive simulations across a diverse range of conflict graphs demonstrate that the proposed solution compares favorably to well-established schedulers in terms of both throughput and delay under various traffic conditions.


title: Difference of Probability and Information Entropy for Skills Classification and Prediction in Student Learning

abstract: The probability of an event is in the range of [0, 1]. In a sample space S, the value of probability determines whether an outcome is true or false. The probability of an event Pr(A) that will never occur = 0. The probability of the event Pr(B) that will certainly occur = 1. This makes both events A and B thus a certainty. Furthermore, the sum of probabilities Pr(E1) + Pr(E2) + ... + Pr(En) of a finite set of events in a given sample space S = 1. Conversely, the difference of the sum of two probabilities that will certainly occur is 0. Firstly, this paper discusses Bayes' theorem, then complement of probability and the difference of probability for occurrences of learning-events, before applying these in the prediction of learning objects in student learning. Given the sum total of 1; to make recommendation for student learning, this paper submits that the difference of argMaxPr(S) and probability of student-performance quantifies the weight of learning objects for students. Using a dataset of skill-set, the computational procedure demonstrates: i) the probability of skill-set events that has occurred that would lead to higher level learning; ii) the probability of the events that has not occurred that requires subject-matter relearning; iii) accuracy of decision tree in the prediction of student performance into class labels; and iv) information entropy about skill-set data and its implication on student cognitive performance and recommendation of learning [1].


title: IL-NeRF: Incremental Learning for Neural Radiance Fields with Camera Pose Alignment

abstract: Neural radiance fields (NeRF) is a promising approach for generating photorealistic images and representing complex scenes. However, when processing data sequentially, it can suffer from catastrophic forgetting, where previous data is easily forgotten after training with new data. Existing incremental learning methods using knowledge distillation assume that continuous data chunks contain both 2D images and corresponding camera pose parameters, pre-estimated from the complete dataset. This poses a paradox as the necessary camera pose must be estimated from the entire dataset, even though the data arrives sequentially and future chunks are inaccessible. In contrast, we focus on a practical scenario where camera poses are unknown. We propose IL-NeRF, a novel framework for incremental NeRF training, to address this challenge. IL-NeRF's key idea lies in selecting a set of past camera poses as references to initialize and align the camera poses of incoming image data. This is followed by a joint optimization of camera poses and replay-based NeRF distillation. Our experiments on real-world indoor and outdoor scenes show that IL-NeRF handles incremental NeRF training and outperforms the baselines by up to $54.04\%$ in rendering quality.


title: Discovery of a Magnetic Double-Faced DBA White Dwarf

abstract: We report the discovery of spectroscopic variations in the magnetic DBA white dwarf SDSS J091016.43+210554.2. Follow-up time-resolved spectroscopy at the Apache Point Observatory (APO) and the MMT show significant variations in the H absorption lines over a rotation period of 7.7 or 11.3 h. Unlike recent targets that show similar discrepancies in their H and He line profiles, such as GD 323 and Janus (ZTF J203349.8+322901.1), SDSS J091016.43+210554.2 is confirmed to be magnetic, with a field strength derived from Zeeman-split H and He lines of B ~ 0.5 MG. Model fits using a H and He atmosphere with a constant abundance ratio across the surface fail to match our time-resolved spectra. On the other hand, we obtain excellent fits using magnetic atmosphere models with varying H/He surface abundance ratios. We use the oblique rotator model to fit the system geometry. The observed spectroscopic variations can be explained by a magnetic inhomogeneous atmosphere where the magnetic axis is offset from the rotation axis by beta = 52 degrees, and the inclination angle between the line of sight and the rotation axis is i = 13 - 16 degrees. This magnetic white dwarf offers a unique opportunity to study the effect of the magnetic field on surface abundances. We propose a model where H is brought to the surface from the deep interior more efficiently along the magnetic field lines, thus producing H polar caps


title: Hyperresolution for Multi-step Fuzzy Inference in Goedel Logic

abstract: This paper is a continuation of our work concerning the logical and computational foundations of multi-step fuzzy inference. We bring further results on the implementation of the Mamdani-Assilian type of fuzzy rules and inference in Goedel logic with truth constants. In our previous work, we have provided translation of Mamdani-Assilian fuzzy rules to formulae of Goedel logic, and subsequently, to suitable clausal form. Moreover, we have outlined a class of problems regarding general properties of fuzzy inference and shown its reduction to a class of deduction/unsatisfiability problems. We now focus on solving such problems using an adapted hyperresolution calculus.


title: Benchmarking of Query Strategies: Towards Future Deep Active Learning

abstract: In this study, we benchmark query strategies for deep actice learning~(DAL). DAL reduces annotation costs by annotating only high-quality samples selected by query strategies. Existing research has two main problems, that the experimental settings are not standardized, making the evaluation of existing methods is difficult, and that most of experiments were conducted on the CIFAR or MNIST datasets. Therefore, we develop standardized experimental settings for DAL and investigate the effectiveness of various query strategies using six datasets, including those that contain medical and visual inspection images. In addition, since most current DAL approaches are model-based, we perform verification experiments using fully-trained models for querying to investigate the effectiveness of these approaches for the six datasets. Our code is available at \href{https://github.com/ia-gu/Benchmarking-of-Query-Strategies-Towards-Future-Deep-Active-Learning}


title: Camera-based 3D Semantic Scene Completion with Sparse Guidance Network

abstract: Semantic scene completion (SSC) aims to predict the semantic occupancy of each voxel in the entire 3D scene from limited observations, which is an emerging and critical task for autonomous driving. Recently, many studies have turned to camera-based SSC solutions due to the richer visual cues and cost-effectiveness of cameras. However, existing methods usually rely on sophisticated and heavy 3D models to directly process the lifted 3D features that are not discriminative enough for clear segmentation boundaries. In this paper, we adopt the dense-sparse-dense design and propose an end-to-end camera-based SSC framework, termed SGN, to diffuse semantics from the semantic- and occupancy-aware seed voxels to the whole scene based on geometry prior and occupancy information. By designing hybrid guidance (sparse semantic and geometry guidance) and effective voxel aggregation for spatial occupancy and geometry priors, we enhance the feature separation between different categories and expedite the convergence of semantic diffusion. Extensive experimental results on the SemanticKITTI dataset demonstrate the superiority of our SGN over existing state-of-the-art methods.


title: Mid-Infrared Variability of Young Stellar Objects on Timescales of Days to Years

abstract: Variability in the brightness of Young Stellar Objects (YSOs) is a common phenomenon that can be caused by changes in various factors, including accretion, extinction, disk morphology, interactions between the disk and the stellar photosphere, and the rotation of hot or cold magnetic spots on the stellar photosphere. Analyzing the variability on different timescales gives insight into the mechanisms driving the brightness changes in YSOs. We investigate the variability of YSOs on both long and short timescales using two mid-infrared datasets: the NEOWISE 7.5-year W2 (4.6$\mu$m) data and the YSOVAR 40-day Spitzer/IRAC2 (4.5$\mu$m) data, respectively. We classify the variability types in each timescale following Park et al (2021). We find a higher detection rate of variable sources in the short-term (77.6%) compared to the long-term (43.0%) due to the higher sensitivity of the Spitzer observations. In addition, the higher cadence of the YSOVAR data results in the weeks-long short-term variability being mostly secular, while the years-long long-term variability explored with the coarsely sampled NEOWISE data is mostly stochastic. By cross-matching the two catalogs, we statistically analyze the variability types exhibited by YSOs across both timescales. The long-term variability amplitude is mostly three times (up to ten times) greater than the short-term variability. Furthermore, we evaluate variability on very short (1-2 days) timescales and recover a trend of the increasing amplitude of variability as the timescales increase. By comprehensively analyzing the variability of YSOs over various timescales, we contribute to a deeper understanding of the underlying mechanisms driving their variability.


title: A graph discretization of vector Laplace operator

abstract: In this paper, we study the graph-theoretic analogues of vector Laplacian (or Helmholtz operator) and vector Laplace equation. We determine the graph matrix representation of vector Laplacian and obtain the dimension of solution space of vector Laplace equation on graphs.


title: Understanding muon diffusion in perovskite oxides below room temperature based on harmonic transition state theory

abstract: In positive muon spin rotation and relaxation ($\mu^+$SR) spectroscopy, positive muons ($\mu^+$) implanted into solid oxides are conventionally treated as immobile spin-probes at interstitial sites below room temperature. This is because each $\mu^+$ is thought to be tightly bound to an oxygen atom in the host lattice to form a muonic analogue of the hydroxy group. On the basis of this concept, anomalies in $\mu^+$SR spectra observed in oxides have been attributed in most cases to the intrinsic properties of host materials. On the other hand, global $\mu^+$ diffusion with an activation energy of $\sim$0.1~eV has been reported in some chemically-substituted perovskite oxides at cryogenic temperatures, although the reason for the small activation energy despite the formation of the strong O$\mu$ bond has not yet been quantitatively understood. In this study, we investigated interstitial $\mu^+$ diffusion in the perovskite oxide lattice using KTaO$_3$ cubic perovskite as a model system. We used the $\mu^+$SR method and density functional theory calculations along with the harmonic transition state theory to study this phenomenon both experimentally and theoretically. Experimental activation energies for global $\mu^+$ diffusion obtained below room temperature were less than a quarter of the calculated classical potential barrier height for a bottleneck $\mu^+$ transfer path. The reduction in the effective barrier height could be explained by the harmonic transition state theory with a zero-point energy correction; a significant difference in zero-point energies for $\mu^+$ at the positions in the O$\mu$ bonding equilibrium state and a bond-breaking transition state was the primary cause of the reduction. This suggests that the assumption of immobile $\mu^+$ in solid oxides is not always satisfied since such a significant decrease in diffusion barrier height can also occur in other oxides.


title: A quantitative fusion strategy of stock picking and timing based on Particle Swarm Optimized-Back Propagation Neural Network and Multivariate Gaussian-Hidden Markov Model

abstract: In recent years, machine learning (ML) has brought effective approaches and novel techniques to economic decision, investment forecasting, and risk management, etc., coping the variable and intricate nature of economic and financial environments. For the investment in stock market, this research introduces a pioneering quantitative fusion model combining stock timing and picking strategy by leveraging the Multivariate Gaussian-Hidden Markov Model (MGHMM) and Back Propagation Neural Network optimized by Particle Swarm (PSO-BPNN). After the information coefficients (IC) between fifty-two factors that have been winsorized, neutralized and standardized and the return of CSI 300 index are calculated, a given amount of factors that rank ahead are choose to be candidate factors heading for the input of PSO-BPNN after dimension reduction by Principal Component Analysis (PCA), followed by a certain amount of constituent stocks outputted. Subsequently, we conduct the prediction and trading on the basis of the screening stocks and stock market state outputted by MGHMM trained using inputting CSI 300 index data after Box-Cox transformation, bespeaking eximious performance during the period of past four years. Ultimately, some conventional forecast and trading methods are compared with our strategy in Chinese stock market. Our fusion strategy incorporating stock picking and timing presented in this article provide a innovative technique for financial analysis.


title: Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

abstract: Heterogeneous graph neural networks have become popular in various domains. However, their generalizability and interpretability are limited due to the discrepancy between their inherent inference flows and human reasoning logic or underlying causal relationships for the learning problem. This study introduces a novel solution, HG-SCM (Heterogeneous Graph as Structural Causal Model). It can mimic the human perception and decision process through two key steps: constructing intelligible variables based on semantics derived from the graph schema and automatically learning task-level causal relationships among these variables by incorporating advanced causal discovery techniques. We compared HG-SCM to seven state-of-the-art baseline models on three real-world datasets, under three distinct and ubiquitous out-of-distribution settings. HG-SCM achieved the highest average performance rank with minimal standard deviation, substantiating its effectiveness and superiority in terms of both predictive power and generalizability. Additionally, the visualization and analysis of the auto-learned causal diagrams for the three tasks aligned well with domain knowledge and human cognition, demonstrating prominent interpretability. HG-SCM's human-like nature and its enhanced generalizability and interpretability make it a promising solution for special scenarios where transparency and trustworthiness are paramount.


title: CLeaRForecast: Contrastive Learning of High-Purity Representations for Time Series Forecasting

abstract: Time series forecasting (TSF) holds significant importance in modern society, spanning numerous domains. Previous representation learning-based TSF algorithms typically embrace a contrastive learning paradigm featuring segregated trend-periodicity representations. Yet, these methodologies disregard the inherent high-impact noise embedded within time series data, resulting in representation inaccuracies and seriously demoting the forecasting performance. To address this issue, we propose CLeaRForecast, a novel contrastive learning framework to learn high-purity time series representations with proposed sample, feature, and architecture purifying methods. More specifically, to avoid more noise adding caused by the transformations of original samples (series), transformations are respectively applied for trendy and periodic parts to provide better positive samples with obviously less noise. Moreover, we introduce a channel independent training manner to mitigate noise originating from unrelated variables in the multivariate series. By employing a streamlined deep-learning backbone and a comprehensive global contrastive loss function, we prevent noise introduction due to redundant or uneven learning of periodicity and trend. Experimental results show the superior performance of CLeaRForecast in various downstream TSF tasks.


title: Beyond One Model Fits All: Ensemble Deep Learning for Autonomous Vehicles

abstract: Deep learning has revolutionized autonomous driving by enabling vehicles to perceive and interpret their surroundings with remarkable accuracy. This progress is attributed to various deep learning models, including Mediated Perception, Behavior Reflex, and Direct Perception, each offering unique advantages and challenges in enhancing autonomous driving capabilities. However, there is a gap in research addressing integrating these approaches and understanding their relevance in diverse driving scenarios. This study introduces three distinct neural network models corresponding to Mediated Perception, Behavior Reflex, and Direct Perception approaches. We explore their significance across varying driving conditions, shedding light on the strengths and limitations of each approach. Our architecture fuses information from the base, future latent vector prediction, and auxiliary task networks, using global routing commands to select appropriate action sub-networks. We aim to provide insights into effectively utilizing diverse modeling strategies in autonomous driving by conducting experiments and evaluations. The results show that the ensemble model performs better than the individual approaches, suggesting that each modality contributes uniquely toward the performance of the overall model. Moreover, by exploring the significance of each modality, this study offers a roadmap for future research in autonomous driving, emphasizing the importance of leveraging multiple models to achieve robust performance.


title: RepViT-SAM: Towards Real-Time Segmenting Anything

abstract: Segment Anything Model (SAM) has shown impressive zero-shot transfer performance for various computer vision tasks recently. However, its heavy computation costs remain daunting for practical applications. MobileSAM proposes to replace the heavyweight image encoder in SAM with TinyViT by employing distillation, which results in a significant reduction in computational requirements. However, its deployment on resource-constrained mobile devices still encounters challenges due to the substantial memory and computational overhead caused by self-attention mechanisms. Recently, RepViT achieves the state-of-the-art performance and latency trade-off on mobile devices by incorporating efficient architectural designs of ViTs into CNNs. Here, to achieve real-time segmenting anything on mobile devices, following MobileSAM, we replace the heavyweight image encoder in SAM with RepViT model, ending up with the RepViT-SAM model. Extensive experiments show that RepViT-SAM can enjoy significantly better zero-shot transfer capability than MobileSAM, along with nearly $10\times$ faster inference speed. The code and models are available at \url{https://github.com/THU-MIG/RepViT}.


title: QMGeo: Differentially Private Federated Learning via Stochastic Quantization with Mixed Truncated Geometric Distribution

abstract: Federated learning (FL) is a framework which allows multiple users to jointly train a global machine learning (ML) model by transmitting only model updates under the coordination of a parameter server, while being able to keep their datasets local. One key motivation of such distributed frameworks is to provide privacy guarantees to the users. However, preserving the users' datasets locally is shown to be not sufficient for privacy. Several differential privacy (DP) mechanisms have been proposed to provide provable privacy guarantees by introducing randomness into the framework, and majority of these mechanisms rely on injecting additive noise. FL frameworks also face the challenge of communication efficiency, especially as machine learning models grow in complexity and size. Quantization is a commonly utilized method, reducing the communication cost by transmitting compressed representation of the underlying information. Although there have been several studies on DP and quantization in FL, the potential contribution of the quantization method alone in providing privacy guarantees has not been extensively analyzed yet. We in this paper present a novel stochastic quantization method, utilizing a mixed geometric distribution to introduce the randomness needed to provide DP, without any additive noise. We provide convergence analysis for our framework and empirically study its performance.


title: Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning

abstract: Multiple defendants in a criminal fact description generally exhibit complex interactions, and cannot be well handled by existing Legal Judgment Prediction (LJP) methods which focus on predicting judgment results (e.g., law articles, charges, and terms of penalty) for single-defendant cases. To address this problem, we propose the task of multi-defendant LJP, which aims to automatically predict the judgment results for each defendant of multi-defendant cases. Two challenges arise with the task of multi-defendant LJP: (1) indistinguishable judgment results among various defendants; and (2) the lack of a real-world dataset for training and evaluation. To tackle the first challenge, we formalize the multi-defendant judgment process as hierarchical reasoning chains and introduce a multi-defendant LJP method, named Hierarchical Reasoning Network (HRN), which follows the hierarchical reasoning chains to determine criminal relationships, sentencing circumstances, law articles, charges, and terms of penalty for each defendant. To tackle the second challenge, we collect a real-world multi-defendant LJP dataset, namely MultiLJP, to accelerate the relevant research in the future. Extensive experiments on MultiLJP verify the effectiveness of our proposed HRN.


title: Fluid Antennas-Enabled Multiuser Uplink: A Low-Complexity Gradient Descent for Total Transmit Power Minimization

abstract: We investigate multiuser uplink communication from multiple single-antenna users to a base station (BS), which is equipped with a movable-antenna (MA) array and adopts zero-forcing receivers to decode multiple signals. We aim to optimize the MAs' positions at the BS, to minimize the total transmit power of all users subject to the minimum rate requirement. After applying transformations, we show that the problem is equivalent to minimizing the sum of each eigenvalue's reciprocal of a matrix, which is a function of all MAs' positions. Subsequently, the projected gradient descent (PGD) method is utilized to find a locally optimal solution. In particular, different from the latest related work, we exploit the eigenvalue decomposition to successfully derive a closed-form gradient for the PGD, which facilitates the practical implementation greatly. We demonstrate by simulations that via careful optimization for all MAs' positions in our proposed design, the total transmit power of all users can be decreased significantly as compared to competitive benchmarks.


title: Synthesis of Temporally-Robust Policies for Signal Temporal Logic Tasks using Reinforcement Learning

abstract: This paper investigates the problem of designing control policies that satisfy high-level specifications described by signal temporal logic (STL) in unknown, stochastic environments. While many existing works concentrate on optimizing the spatial robustness of a system, our work takes a step further by also considering temporal robustness as a critical metric to quantify the tolerance of time uncertainty in STL. To this end, we formulate two relevant control objectives to enhance the temporal robustness of the synthesized policies. The first objective is to maximize the probability of being temporally robust for a given threshold. The second objective is to maximize the worst-case spatial robustness value within a bounded time shift. We use reinforcement learning to solve both control synthesis problems for unknown systems. Specifically, we approximate both control objectives in a way that enables us to apply the standard Q-learning algorithm. Theoretical bounds in terms of the approximations are also derived. We present case studies to demonstrate the feasibility of our approach.


title: Invisible hand and arbitrage equilibrium in the self-organizing dynamics of pattern formation in ecological systems

abstract: Patterns in ecological systems such as mussel beds have been of considerable interest for a long time. Several physicochemical mechanisms have been proposed for their formation. Here, we propose a novel framework based on economics and game theory. Since mussels are biological agents instinctively driven by the survival purpose, we mathematically model this purpose explicitly using a new theoretical framework called statistical teleodynamics. We show both analytically and computationally that when every mussel pursues its own self-interest to survive, a stable collective order emerges spontaneously via self-organization. Thus, our mechanism is essentially the same as Adam Smith's invisible hand in a biological context. Our analysis reveals a new insight that the mussel bed patterns could be the result of arbitrage equilibrium in the competition for survival among the mussels.


title: Efficient harmonic resolvent analysis via time-stepping

abstract: We present an extension of the RSVD-$\Delta t$ algorithm initially developed for resolvent analysis of statistically stationary flows to handle harmonic resolvent analysis of time-periodic flows. The harmonic resolvent operator, as proposed by \citet{Padovanetal20}, characterizes the linearized dynamics of time-periodic flows in the frequency domain, and its singular value decomposition reveals forcing and response modes with optimal energetic gain. However, computing harmonic resolvent modes poses challenges due to $(i)$ the coupling of all $N_{\omega}$ retained frequencies into a single harmonic resolvent operator and $(ii)$ the singularity or near-singularity of the operator, making harmonic resolvent analysis considerably more computationally expensive than a standard resolvent analysis. To overcome these challenges, the RSVD-$\Delta t$ algorithm leverages time stepping of the underlying time-periodic linearized Navier-Stokes operator, which is $N_{\omega}$ times smaller than the harmonic resolvent operator, to compute the action of the harmonic resolvent operator. We develop strategies to minimize the algorithm's CPU and memory consumption, and our results demonstrate that these costs scale linearly with the problem dimension. We validate the RSVD-$\Delta t$ algorithm by computing modes for a periodically varying Ginzburg-Landau equation and demonstrate its performance using the flow over an airfoil.


title: AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model

abstract: Anomaly inspection plays an important role in industrial manufacture. Existing anomaly inspection methods are limited in their performance due to insufficient anomaly data. Although anomaly generation methods have been proposed to augment the anomaly data, they either suffer from poor generation authenticity or inaccurate alignment between the generated anomalies and masks. To address the above problems, we propose AnomalyDiffusion, a novel diffusion-based few-shot anomaly generation model, which utilizes the strong prior information of latent diffusion model learned from large-scale dataset to enhance the generation authenticity under few-shot training data. Firstly, we propose Spatial Anomaly Embedding, which consists of a learnable anomaly embedding and a spatial embedding encoded from an anomaly mask, disentangling the anomaly information into anomaly appearance and location information. Moreover, to improve the alignment between the generated anomalies and the anomaly masks, we introduce a novel Adaptive Attention Re-weighting Mechanism. Based on the disparities between the generated anomaly image and normal sample, it dynamically guides the model to focus more on the areas with less noticeable generated anomalies, enabling generation of accurately-matched anomalous image-mask pairs. Extensive experiments demonstrate that our model significantly outperforms the state-of-the-art methods in generation authenticity and diversity, and effectively improves the performance of downstream anomaly inspection tasks. The code and data are available in https://github.com/sjtuplayer/anomalydiffusion.


title: Multi-hop Sub-THz-FSO: A Technique for High-rate Uninterrupted Backhauling in 6G

abstract: Moving towards $6^{\text{th}}$ generation (6G), backhaul networks require significant improvements to support new use-cases with restricted joint capacity and availability requirements. In this paper, we investigate the potentials and challenges of joint sub-teraHertz (sub-THz) and free space optical (FSO), in short sub-THz-FSO, multi-hop networks as a candidate technology for future backhaul communications. As we show, with a proper deployment, sub-THz-FSO networks have the potential to provide high-rate reliable backhauling, while there are multiple practical challenges to be address before they can be used in large-scale.


title: Detection of Network and Genuine Network Quantum Steering

abstract: The quantum network correlations play significant roles in long distance quantum communication,quantum cryptography and distributed quantum computing. Generally it is very difficult to characterize the multipartite quantum network correlations such as nonlocality, entanglement and steering. In this paper, we propose the network and the genuine network quantum steering models from the aspect of probabilities in the star network configurations. Linear and nonlinear inequalities are derived to detect the network and genuine network quantum steering when the central party performs one fixed measurement. We show that our criteria can detect more quantum network steering than that from the violation of the n-locality quantum networks. Moreover, it is shown that biseparable assemblages can demonstrate genuine network steering in the star network configurations.


title: FedASMU: Efficient Asynchronous Federated Learning with Dynamic Staleness-aware Model Update

abstract: As a promising approach to deal with distributed data, Federated Learning (FL) achieves major advancements in recent years. FL enables collaborative model training by exploiting the raw data dispersed in multiple edge devices. However, the data is generally non-independent and identically distributed, i.e., statistical heterogeneity, and the edge devices significantly differ in terms of both computation and communication capacity, i.e., system heterogeneity. The statistical heterogeneity leads to severe accuracy degradation while the system heterogeneity significantly prolongs the training process. In order to address the heterogeneity issue, we propose an Asynchronous Staleness-aware Model Update FL framework, i.e., FedASMU, with two novel methods. First, we propose an asynchronous FL system model with a dynamical model aggregation method between updated local models and the global model on the server for superior accuracy and high efficiency. Then, we propose an adaptive local model adjustment method by aggregating the fresh global model with local models on devices to further improve the accuracy. Extensive experimentation with 6 models and 5 public datasets demonstrates that FedASMU significantly outperforms baseline approaches in terms of accuracy (0.60% to 23.90% higher) and efficiency (3.54% to 97.98% faster).


title: Hacking Task Confounder in Meta-Learning

abstract: Meta-learning enables rapid generalization to new tasks by learning knowledge from various tasks. It is intuitively assumed that as the training progresses, a model will acquire richer knowledge, leading to better generalization performance. However, our experiments reveal an unexpected result: there is negative knowledge transfer between tasks, affecting generalization performance. To explain this phenomenon, we conduct Structural Causal Models (SCMs) for causal analysis. Our investigation uncovers the presence of spurious correlations between task-specific causal factors and labels in meta-learning. Furthermore, the confounding factors differ across different batches. We refer to these confounding factors as "Task Confounders". Based on these findings, we propose a plug-and-play Meta-learning Causal Representation Learner (MetaCRL) to eliminate task confounders. It encodes decoupled generating factors from multiple tasks and utilizes an invariant-based bi-level optimization mechanism to ensure their causality for meta-learning. Extensive experiments on various benchmark datasets demonstrate that our work achieves state-of-the-art (SOTA) performance.


title: A^3-CodGen: A Repository-Level Code Generation Framework for Code Reuse with Local-Aware, Global-Aware, and Third-Party-Library-Aware

abstract: Code generation tools are essential to help developers in the software development process. Existing tools often disconnect with the working context, i.e., the code repository, causing the generated code to be not similar to human developers. In this paper, we propose a novel code generation framework, dubbed A^3-CodGen, to harness information within the code repository to generate code with fewer potential logical errors, code redundancy, and library-induced compatibility issues. We identify three categories of representative information for the code repository: local-aware information from current code file, global-aware information from other code files, and third-party-library information. Results demonstrate that by adopting the A^3-CodGen framework, we successfully extract, fuse, and feed code repository information into the LLM, generating more accurate, efficient, and highly reusable code. The effectiveness of our framework is further underscored by generating code with a higher reuse rate, compared to human developers. This research contributes significantly to the field of code generation, providing developers with a more powerful tool to address the evolving demands in software development in practice.


title: Explosive Legged Robotic Hopping: Energy Accumulation and Power Amplification via Pneumatic Augmentation

abstract: We present a novel pneumatic augmentation to traditional electric motor-actuated legged robot to increase intermittent power density to perform infrequent explosive hopping behaviors. The pneumatic system is composed of a pneumatic pump, a tank, and a pneumatic actuator. The tank is charged up by the pump during regular hopping motion that is created by the electric motors. At any time after reaching a desired air pressure in the tank, a solenoid valve is utilized to rapidly release the air pressure to the pneumatic actuator (piston) which is used in conjunction with the electric motors to perform explosive hopping, increasing maximum hopping height for one or subsequent cycles. We show that, on a custom-designed one-legged hopping robot, without any additional power source and with this novel pneumatic augmentation system, their associated system identification and optimal control, the robot is able to realize highly explosive hopping with power amplification per cycle by a factor of approximately 5.4 times the power of electric motor actuation alone.


title: Secured Quantum Identity Authentication Protocol for Quantum Networks

abstract: Quantum Internet signifies a remarkable advancement in communication technology, harnessing the principles of quantum entanglement and superposition to facilitate unparalleled levels of security and efficient computations. Quantum communication can be achieved through the utilization of quantum entanglement. Through the exchange of entangled pairs between two entities, quantum communication becomes feasible, enabled by the process of quantum teleportation. Given the lossy nature of the channels and the exponential decoherence of the transmitted photons, a set of intermediate nodes can serve as quantum repeaters to perform entanglement swapping and directly entangle two distant nodes. Such quantum repeaters may be malicious and by setting up malicious entanglements, intermediate nodes can jeopardize the confidentiality of the quantum information exchanged between the two communication nodes. Hence, this paper proposes a quantum identity authentication protocol that protects quantum networks from malicious entanglements. Unlike the existing protocols, the proposed quantum authentication protocol does not require periodic refreshments of the shared secret keys. Simulation results demonstrate that the proposed protocol can detect malicious entanglements with a 100% probability after an average of 4 authentication rounds.


title: Secure and Efficient Entanglement Distribution Protocol for Near-Term Quantum Internet

abstract: Quantum information technology has the potential to revolutionize computing, communications, and security. To fully realize its potential, quantum processors with millions of qubits are needed, which is still far from being accomplished. Thus, it is important to establish quantum networks to enable distributed quantum computing to leverage existing and near-term quantum processors into more powerful resources. This paper introduces a protocol to distribute entanglements among quantum devices within classical-quantum networks with limited quantum links, enabling more efficient quantum teleportation in near-term hybrid networks. The proposed protocol uses entanglement swapping to distribute entanglements efficiently in a butterfly network, then classical network coding is applied to enable quantum teleportation while overcoming network bottlenecks and minimizing qubit requirements for individual nodes. Experimental results show that the proposed protocol requires quantum resources that scale linearly with network size, with individual nodes only requiring a fixed number of qubits. For small network sizes of up to three transceiver pairs, the proposed protocol outperforms the benchmark by using 17% fewer qubit resources, achieving 8.8% higher accuracy, and with a 35% faster simulation time. The percentage improvement increases significantly for large network sizes. We also propose a protocol for securing entanglement distribution against malicious entanglements using quantum state encoding through rotation. Our analysis shows that this method requires no communication overhead and reduces the chance of a malicious node retrieving a quantum state to 7.2%. The achieved results point toward a protocol that enables a highly scalable, efficient, and secure near-term quantum Internet.


title: A complex singlet extension of the Standard Model with a singlet fermion dark matter

abstract: We examine a complex singlet scalar extension of the Standard Model (CxSM) with an extra singlet fermion. Both the singlet scalar and fermion are dark matter (DM) candidates. It is known that although the scalar potential in the CxSM can realize strong first-order electroweak phase transition, the scalar DM included in the model gives only a tiny amount of the relic density compared to the observed one. Therefore, a fermion DM is introduced to compensate for the lack of relic density. We find that the scattering of the fermion DM and nucleons is sufficiently suppressed when the masses of scalar mediators are degenerate, as well as in the case of the scalar DM. We show the range of a combination of the mass and the Yukawa coupling of the fermion DM, which satisfies both the observed relic density and conditions of strong first-order electroweak phase transition.


title: Negative Pre-aware for Noisy Cross-modal Matching

abstract: Cross-modal noise-robust learning is a challenging task since noisy correspondence is hard to recognize and rectify. Due to the cumulative and unavoidable negative impact of unresolved noise, existing methods cannot maintain a stable performance when the noise increases. In this paper, we present a novel Negative Pre-aware Cross-modal (NPC) matching solution for large visual-language model fine-tuning on noisy downstream tasks. It is featured in two aspects: (1) For noise recognition and resistance, previous methods usually directly filter out a noise subset, we propose to estimate the negative impact of each sample. It does not need additional correction mechanisms that may predict unreliable correction results, leading to self-reinforcing error. We assign a confidence weight to each sample according to its negative impact in the training process. This adaptively adjusts the contribution of each sample to avoid noisy accumulation. (2) For maintaining stable performance with increasing noise, we utilize the memorization effect of DNNs by maintaining a memory bank. Specifically, we apply GMM to select high-confident clean samples as the memory entry, where the memory entry is used to estimate the negative impact of each sample. Since clean samples are easier distinguished by GMM with increasing noise, the memory bank can still maintain high quality at a high noise ratio. Compared to the correction mechanism focusing on noise samples, memory bank-based estimation is more robust, which makes the model performance stable on noisy datasets. Extensive experiments demonstrate that our method significantly improves matching accuracy and performance stability at increasing noise ratio. Our approach also surpasses the state-of-the-art methods by a large margin. The code is available at: https://github.com/ZhangXu0963/NPC.


title: Guiding ChatGPT to Fix Web UI Tests via Explanation-Consistency Checking

abstract: The rapid evolution of Web UI incurs time and effort in maintaining UI tests. Existing techniques in Web UI test repair focus on finding the target elements on the new web page that match the old ones so that the corresponding broken statements can be repaired. We present the first study that investigates the feasibility of using prior Web UI repair techniques for initial local matching and then using ChatGPT to perform global matching. Our key insight is that given a list of elements matched by prior techniques, ChatGPT can leverage the language understanding to perform global view matching and use its code generation model for fixing the broken statements. To mitigate hallucination in ChatGPT, we design an explanation validator that checks whether the provided explanation for the matching results is consistent, and provides hints to ChatGPT via a self-correction prompt to further improve its results. Our evaluation on a widely used dataset shows that the ChatGPT-enhanced techniques improve the effectiveness of existing Web test repair techniques. Our study also shares several important insights in improving future Web UI test repair techniques.


title: Autotuning by Changing Directives and Number of Threads in OpenMP using ppOpen-AT

abstract: Recently, computers have diversified architectures. To achieve high numerical calculation software performance, it is necessary to tune the software according to the target computer architecture. However, code optimization for each environment is difficult unless it is performed by a specialist who knows computer architectures well. By applying autotuning (AT), the tuning effort can be reduced. Optimized implementation by AT that enhances computer performance can be used even by non-experts. In this research, we propose a technique for AT for programs using open multi-processing (OpenMP). We propose an AT method using an AT language that changes the OpenMP optimized loop and dynamically changes the number of threads in OpenMP according to computational kernels. Performance evaluation was performed using the Fujitsu PRIMEHPC FX100, which is a K-computer type supercomputer installed at the Information Technology Center, Nagoya University. As a result, we found there was a performance increase of 1.801 times that of the original code in a plasma turbulence analysis.


title: PULSAR: Graph based Positive Unlabeled Learning with Multi Stream Adaptive Convolutions for Parkinson's Disease Recognition

abstract: Parkinson's disease (PD) is a neuro-degenerative disorder that affects movement, speech, and coordination. Timely diagnosis and treatment can improve the quality of life for PD patients. However, access to clinical diagnosis is limited in low and middle income countries (LMICs). Therefore, development of automated screening tools for PD can have a huge social impact, particularly in the public health sector. In this paper, we present PULSAR, a novel method to screen for PD from webcam-recorded videos of the finger-tapping task from the Movement Disorder Society - Unified Parkinson's Disease Rating Scale (MDS-UPDRS). PULSAR is trained and evaluated on data collected from 382 participants (183 self-reported as PD patients). We used an adaptive graph convolutional neural network to dynamically learn the spatio temporal graph edges specific to the finger-tapping task. We enhanced this idea with a multi stream adaptive convolution model to learn features from different modalities of data critical to detect PD, such as relative location of the finger joints, velocity and acceleration of tapping. As the labels of the videos are self-reported, there could be cases of undiagnosed PD in the non-PD labeled samples. We leveraged the idea of Positive Unlabeled (PU) Learning that does not need labeled negative data. Our experiments show clear benefit of modeling the problem in this way. PULSAR achieved 80.95% accuracy in validation set and a mean accuracy of 71.29% (2.49% standard deviation) in independent test, despite being trained with limited amount of data. This is specially promising as labeled data is scarce in health care sector. We hope PULSAR will make PD screening more accessible to everyone. The proposed techniques could be extended for assessment of other movement disorders, such as ataxia, and Huntington's disease.


title: The CO outflow components ejected by a recent accretion event in B335

abstract: Protostellar outflows often present a knotty appearance, providing evidence of sporadic accretion in stellar mass growth. To understand the direct relation between mass accretion and ejection, we analyze the contemporaneous accretion activity and associated ejection components in B335. B335 has brightened in the mid-IR by 2.5 mag since 2010, indicating increased luminosity, presumably due to increased mass accretion rate onto the protostar. ALMA observations of 12CO emission in the outflow reveal high-velocity emission, estimated to have been ejected 4.6 - 2 years before the ALMA observation and consistent with the jump in mid-IR brightness. The consistency in timing suggests that the detected high-velocity ejection components are directly linked to the most recent accretion activity. We calculated the kinetic energy, momentum, and force for the ejection component associated with the most recent accretion activity and found that at least, about 1.0% of accreted mass has been ejected. More accurate information on the jet inclination and the temperature of the ejected gas components will better constrain the ejected mass induced by the recently enhanced accretion event.


title: Cellular uptake of active nonspherical nanoparticles

abstract: Due to the potential applications in biomedical engineering, it becomes more and more important to understand the process of engulfment and internalization of nanoparticles (NPs) by cell membranes. Despite the fact that the interaction between cell membranes and passive particles has been widely studied, the interaction between cell membranes and self-propelled nonspherical NPs remains to be elucidated. Here we present a theoretical model to systematically investigate the influence of the active force, aspect ratio of NPs, particle size and membrane properties (adhesion energy density and membrane tension) on the cellular uptake of a nonspherical nanoparticle. It is found that the active force generated by an NP can trigger a type of first-order wrapping transition from a small partial wrapping state to a large one. In addition, the phase diagram in the force-aspect ratio (particle size, adhesion energy density and membrane tension) space displays more complex behaviors compared with that for the passive wrapping mediated merely by adhesion. These results may provide a useful guidance to the study of activity-driven cellular entry of active particles into cells.


title: DCIR: Dynamic Consistency Intrinsic Reward for Multi-Agent Reinforcement Learning

abstract: Learning optimal behavior policy for each agent in multi-agent systems is an essential yet difficult problem. Despite fruitful progress in multi-agent reinforcement learning, the challenge of addressing the dynamics of whether two agents should exhibit consistent behaviors is still under-explored. In this paper, we propose a new approach that enables agents to learn whether their behaviors should be consistent with that of other agents by utilizing intrinsic rewards to learn the optimal policy for each agent. We begin by defining behavior consistency as the divergence in output actions between two agents when provided with the same observation. Subsequently, we introduce dynamic consistency intrinsic reward (DCIR) to stimulate agents to be aware of others' behaviors and determine whether to be consistent with them. Lastly, we devise a dynamic scale network (DSN) that provides learnable scale factors for the agent at every time step to dynamically ascertain whether to award consistent behavior and the magnitude of rewards. We evaluate DCIR in multiple environments including Multi-agent Particle, Google Research Football and StarCraft II Micromanagement, demonstrating its efficacy.


title: Graph-based Prediction and Planning Policy Network (GP3Net) for scalable self-driving in dynamic environments using Deep Reinforcement Learning

abstract: Recent advancements in motion planning for Autonomous Vehicles (AVs) show great promise in using expert driver behaviors in non-stationary driving environments. However, learning only through expert drivers needs more generalizability to recover from domain shifts and near-failure scenarios due to the dynamic behavior of traffic participants and weather conditions. A deep Graph-based Prediction and Planning Policy Network (GP3Net) framework is proposed for non-stationary environments that encodes the interactions between traffic participants with contextual information and provides a decision for safe maneuver for AV. A spatio-temporal graph models the interactions between traffic participants for predicting the future trajectories of those participants. The predicted trajectories are utilized to generate a future occupancy map around the AV with uncertainties embedded to anticipate the evolving non-stationary driving environments. Then the contextual information and future occupancy maps are input to the policy network of the GP3Net framework and trained using Proximal Policy Optimization (PPO) algorithm. The proposed GP3Net performance is evaluated on standard CARLA benchmarking scenarios with domain shifts of traffic patterns (urban, highway, and mixed). The results show that the GP3Net outperforms previous state-of-the-art imitation learning-based planning models for different towns. Further, in unseen new weather conditions, GP3Net completes the desired route with fewer traffic infractions. Finally, the results emphasize the advantage of including the prediction module to enhance safety measures in non-stationary environments.


title: On Possible Indicators of Negative Selection in Germinal Centers

abstract: A central feature of vertebrate immune response is affinity maturation, wherein antibody-producing B cells undergo evolutionary selection in microanatomical structures called germinal centers, which form in secondary lymphoid organs upon antigen exposure. While it has been shown that the median B cell affinity dependably increases over the course of maturation, the exact logic behind this evolution remains vague. Three potential selection methods include encouraging the reproduction of high affinity cells (``birth/positive selection''), encouraging cell death in low affinity cells (``death/negative selection''), and adjusting the mutation rate based on cell affinity (``mutational selection''). While all three forms of selection would lead to a net increase in affinity, different selection methods may lead to distinct statistical dynamics. We present a tractable model of selection, and analyze proposed signatures of negative selection. Given the simplicity of the model, such signatures should be stronger here than in real systems. However, we find a number of intuitively appealing metrics -- such as preferential ancestry ratios, terminal node counts, and mutation count skewness -- are all ill-suited for detecting selection method.


title: Deep Learning for Joint Design of Pilot, Channel Feedback, and Hybrid Beamforming in FDD Massive MIMO-OFDM Systems

abstract: This letter considers the transceiver design in frequency division duplex (FDD) massive multiple-input multiple-output (MIMO) orthogonal frequency division multiplexing (OFDM) systems for high-quality data transmission. We propose a novel deep learning based framework where the procedures of pilot design, channel feedback, and hybrid beamforming are realized by carefully crafted deep neural networks. All the considered modules are jointly learned in an end-to-end manner, and a graph neural network is adopted to effectively capture interactions between beamformers based on the built graphical representation. Numerical results validate the effectiveness of our method.


title: Efficient Sparse-Reward Goal-Conditioned Reinforcement Learning with a High Replay Ratio and Regularization

abstract: Reinforcement learning (RL) methods with a high replay ratio (RR) and regularization have gained interest due to their superior sample efficiency. However, these methods have mainly been developed for dense-reward tasks. In this paper, we aim to extend these RL methods to sparse-reward goal-conditioned tasks. We use Randomized Ensemble Double Q-learning (REDQ) (Chen et al., 2021), an RL method with a high RR and regularization. To apply REDQ to sparse-reward goal-conditioned tasks, we make the following modifications to it: (i) using hindsight experience replay and (ii) bounding target Q-values. We evaluate REDQ with these modifications on 12 sparse-reward goal-conditioned tasks of Robotics (Plappert et al., 2018), and show that it achieves about $2 \times$ better sample efficiency than previous state-of-the-art (SoTA) RL methods. Furthermore, we reconsider the necessity of specific components of REDQ and simplify it by removing unnecessary ones. The simplified REDQ with our modifications achieves $\sim 8 \times$ better sample efficiency than the SoTA methods in 4 Fetch tasks of Robotics.


title: Hot Electron Generation and Manipulation in Nano-spiked Plasmonic Cavity Arrays

abstract: The generation of the localized surface plasmon resonance (LSPR) on the surface of plasmonic structures in the nanoscale has paved the way for advanced biosensing, surpassing the conventional detection limits. The electric field enhancement (electromagnetic hot spots) between two plasmonic nano structures at close quarters produces hot electrons with a change in the electron density of the material. Techniques such as photoinjection are suitable to inject hot electrons from the metal crossing the Schottky barrier to the semiconductor leading to the development of photocurrent. sea urchin looking spiked nanoparticles serve a great interest in research of plasmonic materials as they can generate hot electrons at higher rate compared to other structures. By means of finite element method (FEM) analysis, we investigate the electric field enhancement generated between the cavity of nano star spike pairs and extend the study to an array of them. We further do a parametric study and identify the importance of using such an array to generate hot electrons whose applications are envisaged for light harvesting, enhanced photodetection, photo catalysis etc.


title: Small-ball constants, and exceptional flat points of SPDEs

abstract: We study small-ball probabilities for the stochastic heat equation with multiplicative noise in the moderate-deviations regime. We prove the existence of a small-ball constant and related it to other known quantities in the literature. These small-ball estimates are known to imply Chung-type laws of the iterated logarithm (LIL) at typical spatial points; these points can be thought of as "points of flat growth". For this result in a similar context in SPDEs see, for example, the recent work of Chen \cite{Ch2023}. We establish the existence of a new family of exceptional spatial points where the Chung-type LIL fails.


title: SimPSI: A Simple Strategy to Preserve Spectral Information in Time Series Data Augmentation

abstract: Data augmentation is a crucial component in training neural networks to overcome the limitation imposed by data size, and several techniques have been studied for time series. Although these techniques are effective in certain tasks, they have yet to be generalized to time series benchmarks. We find that current data augmentation techniques ruin the core information contained within the frequency domain. To address this issue, we propose a simple strategy to preserve spectral information (SimPSI) in time series data augmentation. SimPSI preserves the spectral information by mixing the original and augmented input spectrum weighted by a preservation map, which indicates the importance score of each frequency. Specifically, our experimental contributions are to build three distinct preservation maps: magnitude spectrum, saliency map, and spectrum-preservative map. We apply SimPSI to various time series data augmentations and evaluate its effectiveness across a wide range of time series benchmarks. Our experimental results support that SimPSI considerably enhances the performance of time series data augmentations by preserving core spectral information. The source code used in the paper is available at https://github.com/Hyun-Ryu/simpsi.


title: Gluing GAP to RAS Mutants: A New Approach to an Old Problem in Cancer Drug Development

abstract: Mutated genes may lead to cancer development in numerous tissues. While more than 600 cancer-causing genes are known today, some of the most widespread mutations are connected to the RAS gene: RAS mutations are found in approximately 25% of all human tumors. Specifically, KRAS mutations are involved in the three most lethal cancers in U.S.: pancreatic ductal adenocarcinoma, colorectal adenocarcinoma, and lung adenocarcinoma. These cancers are among the most difficult to treat, and they are frequently excluded from chemotherapeutic attacks as hopeless cases. The mutated KRAS proteins have specific 3-dimensional conformations, which perturb functional interaction with the GAP protein on the GAP:RAS complex surface leading to a signaling cascade and uncontrolled cell growth. Here we describe a gluing docking method for finding small molecules that bind to both the GAP and the mutated KRAS molecules. These small molecules glue together the GAP and the mutated KRAS molecules and may serve as new cancer drugs for the most lethal, most difficult-to-treat carcinomas. As a proof of concept, we identify two new, drug-like small molecules with the new method: these compounds specifically inhibit the growth of PANC-1 cell line with KRAS mutation G12D in vitro and in vivo. Importantly, the two new compounds show significantly lower IC50 and higher specificity against the G12D KRAS mutant as compared to the recently described MRTX-1133 inhibitor against the G12D KRAS mutant.