title: On the Limits of Multi-modal Meta-Learning with Auxiliary Task Modulation Using Conditional Batch Normalization

abstract: Few-shot learning aims to learn representations that can tackle novel tasks given a small number of examples. Recent studies show that cross-modal learning can improve representations for few-shot classification. More specifically, language is a rich modality that can be used to guide visual learning. In this work, we experiment with a multi-modal architecture for few-shot learning that consists of three components: a classifier, an auxiliary network, and a bridge network. While the classifier performs the main classification task, the auxiliary network learns to predict language representations from the same input, and the bridge network transforms high-level features of the auxiliary network into modulation parameters for layers of the few-shot classifier using conditional batch normalization. The bridge should encourage a form of lightweight semantic alignment between language and vision which could be useful for the classifier. However, after evaluating the proposed approach on two popular few-shot classification benchmarks we find that a) the improvements do not reproduce across benchmarks, and b) when they do, the improvements are due to the additional compute and parameters introduced by the bridge network. We contribute insights and recommendations for future work in multi-modal meta-learning, especially when using language representations.


title: Resilient Average Consensus with Adversaries via Distributed Detection and Recovery

abstract: We study the problem of resilient average consensus in multi-agent systems where some of the agents are subject to failures or attacks. The objective of resilient average consensus is for non-faulty/normal agents to converge to the average of their initial values despite the erroneous effects from malicious agents. To this end, we propose a successful distributed iterative resilient average consensus algorithm for the multi-agent networks with general directed topologies. The proposed algorithm has two parts at each iteration: detection and averaging. For the detection part, we propose two distributed algorithms and one of them can detect malicious agents with only the information from direct in-neighbors. For the averaging part, we extend the applicability of an existing averaging algorithm where normal agents can remove the effects from malicious agents so far, after they are detected. Another important feature of our method is that it can handle the case where malicious agents are neighboring and collaborating with each other to mislead the normal ones from averaging. This case cannot be solved by existing detection approaches in related literature. Moreover, our algorithm is efficient in storage usage especially for large-scale networks as each agent only requires the values of neighbors within two hops. Lastly, numerical examples are given to verify the efficacy of the proposed algorithms.


title: Confronting the Reproducibility Crisis: A Case Study in Validating Certified Robustness

abstract: Reproducibility is a cornerstone of scientific research, enabling validation, extension, and progress. However, the rapidly evolving nature of software and dependencies poses significant challenges to reproducing research results, particularly in fields like adversarial robustness for deep neural networks, where complex codebases and specialized toolkits are utilized. This paper presents a case study of attempting to validate the results on certified adversarial robustness in "SoK: Certified Robustness for Deep Neural Networks" using the VeriGauge toolkit. Despite following the documented methodology, numerous software and hardware compatibility issues were encountered, including outdated or unavailable dependencies, version conflicts, and driver incompatibilities. While a subset of the original results could be run, key findings related to the empirical robust accuracy of various verification methods proved elusive due to these technical obstacles, as well as slight discrepancies in the test results. This practical experience sheds light on the reproducibility crisis afflicting adversarial robustness research, where a lack of reproducibility threatens scientific integrity and hinders progress. The paper discusses the broader implications of this crisis, proposing potential solutions such as containerization, software preservation, and comprehensive documentation practices. Furthermore, it highlights the need for collaboration and standardization efforts within the research community to develop robust frameworks for reproducible research. By addressing the reproducibility crisis head-on, this work aims to contribute to the ongoing discourse on scientific reproducibility and advocate for best practices that ensure the reliability and validity of research findings within not only adversarial robustness, but security and technology research as a whole.


title: GIST: Greedy Independent Set Thresholding for Diverse Data Summarization

abstract: We propose a novel subset selection task called min-distance diverse data summarization ($\textsf{MDDS}$), which has a wide variety of applications in machine learning, e.g., data sampling and feature selection. Given a set of points in a metric space, the goal is to maximize an objective that combines the total utility of the points and a diversity term that captures the minimum distance between any pair of selected points, subject to the constraint $|S| \le k$. For example, the points may correspond to training examples in a data sampling problem, e.g., learned embeddings of images extracted from a deep neural network. This work presents the $\texttt{GIST}$ algorithm, which achieves a $\frac{2}{3}$-approximation guarantee for $\textsf{MDDS}$ by approximating a series of maximum independent set problems with a bicriteria greedy algorithm. We also prove a complementary $(\frac{2}{3}+\varepsilon)$-hardness of approximation, for any $\varepsilon > 0$. Finally, we provide an empirical study that demonstrates $\texttt{GIST}$ outperforms existing methods for $\textsf{MDDS}$ on synthetic data, and also for a real-world image classification experiment the studies single-shot subset selection for ImageNet.


title: Feynman integrals and Fox functions

abstract: In this work we discuss the connection between Feynman integrals and Fox functions. Illustrative examples are given.


title: Provable Contrastive Continual Learning

abstract: Continual learning requires learning incremental tasks with dynamic data distributions. So far, it has been observed that employing a combination of contrastive loss and distillation loss for training in continual learning yields strong performance. To the best of our knowledge, however, this contrastive continual learning framework lacks convincing theoretical explanations. In this work, we fill this gap by establishing theoretical performance guarantees, which reveal how the performance of the model is bounded by training losses of previous tasks in the contrastive continual learning framework. Our theoretical explanations further support the idea that pre-training can benefit continual learning. Inspired by our theoretical analysis of these guarantees, we propose a novel contrastive continual learning algorithm called CILA, which uses adaptive distillation coefficients for different tasks. These distillation coefficients are easily computed by the ratio between average distillation losses and average contrastive losses from previous tasks. Our method shows great improvement on standard benchmarks and achieves new state-of-the-art performance.


title: Multi-objective Cross-task Learning via Goal-conditioned GPT-based Decision Transformers for Surgical Robot Task Automation

abstract: Surgical robot task automation has been a promising research topic for improving surgical efficiency and quality. Learning-based methods have been recognized as an interesting paradigm and been increasingly investigated. However, existing approaches encounter difficulties in long-horizon goal-conditioned tasks due to the intricate compositional structure, which requires decision-making for a sequence of sub-steps and understanding of inherent dynamics of goal-reaching tasks. In this paper, we propose a new learning-based framework by leveraging the strong reasoning capability of the GPT-based architecture to automate surgical robotic tasks. The key to our approach is developing a goal-conditioned decision transformer to achieve sequential representations with goal-aware future indicators in order to enhance temporal reasoning. Moreover, considering to exploit a general understanding of dynamics inherent in manipulations, thus making the model's reasoning ability to be task-agnostic, we also design a cross-task pretraining paradigm that uses multiple training objectives associated with data from diverse tasks. We have conducted extensive experiments on 10 tasks using the surgical robot learning simulator SurRoL~\cite{long2023human}. The results show that our new approach achieves promising performance and task versatility compared to existing methods. The learned trajectories can be deployed on the da Vinci Research Kit (dVRK) for validating its practicality in real surgical robot settings. Our project website is at: https://med-air.github.io/SurRoL.


title: Learning to Continually Learn with the Bayesian Principle

abstract: In the present era of deep learning, continual learning research is mainly focused on mitigating forgetting when training a neural network with stochastic gradient descent on a non-stationary stream of data. On the other hand, in the more classical literature of statistical machine learning, many models have sequential Bayesian update rules that yield the same learning outcome as the batch training, i.e., they are completely immune to catastrophic forgetting. However, they are often overly simple to model complex real-world data. In this work, we adopt the meta-learning paradigm to combine the strong representational power of neural networks and simple statistical models' robustness to forgetting. In our novel meta-continual learning framework, continual learning takes place only in statistical models via ideal sequential Bayesian update rules, while neural networks are meta-learned to bridge the raw data and the statistical models. Since the neural networks remain fixed during continual learning, they are protected from catastrophic forgetting. This approach not only achieves significantly improved performance but also exhibits excellent scalability. Since our approach is domain-agnostic and model-agnostic, it can be applied to a wide range of problems and easily integrated with existing model architectures.


title: Ponderomotive electron physics captured in single-fluid extended MHD model

abstract: The well-known ponderomotive force, arising from the interaction of matter and light, has critical implications across a broad range of fields from laser fusion and astrophysics to laser diagnostics and even pulsed-power experiments. This pseudo-potential pushes electrons, which through coulomb forces causes ion density modulations that can steepen with profound implications. When used intentionally, density modulations can be used for plasma gratings, which are essential for optical components operating in extreme conditions for next generation lasers. They can also be important for plasma confinement and particle trapping, which can even impact magnetic confinement in fusion devices. The ponderomotive potential also leads to laser self-focusing, complicating laser diagnostics. In laser fusion, the force exacerbates challenges posed by stimulated Brillouin scattering (SBS) and crossed beam energy transfer (CBET), both of which destabilize the fusion process. It even plays an astrophysical role in the filamentation of fast radio bursts in the relativistic winds of magnetars. Since the ponderomotive force primarily effects electron dynamics, multi-fluid/particle codes or additional ansatz are required to include its effects. This paper demonstrates that by including electron effects on an ion timescale with a 1-fluid, 2-energy extended magnetohydrodynamics (XMHD) model, ponderomotive effects are also naturally present. We introduce the theory for these dynamics and demonstrate their presence with 1-D pencil-like simulations.


title: Local nature of 0.1 Hz oscillations in microcirculation is confirmed by imaging photoplethysmography

abstract: Low-frequency oscillations in the human circulatory system is important for basic physiology and practical applications in clinical medicine. Our objective was to study which mechanism (central or local) is responsible for changes in blood flow fluctuations at around 0.1 Hz. We used the method of imaging photoplethysmography synchronized with electrocardiography to measure blood-flow response to local forearm heating of 18 healthy male volunteers. The dynamics of peripheral perfusion was revealed by a correlation processing of photoplethysmography data, and the central hemodynamics was assessed from the electrocardiogram. Wavelet analysis was used to estimate the dynamics of spectral components. Our results show that skin heating leads to multiple increase in local perfusion accompanied by drop in blood flow oscillations at 0.1 Hz, whereas no changes in heart rate variability was observed. After switching off the heating, perfusion remains at the high level, regardless decrease in skin temperature. The 0.1 Hz oscillations are smoothly recovered to the base level. In conclusion, we confirm the local nature of fluctuations in peripheral blood flow in the frequency band of about 0.1 Hz. A significant, but time-delayed, recovery of fluctuation energy in this frequency range after cessation of the skin warming was discovered. This study reveals a novel factor involved in the regulation microcirculatory vascular tone. A comprehensive study of hemodynamics using the new technique of imaging photoplethysmography synchronized with electrocardiography is a prerequisite for development of a valuable diagnostic tool.


title: FDQN: A Flexible Deep Q-Network Framework for Game Automation

abstract: In reinforcement learning, it is often difficult to automate high-dimensional, rapid decision-making in dynamic environments, especially when domains require real-time online interaction and adaptive strategies such as web-based games. This work proposes a state-of-the-art Flexible Deep Q-Network (FDQN) framework that can address this challenge with a selfadaptive approach that is processing high-dimensional sensory data in realtime using a CNN and dynamically adapting the model architecture to varying action spaces of different gaming environments and outperforming previous baseline models in various Atari games and the Chrome Dino game as baselines. Using the epsilon-greedy policy, it effectively balances the new learning and exploitation for improved performance, and it has been designed with a modular structure that it can be easily adapted to other HTML-based games without touching the core part of the framework. It is demonstrated that the FDQN framework can successfully solve a well-defined task in a laboratory condition, but more importantly it also discusses potential applications to more challenging real-world cases and serve as the starting point for future further exploration into automated game play and beyond.


title: Inpaint Biases: A Pathway to Accurate and Unbiased Image Generation

abstract: This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations not only confine the creative potential of these models but also pose risks of reinforcing stereotypes. To address these challenges, we introduce the Inpaint Biases framework, which employs user-defined masks and inpainting techniques to enhance the accuracy of image generation, particularly for novel or inaccurately rendered objects. Through experimental validation, we demonstrate how this framework significantly improves the fidelity of generated images to the user's intent, thereby expanding the models' creative capabilities and mitigating the risk of perpetuating biases. Our study contributes to the advancement of text-to-image models as unbiased, versatile tools for creative expression.


title: Stationary distribution approximations of Two-island Wright-Fisher and seed-bank models using Stein's method

abstract: We consider two finite population Markov chain models, the two-island Wright-Fisher model with mutation, and the seed-bank model with mutation. Despite the relatively simple descriptions of the two processes, the the exact form of their stationary distributions is in general intractable. For each of the two models we provide two approximation theorems with explicit upper bounds on the distance between the stationary distributions of the finite population Markov chains, and either the stationary distribution of a two-island diffusion model, or the beta distribution. We show that the order of the bounds, and correspondingly the appropriate choice of approximation, depends upon the relative sizes of mutation and migration. In the case where migration and mutation are of the same order, the suitable approximation is the two-island diffusion model, and if migration dominates mutation, then the weighted average of both islands is well approximated by a beta random variable. Our results are derived from a new development of Stein's method for the stationary distribution of the two-island diffusion model for the weak migration results, and utilising the existing framework for Stein's method for the Dirichlet distribution.


title: 2D hydrodynamic simulation of TeraFETs beyond the gradual-channel approximation for transient, large-signal or ultrahigh-frequency simulations

abstract: In the past decade, detection of THz radiation by plasma-wave-assisted frequency mixing in antenna-coupled field-effect transistors (TeraFETs) -- implemented in various semiconductor material systems (Si CMOS, GaN/AlGaN, GaAs/AlGaAs, graphene, etc.) -- has matured and led to a practically applied detector technology. This has been supported by the development of powerful device simulation tools which take into account relevant collective carrier dynamics and mixing processes in various approximations. These tools mostly model carrier transport in 1D and they are usually geared towards continuous-wave illumination of the device and small-signal response. Depending on their implementation, it may not be possible readily to simulate large-signal and pulsed operation. Another approximation which may lead to unsatisfactory results is the 1D restriction to calculate only the longitudinal electric field components. Especially at the edges of the gate electrode, solving of the 2D Poisson equation promises better results. This contribution introduces a stable way to solve the 2D Poisson equation self-consistently with the hydrodynamic transport equations including the numerically challenging convection term. We employ a well-balanced approximate Harten-Lax-van-Leer-Contact Riemann solver. The approach is well suited for a future treatment of transient and large-signal cases as well as the Dyakonov-Shur instability. The 2D treatment also generically extends the model beyond the gradual-channel approximation and allows to calculate the FET's response at high THz frequencies where the gate-to-channel potential acquires a non-local character. Model calculations are performed for the exemplary case of a 65-nm Si CMOS TeraFET in the isothermal approximation.


title: Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI

abstract: The current electroencephalogram (EEG) based deep learning models are typically designed for specific datasets and applications in brain-computer interaction (BCI), limiting the scale of the models and thus diminishing their perceptual capabilities and generalizability. Recently, Large Language Models (LLMs) have achieved unprecedented success in text processing, prompting us to explore the capabilities of Large EEG Models (LEMs). We hope that LEMs can break through the limitations of different task types of EEG datasets, and obtain universal perceptual capabilities of EEG signals through unsupervised pre-training. Then the models can be fine-tuned for different downstream tasks. However, compared to text data, the volume of EEG datasets is generally small and the format varies widely. For example, there can be mismatched numbers of electrodes, unequal length data samples, varied task designs, and low signal-to-noise ratio. To overcome these challenges, we propose a unified foundation model for EEG called Large Brain Model (LaBraM). LaBraM enables cross-dataset learning by segmenting the EEG signals into EEG channel patches. Vector-quantized neural spectrum prediction is used to train a semantically rich neural tokenizer that encodes continuous raw EEG channel patches into compact neural codes. We then pre-train neural Transformers by predicting the original neural codes for the masked EEG channel patches. The LaBraMs were pre-trained on about 2,500 hours of various types of EEG signals from around 20 datasets and validated on multiple different types of downstream tasks. Experiments on abnormal detection, event type classification, emotion recognition, and gait prediction show that our LaBraM outperforms all compared SOTA methods in their respective fields. Our code is available at https://github.com/935963004/LaBraM.


title: A combinatorial interpretation of the Bernstein degree of modules of covariants

abstract: We introduce sets $\mathcal{R}(\sigma)$ consisting of semistandard tableaux of shape $\sigma$, subject to a certain restriction on the initial column. These $\mathcal{R}(\sigma)$ are generalizations of the rational, symplectic, or orthogonal tableaux (which furnish a weight basis for the irreducible finite-dimensional representations $U_\sigma$ of the classical groups $H = \operatorname{GL}_k$, $\operatorname{Sp}_{2k}$, or $\operatorname{O}_k$, respectively). As our main result, we show that the cardinality of $\mathcal{R}(\sigma)$ gives the Bernstein degree (i.e., multiplicity) of the modules of covariants (of type $U_\sigma$) of each classical group $H$. Via Howe duality, these modules can also be viewed as $(\mathfrak{g},K)$-modules of unitary highest weight representations of a real reductive group $G_{\mathbb{R}}$. Notably, our result using $\mathcal{R}(\sigma)$ is valid regardless of the rank of $H$, whereas the previous result of Nishiyama-Ochiai-Taniguchi (expressing the Bernstein degree in terms of $\dim U_\sigma$) holds only when $k$ is at most the real rank of $G_{\mathbb{R}}$. In effect, as $k$ increases beyond this range, $|\mathcal{R}(\sigma)|$ interpolates between $\dim U_\sigma$ and the dimension of a certain "limiting" $K$-module.


title: Kinetic temperature of massive star-forming molecular clumps measured with formaldehyde V. The massive filament DR21

abstract: The kinetic temperature structure of the massive filament DR21 has been mapped using the IRAM 30 m telescope. This mapping employed the para-H$_2$CO triplet ($J_{\rm K_aK_c}$ = 3$_{03}$--2$_{02}$, 3$_{22}$--2$_{21}$, and 3$_{21}$--2$_{20}$) on a scale of $\sim$0.1 pc. By modeling the averaged line ratios of para-H$_{2}$CO with RADEX under non-LTE assumptions, the kinetic temperature of the dense gas was derived at a density of $n$(H$_{2}$) = 10$^{5}$ cm$^{-3}$. The para-H$_2$CO lines reveal significantly higher temperatures than NH$_3$ (1,1)/(2,2) and FIR wavelengths. The dense clumps appear to correlate with the notable kinetic temperature. Among the four dense cores (N44, N46, N48, and N54), temperature gradients are observed on a scale of $\sim$0.1-0.3 pc. This suggests that the warm dense gas is influenced by internal star formation activity. With the exception of N54, the temperature profiles of these cores were fitted with power-law indices ranging from $-$0.3 to $-$0.5. This indicates that the warm dense gas is heated by radiation emitted from internally embedded protostar(s) and/or clusters. While there is no direct evidence supporting the idea that the dense gas is heated by shocks resulting from a past explosive event in the DR21 region, our measurements toward the DR21W1 region provide compelling evidence that the dense gas is indeed heated by shocks originating from the western DR21 flow. Higher temperatures appear to be associated with turbulence. The physical parameters of the dense gas in the DR21 filament exhibit a remarkable similarity to the results obtained in OMC-1 and N113. This may imply that the physical mechanisms governing the dynamics and thermodynamics of dense gas traced by H$_{2}$CO in diverse star formation regions may be dominated by common underlying principles despite variations in specific environmental conditions. (abbreviated)


title: RNAFlow: RNA Structure & Sequence Design via Inverse Folding-Based Flow Matching

abstract: The growing significance of RNA engineering in diverse biological applications has spurred interest in developing AI methods for structure-based RNA design. While diffusion models have excelled in protein design, adapting them for RNA presents new challenges due to RNA's conformational flexibility and the computational cost of fine-tuning large structure prediction models. To this end, we propose RNAFlow, a flow matching model for protein-conditioned RNA sequence-structure design. Its denoising network integrates an RNA inverse folding model and a pre-trained RosettaFold2NA network for generation of RNA sequences and structures. The integration of inverse folding in the structure denoising process allows us to simplify training by fixing the structure prediction network. We further enhance the inverse folding model by conditioning it on inferred conformational ensembles to model dynamic RNA conformations. Evaluation on protein-conditioned RNA structure and sequence generation tasks demonstrates RNAFlow's advantage over existing RNA design methods.


title: OUS: Scene-Guided Dynamic Facial Expression Recognition

abstract: Dynamic Facial Expression Recognition (DFER) is crucial for affective computing but often overlooks the impact of scene context. We have identified a significant issue in current DFER tasks: human annotators typically integrate emotions from various angles, including environmental cues and body language, whereas existing DFER methods tend to consider the scene as noise that needs to be filtered out, focusing solely on facial information. We refer to this as the Rigid Cognitive Problem. The Rigid Cognitive Problem can lead to discrepancies between the cognition of annotators and models in some samples. To align more closely with the human cognitive paradigm of emotions, we propose an Overall Understanding of the Scene DFER method (OUS). OUS effectively integrates scene and facial features, combining scene-specific emotional knowledge for DFER. Extensive experiments on the two largest datasets in the DFER field, DFEW and FERV39k, demonstrate that OUS significantly outperforms existing methods. By analyzing the Rigid Cognitive Problem, OUS successfully understands the complex relationship between scene context and emotional expression, closely aligning with human emotional understanding in real-world scenarios.


title: Leveraging Many-To-Many Relationships for Defending Against Visual-Language Adversarial Attacks

abstract: Recent studies have revealed that vision-language (VL) models are vulnerable to adversarial attacks for image-text retrieval (ITR). However, existing defense strategies for VL models primarily focus on zero-shot image classification, which do not consider the simultaneous manipulation of image and text, as well as the inherent many-to-many (N:N) nature of ITR, where a single image can be described in numerous ways, and vice versa. To this end, this paper studies defense strategies against adversarial attacks on VL models for ITR for the first time. Particularly, we focus on how to leverage the N:N relationship in ITR to enhance adversarial robustness. We found that, although adversarial training easily overfits to specific one-to-one (1:1) image-text pairs in the train data, diverse augmentation techniques to create one-to-many (1:N) / many-to-one (N:1) image-text pairs can significantly improve adversarial robustness in VL models. Additionally, we show that the alignment of the augmented image-text pairs is crucial for the effectiveness of the defense strategy, and that inappropriate augmentations can even degrade the model's performance. Based on these findings, we propose a novel defense strategy that leverages the N:N relationship in ITR, which effectively generates diverse yet highly-aligned N:N pairs using basic augmentations and generative model-based augmentations. This work provides a novel perspective on defending against adversarial attacks in VL tasks and opens up new research directions for future work.


title: Benchmarking the Exponential Ansatz for the Holstein model

abstract: Polarons are quasiparticles formed as a result of lattice distortions induced by charge carriers. The single-electron Holstein model captures the fundamentals of single polaron physics. We examine the power of the exponential ansatz for the polaron ground-state wavefunction in its coupled cluster, canonical transformation, and (canonically transformed) perturbative variants across the parameter space of the Holstein model. Our benchmark serves to guide future developments of polaron wavefunctions beyond the single-electron Holstein model.


title: Evolving Reliable Differentiating Constraints for the Chance-constrained Maximum Coverage Problem

abstract: Chance-constrained problems involve stochastic components in the constraints which can be violated with a small probability. We investigate the impact of different types of chance constraints on the performance of iterative search algorithms and study the classical maximum coverage problem in graphs with chance constraints. Our goal is to evolve reliable chance constraint settings for a given graph where the performance of algorithms differs significantly not just in expectation but with high confidence. This allows to better learn and understand how different types of algorithms can deal with different types of constraint settings and supports automatic algorithm selection. We develop an evolutionary algorithm that provides sets of chance constraints that differentiate the performance of two stochastic search algorithms with high confidence. We initially use traditional approximation ratio as the fitness function of (1+1)~EA to evolve instances, which shows inadequacy to generate reliable instances. To address this issue, we introduce a new measure to calculate the performance difference for two algorithms, which considers variances of performance ratios. Our experiments show that our approach is highly successful in solving the instability issue of the performance ratios and leads to evolving reliable sets of chance constraints with significantly different performance for various types of algorithms.


title: On line upper ideal relation graphs of rings

abstract: The upper ideal relation graph $\Gamma_{U}(R)$ of a commutative ring $R$ with unity is a simple undirected graph with the set of all non-unit elements of $R$ as a vertex set and two vertices $x$, $y$ are adjacent if and only if the principal ideals $(x)$ and $(y)$ are contained in the principal ideal $(z)$ for some non-unit element $z\in R$. This manuscript characterizes all the Artinian rings $R$ such that the graph $\Gamma_{U}(R)$ is a line graph. Moreover, all the Artinian rings $R$ for which $\Gamma_{U}(R)$ is the complement of a line graph have been described.


title: LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical Image Registration

abstract: Medical image registration is an essential topic in medical image analysis. In this paper, we propose a method for medical image registration using a pretrained large language model. We find that using the pretrained large language model to encode deep features of the medical images in the registration model can effectively improve image registration accuracy, indicating the great potential of the large language model in medical image registration tasks. We use dual encoders to perform deep feature extraction on image pairs and then input the features into the pretrained large language model. To adapt the large language model to our registration task, the weights of the large language model are frozen in the registration model, and an adapter is utilized to fine-tune the large language model, which aims at (a) mapping the visual tokens to the language space before the large language model computing, (b) project the modeled language tokens output from the large language model to the visual space. Our method combines output features from the fine-tuned large language model with the features output from each encoder layer to gradually generate the deformation fields required for registration in the decoder. To demonstrate the effectiveness of the large prediction model in registration tasks, we conducted experiments on knee and brain MRI and achieved state-of-the-art results.


title: Synchronization Scheme based on Pilot Sharing in Cell-Free Massive MIMO Systems

abstract: This paper analyzes the impact of pilot-sharing scheme on synchronization performance in a scenario where several slave access points (APs) with uncertain carrier frequency offsets (CFOs) and timing offsets (TOs) share a common pilot sequence. First, the Cramer-Rao bound (CRB) with pilot contamination is derived for pilot-pairing estimation. Furthermore, a maximum likelihood algorithm is presented to estimate the CFO and TO among the pairing APs. Then, to minimize the sum of CRBs, we devise a synchronization strategy based on a pilot-sharing scheme by jointly optimizing the cluster classification, synchronization overhead, and pilot-sharing scheme, while simultaneously considering the overhead and each AP's synchronization requirements. To solve this NP-hard problem, we simplify it into two sub-problems, namely cluster classification problem and the pilot sharing problem. To strike a balance between synchronization performance and overhead, we first classify the clusters by using the K-means algorithm, and propose a criteria to find a good set of master APs. Then, the pilot-sharing scheme is obtained by using the swap-matching operations. Simulation results validate the accuracy of our derivations and demonstrate the effectiveness of the proposed scheme over the benchmark schemes.


title: LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Models

abstract: Differentially Private Stochastic Gradient Descent (DP-SGD) and its variants have been proposed to ensure rigorous privacy for fine-tuning large-scale pre-trained language models. However, they rely heavily on the Gaussian mechanism, which may overly perturb the gradients and degrade the accuracy, especially in stronger privacy regimes (e.g., the privacy budget $\epsilon < 3$). To address such limitations, we propose a novel Language Model-based Optimal Differential Privacy (LMO-DP) mechanism, which takes the first step to enable the tight composition of accurately fine-tuning (large) language models with a sub-optimal DP mechanism, even in strong privacy regimes (e.g., $0.1\leq \epsilon<3$). Furthermore, we propose a novel offline optimal noise search method to efficiently derive the sub-optimal DP that significantly reduces the noise magnitude. For instance, fine-tuning RoBERTa-large (with 300M parameters) on the SST-2 dataset can achieve an accuracy of 92.20% (given $\epsilon=0.3$, $\delta=10^{-10}$) by drastically outperforming the Gaussian mechanism (e.g., $\sim 50\%$ for small $\epsilon$ and $\delta$). We also draw similar findings on the text generation tasks on GPT-2. Finally, to our best knowledge, LMO-DP is also the first solution to accurately fine-tune Llama-2 with strong differential privacy guarantees. The code will be released soon and available upon request.


title: SPABA: A Single-Loop and Probabilistic Stochastic Bilevel Algorithm Achieving Optimal Sample Complexity

abstract: While stochastic bilevel optimization methods have been extensively studied for addressing large-scale nested optimization problems in machine learning, it remains an open question whether the optimal complexity bounds for solving bilevel optimization are the same as those in single-level optimization. Our main result resolves this question: SPABA, an adaptation of the PAGE method for nonconvex optimization in (Li et al., 2021) to the bilevel setting, can achieve optimal sample complexity in both the finite-sum and expectation settings. We show the optimality of SPABA by proving that there is no gap in complexity analysis between stochastic bilevel and single-level optimization when implementing PAGE. Notably, as indicated by the results of (Dagr\'eou et al., 2022), there might exist a gap in complexity analysis when implementing other stochastic gradient estimators, like SGD and SAGA. In addition to SPABA, we propose several other single-loop stochastic bilevel algorithms, that either match or improve the state-of-the-art sample complexity results, leveraging our convergence rate and complexity analysis. Numerical experiments demonstrate the superior practical performance of the proposed methods.


title: On the moments of averages of quadratic twists of the M\"obius function

abstract: We consider the moment of quadratic twists of the M\"obius function of the form \[ S_k(X,Y) = \sum_{d\leq X} \left( \sum_{n\leq Y} \left(\frac{8d}{n}\right) \mu(n)\right)^k, \] where $\left(\frac{8d}{\cdot}\right)$ is the Kronecker symbol and $d$ runs over positive, odd and square-free integers. We give unconditional results for their asymptotic behaviors.


title: Categorization of 31 computational methods to detect spatially variable genes from spatially resolved transcriptomics data

abstract: In the analysis of spatially resolved transcriptomics data, detecting spatially variable genes (SVGs) is crucial. Numerous computational methods exist, but varying SVG definitions and methodologies lead to incomparable results. We review 31 state-of-the-art methods, categorizing SVGs into three types: overall, cell-type-specific, and spatial-domain-marker SVGs. Our review explains the intuitions underlying these methods, summarizes their applications, and categorizes the hypothesis tests they use in the trade-off between generality and specificity for SVG detection. We discuss challenges in SVG detection and propose future directions for improvement. Our review offers insights for method developers and users, advocating for category-specific benchmarking.


title: Quantitative Certification of Bias in Large Language Models

abstract: Large Language Models (LLMs) can produce responses that exhibit social biases and support stereotypes. However, conventional benchmarking is insufficient to thoroughly evaluate LLM bias, as it can not scale to large sets of prompts and provides no guarantees. Therefore, we propose a novel certification framework QuaCer-B (Quantitative Certification of Bias) that provides formal guarantees on obtaining unbiased responses from target LLMs under large sets of prompts. A certificate consists of high-confidence bounds on the probability of obtaining biased responses from the LLM for any set of prompts containing sensitive attributes, sampled from a distribution. We illustrate the bias certification in LLMs for prompts with various prefixes drawn from given distributions. We consider distributions of random token sequences, mixtures of manual jailbreaks, and jailbreaks in the LLM's embedding space to certify its bias. We certify popular LLMs with QuaCer-B and present novel insights into their biases.


title: On the Role of Attention Masks and LayerNorm in Transformers

abstract: Self-attention is the key mechanism of transformers, which are the essential building blocks of modern foundation models. Recent studies have shown that pure self-attention suffers from an increasing degree of rank collapse as depth increases, limiting model expressivity and further utilization of model depth. The existing literature on rank collapse, however, has mostly overlooked other critical components in transformers that may alleviate the rank collapse issue. In this paper, we provide a general analysis of rank collapse under self-attention, taking into account the effects of attention masks and layer normalization (LayerNorm). In particular, we find that although pure masked attention still suffers from exponential collapse to a rank one subspace, local masked attention can provably slow down the collapse rate. In the case of self-attention with LayerNorm, we first show that for certain classes of value matrices, collapse to a rank one subspace still happens exponentially. However, through construction of nontrivial counterexamples, we then establish that with proper choice of value matrices, a general class of sequences may not converge to a rank one subspace, and the self-attention dynamics with LayerNorm can simultaneously possess a rich set of equilibria with any possible rank between one and full. Our result refutes the previous hypothesis that LayerNorm plays no role in the rank collapse of self-attention and suggests that self-attention with LayerNorm constitutes a much more expressive, versatile nonlinear dynamical system than what was originally thought.


title: Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors

abstract: Diffusion models (DMs) have recently shown outstanding capability in modeling complex image distributions, making them expressive image priors for solving Bayesian inverse problems. However, most existing DM-based methods rely on approximations in the generative process to be generic to different inverse problems, leading to inaccurate sample distributions that deviate from the target posterior defined within the Bayesian framework. To harness the generative power of DMs while avoiding such approximations, we propose a Markov chain Monte Carlo algorithm that performs posterior sampling for general inverse problems by reducing it to sampling the posterior of a Gaussian denoising problem. Crucially, we leverage a general DM formulation as a unified interface that allows for rigorously solving the denoising problem with a range of state-of-the-art DMs. We demonstrate the effectiveness of the proposed method on six inverse problems (three linear and three nonlinear), including a real-world black hole imaging problem. Experimental results indicate that our proposed method offers more accurate reconstructions and posterior estimation compared to existing DM-based imaging inverse methods.


title: Global optimization in variational quantum algorithms via dynamic tunneling method

abstract: We present a global optimization routine for the variational quantum algorithms, which utilizes the dynamic tunneling flow. Originally designed to leverage information gathered by a gradient-based optimizer around local minima, we adapt the conventional dynamic tunneling flow to exploit the distance measure of quantum states, resolving issues of extrinsic degeneracy arising from the parametrization of quantum states. Our global optimization algorithm is applied to the variational quantum eigensolver for the transverse-field Ising model to demonstrate the performance of our routine while comparing it with the conventional dynamic tunneling method, which is based on the Euclidean distance measure on the parameter space.


title: LP-3DGS: Learning to Prune 3D Gaussian Splatting

abstract: Recently, 3D Gaussian Splatting (3DGS) has become one of the mainstream methodologies for novel view synthesis (NVS) due to its high quality and fast rendering speed. However, as a point-based scene representation, 3DGS potentially generates a large number of Gaussians to fit the scene, leading to high memory usage. Improvements that have been proposed require either an empirical and preset pruning ratio or importance score threshold to prune the point cloud. Such hyperparamter requires multiple rounds of training to optimize and achieve the maximum pruning ratio, while maintaining the rendering quality for each scene. In this work, we propose learning-to-prune 3DGS (LP-3DGS), where a trainable binary mask is applied to the importance score that can find optimal pruning ratio automatically. Instead of using the traditional straight-through estimator (STE) method to approximate the binary mask gradient, we redesign the masking function to leverage the Gumbel-Sigmoid method, making it differentiable and compatible with the existing training process of 3DGS. Extensive experiments have shown that LP-3DGS consistently produces a good balance that is both efficient and high quality.


title: A Fast and Adaptable Algorithm for Optimal Multi-Qubit Pathfinding in Quantum Circuit Compilation

abstract: Quantum computing has the potential to significantly enhance our ability to simulate and solve complex, classically intractable problems across various fields of research and industry. However, we are currently in the noisy intermediate-scale quantum (NISQ) era, where devices are relatively small and suffer from substantial noise levels, prohibiting large-scale computations. To achieve any quantum advantage in this regime and beyond, it is crucial to minimise the impact of noise from qubit decoherence and two-qubit gates. A direct approach is to improve the optimisation of quantum circuit compilation processes that map circuits onto physical devices, thereby reducing noisy gates and circuit execution times. This work focuses on multi-qubit pathfinding as a critical subroutine within the quantum circuit compilation mapping problem. We introduce an algorithm, modelled using binary integer linear programming, that navigates qubits on quantum hardware optimally with respect to circuit SWAP-gate depth, while also optimising for accumulated gate errors and can be flexibly adapted to various problem modifications. This multi-qubit pathfinding algorithm incorporates considerations for gate-error penalties, SWAP movement constraints, and configurable arrangements of source and target qubit locations and qubit teams. We have benchmarked the algorithm across a variety of quantum hardware layouts, assessing properties such as computational runtimes, solution SWAP depths, and accumulated SWAP-gate error rates. The results demonstrate the algorithm's practical runtimes on current quantum devices and compare its effectiveness across different hardware configurations, providing insights for future quantum hardware design.


title: MOKD: Cross-domain Finetuning for Few-shot Classification via Maximizing Optimized Kernel Dependence

abstract: In cross-domain few-shot classification, \emph{nearest centroid classifier} (NCC) aims to learn representations to construct a metric space where few-shot classification can be performed by measuring the similarities between samples and the prototype of each class. An intuition behind NCC is that each sample is pulled closer to the class centroid it belongs to while pushed away from those of other classes. However, in this paper, we find that there exist high similarities between NCC-learned representations of two samples from different classes. In order to address this problem, we propose a bi-level optimization framework, \emph{maximizing optimized kernel dependence} (MOKD) to learn a set of class-specific representations that match the cluster structures indicated by labeled data of the given task. Specifically, MOKD first optimizes the kernel adopted in \emph{Hilbert-Schmidt independence criterion} (HSIC) to obtain the optimized kernel HSIC (opt-HSIC) that can capture the dependence more precisely. Then, an optimization problem regarding the opt-HSIC is addressed to simultaneously maximize the dependence between representations and labels and minimize the dependence among all samples. Extensive experiments on Meta-Dataset demonstrate that MOKD can not only achieve better generalization performance on unseen domains in most cases but also learn better data representation clusters. The project repository of MOKD is available at: \href{https://github.com/tmlr-group/MOKD}{https://github.com/tmlr-group/MOKD}.


title: Modeling and Control of a Novel Bi-Quadcopter with Auxiliary Thruster Mechanism

abstract: In this paper, a new under-actuated Bi-Quadcopter Unmanned Aerial Vehicle is introduced. The proposed drone configuration can be controlled similar to a Bicopter. The dynamics of the proposed Bi-Quadcopter is developed using the Newton-Euler approach. Using the force decomposition technique, a mapping between the control wrench and actuator inputs is developed. A nonlinear position control is applied for the Bi-Quadcopter using the quaternion-based cascaded attitude controller. The performance of the proposed UAV with the control algorithm is verified through simulations. Finally, the actuator failure scenarios were analyzed.


title: TVB C++: A Fast and Flexible Back-End for The Virtual Brain

abstract: This paper introduces TVB C++, a streamlined and fast C++ Back-End for The Virtual Brain (TVB), a renowned platform and a benchmark tool for full-brain simulation. TVB C++ is engineered with speed as a primary focus while retaining the flexibility and ease of use characteristic of the original TVB platform. Positioned as a complementary tool, TVB serves as a prototyping platform, whereas TVB C++ becomes indispensable when performance is paramount, particularly for large-scale simulations and leveraging advanced computation facilities like supercomputers. Developed as a TVB-compatible Back-End, TVB C++ seamlessly integrates with the original TVB implementation, facilitating effortless usage. Users can easily configure TVB C++ to execute the same code as in TVB but with enhanced performance and parallelism capabilities.


title: An overview of some single machine scheduling problems: polynomial algorithms, complexity and approximability

abstract: Since the publication of the first scheduling paper in 1954, a huge number of works dealing with different types of single machine problems appeared. They addressed many heuristics and enumerative procedures, complexity results or structural properties of certain problems. Regarding surveys, often particular subjects like special objective functions are discussed, or more general scheduling problems were surveyed, where a substantial part is devoted to single machine problems. In this paper we present some results on polynomial algorithms, complexity and approximation issues, where the main focus is on results, which have been published during the last decades in papers, where at least one of the first two authors of this paper was involved. We hope that the reviewed results will stimulate further investigation in related research fields.


title: Opinion-Unaware Blind Image Quality Assessment using Multi-Scale Deep Feature Statistics

abstract: Deep learning-based methods have significantly influenced the blind image quality assessment (BIQA) field, however, these methods often require training using large amounts of human rating data. In contrast, traditional knowledge-based methods are cost-effective for training but face challenges in effectively extracting features aligned with human visual perception. To bridge these gaps, we propose integrating deep features from pre-trained visual models with a statistical analysis model into a Multi-scale Deep Feature Statistics (MDFS) model for achieving opinion-unaware BIQA (OU-BIQA), thereby eliminating the reliance on human rating data and significantly improving training efficiency. Specifically, we extract patch-wise multi-scale features from pre-trained vision models, which are subsequently fitted into a multivariate Gaussian (MVG) model. The final quality score is determined by quantifying the distance between the MVG model derived from the test image and the benchmark MVG model derived from the high-quality image set. A comprehensive series of experiments conducted on various datasets show that our proposed model exhibits superior consistency with human visual perception compared to state-of-the-art BIQA models. Furthermore, it shows improved generalizability across diverse target-specific BIQA tasks. Our code is available at: https://github.com/eezkni/MDFS


title: A new platooning model for connected and autonomous vehicles to improve string stability

abstract: This paper introduces a novel idea of coordinated vehicle platooning such that platoon followers inside the platoon communicates only to the platoon leader. A novel dynamic model is proposed to take driving safety into account when there is communication delay. Some general results of linear stability are proved mathematically, and numerical simulations are conducted to show the effect of model parameters for both ring road with an initial disturbance and infinite road with a periodic disturbance. The simulation results are consistent with theoretical analysis, and demonstrate that the proposed look-to-the-leader platooning strategy is far superior than the follow-one-vehicle-ahead or follow-two-vehicle-ahead conventional car-following (CF) strategies in stabilizing traffic flow. This paper provides a new perspective for the organization of platoons of autonomous vehicles.


title: Kernel Metric Learning for In-Sample Off-Policy Evaluation of Deterministic RL Policies

abstract: We consider off-policy evaluation (OPE) of deterministic target policies for reinforcement learning (RL) in environments with continuous action spaces. While it is common to use importance sampling for OPE, it suffers from high variance when the behavior policy deviates significantly from the target policy. In order to address this issue, some recent works on OPE proposed in-sample learning with importance resampling. Yet, these approaches are not applicable to deterministic target policies for continuous action spaces. To address this limitation, we propose to relax the deterministic target policy using a kernel and learn the kernel metrics that minimize the overall mean squared error of the estimated temporal difference update vector of an action value function, where the action value function is used for policy evaluation. We derive the bias and variance of the estimation error due to this relaxation and provide analytic solutions for the optimal kernel metric. In empirical studies using various test domains, we show that the OPE with in-sample learning using the kernel with optimized metric achieves significantly improved accuracy than other baselines.


title: Adaptive Discretization-based Non-Episodic Reinforcement Learning in Metric Spaces

abstract: We study non-episodic Reinforcement Learning for Lipschitz MDPs in which state-action space is a metric space, and the transition kernel and rewards are Lipschitz functions. We develop computationally efficient UCB-based algorithm, $\textit{ZoRL-}\epsilon$ that adaptively discretizes the state-action space and show that their regret as compared with $\epsilon$-optimal policy is bounded as $\mathcal{O}(\epsilon^{-(2 d_\mathcal{S} + d^\epsilon_z + 1)}\log{(T)})$, where $d^\epsilon_z$ is the $\epsilon$-zooming dimension. In contrast, if one uses the vanilla $\textit{UCRL-}2$ on a fixed discretization of the MDP, the regret w.r.t. a $\epsilon$-optimal policy scales as $\mathcal{O}(\epsilon^{-(2 d_\mathcal{S} + d + 1)}\log{(T)})$ so that the adaptivity gains are huge when $d^\epsilon_z \ll d$. Note that the absolute regret of any 'uniformly good' algorithm for a large family of continuous MDPs asymptotically scales as at least $\Omega(\log{(T)})$. Though adaptive discretization has been shown to yield $\mathcal{\tilde{O}}(H^{2.5}K^\frac{d_z + 1}{d_z + 2})$ regret in episodic RL, an attempt to extend this to the non-episodic case by employing constant duration episodes whose duration increases with $T$, is futile since $d_z \to d$ as $T \to \infty$. The current work shows how to obtain adaptivity gains for non-episodic RL. The theoretical results are supported by simulations on two systems where the performance of $\textit{ZoRL-}\epsilon$ is compared with that of '$\textit{UCRL-C}$,' the fixed discretization-based extension of $\textit{UCRL-}2$ for systems with continuous state-action spaces.


title: Characterizing Novel Indium Phosphide Pad Detectors with Focused X-ray Beams and Laboratory Tests

abstract: Future tracking systems in High Energy Physics experiments will require large instrumented areas with low radiation length. Crystalline silicon sensors have been used in tracking systems for decades, but are difficult to manufacture and costly to produce for large areas. We are exploring alternative sensor materials that are amenable to fast fabrication techniques used for thin film devices. Indium Phosphide pad sensors were fabricated at Argonne National Lab using commercially available InP:Fe 2-inch mono-crystal substrates. Current-voltage and capacitance-voltage characterizations were performed to study the basic operating characteristics of a group of sensors. Micro-focused X-ray beams at Canadian Light Source and Diamond Light Source were used to study the response to ionizing radiation, and characterize the uniformity of the response for several devices. The results show a high degree of performance uniformity in our evaluations, both within a device and between the 48 tested devices. This motivates further studies into thin film devices for future tracking detectors.


title: Federated Q-Learning with Reference-Advantage Decomposition: Almost Optimal Regret and Logarithmic Communication Cost

abstract: In this paper, we consider model-free federated reinforcement learning for tabular episodic Markov decision processes. Under the coordination of a central server, multiple agents collaboratively explore the environment and learn an optimal policy without sharing their raw data. Despite recent advances in federated Q-learning algorithms achieving near-linear regret speedup with low communication cost, existing algorithms only attain suboptimal regrets compared to the information bound. We propose a novel model-free federated Q-learning algorithm, termed FedQ-Advantage. Our algorithm leverages reference-advantage decomposition for variance reduction and operates under two distinct mechanisms: synchronization between the agents and the server, and policy update, both triggered by events. We prove that our algorithm not only requires a lower logarithmic communication cost but also achieves an almost optimal regret, reaching the information bound up to a logarithmic factor and near-linear regret speedup compared to its single-agent counterpart when the time horizon is sufficiently large.


title: Spectral measure of large random Helson matrices

abstract: We study the limiting spectral measure of large random Helson matrices and large random matrices of certain patterned structures. Given a real random variable $X \in L^{2+ \varepsilon}(\mathbb{P}) $ for some $\varepsilon > 0$ and $\mathrm{Var}(X) = 1$. For the random $n \times n$ Helson matrices generated by the independent copies of $X$, scaling the eigenvalues by $\sqrt{n}$, we prove the almost sure weak convergence of the spectral measure to the standard Wigner semi-circular law. Similar results are established for large random matrices with certain general patterned structures.


title: User Association and Channel Allocation in 5G Mobile Asymmetric Multi-band Heterogeneous Networks

abstract: With the proliferation of mobile terminals and the continuous upgrading of services, 4G LTE networks are showing signs of weakness. To enhance the capacity of wireless networks, millimeter waves are introduced to drive the evolution of networks towards multi-band 5G heterogeneous networks. The distinct propagation characteristics of mmWaves and microwaves, as well as the vastly different hardware configurations of heterogeneous base stations, make traditional access strategies no longer effective. Therefore, to narrowing the gap between theory and practice, we investigate the access strategy in multi-band 5G heterogeneous networks, taking into account the characteristics of mobile users, asynchronous switching between uplink and downlink of pico base stations, asymmetric service requirements, and user communication continuity. We formulate the problem as integer nonlinear programming and prove its intractability. Thereby, we decouple it into three subproblems: user association, switch point selection, and subchannel allocation, and design an algorithm based on optimal matching and spectral clustering to solve it efficiently. The simulation results show that the proposed algorithm outperforms the comparison methods in terms of overall data rate, effective data rate, and number of satisfied users.


title: Effective Potential and Topological Photon Spheres: A Novel Approach to Black Hole Parameter Classification

abstract: In this article, we anchor our analysis on the premise that the presence of a photon sphere is an intrinsic characteristic of any ultra-compact gravitational structure with spherical symmetry. Utilizing the concept of a topological photon sphere, we categorize the behaviors of diverse gravitational models based on the structure of their photon spheres. This innovative approach enables us to define boundaries for black hole parameters, which subsequently allows us to classify the model as either a black hole or a naked singularity. Indeed, we will demonstrate that the existence of this reciprocal relationship between the gravitational structure and the presence of a photon sphere offers a unique advantage that can be directly and inversely harnessed. Furthermore, we present a precise correlation between the behavior of the defined effective potential and the total topological charge for each model. Through an independent examination of the effective potential, we show that a gravitational model typically exhibits naked singularity behavior when at least one effective potential minimum (a stable photon sphere) protrudes beyond the event horizon. Finally, we will compare the effect of adding perfect fluid dark matter to the models under study and observe the impact of this quantity on the behavior of the photon sphere and the extent of their dominance.


title: Layered Chirp Spread Spectrum Modulations for LPWANs

abstract: This article examines two chirp spread spectrum techniques specifically devised for low-power wide-area networks (LPWANs) to optimize energy and spectral efficiency (SE). These methods referred to as layered CSS (LCSS) and layered dual-mode CSS (LDMCSS), involves utilizing multiple layers for multiplexing symbols with varying chirp rates. These waveform designs exemplify a high degree of SE compared to existing schemes. Additionally, LDMCSS necessitates a lesser number of layers than LCSS to attain comparable SE, thereby reducing computational complexity. These proposed techniques can employ coherent and non-coherent detection and can be adjusted to achieve various spectral efficiencies by altering the number of multiplexed layers. Unlike our proposed LCSS and LDMCSS, other CSS alternatives for LPWANs cannot provide the same level of flexibility and SE. The performance of these techniques is evaluated in terms of bit error rate under different channel conditions, as well as with phase and frequency offsets.


title: Face processing emerges from object-trained convolutional neural networks

abstract: Whether face processing depends on unique, domain-specific neurocognitive mechanisms or domain-general object recognition mechanisms has long been debated. Directly testing these competing hypotheses in humans has proven challenging due to extensive exposure to both faces and objects. Here, we systematically test these hypotheses by capitalizing on recent progress in convolutional neural networks (CNNs) that can be trained without face exposure (i.e., pre-trained weights). Domain-general mechanism accounts posit that face processing can emerge from a neural network without specialized pre-training on faces. Consequently, we trained CNNs solely on objects and tested their ability to recognize and represent faces as well as objects that look like faces (face pareidolia stimuli).... Due to the character limits, for more details see in attached pdf


title: SketchTriplet: Self-Supervised Scenarized Sketch-Text-Image Triplet Generation

abstract: The scarcity of free-hand sketch presents a challenging problem. Despite the emergence of some large-scale sketch datasets, these datasets primarily consist of sketches at the single-object level. There continues to be a lack of large-scale paired datasets for scene sketches. In this paper, we propose a self-supervised method for scene sketch generation that does not rely on any existing scene sketch, enabling the transformation of single-object sketches into scene sketches. To accomplish this, we introduce a method for vector sketch captioning and sketch semantic expansion. Additionally, we design a sketch generation network that incorporates a fusion of multi-modal perceptual constraints, suitable for application in zero-shot image-to-sketch downstream task, demonstrating state-of-the-art performance through experimental validation. Finally, leveraging our proposed sketch-to-sketch generation method, we contribute a large-scale dataset centered around scene sketches, comprising highly semantically consistent "text-sketch-image" triplets. Our research confirms that this dataset can significantly enhance the capabilities of existing models in sketch-based image retrieval and sketch-controlled image synthesis tasks. We will make our dataset and code publicly available.


title: Enhancing Security and Privacy in Federated Learning using Update Digests and Voting-Based Defense

abstract: Federated Learning (FL) is a promising privacy-preserving machine learning paradigm that allows data owners to collaboratively train models while keeping their data localized. Despite its potential, FL faces challenges related to the trustworthiness of both clients and servers, especially in the presence of curious or malicious adversaries. In this paper, we introduce a novel framework named \underline{\textbf{F}}ederated \underline{\textbf{L}}earning with \underline{\textbf{U}}pdate \underline{\textbf{D}}igest (FLUD), which addresses the critical issues of privacy preservation and resistance to Byzantine attacks within distributed learning environments. FLUD utilizes an innovative approach, the $\mathsf{LinfSample}$ method, allowing clients to compute the $l_{\infty}$ norm across sliding windows of updates as an update digest. This digest enables the server to calculate a shared distance matrix, significantly reducing the overhead associated with Secure Multi-Party Computation (SMPC) by three orders of magnitude while effectively distinguishing between benign and malicious updates. Additionally, FLUD integrates a privacy-preserving, voting-based defense mechanism that employs optimized SMPC protocols to minimize communication rounds. Our comprehensive experiments demonstrate FLUD's effectiveness in countering Byzantine adversaries while incurring low communication and runtime overhead. FLUD offers a scalable framework for secure and reliable FL in distributed environments, facilitating its application in scenarios requiring robust data management and security.


title: Information Dynamics in Evolving Networks Based on the Birth-Death Process: Random Drift and Natural Selection Perspective

abstract: Dynamic processes in complex networks are crucial for better understanding collective behavior in human societies, biological systems, and the internet. In this paper, we first focus on the continuous Markov-based modeling of evolving networks with the birth-death of individuals. A new individual arrives at the group by the Poisson process, while new links are established in the network through either uniform connection or preferential attachment. Moreover, an existing individual has a limited lifespan before leaving the network. We determine stationary topological properties of these networks, including their size and mean degree. To address the effect of the birth-death evolution, we further study the information dynamics in the proposed network model from the random drift and natural selection perspective, based on assumptions of total-stochastic and fitness-driven evolution, respectively. In simulations, we analyze the fixation probability of individual information and find that means of new connections affect the random drift process but do not affect the natural selection process.


title: Tilde: Teleoperation for Dexterous In-Hand Manipulation Learning with a DeltaHand

abstract: Dexterous robotic manipulation remains a challenging domain due to its strict demands for precision and robustness on both hardware and software. While dexterous robotic hands have demonstrated remarkable capabilities in complex tasks, efficiently learning adaptive control policies for hands still presents a significant hurdle given the high dimensionalities of hands and tasks. To bridge this gap, we propose Tilde, an imitation learning-based in-hand manipulation system on a dexterous DeltaHand. It leverages 1) a low-cost, configurable, simple-to-control, soft dexterous robotic hand, DeltaHand, 2) a user-friendly, precise, real-time teleoperation interface, TeleHand, and 3) an efficient and generalizable imitation learning approach with diffusion policies. Our proposed TeleHand has a kinematic twin design to the DeltaHand that enables precise one-to-one joint control of the DeltaHand during teleoperation. This facilitates efficient high-quality data collection of human demonstrations in the real world. To evaluate the effectiveness of our system, we demonstrate the fully autonomous closed-loop deployment of diffusion policies learned from demonstrations across seven dexterous manipulation tasks with an average 90% success rate.


title: Semiring Activation in Neural Networks

abstract: We introduce a class of trainable nonlinear operators based on semirings that are suitable for use in neural networks. These operators generalize the traditional alternation of linear operators with activation functions in neural networks. Semirings are algebraic structures that describe a generalised notation of linearity, greatly expanding the range of trainable operators that can be included in neural networks. In fact, max- or min-pooling operations are convolutions in the tropical semiring with a fixed kernel. We perform experiments where we replace the activation functions for trainable semiring-based operators to show that these are viable operations to include in fully connected as well as convolutional neural networks (ConvNeXt). We discuss some of the challenges of replacing traditional activation functions with trainable semiring activations and the trade-offs of doing so.


title: Propagation of Waves from Finite Sources Arranged in Line Segments within an Infinite Triangular Lattice

abstract: This paper examines the propagation of time harmonic waves through a two-dimensional triangular lattice with sources located on line segments. Specifically, we investigate the discrete Helmholtz equation with a wavenumber $k \in \left( 0,2\sqrt{2} \right)$, where input data is prescribed on finite rows or columns of lattice sites. We focus on two main questions: the efficacy of the numerical methods employed in evaluating the Green's function, and the necessity of the cone condition. Consistent with a continuum theory, we employ the notion of radiating solution and establish a unique solvability result and Green's representation formula using difference potentials. Finally, we propose a numerical computation method and demonstrate its efficiency through examples related to the propagation problems in the left-handed 2D inductor-capacitor metamaterial.


title: Emergence of bidirectional cell laning from collective contact guidance

abstract: Directed collective cell migration is central in morphogenesis, wound healing and cancer progression1,2. Although it is well-accepted that the molecular anisotropy of the micro-environment guides this migration3,4, its impact on the pattern of the cell flows remains largely unexplored. Studying confluent human bronchial epithelial cells (HBECs) in vitro, we show that subcellular microgrooves elicit a polar mode of collective migration in millimeter-long bidirectional lanes that are much wider than a cell size, even though cell flows are highly disordered on featureless surfaces 5. This directed flocking-like transition6,7 can be accounted for by a hydrodynamic theory of active polar fluids and corresponding numerical simulations. This model further predicts that anisotropic friction resulting from the grooves lowers the threshold of the transition, which we confirm experimentally. Therefore, microscopic anisotropy of the environment not only directs the collective motion of the cells in the easy direction, but also shapes the cell migration pattern. Flow patterns induced by collective contact guidance are thus markedly different from those induced by supracellular confinement8, demonstrating that all length-scales of the micro-environment must be considered in a comprehensive description of collective migration. Furthermore, artificial microtopographies designed from theoretical considerations can provide a rational strategy to direct cells to specific geometries and functions, which has broad implications, for instance, for tissue engineering strategies in organoid morphogenesis.


title: BRACTIVE: A Brain Activation Approach to Human Visual Brain Learning

abstract: The human brain is a highly efficient processing unit, and understanding how it works can inspire new algorithms and architectures in machine learning. In this work, we introduce a novel framework named Brain Activation Network (BRACTIVE), a transformer-based approach to studying the human visual brain. The main objective of BRACTIVE is to align the visual features of subjects with corresponding brain representations via fMRI signals. It allows us to identify the brain's Regions of Interest (ROI) of the subjects. Unlike previous brain research methods, which can only identify ROIs for one subject at a time and are limited by the number of subjects, BRACTIVE automatically extends this identification to multiple subjects and ROIs. Our experiments demonstrate that BRACTIVE effectively identifies person-specific regions of interest, such as face and body-selective areas, aligning with neuroscience findings and indicating potential applicability to various object categories. More importantly, we found that leveraging human visual brain activity to guide deep neural networks enhances performance across various benchmarks. It encourages the potential of BRACTIVE in both neuroscience and machine intelligence studies.


title: Multiplicative Weights Update, Area Convexity and Random Coordinate Descent for Densest Subgraph Problems

abstract: We study the densest subgraph problem and give algorithms via multiplicative weights update and area convexity that converge in $O\left(\frac{\log m}{\epsilon^{2}}\right)$ and $O\left(\frac{\log m}{\epsilon}\right)$ iterations, respectively, both with nearly-linear time per iteration. Compared with the work by Bahmani et al. (2014), our MWU algorithm uses a very different and much simpler procedure for recovering the dense subgraph from the fractional solution and does not employ a binary search. Compared with the work by Boob et al. (2019), our algorithm via area convexity improves the iteration complexity by a factor $\Delta$ -- the maximum degree in the graph, and matches the fastest theoretical runtime currently known via flows (Chekuri et al., 2022) in total time. Next, we study the dense subgraph decomposition problem and give the first practical iterative algorithm with linear convergence rate $O\left(mn\log\frac{1}{\epsilon}\right)$ via accelerated random coordinate descent. This significantly improves over $O\left(\frac{m\sqrt{mn\Delta}}{\epsilon}\right)$ time of the FISTA-based algorithm by Harb et al. (2022). In the high precision regime $\epsilon\ll\frac{1}{n}$ where we can even recover the exact solution, our algorithm has a total runtime of $O\left(mn\log n\right)$, matching the exact algorithm via parametric flows (Gallo et al., 1989). Empirically, we show that this algorithm is very practical and scales to very large graphs, and its performance is competitive with widely used methods that have significantly weaker theoretical guarantees.


title: UniPTS: A Unified Framework for Proficient Post-Training Sparsity

abstract: Post-training Sparsity (PTS) is a recently emerged avenue that chases efficient network sparsity with limited data in need. Existing PTS methods, however, undergo significant performance degradation compared with traditional methods that retrain the sparse networks via the whole dataset, especially at high sparsity ratios. In this paper, we attempt to reconcile this disparity by transposing three cardinal factors that profoundly alter the performance of conventional sparsity into the context of PTS. Our endeavors particularly comprise (1) A base-decayed sparsity objective that promotes efficient knowledge transferring from dense network to the sparse counterpart. (2) A reducing-regrowing search algorithm designed to ascertain the optimal sparsity distribution while circumventing overfitting to the small calibration set in PTS. (3) The employment of dynamic sparse training predicated on the preceding aspects, aimed at comprehensively optimizing the sparsity structure while ensuring training stability. Our proposed framework, termed UniPTS, is validated to be much superior to existing PTS methods across extensive benchmarks. As an illustration, it amplifies the performance of POT, a recently proposed recipe, from 3.9% to 68.6% when pruning ResNet-50 at 90% sparsity ratio on ImageNet. We release the code of our paper at https://github.com/xjjxmu/UniPTS.


title: Computing the thermal transport coefficient of neutral amorphous polymers using exact vibrational density of states: Comparison with experiments

abstract: Thermal transport coefficient $\kappa$ is an important property that often dictates broad applications of a polymeric material, while at the same time its computation remains challenging. In particular, classical simulations overestimate $\kappa$ than the experimentally measured $\kappa^{\rm exp}$ and thus hinder their meaningful comparison. This is even when very careful simulations are performed using the most accurate empirical potentials. A key reason for such a discrepancy is because polymers have quantum--mechanical, nuclear degrees--of--freedom whose contribution to the heat balance is non--trivial. In this work, two semi--analytical approaches are considered to accurately compute $\kappa$ by using the exact vibrational density of states $g(\nu)$. The first approach is based within the framework of the minimum thermal conductivity model, while the second uses computed quantum heat capacity to scale $\kappa$. Computed $\kappa$ of a set of commodity polymers compares quantitatively with $\kappa^{\rm exp}$.


title: MindSemantix: Deciphering Brain Visual Experiences with a Brain-Language Model

abstract: Deciphering the human visual experience through brain activities captured by fMRI represents a compelling and cutting-edge challenge in the field of neuroscience research. Compared to merely predicting the viewed image itself, decoding brain activity into meaningful captions provides a higher-level interpretation and summarization of visual information, which naturally enhances the application flexibility in real-world situations. In this work, we introduce MindSemantix, a novel multi-modal framework that enables LLMs to comprehend visually-evoked semantic content in brain activity. Our MindSemantix explores a more ideal brain captioning paradigm by weaving LLMs into brain activity analysis, crafting a seamless, end-to-end Brain-Language Model. To effectively capture semantic information from brain responses, we propose Brain-Text Transformer, utilizing a Brain Q-Former as its core architecture. It integrates a pre-trained brain encoder with a frozen LLM to achieve multi-modal alignment of brain-vision-language and establish a robust brain-language correspondence. To enhance the generalizability of neural representations, we pre-train our brain encoder on a large-scale, cross-subject fMRI dataset using self-supervised learning techniques. MindSemantix provides more feasibility to downstream brain decoding tasks such as stimulus reconstruction. Conditioned by MindSemantix captioning, our framework facilitates this process by integrating with advanced generative models like Stable Diffusion and excels in understanding brain visual perception. MindSemantix generates high-quality captions that are deeply rooted in the visual and semantic information derived from brain activity. This approach has demonstrated substantial quantitative improvements over prior art. Our code will be released.


title: Spontaneous CP violation and partially broken modular flavor symmetries

abstract: We study the realization of spontaneous CP violation through moduli stabilization. In modular flavor models, the source of CP violation is the vacuum expectation values of the complex structure moduli of toroidal compact space. We demonstrate that the combined effects of Type IIB flux compactifications with modular invariant couplings between the moduli and matter fields can induce spontaneous CP violation without or with supersymmetry breaking. Furthermore, some general properties of CP and modular invariant scalar potentials are presented. It is found that certain modifications or partial breakings of modular symmetry are useful in generating spontaneous CP violation.


title: Design and Implementation of a New Apparatus for Astrochemistry: Kinetic Measurements of the CH + OCS Reaction and Frequency Comb Spectroscopy in a Cold Uniform Supersonic Flow

abstract: We present the development of a new astrochemical research tool HILTRAC, the Highly Instrumented Low Temperature ReAction Chamber. The instrument is based on a pulsed form of the CRESU (Cin\'etique de R\'eaction en \'Ecoulement Supersonique Uniforme, meaning reaction kinetics in a uniform supersonic flow) apparatus, with the aim of collecting kinetics and spectroscopic information on gas phase chemical reactions important in interstellar space or planetary atmospheres. We discuss the apparatus design and its flexibility, the implementation of pulsed laser photolysis followed by laser induced fluorescence (PLP-LIF), and the first implementation of direct infrared frequency comb spectroscopy (DFCS) coupled to the uniform supersonic flow. Achievable flow temperatures range from 32(3) - 111(9) K, characterising a total of five Laval nozzles for use with N2 and Ar buffer gases by pressure impact measurements. These results were further validated using LIF and DFCS measurements of the CH radical and OCS, respectively. Spectroscopic constants and linelists for OCS are reported for the 1001 band near $2890 - 2940 cm^{-1}$ for both $OC^{32}S$ and $OC^{34}S$, measured using DFCS. Additional peaks in the spectrum are tentatively assigned to the OCS-Ar complex. The first reaction rate coefficients for the CH + OCS reaction measured between 32(3) K and 58(5) K are reported. The reaction rate coefficient at 32(3) K was measured to be $3.9(4) \times 10^{10} cm^3 molecule^{-1} s^{-1}$ and the reaction was found to exhibit no observable temperature dependence over this low temperature range.


title: Number of Independent Sets in Regular and Irregular Graphs: A 31 Year Journey

abstract: We review the progress made on bounding the number of independent sets in $d$-regular and irregular graphs over the last 31 years. We particularly focus on contributions from Kahn, Zhao, and Sah et al. in incrementally proving stronger and more general versions of the upper bound. We reproduce the main results of these works, particularly focusing on the unweighted special case (with fugacity $\lambda = 1$), which allows us to provide more intuitive and clear explanations of the key ideas that have been developed in the field over three decades.


title: Flow Priors for Linear Inverse Problems via Iterative Corrupted Trajectory Matching

abstract: Generative models based on flow matching have attracted significant attention for their simplicity and superior performance in high-resolution image synthesis. By leveraging the instantaneous change-of-variables formula, one can directly compute image likelihoods from a learned flow, making them enticing candidates as priors for downstream tasks such as inverse problems. In particular, a natural approach would be to incorporate such image probabilities in a maximum-a-posteriori (MAP) estimation problem. A major obstacle, however, lies in the slow computation of the log-likelihood, as it requires backpropagating through an ODE solver, which can be prohibitively slow for high-dimensional problems. In this work, we propose an iterative algorithm to approximate the MAP estimator efficiently to solve a variety of linear inverse problems. Our algorithm is mathematically justified by the observation that the MAP objective can be approximated by a sum of $N$ ``local MAP'' objectives, where $N$ is the number of function evaluations. By leveraging Tweedie's formula, we show that we can perform gradient steps to sequentially optimize these objectives. We validate our approach for various linear inverse problems, such as super-resolution, deblurring, inpainting, and compressed sensing, and demonstrate that we can outperform other methods based on flow matching.


title: Observation of nonreciprocal diffraction of surface acoustic wave

abstract: Rectification phenomenon caused by the simultaneous breaking of time reversal and spatial inversion symmetries has been extended to a wide range of (quasi)particles and waves; however, the nonreciprocal diffraction, which is the imbalance of upward and downward deflections, was previously observed only for photons and remained to be extended to other (quasi)particles. In this study, we present evidence of the nonreciprocal diffraction of surface acoustic wave (SAW) utilizing a magnetoelastic grating on a SAW device. Asymmetric diffraction intensities were observed when the ferromagnetic resonance was acoustically excited. Based on a theoretical model, we attribute the microscopic origin of this phenomenon to the resonant scattering involving ferromagnetic resonance excitations. The novel property may pave an avenue to further development of SAW devices for various purposes, including microwave communications and quantum engineering applications.


title: Dark energy due to quantum corrections to effective potential

abstract: In this paper we calculate quantum corrections to the effective potential in different models of inflationary cosmology. We show that quantum corrections lead to a modification of the initial potential uplifting its value at the minimum, which can be interpreted as a cosmological constant/dark energy. We concentrate on the models of $\alpha$-attractors and show that one can naturally get small values of the cosmological constant. In the model of quintessence, the same mechanism modifies the value of dark energy at the present time.


title: Encoding innumerable charge density waves of FeGe into polymorphs of LiFe6Ge6

abstract: Kagome metals exhibit rich quantum states by the intertwining of lattice, charge, orbital and spin degrees of freedom. Recently, a novel charge density wave (CDW) ground state was discovered in kagome magnet FeGe and was revealed to be driven by lowering magnetic energy via large Ge1-dimerization. Here, based on DFT calculations, we show that such mechanism will yield infinitely many metastable CDWs in FeGe due to different ways to arrange the Ge1-dimerization in enlarged superstructures. Intriguingly, utilizing these metastable CDWs, innumerable polymorphs of kagome magnet LiFe6Ge6 can be stabilized by filling Li atoms in the voids right above/below the dimerized Ge1-sites in the CDW superstructures. Such polymorphs are very stable due to the presence of magnetic-energy-saving mechanism, in sharp contrast to the non-magnetic "166" kagome compounds. In this way, a one-to-one mapping of the metastable CDWs of FeGe to stable polymorphs of LiFe6Ge6 is established. On one hand, the fingerprints of these metastable CDWs, i.e., the induced in-plane atomic distortions and band gaps, are encoded into the corresponding stable polymorphs of LiFe6Ge6, such that further study of their properties becomes possible. On the other hand, such innumerable polymorphs of LiFe6Ge6 offer great degrees of freedom to explore the rich physics of magnetic kagome metals. We thus reveal a novel connection between the unusually abundant CDWs and structural polymorphism in magnetic kagome materials, and establish a new route to obtain structural polymorphism on top of CDW states.


title: Diffeomorphic interpolation for efficient persistence-based topological optimization

abstract: Topological Data Analysis (TDA) provides a pipeline to extract quantitative topological descriptors from structured objects. This enables the definition of topological loss functions, which assert to what extent a given object exhibits some topological properties. These losses can then be used to perform topological optimizationvia gradient descent routines. While theoretically sounded, topological optimization faces an important challenge: gradients tend to be extremely sparse, in the sense that the loss function typically depends on only very few coordinates of the input object, yielding dramatically slow optimization schemes in practice.Focusing on the central case of topological optimization for point clouds, we propose in this work to overcome this limitation using diffeomorphic interpolation, turning sparse gradients into smooth vector fields defined on the whole space, with quantifiable Lipschitz constants. In particular, we show that our approach combines efficiently with subsampling techniques routinely used in TDA, as the diffeomorphism derived from the gradient computed on a subsample can be used to update the coordinates of the full input object, allowing us to perform topological optimization on point clouds at an unprecedented scale. Finally, we also showcase the relevance of our approach for black-box autoencoder (AE) regularization, where we aim at enforcing topological priors on the latent spaces associated to fixed, pre-trained, black-box AE models, and where we show thatlearning a diffeomorphic flow can be done once and then re-applied to new data in linear time (while vanilla topological optimization has to be re-run from scratch). Moreover, reverting the flow allows us to generate data by sampling the topologically-optimized latent space directly, yielding better interpretability of the model.


title: Hecke and Artin monoids and their homomorphisms

abstract: This work was motivated by a striking observation that parabolic projections of Hecke monoids map respect all parabolic elements. We found other classes of homomorphisms of Hecke monoids with the same property and discovered that many of them lift to homomorphisms of covering Artin monoids with a similar property. It turned out that they belong to a much larger class (in fact, a category) of homomorphisms of Artin monoids, most of which appear to be new.


title: Toxicity Detection for Free

abstract: Current LLMs are generally aligned to follow safety requirements and tend to refuse toxic prompts. However, LLMs can fail to refuse toxic prompts or be overcautious and refuse benign examples. In addition, state-of-the-art toxicity detectors have low TPRs at low FPR, incurring high costs in real-world applications where toxic examples are rare. In this paper, we explore Moderation Using LLM Introspection (MULI), which detects toxic prompts using the information extracted directly from LLMs themselves. We found significant gaps between benign and toxic prompts in the distribution of alternative refusal responses and in the distribution of the first response token's logits. These gaps can be used to detect toxicities: We show that a toy model based on the logits of specific starting tokens gets reliable performance, while requiring no training or additional computational cost. We build a more robust detector using a sparse logistic regression model on the first response token logits, which greatly exceeds SOTA detectors under multiple metrics.


title: Why Reinforcement Learning in Energy Systems Needs Explanations

abstract: With economic development, the complexity of infrastructure has increased drastically. Similarly, with the shift from fossil fuels to renewable sources of energy, there is a dire need for such systems that not only predict and forecast with accuracy but also help in understanding the process of predictions. Artificial intelligence and machine learning techniques have helped in finding out wellperforming solutions to different problems in the energy sector. However, the usage of state-of-the-art techniques like reinforcement learning is not surprisingly convincing. This paper discusses the application of reinforcement techniques in energy systems and how explanations of these models can be helpful


title: Node Injection Attack Based on Label Propagation Against Graph Neural Network

abstract: Graph Neural Network (GNN) has achieved remarkable success in various graph learning tasks, such as node classification, link prediction and graph classification. The key to the success of GNN lies in its effective structure information representation through neighboring aggregation. However, the attacker can easily perturb the aggregation process through injecting fake nodes, which reveals that GNN is vulnerable to the graph injection attack. Existing graph injection attack methods primarily focus on damaging the classical feature aggregation process while overlooking the neighborhood aggregation process via label propagation. To bridge this gap, we propose the label-propagation-based global injection attack (LPGIA) which conducts the graph injection attack on the node classification task. Specifically, we analyze the aggregation process from the perspective of label propagation and transform the graph injection attack problem into a global injection label specificity attack problem. To solve this problem, LPGIA utilizes a label propagation-based strategy to optimize the combinations of the nodes connected to the injected node. Then, LPGIA leverages the feature mapping to generate malicious features for injected nodes. In extensive experiments against representative GNNs, LPGIA outperforms the previous best-performing injection attack method in various datasets, demonstrating its superiority and transferability.


title: Theoretical insights and an experimental comparison of tango trees and multi-splay trees

abstract: The tango tree is the first proven $O(\lg \lg n)$-competitive binary search tree (BST). We present the first ever experimental implementation of tango trees and compare the running time of the tango tree with the multi-splay tree and the splay tree on a variety of families of access sequences. We construct access sequences that are intended to test specific properties of BSTs. The results of the other experiments demonstrate the optimality of the splay tree and multi-splay tree on these accesses, while simultaneously demonstrating the tango trees inability to achieve optimality. We prove that the running time of tango trees on the sequential access is $\Theta(n \lg \lg n)$, which provides insight into why the $\Theta(\lg \lg n)$ slow down exists on many access sequences. Motivated by experimental results, we conduct a deeper analysis of the working set access on multi-splay trees, leading to new insights about multi-splay tree behavior. Finally, all of the experiments also reveal insights about large constants and lower order terms in the multi-splay tree, which make it less practical than the splay tree, even though its proven competitive bound is tighter.


title: Isovalent alloying assisted anomalous valley Hall effect in hexagonal antiferromagnetic monolayer

abstract: Exploring combination of antiferromagnetic (AFM) spintronics and anomalous valley Hall effect (AVHE) is one of the most important questions for valleytronic applications. The key to address this issue is to achieve spin splitting around the valleys in AFM systems. Here, we propose a possible way for achieving AVHE in hexagonal AFM monolayer, which involves the isovalent alloying. This can break the combined symmetry ($PT$ symmetry) of spatial inversion ($P$) and time reversal ($T$), giving rise to spin splitting. More specifically, the large spin splitting around the Fermi energy level owes to $d$ orbital mismatch among these different transition metal ions. Based on first-principles calculations, the proposed way can be verified in out-of-plane AFM $\mathrm{CrMoC_2S_6}$ monolayer, which possesses spontaneous valley polarization and spitting splitting, providing possibility to realize AVHE. It is also proved that tensile strain can strengthen the valley splitting and maintain the out-of-plane AFM ordering. Our works provide an experimentally feasible way for developing AFM valleytronic devices.


title: Device-independent dimension leakage null test on qubits with minimal resources

abstract: We construct a null test of the two-level space of a qubit, which is both device independent and needs a minimal number of different experiments. We demonstrate its feasibility on IBM Quantum, with most qubits failing the test by more than 10 standard deviations. The robustness of the test against common technical imperfections, like decoherence and phase shifts, and supposedly negligible leakage, indicates that the origin of deviations is beyond known effects.