title: PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysis

abstract: Point cloud analysis has seen substantial advancements due to deep learning, although previous Transformer-based methods excel at modeling long-range dependencies on this task, their computational demands are substantial. Conversely, the Mamba offers greater efficiency but shows limited potential compared with Transformer-based methods. In this study, we introduce PoinTramba, a pioneering hybrid framework that synergies the analytical power of Transformer with the remarkable computational efficiency of Mamba for enhanced point cloud analysis. Specifically, our approach first segments point clouds into groups, where the Transformer meticulously captures intricate intra-group dependencies and produces group embeddings, whose inter-group relationships will be simultaneously and adeptly captured by efficient Mamba architecture, ensuring comprehensive analysis. Unlike previous Mamba approaches, we introduce a bi-directional importance-aware ordering (BIO) strategy to tackle the challenges of random ordering effects. This innovative strategy intelligently reorders group embeddings based on their calculated importance scores, significantly enhancing Mamba's performance and optimizing the overall analytical process. Our framework achieves a superior balance between computational efficiency and analytical performance by seamlessly integrating these advanced techniques, marking a substantial leap forward in point cloud analysis. Extensive experiments on datasets such as ScanObjectNN, ModelNet40, and ShapeNetPart demonstrate the effectiveness of our approach, establishing a new state-of-the-art analysis benchmark on point cloud recognition. For the first time, this paradigm leverages the combined strengths of both Transformer and Mamba architectures, facilitating a new standard in the field. The code is available at https://github.com/xiaoyao3302/PoinTramba.


title: A note about a transition of Ratliff and Rosenthal's order picking algorithm for rectangular warehouses

abstract: In the order picking problem, a picker has to collect a number of products in a warehouse with a minimum length tour. Ratliff and Rosenthal gave a linear algorithm solving the order picking problem in the case where the warehouse has two cross aisles. Their algorithm allow the tour to double cross an entire aisle. We prove that, in rectangular warehouses, there always exists a minimum length tour which doesn't double cross an aisle.


title: Scale-Invariant Feature Disentanglement via Adversarial Learning for UAV-based Object Detection

abstract: Detecting objects from Unmanned Aerial Vehicles (UAV) is often hindered by a large number of small objects, resulting in low detection accuracy. To address this issue, mainstream approaches typically utilize multi-stage inferences. Despite their remarkable detecting accuracies, real-time efficiency is sacrificed, making them less practical to handle real applications. To this end, we propose to improve the single-stage inference accuracy through learning scale-invariant features. Specifically, a Scale-Invariant Feature Disentangling module is designed to disentangle scale-related and scale-invariant features. Then an Adversarial Feature Learning scheme is employed to enhance disentanglement. Finally, scale-invariant features are leveraged for robust UAV-based object detection. Furthermore, we construct a multi-modal UAV object detection dataset, State-Air, which incorporates annotated UAV state parameters. We apply our approach to three state-of-the-art lightweight detection frameworks on three benchmark datasets, including State-Air. Extensive experiments demonstrate that our approach can effectively improve model accuracy. Our code and dataset are provided in Supplementary Materials and will be publicly available once the paper is accepted.


title: Skew-group $A_{\infty}$-categories as Fukaya categories of orbifolds

abstract: We study the partially wrapped Fukaya category of a surface with boundary with an action of a group of order two. Inspired by skew-group algebras and categories, we define the notion of a skew-group $A_\infty$-category and let it play the role of the partially wrapped Fukaya category of an orbifold surface. We classify indecomposable objects in terms of graded curves with signs, or taggings, at orbifold points. We compute morphisms between a class of objects, and we use this to describe tilting objects and find algebras derived-equivalent to skew-gentle algebras.


title: The comparison of alternative spacetimes using the spherical accretion around the black hole

abstract: In the region where the gravitational field is strong, we have examined the influence of different gravities on the accretion disk formed due to spherical accretion. To achieve this, we obtain numerical solutions of the GRH equations, utilizing Schwarzschild, Kerr, Einstein-Gauss-Bonnet, and Hartle-Thorne spacetime metrics. We investigate the impact of the rotation parameter of a black hole (a/M), the EGB coupling constant ($\alpha$), and the quadrupole moment of the rotating black hole (q) on the accretion disk formed in a strong field. The formation of the disk for the slowly and rapidly rotating black hole models is separately examined, and comparisons are made. Our numerical simulations reveal that, under the specific conditions, the solution derived from Hartle-Thorne gravity converges towards solutions obtained from Kerr and other gravitational models. In the context of the slowly rotating black hole with $a/M=0.28$, we observe a favorable agreement between the Hartle-Thorne result and the Kerr result within the range of 0 < q < 0.5. Conversely, in the scenario of the rapidly rotating black hole, a more pronounced alignment with the value of q=1 is evident within the range of 0.5 < q < 1. Nevertheless, for q > 1, it becomes apparent that the Hartle-Thorne solution diverges from solutions provided by all gravitational models. Our motivation here is to utilize the Hartle-Thorne spacetime metric for the first time in the numerical solutions of the GRH equations for the black holes, compare the results with those obtained using other gravities, and identify under which conditions the Hartle-Thorne solution is compatible with known black hole spacetime metric solutions. This may allow us to provide an alternative perspective in explaining observed X-ray data.


title: Semantic Aware Diffusion Inverse Tone Mapping

abstract: The range of real-world scene luminance is larger than the capture capability of many digital camera sensors which leads to details being lost in captured images, most typically in bright regions. Inverse tone mapping attempts to boost these captured Standard Dynamic Range (SDR) images back to High Dynamic Range (HDR) by creating a mapping that linearizes the well exposed values from the SDR image, and provides a luminance boost to the clipped content. However, in most cases, the details in the clipped regions cannot be recovered or estimated. In this paper, we present a novel inverse tone mapping approach for mapping SDR images to HDR that generates lost details in clipped regions through a semantic-aware diffusion based inpainting approach. Our method proposes two major contributions - first, we propose to use a semantic graph to guide SDR diffusion based inpainting in masked regions in a saturated image. Second, drawing inspiration from traditional HDR imaging and bracketing methods, we propose a principled formulation to lift the SDR inpainted regions to HDR that is compatible with generative inpainting methods. Results show that our method demonstrates superior performance across different datasets on objective metrics, and subjective experiments show that the proposed method matches (and in most cases outperforms) state-of-art inverse tone mapping operators in terms of objective metrics and outperforms them for visual fidelity.


title: Star formation in the high-extinction Planck cold clump PGCC G120.69+2.66

abstract: We investigate the star formation occurring in the Planck Galactic cold clump PGCC 120.69+2.66. Near-infrared JHKs images and K-band spectroscopy obtained with NOTCam at the Nordic Optical Telescope complemented with archive data are used to study the stellar content. In addition, millimetre line CO and CS spectra were obtained with the Onsala 20 m telescope, and sub-millimetre continuum SCUBA archive data are used to characterise the host molecular cloud. We identify a molecular cloud core traced by CO and CS emission at a distance of 1.1 kpc. In the region studied, we identify 5 submm continuum cores. Embedded in and around these dense submm cores, we find 38 young stellar objects, classified as 9 Class I, 8 Class II, and 21 near-IR excess or variability sources, accompanied by bipolar nebulosities and signs of protostellar jets. Furthermore, a very bright and reddened source is found towards this molecular cloud core. Even though its location appears to suggest its association to the star formation region, its infrared spectral type is compatible with a red supergiant, hidden behind 36 mag of visual extinction.


title: Unsteady aerodynamic prediction using limited samples based on transfer learning

abstract: In this study, a method for predicting unsteady aerodynamic forces under different initial conditions using a limited number of samples based on transfer learning is proposed, aiming to avoid the need for large-scale high-fidelity aerodynamic simulations. First, a large number of training samples are acquired through high-fidelity simulation under the initial condition for the baseline, followed by the establishment of a pre-trained network as the source model using a long short-term memory (LSTM) network. When unsteady aerodynamic forces are predicted under the new initial conditions, a limited number of training samples are collected by high-fidelity simulations. Then, the parameters of the source model are transferred to the new prediction model, which is further fine-tuned and trained with limited samples. The new prediction model can be used to predict the unsteady aerodynamic forces of the entire process under the new initial conditions. The proposed method is validated by predicting the aerodynamic forces of free flight of a high-spinning projectile with a large extension of initial angular velocity and pitch angle. The results indicatethat the proposed method can predict unsteady aerodynamic forces under different initial conditions using 1/3 of the sample size of the source model. Compared with direct modeling using the LSTM networks, the proposed method shows improved accuracy and efficiency.


title: Emergence of a High-Dimensional Abstraction Phase in Language Transformers

abstract: A language model (LM) is a mapping from a linguistic context to an output token. However, much remains to be known about this mapping, including how its geometric properties relate to its function. We take a high-level geometric approach to its analysis, observing, across five pre-trained transformer-based LMs and three input datasets, a distinct phase characterized by high intrinsic dimensionality. During this phase, representations (1) correspond to the first full linguistic abstraction of the input; (2) are the first to viably transfer to downstream tasks; (3) predict each other across different LMs. Moreover, we find that an earlier onset of the phase strongly predicts better language modelling performance. In short, our results suggest that a central high-dimensionality phase underlies core linguistic processing in many common LM architectures.


title: Stability Analysis of Biochemical Reaction Networks Linearly Conjugated to complex balanced Systems with Time Delays Added

abstract: Linear conjugacy offers a new perspective to broaden the scope of stable biochemical reaction networks to the systems linearly conjugated to the well-established complex balanced mass action systems ($\ell$cCBMASs). This paper addresses the challenge posed by time delay, which can disrupt the linear conjugacy relationship and complicate stability analysis for delayed versions of $\ell$cCBMASs (D$\ell$cCBMAS). Firstly, we develop Lyapunov functionals tailored to some D$\ell$cCBMASs by using the persisted parameter relationships under time delays. Subsequently, we redivide the phase space as several invariant sets of trajectories and further investigate the existence and uniqueness of equilibriums in each newly defined invariant set. This enables us to determine the local asymptotic stability of some D$\ell$cCBMASs within an updated framework. Furthermore, illustrative examples are provided to demonstrate the practical implications of our approach.


title: Encoder Embedding for General Graph and Node Classification

abstract: Graph encoder embedding, a recent technique for graph data, offers speed and scalability in producing vertex-level representations from binary graphs. In this paper, we extend the applicability of this method to a general graph model, which includes weighted graphs, distance matrices, and kernel matrices. We prove that the encoder embedding satisfies the law of large numbers and the central limit theorem on a per-observation basis. Under certain condition, it achieves asymptotic normality on a per-class basis, enabling optimal classification through discriminant analysis. These theoretical findings are validated through a series of experiments involving weighted graphs, as well as text and image data transformed into general graph representations using appropriate distance metrics.


title: Unlearning during Learning: An Efficient Federated Machine Unlearning Method

abstract: In recent years, Federated Learning (FL) has garnered significant attention as a distributed machine learning paradigm. To facilitate the implementation of the right to be forgotten, the concept of federated machine unlearning (FMU) has also emerged. However, current FMU approaches often involve additional time-consuming steps and may not offer comprehensive unlearning capabilities, which renders them less practical in real FL scenarios. In this paper, we introduce FedAU, an innovative and efficient FMU framework aimed at overcoming these limitations. Specifically, FedAU incorporates a lightweight auxiliary unlearning module into the learning process and employs a straightforward linear operation to facilitate unlearning. This approach eliminates the requirement for extra time-consuming steps, rendering it well-suited for FL. Furthermore, FedAU exhibits remarkable versatility. It not only enables multiple clients to carry out unlearning tasks concurrently but also supports unlearning at various levels of granularity, including individual data samples, specific classes, and even at the client level. We conducted extensive experiments on MNIST, CIFAR10, and CIFAR100 datasets to evaluate the performance of FedAU. The results demonstrate that FedAU effectively achieves the desired unlearning effect while maintaining model accuracy.


title: Efficient Degradation-aware Any Image Restoration

abstract: Reconstructing missing details from degraded low-quality inputs poses a significant challenge. Recent progress in image restoration has demonstrated the efficacy of learning large models capable of addressing various degradations simultaneously. Nonetheless, these approaches introduce considerable computational overhead and complex learning paradigms, limiting their practical utility. In response, we propose \textit{DaAIR}, an efficient All-in-One image restorer employing a Degradation-aware Learner (DaLe) in the low-rank regime to collaboratively mine shared aspects and subtle nuances across diverse degradations, generating a degradation-aware embedding. By dynamically allocating model capacity to input degradations, we realize an efficient restorer integrating holistic and specific learning within a unified model. Furthermore, DaAIR introduces a cost-efficient parameter update mechanism that enhances degradation awareness while maintaining computational efficiency. Extensive comparisons across five image degradations demonstrate that our DaAIR outperforms both state-of-the-art All-in-One models and degradation-specific counterparts, affirming our efficacy and practicality. The source will be publicly made available at https://eduardzamfir.github.io/daair/


title: Editable Concept Bottleneck Models

abstract: Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a human-understandable concept layer. However, most previous studies focused on cases where the data, including concepts, are clean. In many scenarios, we always need to remove/insert some training data or new concepts from trained CBMs due to different reasons, such as privacy concerns, data mislabelling, spurious concepts, and concept annotation errors. Thus, the challenge of deriving efficient editable CBMs without retraining from scratch persists, particularly in large-scale applications. To address these challenges, we propose Editable Concept Bottleneck Models (ECBMs). Specifically, ECBMs support three different levels of data removal: concept-label-level, concept-level, and data-level. ECBMs enjoy mathematically rigorous closed-form approximations derived from influence functions that obviate the need for re-training. Experimental results demonstrate the efficiency and effectiveness of our ECBMs, affirming their adaptability within the realm of CBMs.


title: MagicBathyNet: A Multimodal Remote Sensing Dataset for Bathymetry Prediction and Pixel-based Classification in Shallow Waters

abstract: Accurate, detailed, and high-frequent bathymetry, coupled with complex semantic content, is crucial for the undermapped shallow seabed areas facing intense climatological and anthropogenic pressures. Current methods exploiting remote sensing images to derive bathymetry or seabed classes mainly exploit non-open data. This lack of openly accessible benchmark archives prevents the wider use of deep learning methods in such applications. To address this issue, in this paper we present the MagicBathyNet, which is a benchmark dataset made up of image patches of Sentinel2, SPOT-6 and aerial imagery, bathymetry in raster format and annotations of seabed classes. MagicBathyNet is then exploited to benchmark state-of-the-art methods in learning-based bathymetry and pixel-based classification. Dataset, pre-trained weights, and code are publicly available at www.magicbathy.eu/magicbathynet.html.


title: Stability Analysis of a Diffusive SVIR Epidemic Model with Distributed Delay, Imperfect Vaccine and General Incidence Rate

abstract: In this chapter, we consider a reaction-diffusion SVIR infection model with dis-tributed delay and nonlinear incidence rate. The wellposedness of the proposed model is proved. By means of Lyapunov functionals, we show that the disease-free equilibrium state is globally asymptotically stable when the basic reproduction number is less or equal than one, and that the disease endemic equilibrium is globally asymptotically stable when the basic reproduction number is greater than one. Numerical simulations are provided to illustrate the obtained theoretical results.


title: Quasi-two-dimensional ferromagnetism in the triangular magnet EuAl$_{12}$O$_{19}$

abstract: We report ferromagnetic ordering at $T_\mathrm {C}=1.3\,$K in the quasi-two dimensional magnet EuAl$_{12}$O$_{19}$ with large spins $S=7/2$. This ferromagnetic state was characterized by magnetization and specific heat measurements and the experimental results were compared with classical Monte Carlo simulations. They reveal a strong single ion anisotropy leading to an uniaxial spontaneous magnetization along the $c$ axis. Furthermore the application of a magnetic field in the hard magnetization plane $ab$ reduces the Curie temperature and it reaches zero temperature at a magnetic field of $\mu_\mathrm{0} H_c \approx 0.5\,$T.


title: Fundamental limits of weak learnability in high-dimensional multi-index models

abstract: Multi-index models -- functions which only depend on the covariates through a non-linear transformation of their projection on a subspace -- are a useful benchmark for investigating feature learning with neural networks. This paper examines the theoretical boundaries of learnability in this hypothesis class, focusing particularly on the minimum sample complexity required for weakly recovering their low-dimensional structure with first-order iterative algorithms, in the high-dimensional regime where the number of samples is $n=\alpha d$ is proportional to the covariate dimension $d$. Our findings unfold in three parts: (i) first, we identify under which conditions a \textit{trivial subspace} can be learned with a single step of a first-order algorithm for any $\alpha\!>\!0$; (ii) second, in the case where the trivial subspace is empty, we provide necessary and sufficient conditions for the existence of an {\it easy subspace} consisting of directions that can be learned only above a certain sample complexity $\alpha\!>\!\alpha_c$. The critical threshold $\alpha_{c}$ marks the presence of a computational phase transition, in the sense that no efficient iterative algorithm can succeed for $\alpha\!<\!\alpha_c$. In a limited but interesting set of really hard directions -- akin to the parity problem -- $\alpha_c$ is found to diverge. Finally, (iii) we demonstrate that interactions between different directions can result in an intricate hierarchical learning phenomenon, where some directions can be learned sequentially when coupled to easier ones. Our analytical approach is built on the optimality of approximate message-passing algorithms among first-order iterative methods, delineating the fundamental learnability limit across a broad spectrum of algorithms, including neural networks trained with gradient descent.


title: Sparse Spectral Training and Inference on Euclidean and Hyperbolic Neural Networks

abstract: The growing computational demands posed by increasingly number of neural network's parameters necessitate low-memory-consumption training approaches. Previous memory reduction techniques, such as Low-Rank Adaptation (LoRA) and ReLoRA, suffer from the limitation of low rank and saddle point issues, particularly during intensive tasks like pre-training. In this paper, we propose Sparse Spectral Training (SST), an advanced training methodology that updates all singular values and selectively updates singular vectors of network weights, thereby optimizing resource usage while closely approximating full-rank training. SST refines the training process by employing a targeted updating strategy for singular vectors, which is determined by a multinomial sampling method weighted by the significance of the singular values, ensuring both high performance and memory reduction. Through comprehensive testing on both Euclidean and hyperbolic neural networks across various tasks, including natural language generation, machine translation, node classification and link prediction, SST demonstrates its capability to outperform existing memory reduction training methods and is comparable with full-rank training in some cases. On OPT-125M, with rank equating to 8.3% of embedding dimension, SST reduces the perplexity gap to full-rank training by 67.6%, demonstrating a significant reduction of the performance loss with prevalent low-rank methods. This approach offers a strong alternative to traditional training techniques, paving the way for more efficient and scalable neural network training solutions.


title: An input-output continuous-time version of Willems' lemma

abstract: We illustrate a novel version of Willems' lemma for data-based representation of continuous-time systems. The main novelties compared to previous works are two. First, the proposed framework relies only on measured input-output trajectories from the system and no internal (state) information is required. Second, our system representation makes use of exact system trajectories, without resorting to orthogonal bases representations and consequent approximations. We first establish sufficient and necessary conditions for data-based generation of system trajectories in terms of suitable latent variables. Subsequently, we reformulate these conditions using measured input-output data and show how to span the full behavior of the system. Furthermore, we show how to use the developed framework to solve the data-based continuous-time simulation problem.


title: Extended Kohler's scaling, a low temperature anomaly and Isosbestic point in the charge density wave state of 1T-VSe$_2$

abstract: 1T-VSe$_2$ is a narrow band transition metal chalcogenide that shows charge density wave (CDW) state below $T_{CDW}$ = 110 K. Here, we have explored the relevance of Kohler's rule and the thermal transport properties of VSe$_2$ across the CDW state. The magnetoresistance (MR) follows Kohler's rule above $T_{CDW}$, while an extended Kohler's rule is employed below $T_{CDW}$. Interestingly, we observed an anomaly in MR at T = 20 K, below which MR value decreases on lowering temperature. This anomaly is also reflected in the slope ($\kappa$) of Kohler's plots and the relative change in the thermal excitation induced carrier density ($n_T$) also. The $T_{CDW}$ remains largely unaffected in both electrical resistivity ($\rho(T)$) and longitudinal Seebeck coefficient ($\it{S_{xx}}$) even under a strong magnetic field of 14 Tesla. However, the application of magnetic field enhances the peak intensity of $\it{S_{xx}}$ at T $\sim$ 60 K. Additionally, $\it{S_{xx}(T)}$ curves measured at different fields exhibit a crossover at T = 20 K, which suggest the existence of unique feature in the CDW state of VSe$_2$ \textit{i.e.} a locally exact isosbestic point.


title: Spin, inclination, and magnetic field evolution of magnetar population in vacuum and plasma-filled magnetospheres

abstract: Magnetars are potential energy sources or central engines for numerous transient phenomena in the Universe. How newborn magnetars evolve in different environments remains an open question. Based on both observed and candidate magnetars, it is found that the periods of all magnetars or candidates appear as a bimodal distribution, and are defined as the ``long-P'' and ``short-P'' magnetar subclasses, respectively. We find that for the ``short-P'' subclass of magnetars, the $\dot{P}$ values also appear as a bimodal distribution, and therefore can be classified as ``high-$\dot{P}$ short-P'' and ``low-$\dot{P}$ short-P'' magnetar subclasses. In this paper, we use Monte Carlo simulations to generate synthetic magnetar populations and investigate the evolution of the ``high-$\dot{P}$ short-P'' and ``low-$\dot{P}$ short-P'' magnetar subclasses by considering both the magnetar spin and inclination, as well as the decay of their magnetic field within their evolution in both vacuum and plasma-filled magnetospheres. We find that the magnetar evolution is dependent on both spin and magnetic field, but seems to be insensitive to inclination evolution and magnetospheric environment for the ``high-$\dot{P}$ short-P'' sub-class. In comparison for the case of ``high-$\dot{P}$ short-P'', the magnetar evolution is dependent on spin, magnetic field, and inclination evolution, as well as the magnetospheric environment. The best evolution model should be the case of inclination evolution in vacuum with a small value of $\overline{\mathrm{FOM}}$. The differences in the best-fit parameters also suggest that the ``high-$\dot{P}$ short-P'' and ``low-$\dot{P}$ short-P'' magnetar subclasses may be tracking with different evolution channels.


title: Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs

abstract: We are beginning to see progress in language model assisted scientific discovery. Motivated by the use of LLMs as a general scientific assistant, this paper assesses the domain knowledge of LLMs through its understanding of different mathematical skills required to solve problems. In particular, we look at not just what the pre-trained model already knows, but how it learned to learn from information during in-context learning or instruction-tuning through exploiting the complex knowledge structure within mathematics. Motivated by the Neural Tangent Kernel (NTK), we propose \textit{NTKEval} to assess changes in LLM's probability distribution via training on different kinds of math data. Our systematic analysis finds evidence of domain understanding during in-context learning. By contrast, certain instruction-tuning leads to similar performance changes irrespective of training on different data, suggesting a lack of domain understanding across different skills.


title: Digital finance, Bargaining Power and Gender Wage Gap

abstract: The proliferation of internet technology has catalyzed the rapid development of digital finance, significantly impacting the optimization of resource allocation in China and exerting a substantial and enduring influence on the structure of employment and income distribution. This research utilizes data sourced from the Chinese General Social Survey and the Digital Financial Inclusion Index to scrutinize the influence of digital finance on the gender wage disparity in China. The findings reveal that digital finance reduces the gender wage gap, and this conclusion remains robust after addressing endogeneity problem using instrumental variable methods. Further analysis of the underlying mechanisms indicates that digital finance facilitates female entrepreneurship by lowering financing barriers, thereby promoting employment opportunities for women and also empowering them to negotiate higher wages. Specially, digital finance enhances women's bargaining power within domestic settings, therefore exerts a positive influence on the wages of women. Sub-sample regressions demonstrate that women from economically disadvantaged backgrounds, with lower human capital, benefit more from digital finance, underscoring its inclusive nature. This study provides policy evidence for empowering vulnerable groups to increase their wages and addressing the persistent issue of gender income disparity in the labor market.


title: Principal components of nuclear mass models

abstract: The principal component analysis approach is employed to extract the principal components contained in nuclear mass models for the first time. The effects coming from different nuclear mass models are reintegrated and reorganized in the extracted principal components. These extracted principal components are recombined to build new mass models, which achieve better accuracy than the original theoretical mass models. This indicates that the effects contained in different mass models can work together to improve the nuclear mass predictions with the help of the principal component analysis approach.


title: Unsupervised Deep Neural Network Approach To Solve Bosonic Systems

abstract: The simulation of quantum many-body systems poses a significant challenge in physics due to the exponential scaling of Hilbert space with the number of particles. Traditional methods often struggle with large system sizes and frustrated lattices. In this research article, we present a novel algorithm that leverages the power of deep neural networks combined with Markov Chain Monte Carlo simulation to address these limitations. Our method introduces a neural network architecture specifically designed to represent bosonic quantum states on a 1D lattice chain. We successfully achieve the ground state of the Bose-Hubbard model, demonstrating the superiority of the adaptive momentum optimizer for convergence speed and stability. Notably, our approach offers flexibility in simulating various lattice geometries and potentially larger system sizes, making it a valuable tool for exploring complex quantum phenomena. This work represents a substantial advancement in the field of quantum simulation, opening new possibilities for investigating previously challenging systems.


title: Out of Many, One: Designing and Scaffolding Proteins at the Scale of the Structural Universe with Genie 2

abstract: Protein diffusion models have emerged as a promising approach for protein design. One such pioneering model is Genie, a method that asymmetrically represents protein structures during the forward and backward processes, using simple Gaussian noising for the former and expressive SE(3)-equivariant attention for the latter. In this work we introduce Genie 2, extending Genie to capture a larger and more diverse protein structure space through architectural innovations and massive data augmentation. Genie 2 adds motif scaffolding capabilities via a novel multi-motif framework that designs co-occurring motifs with unspecified inter-motif positions and orientations. This makes possible complex protein designs that engage multiple interaction partners and perform multiple functions. On both unconditional and conditional generation, Genie 2 achieves state-of-the-art performance, outperforming all known methods on key design metrics including designability, diversity, and novelty. Genie 2 also solves more motif scaffolding problems than other methods and does so with more unique and varied solutions. Taken together, these advances set a new standard for structure-based protein design. Genie 2 inference and training code, as well as model weights, are freely available at: https://github.com/aqlaboratory/genie2.


title: Leveraging Large Language Models and Social Media for Automation in Scanning Probe Microscopy

abstract: We present the development of an automated scanning probe microscopy (SPM) measurement system using an advanced large-scale language model (LLM). This SPM system can receive instructions via social networking services (SNS), and the integration of SNS and LLMs enables real-time, language-agnostic control of SPM operations, thereby improving accessibility and efficiency. The integration of LLMs with AI systems with specialized functions brings the realization of self-driving labs closer.


title: GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting

abstract: We present GSDeformer, a method that achieves free-form deformation on 3D Gaussian Splatting(3DGS) without requiring any architectural changes. Our method extends cage-based deformation, a traditional mesh deformation method, to 3DGS. This is done by converting 3DGS into a novel proxy point cloud representation, where its deformation can be used to infer the transformations to apply on the 3D gaussians making up 3DGS. We also propose an automatic cage construction algorithm for 3DGS to minimize manual work. Our method does not modify the underlying architecture of 3DGS. Therefore, any existing trained vanilla 3DGS can be easily edited by our method. We compare the deformation capability of our method against other existing methods, demonstrating the ease of use and comparable quality of our method, despite being more direct and thus easier to integrate with other concurrent developments on 3DGS.


title: Finding Induced Subgraphs from Graphs with Small Mim-Width

abstract: In the last decade, algorithmic frameworks based on a structural graph parameter called mim-width have been developed to solve generally NP-hard problems. However, it is known that the frameworks cannot be applied to the Clique problem, and the complexity status of many problems of finding dense induced subgraphs remains open when parameterized by mim-width. In this paper, we investigate the complexity of the problem of finding a maximum induced subgraph that satisfies prescribed properties from a given graph with small mim-width. We first give a meta-theorem implying that various induced subgraph problems are NP-hard for bounded mim-width graphs. Moreover, we show that some problems, including Clique and Induced Cluster Subgraph, remain NP-hard even for graphs with (linear) mim-width at most 2. In contrast to the intractability, we provide an algorithm that, given a graph and its branch decomposition with mim-width at most 1, solves Induced Cluster Subgraph in polynomial time. We emphasize that our algorithmic technique is applicable to other problems such as Induced Polar Subgraph and Induced Split Subgraph. Since a branch decomposition with mim-width at most 1 can be constructed in polynomial time for block graphs, interval graphs, permutation graphs, cographs, distance-hereditary graphs, convex graphs, and their complement graphs, our positive results reveal the polynomial-time solvability of various problems for these graph classes.


title: Design and Implementation of DC-DC Buck Converter based on Deep Neural Network Sliding Mode Control

abstract: In order to address the challenge of traditional sliding mode controllers struggling to balance between suppressing system jitter and accelerating convergence speed, a deep neural network (DNN)-based sliding mode control strategy is proposed in this paper. The strategy achieves dynamic adjustment of parameters by modelling and learning the system through deep neural networks, which suppresses the system jitter while ensuring the convergence speed of the system. To demonstrate the stability of the system, a Lyapunov function is designed to prove the stability of the mathematical model of the DNN-based sliding mode control strategy for DC-DC buck switching power supply. We adopt a double closed-loop control mode to combine the sliding mode control of the voltage inner loop with the PI control of the current outer loop. Simultaneously, The DNN performance is evaluated through simulation and hardware experiments and compared with conventional control methods. The results demonstrate that the sliding mode controller based on the DNN exhibits faster system convergence speed, enhanced jitter suppression capability, and greater robustness.


title: Creation and manipulation of Schr\"odinger cat states of a nuclear spin qudit in silicon

abstract: High-dimensional quantum systems are a valuable resource for quantum information processing. They can be used to encode error-correctable logical qubits, for instance in continuous-variable states of oscillators such as microwave cavities or the motional modes of trapped ions. Powerful encodings include 'Schr\"odinger cat' states, superpositions of widely displaced coherent states, which also embody the challenge of quantum effects at the large scale. Alternatively, recent proposals suggest encoding logical qubits in high-spin atomic nuclei, which can host hardware-efficient versions of continuous-variable codes on a finite-dimensional system. Here we demonstrate the creation and manipulation of Schr\"odinger cat states using the spin-7/2 nucleus of a single antimony ($^{123}$Sb) atom, embedded and operated within a silicon nanoelectronic device. We use a coherent multi-frequency control scheme to produce spin rotations that preserve the SU(2) symmetry of the qudit, and constitute logical Pauli operations for logical qubits encoded in the Schr\"odinger cat states. The Wigner function of the cat states exhibits parity oscillations with a contrast up to 0.982(5), and state fidelities up to 0.913(2). These results demonstrate high-fidelity preparation of nonclassical resource states and logical control in a single atomic-scale object, opening up applications in quantum information processing and quantum error correction within a scalable, manufacturable semiconductor platform.


title: Towards Natural Machine Unlearning

abstract: Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream of existing MU methods involves modifying the forgetting data with incorrect labels and subsequently fine-tuning the model. While learning such incorrect information can indeed remove knowledge, the process is quite unnatural as the unlearning process undesirably reinforces the incorrect information and leads to over-forgetting. Towards more \textit{natural} machine unlearning, we inject correct information from the remaining data to the forgetting samples when changing their labels. Through pairing these adjusted samples with their labels, the model will tend to use the injected correct information and naturally suppress the information meant to be forgotten. Albeit straightforward, such a first step towards natural machine unlearning can significantly outperform current state-of-the-art approaches. In particular, our method substantially reduces the over-forgetting and leads to strong robustness to hyperparameters, making it a promising candidate for practical machine unlearning.


title: Essential positivity for Toeplitz operators on the Fock space

abstract: In this short note, we discuss essential positivity of Toeplitz operators on the Fock space, as motivated by a recent question of Per\"al\"a and Virtanen. We give a proper characterization of essential positivity in terms of limit operators. A conjectured characterization of essential positivity of Per\"al\"a and Virtanen is disproven when the assumption of radiality is dropped. Nevertheless, when the symbol of the Toeplitz operator is of vanishing mean oscillation, we show that the conjecture of Per\"al\"a and Virtanen holds true, even without radiality.


title: Finite-time convergence to an $\epsilon$-efficient Nash equilibrium in potential games

abstract: This paper investigates the convergence time of log-linear learning to an $\epsilon$-efficient Nash equilibrium (NE) in potential games. In such games, an efficient NE is defined as the maximizer of the potential function. Existing results are limited to potential games with stringent structural assumptions and entail exponential convergence times in $1/\epsilon$. Unaddressed so far, we tackle general potential games and prove the first finite-time convergence to an $\epsilon$-efficient NE. In particular, by using a problem-dependent analysis, our bound depends polynomially on $1/\epsilon$. Furthermore, we provide two extensions of our convergence result: first, we show that a variant of log-linear learning that requires a factor $A$ less feedback on the utility per round enjoys a similar convergence time; second, we demonstrate the robustness of our convergence guarantee if log-linear learning is subject to small perturbations such as alterations in the learning rule or noise-corrupted utilities.


title: Node Accessibility Characterization of Radially-Grown Structures

abstract: Complex systems have motivated continuing interest from the scientific community, leading to new concepts and methods. Growing systems represent a case of particular interest, as their topological, geometrical, and also dynamical properties change along time, as new elements are incorporated into the existing structure. In the present work, an approach is the case in which systems grown radially around some straight axis of reference, such as particle deposition on electrodes, or urban expansion along avenues, roads, coastline, or rivers, among several other possibilities. More specifically, we aim at characterizing the topological properties of simulated growing structures, which are represented as graphs, in terms of a measurement corresponding to the accessibility of each involved node. The incorporation of new elements (nodes and links) is performed preferentially to the angular orientation respectively to the reference axis. Several interesting results are reported, including the tendency of structures grown preferentially to the orientation normal to the axis to have smaller accessibility.


title: Energy of Gravitational Radiation and the Background Energy of the Space-Time

abstract: We address the issue of gravitational radiation in the context of the Bondi-Sachs space-time, and consider the expression for the gravitational energy of the radiation obtained in the realm of the teleparallel equivalent of general relativity (TEGR). This expression is independent of the radial distance (i.e., of powers of $1/r$) and depends exclusively on the functions $c(u,\theta,\phi)$ and $d(u,\theta,\phi)$, which yield the news functions ($u$ is the retarded time, $u=t-r$). We investigate the mathematical and physical features of this energy expression in the simpler framework of axial symmetry. Once a burst of gravitational radiation takes place in a self gravitating system, that leads to a loss of the Bondi mass, gravitational radiation is emitted throughout the whole space-time. The existence and presence of this radiation in the background structure of the space-time is consistent with the analysis developed by Papapetrou, and Hallidy and Janis, who found no proof that a gravitational system that emits a burst of gravitational radiation is preceded and followed by two stationary gravitational field configurations, namely, it seems that it is impossible for a gravitational system, which is initially stationary, to return to a stationary state after emitting a burst of axially symmetric gravitational radiation, in which case the space-time is not even asymptotically stationary. Therefore, it is plausible that the gravitational energy of radiation is present in the background structure of the space-time, and this is the energy predicted in the TEGR. This analysis lead us to conjecture that the noise detected in the large terrestrial gravitational wave observatories is intrinsically related to the background gravitational radiation.


title: Hierarchical Loss And Geometric Mask Refinement For Multilabel Ribs Segmentation

abstract: Automatic ribs segmentation and numeration can increase computed tomography assessment speed and reduce radiologists mistakes. We introduce a model for multilabel ribs segmentation with hierarchical loss function, which enable to improve multilabel segmentation quality. Also we propose postprocessing technique to further increase labeling quality. Our model achieved new state-of-the-art 98.2% label accuracy on public RibSeg v2 dataset, surpassing previous result by 6.7%.


title: Absence of Long-Range Magnetic Ordering in a Trirutile High-Entropy Oxide (Mn0.2Fe0.2Co0.2Ni0.2Cu0.2)Ta2O6

abstract: Functionalities of solid-state materials are usually considered to be dependent on their crystal structures. The limited structural types observed in the emerged high-entropy oxides put constraints on exploration of their physical properties and potential applications. Herein, we synthesized the first high-entropy oxide in a trirutile structure, (Mn0.2Fe0.2Co0.2Ni0.2Cu0.2)Ta2O6, and investigated its magnetism. The phase purity and high-entropy nature were confirmed by powder X-ray diffraction and energy-dispersive spectroscopy, respectively. X-ray photoelectron spectroscopy indicated divalent Mn, Co and Cu along with coexistence of divalent and trivalent Fe and Ni. Magnetic properties measurements showed antiferromagnetic coupling and potential short-range magnetic ordering below ~ 4 K. The temperature-dependent heat capacity data measured under zero and high magnetic field confirmed the short-range magnetic ordering and a possible low-temperature phonon excitation. Moreover, the possible reasons for the absence of long-range magnetic ordering are concluded from a molecular orbital perspective. The discovery of the first trirutile high-entropy oxide opens a new way for studying the relationship between the highly disordered atomic arrangement and their magnetic interaction. Furthermore, it provides a new direction for exploring functionalities of high-entropy oxides.


title: Unsupervised Deep Neural Network Approach To Solve Fermionic Systems

abstract: Solving the Schr\"{o}dinger equation for interacting many-body quantum systems faces computational challenges due to exponential scaling with system size. This complexity limits the study of important phenomena in materials science and physics. We develop an Artificial Neural Network (ANN)-driven algorithm to simulate fermionic systems on lattices. Our method uses Pauli matrices to represent quantum states, incorporates Markov Chain Monte Carlo sampling, and leverages an adaptive momentum optimizer. We demonstrate the algorithm's accuracy by simulating the Heisenberg Hamiltonian on a one-dimensional lattice, achieving results with an error in the order of $10^{-4}$ compared to exact diagonalization. Furthermore, we successfully model a magnetic phase transition in a two-dimensional lattice under an applied magnetic field. Importantly, our approach avoids the sign problem common to traditional Fermionic Monte Carlo methods, enabling the investigation of frustrated systems. This work demonstrates the potential of ANN-based algorithms for efficient simulation of complex quantum systems, opening avenues for discoveries in condensed matter physics and materials science.


title: The two-thirds power law derived from an higher-derivative action

abstract: The two-thirds power law is a link between angular speed $\omega$ and curvature $\kappa$ observed in voluntary human movements: $\omega$ is proportional to $\kappa^{2/3}$. Squared jerk is known to be a Lagrangian leading to the latter law. We propose that a broader class of higher-derivative Lagrangians leads to the two-thirds power law and we perform the Hamiltonian analysis leading to action-angle variables through Ostrogradski's procedure. In this framework, squared jerk appears as an action variable and its minimization may be related to power expenditure minimization during motion. The identified higher-derivative Lagrangians are therefore natural candidates for cost functions, i.e. movement functions that are targeted to be minimal when one individual performs a voluntary movement.


title: Photon under repeated transverse Lorentz boosts: An apparent paradox

abstract: We investigate the effects of the repeated application of Lorentz-boosts to the four momentum of a photon in the transverse direction and observe that this can take us to a reference frame in which the direction of the photon's momentum is apparently reversed. We further extend this to an infinite succession of infinitesimal transverse Lorentz-boosts and show it amounts to a rotation of the photon's momentum, while the transformation is not a simple rotation but a Lorentz transformation. These possibly surprising results can be understood in light of the Wigner rotation: the combination of Lorentz-boosts along different directions amounts to a Lorentz-boost combined with a rotation. The presented exercises are some more illustrations of the counterintuitive behavior of Lorentz-boost combinations.


title: Revisiting Counterfactual Regression through the Lens of Gromov-Wasserstein Information Bottleneck

abstract: As a promising individualized treatment effect (ITE) estimation method, counterfactual regression (CFR) maps individuals' covariates to a latent space and predicts their counterfactual outcomes. However, the selection bias between control and treatment groups often imbalances the two groups' latent distributions and negatively impacts this method's performance. In this study, we revisit counterfactual regression through the lens of information bottleneck and propose a novel learning paradigm called Gromov-Wasserstein information bottleneck (GWIB). In this paradigm, we learn CFR by maximizing the mutual information between covariates' latent representations and outcomes while penalizing the kernelized mutual information between the latent representations and the covariates. We demonstrate that the upper bound of the penalty term can be implemented as a new regularizer consisting of $i)$ the fused Gromov-Wasserstein distance between the latent representations of different groups and $ii)$ the gap between the transport cost generated by the model and the cross-group Gromov-Wasserstein distance between the latent representations and the covariates. GWIB effectively learns the CFR model through alternating optimization, suppressing selection bias while avoiding trivial latent distributions. Experiments on ITE estimation tasks show that GWIB consistently outperforms state-of-the-art CFR methods. To promote the research community, we release our project at https://github.com/peteryang1031/Causal-GWIB.


title: Learning to Discretize Denoising Diffusion ODEs

abstract: Diffusion Probabilistic Models (DPMs) are powerful generative models showing competitive performance in various domains, including image synthesis and 3D point cloud generation. However, sampling from pre-trained DPMs involves multiple neural function evaluations (NFE) to transform Gaussian noise samples into images, resulting in higher computational costs compared to single-step generative models such as GANs or VAEs. Therefore, a crucial problem is to reduce NFE while preserving generation quality. To this end, we propose LD3, a lightweight framework for learning time discretization while sampling from the diffusion ODE encapsulated by DPMs. LD3 can be combined with various diffusion ODE solvers and consistently improves performance without retraining resource-intensive neural networks. We demonstrate analytically and empirically that LD3 enhances sampling efficiency compared to distillation-based methods, without the extensive computational overhead. We evaluate our method with extensive experiments on 5 datasets, covering unconditional and conditional sampling in both pixel-space and latent-space DPMs. For example, in about 5 minutes of training on a single GPU, our method reduces the FID score from 6.63 to 2.68 on CIFAR10 (7 NFE), and in around 20 minutes, decreases the FID from 8.51 to 5.03 on class-conditional ImageNet-256 (5 NFE). LD3 complements distillation methods, offering a more efficient approach to sampling from pre-trained diffusion models.


title: Time-Harmonic Optical Flow with Applications in Elastography

abstract: In this paper, we propose mathematical models for reconstructing the optical flow in time-harmonic elastography. In this image acquisition technique, the object undergoes a special time-harmonic oscillation with known frequency so that only the spatially varying amplitude of the velocity field has to be determined. This allows for a simpler multi-frame optical flow analysis using Fourier analytic tools in time. We propose three variational optical flow models and show how their minimization can be tackled via Fourier transform in time. Numerical examples with synthetic as well as real-world data demonstrate the benefits of our approach. Keywords: optical flow, elastography, Fourier transform, iteratively reweighted least squares, Horn--Schunck method


title: Human-in-the-loop Reinforcement Learning for Data Quality Monitoring in Particle Physics Experiments

abstract: Data Quality Monitoring (DQM) is a crucial task in large particle physics experiments, since detector malfunctioning can compromise the data. DQM is currently performed by human shifters, which is costly and results in limited accuracy. In this work, we provide a proof-of-concept for applying human-in-the-loop Reinforcement Learning (RL) to automate the DQM process while adapting to operating conditions that change over time. We implement a prototype based on the Proximal Policy Optimization (PPO) algorithm and validate it on a simplified synthetic dataset. We demonstrate how a multi-agent system can be trained for continuous automated monitoring during data collection, with human intervention actively requested only when relevant. We show that random, unbiased noise in human classification can be reduced, leading to an improved accuracy over the baseline. Additionally, we propose data augmentation techniques to deal with scarce data and to accelerate the learning process. Finally, we discuss further steps needed to implement the approach in the real world, including protocols for periodic control of the algorithm's outputs.


title: Randomized algorithms and PAC bounds for inverse reinforcement learning in continuous spaces

abstract: This work studies discrete-time discounted Markov decision processes with continuous state and action spaces and addresses the inverse problem of inferring a cost function from observed optimal behavior. We first consider the case in which we have access to the entire expert policy and characterize the set of solutions to the inverse problem by using occupation measures, linear duality, and complementary slackness conditions. To avoid trivial solutions and ill-posedness, we introduce a natural linear normalization constraint. This results in an infinite-dimensional linear feasibility problem, prompting a thorough analysis of its properties. Next, we use linear function approximators and adopt a randomized approach, namely the scenario approach and related probabilistic feasibility guarantees, to derive epsilon-optimal solutions for the inverse problem. We further discuss the sample complexity for a desired approximation accuracy. Finally, we deal with the more realistic case where we only have access to a finite set of expert demonstrations and a generative model and provide bounds on the error made when working with samples.


title: On birational automorphisms of double EPW-cubes

abstract: We give a classification of finite groups of symplectic birational automorphisms on a manifold of K3^[3]-type with stable and stably saturated cohomological action. We describe the group of polarized automorphisms of a smooth double EPW-cube. Using this description, we exhibit examples of projective hyperkaehler manifolds of K3^[3]-type of maximal Picard rank with a symplectic action of a large group.


title: On Colimits and Model Structures in Various Categories of Manifolds

abstract: After explaining the importance of model categories in abstract homotopy theory, we provide concrete examples demonstrating that various categories of manifolds do not have all finite colimits, and hence cannot be model categories. We then consider various enlargements of our categories of manifolds, culminating in categories of presheaves. We explain how to produce model structures on these enlarged categories, culminating with answering an open problem involving Poincar\'{e} spaces.


title: ChatGPT Code Detection: Techniques for Uncovering the Source of Code

abstract: In recent times, large language models (LLMs) have made significant strides in generating computer code, blurring the lines between code created by humans and code produced by artificial intelligence (AI). As these technologies evolve rapidly, it is crucial to explore how they influence code generation, especially given the risk of misuse in areas like higher education. This paper explores this issue by using advanced classification techniques to differentiate between code written by humans and that generated by ChatGPT, a type of LLM. We employ a new approach that combines powerful embedding features (black-box) with supervised learning algorithms - including Deep Neural Networks, Random Forests, and Extreme Gradient Boosting - to achieve this differentiation with an impressive accuracy of 98%. For the successful combinations, we also examine their model calibration, showing that some of the models are extremely well calibrated. Additionally, we present white-box features and an interpretable Bayes classifier to elucidate critical differences between the code sources, enhancing the explainability and transparency of our approach. Both approaches work well but provide at most 85-88% accuracy. We also show that untrained humans solve the same task not better than random guessing. This study is crucial in understanding and mitigating the potential risks associated with using AI in code generation, particularly in the context of higher education, software development, and competitive programming.


title: Seismic fragility curves fitting revisited: ordinal regression models and their generalization

abstract: This research conducts a thorough reevaluation of seismic fragility curves by utilizing ordinal regression models, moving away from the commonly used log-normal distribution function known for its simplicity. It explores the nuanced differences and interrelations among various ordinal regression approaches, including Cumulative, Sequential, and Adjacent Category models, alongside their enhanced versions that incorporate category-specific effects and variance heterogeneity. The study applies these methodologies to empirical bridge damage data from the 2008 Wenchuan earthquake, using both frequentist and Bayesian inference methods, and conducts model diagnostics using surrogate residuals. The analysis covers eleven models, from basic to those with heteroscedastic extensions and category-specific effects. Through rigorous leave-one-out cross-validation, the Sequential model with category-specific effects emerges as the most effective. The findings underscore a notable divergence in damage probability predictions between this model and conventional Cumulative probit models, advocating for a substantial transition towards more adaptable fragility curve modeling techniques that enhance the precision of seismic risk assessments. In conclusion, this research not only readdresses the challenge of fitting seismic fragility curves but also advances methodological standards and expands the scope of seismic fragility analysis. It advocates for ongoing innovation and critical reevaluation of conventional methods to advance the predictive accuracy and applicability of seismic fragility models within the performance-based earthquake engineering domain.


title: On the Convexity and Reliability of the Bethe Free Energy Approximation

abstract: The Bethe free energy approximation provides an effective way for relaxing NP-hard problems of probabilistic inference. However, its accuracy depends on the model parameters and particularly degrades if a phase transition in the model occurs. In this work, we analyze when the Bethe approximation is reliable and how this can be verified. We argue and show by experiment that it is mostly accurate if it is convex on a submanifold of its domain, the 'Bethe box'. For verifying its convexity, we derive two sufficient conditions that are based on the definiteness properties of the Bethe Hessian matrix: the first uses the concept of diagonal dominance, and the second decomposes the Bethe Hessian matrix into a sum of sparse matrices and characterizes the definiteness properties of the individual matrices in that sum. These theoretical results provide a simple way to estimate the critical phase transition temperature of a model. As a practical contribution we propose $\texttt{BETHE-MIN}$, a projected quasi-Newton method to efficiently find a minimum of the Bethe free energy.


title: The handlebody group is a virtual duality group

abstract: We show that the mapping class group of a handlebody is a virtual duality group, in the sense of Bieri and Eckmann. In positive genus we give a description of the dualising module of any torsion-free, finite-index subgroup of the handlebody mapping class group as the homology of the complex of non-simple disc systems.


title: Source Code Archiving to the Rescue of Reproducible Deployment

abstract: The ability to verify research results and to experiment with methodologies are core tenets of science. As research results are increasingly the outcome of computational processes, software plays a central role. GNU Guix is a software deployment tool that supports reproducible software deployment, making it a foundation for computational research workflows. To achieve reproducibility, we must first ensure the source code of software packages Guix deploys remains available.We describe our work connecting Guix with Software Heritage, the universal source code archive, making Guix the first free software distribution and tool backed by a stable archive. Our contribution is twofold: we explain the rationale and present the design and implementation we came up with; second, we report on the archival coverage for package source code with data collected over five years and discuss remaining challenges.


title: Erase to Enhance: Data-Efficient Machine Unlearning in MRI Reconstruction

abstract: Machine unlearning is a promising paradigm for removing unwanted data samples from a trained model, towards ensuring compliance with privacy regulations and limiting harmful biases. Although unlearning has been shown in, e.g., classification and recommendation systems, its potential in medical image-to-image translation, specifically in image recon-struction, has not been thoroughly investigated. This paper shows that machine unlearning is possible in MRI tasks and has the potential to benefit for bias removal. We set up a protocol to study how much shared knowledge exists between datasets of different organs, allowing us to effectively quantify the effect of unlearning. Our study reveals that combining training data can lead to hallucinations and reduced image quality in the reconstructed data. We use unlearning to remove hallucinations as a proxy exemplar of undesired data removal. Indeed, we show that machine unlearning is possible without full retraining. Furthermore, our observations indicate that maintaining high performance is feasible even when using only a subset of retain data. We have made our code publicly accessible.


title: Feature Splatting for Better Novel View Synthesis with Low Overlap

abstract: 3D Gaussian Splatting has emerged as a very promising scene representation, achieving state-of-the-art quality in novel view synthesis significantly faster than competing alternatives. However, its use of spherical harmonics to represent scene colors limits the expressivity of 3D Gaussians and, as a consequence, the capability of the representation to generalize as we move away from the training views. In this paper, we propose to encode the color information of 3D Gaussians into per-Gaussian feature vectors, which we denote as Feature Splatting (FeatSplat). To synthesize a novel view, Gaussians are first "splatted" into the image plane, then the corresponding feature vectors are alpha-blended, and finally the blended vector is decoded by a small MLP to render the RGB pixel values. To further inform the model, we concatenate a camera embedding to the blended feature vector, to condition the decoding also on the viewpoint information. Our experiments show that these novel model for encoding the radiance considerably improves novel view synthesis for low overlap views that are distant from the training views. Finally, we also show the capacity and convenience of our feature vector representation, demonstrating its capability not only to generate RGB values for novel views, but also their per-pixel semantic labels. We will release the code upon acceptance. Keywords: Gaussian Splatting, Novel View Synthesis, Feature Splatting


title: Confocal structured illumination microscopy

abstract: Confocal microscopy, a critical advancement in optical imaging, is widely applied because of its excellent anti-noise ability. However, it has low imaging efficiency and can cause phototoxicity. Optical-sectioning structured illumination microscopy (OS-SIM) can overcome the limitations of confocal microscopy but still face challenges in imaging depth and signal-to-noise ratio (SNR). We introduce the concept of confocal imaging into OS-SIM and propose confocal structured illumination microscopy (CSIM) to enhance the imaging performance of OS-SIM. CSIM exploits the principle of dual photography to reconstruct a dual image from each pixel of the camera. The reconstructed dual image is equivalent to the image obtained by using the spatial light modulator (SLM) as a virtual camera, enabling the separation of the conjugate and non-conjugate signals recorded by the camera pixel. We can reject the non-conjugate signals by extracting the conjugate signal from each dual image to reconstruct a confocal image when establishing the conjugate relationship between the camera and the SLM. We have constructed the theoretical framework of CSIM. Optical-sectioning experimental results demonstrate that CSIM can reconstruct images with superior SNR and greater imaging depth compared with existing OS-SIM. CSIM is expected to expand the application scope of OS-SIM.


title: From Data Complexity to User Simplicity: A Framework for Linked Open Data Reconciliation and Serendipitous Discovery

abstract: This article introduces a novel software solution to create a Web portal to align Linked Open Data sources and provide user-friendly interfaces for serendipitous discovery. We present the Polifonia Web portal as a motivating scenario and case study to address research problems such as data reconciliation and serving generous interfaces in the music heritage domain.


title: A Preference-oriented Diversity Model Based on Mutual-information in Re-ranking for E-commerce Search

abstract: Re-ranking is a process of rearranging ranking list to more effectively meet user demands by accounting for the interrelationships between items. Existing methods predominantly enhance the precision of search results, often at the expense of diversity, leading to outcomes that may not fulfill the varied needs of users. Conversely, methods designed to promote diversity might compromise the precision of the results, failing to satisfy the users' requirements for accuracy. To alleviate the above problems, this paper proposes a Preference-oriented Diversity Model Based on Mutual-information (PODM-MI), which consider both accuracy and diversity in the re-ranking process. Specifically, PODM-MI adopts Multidimensional Gaussian distributions based on variational inference to capture users' diversity preferences with uncertainty. Then we maximize the mutual information between the diversity preferences of the users and the candidate items using the maximum variational inference lower bound to enhance their correlations. Subsequently, we derive a utility matrix based on the correlations, enabling the adaptive ranking of items in line with user preferences and establishing a balance between the aforementioned objectives. Experimental results on real-world online e-commerce systems demonstrate the significant improvements of PODM-MI, and we have successfully deployed PODM-MI on an e-commerce search platform.


title: A derivation of the first generation particle masses from internal spacetime

abstract: Internal spacetime geometry was recently introduced to model certain quantum phenomena using spacetime metrics that are degenerate. We use the Ricci tensors of these metrics to derive a ratio of the bare up and down quark masses, obtaining $m_u/m_d = 9604/19683 \approx .4879$. This value is within the lattice QCD value at $2 \operatorname{GeV}$ in the $\overline{\operatorname{MS}}$-scheme, $.473 \pm .023$. Moreover, using the Levi-Cevita Poisson equation, we derive ratios of the dressed electron mass and bare quark masses. For a dressed electron mass of $.511 \operatorname{MeV}$, these ratios yield the bare quark masses $m_u \approx 2.2440 \operatorname{MeV}$ and $m_d \approx 4.599 \operatorname{MeV}$, which are within/near the lattice QCD values $m^{\overline{\operatorname{MS}}}_u = (2.20\pm .10) \operatorname{MeV}$ and $m^{\overline{\operatorname{MS}}}_d = (4.69 \pm .07) \operatorname{MeV}$. Finally, using $4$-accelerations, we derive the ratio $\tilde{m}_u/\tilde{m}_d = 48/49 \approx .98$ of the constituent up and down quark masses. This value is within the $.97 \sim 1$ range of constituent quark models. All of the ratios we obtain are from first principles alone, with no free or ad hoc parameters. Furthermore, and rather curiously, our derivations do not use quantum field theory, but only tools from general relativity.


title: Mosaic Memory: Fuzzy Duplication in Copyright Traps for Large Language Models

abstract: The immense datasets used to develop Large Language Models (LLMs) often include copyright-protected content, typically without the content creator's consent. Copyright traps have been proposed to be injected into the original content, improving content detectability in newly released LLMs. Traps, however, rely on the exact duplication of a unique text sequence, leaving them vulnerable to commonly deployed data deduplication techniques. We here propose the generation of fuzzy copyright traps, featuring slight modifications across duplication. When injected in the fine-tuning data of a 1.3B LLM, we show fuzzy trap sequences to be memorized nearly as well as exact duplicates. Specifically, the Membership Inference Attack (MIA) ROC AUC only drops from 0.90 to 0.87 when 4 tokens are replaced across the fuzzy duplicates. We also find that selecting replacement positions to minimize the exact overlap between fuzzy duplicates leads to similar memorization, while making fuzzy duplicates highly unlikely to be removed by any deduplication process. Lastly, we argue that the fact that LLMs memorize across fuzzy duplicates challenges the study of LLM memorization relying on naturally occurring duplicates. Indeed, we find that the commonly used training dataset, The Pile, contains significant amounts of fuzzy duplicates. This introduces a previously unexplored confounding factor in post-hoc studies of LLM memorization, and questions the effectiveness of (exact) data deduplication as a privacy protection technique.


title: Polyp Segmentation Generalisability of Pretrained Backbones

abstract: It has recently been demonstrated that pretraining backbones in a self-supervised manner generally provides better fine-tuned polyp segmentation performance, and that models with ViT-B backbones typically perform better than models with ResNet50 backbones. In this paper, we extend this recent work to consider generalisability. I.e., we assess the performance of models on a different dataset to that used for fine-tuning, accounting for variation in network architecture and pretraining pipeline (algorithm and dataset). This reveals how well models with different pretrained backbones generalise to data of a somewhat different distribution to the training data, which will likely arise in deployment due to different cameras and demographics of patients, amongst other factors. We observe that the previous findings, regarding pretraining pipelines for polyp segmentation, hold true when considering generalisability. However, our results imply that models with ResNet50 backbones typically generalise better, despite being outperformed by models with ViT-B backbones in evaluation on the test set from the same dataset used for fine-tuning.


title: Sparse Matrix in Large Language Model Fine-tuning

abstract: LoRA and its variants have become popular parameter-efficient fine-tuning (PEFT) methods due to their ability to avoid excessive computational costs. However, an accuracy gap often exists between PEFT methods and full fine-tuning (FT), and this gap has yet to be systematically studied. In this work, we introduce a method for selecting sparse sub-matrices that aim to minimize the performance gap between PEFT vs. full fine-tuning (FT) while also reducing both fine-tuning computational cost and memory cost. Our Sparse Matrix Tuning (SMT) method begins by identifying the most significant sub-matrices in the gradient update, updating only these blocks during the fine-tuning process. In our experiments, we demonstrate that SMT consistently surpasses other PEFT baseline (e.g. LoRA and DoRA) in fine-tuning popular large language models such as LLaMA across a broad spectrum of tasks, while reducing the GPU memory footprint by 67% compared to FT. We also examine how the performance of LoRA and DoRA tends to plateau and decline as the number of trainable parameters increases, in contrast, our SMT method does not suffer from such issue.


title: Syngas conversion to higher alcohols via wood-framed Cu/Co-carbon catalyst

abstract: Syngas conversion into higher alcohols represents a promising avenue for transforming coal or biomass into liquid fuels. However, the commercialization of this process has been hindered by the high cost, low activity, and inadequate C$_{2+}$OH selectivity of catalysts. Herein, we have developed Cu/Co carbon wood catalysts, offering a cost-effective and stable alternative with exceptional selectivity for catalytic conversion. The formation of Cu/Co nanoparticles was found, influenced by water-1,2-propylene glycol ratios in the solution, resulting in bidisperse nanoparticles. The catalyst exhibited a remarkable CO conversion rate of 74.8% and a selectivity of 58.7% for C$_{2+}$OH, primarily comprising linear primary alcohols. This catalyst demonstrated enduring stability and selectivity under industrial conditions, maintaining its efficacy for up to 350 h of operation. We also employed density functional theory (DFT) to analyze selectivity, particularly focusing on the binding strength of CO, a crucial precursor for subsequent reactions leading to the formation of CH$_3$OH. DFT identified the pathway of CH$_x$ and CO coupling, ultimately yielding C$_2$H$_5$OH. This computational understanding, coupled with high performance of the Cu/Co-carbon wood catalyst, paves ways for the development of catalytically selective materials tailored for higher alcohols production, thereby ushering in new possibility in this field.


title: Polygons and non-starlikeness of Teichmuller spaces

abstract: The problem of starlikeness of Teichmuller spaces in Bers' embedding was raised in 1974 and is solved (negatively) for Teichmuller spaces of sufficiently large dimensions. The original proof given by the author relies on the existence of conformally rigid domains established by Thurston. Later the author found another proof of non-starlikeness of universal Teichmuller space based on geometric features of rectilinear polygons. This paper provides a complete solution of the problem for Teichmuller spaces $T(g,0)$ of closed Riemann surfaces of genus $g \ge 2$.


title: Ligand Field Exciton Annihilation in Bulk CrCl3

abstract: The layered van der Waals material CrCl3 exhibits very strongly bound ligand field excitons that control optoelectronic applications and are connected with magnetic ordering by virtue of their d-orbital origin. Time-resolved photoluminescence of these exciton populations at room temperature shows that their relaxation is dominated by exciton-exciton annihilation and that the spontaneous decay lifetime is very long. These observations allow the rough quantification of the exciton annihilation rate constant and contextualization in light of a recent theory of universal scaling behavior of the annihilation process.


title: pyLOM: A HPC open source reduced order model suite for fluid dynamics applications

abstract: This paper describes the numerical implementation in a high-performance computing environment of an open-source library for model order reduction in fluid dynamics. This library, called pyLOM, contains the algorithms of proper orthogonal decomposition (POD), dynamic mode decomposition (DMD) and spectral proper orthogonal decomposition (SPOD), as well as, efficient SVD and matrix-matrix multiplication, all of them tailored for supercomputers. The library is profiled in detail under the MareNostrum IV supercomputer. The bottleneck is found to be in the QR factorization, which has been solved by an efficient binary tree communications pattern. Strong and weak scalability benchmarks reveal that the serial part (i.e., the part of the code that cannot be parallelized) of these algorithms is under 10% for the strong scaling and under 0.7% for the weak scaling. Using pyLOM, a POD of a dataset containing 1.14 x 108 gridpoints and 1808 snapshots that takes 6.3Tb of memory can be computed in 81.08 seconds using 10368 CPUs. Additioally, the algorithms are validated using the datasets of a flow around a circular cylinder at ReD = 100 and ReD = 1 x 104, as well as the flow in the Stanford diffuser at Reh = 1 x 104.


title: Electron localization function for non-collinear spins

abstract: We extend the electron localization function -- a popular descriptor of molecular bonds and atomic shells -- to general non-collinearly magnetized states, open-shell solutions of the Pauli-Schr{\"o}dinger equation. The description is also improved in paradigmatic, collinear states.

categories: cond-mat.mtrl-sci physics.app-ph physics.chem-ph physics.comp-ph


title: MMD Two-sample Testing in the Presence of Arbitrarily Missing Data

abstract: In many real-world applications, it is common that a proportion of the data may be missing or only partially observed. We develop a novel two-sample testing method based on the Maximum Mean Discrepancy (MMD) which accounts for missing data in both samples, without making assumptions about the missingness mechanism. Our approach is based on deriving the mathematically precise bounds of the MMD test statistic after accounting for all possible missing values. To the best of our knowledge, it is the only two-sample testing method that is guaranteed to control the Type I error for both univariate and multivariate data where data may be arbitrarily missing. Simulation results show that our method has good statistical power, typically for cases where 5% to 10% of the data are missing. We highlight the value of our approach when the data are missing not at random, a context in which either ignoring the missing values or using common imputation methods may not control the Type I error.


title: Dynamical Analysis of a Cocaine-Heroin Epidemiological Model with Spatial Distributions

abstract: This article conducts an in-depth investigation of a new spatio-temporal model for the cocaine-heroin epidemiological model with vital dynamics, incorporating the Laplacian operator. The study rigorously establishes the existence, uniqueness, non-negativity, and boundedness of solutions for the proposed model. In addition, the local stability of both a drug-free equilibrium and a drug-addiction equilibrium are analyzed by studying the corresponding characteristic equations. The research provides conclusive evidence that when the basic reproductive number $\mathcal{R}_0$ exceeds 1, the drug-addiction equilibrium is globally asymptotically stable. Conversely, using comparative arguments, it is shown that if $\mathcal{R}_0$ is less than 1, the drug-free equilibrium is globally asymptotically stable. Furthermore, the article includes a series of numerical simulations to visually convey and support the analytical results.


title: Using covariance extension equation to solve the Nevanlinna-Pick interpolation with degree constraint

abstract: Nevanlinna-Pick interpolation problem has been widely studied in recent decades, however, the known algorithm is not simplistic and robust enough. This paper provide a new method to solve the Nevanlinna-Pick interpolation problem with degree constraint. It is based on the covariance extension equation proposed by Byrnes and Lindquist. A reformulation of the Nevanlinna-Pick interpolation problem is achieved and then solved by continuation method. This method need not calculate the initial value and a numerical example illustrates robustness and effciency of the proposed procedure


title: $K^-d\rightarrow\pi\Lambda N$ reaction with in-flight kaons for studying the $\Lambda N$ interaction

abstract: The $\Lambda N$ invariant mass spectra for the reactions $K^-d\rightarrow\pi^-\Lambda p$ and $K^-d\rightarrow\pi^0\Lambda n$ are calculated for experimental study of isospin symmetry breaking in the $\Lambda N$ scattering at low energies, the difference in the scattering lengths and effective ranges of $\Lambda p$ and $\Lambda n$ systems. The calculations are performed for in-flight kaons with a momentum of 1000 MeV/c, employing partial wave analysis up to the p-wave for meson-baryon amplitudes and the spin-flip term for baryon-baryon amplitudes. Kinematic selection is utilized to suppress the background processes, involving the angular selection of pions to the forward direction and selecting nucleons with higher momentum. It is worth noting that isospin symmetry breaking in the $\Lambda N$ system can be extracted from the observed deviations in that breaking in the $\Lambda N$ invariant mass spectra for the $K^-d\rightarrow\pi\Lambda N$ reaction.


title: Formulating human risk response in epidemic models: exogenous vs endogenous approaches

abstract: The recent pandemic emphasized the need to consider the role of human behavior in shaping epidemic dynamics. In particular, it is necessary to extend beyond the classical epidemiological structures to fully capture the interplay between the spread of disease and how people respond. Here, we focus on the challenge of incorporating change in human behavior in the form of "risk response" into compartmental epidemiological models, where humans adapt their actions in response to their perceived risk of becoming infected. The review examines over 40 compartmental models, categorizing them into two fundamentally distinct classes: exogenous and endogenous approaches to modeling risk response. While in exogenous approaches, human behavior is often included using different fixed parameter values for certain time periods, endogenous approaches seek for a mechanism internal to the model to explain changes in human behavior as a function of the state of disease. We further discuss two different formulations within endogenous models as implicit versus explicit representation of information diffusion. This comprehensive analysis provides modelers with guidance in selecting an appropriate framework for epidemic modeling.


title: A graph-space optimal transport FWI approach based on \kappa-generalized Gaussian distribution

abstract: The statistical basis for conventional full-waveform inversion (FWI) approaches is commonly associated with Gaussian statistics. However, errors are rarely Gaussian in non-linear problems like FWI. In this work, we investigate the portability of a new objective function for FWI applications based on the graph-space optimal transport and $\kappa$-generalized Gaussian probability distribution. In particular, we demonstrate that the proposed objective function is robust in mitigating two critical problems in FWI, which are associated with cycle skipping issues and non-Gaussian errors. The results reveal that our proposal can mitigate the negative influence of cycle-skipping ambiguity and non-Gaussian noises and reduce the computational runtime for computing the transport plan associated with the optimal transport theory.

categories: physics.geo-ph math.ST physics.comp-ph physics.data-an stat.AP stat.TH


title: Do Not Trust Power Management: Challenges and Hints for Securing Future Trusted Execution Environments

abstract: Over the past few years, several research groups have introduced innovative hardware designs for Trusted Execution Environments (TEEs), aiming to secure applications against potentially compromised privileged software, including the kernel. Since 2017, Tang et al. introduced a new class of software-enabled hardware attacks, which leverages energy management mechanisms. These attacks aim at bypassing TEE security guarantees and exposing sensitive information like cryptographic keys. They have increased in prevalence over the past few years. Despite that, current RISC-V TEE architectures have yet to incorporate them into their threat models. Proprietary implementations, such as Arm TrustZone and Intel SGX, embed countermeasures. However, these countermeasures are not viable in the long term and hinder the capabilities of energy management mechanisms. This article presents the first comprehensive knowledge survey of these attacks, along with an evaluation of literature countermeasures. Our analysis highlights a substantial security gap between assumed threat models and the actual ones, presenting considerable threats in modern systems-on-chip that can undermine even the security guarantees provided by TEEs. We advocate for the enhancement of the next generation of RISC-V TEEs to address these attacks within their threat models, and we believe this study will spur further community efforts in this direction.


title: $n\pi$ phase ambiguity of cosmic birefringence

abstract: We point out that the rotation angle $\beta$ of cosmic birefringence, which is a recently reported parity-violating signal in the cosmic microwave background (CMB), has a phase ambiguity of $n\pi \,(n\in\mathbb{Z})$. This ambiguity has a significant impact on the interpretation of the origin of cosmic birefringence. Assuming an axion-like particle as the origin of cosmic birefringence, this ambiguity can be partly broken by the anisotropic cosmic birefringence and the shape of the CMB angular power spectra. We also discuss constraints on $\beta$ from existing experimental results.


title: A generalized neural tangent kernel for surrogate gradient learning

abstract: State-of-the-art neural network training methods depend on the gradient of the network function. Therefore, they cannot be applied to networks whose activation functions do not have useful derivatives, such as binary and discrete-time spiking neural networks. To overcome this problem, the activation function's derivative is commonly substituted with a surrogate derivative, giving rise to surrogate gradient learning (SGL). This method works well in practice but lacks theoretical foundation. The neural tangent kernel (NTK) has proven successful in the analysis of gradient descent. Here, we provide a generalization of the NTK, which we call the surrogate gradient NTK, that enables the analysis of SGL. First, we study a naive extension of the NTK to activation functions with jumps, demonstrating that gradient descent for such activation functions is also ill-posed in the infinite-width limit. To address this problem, we generalize the NTK to gradient descent with surrogate derivatives, i.e., SGL. We carefully define this generalization and expand the existing key theorems on the NTK with mathematical rigor. Further, we illustrate our findings with numerical experiments. Finally, we numerically compare SGL in networks with sign activation function and finite width to kernel regression with the surrogate gradient NTK; the results confirm that the surrogate gradient NTK provides a good characterization of SGL.

categories: stat.ML cond-mat.dis-nn cs.LG math.PR q-bio.NC


title: Bundle Neural Networks for message diffusion on graphs

abstract: The dominant paradigm for learning on graph-structured data is message passing. Despite being a strong inductive bias, the local message passing mechanism suffers from pathological issues such as over-smoothing, over-squashing, and limited node-level expressivity. To address these limitations we propose Bundle Neural Networks (BuNN), a new type of GNN that operates via message diffusion over flat vector bundles - structures analogous to connections on Riemannian manifolds that augment the graph by assigning to each node a vector space and an orthogonal map. A BuNN layer evolves the features according to a diffusion-type partial differential equation. When discretized, BuNNs are a special case of Sheaf Neural Networks (SNNs), a recently proposed MPNN capable of mitigating over-smoothing. The continuous nature of message diffusion enables BuNNs to operate on larger scales of the graph and, therefore, to mitigate over-squashing. Finally, we prove that BuNN can approximate any feature transformation over nodes on any (potentially infinite) family of graphs given injective positional encodings, resulting in universal node-level expressivity. We support our theory via synthetic experiments and showcase the strong empirical performance of BuNNs over a range of real-world tasks, achieving state-of-the-art results on several standard benchmarks in transductive and inductive settings.


title: Learning Generalizable Human Motion Generator with Reinforcement Learning

abstract: Text-driven human motion generation, as one of the vital tasks in computer-aided content creation, has recently attracted increasing attention. While pioneering research has largely focused on improving numerical performance metrics on given datasets, practical applications reveal a common challenge: existing methods often overfit specific motion expressions in the training data, hindering their ability to generalize to novel descriptions like unseen combinations of motions. This limitation restricts their broader applicability. We argue that the aforementioned problem primarily arises from the scarcity of available motion-text pairs, given the many-to-many nature of text-driven motion generation. To tackle this problem, we formulate text-to-motion generation as a Markov decision process and present \textbf{InstructMotion}, which incorporate the trail and error paradigm in reinforcement learning for generalizable human motion generation. Leveraging contrastive pre-trained text and motion encoders, we delve into optimizing reward design to enable InstructMotion to operate effectively on both paired data, enhancing global semantic level text-motion alignment, and synthetic text-only data, facilitating better generalization to novel prompts without the need for ground-truth motion supervision. Extensive experiments on prevalent benchmarks and also our synthesized unpaired dataset demonstrate that the proposed InstructMotion achieves outstanding performance both quantitatively and qualitatively.


title: SATSense: Multi-Satellite Collaborative Framework for Spectrum Sensing

abstract: Low Earth Orbit satellite Internet has recently been deployed, providing worldwide service with non-terrestrial networks. With the large-scale deployment of both non-terrestrial and terrestrial networks, limited spectrum resources will not be allocated enough. Consequently, dynamic spectrum sharing is crucial for their coexistence in the same spectrum, where accurate spectrum sensing is essential. However, spectrum sensing in space is more challenging than in terrestrial networks due to variable channel conditions, making single-satellite sensing unstable. Therefore, we first attempt to design a collaborative sensing scheme utilizing diverse data from multiple satellites. However, it is non-trivial to achieve this collaboration due to heterogeneous channel quality, considerable raw sampling data, and packet loss. To address the above challenges, we first establish connections between the satellites by modeling their sensing data as a graph and devising a graph neural network-based algorithm to achieve effective spectrum sensing. Meanwhile, we establish a joint sub-Nyquist sampling and autoencoder data compression framework to reduce the amount of transmitted sensing data. Finally, we propose a contrastive learning-based mechanism compensates for missing packets. Extensive experiments demonstrate that our proposed strategy can achieve efficient spectrum sensing performance and outperform the conventional deep learning algorithm in spectrum sensing accuracy.


title: A tame vs. feral dichotomy for graph classes excluding an induced minor or induced topological minor

abstract: A minimal separator in a graph is an inclusion-minimal set of vertices that separates some fixed pair of nonadjacent vertices. A graph class is said to be tame if there exists a polynomial upper bound for the number of minimal separators of every graph in the class, and feral if it contains arbitrarily large graphs with exponentially many minimal separators. Building on recent works of Gartland and Lokshtanov [SODA 2023] and Gajarsk\'y, Jaffke, Lima, Novotn\'a, Pilipczuk, Rz\k{a}\.zewski, and Souza [arXiv, 2022], we show that every graph class defined by a single forbidden induced minor or induced topological minor is either tame or feral, and classify the two cases. This leads to new graph classes in which Maximum Weight Independent Set and many other problems are solvable in polynomial time. We complement the classification results with polynomial-time recognition algorithms for the maximal tame graph classes appearing in the obtained classifications.


title: Knowledge-enhanced Relation Graph and Task Sampling for Few-shot Molecular Property Prediction

abstract: Recently, few-shot molecular property prediction (FSMPP) has garnered increasing attention. Despite impressive breakthroughs achieved by existing methods, they often overlook the inherent many-to-many relationships between molecules and properties, which limits their performance. For instance, similar substructures of molecules can inspire the exploration of new compounds. Additionally, the relationships between properties can be quantified, with high-related properties providing more information in exploring the target property than those low-related. To this end, this paper proposes a novel meta-learning FSMPP framework (KRGTS), which comprises the Knowledge-enhanced Relation Graph module and the Task Sampling module. The knowledge-enhanced relation graph module constructs the molecule-property multi-relation graph (MPMRG) to capture the many-to-many relationships between molecules and properties. The task sampling module includes a meta-training task sampler and an auxiliary task sampler, responsible for scheduling the meta-training process and sampling high-related auxiliary tasks, respectively, thereby achieving efficient meta-knowledge learning and reducing noise introduction. Empirically, extensive experiments on five datasets demonstrate the superiority of KRGTS over a variety of state-of-the-art methods. The code is available in https://github.com/Vencent-Won/KRGTS-public.


title: Freya PAGE: First Optimal Time Complexity for Large-Scale Nonconvex Finite-Sum Optimization with Heterogeneous Asynchronous Computations

abstract: In practical distributed systems, workers are typically not homogeneous, and due to differences in hardware configurations and network conditions, can have highly varying processing times. We consider smooth nonconvex finite-sum (empirical risk minimization) problems in this setup and introduce a new parallel method, Freya PAGE, designed to handle arbitrarily heterogeneous and asynchronous computations. By being robust to "stragglers" and adaptively ignoring slow computations, Freya PAGE offers significantly improved time complexity guarantees compared to all previous methods, including Asynchronous SGD, Rennala SGD, SPIDER, and PAGE, while requiring weaker assumptions. The algorithm relies on novel generic stochastic gradient collection strategies with theoretical guarantees that can be of interest on their own, and may be used in the design of future optimization methods. Furthermore, we establish a lower bound for smooth nonconvex finite-sum problems in the asynchronous setup, providing a fundamental time complexity limit. This lower bound is tight and demonstrates the optimality of Freya PAGE in the large-scale regime, i.e., when $\sqrt{m} \geq n$, where $n$ is # of workers, and $m$ is # of data samples.