title: Analyzing leptonic decays of heavy quarkonia in covariant confined quark model

abstract: The leptonic decay widths of heavy quarkonia are complementary observables to the semileptonic decays of heavy mesons and provide additional insight into the possible lepton flavor universality breaking. We analyze the former in the framework of the covariant confined quark model, introducing a novel approach for the description of the radially excited quarkonia states, which is based on constituent quark mass running and the orthogonality of the states. We are able to describe the experimental observations by our approach within the Standard model, which does not support new physics explanations.


title: MKIDGen3: Energy-Resolving, Single-Photon-Counting MKID Readout on an RFSoC

abstract: Building large, cryogenic MKID arrays requires processing highly-multiplexed, wideband readout signals in real time; a task that has previously required large, heavy, and power-intensive custom electronics. In this work, we present the third-generation UVOIR MKID readout system (Gen3) which is capable of reading out twice as many detectors with a fifth the weight and power and an order of magnitude less volume and cost-per-pixel as compared to the previous system. Gen3 leverages the Xilinx RFSoC4x2 platform to read out 2048, 1 MHz MKID channels per board. The system takes a modern approach to FPGA design using Vitis High-Level Synthesis (HLS) to specify signal processing blocks in C/C++, Vivado ML Intelligent Design Runs (IDR) to inform implementation stragety and close timing, and Python Productivity for ZYNQ (PYNQ) to simplify interacting with and programming the FPGA using Python. This design suite and tool flow allows general users to contribute to and maintain the design and positions Gen3 to rapidly migrate to future platforms as they become available. In this work, we describe the system requirements, design, and implementation. We also provide performance characterization details and show that the system achieves detector-limited resolving power in the case of few readout tones and minimal degradation with all 2048 tones. Planned upgrades and future work are also discussed. The Gen3 MKID readout system is fully open-source and is expected to facilitate future array scaling to megapixel-sized formats and increase the feasibility of deploying UVOIR MKIDs in space.


title: Application of Natural Language Processing in Financial Risk Detection

abstract: This paper explores the application of Natural Language Processing (NLP) in financial risk detection. By constructing an NLP-based financial risk detection model, this study aims to identify and predict potential risks in financial documents and communications. First, the fundamental concepts of NLP and its theoretical foundation, including text mining methods, NLP model design principles, and machine learning algorithms, are introduced. Second, the process of text data preprocessing and feature extraction is described. Finally, the effectiveness and predictive performance of the model are validated through empirical research. The results show that the NLP-based financial risk detection model performs excellently in risk identification and prediction, providing effective risk management tools for financial institutions. This study offers valuable references for the field of financial risk management, utilizing advanced NLP techniques to improve the accuracy and efficiency of financial risk detection.


title: Exploration on $1n$ halo nucleus $^{19}$C from D-RHFB structure to reaction observables

abstract: We utilize the axially deformed relativistic Hartree-Fock-Bogoliubov (D-RHFB) model to describe the structure of neutron-rich carbon isotopes, taking into account the continuum, pairing correlations, tensor force and their interplay. In this scheme, one- and two-neutron separation energies of neutron-rich carbon isotopes agree well with measured data, as well as the spin and parity $J^\pi=1/2^+$ for the ground state of $^{19}$C, which is a long-standing problem for theoretical structure models. With the structure input extracted from the microscopic D-RHFB model, the reaction observables are well described the Glauber model. In particular, this unified approach accurately reproduces the inclusive longitudinal momentum distributions of the breakup reaction $^{19}$C + $^{12}$C at 240 MeV/nucleon, which rule out the possibility of the ground state of $^{19}$C being $J^\pi=3/2^+$. Moreover, the continuum plays a crucial role in the formation of the halo, which is further confirmed by the reaction cross sections and longitudinal momentum distributions. However, the tensor force components carried by the $\pi$-coupling are not as significant as anticipated. Consequently, the D-RHFB + Glauber approach turns out to be a promising tool to search for halo candidates from the structure to the reaction.


title: Language-Guided Manipulation with Diffusion Policies and Constrained Inpainting

abstract: Diffusion policies have demonstrated robust performance in generative modeling, prompting their application in robotic manipulation controlled via language descriptions. In this paper, we introduce a zero-shot, open-vocabulary diffusion policy method for robot manipulation. Using Vision-Language Models (VLMs), our method transforms linguistic task descriptions into actionable keyframes in 3D space. These keyframes serve to guide the diffusion process via inpainting. However, naively enforcing the diffusion process to adhere to the generated keyframes is problematic: the keyframes from the VLMs may be incorrect and lead to out-of-distribution (OOD) action sequences where the diffusion model performs poorly. To address these challenges, we develop an inpainting optimization strategy that balances adherence to the keyframes v.s. the training data distribution. Experimental evaluations demonstrate that our approach surpasses the performance of traditional fine-tuned language-conditioned methods in both simulated and real-world settings.


title: Bayesian Conditioned Diffusion Models for Inverse Problems

abstract: Diffusion models have recently been shown to excel in many image reconstruction tasks that involve inverse problems based on a forward measurement operator. A common framework uses task-agnostic unconditional models that are later post-conditioned for reconstruction, an approach that typically suffers from suboptimal task performance. While task-specific conditional models have also been proposed, current methods heuristically inject measured data as a naive input channel that elicits sampling inaccuracies. Here, we address the optimal conditioning of diffusion models for solving challenging inverse problems that arise during image reconstruction. Specifically, we propose a novel Bayesian conditioning technique for diffusion models, BCDM, based on score-functions associated with the conditional distribution of desired images given measured data. We rigorously derive the theory to express and train the conditional score-function. Finally, we show state-of-the-art performance in image dealiasing, deblurring, super-resolution, and inpainting with the proposed technique.


title: Approximate Contraction of Arbitrary Tensor Networks with a Flexible and Efficient Density Matrix Algorithm

abstract: Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate tensor generated during the contractions is approximated as a low-rank binary tree tensor network. The proposed algorithm has the flexibility to incorporate a large portion of the environment when performing low-rank approximations, which can lead to high accuracy for a given rank. Here, the environment refers to the remaining set of tensors in the network, and low-rank approximations with larger environments can generally provide higher accuracy. For contracting tensor networks defined on lattices, the proposed algorithm can be viewed as a generalization of the standard boundary-based algorithms. In addition, the algorithm includes a cost-efficient density matrix algorithm for approximating a tensor network with a general graph structure into a tree structure, whose computational cost is asymptotically upper-bounded by that of the standard algorithm that uses canonicalization. Experimental results indicate that the proposed technique outperforms previously proposed approximate tensor network contraction algorithms for multiple problems in terms of both accuracy and efficiency.


title: Towards Efficient Pareto Set Approximation via Mixture of Experts Based Model Fusion

abstract: Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front approximation of large models enables multi-objective optimization for various tasks such as multi-task learning and trade-off analysis. Existing algorithms for learning Pareto set, including (1) evolutionary, hypernetworks, and hypervolume-maximization methods, are computationally expensive and have restricted scalability to large models; (2) Scalarization algorithms, where a separate model is trained for each objective ray, which is inefficient for learning the entire Pareto set and fails to capture the objective trade-offs effectively. Inspired by the recent success of model merging, we propose a practical and scalable approach to Pareto set learning problem via mixture of experts (MoE) based model fusion. By ensembling the weights of specialized single-task models, the MoE module can effectively capture the trade-offs between multiple objectives and closely approximate the entire Pareto set of large neural networks. Once the routers are learned and a preference vector is set, the MoE module can be unloaded, thus no additional computational cost is introduced during inference. We conduct extensive experiments on vision and language tasks using large-scale models such as CLIP-ViT and GPT-2. The experimental results demonstrate that our method efficiently approximates the entire Pareto front of large models. Using only hundreds of trainable parameters of the MoE routers, our method even has lower memory usage compared to linear scalarization and algorithms that learn a single Pareto optimal solution, and are scalable to both the number of objectives and the size of the model.


title: Block Coordinate Descent Methods for Optimization under J-Orthogonality Constraints with Applications

abstract: The J-orthogonal matrix, also referred to as the hyperbolic orthogonal matrix, is a class of special orthogonal matrix in hyperbolic space, notable for its advantageous properties. These matrices are integral to optimization under J-orthogonal constraints, which have widespread applications in statistical learning and data science. However, addressing these problems is generally challenging due to their non-convex nature and the computational intensity of the constraints. Currently, algorithms for tackling these challenges are limited. This paper introduces JOBCD, a novel Block Coordinate Descent method designed to address optimizations with J-orthogonality constraints. We explore two specific variants of JOBCD: one based on a Gauss-Seidel strategy (GS-JOBCD), the other on a variance-reduced and Jacobi strategy (VR-J-JOBCD). Notably, leveraging the parallel framework of a Jacobi strategy, VR-J-JOBCD integrates variance reduction techniques to decrease oracle complexity in the minimization of finite-sum functions. For both GS-JOBCD and VR-J-JOBCD, we establish the oracle complexity under mild conditions and strong limit-point convergence results under the Kurdyka-Lojasiewicz inequality. To demonstrate the effectiveness of our method, we conduct experiments on hyperbolic eigenvalue problems, hyperbolic structural probe problems, and the ultrahyperbolic knowledge graph embedding problem. Extensive experiments using both real-world and synthetic data demonstrate that JOBCD consistently outperforms state-of-the-art solutions, by large margins.


title: Accelerated Over-Relaxation Heavy-Ball Methods with Provable Acceleration and Global Convergence

abstract: The heavy-ball momentum method has gained widespread popularity for accelerating gradient descent by incorporating a momentum term. Recent studies have conclusively shown that the heavy-ball method cannot achieve an accelerated convergence rate for general smooth strongly convex optimization problems. This work introduces the Accelerated Over-Relaxation Heavy-Ball (AOR-HB) method, a novel approach that represents the first heavy-ball method to demonstrate provable global and accelerated convergence for smooth strongly convex optimization. The key innovation of the AOR-HB method lies in the application of an over-relaxation technique to the gradient term. This novel approach enables the method to be applied to min-max problems and meet optimal lower complexity bounds. This breakthrough addresses a long-standing theoretical gap in heavy-ball momentum methods and paves the way for developing accelerated methods that transcend the boundaries of convex optimization to non-convex optimization. Numerical experiments validate the effectiveness of the proposed algorithms, with their performance matching that of other leading first-order optimization methods.


title: Research on Edge Detection of LiDAR Images Based on Artificial Intelligence Technology

abstract: With the widespread application of Light Detection and Ranging (LiDAR) technology in fields such as autonomous driving, robot navigation, and terrain mapping, the importance of edge detection in LiDAR images has become increasingly prominent. Traditional edge detection methods often face challenges in accuracy and computational complexity when processing LiDAR images. To address these issues, this study proposes an edge detection method for LiDAR images based on artificial intelligence technology. This paper first reviews the current state of research on LiDAR technology and image edge detection, introducing common edge detection algorithms and their applications in LiDAR image processing. Subsequently, a deep learning-based edge detection model is designed and implemented, optimizing the model training process through preprocessing and enhancement of the LiDAR image dataset. Experimental results indicate that the proposed method outperforms traditional methods in terms of detection accuracy and computational efficiency, showing significant practical application value. Finally, improvement strategies are proposed for the current method's shortcomings, and the improvements are validated through experiments.


title: A lightweight residual network for unsupervised deformable image registration

abstract: Accurate volumetric image registration is highly relevant for clinical routines and computer-aided medical diagnosis. Recently, researchers have begun to use transformers in learning-based methods for medical image registration, and have achieved remarkable success. Due to the strong global modeling capability, Transformers are considered a better option than convolutional neural networks (CNNs) for registration. However, they use bulky models with huge parameter sets, which require high computation edge devices for deployment as portable devices or in hospitals. Transformers also need a large amount of training data to produce significant results, and it is often challenging to collect suitable annotated data. Although existing CNN-based image registration can offer rich local information, their global modeling capability is poor for handling long-distance information interaction and limits registration performance. In this work, we propose a CNN-based registration method with an enhanced receptive field, a low number of parameters, and significant results on a limited training dataset. For this, we propose a residual U-Net with embedded parallel dilated-convolutional blocks to enhance the receptive field. The proposed method is evaluated on inter-patient and atlas-based datasets. We show that the performance of the proposed method is comparable and slightly better than transformer-based methods by using only $\SI{1.5}{\percent}$ of its number of parameters.


title: A semi-implicit stochastic multiscale method for radiative heat transfer problem

abstract: In this paper, we propose and analyze a new semi-implicit stochastic multiscale method for the radiative heat transfer problem with additive noise fluctuation in composite materials. In the proposed method, the strong nonlinearity term induced by heat radiation is first approximated, by a semi-implicit predictor-corrected numerical scheme, for each fixed time step, resulting in a spatially random multiscale heat transfer equation. Then, the infinite-dimensional stochastic processes are modeled and truncated using a complete orthogonal system, facilitating the reduction of the model's dimensionality in the random space. The resulting low-rank random multiscale heat transfer equation is approximated and computed by using efficient spatial basis functions based multiscale method. The main advantage of the proposed method is that it separates the computational difficulty caused by the spatial multiscale properties, the high-dimensional randomness and the strong nonlinearity of the solution, so they can be overcome separately using different strategies. The convergence analysis is carried out, and the optimal rate of convergence is also obtained for the proposed semi-implicit stochastic multiscale method. Numerical experiments on several test problems for composite materials with various microstructures are also presented to gauge the efficiency and accuracy of the proposed semi-implicit stochastic multiscale method.


title: Faster Convergence on Heterogeneous Federated Edge Learning: An Adaptive Sidelink-Assisted Data Multicasting Approach

abstract: Federated Edge Learning (FEEL) emerges as a pioneering distributed machine learning paradigm for the 6G Hyper-Connectivity, harnessing data from the Internet of Things (IoT) devices while upholding data privacy. However, current FEEL algorithms struggle with non-independent and non-identically distributed (non-IID) data, leading to elevated communication costs and compromised model accuracy. To address these statistical imbalances within FEEL, we introduce a clustered data sharing framework, mitigating data heterogeneity by selectively sharing partial data from cluster heads to trusted associates through sidelink-aided multicasting. The collective communication pattern is integral to FEEL training, where both cluster formation and the efficiency of communication and computation impact training latency and accuracy simultaneously. To tackle the strictly coupled data sharing and resource optimization, we decompose the overall optimization problem into the clients clustering and effective data sharing subproblems. Specifically, a distribution-based adaptive clustering algorithm (DACA) is devised basing on three deductive cluster forming conditions, which ensures the maximum sharing yield. Meanwhile, we design a stochastic optimization based joint computed frequency and shared data volume optimization (JFVO) algorithm, determining the optimal resource allocation with an uncertain objective function. The experiments show that the proposed framework facilitates FEEL on non-IID datasets with faster convergence rate and higher model accuracy in a limited communication environment.


title: Road to Serenity: Individual Variations in the Efficacy of Unobtrusive Respiratory Guidance for Driving Stress Regulation

abstract: Stress impacts driving-related cognitive functions like attention and decision-making, and may arise in automated vehicles due to non-driving tasks. Unobtrusive relaxation techniques are needed to regulate stress without distracting from driving. Tactile wearables have shown efficacy in stress regulation through respiratory guidance, but individual variations may affect their efficacy. This study assessed slow-breathing tactile guidance under different stress levels on 85 participants. Physiological, behavioral and subjective data were collected. The influence of individual variations (e.g., driving habits and behavior, personality) using logistic regression analysis was explored. Participants could follow the guidance and adjust breathing while driving, but subjective efficacy depended on individual variations linked to different efficiency in using the technique, in relation with its attentional cost. An influence of factors linked to the evaluation of context criticality was also found. The results suggest that considering individual and contextual variations is crucial in designing and using such techniques in demanding driving contexts. In this line some design recommendations and insights for further studies are provided.


title: Small Solutions of generic ternary quadratic congruences

abstract: We consider small solutions of quadratic congruences of the form $x_1^2+\alpha_2x_2^2+\alpha_3x_3^2\equiv 0 \bmod{q}$, where $q=p^m$ is an odd prime power. Here, $\alpha_2$ is arbitrary but fixed and $\alpha_3$ is variable, and we assume that $(\alpha_2\alpha_3,p)=1$. We show that for all $\alpha_3$ modulo $p^m$ which are coprime to $p$ except for a small number of $\alpha_3$'s, an asymptotic formula for the number of solutions $(x_1,x_2,x_3)$ to the congruence $x_1^2+\alpha_2x_2^2+\alpha_3x_3^2\equiv 0 \bmod{q}$ with $\max\{|x_1|,|x_2|,|x_3|\}\le N$ holds if $N\ge q^{11/24+\varepsilon}$ and $q$ is large enough. It is of significance that we break the barrier 1/2 in the above exponent. If $q$ is restricted to powers of a fixed prime $p$, we obtain a slight improvement of this result using the theory of $p$-adic exponent pairs, as developed by Mili\'cevi\'c, replacing the exponent $11/24$ above by $11/25$. Under the Lindel\"of hypothesis for Dirichlet $L$-functions, we are able to replace the exponent $11/24$ above by $1/3$.


title: OSPC: Detecting Harmful Memes with Large Language Model as a Catalyst

abstract: Memes, which rapidly disseminate personal opinions and positions across the internet, also pose significant challenges in propagating social bias and prejudice. This study presents a novel approach to detecting harmful memes, particularly within the multicultural and multilingual context of Singapore. Our methodology integrates image captioning, Optical Character Recognition (OCR), and Large Language Model (LLM) analysis to comprehensively understand and classify harmful memes. Utilizing the BLIP model for image captioning, PP-OCR and TrOCR for text recognition across multiple languages, and the Qwen LLM for nuanced language understanding, our system is capable of identifying harmful content in memes created in English, Chinese, Malay, and Tamil. To enhance the system's performance, we fine-tuned our approach by leveraging additional data labeled using GPT-4V, aiming to distill the understanding capability of GPT-4V for harmful memes to our system. Our framework achieves top-1 at the public leaderboard of the Online Safety Prize Challenge hosted by AI Singapore, with the AUROC as 0.7749 and accuracy as 0.7087, significantly ahead of the other teams. Notably, our approach outperforms previous benchmarks, with FLAVA achieving an AUROC of 0.5695 and VisualBERT an AUROC of 0.5561.


title: Impact of Measurement Noise on Escaping Saddles in Variational Quantum Algorithms

abstract: Stochastic gradient descent (SGD) is a frequently used optimization technique in classical machine learning and Variational Quantum Eigensolver (VQE). For the implementation of VQE on quantum hardware, the results are always affected by measurement shot noise. However, there are many unknowns about the structure and properties of the measurement noise in VQE and how it contributes to the optimization. In this work, we analyze the effect of measurement noise to the optimization dynamics. Especially, we focus on escaping from saddle points in the loss landscape, which is crucial in the minimization of the non-convex loss function. We find that the escape time (1) decreases as the measurement noise increases in a power-law fashion and (2) is expressed as a function of $\eta/N_s$ where $\eta$ is the learning rate and $N_s$ is the number of measurements. The latter means that the escape time is approximately constant when we vary $\eta$ and $N_s$ with the ratio $\eta/N_s$ held fixed. This scaling behavior is well explained by the stochastic differential equation (SDE) that is obtained by the continuous-time approximation of the discrete-time SGD. According to the SDE, $\eta/N_s$ is interpreted as the variance of measurement shot noise. This result tells us that we can learn about the optimization dynamics in VQE from the analysis based on the continuous-time SDE, which is theoretically simpler than the original discrete-time SGD.


title: GPT-4o: Visual perception performance of multimodal large language models in piglet activity understanding

abstract: Animal ethology is an crucial aspect of animal research, and animal behavior labeling is the foundation for studying animal behavior. This process typically involves labeling video clips with behavioral semantic tags, a task that is complex, subjective, and multimodal. With the rapid development of multimodal large language models(LLMs), new application have emerged for animal behavior understanding tasks in livestock scenarios. This study evaluates the visual perception capabilities of multimodal LLMs in animal activity recognition. To achieve this, we created piglet test data comprising close-up video clips of individual piglets and annotated full-shot video clips. These data were used to assess the performance of four multimodal LLMs-Video-LLaMA, MiniGPT4-Video, Video-Chat2, and GPT-4 omni (GPT-4o)-in piglet activity understanding. Through comprehensive evaluation across five dimensions, including counting, actor referring, semantic correspondence, time perception, and robustness, we found that while current multimodal LLMs require improvement in semantic correspondence and time perception, they have initially demonstrated visual perception capabilities for animal activity recognition. Notably, GPT-4o showed outstanding performance, with Video-Chat2 and GPT-4o exhibiting significantly better semantic correspondence and time perception in close-up video clips compared to full-shot clips. The initial evaluation experiments in this study validate the potential of multimodal large language models in livestock scene video understanding and provide new directions and references for future research on animal behavior video understanding. Furthermore, by deeply exploring the influence of visual prompts on multimodal large language models, we expect to enhance the accuracy and efficiency of animal behavior recognition in livestock scenarios through human visual processing methods.


title: Unsupervised Monocular Depth Estimation Based on Hierarchical Feature-Guided Diffusion

abstract: Unsupervised monocular depth estimation has received widespread attention because of its capability to train without ground truth. In real-world scenarios, the images may be blurry or noisy due to the influence of weather conditions and inherent limitations of the camera. Therefore, it is particularly important to develop a robust depth estimation model. Benefiting from the training strategies of generative networks, generative-based methods often exhibit enhanced robustness. In light of this, we employ a well-converging diffusion model among generative networks for unsupervised monocular depth estimation. Additionally, we propose a hierarchical feature-guided denoising module. This model significantly enriches the model's capacity for learning and interpreting depth distribution by fully leveraging image features to guide the denoising process. Furthermore, we explore the implicit depth within reprojection and design an implicit depth consistency loss. This loss function serves to enhance the performance of the model and ensure the scale consistency of depth within a video sequence. We conduct experiments on the KITTI, Make3D, and our self-collected SIMIT datasets. The results indicate that our approach stands out among generative-based models, while also showcasing remarkable robustness.


title: Implementing a Machine Learning Deformer for CG Crowds: Our Journey

abstract: CG crowds have become increasingly popular this last decade in the VFX and animation industry: formerly reserved to only a few high end studios and blockbusters, they are now widely used in TV shows or commercials. Yet, there is still one major limitation: in order to be ingested properly in crowd software, studio rigs have to comply with specific prerequisites, especially in terms of deformations. Usually only skinning, blend shapes and geometry caches are supported preventing close-up shots with facial performances on crowd characters. We envisioned two approaches to tackle this: either reverse engineer the hundreds of deformer nodes available in the major DCCs/plugins and incorporate them in our crowd package, or surf the machine learning wave to compress the deformations of a rig using a neural network architecture. Considering we could not commit 5+ man/years of development into this problem, and that we were excited to dip our toes in the machine learning pool, we went for the latter. From our first tests to a minimum viable product, we went through hopes and disappointments: we hit multiple pitfalls, took false shortcuts and dead ends before reaching our destination. With this paper, we hope to provide a valuable feedback by sharing the lessons we learnt from this experience.


title: A splitting theorem for manifolds with a convex boundary component

abstract: We prove a warped product splitting theorem for manifolds with Ricci curvature bounded from below in the spirit of [Croke-Kleiner, \emph{Duke Math.\;J}.\;(1992)], but instead of asking that one boundary component is compact and mean convex, we require that it is parabolic and convex. The parabolicity assumption cannot be dropped as, otherwise, the catenoid in ambient dimension four would give a counterexample. The result is an application of recently developed tools in synthetic geometry.


title: Diffusiophoretic Brownian dynamics: characterization of hydrodynamic effects for an active chemoattractive polymer

abstract: The phoretic Brownian dynamics method is shown here to be an effective approach to simulate the properties of colloidal chemophoretic based systems. The method is then optimized to allow for the comparison with results from multiparticle collision dynamics, a hydrodynamic method with explicit solvent, which can also be employed in the case of chemoattractive polymers. In order to obtain a good match of the conformational equilibrium properties of the models without and with explicit solvent, we propose a modified version of the phoretic Brownian dynamics accounting for the explicit solvent induced swelling. In the presence of activity, chemoattractive polymers show a transition to a compact globular state and hydrodynamics have a non-trivial influence in the polymer collapse times. The phoretic Brownian method can then be applied to much longer polymers, which allows the observation of a non-monotonous growth of both, the radius of gyration and the relaxation time with polymer length, for such chemoattractive active polymers.


title: Convergence analysis of a regularized Newton method with generalized regularization terms for convex optimization problems

abstract: In this paper, we present a regularized Newton method (RNM) with generalized regularization terms for an unconstrained convex optimization problem. The generalized regularization includes the quadratic, cubic, and elastic net regularization as a special case. Therefore, the proposed method is a general framework that includes not only the classical and cubic RNMs but also a novel RNM with the elastic net. We show that the proposed RNM has the global $\mathcal{O}(k^{-2})$ and local superlinear convergence, which are the same as those of the cubic RNM.


title: Evolving Self-Assembling Neural Networks: From Spontaneous Activity to Experience-Dependent Learning

abstract: Biological neural networks are characterized by their high degree of plasticity, a core property that enables the remarkable adaptability of natural organisms. Importantly, this ability affects both the synaptic strength and the topology of the nervous systems. Artificial neural networks, on the other hand, have been mainly designed as static, fully connected structures that can be notoriously brittle in the face of changing environments and novel inputs. Building on previous works on Neural Developmental Programs (NDPs), we propose a class of self-organizing neural networks capable of synaptic and structural plasticity in an activity and reward-dependent manner which we call Lifelong Neural Developmental Program (LNDP). We present an instance of such a network built on the graph transformer architecture and propose a mechanism for pre-experience plasticity based on the spontaneous activity of sensory neurons. Our results demonstrate the ability of the model to learn from experiences in different control tasks starting from randomly connected or empty networks. We further show that structural plasticity is advantageous in environments necessitating fast adaptation or with non-stationary rewards.


title: OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanics

abstract: Pose estimation has promised to impact healthcare by enabling more practical methods to quantify nuances of human movement and biomechanics. However, despite the inherent connection between pose estimation and biomechanics, these disciplines have largely remained disparate. For example, most current pose estimation benchmarks use metrics such as Mean Per Joint Position Error, Percentage of Correct Keypoints, or mean Average Precision to assess performance, without quantifying kinematic and physiological correctness - key aspects for biomechanics. To alleviate this challenge, we develop OpenCapBench to offer an easy-to-use unified benchmark to assess common tasks in human pose estimation, evaluated under physiological constraints. OpenCapBench computes consistent kinematic metrics through joints angles provided by an open-source musculoskeletal modeling software (OpenSim). Through OpenCapBench, we demonstrate that current pose estimation models use keypoints that are too sparse for accurate biomechanics analysis. To mitigate this challenge, we introduce SynthPose, a new approach that enables finetuning of pre-trained 2D human pose models to predict an arbitrarily denser set of keypoints for accurate kinematic analysis through the use of synthetic data. Incorporating such finetuning on synthetic data of prior models leads to twofold reduced joint angle errors. Moreover, OpenCapBench allows users to benchmark their own developed models on our clinically relevant cohort. Overall, OpenCapBench bridges the computer vision and biomechanics communities, aiming to drive simultaneous advances in both areas.


title: Localized subspace iteration methods for elliptic multiscale problems

abstract: This paper proposes localized subspace iteration (LSI) methods to construct generalized finite element basis functions for elliptic problems with multiscale coefficients. The key components of the proposed method consist of the localization of the original differential operator and the subspace iteration of the corresponding local spectral problems, where the localization is conducted by enforcing the local homogeneous Dirichlet condition and the partition of the unity functions. From a novel perspective, some multiscale methods can be regarded as one iteration step under approximating the eigenspace of the corresponding local spectral problems. Vice versa, new multiscale methods can be designed through subspaces of spectral problem algorithms. Then, we propose the efficient localized standard subspace iteration (LSSI) method and the localized Krylov subspace iteration (LKSI) method based on the standard subspace and Krylov subspace, respectively. Convergence analysis is carried out for the proposed method. Various numerical examples demonstrate the effectiveness of our methods. In addition, the proposed methods show significant superiority in treating long-channel cases over other well-known multiscale methods.


title: Pcc-tuning: Breaking the Contrastive Learning Ceiling in Semantic Textual Similarity

abstract: Semantic Textual Similarity (STS) constitutes a critical research direction in computational linguistics and serves as a key indicator of the encoding capabilities of embedding models. Driven by advances in pre-trained language models and contrastive learning techniques, leading sentence representation methods can already achieved average Spearman's correlation scores of approximately 86 across seven STS benchmarks in SentEval. However, further improvements have become increasingly marginal, with no existing method attaining an average score higher than 87 on these tasks. This paper conducts an in-depth analysis of this phenomenon and concludes that the upper limit for Spearman's correlation scores using contrastive learning is 87.5. To transcend this ceiling, we propose an innovative approach termed Pcc-tuning, which employs Pearson's correlation coefficient as a loss function to refine model performance beyond contrastive learning. Experimental results demonstrate that Pcc-tuning markedly surpasses previous state-of-the-art strategies, raising the Spearman's correlation score to above 90.


title: Semi-Blind Multi-Tag Ambient Backscatter Communications Using Radar Signals

abstract: In this work, we consider a backscatter communication system wherein multiple asynchronous sources (tags) exploit the reverberation generated by a nearby radar transmitter as an ambient carrier to deliver a message to a common destination (reader) through a number of available subchannels. We propose a new encoding strategy wherein each tag transmits both pilot and data symbols on each subchannel and repeats some of the data symbols on multiple subchannels. We then exploit this signal structure to derive two semi-blind iterative algorithms for joint estimation of the data symbols and the subchannel responses that are also able to handle some missing measurements. The proposed encoding/decoding strategies are scalable with the number of tags and their payload and can achieve different tradeoffs in terms of transmission and error rates. Some numerical examples are provided to illustrate the merits of the proposed solutions.


title: A Two-Stage Masked Autoencoder Based Network for Indoor Depth Completion

abstract: Depth images have a wide range of applications, such as 3D reconstruction, autonomous driving, augmented reality, robot navigation, and scene understanding. Commodity-grade depth cameras are hard to sense depth for bright, glossy, transparent, and distant surfaces. Although existing depth completion methods have achieved remarkable progress, their performance is limited when applied to complex indoor scenarios. To address these problems, we propose a two-step Transformer-based network for indoor depth completion. Unlike existing depth completion approaches, we adopt a self-supervision pre-training encoder based on the masked autoencoder to learn an effective latent representation for the missing depth value; then we propose a decoder based on a token fusion mechanism to complete (i.e., reconstruct) the full depth from the jointly RGB and incomplete depth image. Compared to the existing methods, our proposed network, achieves the state-of-the-art performance on the Matterport3D dataset. In addition, to validate the importance of the depth completion task, we apply our methods to indoor 3D reconstruction. The code, dataset, and demo are available at https://github.com/kailaisun/Indoor-Depth-Completion.


title: Hyperbolic entropy for harmonic measures on singular holomorphic foliations

abstract: Let $\mathscr{F}=(M,\mathscr{L},E)$ be a Brody-hyperbolic singular holomorphic foliation on a compact complex manifold $M$. Suppose that $\mathscr{F}$ has isolated singularities and that its Poincar\'e metric is complete. This is the case for a very large class of singularities, namely, non-degenerate and saddle-nodes in dimension $2$. Let $\mu$ be an ergodic harmonic measure on $\mathscr{F}$. We show that the upper and lower local hyperbolic entropies of $\mu$ are leafwise constant almost everywhere. Moreover, we show that the entropy of $\mu$ is at least $2$.


title: SuperSVG: Superpixel-based Scalable Vector Graphics Synthesis

abstract: SVG (Scalable Vector Graphics) is a widely used graphics format that possesses excellent scalability and editability. Image vectorization, which aims to convert raster images to SVGs, is an important yet challenging problem in computer vision and graphics. Existing image vectorization methods either suffer from low reconstruction accuracy for complex images or require long computation time. To address this issue, we propose SuperSVG, a superpixel-based vectorization model that achieves fast and high-precision image vectorization. Specifically, we decompose the input image into superpixels to help the model focus on areas with similar colors and textures. Then, we propose a two-stage self-training framework, where a coarse-stage model is employed to reconstruct the main structure and a refinement-stage model is used for enriching the details. Moreover, we propose a novel dynamic path warping loss to help the refinement-stage model to inherit knowledge from the coarse-stage model. Extensive qualitative and quantitative experiments demonstrate the superior performance of our method in terms of reconstruction accuracy and inference time compared to state-of-the-art approaches. The code is available in \url{https://github.com/sjtuplayer/SuperSVG}.


title: DeltaPhi: Learning Physical Trajectory Residual for PDE Solving

abstract: Although neural operator networks theoretically approximate any operator mapping, the limited generalization capability prevents them from learning correct physical dynamics when potential data biases exist, particularly in the practical PDE solving scenario where the available data amount is restricted or the resolution is extremely low. To address this issue, we propose and formulate the Physical Trajectory Residual Learning (DeltaPhi), which learns to predict the physical residuals between the pending solved trajectory and a known similar auxiliary trajectory. First, we transform the direct operator mapping between input-output function fields in original training data to residual operator mapping between input function pairs and output function residuals. Next, we learn the surrogate model for the residual operator mapping based on existing neural operator networks. Additionally, we design helpful customized auxiliary inputs for efficient optimization. Through extensive experiments, we conclude that, compared to direct learning, physical residual learning is preferred for PDE solving.


title: Trivial zeros of Riemann auxiliary function

abstract: It is proved that $s=-2n$ is a simple zero of $\mathop{\mathcal R}(s)$ for each integer $n\ge1$. Here $\mathop{\mathcal R}(s)$ is the function found by Siegel in Riemann's posthumous papers.


title: Loop unitary and phase band topological invariant in generic multi-band Chern insulators

abstract: Quench dynamics of topological phases have been studied in the past few years and dynamical topological invariants are formulated in different ways. Yet most of these invariants are limited to minimal systems in which Hamiltonians are expanded by Gamma matrices. Here we generalize the dynamical 3-winding-number in two-band systems into the one in generic multi-band Chern insulators and prove that its value is equal to the difference of Chern numbers between post-quench and pre-quench Hamiltonians. Moreover we obtain an expression of this dynamical 3-winding-number represented by gapless fermions in phase bands depending only on the phase and its projectors, so it is generic for the quench of all multi-band Chern insulators. Besides, we obtain a multifold fermion in the phase band in (k, t) space by quenching a three-band model, which cannot happen for two band models.


title: Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigation

abstract: Vision-and-language navigation (VLN) enables the agent to navigate to a remote location in 3D environments following the natural language instruction. In this field, the agent is usually trained and evaluated in the navigation simulators, lacking effective approaches for sim-to-real transfer. The VLN agents with only a monocular camera exhibit extremely limited performance, while the mainstream VLN models trained with panoramic observation, perform better but are difficult to deploy on most monocular robots. For this case, we propose a sim-to-real transfer approach to endow the monocular robots with panoramic traversability perception and panoramic semantic understanding, thus smoothly transferring the high-performance panoramic VLN models to the common monocular robots. In this work, the semantic traversable map is proposed to predict agent-centric navigable waypoints, and the novel view representations of these navigable waypoints are predicted through the 3D feature fields. These methods broaden the limited field of view of the monocular robots and significantly improve navigation performance in the real world. Our VLN system outperforms previous SOTA monocular VLN methods in R2R-CE and RxR-CE benchmarks within the simulation environments and is also validated in real-world environments, providing a practical and high-performance solution for real-world VLN.


title: GeoSEE: Regional Socio-Economic Estimation With a Large Language Model

abstract: Moving beyond traditional surveys, combining heterogeneous data sources with AI-driven inference models brings new opportunities to measure socio-economic conditions, such as poverty and population, over expansive geographic areas. The current research presents GeoSEE, a method that can estimate various socio-economic indicators using a unified pipeline powered by a large language model (LLM). Presented with a diverse set of information modules, including those pre-constructed from satellite imagery, GeoSEE selects which modules to use in estimation, for each indicator and country. This selection is guided by the LLM's prior socio-geographic knowledge, which functions similarly to the insights of a domain expert. The system then computes target indicators via in-context learning after aggregating results from selected modules in the format of natural language-based texts. Comprehensive evaluation across countries at various stages of development reveals that our method outperforms other predictive models in both unsupervised and low-shot contexts. This reliable performance under data-scarce setting in under-developed or developing countries, combined with its cost-effectiveness, underscores its potential to continuously support and monitor the progress of Sustainable Development Goals, such as poverty alleviation and equitable growth, on a global scale.


title: R-matrix presentation of quantum affine superalgebra for type $\mathfrak{osp}(2m+1|2n)$

abstract: In the current paper, we extend our prior research [X. Wu, H. Lin and H. Zhang, Braid group action and quantum affine superalgebra for type $\mathfrak{osp}(2m+1|2n)$. Preprint, (2024)], which introduced the Drinfeld presentation of the quantum affine superalgebra associated with the orthosymplectic Lie superalgebra $\mathfrak{osp}$ $(2m+1|2n)$ for $m>0$. Based on this work, our present investigation focuses on its R-matrix presentation. Moreover, we establish an explicit isomorphism between the R-matrix presentation and the Drinfeld presentation. In particular, our contribution extends the investigations of Jing, Liu, and Molev concerning quantum affine algebra in type BCD to the domain of supersymmetry [arXiv:1903.00204; arXiv:1911.03496].


title: RaNeuS: Ray-adaptive Neural Surface Reconstruction

abstract: Our objective is to leverage a differentiable radiance field \eg NeRF to reconstruct detailed 3D surfaces in addition to producing the standard novel view renderings. There have been related methods that perform such tasks, usually by utilizing a signed distance field (SDF). However, the state-of-the-art approaches still fail to correctly reconstruct the small-scale details, such as the leaves, ropes, and textile surfaces. Considering that different methods formulate and optimize the projection from SDF to radiance field with a globally constant Eikonal regularization, we improve with a ray-wise weighting factor to prioritize the rendering and zero-crossing surface fitting on top of establishing a perfect SDF. We propose to adaptively adjust the regularization on the signed distance field so that unsatisfying rendering rays won't enforce strong Eikonal regularization which is ineffective, and allow the gradients from regions with well-learned radiance to effectively back-propagated to the SDF. Consequently, balancing the two objectives in order to generate accurate and detailed surfaces. Additionally, concerning whether there is a geometric bias between the zero-crossing surface in SDF and rendering points in the radiance field, the projection becomes adjustable as well depending on different 3D locations during optimization. Our proposed \textit{RaNeuS} are extensively evaluated on both synthetic and real datasets, achieving state-of-the-art results on both novel view synthesis and geometric reconstruction.


title: Simulating the Escaping Atmosphere of GJ 436 b with Two-fluid Magnetohydrodynamic Models

abstract: Observations of transmission spectra reveal that hot Jupiters and Neptunes are likely to possess escaping atmospheres driven by stellar radiation. Numerous models predict that magnetic fields may exert significant influences on the atmospheres of hot planets. Generally, the escaping atmospheres are not entirely ionized, and magnetic fields only directly affect the escape of ionized components within them. Considering the chemical reactions between ionized components and neutral atoms, as well as collision processes, magnetic fields indirectly impact the escape of neutral atoms, thereby influencing the detection signals of planetary atmospheres in transmission spectra. In order to simulate this process, we developed a magneto-hydrodynamic multi-fluid model based on MHD code PLUTO. As an initial exploration, we investigated the impact of magnetic fields on the decoupling of H$^+$ and H in the escaping atmosphere of the hot Neptune GJ436 b. Due to the strong resonant interactions between H and H$^+$, the coupling between them is tight even if the magnetic field is strong. Of course, alternatively, our work also suggests that merging H and H$^+$ into a single flow can be a reasonable assumption in MHD simulations of escaping atmospheres. However, our simulation results indicate that under the influence of magnetic fields, there are noticeable regional differences in the decoupling of H$^+$ and H. With the increase of magnetic field strength, the degree of decoupling also increases. For heavier particles such as O, the decoupling between O and H$^+$ is more pronounced. Our findings provide important insights for future studies on the decoupling processes of heavy atoms in the escaping atmospheres of hot Jupiters and hot Neptunes under the influence of magnetic fields.


title: Triaxial shape of the one-proton emitter $^{149}$Lu

abstract: We revisit the proton emitter $^{149}$Lu utilizing the recently developed triaxial relativistic Hartree-Bogoliubov theory in continuum (TRHBc). By incorporating the microscopic nuclear structure properties from the TRHBc theory into the WKB approximation, we successfully reproduce the measured proton-emission half-life of $^{149}$Lu within experimental uncertainties. A triaxial ground state characterized by ($\beta=0.17,\gamma=31^\circ$) has been clarified for $^{149}$Lu. The inclusion of triaxiality significantly changes nuclear density distributions and potentials, which results in enhanced binding of both the nuclear system and the proton-emitting orbital. As a result, a slightly extended half-life for the proton emission of $^{149}$Lu is achieved after considering triaxial deformation degrees of freedom.


title: Optimizing Layer-Fused Scheduling of Transformer Networks on Multi-accelerator Platforms

abstract: The impact of transformer networks is booming, yet, they come with significant computational complexity. It is therefore essential to understand how to optimally map and execute these networks on modern neural processor hardware. So far, literature on transformer scheduling optimization has been focusing on deployment on GPU and specific ASICs. This work enables extensive hardware/mapping exploration by extending the DSE framework Stream towards support for transformers across a wide variety of hardware architectures and different execution schedules. After validation, we explore the optimal schedule for transformer layers/attention heads and investigate whether layer fusion is beneficial to improve latency, energy or memory requirements. Our study shows that the memory requirements for active feature data can be drastically reduced, by adapting the execution schedule based on the size of the input of the attention head.


title: Two-Step Blackout Mitigation by Flexibility-Enabled Microgrid Islanding

abstract: Blackouts are disastrous events with a low probability of occurrence but a high impact on the system and its users. With the help of more distributed and controllable generation and sector-coupled flexibility, microgrids could be prepared to operate in islanded mode during a blackout. This paper discusses a two-step blackout mitigation approach for highly renewable microgrids that utilizes user flexibility and energy storage systems for power balance in islanded grid operation. The proposed method includes a proactive flexibility reservation step, which derives a minimal reservation schedule for microgrid resources under uncertainty considering related operational costs. As a second step, during a blackout, a fully distributed control is implemented to maximize the usage of available resources based on a sequence of max and min-consensus rounds. This paper focuses on the second step, for which the effectiveness of blackstart and long-term coordination is shown. Load shedding can be reduced by 40\% compared to the forecast value. A hardware-in-the-loop simulation of a grid-forming converter further showed a fast convergence toward the optimal operation point.


title: Halo Radius (Splashback Radius) of Groups and Clusters of Galaxies on small scales

abstract: We report the results of a study of the distribution of galaxies in the projection along the radius ($R \leq 3R_{200c}$) for 157~groups and clusters of galaxies in the local Universe (0.01 < $z$ < 0.10) with line-of-sight velocity dispersions~200~km~s$^{-1}$ < $ \sigma$ < 1100~km~s$^{-1}$. We introduce a new observed boundary for the halos of clusters of galaxies, which we identify with the splashback radius $R_{\rm{sp}}$. We also identified the core of groups/clusters of galaxies with the radius$R_c$. These radii are determined by the observed integrated distribution of the number of galaxies as a function of squared angular radius from the center of the group/cluster, which (usually) coincides with the brightest galaxy. We found for the entire sample that the boundary of dark matter $R_{\rm{sp}}$ for groups/clusters of galaxies is proportional to the radius $R_{\rm{200c}}$ of the virialized region. We measured the mean radius $\langle R_{\rm{sp}} \rangle = 1.14\pm0.02$~Mpc for groups of galaxies ($\sigma \leq 400$~km~s$^{-1}$) and $\langle R_{\rm{sp}} \rangle = 2.00\pm0.07$~Mpc for clusters of galaxies ($\sigma > 400$~km~s$^{-1}$). The mean ratio of radii is $\langle R_{\rm{sp}}/R_{\rm{200c}} \rangle = 1.40\pm0.02$}, or $\langle R_{\rm{sp}}/R_{\rm{200m}} \rangle = 0.88\pm0.02$.


title: Same App, Different Behaviors: Uncovering Device-specific Behaviors in Android Apps

abstract: The Android ecosystem faces a notable challenge known as fragmentation, which denotes the extensive diversity within the system. This issue is mainly related to differences in system versions, device hardware specifications, and customizations introduced by manufacturers. The growing divergence among devices leads to marked variations in how a given app behaves across diverse devices. This is referred to as device-specific behaviors. In this work, we present the first large-scale empirical study of device-specific behaviors in real-world Android apps. We have designed a three-phase static analysis framework to accurately detect and understand the device-specific behaviors. Upon employing our tool on a dataset comprising more than 20,000 apps, we detected device-specific behaviors in 2,357 of them. By examining the distribution of device-specific behaviors, our analysis revealed that apps within the Chinese third-party app market exhibit more relevant behaviors compared to their counterparts in Google Play. Additionally, these behaviors are more likely to feature dominant brands that hold larger market shares. Reflecting this, we have classified these device-specific behaviors into 29 categories based on implemented functionalities, providing structured insight into these behaviors. Beyond common behaviors like issue fixes and feature adaptations, we observed 33 aggressive apps, including popular ones with millions of downloads, abusing system properties of customized ROMs to obtain user-unresettable identifiers without requiring permission, substantially impacting user privacy. Finally, we investigated the origins of device-specific behaviors, revealing significant challenges developers face in implementing them comprehensively. Our research sheds light on the promising but less touched research direction of device-specific behaviors, benefiting community stakeholders.


title: Uniform property $\Gamma$ and the small boundary property

abstract: We prove that, for an action $\alpha \colon G \curvearrowright X$ of a countably infinite discrete amenable group on a compact metric space, the small boundary property is implied by uniform property $\Gamma$ of the Cartan subalgebra $(C(X) \subseteq C(X) \rtimes_\alpha G)$. The reverse implication has been demonstrated by Kerr and Szab\'o for free actions, from which we obtain the equivalence of the two conditions in the free case. We moreover show that, if $\alpha$ is free and minimal, then almost finiteness of $\alpha$ is implied by tracial $\mathcal{Z}$-stability of the subalgebra $(C(X) \subseteq C(X) \rtimes_\alpha G)$. The reverse implication is due to Kerr, resulting in the equivalence of these two properties as well. As an application, we prove that if $\alpha \colon G \curvearrowright X$ and $\beta \colon H \curvearrowright Y$ are free actions and $\alpha$ has the small boundary property, then $\alpha \times \beta \colon G \times H \curvearrowright X \times Y$ has the small boundary property. An analogous permanence property is obtained for almost finiteness in case $\alpha$ and $\beta$ are free minimal actions.


title: Quadrupolar and dipolar excitons in symmetric trilayer heterostructures: Insights from first principles theory

abstract: Excitons in van der Waals heterostructures come in many different forms. In bilayer structures, the electron and hole may be localized on the same layer or they may be separated forming an interlayer exciton with a finite out-of-plane dipole moment. Using first principles calculations, we investigate the excitons in a symmetric WS$_2$/MoS$_2$/WS$_2$ heterostructure in the presence of a vertical electric field. The excitons exhibit a quadratic Stark shift for low field strengths and a linear Stark shift for stronger fields. This behaviour is traced to the coupling of interlayer excitons with opposite dipole moments, which lead to the formation of quadrupolar excitons at small fields. The formation of quadrupolar excitons is determined by the relative size of the electric field-induced splitting of the dipolar excitons and the coupling between them given by the hole tunneling across the MoS$_2$ layer. For the inverted structure, MoS$_2$/WS$_2$/MoS$_2$, the dipolar excitons are coupled by electron tunneling across the WS$_2$ layer. Because this effect is much weaker, the resulting quadrupolar excitons are more fragile and break at a weaker electric field.


title: Think Deep and Fast: Learning Neural Nonlinear Opinion Dynamics from Inverse Dynamic Games for Split-Second Interactions

abstract: Non-cooperative interactions commonly occur in multi-agent scenarios such as car racing, where an ego vehicle can choose to overtake the rival, or stay behind it until a safe overtaking "corridor" opens. While an expert human can do well at making such time-sensitive decisions, the development of safe and efficient game-theoretic trajectory planners capable of rapidly reasoning discrete options is yet to be fully addressed. The recently developed nonlinear opinion dynamics (NOD) show promise in enabling fast opinion formation and avoiding safety-critical deadlocks. However, it remains an open challenge to determine the model parameters of NOD automatically and adaptively, accounting for the ever-changing environment of interaction. In this work, we propose for the first time a learning-based, game-theoretic approach to synthesize a Neural NOD model from expert demonstrations, given as a dataset containing (possibly incomplete) state and action trajectories of interacting agents. The learned NOD can be used by existing dynamic game solvers to plan decisively while accounting for the predicted change of other agents' intents, thus enabling situational awareness in planning. We demonstrate Neural NOD's ability to make fast and robust decisions in a simulated autonomous racing example, leading to tangible improvements in safety and overtaking performance over state-of-the-art data-driven game-theoretic planning methods.


title: Regularising Spectral Curves for Homogeneous Yang-Baxter strings

abstract: In this Letter, we study the semi-classical spectrum of integrable worldsheet $\sigma$-models using the Spectral Curve. We consider a Homogeneous Yang-Baxter deformation of the $AdS_5\times S^5$ superstring, understood as the composition of a Jordanian with a "non-diagonal" TsT deformation. We derive its type IIB supergravity solution, whose isometry algebra features zero supercharges and a non-relativistic conformal algebra in $0+1$ dimensions. While the Spectral Curves of non-diagonal TsT models are ill-defined, we demonstrate that the composition with a Jordanian model regularises this issue. From the regularised Curve, we derive the one-loop shift of the classical energy and the semi-classical spectrum of excitations of a point-like string. In the TsT limit, the one-loop shift vanishes despite the loss of supersymmetry. Our results suggest that it may be possible to use standard Bethe Ansatze on spin chain pictures of deformed $N=4$ Super-Yang-Mills theory dual to non-diagonal TsT models.


title: Soil nitrogen forecasting from environmental variables provided by multisensor remote sensing images

abstract: This study introduces a framework for forecasting soil nitrogen content, leveraging multi-modal data, including multi-sensor remote sensing images and advanced machine learning methods. We integrate the Land Use/Land Cover Area Frame Survey (LUCAS) database, which covers European and UK territory, with environmental variables from satellite sensors to create a dataset of novel features. We further test a broad range of machine learning algorithms, focusing on tree-based models such as CatBoost, LightGBM, and XGBoost. We test the proposed methods with a variety of land cover classes, including croplands and grasslands to ensure the robustness of this approach. Our results demonstrate that the CatBoost model surpasses other methods in accuracy. This research advances the field of agricultural management and environmental monitoring and demonstrates the significant potential of integrating multisensor remote sensing data with machine learning for environmental analysis.


title: Diffuse X-ray Explorer: a high-resolution X-ray spectroscopic sky surveyor on the China Space Station

abstract: DIffuse X-ray Explorer (DIXE) is a proposed high-resolution X-ray spectroscopic sky surveyor on the China Space Station (CSS). DIXE will focus on studying hot baryons in the Milky Way. Galactic hot baryons like the X-ray emitting Milky Way halo and eROSITA bubbles are best observed in the sky survey mode with a large field of view. DIXE will take advantage of the orbital motion of the CSS to scan a large fraction of the sky. High-resolution X-ray spectroscopy, enabled by superconducting microcalorimeters based on the transition-edge sensor (TES) technology, will probe the physical properties (e.g., temperature, density, elemental abundances, kinematics) of the Galactic hot baryons. This will complement the high-resolution imaging data obtained with the eROSITA mission. Here we present the preliminary design of DIXE. The payload consists mainly of a detector assembly and a cryogenic cooling system. The key components of the detector assembly are a microcalorimeter array and frequency-domain multiplexing readout electronics. To provide a working temperature for the detector assembly, the cooling system consists of an adiabatic demagnetization refrigerator and a mechanical cryocooler system.


title: Eigenvalues of the Hodge Laplacian on digraphs

abstract: This paper aims to compute and estimate the eigenvalues of the Hodge Laplacians on directed graphs. We have devised a new method for computing Hodge spectra with the following two ingredients. (I) We have observed that the product rule does work for the so-called normalized Hodge operator, denoted by $\Delta _{p}^{(a)},$ where $a$ refers to the weight that is used to redefine the inner product in the spaces $\Omega _{p}$. This together with the K\"{u}nneth formula for product allows us to compute inductively the spectra of all normalized Hodge operators $\Delta _{p}^{(a)}$ on Cartesian powers including $n$-cubes and $n$-tori. (II) We relate in a certain way the spectra of $\Delta _{p}$ and $\Delta_{p}^{(a)}$ to those of operators $\mathcal{L}_{p}=\partial ^{\ast }\partial$ also acting on $\Omega _{p}$. Knowing the spectra of $\Delta_{p}^{(a)}$ for all values of $p$, we compute the spectra of $\mathcal{L}_{p} $ and then the spectra of $\Delta _{p}.$ This program yields the spectra of all operators $\Delta _{p}$ on all $n$-cubes and $n$-tori.


title: Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments

abstract: The rapid propagation of misinformation poses substantial risks to public interest. To combat misinformation, large language models (LLMs) are adapted to automatically verify claim credibility. Nevertheless, existing methods heavily rely on the embedded knowledge within LLMs and / or black-box APIs for evidence collection, leading to subpar performance with smaller LLMs or upon unreliable context. In this paper, we propose retrieval augmented fact verification through the synthesis of contrasting arguments (RAFTS). Upon input claims, RAFTS starts with evidence retrieval, where we design a retrieval pipeline to collect and re-rank relevant documents from verifiable sources. Then, RAFTS forms contrastive arguments (i.e., supporting or refuting) conditioned on the retrieved evidence. In addition, RAFTS leverages an embedding model to identify informative demonstrations, followed by in-context prompting to generate the prediction and explanation. Our method effectively retrieves relevant documents as evidence and evaluates arguments from varying perspectives, incorporating nuanced information for fine-grained decision-making. Combined with informative in-context examples as prior, RAFTS achieves significant improvements to supervised and LLM baselines without complex prompts. We demonstrate the effectiveness of our method through extensive experiments, where RAFTS can outperform GPT-based methods with a significantly smaller 7B LLM.


title: A Zeroth-Order Proximal Algorithm for Consensus Optimization

abstract: This paper considers a consensus optimization problem, where all the nodes in a network, with access to the zeroth-order information of its local objective function only, attempt to cooperatively achieve a common minimizer of the sum of their local objectives. To address this problem, we develop ZoPro, a zeroth-order proximal algorithm, which incorporates a zeroth-order oracle for approximating Hessian and gradient into a recently proposed, high-performance distributed second-order proximal algorithm. We show that the proposed ZoPro algorithm, equipped with a dynamic stepsize, converges linearly to a neighborhood of the optimum in expectation, provided that each local objective function is strongly convex and smooth. Extensive simulations demonstrate that ZoPro converges faster than several state-of-the-art distributed zeroth-order algorithms and outperforms a few distributed second-order algorithms in terms of running time for reaching given accuracy.


title: Efficient and Precise Force Field Optimization for Biomolecules Using DPA-2

abstract: Molecular simulations are essential tools in computational chemistry, enabling the prediction and understanding of molecular interactions and thermodynamic properties of biomolecules. However, traditional force fields face significant challenges in accurately representing novel molecules and complex chemical environments due to the labor-intensive process of manually setting optimization parameters and the high computational cost of quantum mechanical calculations. To overcome these difficulties, we fine-tuned a high-accuracy DPA-2 pre-trained model and applied it to optimize force field parameters on-the-fly, significantly reducing computational costs. Our method combines this fine-tuned DPA-2 model with a node-embedding-based similarity metric, allowing seamless augmentation to new chemical species without manual intervention. We applied this process to the TYK2 inhibitor and PTP1B systems and demonstrated its effectiveness through the improvement of free energy perturbation calculation results. This advancement contributes valuable insights and tools for the computational chemistry community.


title: ClimRetrieve: A Benchmarking Dataset for Information Retrieval from Corporate Climate Disclosures

abstract: To handle the vast amounts of qualitative data produced in corporate climate communication, stakeholders increasingly rely on Retrieval Augmented Generation (RAG) systems. However, a significant gap remains in evaluating domain-specific information retrieval - the basis for answer generation. To address this challenge, this work simulates the typical tasks of a sustainability analyst by examining 30 sustainability reports with 16 detailed climate-related questions. As a result, we obtain a dataset with over 8.5K unique question-source-answer pairs labeled by different levels of relevance. Furthermore, we develop a use case with the dataset to investigate the integration of expert knowledge into information retrieval with embeddings. Although we show that incorporating expert knowledge works, we also outline the critical limitations of embeddings in knowledge-intensive downstream domains like climate change communication.


title: Enhanced Deep Speech Separation in Clustered Ad Hoc Distributed Microphone Environments

abstract: Ad-hoc distributed microphone environments, where microphone locations and numbers are unpredictable, present a challenge to traditional deep learning models, which typically require fixed architectures. To tailor deep learning models to accommodate arbitrary array configurations, the Transform-Average-Concatenate (TAC) layer was previously introduced. In this work, we integrate TAC layers with dual-path transformers for speech separation from two simultaneous talkers in realistic settings. However, the distributed nature makes it hard to fuse information across microphones efficiently. Therefore, we explore the efficacy of blindly clustering microphones around sources of interest prior to enhancement. Experimental results show that this deep cluster-informed approach significantly improves the system's capacity to cope with the inherent variability observed in ad-hoc distributed microphone environments.


title: On the existence of Markovian randomized equilibria in Dynkin games of war-of-attrition-type

abstract: In optimal stopping problems, a Markov structure guarantees Markovian optimal stopping times (first exit times). Surprisingly, there is no analogous result for Markovian stopping games once randomization is required. This paper addresses this gap by proving the existence of Markov-perfect equilibria in a specific type of stopping game - a general nonzero-sum Dynkin games of the war-of-attrition type with underlying linear diffusions. Our main mathematical contribution lies in the development of appropriate topologies for Markovian randomized stopping times. This allows us to establish the existence of equilibria within a tractable and interpretable class of stopping times, paving the way for further analysis of Markovian stopping games.


title: Low algorithmic delay implementation of convolutional beamformer for online joint source separation and dereverberation

abstract: Blind-audio-source-separation (BASS) techniques, particularly those with low latency, play an important role in a wide range of real-time systems, e.g., hearing aids, in-car hand-free voice communication, real-time human-machine interaction, etc. Most existing BASS algorithms are deduced to run on batch mode, and therefore large latency is unavoidable. Recently, some online algorithms were developed, which achieve separation on a frame-by-frame basis in the short-time-Fourier-transform (STFT) domain and the latency is significantly reduced as compared to those batch methods. However, the latency with these algorithms may still be too long for many real-time systems to bear. To further reduce latency while achieving good separation performance, we propose in this work to integrate a weighted prediction error (WPE) module into a non-causal sample-truncating-based independent vector analysis (NST-IVA). The resulting algorithm can maintain the algorithmic delay as NST-IVA if the delay with WPE is appropriately controlled while achieving significantly better performance, which is validated by simulations.


title: An I2I Inpainting Approach for Efficient Channel Knowledge Map Construction

abstract: Channel knowledge map (CKM) has received widespread attention as an emerging enabling technology for environment-aware wireless communications. It involves the construction of databases containing location-specific channel knowledge, which are then leveraged to facilitate channel state information (CSI) acquisition and transceiver design. In this context, a fundamental challenge lies in efficiently constructing the CKM based on a given wireless propagation environment. Most existing methods are based on stochastic modeling and sequence prediction, which do not fully exploit the inherent physical characteristics of the propagation environment, resulting in low accuracy and high computational complexity. To address these limitations, we propose a Laplacian pyramid (LP)-based CKM construction scheme to predict the channel knowledge at arbitrary locations in a targeted area. Specifically, we first view the channel knowledge as a 2-D image and transform the CKM construction problem into an image-to-image (I2I) inpainting task, which predicts the channel knowledge at a specific location by recovering the corresponding pixel value in the image matrix. Then, inspired by the reversible and closed-form structure of the LP, we show its natural suitability for our task in designing a fast I2I mapping network. For different frequency components of LP decomposition, we design tailored networks accordingly. Besides, to encode the global structural information of the propagation environment, we introduce self-attention and cross-covariance attention mechanisms in different layers, respectively. Finally, experimental results show that the proposed scheme outperforms the benchmark, achieving higher reconstruction accuracy while with lower computational complexity. Moreover, the proposed approach has a strong generalization ability and can be implemented in different wireless communication scenarios.

categories: cs.IT cs.CV cs.LG eess.IV eess.SP math.IT


title: From Manifestations to Cognitive Architectures: a Scalable Framework

abstract: The Artificial Intelligence field is flooded with optimisation methods. In this paper, we change the focus to developing modelling methods with the aim of getting us closer to Artificial General Intelligence. To do so, we propose a novel way to interpret reality as an information source, that is later translated into a computational framework able to capture and represent such information. This framework is able to build elements of classical cognitive architectures, like Long Term Memory and Working Memory, starting from a simple primitive that only processes Spatial Distributed Representations. Moreover, it achieves such level of verticality in a seamless scalable hierarchical way.


title: Optimization policy for file replica placement in fog domains

abstract: Fog computing architectures distribute computational and storage resources along the continuum from the cloud to things. Therefore, the execution of services or the storage of files can be closer to the users. The main objectives of fog computing domains are to reduce the user latency and the network usage. Availability is also an issue in fog architectures because the topology of the network does not guarantee redundant links between devices. Consequently, the definition of placement polices is a key challenge. We propose a placement policy for data replication to increase data availability that contrasts with other storage policies that only consider a single replica of the files. The system is modeled with complex weighted networks and topological features, such as centrality indices. Graph partition algorithms are evaluated to select the fog devices that store data replicas. Our approach is compared with two other placement policies: one that stores only one replica and FogStore, which also stores file replicas but uses a greedy approach (the shortest path). We analyze 22 experiments with simulations. The results show that our approach obtains the shortest latency times, mainly for writing operations, a smaller network usage increase, and a similar file availability to FogStore.


title: Unraveling Anomalies in Time: Unsupervised Discovery and Isolation of Anomalous Behavior in Bio-regenerative Life Support System Telemetry

abstract: The detection of abnormal or critical system states is essential in condition monitoring. While much attention is given to promptly identifying anomalies, a retrospective analysis of these anomalies can significantly enhance our comprehension of the underlying causes of observed undesired behavior. This aspect becomes particularly critical when the monitored system is deployed in a vital environment. In this study, we delve into anomalies within the domain of Bio-Regenerative Life Support Systems (BLSS) for space exploration and analyze anomalies found in telemetry data stemming from the EDEN ISS space greenhouse in Antarctica. We employ time series clustering on anomaly detection results to categorize various types of anomalies in both uni- and multivariate settings. We then assess the effectiveness of these methods in identifying systematic anomalous behavior. Additionally, we illustrate that the anomaly detection methods MDI and DAMP produce complementary results, as previously indicated by research.


title: Some contributions to Lagrangian modelling of Power Converters

abstract: Lagrangian modelling can be used to derive mathematical models for complex power electronic converters. This approach uses scalar quantities (kinetic and potential energy) to derive models, which is simpler than using (vector-based) force balance equations. It employs generalized coordinates, making it easier to deal with complex systems with constraints. This systematic approach results in equations that can be expressed in state-space form, which allows for the simplification of the simulation and design process and the use of many standard software packages for system analysis and simulation. In this work, contributions are made regarding the procedure to be followed for the Lagrangian modelling of power converters and the incorporation of constraints within the Lagrangian framework. Furthermore, for the first time, Lagrangian modelling is extended to non-ideal, high-fidelity descriptions of standard power electronic circuits.


title: HiP Attention: Sparse Sub-Quadratic Attention with Hierarchical Attention Pruning

abstract: In modern large language models (LLMs), increasing sequence lengths is a crucial challenge for enhancing their comprehension and coherence in handling complex tasks such as multi-modal question answering. However, handling long context sequences with LLMs is prohibitively costly due to the conventional attention mechanism's quadratic time and space complexity, and the context window size is limited by the GPU memory. Although recent works have proposed linear and sparse attention mechanisms to address this issue, their real-world applicability is often limited by the need to re-train pre-trained models. In response, we propose a novel approach, Hierarchically Pruned Attention (HiP), which simultaneously reduces the training and inference time complexity from $O(T^2)$ to $O(T \log T)$ and the space complexity from $O(T^2)$ to $O(T)$. To this end, we devise a dynamic sparse attention mechanism that generates an attention mask through a novel tree-search-like algorithm for a given query on the fly. HiP is training-free as it only utilizes the pre-trained attention scores to spot the positions of the top-$k$ most significant elements for each query. Moreover, it ensures that no token is overlooked, unlike the sliding window-based sub-quadratic attention methods, such as StreamingLLM. Extensive experiments on diverse real-world benchmarks demonstrate that HiP significantly reduces prompt (i.e., prefill) and decoding latency and memory usage while maintaining high generation performance with little or no degradation. As HiP allows pretrained LLMs to scale to millions of tokens on commodity GPUs with no additional engineering due to its easy plug-and-play deployment, we believe that our work will have a large practical impact, opening up the possibility to many long-context LLM applications previously infeasible.


title: Dynamic Decentralized 3D Urban Coverage and Patrol with UAVs

abstract: In the event of natural or man-made disasters in an urban environment, such as fires, floods, and earthquakes, a swarm of unmanned aerial vehicles (UAVs) can rapidly sweep and provide coverage to monitor the area of interest and locate survivors. We propose a modular framework and patrol strategy that enables a swarm of UAVs to perform cooperative and periodic coverage in such scenarios. Our approach first discretizes the area of interest into viewpoints connected via closed paths. UAVs are assigned to teams via task allocation to cooperatively patrol these closed paths. We propose a minimal, scalable, and robust patrol strategy where UAVs within a team move in a random direction along their assigned closed path and "bounce" off each other when they meet. Our simulation results show that such a minimal strategy can exhibit an emergent behaviour that provides periodic and complete coverage in a 3D urban environment.


title: Open-Vocabulary Semantic Segmentation with Image Embedding Balancing

abstract: Open-vocabulary semantic segmentation is a challenging task, which requires the model to output semantic masks of an image beyond a close-set vocabulary. Although many efforts have been made to utilize powerful CLIP models to accomplish this task, they are still easily overfitting to training classes due to the natural gaps in semantic information between training and new classes. To overcome this challenge, we propose a novel framework for openvocabulary semantic segmentation called EBSeg, incorporating an Adaptively Balanced Decoder (AdaB Decoder) and a Semantic Structure Consistency loss (SSC Loss). The AdaB Decoder is designed to generate different image embeddings for both training and new classes. Subsequently, these two types of embeddings are adaptively balanced to fully exploit their ability to recognize training classes and generalization ability for new classes. To learn a consistent semantic structure from CLIP, the SSC Loss aligns the inter-classes affinity in the image feature space with that in the text feature space of CLIP, thereby improving the generalization ability of our model. Furthermore, we employ a frozen SAM image encoder to complement the spatial information that CLIP features lack due to the low training image resolution and image-level supervision inherent in CLIP. Extensive experiments conducted across various benchmarks demonstrate that the proposed EBSeg outperforms the state-of-the-art methods. Our code and trained models will be here: https://github.com/slonetime/EBSeg.


title: Does the full configuration interaction method based on quantum phase estimation with Trotter decomposition satisfy the size consistency condition?

abstract: Electronic structure calculations of atoms and molecules are expected to be a promising application for quantum computers, and two important algorithms, the quantum phase estimation (QPE) and the variational quantum eigensolver (VQE), have been widely studied. The condition that the energy of the dimer consisting of two monomers separated by a large distance should be twice of the energy of the monomer, known as a size consistency, is very important in quantum chemical calculations. Recently, we reported that the size consistency condition can be broken by the Trotterization in the unitary coupled cluster singles and doubles (UCCSD) ansatz in VQE, when the molecular orbitals delocalized to the dimer are used (K. Sugisaki et al., J. Comput. Chem., published online; DOI: 10.1002/jcc.27438). It is well known that the full configuration interaction (full-CI) energy is invariant with arbitrary rotations of molecular orbitals, and therefore the QPE-based full-CI in principle satisfies the size consistency. However, Trotterization of the time evolution operator has a chance to break the size consistency conditions. In this work, we investigated whether or not the size consistency condition can be maintained by the Trotterization of the time evolution operator in the QPE-based full-CI calculations. Our numerical simulations revealed that the size consistency of the QPE-based full-CI is not automatically violated by using the molecular orbitals delocalized to the dimer, but the use of an appropriate Trotter decomposition condition is crucial to satisfy the size consistency condition. Acceleration of the QPE simulations with sequential addition of ancillary qubits is also reported.


title: Federated Learning driven Large Language Models for Swarm Intelligence: A Survey

abstract: Federated learning (FL) offers a compelling framework for training large language models (LLMs) while addressing data privacy and decentralization challenges. This paper surveys recent advancements in the federated learning of large language models, with a particular focus on machine unlearning, a crucial aspect for complying with privacy regulations like the Right to be Forgotten. Machine unlearning in the context of federated LLMs involves systematically and securely removing individual data contributions from the learned model without retraining from scratch. We explore various strategies that enable effective unlearning, such as perturbation techniques, model decomposition, and incremental learning, highlighting their implications for maintaining model performance and data privacy. Furthermore, we examine case studies and experimental results from recent literature to assess the effectiveness and efficiency of these approaches in real-world scenarios. Our survey reveals a growing interest in developing more robust and scalable federated unlearning methods, suggesting a vital area for future research in the intersection of AI ethics and distributed machine learning technologies.


title: On bi-enriched $\infty$-categories

abstract: We extend Lurie's definition of enriched $\infty$-categories to notions of left enriched, right enriched and bi-enriched $\infty$-categories, which generalize the concepts of closed left tensored, right tensored and bitensored $\infty$-categories and share many desirable features with them. We use bi-enriched $\infty$-categories to endow the $\infty$-category of enriched functors with enrichment that generalizes both the internal hom of the tensor product of enriched $\infty$-categories when the latter exists, and the free cocompletion under colimits and tensors. As an application we prove an end formula for morphism objects of enriched $\infty$-categories of enriched functors and compute the monad for enriched functors. We build our theory closely related to Lurie's higher algebra: we construct an enriched $\infty$-category of enriched presheaves via the enveloping tensored $\infty$-category, construct transfer of enrichment via scalar extension of bitensored $\infty$-categories, and construct enriched Kan-extensions via operadic Kan extensions. In particular, we develop an independent theory of enriched $\infty$-categories for Lurie's model of enriched $\infty$-categories.


title: SHMamba: Structured Hyperbolic State Space Model for Audio-Visual Question Answering

abstract: The Audio-Visual Question Answering (AVQA) task holds significant potential for applications. Compared to traditional unimodal approaches, the multi-modal input of AVQA makes feature extraction and fusion processes more challenging. Euclidean space is difficult to effectively represent multi-dimensional relationships of data. Especially when extracting and processing data with a tree structure or hierarchical structure, Euclidean space is not suitable as an embedding space. Additionally, the self-attention mechanism in Transformers is effective in capturing the dynamic relationships between elements in a sequence. However, the self-attention mechanism's limitations in window modeling and quadratic computational complexity reduce its effectiveness in modeling long sequences. To address these limitations, we propose SHMamba: Structured Hyperbolic State Space Model to integrate the advantages of hyperbolic geometry and state space models. Specifically, SHMamba leverages the intrinsic properties of hyperbolic space to represent hierarchical structures and complex relationships in audio-visual data. Meanwhile, the state space model captures dynamic changes over time by globally modeling the entire sequence. Furthermore, we introduce an adaptive curvature hyperbolic alignment module and a cross fusion block to enhance the understanding of hierarchical structures and the dynamic exchange of cross-modal information, respectively. Extensive experiments demonstrate that SHMamba outperforms previous methods with fewer parameters and computational costs. Our learnable parameters are reduced by 78.12\%, while the average performance improves by 2.53\%. Experiments show that our method demonstrates superiority among all current major methods and is more suitable for practical application scenarios.


title: How and Why LLMs Use Deprecated APIs in Code Completion? An Empirical Study

abstract: Large language models (LLMs), pre-trained or fine-tuned on large code corpora, have shown effectiveness in generating code completions. However, in LLM-based code completion, LLMs may struggle to use correct and up-to-date Application Programming Interfaces (APIs) due to the rapid and continuous evolution of libraries. While existing studies have highlighted issues with predicting incorrect APIs, the specific problem of deprecated API usage in LLM-based code completion has not been thoroughly investigated. To address this gap, we conducted the first evaluation study on deprecated API usage in LLM-based code completion. This study involved seven advanced LLMs, 145 API mappings from eight popular Python libraries, and 28,125 completion prompts. The study results reveal the \textit{status quo} and \textit{root causes} of deprecated API usage in LLM-based code completion from the perspectives of \textit{model}, \textit{prompt}, and \textit{library}. Based on these findings, we propose two lightweight fixing approaches, \textsc{ReplaceAPI} and \textsc{InsertPrompt}, which can serve as baseline approaches for future research on mitigating deprecated API usage in LLM-based completion. Additionally, we provide implications for future research on integrating library evolution with LLM-driven software development.


title: I Know How: Combining Prior Policies to Solve New Tasks

abstract: Multi-Task Reinforcement Learning aims at developing agents that are able to continually evolve and adapt to new scenarios. However, this goal is challenging to achieve due to the phenomenon of catastrophic forgetting and the high demand of computational resources. Learning from scratch for each new task is not a viable or sustainable option, and thus agents should be able to collect and exploit prior knowledge while facing new problems. While several methodologies have attempted to address the problem from different perspectives, they lack a common structure. In this work, we propose a new framework, I Know How (IKH), which provides a common formalization. Our methodology focuses on modularity and compositionality of knowledge in order to achieve and enhance agent's ability to learn and adapt efficiently to dynamic environments. To support our framework definition, we present a simple application of it in a simulated driving environment and compare its performance with that of state-of-the-art approaches.


title: Robustness-Inspired Defense Against Backdoor Attacks on Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have achieved promising results in tasks such as node classification and graph classification. However, recent studies reveal that GNNs are vulnerable to backdoor attacks, posing a significant threat to their real-world adoption. Despite initial efforts to defend against specific graph backdoor attacks, there is no work on defending against various types of backdoor attacks where generated triggers have different properties. Hence, we first empirically verify that prediction variance under edge dropping is a crucial indicator for identifying poisoned nodes. With this observation, we propose using random edge dropping to detect backdoors and theoretically show that it can efficiently distinguish poisoned nodes from clean ones. Furthermore, we introduce a novel robust training strategy to efficiently counteract the impact of the triggers. Extensive experiments on real-world datasets show that our framework can effectively identify poisoned nodes, significantly degrade the attack success rate, and maintain clean accuracy when defending against various types of graph backdoor attacks with different properties.


title: TabularFM: An Open Framework For Tabular Foundational Models

abstract: Foundational models (FMs), pretrained on extensive datasets using self-supervised techniques, are capable of learning generalized patterns from large amounts of data. This reduces the need for extensive labeled datasets for each new task, saving both time and resources by leveraging the broad knowledge base established during pretraining. Most research on FMs has primarily focused on unstructured data, such as text and images, or semi-structured data, like time-series. However, there has been limited attention to structured data, such as tabular data, which, despite its prevalence, remains under-studied due to a lack of clean datasets and insufficient research on the transferability of FMs for various tabular data tasks. In response to this gap, we introduce a framework called TabularFM, which incorporates state-of-the-art methods for developing FMs specifically for tabular data. This includes variations of neural architectures such as GANs, VAEs, and Transformers. We have curated a million of tabular datasets and released cleaned versions to facilitate the development of tabular FMs. We pretrained FMs on this curated data, benchmarked various learning methods on these datasets, and released the pretrained models along with leaderboards for future comparative studies. Our fully open-sourced system provides a comprehensive analysis of the transferability of tabular FMs. By releasing these datasets, pretrained models, and leaderboards, we aim to enhance the validity and usability of tabular FMs in the near future.