title: Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios

abstract: The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings. This research evaluates the performance of seven leading LLMs in sentiment analysis on a dataset derived from multilingual and code-mixed WhatsApp chats, including Swahili, English and Sheng. Our evaluation includes both quantitative analysis using metrics like F1 score and qualitative assessment of LLMs' explanations for their predictions. We find that, while Mistral-7b and Mixtral-8x7b achieved high F1 scores, they and other LLMs such as GPT-3.5-Turbo, Llama-2-70b, and Gemma-7b struggled with understanding linguistic and contextual nuances, as well as lack of transparency in their decision-making process as observed from their explanations. In contrast, GPT-4 and GPT-4-Turbo excelled in grasping diverse linguistic inputs and managing various contextual information, demonstrating high consistency with human alignment and transparency in their decision-making process. The LLMs however, encountered difficulties in incorporating cultural nuance especially in non-English settings with GPT-4s doing so inconsistently. The findings emphasize the necessity of continuous improvement of LLMs to effectively tackle the challenges of culturally nuanced, low-resource real-world settings and the need for developing evaluation benchmarks for capturing these issues.


title: Efficient Historical Butterfly Counting in Large Temporal Bipartite Networks via Graph Structure-aware Index

abstract: Bipartite graphs are ubiquitous in many domains, e.g., e-commerce platforms, social networks, and academia, by modeling interactions between distinct entity sets. Within these graphs, the butterfly motif, a complete 2*2 biclique, represents the simplest yet significant subgraph structure, crucial for analyzing complex network patterns. Counting the butterflies offers significant benefits across various applications, including community analysis and recommender systems. Additionally, the temporal dimension of bipartite graphs, where edges activate within specific time frames, introduces the concept of historical butterfly counting, i.e., counting butterflies within a given time interval. This temporal analysis sheds light on the dynamics and evolution of network interactions, offering new insights into their mechanisms. Despite its importance, no existing algorithm can efficiently solve the historical butterfly counting task. To address this, we design two novel indices whose memory footprints are dependent on #butterflies and #wedges, respectively. Combining these indices, we propose a graph structure-aware indexing approach that significantly reduces memory usage while preserving exceptional query speed. We theoretically prove that our approach is particularly advantageous on power-law graphs, a common characteristic of real-world bipartite graphs, by surpassing traditional complexity barriers for general graphs. Extensive experiments reveal that our query algorithms outperform existing methods by up to five magnitudes, effectively balancing speed with manageable memory requirements.


title: DeCoOp: Robust Prompt Tuning with Out-of-Distribution Detection

abstract: Vision-language models (VLMs), such as CLIP, have demonstrated impressive zero-shot capabilities for various downstream tasks. Their performance can be further enhanced through few-shot prompt tuning methods. However, current studies evaluate the performance of learned prompts separately on base and new classes. This evaluation lacks practicality for real-world applications since downstream tasks cannot determine whether the data belongs to base or new classes in advance. In this paper, we explore a problem setting called Open-world Prompt Tuning (OPT), which involves tuning prompts on base classes and evaluating on a combination of base and new classes. By introducing Decomposed Prompt Tuning framework (DePT), we theoretically demonstrate that OPT can be solved by incorporating out-of-distribution detection into prompt tuning, thereby enhancing the base-to-new discriminability. Based on DePT, we present a novel prompt tuning approach, namely, Decomposed Context Optimization (DeCoOp), which introduces new-class detectors and sub-classifiers to further enhance the base-class and new-class discriminability. Experimental results on 11 benchmark datasets validate the effectiveness of DePT and demonstrate that DeCoOp outperforms current state-of-the-art methods, providing a significant 2% average accuracy improvement.


title: Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstruction

abstract: While Signed Distance Fields (SDF) are well-established for modeling watertight surfaces, Unsigned Distance Fields (UDF) broaden the scope to include open surfaces and models with complex inner structures. Despite their flexibility, UDFs encounter significant challenges in high-fidelity 3D reconstruction, such as non-differentiability at the zero level set, difficulty in achieving the exact zero value, numerous local minima, vanishing gradients, and oscillating gradient directions near the zero level set. To address these challenges, we propose Details Enhanced UDF (DEUDF) learning that integrates normal alignment and the SIREN network for capturing fine geometric details, adaptively weighted Eikonal constraints to address vanishing gradients near the target surface, unconditioned MLP-based UDF representation to relax non-negativity constraints, and a UDF-tailored method for extracting iso-surface with non-constant iso-values. These strategies collectively stabilize the learning process from unoriented point clouds and enhance the accuracy of UDFs. Our computational results demonstrate that DEUDF outperforms existing UDF learning methods in both accuracy and the quality of reconstructed surfaces. We will make the source code publicly available.


title: E$^3$-Net: Efficient E(3)-Equivariant Normal Estimation Network

abstract: Point cloud normal estimation is a fundamental task in 3D geometry processing. While recent learning-based methods achieve notable advancements in normal prediction, they often overlook the critical aspect of equivariance. This results in inefficient learning of symmetric patterns. To address this issue, we propose E3-Net to achieve equivariance for normal estimation. We introduce an efficient random frame method, which significantly reduces the training resources required for this task to just 1/8 of previous work and improves the accuracy. Further, we design a Gaussian-weighted loss function and a receptive-aware inference strategy that effectively utilizes the local properties of point clouds. Our method achieves superior results on both synthetic and real-world datasets, and outperforms current state-of-the-art techniques by a substantial margin. We improve RMSE by 4% on the PCPNet dataset, 2.67% on the SceneNN dataset, and 2.44% on the FamousShape dataset.


title: An Effective Weight Initialization Method for Deep Learning: Application to Satellite Image Classification

abstract: The growing interest in satellite imagery has triggered the need for efficient mechanisms to extract valuable information from these vast data sources, providing deeper insights. Even though deep learning has shown significant progress in satellite image classification. Nevertheless, in the literature, only a few results can be found on weight initialization techniques. These techniques traditionally involve initializing the networks' weights before training on extensive datasets, distinct from fine-tuning the weights of pre-trained networks. In this study, a novel weight initialization method is proposed in the context of satellite image classification. The proposed weight initialization method is mathematically detailed during the forward and backward passes of the convolutional neural network (CNN) model. Extensive experiments are carried out using six real-world datasets. Comparative analyses with existing weight initialization techniques made on various well-known CNN models reveal that the proposed weight initialization technique outperforms the previous competitive techniques in classification accuracy. The complete code of the proposed technique, along with the obtained results, is available at https://github.com/WadiiBoulila/Weight-Initialization


title: A porous medium equation with spatially inhomogeneous absorption. Part I: Self-similar solutions

abstract: This is the first of a two-parts work on the qualitative properties and large time behavior for the following quasilinear equation involving a spatially inhomogeneous absorption $$ \partial_tu=\Delta u^m-|x|^{\sigma}u^p, $$ posed for $(x,t)\in\mathbf{R}^N\times(0,\infty)$, $N\geq1$, and in the range of exponents $1<m<p<\infty$, $\sigma>0$. We give a complete classification of (singular) self-similar solutions of the form $$ u(x,t)=t^{-\alpha}f(|x|t^{-\beta}), \ \alpha=\frac{\sigma+2}{\sigma(m-1)+2(p-1)}, \ \beta=\frac{p-m}{\sigma(m-1)+2(p-1)}, $$ showing that their form and behavior strongly depends on the critical exponent $$ p_F(\sigma)=m+\frac{\sigma+2}{N}. $$ For $p\geq p_F(\sigma)$, we prove that all self-similar solutions have a tail as $\xi\to\infty$ of one of the forms $$ u(x,t)\sim C|x|^{-(\sigma+2)/(p-m)} \quad {\rm or} \quad u(x,t)\sim \left(\frac{1}{p-1}\right)^{1/(p-1)}|x|^{-\sigma/(p-1)}, $$ while for $m<p<p_F(\sigma)$ we add to the previous the \emph{existence and uniqueness} of a \emph{compactly supported very singular solution}. These solutions will be employed in describing the large time behavior of general solutions in a forthcoming paper.


title: On Transversality Across Two Distinct Quantum Error Correction Codes For Quantum Repeaters

abstract: In this paper, we investigate the transversality of pairs of CSS codes and their use in the second generation of quantum repeaters (QR)s. We show that different stations of quantum link can experience different errors. Considering this fact, we suggest to use different CSS codes in different stations. We also suggest to use $[[n, k]]$ codes with $k > 1$ as they are more efficient then codes with $k = 1$. We establish sufficient and necessary conditions for a pair of CSS codes to be non-local CNOT-transversal. We show that in contrast to the well known CNOT transversality which states that two CSS codes should be the same, less restrictive constraints are needed. Next, we establish sufficient and necessary conditions for a code pair to be CZ-transversal.


title: Solar system consistency of $f(R)$ gravity theory and its MOND equivalence

abstract: Since last two decades $f(R)$ gravity theory has been extensively used as a serious alternative of general relativity to mimic the effects of dark energy. The theory presents a Yukawa correction to Newtonian gravitational potential, acting as a fifth force of Nature. Generally speaking, this new force is mediated by a scalar field known as scalaron. It affects orbital dynamics of test bodies around a central mass. When the scalaron becomes extremely massive $f(R)$ gravity reduces to Newtonian theory in the weak field limit. In this paper we test $f(R)$ gravity theory in the Solar system by constraining scalaron mass through existing measurements of perihelion shift of planets, Cassini's measurement of the Parameterised Post Newtonian parameter and measurement of the Brans-Dicke coupling constant. We calculate acceleration due to gravity in the theory for planets, Trans Neptunian Objects (TNOs), Centaurs, Scattered Disk Objects (SDOs) and Oort cloud objects and compare it with the values predicted by Newtonian and Modified Newtonian Dynamics (MOND). It is found that the theory reproduces to MOND like acceleration in the outer Solar system ($r_p \sim 2000$ au - $36000$ au) for available interpolating functions of the MOND paradigm. From its MOND equivalence we constrain the parameters of the theory. Our results are consistent with existing constraints on the theory arising from the environment of the Galactic Centre black hole.


title: Induced Ramsey problems for trees and graphs with bounded treewidth

abstract: The induced $q$-color size-Ramsey number $\hat{r}_{\text{ind}}(H;q)$ of a graph $H$ is the minimal number of edges a host graph $G$ can have so that every $q$-edge-coloring of $G$ contains a monochromatic copy of $H$ which is an induced subgraph of $G$. A natural question, which in the non-induced case has a very long history, asks which families of graphs $H$ have induced Ramsey numbers that are linear in $|H|$. We prove that for every $k,w,q$, if $H$ is an $n$-vertex graph with maximum degree $k$ and treewidth at most $w$, then $\hat{r}_{\text{ind}}(H;q) = O_{k,w,q}(n)$. This extends several old and recent results in Ramsey theory. Our proof is quite simple and relies upon a novel reduction argument.


title: Form factors of $\Lambda_b^0 \to \Lambda_c(2595)^+$ within light-cone QCD sum rules

abstract: In this work, we calculated the form factors of the weak decay process $\Lambda_b^0 \to \Lambda_c(2595)^+$, where the final charm baryon represents an excited state with spin-parity $\frac{1}{2}^-$. Utilizing the light-cone QCD sum rules approach, we incorporated the contributions of the lowest two charm baryon states: the ground state $\Lambda_c$ with $J^P=\frac{1}{2}^+$ and the excited state $\Lambda_c(2595)^+$ with $J^P=\frac{1}{2}^-$ in the hadronic representation of the $\Lambda_b$ to $\Lambda_c(2595)$ transition correlation function. This approach allowes us to extract the form factors of the $\Lambda_b^0 \to \Lambda_c(2595)^+$ from $\Lambda_b^0 \to \Lambda_c^+$ transition. During the light-cone QCD sum rules procedure, we employed the light-cone distribution amplitudes (LCDAs) of the $\Lambda_b$ baryon. Furthermore, by combining these form factors with the helicity amplitudes of the bottom baryon transition matrix elements, we calculated the differential decay widths for the processes $\Lambda_b^0 \to \Lambda_c(2595)^+\ell^-\bar{\nu}_\ell$. Additionally, within the lifetime of $\Lambda_b^0$, we obtained the absolute branching fractions for the semileptonic decays $\Lambda_b^0 \to \Lambda_c(2595)^+ \ell^- \bar{\nu}_\ell$. With the branching fractions of $\Lambda_b^0 \to \Lambda_c(2595)^+ \ell^- \bar{\nu}_\ell$ calculated in this work, we also determined the parameter $\mathcal{R}(\Lambda_c(2595)^+)$ which tests the lepton flavor universality. This parameter is defined as the ratio of branching fractions $\mathcal{B}r(\Lambda_b^0 \to \Lambda_c(2595)^+\tau^-\bar{\nu}_\tau)$ and $\mathcal{B}r(\Lambda_b^0 \to \Lambda_c(2595)^+\mu^-\bar{\nu}_\mu)$. Our results provide a valuable theoretical test for these decay channels and offer insights into the LCDAs of bottom baryons, paving the way for further in-depth investigations.


title: Semilinear Schr\"odinger equations with Hardy potentials involving the distance to a boundary submanifold and gradient source nonlinearities

abstract: Let $\Omega\subset\mathbb{R}^N$ ($N\geq 3$) be a bounded $C^2$ domain and $\Sigma\subset\partial\Omega$ be a compact $C^2$ submanifold of dimension $k$. Denote the distance from $\Sigma$ by $d_\Sigma$. In this paper, we study positive solutions of the equation $(*)\, -\Delta u -\mu u/d_\Sigma^2 = g(u,|\nabla u|)$ in $\Omega$, where $\mu\leq \big( \frac{N-k}{2} \big)^2$ and the source term $g:\mathbb{R}\times\mathbb{R}_+ \rightarrow \mathbb{R}_+$ is continuous and non-decreasing in its arguments with $g(0,0)=0$. In particular, we prove the existence of solutions of $(*)$ with boundary measure data $u=\nu$ in two main cases, provided that the total mass of $\nu$ is small. In the first case $g$ satisfies some subcriticality conditions that always ensure the existence of solutions. In the second case we examine power type nonlinearity $g(u,|\nabla u|) = |u|^p|\nabla u|^q$, where the problem may not possess a solution for exponents in the supercritical range. Nevertheless we obtain criteria for existence under the assumption that $\nu$ is absolutely continuous with respect to some appropriate capacity or the Bessel capacity of $\Sigma$, or under other equivalent conditions.


title: Computation of Maximal Admissible Robust Positive Invariant Sets for Linear Systems with Parametric and Additive Uncertainties

abstract: In this paper, we address the problem of computing the maximal admissible robust positive invariant (MARPI) set for discrete-time linear time-varying systems with parametric uncertainties and additive disturbances. The system state and input are subjected to hard constraints, and the system parameters and the exogenous disturbance are assumed to belong to known convex polytopes. We provide necessary and sufficient conditions for the existence of the non-empty MARPI set, and explore relevant features of the set that lead to an efficient finite-time converging algorithm with a suitable stopping criterion. The analysis hinges on backward reachable sets defined using recursively computed halfspaces and the minimal RPI set. A numerical example is used to validate the theoretical development.


title: AudioLCM: Text-to-Audio Generation with Latent Consistency Models

abstract: Recent advancements in Latent Diffusion Models (LDMs) have propelled them to the forefront of various generative tasks. However, their iterative sampling process poses a significant computational burden, resulting in slow generation speeds and limiting their application in text-to-audio generation deployment. In this work, we introduce AudioLCM, a novel consistency-based model tailored for efficient and high-quality text-to-audio generation. AudioLCM integrates Consistency Models into the generation process, facilitating rapid inference through a mapping from any point at any time step to the trajectory's initial point. To overcome the convergence issue inherent in LDMs with reduced sample iterations, we propose the Guided Latent Consistency Distillation with a multi-step Ordinary Differential Equation (ODE) solver. This innovation shortens the time schedule from thousands to dozens of steps while maintaining sample quality, thereby achieving fast convergence and high-quality generation. Furthermore, to optimize the performance of transformer-based neural network architectures, we integrate the advanced techniques pioneered by LLaMA into the foundational framework of transformers. This architecture supports stable and efficient training, ensuring robust performance in text-to-audio synthesis. Experimental results on text-to-sound generation and text-to-music synthesis tasks demonstrate that AudioLCM needs only 2 iterations to synthesize high-fidelity audios, while it maintains sample quality competitive with state-of-the-art models using hundreds of steps. AudioLCM enables a sampling speed of 333x faster than real-time on a single NVIDIA 4090Ti GPU, making generative models practically applicable to text-to-audio generation deployment. Our extensive preliminary analysis shows that each design in AudioLCM is effective.


title: Better coloring of 3-colorable graphs

abstract: We consider the problem of coloring a 3-colorable graph in polynomial time using as few colors as possible. This is one of the most challenging problems in graph algorithms. In this paper using Blum's notion of ``progress'', we develop a new combinatorial algorithm for the following: Given any 3-colorable graph with minimum degree $\ds>\sqrt n$, we can, in polynomial time, make progress towards a $k$-coloring for some $k=\sqrt{n/\ds}\cdot n^{o(1)}$. We balance our main result with the best-known semi-definite(SDP) approach which we use for degrees below $n^{0.605073}$. As a result, we show that $\tO(n^{0.19747})$ colors suffice for coloring 3-colorable graphs. This improves on the previous best bound of $\tO(n^{0.19996})$ by Kawarabayashi and Thorup in 2017.


title: Three-gap superconductivity with $T_{c}$ above 80 K in hydrogenated 2D monolayer LiBC

abstract: Although the metalization of semiconductor bulk LiBC has been experimentally achieved, various flaws, including the strong lattice distortion, the uncontrollability of phase transition under pressure, usually appear. In this work, based on the first-principles calculations, we propose a new way of hydrogenation to realize metalization. Using the fully anisotropic Migdal-Eliashberg theory, we investigate the superconducting behaviors in the stable monolayers LiBCH and LiCBH, in which C and B atoms are hydrogenated, respectively. Our findings indicate that the monolayers possess the high $T_{c}$ of 82.0 and 82.5 K, respectively, along with the interesting three-gap superconducting natures. The Fermi sheets showing the obvious three-region distribution characteristics and the abnormally strong electron-phonon coupling (EPC) are responsible for the high-$T_{c}$ three-gap superconductivity. Furthermore, the $T_{c}$ can be dramatically boosted up to 120.0 K under 3.5 \% tensile strain. To a great extent, the high $T_{c}$ is beyond the liquid nitrogen temperature ($77$ K), which is beneficial for the applications in future experiments. This study not only explores the superconducting properties of the monolayers LiBCH and LiCBH, but also offers practical insights into the search for high-$T_{c}$ superconductors.


title: Location Privacy in B5G/6G: Systematization of Knowledge

abstract: As we transition into the era of B5G/6G networks, the promise of seamless, high-speed connectivity brings unprecedented opportunities and challenges. Among the most critical concerns is the preservation of location privacy, given the enhanced precision and pervasive connectivity of these advanced networks. This paper systematically reviews the state of knowledge on location privacy in B5G/6G networks, highlighting the architectural advancements and infrastructural complexities that contribute to increased privacy risks. The urgency of studying these technologies is underscored by the rapid adoption of B5G/6G and the growing sophistication of location tracking methods. We evaluate current and emerging privacy-preserving mechanisms, exploring the implications of sophisticated tracking methods and the challenges posed by the complex network infrastructures. Our findings reveal the effectiveness of various mitigation strategies and emphasize the important role of physical layer security. Additionally, we propose innovative approaches, including decentralized authentication systems and the potential of satellite communications, to enhance location privacy. By addressing these challenges, this paper provides a comprehensive perspective on preserving user privacy in the rapidly evolving landscape of modern communication networks.


title: L2R-CIPU: Efficient CNN Computation with Left-to-Right Composite Inner Product Units

abstract: This paper proposes a composite inner-product computation unit based on left-to-right (LR) arithmetic for the acceleration of convolution neural networks (CNN) on hardware. The efficacy of the proposed L2R-CIPU method has been shown on the VGG-16 network, and assessment is done on various performance metrics. The L2R-CIPU design achieves 1.06x to 6.22x greater performance, 4.8x to 15x more TOPS/W, and 4.51x to 53.45x higher TOPS/mm2 than prior architectures.


title: Velocity decorrelation functions of high-energy cosmic rays propagating in magnetic fields

abstract: Diffusion tensor coefficients play a central role in describing cosmic-ray transport in various astrophysical environments permeated with magnetic fields, which are usually modeled as a fluctuating field on top of a mean field. In this article, a formal derivation of these coefficients is presented by means of the calculation of velocity decorrelation functions of particles. It relies mainly on expanding the 2-pt correlation function of the (fluctuating) magnetic field experienced by the particles between two successive times in the form of an infinite Dyson series and retaining a class of terms that converge to a physical solution. Subsequently, the velocity decorrelation functions, themselves expressed as Dyson series, are deduced from an iteration procedure that improves on the partial summation scheme. The results are shown to provide approximate solutions compared to those obtained by Monte-Carlo simulations as long as the Larmor radius of the particles is larger than at least one tenth of the largest scale of the turbulence.


title: Quasi-periodic Disturbance Observer for Wideband Harmonic Suppression

abstract: Periodic disturbances composed of harmonics usually appear during periodic operation, impairing performance in mechanical and electrical systems. To improve the performance, control for periodic-disturbance suppression has been studied, such as repetitive control and periodic-disturbance observer. For robustness against perturbations in each cycle, slight changes over cycles, slight variations in the period, and/or aperiodic disturbances, although wideband harmonic suppression is expected, the conventional methods have trade-offs among the wideband harmonic suppression, non-amplification of aperiodic disturbances, and deviation of harmonic suppression frequencies. This article proposes a quasi-periodic disturbance observer to estimate and compensate for a quasi-periodic disturbance. The quasi-periodic disturbance is defined to consist of harmonics and surrounding signals, based on which the quasi-periodic disturbance observer is designed using a periodic-pass filter of a first-order periodic/aperiodic separation filter, time delay integrated with a zero-phase low-pass filter, and an inverse plant model with a first-order low-pass filter. For the implementation of the proposed observer, its Q-filter is discretized by the exact mapping of the s-plane to the z-plane, and the inverse plant model is discretized by the backward Euler method. The experiments validated the frequency response and position-control precision of the quasi-periodic disturbance observer in comparison with conventional methods.


title: Exploring quantum localization with machine learning

abstract: We introduce an efficient neural network (NN) architecture for classifying wave functions in terms of their localization. Our approach integrates a versatile quantum phase space parametrization leading to a custom 'quantum' NN, with the pattern recognition capabilities of a modified convolutional model. This design accepts wave functions of any dimension as inputs and makes accurate predictions at an affordable computational cost. This scalability becomes crucial to explore the localization rate at the semiclassical limit, a long standing question in the quantum scattering field. Moreover, the physical meaning built in the model allows for the interpretation of the learning process


title: Cognitive Manipulation: Semi-supervised Visual Representation and Classroom-to-real Reinforcement Learning for Assembly in Semi-structured Environments

abstract: Assembling a slave object into a fixture-free master object represents a critical challenge in flexible manufacturing. Existing deep reinforcement learning-based methods, while benefiting from visual or operational priors, often struggle with small-batch precise assembly tasks due to their reliance on insufficient priors and high-costed model development. To address these limitations, this paper introduces a cognitive manipulation and learning approach that utilizes skill graphs to integrate learning-based object detection with fine manipulation models into a cohesive modular policy. This approach enables the detection of the master object from both global and local perspectives to accommodate positional uncertainties and variable backgrounds, and parametric residual policy to handle pose error and intricate contact dynamics effectively. Leveraging the skill graph, our method supports knowledge-informed learning of semi-supervised learning for object detection and classroom-to-real reinforcement learning for fine manipulation. Simulation experiments on a gear-assembly task have demonstrated that the skill-graph-enabled coarse-operation planning and visual attention are essential for efficient learning and robust manipulation, showing substantial improvements of 13$\%$ in success rate and 15.4$\%$ in number of completion steps over competing methods. Real-world experiments further validate that our system is highly effective for robotic assembly in semi-structured environments.


title: SynthBA: Reliable Brain Age Estimation Across Multiple MRI Sequences and Resolutions

abstract: Brain age is a critical measure that reflects the biological ageing process of the brain. The gap between brain age and chronological age, referred to as brain PAD (Predicted Age Difference), has been utilized to investigate neurodegenerative conditions. Brain age can be predicted using MRIs and machine learning techniques. However, existing methods are often sensitive to acquisition-related variabilities, such as differences in acquisition protocols, scanners, MRI sequences, and resolutions, significantly limiting their application in highly heterogeneous clinical settings. In this study, we introduce Synthetic Brain Age (SynthBA), a robust deep-learning model designed for predicting brain age. SynthBA utilizes an advanced domain randomization technique, ensuring effective operation across a wide array of acquisition-related variabilities. To assess the effectiveness and robustness of SynthBA, we evaluate its predictive capabilities on internal and external datasets, encompassing various MRI sequences and resolutions, and compare it with state-of-the-art techniques. Additionally, we calculate the brain PAD in a large cohort of subjects with Alzheimer's Disease (AD), demonstrating a significant correlation with AD-related measures of cognitive dysfunction. SynthBA holds the potential to facilitate the broader adoption of brain age prediction in clinical settings, where re-training or fine-tuning is often unfeasible. The SynthBA source code and pre-trained models are publicly available at https://github.com/LemuelPuglisi/SynthBA.


title: Collective modes of nanoparticles levitated in a cavity: mechanical mode combs

abstract: Levitated nanoparticles are being investigated as ultrasensitive sensors of forces and accelerations, with applications ranging from fundamental physics phenomena such as dark matter or quantum gravity to real world applications. Quantum cooling in up to 2 motional modes was achieved recently, and attention is now turning to multimode and multiparticle regimes. We investigate here the spectral characteristics of collective motion of $\Ntot= 2-20 $ nanoparticle modes interacting via the optical light of a cavity. We find output spectra of collective motion typically exhibit two dominant generic features: a broad spectral feature, the collective bright mode (CBM) as expected; but we introduce also the mechanical mode comb (MC) a -- not previously studied -- spectral feature. We investigate numerically, and can also precisely reproduce all the intricate details of the MC spectra, including ponderomotive squeezing, with a simple closed-form expression. We show the mechanical comb can autonomously repair loss of teeth due to nanoparticle loss, a feature that may offer robustness to a levitated sensor of external forces.


title: RoBERTa-BiLSTM: A Context-Aware Hybrid Model for Sentiment Analysis

abstract: Effectively analyzing the comments to uncover latent intentions holds immense value in making strategic decisions across various domains. However, several challenges hinder the process of sentiment analysis including the lexical diversity exhibited in comments, the presence of long dependencies within the text, encountering unknown symbols and words, and dealing with imbalanced datasets. Moreover, existing sentiment analysis tasks mostly leveraged sequential models to encode the long dependent texts and it requires longer execution time as it processes the text sequentially. In contrast, the Transformer requires less execution time due to its parallel processing nature. In this work, we introduce a novel hybrid deep learning model, RoBERTa-BiLSTM, which combines the Robustly Optimized BERT Pretraining Approach (RoBERTa) with Bidirectional Long Short-Term Memory (BiLSTM) networks. RoBERTa is utilized to generate meaningful word embedding vectors, while BiLSTM effectively captures the contextual semantics of long-dependent texts. The RoBERTa-BiLSTM hybrid model leverages the strengths of both sequential and Transformer models to enhance performance in sentiment analysis. We conducted experiments using datasets from IMDb, Twitter US Airline, and Sentiment140 to evaluate the proposed model against existing state-of-the-art methods. Our experimental findings demonstrate that the RoBERTa-BiLSTM model surpasses baseline models (e.g., BERT, RoBERTa-base, RoBERTa-GRU, and RoBERTa-LSTM), achieving accuracies of 80.74%, 92.36%, and 82.25% on the Twitter US Airline, IMDb, and Sentiment140 datasets, respectively. Additionally, the model achieves F1-scores of 80.73%, 92.35%, and 82.25% on the same datasets, respectively.


title: Modeling Randomly Observed Spatiotemporal Dynamical Systems

abstract: Spatiotemporal processes are a fundamental tool for modeling dynamics across various domains, from heat propagation in materials to oceanic and atmospheric flows. However, currently available neural network-based modeling approaches fall short when faced with data collected randomly over time and space, as is often the case with sensor networks in real-world applications like crowdsourced earthquake detection or pollution monitoring. In response, we developed a new spatiotemporal method that effectively handles such randomly sampled data. Our model integrates techniques from amortized variational inference, neural differential equations, neural point processes, and implicit neural representations to predict both the dynamics of the system and the probabilistic locations and timings of future observations. It outperforms existing methods on challenging spatiotemporal datasets by offering substantial improvements in predictive accuracy and computational efficiency, making it a useful tool for modeling and understanding complex dynamical systems observed under realistic, unconstrained conditions.


title: Algebraic Geometrical Analysis of Metropolis Algorithm When Parameters Are Non-identifiable

abstract: The Metropolis algorithm is one of the Markov chain Monte Carlo (MCMC) methods that realize sampling from the target probability distribution. In this paper, we are concerned with the sampling from the distribution in non-identifiable cases that involve models with Fisher information matrices that may fail to be invertible. The theoretical adjustment of the step size, which is the variance of the candidate distribution, is difficult for non-identifiable cases. In this study, to establish such a principle, the average acceptance rate, which is used as a guideline to optimize the step size in the MCMC method, was analytically derived in non-identifiable cases. The optimization principle for the step size was developed from the viewpoint of the average acceptance rate. In addition, we performed numerical experiments on some specific target distributions to verify the effectiveness of our theoretical results.


title: Eery Space: Facilitating Virtual Meetings Through Remote Proxemics

abstract: Virtual meetings have become increasingly common with modern video-conference and collaborative software. While they allow obvious savings in time and resources, current technologies add unproductive layers of protocol to the flow of communication between participants, rendering the interactions far from seamless. In this work we introduce Remote Proxemics, an extension of proxemics aimed at bringing the syntax of co-located proximal interactions to virtual meetings. We propose Eery Space, a shared virtual locus that results from merging multiple remote areas, where meeting participants' are located side-by-side as if they shared the same physical location. Eery Space promotes collaborative content creation and seamless mediation of communication channels based on virtual proximity. Results from user evaluation suggest that our approach is effective at enhancing mutual awareness between participants and sufficient to initiate proximal exchanges regardless of their geolocation, while promoting smooth interactions between local and remote people alike. These results happen even in the absence of visual avatars and other social devices such as eye contact, which are largely the focus of previous approaches.


title: Alternative Methods to SHAP Derived from Properties of Kernels: A Note on Theoretical Analysis

abstract: This study first derives a general and analytical expression of AFA (Additive Feature Attribution) in terms of the kernel in LIME (Local Interpretable Model-agnostic Explanations). Then, we propose some new AFAs that have appropriate properties of kernels or that coincide with the LS prenucleolus in cooperative game theory. We also revisit existing AFAs such as SHAP (SHapley Additive exPlanations) and re-examine the properties of their kernels.


title: Performance Evaluation of Damping Systems in Civil Engineering Structures Via Minimal Sensor

abstract: To control structural responses under various actions, the growing use of supplementary damping systems in modern civil engineering structures necessitates inspecting and evaluating their operational performance postinstallation. However, due to the dispersed placement and complex nonlinearities of these devices, difficulties arise in determining minimal sensor configuration. This is inherently connected to a pivotal challenge: establishing a reliable input-output mapping, which comprises both the mathematical model and sensor arrangements. Prior work indicates this can be achieved through theoretical observability analysis or Lie symmetries analysis, both of which provide different perspectives on the existence of a way to access the solutions of a system identification problem uniquely (at least locally). The present study introduces a unified framework, enhanced by algorithm realization as an application guide, for analyzing the observability and Lie symmetries of a given input-output mapping. We demonstrate its implementation via examples of a building structure with various damping systems under different conditions such as seismic loads, wind loads, and operational vibrations. Finally, we present a case study for an isolation building with an inerter damper and minimal sensor arrangement under seismic action. The results demonstrate that the unscented Kalman filter, a system identification method, can precisely estimate structural responses and assess damping device performance once a reliable input-output mapping is established.


title: Analysis of three-body decays $B \to D (V \to ) PP $ under the factorization-assisted topological-amplitude approach

abstract: Motived by the accumulated experimental results on three-body charmed $B$ decays with resonance contributions in Babar, LHCb and Belle (II), we systematically analyze $B_{(s)} \to D_{(s)} (V \to) P_1 P_2 $ decays with $V$ representing a vector resonance ($\rho, K^*, \omega$ or $\phi$) and $P_{1,2}$ as a light pseudoscalar meson (pion or kaon). The intermediate subprocesses $B_{(s)} \to D_{(s)} V$ are calculated with the factorization-assisted topological-amplitude (FAT) approach and the intermediate resonant states $V$ described by the relativistic Breit-Wigner distribution successively decay to $P_1 P_2$ via strong interaction. Taking all lowest resonance states ($\rho, K^*, \omega, \phi$) into account, we calculate the branching fractions of these decay modes as well as the Breit-Wigner-tail effects for $B_{(s)} \to D_{(s)} (\rho ,\omega \to) KK$. Our results agree with the data by Babar, LHCb and Belle (II). Among the predictions that are still not observed, there are some branching ratios of order $10^{-6}-10^{-4}$ which are hopeful to be measured by LHCb and Belle II. Our approach and the perturbative QCD approach (PQCD) adopt the compatible theme to deal with the resonance contributions. What's more, our data for the intermediate two-body charmed $B$-meson decays in FAT approach are more precise. As a result, our results for branching fractions have smaller uncertainties, especially for color-suppressed emission diagram dominated modes.


title: Did I Vet You Before? Assessing the Chrome Web Store Vetting Process through Browser Extension Similarity

abstract: Web browsers, particularly Google Chrome and other Chromium-based browsers, have grown in popularity over the past decade, with browser extensions becoming an integral part of their ecosystem. These extensions can customize and enhance the user experience, providing functionality that ranges from ad blockers to, more recently, AI assistants. Given the ever-increasing importance of web browsers, distribution marketplaces for extensions play a key role in keeping users safe by vetting submissions that display abusive or malicious behavior. In this paper, we characterize the prevalence of malware and other infringing extensions in the Chrome Web Store (CWS), the largest distribution platform for this type of software. To do so, we introduce SimExt, a novel methodology for detecting similarly behaving extensions that leverages static and dynamic analysis, Natural Language Processing (NLP) and vector embeddings. Our study reveals significant gaps in the CWS vetting process, as 86% of infringing extensions are extremely similar to previously vetted items, and these extensions take months or even years to be removed. By characterizing the top kinds of infringing extension, we find that 83% are New Tab Extensions (NTEs) and raise some concerns about the consistency of the vetting labels assigned by CWS analysts. Our study also reveals that only 1% of malware extensions flagged by the CWS are detected as malicious by anti-malware engines, indicating a concerning gap between the threat landscape seen by CWS moderators and the detection capabilities of the threat intelligence community.


title: Teledrive: An Embodied AI based Telepresence System

abstract: This article presents Teledrive, a telepresence robotic system with embodied AI features that empowers an operator to navigate the telerobot in any unknown remote place with minimal human intervention. We conceive Teledrive in the context of democratizing remote care-giving for elderly citizens as well as for isolated patients, affected by contagious diseases. In particular, this paper focuses on the problem of navigating to a rough target area (like bedroom or kitchen) rather than pre-specified point destinations. This ushers in a unique AreaGoal based navigation feature, which has not been explored in depth in the contemporary solutions. Further, we describe an edge computing-based software system built on a WebRTC-based communication framework to realize the aforementioned scheme through an easy-to-use speech-based human-robot interaction. Moreover, to enhance the ease of operation for the remote caregiver, we incorporate a person following feature, whereby a robot follows a person on the move in its premises as directed by the operator. Moreover, the system presented is loosely coupled with specific robot hardware, unlike the existing solutions. We have evaluated the efficacy of the proposed system through baseline experiments, user study, and real-life deployment.


title: Approaching 100% Confidence in Stream Summary through ReliableSketch

abstract: To approximate sums of values in key-value data streams, sketches are widely used in databases and networking systems. They offer high-confidence approximations for any given key while ensuring low time and space overhead. While existing sketches are proficient in estimating individual keys, they struggle to maintain this high confidence across all keys collectively, an objective that is critically important in both algorithm theory and its practical applications. We propose ReliableSketch, the first to control the error of all keys to less than $\Lambda$ with a small failure probability $\Delta$, requiring only $O(1 + \Delta\ln\ln(\frac{N}{\Lambda}))$ amortized time and $O(\frac{N}{\Lambda} + \ln(\frac{1}{\Delta}))$ space. Furthermore, its simplicity makes it hardware-friendly, and we implement it on CPU servers, FPGAs, and programmable switches. Our experiments show that under the same small space, ReliableSketch not only keeps all keys' errors below $\Lambda$ but also achieves near-optimal throughput, outperforming competitors with thousands of uncontrolled estimations. We have made our source code publicly available.


title: Echoes and quasi-normal modes of perturbations around Schwarzchild traversable wormholes

abstract: We investigate the waveforms and quasi-normal modes around Schwarzschild traversable wormholes under different field perturbations, including the scalar field perturbation, the electromagnetic (vector) field perturbation and the gravitational (tensor) field perturbation. By comparing Schwarzschild traversable wormholes with Schwarzschild black holes, we find some unique properties for the former. At first, the perturbation waveform includes echoes and damping oscillations around Schwarzschild traversable wormholes, while it has only the damping waveform around Schwarzschild black holes. Secondly, the difference between adjacent peaks of echoes varies with the mass parameter and the defect parameter in the waveform around Schwarzschild traversable wormholes, while it always keeps constant around Schwarzschild black holes. Thirdly, the ordinary isospectrality between the odd and even parities no longer exists in the quasi-normal modes of gravitational perturbations around Schwarzschild traversable wormholes, but an alternative isospectrality appears. According to these properties, we summarize a scenario for estimating the mass parameter and the defect parameter of Schwarzschild traversable wormholes through the waveforms and quasi-normal modes. Our analyses provide a more profound comprehension of the inherent characteristics of Schwarzschild traversable wormholes.


title: Real-Time State Modulation and Acquisition Circuit in Neuromorphic Memristive Systems

abstract: Memristive neuromorphic systems are designed to emulate human perception and cognition, where the memristor states represent essential historical information to perform both low-level and high-level tasks. However, current systems face challenges with the separation of state modulation and acquisition, leading to undesired time delays that impact real-time performance. To overcome this issue, we introduce a dual-function circuit that concurrently modulates and acquires memristor state information. This is achieved through two key features: 1) a feedback operational amplifier (op-amp) based circuit that ensures precise voltage application on the memristor while converting the passing current into a voltage signal; 2) a division calculation circuit that acquires state information from the modulation voltage and the converted voltage, improving stability by leveraging the intrinsic threshold characteristics of memristors. This circuit has been evaluated in a memristor-based nociceptor and a memristor crossbar, demonstrating exceptional performance. For instance, it achieves mean absolute acquisition errors below 1 {\Omega} during the modulation process in the nociceptor application. These results demonstrate that the proposed circuit can operate at different scales, holding the potential to enhance a wide range of neuromorphic applications.


title: Impact disruption of Bjurb\"ole porous chondritic projectile

abstract: The ~200 m/s impact of a single 400-kg Bjurb\"ole L/LL ordinary chondrite meteorite onto sea ice resulted in the catastrophic disruption of the projectile. This resulted in a significant fraction of decimeter-sized fragments that exhibit power law cumulative size and mass distributions. This size range is underrepresented in impact experiments and asteroid boulder studies. The Bjurb\"ole projectile fragments share similarities in shape (sphericity, and roughness at small and large scale) with asteroid boulders. However, the mean aspect ratio (3D measurement) and apparent aspect ratio (2D measurement) of Bjurb\"ole fragment is 0.83 and 0.77, respectively, indicating that Bjurb\"ole fragments are more equidimensional compared to both fragments produced in smaller scale impact experiments and asteroid boulders. These differences may be attributed either to the fragment source (projectile vs. target), to the high porosity and low strength of Bjurb\"ole, to the lower impact velocity compared with typical asteroid collision velocities, or potentially to fragment erosion during sea sediment penetration or cleaning.


title: The Best of Both Worlds: Toward an Honest and Helpful Large Language Model

abstract: Large Language Models (LLMs) have achieved remarkable success across various industries due to their exceptional generative capabilities. However, for safe and effective real-world deployments, ensuring honesty and helpfulness is critical. This paper addresses the question: Can we prioritize the helpfulness of LLMs while preserving their honesty? To begin with, we establish exhaustive principles aimed at guaranteeing the honesty of LLM. Additionally, we introduce a novel dataset, referred to as HoneSet, comprising 930 queries spanning six categories meticulously crafted to assess an LLM's capacity for maintaining honesty. Subsequently, we present two approaches to augmenting honesty and helpfulness in LLMs: a training-free enhancement and a fine-tuning-based improvement. The training-free approach, which is based on curiosity-driven prompting, empowers LLMs to articulate internal confusion and uncertainty regarding queries, thereby optimizing their responses. Conversely, the fine-tuning-based method employs a two-stage process inspired by curriculum learning: initially instructing LLMs to discern between honest and dishonest responses, then refining their training to enhance helpfulness. Experiments conducted on nine prominent LLMs demonstrate a significant improvement in alignment with honesty across all models through the implementation of our proposed enhancements. Particularly noteworthy is the 65.3% enhancement observed in Llama3-8b and the remarkable 124.7% improvement in Mistral-7b, as measured by the H$^{2}$ (honest and helpful) assessment. We believe that our work can pave the way for developing more trustworthy LLMs for real-world applications.


title: On Fuchs' problem for finitely generated abelian groups: The small torsion case

abstract: A classical problem, raised by Fuchs in 1960, asks to classify the abelian groups which are groups of units of some rings. In this paper, we consider the case of finitely generated abelian groups, solving Fuchs' problem for such group with the additional assumption that the torsion subgroups are small, for a suitable notion of small related to the Pr\"ufer rank. As a concrete instance, we classify for each $n\ge2$ the realisable groups of the form $\mathbb{Z}/n\mathbb{Z}\times\mathbb{Z}^r$. Our tools require an investigation of the adjoint group of suitable radical rings of odd prime power order appearing in the picture, giving conditions under which the additive and adjoint groups are isomorphic. In the last section, we also deal with some groups of order a power of $2$, proving that the groups of the form $\mathbb{Z}/4\mathbb{Z}\times \mathbb{Z}/2^{u}\mathbb{Z}$ are realisable if and only if $0\le u\le 3$ or $2^u+1$ is a Fermat's prime.


title: Localized FDG loss in lung cancer lesions

abstract: Purpose: Analysis of [18F]-Fluorodeoxyglucose (FDG) kinetics in cancer has been most often limited to the evaluation of the average uptake over relatively large volumes. Nevertheless, tumor lesion almost contains inflammatory infiltrates whose cells are characterized by a significant radioactivity washout due to the hydrolysis of FDG-6P catalyzed by glucose-6P phosphatase. The present study aimed to verify whether voxel-wise compartmental analysis of dynamic imaging can identify tumor regions characterized by tracer washout. Materials & Methods: The study included 11 patients with lung cancer submitted to PET/CT imaging for staging purposes. Tumor was defined by drawing a volume of interest loosely surrounding the lesion and considering all inside voxels with standardized uptake value (SUV) >40% of the maximum. After 20 minutes dynamic imaging centered on the heart, eight whole body scans were repeated. Six parametric maps were progressively generated by computing six regression lines that considered all eight frames, the last seven ones, and so on, up to the last three. Results: Progressively delaying the starting point of regression line computation identified a progressive increase in the prevalence of voxels with a negative slope. Conclusions: The voxel-wise parametric maps provided by compartmental analysis permits to identify a measurable volume characterized by radioactivity washout. The spatial localization of this pattern is compatible with the recognized preferential site of inflammatory infiltrates populating the tumor stroma and might improve the power of FDG imaging in monitoring the effectiveness of treatments aimed to empower the host immune response against the cancer.


title: SpikeMM: Flexi-Magnification of High-Speed Micro-Motions

abstract: The amplification of high-speed micro-motions holds significant promise, with applications spanning fault detection in fast-paced industrial environments to refining precision in medical procedures. However, conventional motion magnification algorithms often encounter challenges in high-speed scenarios due to low sampling rates or motion blur. In recent years, spike cameras have emerged as a superior alternative for visual tasks in such environments, owing to their unique capability to capture temporal and spatial frequency domains with exceptional fidelity. Unlike conventional cameras, which operate at fixed, low frequencies, spike cameras emulate the functionality of the retina, asynchronously capturing photon changes at each pixel position using spike streams. This innovative approach comprehensively records temporal and spatial visual information, rendering it particularly suitable for magnifying high-speed micro-motions.This paper introduces SpikeMM, a pioneering spike-based algorithm tailored specifically for high-speed motion magnification. SpikeMM integrates multi-level information extraction, spatial upsampling, and motion magnification modules, offering a self-supervised approach adaptable to a wide range of scenarios. Notably, SpikeMM facilitates seamless integration with high-performance super-resolution and motion magnification algorithms. We substantiate the efficacy of SpikeMM through rigorous validation using scenes captured by spike cameras, showcasing its capacity to magnify motions in real-world high-frequency settings.


title: CapeX: Category-Agnostic Pose Estimation from Textual Point Explanation

abstract: Conventional 2D pose estimation models are constrained by their design to specific object categories. This limits their applicability to predefined objects. To overcome these limitations, category-agnostic pose estimation (CAPE) emerged as a solution. CAPE aims to facilitate keypoint localization for diverse object categories using a unified model, which can generalize from minimal annotated support images. Recent CAPE works have produced object poses based on arbitrary keypoint definitions annotated on a user-provided support image. Our work departs from conventional CAPE methods, which require a support image, by adopting a text-based approach instead of the support image. Specifically, we use a pose-graph, where nodes represent keypoints that are described with text. This representation takes advantage of the abstraction of text descriptions and the structure imposed by the graph. Our approach effectively breaks symmetry, preserves structure, and improves occlusion handling. We validate our novel approach using the MP-100 benchmark, a comprehensive dataset spanning over 100 categories and 18,000 images. Under a 1-shot setting, our solution achieves a notable performance boost of 1.07\%, establishing a new state-of-the-art for CAPE. Additionally, we enrich the dataset by providing text description annotations, further enhancing its utility for future research.


title: A Broadband 3-D Numerical FEM Study on the Characterization of Dielectric Relaxation Processes in Soils

abstract: Soil as a complex multi-phase porous material typical exhibits several distributed relaxation processes in the frequency range from 1 MHz to approximately 10 GHz of interest in applications. To relate physico-chemical material parameters to the dielectric relaxation behavior, measured dielectric relaxation spectra have to be parameterized. In this context, a broadband numerical 3D FEM study was carried out to analyze the possibilities and limitations in the characterization of the relaxation processes in complex systems.


title: A modified dyon solution in a non-Abelian gauge model

abstract: A modified $SU(2)$ Georgi-Glashow model is considered here, and it is shown that besides the well-known Julia-Zee dyon solution, the model can also have a modified dyon solution. The properties of the modified dyon solution are studied using analytical and numerical methods. A comparative analysis of the modified dyon and the Julia-Zee dyon shows that their properties are significantly different. In particular, except for the BPS case, the energy and electric charge of the modified dyons exceed considerably those of the Julia-Zee dyons. At the same time, the energy and electric charge of the modified dyon are bounded for all admissible parameter values, whereas those of the Julia-Zee dyon can be arbitrarily large in the BPS case.


title: Upper limit on axion-photon coupling from Markarian 421

abstract: We obtain a stringent upper limit on axion-photon coupling from the 1038 days gamma-ray observations of the TeV blazar Markarian 421. The long-term VHE gamma-ray spectra are measured by the collaborations Fermi-LAT and HAWC from 2015 June to 2018 July. We show the best-fit SEDs of Markarian 421 under the null and axion hypotheses. Then we set the axion-photon limit in the $\{m_a, \, g_{a\gamma}\}$ plane. The 99% $\rm C.L.$ upper limit set by Markarian 421 is $g_{a\gamma} \lesssim 4.0\times 10^{-12} \rm \, GeV^{-1}$ for the axion mass $[1.0\times10^{-9} \, {\rm eV} \lesssim m_a \lesssim 1.0\times10^{-8} \, {\rm eV}]$. It is the most stringent upper limit in this axion mass region.


title: Products, Abstractions and Inclusions of Causal Spaces

abstract: Causal spaces have recently been introduced as a measure-theoretic framework to encode the notion of causality. While it has some advantages over established frameworks, such as structural causal models, the theory is so far only developed for single causal spaces. In many mathematical theories, not least the theory of probability spaces of which causal spaces are a direct extension, combinations of objects and maps between objects form a central part. In this paper, taking inspiration from such objects in probability theory, we propose the definitions of products of causal spaces, as well as (stochastic) transformations between causal spaces. In the context of causality, these quantities can be given direct semantic interpretations as causally independent components, abstractions and extensions.


title: Understanding the Convergence in Balanced Resonate-and-Fire Neurons

abstract: Resonate-and-Fire (RF) neurons are an interesting complementary model for integrator neurons in spiking neural networks (SNNs). Due to their resonating membrane dynamics they can extract frequency patterns within the time domain. While established RF variants suffer from intrinsic shortcomings, the recently proposed balanced resonate-and-fire (BRF) neuron marked a significant methodological advance in terms of task performance, spiking and parameter efficiency, as well as, general stability and robustness, demonstrated for recurrent SNNs in various sequence learning tasks. One of the most intriguing result, however, was an immense improvement in training convergence speed and smoothness, overcoming the typical convergence dilemma in backprop-based SNN training. This paper aims at providing further intuitions about how and why these convergence advantages emerge. We show that BRF neurons, in contrast to well-established ALIF neurons, span a very clean and smooth - almost convex - error landscape. Furthermore, empirical results reveal that the convergence benefits are predominantly coupled with a divergence boundary-aware optimization, a major component of the BRF formulation that addresses the numerical stability of the time-discrete resonator approximation. These results are supported by a formal investigation of the membrane dynamics indicating that the gradient is transferred back through time without loss of magnitude.


title: AI-based data assimilation: Learning the functional of analysis estimation

abstract: The integration of observational data into numerical models, known as data assimilation (DA), is fundamental for making Numerical Weather Prediction (NWP) possible, with breathtaking success over the past 60 years (Bauer et al. 2015). Traditional DA methods, such as variational techniques and ensemble Kalman filters, are basic pillars of current NWP by incorporating diverse observational data. However, the emergence of artificial intelligence (AI) presents new opportunities for further improvements. AI-based approaches can emulate the complex computations of traditional NWP models at a reduced computational cost, offering the potential to speed up and improve analyses and forecasts dramatically (e.g. Pathak et al., 2022; Bi et al., 2023; Lam et al., 2023; Bouallegue et al., 2023). AI itself plays a growing role in optimization (e.g. Fan et al., 2024), which offers new possibilities also beyond model emulation. In this paper, we introduce a novel AI-based variational DA approach designed to replace classical methods of DA by leveraging deep learning techniques. Unlike previous hybrid approaches, our method integrates the DA process directly into a neural network, utilizing the variational DA framework. This innovative AI-based system, termed AI-Var, employs a neural network trained to minimize the variational cost function, enabling it to perform DA without relying on pre-existing analysis datasets. We present a proof-of-concept implementation of this approach, demonstrating its feasibility through a series of idealized and real-world test cases. Our results indicate that the AI-Var system can efficiently assimilate observations and produce accurate initial conditions for NWP, highlighting its potential to carry out the DA process in weather forecasting. This advancement paves the way for fully data-driven NWP systems, offering a significant leap forward in computational efficiency.


title: DS@BioMed at ImageCLEFmedical Caption 2024: Enhanced Attention Mechanisms in Medical Caption Generation through Concept Detection Integration

abstract: Purpose: Our study presents an enhanced approach to medical image caption generation by integrating concept detection into attention mechanisms. Method: This method utilizes sophisticated models to identify critical concepts within medical images, which are then refined and incorporated into the caption generation process. Results: Our concept detection task, which employed the Swin-V2 model, achieved an F1 score of 0.58944 on the validation set and 0.61998 on the private test set, securing the third position. For the caption prediction task, our BEiT+BioBart model, enhanced with concept integration and post-processing techniques, attained a BERTScore of 0.60589 on the validation set and 0.5794 on the private test set, placing ninth. Conclusion: These results underscore the efficacy of concept-aware algorithms in generating precise and contextually appropriate medical descriptions. The findings demonstrate that our approach significantly improves the quality of medical image captions, highlighting its potential to enhance medical image interpretation and documentation, thereby contributing to improved healthcare outcomes.


title: Artificial Generational Intelligence: Cultural Accumulation in Reinforcement Learning

abstract: Cultural accumulation drives the open-ended and diverse progress in capabilities spanning human history. It builds an expanding body of knowledge and skills by combining individual exploration with inter-generational information transmission. Despite its widespread success among humans, the capacity for artificial learning agents to accumulate culture remains under-explored. In particular, approaches to reinforcement learning typically strive for improvements over only a single lifetime. Generational algorithms that do exist fail to capture the open-ended, emergent nature of cultural accumulation, which allows individuals to trade-off innovation and imitation. Building on the previously demonstrated ability for reinforcement learning agents to perform social learning, we find that training setups which balance this with independent learning give rise to cultural accumulation. These accumulating agents outperform those trained for a single lifetime with the same cumulative experience. We explore this accumulation by constructing two models under two distinct notions of a generation: episodic generations, in which accumulation occurs via in-context learning and train-time generations, in which accumulation occurs via in-weights learning. In-context and in-weights cultural accumulation can be interpreted as analogous to knowledge and skill accumulation, respectively. To the best of our knowledge, this work is the first to present general models that achieve emergent cultural accumulation in reinforcement learning, opening up new avenues towards more open-ended learning systems, as well as presenting new opportunities for modelling human culture.


title: Gender Bias Detection in Court Decisions: A Brazilian Case Study

abstract: Data derived from the realm of the social sciences is often produced in digital text form, which motivates its use as a source for natural language processing methods. Researchers and practitioners have developed and relied on artificial intelligence techniques to collect, process, and analyze documents in the legal field, especially for tasks such as text summarization and classification. While increasing procedural efficiency is often the primary motivation behind natural language processing in the field, several works have proposed solutions for human rights-related issues, such as assessment of public policy and institutional social settings. One such issue is the presence of gender biases in court decisions, which has been largely studied in social sciences fields; biased institutional responses to gender-based violence are a violation of international human rights dispositions since they prevent gender minorities from accessing rights and hamper their dignity. Natural language processing-based approaches can help detect these biases on a larger scale. Still, the development and use of such tools require researchers and practitioners to be mindful of legal and ethical aspects concerning data sharing and use, reproducibility, domain expertise, and value-charged choices. In this work, we (a) present an experimental framework developed to automatically detect gender biases in court decisions issued in Brazilian Portuguese and (b) describe and elaborate on features we identify to be critical in such a technology, given its proposed use as a support tool for research and assessment of court~activity.


title: Learning Causal Abstractions of Linear Structural Causal Models

abstract: The need for modelling causal knowledge at different levels of granularity arises in several settings. Causal Abstraction provides a framework for formalizing this problem by relating two Structural Causal Models at different levels of detail. Despite increasing interest in applying causal abstraction, e.g. in the interpretability of large machine learning models, the graphical and parametrical conditions under which a causal model can abstract another are not known. Furthermore, learning causal abstractions from data is still an open problem. In this work, we tackle both issues for linear causal models with linear abstraction functions. First, we characterize how the low-level coefficients and the abstraction function determine the high-level coefficients and how the high-level model constrains the causal ordering of low-level variables. Then, we apply our theoretical results to learn high-level and low-level causal models and their abstraction function from observational data. In particular, we introduce Abs-LiNGAM, a method that leverages the constraints induced by the learned high-level model and the abstraction function to speedup the recovery of the larger low-level model, under the assumption of non-Gaussian noise terms. In simulated settings, we show the effectiveness of learning causal abstractions from data and the potential of our method in improving scalability of causal discovery.


title: Holomorphic symplectic manifolds from semistable Higgs bundles

abstract: Let $\mathcal{M}_{C}(2, 0)$ be the moduli space of semistable rank two and degree zero Higgs bundles on a smooth complex hyperelliptic curve $C$ of genus three. We prove that the quotient of $\mathcal{M}_{C}(2, 0)$ by a twisted version of the hyperelliptic involution is an 18-dimensional holomorphic symplectic variety admitting a crepant resolution, whose local model was studied by Kaledin and Lehn to describe O'Grady's singularities. Similarly, by considering the moduli space of Higgs bundles with trivial determinant $\mathcal{M}_C(2, \mathcal{O}_{C})\subseteq \mathcal{M}_C(2, 0)$, we show that the quotient of $\mathcal{M}_C(2, \mathcal{O}_{C})$ by the hyperelliptic involution is a 12-dimensional holomorphic symplectic variety admitting a crepant resolution.


title: Stochastic Restarting to Overcome Overfitting in Neural Networks with Noisy Labels

abstract: Despite its prevalence, giving up and starting over may seem wasteful in many situations such as searching for a target or training deep neural networks (DNNs). Our study, though, demonstrates that restarting from a checkpoint can significantly improve generalization performance when training DNNs with noisy labels. In the presence of noisy labels, DNNs initially learn the general patterns of the data but then gradually overfit to the noisy labels. To combat this overfitting phenomenon, we developed a method based on stochastic restarting, which has been actively explored in the statistical physics field for finding targets efficiently. By approximating the dynamics of stochastic gradient descent into Langevin dynamics, we theoretically show that restarting can provide great improvements as the batch size and the proportion of corrupted data increase. We then empirically validate our theory, confirming the significant improvements achieved by restarting. An important aspect of our method is its ease of implementation and compatibility with other methods, while still yielding notably improved performance. We envision it as a valuable tool that can complement existing methods for handling noisy labels.


title: Remeasuring the $\gamma$-decay branching ratio of the Hoyle state

abstract: The radiative branching ratio of the Hoyle state is crucial to estimate the triple-$\alpha$ reaction rate in stellar environments at medium temperatures. Knowledge of the $\gamma$-decay channel is critical as this is the dominant radiative decay channel for the Hoyle state. A recent study by Kib\'edi et al. [Phys. Rev. Lett. 125, 182701 (2020)] has challenged our understanding of this astrophysically significant branching ratio and its constraints. The objective of this work was to perform a new measurement of the $\gamma$-decay branching ratio of the Hoyle state to deduce the radiative branching ratio of the Hoyle state. An additional objective was to independently verify aspects of the aforementioned measurement conducted by Kib\'edi et al. For the main experiment of this work, the Hoyle state was populated by the $^{12}\textrm{C}(p,p')$ reaction at 10.8 MeV at the Oslo Cyclotron Laboratory. The $\gamma$-decay branching ratio was deduced through triple-coincidence events, each consisting of a proton ejectile corresponding to the Hoyle state, and the subsequent $\gamma$-ray cascade. In the main experiment of this work, a $\gamma$-decay branching ratio of the Hoyle state of $\Gamma_{\gamma}/\Gamma=4.0(4)\times 10^{-4}$ was determined, yielding a corresponding radiative branching ratio of $\Gamma_{\textrm{rad}}/\Gamma=4.1(4) \times 10^{-4}$, which is in agreement with several recent studies, as well as the previously adopted ENSDF average of $\Gamma_{\textrm{rad}}/\Gamma=4.16(11)\times 10^{-4}$. Aspects of the analysis performed by Kib\'edi et al. were verified in this work and the source of discrepancy between the results of this work and that of Kib\'edi et al. could not be determined. Further independent and innovative studies for the radiative width of the Hoyle state will substantiate whether the discrepant result by Kib\'edi et al. should be excluded from future evaluations.


title: Shadowing of non-transversal heteroclinic chains in lattices

abstract: We deal with dynamical systems on complex lattices possessing chains of non-transversal heteroclinic connections between several periodic orbits. The systems we consider are inspired by the so-called \emph{toy model systems} (TMS) used to prove the existence of energy transfer from low to high frequencies in the \emph{nonlinear cubic Schr\"odinger equation} (NLS) or generalizations. Using the geometric properties of the complex projective space as a base space, we generate in a natural way collections of such systems containing this type of chains, both in the Hamiltonian and in the non-Hamiltonian setting. On the other hand, we characterize the property of block diagonal dynamics along the heteroclinic connections that allows these chains to be shadowed, a property which in general only holds for transversal heteroclinic connections. Due to the lack of transversality, only finite chains are shadowed, since there is a dropping dimensions mechanism in the evolution of any disk close to them. The main shadowing technical tool used in our work is the notion of covering relations as introduced by one of the authors.


title: Patterned Beam Training: A Novel Low-Complexity and Low-Overhead Scheme for ELAA

abstract: Extremely large antenna arrays (ELAAs) can provide higher spectral efficiency. However, the use of narrower beams for data transmission significantly increases the overhead associated with beam training. In this letter, we propose a novel patterned beam training (PBT) scheme characterized by its low overhead and complexity. This scheme requires only a single linear operation by both the base station and the user equipment to determine the optimal beam, reducing the training overhead to half or even less compared to traditional exhaustive search methods. Furthermore, We discuss the pattern design principles in detail and provide specific forms. Simulation results demonstrate that the proposed scheme outperforms the compared methods in terms of beam alignment accuracy and achieves a balance between signal-to-noise ratio (SNR) conditions and training overhead, making it a promising alternative.


title: A structure theorem for syzygies of del Pezzo varieties

abstract: Using the Buchsbaum-Eisenbud structure theorem for a minimal free resolution of an arithmetically Gorenstein variety, we describe a structure theorem for the highest linear syzygies among quadrics defining a del Pezzo variety. Indeed, such syzygies can be represented as columns of a skew-symmetric matrix whose entries are wedge products of linear forms.


title: Hamilton paths and cycles in the 3-uniform cube hypergraph

abstract: The $d$-dimensional hypercube is the $d$-dimensional generalisation of a square $(d=2)$ and a cube $(d=3)$. Formally, it is the graph with vertex set $\{0,1\}^d$ and edges connecting any two vertices that differ in exactly one coordinate. These vertices represent the corners of the hypercube, while the edges establish connections between these corners. It is well-known that for $d \geq 2$ the $d$-dimensional hypercube contains a Hamilton cycle, which is a path that visits every vertex exactly once and returns to the starting vertex. In this thesis we address the analogous problem for the $3$-uniform cube hypergraph, a $3$-uniform analogue of the hypercube. In contrast to the ordinary hypercube, the vertex set is now $\{0,1,2\}^d$ and edges consist of three instead of two vertices. We will examine the $3$-uniform cube hypergraph and consider a number of different definitions of paths and cycles. Our strongest result concerns loose paths: for simple parity reasons, the $3$-uniform cube hypergraph can never admit a loose Hamilton cycle in any dimension, but we determine for which dimensions a loose Hamilton path exists.


title: Reconfigurable FPGA-Based Solvers For Sparse Satellite Control

abstract: This paper introduces a novel reconfigurable and power-efficient FPGA (Field-Programmable Gate Array) implementation of an operator splitting algorithm for Non-Terrestial Network's (NTN) relay satellites model predictive orientation control (MPC). Our approach ensures system stability and introduces an innovative reconfigurable bit-width FPGA-based optimization solver. To demonstrate its efficacy, we employ a real FPGA-In-the-Loop hardware setup to control simulated satellite dynamics. Furthermore, we conduct an in-depth comparative analysis, examining various fixed-point configurations to evaluate the combined system's closed-loop performance and power efficiency, providing a holistic understanding of the proposed implementation's advantages.


title: Dual-perspective Cross Contrastive Learning in Graph Transformers

abstract: Graph contrastive learning (GCL) is a popular method for leaning graph representations by maximizing the consistency of features across augmented views. Traditional GCL methods utilize single-perspective i.e. data or model-perspective) augmentation to generate positive samples, restraining the diversity of positive samples. In addition, these positive samples may be unreliable due to uncontrollable augmentation strategies that potentially alter the semantic information. To address these challenges, this paper proposed a innovative framework termed dual-perspective cross graph contrastive learning (DC-GCL), which incorporates three modifications designed to enhance positive sample diversity and reliability: 1) We propose dual-perspective augmentation strategy that provide the model with more diverse training data, enabling the model effective learning of feature consistency across different views. 2) From the data perspective, we slightly perturb the original graphs using controllable data augmentation, effectively preserving their semantic information. 3) From the model perspective, we enhance the encoder by utilizing more powerful graph transformers instead of graph neural networks. Based on the model's architecture, we propose three pruning-based strategies to slightly perturb the encoder, providing more reliable positive samples. These modifications collectively form the DC-GCL's foundation and provide more diverse and reliable training inputs, offering significant improvements over traditional GCL methods. Extensive experiments on various benchmarks demonstrate that DC-GCL consistently outperforms different baselines on various datasets and tasks.


title: The universal property of bordism of commuting involutions

abstract: We propose a formalism to capture the structure of the equivariant bordism rings of smooth manifolds with commuting involutions. We introduce the concept of an oriented el$_2^{RO}$-algebra, an algebraic structure featuring representation graded rings for all elementary abelian 2-groups, connected by restriction homomorphisms, a pre-Euler class, and an inverse Thom class; this data is subject to one exactness property. Besides equivariant bordism, oriented global ring spectra also give rise to oriented el$_2^{RO}$-algebras, so examples abound. Inverting the inverse Thom classes yields a global 2-torsion group law. In this sense, our oriented el$_2^{RO}$-algebras are delocalized generalizations of global 2-torsion group laws. Our main result shows that equivariant bordism for elementary abelian 2-groups is an initial oriented el$_2^{RO}$-algebra. Several other interesting equivariant homology theories can also be characterized, on elementary abelian 2-groups, by similar universal properties. We prove that stable equivariant bordism is an initial el$_2^{RO}$-algebra with an invertible orientation; that Bredon homology with constant mod 2 coefficients is an initial el$_2^{RO}$-algebra with an additive orientation; and that Borel equivariant homology with mod 2 coefficients is an initial el$_2^{RO}$-algebra with an orientation that is both additive and invertible.


title: Autaptic Synaptic Circuit Enhances Spatio-temporal Predictive Learning of Spiking Neural Networks

abstract: Spiking Neural Networks (SNNs) emulate the integrated-fire-leak mechanism found in biological neurons, offering a compelling combination of biological realism and energy efficiency. In recent years, they have gained considerable research interest. However, existing SNNs predominantly rely on the Leaky Integrate-and-Fire (LIF) model and are primarily suited for simple, static tasks. They lack the ability to effectively model long-term temporal dependencies and facilitate spatial information interaction, which is crucial for tackling complex, dynamic spatio-temporal prediction tasks. To tackle these challenges, this paper draws inspiration from the concept of autaptic synapses in biology and proposes a novel Spatio-Temporal Circuit (STC) model. The STC model integrates two learnable adaptive pathways, enhancing the spiking neurons' temporal memory and spatial coordination. We conduct a theoretical analysis of the dynamic parameters in the STC model, highlighting their contribution in establishing long-term memory and mitigating the issue of gradient vanishing. Through extensive experiments on multiple spatio-temporal prediction datasets, we demonstrate that our model outperforms other adaptive models. Furthermore, our model is compatible with existing spiking neuron models, thereby augmenting their dynamic representations. In essence, our work enriches the specificity and topological complexity of SNNs.


title: Difference sets and positive exponential sums II: cubic residues in cyclic groups

abstract: By constructing suitable nonnegative exponential sums we give upper bounds on the cardinality of any set $B_q$ in cyclic groups $\ZZ_q$ such that the difference set $B_q-B_q$ avoids cubic residues modulo $q$.


title: Computer Simulation of DNA Computing-Based Boolean Matrix Multiplication

abstract: DNA computing is an unconventional approach to computing that harnesses the parallelism and information storage capabilities of DNA molecules. It has emerged as a promising field with potential applications in solving a variety of computationally complex problems. This paper explores a DNA computing algorithm for Boolean matrix multiplication proposed by Nobuyuki et al. (2006) using a computer simulation, inspired by similar work done in the past by Obront (2021) for the DNA computing algorithm developed by Adleman (1994) for solving the Hamiltonian path problem. We develop a Python program to simulate the logical operations involved in the DNA-based Boolean matrix multiplication algorithm. The simulation replicates the key steps of the algorithm, including DNA sequence generation and hybridization, without imitating the physical behaviour of the DNA molecules. It is intended to serve as a basic prototype for larger, more comprehensive DNA computing simulators that can be used as educational or research tools in the future. Through this work, we aim to contribute to the understanding of DNA-based computing paradigms and their potential advantages and trade-offs compared to conventional computing systems, paving the way for future research and advancements in this emerging field.


title: Optimizing 6G Integrated Sensing and Communications (ISAC) via Expert Networks

abstract: Integrated Sensing and Communications (ISAC) is one of the core technologies of 6G, which combines sensing and communication functions into a single system. However, limited computing and storage resources make it impractical to combine multiple sensing models into a single device, constraining the system's function and performance. Therefore, this article proposes enhancing ISAC with the mixture of experts (MoE) architecture. Rigorously, we first investigate ISAC and MoE, including their concepts, advantages, and applications. Then, we explore how MoE can enhance ISAC from the perspectives of signal processing and network optimization. Building on this, we propose an MoE based ISAC framework, which uses a gating network to selectively activate multiple experts in handling sensing tasks under given communication conditions, thereby improving the overall performance. The case study demonstrates that the proposed framework can effectively increase the accuracy and robustness in detecting targets by using wireless communication signal, providing strong support for the practical deployment and applications of the ISAC system.


title: Arabic Handwritten Text for Person Biometric Identification: A Deep Learning Approach

abstract: This study thoroughly investigates how well deep learning models can recognize Arabic handwritten text for person biometric identification. It compares three advanced architectures -- ResNet50, MobileNetV2, and EfficientNetB7 -- using three widely recognized datasets: AHAWP, Khatt, and LAMIS-MSHD. Results show that EfficientNetB7 outperforms the others, achieving test accuracies of 98.57\%, 99.15\%, and 99.79\% on AHAWP, Khatt, and LAMIS-MSHD datasets, respectively. EfficientNetB7's exceptional performance is credited to its innovative techniques, including compound scaling, depth-wise separable convolutions, and squeeze-and-excitation blocks. These features allow the model to extract more abstract and distinctive features from handwritten text images. The study's findings hold significant implications for enhancing identity verification and authentication systems, highlighting the potential of deep learning in Arabic handwritten text recognition for person biometric identification.


title: Posterior Label Smoothing for Node Classification

abstract: Soft labels can improve the generalization of a neural network classifier in many domains, such as image classification. Despite its success, the current literature has overlooked the efficiency of label smoothing in node classification with graph-structured data. In this work, we propose a simple yet effective label smoothing for the transductive node classification task. We design the soft label to encapsulate the local context of the target node through the neighborhood label distribution. We apply the smoothing method for seven baseline models to show its effectiveness. The label smoothing methods improve the classification accuracy in 10 node classification datasets in most cases. In the following analysis, we find that incorporating global label statistics in posterior computation is the key to the success of label smoothing. Further investigation reveals that the soft labels mitigate overfitting during training, leading to better generalization performance.


title: Work extraction from quantum coherence in non-equilibrium environment

abstract: Ergotropy, as a measure for extractable work from a quantum system, has garnered significant attention due to its relevance in quantum thermodynamics and information processing. In this work, the dynamics of ergotropy will be investigated in a nonequilibrium environment for both Markovian and non-Markovian regime. In this study, both the coherent and incoherent parts of the ergotropy will be considered. It will be shown that for a non-equilibrium environment, the extraction of work is more efficient compared to when the environment is in equilibrium.


title: Essential norm of generalized Integral type Operators from Mixed-Norm to Zygmund-Type Spaces

abstract: In this paper, we consider the generalized integration operator from mixed-norm space into Zygmund-type and Bloch-type spaces and find an estimation for the essential norm of this operator.


title: ADHM Wilson line defect indices

abstract: The Coulomb and Higgs indices of the 3d $\mathcal{N}=4$ $U(N)$ ADHM theories can be decorated by line defect operators as the line defect correlators. We obtain exact closed-form expressions and various non-trivial algebraic relations for the correlators of the Wilson lines in the fundamental and (anti)symmetric representations by means of the Hall-Littlewood expansion, the Fermi-gas method and the residue calculation. From the large $N$ limit of the correlators we obtain the single particle gravity indices which are expected to encode the spectra of fluctuation modes on the gravity duals of line operators in M2-brane SCFTs.


title: Large Deviations Analysis For Regret Minimizing Stochastic Approximation Algorithms

abstract: Motivated by learning of correlated equilibria in non-cooperative games, we perform a large deviations analysis of a regret minimizing stochastic approximation algorithm. The regret minimization algorithm we consider comprises multiple agents that communicate over a graph to coordinate their decisions. We derive an exponential decay rate towards the algorithm's stable point using large deviations theory. Our analysis leverages the variational representation of the Laplace functionals and weak convergence methods to characterize the exponential decay rate.


title: Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives

abstract: Although several surveys on Neural Combinatorial Optimization (NCO) solvers specifically designed to solve Vehicle Routing Problems (VRPs) have been conducted. These existing surveys did not cover the state-of-the-art (SOTA) NCO solvers emerged recently. More importantly, to provide a comprehensive taxonomy of NCO solvers with up-to-date coverage, based on our thorough review of relevant publications and preprints, we divide all NCO solvers into four distinct categories, namely Learning to Construct, Learning to Improve, Learning to Predict-Once, and Learning to Predict-Multiplicity solvers. Subsequently, we present the inadequacies of the SOTA solvers, including poor generalization, incapability to solve large-scale VRPs, inability to address most types of VRP variants simultaneously, and difficulty in comparing these NCO solvers with the conventional Operations Research algorithms. Simultaneously, we propose promising and viable directions to overcome these inadequacies. In addition, we compare the performance of representative NCO solvers from the Reinforcement, Supervised, and Unsupervised Learning paradigms across both small- and large-scale VRPs. Finally, following the proposed taxonomy, we provide an accompanying web page as a live repository for NCO solvers. Through this survey and the live repository, we hope to make the research community of NCO solvers for VRPs more thriving.


title: Representation and De-interleaving of Mixtures of Hidden Markov Processes

abstract: De-interleaving of the mixtures of Hidden Markov Processes (HMPs) generally depends on its representation model. Existing representation models consider Markov chain mixtures rather than hidden Markov, resulting in the lack of robustness to non-ideal situations such as observation noise or missing observations. Besides, de-interleaving methods utilize a search-based strategy, which is time-consuming. To address these issues, this paper proposes a novel representation model and corresponding de-interleaving methods for the mixtures of HMPs. At first, a generative model for representing the mixtures of HMPs is designed. Subsequently, the de-interleaving process is formulated as a posterior inference for the generative model. Secondly, an exact inference method is developed to maximize the likelihood of the complete data, and two approximate inference methods are developed to maximize the evidence lower bound by creating tractable structures. Then, a theoretical error probability lower bound is derived using the likelihood ratio test, and the algorithms are shown to get reasonably close to the bound. Finally, simulation results demonstrate that the proposed methods are highly effective and robust for non-ideal situations, outperforming baseline methods on simulated and real-life data.


title: Construct ideal cotorsion pairs by recollement of triangulated categories

abstract: Let $(\mathcal{T}',\mathcal{T},\mathcal{T}'')$ be a recollement of triangulated categories. Two complete ideal cotorsion pairs in $\mathcal{T}'$ and $\mathcal{T}''$ can be induced by a complete ideal cotorsion pair in $\mathcal{T}$. If $(\mathcal{I},\mathcal{I}^\perp )$ and $(\mathcal{J},\mathcal{J}^\perp)$ are two complete ideal cotorsion pair in triangulated category, then $(\mathcal{I}\cap\mathcal{J},\langle\mathcal{I}^\perp,\mathcal{J}^\perp\rangle)$ is also a complete ideal cotorsion pair. In this way, a series of ideal cotorsion pairs in $\mathcal{T}$ can be induced by two ideal cotorsion pairs in $\mathcal{T}'$ and $\mathcal{T}''$.


title: GATE: How to Keep Out Intrusive Neighbors

abstract: Graph Attention Networks (GATs) are designed to provide flexible neighborhood aggregation that assigns weights to neighbors according to their importance. In practice, however, GATs are often unable to switch off task-irrelevant neighborhood aggregation, as we show experimentally and analytically. To address this challenge, we propose GATE, a GAT extension that holds three major advantages: i) It alleviates over-smoothing by addressing its root cause of unnecessary neighborhood aggregation. ii) Similarly to perceptrons, it benefits from higher depth as it can still utilize additional layers for (non-)linear feature transformations in case of (nearly) switched-off neighborhood aggregation. iii) By down-weighting connections to unrelated neighbors, it often outperforms GATs on real-world heterophilic datasets. To further validate our claims, we construct a synthetic test bed to analyze a model's ability to utilize the appropriate amount of neighborhood aggregation, which could be of independent interest.


title: Homogeneous projective coordinates for the Bondi-Metzner-Sachs group

abstract: This paper studies the Bondi-Metzner-Sachs group in homogeneous projective coordinates, because it is then possible to write all transformations of such a group in a manifestly linear way. The 2-sphere metric, Bondi-Metzner-Sachs metric, asymptotic Killing vectors, generators of supertranslations, as well as boosts and rotations of Minkowski spacetime, are all re-expressed in homogeneous projective coordinates. Last, the integral curves of vector fields which generate supertranslations are evaluated in detail. This work prepares the ground for more advanced applications of the differential geometry of asymptotically flat spacetimes in projective coordinates.


title: Realization of type-II double-zero-index photonic crystals

abstract: Some photonic crystals (PCs) with Dirac-like conical dispersions exhibit the property of double zero refractive index (that is, both epsilon and mu near zero (EMNZ)), wherein the electromagnetic waves have an infinite effective wavelength and do not experience any spatial phase change. The Dirac-like cones that support EMNZ are previously thought to present only at the center of the Brillouin zone ($\Gamma$ point) with a zero wavevector (we refer to as type-I EMNZ), which is constrained by the proportional relationship between phase refractive index and wavevector ($n=kc/\omega$). Here, we demonstrate the existence of an anomalous type-II EMNZ in PCs, which is associated with the Dirac-like point at off-$\Gamma$ points. By introducing a wave modulation approach, we theoretically elucidate its physical mechanism, and resolve the paradox of type-II EMNZ with non-zero wavevectors. We then fabricate a type-II EMNZ PC operating at the X point, and experimentally demonstrate that both its effective permittivity and permeability are zero at the Dirac-like point. Type-II EMNZ PCs exhibit a range of intriguing phenomena, including angle-selective transmission, wavefront flattening, a 180$^{\circ}$ phase shift upon transmission, and waveguiding with natural zero radiation loss. The extraordinary properties of type-II EMNZ PCs may open new avenues for the development of angle-selective optical filters, directional light sources, phase-controlled optical switches, ultracompact photonic circuits, nanolasers, and on-chip nonlinear enhancement.


title: Modal Analysis of Power System with High CIG Penetration Based on Impedance Models

abstract: This paper explores the modal analysis of power systems with high Converter-Interfaced Generation (CIG) penetration utilizing an impedance-based modeling approach. Traditional modal analysis based on the state-space model (MASS) requires comprehensive control structures and parameters of each system element, a challenging prerequisite as converters increasingly integrate into power systems and their internal specifics remain largely inaccessible. Conversely, the proposed modal analysis based on the impedance model (MAI) leverages only the impedance port characteristics to pinpoint system elements significantly influencing unstable modes. This study is the first to confirm the theoretical equivalency between MASS and MAI in terms of transfer functions, eigenvalues, and sensitivities, thus bridging the gap between detailed theoretical modeling and practical, accessible analyses. We further provide enhancements to the MAI method, including a revised element participation index, a transformer ratio-based admittance sensitivity adjustment, and an impedance splitting-based sensitivity analysis considering parameter variations. Validation through numerical simulations on a modified IEEE 14-bus system underscores the efficacy of our approach. By examining the interplay between different elements and system modes in high CIG environments, this study offers insights and a foundational framework for delineating the oscillatory modes' participation and stability characteristics of power systems with substantial CIG integration.