title: Saturation of fishbone instability through zonal flows driven by energetic particle transport in tokamak plasmas

abstract: Gyrokinetic and kinetic-MHD simulations are performed for the fishbone instability in the DIII-D discharge #178631, chosen for validation of first-principles simulations to predict the energetic particle (EP) transport in an ITER prefusion baseline scenario. Fishbone modes are found to generate zonal flows, which dominate the fishbone saturation. The underlying mechanisms of the two-way fishbone-zonal flows nonlinear interplay are discussed in details. Numerical and analytical analyses identify the fishbone-induced EP redistribution as the dominant generation mechanism for zonal flows. The zonal flows modify the nonlinear dynamics of phase space zonal structures, which reduces the amount of EPs able to resonate with the mode, leading to an early fishbone saturation. Simulation results including zonal flows agree quantitatively with DIII-D experimental measurements of the fishbone saturation amplitude and EP transport, supporting this novel saturation mechanism by self-generated zonal flows. Moreover, the wave-particle mode-locking mechanism is shown to determine quantitatively the fishbone frequency down-chirping, as evident in GTC simulation results in agreement with predictions from analytical theory. Finally, the fishbone-induced zonal flows are possibly responsible for the formation of an ion-ITB in the DIII-D discharge. Based on the low EP transport and the large zonal flow shearing rates associated with the fishbone instability in gyrokinetic simulations of the ITER scenario, it is conjectured that high performance scenarios could be designed in ITER burning plasmas through fishbone-induced ITBs.


title: The gravitational Vlasov-Poisson system with infinite mass and velocities in $\mathbb{R}^3$

abstract: We study existence and uniqueness of the solution to the gravitational Vlasov-Poisson system evolving in $\mathbb{R}^3$. It is assumed that initially the particles are distributed according to a spatial density with a power-law decay in space, allowing for unbounded mass, and an exponential decay in velocities given by a Maxwell-Boltzmann law. We extend a classical result which holds for systems with finite total mass.


title: Partial-dual polynomial as a framed weight system

abstract: Recently, Chmutov proved that the partial-dual polynomial considered as a function on chord diagrams satisfies the four-term relations. In this paper, we show that this function on framed chord diagrams also satisfies the four-term relations, i.e., is a framed weight system.


title: Effects of carbon pricing and other climate policies on CO2 emissions

abstract: We provide ex-post empirical analysis of the effects of climate policies on carbon dioxide emissions at the aggregate national level. Our results are based on a comprehensive database of 121 countries. As climate policies we examine carbon taxes and emissions trading systems (ETS), as well as the overall stringency of climate policies. We use dynamic panel regressions, controlling for macroeconomic factors such as economic development, GDP growth, urbanisation, as well as the energy mix. We find that higher carbon taxes and prices of permits in ETS reduce carbon emissions. An increase in carbon taxes by $10 per ton of CO2 reduces CO2 emissions per capita by 1.3% in the short run and by 4.6% in the long run.


title: On Practical Diversified Recommendation with Controllable Category Diversity Framework

abstract: Recommender systems have made significant strides in various industries, primarily driven by extensive efforts to enhance recommendation accuracy. However, this pursuit of accuracy has inadvertently given rise to echo chamber/filter bubble effects. Especially in industry, it could impair user's experiences and prevent user from accessing a wider range of items. One of the solutions is to take diversity into account. However, most of existing works focus on user's explicit preferences, while rarely exploring user's non-interaction preferences. These neglected non-interaction preferences are especially important for broadening user's interests in alleviating echo chamber/filter bubble effects.Therefore, in this paper, we first define diversity as two distinct definitions, i.e., user-explicit diversity (U-diversity) and user-item non-interaction diversity (N-diversity) based on user historical behaviors. Then, we propose a succinct and effective method, named as Controllable Category Diversity Framework (CCDF) to achieve both high U-diversity and N-diversity simultaneously.Specifically, CCDF consists of two stages, User-Category Matching and Constrained Item Matching. The User-Category Matching utilizes the DeepU2C model and a combined loss to capture user's preferences in categories, and then selects the top-$K$ categories with a controllable parameter $K$.These top-$K$ categories will be used as trigger information in Constrained Item Matching. Offline experimental results show that our proposed DeepU2C outperforms state-of-the-art diversity-oriented methods, especially on N-diversity task. The whole framework is validated in a real-world production environment by conducting online A/B testing.


title: Elucidating the nature of hidden-charm pentaquark states with spin-$\frac{3}{2}$ through their electromagnetic form factors

abstract: We perform a systematic study of the electromagnetic properties of exotic states to shed light on their nature, which is still controversial and not fully understood. The magnetic dipole and higher multipole moments of a hadronic state are as fundamental a dynamical quantity as its mass, and they contain valuable information about the deep structure underlying it. In the present work, we have explored the magnetic dipole and higher multipole moments of the hidden-charm pentaquarks with quantum number $J^P = 3/2^-$ using the QCD light-cone sum rule method and different interpolating currents. The obtained results show that different interpolating currents employed to probe pentaquarks with the same quark content produce varying results for their magnetic dipole and higher multipole moments at all. This can be interpreted to mean that there is more than one hidden-charm pentaquark with identical quark content but with different magnetic dipole and higher multipole moments. The nature, internal structure, and quark-gluon configurations of these states can be better understood by studying their electromagnetic properties.


title: Robot voice a voice controlled robot using arduino

abstract: Robotic assistants reduce the manual efforts being put in by humans in their day-to-day tasks. In this paper, we develop a voice-controlled personal assistant robot. The robot takes the human voice commands by its own built-in microphone. This robot not only takes the commands and executes them but also acknowledges them through speech output. This robot can perform different movements, turns, wakeup/shutdown operations, relocate an object from one place to another, and can also develop a conversation with humans. The voice commands are processed in real time using an offline server. The speech signal commands are directly communicated to the server using a USB cable. The personal assistant robot is developed on a microcontroller-based platform. Performance evaluation is carried out with encouraging results of the initial experiments. Possible improvements for applications in homes, hospitals, car systems, and industries are also discussed.


title: ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs

abstract: Sparse computation offers a compelling solution for the inference of Large Language Models (LLMs) in low-resource scenarios by dynamically skipping the computation of inactive neurons. While traditional approaches focus on ReLU-based LLMs, leveraging zeros in activation values, we broaden the scope of sparse LLMs beyond zero activation values. We introduce a general method that defines neuron activation through neuron output magnitudes and a tailored magnitude threshold, demonstrating that non-ReLU LLMs also exhibit sparse activation. To find the most efficient activation function for sparse computation, we propose a systematic framework to examine the sparsity of LLMs from three aspects: the trade-off between sparsity and performance, the predictivity of sparsity, and the hardware affinity. We conduct thorough experiments on LLMs utilizing different activation functions, including ReLU, SwiGLU, ReGLU, and ReLU$^2$. The results indicate that models employing ReLU$^2$ excel across all three evaluation aspects, highlighting its potential as an efficient activation function for sparse LLMs. We will release the code to facilitate future research.


title: Automated Description Generation for Software Patches

abstract: Software patches are pivotal in refining and evolving codebases, addressing bugs, vulnerabilities, and optimizations. Patch descriptions provide detailed accounts of changes, aiding comprehension and collaboration among developers. However, manual description creation poses challenges in terms of time consumption and variations in quality and detail. In this paper, we propose PATCHEXPLAINER, an approach that addresses these challenges by framing patch description generation as a machine translation task. In PATCHEXPLAINER, we leverage explicit representations of critical elements, historical context, and syntactic conventions. Moreover, the translation model in PATCHEXPLAINER is designed with an awareness of description similarity. Particularly, the model is explicitly trained to recognize and incorporate similarities present in patch descriptions clustered into groups, improving its ability to generate accurate and consistent descriptions across similar patches. The dual objectives maximize similarity and accurately predict affiliating groups. Our experimental results on a large dataset of real-world software patches show that PATCHEXPLAINER consistently outperforms existing methods, with improvements up to 189% in BLEU, 5.7X in Exact Match rate, and 154% in Semantic Similarity, affirming its effectiveness in generating software patch descriptions.


title: Explainable Automated Machine Learning for Credit Decisions: Enhancing Human Artificial Intelligence Collaboration in Financial Engineering

abstract: This paper explores the integration of Explainable Automated Machine Learning (AutoML) in the realm of financial engineering, specifically focusing on its application in credit decision-making. The rapid evolution of Artificial Intelligence (AI) in finance has necessitated a balance between sophisticated algorithmic decision-making and the need for transparency in these systems. The focus is on how AutoML can streamline the development of robust machine learning models for credit scoring, while Explainable AI (XAI) methods, particularly SHapley Additive exPlanations (SHAP), provide insights into the models' decision-making processes. This study demonstrates how the combination of AutoML and XAI not only enhances the efficiency and accuracy of credit decisions but also fosters trust and collaboration between humans and AI systems. The findings underscore the potential of explainable AutoML in improving the transparency and accountability of AI-driven financial decisions, aligning with regulatory requirements and ethical considerations.


title: SEABO: A Simple Search-Based Method for Offline Imitation Learning

abstract: Offline reinforcement learning (RL) has attracted much attention due to its ability in learning from static offline datasets and eliminating the need of interacting with the environment. Nevertheless, the success of offline RL relies heavily on the offline transitions annotated with reward labels. In practice, we often need to hand-craft the reward function, which is sometimes difficult, labor-intensive, or inefficient. To tackle this challenge, we set our focus on the offline imitation learning (IL) setting, and aim at getting a reward function based on the expert data and unlabeled data. To that end, we propose a simple yet effective search-based offline IL method, tagged SEABO. SEABO allocates a larger reward to the transition that is close to its closest neighbor in the expert demonstration, and a smaller reward otherwise, all in an unsupervised learning manner. Experimental results on a variety of D4RL datasets indicate that SEABO can achieve competitive performance to offline RL algorithms with ground-truth rewards, given only a single expert trajectory, and can outperform prior reward learning and offline IL methods across many tasks. Moreover, we demonstrate that SEABO also works well if the expert demonstrations contain only observations. Our code is publicly available at https://github.com/dmksjfl/SEABO.


title: SDEMG: Score-based Diffusion Model for Surface Electromyographic Signal Denoising

abstract: Surface electromyography (sEMG) recordings can be influenced by electrocardiogram (ECG) signals when the muscle being monitored is close to the heart. Several existing methods use signal-processing-based approaches, such as high-pass filter and template subtraction, while some derive mapping functions to restore clean sEMG signals from noisy sEMG (sEMG with ECG interference). Recently, the score-based diffusion model, a renowned generative model, has been introduced to generate high-quality and accurate samples with noisy input data. In this study, we proposed a novel approach, termed SDEMG, as a score-based diffusion model for sEMG signal denoising. To evaluate the proposed SDEMG approach, we conduct experiments to reduce noise in sEMG signals, employing data from an openly accessible source, the Non-Invasive Adaptive Prosthetics database, along with ECG signals from the MIT-BIH Normal Sinus Rhythm Database. The experiment result indicates that SDEMG outperformed comparative methods and produced high-quality sEMG samples. The source code of SDEMG the framework is available at: https://github.com/tonyliu0910/SDEMG


title: Combining additivity and active subspaces for high-dimensional Gaussian process modeling

abstract: Gaussian processes are a widely embraced technique for regression and classification due to their good prediction accuracy, analytical tractability and built-in capabilities for uncertainty quantification. However, they suffer from the curse of dimensionality whenever the number of variables increases. This challenge is generally addressed by assuming additional structure in theproblem, the preferred options being either additivity or low intrinsic dimensionality. Our contribution for high-dimensional Gaussian process modeling is to combine them with a multi-fidelity strategy, showcasing the advantages through experiments on synthetic functions and datasets.


title: On Erd\H{o}s covering systems in global function fields

abstract: A covering system of the integers is a finite collection of arithmetic progressions whose union is the set of integers. A well-known problem on covering systems is the minimum modulus problem posed by Erd\H{o}s in 1950, who asked whether the minimum modulus in such systems with distinct moduli is arbitrarily large. This problem was resolved by Hough in 2015, showing that the minimum modulus is at most $10^{16}$. In 2022, Balister, Bollob\'as, Morris, Sahasrabudhe and Tiba reduced Hough's bound to $616,000$ by developing Hough's method. They call it the distortion method. In this paper, by applying this method, we mainly prove that there does not exist any covering system of multiplicity $s$ in any global function field of genus $g$ over $\mathbb{F}_q$ for $q\geq (1.14+0.16g)e^{6.5+0.97g}s^2$. In particular, there is no covering system of $\mathbb{F}_q[x]$ of distinct moduli for $q\geq 759$.


title: Using Perspective-n-Point Algorithms for a Local Positioning System Based on LEDs and a QADA Receiver

abstract: The research interest on location-based services has increased during the last years ever since 3D centimetre accuracy inside intelligent environments could be confronted with. This work proposes an indoor local positioning system based on LED lighting, transmitted from a set of beacons to a receiver.The receiver is based on a quadrant photodiode angular diversity aperture (QADA) plus an aperture placed over it.This configuration can be modelled as a perspective camera, where the image position of the transmitters can be used to recover the receiver's 3D pose. This process is known as the perspective-n-point (PnP) problem, which is well known in computer vision and photogrammetry. This work investigates the use of different state-of-the-art PnP algorithms to localize the receiver in a large space based on four co-planar transmitters and with a distance from transmitters to receiver of 3.4 m. Encoding techniques are used to permit the simultaneous emission of all the transmitted signals and their processing in the receiver. In addition, correlation techniques are used to determine the image points projected from each emitter on the QADA. This work uses Monte Carlo simulations to characterize the absolute errors for a grid of test points under noisy measurements, as well as the robustness of the system when varying the 3D location of one transmitter. The IPPE algorithm obtained the best performance in this configuration. The proposal has also been experimentally evaluated in a real setup. The estimation of the receiver's position at three points using the IPPE algorithm achieves average absolute errors of 4.33cm, 3.51cm and 28.90cm in the coordinates x, y and z, respectively. These positioning results are in line with those obtained in previous work using triangulation techniques but with the addition that the complete pose of the receiver is obtained in this proposal.


title: FDO Manager: Minimum Viable FAIR Digital Object Implementation

abstract: The concept of FAIR Digital Objects (FDOs) aims to revolutionise the field of digital preservation and accessibility in the next few years. Central to this revolution is the alignment of FDOs with the FAIR (Findable, Accessible, Interoperable, Reusable) Principles, particularly emphasizing machine-actionability and interoperability across diverse data ecosystems. This abstract introduces the "FDO Manager", a Minimum Viable Implementation, designed to optimize the management of FDOs following these principles and the FDO specifications. The FDO Manager is tailored to manage research artefacts such as datasets, codes, and publications, to foster increased transparency and reproducibility in research. The abstract presents the implementation details of the FDO Manager, its underlying architecture, and the metadata schemas it employs, thereby offering a clear and comprehensive understanding of its functionalities and impact on the research domain.


title: NK Hybrid Genetic Algorithm for Clustering

abstract: The NK hybrid genetic algorithm for clustering is proposed in this paper. In order to evaluate the solutions, the hybrid algorithm uses the NK clustering validation criterion 2 (NKCV2). NKCV2 uses information about the disposition of $N$ small groups of objects. Each group is composed of $K+1$ objects of the dataset. Experimental results show that density-based regions can be identified by using NKCV2 with fixed small $K$. In NKCV2, the relationship between decision variables is known, which in turn allows us to apply gray box optimization. Mutation operators, a partition crossover, and a local search strategy are proposed, all using information about the relationship between decision variables. In partition crossover, the evaluation function is decomposed into $q$ independent components; partition crossover then deterministically returns the best among $2^q$ possible offspring with computational complexity $O(N)$. The NK hybrid genetic algorithm allows the detection of clusters with arbitrary shapes and the automatic estimation of the number of clusters. In the experiments, the NK hybrid genetic algorithm produced very good results when compared to another genetic algorithm approach and to state-of-art clustering algorithms.


title: Masked Graph Autoencoder with Non-discrete Bandwidths

abstract: Masked graph autoencoders have emerged as a powerful graph self-supervised learning method that has yet to be fully explored. In this paper, we unveil that the existing discrete edge masking and binary link reconstruction strategies are insufficient to learn topologically informative representations, from the perspective of message propagation on graph neural networks. These limitations include blocking message flows, vulnerability to over-smoothness, and suboptimal neighborhood discriminability. Inspired by these understandings, we explore non-discrete edge masks, which are sampled from a continuous and dispersive probability distribution instead of the discrete Bernoulli distribution. These masks restrict the amount of output messages for each edge, referred to as "bandwidths". We propose a novel, informative, and effective topological masked graph autoencoder using bandwidth masking and a layer-wise bandwidth prediction objective. We demonstrate its powerful graph topological learning ability both theoretically and empirically. Our proposed framework outperforms representative baselines in both self-supervised link prediction (improving the discrete edge reconstructors by at most 20%) and node classification on numerous datasets, solely with a structure-learning pretext. Our implementation is available at https://github.com/Newiz430/Bandana.


title: Expediting In-Network Federated Learning by Voting-Based Consensus Model Compression

abstract: Recently, federated learning (FL) has gained momentum because of its capability in preserving data privacy. To conduct model training by FL, multiple clients exchange model updates with a parameter server via Internet. To accelerate the communication speed, it has been explored to deploy a programmable switch (PS) in lieu of the parameter server to coordinate clients. The challenge to deploy the PS in FL lies in its scarce memory space, prohibiting running memory consuming aggregation algorithms on the PS. To overcome this challenge, we propose Federated Learning in-network Aggregation with Compression (FediAC) algorithm, consisting of two phases: client voting and model aggregating. In the former phase, clients report their significant model update indices to the PS to estimate global significant model updates. In the latter phase, clients upload global significant model updates to the PS for aggregation. FediAC consumes much less memory space and communication traffic than existing works because the first phase can guarantee consensus compression across clients. The PS easily aligns model update indices to swiftly complete aggregation in the second phase. Finally, we conduct extensive experiments by using public datasets to demonstrate that FediAC remarkably surpasses the state-of-the-art baselines in terms of model accuracy and communication traffic.


title: Energetic particle contamination in STIX during Solar Orbiter's passage through Earth's radiation belts and an interplanetary shock

abstract: The Spectrometer/Telescope for Imaging X-rays (STIX) is a hard X-ray imaging spectrometer on board the ESA and NASA heliospheric mission Solar Orbiter. STIX has been operational for three years and has observed X-ray emission from ~35,000 solar flares. Throughout its lifetime, Solar Orbiter has been frequently struck by a high flux of energetic particles usually of flare origin, or from coronal mass ejection shocks. These Solar Energetic Particles (SEPs) are detected on board by the purpose-built energetic particle detector instrument suite. During SEP events, the X-ray signal is also contaminated in STIX. This work investigates the effect of these particles on the STIX instrument for two events. The first event occurred during an interplanetary shock crossing and the second event occurred when Solar Orbiter passed through Earth's radiation belts while performing a gravity assist maneuver. The induced spectra consist of tungsten fluorescence emission lines and secondary Bremsstrahlung emission produced by incident particles interacting with spacecraft components. For these two events, we identify > 100 keV electrons as significant contributors to the contamination via Bremsstrahlung emission and tungsten fluorescence.


title: Improvement of Frequency Source Phase Noise Reduction Design under Vibration Condition

abstract: Reasonable vibration reduction design is an important way to achieve low phase noise index of airborne frequency source output signal. Aiming at the problem of phase noise deterioration of an airborne frequency source under random condition, this paper proposes to improve the vibration reduction mode crystal oscillator and reduce the distance between the barycenter of frequency source and crystal oscillator vibration based on the analysis of the relationship between the frequency source and the phase noise of output signal. Experimental results show that the active noise control system achieves 62dB phase noise compensation under the random vibration of 0.04-0.1g*g/Hz amplitude range and 5-2000 Hz frequency range.


title: Asymptotic generalization error of a single-layer graph convolutional network

abstract: While graph convolutional networks show great practical promises, the theoretical understanding of their generalization properties as a function of the number of samples is still in its infancy compared to the more broadly studied case of supervised fully connected neural networks. In this article, we predict the performances of a single-layer graph convolutional network (GCN) trained on data produced by attributed stochastic block models (SBMs) in the high-dimensional limit. Previously, only ridge regression on contextual-SBM (CSBM) has been considered in Shi et al. 2022; we generalize the analysis to arbitrary convex loss and regularization for the CSBM and add the analysis for another data model, the neural-prior SBM. We also study the high signal-to-noise ratio limit, detail the convergence rates of the GCN and show that, while consistent, it does not reach the Bayes-optimal rate for any of the considered cases.


title: Do we need rebalancing strategies? A theoretical and empirical study around SMOTE and its variants

abstract: Synthetic Minority Oversampling Technique (SMOTE) is a common rebalancing strategy for handling imbalanced tabular data sets. However, few works analyze SMOTE theoretically. In this paper, we prove that SMOTE (with default parameter) simply copies the original minority samples asymptotically. We also prove that SMOTE exhibits boundary artifacts, thus justifying existing SMOTE variants. Then we introduce two new SMOTE-related strategies, and compare them with state-of-the-art rebalancing procedures. Surprisingly, for most data sets, we observe that applying no rebalancing strategy is competitive in terms of predictive performances, with tuned random forests. For highly imbalanced data sets, our new method, named Multivariate Gaussian SMOTE, is competitive. Besides, our analysis sheds some lights on the behavior of common rebalancing strategies, when used in conjunction with random forests.


title: PMSM transient response optimization by end-to-end optimal control

abstract: Speed responses of motors, especially Permanent Magnet Synchronous Motors (PMSMs), are increasing in importance for recent applications, such as electric vehicles or quadrotors. These applications require quick acceleration performance. However, commercial controllers are based mainly on Proportional-Integral (PI) controllers, which are suitable for eliminating steady-state errors but unsuitable for transient response optimization. In this paper, we replaced whole conventional controllers with an end-to-end Recurrent Neural Network (RNN) that has a regularized transition matrix. Our end-to-end controller directly minimizes the transient response time on the basis of optimal control theory. Computer-simulated results show that speed response indices improved using the RNN rather than a PI controller, while both were under comparable power losses. The current vector trajectories of the RNN showed that the RNN could automatically determine arbitrary trajectories in the flux-weakening region in accordance with an arbitrarily designed loss function. In contrast, the traditional flux-weakening methods using PI controllers have pre-determined current vector trajectories.


title: Finite volumes for the Gross-Pitaevskii equation

abstract: We study the approximation by a Voronoi finite-volume scheme of the Gross-Pitaevskii equation with time-dependent potential in two and three dimensions. We perform an explicit splitting scheme for the time integration alongside a two-point flux approximation scheme in space. We rigorously analyze the error bounds relying on discrete uniform Sobolev inequalities. We also prove the convergence of the pseudo-vorticity of the wave function. We finally perform some numerical simulations to illustrate our theoretical results.


title: RevOrder: A Novel Method for Enhanced Arithmetic in Language Models

abstract: This paper presents RevOrder, a novel technique aimed at improving arithmetic operations in large language models (LLMs) by reversing the output digits in addition, subtraction, and n-digit by 1-digit (nD by 1D) multiplication tasks. Our method significantly reduces the Count of Sequential Intermediate Digits (CSID) to $\mathcal{O}(1)$, a new metric we introduce to assess equation complexity. Through comprehensive testing, RevOrder not only achieves perfect accuracy in basic arithmetic operations but also substantially boosts LLM performance in division tasks, particularly with large numbers where traditional models struggle. Implementation of RevOrder is cost-effective for both training and inference phases. Moreover, applying RevOrder to fine-tune the LLaMA2-7B model on the GSM8K math task results in a considerable improvement, reducing equation calculation errors by 46% and increasing overall scores from 41.6 to 44.4.


title: Learning immune receptor representations with protein language models

abstract: Protein language models (PLMs) learn contextual representations from protein sequences and are profoundly impacting various scientific disciplines spanning protein design, drug discovery, and structural predictions. One particular research area where PLMs have gained considerable attention is adaptive immune receptors, whose tremendous sequence diversity dictates the functional recognition of the adaptive immune system. The self-supervised nature underlying the training of PLMs has been recently leveraged to implement a variety of immune receptor-specific PLMs. These models have demonstrated promise in tasks such as predicting antigen-specificity and structure, computationally engineering therapeutic antibodies, and diagnostics. However, challenges including insufficient training data and considerations related to model architecture, training strategies, and data and model availability must be addressed before fully unlocking the potential of PLMs in understanding, translating, and engineering immune receptors.


title: A call for embodied AI

abstract: We propose Embodied AI as the next fundamental step in the pursuit of Artificial General Intelligence, juxtaposing it against current AI advancements, particularly Large Language Models. We traverse the evolution of the embodiment concept across diverse fields - philosophy, psychology, neuroscience, and robotics - to highlight how EAI distinguishes itself from the classical paradigm of static learning. By broadening the scope of Embodied AI, we introduce a theoretical framework based on cognitive architectures, emphasizing perception, action, memory, and learning as essential components of an embodied agent. This framework is aligned with Friston's active inference principle, offering a comprehensive approach to EAI development. Despite the progress made in the field of AI, substantial challenges, such as the formulation of a novel AI learning theory and the innovation of advanced hardware, persist. Our discussion lays down a foundational guideline for future Embodied AI research. Highlighting the importance of creating Embodied AI agents capable of seamless communication, collaboration, and coexistence with humans and other intelligent entities within real-world environments, we aim to steer the AI community towards addressing the multifaceted challenges and seizing the opportunities that lie ahead in the quest for AGI.


title: Two Families of Clifford Distributions Revisited

abstract: Two specific families of distributions in harmonic and Clifford analysis are further studied through a spherical co-ordinates approach. In particular actions involving spherical co-ordinates, such as the radial derivative and the multiplication and division by the radial distance, are computed, giving rise to two families of so--called signumdistributions, i.e. bounded linear functionals on a space of test functions showing a singularity at the origin.


title: Optical absorption and photoluminescence of single layer boron nitride from a first principles cumulant approach

abstract: The photoluminescence spectrum of a single-layer boron nitride remains elusive, marked by enigmatic satellites that hint at a significant but unidentified exciton-phonon coupling.Here, by employing a first principles approach based on the many-body cumulant expansion of the charge response, we calculate the optical absorption and photoluminescence of a single layer boron nitride. We identify the specific exciton-phonon scattering channels and unravel their impact on the optical absorption and photoluminescence spectra thereby providing an interpretation of the experimental features. Finally, we show that, even in a strongly polar material such as h-BN monolayer, the electron-hole interaction responsible for the excitonic effect results in the cancellation of the Fr\"olich interaction at small phonon momenta. This effect is captured only if the invariance of the exciton-phonon matrix elements under unitary transformations in the Bloch functions manifold is preserved in the calculation.


title: Conditions for growth and extinction in matrix models with environmental stochasticity

abstract: In this kind of model, the main characteristic that determines population viability in the long term is the stochastic growth rate (SGR) denoted $\lambda_S$. When $\lambda_S$ is larger than one, the population grows exponentially with probability one and when it is smaller than one, the population goes extinct with probability one. However, even in very simple situations it is not possible to calculate the SGR analytically. The literature offers some approximations for the case in which environmental variability is low, and there are also some lower and upper bounds, but there is no study of the practical situations in which they would be tight. Some new bounds for the SGR are built and the conditions under which each bound works best are analyzed. These bounds are used to give some necessary and some sufficient conditions for population explosion and extinction that are easy to check in practice. The general results are applied to several cases, amongst them a population structured as juveniles and adults living in an environment switching randomly between "rich" and "poor".


title: Estimating Barycenters of Distributions with Neural Optimal Transport

abstract: Given a collection of probability measures, a practitioner sometimes needs to find an "average" distribution which adequately aggregates reference distributions. A theoretically appealing notion of such an average is the Wasserstein barycenter, which is the primal focus of our work. By building upon the dual formulation of Optimal Transport (OT), we propose a new scalable approach for solving the Wasserstein barycenter problem. Our methodology is based on the recent Neural OT solver: it has bi-level adversarial learning objective and works for general cost functions. These are key advantages of our method since the typical adversarial algorithms leveraging barycenter tasks utilize tri-level optimization and focus mostly on quadratic cost. We also establish theoretical error bounds for our proposed approach and showcase its applicability and effectiveness in illustrative scenarios and image data setups. Our source code is available at https://github.com/justkolesov/NOTBarycenters.


title: Precise Measurement of Born Cross Sections for $e^+e^-\to D\bar{D}$ and Observation of One Structure between $\sqrt{s} = 3.80-4.95$ GeV

abstract: Using data samples collected with the BESIII detector at the BEPCII collider at center-of-mass energies ranging from 3.80 to 4.95 GeV, corresponding to an integrated luminosity of 20 fb$^{-1}$, a measurement of Born cross sections for the $e^+e^-\to D^{0}\bar{D}^{0}$ and $D^{+}D^{-}$ processes is presented with unprecedented precision. By performing a simultaneous fit to the dressed cross sections for both processes, one possible new structure around 3.9 GeV/$c^2$ is observed for the first time, in addition to seven known resonances $\psi(3770)$, $\psi(4040)$, $\psi(4160)$, $Y(4230)$, $Y(4360)$, $\psi(4415)$, and $Y(4660)$. These results offer crucial experimental insights into the nature of hadron production in the open charm region.


title: OASim: an Open and Adaptive Simulator based on Neural Rendering for Autonomous Driving

abstract: With deep learning and computer vision technology development, autonomous driving provides new solutions to improve traffic safety and efficiency. The importance of building high-quality datasets is self-evident, especially with the rise of end-to-end autonomous driving algorithms in recent years. Data plays a core role in the algorithm closed-loop system. However, collecting real-world data is expensive, time-consuming, and unsafe. With the development of implicit rendering technology and in-depth research on using generative models to produce data at scale, we propose OASim, an open and adaptive simulator and autonomous driving data generator based on implicit neural rendering. It has the following characteristics: (1) High-quality scene reconstruction through neural implicit surface reconstruction technology. (2) Trajectory editing of the ego vehicle and participating vehicles. (3) Rich vehicle model library that can be freely selected and inserted into the scene. (4) Rich sensors model library where you can select specified sensors to generate data. (5) A highly customizable data generation system can generate data according to user needs. We demonstrate the high quality and fidelity of the generated data through perception performance evaluation on the Carla simulator and real-world data acquisition. Code is available at https://github.com/PJLab-ADG/OASim.


title: Soliton Management for ultrashort pulse: dark and anti-dark solitons of Fokas-Lenells equation with a damping like perturbation and a gauge equivalent spin system

abstract: We investigate the propagation of an ultrashort optical pulse using Fokas-Lenells equation (FLE) under varying dispersion, nonlinear effects and perturbation. Such a system can be said to be under soliton management (SM) scheme. At first, under a gauge transformation, followed by shifting of variables, we transform FLE under SM into a simplified form, which is similar to an equation given by Davydova and Lashkin for plasma waves, we refer to this form as DLFLE. Then, we propose a bilinearization for DLFLE in a non-vanishing background by introducing an auxiliary function which transforms DLFLE into three bilinear equations. We solve these equations and obtain dark and anti-dark one-soliton solution (1SS) of DLFLE. From here, by reverse transformation of the solution, we obtain the 1SS of FLE and explore the soliton behavior under different SM schemes. Thereafter, we obtain dark and anti-dark two-soliton solution (2SS) of DLFLE and determine the shift in phase of the individual solitons on interaction through asymptotic analysis. We then, obtain the 2SS of FLE and represent the soliton graph for different SM scheme. Thereafter, we present the procedure to determine N-soliton solution (NSS) of DLFLE and FLE. Later, we introduce a Lax pair for DLFLE and through a gauge transformation we convert the spectral problem of our system into that of an equivalent spin system which is termed as Landau-Lifshitz (LL) system. LL equation (LLE) holds the potential to provide information about various nonlinear structures and properties of the system.


title: Rethinking Skill Extraction in the Job Market Domain using Large Language Models

abstract: Skill Extraction involves identifying skills and qualifications mentioned in documents such as job postings and resumes. The task is commonly tackled by training supervised models using a sequence labeling approach with BIO tags. However, the reliance on manually annotated data limits the generalizability of such approaches. Moreover, the common BIO setting limits the ability of the models to capture complex skill patterns and handle ambiguous mentions. In this paper, we explore the use of in-context learning to overcome these challenges, on a benchmark of 6 uniformized skill extraction datasets. Our approach leverages the few-shot learning capabilities of large language models (LLMs) to identify and extract skills from sentences. We show that LLMs, despite not being on par with traditional supervised models in terms of performance, can better handle syntactically complex skill mentions in skill extraction tasks.


title: A Lightweight Randomized Nonlinear Dictionary Learning Method using Random Vector Functional Link

abstract: Kernel-based nonlinear dictionary learning methods operate in a feature space obtained by an implicit feature map, and they are not independent of computationally expensive operations like Singular Value Decomposition (SVD). This paper presents an SVD-free lightweight approach to learning a nonlinear dictionary using a randomized functional link called a Random Vector Functional Link (RVFL). The proposed RVFL-based nonlinear Dictionary Learning (RVFLDL) learns a dictionary as a sparse-to-dense feature map from nonlinear sparse coefficients to the dense input features. Sparse coefficients w.r.t an initial random dictionary are derived by assuming Horseshoe prior are used as inputs making it a lightweight network. Training the RVFL-based dictionary is free from SVD computation as RVFL generates weights from the input to the output layer analytically. Higher-order dependencies between the input sparse coefficients and the dictionary atoms are incorporated into the training process by nonlinearly transforming the sparse coefficients and adding them as enhanced features. Thus the method projects sparse coefficients to a higher dimensional space while inducing nonlinearities into the dictionary. For classification using RVFL-net, a classifier matrix is learned as a transform that maps nonlinear sparse coefficients to the labels. The empirical evidence of the method illustrated in image classification and reconstruction applications shows that RVFLDL is scalable and provides a solution better than those obtained using other nonlinear dictionary learning methods.


title: Enhanced Security and Efficiency in Blockchain with Aggregated Zero-Knowledge Proof Mechanisms

abstract: Blockchain technology has emerged as a revolutionary tool in ensuring data integrity and security in digital transactions. However, the current approaches to data verification in blockchain systems, particularly in Ethereum, face challenges in terms of efficiency and computational overhead. The traditional use of Merkle Trees and cryptographic hash functions, while effective, leads to significant resource consumption, especially for large datasets. This highlights a gap in existing research: the need for more efficient methods of data verification in blockchain networks. Our study addresses this gap by proposing an innovative aggregation scheme for Zero-Knowledge Proofs within the structure of Merkle Trees. We develop a system that significantly reduces the size of the proof and the computational resources needed for its generation and verification. Our approach represents a paradigm shift in blockchain data verification, balancing security with efficiency. We conducted extensive experimental evaluations using real Ethereum block data to validate the effectiveness of our proposed scheme. The results demonstrate a drastic reduction in proof size and computational requirements compared to traditional methods, making the verification process more efficient and economically viable. Our contribution fills a critical research void, offering a scalable and secure solution for blockchain data verification. The implications of our work are far-reaching, enhancing the overall performance and adaptability of blockchain technology in various applications, from financial transactions to supply chain management.


abstract: In recent years, transformer-based deep learning networks have gained popularity in Hyperspectral (HS) unmixing applications due to their superior performance. The attention mechanism within transformers facilitates input-dependent weighting and enhances contextual awareness during training. Drawing inspiration from this, we propose a novel attention based Hyperspectral Unmixing algorithm called Transformer based Endmember Fusion with Spatial Context for Hyperspectral Unmixing (FusionNet). This algorithm can effectively fuse endmember signatures obtained from different endmember extraction algorithms, as opposed to the classical HS unmixing approaches that rely on a single Endmember Extraction Algorithm (EEA). The FusionNet incorporates an Approximation Network (AN), introducing contextual awareness into abundance prediction by considering neighborhood pixels. Unlike Convolutional Neural Networks (CNNs), which are constrained by specific kernel shapes, the Fusion network offers flexibility in choosing any arbitrary configuration of the neighborhood. We conducted a comparative analysis between the FusionNet algorithm and state-of-the-art algorithms using two popular datasets. Remarkably, FusionNet outperformed other algorithms, achieving the lowest Root Mean Square Error (RMSE) for abundance predictions and competitive Spectral Angle Distance (SAD) for signatures associated with each endmember for both datasets.


title: Analysis of wall-modelled particle/mesh PDF methods for turbulent parietal flows

abstract: Lagrangian stochastic methods are widely used to model turbulent flows. Scarce consideration has, however, been devoted to the treatment of the near-wall region and to the formulation of a proper wall-boundary condition. With respect to this issue, the main purpose of this paper is to present an in-depth analysis of such flows when relying on particle/mesh formulations of the probability density function (PDF) model. This is translated into three objectives. The first objective is to assess the existing an-elastic wall-boundary condition and present new validation results. The second objective is to analyse the impact of the interpolation of the mean fields at particle positions on their dynamics. The third objective is to investigate the spatial error affecting covariance estimators when they are extracted on coarse volumes. All these developments allow to ascertain that the key dynamical statistics of wall-bounded flows are properly captured even for coarse spatial resolutions.


title: Expressivity of Geometric Inhomogeneous Random Graphs -- Metric and Non-Metric

abstract: Recently there has been increased interest in fitting generative graph models to real-world networks. In particular, Bl\"asius et al. have proposed a framework for systematic evaluation of the expressivity of random graph models. We extend this framework to Geometric Inhomogeneous Random Graphs (GIRGs). This includes a family of graphs induced by non-metric distance functions which allow capturing more complex models of partial similarity between nodes as a basis of connection - as well as homogeneous and non-homogeneous feature spaces. As part of the extension, we develop schemes for estimating the multiplicative constant and the long-range parameter in the connection probability. Moreover, we devise an algorithm for sampling Minimum-Component-Distance GIRGs whose runtime is linear both in the number of vertices and in the dimension of the underlying geometric space. Our results provide evidence that GIRGs are more realistic candidates with respect to various graph features such as closeness centrality, betweenness centrality, local clustering coefficient, and graph effective diameter, while they face difficulties to replicate higher variance and more extreme values of graph statistics observed in real-world networks.


title: Gaussian process regression with Sliced Wasserstein Weisfeiler-Lehman graph kernels

abstract: Supervised learning has recently garnered significant attention in the field of computational physics due to its ability to effectively extract complex patterns for tasks like solving partial differential equations, or predicting material properties. Traditionally, such datasets consist of inputs given as meshes with a large number of nodes representing the problem geometry (seen as graphs), and corresponding outputs obtained with a numerical solver. This means the supervised learning model must be able to handle large and sparse graphs with continuous node attributes. In this work, we focus on Gaussian process regression, for which we introduce the Sliced Wasserstein Weisfeiler-Lehman (SWWL) graph kernel. In contrast to existing graph kernels, the proposed SWWL kernel enjoys positive definiteness and a drastic complexity reduction, which makes it possible to process datasets that were previously impossible to handle. The new kernel is first validated on graph classification for molecular datasets, where the input graphs have a few tens of nodes. The efficiency of the SWWL kernel is then illustrated on graph regression in computational fluid dynamics and solid mechanics, where the input graphs are made up of tens of thousands of nodes.


title: Random features models: a way to study the success of naive imputation

abstract: Constant (naive) imputation is still widely used in practice as this is a first easy-to-use technique to deal with missing data. Yet, this simple method could be expected to induce a large bias for prediction purposes, as the imputed input may strongly differ from the true underlying data. However, recent works suggest that this bias is low in the context of high-dimensional linear predictors when data is supposed to be missing completely at random (MCAR). This paper completes the picture for linear predictors by confirming the intuition that the bias is negligible and that surprisingly naive imputation also remains relevant in very low dimension.To this aim, we consider a unique underlying random features model, which offers a rigorous framework for studying predictive performances, whilst the dimension of the observed features varies.Building on these theoretical results, we establish finite-sample bounds on stochastic gradient (SGD) predictors applied to zero-imputed data, a strategy particularly well suited for large-scale learning.If the MCAR assumption appears to be strong, we show that similar favorable behaviors occur for more complex missing data scenarios.


title: Belief Scene Graphs: Expanding Partial Scenes with Objects through Computation of Expectation

abstract: In this article, we propose the novel concept of Belief Scene Graphs, which are utility-driven extensions of partial 3D scene graphs, that enable efficient high-level task planning with partial information. We propose a graph-based learning methodology for the computation of belief (also referred to as expectation) on any given 3D scene graph, which is then used to strategically add new nodes (referred to as blind nodes) that are relevant to a robotic mission. We propose the method of Computation of Expectation based on Correlation Information (CECI), to reasonably approximate real Belief/Expectation, by learning histograms from available training data. A novel Graph Convolutional Neural Network (GCN) model is developed, to learn CECI from a repository of 3D scene graphs. As no database of 3D scene graphs exists for the training of the novel CECI model, we present a novel methodology for generating a 3D scene graph dataset based on semantically annotated real-life 3D spaces. The generated dataset is then utilized to train the proposed CECI model and for extensive validation of the proposed method. We establish the novel concept of \textit{Belief Scene Graphs} (BSG), as a core component to integrate expectations into abstract representations. This new concept is an evolution of the classical 3D scene graph concept and aims to enable high-level reasoning for task planning and optimization of a variety of robotics missions. The efficacy of the overall framework has been evaluated in an object search scenario, and has also been tested in a real-life experiment to emulate human common sense of unseen-objects. For a video of the article, showcasing the experimental demonstration, please refer to the following link: https://youtu.be/hsGlSCa12iY


title: Momentum-space Langevin dynamics of holographic Wilsonian RG flow: self-interacting massive scalar field theory

abstract: We explore mathematical relationship between holographic Wilsonian renormalization group(HWRG) and stochastic quantization(SQ) motivated by the similarity of the monotonicity in RG flow with Langevin dynamics of non-equilibrium thermodynamics. We look at scalar field theory in AdS space with its generic mass, self-interaction, and boundary deformation in the momentum space. Identifying the stochastic time $t$ with radial coordinate $r$ in AdS, we establish maps between the fictitious time evolution of stochastic multi point correlation function and the radial evolution of multi-trace deformation, which respectively, express the relaxation process of Langevin dynamics and holographic RG flow. We especially consider marginal multi-trace deformation on the AdS boundary which is successfully captured by a Langevin dynamics of SQ.


title: Estimation of the lifetime distribution from fluctuations in Bellman-Harris processes

abstract: The growth of a population is often modeled as branching process where each individual at the end of its life is replaced by a certain number of offspring. An example of these branching models is the Bellman-Harris process, where the lifetime of individuals is assumed to be independent and identically distributed. Here, we are interested in the estimation of the parameters of the Bellman-Harris model, motivated by the estimation of cell division time. Lifetimes are distributed according a Gamma distribution and we follow a population that starts from a small number of individuals by performing time-resolved measurements of the population size. The exponential growth of the population size at the beginning offers an easy estimation of the mean of the lifetime. Going farther and describing lifetime variability is a challenging task however, due to the complexity of the fluctuations of non-Markovian branching processes. Using fine and recent results on these fluctuations, we describe two time-asymptotic regimes and explain how to estimate the parameters. Then, we both consider simulations and biological data to validate and discuss our method. The results described here provide a method to determine single-cell parameters from time-resolved measurements of populations without the need to track each individual or to know the details of the initial condition.


title: A new method for optical steel rope non-destructive damage detection

abstract: This paper presents a novel algorithm for non-destructive damage detection for steel ropes in high-altitude environments (aerial ropeway). The algorithm comprises two key components: First, a segmentation model named RGBD-UNet is designed to accurately extract steel ropes from complex backgrounds. This model is equipped with the capability to process and combine color and depth information through the proposed CMA module. Second, a detection model named VovNetV3.5 is developed to differentiate between normal and abnormal steel ropes. It integrates the VovNet architecture with a DBB module to enhance performance. Besides, a novel background augmentation method is proposed to enhance the generalization ability of the segmentation model. Datasets containing images of steel ropes in different scenarios are created for the training and testing of both the segmentation and detection models. Experiments demonstrate a significant improvement over baseline models. On the proposed dataset, the highest accuracy achieved by the detection model reached 0.975, and the maximum F-measure achieved by the segmentation model reached 0.948.


title: A Unified Model for Non-Fickian Diffusion and Anomalous Swelling of Glassy Polymer Gels

abstract: A sheet of glassy polymers placed in a solvent shows swelling behaviors quite different from that of soft polymers (rubbers and gels). (1) Non-Fickian diffusion (called case II diffusion): As solvent permeates into the sample, a sharp front is created between the swollen part and the glassy part, and it moves toward the center at constant speed. (2) Nonmonotonous swelling: The thickness of the sample first increases and then decreases toward the equilibrium value. Here we propose a theory to explain such anomalous behavior by extending the previous theory for swelling of soft gels. We regard the material as a continuum mixture of a glassy polymer network and solvent. We assume that the polymer network is a viscoelastic gel of glassy polymers, and its relaxation time depends strongly on solvent concentration. We show that this theory explains the above two characteristics of glassy polymers in a simple and unified framework. The theory predicts how the permeation speed of the solvent and the characteristic times of the swelling process depend on material parameters and experimental conditions, which can be checked experimentally.


title: On gauge freedom, conservativity and intrinsic dimensionality estimation in diffusion models

abstract: Diffusion models are generative models that have recently demonstrated impressive performances in terms of sampling quality and density estimation in high dimensions. They rely on a forward continuous diffusion process and a backward continuous denoising process, which can be described by a time-dependent vector field and is used as a generative model. In the original formulation of the diffusion model, this vector field is assumed to be the score function (i.e. it is the gradient of the log-probability at a given time in the diffusion process). Curiously, on the practical side, most studies on diffusion models implement this vector field as a neural network function and do not constrain it be the gradient of some energy function (that is, most studies do not constrain the vector field to be conservative). Even though some studies investigated empirically whether such a constraint will lead to a performance gain, they lead to contradicting results and failed to provide analytical results. Here, we provide three analytical results regarding the extent of the modeling freedom of this vector field. {Firstly, we propose a novel decomposition of vector fields into a conservative component and an orthogonal component which satisfies a given (gauge) freedom. Secondly, from this orthogonal decomposition, we show that exact density estimation and exact sampling is achieved when the conservative component is exactly equals to the true score and therefore conservativity is neither necessary nor sufficient to obtain exact density estimation and exact sampling. Finally, we show that when it comes to inferring local information of the data manifold, constraining the vector field to be conservative is desirable.


title: Efficient Generation of Hidden Outliers for Improved Outlier Detection

abstract: Outlier generation is a popular technique used for solving important outlier detection tasks. Generating outliers with realistic behavior is challenging. Popular existing methods tend to disregard the 'multiple views' property of outliers in high-dimensional spaces. The only existing method accounting for this property falls short in efficiency and effectiveness. We propose BISECT, a new outlier generation method that creates realistic outliers mimicking said property. To do so, BISECT employs a novel proposition introduced in this article stating how to efficiently generate said realistic outliers. Our method has better guarantees and complexity than the current methodology for recreating 'multiple views'. We use the synthetic outliers generated by BISECT to effectively enhance outlier detection in diverse datasets, for multiple use cases. For instance, oversampling with BISECT reduced the error by up to 3 times when compared with the baselines.


title: Non-Hemolytic Peptide Classification Using A Quantum Support Vector Machine

abstract: Quantum machine learning (QML) is one of the most promising applications of quantum computation. However, it is still unclear whether quantum advantages exist when the data is of a classical nature and the search for practical, real-world applications of QML remains active. In this work, we apply the well-studied quantum support vector machine (QSVM), a powerful QML model, to a binary classification task which classifies peptides as either hemolytic or non-hemolytic. Using three peptide datasets, we apply and contrast the performance of the QSVM, numerous classical SVMs, and the best published results on the same peptide classification task, out of which the QSVM performs best. The contributions of this work include (i) the first application of the QSVM to this specific peptide classification task, (ii) an explicit demonstration of QSVMs outperforming the best published results attained with classical machine learning models on this classification task and (iii) empirical results showing that the QSVM is capable of outperforming many (and possibly all) classical SVMs on this classification task. This foundational work paves the way to verifiable quantum advantages in the field of computational biology and facilitates safer therapeutic development.


title: ANLS* -- A Universal Document Processing Metric for Generative Large Language Models

abstract: Traditionally, discriminative models have been the predominant choice for tasks like document classification and information extraction. These models make predictions that fall into a limited number of predefined classes, facilitating a binary true or false evaluation and enabling the direct calculation of metrics such as the F1 score. However, recent advancements in generative large language models (GLLMs) have prompted a shift in the field due to their enhanced zero-shot capabilities, which eliminate the need for a downstream dataset and computationally expensive fine-tuning. However, evaluating GLLMs presents a challenge as the binary true or false evaluation used for discriminative models is not applicable to the predictions made by GLLMs. This paper introduces a new metric for generative models called ANLS* for evaluating a wide variety of tasks, including information extraction and classification tasks. The ANLS* metric extends existing ANLS metrics as a drop-in-replacement and is still compatible with previously reported ANLS scores. An evaluation of 7 different datasets, 6 different GLLMs and 3 different prompting methods using the ANLS* metric is also provided, demonstrating the importance of the proposed metric. We also benchmark a novel approach to generate prompts for documents, called SFT, against other prompting techniques such as LATIN. In 27 out of 35 cases, SFT outperforms other techniques and improves the state-of-the-art, sometimes by as much as $18$ percentage points. Sources are available at https://github.com/deepopinion/anls_star_metric


title: Global certification via perfect hashing

abstract: In this work, we provide an upper bound for global certification of graph homomorphism, a generalization of graph coloring. In certification, the nodes of a network should decide if the network satisfies a given property, thanks to small pieces of information called certificates. Here, there is only one global certificate which is shared by all the nodes, and the property we want to certify is the existence of a graph homomorphism to a given graph. For bipartiteness, a special case of graph homomorphism, Feuilloley and Hirvonen proved in~\cite{FeuilloleyH18} some upper and lower bounds on the size of the optimal certificate, and made the conjecture that their lower bound could be improved to match their upper bound. We prove that this conjecture is false: their lower bound was in fact optimal, and we prove it by providing the matching upper bound using a known result of perfect hashing.


title: Even better sums of squares over quintic and cyclotomic fields

abstract: We classify all totally real number fields of degree at most 5 that admit a universal quadratic form with rational integer coefficients; in fact, there are none over the previously unsolved cases of quartic and quintic fields. This fully settles the lifting problem for universal forms in degrees at most 5. The main tool behind the proof is a computationally intense classification of fields in which every multiple of 2 is the sum of squares. We further extend these results to some real cyclotomic fields of large degrees and prove Kitaoka's conjecture for them.


title: Controlling Inter-Particle Distances in Crowds of Motile, Cognitive, Active Particles

abstract: Distance control in many-particle systems is a fundamental problem in nature. This becomes particularly relevant in systems of active agents, which can sense their environment and react by adjusting their direction of motion. We employ agent-based simulations to investigate the complex interplay between agent activity, characterized by P{\'e}clet number $Pe$, reorientation maneuverability $\Omega$, vision angle $\theta$ and vision range $R_0$, and agent density, which determines agent distancing and dynamics. We focus on semi-dense crowds, where the vision range is much larger than the particle size. The minimal distance to the nearest neighbors, exposure time, and persistence of orientation direction are analyzed to characterize the behavior. With increasing particle speed at fixed maneuverability, particles approach each other more closely, and exhibit shorter exposure times. The temporal persistence of motion decreases with increasing $Pe$, reflecting the impact of activity and maneuverability on direction changes. For a vision angle $\theta=\pi/4$, we observe the emergence of flocking aggregates with a band-like structure, reminiscent of the Viscek model. Additionally, for vision angles $\theta\ge \pi/2$, several quantities are found to display a universal scaling behavior with scaling variable $Pe^{3/2}/\Omega$. Our results are in good agreement with recent experiments of pedestrians in confined spaces.


title: Stabilization of U 5$f^2$ configuration in UTe$_2$ through U 6d dimers in the presence of Te2 chains

abstract: We investigate the topological superconductor candidate UTe$_2$ using high-resolution valence-band resonant inelastic x-ray scattering at the U $M_{4,5}$-edges. We observe atomic-like low-energy excitations that support the correlated nature of this unconventional superconductor. These excitations originate from the U $5f^2$ configuration, which is unexpected since the short Te2-Te2 distances exclude Te2 being 2-. By utilizing the photoionization cross-section dependence of the photoemission spectra in combination with band structure calculations, we infer that the stabilization of the U $5f^2$ configuration is due to the U $6d$ bonding states in the U-dimers acting as a charge reservoir. Our results emphasize that the description of the physical properties should commence with a $5f^2$ $ansatz$.


title: Design and optimization of CdSe-CuSbSe2-based double-junction two-terminal tandem solar cells with VOC> 2.0 V and PCE over 42%

abstract: In this article, we demonstrate CdSe-CuSbSe2-based double junction two-terminal tandem solar cells simulated with SCAPS-1D. The highest performance of the tandem cell has been confirmed by optimizing the electrical and optical properties of window, top absorber, CdSe (bandgap 1.7 eV), bottom absorber, CuSbSe2 (bandgap 1.08 eV) and back surface layers. In addition, the effect of different parameters such as thickness, doping, defect density of different layers has been investigated in details. With the optimized condition, the modeled CdSe-CuSbSe2 double-junction two-terminal tandem solar cell displays the noticeable efficiency of 42.64% with open circuit voltage of 2.09 V, short circuit current density of 24.09 mA/cm2 and fill factor of 84.36%, respectively. These results are highly propitious for the construction of all-chalcogenide based high performance tandem photovoltaic cells in the future.


title: On the calculation and use of effective single-particle energies. The example of the neutron $1d_{3/2}$-$1d_{5/2}$ splitting along $\text{N}=20$ isotones

abstract: The rich phenomenology of quantum many-body systems such as atomic nuclei is complex to interpret. Often, the behaviour (e.g. evolution with the number of constituents) of measurable/observable quantities such as binding or excitation energies can be best understood on the basis of a simplified picture involving auxiliary quantities that are not observable, i.e. whose values vary with parameters that are internal to the theoretical construction (contrarily to measurable/observable quantities). While being useful, the simplified interpretation is thus theoretical-scheme-dependent. This applies, in particular, to the so-called single-nucleon shell structure based on auxiliary effective single-particle energies (ESPEs). In this context, the present work aims at (i) recalling the way to compute ESPEs out of solutions of many-body Schr\"odinger's equation, (ii) illustrating the use of ESPEs within the frame of state-of-the-art ab initio calculations to interpret the outcome of a recent nuclear experiment and (iii) demonstrating the impact of several alterations to the computation of ESPEs. While the chosen alterations constitute approximations within the ab initio scheme, they are built-in when employing other theoretical constructs at play in nuclear physics. The present considerations are thus meant to empirically illustrate variations that can be expected between ESPEs computed within different (equally valid) theoretical schemes.


title: Position Paper: Toward New Frameworks for Studying Model Representations

abstract: Mechanistic interpretability (MI) aims to understand AI models by reverse-engineering the exact algorithms neural networks learn. Most works in MI so far have studied behaviors and capabilities that are trivial and token-aligned. However, most capabilities are not that trivial, which advocates for the study of hidden representations inside these networks as the unit of analysis. We do a literature review, formalize representations for features and behaviors, highlight their importance and evaluation, and perform some basic exploration in the mechanistic interpretability of representations. With discussion and exploratory results, we justify our position that studying representations is an important and under-studied field, and that currently established methods in MI are not sufficient to understand representations, thus pushing for the research community to work toward new frameworks for studying representations.


title: High-order stochastic integration schemes for the Rosenbluth-Trubnikov collision operator in particle simulations

abstract: In this study, we consider a numerical implementation of the nonlinear Rosenbluth-Trubnikov collision operator for particle simulations in plasma physics in the framework of the finite element method (FEM). The relevant particle evolution equations are formulated as stochastic differential equations, both in the Stratonovich and It\^o forms, and are then solved with advanced high-order stochastic numerical schemes. Due to its formulation as a stochastic differential equation, both the drift and diffusion components of the collision operator are treated on an equal footing. Our investigation focuses on assessing the accuracy of these schemes. Previous studies on this subject have used the Euler-Maruyama scheme, which, although popular, is of low order, and requires small time steps to achieve satisfactory accuracy. In this work, we compare the performance of the Euler-Maruyama method to other high-order stochastic methods known in the stochastic differential equations literature. Our study reveals advantageous features of these high-order schemes, such as better accuracy and improved conservation properties of the numerical solution. The main test case used in the numerical experiments is the thermalization of isotropic and anisotropic particle distributions.

categories: physics.plasm-ph math-ph math.MP physics.comp-ph


title: Steady periodic hydroelastic waves in polar regions

abstract: We construct two-dimensional steady periodic hydroelastic waves with vorticity that propagate on water of finite depth under a deformable floating elastic plate which is modeled by using the special Cosserat theory of hyperelastic shells satisfying Kirchhoff's hypothesis. This is achieved by providing necessary and sufficient condition for local bifurcation from the trivial branch of laminar flow solutions.


title: Higher-order nonclassicalities in hybrid coherent states

abstract: In the development of quantum technologies, nonclassical states have been playing a pivotal role, as quantum advantage cannot be obtained without appropriate utilization of nonclassicality. In the present work, we consider a hybrid coherent state (HCS), which is a coherent superposition of the single-photon-added coherent (SPAC) state and a coherent state (CS). Here, we report higher-order nonclassical properties of HCS with a specific focus on higher-order squeezing and higher-order antibunching. It's shown that HCS is experimentally realizable, and this engineered quantum state can be used to produce quantum states with desired higher-order nonclassical properties.


title: General boundary conditions for a Boussinesq model with varying bathymetry

abstract: This paper is devoted to the theoretical and numerical investigation of the initial boundary value problem for a system of equations used for the description of waves in coastal areas, namely, the Boussinesq-Abbott system in the presence of topography. We propose a procedure that allows one to handle very general linear or nonlinear boundary conditions. It consists in reducing the problem to a system of conservation laws with nonlocal fluxes and coupled to an ODE. This reformulation is used to propose two hybrid finite volumes/finite differences schemes of first and second order respectively. The possibility to use many kinds of boundary conditions is used to investigate numerically the asymptotic stability of the boundary conditions, which is an issue of practical relevance in coastal oceanography since asymptotically stable boundary conditions would allow one to reconstruct a wave field from the knowledge of the boundary data only, even if the initial data is not known.

categories: math.AP cs.NA math-ph math.MP math.NA physics.ao-ph physics.flu-dyn


title: AED: Adaptable Error Detection for Few-shot Imitation Policy

abstract: We introduce a new task called Adaptable Error Detection (AED), which aims to identify behavior errors in few-shot imitation (FSI) policies based on visual observations in novel environments. The potential to cause serious damage to surrounding areas limits the application of FSI policies in real-world scenarios. Thus, a robust system is necessary to notify operators when FSI policies are inconsistent with the intent of demonstrations. This task introduces three challenges: (1) detecting behavior errors in novel environments, (2) identifying behavior errors that occur without revealing notable changes, and (3) lacking complete temporal information of the rollout due to the necessity of online detection. However, the existing benchmarks cannot support the development of AED because their tasks do not present all these challenges. To this end, we develop a cross-domain AED benchmark, consisting of 322 base and 153 novel environments. Additionally, we propose Pattern Observer (PrObe) to address these challenges. PrObe is equipped with a powerful pattern extractor and guided by novel learning objectives to parse discernible patterns in the policy feature representations of normal or error states. Through our comprehensive evaluation, PrObe demonstrates superior capability to detect errors arising from a wide range of FSI policies, consistently surpassing strong baselines. Moreover, we conduct detailed ablations and a pilot study on error correction to validate the effectiveness of the proposed architecture design and the practicality of the AED task, respectively.


title: A Bernoulli-barycentric rational matrix collocation method with preconditioning for a class of evolutionary PDEs

abstract: We propose a Bernoulli-barycentric rational matrix collocation method for two-dimensional evolutionary partial differential equations (PDEs) with variable coefficients that combines Bernoulli polynomials with barycentric rational interpolations in time and space, respectively. The theoretical accuracy $O\left((2\pi)^{-N}+h_x^{d_x-1}+h_y^{d_y-1}\right)$ of our numerical scheme is proven, where $N$ is the number of basis functions in time, $h_x$ and $h_y$ are the grid sizes in the $x$, $y$-directions, respectively, and $0\leq d_x\leq \frac{b-a}{h_x},~0\leq d_y\leq\frac{d-c}{h_y}$. For the efficient solution of the relevant linear system arising from the discretizations, we introduce a class of dimension expanded preconditioners that take the advantage of structural properties of the coefficient matrices, and we present a theoretical analysis of eigenvalue distributions of the preconditioned matrices. The effectiveness of our proposed method and preconditioners are studied for solving some real-world examples represented by the heat conduction equation, the advection-diffusion equation, the wave equation and telegraph equations.


title: Nonstationary Discounted Stochastic Games under Prospect Theory with Applications to the Smart Grid

abstract: This paper considers the discounted criterion of nonzero-sum decentralized stochastic games with prospect players. The state and action spaces are finite. The state transition probability is nonstationary. Each player independently controls their own Markov chain. The subjective behavior of players is described by the prospect theory (PT). Compared to the average criterion of stochastic games under PT studied firstly in 2018, we are concerned with the time value of utility, i.e., the utility should be discounted in the future. Since PT distorts the probability, the optimality equation that plays a significant role in proving the existence of equilibrium does not exist. On the other hand, the games change into Markov decision processes (MDPs) with nonstationary payoff function when fixing others' stationary Markov strategies, then the occupation measure and the linear programming of stationary MDPs are no longer suitable. Therefore, we explore a new technique by constructing the marginal distribution on the state-action pairs at any time, and establish the existence of Nash equilibrium. When the initial state is given, there exists a Markov Nash equilibrium. Furthermore, this novel technique can be extended to the finite horizon criterion. Then, we present an algorithm to find a Markov $\varepsilon$-equilibrium. Finally, the model is applied to a noncooperative stochastic game among prosumers who can produce and consume energy in the smart grid, and we give some simulation results.


title: B rare decays: theory overview

abstract: In this proceeding we will review the current theoretical status of rare $B$ decays. These decays are indeed excellent indirect probes for New Physics searches, and in the current situation where no new states have been directly observed at collider, they provide a fundamental and alternative approach in the quest for Physics beyond the Standard Model. We will focus on the following classes of decays: $B_q\to\tau\nu$, $B_q\to\mu\mu$, $B\to K^{(*)}\nu\bar\nu$, $B\to K^{(*)}\ell\ell$, $B_s\to\phi\ell\ell$ and $b\to s\gamma$. The most updated Standard Model predictions will be provided, highlighting which are the main sources of uncertainty, and what is the possibility for New Physics effects when confronting the theory numbers to current experimental results.


title: The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks

abstract: The Neural Tangent Kernel (NTK) viewpoint is widely employed to analyze the training dynamics of overparameterized Physics-Informed Neural Networks (PINNs). However, unlike the case of linear Partial Differential Equations (PDEs), we show how the NTK perspective falls short in the nonlinear scenario. Specifically, we establish that the NTK yields a random matrix at initialization that is not constant during training, contrary to conventional belief. Another significant difference from the linear regime is that, even in the idealistic infinite-width limit, the Hessian does not vanish and hence it cannot be disregarded during training. This motivates the adoption of second-order optimization methods. We explore the convergence guarantees of such methods in both linear and nonlinear cases, addressing challenges such as spectral bias and slow convergence. Every theoretical result is supported by numerical examples with both linear and nonlinear PDEs, and we highlight the benefits of second-order methods in benchmark test cases.


title: Design and implementation of multiprotocol framework for residential prosumer incorporation in flexibility markets

abstract: The growth of distributed renewable energy in the electrical grid presents challenges to its stability and quality. To address this at the local level, flexibility energy strategies emerge as an innovative technique. However, managing these strategies in residential areas becomes complex due to the unique characteristics of each prosumer. A major challenge lies in managing communication among diverse devices with different protocols. To address these issues, a comprehensive framework is designed and implemented to facilitate prosumers' integration in flexibility strategies, addressing communication at various levels. The effectiveness of the proposed framework is demonstrated through its implementation in a real smart home environment with diverse devices. The framework enables seamless integration and communication between IoT devices and IEC 61,850-compliant power devices. This research presents a novel approach to address the challenges of managing flexibility strategies in residential areas, providing a practical solution for prosumers to actively participate in optimizing energy consumption and enhancing the stability and quality of the electricity system amidst the growing integration of distributed renewable energy.


title: Patterns in temporal networks with higher-order egocentric structures

abstract: The analysis of complex and time-evolving interactions like social dynamics represents a current challenge for the science of complex systems. Temporal networks stand as a suitable tool to schematise such systems, encoding all the appearing interactions between pairs of individuals in discrete time. Over the years, network science has developed many measures to analyse and compare temporal networks. Some of them imply a decomposition of the network into small pieces of interactions, i.e. only involving a few nodes for a short time range. Along this line, a possible way to decompose a network is to assume an egocentric perspective, i.e. to consider for each node the time evolution of its neighbourhood. This has been proposed by Longa et al. by defining the "egocentric temporal neighbourhood", which has proven a useful tool to characterise temporal networks relative to social interactions. However, this definition neglects group interactions (quite common in social domains) as they are always decomposed into pairwise connections.A more general framework that allows us to consider also larger interactions is represented by higher-order networks. Here, we generalise the description of social interactions by making use of hypergraphs, consequently, we generalise its decomposition into "hyper egocentric temporal neighbourhoods". This will allow us to analyse social interactions, to compare different datasets or different nodes inside a dataset, by taking into account the intrinsic complexity represented by higher-order interactions. Even if we limit the order of interactions to the second (triplets of nodes), our results reveal the importance of a higher-order representation. In fact, our analyses show second-order structures are responsible for the majority of the variability at all scales: between datasets, amongst nodes and over time.


title: Binaural sound source localization using a hybrid time and frequency domain model

abstract: This paper introduces a new approach to sound source localization using head-related transfer function (HRTF) characteristics, which enable precise full-sphere localization from raw data. While previous research focused primarily on using extensive microphone arrays in the frontal plane, this arrangement often encountered limitations in accuracy and robustness when dealing with smaller microphone arrays. Our model proposes using both time and frequency domain for sound source localization while utilizing Deep Learning (DL) approach. The performance of our proposed model, surpasses the current state-of-the-art results. Specifically, it boasts an average angular error of $0.24 degrees and an average Euclidean distance of 0.01 meters, while the known state-of-the-art gives average angular error of 19.07 degrees and average Euclidean distance of 1.08 meters. This level of accuracy is of paramount importance for a wide range of applications, including robotics, virtual reality, and aiding individuals with cochlear implants (CI).


title: Solving Order 3 Difference Equations

abstract: We classify order $3$ linear difference operators over $\mathbb{C}(x)$ that are solvable in terms of lower order difference operators. To prove this result, we introduce the notion of absolute irreducibility for difference modules, and classify modules that are irreducible but not absolutely irreducible by using restricted and induced modules. We also show how restriction and induction give coordinate-free formulations of sectioning and interlacing of sequences.


title: Eigenmode Decomposition Method for Full-Wave Modeling of Microring Resonators

abstract: We develop a theoretical predictive model for an all-pass ring resonator that enables the most complete description of linear coupling regimes. The model is based on eigenmode decomposition of Maxwell's equations with full account of the confined and leaky modes, as opposed to the existing phenomenological methods restricted to the confined modes only. This model enables quantitative description of all-pass ring resonators and provides insights into the physics underlying microring-waveguide coupling. We experimentally validate the model using transmission measurements in the linear regime of aluminium nitride resonators. The developed model is then used to explore the field enhancement in microrings crucial for nonlinear photonic applications.


title: Less than one percent of words would be affected by gender-inclusive language in German press texts

abstract: Research on gender and language is tightly knitted to social debates on gender equality and non-discriminatory language use. Psycholinguistic scholars have made significant contributions in this field. However, corpus-based studies that investigate these matters within the context of language use are still rare. In our study, we address the question of how much textual material would actually have to be changed if non-gender-inclusive texts were rewritten to be gender-inclusive. This quantitative measure is an important empirical insight, as a recurring argument against the use of gender-inclusive German is that it supposedly makes written texts too long and complicated. It is also argued that gender-inclusive language has negative effects on language learners. However, such effects are only likely if gender-inclusive texts are very different from those that are not gender-inclusive. In our corpus-linguistic study, we manually annotated German press texts to identify the parts that would have to be changed. Our results show that, on average, less than 1% of all tokens would be affected by gender-inclusive language. This small proportion calls into question whether gender-inclusive German presents a substantial barrier to understanding and learning the language, particularly when we take into account the potential complexities of interpreting masculine generics.


title: Geometric quantum machine learning of BQP$^A$ protocols and latent graph classifiers

abstract: Geometric quantum machine learning (GQML) aims to embed problem symmetries for learning efficient solving protocols. However, the question remains if (G)QML can be routinely used for constructing protocols with an exponential separation from classical analogs. In this Letter we consider Simon's problem for learning properties of Boolean functions, and show that this can be related to an unsupervised circuit classification problem. Using the workflow of geometric QML, we learn from first principles Simon's algorithm, thus discovering an example of BQP$^A\neq$BPP protocol with respect to some dataset (oracle $A$). Our key findings include the development of an equivariant feature map for embedding Boolean functions, based on twirling with respect to identified bitflip and permutational symmetries, and measurement based on invariant observables with a sampling advantage. The proposed workflow points to the importance of data embeddings and classical post-processing, while keeping the variational circuit as a trivial identity operator. Next, developing the intuition for the function learning, we visualize instances as directed computational hypergraphs, and observe that the GQML protocol can access their global topological features for distinguishing bijective and surjective functions. Finally, we discuss the prospects for learning other BQP$^A$-type protocols, and conjecture that this depends on the ability of simplifying embeddings-based oracles $A$ applied as a linear combination of unitaries.


title: Upper deviation probabilities for level sets of a supercritical branching random walk

abstract: Given a supercritical branching random walk $\{Z_n\}_{n\geq 0}$ on $\mathbb{R}$, let $Z_n([y,\infty))$ be the number of particles located in $[y,\infty)\subset\mathbb{R}$ at generation $n$. Let $m$ be the mean of the offspring law of $\{Z_n\}_{n\geq 0}$ and $I(x)$ be the large deviation rate function of the underlying random walk of $\{Z_n\}_{n\geq 0}$. It is known from [6] that under some mild conditions, for $x\in(0,x^*)$, $n^{-1}\log Z_n([nx,\infty))$ converges almost surely to $\log m- I(x)$ on the event of nonextinction as $n\to\infty$, where $x^*$ is the speed of maximal position of the branching random walk. In this work, we investigate its upper deviation probabilities, in other words, the convergence rates of \[\mathbb{P}(Z_n([xn,\infty))\geq e^{an})\] as $n\to\infty$, where $x>0$ and $a>(\log m- I(x))^+$. This paper is a counterpart work of the lower deviation probabilities [28] and also completes those results in [1] for the branching Brownian motion.


title: Comprehensive mass measurement study of ${}^{252}$Cf fission fragments with MRTOF-MS and masses of neutron-rich Ce isotopes

abstract: We report the mass measurements of neutron-rich isotopes produced via spontaneous fission of ${}^{252}$Cf using a multi-reflection time-of-flight mass spectrograph. The mass of ${}^{155}$Ce is determined experimentally for the first time. A discrepancy between the experimental and literature values was found for the mass of ${}^{127}$Sb, which was previously deduced through indirect measurements. In comparison with several theoretical predictions, both the values and the trend of the mass excesses of ${}^{152-155}$Ce cannot be consistently explained. The wide-range and simultaneous mass measurements of the multi-reflection time-of-flight mass spectrograph enable us to reexamine existing mass data. The new measurements suggest corrections to the present values, including data from previous Penning trap mass measurements.


title: Holomorphic forms and non-tautological cycles on moduli spaces of curves

abstract: We prove, for infinitely many values of $g$ and $n$, the existence of non-tautological algebraic cohomology classes on the moduli space $\mathcal{M}_{g,n}$ of smooth, genus-$g$, $n$-pointed curves. In particular, when $n=0$, our results show that there exist non-tautological algebraic cohomology classes on $\mathcal{M}_g$ for $g=12$ and all $g \geq 16$. These results generalize the work of Graber--Pandharipande and van Zelm, who proved that the classes of particular loci of bielliptic curves are non-tautological and thereby exhibited the only previously-known non-tautological class on any $\mathcal{M}_g$: the bielliptic cycle on $\mathcal{M}_{12}$. We extend their work by using the existence of holomorphic forms on certain moduli spaces $\overline{\mathcal{M}}_{g,n}$ to produce non-tautological classes with nontrivial restriction to the interior, via which we conclude that the classes of many new double-cover loci are non-tautological.


title: Exotic Superfluid with Emergent flux in a one-dimensional Bose-Fermi mixture

abstract: We find a novel chiral superfluid (CSF) phase in a chain of Bose-Fermi mixture, which has been validated using two unbiased numerical methods, density matrix renormalization group and Grassmann multi-scale entanglement renormalization ansatz. The system hosts the interplay between two types of fermions: bare spinless fermions and composite fermions, the latter consisting of a fermion and a boson. In the CSF phase, bosons condensate at non-zero momentum $\pm 2\pi /L$ with chain length $L$. In essence, the local superfluid order parameter continuously rotates along the chain, indicating that the CSF phase spontaneously breaks time-reversal symmetry. This symmetry breaking gives rise to an emergent flux in the background, effectively optimizing the kinetic energy of the composite fermions within the system. We provide a physical understanding at the mean-field level. Furthermore, we demonstrate that the 1D CSF phase can emerge in a more widely applicable extended Hubbard model. The potential realization of this phase in cold-atom experiments has also been explored.


title: Convolutional Neural Networks and Volcano Plots: Screening and Prediction of Two-Dimensional Single-Atom Catalysts

abstract: Single-atom catalysts (SACs) have emerged as frontiers for catalyzing chemical reactions, yet the diverse combinations of active elements and support materials, the nature of coordination environments, elude traditional methodologies in searching optimal SAC systems with superior catalytic performance. Herein, by integrating multi-branch Convolutional Neural Network (CNN) analysis models to hybrid descriptor based activity volcano plot, 2D SAC system composed of diverse metallic single atoms anchored on six type of 2D supports, including graphitic carbon nitride, nitrogen-doped graphene, graphene with dual-vacancy, black phosphorous, boron nitride, and C2N, are screened for efficient CO2RR. Starting from establishing a correlation map between the adsorption energies of intermediates and diverse electronic and elementary descriptors, sole singular descriptor lost magic to predict catalytic activity. Deep learning method utilizing multi-branch CNN model therefore was employed, using 2D electronic density of states as input to predict adsorption energies. Hybrid-descriptor enveloping both C- and O-types of CO2RR intermediates was introduced to construct volcano plots and limiting potential periodic table, aiming for intuitive screening of catalyst candidates for efficient CO2 reduction to CH4. The eDOS occlusion experiments were performed to unravel individual orbital contribution to adsorption energy. To explore the electronic scale principle governing practical engineering catalytic CO2RR activity, orbitalwise eDOS shifting experiments based on CNN model were employed. The study involves examining the adsorption energy and, consequently, catalytic activities while varying supported single atoms. This work offers a tangible framework to inform both theoretical screening and experimental synthesis, thereby paving the way for systematically designing efficient SACs.


title: Beyond Lines and Circles: Unveiling the Geometric Reasoning Gap in Large Language Models

abstract: Large Language Models (LLMs) demonstrate ever-increasing abilities in mathematical and algorithmic tasks, yet their geometric reasoning skills are underexplored. We investigate LLMs' abilities in constructive geometric problem-solving one of the most fundamental steps in the development of human mathematical reasoning. Our work reveals notable challenges that the state-of-the-art LLMs face in this domain despite many successes in similar areas. LLMs exhibit biases in target variable selection and struggle with 2D spatial relationships, often misrepresenting and hallucinating objects and their placements. To this end, we introduce a framework that formulates an LLMs-based multi-agents system that enhances their existing reasoning potential by conducting an internal dialogue. This work underscores LLMs' current limitations in geometric reasoning and improves geometric reasoning capabilities through self-correction, collaboration, and diverse role specializations.