title: Borromean supercounterfluids at finite temperatures

abstract: While the properties of standard (single-component) superfluids are well understood, principal differences arise in a special type of multicomponent systems -- the so-called Borromean supercounterfluids -- in which (i) supertransport is possible only in the counterflow regime and (ii) there are three or more counterflowing components. Borromean supercounterfluids's correlation and topological properties distinguish them from their single- and two-component counterparts. The component-symmetric case characterized by a distinctively different universality class of the supercounterfluid-to-normal phase transition is especially interesting. Using the recently introduced concept of compact-gauge invariance as the guiding principle, we develop the finite-temperature description of Borromean supercounterfluids in terms of an asymptotically exact long-wave effective action. We formulate and study Borromean XY and loop statistical models, capturing the universal long-range properties and allowing us to perform efficient worm algorithm simulations. Numeric results demonstrate perfect agreement with analytic predictions. Particularly instructive is the two-dimensional case, where the Borromean nature of the system is strongly manifested while allowing for an asymptotically exact analytic description.


title: GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentation

abstract: Referring Video Object Segmentation (RVOS) aims to segment the object referred to by the query sentence throughout the entire video. Most existing methods require end-to-end training with dense mask annotations, which could be computation-consuming and less scalable. In this work, we aim to efficiently adapt foundation segmentation models for addressing RVOS from weak supervision with the proposed Grounded Prompting (GroPrompt) framework. More specifically, we propose Text-Aware Prompt Contrastive Learning (TAP-CL) to enhance the association between the position prompts and the referring sentences with only box supervisions, including Text-Contrastive Prompt Learning (TextCon) and Modality-Contrastive Prompt Learning (ModalCon) at frame level and video level, respectively. With the proposed TAP-CL, our GroPrompt framework can generate temporal-consistent yet text-aware position prompts describing locations and movements for the referred object from the video. The experimental results in the standard RVOS benchmarks (Ref-YouTube-VOS, Ref-DAVIS17, A2D-Sentences, and JHMDB-Sentences) demonstrate the competitive performance of our proposed GroPrompt framework given only bounding box weak supervisions.


title: Influence Maximization via Graph Neural Bandits

abstract: We consider a ubiquitous scenario in the study of Influence Maximization (IM), in which there is limited knowledge about the topology of the diffusion network. We set the IM problem in a multi-round diffusion campaign, aiming to maximize the number of distinct users that are influenced. Leveraging the capability of bandit algorithms to effectively balance the objectives of exploration and exploitation, as well as the expressivity of neural networks, our study explores the application of neural bandit algorithms to the IM problem. We propose the framework IM-GNB (Influence Maximization with Graph Neural Bandits), where we provide an estimate of the users' probabilities of being influenced by influencers (also known as diffusion seeds). This initial estimate forms the basis for constructing both an exploitation graph and an exploration one. Subsequently, IM-GNB handles the exploration-exploitation tradeoff, by selecting seed nodes in real-time using Graph Convolutional Networks (GCN), in which the pre-estimated graphs are employed to refine the influencers' estimated rewards in each contextual setting. Through extensive experiments on two large real-world datasets, we demonstrate the effectiveness of IM-GNB compared with other baseline methods, significantly improving the spread outcome of such diffusion campaigns, when the underlying network is unknown.


title: Quot scheme and deformation quantization

abstract: Let $X$ be a compact connected Riemann surface, and let ${\mathcal Q}(r,d)$ denote the quot scheme parametrizing the torsion quotients of ${\mathcal O}^{\oplus r}_X$ of degree $d$. Given a projective structure $P$ on $X$, we show that the cotangent bundle $T^*{\mathcal U}$ of a certain nonempty Zariski open subset ${\mathcal U}\, \subset\, {\mathcal Q}(r,d)$, equipped with the natural Liouville symplectic form, admits a canonical deformation quantization. When $r\,=\,1\,=\, d$, then ${\mathcal Q}(r,d)\,=\, X$; this case was addressed earlier in \cite{BB}.


title: LayerMerge: Neural Network Depth Compression through Layer Pruning and Merging

abstract: Recent works show that reducing the number of layers in a convolutional neural network can enhance efficiency while maintaining the performance of the network. Existing depth compression methods remove redundant non-linear activation functions and merge the consecutive convolution layers into a single layer. However, these methods suffer from a critical drawback; the kernel size of the merged layers becomes larger, significantly undermining the latency reduction gained from reducing the depth of the network. We show that this problem can be addressed by jointly pruning convolution layers and activation functions. To this end, we propose LayerMerge, a novel depth compression method that selects which activation layers and convolution layers to remove, to achieve a desired inference speed-up while minimizing performance loss. Since the corresponding selection problem involves an exponential search space, we formulate a novel surrogate optimization problem and efficiently solve it via dynamic programming. Empirical results demonstrate that our method consistently outperforms existing depth compression and layer pruning methods on various network architectures, both on image classification and generation tasks. We release the code at https://github.com/snu-mllab/LayerMerge.


title: Cohomological Hall algebras for 3-Calabi-Yau categories

abstract: The aim of this paper is to construct the cohomological Hall algebras for $3$-Calabi--Yau categories admitting a strong orientation data. This can be regarded as a mathematical definition of the algebra of BPS states, whose existence was first mathematically conjectured by Kontsevich and Soibelman. Along the way, we prove Joyce's conjecture on the functorial behaviour of the Donaldson--Thomas perverse sheaves for the attractor Lagrangian correspondence of $(-1)$-shifted symplectic stacks. This result allows us to construct a parabolic induction map for cohomological Donaldson--Thomas invariants of $G$-local systems on $3$-manifolds for a reductive group $G$, which can be regarded as a $3$-manifold analogue of the Eisenstein series functor in the geometric Langlands program.


title: Evaluating the design space of diffusion-based generative models

abstract: Most existing theoretical investigations of the accuracy of diffusion models, albeit significant, assume the score function has been approximated to a certain accuracy, and then use this a priori bound to control the error of generation. This article instead provides a first quantitative understanding of the whole generation process, i.e., both training and sampling. More precisely, it conducts a non-asymptotic convergence analysis of denoising score matching under gradient descent. In addition, a refined sampling error analysis for variance exploding models is also provided. The combination of these two results yields a full error analysis, which elucidates (again, but this time theoretically) how to design the training and sampling processes for effective generation. For instance, our theory implies a preference toward noise distribution and loss weighting that qualitatively agree with the ones used in [Karras et al. 2022]. It also provides some perspectives on why the time and variance schedule used in [Karras et al. 2022] could be better tuned than the pioneering version in [Song et al. 2020].


title: Towards an Automatic Framework for Solving Optimization Problems with Quantum Computers

abstract: Optimizing objective functions stands to benefit significantly from leveraging quantum computers, promising enhanced solution quality across various application domains in the future. However, harnessing the potential of quantum solvers necessitates formulating problems according to the Quadratic Unconstrained Binary Optimization (QUBO) model, demanding significant expertise in quantum computation and QUBO formulations. This expertise barrier limits access to quantum solutions. Fortunately, automating the conversion of conventional optimization problems into QUBO formulations presents a solution for promoting accessibility to quantum solvers. This article addresses the unmet need for a comprehensive automatic framework to assist users in utilizing quantum solvers for optimization tasks while preserving interfaces that closely resemble conventional optimization practices. The framework prompts users to specify variables, optimization criteria, as well as validity constraints and, afterwards, allows them to choose the desired solver. Subsequently, it automatically transforms the problem description into a format compatible with the chosen solver and provides the resulting solution. Additionally, the framework offers instruments for analyzing solution validity and quality. Comparative analysis against existing libraries and tools in the literature highlights the comprehensive nature of the proposed framework. Two use cases (the knapsack problem and linear regression) are considered to show the completeness and efficiency of the framework in real-world applications. Finally, the proposed framework represents a significant advancement towards automating quantum computing solutions and widening access to quantum optimization for a broader range of users.


title: Demystifying Higher-Order Graph Neural Networks

abstract: Higher-order graph neural networks (HOGNNs) are an important class of GNN models that harness polyadic relations between vertices beyond plain edges. They have been used to eliminate issues such as over-smoothing or over-squashing, to significantly enhance the accuracy of GNN predictions, to improve the expressiveness of GNN architectures, and for numerous other goals. A plethora of HOGNN models have been introduced, and they come with diverse neural architectures, and even with different notions of what the "higher-order" means. This richness makes it very challenging to appropriately analyze and compare HOGNN models, and to decide in what scenario to use specific ones. To alleviate this, we first design an in-depth taxonomy and a blueprint for HOGNNs. This facilitates designing models that maximize performance. Then, we use our taxonomy to analyze and compare the available HOGNN models. The outcomes of our analysis are synthesized in a set of insights that help to select the most beneficial GNN model in a given scenario, and a comprehensive list of challenges and opportunities for further research into more powerful HOGNNs.


title: A Characterization of Semi-Involutory MDS Matrices

abstract: In symmetric cryptography, maximum distance separable (MDS) matrices with computationally simple inverses have wide applications. Many block ciphers like AES, SQUARE, SHARK, and hash functions like PHOTON use an MDS matrix in the diffusion layer. In this article, we first characterize all $3 \times 3$ irreducible semi-involutory matrices over the finite field of characteristic $2$. Using this matrix characterization, we provide a necessary and sufficient condition to construct MDS semi-involutory matrices using only their diagonal entries and the entries of an associated diagonal matrix. Finally, we count the number of $3 \times 3$ semi-involutory MDS matrices over any finite field of characteristic $2$.


title: Can Go AIs be adversarially robust?

abstract: Prior work found that superhuman Go AIs like KataGo can be defeated by simple adversarial strategies. In this paper, we study if simple defenses can improve KataGo's worst-case performance. We test three natural defenses: adversarial training on hand-constructed positions, iterated adversarial training, and changing the network architecture. We find that some of these defenses are able to protect against previously discovered attacks. Unfortunately, we also find that none of these defenses are able to withstand adaptive attacks. In particular, we are able to train new adversaries that reliably defeat our defended agents by causing them to blunder in ways humans would not. Our results suggest that building robust AI systems is challenging even in narrow domains such as Go. For interactive examples of attacks and a link to our codebase, see https://goattack.far.ai.


title: Synergizing Foundation Models and Federated Learning: A Survey

abstract: The recent development of Foundation Models (FMs), represented by large language models, vision transformers, and multimodal models, has been making a significant impact on both academia and industry. Compared with small-scale models, FMs have a much stronger demand for high-volume data during the pre-training phase. Although general FMs can be pre-trained on data collected from open sources such as the Internet, domain-specific FMs need proprietary data, posing a practical challenge regarding the amount of data available due to privacy concerns. Federated Learning (FL) is a collaborative learning paradigm that breaks the barrier of data availability from different participants. Therefore, it provides a promising solution to customize and adapt FMs to a wide range of domain-specific tasks using distributed datasets whilst preserving privacy. This survey paper discusses the potentials and challenges of synergizing FL and FMs and summarizes core techniques, future directions, and applications. A periodically updated paper collection on FM-FL is available at https://github.com/lishenghui/awesome-fm-fl.


title: Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts

abstract: Reinforcement learning from human feedback (RLHF) has emerged as the primary method for aligning large language models (LLMs) with human preferences. The RLHF process typically starts by training a reward model (RM) using human preference data. Conventional RMs are trained on pairwise responses to the same user request, with relative ratings indicating which response humans prefer. The trained RM serves as a proxy for human preferences. However, due to the black-box nature of RMs, their outputs lack interpretability, as humans cannot intuitively understand why an RM thinks a response is good or not. As RMs act as human preference proxies, we believe they should be human-interpretable to ensure that their internal decision processes are consistent with human preferences and to prevent reward hacking in LLM alignment. To build RMs with interpretable preferences, we propose a two-stage approach: i) train an Absolute-Rating Multi-Objective Reward Model (ArmoRM) with multi-dimensional absolute-rating data, each dimension corresponding to a human-interpretable objective (e.g., honesty, verbosity, safety); ii) employ a Mixture-of-Experts (MoE) strategy with a gating network that automatically selects the most suitable reward objectives based on the context. We efficiently trained an ArmoRM with Llama-3 8B and a gating network consisting of a shallow MLP on top of the ArmoRM. Our trained model, ArmoRM-Llama3-8B, obtains state-of-the-art performance on RewardBench, a benchmark evaluating RMs for language modeling. Notably, the performance of our model surpasses the LLM-as-a-judge method with GPT-4 judges by a margin, and approaches the performance of the much larger Nemotron-4 340B reward model.


title: DrVideo: Document Retrieval Based Long Video Understanding

abstract: Existing methods for long video understanding primarily focus on videos only lasting tens of seconds, with limited exploration of techniques for handling longer videos. The increased number of frames in longer videos presents two main challenges: difficulty in locating key information and performing long-range reasoning. Thus, we propose DrVideo, a document-retrieval-based system designed for long video understanding. Our key idea is to convert the long-video understanding problem into a long-document understanding task so as to effectively leverage the power of large language models. Specifically, DrVideo transforms a long video into a text-based long document to initially retrieve key frames and augment the information of these frames, which is used this as the system's starting point. It then employs an agent-based iterative loop to continuously search for missing information, augment relevant data, and provide final predictions in a chain-of-thought manner once sufficient question-related information is gathered. Extensive experiments on long video benchmarks confirm the effectiveness of our method. DrVideo outperforms existing state-of-the-art methods with +3.8 accuracy on EgoSchema benchmark (3 minutes), +17.9 in MovieChat-1K break mode, +38.0 in MovieChat-1K global mode (10 minutes), and +30.2 on the LLama-Vid QA dataset (over 60 minutes).


title: ChangeViT: Unleashing Plain Vision Transformers for Change Detection

abstract: Change detection in remote sensing images is essential for tracking environmental changes on the Earth's surface. Despite the success of vision transformers (ViTs) as backbones in numerous computer vision applications, they remain underutilized in change detection, where convolutional neural networks (CNNs) continue to dominate due to their powerful feature extraction capabilities. In this paper, our study uncovers ViTs' unique advantage in discerning large-scale changes, a capability where CNNs fall short. Capitalizing on this insight, we introduce ChangeViT, a framework that adopts a plain ViT backbone to enhance the performance of large-scale changes. This framework is supplemented by a detail-capture module that generates detailed spatial features and a feature injector that efficiently integrates fine-grained spatial information into high-level semantic learning. The feature integration ensures that ChangeViT excels in both detecting large-scale changes and capturing fine-grained details, providing comprehensive change detection across diverse scales. Without bells and whistles, ChangeViT achieves state-of-the-art performance on three popular high-resolution datasets (i.e., LEVIR-CD, WHU-CD, and CLCD) and one low-resolution dataset (i.e., OSCD), which underscores the unleashed potential of plain ViTs for change detection. Furthermore, thorough quantitative and qualitative analyses validate the efficacy of the introduced modules, solidifying the effectiveness of our approach. The source code is available at https://github.com/zhuduowang/ChangeViT.


title: Manipulation and control of temporal cavity solitons with trapping potential

abstract: Temporal cavity solitons (CSs) are stable, localized particle-like objects in the form of optical pulses that circulate indefinitely in coherently driven nonlinear resonators. In the spectral domain, they form highly coherent frequency combs. Owing to their remarkable stability, they are attracting attention for applications in sensing, metrology, or optical signal synthesis. In this work, we report on the dynamics of CSs interacting with a trapping potential. We demonstrate that this interaction provides a powerful means to control their properties such as position, speed, and central frequency. Our theoretical analysis predicts fundamental limitations on the spectral shift of CSs relative to the driving frequency. Specifically, it reveals that within a broad range of detunings, frequency-shifted CSs encounter destabilization through a Hopf bifurcation. Moreover, we find that with periodic potentials, the Kelly sidebands emitted by trapped solitons undergo Bloch oscillations. In our experiments, we use an intracavity phase modulator to create the equivalent of an external real potential. We observe stable blue- and red- shifted solitons up to a limit close to our theoretical predictions. We then show theoretically and experimentally that this unprecedented level of control over the CS spectrum can be leveraged to cancel the Raman-induced self-frequency shift and even to stabilize CSs beyond the limitation imposed by stimulated Raman scattering. Our results provide valuable insights for applications requiring robust and potentially rapid tunable control over the cavity soliton properties.


title: Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentation

abstract: Accurately estimating depth in 360-degree imagery is crucial for virtual reality, autonomous navigation, and immersive media applications. Existing depth estimation methods designed for perspective-view imagery fail when applied to 360-degree images due to different camera projections and distortions, whereas 360-degree methods perform inferior due to the lack of labeled data pairs. We propose a new depth estimation framework that utilizes unlabeled 360-degree data effectively. Our approach uses state-of-the-art perspective depth estimation models as teacher models to generate pseudo labels through a six-face cube projection technique, enabling efficient labeling of depth in 360-degree images. This method leverages the increasing availability of large datasets. Our approach includes two main stages: offline mask generation for invalid regions and an online semi-supervised joint training regime. We tested our approach on benchmark datasets such as Matterport3D and Stanford2D3D, showing significant improvements in depth estimation accuracy, particularly in zero-shot scenarios. Our proposed training pipeline can enhance any 360 monocular depth estimator and demonstrates effective knowledge transfer across different camera projections and data types. See our project page for results: https://albert100121.github.io/Depth-Anywhere/


title: Machine learning guided discovery of stable, spin-resolved topological insulators

abstract: Identification of a non-trivial $\mathbb{Z}_{2}$ index in a spinful two dimensional insulator indicates the presence of an odd, quantized (pseudo)spin-resolved Chern number, $C_{s}=(C_{\uparrow}-C_{\downarrow})/2$. However, the statement is not biconditional. An odd spin-Chern number can survive when the familiar $\mathbb{Z}_{2}$ index vanishes. Identification of solid-state systems hosting an odd, quantized $C_{s}$ and trivial $\mathbb{Z}_{2}$ index is a pressing issue due to the potential for such insulators to admit band gaps optimal for experiments and quantum devices. Nevertheless, they have proven elusive due to the computational expense associated with their discovery. In this work, a neural network capable of identifying the spin-Chern number is developed and used to identify the first solid-state systems hosting a trivial $\mathbb{Z}_{2}$ index and odd $C_{s}$. We demonstrate the potential of one such system, Ti$_{2}$CO$_{2}$, to support Majorana corner modes via the superconducting proximity effect.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.str-el cond-mat.supr-con


title: Generalized entropy of photons in AdS

abstract: This work analyzes the quantum corrections to holographic entanglement entropy at first subleading order in $G_{N}$ due to photon excited states in AdS. We compute the vacuum-subtracted von Neumann entropy of a $U(1)$ current excited state for a polar cap region on the cylinder in any large-$N$, strongly-coupled CFT$_{d}$ holographically dual to weakly-coupled Einstein gravity for any dimension $d>2$. We then quantize a Maxwell field in AdS$_{d+1}$ dual to the $U(1)$ current and consider a photon excited state whose vacuum-subtracted generalized entropy for the entanglement wedge is calculated. In order to factorise the Maxwell Hilbert space in AdS, we construct an extended Hilbert space and the corresponding electromagnetic edge modes. We find exact agreement between the CFT entanglement entropy and AdS generalized entropy without the inclusion of entropy of the edge modes. Finally, we show via explicit calculation that the contribution to the vacuum-subtracted von Neumann entropy from electromagnetic edge modes indeed vanishes, which is crucial for consistency with known holographic entropy formulas.


title: Analyzing Dynamical Systems Inspired by Montgomery's Conjecture: Insights into Zeta Function Zeros and Chaos in Number Theory

abstract: In this study, we delve into a novel dynamic system inspired by Montgomery's pair correlation conjecture in number theory. The dynamic system is intricately designed to emulate the behavior of the nontrivial zeros of the Riemann zeta function. Our exploration encompasses bifurcation analysis and Lyapunov exponents to scrutinize the system's behavior and stability, offering insights into both small and large initial conditions. Our efforts extend to unveiling the probability distribution characterizing the dynamics for varying initial conditions. The dynamic system unfolds intricate behaviors, displaying sensitivity to initial conditions and revealing complex bifurcation patterns. Small deviations in the initial conditions unveil significantly different trajectories, reminiscent of chaotic systems. Lyapunov exponents become our lens into understanding stability and chaos within the system. A comparative analysis between the dynamic system's approximate solutions and the actual nontrivial zeros of the Riemann zeta function enhances our comprehension of model accuracy and its potential implications for number theory. This research illuminates the versatility of dynamic systems as analogs for studying complex mathematical phenomena. It provides fresh perspectives on the pair correlation conjecture, establishing connections with nonlinear dynamics and chaos theory. Notably, we delve into the boundedness of solutions for both small and large initial conditions, unraveling the distinctive probability distribution governing the dynamics in each scenario. Furthermore, we introduce an in-depth analysis of the entropy of our dynamic system for both small and large initial conditions. The entropy study enhances our understanding of the predictability and stability of the system, shedding light on its behavior in different parameter regimes.


title: Review of the analytical prediction method of surf-riding threshold in following sea, and its relation to IMO second-generation intact stability criteria

abstract: In high-speed maritime operations, the broaching phenomenon can pose a significant risk when navigating in following/quartering seas. The occurrence of this phenomenon can result in a violent yaw motion, regardless of the steering effort, which, in turn, cause the resulting centrifugal force to capsize a vessel. A necessary condition for the occurrence of broaching is the surf-riding phenomenon. Therefore, the International Maritime Organization (IMO) has set up criteria to include theoretical formulas for estimating the occurrence of surf-riding phenomena. The theoretical equation used in the IMO's second-generation intact stability criteria (SGISC) to estimate the surf-riding threshold is based on Melnikov's method. This paper presents nonlinear equations describing the forward and backward motions of a ship. However, such equations cannot be directly solved; therefore, we proposed the use of and explain various approximate solution methods, including Meknikov's method. Subsequently, the relationship between the theoretical prediction method of the surf-riding threshold rooted in Melnikov's method and the IMO's SGISC is determined.


title: Time and band limiting for exceptional polynomials

abstract: The "time-and-band limiting" commutative property was found and exploited by D. Slepian, H. Landau and H. Pollak at Bell Labs in the 1960's, and independently by M. Mehta and later by C. Tracy and H. Widom in Random matrix theory. The property in question is the existence of local operators with simple spectrum that commute with naturally appearing global ones. Here we give a general result that insures the existence of a commuting differential operator for a given family of exceptional orthogonal polynomials satisfying the "bispectral property". As a main tool we go beyond bispectrality and make use of the notion of Fourier Algebras associated to the given sequence of exceptional polynomials. We illustrate this result with two examples, of Hermite and Laguerre type, exhibiting also a nice Perline's form for the commuting differential operator.


title: Moving frame and spin field representations of submanifolds in flat space

abstract: We introduce a spin field approach, that is compatible with the Cartan moving frame method, to describe the submanifold in a flat space. In fact, we consider a kind of spin field $\psi$, that satisfies a Killing spin field equation (analogous to a Killing spinor equation) written in terms of the Clifford algebra, and we use the spin field to locally rotate the orthonormal basis $\{\hat{e}_\mathtt{I}\}$. Then, the deformed orthonormal frame $\{\tilde{\psi}\hat{e}_\mathtt{I}\psi\}$ can be seen as the moving frame of a submanifold. We find some solutions to the Killing spin field equation and demonstrate an explicit example. Using the product of the spin fields, one can easily generate a new immersion submanifold, and this technique should be useful for studies in geometry and physics. Through the spin field, we find a linear relation between the connection and the extrinsic curvature of the submanifold. We propose a conjecture that any solution of the Killing spin field equation can be locally written as the product of the solutions we find.


title: Dynamics of a Model of Polluted Lakes via Fractal-Fractional Operators with Two Different Numerical Algorithms

abstract: We employ Mittag-Leffler type kernels to solve a system of fractional differential equations using fractal-fractional (FF) operators with two fractal and fractional orders. Using the notion of FF-derivatives with nonsingular and nonlocal fading memory, a model of three polluted lakes with one source of pollution is investigated. The properties of a non-decreasing and compact mapping are used in order to prove the existence of a solution for the FF-model of polluted lake system. For this purpose, the Leray-Schauder theorem is used. After exploring stability requirements in four versions, the proposed model of polluted lakes system is then simulated using two new numerical techniques based on Adams-Bashforth and Newton polynomials methods. The effect of fractal-fractional differentiation is illustrated numerically. Moreover, the effect of the FF-derivatives is shown under three specific input models of the pollutant: linear, exponentially decaying, and periodic.


title: Transformations preserving the effective spectral radius of a matrix

abstract: We discuss transformations on matrices that preserve the effective spectrum and/or the effective spectral radius.


title: Tutorial on one-dimensional $q$-Fourier transforms

abstract: This paper is an introductory text to the theory of $q$-deformed Fourier transforms, as first discussed by Rogov and Olshanetsky. We derive the well-known results in detail, present them in a format that suits our needs, and include some new findings on specific aspects of the theory.


title: Cohomologies of Reynolds Lie-Yamaguti algebras of any weight and applications

abstract: The purpose of the present paper is to investigate cohomologies of Reynolds Lie-Yamaguti algebras of any weight and provide some applications. First, we introduce the notion of Reynolds Lie-Yamaguti algebras and give some new examples. Moreover, cohomologies of Reynolds operators and Reynolds Lie-Yamaguti algebras with coefficients in a suitable representation are established. Finally, formal deformations and abelian extensions of Reynolds Lie-Yamaguti algebras are characterized in terms of lower degree cohomology groups.


title: Permanence and Uniform Asymptotic Stability of Positive Solutions of SAIQH Models on Time Scales

abstract: A susceptible, asymptomatic, infectious, quarantined, and hospitalized (SAIQH) compartmental model on time scales is introduced and a suitable Lyapunov function is defined. Main results include: the proof that the system is permanent; proof of existence of solution; and sufficient conditions implying the dynamic system to have a unique almost periodic solution that is uniformly asymptotically stable. An example is presented supporting the obtained results.


title: Isomorphisms between lattices of hyperinvariant subspaces

abstract: Given two nilpotent endomorphisms, we determine when their lattices of hyperinvariant subspaces are isomorphic. The study of the lattice of hyperinvariant subspaces can be reduced to the nilpotent case when the endomorphism has a Jordan-Chevalley decomposition; for example, it occurs if the underlying field is the field of complex numbers.


title: Kato's chaos of multiple mappings and its continuous self-maps

abstract: In 2016, Hou and Wang introduced the concept of multiple mappings based on iterated function system, which is an important branch of fractal theory. In this paper, we introduce the definitions of sensitivity, accessibility, and Kato's chaos of multiple mappings from a set-valued perspective. We show that multiple mappings and its continuous self-maps do not imply each other in terms of sensitivity and accessibility. While a sufficient condition for multiple mappings to be sensitive, accessible and Kato's chaotic is provided, respectively. And the sensitivity, accessibility, and Kato's chaos of multiple mappings are preserved under topological conjugation.


title: Derivation of Chaotic Dynamics from Montgomery Conjecture and Its Interpretation as an Electrical System

abstract: In this paper, we present an innovative derivation of chaotic dynamics rooted in the Montgomery conjecture, specifically addressing the pair correlation of Riemann zeta function zeros. Our exploration unveils a recursive relation inspired by the conjecture, manifesting chaotic behavior. Remarkably, we interpret this derived chaotic dynamics as a unique representation of an electrical system, providing a novel perspective within the domain of electrical engineering. Beyond this groundbreaking derivation, our study delves into the potential applications of chaos theory, bifurcation analysis, and entropy within the framework of this electrical system. We scrutinize the implications of chaos for signal processing, conduct stability analysis through bifurcation studies, and investigate the role of entropy in quantifying the randomness or predictability of electrical signals. Additionally, we explore energy distribution aspects within the electrical system, shedding light on how chaotic dynamics influence energy dissipation and allocation. In the course of our research, a new finding emerged, contributing to our understanding of the derived chaotic dynamics. This discovery enhances the applicability of our framework within electrical engineering, paving the way for innovative applications and deeper explorations in the realm of system dynamics. Moreover, we draw comparisons with the dynamics presented in our recent paper published in the European Physical Journal, specifically addressing Yitang Zhang's contributions. This comparative analysis further underscores the unique characteristics and potential applications of the derived chaotic dynamics. This study not only elucidates the intricate connection between chaotic dynamics and number theory but also offers a transformative perspective that extends the boundaries of conventional electrical system analysis


title: Flat-virtual knot: introduction and some invariants

abstract: The motivation for this work is to construct a map from classical knots to virtual ones. What we get in the paper is a series of maps from knots in the full torus (thickened torus) to flat-virtual knots. We give definition of flat-virtual knots and presents Alexander-like polynomial and (picture-valued) Kauffman bracket for them.


title: Properties of minimal charts and their applications X: charts of type $(5,2)$

abstract: Charts are oriented labeled graphs in a disk. Any simple surface braid (2-dimensional braid) can be described by using a chart. Also, a chart represents an oriented closed surface embedded in 4-space. In this paper, we investigate embedded surfaces in 4-space by using charts. Let $\Gamma$ be a chart, and we denote by $\Gamma_m$ the union of all the edges of label $m$. A chart $\Gamma$ is of type $(5,2)$ if there exists a label $m$ such that $w(\Gamma)=7$, $w(\Gamma_m\cap\Gamma_{m+1})=5$, $w(\Gamma_{m+1}\cap\Gamma_{m+2})=2$ where $w(G)$ is the number of white vertices in $G$. In this paper, we investigate a minimal chart of type $(5,2)$.


title: Skew-supersymmetric solution of the super Malcev Yang-Baxter equation and Pre-Malcev superalgebras

abstract: The purpose of this paper is to introduce the notion of pre-Malcev superalgebras as the algebraic structure behind the super $\mathcal{O}$-operators on Malcev superalgebras. Moreover, the relations among Malcev superalgebras, pre-Malcev superalgebras and pre-alternative superalgebras are established. Then, we study the operator forms of the classical Yang-Baxter equation (CYBE) in Malcev superalgebras and give their relationship with super $\mathcal{O}$-operators. There are close relationships between the CYBE in Malcev superalgebras and pre-Malcev superalgebras which can be interpreted through the super $\mathcal{O}$-operators.


title: Classification of quasi-affine Generalized Dynkin Diagrams with Rank $3$ and Rank $2$

abstract: All quasi-affine connected Generalized Dynkin Diagram with rank $= 3$ and $2$ are found. All quasi-affine Nichols (Lie braided) algebras with rank $ 3$ and $2$ are also found.


title: Triple products of eigenfunctions and spectral geometry

abstract: Using elementary techniques from Geometric Analysis, Partial Differential Equations, and Abelian $C^*$ Algebras, we uncover a novel, yet familiar, global geometric invariant -- namely the indexed set of integrals of triple products of eigenfunctions of the Laplace-Beltrami operator, to precisely characterize which isospectral closed Riemannian manifolds are isometric.


title: Graph Neural Network-Based Pipeline for Track Finding in the Velo at LHCb

abstract: Over the next decade, increases in instantaneous luminosity and detector granularity will amplify the amount of data that has to be analysed by high-energy physics experiments, whether in real time or offline, by an order of magnitude. The reconstruction of charged particle tracks, which has always been a crucial element of offline data processing pipelines, must increasingly be deployed from the very first stages of the real time processing to enable experiments to achieve their physics goals. Graph Neural Networks (GNNs) have received a great deal of attention in the community because their computational complexity scales nearly linearly with the number of hits in the detector, unlike conventional algorithms which often scale quadratically or worse. This paper presents ETX4VELO, a GNN-based track-finding pipeline tailored for the Run 3 LHCb experiment's Vertex Locator, in the context of LHCb's fully GPU-based first-level trigger system, Allen. Currently implemented in Python, ETX4VELO offers the ability to reconstruct tracks with shared hits using a novel triplet-based method. When benchmarked against the traditional track-finding algorithm in Allen, this GNN-based approach not only matches but occasionally surpasses its physics performance. In particular, the fraction of fake tracks is reduced from over 2\% to below 1\% and the efficiency to reconstruct electrons is improved. While achieving comparable physics performance is a milestone, the immediate priority remains implementing ETX4VELO in Allen in order to determine and optimise its throughput, to meet the demands of this high-rate environment.


title: Water Cherenkov muon veto for the COSINUS experiment: design and simulation optimization

abstract: COSINUS is a dark matter (DM) direct search experiment that uses sodium iodide (NaI) crystals as cryogenic calorimeters. Thanks to the low nuclear recoil energy threshold and event-by-event discrimination capability, COSINUS will address the long-standing DM claim made by the DAMA/LIBRA collaboration. The experiment is currently under construction at the Laboratori Nazionali del Gran Sasso, Italy, and employs a large cylindrical water tank as a passive shield to meet the required background rate. However, muon-induced neutrons can mimic a DM signal therefore requiring an active veto system, which is achieved by instrumenting the water tank with an array of photomultiplier tubes (PMTs). This study optimizes the number, arrangement, and trigger conditions of the PMTs as well as the size of an optically invisible region. The objective was to maximize the muon veto efficiency while minimizing the accidental trigger rate due to the ambient and instrumental background. The final configuration predicts a veto efficiency of 99.63 $\pm$ 0.16 $\%$ and 44.4 $\pm$ $5.6\%$ in the tagging of muon events and showers of secondary particles, respectively. The active veto will reduce the cosmogenic neutron background rate to 0.11 $\pm$ 0.02 cts$\cdot$kg$^{-1}$$\cdot$year$^{-1}$, corresponding to less than one background event in the region of interest for the whole COSINUS-1$\pi$ exposure of 1000 kg$\cdot$days.


title: Weighted differential ($q$-tri)dendriform algebras

abstract: In this paper, we first introduce a weighted derivation on algebras over an operad $\cal P$, and prove that for the free $\cal P$-algebra, its weighted derivation is determined by the restriction on the generators. As applications, we propose the concept of weighted differential ($q$-tri)dendriform algebras and study some basic properties of them. Then Novikov-(tri)dendriform algebras are initiated, which can be induced from differential ($q$-tri) dendriform of weight zero. Finally, the corresponding free objects are constructed, in both the commutative and noncommutative contexts.


title: On the third cohomology of the Lie algebra of vector fields on weighted densities on R

abstract: Let Vect($\mathbb{R}$) be the Lie algebra of smooth vector fields on $\mathbb{R}$ and $\mathbb{F}_{\lambda}$ be the space of $\lambda$-densities on $\mathbb{R}$. Vect($\mathbb{R}$) acts on $\mathbb{F}_{\lambda}$ by Lie derivative. In this paper, we compute the third differential cohomology of the Lie algebra Vect($\mathbb{R}$) with coeffcients in the space $\mathbb{F}_{\lambda}.$ Explicit cocycles spanning these cohomology spaces are given.


title: Evidence for polyimide redeposition and possible correlation with sparks in Gas Electron Multipliers working in CF$_4$ mixtures

abstract: Research on aging processes of Gas Electron Multipliers (GEMs) is important to obtain insights on how to increase the detector's longevity, stability, and performance, as highlighted in the latest developments roadmap by the European Council of Future Accelerators (ECFA). One key aspect of the aging process is the deposit formation on the electrodes surfaces. In this work, through the analysis of the molecular content on the surface of a used GEM, we provide evidence for polyimide redeposition as a source of organic material contributing to the formation of insulating layers on the electrodes, which eventually lead to sparks and detector failure. Furthermore, we show that chromium, used to promote adhesion between copper and polyimide, in the device undergoes a diffusion process, effectively blurring the layered structure. We demonstrate the significance of surface-sensitive chemical analysis to investigate the surface deposits on electrodes of gaseous detectors and our results reveal the necessity of standardization and more stringent study protocols.


title: The Design, Implementation, and Performance of the LZ Calibration Systems

abstract: LUX-ZEPLIN (LZ) is a tonne-scale experiment searching for direct dark matter interactions and other rare events. It is located at the Sanford Underground Research Facility (SURF) in Lead, South Dakota, USA. The core of the LZ detector is a dual-phase xenon time projection chamber (TPC), designed with the primary goal of detecting Weakly Interacting Massive Particles (WIMPs) via their induced low energy nuclear recoils. Surrounding the TPC, two veto detectors immersed in an ultra-pure water tank enable reducing background events to enhance the discovery potential. Intricate calibration systems are purposely designed to precisely understand the responses of these three detector volumes to various types of particle interactions and to demonstrate LZ's ability to discriminate between signals and backgrounds. In this paper, we present a comprehensive discussion of the key features, requirements, and performance of the LZ calibration systems, which play a crucial role in enabling LZ's WIMP-search and its broad science program. The thorough description of these calibration systems, with an emphasis on their novel aspects, is valuable for future calibration efforts in direct dark matter and other rare-event search experiments.


title: Machine learning evaluation in the Global Event Processor FPGA for the ATLAS trigger upgrade

abstract: The Global Event Processor (GEP) FPGA is an area-constrained, performance-critical element of the Large Hadron Collider's (LHC) ATLAS experiment. It needs to very quickly determine which small fraction of detected events should be retained for further processing, and which other events will be discarded. This system involves a large number of individual processing tasks, brought together within the overall Algorithm Processing Platform (APP), to make filtering decisions at an overall latency of no more than 8ms. Currently, such filtering tasks are hand-coded implementations of standard deterministic signal processing tasks. In this paper we present methods to automatically create machine learning based algorithms for use within the APP framework, and demonstrate several successful such deployments. We leverage existing machine learning to FPGA flows such as hls4ml and fwX to significantly reduce the complexity of algorithm design. These have resulted in implementations of various machine learning algorithms with latencies of 1.2us and less than 5% resource utilization on an Xilinx XCVU9P FPGA. Finally, we implement these algorithms into the GEP system and present their actual performance. Our work shows the potential of using machine learning in the GEP for high-energy physics applications. This can significantly improve the performance of the trigger system and enable the ATLAS experiment to collect more data and make more discoveries. The architecture and approach presented in this paper can also be applied to other applications that require real-time processing of large volumes of data.


title: Controlling Chaos Using Edge Computing Hardware

abstract: Machine learning provides a data-driven approach for creating a digital twin of a system - a digital model used to predict the system behavior. Having an accurate digital twin can drive many applications, such as controlling autonomous systems. Often the size, weight, and power consumption of the digital twin or related controller must be minimized, ideally realized on embedded computing hardware that can operate without a cloud-computing connection. Here, we show that a nonlinear controller based on next-generation reservoir computing can tackle a difficult control problem: controlling a chaotic system to an arbitrary time-dependent state. The model is accurate, yet it is small enough to be evaluated on a field-programmable gate array typically found in embedded devices. Furthermore, the model only requires 25.0 $\pm$ 7.0 nJ per evaluation, well below other algorithms, even without systematic power optimization. Our work represents the first step in deploying efficient machine learning algorithms to the computing "edge."


title: Design of a SiPM-on-Tile ZDC for the future EIC and its Performance with Graph Neural Networks

abstract: We present a design for a high-granularity zero-degree calorimeter (ZDC) for the upcoming Electron-Ion Collider (EIC). The design uses SiPM-on-tile technology and features a novel staggered-layer arrangement that improves spatial resolution. To fully leverage the design's high granularity and non-trivial geometry, we employ graph neural networks (GNNs) for energy and angle regression as well as signal classification. The GNN-boosted performance metrics meet, and in some cases, significantly surpass the requirements set in the EIC Yellow Report, laying the groundwork for enhanced measurements that will facilitate a wide physics program. Our studies show that GNNs can significantly enhance the performance of high-granularity CALICE-style calorimeters by automating and optimizing the software compensation algorithms required for these systems. This improvement holds true even in the case of complicated geometries that pose challenges for image-based AI/ML methods.


title: Beam test results of the prototype of the multi wire drift chamber for the CSR external-target experiment

abstract: The half-size prototype of the multi wire drift chamber (MWDC) for the cooling storage ring (CSR) external-target experiment (CEE) was assembled and tested in 350 MeV/u Kr+Fe reactions on the heavy ion research facility in Lanzhou (HIRFL). The prototype consists of 6 sense layers, where the sense wires are stretched in three directions X, U and V, meeting $0^\circ$, $30^\circ$ and $-30^\circ$ with respect to the vertical axis, respectively. The sensitive area of the prototype is $76 {\rm cm} \times 76 {\rm cm}$. The amplified and shaped signals from the anode wires are digitized in a serial capacity array. Being operated with 1500 V high voltage on the anode wires, the efficiency for each layer is beyond 95\%. The tracking residual is about $301 \pm 2 \rm \mu m$. The performance meets the requirements of CEE.


title: Bayesian Approach to Particles Identification in the MPD Experimen

abstract: Identification of particles generated by ion collisions in the NICA collider is one of the basic functions of the Multipurpose Detector (MPD). The main means of identification in MPD are the time-of-flight system (TOF) and the time-projection chamber (TPC). The article considers the optimization of the algorithms of particles identification by these systems. Under certain conditions, the use of the statistical Bayesian approach has made it possible to achieve an optimal ratio of the efficiency of particle identification and contamination by incorrectly defined particles.


title: Technical design report for the CODEX-$\beta$ demonstrator

abstract: The CODEX-$\beta$ apparatus is a demonstrator for the proposed future CODEX-b experiment, a long-lived-particle detector foreseen for operation at IP8 during HL-LHC data-taking. The demonstrator project, intended to collect data in 2025, is described, with a particular focus on the design, construction, and installation of the new apparatus.


title: Towards Unlocking Insights from Logbooks Using AI

abstract: Electronic logbooks contain valuable information about activities and events concerning their associated particle accelerator facilities. However, the highly technical nature of logbook entries can hinder their usability and automation. As natural language processing (NLP) continues advancing, it offers opportunities to address various challenges that logbooks present. This work explores jointly testing a tailored Retrieval Augmented Generation (RAG) model for enhancing the usability of particle accelerator logbooks at institutes like DESY, BESSY, Fermilab, BNL, SLAC, LBNL, and CERN. The RAG model uses a corpus built on logbook contributions and aims to unlock insights from these logbooks by leveraging retrieval over facility datasets, including discussion about potential multimodal sources. Our goals are to increase the FAIR-ness (findability, accessibility, interoperability, and reusability) of logbooks by exploiting their information content to streamline everyday use, enable macro-analysis for root cause analysis, and facilitate problem-solving automation.


title: Examining LEGEND-1000 cosmogenic neutron backgrounds in Geant4 and MCNP

abstract: For next-generation neutrinoless double beta decay experiments, extremely low backgrounds are necessary. An understanding of in-situ cosmogenic backgrounds is critical to the design effort. In-situ cosmogenic backgrounds impose a depth requirement and especially impact the choice of host laboratory. Often, simulations are used to understand background effects, and these simulations can have large uncertainties. One way to characterize the systematic uncertainties is to compare unalike simulation programs. In this paper, a suite of neutron simulations with identical geometries and starting parameters have been performed with Geant4 and MCNP, using geometries relevant to the LEGEND-1000 experiment. This study is an important step in gauging the uncertainties of simulations-based estimates. To reduce project risks associated with simulation uncertainties, a novel alternative shield of methane-doped liquid argon is considered in this paper for LEGEND-1000, which could achieve large background reduction without requiring significant modification to the baseline design.


title: Optimization of a Welding Procedure for Making Critical Aluminum Welds on the LBNF Absorber Core Block

abstract: The LBNF Absorber consists of thirteen 6061-T6 aluminum core blocks. The core blocks are water cooled with de-ionized (DI) water which becomes radioactive during beam operations. The cooling water flows through gun-drilled channels in the core blocks. A weld quality optimization was performed to produce National Aeronautical Standard 1514 Class I quality welds on the aluminum core blocks. This was not successful in all cases. An existing Gas Tungsten Arc Welding Procedure Specification was fine tuned to minimize, in most cases, and eliminate detect-able tungsten inclusions in the welds. All the weld coupons, however passed welding inspection as per the piping code: ASME B31.3 Normal Fluid Service. Tungsten electrode diameter, type, and manufacturer were varied. Some of the samples were pre-heated and others were not. It was observed that larger diameter electrodes, 5/32 in., with pre-heated joints resulted in welds with the least number of tungsten inclusions. It is hypothesized that thinner electrodes breakdown easily and get lodged into the weld pool during the welding process. This breakdown is further enhanced by the large temperature differential between the un-preheated sample and the hot electrode.


title: Automorphisms of free metabelian Lie algebras

abstract: We show that every automorphism of a free metabelian Lie algebra $M_n$ of rank $n\geq 4$ over an arbitrary field $K$ is almost tame, that is, it is a product of so-called Chein automorphisms (or one-row transformations). Moreover, we show that the group of all automorphisms $\mathrm{Aut}(M_n)$ of $M_n$ of rank $n\geq 4$ over a field $K$ of characteristic $\neq 3$ is generated by all linear automorphisms, as well as one quadratic and one cubic automorphism. The same result holds for fields of any characteristic if $n\geq 5$. We also show that all Chein automorphisms of lower degree $\geq 4$ and all exponential automorphisms of lower degree $\geq 5$ are tame, which contradicts the results of \cite{BN,OE}.


title: neuSIM4: A comprehensive GEANT4 based neutron simulation code

abstract: A new neutron SIMulation program based on the versatile GEANT4 toolkit, neuSIM4, has been developed to describe interactions of neutrons in the NE213 liquid scintillator from 0.1 to 3000 MeV. neuSIM4 is designed to accommodate complicated modern detector geometry setups with multiple scintillator detectors, each of which can be outfitted with more than one photo-multiplier. To address a broad spectrum of neutron energies, two new neutron interaction physics models, KSCIN and NxQMD, have been implemented in GEANT4. For neutrons with energy below 110 MeV, we incorporate a total of eleven neutron induced reaction channels on hydrogen and carbon nuclei, including nine carbon inelastic reaction channels, into KSCIN. Beyond 110 MeV, we implement a neutron induced reaction model, NxQMD, in GEANT4. We use its results as reference to evaluate other neutron-interaction physics models in GEANT4. We find that results from an existing cascade physics model (INCL) in GEANT4 agree very well with the results from NxQMD, and results from both codes agree with new and existing light response data. To connect KSCIN to NxQMD or INCL, we introduce a transition region where the contribution of neuSIM4 linearly decreases with corresponding increased contributions from NxQMD or INCL. To demonstrate the application of the new code, we simulate the light response and performance of a 2 x 2 m2 neutron detector wall array consisting of 25 2m-long scintillation bars. We are able to compare the predicted light response functions to the shape of the experimental response functions and calculate the efficiency of the neutron detector array for neutron energies up to 200 MeV. These simulation results will be pivotal for understanding the performance of modern neutron arrays with intricate geometries, especially in the measurements of neutron energy spectra in heavy-ion reactions.


title: Bessel beam fabrication of graphitic micro electrodes in diamond using laser bursts

abstract: We present the fabrication of conductive graphitic microelectrodes in diamond by using pulsed Bessel beams in the burst mode laser writing regime. The graphitic wires are created in the bulk of a 500 {\mu}m thick monocrystalline HPHT diamond (with (100) orientation) perpendicular to the sample surface, without beam scanning or sample translation. In particular, the role of different burst features in the resistivity of such electrodes is investigated for two very different sub-pulse durations namely 200 fs and 10 ps, together with the role of thermal annealing. Micro-Raman spectroscopy is implemented to investigate the laser-induced crystalline modification, and the results obtained by using two different laser repetition rates, namely 20 Hz and 200 kHz, are compared. A comparison of the micro-Raman spectra and of the resistivity of the electrodes fabricated respectively with 10 ps single pulses and with bursts (of sub-pulses) of similar total duration has also been made, and we show that the burst mode writing regime allows to fabricate more conductive micro electrodes, thanks to the heat accumulation process leading to stronger graphitization. Moreover, the microfabrication of diamond by means of the longest available bursts (~ 46.7 ps duration) featured by 32 sub-pulses of 200 fs duration, with intra-burst time delay of 1.5 ps (sub-THz bursts), leads to graphitic wires with the lowest resistivity values obtained in this work, especially at low repetition rate such as 20 Hz. Indeed, micro electrodes with resistivity on the order of 0.01 {\Omega} cm can be fabricated by Bessel beams in the burst mode regime even when the bursts are constituted by femtosecond laser sub-pulses, in contrast with the results of the standard writing regime with single fs pulses typically leading to less conductive micro electrodes.


title: Scintillating low-temperature calorimeters for direct dark matter search

abstract: The lack of an unambiguous signal for thermally produced dark matter particles in direct detection, indirect detection, and collider searches calls for broadening the search strategies by probing a wider range of dark matter masses with different detection techniques. One of the most common approaches is to search for nuclear recoils induced by dark matter particles scattering off the target material's nuclei. Low-temperature detectors have proven to provide the required performance to probe dark matter masses from 100 MeV/c$^2$ to 100 GeV/c$^2$ via this channel. Using scintillation light as an ancillary channel is a powerful tool for particle identification and background suppression at the keV-recoil energy scale. The CRESST-III experiment, employing scintillating cryogenic detectors with highly sensitive transition edge sensors and multi-target absorber crystals, achieved unprecedented sensitivities to explore sub-GeV dark matter masses. COSINUS, instead, is a new experiment exploiting the phonon-light technique using sodium iodide crystals with the scope to clarify the long-lasting dark matter claim of the DAMA/LIBRA collaboration. This article reviews the principle of scintillating low-temperature calorimeters with emphasis on the benefits and challenges of this technique for direct dark matter searches in light of the current status and future developments.


title: A Space Group Symmetry Informed Network for O(3) Equivariant Crystal Tensor Prediction

abstract: We consider the prediction of general tensor properties of crystalline materials, including dielectric, piezoelectric, and elastic tensors. A key challenge here is how to make the predictions satisfy the unique tensor equivariance to O(3) group and invariance to crystal space groups. To this end, we propose a General Materials Tensor Network (GMTNet), which is carefully designed to satisfy the required symmetries. To evaluate our method, we curate a dataset and establish evaluation metrics that are tailored to the intricacies of crystal tensor predictions. Experimental results show that our GMTNet not only achieves promising performance on crystal tensors of various orders but also generates predictions fully consistent with the intrinsic crystal symmetries. Our code is publicly available as part of the AIRS library (https://github.com/divelab/AIRS).


title: Wide-bandgap semiconductor of three-dimensional unconventional stoichiometric NaCl2 crystal

abstract: The expanding applications call for novel new-generation wide-bandgap semiconductors. Here, we show that a compound only composed of the ordinary elements Na and Cl, namely three-dimensional NaCl2 crystal, is a wide-bandgap semiconductor. This finding benefits from the breaking of conventional stoichiometry frameworks in the theoretical design, leading to the discovery of three-dimensional XY2 (X = Na, Li, K; Y = Cl, F, Br, I) crystals, with covalent bonds of Y pairs inducing the wide bandgap from 2.24 to 4.45 eV. Crucially, such an unexpected NaCl2 crystal was successfully synthesized under ambient conditions. The unconventional stoichiometric strategy with other chemical elements potentially yields more wide-bandgap semiconductors, offering the capability for bandgap tuning. These unconventional stoichiometric materials may also exhibit superconductivity, transparent inorganic electrides, high-energy-density, and beyond.


title: The conductor ideals of maximal subrings in non-commutative rings

abstract: Let $R$ be a maximal subring of a ring $T$, and $(R:T)$, $(R:T)_l$ and $(R:T)_r$ denote the greatest ideal, left ideal and right ideal of $T$ which are contained in $R$, respectively. It is shown that $(R:T)_l$ and $(R:T)_r$ are prime ideals of $R$ and $|Min_R((R:T))|\leq 2$. We prove that if $T_R$ has a maximal submodule, then $(R:T)_l$ is a right primitive ideal of $R$. We investigate that when $(R:T)_r$ is a completely prime (right) ideal of $R$ or $T$. If $R$ is integrally closed in $T$, then $(R:T)_l$ and $(R:T)_r$ are prime one-sided ideals of $T$. We observe that if $(R:T)_lT=T$, then $T$ is a finitely generated left $R$-module and $(R:T)_l$ is a finitely generated right $R$-module. We prove that $Char(R/(R:T)_l)=Char(R/(R:T)_r)$, and if $Char(T)$ is neither zero or a prime number, then $(R:T)\neq 0$. If $|Min(R)|\geq 3$, then $(R:T)$ and $(R:T)_l(R:T)_r$ are nonzero ideals. Finally we study the Noetherian and the Artinian properties between $R$ and $T$.


title: Classical ideals theory of maximal subrings in non-commutative rings

abstract: Let $R$ be a maximal subring of a ring $T$. In this paper we study relation between some important ideals in the ring extension $R\subseteq T$. In fact, we would like to find some relation between $Nil_*(R)$ and $Nil_*(T)$, $Nil^*(R)$ and $Nil^*(T)$, $J(R)$ and $J(T)$, $Soc({}_RR)$ and $Soc({}_RT)$, and finally $Z({}_RR)$ and $Z({}_RT)$; especially, in certain cases, for example when $T$ is a reduced ring, $R$ (or $T$) is a left Artinian ring, or $R$ is a certain maximal subring of $T$. We show that either $Soc({}_RR)=Soc({}_RT)$ or $(R:T)_r$ (the greatest right ideal of $T$ which is contained in $R$) is a left primitive ideal of $R$. We prove that if $T$ is a reduced ring, then either $Z({}_RT)=0$ or $Z({}_RT)$ is a minimal ideal of $T$, $T=R\oplus Z({}_RT)$, and $(R:T)=(R:T)_l=(R:T)_r=ann_R(Z({}_RT))$. If $T=R\oplus I$, where $I$ is an ideal of $T$, then we completely determine relation between Jacobson radicals, lower nilradicals, upper nilradicals, socle and singular ideals of $R$ and $T$. Finally, we study the relation between previous ideals of $R$ and $T$ when either $R$ or $T$ is a left Artinian ring.


title: Synthesis and Characterization of NiCoMn MOFs for Wastewater Treatment

abstract: Water pollution has become a global problem. Sources of wastewater majorly include industrial and commercial sectors. To cater to the exponential increase in clean water, efficient technologies are needed to treat wastewater. Several techniques such as redox reactions, membrane filtrations, mechanical processes, chemical treatment and adsorption techniques have been employed. However, their cost and effectiveness is still a major problem. In this study, we employed an effective wastewater treatment technique by synthesizing NiCoMn MOFs using a simple hydrothermal technique and characterized the properties using XRD and SEM for their possible characteristics. XRD analysis confirmed the successful synthesis of NiCoMn MOFs. Sufficient information regarding the surface morphology and topology was given by the SEM analysis which proved a nanoporous structure with high surface area effective for adsorption and oxidative catalysis of contaminants in wastewater. Moreover, a high electrostatic attraction between the MOFs was observed which could attract oppositely charged contaminants. The results showed a high potential for the synthesized NiCoMn MOFs for wastewater treatment applications.


title: A variational method for the simulation of hydrogen diffusion in metals

abstract: We present a new method for the approximate solution of the strongly coupled, nonlinear stress-diffusion problem that appears when modeling hydrogen transport in metals. The most salient feature of the proposed approximation is that it is fully variational, meaning that all the discrete equations are obtained from the optimality conditions of an incremental potential, even for inelastic mechanical behavior. Like other variational methods, the proposed algorithm has remarkable properties, including the symmetry of the tangent operator, making its solution extremely efficient compared to other similar methods available in the literature.


title: The importance of definitions in crystallography

abstract: This paper was motivated by the articles "Same or different - that is the question" in CrystEngComm (July 2020) and "Change to the definition of a crystal" in the IUCr newsletter (June 2021). Experimental approaches to crystal comparisons require rigorously defined classifications in crystallography and beyond. Since crystal structures are determined in a rigid form, their strongest equivalence in practice is rigid motion, which is a composition of translations and rotations in 3-dimensional space. Conventional representations based on reduced cells and standardizations theoretically distinguish all periodic crystals. However, all cell-based representations are inherently discontinuous under almost any atomic displacement that can arbitrarily scale up a reduced cell. Hence comparing millions of known structures in materials databases needs continuous distance metrics.


title: Temporal Complexity of a Hopfield-Type Neural Model in Random and Scale-Free Graphs

abstract: The Hopfield network model and its generalizations were introduced as a model of associative, or content-addressable, memory. They were widely investigated both as a unsupervised learning method in artificial intelligence and as a model of biological neural dynamics in computational neuroscience. The complexity features of biological neural networks are attracting the interest of scientific community since the last two decades. More recently, concepts and tools borrowed from complex network theory were applied to artificial neural networks and learning, thus focusing on the topological aspects. However, the temporal structure is also a crucial property displayed by biological neural networks and investigated in the framework of systems displaying complex intermittency. The Intermittency-Driven Complexity (IDC) approach indeed focuses on the metastability of self-organized states, whose signature is a power-decay in the inter-event time distribution or a scaling behavior in the related event-driven diffusion processes. The investigation of IDC in neural dynamics and its relationship with network topology is still in its early stages. In this work we present the preliminary results of a IDC analysis carried out on a bio-inspired Hopfield-type neural network comparing two different connectivities, i.e., scale-free vs. random network topology. We found that random networks can trigger complexity features similar to that of scale-free networks, even if with some differences and for different parameter values, in particular for different noise levels.

categories: q-bio.NC cond-mat.dis-nn cs.NA math-ph math.MP math.NA nlin.AO


title: Leveraging Pedagogical Theories to Understand Student Learning Process with Graph-based Reasonable Knowledge Tracing

abstract: Knowledge tracing (KT) is a crucial task in intelligent education, focusing on predicting students' performance on given questions to trace their evolving knowledge. The advancement of deep learning in this field has led to deep-learning knowledge tracing (DLKT) models that prioritize high predictive accuracy. However, many existing DLKT methods overlook the fundamental goal of tracking students' dynamical knowledge mastery. These models do not explicitly model knowledge mastery tracing processes or yield unreasonable results that educators find difficulty to comprehend and apply in real teaching scenarios. In response, our research conducts a preliminary analysis of mainstream KT approaches to highlight and explain such unreasonableness. We introduce GRKT, a graph-based reasonable knowledge tracing method to address these issues. By leveraging graph neural networks, our approach delves into the mutual influences of knowledge concepts, offering a more accurate representation of how the knowledge mastery evolves throughout the learning process. Additionally, we propose a fine-grained and psychological three-stage modeling process as knowledge retrieval, memory strengthening, and knowledge learning/forgetting, to conduct a more reasonable knowledge tracing process. Comprehensive experiments demonstrate that GRKT outperforms eleven baselines across three datasets, not only enhancing predictive accuracy but also generating more reasonable knowledge tracing results. This makes our model a promising advancement for practical implementation in educational settings. The source code is available at https://github.com/JJCui96/GRKT.


title: Advancing Histopathology-Based Breast Cancer Diagnosis: Insights into Multi-Modality and Explainability

abstract: It is imperative that breast cancer is detected precisely and timely to improve patient outcomes. Diagnostic methodologies have traditionally relied on unimodal approaches; however, medical data analytics is integrating diverse data sources beyond conventional imaging. Using multi-modal techniques, integrating both image and non-image data, marks a transformative advancement in breast cancer diagnosis. The purpose of this review is to explore the burgeoning field of multimodal techniques, particularly the fusion of histopathology images with non-image data. Further, Explainable AI (XAI) will be used to elucidate the decision-making processes of complex algorithms, emphasizing the necessity of explainability in diagnostic processes. This review utilizes multi-modal data and emphasizes explainability to enhance diagnostic accuracy, clinician confidence, and patient engagement, ultimately fostering more personalized treatment strategies for breast cancer, while also identifying research gaps in multi-modality and explainability, guiding future studies, and contributing to the strategic direction of the field.


title: A Comprehensive Evaluation of Generative Models in Calorimeter Shower Simulation

abstract: The pursuit of understanding fundamental particle interactions has reached unparalleled precision levels. Particle physics detectors play a crucial role in generating low-level object signatures that encode collision physics. However, simulating these particle collisions is a demanding task in terms of memory and computation which will be exasperated with larger data volumes, more complex detectors, and a higher pileup environment in the High-Luminosity LHC. The introduction of "Fast Simulation" has been pivotal in overcoming computational bottlenecks. The use of deep-generative models has sparked a surge of interest in surrogate modeling for detector simulations, generating particle showers that closely resemble the observed data. Nonetheless, there is a pressing need for a comprehensive evaluation of their performance using a standardized set of metrics. In this study, we conducted a rigorous evaluation of three generative models using standard datasets and a diverse set of metrics derived from physics, computer vision, and statistics. Furthermore, we explored the impact of using full versus mixed precision modes during inference. Our evaluation revealed that the CaloDiffusion and CaloScore generative models demonstrate the most accurate simulation of particle showers, yet there remains substantial room for improvement. Our findings identified areas where the evaluated models fell short in accurately replicating Geant4 data.

categories: physics.ins-det cs.AI hep-ex physics.data-an


title: Structural design of the acrylic vessel for the Jinping Neutrino Experiment

abstract: The Jinping neutrino experiment is designed to have multiple purposes in the China Jinping Underground Laboratory. Following the acrylic vessel design requirements proposal, a structural scheme has been developed and optimized. Subsequently, the stability of the acrylic shell structure was calculated using finite element analysis, as well as the load-bearing capacities under various working conditions. Further, the effects of temperature changes, rope failures, and Young's modulus of the ropes on the static behavior of the structure were analyzed. The results indicated that the stress level and structural displacement of the structure scheme satisfies the design requirements, as well as the stability of the vessel under compression. Moreover, the stress and displacement of the acrylic shell satisfies the given working conditions and temperatures. The structural scheme ensures basic safety if the rope fails.


title: Factor Graph Optimization of Error-Correcting Codes for Belief Propagation Decoding

abstract: The design of optimal linear block codes capable of being efficiently decoded is of major concern, especially for short block lengths. As near capacity-approaching codes, Low-Density Parity-Check (LDPC) codes possess several advantages over other families of codes, the most notable being its efficient decoding via Belief Propagation. While many LDPC code design methods exist, the development of efficient sparse codes that meet the constraints of modern short code lengths and accommodate new channel models remains a challenge. In this work, we propose for the first time a data-driven approach for the design of sparse codes. We develop locally optimal codes with respect to Belief Propagation decoding via the learning on the Factor graph (also called the Tanner graph) under channel noise simulations. This is performed via a novel tensor representation of the Belief Propagation algorithm, optimized over finite fields via backpropagation coupled with an efficient line-search method. The proposed approach is shown to outperform the decoding performance of existing popular codes by orders of magnitude and demonstrates the power of data-driven approaches for code design.


title: Interpretable machine learning approach for electron antineutrino selection in a large liquid scintillator detector

abstract: Several neutrino detectors, KamLAND, Daya Bay, Double Chooz, RENO, and the forthcoming large-scale JUNO, rely on liquid scintillator to detect reactor antineutrino interactions. In this context, inverse beta decay represents the golden channel for antineutrino detection, providing a pair of correlated events, thus a strong experimental signature to distinguish the signal from a variety of backgrounds. However, given the low cross-section of antineutrino interactions, the development of a powerful event selection algorithm becomes imperative to achieve effective discrimination between signal and backgrounds. In this study, we introduce a machine learning (ML) model to achieve this goal: a fully connected neural network as a powerful signal-background discriminator for a large liquid scintillator detector. We demonstrate, using the JUNO detector as an example, that, despite the already high efficiency of a cut-based approach, the presented ML model can further improve the overall event selection efficiency. Moreover, it allows for the retention of signal events at the detector edges that would otherwise be rejected because of the overwhelming amount of background events in that region. We also present the first interpretable analysis of the ML approach for event selection in reactor neutrino experiments. This method provides insights into the decision-making process of the model and offers valuable information for improving and updating traditional event selection approaches.

categories: physics.ins-det cs.LG hep-ex physics.data-an


title: Can AI Beat Undergraduates in Entry-level Java Assignments? Benchmarking Large Language Models on JavaBench

abstract: Code generation benchmarks such as HumanEval are widely adopted to evaluate LLMs' capabilities. However, after consolidating the latest 24 benchmarks, we noticed three significant imbalances. First, imbalanced programming language. 95.8% of benchmarks involve Python, while only 5 benchmarks involve Java. Second, imbalanced code granularity. Function-/statement-level benchmarks account for over 83.3% of benchmarks. Only a mere handful extends to class-/project-levels, and all are limited to Python. Third, lacking advanced features. Existing benchmarks primarily assess basic coding skills, while overlooking advanced Object-Oriented Programming (OOP) features (i.e., encapsulation, inheritance, and polymorphism). To fill these gaps, we propose JavaBench, a project-level Java benchmark that exercises OOP features. It comprises four Java projects with 389 methods in 106 Java classes. The test coverage is up to 92%, and JavaBench is attested by 282 undergraduate students, reaching a 90.93/100 average score (i.e., pass rate against the test suite), ensuring the quality of documentation, code skeleton, and tests. To better evaluate LLM's capability against JavaBench, we introduce a systematic evaluation design covering three context settings and five synthesis strategies at two granularities using three hierarchical metrics. Our extensive experiment yields several interesting findings. First, we noticed that regarding project-level Java programming, LLMs are far behind undergraduate students (no project can be correctly completed by any studied LLMs, and at most 41.17% Pass@5 in a more relaxed evaluation). Second, using method signature as prompt context may strike an ideal balance for project-level code generation. JavaBench is publicly available at https://github.com/java-bench/JavaBench.


title: Open-Source Optimization of Hybrid Monte-Carlo Methods for Fast Response Modeling of NaI(Tl) and HPGe Gamma Detectors

abstract: Modeling the response of gamma detectors has long been a challenge within the nuclear community. Significant research has been conducted to digitally replicate instruments that can cost over $100,000 and are difficult to operate outside a laboratory setting. Subsequently, there have been multiple attempts to create codes that replicate the response of sodium-iodide and high purity germanium detectors for the purpose of deriving data related to gamma ray interaction with matter. While robust programs do exist, they are often subject to export controls and/or they are not intuitive to use. Through the use of the Hybrid Monte-Carlo methods, MATLAB can be used to produce a fast first-order response of various gamma ray detectors. The combination of a graphics user interface with a numerical based script allows for an open-source and intuitive code. When benchmarked with experimental data from Co-60, Cs-137, and Na-22 the code can numerically calculate a response comparable to experimental and industry standard response codes. Through this code, it is shown that a savings in computational requirements and the inclusion of an intuitive user experience does not heavily compromise data when compared to other standard codes or experimental results. When the application is installed on a computer with 16 cores, the average time to simulate the benchmarked isotopes is 0.26 seconds and 1.63 seconds on a four-core machine. The results indicate that simple gamma detectors can be modeled in an open-source format. The anticipation for the MATLAB application is to be a tool that can be easily accessible and provide datasets for use in an academic setting requiring the gamma ray detectors. Ultimately, providing evidence that Hybrid Monte-Carlo codes in an open-source format can benefit the nuclear community.


title: Meent: Differentiable Electromagnetic Simulator for Machine Learning

abstract: Electromagnetic (EM) simulation plays a crucial role in analyzing and designing devices with sub-wavelength scale structures such as solar cells, semiconductor devices, image sensors, future displays and integrated photonic devices. Specifically, optics problems such as estimating semiconductor device structures and designing nanophotonic devices provide intriguing research topics with far-reaching real world impact. Traditional algorithms for such tasks require iteratively refining parameters through simulations, which often yield sub-optimal results due to the high computational cost of both the algorithms and EM simulations. Machine learning (ML) emerged as a promising candidate to mitigate these challenges, and optics research community has increasingly adopted ML algorithms to obtain results surpassing classical methods across various tasks. To foster a synergistic collaboration between the optics and ML communities, it is essential to have an EM simulation software that is user-friendly for both research communities. To this end, we present Meent, an EM simulation software that employs rigorous coupled-wave analysis (RCWA). Developed in Python and equipped with automatic differentiation (AD) capabilities, Meent serves as a versatile platform for integrating ML into optics research and vice versa. To demonstrate its utility as a research platform, we present three applications of Meent: 1) generating a dataset for training neural operator, 2) serving as an environment for the reinforcement learning of nanophotonic device optimization, and 3) providing a solution for inverse problems with gradient-based optimizers. These applications highlight Meent's potential to advance both EM simulation and ML methodologies. The code is available at https://github.com/kc-ml2/meent with the MIT license to promote the cross-polinations of ideas among academic researchers and industry practitioners.


title: PufferLib: Making Reinforcement Learning Libraries and Environments Play Nice

abstract: You have an environment, a model, and a reinforcement learning library that are designed to work together but don't. PufferLib makes them play nice. The library provides one-line environment wrappers that eliminate common compatibility problems and fast vectorization to accelerate training. With PufferLib, you can use familiar libraries like CleanRL and SB3 to scale from classic benchmarks like Atari and Procgen to complex simulators like NetHack and Neural MMO. We release pip packages and prebuilt images with dependencies for dozens of environments. All of our code is free and open-source software under the MIT license, complete with baselines, documentation, and support at pufferai.github.io.


title: Entropy-statistical approach to phase-locking detection of pulse oscillations: application for the analysis of biosignal synchronization

abstract: In this study a new method for analyzing synchronization in oscillator systems is proposed using the example of modeling the dynamics of a circuit of two resistively coupled pulse oscillators. The dynamic characteristic of synchronization is fuzzy entropy (FuzzyEn) calculated a time series composed of the ratios of the number of pulse periods (subharmonic ratio, SHR) during phase-locking intervals. Low entropy values indicate strong synchronization, whereas high entropy values suggest weak synchronization between the two oscillators. This method effectively visualizes synchronized modes of the circuit using entropy maps of synchronization states. Additionally, a classification of synchronization states is proposed based on the dependencies of FuzzyEn on the length of embedding vectors of SHR time series. An extension of this method for analyzing non-relaxation (non-spike) type signals is illustrated using the example of phase-phase coupling rhythms of local field potential of rat hippocampus. The entropy-statistical approach using rational fractions and pulse signal forms makes this method promising for analyzing biosignal synchronization and implementing the algorithm in mobile digital platforms.


title: Reconciling Kaplan and Chinchilla Scaling Laws

abstract: Kaplan et al. [2020] (`Kaplan') and Hoffmann et al. [2022] (`Chinchilla') studied the scaling behavior of transformers trained on next-token language prediction. These studies produced different estimates for how the number of parameters ($N$) and training tokens ($D$) should be set to achieve the lowest possible loss for a given compute budget ($C$). Kaplan: $N_\text{optimal} \propto C^{0.73}$, Chinchilla: $N_\text{optimal} \propto C^{0.50}$. This note finds that much of this discrepancy can be attributed to Kaplan counting non-embedding rather than total parameters, combined with their analysis being performed at small scale. Simulating the Chinchilla study under these conditions produces biased scaling coefficients close to Kaplan's. Hence, this note reaffirms Chinchilla's scaling coefficients, by explaining the cause of Kaplan's original overestimation.


title: Rating Multi-Modal Time-Series Forecasting Models (MM-TSFM) for Robustness Through a Causal Lens

abstract: AI systems are notorious for their fragility; minor input changes can potentially cause major output swings. When such systems are deployed in critical areas like finance, the consequences of their uncertain behavior could be severe. In this paper, we focus on multi-modal time-series forecasting, where imprecision due to noisy or incorrect data can lead to erroneous predictions, impacting stakeholders such as analysts, investors, and traders. Recently, it has been shown that beyond numeric data, graphical transformations can be used with advanced visual models to achieve better performance. In this context, we introduce a rating methodology to assess the robustness of Multi-Modal Time-Series Forecasting Models (MM-TSFM) through causal analysis, which helps us understand and quantify the isolated impact of various attributes on the forecasting accuracy of MM-TSFM. We apply our novel rating method on a variety of numeric and multi-modal forecasting models in a large experimental setup (six input settings of control and perturbations, ten data distributions, time series from six leading stocks in three industries over a year of data, and five time-series forecasters) to draw insights on robust forecasting models and the context of their strengths. Within the scope of our study, our main result is that multi-modal (numeric + visual) forecasting, which was found to be more accurate than numeric forecasting in previous studies, can also be more robust in diverse settings. Our work will help different stakeholders of time-series forecasting understand the models` behaviors along trust (robustness) and accuracy dimensions to select an appropriate model for forecasting using our rating method, leading to improved decision-making.


title: Scalable Training of Graph Foundation Models for Atomistic Materials Modeling: A Case Study with HydraGNN

abstract: We present our work on developing and training scalable graph foundation models (GFM) using HydraGNN, a multi-headed graph convolutional neural network architecture. HydraGNN expands the boundaries of graph neural network (GNN) in both training scale and data diversity. It abstracts over message passing algorithms, allowing both reproduction of and comparison across algorithmic innovations that define convolution in GNNs. This work discusses a series of optimizations that have allowed scaling up the GFM training to tens of thousands of GPUs on datasets that consist of hundreds of millions of graphs. Our GFMs use multi-task learning (MTL) to simultaneously learn graph-level and node-level properties of atomistic structures, such as the total energy and atomic forces. Using over 150 million atomistic structures for training, we illustrate the performance of our approach along with the lessons learned on two United States Department of Energy (US-DOE) supercomputers, namely the Perlmutter petascale system at the National Energy Research Scientific Computing Center and the Frontier exascale system at Oak Ridge National Laboratory. The HydraGNN architecture enables the GFM to achieve near-linear strong scaling performance using more than 2,000 GPUs on Perlmutter and 16,000 GPUs on Frontier. Hyperparameter optimization (HPO) was performed on over 64,000 GPUs on Frontier to select GFM architectures with high accuracy. Early stopping was applied on each GFM architecture for energy awareness in performing such an extreme-scale task. The training of an ensemble of highest-ranked GFM architectures continued until convergence to establish uncertainty quantification (UQ) capabilities with ensemble learning. Our contribution opens the door for rapidly developing, training, and deploying GFMs using large-scale computational resources to enable AI-accelerated materials discovery and design.


title: Human-level molecular optimization driven by mol-gene evolution

abstract: De novo molecule generation allows the search for more drug-like hits across a vast chemical space. However, lead optimization is still required, and the process of optimizing molecular structures faces the challenge of balancing structural novelty with pharmacological properties. This study introduces the Deep Genetic Molecular Modification Algorithm (DGMM), which brings structure modification to the level of medicinal chemists. A discrete variational autoencoder (D-VAE) is used in DGMM to encode molecules as quantization code, mol-gene, which incorporates deep learning into genetic algorithms for flexible structural optimization. The mol-gene allows for the discovery of pharmacologically similar but structurally distinct compounds, and reveals the trade-offs of structural optimization in drug discovery. We demonstrate the effectiveness of the DGMM in several applications.

categories: cs.LG cs.AI cs.NE physics.chem-ph q-bio.BM


title: The Promise of Analog Deep Learning: Recent Advances, Challenges and Opportunities

abstract: Much of the present-day Artificial Intelligence (AI) utilizes artificial neural networks, which are sophisticated computational models designed to recognize patterns and solve complex problems by learning from data. However, a major bottleneck occurs during a device's calculation of weighted sums for forward propagation and optimization procedure for backpropagation, especially for deep neural networks, or networks with numerous layers. Exploration into different methods of implementing neural networks is necessary for further advancement of the area. While a great deal of research into AI hardware in both directions, analog and digital implementation widely exists, much of the existing survey works lacks discussion on the progress of analog deep learning. To this end, we attempt to evaluate and specify the advantages and disadvantages, along with the current progress with regards to deep learning, for analog implementations. In this paper, our focus lies on the comprehensive examination of eight distinct analog deep learning methodologies across multiple key parameters. These parameters include attained accuracy levels, application domains, algorithmic advancements, computational speed, and considerations of energy efficiency and power consumption. We also identify the neural network-based experiments implemented using these hardware devices and discuss comparative performance achieved by the different analog deep learning methods along with an analysis of their current limitations. Overall, we find that Analog Deep Learning has great potential for future consumer-level applications, but there is still a long road ahead in terms of scalability. Most of the current implementations are more proof of concept and are not yet practically deployable for large-scale models.


title: Burn-in Test and Thermal Performance Evaluation of Silicon Photomultipliers for the JUNO-TAO Experiment

abstract: This study evaluates more than 4,000 tiles made of Hamamatsu visual-sensitive silicon photomultipier (SiPM), each with dimensions of 5 $\times$ 5 cm$^2$, intended for the central detector of the Taishan Anti-neutrino Observatory (TAO), a satellite experiment of the Jiangmen Underground Neutrino Observatory (JUNO) aimed at measuring the reactor anti-neutrino energy spectrum with unprecedented energy resolution. All SiPM tiles underwent a room temperature burn-in test in the dark for two weeks, while cryogenic testing analyzed the thermal dependence of parameters for some sampled SiPMs. Results from these comprehensive tests provide crucial insights into the long-term performance and stability of the 10 square meters of SiPMs operating at -50{\deg}C to detect scintillation photons in the TAO detector. Despite some anomalies awaiting further inspection, all SiPMs successfully passed the burn-in test over two weeks at room temperature, which is equivalent to 6.7 years at -50{\deg}C. Results are also used to guide optimal SiPM selection, configuration, and operation, ensuring reliability and sustainability in reactor neutrino measurements. This work also provides insights for a rapid and robust quality assessment in future experiments that employ large-scale SiPMs as detection systems.


title: T-JEPA: A Joint-Embedding Predictive Architecture for Trajectory Similarity Computation

abstract: Trajectory similarity computation is an essential technique for analyzing moving patterns of spatial data across various applications such as traffic management, wildlife tracking, and location-based services. Modern methods often apply deep learning techniques to approximate heuristic metrics but struggle to learn more robust and generalized representations from the vast amounts of unlabeled trajectory data. Recent approaches focus on self-supervised learning methods such as contrastive learning, which have made significant advancements in trajectory representation learning. However, contrastive learning-based methods heavily depend on manually pre-defined data augmentation schemes, limiting the diversity of generated trajectories and resulting in learning from such variations in 2D Euclidean space, which prevents capturing high-level semantic variations. To address these limitations, we propose T-JEPA, a self-supervised trajectory similarity computation method employing Joint-Embedding Predictive Architecture (JEPA) to enhance trajectory representation learning. T-JEPA samples and predicts trajectory information in representation space, enabling the model to infer the missing components of trajectories at high-level semantics without relying on domain knowledge or manual effort. Extensive experiments conducted on three urban trajectory datasets and two Foursquare datasets demonstrate the effectiveness of T-JEPA in trajectory similarity computation.


title: The Significance of Latent Data Divergence in Predicting System Degradation

abstract: Condition-Based Maintenance is pivotal in enabling the early detection of potential failures in engineering systems, where precise prediction of the Remaining Useful Life is essential for effective maintenance and operation. However, a predominant focus in the field centers on predicting the Remaining Useful Life using unprocessed or minimally processed data, frequently neglecting the intricate dynamics inherent in the dataset. In this work we introduce a novel methodology grounded in the analysis of statistical similarity within latent data from system components. Leveraging a specifically designed architecture based on a Vector Quantized Variational Autoencoder, we create a sequence of discrete vectors which is used to estimate system-specific priors. We infer the similarity between systems by evaluating the divergence of these priors, offering a nuanced understanding of individual system behaviors. The efficacy of our approach is demonstrated through experiments on the NASA commercial modular aero-propulsion system simulation (C-MAPSS) dataset. Our validation not only underscores the potential of our method in advancing the study of latent statistical divergence but also demonstrates its superiority over existing techniques.