title: GLISP: A Scalable GNN Learning System by Exploiting Inherent Structural Properties of Graphs

abstract: As a powerful tool for modeling graph data, Graph Neural Networks (GNNs) have received increasing attention in both academia and industry. Nevertheless, it is notoriously difficult to deploy GNNs on industrial scale graphs, due to their huge data size and complex topological structures. In this paper, we propose GLISP, a sampling based GNN learning system for industrial scale graphs. By exploiting the inherent structural properties of graphs, such as power law distribution and data locality, GLISP addresses the scalability and performance issues that arise at different stages of the graph learning process. GLISP consists of three core components: graph partitioner, graph sampling service and graph inference engine. The graph partitioner adopts the proposed vertex-cut graph partitioning algorithm AdaDNE to produce balanced partitioning for power law graphs, which is essential for sampling based GNN systems. The graph sampling service employs a load balancing design that allows the one hop sampling request of high degree vertices to be handled by multiple servers. In conjunction with the memory efficient data structure, the efficiency and scalability are effectively improved. The graph inference engine splits the $K$-layer GNN into $K$ slices and caches the vertex embeddings produced by each slice in the data locality aware hybrid caching system for reuse, thus completely eliminating redundant computation caused by the data dependency of graph. Extensive experiments show that GLISP achieves up to $6.53\times$ and $70.77\times$ speedups over existing GNN systems for training and inference tasks, respectively, and can scale to the graph with over 10 billion vertices and 40 billion edges with limited resources.


title: Transferable Learned Image Compression-Resistant Adversarial Perturbations

abstract: Adversarial attacks can readily disrupt the image classification system, revealing the vulnerability of DNN-based recognition tasks. While existing adversarial perturbations are primarily applied to uncompressed images or compressed images by the traditional image compression method, i.e., JPEG, limited studies have investigated the robustness of models for image classification in the context of DNN-based image compression. With the rapid evolution of advanced image compression, DNN-based learned image compression has emerged as the promising approach for transmitting images in many security-critical applications, such as cloud-based face recognition and autonomous driving, due to its superior performance over traditional compression. Therefore, there is a pressing need to fully investigate the robustness of a classification system post-processed by learned image compression. To bridge this research gap, we explore the adversarial attack on a new pipeline that targets image classification models that utilize learned image compressors as pre-processing modules. Furthermore, to enhance the transferability of perturbations across various quality levels and architectures of learned image compression models, we introduce a saliency score-based sampling method to enable the fast generation of transferable perturbation. Extensive experiments with popular attack methods demonstrate the enhanced transferability of our proposed method when attacking images that have been post-processed with different learned image compression models.


title: Advancing DDoS Attack Detection: A Synergistic Approach Using Deep Residual Neural Networks and Synthetic Oversampling

abstract: Distributed Denial of Service (DDoS) attacks pose a significant threat to the stability and reliability of online systems. Effective and early detection of such attacks is pivotal for safeguarding the integrity of networks. In this work, we introduce an enhanced approach for DDoS attack detection by leveraging the capabilities of Deep Residual Neural Networks (ResNets) coupled with synthetic oversampling techniques. Because of the inherent class imbalance in many cyber-security datasets, conventional methods often struggle with false negatives, misclassifying subtle DDoS patterns as benign. By applying the Synthetic Minority Over-sampling Technique (SMOTE) to the CICIDS dataset, we balance the representation of benign and malicious data points, enabling the model to better discern intricate patterns indicative of an attack. Our deep residual network, tailored for this specific task, further refines the detection process. Experimental results on a real-world dataset demonstrate that our approach achieves an accuracy of 99.98%, significantly outperforming traditional methods. This work underscores the potential of combining advanced data augmentation techniques with deep learning models to bolster cyber-security defenses.


title: The Origin of the X-ray Emission from the Non-Starburst Gas-Rich Luminous Infrared Galaxies Arp 302

abstract: We present an analysis of the XMM-Newton observation of luminous infrared merging galaxies Arp 302 and a joint re-analysis of its Chandra observation. In particular, we focus on the more significant X-ray emitter of the pair, Arp 302N. Chandra detects significant soft X-ray emission from the hot gas in the star-forming region of Arp 302N spreading up to 12 kpc. We estimate the star-formation rate of Arp 302N to be around 1-2 $M_{\odot}$ yr$^{-1}$ based on the X-ray luminosity of the star-forming region, similar to previous measurements at longer wavelengths. Chandra and XMM-Newton observations show evidence of a Si XIII emission line with 86% confidence. Our best-fit model infers a super-solar silicon abundance in the star-forming region, likely related to the past core-collapse supernovae in this galaxy. Similar silicon overabundance was reported in the circumstellar medium of core-collapse supernova remnants in our Galaxy. We also detect narrow Fe K$\alpha$ and Fe K$\beta$ (98.6% confidence) emission lines as part of the AGN emission. Our best-fit spectral model using Mytorus indicates the evidence of a heavily obscured power-law emission with $N_{\rm H}>3\times10^{24}$ cm$^{-2}$ in addition to a weak, unobscured power-law emission. The scattering fraction of the unobscured power-law emission from Compton-thin materials is 0.7%. All these spectral features suggest evidence of a Seyfert 2-like AGN in Arp 302N. The X-ray measurement of its AGN activity is consistent with the previous Spitzer measurement of the same object.


title: Zero-Knowledge Proof in NuLink

abstract: NuLink provides privacy-preserving technology for decentralized applications via APIs. Users can securely store its valuable data, trade with others and so on. To ensure the privacy and security of service provided by NuLink, (zero-knowledge) proof systems are necessary. Zero-knowledge proof systems allow the prover to make the verifier believe that a certain conclusion is correct without providing any useful information to the verifier. In NuLink, we are going to use (zero-knowledge) proof system in the following three methods: 1. Users store their data through NuLink in a decentralized manner. To ensure that the storage clients are indeed storing the data, we employ proof of storage systems. In this system, users prepare certain challenges that can only be correctly answered by those who are actually storing the data. 2. Users have the option to outsource computations to NuLink. To verify the correctness of the computation results provided by the compute node, we require the node to provide a proof of correctness via SNARK systems. When sensitive parameters are used as inputs for computation, we utilize zk-SNARKs to prevent any potential leakage of these parameters. 3. Users may choose to trade their data through NuLink. To confirm that the buyer has sufficient digital funds and the seller possesses the desired data, both parties can provide a proof via zk-SNARKs. This builds confidence and prevents cheating during transactions. Using zero-knowledge proof systems, we can ensure that all nodes in NuLink behaves honestly and avoid cheating in the whole system.


title: Repeatedly applying the Combinatorial Nullstellensatz for Zero-sum Grids to Martin Gardner's minimum no-3-in-a-line problem

abstract: In 1976 Martin Gardner posed the following problem: ``What is the smallest number of [queens] you can put on an [$n \times n$ chessboard] such that no [queen] can be added without creating three in a row, a column, or a diagonal?'' The work of Cooper, Pikhurko, Schmitt and Warrington showed that this number is at least $n$, except in the case when $n$ is congruent to $3$ modulo $4$, in which case one less may suffice. When $n>1$ is odd, Gardner conjectured the lower bound to be $n+1$. We prove this conjecture in the case that $n$ is congruent to 1 modulo 4. The proof relies heavily on a recent advancement to the Combinatorial Nullstellensatz for zero-sum grids due to Bogdan Nica.


title: An Ohta-Kawasaki Model set on the space

abstract: We examine a non-local diffuse interface energy with Coulomb repulsion in three dimensions inspired by the Thomas-Fermi-Dirac-von Weizs\"{a}cker, and the Ohta-Kawasaki models. We consider the corresponding mass-constrained variational problem and show the existence of minimizers for small masses, and the absence of minimizers for large masses.


title: Self-Calibrated Transit Service Monitoring Using Automated Collected Data

abstract: This paper proposes a self-calibrated transit service monitoring framework that aims to obtain the performance of a transit system using automated collected data. We first introduce an event-based transit simulation model, which allows the detailed simulation of passenger travel behavior in a transit system, including boarding, alighting, and transfer walking. To estimate passenger path choices, we assume the path choices can be modeled using a C-logit model, and propose a simulation-based optimization model to estimate the path choice parameters based on automated fare collection and automated vehicle location data. The path choices can be estimated on a daily basis, which enables the simulation model to adapt to dynamic passenger behavior changes, and output more accurate network performance indicators for regular service monitoring such as train load, passenger travel time, and crowding at platforms. The proposed system eliminates the need for conventional monitoring equipment such as cameras at platforms and scaling/weighing systems on trains. The Hong Kong Mass Transit Railway (MTR) system is used as the case study. Results show that the model can well estimate the path choice behavior of passengers in the system. The output passenger exit flows are closer to the actual one compared to the two benchmark models (shortest path and uniform path choice).


title: SAR Despeckling via Regional Denoising Diffusion Probabilistic Model

abstract: Speckle noise poses a significant challenge in maintaining the quality of synthetic aperture radar (SAR) images, so SAR despeckling techniques have drawn increasing attention. Despite the tremendous advancements of deep learning in fixed-scale SAR image despeckling, these methods still struggle to deal with large-scale SAR images. To address this problem, this paper introduces a novel despeckling approach termed Region Denoising Diffusion Probabilistic Model (R-DDPM) based on generative models. R-DDPM enables versatile despeckling of SAR images across various scales, accomplished within a single training session. Moreover, The artifacts in the fused SAR images can be avoided effectively with the utilization of region-guided inverse sampling. Experiments of our proposed R-DDPM on Sentinel-1 data demonstrates superior performance to existing methods.


title: A least distance estimator for a multivariate regression model using deep neural networks

abstract: We propose a deep neural network (DNN) based least distance (LD) estimator (DNN-LD) for a multivariate regression problem, addressing the limitations of the conventional methods. Due to the flexibility of a DNN structure, both linear and nonlinear conditional mean functions can be easily modeled, and a multivariate regression model can be realized by simply adding extra nodes at the output layer. The proposed method is more efficient in capturing the dependency structure among responses than the least squares loss, and robust to outliers. In addition, we consider $L_1$-type penalization for variable selection, crucial in analyzing high-dimensional data. Namely, we propose what we call (A)GDNN-LD estimator that enjoys variable selection and model estimation simultaneously, by applying the (adaptive) group Lasso penalty to weight parameters in the DNN structure. For the computation, we propose a quadratic smoothing approximation method to facilitate optimizing the non-smooth objective function based on the least distance loss. The simulation studies and a real data analysis demonstrate the promising performance of the proposed method.


title: To Balance or to Not? Battery Aging-Aware Active Cell Balancing for Electric Vehicles

abstract: Due to manufacturing variabilities and temperature gradients within an electric vehicle's battery pack, the capacities of cells in it decrease differently over time. This reduces the usable capacity of the battery - the charge levels of one or more cells might be at the minimum threshold while most of the other cells have residual charge. Active cell balancing (i.e., transferring charge among cells) can equalize their charge levels, thereby increasing the battery pack's usable capacity. But performing balancing means additional charge transfer, which can result in energy loss and cell aging, akin to memory aging in storage technologies due to writing. This paper studies when cell balancing should be optimally triggered to minimize aging while maintaining the necessary driving capability. In particular, we propose optimization strategies for cell balancing while minimizing their impact on aging. By borrowing terminology from the storage domain, we refer to this as "wear leveling-aware" active balancing.


title: Heterotic Orbifold Models

abstract: We review efforts in string model building, focusing on the heterotic orbifold compactifications. We survey how one can, starting from an explicit string theory, obtain models which resemble Nature. These models exhibit the standard model gauge group, three generations of standard model matter and an appropriate Higgs sector. Unlike many unified models, these models do not suffer from problems such as doublet-triplet splitting, too rapid proton decay and the $\mu$ problem. Realistic patterns of fermion masses emerge, which are partly explained by flavor symmetries, including their modular variants. We comment on challenges and open questions.


title: Quotient geometry of bounded or fixed rank correlation matrices

abstract: This paper studies the quotient geometry of bounded or fixed-rank correlation matrices. We establish a bijection between the set of bounded-rank correlation matrices and a quotient set of a spherical product manifold by an orthogonal group. We show that it forms an orbit space, whose stratification is determined by the rank of the matrices, and the principal stratum has a compatible Riemannian quotient manifold structure. We show that any minimizing geodesic in the orbit space has constant rank on the interior of the segment. We also develop efficient Riemannian optimization algorithms for computing the distance and weighted the Frechet mean in the orbit space. Moreover, we examine geometric properties of the quotient manifold, including horizontal and vertical spaces, Riemannian metric, injectivity radius, exponential and logarithmic map, curvature, gradient and Hessian.


title: Anomalous diffusion of scaled Brownian tracers

abstract: A model for anomalous transport of tracer particles diffusing in complex media in two dimensions is proposed. The model takes into account the characteristics of persistent motion that active bath transfer to the tracer, thus the model proposed in here extends active Brownian motion, for which the stochastic dynamics of the orientation of the propelling force is described by scale Brownian motion (sBm), identified by a the time dependent diffusivity of the form $D_\beta\propto t^{\beta-1}$, $\beta>0$. If $\beta\neq1$, sBm is highly non-stationary and suitable to describe such a non-equilibrium dynamics induced by complex media. In this paper we provide analytical calculations and computer simulations to show that genuine anomalous diffusion emerge in the long-time regime, with a time scaling of the mean square displacement $t^{2-\beta}$, while ballistic transport $t^2$, characteristic of persistent motion, is found in the short-time one. An analysis of the time dependence of the kurtosis, and intermediate scattering function of the positions distribution, as well as the propulsion auto-correlation function, which defines the effective persistence time, are provided.


title: Manifold-based Shapley for SAR Recognization Network Explanation

abstract: Explainable artificial intelligence (XAI) holds immense significance in enhancing the deep neural network's transparency and credibility, particularly in some risky and high-cost scenarios, like synthetic aperture radar (SAR). Shapley is a game-based explanation technique with robust mathematical foundations. However, Shapley assumes that model's features are independent, rendering Shapley explanation invalid for high dimensional models. This study introduces a manifold-based Shapley method by projecting high-dimensional features into low-dimensional manifold features and subsequently obtaining Fusion-Shap, which aims at (1) addressing the issue of erroneous explanations encountered by traditional Shap; (2) resolving the challenge of interpretability that traditional Shap faces in complex scenarios.


title: Examining Forgetting in Continual Pre-training of Aligned Large Language Models

abstract: Recent advances in Large Language Models (LLMs) have exhibited remarkable proficiency across various tasks. Given the potent applications of LLMs in numerous fields, there has been a surge in LLM development. In developing LLMs, a common practice involves continual pre-training on previously fine-tuned models. However, this can lead to catastrophic forgetting. In our work, we investigate the phenomenon of forgetting that occurs during continual pre-training on an existing fine-tuned LLM. We evaluate the impact of continuous pre-training on the fine-tuned LLM across various dimensions, including output format, knowledge, and reliability. Experiment results highlight the non-trivial challenge of addressing catastrophic forgetting during continual pre-training, especially the repetition issue.


title: Endless Dirac nodal lines and high mobility in kagome semimetal Ni3In2Se2 single crystal

abstract: Kagome-lattice crystal is crucial in quantum materials research, exhibiting unique transport properties due to its rich band structure and the presence of nodal lines and rings. Here, we investigate the electronic transport properties and perform first-principles calculations for Ni$_{3}$In$_{2}$Se$_{2}$ kagome topological semimetal. First-principle calculations indicate six endless Dirac nodal lines and two nodal rings with a $\pi$-Berry phase in the Ni$_{3}$In$_{2}$Se$_{2}$ compound. The temperature-dependent resistivity is dominated by two scattering mechanisms: $s$-$d$ interband scattering occurs below 50 K, while electron-phonon ($e$-$p$) scattering is observed above 50 K. The magnetoresistance (MR) curve aligns with the theory of extended Kohler's rule, suggesting multiple scattering origins and temperature-dependent carrier densities. A maximum MR of 120\% at 2 K and 9 T, with a maximum estimated mobility of approximately 3000 cm$^{2}$V$^{-1}$s$^{-1}$ are observed. The Ni atom's hole-like d$_{x^{2}-y^{2} }$ and electron-like d$_{z^{2}}$ orbitals exhibit peaks and valleys, forming a local indirect-type band gap near the Fermi level (E$_{F}$). This configuration enhances the motion of electrons and holes, resulting in high mobility and relatively high magnetoresistance.


title: A Physics-guided Generative AI Toolkit for Geophysical Monitoring

abstract: Full-waveform inversion (FWI) plays a vital role in geoscience to explore the subsurface. It utilizes the seismic wave to image the subsurface velocity map. As the machine learning (ML) technique evolves, the data-driven approaches using ML for FWI tasks have emerged, offering enhanced accuracy and reduced computational cost compared to traditional physics-based methods. However, a common challenge in geoscience, the unprivileged data, severely limits ML effectiveness. The issue becomes even worse during model pruning, a step essential in geoscience due to environmental complexities. To tackle this, we introduce the EdGeo toolkit, which employs a diffusion-based model guided by physics principles to generate high-fidelity velocity maps. The toolkit uses the acoustic wave equation to generate corresponding seismic waveform data, facilitating the fine-tuning of pruned ML models. Our results demonstrate significant improvements in SSIM scores and reduction in both MAE and MSE across various pruning ratios. Notably, the ML model fine-tuned using data generated by EdGeo yields superior quality of velocity maps, especially in representing unprivileged features, outperforming other existing methods.

categories: cs.LG cs.AI cs.CV eess.SP physics.geo-ph


title: Vision Transformers and Bi-LSTM for Alzheimer's Disease Diagnosis from 3D MRI

abstract: Alzheimer's is a brain disease that gets worse over time and affects memory, thinking, and behavior. Alzheimer's disease (AD) can be treated and managed if it is diagnosed early, which can slow the progression of symptoms and improve quality of life. In this study, we suggested using the Visual Transformer (ViT) and bi-LSTM to process MRI images for diagnosing Alzheimer's disease. We used ViT to extract features from the MRI and then map them to a feature sequence. Then, we used Bi-LSTM sequence modeling to keep the interdependencies between related features. In addition, we evaluated the performance of the proposed model for the binary classification of AD patients using data from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Finally, we evaluated our method against other deep learning models in the literature. The proposed method performs well in terms of accuracy, precision, F-score, and recall for the diagnosis of AD.


title: A generalization of the Center Theorem of the Thurston-Wolpert-Goldman Lie algebra

abstract: The Goldman Lie algebra of an oriented surface was defined by Goldman. By the natural involution that opposes the orientation of curves, the Goldman Lie algebra becomes a $\mathbb{Z}_{2}$-graded Lie algebra. Its even part is isomorphic to the Thurston-Wolpert-Goldman Lie algebra or, briefly, the TWG Lie algebra. Chas and Kabiraj proved the center of the TWG Lie algebra is generated by the class of the unoriented trivial loop and the classes of unoriented loops parallel to boundary components or punctures. The center of the even part can be rephrased as the set of elements of the even part annihilated by all the elements of the even part. We also prove some similar statements for the remaining 3 cases involving the odd part. Moreover, we compute the elements of the symmetric algebra and the universal enveloping algebra of the Goldman Lie algebra annihilated by all the even elements of the Goldman Lie algebra, and those annilated by all the odd elements.


title: TimeGraphs: Graph-based Temporal Reasoning

abstract: Many real-world systems exhibit temporal, dynamic behaviors, which are captured as time series of complex agent interactions. To perform temporal reasoning, current methods primarily encode temporal dynamics through simple sequence-based models. However, in general these models fail to efficiently capture the full spectrum of rich dynamics in the input, since the dynamics is not uniformly distributed. In particular, relevant information might be harder to extract and computing power is wasted for processing all individual timesteps, even if they contain no significant changes or no new information. Here we propose TimeGraphs, a novel approach that characterizes dynamic interactions as a hierarchical temporal graph, diverging from traditional sequential representations. Our approach models the interactions using a compact graph-based representation, enabling adaptive reasoning across diverse time scales. Adopting a self-supervised method, TimeGraphs constructs a multi-level event hierarchy from a temporal input, which is then used to efficiently reason about the unevenly distributed dynamics. This construction process is scalable and incremental to accommodate streaming data. We evaluate TimeGraphs on multiple datasets with complex, dynamic agent interactions, including a football simulator, the Resistance game, and the MOMA human activity dataset. The results demonstrate both robustness and efficiency of TimeGraphs on a range of temporal reasoning tasks. Our approach obtains state-of-the-art performance and leads to a performance increase of up to 12.2% on event prediction and recognition tasks over current approaches. Our experiments further demonstrate a wide array of capabilities including zero-shot generalization, robustness in case of data sparsity, and adaptability to streaming data flow.


title: Filtering Homogeneous Observer for MIMO System

abstract: Homogeneous observer for linear multi-input multi-output (MIMO) system is designed. A prefilter of the output is utilized in order to improve robustness of the observer with respect to measurement noises. The use of such a prefilter also simplifies tuning, since the observer gains in this case are parameterized by a linear matrix inequality (LMI) being always feasible for observable system. In particular case, the observer is shown to be applicable in the presence of the state and the output bounded perturbations. Theoretical results are supported by numerical simulations.


title: Asynchronous Decentralized Optimization with Constraints: Achievable Speeds of Convergence for Directed Graphs

abstract: We address a decentralized convex optimization problem, where every agent has its unique local objective function and constraint set. Agents compute at different speeds, and their communication may be delayed and directed. For this setup, we propose an asynchronous double averaging and gradient projection (ASY-DAGP) algorithm. Our algorithm handles difficult scenarios such as message failure, by employing local buffers and utilizing the temporal correlation in the transmitted messages. We guarantee the convergence speed of our algorithm using performance estimation problems (PEP). In particular, we introduce the concept of the linear quadratic (LQ) PEP. This approach simplifies the analysis of smooth convex optimization problems, going beyond Lyapunov function analyses and avoiding restrictive assumptions such as strong-convexity. Numerical experiments validate the effectiveness of our proposed algorithm.


title: SPQR: Controlling Q-ensemble Independence with Spiked Random Model for Reinforcement Learning

abstract: Alleviating overestimation bias is a critical challenge for deep reinforcement learning to achieve successful performance on more complex tasks or offline datasets containing out-of-distribution data. In order to overcome overestimation bias, ensemble methods for Q-learning have been investigated to exploit the diversity of multiple Q-functions. Since network initialization has been the predominant approach to promote diversity in Q-functions, heuristically designed diversity injection methods have been studied in the literature. However, previous studies have not attempted to approach guaranteed independence over an ensemble from a theoretical perspective. By introducing a novel regularization loss for Q-ensemble independence based on random matrix theory, we propose spiked Wishart Q-ensemble independence regularization (SPQR) for reinforcement learning. Specifically, we modify the intractable hypothesis testing criterion for the Q-ensemble independence into a tractable KL divergence between the spectral distribution of the Q-ensemble and the target Wigner's semicircle distribution. We implement SPQR in several online and offline ensemble Q-learning algorithms. In the experiments, SPQR outperforms the baseline algorithms in both online and offline RL benchmarks.


title: TelTrans: Applying Multi-Type Telecom Data to Transportation Evaluation and Prediction via Multifaceted Graph Modeling

abstract: To address the limitations of traffic prediction from location-bound detectors, we present Geographical Cellular Traffic (GCT) flow, a novel data source that leverages the extensive coverage of cellular traffic to capture mobility patterns. Our extensive analysis validates its potential for transportation. Focusing on vehicle-related GCT flow prediction, we propose a graph neural network that integrates multivariate, temporal, and spatial facets for improved accuracy. Experiments reveal our model's superiority over baselines, especially in long-term predictions. We also highlight the potential for GCT flow integration into transportation systems.


title: A Molecular Dynamics Study of Mechanical Properties of Vertically Stacked Silicene/MoS2 van der Waals Heterostructure

abstract: Silicene is an intriguing silicon allotrope with a honeycomb lattice structure similar to graphene with slightly buckled geometry. Molybdenum disulfide (MoS2), on the other hand, is a significant 2D transition metal dichalcogenide that has demonstrated promise in a variety of applications. Van der Waals heterostructures, which are created by stacking distinct 2D crystals on top of each other, are becoming increasingly important due to their unique optoelectronic and electromechanical properties. Using molecular dynamics simulations, the mechanical characteristics of vertically stacked Silicene/MoS2 van der Waals heterostructures are examined in this study. The response and structural stability of the heterostructures at various loading orientations and temperatures are given particular attention. The research findings highlight that the fracture strength of the Silicene/MoS2 heterostructure decreases by 40% in both armchair and zigzag orientations when the temperature is raised from 100K to 600K. Furthermore, a linear decrease in Young's modulus is observed as temperature rises. It is noteworthy that the Rule of Mixture (ROM) predictions for Young's Moduli are observed to be marginally lower than the simulation results. The analyses reveal that the silicene layer fractures first under both loading directions shows crack propagation at +-60{\deg}in the armchair and predominantly perpendicular in zigzag, followed by subsequent MoS2 layer failure. The study also shows that the MoS2 layer largely determines the elastic properties of the heterostructure, whereas the silicene layer primarily dictates the failure of the heterostructure. These findings offer an in-depth understanding of the mechanical properties of Silicene/MoS2 heterostructures, with significant implications for their use in cutting-edge nanoelectronics and nanomechanical systems.


title: Fair Sampling in Diffusion Models through Switching Mechanism

abstract: Diffusion models have shown their effectiveness in generation tasks by well-approximating the underlying probability distribution. However, diffusion models are known to suffer from an amplified inherent bias from the training data in terms of fairness. While the sampling process of diffusion models can be controlled by conditional guidance, previous works have attempted to find empirical guidance to achieve quantitative fairness. To address this limitation, we propose a fairness-aware sampling method called \textit{attribute switching} mechanism for diffusion models. Without additional training, the proposed sampling can obfuscate sensitive attributes in generated data without relying on classifiers. We mathematically prove and experimentally demonstrate the effectiveness of the proposed method on two key aspects: (i) the generation of fair data and (ii) the preservation of the utility of the generated data.


title: Estimating the Lateral Motion States of an Underwater Robot by Propeller Wake Sensing Using an Artificial Lateral Line

abstract: An artificial lateral line (ALL) is a bioinspired flow sensing system of an underwater robot that consists of distributed flow sensors. The ALL has achieved great success in sensing the motion states of bioinspired underwater robots, e.g., robotic fish, that are driven by body undulation and/or tail flapping. However, the ALL has not been systematically tested and studied in the sensing of underwater robots driven by rotating propellers due to the highly dynamic and complex flow field therein. This paper makes a bold hypothesis that the distributed flow measurements sampled from the propeller wake flow, although infeasible to represent the entire flow dynamics, provides sufficient information for estimating the lateral motion states of the leader underwater robot. An experimental testbed is constructed to investigate the feasibility of such a state estimator which comprises a cylindrical ALL sensory system, a rotating leader propeller, and a water tank with a planar sliding guide. Specifically, a hybrid network that consists of a one-dimensional convolution network (1DCNN) and a bidirectional long short-term memory network (BiLSTM) is designed to extract the spatiotemporal features of the time series of distributed pressure measurements. A multi-output deep learning network is adopted to estimate the lateral motion states of the leader propeller. In addition, the state estimator is optimized using the whale optimization algorithm (WOA) considering the comprehensive estimation performance. Extensive experiments are conducted the results of which validate the proposed data-driven algorithm in estimating the motion states of the leader underwater robot by propeller wake sensing.


title: Explicit Visual Prompts for Visual Object Tracking

abstract: How to effectively exploit spatio-temporal information is crucial to capture target appearance changes in visual tracking. However, most deep learning-based trackers mainly focus on designing a complicated appearance model or template updating strategy, while lacking the exploitation of context between consecutive frames and thus entailing the \textit{when-and-how-to-update} dilemma. To address these issues, we propose a novel explicit visual prompts framework for visual tracking, dubbed \textbf{EVPTrack}. Specifically, we utilize spatio-temporal tokens to propagate information between consecutive frames without focusing on updating templates. As a result, we cannot only alleviate the challenge of \textit{when-to-update}, but also avoid the hyper-parameters associated with updating strategies. Then, we utilize the spatio-temporal tokens to generate explicit visual prompts that facilitate inference in the current frame. The prompts are fed into a transformer encoder together with the image tokens without additional processing. Consequently, the efficiency of our model is improved by avoiding \textit{how-to-update}. In addition, we consider multi-scale information as explicit visual prompts, providing multiscale template features to enhance the EVPTrack's ability to handle target scale changes. Extensive experimental results on six benchmarks (i.e., LaSOT, LaSOT\rm $_{ext}$, GOT-10k, UAV123, TrackingNet, and TNL2K.) validate that our EVPTrack can achieve competitive performance at a real-time speed by effectively exploiting both spatio-temporal and multi-scale information. Code and models are available at https://github.com/GXNU-ZhongLab/EVPTrack.


title: From the first observations of cosmic rays to the physics of relativistic nuclei

abstract: Research of cosmic rays at the Physical Institute of the USSR Academy of Sciences resulted in the construction of the JINR Synchrophasotron. For this purpose the Electrophysical Laboratory of the USSR Academy of Sciences was founded in 1953, which became part of JINR in 1956 as the High Energy Laboratory. The initial milestones to develop experiments at the Laboratory on the Synchrophasotron are presented. Leaders and key participants in the experiments are highlighted, as well as the lessons and results relevant today.


title: Integrating Personalized Parsons Problems with Multi-Level Textual Explanations to Scaffold Code Writing

abstract: Novice programmers need to write basic code as part of the learning process, but they often face difficulties. To assist struggling students, we recently implemented personalized Parsons problems, which are code puzzles where students arrange blocks of code to solve them, as pop-up scaffolding. Students found them to be more engaging and preferred them for learning, instead of simply receiving the correct answer, such as the response they might get from generative AI tools like ChatGPT. However, a drawback of using Parsons problems as scaffolding is that students may be able to put the code blocks in the correct order without fully understanding the rationale of the correct solution. As a result, the learning benefits of scaffolding are compromised. Can we improve the understanding of personalized Parsons scaffolding by providing textual code explanations? In this poster, we propose a design that incorporates multiple levels of textual explanations for the Parsons problems. This design will be used for future technical evaluations and classroom experiments. These experiments will explore the effectiveness of adding textual explanations to Parsons problems to improve instructional benefits.


title: Self-supervised Feature Adaptation for 3D Industrial Anomaly Detection

abstract: Industrial anomaly detection is generally addressed as an unsupervised task that aims at locating defects with only normal training samples. Recently, numerous 2D anomaly detection methods have been proposed and have achieved promising results, however, using only the 2D RGB data as input is not sufficient to identify imperceptible geometric surface anomalies. Hence, in this work, we focus on multi-modal anomaly detection. Specifically, we investigate early multi-modal approaches that attempted to utilize models pre-trained on large-scale visual datasets, i.e., ImageNet, to construct feature databases. And we empirically find that directly using these pre-trained models is not optimal, it can either fail to detect subtle defects or mistake abnormal features as normal ones. This may be attributed to the domain gap between target industrial data and source data.Towards this problem, we propose a Local-to-global Self-supervised Feature Adaptation (LSFA) method to finetune the adaptors and learn task-oriented representation toward anomaly detection.Both intra-modal adaptation and cross-modal alignment are optimized from a local-to-global perspective in LSFA to ensure the representation quality and consistency in the inference stage.Extensive experiments demonstrate that our method not only brings a significant performance boost to feature embedding based approaches, but also outperforms previous State-of-The-Art (SoTA) methods prominently on both MVTec-3D AD and Eyecandies datasets, e.g., LSFA achieves 97.1% I-AUROC on MVTec-3D, surpass previous SoTA by +3.4%.


title: Thermal effect in hot QCD matter in strong magnetic fields

abstract: The quasiparticle model is improved by the free magnetic contribution to investigated the QCD matter in a strong magnetic field. The temperature-dependent bag function is determined by the thermodynamic consistency to represent the difference in energy density between physical vacuum and lowest state of QCD. It is found that the positive bag function vanishes at high temperature indicating the deconfinement. The rapid decrease of the bag function in stronger magnetic fields reveals the so-called inverse magnetic catalysis. The interaction measure at high temperature remains so large that the usual Stefan-Boltzmann limit can not be reached. We suggest a limit $|q_iB_m|T^2/4$ for each landau level pressure. Finally, it is demonstrated that the positive magnetization modified by the bag function and free magnetic contribution indicates the paramagnetic characteristic of QCD matter.


title: A fast offline/online forward solver for stationary transport equation with multiple inflow boundary conditions and varying coefficients

abstract: It is of great interest to solve the inverse problem of stationary radiative transport equation (RTE) in optical tomography. The standard way is to formulate the inverse problem into an optimization problem, but the bottleneck is that one has to solve the forward problem repeatedly, which is time-consuming. Due to the optical property of biological tissue, in real applications, optical thin and thick regions coexist and are adjacent to each other, and the geometry can be complex. To use coarse meshes and save the computational cost, the forward solver has to be asymptotic preserving across the interface (APAL). In this paper, we propose an offline/online solver for RTE. The cost at the offline stage is comparable to classical methods, while the cost at the online stage is much lower. Two cases are considered. One is to solve the RTE with fixed scattering and absorption cross sections while the boundary conditions vary; the other is when cross sections vary in a small domain and the boundary conditions change many times. The solver can be decomposed into offline/online stages in these two cases. One only needs to calculate the offline stage once and update the online stage when the parameters vary. Our proposed solver is much cheaper when one needs to solve RTE with multiple right-hand sides or when the cross sections vary in a small domain, thus can accelerate the speed of solving inverse RTE problems. We illustrate the online/offline decomposition based on the Tailored Finite Point Method (TFPM), which is APAL on general quadrilateral meshes.


title: Impulse approximate controllability for stochastic evolution equations and its applications

abstract: This paper is concerned with impulse approximate controllability for stochastic evolution equations with impulse controls. As direct applications, we formulate captivating minimal norm and time optimal control problems; The minimal norm problem seeks to identify an optimal impulse control characterized by the minimum norm among all feasible controls, guiding the system's solutions from an initial state within a fixed time interval toward a predetermined target while the minimal time problem is to find an optimal impulse control (among certain control constraint set), which steers the solution of the stochastic equation from a given initial state to a given target set as soon as possible. These problems, to the best of our knowledge, are among the first to discuss in the stochastic case.


title: CaMML: Context-Aware Multimodal Learner for Large Models

abstract: In this work, we introduce Context-Aware MultiModal Learner (CaMML), for tuning large multimodal models (LMMs). CaMML, a lightweight module, is crafted to seamlessly integrate multimodal contextual samples into large models, thereby empowering the model to derive knowledge from analogous, domain-specific, up-to-date information and make grounded inferences. Importantly, CaMML is highly scalable and can efficiently handle lengthy multimodal context examples owing to its hierarchical design. Based on CaMML, we have developed two multimodal models, CaMML-7B and CaMML-13B, that have shown exceptional performance across an array of benchmark datasets for multimodal tasks. Remarkably, CaMML-13B achieves the state-of-the-art performance on over ten widely recognized multimodal benchmark datasets, surpassing LLaVA-1.5 (13B) with a noticeable margin, without integration of any external resources. Moreover, we have conducted extensive ablative studies to inspect the inner workings of CaMML and performed qualitative analyses to showcase its effectiveness in handling real-world challenging cases. Code and models are available at: https://github.com/amazon-science/camml.


title: O-PRESS: Boosting OCT axial resolution with Prior guidance, Recurrence, and Equivariant Self-Supervision

abstract: Optical coherence tomography (OCT) is a noninvasive technology that enables real-time imaging of tissue microanatomies. The axial resolution of OCT is intrinsically constrained by the spectral bandwidth of the employed light source while maintaining a fixed center wavelength for a specific application. Physically extending this bandwidth faces strong limitations and requires a substantial cost. We present a novel computational approach, called as O-PRESS, for boosting the axial resolution of OCT with Prior Guidance, a Recurrent mechanism, and Equivariant Self-Supervision. Diverging from conventional superresolution methods that rely on physical models or data-driven techniques, our method seamlessly integrates OCT modeling and deep learning, enabling us to achieve real-time axial-resolution enhancement exclusively from measurements without a need for paired images. Our approach solves two primary tasks of resolution enhancement and noise reduction with one treatment. Both tasks are executed in a self-supervised manner, with equivariance imaging and free space priors guiding their respective processes. Experimental evaluations, encompassing both quantitative metrics and visual assessments, consistently verify the efficacy and superiority of our approach, which exhibits performance on par with fully supervised methods. Importantly, the robustness of our model is affirmed, showcasing its dual capability to enhance axial resolution while concurrently improving the signal-to-noise ratio.


title: Semi-supervised learning via DQN for log anomaly detection

abstract: Log anomaly detection plays a critical role in ensuring the security and maintenance of modern software systems. At present, the primary approach for detecting anomalies in log data is through supervised anomaly detection. Nonetheless, existing supervised methods heavily rely on labeled data, which can be frequently limited in real-world scenarios. In this paper, we propose a semi-supervised log anomaly detection method that combines the DQN algorithm from deep reinforcement learning, which is called DQNLog. DQNLog leverages a small amount of labeled data and a large-scale unlabeled dataset, effectively addressing the challenges of imbalanced data and limited labeling. This approach not only learns known anomalies by interacting with an environment biased towards anomalies but also discovers unknown anomalies by actively exploring the unlabeled dataset. Additionally, DQNLog incorporates a cross-entropy loss term to prevent model overestimation during Deep Reinforcement Learning (DRL). Our evaluation on three widely-used datasets demonstrates that DQNLog significantly improves recall rate and F1-score while maintaining precision, validating its practicality.


title: Controllable Image Synthesis of Industrial Data Using Stable Diffusion

abstract: Training supervised deep neural networks that perform defect detection and segmentation requires large-scale fully-annotated datasets, which can be hard or even impossible to obtain in industrial environments. Generative AI offers opportunities to enlarge small industrial datasets artificially, thus enabling the usage of state-of-the-art supervised approaches in the industry. Unfortunately, also good generative models need a lot of data to train, while industrial datasets are often tiny. Here, we propose a new approach for reusing general-purpose pre-trained generative models on industrial data, ultimately allowing the generation of self-labelled defective images. First, we let the model learn the new concept, entailing the novel data distribution. Then, we force it to learn to condition the generative process, producing industrial images that satisfy well-defined topological characteristics and show defects with a given geometry and location. To highlight the advantage of our approach, we use the synthetic dataset to optimise a crack segmentor for a real industrial use case. When the available data is small, we observe considerable performance increase under several metrics, showing the method's potential in production environments.


title: An Event-Oriented Diffusion-Refinement Method for Sparse Events Completion

abstract: Event cameras or dynamic vision sensors (DVS) record asynchronous response to brightness changes instead of conventional intensity frames, and feature ultra-high sensitivity at low bandwidth. The new mechanism demonstrates great advantages in challenging scenarios with fast motion and large dynamic range. However, the recorded events might be highly sparse due to either limited hardware bandwidth or extreme photon starvation in harsh environments. To unlock the full potential of event cameras, we propose an inventive event sequence completion approach conforming to the unique characteristics of event data in both the processing stage and the output form. Specifically, we treat event streams as 3D event clouds in the spatiotemporal domain, develop a diffusion-based generative model to generate dense clouds in a coarse-to-fine manner, and recover exact timestamps to maintain the temporal resolution of raw data successfully. To validate the effectiveness of our method comprehensively, we perform extensive experiments on three widely used public datasets with different spatial resolutions, and additionally collect a novel event dataset covering diverse scenarios with highly dynamic motions and under harsh illumination. Besides generating high-quality dense events, our method can benefit downstream applications such as object classification and intensity frame reconstruction.


title: Decentralized Multi-Agent Active Search and Tracking when Targets Outnumber Agents

abstract: Multi-agent multi-target tracking has a wide range of applications, including wildlife patrolling, security surveillance or environment monitoring. Such algorithms often make restrictive assumptions: the number of targets and/or their initial locations may be assumed known, or agents may be pre-assigned to monitor disjoint partitions of the environment, reducing the burden of exploration. This also limits applicability when there are fewer agents than targets, since agents are unable to continuously follow the targets in their fields of view. Multi-agent tracking algorithms additionally assume inter-agent synchronization of observations, or the presence of a central controller to coordinate joint actions. Instead, we focus on the setting of decentralized multi-agent, multi-target, simultaneous active search-and-tracking with asynchronous inter-agent communication. Our proposed algorithm DecSTER uses a sequential monte carlo implementation of the probability hypothesis density filter for posterior inference combined with Thompson sampling for decentralized multi-agent decision making. We compare different action selection policies, focusing on scenarios where targets outnumber agents. In simulation, we demonstrate that DecSTER is robust to unreliable inter-agent communication and outperforms information-greedy baselines in terms of the Optimal Sub-Pattern Assignment (OSPA) metric for different numbers of targets and varying teamsizes.


title: Stochastic Bregman Proximal Gradient Method Revisited: Kernel Conditioning and Painless Variance Reduction

abstract: We investigate Bregman proximal gradient (BPG) methods for solving nonconvex composite stochastic optimization problems. Instead of the standard gradient Lipschitz continuity (GLC) assumption, the objective function only satisfies a smooth-adaptability assumption w.r.t. some kernel function. An in-depth analysis of the stationarity measure is made in this paper, where we reveal an interesting fact that the widely adopted Bregman proximal gradient mapping in the existing works may not correctly depict the near stationarity of the solutions. To resolve this issue, a new Bregman proximal gradient mapping is proposed and analyzed in this paper. Second, a thorough analysis is made on the sample complexities of the stochastic Bregman proximal gradient methods under both the old and the newly proposed gradient mappings are analyzed. Note that the absence of GLC disables the standard analysis of the stochastic variance reduction techniques, existing stochastic BPG methods only obtain an $O(\epsilon^{-2})$ sample complexity under the old gradient mapping, we show that such a limitation in the existing analyses mainly comes from the insufficient exploitation of the kernel's properties. By proposing a new kernel-conditioning regularity assumption on the kernel, we show that a simple epoch bound mechanism is enough to enable all the existing variance reduction techniques for stochastic BPG methods. Combined with a novel probabilistic argument, we show that there is a high probability event conditioning on which $O(\sqrt{n}\epsilon^{-1})$ sample complexity for the finite-sum stochastic setting can be derived for the old gradient mapping. Moreover, with a novel adaptive step size control mechanism, we also show an $\tilde{O}(\sqrt{n}L_h(\mathcal{X}_\epsilon)\epsilon^{-1})$ complexity under the new gradient mapping.


title: Data-Dependent Stability Analysis of Adversarial Training

abstract: Stability analysis is an essential aspect of studying the generalization ability of deep learning, as it involves deriving generalization bounds for stochastic gradient descent-based training algorithms. Adversarial training is the most widely used defense against adversarial example attacks. However, previous generalization bounds for adversarial training have not included information regarding the data distribution. In this paper, we fill this gap by providing generalization bounds for stochastic gradient descent-based adversarial training that incorporate data distribution information. We utilize the concepts of on-average stability and high-order approximate Lipschitz conditions to examine how changes in data distribution and adversarial budget can affect robust generalization gaps. Our derived generalization bounds for both convex and non-convex losses are at least as good as the uniform stability-based counterparts which do not include data distribution information. Furthermore, our findings demonstrate how distribution shifts from data poisoning attacks can impact robust generalization.


title: ImageLab: Simplifying Image Processing Exploration for Novices and Experts Alike

abstract: Image processing holds immense potential for societal benefit, yet its full potential is often accessible only to tech-savvy experts. Bridging this knowledge gap and providing accessible tools for users of all backgrounds remains an unexplored frontier. This paper introduces "ImageLab," a novel tool designed to democratize image processing, catering to both novices and experts by prioritizing interactive learning over theoretical complexity. ImageLab not only serves as a valuable educational resource but also offers a practical testing environment for seasoned practitioners. Through a comprehensive evaluation of ImageLab's features, we demonstrate its effectiveness through a user study done for a focused group of school children and university students which enables us to get positive feedback on the tool. Our work represents a significant stride toward enhancing image processing education and practice, making it more inclusive and approachable for all.


title: Quartet Logic: A Four-Step Reasoning (QLFR) framework for advancing Short Text Classification

abstract: Short Text Classification (STC) is crucial for processing and comprehending the brief but substantial content prevalent on contemporary digital platforms. The STC encounters difficulties in grasping semantic and syntactic intricacies, an issue that is apparent in traditional pre-trained language models. Although Graph Convolutional Networks enhance performance by integrating external knowledge bases, these methods are limited by the quality and extent of the knowledge applied. Recently, the emergence of Large Language Models (LLMs) and Chain-of-Thought (CoT) has significantly improved the performance of complex reasoning tasks. However, some studies have highlighted the limitations of their application in fundamental NLP tasks. Consequently, this study sought to employ CoT to investigate the capabilities of LLMs in STC tasks. This study introduces Quartet Logic: A Four-Step Reasoning (QLFR) framework. This framework primarily incorporates Syntactic and Semantic Enrichment CoT, effectively decomposing the STC task into four distinct steps: (i) essential concept identification, (ii) common-sense knowledge retrieval, (iii) text rewriting, and (iv) classification. This elicits the inherent knowledge and abilities of LLMs to address the challenges in STC. Surprisingly, we found that QLFR can also improve the performance of smaller models. Therefore, we developed a CoT-Driven Multi-task learning (QLFR-CML) method to facilitate the knowledge transfer from LLMs to smaller models. Extensive experimentation across six short-text benchmarks validated the efficacy of the proposed methods. Notably, QLFR achieved state-of-the-art performance on all datasets, with significant improvements, particularly on the Ohsumed and TagMyNews datasets.


title: Distributed client selection with multi-objective in federated learning assisted Internet of Vehicles

abstract: Federated learning is an emerging distributed machine learning framework in the Internet of Vehicles (IoV). In IoV, millions of vehicles are willing to train the model to share their knowledge. Maintaining an active state means the participants must update their state to the FL server in a fixed interval and participate to next round. However, the cost by maintaining an active state is very large when there are a huge number of participating vehicles. In this paper, we proposed a distributed client selection scheme to reduce the cost of maintaining the active state for all participants. The clients with the highest evaluation are elected among the neighbours. In the evaluator, four variables are considered including sample quantity, throughput available, computational capability and the quality of the local dataset. We adopted fuzzy logic as the evaluator since the closed-form solution over four variables does not exist. Extensive simulation results show our proposal approximates the centralized client selection in terms of accuracy and can significantly reduce the communication overhead.


title: HAIM-DRL: Enhanced Human-in-the-loop Reinforcement Learning for Safe and Efficient Autonomous Driving

abstract: Despite significant progress in autonomous vehicles (AVs), the development of driving policies that ensure both the safety of AVs and traffic flow efficiency has not yet been fully explored. In this paper, we propose an enhanced human-in-the-loop reinforcement learning method, termed the Human as AI mentor-based deep reinforcement learning (HAIM-DRL) framework, which facilitates safe and efficient autonomous driving in mixed traffic platoon. Drawing inspiration from the human learning process, we first introduce an innovative learning paradigm that effectively injects human intelligence into AI, termed Human as AI mentor (HAIM). In this paradigm, the human expert serves as a mentor to the AI agent. While allowing the agent to sufficiently explore uncertain environments, the human expert can take control in dangerous situations and demonstrate correct actions to avoid potential accidents. On the other hand, the agent could be guided to minimize traffic flow disturbance, thereby optimizing traffic flow efficiency. In detail, HAIM-DRL leverages data collected from free exploration and partial human demonstrations as its two training sources. Remarkably, we circumvent the intricate process of manually designing reward functions; instead, we directly derive proxy state-action values from partial human demonstrations to guide the agents' policy learning. Additionally, we employ a minimal intervention technique to reduce the human mentor's cognitive load. Comparative results show that HAIM-DRL outperforms traditional methods in driving safety, sampling efficiency, mitigation of traffic flow disturbance, and generalizability to unseen traffic scenarios. The code and demo videos for this paper can be accessed at: https://zilin-huang.github.io/HAIM-DRL-website/


title: Confined run-and-tumble model with boundary aggregation: long time behavior and convergence to the confined Fokker-Planck model

abstract: The motile micro-organisms such as E. coli, sperm, or some seaweed are usually modelled by self-propelled particles that move with the run-and-tumble process. Individual-based stochastic models are usually employed to model the aggregation phenomenon at the boundary, which is an active research field that has attracted a lot of biologists and biophysicists. Self-propelled particles at the microscale have complex behaviors, while characteristics at the population level are more important for practical applications but rely on individual behaviors. Kinetic PDE models that describe the time evolution of the probability density distribution of the motile micro-organisms are widely used. However, how to impose the appropriate boundary conditions that take into account the boundary aggregation phenomena is rarely studied. In this paper, we propose the boundary conditions for a 2D confined run-and-tumble model (CRTM) for self-propelled particle populations moving between two parallel plates with a run-and-tumble process. The proposed model satisfies the relative entropy inequality and thus long-time convergence. We establish the relation between CRTM and the confined Fokker-Planck model (CFPM) studied in [22]. We prove theoretically that when the tumble is highly forward peaked and frequent enough, CRTM converges asymptotically to the CFPM. A numerical comparison of the CRTM with aggregation and CFPM is given. The time evolution of both the deterministic PDE model and individual-based stochastic simulations are displayed, which match each other well.


title: QoS-Aware Graph Contrastive Learning for Web Service Recommendation

abstract: With the rapid growth of cloud services driven by advancements in web service technology, selecting a high-quality service from a wide range of options has become a complex task. This study aims to address the challenges of data sparsity and the cold-start problem in web service recommendation using Quality of Service (QoS). We propose a novel approach called QoS-aware graph contrastive learning (QAGCL) for web service recommendation. Our model harnesses the power of graph contrastive learning to handle cold-start problems and improve recommendation accuracy effectively. By constructing contextually augmented graphs with geolocation information and randomness, our model provides diverse views. Through the use of graph convolutional networks and graph contrastive learning techniques, we learn user and service embeddings from these augmented graphs. The learned embeddings are then utilized to seamlessly integrate QoS considerations into the recommendation process. Experimental results demonstrate the superiority of our QAGCL model over several existing models, highlighting its effectiveness in addressing data sparsity and the cold-start problem in QoS-aware service recommendations. Our research contributes to the potential for more accurate recommendations in real-world scenarios, even with limited user-service interaction data.


title: An Empirical Investigation of Value-Based Multi-objective Reinforcement Learning for Stochastic Environments

abstract: One common approach to solve multi-objective reinforcement learning (MORL) problems is to extend conventional Q-learning by using vector Q-values in combination with a utility function. However issues can arise with this approach in the context of stochastic environments, particularly when optimising for the Scalarised Expected Reward (SER) criterion. This paper extends prior research, providing a detailed examination of the factors influencing the frequency with which value-based MORL Q-learning algorithms learn the SER-optimal policy for an environment with stochastic state transitions. We empirically examine several variations of the core multi-objective Q-learning algorithm as well as reward engineering approaches, and demonstrate the limitations of these methods. In particular, we highlight the critical impact of the noisy Q-value estimates issue on the stability and convergence of these algorithms.


title: Cavity magnonics with domain walls in insulating ferromagnetic wires

abstract: Magnetic domain walls (DWs) are topological defects that exhibit robust low-energy modes that can be harnessed for classical and neuromorphic computing. However, the quantum nature of these modes has been elusive thus far. Using the language of cavity optomechanics, we show how to exploit a geometric Berry-phase interaction between the localized DWs and the extended magnons in short ferromagnetic insulating wires to efficiently cool the DW to its quantum ground state or to prepare nonclassical states exhibiting a negative Wigner function that can be extracted from the power spectrum of the emitted magnons. Moreover, we demonstrate that magnons can mediate long-range entangling interactions between qubits stored in distant DWs, which could facilitate the implementation of a universal set of quantum gates. Our proposal relies only on the intrinsic degrees of freedom of the ferromagnet, and can be naturally extended to explore the quantum dynamics of DWs in ferrimagnets and antiferromagnets, as well as quantum vortices or skyrmions confined in insulating magnetic nanodisks.


title: Non-orthogonal cavity modes near exceptional points in the far field

abstract: Non-orthogonal eigenstates are a fundamental feature of non-Hermitian systems and are accompanied by the emergence of nontrivial features. However, the platforms to explore non-Hermitian mode couplings mainly measure near-field effects, and the far-field behaviour remain mostly unexplored. Here, we study how a microcavity with non-Hermitian mode coupling exhibits eigenstate non-orthogonality by investigating the spatial field and the far-field polarization of cavity modes. The non-Hermiticity arises from asymmetric backscattering, which is controlled by integrating two scatterers of different size and location into a microdisk. We observe that the spatial field overlaps of two modes increases abruptly to its maximum value, whilst different far-field elliptical polarizations of two modes coalesce when approaching an exceptional point. We demonstrate such features experimentally by measuring the far-field polarization from the fabricated microdisks. Our work reveals the non-orthogonality in the far-field degree of freedom, and the integrability of the microdisks paves a way to integrate more non-Hermitian optical properties into nanophotonic systems.


title: Short-Time Fourier Transform for deblurring Variational Autoencoders

abstract: Variational Autoencoders (VAEs) are powerful generative models, however their generated samples are known to suffer from a characteristic blurriness, as compared to the outputs of alternative generating techniques. Extensive research efforts have been made to tackle this problem, and several works have focused on modifying the reconstruction term of the evidence lower bound (ELBO). In particular, many have experimented with augmenting the reconstruction loss with losses in the frequency domain. Such loss functions usually employ the Fourier transform to explicitly penalise the lack of higher frequency components in the generated samples, which are responsible for sharp visual features. In this paper, we explore the aspects of previous such approaches which aren't well understood, and we propose an augmentation to the reconstruction term in response to them. Our reasoning leads us to use the short-time Fourier transform and to emphasise on local phase coherence between the input and output samples. We illustrate the potential of our proposed loss on the MNIST dataset by providing both qualitative and quantitative results.


title: PosDiffNet: Positional Neural Diffusion for Point Cloud Registration in a Large Field of View with Perturbations

abstract: Point cloud registration is a crucial technique in 3D computer vision with a wide range of applications. However, this task can be challenging, particularly in large fields of view with dynamic objects, environmental noise, or other perturbations. To address this challenge, we propose a model called PosDiffNet. Our approach performs hierarchical registration based on window-level, patch-level, and point-level correspondence. We leverage a graph neural partial differential equation (PDE) based on Beltrami flow to obtain high-dimensional features and position embeddings for point clouds. We incorporate position embeddings into a Transformer module based on a neural ordinary differential equation (ODE) to efficiently represent patches within points. We employ the multi-level correspondence derived from the high feature similarity scores to facilitate alignment between point clouds. Subsequently, we use registration methods such as SVD-based algorithms to predict the transformation using corresponding point pairs. We evaluate PosDiffNet on several 3D point cloud datasets, verifying that it achieves state-of-the-art (SOTA) performance for point cloud registration in large fields of view with perturbations. The implementation code of experiments is available at https://github.com/AI-IT-AVs/PosDiffNet.


title: Probing dark photons from a light scalar at Belle II

abstract: In the minimal $U(1)$ extension of the Standard Model (SM), a new gauge boson referred to as "dark photon" is predicted. The dark-photon mass can be generated from an additional Higgs mechanism associated with a dark scalar boson. At $B$-factories such as Belle II, large numbers of $B$-mesons are produced and can decay to a kaon plus the dark scalar via the latter's mixing with the SM Higgs boson. We evaluate the sensitivity of Belle II for the case in which the dark scalar decays exclusively into a pair of dark photons via the new $U(1)$ gauge coupling, and the dark photons are long lived owing to a small kinetic mixing $\epsilon$. We study the experimental signature in which each dark photon decays into a pair of charged leptons, pions, or kaons, resulting in a pair of displaced vertices, and argue that the search is essentially background-free. We perform detailed Monte-Carlo simulations to determine the expected number of signal events at Belle II with an integrated luminosity of 50 ab$^{-1}$, taking into account the efficiencies for both final-state-particle identification and displaced tracking. We find that for experimentally allowed values of the scalar mixing angle and kinematically allowed dark-photon and dark-scalar masses, the proposed search is uniquely sensitive to the medium-$\epsilon$ regime, which is currently mostly unexcluded by experiments.


title: QCD anomalies in electromagnetic processes: A solution to the $\gamma\to3\pi$ puzzle

abstract: In this work, the $\gamma\to3\pi$ form factor is calculated within the Dyson-Schwinger equations framework using a contact interaction model within the so-called modified rainbow ladder truncation. The present calculation takes into account the pseudovector component in the pion Bethe-Salpeter amplitude (BSA) and $\pi-\pi$ scattering effects, producing a $\gamma\to3\pi$ anomaly which is $1+6\mathcal{R}_\pi^2$ larger than the low energy prediction. Here $\mathcal{R_\pi}$ is the relative ratio of the pseudovector and pseudoscalar components in the pion BSA; with our parameters input, this correction raises the $\gamma\to3\pi$ anomaly by around $10\%$. The main outcome of this work is the unveiling of the origin of such correction, which could be a possible explanation of the discrepancy between the existing experimental data and the low energy prediction. Moreover, it is highlighted how the magnitude of the anomaly is affected in effective theories that require an irremovable ultraviolet cutoff. We find that for both the anomalous processes $\pi\to2\gamma$ and $\gamma\to 3\pi$, the missing contribution to the anomaly can be compensated by the additional structures related with the quark anomalous magnetic moment.


title: Preserving Silent Features for Domain Generalization

abstract: Domain generalization (DG) aims to improve the generalization ability of the model trained on several known training domains over unseen test domains. Previous work has shown that self-supervised contrastive pre-training improves the robustness of the model on downstream tasks. However, in this paper, we find that self-supervised models do not exhibit better generalization performance than supervised models pre-trained on the same dataset in the DG setting. We argue that this is owing to the fact that the richer intra-class discriminative features extracted by self-supervised contrastive learning, which we term silent features, are suppressed during supervised fine-tuning. These silent features are likely to contain features that are more generalizable on the test domain. In this work, we model and analyze this feature suppression phenomenon and theoretically prove that preserving silent features can achieve lower expected test domain risk under certain conditions. In light of this, we propose a simple yet effective method termed STEP (Silent Feature Preservation) to improve the generalization performance of the self-supervised contrastive learning pre-trained model by alleviating the suppression of silent features during the supervised fine-tuning process. Experimental results show that STEP exhibits state-of-the-art performance on standard DG benchmarks with significant distribution shifts.


title: Exploration of Adolescent Depression Risk Prediction Based on Census Surveys and General Life Issues

abstract: In contemporary society, the escalating pressures of life and work have propelled psychological disorders to the forefront of modern health concerns, an issue that has been further accentuated by the COVID-19 pandemic. The prevalence of depression among adolescents is steadily increasing, and traditional diagnostic methods, which rely on scales or interviews, prove particularly inadequate for detecting depression in young people. Addressing these challenges, numerous AI-based methods for assisting in the diagnosis of mental health issues have emerged. However, most of these methods center around fundamental issues with scales or use multimodal approaches like facial expression recognition. Diagnosis of depression risk based on everyday habits and behaviors has been limited to small-scale qualitative studies. Our research leverages adolescent census data to predict depression risk, focusing on children's experiences with depression and their daily life situations. We introduced a method for managing severely imbalanced high-dimensional data and an adaptive predictive approach tailored to data structure characteristics. Furthermore, we proposed a cloud-based architecture for automatic online learning and data updates. This study utilized publicly available NSCH youth census data from 2020 to 2022, encompassing nearly 150,000 data entries. We conducted basic data analyses and predictive experiments, demonstrating significant performance improvements over standard machine learning and deep learning algorithms. This affirmed our data processing method's broad applicability in handling imbalanced medical data. Diverging from typical predictive method research, our study presents a comprehensive architectural solution, considering a wider array of user needs.


title: Root patterns and exact surface energy of the spin-1 Heisenberg model with generic open boundaries

abstract: We investigate the thermodynamic limit and exact surface energy of the isotropic spin-1 Heisenberg chain with integrable generic open boundary conditions by a novel Bethe ansatz method. We obtain the homogeneous Bethe ansatz equations for the zero roots of the transfer matrix. Based on the patterns of the zero roots, we analytical calculate the densities of zero roots and the surface energies of the model in all regimes of the boundary parameters.


title: UGGNet: Bridging U-Net and VGG for Advanced Breast Cancer Diagnosis

abstract: In the field of medical imaging, breast ultrasound has emerged as a crucial diagnostic tool for early detection of breast cancer. However, the accuracy of diagnosing the location of the affected area and the extent of the disease depends on the experience of the physician. In this paper, we propose a novel model called UGGNet, combining the power of the U-Net and VGG architectures to enhance the performance of breast ultrasound image analysis. The U-Net component of the model helps accurately segment the lesions, while the VGG component utilizes deep convolutional layers to extract features. The fusion of these two architectures in UGGNet aims to optimize both segmentation and feature representation, providing a comprehensive solution for accurate diagnosis in breast ultrasound images. Experimental results have demonstrated that the UGGNet model achieves a notable accuracy of 78.2% on the "Breast Ultrasound Images Dataset."


title: Pointwise convergence of ergodic averages with M\"obius weight

abstract: Let $(X,\nu,T)$ be a measure-preserving system, and let $P_1,\ldots, P_k$ be polynomials with integer coefficients. We prove that, for any $f_1,\ldots, f_k\in L^{\infty}(X)$, the M\"obius-weighted polynomial multiple ergodic averages \begin{align*} \frac{1}{N}\sum_{n\leq N}\mu(n)f_1(T^{P_1(n)}x)\cdots f_k(T^{P_k(n)}x) \end{align*} converge to $0$ pointwise almost everywhere, provided that either: (i) $k\leq 3$ and $P_i$ are linear; (ii) $k$ is arbitrary and $P_i$ have distinct degrees; (iii) $k$ and $P_i$ are arbitrary, but $N$ is restricted to a certain explicit sequence of natural numbers. Specialising to $P_1(y)=y, P_2(y)=2y$, our results solve a problem of Frantzikinakis. For the proofs we establish some quantitative generalised von Neumann theorems for polynomial configurations that are of independent interest.


title: Part-of-Speech Tagger for Bodo Language using Deep Learning approach

abstract: Language Processing systems such as Part-of-speech tagging, Named entity recognition, Machine translation, Speech recognition, and Language modeling (LM) are well-studied in high-resource languages. Nevertheless, research on these systems for several low-resource languages, including Bodo, Mizo, Nagamese, and others, is either yet to commence or is in its nascent stages. Language model plays a vital role in the downstream tasks of modern NLP. Extensive studies are carried out on LMs for high-resource languages. Nevertheless, languages such as Bodo, Rabha, and Mising continue to lack coverage. In this study, we first present BodoBERT, a language model for the Bodo language. To the best of our knowledge, this work is the first such effort to develop a language model for Bodo. Secondly, we present an ensemble DL-based POS tagging model for Bodo. The POS tagging model is based on combinations of BiLSTM with CRF and stacked embedding of BodoBERT with BytePairEmbeddings. We cover several language models in the experiment to see how well they work in POS tagging tasks. The best-performing model achieves an F1 score of 0.8041. A comparative experiment was also conducted on Assamese POS taggers, considering that the language is spoken in the same region as Bodo.


title: On the convexity of the Berezin range of composition operators and related questions

abstract: The Berezin range of a bounded operator $T$ acting on a reproducing kernel Hilbert space $\mathcal{H}$ is the set $B(T)$ := $\{\langle T\hat{k}_{x},\hat{k}_{x} \rangle_{\mathcal{H}} : x \in X\}$, where $\hat{k}_{x}$ is the normalized reproducing kernel for $\mathcal{H}$ at $x \in X$. In general, the Berezin range of an operator is not convex. Primarily, we focus on characterizing the convexity of the Berezin range for a class of composition operators acting on the Fock space on $\mathbb{C}$ and the Dirichlet space of the unit disc $\mathbb{D}$. We prove an analogue of the elliptic range theorem for the unitarily equivalent Berezin range of an operator on a two-dimensional reproducing kernel Hilbert space and characterize the convexity of the unitarily equivalent Berezin range for a bounded operator $T$ on a reproducing kernel Hilbert space $\mathcal{H}$.


title: Text-Video Retrieval via Variational Multi-Modal Hypergraph Networks

abstract: Text-video retrieval is a challenging task that aims to identify relevant videos given textual queries. Compared to conventional textual retrieval, the main obstacle for text-video retrieval is the semantic gap between the textual nature of queries and the visual richness of video content. Previous works primarily focus on aligning the query and the video by finely aggregating word-frame matching signals. Inspired by the human cognitive process of modularly judging the relevance between text and video, the judgment needs high-order matching signal due to the consecutive and complex nature of video contents. In this paper, we propose chunk-level text-video matching, where the query chunks are extracted to describe a specific retrieval unit, and the video chunks are segmented into distinct clips from videos. We formulate the chunk-level matching as n-ary correlations modeling between words of the query and frames of the video and introduce a multi-modal hypergraph for n-ary correlation modeling. By representing textual units and video frames as nodes and using hyperedges to depict their relationships, a multi-modal hypergraph is constructed. In this way, the query and the video can be aligned in a high-order semantic space. In addition, to enhance the model's generalization ability, the extracted features are fed into a variational inference component for computation, obtaining the variational representation under the Gaussian distribution. The incorporation of hypergraphs and variational inference allows our model to capture complex, n-ary interactions among textual and visual contents. Experimental results demonstrate that our proposed method achieves state-of-the-art performance on the text-video retrieval task.


title: Machine-Learning Performance on Higgs-Pair Production associated with Dark Matter at the LHC

abstract: Di-Higgs production at the LHC associated with missing transverse energy is explored in the context of simplified models that generically parameterize a large class of models with heavy scalars and dark matter candidates. Our aim is to figure out the improvement capability of machine-learning tools over traditional cut-based analyses. In particular, boosted decision trees and neural networks are implemented in order to determine the parameter space that can be tested at the LHC demanding four $b$-jets and large missing energy in the final state. We present a performance comparison between both machine-learning algorithms, based on the maximum significance reached, by feeding them with different sets of kinematic features corresponding to the LHC at a center-of-mass energy of 14 TeV. Both algorithms present very similar performances and substantially improve traditional analyses, being sensitive to most of the parameter space considered for a total integrated luminosity of 1 ab$^{-1}$, with significances at the evidence level, and even at the discovery level, depending on the masses of the new heavy scalars. A more conservative approach with systematic uncertainties on the background of 30\% has also been contemplated, again providing very promising significances.


title: Multimodal Informative ViT: Information Aggregation and Distribution for Hyperspectral and LiDAR Classification

abstract: In multimodal land cover classification (MLCC), a common challenge is the redundancy in data distribution, where irrelevant information from multiple modalities can hinder the effective integration of their unique features. To tackle this, we introduce the Multimodal Informative Vit (MIVit), a system with an innovative information aggregate-distributing mechanism. This approach redefines redundancy levels and integrates performance-aware elements into the fused representation, facilitating the learning of semantics in both forward and backward directions. MIVit stands out by significantly reducing redundancy in the empirical distribution of each modality's separate and fused features. It employs oriented attention fusion (OAF) for extracting shallow local features across modalities in horizontal and vertical dimensions, and a Transformer feature extractor for extracting deep global features through long-range attention. We also propose an information aggregation constraint (IAC) based on mutual information, designed to remove redundant information and preserve complementary information within embedded features. Additionally, the information distribution flow (IDF) in MIVit enhances performance-awareness by distributing global classification information across different modalities' feature maps. This architecture also addresses missing modality challenges with lightweight independent modality classifiers, reducing the computational load typically associated with Transformers. Our results show that MIVit's bidirectional aggregate-distributing mechanism between modalities is highly effective, achieving an average overall accuracy of 95.56% across three multimodal datasets. This performance surpasses current state-of-the-art methods in MLCC. The code for MIVit is accessible at https://github.com/icey-zhang/MIViT.


title: MolDStruct: modelling the dynamics and structure of matter exposed to ultrafast X-ray lasers with hybrid collisional-radiative/molecular dynamics

abstract: We describe a method to compute photon-matter interaction and atomic dynamics with X-ray lasers using a hybrid code based on classical molecular dynamics and collisional-radiative calculations. The forces between the atoms are dynamically computed based on changes to their electronic occupations and the free electron cloud created due to the irradiation of photons in the X-ray spectrum. The rapid transition from neutral solid matter to dense plasma phase allows the use of screened potentials, which reduces the number of non-bonded interactions required to compute. In combination with parallelisation through domain decomposition, large-scale molecular dynamics and ionisation induced by X-ray lasers can be followed. This method is applicable for large enough samples (solids, liquids, proteins, viruses, atomic clusters and crystals) that when exposed to an X-ray laser pulse turn into a plasma in the first few femtoseconds of the interaction. We show several examples of the applicability of the method and we quantify the sizes that the method is suitable for. For large systems, we investigate non-thermal heating and scattering of bulk water, which we compare to previous experiments. We simulate molecular dynamics of a protein crystal induced by an X-ray pump, X-ray probe scheme, and find good agreement of the damage dynamics with experiments. For single particle imaging, we simulate ultrafast dynamics of a methane cluster exposed to a femtosecond X-ray laser. In the context of coherent diffractive imaging we study the fragmentation as given by an X-ray pump X-ray probe setup to understand the evolution of radiation damage.


title: A Joint-Reasoning based Disease Q&A System

abstract: Medical question answer (QA) assistants respond to lay users' health-related queries by synthesizing information from multiple sources using natural language processing and related techniques. They can serve as vital tools to alleviate issues of misinformation, information overload, and complexity of medical language, thus addressing lay users' information needs while reducing the burden on healthcare professionals. QA systems, the engines of such assistants, have typically used either language models (LMs) or knowledge graphs (KG), though the approaches could be complementary. LM-based QA systems excel at understanding complex questions and providing well-formed answers, but are prone to factual mistakes. KG-based QA systems, which represent facts well, are mostly limited to answering short-answer questions with pre-created templates. While a few studies have jointly used LM and KG approaches for text-based QA, this was done to answer multiple-choice questions. Extant QA systems also have limitations in terms of automation and performance. We address these challenges by designing a novel, automated disease QA system which effectively utilizes both LM and KG techniques through a joint-reasoning approach to answer disease-related questions appropriate for lay users. Our evaluation of the system using a range of quality metrics demonstrates its efficacy over benchmark systems, including the popular ChatGPT.


title: Distribution-aware Interactive Attention Network and Large-scale Cloud Recognition Benchmark on FY-4A Satellite Image

abstract: Accurate cloud recognition and warning are crucial for various applications, including in-flight support, weather forecasting, and climate research. However, recent deep learning algorithms have predominantly focused on detecting cloud regions in satellite imagery, with insufficient attention to the specificity required for accurate cloud recognition. This limitation inspired us to develop the novel FY-4A-Himawari-8 (FYH) dataset, which includes nine distinct cloud categories and uses precise domain adaptation methods to align 70,419 image-label pairs in terms of projection, temporal resolution, and spatial resolution, thereby facilitating the training of supervised deep learning networks. Given the complexity and diversity of cloud formations, we have thoroughly analyzed the challenges inherent to cloud recognition tasks, examining the intricate characteristics and distribution of the data. To effectively address these challenges, we designed a Distribution-aware Interactive-Attention Network (DIAnet), which preserves pixel-level details through a high-resolution branch and a parallel multi-resolution cross-branch. We also integrated a distribution-aware loss (DAL) to mitigate the imbalance across cloud categories. An Interactive Attention Module (IAM) further enhances the robustness of feature extraction combined with spatial and channel information. Empirical evaluations on the FYH dataset demonstrate that our method outperforms other cloud recognition networks, achieving superior performance in terms of mean Intersection over Union (mIoU). The code for implementing DIAnet is available at https://github.com/icey-zhang/DIAnet.


title: Exploring Defeasibility in Causal Reasoning

abstract: Defeasibility in causal reasoning implies that the causal relationship between cause and effect can be strengthened or weakened. Namely, the causal strength between cause and effect should increase or decrease with the incorporation of strengthening arguments (supporters) or weakening arguments (defeaters), respectively. However, existing works ignore defeasibility in causal reasoning and fail to evaluate existing causal strength metrics in defeasible settings. In this work, we present $\delta$-CAUSAL, the first benchmark dataset for studying defeasibility in causal reasoning. $\delta$-CAUSAL includes around 11K events spanning ten domains, featuring defeasible causality pairs, i.e., cause-effect pairs accompanied by supporters and defeaters. We further show current causal strength metrics fail to reflect the change of causal strength with the incorporation of supporters or defeaters in $\delta$-CAUSAL. To this end, we propose CESAR (Causal Embedding aSsociation with Attention Rating), a metric that measures causal strength based on token-level causal relationships. CESAR achieves a significant 69.7% relative improvement over existing metrics, increasing from 47.2% to 80.1% in capturing the causal strength change brought by supporters and defeaters. We further demonstrate even Large Language Models (LLMs) like GPT-3.5 still lag 4.5 and 10.7 points behind humans in generating supporters and defeaters, emphasizing the challenge posed by $\delta$-CAUSAL.


title: Radiation properties of the accretion disk around a black hole in Einstein-Maxwell-scalar theory

abstract: In this study, we explore the properties of a non-rotating black hole in the Einstein-Maxwell-scalar (EMS) theory and investigate the luminosity of the accretion disk surrounding it. We determine all the orbital parameters of particles in the accretion disk, including the radius of the innermost stable circular orbit (ISCO) with angular velocity, angular momentum, and energy. Further, we study the radiative efficiency for different values of black hole parameters. Finally, we analyze the flux, differential luminosity, and temperature of the accretion disk.


title: Thin layer axion dynamo

abstract: We study interacting classical magnetic and pseudoscalar fields in frames of the axion electrodynamics. A large scale pseudoscalar field can be the coherent superposition of axions or axion like particles. We consider the evolution of these fields in a thin spherical layer. Decomposing the magnetic field into the poloidal and toroidal components, we take into account their symmetry properties. The dependence of the pseudoscalar field on the latitude is accounted for the induction equation. Then, we derive the dynamo equations in the low mode approximation. The nonlinear evolution equations for the harmonics of the magnetic and pseudoscalar fields are solved numerically. As an application, we consider a dense axion star embedded in solar plasma. The behavior of the harmonics and their typical oscillations frequencies are obtained. We suggest that such small objects consisting of axions and confined magnetic fields can cause the recently observed flashes in solar corona contributing to its heating.


title: Time-reparametrization invariance: from Glasses to toy Black Holes

abstract: Glassy dynamics have time-reparametrization `softness': glasses fluctuate, and respond to external perturbations, primarily by changing the pace of their evolution. Remarkably, the same situation also appears in toy models of quantum field theory such as the Sachdev-Ye-Kitaev (SYK) model, where the excitations associated to reparametrizations play the role of an emerging `gravity'. I describe here how these two seemingly unrelated systems share common features, arising from a technically very similar origin. This connection is particularly close between glassy dynamics and supersymmetric variants of the SYK model, which I discuss in some detail. Apart from the curiosity that this correspondence naturally arouses, there is also the hope that developments in each field may be useful for the other.


abstract: A generation method of new metric in the case of static spherically symmetric space-time is derived. Using this approach, we construct a metric which describes Euler-Heisenberg black hole surrounded by perfect fluid dark matter and investigate its optical and thermodynamic properties. We found that radius of shadow will increase with the increase of dark matter effect, and more strong dark matter will diminish the light intensity of accretion disk generally. Moreover, in thermodynamics, when quantum electrodynamic parameter is positive, there will be a critical value of dark matter parameter, which determine the number of black hole's critical points.


title: A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligence

abstract: Neurosymbolic artificial intelligence (AI) is an emerging branch of AI that combines the strengths of symbolic AI and sub-symbolic AI. A major drawback of sub-symbolic AI is that it acts as a "black box", meaning that predictions are difficult to explain, making the testing & evaluation (T&E) and validation & verification (V&V) processes of a system that uses sub-symbolic AI a challenge. Since neurosymbolic AI combines the advantages of both symbolic and sub-symbolic AI, this survey explores how neurosymbolic applications can ease the V&V process. This survey considers two taxonomies of neurosymbolic AI, evaluates them, and analyzes which algorithms are commonly used as the symbolic and sub-symbolic components in current applications. Additionally, an overview of current techniques for the T&E and V&V processes of these components is provided. Furthermore, it is investigated how the symbolic part is used for T&E and V&V purposes in current neurosymbolic applications. Our research shows that neurosymbolic AI as great potential to ease the T&E and V&V processes of sub-symbolic AI by leveraging the possibilities of symbolic AI. Additionally, the applicability of current T&E and V&V methods to neurosymbolic AI is assessed, and how different neurosymbolic architectures can impact these methods is explored. It is found that current T&E and V&V techniques are partly sufficient to test, evaluate, verify, or validate the symbolic and sub-symbolic part of neurosymbolic applications independently, while some of them use approaches where current T&E and V&V methods are not applicable by default, and adjustments or even new approaches are needed. Our research shows that there is great potential in using symbolic AI to test, evaluate, verify, or validate the predictions of a sub-symbolic model, making neurosymbolic AI an interesting research direction for safe, secure, and trustworthy AI.