title: Fast and Slow Mixing of the Kawasaki Dynamics on Bounded-Degree Graphs

abstract: We study the worst-case mixing time of the global Kawasaki dynamics for the fixed-magnetization Ising model on the class of graphs of maximum degree $\Delta$. Proving a conjecture of Carlson, Davies, Kolla, and Perkins, we show that below the tree uniqueness threshold, the Kawasaki dynamics mix rapidly for all magnetizations. Disproving a conjecture of Carlson, Davies, Kolla, and Perkins, we show that the regime of fast mixing does not extend throughout the regime of tractability for this model: there is a range of parameters for which there exist efficient sampling algorithms for the fixed-magnetization Ising model on max-degree $\Delta$ graphs, but the Kawasaki dynamics can take exponential time to mix. Our techniques involve showing spectral independence in the fixed-magnetization Ising model and proving a sharp threshold for the existence of multiple metastable states in the Ising model with external field on random regular graphs.


title: Endpoint estimates for commutators with respect to the fractional integral operators on Orlicz-Morrey spaces

abstract: It is known that the necessary and sufficient conditions of the boundedness of commutators on Morrey spaces are given by Di Fazio, Ragusa and Shirai. Moreover, according to the result of Cruz-Uribe and Fiorenza in 2003, it is given that the weak-type boundedness of the commutators of the fractional integral operators on the Orlicz spaces as the endpoint estimates. In this paper, we gave the extention to the weak-type boundedness on the Orlicz-Morrey spaces.


title: A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models

abstract: As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge, providing huge convenience for numerous tasks. Particularly in the era of AI-Generated Content (AIGC), the powerful capacity of retrieval in providing additional knowledge enables RAG to assist existing generative AI in producing high-quality outputs. Recently, Large Language Models (LLMs) have demonstrated revolutionary abilities in language understanding and generation, while still facing inherent limitations, such as hallucinations and out-of-date internal knowledge. Given the powerful abilities of RAG in providing the latest and helpful auxiliary information, Retrieval-Augmented Large Language Models (RA-LLMs) have emerged to harness external and authoritative knowledge bases, rather than solely relying on the model's internal knowledge, to augment the generation quality of LLMs. In this survey, we comprehensively review existing research studies in RA-LLMs, covering three primary technical perspectives: architectures, training strategies, and applications. As the preliminary knowledge, we briefly introduce the foundations and recent advances of LLMs. Then, to illustrate the practical significance of RAG for LLMs, we systematically review mainstream relevant work by their architectures, training strategies, and application areas, detailing specifically the challenges of each and the corresponding capabilities of RA-LLMs. Finally, to deliver deeper insights, we discuss current limitations and several promising directions for future research. Updated information about this survey can be found at https://advanced-recommender-systems.github.io/RAG-Meets-LLMs/


title: Realized Stable BP-N at Ambient Pressure by Phosphorus Doping

abstract: Black phosphorus nitrogen (BP-N) is an attractive high-energy-density material. However, high-pressure synthesized BP-N will decompose at low-pressure and cannot be quenched to ambient conditions. Finding a method to stabilize it at 0 GPa is of great significance for its practical applications. However, unlike cg-N, LP-N, and HLP-N, it is always a metastable phase at high-pressure up to 260 GPa, and decomposes into chains at 23 GPa. Here, based on the first-principles simulations, we find that P atom doping can effectively reduce the synthesis pressure of BP-N and maintain its stability at 0 GPa. Uniform distribution of P atom dopants within the layer helps maintain the structural stability of BP-N layer at 0 GPa, while interlayer electrostatic interaction induced by N-P dipoles enhances its dynamic stability by eliminating interlayer slipping. Furthermore, pressure is conducive to enhancing the stability of BP-N and its doped forms by suppressing N-chain dissociation. For the configuration with 12.5% doping concentration, a gravimetric energy density of 8.07 kJ/g can be realized, which is nearly two times higher than TNT.


title: The jet problem for three-dimensional axially symmetric full compressible subsonic flows with nonzero vorticity

abstract: In this paper, we show that for given Bernoulli function and entropy function at the upstream, if the incoming mass flux is within a suitable range, then there exists a unique outer pressure such that smooth subsonic three-dimensional axially symmetric jet flows for steady full Euler system with nonzero vorticity exist and have certain far fields behavior. A key observation is that we can transform the jet problem for three-dimensional axially symmetric steady full Euler system with nonzero vorticity into a variational problem in terms of the stream function. Moreover, using uniform estimates of the stream function and the iteration method, we exclude the singularity of the jet flows near the symmetry axis.


title: Aerial-NeRF: Adaptive Spatial Partitioning and Sampling for Large-Scale Aerial Rendering

abstract: Recent progress in large-scale scene rendering has yielded Neural Radiance Fields (NeRF)-based models with an impressive ability to synthesize scenes across small objects and indoor scenes. Nevertheless, extending this idea to large-scale aerial rendering poses two critical problems. Firstly, a single NeRF cannot render the entire scene with high-precision for complex large-scale aerial datasets since the sampling range along each view ray is insufficient to cover buildings adequately. Secondly, traditional NeRFs are infeasible to train on one GPU to enable interactive fly-throughs for modeling massive images. Instead, existing methods typically separate the whole scene into multiple regions and train a NeRF on each region, which are unaccustomed to different flight trajectories and difficult to achieve fast rendering. To that end, we propose Aerial-NeRF with three innovative modifications for jointly adapting NeRF in large-scale aerial rendering: (1) Designing an adaptive spatial partitioning and selection method based on drones' poses to adapt different flight trajectories; (2) Using similarity of poses instead of (expert) network for rendering speedup to determine which region a new viewpoint belongs to; (3) Developing an adaptive sampling approach for rendering performance improvement to cover the entire buildings at different heights. Extensive experiments have conducted to verify the effectiveness and efficiency of Aerial-NeRF, and new state-of-the-art results have been achieved on two public large-scale aerial datasets and presented SCUTic dataset. Note that our model allows us to perform rendering over 4 times as fast as compared to multiple competitors. Our dataset, code, and model are publicly available at https://drliuqi.github.io/.


title: Correlation functions and characteristic lengthscales in flat band superconductors

abstract: The possibility of an unconventional form of high temperature superconductivity in flat band (FB) material does not cease to challenge our understanding of the physics in correlated systems. Recently, it has been argued that the coherence length in FB compounds could be decomposed into a conventional part of BCS type and a geometric contribution which characterises the FB eigenstates, the quantum metric. Here, we propose to address this issue in various FB systems and discuss whether the extracted characteristic lengthscales such as the size of the Cooper pairs obey this conjecture. It is found that the relevant lengthscales are less than one lattice spacing, weakly sensitive to the strength of the electron-electron interaction, and more importantly disconnected from the quantum metric.


title: Event-based Structure-from-Orbit

abstract: Event sensors offer high temporal resolution visual sensing, which makes them ideal for perceiving fast visual phenomena without suffering from motion blur. Certain applications in robotics and vision-based navigation require 3D perception of an object undergoing circular or spinning motion in front of a static camera, such as recovering the angular velocity and shape of the object. The setting is equivalent to observing a static object with an orbiting camera. In this paper, we propose event-based structure-from-orbit (eSfO), where the aim is to simultaneously reconstruct the 3D structure of a fast spinning object observed from a static event camera, and recover the equivalent orbital motion of the camera. Our contributions are threefold: since state-of-the-art event feature trackers cannot handle periodic self-occlusion due to the spinning motion, we develop a novel event feature tracker based on spatio-temporal clustering and data association that can better track the helical trajectories of valid features in the event data. The feature tracks are then fed to our novel factor graph-based structure-from-orbit back-end that calculates the orbital motion parameters (e.g., spin rate, relative rotational axis) that minimize the reprojection error. For evaluation, we produce a new event dataset of objects under spinning motion. Comparisons against ground truth indicate the efficacy of eSfO.


title: DARA: Domain- and Relation-aware Adapters Make Parameter-efficient Tuning for Visual Grounding

abstract: Visual grounding (VG) is a challenging task to localize an object in an image based on a textual description. Recent surge in the scale of VG models has substantially improved performance, but also introduced a significant burden on computational costs during fine-tuning. In this paper, we explore applying parameter-efficient transfer learning (PETL) to efficiently transfer the pre-trained vision-language knowledge to VG. Specifically, we propose \textbf{DARA}, a novel PETL method comprising \underline{\textbf{D}}omain-aware \underline{\textbf{A}}dapters (DA Adapters) and \underline{\textbf{R}}elation-aware \underline{\textbf{A}}dapters (RA Adapters) for VG. DA Adapters first transfer intra-modality representations to be more fine-grained for the VG domain. Then RA Adapters share weights to bridge the relation between two modalities, improving spatial reasoning. Empirical results on widely-used benchmarks demonstrate that DARA achieves the best accuracy while saving numerous updated parameters compared to the full fine-tuning and other PETL methods. Notably, with only \textbf{2.13\%} tunable backbone parameters, DARA improves average accuracy by \textbf{0.81\%} across the three benchmarks compared to the baseline model. Our code is available at \url{https://github.com/liuting20/DARA}.


title: Aligning Tutor Discourse Supporting Rigorous Thinking with Tutee Content Mastery for Predicting Math Achievement

abstract: This work investigates how tutoring discourse interacts with students' proximal knowledge to explain and predict students' learning outcomes. Our work is conducted in the context of high-dosage human tutoring where 9th-grade students (N= 1080) attended small group tutorials and individually practiced problems on an Intelligent Tutoring System (ITS). We analyzed whether tutors' talk moves and students' performance on the ITS predicted scores on math learning assessments. We trained Random Forest Classifiers (RFCs) to distinguish high and low assessment scores based on tutor talk moves, student's ITS performance metrics, and their combination. A decision tree was extracted from each RFC to yield an interpretable model. We found AUCs of 0.63 for talk moves, 0.66 for ITS, and 0.77 for their combination, suggesting interactivity among the two feature sources. Specifically, the best decision tree emerged from combining the tutor talk moves that encouraged rigorous thinking and students' ITS mastery. In essence, tutor talk that encouraged mathematical reasoning predicted achievement for students who demonstrated high mastery on the ITS, whereas tutors' revoicing of students' mathematical ideas and contributions was predictive for students with low ITS mastery. Implications for practice are discussed.


title: SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models

abstract: Large language models (LLMs) can now handle longer sequences of tokens, enabling complex tasks like book understanding and generating lengthy novels. However, the key-value (KV) cache required for LLMs consumes substantial memory as context length increasing, becoming the bottleneck for deployment. In this paper, we present a strategy called SKVQ, which stands for sliding-window KV cache quantization, to address the issue of extremely low bitwidth KV cache quantization. To achieve this, SKVQ rearranges the channels of the KV cache in order to improve the similarity of channels in quantization groups, and applies clipped dynamic quantization at the group level. Additionally, SKVQ ensures that the most recent window tokens in the KV cache are preserved with high precision. This helps maintain the accuracy of a small but important portion of the KV cache.SKVQ achieves high compression ratios while maintaining accuracy. Our evaluation on LLMs demonstrates that SKVQ surpasses previous quantization approaches, allowing for quantization of the KV cache to 2-bit keys and 1.5-bit values with minimal loss of accuracy. With SKVQ, it is possible to process context lengths of up to 1M on an 80GB memory GPU for a 7b model and up to 7 times faster decoding.


title: On $\beta$-adic expansions of powers of algebraic integer omitting a digit

abstract: Let $\alpha, \beta$ be two relatively prime algebraic integers in a number field $K$ and $N$ be a positive integer. We show that the number of $n\in\{1,2,\dots,N\}$ such that the $\beta$-adic expansion of $\alpha^n$ omits a given digit is less than $C_1 N^{\sigma(\beta)}$, where $\sigma(\beta):=\frac{\log(|N(\beta)|-1)}{\log|N(\beta)|}$ and $C_1$ is an absolute constant, if all prime ideal factors of $\beta$ are unramified and their norms are integer primes.


title: For the Misgendered Chinese in Gender Bias Research: Multi-Task Learning with Knowledge Distillation for Pinyin Name-Gender Prediction

abstract: Achieving gender equality is a pivotal factor in realizing the UN's Global Goals for Sustainable Development. Gender bias studies work towards this and rely on name-based gender inference tools to assign individual gender labels when gender information is unavailable. However, these tools often inaccurately predict gender for Chinese Pinyin names, leading to potential bias in such studies. With the growing participation of Chinese in international activities, this situation is becoming more severe. Specifically, current tools focus on pronunciation (Pinyin) information, neglecting the fact that the latent connections between Pinyin and Chinese characters (Hanzi) behind convey critical information. As a first effort, we formulate the Pinyin name-gender guessing problem and design a Multi-Task Learning Network assisted by Knowledge Distillation that enables the Pinyin embeddings in the model to possess semantic features of Chinese characters and to learn gender information from Chinese character names. Our open-sourced method surpasses commercial name-gender guessing tools by 9.70\% to 20.08\% relatively, and also outperforms the state-of-the-art algorithms.


title: Imaginarity of quantum channels: Refinement and Alternative

abstract: At present, quantum channels have been widely concerned, and many ways to quantify quantum channels have been proposed, which has led to the generation of many resource theories for quantum channels. We add strong monotonicity and convexity to the requirement of imaginarity measure of quantum channels to make the measure proper. We also introduce an alternative framework to simplify the process of verifying whether a quantifier is a proper measure. We present three imaginarity measures of quantum channels via on the robustness, the trace norm and entropy, respectively. Some properties are also given.


title: McKean-Vlasov SPDEs with H\"older continuous coefficients: existence, uniqueness, ergodicity, exponential mixing and limit theorems

abstract: This paper investigates the existence and uniqueness of solutions, as well as the ergodicity and exponential mixing to invariant measures, and limit theorems for a class of McKean-Vlasov SPDEs characterized by H\"lder continuity. We rigorously establish the existence and uniqueness of strong solutions for a specific class of finite-dimensional systems with H\"older continuous coefficients. Extending these results to the infinite-dimensional counterparts using the Galerkin projection technique. Additionally, we explore the properties of the solutions, including time homogeneity, the Markov and the Feller property. Building upon these properties, we examine the exponential ergodicity and mixing of invariant measures under Lyapunov conditions. Finally, within the framework of coefficients meeting the criteria of H\"lder continuity and Lyapunov conditions, alongside the uniform mixing property of invariant measures, we establish the strong law of large numbers and the central limit theorem for the solution and obtain estimates of corresponding convergence rates.


title: Toward a live homogeneous database of solar active regions based on SOHO/MDI and SDO/HMI synoptic magnetograms.II.parameters for solar cycle variability

abstract: Solar active regions (ARs) determine solar polar fields and cause solar cycle variability within the framework of the Babcock-Leighton (BL) dynamo. The contribution of an AR to the polar field is measured by its dipole field, which results from flux emergence and subsequent flux transport over the solar surface. The dipole fields contributed by an AR before and after the flux transport are referred to as the initial and final dipole fields, respectively. For a better understanding and prediction of solar cycles, in this paper, we provide a database including AR's initial and final dipole fields and the corresponding results of their bipolar magnetic region (BMR) approximation from 1996 onwards. We also identify the repeated ARs and provide the optimized transport parameters. Based on our database, we find that although the commonly used BMR approximation performs well for the initial dipole field, it exhibits a significant deviation for the final dipole field. To accurately assess an AR's contribution to the polar field, the final dipole field with its real configuration should be applied. Despite the notable contributions of a few rogue ARs, approximately the top 500 ARs ordered by their final dipole fields are necessary to derive the polar field at the cycle minimum. While flux transport may increase or decrease the dipole field for an individual AR, its collective impact over all ARs in a cycle is a reduction in their total dipole field.


title: Automating TODO-missed Methods Detection and Patching

abstract: TODO comments are widely used by developers to remind themselves or others about incomplete tasks. In other words, TODO comments are usually associated with temporary or suboptimal solutions. In practice, all the equivalent suboptimal implementations should be updated (e.g., adding TODOs) simultaneously. However, due to various reasons (e.g., time constraints or carelessness), developers may forget or even are unaware of adding TODO comments to all necessary places, which results in the TODO-missed methods. These "hidden" suboptimal implementations in TODO-missed methods may hurt the software quality and maintainability in the long-term. Therefore, in this paper, we propose the novel task of TODO-missed methods detection and patching, and develop a novel model, namely TDPatcher (TODO-comment Patcher), to automatically patch TODO comments to the TODO-missed methods in software projects. Our model has two main stages: offline learning and online inference. During the offline learning stage, TDPatcher employs GraphCodeBERT and contrastive learning for encoding the TODO comment (natural language) and its suboptimal implementation (code fragment) into vector representations. For the online inference stage, we can identify the TODO-missed methods and further determine their patching position by leveraging the offline trained model. We built our dataset by collecting TODO-introduced methods from the top-10,000 Python GitHub repositories and evaluated TDPatcher on them. Extensive experimental results show the promising performance of our model over a set of benchmarks. We further conduct an in-the-wild evaluation which successfully detects 26 \textit{\major{TODO-missed} methods} from 50 GitHub repositories.


title: Minimal Dark Matter Freeze-in with Low Reheating Temperatures and Implications for Direct Detection

abstract: We investigate the influence of the reheating temperature of the visible sector on the freeze-in dark matter (DM) benchmark model for direct detection experiments, where DM production is mediated by an ultralight dark photon. Here we consider a new regime for this benchmark: we take the initial temperature of the thermal Standard Model (SM) bath to be below the DM mass. The production rate from the SM bath is drastically reduced due to Boltzmann suppression, necessitating a significant increase in the portal coupling between DM and the SM to match the observed relic DM abundance. This enhancement in coupling strength increases the predicted DM-electron scattering cross section, making freeze-in DM more accessible to current direct detection experiments.


title: MaskMatch: Boosting Semi-Supervised Learning Through Mask Autoencoder-Driven Feature Learning

abstract: Conventional methods in semi-supervised learning (SSL) often face challenges related to limited data utilization, mainly due to their reliance on threshold-based techniques for selecting high-confidence unlabeled data during training. Various efforts (e.g., FreeMatch) have been made to enhance data utilization by tweaking the thresholds, yet none have managed to use 100% of the available data. To overcome this limitation and improve SSL performance, we introduce \algo, a novel algorithm that fully utilizes unlabeled data to boost semi-supervised learning. \algo integrates a self-supervised learning strategy, i.e., Masked Autoencoder (MAE), that uses all available data to enforce the visual representation learning. This enables the SSL algorithm to leverage all available data, including samples typically filtered out by traditional methods. In addition, we propose a synthetic data training approach to further increase data utilization and improve generalization. These innovations lead \algo to achieve state-of-the-art results on challenging datasets. For instance, on CIFAR-100 with 2 labels per class, STL-10 with 4 labels per class, and Euro-SAT with 2 labels per class, \algo achieves low error rates of 18.71%, 9.47%, and 3.07%, respectively. The code will be made publicly available.


title: Context-Guided Spatial Feature Reconstruction for Efficient Semantic Segmentation

abstract: Semantic segmentation is an important task for many applications but it is still quite challenging to achieve advanced performance with limited computational costs. In this paper, we present CGRSeg, an efficient yet competitive segmentation framework based on context-guided spatial feature reconstruction. A Rectangular Self-Calibration Module is carefully designed for spatial feature reconstruction and pyramid context extraction. It captures the global context in both horizontal and vertical directions and gets the axial global context to explicitly model rectangular key areas. A shape self-calibration function is designed to make the key areas more close to the foreground object. Besides, a lightweight Dynamic Prototype Guided head is proposed to improve the classification of foreground objects by explicit class embedding. Our CGRSeg is extensively evaluated on ADE20K, COCO-Stuff, and Pascal Context benchmarks, and achieves state-of-the-art semantic performance. Specifically, it achieves $43.6\%$ mIoU on ADE20K with only $4.0$ GFLOPs, which is $0.9\%$ and $2.5\%$ mIoU better than SeaFormer and SegNeXt but with about $38.0\%$ fewer GFLOPs. Code is available at https://github.com/nizhenliang/CGRSeg.


title: A generalized Bondal-Orlov full faithfulness criterion for Deligne-Mumford stacks

abstract: Let $X$, $Y$ be smooth projective varieties over $\mathbf{C}$. Let $K$ be a bounded complex of coherent sheaves on $X\times Y$ and let $\Phi_K \colon \mathsf{D}^b_{\mathsf{Coh}}(X) \to \mathsf{D}^b_{\mathsf{Coh}}(Y)$ be the resulting Fourier-Mukai functor. There is a well-known criterion due to Bondal-Orlov for $\Phi_K$ to be fully faithful. This criterion was recently extended to smooth Deligne-Mumford stacks with projective coarse moduli schemes by Lim-Polischuk. We extend this to all smooth, proper Deligne-Mumford stacks over arbitrary fields of characteristic $0$. Along the way, we establish a number of foundational results for bounded derived categories of proper and tame morphisms of noetherian algebraic stacks (e.g., coherent duality).


title: Fire in SRRN: Next-Gen 3D Temperature Field Reconstruction Technology

abstract: In aerospace and energy engineering, accurate 3D combustion field temperature measurement is critical. The resolution of traditional methods based on algebraic iteration is limited by the initial voxel division. This study introduces a novel method for reconstructing three-dimensional temperature fields using the Spatial Radiation Representation Network (SRRN). This method utilizes the flame thermal radiation characteristics and differentiable rendering in graphics, and combines it with a multi-layer perceptron to achieve a functional representation of the flame temperature field. The effectiveness of SRRN is evaluated through simulated temperature field reconstruction experiments with different levels of complexity. The maximum root mean square error is 10.17, which proves the robustness of the algorithm to Gaussian noise and salt-and-pepper noise. We conducted a butane flame temperature field reconstruction experiment, and the maximum relative error between the reconstruction result and the thermocouple measurement value was 4.86%, confirming that the algorithm can achieve accurate reconstruction.


title: Entanglement sharing across a damping-dephasing channel

abstract: Entanglement distillation is a fundamental information processing task whose implementation is key to quantum communication and modular quantum computing. Noise experienced by such communication and computing platforms occurs not only in the form of Pauli noise such as dephasing (sometimes called $T_2$) but also non-Pauli noise such as amplitude damping (sometimes called $T_1$). We initiate a study of practical and asymptotic distillation over what we call the joint damping-dephasing noise channel. In the practical setting, we propose a distillation scheme that completely isolates away the damping noise. In the asymptotic setting we derive lower bounds on the entanglement sharing capacities including the coherent and reverse coherent information. Like the protocol achieving the reverse coherent information, our scheme uses only backward classical communication. However, for realistic damping noise ($T_1 \neq 2T_2$) our strategy can exceed the reverse coherent strategy, which is the best known for pure damping. In the forward communication setting we numerically exceed the single-letter coherent information strategy by observing the channel displays non-additivity at the two-letter level. The work shows non-additivity can also be found in realistic noise models with magnitudes of non-additivity similar to those found in more idealized noise channels.


title: Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Process

abstract: Geometry Problem Solving (GPS), which is a classic and challenging math problem, has attracted much attention in recent years. It requires a solver to comprehensively understand both text and diagram, master essential geometry knowledge, and appropriately apply it in reasoning. However, existing works follow a paradigm of neural machine translation and only focus on enhancing the capability of encoders, which neglects the essential characteristics of human geometry reasoning. In this paper, inspired by dual-process theory, we propose a Dual-Reasoning Geometry Solver (DualGeoSolver) to simulate the dual-reasoning process of humans for GPS. Specifically, we construct two systems in DualGeoSolver, namely Knowledge System and Inference System. Knowledge System controls an implicit reasoning process, which is responsible for providing diagram information and geometry knowledge according to a step-wise reasoning goal generated by Inference System. Inference System conducts an explicit reasoning process, which specifies the goal in each reasoning step and applies the knowledge to generate program tokens for resolving it. The two systems carry out the above process iteratively, which behaves more in line with human cognition. We conduct extensive experiments on two benchmark datasets, GeoQA and GeoQA+. The results demonstrate the superiority of DualGeoSolver in both solving accuracy and robustness from explicitly modeling human reasoning process and knowledge application.


title: The Fearless Journey [Draft]

abstract: Existing minimal Object-Oriented models (OO), like Featherweight Java (FJ), are valuable for modelling programs and designing new programming languages and tools. However, their utility in developing real-world programs is limited. We introduce the 'Fearless Heart', a novel object calculus preserving FJ's minimal and extensible nature while being more suited for constructing complex, real-world applications. To illustrate the extensibility of the Fearless Heart, we extend it with Reference Capabilities (RC), creating R-Fearless. It supports mutability and other side effects while retaining the reasoning advantages of functional programming and gaining support for features that are well-known to be enabled by RC, like automatic parallelism, caching and invariants. R-Fearless is still minimal enough to allow further extensions. It is an ideal foundation for constructing both practical systems and formal models.


title: TS3IM: Unveiling Structural Similarity in Time Series through Image Similarity Assessment Insights

abstract: In the realm of time series analysis, accurately measuring similarity is crucial for applications such as forecasting, anomaly detection, and clustering. However, existing metrics often fail to capture the complex, multidimensional nature of time series data, limiting their effectiveness and application. This paper introduces the Structured Similarity Index Measure for Time Series (TS3IM), a novel approach inspired by the success of the Structural Similarity Index Measure (SSIM) in image analysis, tailored to address these limitations by assessing structural similarity in time series. TS3IM evaluates multiple dimensions of similarity-trend, variability, and structural integrity-offering a more nuanced and comprehensive measure. This metric represents a significant leap forward, providing a robust tool for analyzing temporal data and offering more accurate and comprehensive sequence analysis and decision support in fields such as monitoring power consumption, analyzing traffic flow, and adversarial recognition. Our extensive experimental results also show that compared with traditional methods that rely heavily on computational correlation, TS3IM is 1.87 times more similar to Dynamic Time Warping (DTW) in evaluation results and improves by more than 50% in adversarial recognition.


title: A Two-layer Stochastic Game Approach to Reinsurance Contracting and Competition

abstract: We introduce a two-layer stochastic game model to study reinsurance contracting and competition in a market with one insurer and two competing reinsurers. The insurer negotiates with both reinsurers simultaneously for proportional reinsurance contracts that are priced using the variance premium principle; the reinsurance contracting between the insurer and each reinsurer is modeled as a Stackelberg game. The two reinsurers compete for business from the insurer and optimize the so-called relative performance, instead of their own surplus; the competition game between the two reinsurers is settled by a non-cooperative Nash game. We obtain a sufficient and necessary condition, related to the competition degrees of the two reinsurers, for the existence of an equilibrium. We show that the equilibrium, if exists, is unique, and the equilibrium strategy of each player is constant, fully characterized in semi-closed form. Additionally, we obtain interesting sensitivity results for the equilibrium strategies through both an analytical and numerical study.


title: Fixed Node Determination and Analysis in Directed Acyclic Graphs of Structured Networks

abstract: This paper explores the conditions for determining fixed nodes in structured networks, specifically focusing on directed acyclic graphs (DAGs). We introduce several necessary and sufficient conditions for determining fixed nodes in $p$-layered DAGs. This is accomplished by defining the problem of maximum disjoint stems, based on the observation that all DAGs can be represented as hierarchical structures with a unique label for each layer. For structured networks, we discuss the importance of fixed nodes by considering their controllability against the variations of network parameters. Moreover, we present an efficient algorithm that simultaneously performs labeling and fixed node search for $p$-layered DAGs with an analysis of its time complexity. The results presented in this paper have implications for the analysis of controllability at the individual node level in structured networks.


title: Risks of Practicing Large Language Models in Smart Grid: Threat Modeling and Validation

abstract: Large Language Model (LLM) is a significant breakthrough in artificial intelligence (AI) and holds considerable potential for application within smart grids. However, as demonstrated in previous literature, AI technologies are susceptible to various types of attacks. It is crucial to investigate and evaluate the risks associated with LLMs before deploying them in critical infrastructure like smart grids. In this paper, we systematically evaluate the vulnerabilities of LLMs and identify two major types of attacks relevant to smart grid LLM applications, along with presenting the corresponding threat models. We then validate these attacks using popular LLMs, utilizing real smart grid data. Our validation demonstrates that attackers are capable of injecting bad data and retrieving domain knowledge from LLMs employed in smart grid scenarios.


title: A Novel Pseudo Nearest Neighbor Classification Method Using Local Harmonic Mean Distance

abstract: In the realm of machine learning, the KNN classification algorithm is widely recognized for its simplicity and efficiency. However, its sensitivity to the K value poses challenges, especially with small sample sizes or outliers, impacting classification performance. This article introduces a novel KNN-based classifier called LMPHNN (Novel Pseudo Nearest Neighbor Classification Method Using Local Harmonic Mean Distance). LMPHNN leverages harmonic mean distance (HMD) to improve classification performance based on LMPNN rules and HMD. The classifier begins by identifying k nearest neighbors for each class and generates distinct local vectors as prototypes. Pseudo nearest neighbors (PNNs) are then created based on the local mean for each class, determined by comparing the HMD of the sample with the initial k group. Classification is determined by calculating the Euclidean distance between the query sample and PNNs, based on the local mean of these categories. Extensive experiments on various real UCI datasets and combined datasets compare LMPHNN with seven KNN-based classifiers, using precision, recall, accuracy, and F1 as evaluation metrics. LMPHNN achieves an average precision of 97%, surpassing other methods by 14%. The average recall improves by 12%, with an average accuracy enhancement of 5%. Additionally, LMPHNN demonstrates a 13% higher average F1 value compared to other methods. In summary, LMPHNN outperforms other classifiers, showcasing lower sensitivity with small sample sizes.


title: SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corpora

abstract: In this paper, we introduce SaudiBERT, a monodialect Arabic language model pretrained exclusively on Saudi dialectal text. To demonstrate the model's effectiveness, we compared SaudiBERT with six different multidialect Arabic language models across 11 evaluation datasets, which are divided into two groups: sentiment analysis and text classification. SaudiBERT achieved average F1-scores of 86.15\% and 87.86\% in these groups respectively, significantly outperforming all other comparative models. Additionally, we present two novel Saudi dialectal corpora: the Saudi Tweets Mega Corpus (STMC), which contains over 141 million tweets in Saudi dialect, and the Saudi Forums Corpus (SFC), which includes 15.2 GB of text collected from five Saudi online forums. Both corpora are used in pretraining the proposed model, and they are the largest Saudi dialectal corpora ever reported in the literature. The results confirm the effectiveness of SaudiBERT in understanding and analyzing Arabic text expressed in Saudi dialect, achieving state-of-the-art results in most tasks and surpassing other language models included in the study. SaudiBERT model is publicly available on \url{https://huggingface.co/faisalq/SaudiBERT}.


title: Non-Bloch band theory of sub-symmetry-protected topological phases

abstract: Bulk-boundary correspondence (BBC) of symmetry-protected topological (SPT) phases relates the non-trivial topological invariant of the bulk to the number of topologically protected boundary states. Recently, a finer classification of SPT phases has been discovered, known as sub-symmetry- protected topological (sub-SPT) phases. In sub- SPT phases, a fraction of the boundary states is protected by the sub-symmetry of the system, even when the full symmetry is broken. While the conventional topological invariant derived from the Bloch band is not applicable to describe the BBC in these systems, we propose to use the non-Bloch topological band theory to describe the BBC of sub-SPT phases. Using the concept of the generalized Brillouin zone (GBZ), where Bloch momenta are generalized to take complex values, we show that the non-Bloch band theory naturally gives rise to a non-Bloch topological invariant, establishing the BBC in both SPT and sub-SPT phases. In a one-dimensional system, we define the winding number, whose physical meaning corresponds to the reflection amplitude in the scattering matrix. Furthermore, the non-Bloch topological invariant characterizes the hidden intrinsic topology of the GBZ under translation symmetry-breaking boundary conditions. The topological phase transitions are characterized by the generalized momenta touching the GBZ, which accompanies the emergence of diabolic or band-touching points. Additionally, we discuss the BBCs in the presence of local or global full-symmetry or sub-symmetry-breaking deformations.


title: MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization

abstract: This letter introduces a novel framework for dense Visual Simultaneous Localization and Mapping (VSLAM) based on Gaussian Splatting. Recently Gaussian Splatting-based SLAM has yielded promising results, but rely on RGB-D input and is weak in tracking. To address these limitations, we uniquely integrates advanced sparse visual odometry with a dense Gaussian Splatting scene representation for the first time, thereby eliminating the dependency on depth maps typical of Gaussian Splatting-based SLAM systems and enhancing tracking robustness. Here, the sparse visual odometry tracks camera poses in RGB stream, while Gaussian Splatting handles map reconstruction. These components are interconnected through a Multi-View Stereo (MVS) depth estimation network. And we propose a depth smooth loss to reduce the negative effect of estimated depth maps. Furthermore, the consistency in scale between the sparse visual odometry and the dense Gaussian map is preserved by Sparse-Dense Adjustment Ring (SDAR). We have evaluated our system across various synthetic and real-world datasets. The accuracy of our pose estimation surpasses existing methods and achieves state-of-the-art performance. Additionally, it outperforms previous monocular methods in terms of novel view synthesis fidelity, matching the results of neural SLAM systems that utilize RGB-D input.


title: Impedance vs. Power Side-channel Vulnerabilities: A Comparative Study

abstract: In recent times, impedance side-channel analysis has emerged as a potent strategy for adversaries seeking to extract sensitive information from computing systems. It leverages variations in the intrinsic impedance of a chip's internal structure across different logic states. In this study, we conduct a comparative analysis between the newly explored impedance side channel and the well-established power side channel. Through experimental evaluation, we investigate the efficacy of these two side channels in extracting the cryptographic key from the Advanced Encryption Standard (AES) and analyze their performance. Our results indicate that impedance analysis demonstrates a higher potential for cryptographic key extraction compared to power side-channel analysis. Moreover, we identify scenarios where power side-channel analysis does not yield satisfactory results, whereas impedance analysis proves to be more robust and effective. This work not only underscores the significance of impedance side-channel analysis in enhancing cryptographic security but also emphasizes the necessity for a deeper understanding of its mechanisms and implications.


title: Ultrafast Anisotropic Polarization Dynamics of Electronic Ferroelectrics LuFe2O4

abstract: Femtosecond time-resolved second harmonic generation (SHG) measurements were performed at room temperature on a single crystal of LuFe2O4, which has recently attracted attention as an electronic ferroelectric material in which polarization occurs due to the real-space arrangement of Fe2+ and Fe3+. We irradiated the crystal with 800 nm laser pulses, traced the subsequent SHG changes, and observed anisotropic polarization dynamics: immediately after photoexcitation, the in-plane (ab-plane) component of the SHG greatly reduced, while the inter-plane (c-axis) SHG increased. This means that a hidden photoexcited state, in which the in-plane charge ordering is broken but the polarization along c-axis direction enhanced, has been created by photoexcitation, indicating that the electronic ferroelectricity can be controlled on a femtosecond scale.


title: A $(\frac32+\frac1{\mathrm{e}})$-Approximation Algorithm for Ordered TSP

abstract: We present a new $(\frac32+\frac1{\mathrm{e}})$-approximation algorithm for the Ordered Traveling Salesperson Problem (Ordered TSP). Ordered TSP is a variant of the classical metric Traveling Salesperson Problem (TSP) where a specified subset of vertices needs to appear on the output Hamiltonian cycle in a given order, and the task is to compute a cheapest such cycle. Our approximation guarantee of approximately $1.868$ holds with respect to the value of a natural new linear programming (LP) relaxation for Ordered TSP. Our result significantly improves upon the previously best known guarantee of $\frac52$ for this problem and thereby considerably reduces the gap between approximability of Ordered TSP and metric TSP. Our algorithm is based on a decomposition of the LP solution into weighted trees that serve as building blocks in our tour construction.


title: New observational recipes for measuring dynamical state of galaxy clusters

abstract: During cluster assembly, a cluster's virialization process leaves behind signatures that can provide information on its dynamical state. However, no clear consensus yet exists on the best way to achieve this. Therefore, we attempt to derive improved recipes for classifying the dynamical state of clusters in observations using cosmological simulations. Cluster halo mass and their subhalos' mass are used to $ 10^{14}M_{\odot} h^{-1}$ and $10^{10}M_{\odot} h^{-1}$ to calculate five independent dynamical state indicators. We experiment with recipes by combining two to four indicators for detecting specific merger stages like recent and ancient mergers. These recipes are made by plotting merging clusters and a control sample of relaxed clusters in multiple indicators parameter space, and then applying a rotation matrix method to derive the best way to separate mergers from the control sample. The success of the recipe is quantified using the success rate and the overlap percentage of the merger and control histograms along the newly rotated $x$-axis. This provides us with recipes using different numbers of combined indicators and for different merger stage. Among the recipes, the stellar mass gap and center offset are the first and second most dominant of the indicators, and using more indicators improves the effectiveness of the recipe. When applied to observations, our results show good agreement with literature values of cluster dynamical state.


title: Comparative Analysis of Advanced Feature Matching Algorithms in Challenging High Spatial Resolution Optical Satellite Stereo Scenarios

abstract: Feature matching determines the orientation accuracy for the High Spatial Resolution (HSR) optical satellite stereos, subsequently impacting several significant applications such as 3D reconstruction and change detection. However, the matching of off-track HSR optical satellite stereos often encounters challenging conditions including wide-baseline observation, significant radiometric differences, multi-temporal changes, varying spatial resolutions, inconsistent spectral resolution, and diverse sensors. In this study, we evaluate various advanced feature matching algorithms for HSR optical satellite stereos. Utilizing a specially constructed dataset from five satellites across six challenging scenarios, HSROSS Dataset, we conduct a comparative analysis of four algorithms: the traditional SIFT, and deep-learning based methods including SuperPoint + SuperGlue, SuperPoint + LightGlue, and LoFTR. Our findings highlight overall superior performance of SuperPoint + LightGlue in balancing robustness, accuracy, distribution, and efficiency, showcasing its potential in complex HSR optical satellite scenarios.


title: Disttack: Graph Adversarial Attacks Toward Distributed GNN Training

abstract: Graph Neural Networks (GNNs) have emerged as potent models for graph learning. Distributing the training process across multiple computing nodes is the most promising solution to address the challenges of ever-growing real-world graphs. However, current adversarial attack methods on GNNs neglect the characteristics and applications of the distributed scenario, leading to suboptimal performance and inefficiency in attacking distributed GNN training. In this study, we introduce Disttack, the first framework of adversarial attacks for distributed GNN training that leverages the characteristics of frequent gradient updates in a distributed system. Specifically, Disttack corrupts distributed GNN training by injecting adversarial attacks into one single computing node. The attacked subgraphs are precisely perturbed to induce an abnormal gradient ascent in backpropagation, disrupting gradient synchronization between computing nodes and thus leading to a significant performance decline of the trained GNN. We evaluate Disttack on four large real-world graphs by attacking five widely adopted GNNs. Compared with the state-of-the-art attack method, experimental results demonstrate that Disttack amplifies the model accuracy degradation by 2.75$\times$ and achieves speedup by 17.33$\times$ on average while maintaining unnoticeability.


title: Adversarial neural network methods for topology optimization of eigenvalue problems

abstract: This research presents a novel method using an adversarial neural network to solve the eigenvalue topology optimization problems. The study focuses on optimizing the first eigenvalues of second-order elliptic and fourth-order biharmonic operators subject to geometry constraints. These models are usually solved with topology optimization algorithms based on sensitivity analysis, in which it is expensive to repeatedly solve the nonlinear constrained eigenvalue problem with traditional numerical methods such as finite elements or finite differences. In contrast, our method leverages automatic differentiation within the deep learning framework. Furthermore, the adversarial neural networks enable different neural networks to train independently, which improves the training efficiency and achieve satisfactory optimization results. Numerical results are presented to verify effectiveness of the algorithms for maximizing and minimizing the first eigenvalues.


title: Designing a polymerized phenalenyl tessellation molecule to realize a super-honeycomb antiferromagnetic S = 3/2 spin system

abstract: In a multiply hydrogenated polymer of phenalenyl tessellation molecules (PTMs) where spatially overlapping zero modes appear, three parallelly spin-aligned electron spins per PTM are generated by the direct exchange interaction of the strongly correlated electron system, which we used to facilitate the molecular design of a two-dimensional (2D) S = 3/2 Heisenberg spin system on a honeycomb lattice. Density functional theory with the Wannierization method simulations of the electronic structure suggested that an array of nonbonding molecular orbitals (an array of zero modes) appears in the hydrogenated nanographene structure. Our evaluation of the onsite interaction strength indicated that each zero mode becomes half-filled with a spin-active electron by the electron correlation effect. The low-energy subspace of the obtained zero mode-tight-binding model implies the appearance of a 2D antiferromagnetic S = 3/2 Heisenberg system with the entangled quantum spin ground state.


title: Robust field-free switching using large unconventional spin-orbit torque in an all-van der Waals heterostructure

abstract: The emerging all-van der Waals (vdW) magnetic heterostructure provides a new platform to control the magnetization by the electric field beyond the traditional spintronics devices. One promising strategy is using unconventional spin-orbit torque (SOT) exerted by the out-of-plane polarized spin current to enable deterministic magnetization switching and enhance the switching efficiency. However, in all-vdW heterostructures, large unconventional SOT remains elusive and the robustness of the field-free switching against external magnetic field hasn't been examined, which hinder further applications. Here we demonstrate the field-free switching in an all-vdW heterostructure combining a type-II Weyl semimetal TaIrTe4 and above-room-temperature ferromagnet Fe3GaTe2. The fully field-free switching can be achieved at 2.56 x 10^10 A per m2 at 300K and a large SOT efficiency of the out-of-plane polarized spin current generated by TaIrTe4 is determined to be 0.37. Moreover, we find that the switching polarity cannot be changed until the external in-plane magnetic field reaches 252mT, indicating a robust switching against the magnetic field. The numerical simulation suggests the large unconventional SOT reduces the switching current density and enhances the robustness of the switching. Our work shows that all-vdW heterostructures are promising candidates for future highly efficient and stable SOT-based devices.


title: Randomness and Retention: Using Weak Mean Motion Resonances to Constrain Neptune's Late-Stage Migration

abstract: Planet-planetesimal interactions cause a planet to migrate, manifesting as a random walk in semi-major axis. In models for Neptune's migration involving a gravitational upheaval, this planetesimal-driven migration is a side-effect of the dynamical friction required to damp Neptune's orbital eccentricitiy. This migration is noisy, potentially causing Trans Neptunian Objects (TNOs) in mean motion resonance to be lost. With Nbody simulations, we validate a previously-derived analytic model for resonance retention and determine unknown coefficients. We identify the impact of random-walk (noisy) migration on resonance retention for resonances up to fourth order lying between 39 au and 75 au. Using a population estimate for the weak 7:3 resonance from the well-characterized Outer Solar System Origins Survey (OSSOS), we rule out two cases: (1) a planetesimal disk distributed between 13.3 and 39.9 au with $\gtrsim$ 30 Earth masses in today's size distribution and $T_{\rm mig} \gtrsim$ 40Myr and (2) a top-heavy size distribution with $\gtrsim$ 2000 Pluto-sized TNOs and $T_{\rm mig} \gtrsim$ 10Myr, where $T_{\rm mig}$ is Neptune's migration timescale. We find that low-eccentricity TNOs in the heavily populated 5:2 resonance are easily lost due to noisy migration. Improved observations of the low-eccentricity region of the 5:2 resonance and of weak mean motion resonances with Rubin Observatory's Legacy Survey of Space and Time (LSST) will provide better population estimates, allowing for comparison with our model's retention fractions and providing strong evidence for or against Neptune's random interactions with planetesimals.


title: Estimating Speech Duration by Measuring the Abdominal Movement Using a Barometric Sensor

abstract: Measuring the amount of speech production in daily life is important for understanding communication in organizations and identifying mental disorders. However, measuring the amount of speech production can be problematic in terms of privacy. We observed the whole body condition during speech and noted that the abdomen strains during speech production.Therefore, we developed a less uncomfortable, inflatable abdominal motion measurement device using a barometric sensor to measure speech production indirectly. We measured speech production in 10 subjects and created a speech discrimination model using machine learning. However, the estimated speech duration in an actual meeting using this model was much longer than the actual duration. We found that the wearer's posture significantly affects the accuracy of the speech discrimination model developed in this study. We plan to improve the abdominal motion measurement device to minimize the effect of posture and achieve more accurate speech production measurement.


title: On Characterizations of Potential and Ordinal Potential Games

abstract: This paper investigates some necessary and sufficient conditions for a game to be a potential game. At first, we extend the classical results of Slade and Monderer and Shapley from games with one-dimensional action spaces to games with multi-dimensional action spaces, which require differentiable cost functions. Then, we provide a necessary and sufficient conditions for a game to have a potential function by investigating the structure of a potential function in terms of the players' cost differences, as opposed to differentials. This condition provides a systematic way for construction of a potential function, which is applied to network congestion games, as an example. Finally, we provide some sufficient conditions for a game to be ordinal potential and generalized ordinal potential.


title: Hecke algebras for tame genuine principal series and local Shimura correspondence

abstract: In this paper, we extend the local Shimura correspondence building upon the groundwork laid by Gordan Savin. As preparations, we review part of the type theory of Bushnell and Kutzko which equally applies to covering groups. By adapting the method of linear algebraic groups, we describe the structure of Hecke algebras associated with genuine principal series components and construct the types. In particular, we show each of them shares the same affine Hecke algebra part as one corresponding Hecke algebra of the principal endoscopy group. However, we give a counter example to show they are not isomorphic in general.


title: Sharing Asymmetric Einstein-Podolsky-Rosen Steering with Projective Measurements

abstract: Recently, both global and local classical randomness-assisted projective measurement protocols have been employed to share Bell nonlocality of an entangled state among multiple sequential parties. Unlike Bell nonlocality, Einstein-Podolsky-Rosen (EPR) steering exhibits distinct asymmetric characteristics and serves as the necessary quantum resource for one-sided device-independent quantum information tasks. In this work, we propose a projective measurement protocol and investigate the shareability of EPR steering with steering radius criterion theoretically and experimentally. Our results reveal that arbitrarily many independent parties can share one-way steerability using projective measurements, even when no shared randomness is available. Furthermore, by leveraging only local randomness, asymmetric two-way steerability can also be shared. Our work not only deepens the understanding of the role of projective measurements in sharing quantum correlations but also opens up a new avenue for reutilizing asymmetric quantum correlations.


title: Reconstructing generalised parton distributions from the lattice off-forward Compton amplitude

abstract: We present a determination of the structure functions of the off-forward Compton amplitude $\mathcal{H}_1$ and $\mathcal{E}_1$ from the Feynman-Hellmann method in lattice QCD. At leading twist, these structure functions give access to the generalised parton distributions (GPDs) $H$ and $E$, respectively. This calculation is performed for an unphysical pion mass of $m_{\pi}=412\;\text{MeV}$ and four values of the soft momentum transfer, $t\approx 0, -0.3, -0.6, -1.1\;\text{GeV}^2$, all at a hard momentum scale of $\bar{Q}^2\approx 5\;\text{GeV}^2$. Using these results, we test various methods to determine properties of the real-time scattering amplitudes and GPDs: (1) we fit their Mellin moments, and (2) we use a simple GPD ansatz to reconstruct the entire distribution. Our final results show promising agreement with phenomenology and other lattice results, and highlight specific systematics in need of control.


title: Measurement of cesium $8P_{J}\rightarrow 6P_{J'}$ electric quadrupole transition probabilities using fluorescence spectroscopy

abstract: Fluorescence spectra of the $8P_{J} \rightarrow 6P_{J'}$ ($J$ and $J'$ = 3/2, 1/2) electric quadrupole transition of cesium atoms have been observed with a heated cesium vapor cell. We determined the ratio of the transition probabilities of $8P_{J}\rightarrow6P_{J'}$ to $8P_{J}\rightarrow5D_{3/2}$ by comparing their respective photon emission rates. The results are in good agreement with our theoretical calculations. These measurements provide crucial parameters for tests of coherent amplification method and improve knowledge of cesium properties which are essential to dark matter detection through atomic transitions.


title: Automatic Generation of Model and Data Cards: A Step Towards Responsible AI

abstract: In an era of model and data proliferation in machine learning/AI especially marked by the rapid advancement of open-sourced technologies, there arises a critical need for standardized consistent documentation. Our work addresses the information incompleteness in current human-generated model and data cards. We propose an automated generation approach using Large Language Models (LLMs). Our key contributions include the establishment of CardBench, a comprehensive dataset aggregated from over 4.8k model cards and 1.4k data cards, coupled with the development of the CardGen pipeline comprising a two-step retrieval process. Our approach exhibits enhanced completeness, objectivity, and faithfulness in generated model and data cards, a significant step in responsible AI documentation practices ensuring better accountability and traceability.


title: A novel gas sensing principle based on quantum fluctuations

abstract: We present a model of a novel measurement scheme to detect small amounts of a gas species via the ground-state fluctuations of the electromagnetic field (dispersion forces) depending on the entire spectral properties of all objects. Here, we describe an experimental setup of optically trapped nanoparticles in a hollow-core fibre. We calculate the effects of the gases on the thermal motion of the nanoparticles and present a neural network-based method for reconstructing the gas concentrations. We present an example of one possible setup capable of detecting concentrations of CO2 down to 0.01 volume per cent with an accuracy of 1 ppm. Reliable detection of small concentrations of specific molecules in a gas is essential for numerous applications such as security and environmental monitoring, medical tests, and production processes. Unlike other measurement schemes, such as surface plasmons or functionalised surfaces, this allows for fast, continuous monitoring and using small sample quantities, without influencing the probe or the sensor system.


title: Precise Apple Detection and Localization in Orchards using YOLOv5 for Robotic Harvesting Systems

abstract: The advancement of agricultural robotics holds immense promise for transforming fruit harvesting practices, particularly within the apple industry. The accurate detection and localization of fruits are pivotal for the successful implementation of robotic harvesting systems. In this paper, we propose a novel approach to apple detection and position estimation utilizing an object detection model, YOLOv5. Our primary objective is to develop a robust system capable of identifying apples in complex orchard environments and providing precise location information. To achieve this, we curated an autonomously labeled dataset comprising diverse apple tree images, which was utilized for both training and evaluation purposes. Through rigorous experimentation, we compared the performance of our YOLOv5-based system with other popular object detection models, including SSD. Our results demonstrate that the YOLOv5 model outperforms its counterparts, achieving an impressive apple detection accuracy of approximately 85%. We believe that our proposed system's accurate apple detection and position estimation capabilities represent a significant advancement in agricultural robotics, laying the groundwork for more efficient and sustainable fruit harvesting practices.


title: Improving the Privacy Loss Under User-Level DP Composition for Fixed Estimation Error

abstract: This paper considers the private release of statistics of several disjoint subsets of a datasets, under user-level $\epsilon$-differential privacy (DP). In particular, we consider the user-level differentially private release of sample means and variances of speed values in several grids in a city, in a potentially sequential manner. Traditional analysis of the privacy loss due to the sequential composition of queries necessitates a privacy loss degradation by a factor that equals the total number of grids. Our main contribution is an iterative, instance-dependent algorithm, based on clipping the number of user contributions, which seeks to reduce the overall privacy loss degradation under a canonical Laplace mechanism, while not increasing the {worst} estimation error among the different grids. We test the performance of our algorithm on synthetic datasets and demonstrate improvements in the privacy loss degradation factor via our algorithm. We also demonstrate improvements in the worst-case error using a simple extension of a pseudo-user creation-based mechanism. An important component of this analysis is our exact characterization of the sensitivities and the worst-case estimation errors of sample means and variances incurred by clipping user contributions in an arbitrary fashion, which we believe is of independent interest.


title: Creating cyclo-N$_5$$^{+}$ cation and assembling N$_5$$^{+}$N$_5$$^{-}$ salt via electronegativity co-matching in tailored ionic compounds

abstract: The recent discovery of crystalline pentazolates marks a major advance in polynitrogen science and raises prospects of making the long-touted potent propellant N$_5$$^{+}$N$_5$$^{-}$ salt. However, despite the synthesis of cyclo-N$_5$$^{-}$ anion in pentazolates, counter cation cyclo-N$_5$$^{+}$ remains elusive due to the strong oxidizing power of pentazole ion; moreover, pure N$_5$$^{+}$N$_5$$^{-}$ salt is known to be unstable. Here, we devise a new strategy for making rare cyclo-N$_5$$^{+}$ cation and assembling the long-sought N$_5$$^{+}$N$_5$$^{-}$ salt in tailored ionic compounds, wherein the negative/positive host ions act as oxidizing/reducing agents to form cyclo-N$_5$$^{+}$/N$_5$$^{-}$ species. This strategy is implemented via an advanced computational crystal structure search, which identifies XN$_5$N$_5$F (X = Li, Na, K) compounds that stabilize at high pressures and remain viable at ambient pressure-temperature conditions based on \textit{ab initio} molecular dynamics simulations. This finding opens an avenue for creating and stabilizing N$_5$$^{+}$N$_5$$^{-}$ salt assembly in ionic compounds, where cyclo-N$_5$ species are oxidized/reduced via co-matching with host ions of high/low electronegativity. The present results demonstrate novel polynitrogen chemistry, and these findings offer new insights and prospects in the design and synthesis of diverse chemical species that exhibit unusual charge states, bonding structures, and superior functionality.


title: Learning Latent Dynamic Robust Representations for World Models

abstract: Visual Model-Based Reinforcement Learning (MBRL) promises to encapsulate agent's knowledge about the underlying dynamics of the environment, enabling learning a world model as a useful planner. However, top MBRL agents such as Dreamer often struggle with visual pixel-based inputs in the presence of exogenous or irrelevant noise in the observation space, due to failure to capture task-specific features while filtering out irrelevant spatio-temporal details. To tackle this problem, we apply a spatio-temporal masking strategy, a bisimulation principle, combined with latent reconstruction, to capture endogenous task-specific aspects of the environment for world models, effectively eliminating non-essential information. Joint training of representations, dynamics, and policy often leads to instabilities. To further address this issue, we develop a Hybrid Recurrent State-Space Model (HRSSM) structure, enhancing state representation robustness for effective policy learning. Our empirical evaluation demonstrates significant performance improvements over existing methods in a range of visually complex control tasks such as Maniskill \cite{gu2023maniskill2} with exogenous distractors from the Matterport environment. Our code is avaliable at https://github.com/bit1029public/HRSSM.


title: Selective Focus: Investigating Semantics Sensitivity in Post-training Quantization for Lane Detection

abstract: Lane detection (LD) plays a crucial role in enhancing the L2+ capabilities of autonomous driving, capturing widespread attention. The Post-Processing Quantization (PTQ) could facilitate the practical application of LD models, enabling fast speeds and limited memories without labeled data. However, prior PTQ methods do not consider the complex LD outputs that contain physical semantics, such as offsets, locations, etc., and thus cannot be directly applied to LD models. In this paper, we pioneeringly investigate semantic sensitivity to post-processing for lane detection with a novel Lane Distortion Score. Moreover, we identify two main factors impacting the LD performance after quantization, namely intra-head sensitivity and inter-head sensitivity, where a small quantization error in specific semantics can cause significant lane distortion. Thus, we propose a Selective Focus framework deployed with Semantic Guided Focus and Sensitivity Aware Selection modules, to incorporate post-processing information into PTQ reconstruction. Based on the observed intra-head sensitivity, Semantic Guided Focus is introduced to prioritize foreground-related semantics using a practical proxy. For inter-head sensitivity, we present Sensitivity Aware Selection, efficiently recognizing influential prediction heads and refining the optimization objectives at runtime. Extensive experiments have been done on a wide variety of models including keypoint-, anchor-, curve-, and segmentation-based ones. Our method produces quantized models in minutes on a single GPU and can achieve 6.4% F1 Score improvement on the CULane dataset.


title: Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidence

abstract: Semantic mapping with Bayesian Kernel Inference (BKI) has shown promise in providing a richer understanding of environments by effectively leveraging local spatial information. However, existing methods face challenges in constructing accurate semantic maps or reliable uncertainty maps in perceptually challenging environments due to unreliable semantic predictions. To address this issue, we propose an evidential semantic mapping framework, which integrates the evidential reasoning of Dempster-Shafer Theory of Evidence (DST) into the entire mapping pipeline by adopting Evidential Deep Learning (EDL) and Dempster's rule of combination. Additionally, the extended belief is devised to incorporate local spatial information based on their uncertainty during the mapping process. Comprehensive experiments across various off-road datasets demonstrate that our framework enhances the reliability of uncertainty maps, consistently outperforming existing methods in scenes with high perceptual uncertainties while showing semantic accuracy comparable to the best-performing semantic mapping techniques.


title: A Multi-Channel Spatial-Temporal Transformer Model for Traffic Flow Forecasting

abstract: Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2) the predicted results greatly rely on the extraction of temporal and spatial dependencies from the road networks. To overcome the challenges mentioned above, we propose a multi-channel spatial-temporal transformer model for traffic flow forecasting, which improves the accuracy of the prediction by fusing results from different channels of traffic data. Our approach leverages graph convolutional network to extract spatial features from each channel while using a transformer-based architecture to capture temporal dependencies across channels. We introduce an adaptive adjacency matrix to overcome limitations in feature extraction from fixed topological structures. Experimental results on six real-world datasets demonstrate that introducing a multi-channel mechanism into the temporal model enhances performance and our proposed model outperforms state-of-the-art models in terms of accuracy.


title: Characterization of a graphene-hBN superlattice field effect transistor

abstract: Graphene is a unique platform to naturally host a high quality 2D electron system. With hBN encapsulation to protect the graphene from the noisy environment, it has a potential to realize ultrahigh performance nanodevices, such as photodiodes and transistors. However, absence of a band gap at Dirac point poses challenges in using the system as a useful transistor. In this study, we investigate the functionality of a hBN-aligned monolayer graphene as a field effect transistor (FET). By precisely aligning the hBN and graphene, the band gaps open at the first Dirac point and at the hole-doped induced Dirac point via an interfacial moire potential. To characterize as a submicron scale FET, we fabricated a global bottom gate to tune the density of a conducting channel and a local top gate to switch-off the channel, demonstrating that this system can be tuned at an optimal on/off ratio regime by controlling the gates separately. These findings will present a useful reference point for further development of the FETs based on graphene heterostructures.


title: Meromorphic mappings on K\"{a}hler manifolds weakly sharing hyperplanes in $\mathbb P^n(\mathbb C)$

abstract: In this paper, we study the uniqueness problem for linearly nondegenerate meromorphic mappings from a K\"{a}hler manifold into $\mathbb P^n(\mathbb C)$ satisfying a condition $(C_\rho)$ and sharing hyperplanes in general position, where the condition that two meromorphic mappings $f,g$ have the same inverse image for some hyperplanes $H$ is replaced by a weaker one that $f^{-1}(H)\subset g^{-1}(H)$. Moreover, we also give some improvements on the uniqueness problem and algebraic dependence problem of meromorphic mappings which share hyperplanes and satisfy $(C_\rho)$ conditions for different non-negative numbers $\rho$.


title: Curves with Jacobian syzygies of the same degree

abstract: In this notes we study complex projective plane curves whose graded module of Jacobian syzygies is generated by its minimal degree component. Examples of such curves include the smooth curves as well as the maximal Tjurina curves. However, this class of curves seems to be surprisingly large. In particular, any line arrangement $\mathcal A$ of $d=2k+1\geq 5 $ lines having only double and triple points is in this class if the number of triple points is $k$ and if they are all situated on a line $L \in \mathcal A$, see Theorem 6.2


title: XAI4LLM. Let Machine Learning Models and LLMs Collaborate for Enhanced In-Context Learning in Healthcare

abstract: The integration of Large Language Models (LLMs) into healthcare diagnostics offers a promising avenue for clinical decision-making. This study outlines the development of a novel method for zero-shot/few-shot in-context learning (ICL) by integrating medical domain knowledge using a multi-layered structured prompt. We also explore the efficacy of two communication styles between the user and LLMs: the Numerical Conversational (NC) style, which processes data incrementally, and the Natural Language Single-Turn (NL-ST) style, which employs long narrative prompts. Our study systematically evaluates the diagnostic accuracy and risk factors, including gender bias and false negative rates, using a dataset of 920 patient records in various few-shot scenarios. Results indicate that traditional clinical machine learning (ML) models generally outperform LLMs in zero-shot and few-shot settings. However, the performance gap narrows significantly when employing few-shot examples alongside effective explainable AI (XAI) methods as sources of domain knowledge. Moreover, with sufficient time and an increased number of examples, the conversational style (NC) nearly matches the performance of ML models. Most notably, LLMs demonstrate comparable or superior cost-sensitive accuracy relative to ML models. This research confirms that, with appropriate domain knowledge and tailored communication strategies, LLMs can significantly enhance diagnostic processes. The findings highlight the importance of optimizing the number of training examples and communication styles to improve accuracy and reduce biases in LLM applications.


title: Code Compass: A Study on the Challenges of Navigating Unfamiliar Codebases

abstract: In our research, we investigate the challenges that software engineers face during program comprehension, particularly when debugging unfamiliar codebases. We propose a novel tool, CodeCompass, to address these issues. Our study highlights a significant gap in current tools and methodologies, especially the difficulty developers encounter in effectively utilizing documentation alongside code exploration. CodeCompass tackles these challenges by seamlessly integrating documentation within the IDE, offering context-aware suggestions and visualizations that streamline the debugging process. Our formative study demonstrates how effectively the tool reduces the time developers spend navigating documentation, thereby enhancing code comprehension and task completion rates. Future work will focus on automating the process of annotating codebases, creating sandbox tasks, and providing dynamic support. These innovations could potentially transform software development practices by improving the accessibility and efficiency of program comprehension tools.


title: Effects of vortex and anti-vortex excitations in underdoped Bi-2223 bulk single crystals

abstract: To gain insights into mechanisms underlying superconducting transition in copper oxide high-transition temperature ($T_c$) superconductors, we studied transport properties of underdoped Bi$_2$Sr$_2$Ca$_2$Cu$_3$O$_{10+\delta}$ (Bi-2223) bulk single crystals. The power exponent $\alpha$ ($V \propto I^{\alpha}$) reached 3 just below $T_c$, and the temperature dependence of in-plane resistivity ($\rho_{ab}$) exhibited typical tailing behavior, consistent with Kosterlitz--Thouless transition characteristics. Thus, with increasing temperature, copper oxide high-$T_c$ superconductors undergo transition to the normal state because of destruction of its phase correlations, although a finite Cooper pair density exists at $T_c$.


title: Comparison criteria for first order polynomial differential equations

abstract: In this paper we use the comparison method for investigation of first order polynomial differential equations. We prove two comparison criteria for these equations. The proved criteria we use to obtain some global solvability criteria for first order polynomial differential equations. On the basis of these criteria we prove some criteria for existence of a closed solution (of closed solutions) of for first order polynomial differential equations. The results obtained we compare with some known results.


title: Hybrid thin-film lithium niobate micro-ring acousto-optic modulator for microwave-to-optical conversion

abstract: Highly efficient acousto-optic modulation plays a vital role in the microwave-to-optical conversion. Herein, we demonstrate a hybrid thin-film lithium niobate (TFLN) racetrack micro-ring acousto-optic modulator (AOM) implemented with low-loss chalcogenide (ChG) waveguide. By engineering the electrode configuration of the interdigital transducer, the double-arm micro-ring acousto-optic modulation is experimentally confirmed in nonsuspended ChG loaded TFLN waveguide platform. Varying the position of blue-detuned bias point, the half-wave-voltage-length product VpaiL of the hybrid TFLN micro-ring AOM is as small as 9 mVcm. Accordingly, the acousto-optic coupling strength is estimated to be 0.48 Hz s1/2 at acoustic frequency of 0.84 GHz. By analyzing the generation of phonon number from the piezoelectric transducer, the microwave-to-optical conversion efficiency is calculated to be 0.05%, approximately one order of magnitude larger than that of the state-of-the-art suspended counterpart. Efficient microwave-to-optical conversion thus provides new opportunities for low-power-consumption quantum information transduction using the TFLN-ChG hybrid piezo-optomechanical devices.


title: Pruning as a Domain-specific LLM Extractor

abstract: Large Language Models (LLMs) have exhibited remarkable proficiency across a wide array of NLP tasks. However, the escalation in model size also engenders substantial deployment costs. While few efforts have explored model pruning techniques to reduce the size of LLMs, they mainly center on general or task-specific weights. This leads to suboptimal performance due to lacking specificity on the target domain or generality on different tasks when applied to domain-specific challenges. This work introduces an innovative unstructured dual-pruning methodology, D-Pruner, for domain-specific compression on LLM. It extracts a compressed, domain-specific, and task-agnostic LLM by identifying LLM weights that are pivotal for general capabilities, like linguistic capability and multi-task solving, and domain-specific knowledge. More specifically, we first assess general weight importance by quantifying the error incurred upon their removal with the help of an open-domain calibration dataset. Then, we utilize this general weight importance to refine the training loss, so that it preserves generality when fitting into a specific domain. Moreover, by efficiently approximating weight importance with the refined training loss on a domain-specific calibration dataset, we obtain a pruned model emphasizing generality and specificity. Our comprehensive experiments across various tasks in healthcare and legal domains show the effectiveness of D-Pruner in domain-specific compression. Our code is available at https://github.com/psunlpgroup/D-Pruner.


title: Transition from laminar to turbulent pipe flow as a process of growing material instabilities

abstract: In this work, we simulate the transition to turbulence in the pipe flow based on the modified NS theory incorporating the viscous fluid strength in the constitutive equations. The latter concept enriches theory by allowing for material instabilities in addition to the kinematic ones. We present results of comparative numerical simulations based on the classical NS model and the NS model enhanced with the finite viscous strength. As expected, simulations based on the classical NS model exhibit stable laminar flow in contrast to experimental observations. Conversely, simulations based on the modified NS model with viscous strength exhibit instabilities and transition to turbulence per experimental observations. The transition to turbulence is triggered by the growing material instabilities.


title: Learning A Spiking Neural Network for Efficient Image Deraining

abstract: Recently, spiking neural networks (SNNs) have demonstrated substantial potential in computer vision tasks. In this paper, we present an Efficient Spiking Deraining Network, called ESDNet. Our work is motivated by the observation that rain pixel values will lead to a more pronounced intensity of spike signals in SNNs. However, directly applying deep SNNs to image deraining task still remains a significant challenge. This is attributed to the information loss and training difficulties that arise from discrete binary activation and complex spatio-temporal dynamics. To this end, we develop a spiking residual block to convert the input into spike signals, then adaptively optimize the membrane potential by introducing attention weights to adjust spike responses in a data-driven manner, alleviating information loss caused by discrete binary activation. By this way, our ESDNet can effectively detect and analyze the characteristics of rain streaks by learning their fluctuations. This also enables better guidance for the deraining process and facilitates high-quality image reconstruction. Instead of relying on the ANN-SNN conversion strategy, we introduce a gradient proxy strategy to directly train the model for overcoming the challenge of training. Experimental results show that our approach gains comparable performance against ANN-based methods while reducing energy consumption by 54%. The code source is available at https://github.com/MingTian99/ESDNet.


title: Exploring the Interplay of Interpretability and Robustness in Deep Neural Networks: A Saliency-guided Approach

abstract: Adversarial attacks pose a significant challenge to deploying deep learning models in safety-critical applications. Maintaining model robustness while ensuring interpretability is vital for fostering trust and comprehension in these models. This study investigates the impact of Saliency-guided Training (SGT) on model robustness, a technique aimed at improving the clarity of saliency maps to deepen understanding of the model's decision-making process. Experiments were conducted on standard benchmark datasets using various deep learning architectures trained with and without SGT. Findings demonstrate that SGT enhances both model robustness and interpretability. Additionally, we propose a novel approach combining SGT with standard adversarial training to achieve even greater robustness while preserving saliency map quality. Our strategy is grounded in the assumption that preserving salient features crucial for correctly classifying adversarial examples enhances model robustness, while masking non-relevant features improves interpretability. Our technique yields significant gains, achieving a 35\% and 20\% improvement in robustness against PGD attack with noise magnitudes of $0.2$ and $0.02$ for the MNIST and CIFAR-10 datasets, respectively, while producing high-quality saliency maps.


title: Benchmarking Classical and Learning-Based Multibeam Point Cloud Registration

abstract: Deep learning has shown promising results for multiple 3D point cloud registration datasets. However, in the underwater domain, most registration of multibeam echo-sounder (MBES) point cloud data are still performed using classical methods in the iterative closest point (ICP) family. In this work, we curate and release DotsonEast Dataset, a semi-synthetic MBES registration dataset constructed from an autonomous underwater vehicle in West Antarctica. Using this dataset, we systematically benchmark the performance of 2 classical and 4 learning-based methods. The experimental results show that the learning-based methods work well for coarse alignment, and are better at recovering rough transforms consistently at high overlap (20-50%). In comparison, GICP (a variant of ICP) performs well for fine alignment and is better across all metrics at extremely low overlap (10%). To the best of our knowledge, this is the first work to benchmark both learning-based and classical registration methods on an AUV-based MBES dataset. To facilitate future research, both the code and data are made available online.


title: Green's Function and Pointwise Space-time Behaviors of the Three-Dimensional Relativistic Boltzmann Equation

abstract: The pointwise space-time behavior of the Green's function of the three-dimensional relativistic Boltzmann equation is studied in this paper. It is shown that the Green's function has a decomposition of the macroscopic diffusive waves and Huygens waves with the speed $\sqrt{a^2+b^2}$ at low-frequency, the singular kinetic wave and the remainder term decaying exponentially in space and time. In addition, we establish the pointwise space-time estimate of the global solution to the nonlinear relativistic Boltzmann equation with non-smooth initial data based on the Green's function.


title: Birth and Evolution of Fast Radio Bursts: Strong Population-Based Evidence for a Neutron-Star Origin

abstract: While the appeal of their extraordinary radio luminosity to our curiosity is undiminished, the nature of fast radio bursts (FRBs) has remained unclear. The challenge has been due in part to small sample sizes and limited understanding of telescope selection effects. We here present the first inclusion of the entire set of one-off FRBs from CHIME/FRB Catalog 1 in frbpoppy. Where previous work had to curate this data set, and fit for few model parameters, we have developed full multi-dimensional Markov chain Monte Carlo (MCMC) capabilities for frbpoppy -- the comprehensive, open-science FRB population synthesis code -- that allow us to include all one-off CHIME bursts. Through the combination of these two advances we now find the best description of the real, underlying FRB population, with higher confidence than before. We show that $4\pm3\times10^{3}$ one-off FRBs go off every second between Earth and $z$=1; and we provide a mock catalog based on our best model, for straight-forward inclusion in other studies. We investigate CHIME side-lobe detection fractions, and FRB luminosity characteristics, to show that some bright, local FRBs are still being missed. We find strong evidence that FRB birth rates evolve with the star formation rate of the Universe, even with a hint of a short (0.1$-$1 Gyr) delay time. The preferred contribution of the hosts to the FRB dispersion agrees with a progenitor birth location in the host disk. This population-based evidence solidly aligns with magnetar-like burst sources, and we conclude FRBs are emitted by neutron stars.


title: A cellular automata approach for modelling pedestrian-vehicle mixed traffic flow in urban city

abstract: In urban streets, the intrusion of pedestrians presents significant safety challenges. Modelling mixed pedestrian-vehicle traffic is complex due to the distinct motion characteristics and spatial dimensions of pedestrians and vehicles, making unified modelling difficult, with few studies addressing these issues. This paper employs a multi-grid cellular automata model to bridge the gap between vehicle and pedestrian models. An Improved Kerner-Klenov-Wolf (IKKW) model and a pedestrian motion model that incorporates Time-To-Collision (TTC) are introduced. Both models update the spatial motions of vehicles and pedestrians uniformly. Empirical analysis indicates that the model achieves high simulation accuracy. This model effectively illustrates the impact of pedestrian intrusion within mixed traffic scenario. The fundamental diagram of heterogeneous traffic reveals substantial differences, highlighting the effects of pedestrian intrusion on traffic flow states and identifying six phase regions in mixed traffic. Additionally, this paper examines conflicts between pedestrians and vehicles under varying speed limits and sidewalk widths, demonstrating that lower speeds and broader sidewalks significantly reduce the frequency of pedestrian-vehicle conflicts. Notably, the frequency of peak conflicts at a vehicle speed limit of 60.48 km/h is more than three times higher than at 30.24 km/h. This model offers a potential approach to studying mixed traffic flows and exhibits substantial scalability.


title: Novel Class Discovery for Ultra-Fine-Grained Visual Categorization

abstract: Ultra-fine-grained visual categorization (Ultra-FGVC) aims at distinguishing highly similar sub-categories within fine-grained objects, such as different soybean cultivars. Compared to traditional fine-grained visual categorization, Ultra-FGVC encounters more hurdles due to the small inter-class and large intra-class variation. Given these challenges, relying on human annotation for Ultra-FGVC is impractical. To this end, our work introduces a novel task termed Ultra-Fine-Grained Novel Class Discovery (UFG-NCD), which leverages partially annotated data to identify new categories of unlabeled images for Ultra-FGVC. To tackle this problem, we devise a Region-Aligned Proxy Learning (RAPL) framework, which comprises a Channel-wise Region Alignment (CRA) module and a Semi-Supervised Proxy Learning (SemiPL) strategy. The CRA module is designed to extract and utilize discriminative features from local regions, facilitating knowledge transfer from labeled to unlabeled classes. Furthermore, SemiPL strengthens representation learning and knowledge transfer with proxy-guided supervised learning and proxy-guided contrastive learning. Such techniques leverage class distribution information in the embedding space, improving the mining of subtle differences between labeled and unlabeled ultra-fine-grained classes. Extensive experiments demonstrate that RAPL significantly outperforms baselines across various datasets, indicating its effectiveness in handling the challenges of UFG-NCD. Code is available at https://github.com/SSDUT-Caiyq/UFG-NCD.


title: Modality-agnostic Domain Generalizable Medical Image Segmentation by Multi-Frequency in Multi-Scale Attention

abstract: Generalizability in deep neural networks plays a pivotal role in medical image segmentation. However, deep learning-based medical image analyses tend to overlook the importance of frequency variance, which is critical element for achieving a model that is both modality-agnostic and domain-generalizable. Additionally, various models fail to account for the potential information loss that can arise from multi-task learning under deep supervision, a factor that can impair the model representation ability. To address these challenges, we propose a Modality-agnostic Domain Generalizable Network (MADGNet) for medical image segmentation, which comprises two key components: a Multi-Frequency in Multi-Scale Attention (MFMSA) block and Ensemble Sub-Decoding Module (E-SDM). The MFMSA block refines the process of spatial feature extraction, particularly in capturing boundary features, by incorporating multi-frequency and multi-scale features, thereby offering informative cues for tissue outline and anatomical structures. Moreover, we propose E-SDM to mitigate information loss in multi-task learning with deep supervision, especially during substantial upsampling from low resolution. We evaluate the segmentation performance of MADGNet across six modalities and fifteen datasets. Through extensive experiments, we demonstrate that MADGNet consistently outperforms state-of-the-art models across various modalities, showcasing superior segmentation performance. This affirms MADGNet as a robust solution for medical image segmentation that excels in diverse imaging scenarios. Our MADGNet code is available in GitHub Link.


title: Pedestrian Crossing Discrepancy Within Static and Dynamic Crowds: An Experimental Study

abstract: This paper aims to investigate the disparities in pedestrian crossing behaviors within static and dynamic crowds through experimental analysis. First, the crossing trajectories of pedestrians in various crowd environments were qualitatively observed. These trajectories have shown significant discrepancies and the phenomenon of cross-channel formation within static crowds was observed, a phenomenon similar to the evolution of human trails. To quantitatively assess these discrepancies, metrics of behavior patterns and swarm factor were introduced. Different behavioral patterns, including anticipation and reaction behaviors in pedestrian motion, were observed. Finally, through orthogonal velocity analysis, the variation trends of crossing motions within static and dynamic contexts were revealed.


title: A Joint Approach Towards Data-Driven Virtual Testing for Automated Driving: The AVEAS Project

abstract: With growing complexity and responsibility of automated driving functions in road traffic and growing scope of their operational design domains, there is increasing demand for covering significant parts of development, validation, and verification via virtual environments and simulation models. If, however, simulations are meant not only to augment real-world experiments, but to replace them, quantitative approaches are required that measure to what degree and under which preconditions simulation models adequately represent reality, and thus allow their usage for virtual testing of driving functions. Especially in research and development areas related to the safety impacts of the "open world", there is a significant shortage of real-world data to parametrize and/or validate simulations - especially with respect to the behavior of human traffic participants, whom automated vehicles will meet in mixed traffic. This paper presents the intermediate results of the German AVEAS research project (www.aveas.org) which aims at developing methods and metrics for the harmonized, systematic, and scalable acquisition of real-world data for virtual verification and validation of advanced driver assistance systems and automated driving, and establishing an online database following the FAIR principles.


title: Topological phase diagram of the Haldane model on a Bishamon-kikko--honeycomb lattice

abstract: Topological flat bands have gained extensive interest as a platform for exploring the interplay between nontrivial band topology and correlation effects. In recent studies, strongly correlated phenomena originating from a topological flat band were discussed on a periodically 1/6-depleted honeycomb lattice, but the fundamental topological nature associated with this lattice structure remains unexplored. Here we study the band structure and topological phase diagram for the Haldane model on this lattice, which we call the Bishamon-kikko lattice. We also extend our study to the model connecting the Bishamon-kikko and honeycomb lattices. We show that these models exhibit richer topological characteristics compared to the original Haldane model on the honeycomb lattice, such as topological insulating states with higher Chern numbers, metallic states with nontrivial band topology even at commensurate electron fillings, and metal-insulator transitions between them.7 Our findings offer a playground of correlated topological phenomena and stimulate their realization in a variety of two-dimensional systems, such as van der Waals materials, graphene nanostructures, and photonic crystals.


title: PCLMix: Weakly Supervised Medical Image Segmentation via Pixel-Level Contrastive Learning and Dynamic Mix Augmentation

abstract: In weakly supervised medical image segmentation, the absence of structural priors and the discreteness of class feature distribution present a challenge, i.e., how to accurately propagate supervision signals from local to global regions without excessively spreading them to other irrelevant regions? To address this, we propose a novel weakly supervised medical image segmentation framework named PCLMix, comprising dynamic mix augmentation, pixel-level contrastive learning, and consistency regularization strategies. Specifically, PCLMix is built upon a heterogeneous dual-decoder backbone, addressing the absence of structural priors through a strategy of dynamic mix augmentation during training. To handle the discrete distribution of class features, PCLMix incorporates pixel-level contrastive learning based on prediction uncertainty, effectively enhancing the model's ability to differentiate inter-class pixel differences and intra-class consistency. Furthermore, to reinforce segmentation consistency and robustness, PCLMix employs an auxiliary decoder for dual consistency regularization. In the inference phase, the auxiliary decoder will be dropped and no computation complexity is increased. Extensive experiments on the ACDC dataset demonstrate that PCLMix appropriately propagates local supervision signals to the global scale, further narrowing the gap between weakly supervised and fully supervised segmentation methods. Our code is available at https://github.com/Torpedo2648/PCLMix.