title: Mapping "Brain Coral" Regions on Mars using Deep Learning

abstract: One of the main objectives of the Mars Exploration Program is to search for evidence of past or current life on the planet. To achieve this, Mars exploration has been focusing on regions that may have liquid or frozen water. A set of critical areas may have seen cycles of ice thawing in the relatively recent past in response to periodic changes in the obliquity of Mars. In this work, we use convolutional neural networks to detect surface regions containing "Brain Coral" terrain, a landform on Mars whose similarity in morphology and scale to sorted stone circles on Earth suggests that it may have formed as a consequence of freeze/thaw cycles. We use large images (~100-1000 megapixels) from the Mars Reconnaissance Orbiter to search for these landforms at resolutions close to a few tens of centimeters per pixel (~25--50 cm). Over 52,000 images (~28 TB) were searched (~5% of the Martian surface) where we found detections in over 200 images. To expedite the processing we leverage a classifier network (prior to segmentation) in the Fourier domain that can take advantage of JPEG compression by leveraging blocks of coefficients from a discrete cosine transform in lieu of decoding the entire image at the full spatial resolution. The hybrid pipeline approach maintains ~93% accuracy while cutting down on ~95% of the total processing time compared to running the segmentation network at the full resolution on every image. The timely processing of big data sets helps inform mission operations, geologic surveys to prioritize candidate landing sites, avoid hazardous areas, or map the spatial extent of certain terrain. The segmentation masks and source code are available on Github for the community to explore and build upon.


title: Sample size calculation based on the difference in restricted mean time lost for clinical trials with competing risks

abstract: Computation of sample size is important when designing clinical trials. The presence of competing risks makes the design of clinical trials with time-to-event endpoints cumbersome. A model based on the subdistribution hazard ratio (SHR) is commonly used for trials under competing risks. However, this approach has some limitations related to model assumptions and clinical interpretation. Considering such limitations, the difference in restricted mean time lost (RMTLd) is recommended as an alternative indicator. In this paper, we propose a sample size calculation method based on the RMTLd for the Weibull distribution (RMTLdWeibull) for clinical trials, which considers experimental conditions such as equal allocation, uniform accrual, uniform loss to follow-up, and administrative censoring. Simulation results show that sample size calculation based on the RMTLdWeibull can generally achieve a predefined power level and maintain relative robustness. Moreover, the performance of the sample size calculation based on the RMTLdWeibull is similar or superior to that based on the SHR. Even if the event time does not follow the Weibull distribution, the sample size calculation based on the RMTLdWeibull still performs well. The results also verify the performance of the sample size calculation method based on the RMTLdWeibull. From the perspective of the results of this study, clinical interpretation, application conditions and statistical performance, we recommend that when designing clinical trials in the presence of competing risks, the RMTLd indicator be applied for sample size calculation and subsequent effect size measurement.


title: On a class of stochastic fractional heat equations

abstract: For the fractional heat equation $\frac{\partial}{\partial t} u(t,x) = -(-\Delta)^{\frac{\alpha}{2}}u(t,x)+ u(t,x)\dot W(t,x)$ where the covariance function of the Gaussian noise $\dot W$ is defined by the heat kernel, we establish Feynman-Kac formulae for both Stratonovich and Skorohod solutions, along with their respective moments. In particular, we prove that $d<2+\alpha$ is a sufficient and necessary condition for the equation to have a unique square-integrable mild Skorohod solution. One motivation lies in the occurrence of this equation in the study of a random walk in random environment which is generated by a field of independent random walks starting from a Poisson field.


title: Under the light of a new star: evolution of planetary atmospheres through protoplanetary disc dispersal and boil-off

abstract: The atmospheres of small, close-in exoplanets are vulnerable to rapid mass-loss during protoplanetary disc dispersal via a process referred to as `boil-off', in which confining pressure from the local gas disc reduces, inducing atmospheric loss and contraction. We construct self-consistent models of planet evolution during gaseous core accretion and boil-off. As the surrounding disc gas dissipates, we find that planets lose mass via subsonic breeze outflows which allow causal contact to exist between disc and planet. Planets initially accrete of order $\sim 10\%$ in atmospheric mass, however, boil-off can remove $\gtrsim 90\%$ of this mass during disc dispersal. We show that a planet's final atmospheric mass fraction is strongly dictated by the ratio of cooling timescale to disc dispersal timescale, as well as the planet's core mass and equilibrium temperature. With contributions from core cooling and radioactivity, we show that core luminosity eventually leads to the transition from boil-off to core-powered mass-loss. We find that smaller mass planets closest to their host star may have their atmospheres completely stripped through a combination of boil-off and core-powered mass-loss during disc dispersal, implying the existence of a population-level radius gap emerging as the disc disperses. We additionally consider the transition from boil-off/core-powered mass-loss to X-ray/EUV (XUV) photoevaporation by considering the penetration of stellar XUV photons below the planet's sonic surface. Finally, we show that planets may open gaps in their protoplanetary discs during the late stages of boil-off, which may enhance mass-loss rates.


title: A property of holomorphic functions related to plurisubharmonic functions

abstract: Let $\varphi $ be a negative plurisubharmonic function in a pseudoconvex domain $\Omega$ in $\mathbb{C}^{n}$ and $f$ be a bounded holomorphic function belonging to $L^{2}(\Omega, \varphi)$. For all negative plurisubharmonic functions $\psi$ satisfying that $\psi$ is close to $\varphi$ in the $L^1(\Omega)$ norm. Using the recent results about $L^2-$estimate for $\overline{\partial}-$equation and strong openness conjecture, we prove that there exists a holomorphic function $g$ belonging to $L^{2}( \Omega, \psi)$ such that $g$ is close to $f$ in the $L^2$ norm on some relatively compact open subset $\Omega^{'}$ of $\Omega.$


title: Dense polarized positrons from beam-solid interactions

abstract: Relativistic positron sources with high spin polarization have important applications in nuclear and particle physics and many frontier fields. However, it is challenging to produce dense polarized positrons. Here we present a simple and effective method to achieve such a positron source by directly impinging a relativistic high-density electron beam on the surface of a solid target. During the interaction, a strong return current of plasma electrons is induced and subsequently asymmetric quasistatic magnetic fields as high as megatesla are generated along the target surface. This gives rise to strong radiative spin flips and multiphoton processes, thus leading to efficient generation of copious polarized positrons. With three-dimensional particle-in-cell simulations, we demonstrate the production of a dense highly-polarized multi-GeV positron beam with an average spin polarization above 40% and nC-scale charge per shot. This offers a novel route for the studies of laserless strong-field quantum electrodynamics physics and for the development of high-energy polarized positron sources.


title: Noise in Relation Classification Dataset TACRED: Characterization and Reduction

abstract: The overarching objective of this paper is two-fold. First, to explore model-based approaches to characterize the primary cause of the noise. in the RE dataset TACRED Second, to identify the potentially noisy instances. Towards the first objective, we analyze predictions and performance of state-of-the-art (SOTA) models to identify the root cause of noise in the dataset. Our analysis of TACRED shows that the majority of the noise in the dataset originates from the instances labeled as no-relation which are negative examples. For the second objective, we explore two nearest-neighbor-based strategies to automatically identify potentially noisy examples for elimination and reannotation. Our first strategy, referred to as Intrinsic Strategy (IS), is based on the assumption that positive examples are clean. Thus, we have used false-negative predictions to identify noisy negative examples. Whereas, our second approach, referred to as Extrinsic Strategy, is based on using a clean subset of the dataset to identify potentially noisy negative examples. Finally, we retrained the SOTA models on the eliminated and reannotated dataset. Our empirical results based on two SOTA models trained on TACRED-E following the IS show an average 4% F1-score improvement, whereas reannotation (TACRED-R) does not improve the original results. However, following ES, SOTA models show the average F1-score improvement of 3.8% and 4.4% when trained on respective eliminated (TACRED-EN) and reannotated (TACRED-RN) datasets respectively. We further extended the ES for cleaning positive examples as well, which resulted in an average performance improvement of 5.8% and 5.6% for the eliminated (TACRED-ENP) and reannotated (TACRED-RNP) datasets respectively.


title: Thin Film Lithium Niobate Electro-optic Isolator Fabricated by photolithography assisted chemo-mechanical etching (PLACE)

abstract: We report a thin-film lithium niobate electro-optic isolator fabricated by photolithography-assisted chemo-mechanical etching in this work. The device demonstrates 39.50 dB isolation when subjected to a 24 GHz microwave of 25.5 dBm on its electrodes. The measured isolation remains consistently above 30 dB within the 1510 nm to 1600 nm wavelength range. The overall device insertion loss, specifically the fiber-to-fiber insert loss, has been measured to be 2.6 dB, which is attributed to our highly efficient spot size converter and the low propagation loss observed in the fabricated waveguides.


title: Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the Art

abstract: Automated human action recognition, a burgeoning field within computer vision, boasts diverse applications spanning surveillance, security, human-computer interaction, tele-health, and sports analysis. Precise action recognition in infants serves a multitude of pivotal purposes, encompassing safety monitoring, developmental milestone tracking, early intervention for developmental delays, fostering parent-infant bonds, advancing computer-aided diagnostics, and contributing to the scientific comprehension of child development. This paper delves into the intricacies of infant action recognition, a domain that has remained relatively uncharted despite the accomplishments in adult action recognition. In this study, we introduce a groundbreaking dataset called ``InfActPrimitive'', encompassing five significant infant milestone action categories, and we incorporate specialized preprocessing for infant data. We conducted an extensive comparative analysis employing cutting-edge skeleton-based action recognition models using this dataset. Our findings reveal that, although the PoseC3D model achieves the highest accuracy at approximately 71%, the remaining models struggle to accurately capture the dynamics of infant actions. This highlights a substantial knowledge gap between infant and adult action recognition domains and the urgent need for data-efficient pipeline models.


title: Convergence in $m$-capacity related to maximal subextension of $m$-subharmonic functions with given boundary values

abstract: In this paper, we study maximal subextension of $m$-subharmonic functions with given boundary values. We also study the relationship between convergence in $m$-capacity of $m$-subharmonic functions with given boundary values and the convergence in $m$-capacity of subsequence of the corresponding maximal subextensions with given boundary values.


title: Short rainbow cycles in edge-colored graphs

abstract: A famous conjecture of Caccetta and H\"{a}ggkvist (CHC) states that a directed graph $D$ with $n$ vertices and minimum outdegree at least $r$ has a directed cycle of length at most $\lceil \frac{n}{r}\rceil$. In 2017, Aharoni proposed the following generalization: an edge-colored graph $G$ with $n$ vertices, $n$ color classes of size at least $r$ has a rainbow cycle of length at most $\lceil \frac{n}{r}\rceil$. Since CHC can be seen as the case of Aharoni's Conjecture: color classes in the color partition are monochromatic stars centered at distinct vertices, one way to study Aharoni's Conjecture is to structure the color classes as each color class is either a star, a triangle or contains a matching of size 2. Guo improved the upper bound in Aharoni's Conjecture to $O(\log n)$ in some mixed cases when the color classes are not necessarily stars. In this paper, we extend Guo's results. Our main result is as follows: Let $G$ an edge-colored graph on $n$ vertices and $n$ color classes, if at least $\alpha n$ color classes are either a matching of size 2 or a triangle for $\alpha >\frac{1}{2}$, then $G$ contains a rainbow cycle of length $O(\log n)$. We also prove that the $\log n$ bound is the right order of magnitude.


title: Detecting subtle macroscopic changes in a finite temperature classical scalar field with machine learning

abstract: The ability to detect macroscopic changes is important for probing the behaviors of experimental many-body systems from the classical to the quantum realm. Although abrupt changes near phase boundaries can easily be detected, subtle macroscopic changes are much more difficult to detect as the changes can be obscured by noise. In this study, as a toy model for detecting subtle macroscopic changes in many-body systems, we try to differentiate scalar field samples at varying temperatures. We compare different methods for making such differentiations, from physics method, statistics method, to AI method. Our finding suggests that the AI method outperforms both the statistical method and the physics method in its sensitivity. Our result provides a proof-of-concept that AI can potentially detect macroscopic changes in many-body systems that elude physical measures.


title: Discovering Effective Policies for Land-Use Planning with Neuroevolution

abstract: How areas of land are allocated for different uses, such as forests, urban areas, and agriculture, has a large effect on the terrestrial carbon balance, and therefore climate change. Based on available historical data on land-use changes and a simulation of the associated carbon emissions and removals, a surrogate model can be learned that makes it possible to evaluate the different options available to decision-makers efficiently. An evolutionary search process can then be used to discover effective land-use policies for specific locations. Such a system was built on the Project Resilience platform and evaluated with the Land-Use Harmonization dataset LUH2 and the bookkeeping model BLUE. It generates Pareto fronts that trade off carbon impact and amount of land-use change customized to different locations, thus providing a potentially useful tool for land-use planning.


title: Eliminating Quantization Errors in Classification-Based Sound Source Localization

abstract: Sound Source Localization (SSL) involves estimating the Direction of Arrival (DOA) of sound sources. Since the DOA estimation output space is continuous, regression might be more suitable for DOA, offering higher precision. However, in practice, classification often outperforms regression, exhibiting greater robustness to interference. Conversely, classification's drawback is inherent quantization error. Within the classification paradigm, the DOA output space is discretized into intervals, each treated as a class. These classes show strong inter-class correlations, being inherently ordered, with higher similarity as intervals grow closer. Nevertheless, this has not been fully exploited. To address this, we propose an Unbiased Label Distribution (ULD) to eliminate quantization error in training targets. Furthermore, we tailor two loss functions for the soft label family: Negative Log Absolute Error (NLAE) and Mean Squared Error without activation (MSE(wo)). Finally, we introduce Weighted Adjacent Decoding (WAD) to overcome quantization error during model prediction decoding. Experimental results demonstrate our approach surpasses classification quantization limits, achieving state-of-the-art performance. Our code and supplementary materials are available at https://github.com/linfeng-feng/ULD.


title: A blow up solution of the Navier-Stokes equations with a super critical forcing term

abstract: A forced solution $v$ of the axially symmetric Navier-Stokes equation in a finite cylinder $D$ with suitable boundary condition is constructed. The forcing term is in the super critical space $L^q_t L^1_x$ for all $q>1$. The velocity is in the energy space at the final moment when it blows up.


title: Causality is all you need

abstract: In the fundamental statistics course, students are taught to remember the well-known saying: "Correlation is not Causation". Till now, statistics (i.e., correlation) have developed various successful frameworks, such as Transformer and Pre-training large-scale models, which have stacked multiple parallel self-attention blocks to imitate a wide range of tasks. However, in the causation community, how to build an integrated causal framework still remains an untouched domain despite its excellent intervention capabilities. In this paper, we propose the Causal Graph Routing (CGR) framework, an integrated causal scheme relying entirely on the intervention mechanisms to reveal the cause-effect forces hidden in data. Specifically, CGR is composed of a stack of causal layers. Each layer includes a set of parallel deconfounding blocks from different causal graphs. We combine these blocks via the concept of the proposed sufficient cause, which allows the model to dynamically select the suitable deconfounding methods in each layer. CGR is implemented as the stacked networks, integrating no confounder, back-door adjustment, front-door adjustment, and probability of sufficient cause. We evaluate this framework on two classical tasks of CV and NLP. Experiments show CGR can surpass the current state-of-the-art methods on both Visual Question Answer and Long Document Classification tasks. In particular, CGR has great potential in building the "causal" pre-training large-scale model that effectively generalizes to diverse tasks. It will improve the machines' comprehension of causal relationships within a broader semantic space.


title: Jup2Kub: algorithms and a system to translate a Jupyter Notebook pipeline to a fault tolerant distributed Kubernetes deployment

abstract: Scientific workflows facilitate computational, data manipulation, and sometimes visualization steps for scientific data analysis. They are vital for reproducing and validating experiments, usually involving computational steps in scientific simulations and data analysis. These workflows are often developed by domain scientists using Jupyter notebooks, which are convenient yet face limitations: they struggle to scale with larger data sets, lack failure tolerance, and depend heavily on the stability of underlying tools and packages. To address these issues, Jup2Kup has been developed. This software system translates workflows from Jupyter notebooks into a distributed, high-performance Kubernetes environment, enhancing fault tolerance. It also manages software dependencies to maintain operational stability amidst changes in tools and packages.


title: Power grid operational risk assessment using graph neural network surrogates

abstract: We investigate the utility of graph neural networks (GNNs) as proxies of power grid operational decision-making algorithms (optimal power flow (OPF) and security-constrained unit commitment (SCUC)) to enable rigorous quantification of the operational risk. To conduct principled risk analysis, numerous Monte Carlo (MC) samples are drawn from the (foretasted) probability distributions of spatio-temporally correlated stochastic grid variables. The corresponding OPF and SCUC solutions, which are needed to quantify the risk, are generated using traditional OPF and SCUC solvers to generate data for training GNN model(s). The GNN model performance is evaluated in terms of the accuracy of predicting quantities of interests (QoIs) derived from the decision variables in OPF and SCUC. Specifically, we focus on thermal power generation and load shedding at system and individual zone level. We also perform reliability and risk quantification based on GNN predictions and compare with that obtained from OPF/SCUC solutions. Our results demonstrate that GNNs are capable of providing fast and accurate prediction of QoIs and thus can be good surrogate models for OPF and SCUC. The excellent accuracy of GNN-based reliability and risk assessment further suggests that GNN surrogate has the potential to be applied in real-time and hours-ahead risk quantification.


title: IEKM: A Model Incorporating External Keyword Matrices

abstract: A customer service platform system with a core text semantic similarity (STS) task faces two urgent challenges: Firstly, one platform system needs to adapt to different domains of customers, i.e., different domains adaptation (DDA). Secondly, it is difficult for the model of the platform system to distinguish sentence pairs that are literally close but semantically different, i.e., hard negative samples. In this paper, we propose an incorporation external keywords matrices model (IEKM) to address these challenges. The model uses external tools or dictionaries to construct external matrices and fuses them to the self-attention layers of the Transformer structure through gating units, thus enabling flexible corrections to the model results. We evaluate the method on multiple datasets and the results show that our method has improved performance on all datasets. To demonstrate that our method can effectively solve all the above challenges, we conduct a flexible correction experiment, which results in an increase in the F1 value from 56.61 to 73.53. Our code will be publicly available.


title: ABFL: Angular Boundary Discontinuity Free Loss for Arbitrary Oriented Object Detection in Aerial Images

abstract: Arbitrary oriented object detection (AOOD) in aerial images is a widely concerned and highly challenging task, and plays an important role in many scenarios. The core of AOOD involves the representation, encoding, and feature augmentation of oriented bounding-boxes (Bboxes). Existing methods lack intuitive modeling of angle difference measurement in oriented Bbox representations. Oriented Bboxes under different representations exhibit rotational symmetry with varying periods due to angle periodicity. The angular boundary discontinuity (ABD) problem at periodic boundary positions is caused by rotational symmetry in measuring angular differences. In addition, existing methods also use additional encoding-decoding structures for oriented Bboxes. In this paper, we design an angular boundary free loss (ABFL) based on the von Mises distribution. The ABFL aims to solve the ABD problem when detecting oriented objects. Specifically, ABFL proposes to treat angles as circular data rather than linear data when measuring angle differences, aiming to introduce angle periodicity to alleviate the ABD problem and improve the accuracy of angle difference measurement. In addition, ABFL provides a simple and effective solution for various periodic boundary discontinuities caused by rotational symmetry in AOOD tasks, as it does not require additional encoding-decoding structures for oriented Bboxes. Extensive experiments on the DOTA and HRSC2016 datasets show that the proposed ABFL loss outperforms some state-of-the-art methods focused on addressing the ABD problem.


title: Promise Algebra: An Algebraic Model of Non-Deterministic Computations

abstract: Our goal is to define an algebraic language for reasoning about non-deterministic computations. Towards this goal, we introduce an algebra of string-to-string transductions. Specifically, it is an algebra of partial functions on words over the alphabet of relational $\tau$-structures over the same domain. The algebra has a two-level syntax, and thus, two parameters to control its expressive power. The top level defines algebraic expressions, and the bottom level specifies atomic transitions. History-dependent Choice functions resolve atomic non-determinism, and make general relations functional. Equivalence classes of such functions serve as certificates for computational problems specified by algebraic terms. The algebra has an equivalent syntax in the form of a Dynamic Logic, where terms describing computational processes or programs appear inside the modalities. We define a simple secondary logic for representing atomic transitions, which is a modification of conjunctive queries. With this logic, the algebra can represent both reachability and counting examples, which is not possible in Datalog. We analyze the data complexity of this logic, measured in the size of the input structure, and show that a restricted fragment of the logic captures the complexity class NP. The logic can be viewed as a database query language, where atomic propagations are separated from control.


title: Theory of simultaneous observation of photoelectron and emitted X-ray photon in X-ray emission spectroscopy and their entanglement

abstract: We have theoretically investigated the character of entanglement between photoelectrons and emitted X-ray photons in XEPECS process which is a coincidence spectroscopy of photoelectrons and emitted X-ray photons. In the calculations, we used a three-electron sp-model consisting of an inner-shell 1s orbital and an outer-shell 2p orbital. We found that entanglement occurs between spin of photoelectrons and linear polarization of emitted X-ray photons, using the wavefunction of the whole system including the photon as well as the electron system. Furthermore, we calculated the degree of entanglement and found that it shows maximum at a particular angle of emitted X-ray photon.


title: Demystifying Graph Sparsification Algorithms in Graph Properties Preservation

abstract: Graph sparsification is a technique that approximates a given graph by a sparse graph with a subset of vertices and/or edges. The goal of an effective sparsification algorithm is to maintain specific graph properties relevant to the downstream task while minimizing the graph's size. Graph algorithms often suffer from long execution time due to the irregularity and the large real-world graph size. Graph sparsification can be applied to greatly reduce the run time of graph algorithms by substituting the full graph with a much smaller sparsified graph, without significantly degrading the output quality. However, the interaction between numerous sparsifiers and graph properties is not widely explored, and the potential of graph sparsification is not fully understood. In this work, we cover 16 widely-used graph metrics, 12 representative graph sparsification algorithms, and 14 real-world input graphs spanning various categories, exhibiting diverse characteristics, sizes, and densities. We developed a framework to extensively assess the performance of these sparsification algorithms against graph metrics, and provide insights to the results. Our study shows that there is no one sparsifier that performs the best in preserving all graph properties, e.g. sparsifiers that preserve distance-related graph properties (eccentricity) struggle to perform well on Graph Neural Networks (GNN). This paper presents a comprehensive experimental study evaluating the performance of sparsification algorithms in preserving essential graph metrics. The insights inform future research in incorporating matching graph sparsification to graph algorithms to maximize benefits while minimizing quality degradation. Furthermore, we provide a framework to facilitate the future evaluation of evolving sparsification algorithms, graph metrics, and ever-growing graph data.


title: AcademicGPT: Empowering Academic Research

abstract: Large Language Models (LLMs) have demonstrated exceptional capabilities across various natural language processing tasks. Yet, many of these advanced LLMs are tailored for broad, general-purpose applications. In this technical report, we introduce AcademicGPT, designed specifically to empower academic research. AcademicGPT is a continual training model derived from LLaMA2-70B. Our training corpus mainly consists of academic papers, thesis, content from some academic domain, high-quality Chinese data and others. While it may not be extensive in data scale, AcademicGPT marks our initial venture into a domain-specific GPT tailored for research area. We evaluate AcademicGPT on several established public benchmarks such as MMLU and CEval, as well as on some specialized academic benchmarks like PubMedQA, SCIEval, and our newly-created ComputerScienceQA, to demonstrate its ability from general knowledge ability, to Chinese ability, and to academic ability. Building upon AcademicGPT's foundation model, we also developed several applications catered to the academic area, including General Academic Question Answering, AI-assisted Paper Reading, Paper Review, and AI-assisted Title and Abstract Generation.


title: Generating Progressive Images from Pathological Transitions via Diffusion Model

abstract: Deep learning is widely applied in computer-aided pathological diagnosis, which alleviates the pathologist workload and provide timely clinical analysis. However, most models generally require large-scale annotated data for training, which faces challenges due to the sampling and annotation scarcity in pathological images. The rapid developing generative models shows potential to generate more training samples from recent studies. However, they also struggle in generalization diversity with limited training data, incapable of generating effective samples. Inspired by the pathological transitions between different stages, we propose an adaptive depth-controlled diffusion (ADD) network to generate pathological progressive images for effective data augmentation. This novel approach roots in domain migration, where a hybrid attention strategy guides the bidirectional diffusion, blending local and global attention priorities. With feature measuring, the adaptive depth-controlled strategy ensures the migration and maintains locational similarity in simulating the pathological feature transition. Based on tiny training set (samples less than 500), the ADD yields cross-domain progressive images with corresponding soft-labels. Experiments on two datasets suggest significant improvements in generation diversity, and the effectiveness with generated progressive samples are highlighted in downstream classifications. The code is available at https://github.com/Rowerliu/ADD.


title: Deciphering Non-Gaussianity of Diffusion Based on the Evolution of Diffusivity

abstract: Non-Gaussianity indicates complex dynamics related to extreme events or significant outliers. However, the correlation between non-Gaussianity and the dynamics of heterogeneous environments in anomalous diffusion remains uncertain. Inspired by a recent study by Alexandre et al. [Phys. Rev. Lett. 130, 077101 (2023)], we demonstrate that non-Gaussianity can be deciphered through the spatiotemporal evolution of heterogeneity-dependent diffusivity. Using diffusion experiments in a linear temperature field and Brownian dynamics simulations, we found that short- and long-time non-Gaussianity can be predicted based on diffusivity distribution. Non-Gaussianity variation is determined by an effective P\'eclet number (a ratio of the varying rate of diffusivity to the diffusivity of diffusivity), which clarifies whether the tail distribution expands or contracts. The tail is more Gaussian than exponential over long times, with exceptions significantly dependent on the diffusivity distribution. Our findings shed light on heterogeneity mapping in complex environments using non-Gaussian statistics.


title: A note on cube-free problems

abstract: Eberhard and Pohoata conjectured that every $3$-cube-free subset of $[N]$ has size less than $2N/3+o(N)$. In this paper we show that if we replace $[N]$ with $\mathbb{Z}_N$ the upper bound of $2N/3$ holds, and the bound is tight when $N$ is divisible by $3$ since we have $A=\{a\in \mathbb{Z}_N:a\equiv 1,2\pmod{3}\}.$ Inspired by this observation we conjecture that every $d$-cube-free subset of $\mathbb{Z}_N$ has size less than $(d-1)N/d$ where $N$ is divisible by $d$, and we show the tightness of this bound by providing an example $B=\{b\in\mathbb{Z}_N:b\equiv 1,2,\ldots,d-1\pmod{d}\}$. We prove the conjecture for several interesting cases, including when $d$ is the smallest prime factor of $N$, or when $N$ is a prime power. We also discuss some related issues regarding $\{x,dx\}$-free sets and $\{x,2x,\ldots,dx\}$-free sets. A main ingredient we apply is to arrange all the integers into some square matrix, with $m=d^s\times l$ having the coordinate $(s+1,l-\lfloor l/d\rfloor)$. Here $d$ is a given integer and $l$ is not divisible by $d$.


title: A unified consensus-based parallel ADMM algorithm for high-dimensional regression with combined regularizations

abstract: The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical learning models. However, there is currently limited research on parallel algorithms specifically designed for high-dimensional regression with combined (composite) regularization terms. These terms, such as elastic-net, sparse group lasso, sparse fused lasso, and their nonconvex variants, have gained significant attention in various fields due to their ability to incorporate prior information and promote sparsity within specific groups or fused variables. The scarcity of parallel algorithms for combined regularizations can be attributed to the inherent nonsmoothness and complexity of these terms, as well as the absence of closed-form solutions for certain proximal operators associated with them. In this paper, we propose a unified constrained optimization formulation based on the consensus problem for these types of convex and nonconvex regression problems and derive the corresponding parallel ADMM algorithms. Furthermore, we prove that the proposed algorithm not only has global convergence but also exhibits linear convergence rate. Extensive simulation experiments, along with a financial example, serve to demonstrate the reliability, stability, and scalability of our algorithm. The R package for implementing the proposed algorithms can be obtained at https://github.com/xfwu1016/CPADMM.


title: A Survey on Multimodal Large Language Models for Autonomous Driving

abstract: With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive the real world, make decisions, and control tools as humans. In recent months, LLMs have shown widespread attention in autonomous driving and map systems. Despite its immense potential, there is still a lack of a comprehensive understanding of key challenges, opportunities, and future endeavors to apply in LLM driving systems. In this paper, we present a systematic investigation in this field. We first introduce the background of Multimodal Large Language Models (MLLMs), the multimodal models development using LLMs, and the history of autonomous driving. Then, we overview existing MLLM tools for driving, transportation, and map systems together with existing datasets and benchmarks. Moreover, we summarized the works in The 1st WACV Workshop on Large Language and Vision Models for Autonomous Driving (LLVM-AD), which is the first workshop of its kind regarding LLMs in autonomous driving. To further promote the development of this field, we also discuss several important problems regarding using MLLMs in autonomous driving systems that need to be solved by both academia and industry.


title: Design for Assurance: Employing Functional Verification Tools for Thwarting Hardware Trojan Threat in 3PIPs

abstract: Third-party intellectual property cores are essential building blocks of modern system-on-chip and integrated circuit designs. However, these design components usually come from vendors of different trust levels and may contain undocumented design functionality. Distinguishing such stealthy lightweight malicious design modification can be a challenging task due to the lack of a golden reference. In this work, we make a step towards design for assurance by developing a method for identifying and preventing hardware Trojans, employing functional verification tools and languages familiar to hardware designers. We dump synthesized design netlist mapped to a field programmable gate array technology library and perform switching as well as coverage analysis at the granularity of look-up-tables (LUTs) in order to identify specious signals and cells. We automatically extract and formally prove properties related to switching and coverage, which allows us to retrieve Trojan trigger condition. We further provide a solution to preventing Trojan from activation by reconfiguring the confirmed malicious LUTs. Experimental results have demonstrated that our method can detect and mitigate Trust-Hub as well as recently reported don't care Trojans.


title: Reinforcement Learning for Stochastic LQ Control of Discrete-Time Systems with Multiplicative Noises

abstract: This paper considers a stochastic linear quadratic problem for discrete-time systems with multiplicative noises over an infinite horizon. To obtain the optimal solution, we propose an online iterative algorithm of reinforcement learning based on Bellman dynamic programming principle. The algorithm avoids the direct calculation of algebra Riccati equations. It merely takes advantage of state trajectories over a short interval instead of all iterations, significantly simplifying the calculation process. Under the stabilizable initial values, numerical examples shed light on our theoretical results.


title: Modeling Political Orientation of Social Media Posts: An Extended Analysis

abstract: Developing machine learning models to characterize political polarization on online social media presents significant challenges. These challenges mainly stem from various factors such as the lack of annotated data, presence of noise in social media datasets, and the sheer volume of data. The common research practice typically examines the biased structure of online user communities for a given topic or qualitatively measuring the impacts of polarized topics on social media. However, there is limited work focusing on analyzing polarization at the ground-level, specifically in the social media posts themselves. Such existing analysis heavily relies on annotated data, which often requires laborious human labeling, offers labels only to specific problems, and lacks the ability to determine the near-future bias state of a social media conversations. Understanding the degree of political orientation conveyed in social media posts is crucial for quantifying the bias of online user communities and investigating the spread of polarized content. In this work, we first introduce two heuristic methods that leverage on news media bias and post content to label social media posts. Next, we compare the efficacy and quality of heuristically labeled dataset with a randomly sampled human-annotated dataset. Additionally, we demonstrate that current machine learning models can exhibit improved performance in predicting political orientation of social media posts, employing both traditional supervised learning and few-shot learning setups. We conduct experiments using the proposed heuristic methods and machine learning approaches to predict the political orientation of posts collected from two social media forums with diverse political ideologies: Gab and Twitter.


title: {\AE} codes

abstract: Diatomic molecular codes [arXiv:1911.00099] are designed to encode quantum information in the orientation of a diatomic molecule, allowing error correction from small torques and changes in angular momentum. Here, we directly study noise native to atomic and molecular platforms -- spontaneous emission, stray electromagnetic fields, and Raman scattering -- and show that diatomic molecular codes fail against this noise. We derive simple necessary and sufficient conditions for codes to protect against such noise. We also identify existing and develop new absorption-emission (\AE) codes that are more practical than molecular codes, require lower average momentum, can directly protect against photonic processes up to arbitrary order, and are applicable to a broader set of atomic and molecular systems.


title: Lattice paths and the Rogers--Ramanujan--Gordon type theorems with parity considerations

abstract: Andrews imposed parity restrictions on the Rogers-Ramanujan-Gordon type partitions, yielding fruitful results. These results were later, advanced by Kur\c{s}ung\"{o}z, Kim, and Yee. In this paper, we construct a bijection between lattice paths with three kinds of unitary steps and the Rogers--Ramanujan--Gordon type partitions. We give some results involving parity considerations on lattice paths by this bijection which are Andrews' partition results counterpart. We also give some new results on lattice paths.


title: Voltage-Dependent Electromechanical Wave Propagation Modeling for Dynamic Stability Analysis in Power Systems

abstract: Accurate dynamic modeling of power systems is essential to assess the stability of electrical power systems when faced with disturbances, which can trigger cascading failures leading to blackouts. A continuum model proves to be effective in capturing Electromechanical Wave (EMW) propagation characteristics, including its velocity, arrival time, and deviations. Analyzing these characteristics enables the assessment of the impacts of EMW on the performance of the protection system. Prior research has often modeled nonlinear EMW propagation through Partial Differential Equations (PDEs) within a homogeneous and uniform frame structure, assuming constant bus voltages across the entire power system. However, this assumption can produce inaccurate results. In this paper, we relax this assumption by introducing a second-order nonlinear hyperbolic EMW propagation equation model that accounts for voltage variations. Additionally, we present numerical solutions for the EMW propagation equation using the Lax-Wendroff integration method. To validate our approach, we conduct simulations on two test systems: a two-bus one-machine system and the New England 39-bus 10-machine system. The simulation results demonstrate the effectiveness of our proposed model and emphasize the importance of including the bus voltage equations in the analysis.


title: Enhancing Visual Grounding and Generalization: A Multi-Task Cycle Training Approach for Vision-Language Models

abstract: Visual grounding (VG) occupies a pivotal position in multi-modality vision-language models. In this study, we propose ViLaM, a large multi-modality model, that supports multi-tasks of VG using the cycle training strategy, with abundant interaction instructions. The cycle training between referring expression generation (REG) and referring expression comprehension (REC) is introduced. It enhances the consistency between visual location and referring expressions, and addresses the need for high-quality, multi-tasks VG datasets. Moreover, multi-tasks of VG are promoted in our model, contributed by the cycle training strategy. The multi-tasks in REC encompass a range of granularities, from region-level to pixel-level, which include referring bbox detection, referring keypoints detection, and referring image segmentation. In REG, referring region classification determines the fine-grained category of the target, while referring region captioning generates a comprehensive description. Meanwhile, all tasks participate in the joint training, synergistically enhancing one another and collectively improving the overall performance of the model. Furthermore, leveraging the capabilities of large language models, ViLaM extends a wide range of instructions, thereby significantly enhancing its generalization and interaction potentials. Extensive public datasets corroborate the superior capabilities of our model in VG with muti-tasks. Additionally, validating its robust generalization, ViLaM is validated under open-set and few-shot scenarios. Especially in the medical field, our model demonstrates cross-domain robust generalization capabilities. Furthermore, we contribute a VG dataset, especially with multi-tasks. To support and encourage the community focused on VG, we have made both the dataset and our code public: https://github.com/AnonymGiant/ViLaM.


title: Quantum-Enhanced Support Vector Machine for Large-Scale Stellar Classification with GPU Acceleration

abstract: In this study, we introduce an innovative Quantum-enhanced Support Vector Machine (QSVM) approach for stellar classification, leveraging the power of quantum computing and GPU acceleration. Our QSVM algorithm significantly surpasses traditional methods such as K-Nearest Neighbors (KNN) and Logistic Regression (LR), particularly in handling complex binary and multi-class scenarios within the Harvard stellar classification system. The integration of quantum principles notably enhances classification accuracy, while GPU acceleration using the cuQuantum SDK ensures computational efficiency and scalability for large datasets in quantum simulators. This synergy not only accelerates the processing process but also improves the accuracy of classifying diverse stellar types, setting a new benchmark in astronomical data analysis. Our findings underscore the transformative potential of quantum machine learning in astronomical research, marking a significant leap forward in both precision and processing speed for stellar classification. This advancement has broader implications for astrophysical and related scientific fields


title: Graph Neural Ordinary Differential Equations-based method for Collaborative Filtering

abstract: Graph Convolution Networks (GCNs) are widely considered state-of-the-art for collaborative filtering. Although several GCN-based methods have been proposed and achieved state-of-the-art performance in various tasks, they can be computationally expensive and time-consuming to train if too many layers are created. However, since the linear GCN model can be interpreted as a differential equation, it is possible to transfer it to an ODE problem. This inspired us to address the computational limitations of GCN-based models by designing a simple and efficient NODE-based model that can skip some GCN layers to reach the final state, thus avoiding the need to create many layers. In this work, we propose a Graph Neural Ordinary Differential Equation-based method for Collaborative Filtering (GODE-CF). This method estimates the final embedding by utilizing the information captured by one or two GCN layers. To validate our approach, we conducted experiments on multiple datasets. The results demonstrate that our model outperforms competitive baselines, including GCN-based models and other state-of-the-art CF methods. Notably, our proposed GODE-CF model has several advantages over traditional GCN-based models. It is simple, efficient, and has a fast training time, making it a practical choice for real-world situations.


title: A General Framework for Importance Sampling with Latent Markov Processes

abstract: Although stochastic models driven by latent Markov processes are widely used, the classical importance sampling method based on the exponential tilting method for these models suffers from the difficulty of computing the eigenvalue and associated eigenfunction and the plausibility of the indirect asymptotic large deviation regime for the variance of the estimator. We propose a general importance sampling framework that twists the observable and latent processes separately based on a link function that directly minimizes the estimator's variance. An optimal choice of the link function is chosen within the locally asymptotically normal family. We show the logarithmic efficiency of the proposed estimator under the asymptotic normal regime. As applications, we estimate an overflow probability under a pandemic model and the CoVaR, a measurement of the co-dependent financial systemic risk. Both applications are beyond the scope of traditional importance sampling methods due to their nonlinear structures.


title: $L_1$ approach to the compressible viscous fluid flows in the half-space

abstract: In this paper, we prove the local well-posedness for the Navier-Stokes equations describing the motion of isotropic barotoropic compressible viscous fluid flow with non-slip boundary conditions, where the fluid domain is the $N$ dimensional half-sapce. We solve the equations in the $L_1$ in time and Besov spaces $B^s_{q,1}$ in space maximal regularity framework. Here, we assume that $-1+N/q \leq s < 1/q$ and $N-1 < q < 2N$. We use Lagrange transformation to eliminate the convection term and we use an analytic semigroup approach. We only assume the strictly positiveness of initial mass density.


title: Vernier Spectrum and Isospin State Control in Carbon Nanotube Quantum Dots

abstract: Commensurability phenomena abound in nature and are typically associated with mismatched lengths, as can occur in quasiperiodic systems. However, not all commensuration effects are spatial in nature. In finite-sized Dirac systems, an intriguing example arises in tilted or warped Dirac cones wherein the degeneracy in the speed of right- and left-moving electrons within a given Dirac cone or valley is lifted. Bound states can be purely fast-moving or purely slow-moving, giving rise to incommensurate energy level spacings and a vernier spectrum. In this work, we present evidence for this vernier spectrum in Coulomb blockade measurements of ultraclean suspended carbon nanotube quantum dots. The addition-energy spectrum of the quantum dots reveals an energy-level structure that oscillates between aligned and misaligned energy levels. Our data suggest that the fast- and slow-moving bound states hybridize at certain gate voltages. Thus, gate-voltage tuning can select states with varying degrees of hybridization, suggesting numerous applications based on accessing this isospin-like degree of freedom.


title: QuGeo: An End-to-end Quantum Learning Framework for Geoscience -- A Case Study on Full-Waveform Inversion

abstract: The rapid advancement of quantum computing has generated considerable anticipation for its transformative potential. However, harnessing its full potential relies on identifying "killer applications". In this regard, QuGeo emerges as a groundbreaking quantum learning framework, poised to become a key application in geoscience, particularly for Full-Waveform Inversion (FWI). This framework integrates variational quantum circuits with geoscience, representing a novel fusion of quantum computing and geophysical analysis. This synergy unlocks quantum computing's potential within geoscience. It addresses the critical need for physics-guided data scaling, ensuring high-performance geoscientific analyses aligned with core physical principles. Furthermore, QuGeo's introduction of a quantum circuit custom-designed for FWI highlights the critical importance of application-specific circuit design for quantum computing. In the OpenFWI's FlatVelA dataset experiments, the variational quantum circuit from QuGeo, with only 576 parameters, achieved significant improvement in performance. It reached a Structural Similarity Image Metric (SSIM) score of 0.905 between the ground truth and the output velocity map. This is a notable enhancement from the baseline design's SSIM score of 0.800, which was achieved without the incorporation of physics knowledge.


title: Scaling-critical well-posedness for continuum Calogero-Moser models

abstract: We prove that the focusing and defocusing continuum Calogero--Moser models are well-posed in the scaling-critical space $L^2_+(\mathbb R)$. In the focusing case, this requires solutions to have mass less than that of the soliton.


title: Toughness and distance spectral radius in graphs involving minimum degree

abstract: The toughness $\tau(G)=\mathrm{min}\{\frac{|S|}{c(G-S)}: S~\mbox{is a cut set of vertices in}~G\}$ for $G\ncong K_n.$ The concept of toughness initially proposed by Chv$\mathrm{\acute{a}}$tal in 1973, which serves as a simple way to measure how tightly various pieces of a graph hold together. A graph $G$ is called $t$-tough if $\tau(G)\geq t.$ It is very interesting to investigate the relations between toughness and eigenvalues of graphs. Fan, Lin and Lu [European J. Combin. 110 (2023) 103701] provided sufficient conditions in terms of the spectral radius for a graph to be 1-tough with minimum degree $\delta$ and $t$-tough with $t\geq 1$ being an integer, respectively. By using some typical distance spectral techniques and structural analysis, we in this paper present sufficient conditions based on the distance spectral radius to guarantee a graph to be 1-tough with minimum degree $\delta.$ Moreover, we also prove sufficient conditions with respect to the distance spectral radius for a graph to be $t$-tough, where $t$ or $\frac{1}{t}$ is a positive integer.


title: Classification of Instagram fake users using supervised machine learning algorithms

abstract: In the contemporary era, online social networks have become integral to social life, revolutionizing the way individuals manage their social connections. While enhancing accessibility and immediacy, these networks have concurrently given rise to challenges, notably the proliferation of fraudulent profiles and online impersonation. This paper proposes an application designed to detect and neutralize such dishonest entities, with a focus on safeguarding companies from potential fraud. The user-centric design of the application ensures accessibility for investigative agencies, particularly the criminal branch, facilitating navigation of complex social media landscapes and integration with existing investigative procedures


title: Do Smaller Language Models Answer Contextualised Questions Through Memorisation Or Generalisation?

abstract: A distinction is often drawn between a model's ability to predict a label for an evaluation sample that is directly memorised from highly similar training samples versus an ability to predict the label via some method of generalisation. In the context of using Language Models for question-answering, discussion continues to occur as to the extent to which questions are answered through memorisation. We consider this issue for questions that would ideally be answered through reasoning over an associated context. We propose a method of identifying evaluation samples for which it is very unlikely our model would have memorised the answers. Our method is based on semantic similarity of input tokens and label tokens between training and evaluation samples. We show that our method offers advantages upon some prior approaches in that it is able to surface evaluation-train pairs that have overlap in either contiguous or discontiguous sequences of tokens. We use this method to identify unmemorisable subsets of our evaluation datasets. We train two Language Models in a multitask fashion whereby the second model differs from the first only in that it has two additional datasets added to the training regime that are designed to impart simple numerical reasoning strategies of a sort known to improve performance on some of our evaluation datasets but not on others. We then show that there is performance improvement between the two models on the unmemorisable subsets of the evaluation datasets that were expected to benefit from the additional training datasets. Specifically, performance on unmemorisable subsets of two of our evaluation datasets, DROP and ROPES significantly improves by 9.0%, and 25.7% respectively while other evaluation datasets have no significant change in performance.


title: A Survey on Large Language Models for Personalized and Explainable Recommendations

abstract: In recent years, Recommender Systems(RS) have witnessed a transformative shift with the advent of Large Language Models(LLMs) in the field of Natural Language Processing(NLP). These models such as OpenAI's GPT-3.5/4, Llama from Meta, have demonstrated unprecedented capabilities in understanding and generating human-like text. This has led to a paradigm shift in the realm of personalized and explainable recommendations, as LLMs offer a versatile toolset for processing vast amounts of textual data to enhance user experiences. To provide a comprehensive understanding of the existing LLM-based recommendation systems, this survey aims to analyze how RS can benefit from LLM-based methodologies. Furthermore, we describe major challenges in Personalized Explanation Generating(PEG) tasks, which are cold-start problems, unfairness and bias problems in RS.


title: Emergence of 2000-times higher-mobility carriers through photocarrier screening in correlated kagome magnet Mn$_3$Sn

abstract: We study extremely nonequilibrium transport in correlated kagome magnet Mn$_3$Sn by time-resolved terahertz Faraday rotation spectroscopy. When the photoinjected carrier density exceeds $\sim$10$^{20}$ cm$^{-3}$, a cyclotron resonance is clearly observed, signifying the emergence of unusual carriers with 2000-times higher mobility than those in equilibrium. The result can be attributed to a drastic change in the band structure owing to screening of the electron correlation, highlighting the significant role of many-body effects in this kagome compound in equilibrium. Our study opens up a new phase of transport properties in correlated kagome materials under highly nonequilibrium conditions.


title: Gravitational Wave Signals From Early Matter Domination: Interpolating Between Fast and Slow Transitions

abstract: An epoch of matter domination in the early universe can enhance the primordial stochastic gravitational wave signal, potentially making it detectable to upcoming gravitational wave experiments. However, the resulting gravitational wave signal is quite sensitive to the end of the early matter-dominated epoch. If matter domination ends gradually, a cancellation results in an extremely suppressed signal, while in the limit of an instantaneous transition, there is a resonant-like enhancement. The end of the matter dominated epoch cannot be instantaneous, however, and previous analyses have used a Gaussian smoothing technique to account for this, and consider only a limited regime around the fast transition limit. In this work, we present a study of the enhanced gravitational wave signal from early matter domination without making either approximation and show how the signal smoothly evolves from the strongly suppressed to strongly enhanced regimes.


title: Game Theoretic Application to Intersection Management: A Literature Review

abstract: The emergence of vehicle-to-everything (V2X) technology offers new insights into intersection management. This, however, has also presented new challenges, such as the need to understand and model the interactions of traffic participants, including their competition and cooperation behaviors. Game theory has been widely adopted to study rationally selfish or cooperative behaviors during interactions and has been applied to advanced intersection management. In this paper, we review the application of game theory to intersection management and sort out relevant studies under various levels of intelligence and connectivity. First, the problem of urban intersection management and its challenges are briefly introduced. The basic elements of game theory specifically for intersection applications are then summarized. Next, we present the game-theoretic models and solutions that have been applied to intersection management. Finally, the limitations and potential opportunities for subsequent studies within the game-theoretic application to intersection management are discussed.


title: LoCo: Locally Constrained Training-Free Layout-to-Image Synthesis

abstract: Recent text-to-image diffusion models have reached an unprecedented level in generating high-quality images. However, their exclusive reliance on textual prompts often falls short in precise control of image compositions. In this paper, we propose LoCo, a training-free approach for layout-to-image Synthesis that excels in producing high-quality images aligned with both textual prompts and layout instructions. Specifically, we introduce a Localized Attention Constraint (LAC), leveraging semantic affinity between pixels in self-attention maps to create precise representations of desired objects and effectively ensure the accurate placement of objects in designated regions. We further propose a Padding Token Constraint (PTC) to leverage the semantic information embedded in previously neglected padding tokens, improving the consistency between object appearance and layout instructions. LoCo seamlessly integrates into existing text-to-image and layout-to-image models, enhancing their performance in spatial control and addressing semantic failures observed in prior methods. Extensive experiments showcase the superiority of our approach, surpassing existing state-of-the-art training-free layout-to-image methods both qualitatively and quantitatively across multiple benchmarks.


title: Enhanced sensitivity of partial O-terminated H-diamond for H2S detection at room temperature

abstract: The p-type surface conductivity of H-terminated diamond (HD) has opened new path ways to develop diamond based electronic devices, photo-catalysts, chemical and bio-sensors. Herein, we report on the room temperature H2S detection behaviour of pristine HD and the surface modified HD films with partial O-termination (OHD) through ozonation. The response of the pristine HD and partial OHD devices that are ozonated for 30, 60 and 90 s, is found to be ~ 55, 1420, 810 and 95 % respectively, for exposing 900 ppb of H2S under ambient atmosphere at room temperature. Here, the optimally partial OHD sensor displays an enhanced sensitivity by about an order of magnitude due to the catalytic activity of the sparsely populated O-functional groups on HD surface. Moreover, the gas sensor response is found to be higher in wet background atmospheres such as N2 and synthetic air as compared to their respective dry atmospheres. Also, the response curve of these sensors exhibits a peculiar decrease in resistance immediately after exposure to H2S under wet background atmosphere while such oxidative behaviour is absent under dry atmospheres. Based on these observations, the plausible sensing mechanism of these H-diamond based sensors is proposed with the concept of humidity induced H2S hydrolyzation.


title: Modality Mixer Exploiting Complementary Information for Multi-modal Action Recognition

abstract: Due to the distinctive characteristics of sensors, each modality exhibits unique physical properties. For this reason, in the context of multi-modal action recognition, it is important to consider not only the overall action content but also the complementary nature of different modalities. In this paper, we propose a novel network, named Modality Mixer (M-Mixer) network, which effectively leverages and incorporates the complementary information across modalities with the temporal context of actions for action recognition. A key component of our proposed M-Mixer is the Multi-modal Contextualization Unit (MCU), a simple yet effective recurrent unit. Our MCU is responsible for temporally encoding a sequence of one modality (e.g., RGB) with action content features of other modalities (e.g., depth and infrared modalities). This process encourages M-Mixer network to exploit global action content and also to supplement complementary information of other modalities. Furthermore, to extract appropriate complementary information regarding to the given modality settings, we introduce a new module, named Complementary Feature Extraction Module (CFEM). CFEM incorporates sepearte learnable query embeddings for each modality, which guide CFEM to extract complementary information and global action content from the other modalities. As a result, our proposed method outperforms state-of-the-art methods on NTU RGB+D 60, NTU RGB+D 120, and NW-UCLA datasets. Moreover, through comprehensive ablation studies, we further validate the effectiveness of our proposed method.


title: Stable Diffusion For Aerial Object Detection

abstract: Aerial object detection is a challenging task, in which one major obstacle lies in the limitations of large-scale data collection and the long-tail distribution of certain classes. Synthetic data offers a promising solution, especially with recent advances in diffusion-based methods like stable diffusion (SD). However, the direct application of diffusion methods to aerial domains poses unique challenges: stable diffusion's optimization for rich ground-level semantics doesn't align with the sparse nature of aerial objects, and the extraction of post-synthesis object coordinates remains problematic. To address these challenges, we introduce a synthetic data augmentation framework tailored for aerial images. It encompasses sparse-to-dense region of interest (ROI) extraction to bridge the semantic gap, fine-tuning the diffusion model with low-rank adaptation (LORA) to circumvent exhaustive retraining, and finally, a Copy-Paste method to compose synthesized objects with backgrounds, providing a nuanced approach to aerial object detection through synthetic data.


title: Searching for doubly charmed baryon from $\overline{B}_c$ meson decays

abstract: In this paper, we study the production of doubly charmed baryon from anti-bottom charmed meson. Using the effective Lagrangian approach, we discuss triangle diagrams in hadronic level to get access to the branching ratios of $\overline{B}_c\to \mathcal{B}_{ccq}+\mathcal{B}_{\bar c\bar q\bar q}$. It seems that the specific process $\overline {B}_c \to \Xi_{cc}^{++} \, \overline {\Xi}_{\bar c}^{'-}$ occupies the largest possibility in the order of $6.68\times 10^{-6}$. In addition, although the production of undiscovered $\Omega_{cc}^+$ is Cabibbo suppressed in $\overline B_c\to \Omega_{cc}^+ \, \overline {\Xi}_{\bar c}^0$, it's branching ratio can still reach $10^{-7}$ level. These results are excepted to be fairly valuable supports for future experiments.


title: Bayesian Cluster Geographically Weighted Regression for Spatial Heterogeneous Data

abstract: Spatial statistical models are commonly used in geographical scenarios to ensure spatial variation is captured effectively. However, spatial models and cluster algorithms can be complicated and expensive. This paper pursues three main objectives. First, it introduces covariate effect clustering by integrating a Bayesian Geographically Weighted Regression (BGWR) with a Gaussian mixture model and the Dirichlet process mixture model. Second, this paper examines situations in which a particular covariate holds significant importance in one region but not in another in the Bayesian framework. Lastly, it addresses computational challenges present in existing BGWR, leading to notable enhancements in Markov chain Monte Carlo estimation suitable for large spatial datasets. The efficacy of the proposed method is demonstrated using simulated data and is further validated in a case study examining children's development domains in Queensland, Australia, using data provided by Children's Health Queensland and Australia's Early Development Census.


title: Huber rings and valuation spectra

abstract: These notes expand a four-hour lecture course given in Heidelberg in March 2023, as part of the "Spring School on non-Archimedean Geometry and Eigenvarieties". They are designed for graduate students and other learners. We introduce Huber rings and valuation theory alongside frequent examples. The notes are largely self-contained, though many details are given in exercises found following each lecture.


title: Spatial Non-parametric Bayesian Clustered Coefficients

abstract: In the field of population health research, understanding the similarities between geographical areas and quantifying their shared effects on health outcomes is crucial. In this paper, we synthesise a number of existing methods to create a new approach that specifically addresses this goal. The approach is called a Bayesian spatial Dirichlet process clustered heterogeneous regression model. This non-parametric framework allows for inference on the number of clusters and the clustering configurations, while simultaneously estimating the parameters for each cluster. We demonstrate the efficacy of the proposed algorithm using simulated data and further apply it to analyse influential factors affecting children's health development domains in Queensland. The study provides valuable insights into the contributions of regional similarities in education and demographics to health outcomes, aiding targeted interventions and policy design.


title: Localized Floquet states in gated bilayer graphene induced by a focused optical beam with orbital angular momentum

abstract: We theoretically studied the Floquet state of gated bilayer graphene, which is irradiated by normally incident focused Gaussian beam with orbital angular momentum (OAM). According to the Floquet theory, in-plane and out-of-plane electric field of the OAM beam periodically perturbs the intralayer and interlayer hopping, which are equivalent to the presence of effective staggered sublattice potential and next-nearest neighboring interlayer hopping within the light spot region, respectively. The combination of the effective terms and the gated voltage form an effective trapping potential, which hosts localized quantum states with energy level being within the energy gap of the non-irradiated gated bilayer graphene. The energy spectrum can be tuned by the amplitude of the optical beam and additional static magnetic field. By engineering the parameters, valley-polarized two-fold degenerated zero energy Floquet states can be induced.


title: Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey

abstract: Transformer-based Large Language Models (LLMs) have been applied in diverse areas such as knowledge bases, human interfaces, and dynamic agents, and marking a stride towards achieving Artificial General Intelligence (AGI). However, current LLMs are predominantly pretrained on short text snippets, which compromises their effectiveness in processing the long-context prompts that are frequently encountered in practical scenarios. This article offers a comprehensive survey of the recent advancement in Transformer-based LLM architectures aimed at enhancing the long-context capabilities of LLMs throughout the entire model lifecycle, from pre-training through to inference. We first delineate and analyze the problems of handling long-context input and output with the current Transformer-based models. We then provide a taxonomy and the landscape of upgrades on Transformer architecture to solve these problems. Afterwards, we provide an investigation on wildly used evaluation necessities tailored for long-context LLMs, including datasets, metrics, and baseline models, as well as optimization toolkits such as libraries, frameworks, and compilers to boost the efficacy of LLMs across different stages in runtime. Finally, we discuss the challenges and potential avenues for future research. A curated repository of relevant literature, continuously updated, is available at https://github.com/Strivin0311/long-llms-learning.


title: Integral representations for products of two solutions of the Airy equation with shifted arguments and their applications in physics

abstract: Integral representations for a complete set of linearly independent products of two solutions of the Airy equation whose arguments differ by $z_0$ are obtained using the Laplace contour integral method. This generalizes similar integral representations for the case $z_0=0$ obtained by Reid. The relation to other previous results is discussed. The results are used to obtain the outgoing-wave Green's function for an electron in a static electric field in a closed analytic form.


title: Hierarchical Framework for Predicting Entropies in Bottom-Up Coarse-Grained Models

abstract: The thermodynamic entropy of coarse-grained (CG) models stands as one of the most important properties for quantifying the missing information during the CG process and for establishing transferable (or extendible) CG interactions. However, performing additional CG simulations on top of model construction often leads to significant additional computational overhead. In this work, we propose a simple hierarchical framework for predicting the thermodynamic entropies of various molecular CG systems. Our approach employs a decomposition of the CG interactions, enabling the estimation of the CG partition function and thermodynamic properties a priori. Starting from the ideal gas description, we leverage classical perturbation theory to systematically incorporate simple yet essential interactions, ranging from the hard sphere model to the generalized van der Waals model. Additionally, we propose an alternative approach based on multiparticle correlation functions, allowing for systematic improvements through higher-order correlations. Numerical applications to molecular liquids validate the high fidelity of our approach, and our computational protocols demonstrate that a reduced model with simple energetics can reasonably estimate the thermodynamic entropy of CG models without performing any CG simulations. Overall, our findings present a systematic framework for estimating not only the entropy but also other thermodynamic properties of CG models, relying solely on information from the reference system.

categories: physics.chem-ph cond-mat.mes-hall cond-mat.soft cond-mat.stat-mech physics.comp-ph


title: Black Hole Shadows in Einstein-Bel-Robinson Gravity

abstract: Gravity models given by higher-order scalar curvature corrections are believed to bear important consequences. The Einstein-Bel-Robinson gravity, with quartic curvature modification, motivated Sajadi et al to explore static spherically symmetric black hole solutions with perturbative methods. In this paper, inspired by their work, we investigate AdS black hole shadows in EBR gravity. Moreover, we demonstrate how the gravity parameter alters the energy emission rate. Finally, we handle the same problem in the presence of plasma, since the black holes are thought to be surrounded by a medium that changes the geodesic of photons.


title: Utilizing Language Models for Tour Itinerary Recommendation

abstract: Tour itinerary recommendation involves planning a sequence of relevant Point-of-Interest (POIs), which combines challenges from the fields of both Operations Research (OR) and Recommendation Systems (RS). As an OR problem, there is the need to maximize a certain utility (e.g., popularity of POIs in the tour) while adhering to some constraints (e.g., maximum time for the tour). As a RS problem, it is heavily related to problem or filtering or ranking a subset of POIs that are relevant to a user and recommending it as part of an itinerary. In this paper, we explore the use of language models for the task of tour itinerary recommendation and planning. This task has the unique requirement of recommending personalized POIs relevant to users and planning these POIs as an itinerary that satisfies various constraints. We discuss some approaches in this area, such as using word embedding techniques like Word2Vec and GloVe for learning POI embeddings and transformer-based techniques like BERT for generating itineraries.


title: Random Linear Projections Loss for Hyperplane-Based Optimization in Neural Networks

abstract: Advancing loss function design is pivotal for optimizing neural network training and performance. This work introduces Random Linear Projections (RLP) loss, a novel approach that enhances training efficiency by leveraging geometric relationships within the data. Distinct from traditional loss functions that target minimizing pointwise errors, RLP loss operates by minimizing the distance between sets of hyperplanes connecting fixed-size subsets of feature-prediction pairs and feature-label pairs. Our empirical evaluations, conducted across benchmark datasets and synthetic examples, demonstrate that neural networks trained with RLP loss outperform those trained with traditional loss functions, achieving improved performance with fewer data samples, and exhibiting greater robustness to additive noise. We provide theoretical analysis supporting our empirical findings.


title: Electrodynamics with violations of Lorentz and U(1) gauge symmetries and their Hamiltonian structure

abstract: This article aims to study the Lorentz/U(1) gauge symmetry-breaking electrodynamics in the framework of the Standard-Model Extension and analyze the Hamiltonian structure for the theory with a specific dimension $d\leq 4$ of Lorentz breaking operators. For this purpose, we consider a general quadratic action of the modified electrodynamics with Lorentz/gauge-breaking operators and calculate the number of independent components of the operators at different dimensions in gauge invariance and breaking. With this general action, we then analyze how the Lorentz/gauge symmetry-breaking can change the Hamiltonian structure of the theories by considering Lorentz/gauge-breaking operators with dimension $d\leq 4$ as examples. We show that the Lorentz-breaking operators with gauge invariance do not change the classes of the constraints of the theory and the number of the physical degrees of freedom of the standard Maxwell's electrodynamics. When the U(1) gauge symmetry-breaking operators are present, the theories in general lack first-class constraint and have one additional physical degree of freedom, compared to the standard Maxwell's electrodynamics.


title: Federated Learning via Consensus Mechanism on Heterogeneous Data: A New Perspective on Convergence

abstract: Federated learning (FL) on heterogeneous data (non-IID data) has recently received great attention. Most existing methods focus on studying the convergence guarantees for the global objective. While these methods can guarantee the decrease of the global objective in each communication round, they fail to ensure risk decrease for each client. In this paper, to address the problem,we propose FedCOME, which introduces a consensus mechanism to enforce decreased risk for each client after each training round. In particular, we allow a slight adjustment to a client's gradient on the server side, which generates an acute angle between the corrected gradient and the original ones of other clients. We theoretically show that the consensus mechanism can guarantee the convergence of the global objective. To generalize the consensus mechanism to the partial participation FL scenario, we devise a novel client sampling strategy to select the most representative clients for the global data distribution. Training on these selected clients with the consensus mechanism could empirically lead to risk decrease for clients that are not selected. Finally, we conduct extensive experiments on four benchmark datasets to show the superiority of FedCOME against other state-of-the-art methods in terms of effectiveness, efficiency and fairness. For reproducibility, we make our source code publicly available at: \url{https://github.com/fedcome/fedcome}.


title: Shedding the Bits: Pushing the Boundaries of Quantization with Minifloats on FPGAs

abstract: Post-training quantization (PTQ) is a powerful technique for model compression, reducing the numerical precision in neural networks without additional training overhead. Recent works have investigated adopting 8-bit floating-point formats(FP8) in the context of PTQ for model inference. However, floating-point formats smaller than 8 bits and their relative comparison in terms of accuracy-hardware cost with integers remains unexplored on FPGAs. In this work, we present minifloats, which are reduced-precision floating-point formats capable of further reducing the memory footprint, latency, and energy cost of a model while approaching full-precision model accuracy. We implement a custom FPGA-based multiply-accumulate operator library and explore the vast design space, comparing minifloat and integer representations across 3 to 8 bits for both weights and activations. We also examine the applicability of various integerbased quantization techniques to minifloats. Our experiments show that minifloats offer a promising alternative for emerging workloads such as vision transformers.


title: Ultrathin liquid crystal metasurface for on-demand terahertz beam forming over 110{\deg} field-of-view

abstract: The terahertz spectral region, which bridges between electronics and optics, is poised to play an important role in the development of transformative wireless communication and imaging systems with unprecedented functionality. Currently, a major challenge in terahertz technology is to develop high-performance terahertz beam-forming devices that can dynamically shape the terahertz radiation in a flexible manner. Existing terahertz beam-forming devices have limited coding bits, field-of-view, and beam gain. Here, we experimentally demonstrate a reconfigurable liquid crystal-integrated terahertz metasurface, with each metasurface unit cell being independently addressable. The metasurface has a 260{\deg} continuous phase tuning range with a device thickness of only 1% of the free-space wavelength. We show that the terahertz wave diffracted from the metasurface can be steered towards a wide range of directions, covering a record-large 110{\deg} field-of-view with a peak gain of 25 dBi. The metasurface also features a low power consumption and sub-second switching time. Furthermore, we demonstrate the formation of multiple terahertz beams, with the direction of each beam and the power ratio between beams adjustable on demand. The proposed liquid crystal metasurface possesses compelling prospects for future terahertz communication and imaging applications.


title: Evidence of filamentary superconductivity in pressurized La3Ni2O7

abstract: Recently, the signatures of superconductivity near 80 K have been discovered in the single crystal of La3Ni2O7 under pressure, which makes it a new candidate of the high-temperature superconductors dominated by 3d transition elements after the cuprate and iron-pnictide superconductors, and thus has attracted significant attention. However, the superconductivity, characterized by the zero resistance and the Meissner effect, is anomalously irreproducible in the compressed La3Ni2O7. In this study, we report the experimental results obtained through highly sensitive modulated ac susceptibility measurements, which reveal that the maximum superconducting volume fraction in the La3Ni2O7 sample is only approximately 1% (employing superconducting element vanadium as a reference). In tandem with our observation of the zero-resistance state only in some of the samples, we suggest that the superconductivity in this nickelate is filamentary-like. In combination of our scanning transmission electron microscopy (STEM) investigations, we propose that the filamentary superconductivity most likely emerges at the interface between the La3Ni2O7 and La4Ni3O10 phases. Further, the connection of the oxygen vacancy in La3Ni2O7 with the presence of superconductivity and superconducting transition temperature (Tc) has been established, through which the upper and lower bounds of the oxygen content for the presence of superconductivity were determined to be 6.89 and 7.35, respectively. Our results not only provide new insights into understanding the puzzling issues in this material, but also highlight a new route for exploring new high-Tc nickelate superconductors with a higher superconducting volume fraction, as well as pose a new challenge in comprehending the complex nature of this filamentary superconductivity.


title: Genuinely accessible and inaccessible entanglement in Schwarzschild black hole

abstract: The genuine entanglement of Dirac fields for an N-partite system is investigated in Schwarzschild spacetime and the analysis is carried out using the single-mode approximation. Due to the Hawking effect, quantum entanglement is divided into two parts physically accessible and inaccessible entanglement. We obtain a general analytic expression of genuine N-partite entanglement that includes all accessible and inaccessible entanglement in a Schwarzschild black hole. Unlike bosonic entanglement, the accessible N-partite entanglement of Dirac fields monotonically decreases to a nonzero value with the Hawking temperature. Interestingly, the inaccessible N-partite entanglement is a monotonic or non-monotonic function of the Hawking temperature, depending on the ratio between accessible and inaccessible modes, in contrast to bipartite or tripartite entanglement that is only a monotonic function of the Hawking temperature. Finally, we obtain two restrictive relationships for the quantum information of the black hole. This conclusion provides a new understanding of Hawking effect of the black hole.


title: Faraday rotation as a probe of radio galaxy environment in RMHD AGN jet simulations

abstract: Active galactic nuclei (AGN) play an integral role in galaxy formation and evolution by influencing galaxies and their environments through radio jet feedback. Historically, interpreting observations of radio galaxies and quantifying radio jet feedback has been challenging due to degeneracies between their physical parameters. In particular, it is well-established that different combinations of jet kinetic power and environment density can yield indistinguishable radio continuum properties, including apparent size and Stokes I luminosity. We present an approach to breaking this degeneracy by probing the line-of-sight environment with Faraday rotation. We study this effect in simulations of three-dimensional relativistic magnetohydrodynamic AGN jets in idealised environments with turbulent magnetic fields. We generate synthetic Stokes I emission and Faraday rotation measure (RM) maps, which enable us to distinguish between our simulated sources. We find enhanced RMs near the jet head and lobe edges and an RM reversal across the jet axis. We show that increasing the environment density and the average cluster magnetic field strength broadens the distribution of Faraday rotation measure values. We study the depolarisation properties of our sources, finding that the hotspot regions depolarise at lower frequencies than the lobes. We quantify the effect of depolarisation on the RM distribution, finding that the frequency at which the source is too depolarised to measure the RM distribution accurately is a probe of environmental properties. This technique offers a range of new opportunities for upcoming surveys, including probing radio galaxy environments and determining more accurate estimates of the AGN feedback budget.


title: Semi-supervised Medical Image Segmentation via Query Distribution Consistency

abstract: Semi-supervised learning is increasingly popular in medical image segmentation due to its ability to leverage large amounts of unlabeled data to extract additional information. However, most existing semi-supervised segmentation methods focus only on extracting information from unlabeled data. In this paper, we propose a novel Dual KMax UX-Net framework that leverages labeled data to guide the extraction of information from unlabeled data. Our approach is based on a mutual learning strategy that incorporates two modules: 3D UX-Net as our backbone meta-architecture and KMax decoder to enhance the segmentation performance. Extensive experiments on the Atrial Segmentation Challenge dataset have shown that our method can significantly improve performance by merging unlabeled data. Meanwhile, our framework outperforms state-of-the-art semi-supervised learning methods on 10\% and 20\% labeled settings. Code located at: https://github.com/Rows21/DK-UXNet.


title: Designing Problem Sessions for Algorithmic Subjects to Boost Student Confidence

abstract: In this paper, we describe how we changed the structure of problem sessions in an algorithmic subject, in order to improve student confidence. The subject in question is taught to very large cohorts of (around 900) students, though our approach can be applied more broadly. We reflect on our experiences over a number of years, including during the pandemic, and show that by adding clear sectioning indicating the style of the questions and by including simple warm-up questions, student engagement and confidence improves, while making the teaching activities of our teaching assistants easier to manage.


title: Effect of geometrical, operational and material parameters in the lubrication regime of hard-on-hard hip implants

abstract: Several factors, such as the material, geometry, roughness, relative angular movement and loading conditions, influence the hip implant's lubrication regime, thereby affecting the friction and wear performance including longevity. In this study, a ball-on-plane model is considered to predict the lubrication regime across the entire gait cycle for the metal-on-metal and ceramic-on-ceramic hip implants. According to ISO 14242-1, a normal walking gait cycle is considered for the loads and rotations in the hip implant for this study. A comprehensive analysis is done to estimate the lubrication regime by considering different material combinations, body weights, femoral head sizes, clearances, and roughness across the entire gait cycle. The correlation coefficients show that the geometrical parameters are dominant in affecting the lubrication film thickness compared to the operational and material parameters. The femoral head size and body weight are found to be the most dominant and least dominant parameter respectively. Among the hard-on-hard tribo-pair, ceramics operate predominantly in the full-film lubrication regime compared to metals due to its fine surface finish. The present research suggests that in order to maximise the longevity of a hip implant, an orthopaedic surgeon should choose one with a larger femoral head diameter, less clearance, and an ultra-fine surface finish, regardless of any tribo-pair.


abstract: We study how to design learning-based adaptive controllers that enable fast and accurate online adaptation in changing environments. In these settings, learning is typically done during an initial (offline) design phase, where the vehicle is exposed to different environmental conditions and disturbances (e.g., a drone exposed to different winds) to collect training data. Our work is motivated by the observation that real-world disturbances fall into two categories: 1) those that can be directly monitored or controlled during training, which we call "manageable", and 2) those that cannot be directly measured or controlled (e.g., nominal model mismatch, air plate effects, and unpredictable wind), which we call "latent". Imprecise modeling of these effects can result in degraded control performance, particularly when latent disturbances continuously vary. This paper presents the Hierarchical Meta-learning-based Adaptive Controller (HMAC) to learn and adapt to such multi-source disturbances. Within HMAC, we develop two techniques: 1) Hierarchical Iterative Learning, which jointly trains representations to caption the various sources of disturbances, and 2) Smoothed Streaming Meta-Learning, which learns to capture the evolving structure of latent disturbances over time (in addition to standard meta-learning on the manageable disturbances). Experimental results demonstrate that HMAC exhibits more precise and rapid adaptation to multi-source disturbances than other adaptive controllers.


title: Limiting spectral distribution of random self-adjoint quantum channels

abstract: We study the limiting spectral distribution of quantum channels whose Kraus operators are sampled as $n\times n$ random Hermitian matrices satisfying certain assumptions. We show that when the Kraus rank goes to infinity with n, the limiting spectral distribution (suitably rescaled) of the corresponding quantum channel coincides with the semi-circle distribution. When the Kraus rank is fixed, the limiting spectral distribution is no longer the semi-circle distribution. It corresponds to an explicit law, which can also be described using tools from free probability.


title: The Rapid ASKAP Continuum Survey V: cataloguing the sky at 1367.5 MHz and the second data release of RACS-mid

abstract: The Australian SKA Pathfinder (ASKAP) has surveyed the sky at multiple frequencies as part of the Rapid ASKAP Continuum Survey (RACS). The first two RACS observing epochs, at 887.5 (RACS-low) and 1367.5 (RACS-mid) MHz, have been released (McConnell et al., 2020; Duchesne et al., 2023). A catalogue of radio sources from RACS-low has also been released, covering the sky south of declination +30$^\circ$ (Hale et al., 2021). With this paper, we describe and release the first set of catalogues from RACS-mid, covering the sky below declination +49$^\circ$. The catalogues are created in a similar manner to the RACS-low catalogue, and we discuss this process and highlight additional changes. The general purpose primary catalogue covering 36 200 deg$^2$ features a variable angular resolution to maximise sensitivity and sky coverage across the catalogued area, with a median angular resolution of 11.2" times 9.3". The primary catalogue comprises 3 105 668 radio sources, including those in the Galactic Plane (2 861 923 excluding Galactic latitudes of $|b|<5^\circ$) and we estimate the catalogue to be 95% complete for sources above 1.6 mJy. With the primary catalogue, we also provide two auxiliary catalogues. The first is a fixed-resolution, 25-arcsec catalogue approximately matching the sky coverage of the RACS-low catalogue. This 25-arcsec catalogue is constructed identically to the primary catalogue, except images are convolved to a less-sensitive 25-arcsec angular resolution. The second auxiliary catalogue is designed for time-domain science, and is the concatenation of source-lists from the original RACS-mid images with no additional convolution, mosaicking, or de-duplication of source entries to avoid losing time-variable signals. All three RACS-mid catalogues, and all RACS data products, are available through the CSIRO ASKAP Science Data Archive (CASDA).


abstract: In this note, we numerically estimate Colding-Minicozzi entropies of some self-shrinkers and get that Colding-Minicozzi entropies of $n$-dimensional Angenent torus are decreasing about dimension $n$ ($2\leq n\leq 5*10^7$), which partially answer the questions of Berchenko-Kogan \cite{BK}.


title: AudioLog: LLMs-Powered Long Audio Logging with Hybrid Token-Semantic Contrastive Learning

abstract: Previous studies in automated audio captioning have faced difficulties in accurately capturing the complete temporal details of acoustic scenes and events within long audio sequences. This paper presents AudioLog, a large language models (LLMs)-powered audio logging system with hybrid token-semantic contrastive learning. Specifically, we propose to fine-tune the pre-trained hierarchical token-semantic audio Transformer by incorporating contrastive learning between hybrid acoustic representations. We then leverage LLMs to generate audio logs that summarize textual descriptions of the acoustic environment. Finally, we evaluate the AudioLog system on two datasets with both scene and event annotations. Experiments show that the proposed system achieves exceptional performance in acoustic scene classification and sound event detection, surpassing existing methods in the field. Further analysis of the prompts to LLMs demonstrates that AudioLog can effectively summarize long audio sequences. To the best of our knowledge, this approach is the first attempt to leverage LLMs for summarizing long audio sequences.


title: Malicious URL Detection via Pretrained Language Model Guided Multi-Level Feature Attention Network

abstract: The widespread use of the Internet has revolutionized information retrieval methods. However, this transformation has also given rise to a significant cybersecurity challenge: the rapid proliferation of malicious URLs, which serve as entry points for a wide range of cyber threats. In this study, we present an efficient pre-training model-based framework for malicious URL detection. Leveraging the subword and character-aware pre-trained model, CharBERT, as our foundation, we further develop three key modules: hierarchical feature extraction, layer-aware attention, and spatial pyramid pooling. The hierarchical feature extraction module follows the pyramid feature learning principle, extracting multi-level URL embeddings from the different Transformer layers of CharBERT. Subsequently, the layer-aware attention module autonomously learns connections among features at various hierarchical levels and allocates varying weight coefficients to each level of features. Finally, the spatial pyramid pooling module performs multiscale downsampling on the weighted multi-level feature pyramid, achieving the capture of local features as well as the aggregation of global features. The proposed method has been extensively validated on multiple public datasets, demonstrating a significant improvement over prior works, with the maximum accuracy gap reaching 8.43% compared to the previous state-of-the-art method. Additionally, we have assessed the model's generalization and robustness in scenarios such as cross-dataset evaluation and adversarial attacks. Finally, we conducted real-world case studies on the active phishing URLs.