title: Diverse Intra- and Inter-Domain Activity Style Fusion for Cross-Person Generalization in Activity Recognition

abstract: Existing domain generalization (DG) methods for cross-person generalization tasks often face challenges in capturing intra- and inter-domain style diversity, resulting in domain gaps with the target domain. In this study, we explore a novel perspective to tackle this problem, a process conceptualized as domain padding. This proposal aims to enrich the domain diversity by synthesizing intra- and inter-domain style data while maintaining robustness to class labels. We instantiate this concept using a conditional diffusion model and introduce a style-fused sampling strategy to enhance data generation diversity. In contrast to traditional condition-guided sampling, our style-fused sampling strategy allows for the flexible use of one or more random styles to guide data synthesis. This feature presents a notable advancement: it allows for the maximum utilization of possible permutations and combinations among existing styles to generate a broad spectrum of new style instances. Empirical evaluations on a board of datasets demonstrate that our generated data achieves remarkable diversity within the domain space. Both intra- and inter-domain generated data have proven to be significant and valuable, contributing to varying degrees of performance enhancements. Notably, our approach outperforms state-of-the-art DG methods in all human activity recognition tasks.


title: Contrastive explainable clustering with differential privacy

abstract: This paper presents a novel approach in Explainable AI (XAI), integrating contrastive explanations with differential privacy in clustering methods. For several basic clustering problems, including $k$-median and $k$-means, we give efficient differential private contrastive explanations that achieve essentially the same explanations as those that non-private clustering explanations can obtain. We define contrastive explanations as the utility difference between the original clustering utility and utility from clustering with a specifically fixed centroid. In each contrastive scenario, we designate a specific data point as the fixed centroid position, enabling us to measure the impact of this constraint on clustering utility under differential privacy. Extensive experiments across various datasets show our method's effectiveness in providing meaningful explanations without significantly compromising data privacy or clustering utility. This underscores our contribution to privacy-aware machine learning, demonstrating the feasibility of achieving a balance between privacy and utility in the explanation of clustering tasks.


title: Superradiance of rotating black holes surrounded by dark matter

abstract: In rotating black hole background surrounded by dark matter, we investigated the super-radiant phenomenon of massive scalar field and its associated instability.Using the method of asymptotic matching, we computed the amplification factor of scalar wave scattering to assess the strength of super-radiance. We discussed the influence of dark matter density on amplification factor in this black hole background. Our result indicates that the presence of dark matter has suppressive influence on black hole super-radiance. We also computed the net extracted energy to further support this result. Finally, we analyzed the super-radiant instability caused by massive scalar field using the black hole bomb mechanism and found that the presence of dark matter has no influence on the super-radiant instability condition.


title: Revisiting Attention Weights as Interpretations of Message-Passing Neural Networks

abstract: The self-attention mechanism has been adopted in several widely-used message-passing neural networks (MPNNs) (e.g., GATs), which adaptively controls the amount of information that flows along the edges of the underlying graph. This usage of attention has made such models a baseline for studies on explainable AI (XAI) since interpretations via attention have been popularized in various domains (e.g., natural language processing and computer vision). However, existing studies often use naive calculations to derive attribution scores from attention, and do not take the precise and careful calculation of edge attribution into consideration. In our study, we aim to fill the gap between the widespread usage of attention-enabled MPNNs and their potential in largely under-explored explainability, a topic that has been actively investigated in other areas. To this end, as the first attempt, we formalize the problem of edge attribution from attention weights in GNNs. Then, we propose GATT, an edge attribution calculation method built upon the computation tree. Through comprehensive experiments, we demonstrate the effectiveness of our proposed method when evaluating attributions from GATs. Conversely, we empirically validate that simply averaging attention weights over graph attention layers is insufficient to interpret the GAT model's behavior. Code is publicly available at https://github.com/jordan7186/GAtt/tree/main.


title: Dephasingless two-color terahertz generation

abstract: A laser pulse composed of a fundamental and an appropriately phased second harmonic can drive a time-dependent current of photoionized electrons that generates broadband THz radiation. Over the propagation distances relevant to many experiments, dispersion causes the relative phase between the harmonics to evolve. This "dephasing" slows the accumulation of THz energy and results in a multi-cycle THz pulse with significant angular dispersion. Here, we introduce a novel optical configuration that compensates the relative phase evolution, allowing for the formation of a half-cycle THz pulse with almost no angular dispersion. The configuration uses the spherical aberration of an axilens to map a prescribed radial phase variation in the near field to a desired longitudinal phase variation in the far field. Simulations that combine this configuration with an ultrashort flying focus demonstrate the formation of a half-cycle THz pulse with a controlled emission angle and 1/4 the angular divergence of the multi-cycle pulse created by a conventional optical configuration.


title: LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model

abstract: Large language models (LLMs), including both proprietary and open-source models, have showcased remarkable capabilities in addressing a wide range of downstream tasks. Nonetheless, when it comes to practical Chinese legal tasks, these models fail to meet the actual requirements. Proprietary models do not ensure data privacy for sensitive legal cases, while open-source models demonstrate unsatisfactory performance due to their lack of legal knowledge. To address this problem, we introduce LawGPT, the first open-source model specifically designed for Chinese legal applications. LawGPT comprises two key components: legal-oriented pre-training and legal supervised fine-tuning. Specifically, we employ large-scale Chinese legal documents for legal-oriented pre-training to incorporate legal domain knowledge. To further improve the model's performance on downstream legal tasks, we create a knowledge-driven instruction dataset for legal supervised fine-tuning. Our experimental results demonstrate that LawGPT outperforms the open-source LLaMA 7B model. Our code and resources are publicly available at https://github.com/pengxiao-song/LaWGPT and have received 5.7K stars on GitHub.


title: What do MLLMs hear? Examining reasoning with text and sound components in Multimodal Large Language Models

abstract: Large Language Models (LLMs) have demonstrated remarkable reasoning capabilities, notably in connecting ideas and adhering to logical rules to solve problems. These models have evolved to accommodate various data modalities, including sound and images, known as multimodal LLMs (MLLMs), which are capable of describing images or sound recordings. Previous work has demonstrated that when the LLM component in MLLMs is frozen, the audio or visual encoder serves to caption the sound or image input facilitating text-based reasoning with the LLM component. We are interested in using the LLM's reasoning capabilities in order to facilitate classification. In this paper, we demonstrate through a captioning/classification experiment that an audio MLLM cannot fully leverage its LLM's text-based reasoning when generating audio captions. We also consider how this may be due to MLLMs separately representing auditory and textual information such that it severs the reasoning pathway from the LLM to the audio encoder.


title: Evaluating Data-driven Performances of Mixed Integer Bilinear Formulations for Book Placement Planning

abstract: Mixed integer bilinear programs (MIBLPs) offer tools to resolve robotics motion planning problems with orthogonal rotation matrices or static moment balance, but require long solving times. Recent work utilizing data-driven methods has shown potential to overcome this issue allowing for applications on larger scale problems. To solve mixed-integer bilinear programs online with data-driven methods, several re-formulations exist including mathematical programming with complementary constraints (MPCC), and mixed-integer programming (MIP). In this work, we compare the data-driven performances of various MIBLP reformulations using a book placement problem that has discrete configuration switches and bilinear constraints. The success rate, cost, and solving time are compared along with non-data-driven methods. Our results demonstrate the advantage of using data-driven methods to accelerate the solving speed of MIBLPs, and provide references for users to choose the suitable re-formulation.


title: JWST view of three infant galaxies at z=8.3 and implications for reionization

abstract: New JWST/NIRCam wide-field slitless spectroscopy provides redshifts for two z > 8 galaxies located behind the lensing cluster MACS J0416.1-2403. Both galaxies are strong [O iii]{\lambda}5007 emitters. For one galaxy, "Y1", the existing redshift z = 8.31, based on ALMA measurements of [O iii] 88 {\mu}m and [C ii] 157.7 {\mu}m lines, is confirmed. JWST/NIRCam images resolve this galaxy into three components of similar colors, and the whole system extends over ~3.4 kpc. The other galaxy, "JD", is at z = 8.34 instead of the previously claimed z = 9.28. It has a companion, "JD-N", at the same redshift with projected separation ~2.3 kpc. All objects are only moderately magnified and have intrinsic MUV ranging from -19.66 to -20.85 mag. Their eight-band NIRCam spectral energy distributions show that the galaxies are all very young with ages $\lesssim$11 Myr and stellar masses about 108 $M_{\odot}$. These infant galaxies are actively forming stars at rates of a few tens to a couple of hundred $M_{\odot} yr^{-1}$, but only one of them (JD) has a blue rest-frame UV slope. This slope indicates a high Lyman-continuum photon escape fraction that could contribute significantly to the cosmic hydrogen-reionizing background. The other two systems have much flatter slopes largely because their dust extinction is twice as high as JD's albeit only AV ~ 0.90 mag. The much lower indicated escape fractions show that even very young, actively star-forming galaxies can have negligible contribution to reionization when they quickly form dust throughout their bodies.


title: Density estimates and the fractional Sobolev inequality for sets of zero $s$-mean curvature

abstract: We prove that measurable sets $E\subset \mathbb R^n$ with locally finite perimeter and zero $s$-mean curvature satisfy the surface density estimates: \begin{align*} \operatorname{Per} (E; B_R(x)) \geq CR^{n-1} \end{align*} for all $R>0$, $x\in \partial^\ast E$. The $C$ depends only on $n$ and $s$, and remains bounded as $s\to 1^-$. As an application, we prove that the fractional Sobolev inequality holds on the boundary of sets with zero $s$-mean curvature.


title: CTSyn: A Foundational Model for Cross Tabular Data Generation

abstract: Generative Foundation Models (GFMs) have produced synthetic data with remarkable quality in modalities such as images and text. However, applying GFMs to tabular data poses significant challenges due to the inherent heterogeneity of table features. Existing cross-table learning frameworks are hindered by the absence of both a generative model backbone and a decoding mechanism for heterogeneous feature values. To overcome these limitations, we introduce the Cross-Table Synthesizer (CTSyn), a diffusion-based foundational model tailored for tabular data generation. CTSyn introduces three major components: an aggregator that consolidates heterogeneous tables into a unified latent space; a conditional latent diffusion model for sampling from this space; and type-specific decoders that reconstruct values of varied data types from sampled latent vectors. Extensive testing on real-world datasets reveals that CTSyn not only significantly outperforms existing table synthesizers in utility and diversity, but also uniquely enhances performances of downstream machine learning beyond what is achievable with real data, thus establishing a new paradigm for synthetic data generation.


title: Plasmoid drift and first wall heat deposition during ITER H-mode dual-SPIs in JOREK simulations

abstract: The heat flux mitigation during the Thermal Quench (TQ) by the Shattered Pellet Injection (SPI) is one of the major elements of disruption mitigation strategy for ITER. It's efficiency greatly depends on the SPI and the target plasma, and is ultimately checked by the heat deposition on to the PFCs. To investigate this, JOREK simulations of neon-mixed dual-SPIs into ITER baseline H-mode and a "degraded H-mode" with and without good injector synchronization are performed with focus on the first wall heat flux and its energy impact. It is found that low neon fraction SPIs into the baseline H-mode plasmas exhibit strong major radial plasmoid drift as the fragments arrive at the pedestal, accompanied by edge stochasticity. Significant density expulsion and outgoing heat flux occurs as a result, reducing the mitigation efficiency. Such drift motion could be mitigated by injecting higher neon fraction pellets', or by considering the pre-disruption confinement degradation, thus improving the radiation fraction. The radiation heat flux is found to peak in the vicinity of the fragment injection location in the early injection phase, while it relaxes later on due to parallel impurity transport. The overall radiation asymmetry could be significantly mitigated by good synchronization. Time integration of the local heat flux is carried out to provide its energy impact for wall heat damage assessment. For the baseline H-mode case with full pellet injection, melting of the stainless steel of the diagnostic port could occur near the injection port, which is acceptable, without any melting of the first wall tungsten tiles. For the degraded H-mode cases with quarter-pellet SPIs, which have 1/4 total volume of a full pellet, the maximum energy impact approaches the tolerable limit of the stainless steel with un-synchronized SPIs, and stays well below such limit for the perfectly synchronized ones.


title: Mean-field stochastic linear quadratic control problem with random coefficients

abstract: In this paper, we first prove that the mean-field stochastic linear quadratic (MFSLQ) control problem with random coefficients has a unique optimal control and derive a preliminary stochastic maximum principle to characterize this optimal control by an optimality system. However, because of the term of the form $\mathbb{E}[A(\cdot)X(\cdot)] $ in the adjoint equation, which cannot be represented in the form $\mathbb{E}[A(\cdot)]\mathbb{E} [X(\cdot)] $, we cannot solve this optimality system explicitly. To this end, we decompose the MFSLQ control problem into two constrained SLQ control problems without the mean-field terms. These constrained SLQ control problems can be solved explicitly by an extended LaGrange multiplier method developed in this article.


title: On soft factors and transmutation operators

abstract: The well known soft theorems state the specific factorizations of tree level gravitational (GR) amplitudes at leading, sub-leading and sub-sub-leading orders, with universal soft factors. For Yang-Mills (YM) amplitudes, similar factorizations and universal soft factors are found at leading and sub-leading orders. Then it is natural to ask if the similar factorizations and soft factors exist at higher orders. In this note, by using transformation operators proposed by Cheung, Shen and Wen, we reconstruct the known soft factors of YM and GR amplitudes, and prove the nonexistence of higher order soft factor of YM or GR amplitude which satisfies the universality.


title: The Macias topology on integral domains

abstract: In this manuscript a recent topology on the positive integers generated by the collection of $\{\sigma_n:n\in\mathbb{N}\}$ where $\sigma_n:=\{m: \gcd(n,m)=1\}$ is generalized over integral domains. Some of its topological properties are studied. Properties of this topology on infinite principal ideal domains that are not fields are also explored, and a new topological proof of the infinitude of prime elements is obtained (assuming the set of units is finite or not open), different from those presented in the style of H. Furstenberg. Finally, some problems are proposed.


title: Image Processing Based Forest Fire Detection

abstract: A novel approach for forest fire detection using image processing technique is proposed. A rule-based color model for fire pixel classification is used. The proposed algorithm uses RGB and YCbCr color space. The advantage of using YCbCr color space is that it can separate the luminance from the chrominance more effectively than RGB color space. The performance of the proposed algorithm is tested on two sets of images, one of which contains fire; the other contains fire-like regions. Standard methods are used for calculating the performance of the algorithm. The proposed method has both higher detection rate and lower false alarm rate. Since the algorithm is cheap in computation, it can be used for real-time forest fire detection.


title: Key-Element-Informed sLLM Tuning for Document Summarization

abstract: Remarkable advances in large language models (LLMs) have enabled high-quality text summarization. However, this capability is currently accessible only through LLMs of substantial size or proprietary LLMs with usage fees. In response, smaller-scale LLMs (sLLMs) of easy accessibility and low costs have been extensively studied, yet they often suffer from missing key information and entities, i.e., low relevance, in particular, when input documents are long. We hence propose a key-element-informed instruction tuning for summarization, so-called KEITSum, which identifies key elements in documents and instructs sLLM to generate summaries capturing these key elements. Experimental results on dialogue and news datasets demonstrate that sLLM with KEITSum indeed provides high-quality summarization with higher relevance and less hallucinations, competitive to proprietary LLM.


title: Adaptive Interface-PINNs (AdaI-PINNs): An Efficient Physics-informed Neural Networks Framework for Interface Problems

abstract: We present an efficient physics-informed neural networks (PINNs) framework, termed Adaptive Interface-PINNs (AdaI-PINNs), to improve the modeling of interface problems with discontinuous coefficients and/or interfacial jumps. This framework is an enhanced version of its predecessor, Interface PINNs or I-PINNs (Sarma et al.; https://dx.doi.org/10.2139/ssrn.4766623), which involves domain decomposition and assignment of different predefined activation functions to the neural networks in each subdomain across a sharp interface, while keeping all other parameters of the neural networks identical. In AdaI-PINNs, the activation functions vary solely in their slopes, which are trained along with the other parameters of the neural networks. This makes the AdaI-PINNs framework fully automated without requiring preset activation functions. Comparative studies on one-dimensional, two-dimensional, and three-dimensional benchmark elliptic interface problems reveal that AdaI-PINNs outperform I-PINNs, reducing computational costs by 2-6 times while producing similar or better accuracy.


title: Denoising-Aware Contrastive Learning for Noisy Time Series

abstract: Time series self-supervised learning (SSL) aims to exploit unlabeled data for pre-training to mitigate the reliance on labels. Despite the great success in recent years, there is limited discussion on the potential noise in the time series, which can severely impair the performance of existing SSL methods. To mitigate the noise, the de facto strategy is to apply conventional denoising methods before model training. However, this pre-processing approach may not fully eliminate the effect of noise in SSL for two reasons: (i) the diverse types of noise in time series make it difficult to automatically determine suitable denoising methods; (ii) noise can be amplified after mapping raw data into latent space. In this paper, we propose denoising-aware contrastive learning (DECL), which uses contrastive learning objectives to mitigate the noise in the representation and automatically selects suitable denoising methods for every sample. Extensive experiments on various datasets verify the effectiveness of our method. The code is open-sourced.


title: Projecting Molecules into Synthesizable Chemical Spaces

abstract: Discovering new drug molecules is a pivotal yet challenging process due to the near-infinitely large chemical space and notorious demands on time and resources. Numerous generative models have recently been introduced to accelerate the drug discovery process, but their progression to experimental validation remains limited, largely due to a lack of consideration for synthetic accessibility in practical settings. In this work, we introduce a novel framework that is capable of generating new chemical structures while ensuring synthetic accessibility. Specifically, we introduce a postfix notation of synthetic pathways to represent molecules in chemical space. Then, we design a transformer-based model to translate molecular graphs into postfix notations of synthesis. We highlight the model's ability to: (a) perform bottom-up synthesis planning more accurately, (b) generate structurally similar, synthesizable analogs for unsynthesizable molecules proposed by generative models with their properties preserved, and (c) explore the local synthesizable chemical space around hit molecules.


title: STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargeting

abstract: The creation of 4D avatars (i.e., animated 3D avatars) from text description typically uses text-to-image (T2I) diffusion models to synthesize 3D avatars in the canonical space and subsequently applies animation with target motions. However, such an optimization-by-animation paradigm has several drawbacks. (1) For pose-agnostic optimization, the rendered images in canonical pose for naive Score Distillation Sampling (SDS) exhibit domain gap and cannot preserve view-consistency using only T2I priors, and (2) For post hoc animation, simply applying the source motions to target 3D avatars yields translation artifacts and misalignment. To address these issues, we propose Skeleton-aware Text-based 4D Avatar generation with in-network motion Retargeting (STAR). STAR considers the geometry and skeleton differences between the template mesh and target avatar, and corrects the mismatched source motion by resorting to the pretrained motion retargeting techniques. With the informatively retargeted and occlusion-aware skeleton, we embrace the skeleton-conditioned T2I and text-to-video (T2V) priors, and propose a hybrid SDS module to coherently provide multi-view and frame-consistent supervision signals. Hence, STAR can progressively optimize the geometry, texture, and motion in an end-to-end manner. The quantitative and qualitative experiments demonstrate our proposed STAR can synthesize high-quality 4D avatars with vivid animations that align well with the text description. Additional ablation studies shows the contributions of each component in STAR. The source code and demos are available at: \href{https://star-avatar.github.io}{https://star-avatar.github.io}.


title: Low-Resource Cross-Lingual Summarization through Few-Shot Learning with Large Language Models

abstract: Cross-lingual summarization (XLS) aims to generate a summary in a target language different from the source language document. While large language models (LLMs) have shown promising zero-shot XLS performance, their few-shot capabilities on this task remain unexplored, especially for low-resource languages with limited parallel data. In this paper, we investigate the few-shot XLS performance of various models, including Mistral-7B-Instruct-v0.2, GPT-3.5, and GPT-4. Our experiments demonstrate that few-shot learning significantly improves the XLS performance of LLMs, particularly GPT-3.5 and GPT-4, in low-resource settings. However, the open-source model Mistral-7B-Instruct-v0.2 struggles to adapt effectively to the XLS task with limited examples. Our findings highlight the potential of few-shot learning for improving XLS performance and the need for further research in designing LLM architectures and pre-training objectives tailored for this task. We provide a future work direction to explore more effective few-shot learning strategies and to investigate the transfer learning capabilities of LLMs for cross-lingual summarization.


title: Analyzing the Correlation Between Thermal and Kinematic Parameters in Various Multiplicity Classes within 7 and 13 TeV pp Collisions

abstract: We investigate the transverse momentum spectra of identified particles at 7 TeV and 13 TeV in pp collisions in the framework of the blast wave model with Tsallis statistics (TBW). Based on experimental data by ALICE Collaboration, we observe that the model describes the $p_T$ spectra well with the common Tsallis temperature (T) and flow velocity (\beta_T) but separate non-extensive parameters (q) for baryons and mesons. The parameter dependence on multiplicity as well as on collision energy is investigated, and a strong dependence on the former while a weak dependence on the latter is reported. The extracted parameters in this work consist of the initial temperature (T_i), the average transverse momentum (<p_T>), the T, \beta_T, and the q. These parameters are found to increase a little with increasing energy, however, they (except the parameter q) decrease significantly with decreasing multiplicity. We observe that $\beta_T$ drops to zero after the multiplicity class VII, while, $T$ and $q$ do not change their behavior. Furthermore, our analysis explore the correlations among different parameters, including associations with the charged particle multiplicity per unit pseudorapidity (dN_{ch}/d\eta). The correlation between T and beta_T, T and dN_{ch}/d\eta, \beta_T and dN_{ch}/d\eta, T_i and <p_T> and T_i and dN_{ch}/d\eta demonstrates a positive relationship, while, the correlation between T and q-1, and q-1 and dN_{ch}/d\eta is negative. Finally, we implement an extra flow correction on the T parameter. Our findings reveal that the Doppler-corrected temperature parameter aligns closely with the T in scenarios with lower multiplicities. However, as the multiplicity increases, a noticeable divergence emerges between these parameters, indicating a widening separation between them.


title: StreamOptix: A Cross-layer Adaptive Video Delivery Scheme

abstract: This paper presents a cross-layer video delivery scheme, StreamOptix, and proposes a joint optimization algorithm for video delivery that leverages the characteristics of the physical (PHY), medium access control (MAC), and application (APP) layers. Most existing methods for optimizing video transmission over different layers were developed individually. Realizing a cross-layer design has always been a significant challenge, mainly due to the complex interactions and mismatches in timescales between layers, as well as the presence of distinct objectives in different layers. To address these complications, we take a divide-and-conquer approach and break down the formulated cross-layer optimization problem for video delivery into three sub-problems. We then propose a three-stage closedloop optimization framework, which consists of 1) an adaptive bitrate (ABR) strategy based on the link capacity information from PHY, 2) a video-aware resource allocation scheme accounting for the APP bitrate constraint, and 3) a link adaptation technique utilizing the soft acknowledgment feedback (soft-ACK). The proposed framework also supports the collections of the distorted bitstreams transmitted across the link. This allows a more reasonable assessment of video quality compared to many existing ABR methods that simply neglect the distortions occurring in the PHY layer. Experiments conducted under various network settings demonstrate the effectiveness and superiority of the new cross-layer optimization strategy. A byproduct of this study is the development of more comprehensive performance metrics on video delivery, which lays down the foundation for extending our system to multimodal communications in the future. Code for reproducing the experimental results is available at https://github.com/Evan-sudo/StreamOptix.


title: Boosting Diffusion Model for Spectrogram Up-sampling in Text-to-speech: An Empirical Study

abstract: Scaling text-to-speech (TTS) with autoregressive language model (LM) to large-scale datasets by quantizing waveform into discrete speech tokens is making great progress to capture the diversity and expressiveness in human speech, but the speech reconstruction quality from discrete speech token is far from satisfaction depending on the compressed speech token compression ratio. Generative diffusion models trained with score-matching loss and continuous normalized flow trained with flow-matching loss have become prominent in generation of images as well as speech. LM based TTS systems usually quantize speech into discrete tokens and generate these tokens autoregressively, and finally use a diffusion model to up sample coarse-grained speech tokens into fine-grained codec features or mel-spectrograms before reconstructing into waveforms with vocoder, which has a high latency and is not realistic for real time speech applications. In this paper, we systematically investigate varied diffusion models for up sampling stage, which is the main bottleneck for streaming synthesis of LM and diffusion-based architecture, we present the model architecture, objective and subjective metrics to show quality and efficiency improvement.


title: Deformations of dotted graphs consisting of standard circles

abstract: Dotted graphs are certain finite graphs with vertices of degree 2 called dots in the $xy$-plane $\mathbb{R}^2$, and a dotted graph is said to be admissible if it is associated with a lattice polytope in $\mathbb{R}^2$ each of whose edge is parallel to the $x$-axis or the $y$-axis. A dotted graph is said to be reducible if certain types of deformations are applicable. In this paper, we investigate the reducibility of admissible dotted graphs in certain simple forms consisting of standard circles.


title: Scaling Automatic Extraction of Pseudocode

abstract: Pseudocode in a scholarly paper provides a concise way to express the algorithms implemented therein. Pseudocode can also be thought of as an intermediary representation that helps bridge the gap between programming languages and natural languages. Having access to a large collection of pseudocode can provide various benefits ranging from enhancing algorithmic understanding, facilitating further algorithmic design, to empowering NLP or computer vision based models for tasks such as automated code generation and optical character recognition (OCR). We have created a large pseudocode collection by extracting nearly 320,000 pseudocode examples from arXiv papers. This process involved scanning over $2.2$ million scholarly papers, with 1,000 of them being manually inspected and labeled. Our approach encompasses an extraction mechanism tailored to optimize the coverage and a validation mechanism based on random sampling to check its accuracy and reliability, given the inherent heterogeneity of the collection. In addition, we offer insights into common pseudocode structures, supported by clustering and statistical analyses. Notably, these analyses indicate an exponential-like growth in the usage of pseudocodes, highlighting their increasing significance.


title: Charge self-consistent density functional theory plus ghost rotationally-invariant slave-boson theory for correlated materials

abstract: We present a charge self-consistent density functional theory combined with the ghost-rotationally-invariant slave-boson (DFT+gRISB) formalism for studying correlated materials. This method is applied to SrVO$_3$ and NiO, representing prototypical correlated metals and charge-transfer insulators. For SrVO$_3$, we demonstrate that DFT+gRISB yields an accurate equilibrium volume and effective mass close to experimentally observed values. Regarding NiO, DFT+gRISB enables the simultaneous description of charge transfer and Mott-Hubbard bands, significantly enhancing the accuracy of the original DFT+RISB approach. Furthermore, the calculated equilibrium volume and spectral function reasonably agree with experimental observations.


title: Accessible Adventures: Teaching Accessibility to High School Students Through Games

abstract: Accessibility education has been rarely incorporated into the high school curricula. This is a missed opportunity to equip next-generation software designers and decision-makers with knowledge, awareness, and empathy regarding accessibility and disabilities. We taught accessibility to students (N=93) in a midwestern high school through empathy-driven games and interviewed three Computer Science high school teachers and one librarian who taught programming. Accessibility education is currently insufficient in high school, facing challenges such as teachers' knowledge and conflicted curriculum goals. The students exhibited increased knowledge and awareness of accessibility and empathy for people with disabilities after playing the games. With this education outreach, we aim to provide insights into teaching next-generation software designers about accessibility by leveraging games.


title: Large Language Model-guided Document Selection

abstract: Large Language Model (LLM) pre-training exhausts an ever growing compute budget, yet recent research has demonstrated that careful document selection enables comparable model quality with only a fraction of the FLOPs. Inspired by efforts suggesting that domain-specific training document selection is in fact an interpretable process [Gunasekar et al., 2023], as well as research showing that instruction-finetuned LLMs are adept zero-shot data labelers [Gilardi et al.,2023], we explore a promising direction for scalable general-domain document selection; employing a prompted LLM as a document grader, we distill quality labels into a classifier model, which is applied at scale to a large, and already heavily-filtered, web-crawl-derived corpus autonomously. Following the guidance of this classifier, we drop 75% of the corpus and train LLMs on the remaining data. Results across multiple benchmarks show that: 1. Filtering allows us to quality-match a model trained on the full corpus across diverse benchmarks with at most 70% of the FLOPs, 2. More capable LLM labelers and classifier models lead to better results that are less sensitive to the labeler's prompt, 3. In-context learning helps to boost the performance of less-capable labeling models. In all cases we use open-source datasets, models, recipes, and evaluation frameworks, so that results can be reproduced by the community.


title: Cooperative Meta-Learning with Gradient Augmentation

abstract: Model agnostic meta-learning (MAML) is one of the most widely used gradient-based meta-learning, consisting of two optimization loops: an inner loop and outer loop. MAML learns the new task from meta-initialization parameters with an inner update and finds the meta-initialization parameters in the outer loop. In general, the injection of noise into the gradient of the model for augmenting the gradient is one of the widely used regularization methods. In this work, we propose a novel cooperative meta-learning framework dubbed CML which leverages gradient-level regularization with gradient augmentation. We inject learnable noise into the gradient of the model for the model generalization. The key idea of CML is introducing the co-learner which has no inner update but the outer loop update to augment gradients for finding better meta-initialization parameters. Since the co-learner does not update in the inner loop, it can be easily deleted after meta-training. Therefore, CML infers with only meta-learner without additional cost and performance degradation. We demonstrate that CML is easily applicable to gradient-based meta-learning methods and CML leads to increased performance in few-shot regression, few-shot image classification and few-shot node classification tasks. Our codes are at https://github.com/JJongyn/CML.


title: LinkGPT: Teaching Large Language Models To Predict Missing Links

abstract: Large Language Models (LLMs) have shown promising results on various language and vision tasks. Recently, there has been growing interest in applying LLMs to graph-based tasks, particularly on Text-Attributed Graphs (TAGs). However, most studies have focused on node classification, while the use of LLMs for link prediction (LP) remains understudied. In this work, we propose a new task on LLMs, where the objective is to leverage LLMs to predict missing links between nodes in a graph. This task evaluates an LLM's ability to reason over structured data and infer new facts based on learned patterns. This new task poses two key challenges: (1) How to effectively integrate pairwise structural information into the LLMs, which is known to be crucial for LP performance, and (2) how to solve the computational bottleneck when teaching LLMs to perform LP. To address these challenges, we propose LinkGPT, the first end-to-end trained LLM for LP tasks. To effectively enhance the LLM's ability to understand the underlying structure, we design a two-stage instruction tuning approach where the first stage fine-tunes the pairwise encoder, projector, and node projector, and the second stage further fine-tunes the LLMs to predict links. To address the efficiency challenges at inference time, we introduce a retrieval-reranking scheme. Experiments show that LinkGPT can achieve state-of-the-art performance on real-world graphs as well as superior generalization in zero-shot and few-shot learning, surpassing existing benchmarks. At inference time, it can achieve $10\times$ speedup while maintaining high LP accuracy.


title: Preparation of high precision aspherical lenses based on micro stereolithography technology

abstract: The 3D printing technology based on digital light processing (DLP) has highlighted its powerful manufacturing capabilities for optical components. However, the printing structure obtained by DLP based down projection printing is easily adhered to the printing window below, and the printed lens surface will have a step effect. This article uses DLP 3D printing technology to print non spherical lenses. During the printing process, a new type of inert liquid fluoride solution was used as the isolation layer, which can more effectively and conveniently prevent the printing structure from sticking to the printing window. At the same time, a vertical lifting immersion method was proposed to smooth the step effect on the surface of the lens.


title: Measurements of the branching fractions of $\Xi_{c}^{0}\to\Xi^{0}\pi^{0}$, $\Xi_{c}^{0}\to\Xi^{0}\eta$, and $\Xi_{c}^{0}\to\Xi^{0}\eta^{\prime}$ and asymmetry parameter of $\Xi_{c}^{0}\to\Xi^{0}\pi^{0}$

abstract: We present a study of $\Xi_{c}^{0}\to\Xi^{0}\pi^{0}$, $\Xi_{c}^{0}\to\Xi^{0}\eta$, and $\Xi_{c}^{0}\to\Xi^{0}\eta^{\prime}$ decays using the Belle and Belle~II data samples, which have integrated luminosities of 980~$\mathrm{fb}^{-1}$ and 426~$\mathrm{fb}^{-1}$, respectively. We measure the following relative branching fractions $${\cal B}(\Xi_{c}^{0}\to\Xi^{0}\pi^{0})/{\cal B}(\Xi_{c}^{0}\to\Xi^{-}\pi^{+}) = 0.48 \pm 0.02 ({\rm stat}) \pm 0.03 ({\rm syst}) ,$$ $${\cal B}(\Xi_{c}^{0}\to\Xi^{0}\eta)/{\cal B}(\Xi_{c}^{0}\to\Xi^{-}\pi^{+}) = 0.11 \pm 0.01 ({\rm stat}) \pm 0.01 ({\rm syst}) ,$$ $${\cal B}(\Xi_{c}^{0}\to\Xi^{0}\eta^{\prime})/{\cal B}(\Xi_{c}^{0}\to\Xi^{-}\pi^{+}) = 0.08 \pm 0.02 ({\rm stat}) \pm 0.01 ({\rm syst}) $$ for the first time, where the uncertainties are statistical ($\rm stat$) and systematic ($\rm syst$). By multiplying by the branching fraction of the normalization mode, ${\mathcal B}(\Xi_{c}^{0}\to\Xi^{-}\pi^{+})$, we obtain the following absolute branching fraction results $(6.9 \pm 0.3 ({\rm stat}) \pm 0.5 ({\rm syst}) \pm 1.3 ({\rm norm})) \times 10^{-3}$, $(1.6 \pm 0.2 ({\rm stat}) \pm 0.2 ({\rm syst}) \pm 0.3 ({\rm norm})) \times 10^{-3}$, and $(1.2 \pm 0.3 ({\rm stat}) \pm 0.1 ({\rm syst}) \pm 0.2 ({\rm norm})) \times 10^{-3}$, for $\Xi_{c}^{0}$ decays to $\Xi^{0}\pi^{0}$, $\Xi^{0}\eta$, and $\Xi^{0}\eta^{\prime}$ final states, respectively. The third errors are from the uncertainty on ${\mathcal B}(\Xi_{c}^{0}\to\Xi^{-}\pi^{+})$. The asymmetry parameter for $\Xi_{c}^{0}\to\Xi^{0}\pi^{0}$ is measured to be $\alpha(\Xi_{c}^{0}\to\Xi^{0}\pi^{0}) = -0.90\pm0.15({\rm stat})\pm0.23({\rm syst})$.


title: More Victories, Less Cooperation: Assessing Cicero's Diplomacy Play

abstract: The boardgame Diplomacy is a challenging setting for communicative and cooperative artificial intelligence. The most prominent communicative Diplomacy AI, Cicero, has excellent strategic abilities, exceeding human players. However, the best Diplomacy players master communication, not just tactics, which is why the game has received attention as an AI challenge. This work seeks to understand the degree to which Cicero succeeds at communication. First, we annotate in-game communication with abstract meaning representation to separate in-game tactics from general language. Second, we run two dozen games with humans and Cicero, totaling over 200 human-player hours of competition. While AI can consistently outplay human players, AI-Human communication is still limited because of AI's difficulty with deception and persuasion. This shows that Cicero relies on strategy and has not yet reached the full promise of communicative and cooperative AI.


title: A Hybrid-Layered System for Image-Guided Navigation and Robot Assisted Spine Surgery

abstract: In response to the growing demand for precise and affordable solutions for Image-Guided Spine Surgery (IGSS), this paper presents a comprehensive development of a Robot-Assisted and Navigation-Guided IGSS System. The endeavor involves integrating cutting-edge technologies to attain the required surgical precision and limit user radiation exposure, thereby addressing the limitations of manual surgical methods. We propose an IGSS workflow and system architecture employing a hybrid-layered approach, combining modular and integrated system architectures in distinctive layers to develop an affordable system for seamless integration, scalability, and reconfigurability. We developed and integrated the system and extensively tested it on phantoms and cadavers. The proposed system's accuracy using navigation guidance is 1.020 mm, and robot assistance is 1.11 mm on phantoms. Observing a similar performance in cadaveric validation where 84% of screw placements were grade A, 10% were grade B using navigation guidance, 90% were grade A, and 10% were grade B using robot assistance as per the Gertzbein-Robbins scale, proving its efficacy for an IGSS. The evaluated performance is adequate for an IGSS and at par with the existing systems in literature and those commercially available. The user radiation is lower than in the literature, given that the system requires only an average of 3 C-Arm images per pedicle screw placement and verification


title: Upgrade of the online data quality monitoring system for future PandaX experiments

abstract: PandaX-4T is a xenon-based multi-purpose experiment, focusing on particle and astrophysics research. The data quality monitoring system plays a crucial role in the experiment. This system enables the prompt detection of potential issues during data collection. In order to meet the upgrade requirements of the experiment, we have implemented several updates to improve overall data throughput and provide users with more comprehensive information. As a result, the system is capable of monitoring half of the collected data in future operations of the PandaX-4T experiment. Furthermore, with updated hardware, the system is also well-equipped to meet the requirements of the future multi-ten-tonne level PandaX-xT experiment.


title: An Inexact Bregman Proximal Difference-of-Convex Algorithm with Two Types of Relative Stopping Criteria

abstract: In this paper, we consider a class of difference-of-convex (DC) optimization problems, where the global Lipschitz gradient continuity assumption on the smooth part of the objective function is not required. Such problems are prevalent in many contemporary applications such as compressed sensing, statistical regression, and machine learning, and can be solved by a general Bregman proximal DC algorithm (BPDCA). However, the existing BPDCA is developed based on the stringent requirement that the involved subproblems must be solved exactly, which is often impractical and limits the applicability of the BPDCA. To facilitate the practical implementations and wider applications of the BPDCA, we develop an inexact Bregman proximal difference-of-convex algorithm (iBPDCA) by incorporating two types of relative-type stopping criteria for solving the subproblems. The proposed inexact framework has considerable flexibility to encompass many existing exact and inexact methods, and can accommodate different types of errors that may occur when solving the subproblem. This enables the potential application of our inexact framework across different DC decompositions to facilitate the design of a more efficient DCA scheme in practice. The global subsequential convergence and the global sequential convergence of our iBPDCA are established under suitable conditions including the Kurdyka-{\L}ojasiewicz property. Some numerical experiments on the $\ell_{1-2}$ regularized least squares problem and the constrained $\ell_{1-2}$ sparse optimization problem are conducted to show the superior performance of our iBPDCA in comparison to existing algorithms. These results also empirically verify the necessity of developing different types of stopping criteria to facilitate the efficient computation of the subproblem in each iteration of our iBPDCA.


title: UVCPNet: A UAV-Vehicle Collaborative Perception Network for 3D Object Detection

abstract: With the advancement of collaborative perception, the role of aerial-ground collaborative perception, a crucial component, is becoming increasingly important. The demand for collaborative perception across different perspectives to construct more comprehensive perceptual information is growing. However, challenges arise due to the disparities in the field of view between cross-domain agents and their varying sensitivity to information in images. Additionally, when we transform image features into Bird's Eye View (BEV) features for collaboration, we need accurate depth information. To address these issues, we propose a framework specifically designed for aerial-ground collaboration. First, to mitigate the lack of datasets for aerial-ground collaboration, we develop a virtual dataset named V2U-COO for our research. Second, we design a Cross-Domain Cross-Adaptation (CDCA) module to align the target information obtained from different domains, thereby achieving more accurate perception results. Finally, we introduce a Collaborative Depth Optimization (CDO) module to obtain more precise depth estimation results, leading to more accurate perception outcomes. We conduct extensive experiments on both our virtual dataset and a public dataset to validate the effectiveness of our framework. Our experiments on the V2U-COO dataset and the DAIR-V2X dataset demonstrate that our method improves detection accuracy by 6.1% and 2.7%, respectively.


title: UCDNet: Multi-UAV Collaborative 3D Object Detection Network by Reliable Feature Mapping

abstract: Multi-UAV collaborative 3D object detection can perceive and comprehend complex environments by integrating complementary information, with applications encompassing traffic monitoring, delivery services and agricultural management. However, the extremely broad observations in aerial remote sensing and significant perspective differences across multiple UAVs make it challenging to achieve precise and consistent feature mapping from 2D images to 3D space in multi-UAV collaborative 3D object detection paradigm. To address the problem, we propose an unparalleled camera-based multi-UAV collaborative 3D object detection paradigm called UCDNet. Specifically, the depth information from the UAVs to the ground is explicitly utilized as a strong prior to provide a reference for more accurate and generalizable feature mapping. Additionally, we design a homologous points geometric consistency loss as an auxiliary self-supervision, which directly influences the feature mapping module, thereby strengthening the global consistency of multi-view perception. Experiments on AeroCollab3D and CoPerception-UAVs datasets show our method increases 4.7% and 10% mAP respectively compared to the baseline, which demonstrates the superiority of UCDNet.


title: SMART: Scene-motion-aware human action recognition framework for mental disorder group

abstract: Patients with mental disorders often exhibit risky abnormal actions, such as climbing walls or hitting windows, necessitating intelligent video behavior monitoring for smart healthcare with the rising Internet of Things (IoT) technology. However, the development of vision-based Human Action Recognition (HAR) for these actions is hindered by the lack of specialized algorithms and datasets. In this paper, we innovatively propose to build a vision-based HAR dataset including abnormal actions often occurring in the mental disorder group and then introduce a novel Scene-Motion-aware Action Recognition Technology framework, named SMART, consisting of two technical modules. First, we propose a scene perception module to extract human motion trajectory and human-scene interaction features, which introduces additional scene information for a supplementary semantic representation of the above actions. Second, the multi-stage fusion module fuses the skeleton motion, motion trajectory, and human-scene interaction features, enhancing the semantic association between the skeleton motion and the above supplementary representation, thus generating a comprehensive representation with both human motion and scene information. The effectiveness of our proposed method has been validated on our self-collected HAR dataset (MentalHAD), achieving 94.9% and 93.1% accuracy in un-seen subjects and scenes and outperforming state-of-the-art approaches by 6.5% and 13.2%, respectively. The demonstrated subject- and scene- generalizability makes it possible for SMART's migration to practical deployment in smart healthcare systems for mental disorder patients in medical settings. The code and dataset will be released publicly for further research: https://github.com/Inowlzy/SMART.git.


title: The Potential Energy of Heavy Quarkonium in Flavor-Dependent Systems from a Holographic Model

abstract: Within the framework of the Einstein-Maxwell-Dilaton (EMD) model, which incorporates information on the equation of state and baryon number susceptibility from lattice results, we have conducted a comprehensive analysis of the potential energy, running coupling, and dissociation time for heavy quark-antiquark pairs using gauge/gravity duality. This study encompasses various systems, including pure gluon systems, 2 flavor systems, 2+1 flavor systems, and 2+1+1 flavor systems under finite temperature and chemical potential. The results reveal that the linear component of the potential energy diminishes as the flavor increases. It is also found that our results are extremely close to the recent lattice results for 2+1 flavors at finite temperature. Moreover, we have thoroughly investigated the dissociation distance and running coupling constant of quark-antiquark pairs to gain a comprehensive understanding of their behavior across various flavors. Finally, we have examined real-time dynamics of quark dissociation. The findings indicate that the dissociation time of quark-antiquark pairs is dependent on temperature, chemical potential, and flavor of the systems.


title: Quantitative instability for stochastic scalar reaction-diffusion equations

abstract: This work studies the instability of stochastic scalar reaction diffusion equations, driven by a multiplicative noise that is white in time and smooth in space, near to zero, which is assumed to be a fixed point for the equation. We prove that if the Lyapunov exponent at zero is positive, then the flow of non-zero solutions admits uniform bounds on small negative moments. The proof builds on ideas from stochastic homogenisation. We require suitable corrector estimates for the solution to a Poisson problem involving an infinite-dimensional projective process, together with a linearisation step that hinges on quantitative parametrix-like arguments. Overall, we are able to construct an appropriate Lyapunov functional for the nonlinear dynamics and address some problems left open in the literature.


title: Quantum state preparation for a velocity field based on the spherical Clebsch wave function

abstract: We propose a method for preparing the quantum state for a given velocity field, e.g., in fluid dynamics, via the spherical Clebsch wave function (SCWF). Using the pointwise normalization constraint for the SCWF, we develop a variational ansatz comprising parameterized controlled rotation gates. Employing the variational quantum algorithm, we iteratively optimize the circuit parameters to transform the target velocity field into the SCWF and its corresponding discrete quantum state, enabling subsequent quantum simulation of fluid dynamics. Validations for one- and two-dimensional flow fields confirm the accuracy and robustness of our method, emphasizing its effectiveness in handling multiscale and multidimensional velocity fields. Our method is able to capture critical flow features like sources, sinks, and saddle points. Furthermore, it enables the generation of SCWFs for various vector fields, which can then be applied in quantum simulations through SCWF evolution.


title: Dynamical mixture modeling with fast, automatic determination of Markov chains

abstract: Markov state modeling has gained popularity in various scientific fields due to its ability to reduce complex time series data into transitions between a few states. Yet, current frameworks are limited by assuming a single Markov chain describes the data, and they suffer an inability to discern heterogeneities. As a solution, this paper proposes a variational expectation-maximization algorithm that identifies a mixture of Markov chains in a time-series data set. The method is agnostic to the definition of the Markov states, whether data-driven (e.g. by spectral clustering) or based on domain knowledge. Variational EM efficiently and organically identifies the number of Markov chains and dynamics of each chain without expensive model comparisons or posterior sampling. The approach is supported by a theoretical analysis and numerical experiments, including simulated and observational data sets based on ${\tt Last.fm}$ music listening, ultramarathon running, and gene expression. The results show the new algorithm is competitive with contemporary mixture modeling approaches and powerful in identifying meaningful heterogeneities in time series data.


title: GenzIQA: Generalized Image Quality Assessment using Prompt-Guided Latent Diffusion Models

abstract: The design of no-reference (NR) image quality assessment (IQA) algorithms is extremely important to benchmark and calibrate user experiences in modern visual systems. A major drawback of state-of-the-art NR-IQA methods is their limited ability to generalize across diverse IQA settings with reasonable distribution shifts. Recent text-to-image generative models such as latent diffusion models generate meaningful visual concepts with fine details related to text concepts. In this work, we leverage the denoising process of such diffusion models for generalized IQA by understanding the degree of alignment between learnable quality-aware text prompts and images. In particular, we learn cross-attention maps from intermediate layers of the denoiser of latent diffusion models to capture quality-aware representations of images. In addition, we also introduce learnable quality-aware text prompts that enable the cross-attention features to be better quality-aware. Our extensive cross database experiments across various user-generated, synthetic, and low-light content-based benchmarking databases show that latent diffusion models can achieve superior generalization in IQA when compared to other methods in the literature.


title: Bayesian Inference for Spatial-temporal Non-Gaussian Data Using Predictive Stacking

abstract: Analysing non-Gaussian spatial-temporal data typically requires introducing spatial dependence in generalised linear models through the link function of an exponential family distribution. However, unlike in Gaussian likelihoods, inference is considerably encumbered by the inability to analytically integrate out the random effects and reduce the dimension of the parameter space. Iterative estimation algorithms struggle to converge due to the presence of weakly identified parameters. We devise an approach that obviates these issues by exploiting generalised conjugate multivariate distribution theory for exponential families, which enables exact sampling from analytically available posterior distributions conditional upon some fixed process parameters. More specifically, we expand upon the Diaconis-Ylvisaker family of conjugate priors to achieve analytically tractable posterior inference for spatially-temporally varying regression models conditional on some kernel parameters. Subsequently, we assimilate inference from these individual posterior distributions over a range of values of these parameters using Bayesian predictive stacking. We evaluate inferential performance on simulated data, compare with fully Bayesian inference using Markov chain Monte Carlo and apply our proposed method to analyse spatially-temporally referenced avian count data from the North American Breeding Bird Survey database.


title: The Active Optics System on the Vera C. Rubin Observatory: Optimal Control of Degeneracy Among the Large Number of Degrees of Freedom

abstract: The Vera C. Rubin Observatory is a unique facility for survey astronomy that will soon be commissioned and begin operations. Crucial to many of its scientific goals is the achievement of sustained high image quality, limited only by the seeing at the site. This will be maintained through an Active Optics System (AOS) that controls optical element misalignments and corrects mirror figure error to minimize aberrations caused by both thermal and gravitational distortions. However, the large number of adjustment degrees of freedom available on the Rubin Observatory introduces a range of degeneracies, including many that are \textit{noise-induced} due to imperfect measurement of the wavefront errors. We present a structured methodology for identifying these degeneracies through an analysis of image noise level. We also present a novel scaling strategy based on Truncated Singular Value Decomposition (TSVD) that mitigates the degeneracy, and optimally distributes the adjustment over the available degrees of freedom. Our approach ensures the attainment of optimal image quality, while avoiding excursions around the noise-induced subspace of degeneracies, marking a significant improvement over the previous techniques adopted for Rubin, which were based on an Optimal Integral Controller (OIC). This new approach is likely to also yield significant benefits for all telescopes that incorporate large numbers of degrees of freedom of adjustment.


title: Crafting Heavy-Tails in Weight Matrix Spectrum without Gradient Noise

abstract: Modern training strategies of deep neural networks (NNs) tend to induce a heavy-tailed (HT) spectra of layer weights. Extensive efforts to study this phenomenon have found that NNs with HT weight spectra tend to generalize well. A prevailing notion for the occurrence of such HT spectra attributes gradient noise during training as a key contributing factor. Our work shows that gradient noise is unnecessary for generating HT weight spectra: two-layer NNs trained with full-batch Gradient Descent/Adam can exhibit HT spectra in their weights after finite training steps. To this end, we first identify the scale of the learning rate at which one step of full-batch Adam can lead to feature learning in the shallow NN, particularly when learning a single index teacher model. Next, we show that multiple optimizer steps with such (sufficiently) large learning rates can transition the bulk of the weight's spectra into an HT distribution. To understand this behavior, we present a novel perspective based on the singular vectors of the weight matrices and optimizer updates. We show that the HT weight spectrum originates from the `spike', which is generated from feature learning and interacts with the main bulk to generate an HT spectrum. Finally, we analyze the correlations between the HT weight spectra and generalization after multiple optimizer updates with varying learning rates.


title: Advanced Payment Security System:XGBoost, CatBoost and SMOTE Integrated

abstract: With the rise of various online and mobile payment systems, transaction fraud has become a significant threat to financial security. This study explores the application of advanced machine learning models, specifically XGBoost and LightGBM, for developing a more accurate and robust Payment Security Protection Model.To enhance data reliability, we meticulously processed the data sources and used SMOTE (Synthetic Minority Over-sampling Technique) to address class imbalance and improve data representation. By selecting highly correlated features, we aimed to strengthen the training process and boost model performance.We conducted thorough performance evaluations of our proposed models, comparing them against traditional methods including Random Forest, Neural Network, and Logistic Regression. Key metrics such as Precision, Recall, and F1 Score were used to rigorously assess their effectiveness.Our detailed analyses and comparisons reveal that the combination of SMOTE with XGBoost and LightGBM offers a highly efficient and powerful mechanism for payment security protection. The results show that these models not only outperform traditional approaches but also hold significant promise for advancing the field of transaction fraud prevention.


title: LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model

abstract: The capacity of existing human keypoint localization models is limited by keypoint priors provided by the training data. To alleviate this restriction and pursue more general model, this work studies keypoint localization from a different perspective by reasoning locations based on keypiont clues in text descriptions. We propose LocLLM, the first Large-Language Model (LLM) based keypoint localization model that takes images and text instructions as inputs and outputs the desired keypoint coordinates. LocLLM leverages the strong reasoning capability of LLM and clues of keypoint type, location, and relationship in textual descriptions for keypoint localization. To effectively tune LocLLM, we construct localization-based instruction conversations to connect keypoint description with corresponding coordinates in input image, and fine-tune the whole model in a parameter-efficient training pipeline. LocLLM shows remarkable performance on standard 2D/3D keypoint localization benchmarks. Moreover, incorporating language clues into the localization makes LocLLM show superior flexibility and generalizable capability in cross dataset keypoint localization, and even detecting novel type of keypoints unseen during training.


title: URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement

abstract: The last decade has witnessed significant advancements in deep learning-based speech enhancement (SE). However, most existing SE research has limitations on the coverage of SE sub-tasks, data diversity and amount, and evaluation metrics. To fill this gap and promote research toward universal SE, we establish a new SE challenge, named URGENT, to focus on the universality, robustness, and generalizability of SE. We aim to extend the SE definition to cover different sub-tasks to explore the limits of SE models, starting from denoising, dereverberation, bandwidth extension, and declipping. A novel framework is proposed to unify all these sub-tasks in a single model, allowing the use of all existing SE approaches. We collected public speech and noise data from different domains to construct diverse evaluation data. Finally, we discuss the insights gained from our preliminary baseline experiments based on both generative and discriminative SE methods with 12 curated metrics.


title: Quantum channel correction outperforming direct transmission

abstract: Long-distance optical quantum channels are necessarily lossy, leading to errors in transmitted quantum information, entanglement degradation and, ultimately, poor protocol performance. Quantum states carrying information in the channel can be probabilistically amplified to compensate for loss, but are destroyed when amplification fails. Quantum correction of the channel itself is therefore required, but break-even performance -- where arbitrary states can be better transmitted through a corrected channel than an uncorrected one -- has so far remained out of reach. Here we perform distillation by heralded amplification to improve a noisy entanglement channel. We subsequently employ entanglement swapping to demonstrate that arbitrary quantum information transmission is unconditionally improved -- i.e. without relying on postselection or post-processing of data -- compared to the uncorrected channel. In this way, it represents realisation of a genuine quantum relay. Our channel correction for single-mode quantum states will find use in quantum repeater, communication and metrology applications.


title: Evaluating and Mitigating IP Infringement in Visual Generative AI

abstract: The popularity of visual generative AI models like DALL-E 3, Stable Diffusion XL, Stable Video Diffusion, and Sora has been increasing. Through extensive evaluation, we discovered that the state-of-the-art visual generative models can generate content that bears a striking resemblance to characters protected by intellectual property rights held by major entertainment companies (such as Sony, Marvel, and Nintendo), which raises potential legal concerns. This happens when the input prompt contains the character's name or even just descriptive details about their characteristics. To mitigate such IP infringement problems, we also propose a defense method against it. In detail, we develop a revised generation paradigm that can identify potentially infringing generated content and prevent IP infringement by utilizing guidance techniques during the diffusion process. It has the capability to recognize generated content that may be infringing on intellectual property rights, and mitigate such infringement by employing guidance methods throughout the diffusion process without retrain or fine-tune the pretrained models. Experiments on well-known character IPs like Spider-Man, Iron Man, and Superman demonstrate the effectiveness of the proposed defense method. Our data and code can be found at https://github.com/ZhentingWang/GAI_IP_Infringement.


title: LLM-POET: Evolving Complex Environments using Large Language Models

abstract: Creating systems capable of generating virtually infinite variations of complex and novel behaviour without predetermined goals or limits is a major challenge in the field of AI. This challenge has been addressed through the development of several open-ended algorithms that can continuously generate new and diverse behaviours, such as the POET and Enhanced-POET algorithms for co-evolving environments and agent behaviour. One of the challenges with existing methods however, is that they struggle to continuously generate complex environments. In this work, we propose LLM-POET, a modification of the POET algorithm where the environment is both created and mutated using a Large Language Model (LLM). By fine-tuning a LLM with text representations of Evolution Gym environments and captions that describe the environment, we were able to generate complex and diverse environments using natural language. We found that not only could the LLM produce a diverse range of environments, but compared to the CPPNs used in Enhanced-POET for environment generation, the LLM allowed for a 34% increase in the performance gain of co-evolution. This increased performance suggests that the agents were able to learn a more diverse set of skills by training on more complex environments.


title: Planar near-field measurements of specular and diffuse reflection of millimeter-wave absorbers

abstract: Mitigating the far sidelobes of a wide field-of-view telescope is one of the critical issues for polarization observation of the cosmic microwave background. Since even small reflections of stray light at the millimeter-wave absorbers inside the telescope may create nonnegligible far sidelobes, we have developed a method to measure the reflectance of millimeter-wave absorbers, including diffuse reflections. By applying the planar near-field measurement method to the absorbers, we have enabled two-dimensional diffuse-reflection measurements, in addition to characterizing specular reflection. We have measured the reflectance of five samples (TK RAM Large and Small Tiles and Eccosorb AN-72, HR-10, and LS-22) at two angles of incidence in the frequency range from 70 GHz to 110 GHz. Compared with conventional horn-to-horn measurements, we obtained a consistent specular reflectance with a higher precision, less affected by standing waves. We have demonstrated that the angular response and diffuse-to-specular reflectance ratio differ among various materials. The measurements also imply that some absorbers may affect the polarization direction when reflecting the incident waves.


title: Vortex entropy and superconducting fluctuations in ultrathin underdoped Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ superconductor

abstract: Vortices in superconductors can help identify emergent phenomena but certain fundamental aspects of vortices, such as their entropy, remain poorly understood. Here, we study the vortex entropy in underdoped Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ by measuring both magneto-resistivity and Nernst effect on ultrathin flakes ($\le$2 unit-cell). We extract the London penetration depth from the magneto-transport measurements on samples with different doping levels. It reveals that the superfluid phase stiffness $\rho_s$ scales linearly with the superconducting transition temperature $T_c$, down to the extremely underdoped case. On the same batch of ultrathin flakes, we measure the Nernst effect via on-chip thermometry. Together, we obtain the vortex entropy and find that it decays exponentially with $T_c$ or $\rho_s$. We further analyze the Nernst signal above $T_c$ in the framework of Gaussian superconducting fluctuations. The combination of electrical and thermoelectric measurements in the two-dimensional limit provides fresh insight into high temperature superconductivity.


title: Underactuated Control of Multiple Soft Pneumatic Actuators via Stable Inversion

abstract: Soft grippers, with their inherent compliance and adaptability, show advantages for delicate and versatile manipulation tasks in robotics. This paper presents a novel approach to underactuated control of multiple soft actuators, specifically focusing on the synchronization of soft fingers within a soft gripper. Utilizing a single syringe pump as the actuation mechanism, we address the challenge of coordinating multiple degrees of freedom of a compliant system. The theoretical framework applies concepts from stable inversion theory, adapting them to the unique dynamics of the underactuated soft gripper. Through meticulous mechatronic system design and controller synthesis, we demonstrate both in simulation and experimentation the efficacy and applicability of our approach in achieving precise and synchronized manipulation tasks. Our findings not only contribute to the advancement of soft robot control but also offer practical insights into the design and control of underactuated systems for real-world applications.


title: Prescribed mean curvature flow for noncompact hypersurfaces in Lorentz manifolds

abstract: Motivated by previous study on mean curvature flow and prescribed mean curvature flow on spatially compact space or asymptotically flat spacetime, in this work we will find sufficient conditions for the short time existence of prescribed mean curvature flow on a Lorentz manifold with a smooth time function starting from a complete noncompact spacelike hypersurface. Long time existence and convergence will also be discussed. Results will be applied to study some prescribed mean curvature flows inside the future of the origin in the Minkowski spacetime. Examples of spacetime related to the existence and convergence results near the future null infinity of the Schwarzschild spacetime are also discussed.


title: The distribution amplitude of the $\eta_c$-meson at leading twist from Lattice QCD

abstract: Distribution amplitudes are functions of non-perturbative matrix elements describing the hadronization of quarks and gluons. Thanks to factorization theorems, they can be used to compute the scattering amplitude of high-energy processes. Recently, new ideas have allowed their computation using lattice QCD, which should provide us with a general, fully relativistic determination. We present the first lattice calculation of the $\eta_c$-meson distribution amplitude at leading twist. Starting from the relevant matrix element in discrete Euclidean space on a set of $N_f=2$ CLS ensembles, we explain the method to connect to continuum Minkowski spacetime. After addressing several sources of systematic uncertainty, we compare to Dyson-Schwinger and non-relativistic QCD determinations of this quantity. We find significant deviations between the latter and our result even at small Ioffe times.


title: DiNeR: a Large Realistic Dataset for Evaluating Compositional Generalization

abstract: Most of the existing compositional generalization datasets are synthetically-generated, resulting in a lack of natural language variation. While there have been recent attempts to introduce non-synthetic datasets for compositional generalization, they suffer from either limited data scale or a lack of diversity in the forms of combinations. To better investigate compositional generalization with more linguistic phenomena and compositional diversity, we propose the DIsh NamE Recognition (DiNeR) task and create a large realistic Chinese dataset. Given a recipe instruction, models are required to recognize the dish name composed of diverse combinations of food, actions, and flavors. Our dataset consists of 3,811 dishes and 228,114 recipes, and involves plenty of linguistic phenomena such as anaphora, omission and ambiguity. We provide two strong baselines based on T5 and large language models (LLMs). This work contributes a challenging task, baseline methods to tackle the task, and insights into compositional generalization in the context of dish name recognition. Code and data are available at https://github.com/Jumpy-pku/DiNeR.


title: MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources

abstract: Leveraging external knowledge is crucial for achieving high performance in knowledge-intensive tasks, such as question answering. The retrieve-and-read approach is widely adopted for integrating external knowledge into a language model. However, this approach suffers from increased computational cost and latency due to the long context length, which grows proportionally with the number of retrieved knowledge. Furthermore, existing retrieval-augmented models typically retrieve information from a single type of knowledge source, limiting their scalability to diverse knowledge sources with varying structures. In this work, we introduce an efficient memory-augmented transformer called MATTER, designed to retrieve relevant knowledge from multiple heterogeneous knowledge sources. Specifically, our model retrieves and reads from both unstructured sources (paragraphs) and semi-structured sources (QA pairs) in the form of fixed-length neural memories. We demonstrate that our model outperforms existing efficient retrieval-augmented models on popular QA benchmarks in terms of both accuracy and speed. Furthermore, MATTER achieves competitive results compared to conventional read-and-retrieve models while having 100x throughput during inference.


title: The Reasonable Person Standard for AI

abstract: As AI systems are increasingly incorporated into domains where human behavior has set the norm, a challenge for AI governance and AI alignment research is to regulate their behavior in a way that is useful and constructive for society. One way to answer this question is to ask: how do we govern the human behavior that the models are emulating? To evaluate human behavior, the American legal system often uses the "Reasonable Person Standard." The idea of "reasonable" behavior comes up in nearly every area of law. The legal system often judges the actions of parties with respect to what a reasonable person would have done under similar circumstances. This paper argues that the reasonable person standard provides useful guidelines for the type of behavior we should develop, probe, and stress-test in models. It explains how reasonableness is defined and used in key areas of the law using illustrative cases, how the reasonable person standard could apply to AI behavior in each of these areas and contexts, and how our societal understanding of "reasonable" behavior provides useful technical goals for AI researchers.


title: Partial semigroup partial dynamical systems and Partial Central Sets

abstract: H. Furstenberg defined Central sets in $\mathbb{N}$ by using the notions of topological dynamics, later Bergelson and Hindman characterized central sets in $\mathbb{N}$ and also in arbitrary semigroup in terms of algebra of Stone-\v{C}ech compactification of that set. We state the new notion of large sets in a partial semigroup setting and characterize the algebraic structure of the sets by using the algebra of Stone-\v{C}ech compactification. By using these notions, we introduce the \emph{Partial Semigroup Partial Dynamical System(PSPDS)} and show that topological dynamical characterization of central sets in a partial semigroup is equivalent to the usual algebraic characterization.


title: MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models

abstract: Music is a universal language that can communicate emotions and feelings. It forms an essential part of the whole spectrum of creative media, ranging from movies to social media posts. Machine learning models that can synthesize music are predominantly conditioned on textual descriptions of it. Inspired by how musicians compose music not just from a movie script, but also through visualizations, we propose MeLFusion, a model that can effectively use cues from a textual description and the corresponding image to synthesize music. MeLFusion is a text-to-music diffusion model with a novel "visual synapse", which effectively infuses the semantics from the visual modality into the generated music. To facilitate research in this area, we introduce a new dataset MeLBench, and propose a new evaluation metric IMSM. Our exhaustive experimental evaluation suggests that adding visual information to the music synthesis pipeline significantly improves the quality of generated music, measured both objectively and subjectively, with a relative gain of up to 67.98% on the FAD score. We hope that our work will gather attention to this pragmatic, yet relatively under-explored research area.


title: VLBA Astrometry of the Fastest-spinning Magnetar Swift J1818.0-1607: A Large Trigonometric Distance & A Small Transverse Velocity

abstract: In addition to being the most magnetic objects in the known universe, magnetars are the only objects observed to generate fast-radio-burst-like emissions. The formation mechanism of magnetars is still highly debated, and may potentially be probed with the magnetar velocity distribution. We carried out a 3-year-long astrometric campaign on Swift J1818.0-1607 -- the fastest-spinning magnetar, using the Very Long Baseline Array. After applying the phase-calibrating 1D interpolation strategy, we obtained a small proper motion of 8.5 $\mathrm{mas~yr^{-1}}$ magnitude, and a parallax of $0.12\pm0.02$ mas (uncertainties at $1\,\sigma$ confidence throughout the Letter) for Swift J1818.0-1607. The latter is the second magnetar parallax, and is among the smallest neutron star parallaxes ever determined. From the parallax, we derived the distance $9.4^{+2.0}_{-1.6}$ kpc, which locates Swift J1818.0-1607 at the far side of the Galactic central region. Combined with the distance, the small proper motion leads to a transverse peculiar velocity $v_\perp=48^{+50}_{-16}$ $\mathrm{km~s^{-1}}$ -- a new lower limit to magnetar $v_\perp$. Incorporating previous $v_\perp$ estimates of seven other magnetars, we acquired $v_\perp=149^{+132}_{-68}$ $\mathrm{km~s^{-1}}$ for the sample of astrometrically studied magnetars, corresponding to the three-dimensional space velocity $\sim190^{+168}_{-87}$ $\mathrm{km~s^{-1}}$, smaller than the average level of young pulsars. Additionally, we found that the magnetar velocity sample does not follow the unimodal young pulsar velocity distribution reported by Hobbs et al. at $>2\,\sigma$ confidence, while loosely agreeing with more recent bimodal young pulsar velocity distributions derived from relatively small samples of quality astrometric determinations.


title: OVMR: Open-Vocabulary Recognition with Multi-Modal References

abstract: The challenge of open-vocabulary recognition lies in the model has no clue of new categories it is applied to. Existing works have proposed different methods to embed category cues into the model, \eg, through few-shot fine-tuning, providing category names or textual descriptions to Vision-Language Models. Fine-tuning is time-consuming and degrades the generalization capability. Textual descriptions could be ambiguous and fail to depict visual details. This paper tackles open-vocabulary recognition from a different perspective by referring to multi-modal clues composed of textual descriptions and exemplar images. Our method, named OVMR, adopts two innovative components to pursue a more robust category cues embedding. A multi-modal classifier is first generated by dynamically complementing textual descriptions with image exemplars. A preference-based refinement module is hence applied to fuse uni-modal and multi-modal classifiers, with the aim to alleviate issues of low-quality exemplar images or textual descriptions. The proposed OVMR is a plug-and-play module, and works well with exemplar images randomly crawled from the Internet. Extensive experiments have demonstrated the promising performance of OVMR, \eg, it outperforms existing methods across various scenarios and setups. Codes are publicly available at \href{https://github.com/Zehong-Ma/OVMR}{https://github.com/Zehong-Ma/OVMR}.


title: Monotone Lipschitz-Gradient Denoiser: Explainability of Operator Regularization Approaches and Convergence to Optimal Point

abstract: This paper addresses explainability of the operator-regularization approach under the use of monotone Lipschitz-gradient (MoL-Grad) denoiser -- an operator that can be expressed as the Lipschitz continuous gradient of a differentiable convex function. We prove that an operator is a MoL-Grad denoiser if and only if it is the ``single-valued'' proximity operator of a weakly convex function. An extension of Moreau's decomposition is also shown with respect to a weakly convex function and the conjugate of its convexified function. Under these arguments, two specific algorithms, the forward-backward splitting algorithm and the primal-dual splitting algorithm, are considered, both employing MoL-Grad denoisers. These algorithms generate a sequence of vectors converging weakly, under conditions, to a minimizer of a certain cost function which involves an ``implicit regularizer'' induced by the denoiser. The theoretical findings are supported by simulations.


title: Electric leakage suppression of phase-transforming ferroelectrics with donor impurities

abstract: Phase-transforming ferroelectric materials are widely used in energy harvesting and conversion devices. However, the functionality of these devices is significantly impeded by electrical leakage at high temperatures. In this study, we fundamentally study the mechanism of electrical leakage suppression due to phase transformation in a series of donor-doped ferroelectric oxides,Ba0.955Eu0.03Ti(1-x)ZrxO3 with 0<= x<= 0.15. Our experiments clearly demonstrate that the symmetry-breaking phase transformations result in the reduction in electrical conductivity of the donor-doped ferroelectric oxides. The DFT calculation suggests that the donor energy level undergoes a shallow-to-deep transition at the phase transformation temperature. By analyzing the constitutive model of the leakage current density function, we propose a leakage suppression coefficient that rationalizes the development of ferroelectrics with low electrical leakage at elevated temperatures.


title: ACE Metric: Advection and Convection Evaluation for Accurate Weather Forecasting

abstract: Recently, data-driven weather forecasting methods have received significant attention for surpassing the RMSE performance of traditional NWP (Numerical Weather Prediction)-based methods. However, data-driven models are tuned to minimize the loss between forecasted data and ground truths, often using pixel-wise loss. This can lead to models that produce blurred outputs, which, despite being significantly different in detail from the actual weather conditions, still demonstrate low RMSE values. Although evaluation metrics from the computer vision field, such as PSNR, SSIM, and FVD, can be used, they are not entirely suitable for weather variables. This is because weather variables exhibit continuous physical changes over time and lack the distinct boundaries of objects typically seen in computer vision images. To resolve these issues, we propose the advection and convection Error (ACE) metric, specifically designed to assess how well models predict advection and convection, which are significant atmospheric transfer methods. We have validated the ACE evaluation metric on the WeatherBench2 and MovingMNIST datasets.


title: XctDiff: Reconstruction of CT Images with Consistent Anatomical Structures from a Single Radiographic Projection Image

abstract: In this paper, we present XctDiff, an algorithm framework for reconstructing CT from a single radiograph, which decomposes the reconstruction process into two easily controllable tasks: feature extraction and CT reconstruction. Specifically, we first design a progressive feature extraction strategy that is able to extract robust 3D priors from radiographs. Then, we use the extracted prior information to guide the CT reconstruction in the latent space. Moreover, we design a homogeneous spatial codebook to improve the reconstruction quality further. The experimental results show that our proposed method achieves state-of-the-art reconstruction performance and overcomes the blurring issue. We also apply XctDiff on self-supervised pre-training task. The effectiveness indicates that it has promising additional applications in medical image analysis. The code is available at:https://github.com/qingze-bai/XctDiff


title: MTS-Net: Dual-Enhanced Positional Multi-Head Self-Attention for 3D CT Diagnosis of May-Thurner Syndrome

abstract: May-Thurner Syndrome (MTS), also known as iliac vein compression syndrome or Cockett's syndrome, is a condition potentially impacting over 20 percent of the population, leading to an increased risk of iliofemoral deep venous thrombosis. In this paper, we present a 3D-based deep learning approach called MTS-Net for diagnosing May-Thurner Syndrome using CT scans. To effectively capture the spatial-temporal relationship among CT scans and emulate the clinical process of diagnosing MTS, we propose a novel attention module called the dual-enhanced positional multi-head self-attention (DEP-MHSA). The proposed DEP-MHSA reconsiders the role of positional embedding and incorporates a dual-enhanced positional embedding in both attention weights and residual connections. Further, we establish a new dataset, termed MTS-CT, consisting of 747 subjects. Experimental results demonstrate that our proposed approach achieves state-of-the-art MTS diagnosis results, and our self-attention design facilitates the spatial-temporal modeling. We believe that our DEP-MHSA is more suitable to handle CT image sequence modeling and the proposed dataset enables future research on MTS diagnosis. We make our code and dataset publicly available at: https://github.com/Nutingnon/MTS_dep_mhsa.


title: Whitney Stratification of Algebraic Boundaries of Convex Semi-algebraic Sets

abstract: Algebraic boundaries of convex semi-algebraic sets are closely related to polynomial optimization problems. Building upon Rainer Sinn's work, we refine the stratification of iterated singular loci to a Whitney (a) stratification, which gives a list of candidates of varieties whose dual is an irreducible component of the algebraic boundary of the dual convex body. We also present an algorithm based on Teissier's criterion to compute Whitney (a) stratifications, which employs conormal spaces and prime decomposition.


title: Xenon plasma-focused ion beam milling as a method to deterministically fabricate bright and high-purity single-photon sources operating at C-band

abstract: Electron beam lithography is a standard method for fabricating photonic nanostructures around semiconductor quantum dots (QDs), which are crucial for efficient single and indistinguishable photon sources in quantum information processing. However, this technique lacks direct 3D control over the nanostructure shape, complicating the design and enlarging the 2D footprint to suppress in-plane photon leakage while directing photons into the collecting lens aperture. Here, we present an alternative approach to employ Xenon plasma-focused ion beam (Xe-PFIB) technology as a reliable method for the 3D shaping of photonic nanostructures containing low-density self-assembled InAs/InP quantum dots emitting in the C-band range of the 3rd telecommunication window. We explore both deterministic and non-deterministic fabrication approaches, resulting in mesas naturally shaped as truncated cones. As a demonstration, we fabricate mesas using a heterogeneously integrated structure with a QDs membrane atop an aluminum mirror and silicon substrate. Finite-difference time-domain (FDTD) simulations show that the angled sidewalls significantly increase photon extraction efficiency, achieving {\eta} = 0.89 for NA = 0.65. We demonstrate experimentally a high purity of pulsed single-photon emission (~99%) and a high extraction efficiency of {\eta} = 0.24, with the latter surpassing the highest reported values obtained using electron beam lithography in the C-band.


title: PPPR: Portable Plug-in Prompt Refiner for Text to Audio Generation

abstract: Text-to-Audio (TTA) aims to generate audio that corresponds to the given text description, playing a crucial role in media production. The text descriptions in TTA datasets lack rich variations and diversity, resulting in a drop in TTA model performance when faced with complex text. To address this issue, we propose a method called Portable Plug-in Prompt Refiner, which utilizes rich knowledge about textual descriptions inherent in large language models to effectively enhance the robustness of TTA acoustic models without altering the acoustic training set. Furthermore, a Chain-of-Thought that mimics human verification is introduced to enhance the accuracy of audio descriptions, thereby improving the accuracy of generated content in practical applications. The experiments show that our method achieves a state-of-the-art Inception Score (IS) of 8.72, surpassing AudioGen, AudioLDM and Tango.


title: Out-of-equilibrium Eigenstate Thermalization Hypothesis

abstract: Understanding how out-of-equilibrium states thermalize under quantum unitary dynamics is an important problem in many-body physics. In this work, we propose a statistical ansatz for the matrix elements of non-equilibrium initial states in the energy eigenbasis. The approach is inspired by the Eigenstate Thermalisation Hypothesis (ETH) but the proposed ansatz exhibits different scaling. Importantly, exponentially small cross-correlations between the observable and the initial state matrix elements determine relaxation dynamics toward equilibrium. We numerically verify scaling and cross-correlation, point out the emergent universality of the high-frequency behavior, and outline possible generalizations.


title: Statistical QoS Provisioning Architecture for 6G Satellite-Terrestrial Integrated Networks

abstract: The emergence of massive ultra-reliable and low latency communications (mURLLC) as a category of time/reliability-sensitive service over 6G networks has received considerable research attention, which has presented unprecedented challenges. As one of the key enablers for 6G, satellite-terrestrial integrated networks (STIN) have been developed to offer more expansive connectivity and comprehensive 3D coverage in space-aerial-terrestrial domains for supporting 6G mission-critical mURLLC applications while fulfilling diverse and rigorous quality of service (QoS) requirements. In the context of these mURLLC-driven satellite services, data freshness assumes paramount importance, as outdated data may engender unpredictable or catastrophic outcomes. To effectively measure data freshness in satellite-terrestrial integrated communications, age of information (AoI) has recently surfaced as a new dimension of QoS metric to support time-sensitive applications. It is crucial to design new analytical models that ensure stringent and diverse QoS metrics bounded by different key parameters, including AoI, delay, and reliability, over 6G satellite-terrestrial integrated networks. However, due to the complicated and dynamic nature of satellite-terrestrial integrated network environments, the research on efficiently defining new statistical QoS schemes while taking into account varying degrees of freedom has still been in their infancy. To remedy these deficiencies, in this paper we develop statistical QoS provisioning schemes over 6G satellite-terrestrial integrated networks in the finite blocklength regime. Particularly, we firstly introduce and review key technologies for supporting mURLLC. Secondly, we formulate a number of novel fundamental statistical-QoS metrics in the finite blocklength regime. Finally, we conduct a set of simulations to evaluate our developed statistical QoS schemes.


title: Memory principle of the Matlab code for Lyapunov Exponents of fractional order

abstract: The paper presents two representative classes of Impulsive Fractional Differential Equations defined with generalized Caputo\'s derivative, with fixed lower limit and changing lower limit, respectively. Memory principle is studied and numerical examples are considered. The problem of the memory principle of the Matlab code for Lyapunov exponents of fractional order systems [Danca & Kuznetsov, 2018] is analyzed.


title: LogiCode: an LLM-Driven Framework for Logical Anomaly Detection

abstract: This paper presents LogiCode, a novel framework that leverages Large Language Models (LLMs) for identifying logical anomalies in industrial settings, moving beyond traditional focus on structural inconsistencies. By harnessing LLMs for logical reasoning, LogiCode autonomously generates Python codes to pinpoint anomalies such as incorrect component quantities or missing elements, marking a significant leap forward in anomaly detection technologies. A custom dataset "LOCO-Annotations" and a benchmark "LogiBench" are introduced to evaluate the LogiCode's performance across various metrics including binary classification accuracy, code generation success rate, and precision in reasoning. Findings demonstrate LogiCode's enhanced interpretability, significantly improving the accuracy of logical anomaly detection and offering detailed explanations for identified anomalies. This represents a notable shift towards more intelligent, LLM-driven approaches in industrial anomaly detection, promising substantial impacts on industry-specific applications.