title: DNPM: A Neural Parametric Model for the Synthesis of Facial Geometric Details

abstract: Parametric 3D models have enabled a wide variety of computer vision and graphics tasks, such as modeling human faces, bodies and hands. In 3D face modeling, 3DMM is the most widely used parametric model, but can't generate fine geometric details solely from identity and expression inputs. To tackle this limitation, we propose a neural parametric model named DNPM for the facial geometric details, which utilizes deep neural network to extract latent codes from facial displacement maps encoding details and wrinkles. Built upon DNPM, a novel 3DMM named Detailed3DMM is proposed, which augments traditional 3DMMs by including the synthesis of facial details only from the identity and expression inputs. Moreover, we show that DNPM and Detailed3DMM can facilitate two downstream applications: speech-driven detailed 3D facial animation and 3D face reconstruction from a degraded image. Extensive experiments have shown the usefulness of DNPM and Detailed3DMM, and the progressiveness of two proposed applications.


title: Uncertainty-aware sign language video retrieval with probability distribution modeling

abstract: Sign language video retrieval plays a key role in facilitating information access for the deaf community. Despite significant advances in video-text retrieval, the complexity and inherent uncertainty of sign language preclude the direct application of these techniques. Previous methods achieve the mapping between sign language video and text through fine-grained modal alignment. However, due to the scarcity of fine-grained annotation, the uncertainty inherent in sign language video is underestimated, limiting the further development of sign language retrieval tasks. To address this challenge, we propose a novel Uncertainty-aware Probability Distribution Retrieval (UPRet), that conceptualizes the mapping process of sign language video and text in terms of probability distributions, explores their potential interrelationships, and enables flexible mappings. Experiments on three benchmarks demonstrate the effectiveness of our method, which achieves state-of-the-art results on How2Sign (59.1%), PHOENIX-2014T (72.0%), and CSL-Daily (78.4%).


title: Diffusion Policies creating a Trust Region for Offline Reinforcement Learning

abstract: Offline reinforcement learning (RL) leverages pre-collected datasets to train optimal policies. Diffusion Q-Learning (DQL), introducing diffusion models as a powerful and expressive policy class, significantly boosts the performance of offline RL. However, its reliance on iterative denoising sampling to generate actions slows down both training and inference. While several recent attempts have tried to accelerate diffusion-QL, the improvement in training and/or inference speed often results in degraded performance. In this paper, we introduce a dual policy approach, Diffusion Trusted Q-Learning (DTQL), which comprises a diffusion policy for pure behavior cloning and a practical one-step policy. We bridge the two polices by a newly introduced diffusion trust region loss. The diffusion policy maintains expressiveness, while the trust region loss directs the one-step policy to explore freely and seek modes within the region defined by the diffusion policy. DTQL eliminates the need for iterative denoising sampling during both training and inference, making it remarkably computationally efficient. We evaluate its effectiveness and algorithmic characteristics against popular Kullback-Leibler (KL) based distillation methods in 2D bandit scenarios and gym tasks. We then show that DTQL could not only outperform other methods on the majority of the D4RL benchmark tasks but also demonstrate efficiency in training and inference speeds. The PyTorch implementation is available at https://github.com/TianyuCodings/Diffusion_Trusted_Q_Learning.


title: Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing

abstract: While ChatGPT has significantly impacted education by offering personalized resources for students, its integration into educational settings poses unprecedented risks, such as inaccuracies and biases in AI-generated content, plagiarism and over-reliance on AI, and privacy and security issues. To help teachers address such risks, we conducted a two-phase iterative design process that comprises surveys, interviews, and prototype demonstration involving six EFL (English as a Foreign Language) teachers, who integrated ChatGPT into semester-long English essay writing classes. Based on the needs identified during the initial survey and interviews, we developed a prototype of Prompt Analytics Dashboard (PAD) that integrates the essay editing history and chat logs between students and ChatGPT. Teacher's feedback on the prototype informs additional features and unmet needs for designing future PAD, which helps them (1) analyze contextual analysis of student behaviors, (2) design an overall learning loop, and (3) develop their teaching skills.


title: Neural Network Gauge Field Transformation for 4D SU(3) gauge fields

abstract: We construct neural networks that work for any Lie group and maintain gauge covariance, enabling smooth, invertible gauge field transformations. We implement these transformations for 4D SU(3) lattice gauge fields and explore their use in HMC. We focus on developing loss functions and optimizing the transformations. We show the effects on HMC's molecular dynamics and discuss the scalability of the approach.


title: Constraining small-scale primordial magnetic fields from the abundance of primordial black holes

abstract: The presence of magnetic fields in the early universe affects the cosmological processes, leading to the distinct signature, which allows constraining their properties and the genesis mechanisms. In this study, we revisit the method to constrain the amplitude of the magnetic fields on small scales in the radiation-dominated era from the abundance of primordial black holes. Constraints in the previous work were based on the fact that the density perturbations sourced by stronger magnetic fields become large enough to gravitationally collapse to form PBHs. However, we demonstrate that this picture is incomplete because magnetic fields also increase the threshold value of the density contrast required for PBH formation. The increase in threshold density contrast is more pronounced on smaller scales, and in extreme cases, it might even prevent PBH production despite the presence of significant magnetic field. Taking into account the relevant physical effects on the magnetized overdense region, we establish an upper-limit on the amplitude of comoving magnetic fields, approximately $0.12-0.14 {\rm \mu G}$ at a scale of $10^{17} {\rm Mpc}^{-1}$. Additionally, we compare our constraints with various small-scale probes.


title: Grade Like a Human: Rethinking Automated Assessment with Large Language Models

abstract: While large language models (LLMs) have been used for automated grading, they have not yet achieved the same level of performance as humans, especially when it comes to grading complex questions. Existing research on this topic focuses on a particular step in the grading procedure: grading using predefined rubrics. However, grading is a multifaceted procedure that encompasses other crucial steps, such as grading rubrics design and post-grading review. There has been a lack of systematic research exploring the potential of LLMs to enhance the entire grading~process. In this paper, we propose an LLM-based grading system that addresses the entire grading procedure, including the following key components: 1) Developing grading rubrics that not only consider the questions but also the student answers, which can more accurately reflect students' performance. 2) Under the guidance of grading rubrics, providing accurate and consistent scores for each student, along with customized feedback. 3) Conducting post-grading review to better ensure accuracy and fairness. Additionally, we collected a new dataset named OS from a university operating system course and conducted extensive experiments on both our new dataset and the widely used Mohler dataset. Experiments demonstrate the effectiveness of our proposed approach, providing some new insights for developing automated grading systems based on LLMs.


title: Distribution Aligned Semantics Adaption for Lifelong Person Re-Identification

abstract: In real-world scenarios, person Re-IDentification (Re-ID) systems need to be adaptable to changes in space and time. Therefore, the adaptation of Re-ID models to new domains while preserving previously acquired knowledge is crucial, known as Lifelong person Re-IDentification (LReID). Advanced LReID methods rely on replaying exemplars from old domains and applying knowledge distillation in logits with old models. However, due to privacy concerns, retaining previous data is inappropriate. Additionally, the fine-grained and open-set characteristics of Re-ID limit the effectiveness of the distillation paradigm for accumulating knowledge. We argue that a Re-ID model trained on diverse and challenging pedestrian images at a large scale can acquire robust and general human semantic knowledge. These semantics can be readily utilized as shared knowledge for lifelong applications. In this paper, we identify the challenges and discrepancies associated with adapting a pre-trained model to each application domain, and introduce the Distribution Aligned Semantics Adaption (DASA) framework. It efficiently adjusts Batch Normalization (BN) to mitigate interference from data distribution discrepancy and freezes the pre-trained convolutional layers to preserve shared knowledge. Additionally, we propose the lightweight Semantics Adaption (SA) module, which effectively adapts learned semantics to enhance pedestrian representations. Extensive experiments demonstrate the remarkable superiority of our proposed framework over advanced LReID methods, and it exhibits significantly reduced storage consumption. DASA presents a novel and cost-effective perspective on effectively adapting pre-trained models for LReID.


title: Asymptotics for automorphisms of quantum systems on the lattice

abstract: We study the behaviour of continuous automorphism groups of quantum spin systems on the lattice. Whereas the shift is norm asymptotically abelian continuous automorphism groups can lead only to delocalization but not to norm asymptotic abelianess. As a consequence the shift does not allow a continuous extension.


title: Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity

abstract: Bilevel reinforcement learning (RL), which features intertwined two-level problems, has attracted growing interest recently. The inherent non-convexity of the lower-level RL problem is, however, to be an impediment to developing bilevel optimization methods. By employing the fixed point equation associated with the regularized RL, we characterize the hyper-gradient via fully first-order information, thus circumventing the assumption of lower-level convexity. This, remarkably, distinguishes our development of hyper-gradient from the general AID-based bilevel frameworks since we take advantage of the specific structure of RL problems. Moreover, we propose both model-based and model-free bilevel reinforcement learning algorithms, facilitated by access to the fully first-order hyper-gradient. Both algorithms are provable to enjoy the convergence rate $\mathcal{O}(\epsilon^{-1})$. To the best of our knowledge, this is the first time that AID-based bilevel RL gets rid of additional assumptions on the lower-level problem. In addition, numerical experiments demonstrate that the hyper-gradient indeed serves as an integration of exploitation and exploration.


title: Enhancement of the Cauchy-Schwarz Inequality and Its Implications for Numerical Radius Inequalities

abstract: In this article, we establish an improvement of the Cauchy-Schwarz inequality. Let $x, y \in \mathcal{H},$ and let $f: (0,1) \rightarrow \mathbb{R}^+$ be a well-defined function, where $\mathbb{R}^+$ denote the set of all positive real numbers. Then \[|\langle x, y \rangle|^2 \leq \frac{f(t)}{1+f(t)} \|x\|^2 \|y\|^2 + \frac{1}{1+ f(t)} |\langle x, y \rangle | \|x\|\|y\|. \] We have applied this result to derive new and improved upper bounds for the numerical radius.


title: Fairness in AI-Driven Recruitment: Challenges, Metrics, Methods, and Future Directions

abstract: The recruitment process is crucial to an organization's ability to position itself for success, from finding qualified and well-fitting job candidates to impacting its output and culture. Therefore, over the past century, human resources experts and industrial-organizational psychologists have established hiring practices such as attracting candidates with job ads, gauging a candidate's skills with assessments, and using interview questions to assess organizational fit. However, the advent of big data and machine learning has led to a rapid transformation in the traditional recruitment process as many organizations have moved to using artificial intelligence (AI). Given the prevalence of AI-based recruitment, there is growing concern that human biases may carry over to decisions made by these systems, which can amplify the effect through systematic application. Empirical studies have identified prevalent biases in candidate ranking software and chatbot interactions, catalyzing a growing body of research dedicated to AI fairness over the last decade. This paper provides a comprehensive overview of this emerging field by discussing the types of biases encountered in AI-driven recruitment, exploring various fairness metrics and mitigation methods, and examining tools for auditing these systems. We highlight current challenges and outline future directions for developing fair AI recruitment applications, ensuring equitable candidate treatment and enhancing organizational outcomes.


title: Initial measurement of reactor antineutrino oscillation at SNO+

abstract: The SNO+ collaboration reports its first spectral analysis of long-baseline reactor antineutrino oscillation using 114 tonne-years of data. Fitting the neutrino oscillation probability to the observed energy spectrum yields constraints on the neutrino mass-squared difference $\Delta m^2_{21}$. In the ranges allowed by previous measurements, the best-fit $\Delta m^2_{21}$ is (8.85$^{+1.10}_{-1.33}$) $\times$ 10$^{-5}$ eV$^2$. This measurement is continuing in the next phases of SNO+ and is expected to surpass the present global precision on $\Delta m^2_{21}$ with about three years of data.


title: Significance of Chain of Thought in Gender Bias Mitigation for English-Dravidian Machine Translation

abstract: Gender bias in machine translation (MT) sys- tems poses a significant challenge to achieving accurate and inclusive translations. This paper examines gender bias in machine translation systems for languages such as Telugu and Kan- nada from the Dravidian family, analyzing how gender inflections affect translation accuracy and neutrality using Google Translate and Chat- GPT. It finds that while plural forms can reduce bias, individual-centric sentences often main- tain the bias due to historical stereotypes. The study evaluates the Chain of Thought process- ing, noting significant bias mitigation from 80% to 4% in Telugu and from 40% to 0% in Kan- nada. It also compares Telugu and Kannada translations, emphasizing the need for language specific strategies to address these challenges and suggesting directions for future research to enhance fairness in both data preparation and prompts during inference.


title: Acylindrical hyperbolicity of outer automorphism groups of right-angled Artin groups

abstract: We study the acylindrical hyperbolicity of the outer automorphism group of a right-angled Artin group $A_\Gamma$. When the defining graph $\Gamma$ has no SIL-pair (separating intersection of links), we obtain a necessary and sufficient condition for $\mathrm{Out}(A_\Gamma)$ to be acylindrically hyperbolic. As a corollary, if $\Gamma$ is a random connected graph satisfying a certain probabilistic condition, then $\mathrm{Out}(A_\Gamma)$ is not acylindrically hyperbolic with high probability. When $\Gamma$ has a maximal SIL-pair system, we derive a classification theorem for partial conjugations. Such a classification theorem allows us to show that the acylindrical hyperbolicity of $\mathrm{Out}(A_\Gamma)$ is closely related to the existence of a specific type of partial conjugations.


title: Towards a Better Evaluation of Out-of-Domain Generalization

abstract: The objective of Domain Generalization (DG) is to devise algorithms and models capable of achieving high performance on previously unseen test distributions. In the pursuit of this objective, average measure has been employed as the prevalent measure for evaluating models and comparing algorithms in the existing DG studies. Despite its significance, a comprehensive exploration of the average measure has been lacking and its suitability in approximating the true domain generalization performance has been questionable. In this study, we carefully investigate the limitations inherent in the average measure and propose worst+gap measure as a robust alternative. We establish theoretical grounds of the proposed measure by deriving two theorems starting from two different assumptions. We conduct extensive experimental investigations to compare the proposed worst+gap measure with the conventional average measure. Given the indispensable need to access the true DG performance for studying measures, we modify five existing datasets to come up with SR-CMNIST, C-Cats&Dogs, L-CIFAR10, PACS-corrupted, and VLCS-corrupted datasets. The experiment results unveil an inferior performance of the average measure in approximating the true DG performance and confirm the robustness of the theoretically supported worst+gap measure.


title: Enhancing Sufficient Dimension Reduction via Hellinger Correlation

abstract: In this work, we develop a new theory and method for sufficient dimension reduction (SDR) in single-index models, where SDR is a sub-field of supervised dimension reduction based on conditional independence. Our work is primarily motivated by the recent introduction of the Hellinger correlation as a dependency measure. Utilizing this measure, we develop a method capable of effectively detecting the dimension reduction subspace, complete with theoretical justification. Through extensive numerical experiments, we demonstrate that our proposed method significantly enhances and outperforms existing SDR methods. This improvement is largely attributed to our proposed method's deeper understanding of data dependencies and the refinement of existing SDR techniques.


title: Universal Online Convex Optimization with $1$ Projection per Round

abstract: To address the uncertainty in function types, recent progress in online convex optimization (OCO) has spurred the development of universal algorithms that simultaneously attain minimax rates for multiple types of convex functions. However, for a $T$-round online problem, state-of-the-art methods typically conduct $O(\log T)$ projections onto the domain in each round, a process potentially time-consuming with complicated feasible sets. In this paper, inspired by the black-box reduction of Cutkosky and Orabona (2018), we employ a surrogate loss defined over simpler domains to develop universal OCO algorithms that only require $1$ projection. Embracing the framework of prediction with expert advice, we maintain a set of experts for each type of functions and aggregate their predictions via a meta-algorithm. The crux of our approach lies in a uniquely designed expert-loss for strongly convex functions, stemming from an innovative decomposition of the regret into the meta-regret and the expert-regret. Our analysis sheds new light on the surrogate loss, facilitating a rigorous examination of the discrepancy between the regret of the original loss and that of the surrogate loss, and carefully controlling meta-regret under the strong convexity condition. In this way, with only $1$ projection per round, we establish optimal regret bounds for general convex, exponentially concave, and strongly convex functions simultaneously. Furthermore, we enhance the expert-loss to exploit the smoothness property, and demonstrate that our algorithm can attain small-loss regret for multiple types of convex and smooth functions.


title: Bridging eResearch Infrastructure and Experimental Materials Science Process in the Quantum Data Hub

abstract: Experimental materials science is experiencing significant growth due to automated experimentation and AI techniques. Integrated autonomous platforms are emerging, combining generative models, robotics, simulations, and automated systems for material synthesis. However, two major challenges remain: democratizing access to these technologies and creating accessible infrastructure for under-resourced scientists. This paper introduces the Quantum Data Hub (QDH), a community-accessible research infrastructure aimed at researchers working with quantum materials. QDH integrates with the National Data Platform, adhering to FAIR principles while proposing additional UNIT principles for usability, navigability, interpretability, and timeliness. The QDH facilitates collaboration and extensibility, allowing seamless integration of new researchers, instruments, and data into the system.


title: DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark

abstract: Recently, video generation techniques have advanced rapidly. Given the popularity of video content on social media platforms, these models intensify concerns about the spread of fake information. Therefore, there is a growing demand for detectors capable of distinguishing between fake AI-generated videos and mitigating the potential harm caused by fake information. However, the lack of large-scale datasets from the most advanced video generators poses a barrier to the development of such detectors. To address this gap, we introduce the first AI-generated video detection dataset, GenVideo. It features the following characteristics: (1) a large volume of videos, including over one million AI-generated and real videos collected; (2) a rich diversity of generated content and methodologies, covering a broad spectrum of video categories and generation techniques. We conducted extensive studies of the dataset and proposed two evaluation methods tailored for real-world-like scenarios to assess the detectors' performance: the cross-generator video classification task assesses the generalizability of trained detectors on generators; the degraded video classification task evaluates the robustness of detectors to handle videos that have degraded in quality during dissemination. Moreover, we introduced a plug-and-play module, named Detail Mamba (DeMamba), designed to enhance the detectors by identifying AI-generated videos through the analysis of inconsistencies in temporal and spatial dimensions. Our extensive experiments demonstrate DeMamba's superior generalizability and robustness on GenVideo compared to existing detectors. We believe that the GenVideo dataset and the DeMamba module will significantly advance the field of AI-generated video detection. Our code and dataset will be aviliable at \url{https://github.com/chenhaoxing/DeMamba}.


title: Text Guided Image Editing with Automatic Concept Locating and Forgetting

abstract: With the advancement of image-to-image diffusion models guided by text, significant progress has been made in image editing. However, a persistent challenge remains in seamlessly incorporating objects into images based on textual instructions, without relying on extra user-provided guidance. Text and images are inherently distinct modalities, bringing out difficulties in fully capturing the semantic intent conveyed through language and accurately translating that into the desired visual modifications. Therefore, text-guided image editing models often produce generations with residual object attributes that do not fully align with human expectations. To address this challenge, the models should comprehend the image content effectively away from a disconnect between the provided textual editing prompts and the actual modifications made to the image. In our paper, we propose a novel method called Locate and Forget (LaF), which effectively locates potential target concepts in the image for modification by comparing the syntactic trees of the target prompt and scene descriptions in the input image, intending to forget their existence clues in the generated image. Compared to the baselines, our method demonstrates its superiority in text-guided image editing tasks both qualitatively and quantitatively.


title: WISDOM Project -- XXI. Giant molecular clouds in the central region of the barred spiral galaxy NGC 613: a steep size -- linewidth relation

abstract: NGC~613 is a nearby barred spiral galaxy with a nuclear ring. Exploiting high spatial resolution ($\approx20$ pc) Atacama Large Millimeter/sub-millimeter Array $^{12}$CO(1-0) observations, we study the giant molecular clouds (GMCs) in the nuclear ring and its vicinity, identifying $158$ spatially- and spectrally-resolved GMCs. The GMC sizes ($R_{\mathrm{c}}$) are comparable to those of the clouds in the Milky Way (MW) disc, but their gas masses, observed linewidths ($\sigma_{\mathrm{obs,los}}$) and gas mass surface densities are larger. The GMC size -- linewidth relation ($\sigma_{\mathrm{obs,los}}\propto R_{\mathrm{c}}^{0.77}$) is steeper than that of the clouds of the MW disc and centre, and the GMCs are on average only marginally gravitationally bound (with a mean virial parameter $\langle\alpha_{\mathrm{obs,vir}}\rangle\approx1.7$). We discuss the possible origins of the steep size -- linewidth relation and enhanced observed linewidths of the clouds and suggest that a combination of mechanisms such as stellar feedback, gas accretion and cloud-cloud collisions, as well as the gas inflows driven by the large-scale bar, may play a role.


title: Optical Extinctions of Inter-Arm Molecular Clouds in M31: A Pilot Study for the Upcoming CSST Observations

abstract: Recent sub-millimeter dust thermal emission observations have unveiled a significant number of inter-arm massive molecular clouds in M31.However,the effectiveness of this technique is limited to its sensitivity,making it challenging to study more distant galaxies.This study introduces an alternative approach,utilizing optical extinctions derived from space-based telescopes,with a focus on the forthcoming China Space Station Telescope(CSST).We first demonstrate the capability of this method by constructing dust extinction maps for 17 inter-arm massive molecular clouds in M31 using the Panchromatic Hubble Andromeda Treasury(PHAT) data.Our analysis reveals that inter-arm massive molecular clouds with an optical extinction(AV) greater than 1.6 mag exhibit a notable AV excess,facilitating their identification.The majority of these inter-arm massive molecular clouds show an AV around 1 mag,aligning with measurements from our JCMT data.Further validation using a mock CSST RGB star catalog confirms the method's effectiveness.We show that the derived AV values using CSST z and y photometries align more closely with the input values.Molecular clouds with AV>1.6 mag can also be identified using the CSST mock data.We thus claim that future CSST observation could provide an effective way for the detection of inter-arm massive molecular clouds with significant optical extinction in nearby galaxies.


title: SimiSketch: Efficiently Estimating Similarity of streaming Multisets

abstract: The challenge of estimating similarity between sets has been a significant concern in data science, finding diverse applications across various domains. However, previous approaches, such as MinHash, have predominantly centered around hashing techniques, which are well-suited for sets but less naturally adaptable to multisets, a common occurrence in scenarios like network streams and text data. Moreover, with the increasing prevalence of data arriving in streaming patterns, many existing methods struggle to handle cases where set items are presented in a continuous stream. Consequently, our focus in this paper is on the challenging scenario of multisets with item streams. To address this, we propose SimiSketch, a sketching algorithm designed to tackle this specific problem. The paper begins by presenting two simpler versions that employ intuitive sketches for similarity estimation. Subsequently, we formally introduce SimiSketch and leverage SALSA to enhance accuracy. To validate our algorithms, we conduct extensive testing on synthetic datasets, real-world network traffic, and text articles. Our experiment shows that compared with the state-of-the-art, SimiSketch can improve the accuracy by up to 42 times, and increase the throughput by up to 360 times. The complete source code is open-sourced and available on GitHub for reference.


title: HINT: Learning Complete Human Neural Representations from Limited Viewpoints

abstract: No augmented application is possible without animated humanoid avatars. At the same time, generating human replicas from real-world monocular hand-held or robotic sensor setups is challenging due to the limited availability of views. Previous work showed the feasibility of virtual avatars but required the presence of 360 degree views of the targeted subject. To address this issue, we propose HINT, a NeRF-based algorithm able to learn a detailed and complete human model from limited viewing angles. We achieve this by introducing a symmetry prior, regularization constraints, and training cues from large human datasets. In particular, we introduce a sagittal plane symmetry prior to the appearance of the human, directly supervise the density function of the human model using explicit 3D body modeling, and leverage a co-learned human digitization network as additional supervision for the unseen angles. As a result, our method can reconstruct complete humans even from a few viewing angles, increasing performance by more than 15% PSNR compared to previous state-of-the-art algorithms.


title: Summing divergent matrix series

abstract: We extend several celebrated methods in classical analysis for summing series of complex numbers to series of complex matrices. These include the summation methods of Abel, Borel, Ces\'aro, Euler, Lambert, N\"orlund, and Mittag-Leffler, which are frequently used to sum scalar series that are divergent in the conventional sense. One feature of our matrix extensions is that they are fully noncommutative generalizations of their scalar counterparts -- not only is the scalar series replaced by a matrix series, positive weights are replaced by positive definite matrix weights, order on $\mathbb{R}$ replaced by Loewner order, exponential function replaced by matrix exponential function, etc. We will establish the regularity of our matrix summation methods, i.e., when applied to a matrix series convergent in the conventional sense, we obtain the same value for the sum. Our second goal is to provide numerical algorithms that work in conjunction with these summation methods. We discuss how the block and mixed-block summation algorithms, the Kahan compensated summation algorithm, may be applied to matrix sums with similar roundoff error bounds. These summation methods and algorithms apply not only to power or Taylor series of matrices but to any general matrix series including matrix Fourier and Dirichlet series. We will demonstrate the utility of these summation methods: establishing a Fej\'{e}r's theorem and alleviating the Gibbs phenomenon for matrix Fourier series; extending the domains of matrix functions and accurately evaluating them; enhancing the matrix Pad\'e approximation and Schur--Parlett algorithms; and more.


title: Status of QCD precision predictions for Drell-Yan processes

abstract: We compute differential distributions for Drell-Yan processes at the LHC and the Tevatron colliders at next-to-next-to-leading order in perturbative QCD, including fiducial cuts on the decay leptons in the final state. The comparison of predictions obtained with four different codes shows excellent agreement, once linear power corrections from the fiducial cuts are included in those codes that rely on phase-space slicing subtraction schemes. For $Z$-boson production we perform a detailed study of the symmetric cuts on the transverse momenta of the decay leptons. Predictions at fixed order in perturbative QCD for those symmetric cuts, typically imposed in experiments, suffer from an instability. We show how this can be remedied by an all-order resummation of the fiducial transverse momentum spectrum, and we comment on the choice of cuts for future experimental analyses.


title: SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths

abstract: Speculative decoding reduces the inference latency of a target large language model via utilizing a smaller and faster draft model. Its performance depends on a hyperparameter K -- the candidate length, i.e., the number of candidate tokens for the target model to verify in each round. However, previous methods often use simple heuristics to choose K, which may result in sub-optimal performance. We study the choice of the candidate length K and formulate it as a Markov Decision Process. We theoretically show that the optimal policy of this Markov decision process takes the form of a threshold policy, i.e., the current speculation should stop and be verified when the probability of getting a rejection exceeds a threshold value. Motivated by this theory, we propose SpecDec++, an enhanced version of speculative decoding that adaptively determines the candidate length on the fly. We augment the draft model with a trained acceptance prediction head to predict the conditional acceptance probability of the candidate tokens. SpecDec++ will stop the current speculation when the predicted probability that at least one token gets rejected exceeds a threshold. We implement SpecDec++ and apply it to the llama-2-chat 7B & 70B model pair. Our adaptive method achieves a 2.04x speedup on the Alpaca dataset (an additional 7.2% improvement over the baseline speculative decoding). On the GSM8K and HumanEval datasets, our method achieves a 2.26x speedup (9.4% improvement) and 2.23x speedup (11.1% improvement), respectively.


title: Enhancing Large Vision Language Models with Self-Training on Image Comprehension

abstract: Large vision language models (LVLMs) integrate large language models (LLMs) with pre-trained vision encoders, thereby activating the perception capability of the model to understand image inputs for different queries and conduct subsequent reasoning. Improving this capability requires high-quality vision-language data, which is costly and labor-intensive to acquire. Self-training approaches have been effective in single-modal settings to alleviate the need for labeled data by leveraging model's own generation. However, effective self-training remains a challenge regarding the unique visual perception and reasoning capability of LVLMs. To address this, we introduce Self-Training on Image Comprehension (STIC), which emphasizes a self-training approach specifically for image comprehension. First, the model self-constructs a preference dataset for image descriptions using unlabeled images. Preferred responses are generated through a step-by-step prompt, while dis-preferred responses are generated from either corrupted images or misleading prompts. To further self-improve reasoning on the extracted visual information, we let the model reuse a small portion of existing instruction-tuning data and append its self-generated image descriptions to the prompts. We validate the effectiveness of STIC across seven different benchmarks, demonstrating substantial performance gains of 4.0% on average while using 70% less supervised fine-tuning data than the current method. Further studies investigate various components of STIC and highlight its potential to leverage vast quantities of unlabeled images for self-training. Code and data are made publicly available.


title: Rainbow cycles through specified vertices

abstract: An edge-coloured cycle is rainbow if the edges have distinct colours. Let $G$ be a graph such that any $k$ vertices lie in a cycle of $G$. The $k$-rainbow cycle index of $G$, denoted by $crx_k(G)$, is the minimum number of colours required to colour the edges of $G$ such that, for every set $S$ of $k$ vertices in $G$, there exists a rainbow cycle in $G$ containing $S$. In this paper, we will first prove some results about the parameter $crx_k(G)$ for general graphs $G$. One of the results is a classification of all graphs $G$ such that $crx_k(G)=e(G)$, for $k=1,2$. We will also determine $crx_k(G)$ for some specific graphs $G$, including wheels, complete graphs, complete bipartite and multipartite graphs, and discrete cubes.


title: LED: A Large-scale Real-world Paired Dataset for Event Camera Denoising

abstract: Event camera has significant advantages in capturing dynamic scene information while being prone to noise interference, particularly in challenging conditions like low threshold and low illumination. However, most existing research focuses on gentle situations, hindering event camera applications in realistic complex scenarios. To tackle this limitation and advance the field, we construct a new paired real-world event denoising dataset (LED), including 3K sequences with 18K seconds of high-resolution (1200*680) event streams and showing three notable distinctions compared to others: diverse noise levels and scenes, larger-scale with high-resolution, and high-quality GT. Specifically, it contains stepped parameters and varying illumination with diverse scenarios. Moreover, based on the property of noise events inconsistency and signal events consistency, we propose a novel effective denoising framework(DED) using homogeneous dual events to generate the GT with better separating noise from the raw. Furthermore, we design a bio-inspired baseline leveraging Leaky-Integrate-and-Fire (LIF) neurons with dynamic thresholds to realize accurate denoising. The experimental results demonstrate that the remarkable performance of the proposed approach on different datasets.The dataset and code are at https://github.com/Yee-Sing/led.


title: The Isospectral Problem for p-widths: An Application of Zoll Metrics

abstract: We pose the isospectral problem for the $p$-widths: Is a riemannian manifold $(M^n, g)$ uniquely determined by its $p$-widths, $\{\omega_p(M,g)\}_{p=1}^{\infty}$? We construct many counterexamples on $S^2$ using Zoll metrics and the fact that geodesic $p$-widths are given by unions of immersed geodesics.


title: A study on star formation in rotating and magnetized filamentary molecular clouds

abstract: A 2D dynamic model is utilized to investigate star formation in rotating filamentary molecular clouds (FMCs) amidst magnetic fields. The study reveals that the emergence of field stars is possible under both weak and strong magnetic fields due to the presence of low-density structures. The presence of a strong rotation in a strongly magnetized FMC Plays a crucial role in forming a combination of two binary pairs and two field stars. An intermediate-density structure in the presence of a moderate magnetic field can form a combination of binary stars and field stars, whereas, in very high dense filamentary molecular clouds, a low magnetic field may help to form binary stars or stellar associations. In a rapidly rotating and weakly magnetized highly dense cloud binary stars are formed, whereas, strong rotation and moderate magnetic field help to form stellar associations


title: Generalized Bayesian Nash Equilibrium with Continuous Type and Action Spaces

abstract: Bayesian game is a strategic decision-making model where each player's type parameter characterizing its own objective is private information: each player knows its own type but not its rivals' types, and Bayesian Nash equilibrium (BNE) is an outcome of this game where each player makes a strategic optimal decision according to its own type under the Nash conjecture. In this paper, we advance the literature by considering a generalized Bayesian game where each player's action space depends on its own type parameter and the rivals' actions. This reflects the fact that in practical applications, a firm's feasible action is often related to its own type (e.g. marginal cost) and the rivals' actions (e.g. common resource constraints in a competitive market). Under some moderate conditions, we demonstrate existence of continuous generalized Bayesian Nash equilibria (GBNE) and uniqueness of such an equilibrium when each player's action space is only dependent on its type. In the case that each player's action space is also dependent on rivals' actions, we give a simple example to show that uniqueness of GBNE is not guaranteed under standard monotone conditions. To compute an approximate GBNE, we restrict each player's response function to the space of polynomial functions of its type parameter and consequently convert the GBNE problem to a stochastic generalized Nash equilibrium problem (SGNE). To justify the approximation, we discuss convergence of the approximation scheme. Some preliminary numerical test results show that the approximation scheme works well.


title: QClusformer: A Quantum Transformer-based Framework for Unsupervised Visual Clustering

abstract: Unsupervised vision clustering, a cornerstone in computer vision, has been studied for decades, yielding significant outcomes across numerous vision tasks. However, these algorithms involve substantial computational demands when confronted with vast amounts of unlabeled data. Conversely, Quantum computing holds promise in expediting unsupervised algorithms when handling large-scale databases. In this study, we introduce QClusformer, a pioneering Transformer-based framework leveraging Quantum machines to tackle unsupervised vision clustering challenges. Specifically, we design the Transformer architecture, including the self-attention module and transformer blocks, from a Quantum perspective to enable execution on Quantum hardware. In addition, we present QClusformer, a variant based on the Transformer architecture, tailored for unsupervised vision clustering tasks. By integrating these elements into an end-to-end framework, QClusformer consistently outperforms previous methods running on classical computers. Empirical evaluations across diverse benchmarks, including MS-Celeb-1M and DeepFashion, underscore the superior performance of QClusformer compared to state-of-the-art methods.


title: Encoding and Controlling Global Semantics for Long-form Video Question Answering

abstract: Seeking answers effectively for long videos is essential to build video question answering (videoQA) systems. Previous methods adaptively select frames and regions from long videos to save computations. However, this fails to reason over the whole sequence of video, leading to sub-optimal performance. To address this problem, we introduce a state space layer (SSL) into multi-modal Transformer to efficiently integrate global semantics of the video, which mitigates the video information loss caused by frame and region selection modules. Our SSL includes a gating unit to enable controllability over the flow of global semantics into visual representations. To further enhance the controllability, we introduce a cross-modal compositional congruence (C^3) objective to encourage global semantics aligned with the question. To rigorously evaluate long-form videoQA capacity, we construct two new benchmarks Ego-QA and MAD-QA featuring videos of considerably long length, i.e. 17.5 minutes and 1.9 hours, respectively. Extensive experiments demonstrate the superiority of our framework on these new as well as existing datasets.


title: Llarull's theorem on punctured sphere with $L^\infty$ metric

abstract: The classical Llarull theorem states that a smooth metric on $n$-sphere cannot have scalar curvature no less than $n(n-1)$ and dominate the standard spherical metric at the same time unless it is the standard spherical metric. In this work, we prove that Llarull's rigidity theorem holds for $L^{\infty}$ metrics on spheres with finitely many points punctured. This is related to a question of Gromov.


title: Quantum Visual Feature Encoding Revisited

abstract: Although quantum machine learning has been introduced for a while, its applications in computer vision are still limited. This paper, therefore, revisits the quantum visual encoding strategies, the initial step in quantum machine learning. Investigating the root cause, we uncover that the existing quantum encoding design fails to ensure information preservation of the visual features after the encoding process, thus complicating the learning process of the quantum machine learning models. In particular, the problem, termed "Quantum Information Gap" (QIG), leads to a gap of information between classical and corresponding quantum features. We provide theoretical proof and practical demonstrations of that found and underscore the significance of QIG, as it directly impacts the performance of quantum machine learning algorithms. To tackle this challenge, we introduce a simple but efficient new loss function named Quantum Information Preserving (QIP) to minimize this gap, resulting in enhanced performance of quantum machine learning algorithms. Extensive experiments validate the effectiveness of our approach, showcasing superior performance compared to current methodologies and consistently achieving state-of-the-art results in quantum modeling.


title: Streaming Video Diffusion: Online Video Editing with Diffusion Models

abstract: We present a novel task called online video editing, which is designed to edit \textbf{streaming} frames while maintaining temporal consistency. Unlike existing offline video editing assuming all frames are pre-established and accessible, online video editing is tailored to real-life applications such as live streaming and online chat, requiring (1) fast continual step inference, (2) long-term temporal modeling, and (3) zero-shot video editing capability. To solve these issues, we propose Streaming Video Diffusion (SVDiff), which incorporates the compact spatial-aware temporal recurrence into off-the-shelf Stable Diffusion and is trained with the segment-level scheme on large-scale long videos. This simple yet effective setup allows us to obtain a single model that is capable of executing a broad range of videos and editing each streaming frame with temporal coherence. Our experiments indicate that our model can edit long, high-quality videos with remarkable results, achieving a real-time inference speed of 15.2 FPS at a resolution of 512x512.


title: Automatic Dance Video Segmentation for Understanding Choreography

abstract: Segmenting dance video into short movements is a popular way to easily understand dance choreography. However, it is currently done manually and requires a significant amount of effort by experts. That is, even if many dance videos are available on social media (e.g., TikTok and YouTube), it remains difficult for people, especially novices, to casually watch short video segments to practice dance choreography. In this paper, we propose a method to automatically segment a dance video into each movement. Given a dance video as input, we first extract visual and audio features: the former is computed from the keypoints of the dancer in the video, and the latter is computed from the Mel spectrogram of the music in the video. Next, these features are passed to a Temporal Convolutional Network (TCN), and segmentation points are estimated by picking peaks of the network output. To build our training dataset, we annotate segmentation points to dance videos in the AIST Dance Video Database, which is a shared database containing original street dance videos with copyright-cleared dance music. The evaluation study shows that the proposed method (i.e., combining the visual and audio features) can estimate segmentation points with high accuracy. In addition, we developed an application to help dancers practice choreography using the proposed method.


title: Legendre symbols related to $D_p(b,1)$

abstract: Let $p$ be an odd prime. For any $b,c\in\mathbb{Z}$, Z.-W. Sun introduced the new-type determinant $$D_p(b,c)=|(i^2+bij+cj^2)^{p-2}|_{1\leqslant i,j\leqslant p-1},$$ and studied its arithmetic properties. In this paper we mainly prove that $$\left(\frac{D_p(b,1)}{p}\right)=\left(\frac{2b}{p}\right)$$ when $(\frac{b^2-4}{p})=-1$ and $p\equiv1\pmod 4$. As an application of our result, we confirm several conjectures of Sun.


title: Dynamic feature selection in medical predictive monitoring by reinforcement learning

abstract: In this paper, we investigate dynamic feature selection within multivariate time-series scenario, a common occurrence in clinical prediction monitoring where each feature corresponds to a bio-test result. Many existing feature selection methods fall short in effectively leveraging time-series information, primarily because they are designed for static data. Our approach addresses this limitation by enabling the selection of time-varying feature subsets for each patient. Specifically, we employ reinforcement learning to optimize a policy under maximum cost restrictions. The prediction model is subsequently updated using synthetic data generated by trained policy. Our method can seamlessly integrate with non-differentiable prediction models. We conducted experiments on a sizable clinical dataset encompassing regression and classification tasks. The results demonstrate that our approach outperforms strong feature selection baselines, particularly when subjected to stringent cost limitations. Code will be released once paper is accepted.


title: Research on Foundation Model for Spatial Data Intelligence: China's 2024 White Paper on Strategic Development of Spatial Data Intelligence

abstract: This report focuses on spatial data intelligent large models, delving into the principles, methods, and cutting-edge applications of these models. It provides an in-depth discussion on the definition, development history, current status, and trends of spatial data intelligent large models, as well as the challenges they face. The report systematically elucidates the key technologies of spatial data intelligent large models and their applications in urban environments, aerospace remote sensing, geography, transportation, and other scenarios. Additionally, it summarizes the latest application cases of spatial data intelligent large models in themes such as urban development, multimodal systems, remote sensing, smart transportation, and resource environments. Finally, the report concludes with an overview and outlook on the development prospects of spatial data intelligent large models.


title: Some New Approaches to MPI Implementations

abstract: This paper provides some new approaches to MPI implementations to improve MPI performance. These approaches include dynamically composable libraries, reducing average layer numbers of MPI libraries, and a single entity of MPI-network, MPI-protocol, and MPI.


title: Two Optimizers Are Better Than One: LLM Catalyst Empowers Gradient-Based Optimization for Prompt Tuning

abstract: Learning a skill generally relies on both practical experience by doer and insightful high-level guidance by instructor. Will this strategy also work well for solving complex non-convex optimization problems? Here, a common gradient-based optimizer acts like a disciplined doer, making locally optimal update at each step. Recent methods utilize large language models (LLMs) to optimize solutions for concrete problems by inferring from natural language instructions, akin to a high-level instructor. In this paper, we show that these two optimizers are complementary to each other, suggesting a collaborative optimization approach. The gradient-based optimizer and LLM-based optimizer are combined in an interleaved manner. We instruct LLMs using task descriptions and timely optimization trajectories recorded during gradient-based optimization. Inferred results from LLMs are used as restarting points for the next stage of gradient optimization. By leveraging both the locally rigorous gradient-based optimizer and the high-level deductive LLM-based optimizer, our combined optimization method consistently yields improvements over competitive baseline prompt tuning methods. Our results demonstrate the synergistic effect of conventional gradient-based optimization and the inference ability of LLMs. The code is released at https://github.com/guozix/LLM-catalyst.


title: Unraveling the global behavior of equation of state by explicit finite nuclei constraints

abstract: We obtain posterior distribution of equations of state (EOSs) across a broad range of density by imposing explicitly the constraints from precisely measured fundamental properties of finite nuclei, in combination with the experimental data from heavy-ion collisions and the astrophysical observations of radius, tidal deformability and minimum-maximum mass of neutron stars. The acquired EOSs exhibit a distinct global behavior compared to those usually obtained by imposing the finite nuclei constraints implicitly through empirical values of selected key parameters describing symmetric nuclear matter and symmetry energy in the vicinity of the saturation density. The explicit treatment of finite nuclei constraints yields softer EOSs at low densities which eventually become stiffer to meet the maximum mass criteria. The Kullback-Leibler divergence has been used to perform a quantitative comparison of the distributions of neutron star properties resulting from the EOSs obtained from implicit and explicit finite nuclei constraints.


title: Search for the decay $B^{0}\to\gamma\gamma$ using Belle and Belle II data

abstract: We report the result of a search for the rare decay $B^{0} \to \gamma \gamma$ using a combined dataset of $753\times10^{6}$ $B\bar{B}$ pairs collected by the Belle experiment and $387\times10^{6}$ $B\bar{B}$ pairs collected by the Belle II experiment from decays of the $\rm \Upsilon(4S)$ resonance produced in $e^{+}e^{-}$ collisions. A simultaneous fit to the Belle and Belle II data sets yields $11.0^{+6.5}_{-5.5}$ signal events, corresponding to a 2.5$\sigma$ significance. We determine the branching fraction $\mathcal{B}(B^{0} \to \gamma\gamma) = (3.7^{+2.2}_{-1.8}(\rm stat)\pm0.5(\rm syst))\times10^{-8}$ and set a 90% credibility level upper limit of $\mathcal{B}(B^{0} \to \gamma\gamma) < 6.4\times10^{-8}$.


title: Twin Deformable Point Convolutions for Point Cloud Semantic Segmentation in Remote Sensing Scenes

abstract: Thanks to the application of deep learning technology in point cloud processing of the remote sensing field, point cloud segmentation has become a research hotspot in recent years, which can be applied to real-world 3D, smart cities, and other fields. Although existing solutions have made unprecedented progress, they ignore the inherent characteristics of point clouds in remote sensing fields that are strictly arranged according to latitude, longitude, and altitude, which brings great convenience to the segmentation of point clouds in remote sensing fields. To consider this property cleverly, we propose novel convolution operators, termed Twin Deformable point Convolutions (TDConvs), which aim to achieve adaptive feature learning by learning deformable sampling points in the latitude-longitude plane and altitude direction, respectively. First, to model the characteristics of the latitude-longitude plane, we propose a Cylinder-wise Deformable point Convolution (CyDConv) operator, which generates a two-dimensional cylinder map by constructing a cylinder-like grid in the latitude-longitude direction. Furthermore, to better integrate the features of the latitude-longitude plane and the spatial geometric features, we perform a multi-scale fusion of the extracted latitude-longitude features and spatial geometric features, and realize it through the aggregation of adjacent point features of different scales. In addition, a Sphere-wise Deformable point Convolution (SpDConv) operator is introduced to adaptively offset the sampling points in three-dimensional space by constructing a sphere grid structure, aiming at modeling the characteristics in the altitude direction. Experiments on existing popular benchmarks conclude that our TDConvs achieve the best segmentation performance, surpassing the existing state-of-the-art methods.


title: Learning Task-relevant Sequence Representations via Intrinsic Dynamics Characteristics in Reinforcement Learning

abstract: Learning task-relevant state representations is crucial to solving the problem of scene generalization in visual deep reinforcement learning. Prior work typically establishes a self-supervised auxiliary learner, introducing elements (e.g., rewards and actions) to extract task-relevant state information from observations through behavioral similarity metrics. However, the methods often ignore the inherent relationships between the elements (e.g., dynamics relationships) that are essential for learning accurate representations, and they are also limited to single-step metrics, which impedes the discrimination of short-term similar task/behavior information in long-term dynamics transitions. To solve the issues, we propose an intrinsic dynamic characteristics-driven sequence representation learning method (DSR) over a common DRL frame. Concretely, inspired by the fact of state transition in the underlying system, it constrains the optimization of the encoder via modeling the dynamics equations related to the state transition, which prompts the latent encoding information to satisfy the state transition process and thereby distinguishes state space and noise space. Further, to refine the ability of encoding similar tasks based on dynamics constraints, DSR also sequentially models inherent dynamics equation relationships from the perspective of sequence elements' frequency domain and multi-step prediction. Finally, experimental results show that DSR has achieved a significant performance boost in the Distracting DMControl Benchmark, with an average of 78.9% over the backbone baseline. Further results indicate that it also achieves the best performance in real-world autonomous driving tasks in the CARLA simulator. Moreover, the qualitative analysis results of t-SNE visualization validate that our method possesses superior representation ability on visual tasks.


title: Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation

abstract: As Large Language Models (LLMs) scale up and gain powerful Chain-of-Thoughts (CoTs) reasoning abilities, practical resource constraints drive efforts to distill these capabilities into more compact Smaller Language Models (SLMs). We find that CoTs consist mainly of simple reasoning forms, with a small proportion ($\approx 4.7\%$) of key reasoning steps that truly impact conclusions. However, previous distillation methods typically involve supervised fine-tuning student SLMs only on correct CoTs data produced by teacher LLMs, resulting in students struggling to learn the key reasoning steps, instead imitating the teacher's reasoning forms and making errors or omissions on these steps. To address these issues, drawing an analogy to human learning, where analyzing mistakes according to correct solutions often reveals the crucial steps leading to successes or failures, we propose mistak\textbf{E}-\textbf{D}riven key reason\textbf{I}ng step distilla\textbf{T}ion (\textbf{EDIT}), a novel method that further aids SLMs learning key reasoning steps rather than mere simple fine-tuning. Firstly, to expose these crucial steps in CoTs, we design specific prompts to generate dual CoTs data with similar reasoning paths but divergent conclusions. Then, we apply the minimum edit distance algorithm on the dual CoTs data to locate these key steps and optimize the likelihood of these steps. Extensive experiments validate the effectiveness of EDIT across both in-domain and out-of-domain benchmark reasoning datasets. Further analysis shows that EDIT can generate high-quality CoTs with more correct key reasoning steps. Notably, we also explore how different mistake patterns affect performance and find that EDIT benefits more from logical errors than from knowledge or mathematical calculation errors in dual CoTs\footnote{Code can be found at \url{https://github.com/C-W-D/EDIT}}.


title: On the weak Harnack inequalities for nonlocal double phase problems

abstract: This paper is devoted to studying the weak Harnack inequalities for nonlocal double phase functionals by using expansion of positivity, whose prototype is $$ \iint_{\mathbb{R}^n\times\mathbb{R}^n} \left(\frac{|u(x)-u(y)|^p}{|x-y|^{n+sp}}+a(x,y)\frac{|u(x)-u(y)|^q}{|x-y|^{n+tq}}\right) \,dxdy $$ with $a\ge0$ and $0<s\le t<1<p\le q$. The core of our approach is to establish several measure theoretical estimates based on the nonlocal Caccioppoli-type inequality, where the challenges consist in controlling subtle interaction between the pointwise behaviour of modulating coefficient and the growth exponents. Meanwhile, a quantitative boundedness result on the minimizer of such functionals is also discussed.


title: On Haagerup noncommutative quasi $H^p(\A)$ spaces

abstract: Let $\mathcal{M}$ be a $\sigma$-finite von Neumann algebra, equipped with a normal faithful state $\varphi$, and let $\mathcal{A}$ be a maximal subdiagonal subalgebra of $\mathcal{M}$. We have proved that for $0< p<1$, $H^p(\mathcal{A})$ is independent of $\varphi$. Furthermore, in the case that $\mathcal{A}$ is a type 1 subdiagonal subalgebra, we have extended the most recent results about the Riesz type factorization to the case $0<p<1$ and have proved an interpolation theorem for $H^p(\mathcal{A})$ in the case where $0 < p_0, p_1 \le \infty$.


title: PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations

abstract: Expert-designed close-ended benchmarks serve as vital tools in assessing the knowledge capacity of large language models (LLMs). Despite their widespread use, concerns have mounted regarding their reliability due to limited test scenarios and an unavoidable risk of data contamination. To rectify this, we present PertEval, a toolkit devised for in-depth probing of LLMs' knowledge capacity through knowledge-invariant perturbations. These perturbations employ human-like restatement techniques to generate on-the-fly test samples from static benchmarks, meticulously retaining knowledge-critical content while altering irrelevant details. Our toolkit further includes a suite of transition analyses that compare performance on raw vs. perturbed test sets to precisely assess LLMs' genuine knowledge capacity. Six state-of-the-art LLMs are re-evaluated using PertEval. Results reveal significantly inflated performance of the LLMs on raw benchmarks, including an absolute 21% overestimation for GPT-4. Additionally, through a nuanced response pattern analysis, we discover that PertEval retains LLMs' uncertainty to specious knowledge, potentially being resolved through rote memorization and leading to inflated performance. We also find that the detailed transition analyses by PertEval could illuminate weaknesses in existing LLMs' knowledge mastery and guide the development of refinement. Given these insights, we posit that PertEval can act as an essential tool that, when applied alongside any close-ended benchmark, unveils the true knowledge capacity of LLMs, marking a significant step toward more trustworthy LLM evaluation.


title: Teaching the apparent motion of Sun and stars across four European countries

abstract: In the context of the European Erasmus+ project Teaching ASTronomy at the Educational level (TASTE), we investigated the extent to which a learning module at school and a set of activities during a planetarium visit help students to gain insight in the Apparent Motion of the Sun and Stars. Therefore, we have set up a two treatment study with a pretest posttest design. In the four participating countries (Belgium, Germany, Greece and Italy), secondary school students studied the concept of the celestial globe at school using newly designed learning materials. By using a latent class analysis, we identified different classes of student answers on the AMoSS test. We show how students evolve from one class to another between pretest and posttest. Overall the results of the pretest and posttest show that a good understanding of the different aspects of the apparent motion of celestial bodies is difficult to achieve.


title: CMC surfaces of revolution, Elliptic curves, and Weierstrass-$\wp$ functions

abstract: This paper establishes an interesting connection between the family of CMC surfaces of revolution in $\mathbb E_1^3$ and some specific families of elliptic curves. As a consequence of this connection, we show in the class of spacelike CMC surfaces of revolution in the $\mathbb E_1^3$, only spacelike cylinders and standard hyperboloids are algebraic. We also show that a similar connection exists between CMC surfaces of revolution in $\mathbb E^3$ and elliptic curves. Further, we use this to reestablish the fact that the only CMC algebraic surfaces of revolution in $\mathbb E^3$ are spheres and right circular cylinders.


title: May the Dance be with You: Dance Generation Framework for Non-Humanoids

abstract: We hypothesize dance as a motion that forms a visual rhythm from music, where the visual rhythm can be perceived from an optical flow. If an agent can recognize the relationship between visual rhythm and music, it will be able to dance by generating a motion to create a visual rhythm that matches the music. Based on this, we propose a framework for any kind of non-humanoid agents to learn how to dance from human videos. Our framework works in two processes: (1) training a reward model which perceives the relationship between optical flow (visual rhythm) and music from human dance videos, (2) training the non-humanoid dancer based on that reward model, and reinforcement learning. Our reward model consists of two feature encoders for optical flow and music. They are trained based on contrastive learning which makes the higher similarity between concurrent optical flow and music features. With this reward model, the agent learns dancing by getting a higher reward when its action creates an optical flow whose feature has a higher similarity with the given music feature. Experiment results show that generated dance motion can align with the music beat properly, and user study result indicates that our framework is more preferred by humans compared to the baselines. To the best of our knowledge, our work of non-humanoid agents which learn dance from human videos is unprecedented. An example video can be found at https://youtu.be/dOUPvo-O3QY.


title: X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions

abstract: Large language models respond well in high-resource languages like English but struggle in low-resource languages. It may arise from the lack of high-quality instruction following data in these languages. Directly translating English samples into these languages can be a solution but unreliable, leading to responses with translation errors and lacking language-specific or cultural knowledge. To address this issue, we propose a novel method to construct cross-lingual instruction following samples with instruction in English and response in low-resource languages. Specifically, the language model first learns to generate appropriate English instructions according to the natural web texts in other languages as responses. The candidate cross-lingual instruction tuning samples are further refined and diversified. We have employed this method to build a large-scale cross-lingual instruction tuning dataset on 10 languages, namely X-Instruction. The instruction data built using our method incorporate more language-specific knowledge compared with the naive translation method. Experimental results have shown that the response quality of the model tuned on X-Instruction greatly exceeds the model distilled from a powerful teacher model, reaching or even surpassing the ones of ChatGPT. In addition, we find that models tuned on cross-lingual instruction following samples can follow the instruction in the output language without further tuning.


title: GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesis

abstract: Forecasting future scenarios in dynamic environments is essential for intelligent decision-making and navigation, a challenge yet to be fully realized in computer vision and robotics. Traditional approaches like video prediction and novel-view synthesis either lack the ability to forecast from arbitrary viewpoints or to predict temporal dynamics. In this paper, we introduce GaussianPrediction, a novel framework that empowers 3D Gaussian representations with dynamic scene modeling and future scenario synthesis in dynamic environments. GaussianPrediction can forecast future states from any viewpoint, using video observations of dynamic scenes. To this end, we first propose a 3D Gaussian canonical space with deformation modeling to capture the appearance and geometry of dynamic scenes, and integrate the lifecycle property into Gaussians for irreversible deformations. To make the prediction feasible and efficient, a concentric motion distillation approach is developed by distilling the scene motion with key points. Finally, a Graph Convolutional Network is employed to predict the motions of key points, enabling the rendering of photorealistic images of future scenarios. Our framework shows outstanding performance on both synthetic and real-world datasets, demonstrating its efficacy in predicting and rendering future environments.


title: DenseSeg: Joint Learning for Semantic Segmentation and Landmark Detection Using Dense Image-to-Shape Representation

abstract: Purpose: Semantic segmentation and landmark detection are fundamental tasks of medical image processing, facilitating further analysis of anatomical objects. Although deep learning-based pixel-wise classification has set a new-state-of-the-art for segmentation, it falls short in landmark detection, a strength of shape-based approaches. Methods: In this work, we propose a dense image-to-shape representation that enables the joint learning of landmarks and semantic segmentation by employing a fully convolutional architecture. Our method intuitively allows the extraction of arbitrary landmarks due to its representation of anatomical correspondences. We benchmark our method against the state-of-the-art for semantic segmentation (nnUNet), a shape-based approach employing geometric deep learning and a CNN-based method for landmark detection. Results: We evaluate our method on two medical dataset: one common benchmark featuring the lungs, heart, and clavicle from thorax X-rays, and another with 17 different bones in the paediatric wrist. While our method is on pair with the landmark detection baseline in the thorax setting (error in mm of $2.6\pm0.9$ vs $2.7\pm0.9$), it substantially surpassed it in the more complex wrist setting ($1.1\pm0.6$ vs $1.9\pm0.5$). Conclusion: We demonstrate that dense geometric shape representation is beneficial for challenging landmark detection tasks and outperforms previous state-of-the-art using heatmap regression. While it does not require explicit training on the landmarks themselves, allowing for the addition of new landmarks without necessitating retraining.}


title: Understanding and mitigating difficulties in posterior predictive evaluation

abstract: Predictive posterior densities (PPDs) are of interest in approximate Bayesian inference. Typically, these are estimated by simple Monte Carlo (MC) averages using samples from the approximate posterior. We observe that the signal-to-noise ratio (SNR) of such estimators can be extremely low. An analysis for exact inference reveals SNR decays exponentially as there is an increase in (a) the mismatch between training and test data, (b) the dimensionality of the latent space, or (c) the size of the test data relative to the training data. Further analysis extends these results to approximate inference. To remedy the low SNR problem, we propose replacing simple MC sampling with importance sampling using a proposal distribution optimized at test time on a variational proxy for the SNR and demonstrate that this yields greatly improved estimates.


title: Recipes for forming a carbon-rich giant planet

abstract: The exploration of carbon-to-oxygen ratios has yielded intriguing insights into the composition of close-in giant exoplanets, giving rise to a distinct classification: carbon-rich planets, characterized by a carbon-to-oxygen ratio $\ge$ 1 in their atmospheres, as opposed to giant planets exhibiting carbon-to-oxygen ratios close to the protosolar value. In contrast, despite numerous space missions dispatched to the outer solar system and the proximity of Jupiter, Saturn, Uranus, and Neptune, our understanding of the carbon-to-oxygen ratio in these giants remains notably deficient. Determining this ratio is crucial as it serves as a marker linking a planet's volatile composition directly to its formation region within the disk. This article provides an overview of the current understanding of the carbon-to-oxygen ratio in the four gas giants of our solar system and explores why there is yet no definitive dismissal of the possibility that Jupiter, Saturn, Uranus, or Neptune could be considered carbon-rich planets. Additionally, we delve into the three primary formation scenarios proposed in existing literature to account for a bulk carbon-to-oxygen ratio $\ge$ 1 in a giant planet. A significant challenge lies in accurately inferring the bulk carbon-to-oxygen ratio of our solar system's gas giants. Retrieval methods involve integrating in situ measurements from entry probes equipped with mass spectrometers and remote sensing observations conducted at microwave wavelengths by orbiters. However, these methods fall short of fully discerning the deep carbon-to-oxygen abundance in the gas giants due to their limited probing depth, typically within the 10-100 bar range.


title: Generating Query Recommendations via LLMs

abstract: Query recommendation systems are ubiquitous in modern search engines, assisting users in producing effective queries to meet their information needs. However, these systems require a large amount of data to produce good recommendations, such as a large collection of documents to index and query logs. In particular, query logs and user data are not available in cold start scenarios. Query logs are expensive to collect and maintain and require complex and time-consuming cascading pipelines for creating, combining, and ranking recommendations. To address these issues, we frame the query recommendation problem as a generative task, proposing a novel approach called Generative Query Recommendation (GQR). GQR uses an LLM as its foundation and does not require to be trained or fine-tuned to tackle the query recommendation problem. We design a prompt that enables the LLM to understand the specific recommendation task, even using a single example. We then improved our system by proposing a version that exploits query logs called Retriever-Augmented GQR (RA-GQR). RA-GQr dynamically composes its prompt by retrieving similar queries from query logs. GQR approaches reuses a pre-existing neural architecture resulting in a simpler and more ready-to-market approach, even in a cold start scenario. Our proposed GQR obtains state-of-the-art performance in terms of NDCG@10 and clarity score against two commercial search engines and the previous state-of-the-art approach on the Robust04 and ClueWeb09B collections, improving on average the NDCG@10 performance up to ~4% on Robust04 and ClueWeb09B w.r.t the previous best competitor. RA-GQR further improve the NDCG@10 obtaining an increase of ~11%, ~6\% on Robust04 and ClueWeb09B w.r.t the best competitor. Furthermore, our system obtained ~59% of user preferences in a blind user study, proving that our method produces the most engaging queries.


title: Sloshing and spiral structures breeding a putative radio mini-halo in the environment of a cool-core cluster Abell 795

abstract: Spiral structures and cold fronts in X-rays are frequently observed in cool core galaxy clusters. However, studies on radio mini-haloes associated with such spirals and their physical connections are rare. Here, we present the detection of an extended diffuse radio emission entrained in the X-ray spiral structure in a known cool core cluster Abell 795 (A795). Though the cool core is a sign of the relaxed nature of the clusters, our re-analysed 30 ks Chandra X-ray data of cluster A795 confirms the presence of an interesting log spiral structure of X-ray deficit region complemented by an X-ray excess counter spiral in the residual map, exposing its dynamical activity. Our new analysis of 150 $\&$ 325 MHz GMRT archival data of the cluster confirms the detection of a $\sim180$ kpc ultra-steep ($\alpha\sim-2.7$) diffuse radio structure which was previously reported as a candidate radio mini halo from low sensitive survey maps. This radio emission spans the entire spiral structure ($\sim186$ kpc), enclosed by two previously reported cold fronts. Furthermore, SDSS DR13 optical spectra, as well as GALEX's FUV data, show a considerably low total star formation rate of 2.52 M$_{\odot}$ yr$^{-1}$ and having no significant variation in metallicity distribution. We argued that the two-phase (hot and cold) plasma at the cluster core with differential velocity has probably caused the spiral formation and has redistributed the secondary electrons from the central BCG or the pre-accelerated electrons which have been (re-)accelerated by the sloshing turbulence to form the observed candidate radio mini-halo structure. This has been supported by a few previous studies that indicate spiral formation and sloshing turbulence may quench star formation and facilitate smooth metallicity distribution by mixing the gas in the core.


title: HQ-DiT: Efficient Diffusion Transformer with FP4 Hybrid Quantization

abstract: Diffusion Transformers (DiTs) have recently gained substantial attention in both industrial and academic fields for their superior visual generation capabilities, outperforming traditional diffusion models that use U-Net. However,the enhanced performance of DiTs also comes with high parameter counts and implementation costs, seriously restricting their use on resource-limited devices such as mobile phones. To address these challenges, we introduce the Hybrid Floating-point Quantization for DiT(HQ-DiT), an efficient post-training quantization method that utilizes 4-bit floating-point (FP) precision on both weights and activations for DiT inference. Compared to fixed-point quantization (e.g., INT8), FP quantization, complemented by our proposed clipping range selection mechanism, naturally aligns with the data distribution within DiT, resulting in a minimal quantization error. Furthermore, HQ-DiT also implements a universal identity mathematical transform to mitigate the serious quantization error caused by the outliers. The experimental results demonstrate that DiT can achieve extremely low-precision quantization (i.e., 4 bits) with negligible impact on performance. Our approach marks the first instance where both weights and activations in DiTs are quantized to just 4 bits, with only a 0.12 increase in sFID on ImageNet.


title: Understanding Memory-Regret Trade-Off for Streaming Stochastic Multi-Armed Bandits

abstract: We study the stochastic multi-armed bandit problem in the $P$-pass streaming model. In this problem, the $n$ arms are present in a stream and at most $m<n$ arms and their statistics can be stored in the memory. We give a complete characterization of the optimal regret in terms of $m, n$ and $P$. Specifically, we design an algorithm with $\tilde O\left((n-m)^{1+\frac{2^{P}-2}{2^{P+1}-1}} n^{\frac{2-2^{P+1}}{2^{P+1}-1}} T^{\frac{2^P}{2^{P+1}-1}}\right)$ regret and complement it with an $\tilde \Omega\left((n-m)^{1+\frac{2^{P}-2}{2^{P+1}-1}} n^{\frac{2-2^{P+1}}{2^{P+1}-1}} T^{\frac{2^P}{2^{P+1}-1}}\right)$ lower bound when the number of rounds $T$ is sufficiently large. Our results are tight up to a logarithmic factor in $n$ and $P$.


title: Analytical modeling of coated plasmonic particles

abstract: Biomedical applications of plasmonic nanoparticle conjugates need control over their optical properties modulated by surface coating with stabilizing or targeting molecules often attached to or embedded in the secondary functionalization shell, such as silica. Although current numerical techniques can simulate the plasmonic response of such structures, it is desirable in practice to have analytical models based on simple physical ideas that can be implemented without considerable computer resources. Here, we present two efficient analytical methods based on improved electrostatic approximation (IEA) and modal expansion method (MEM) combined with the dipole equivalence method (DEM). The last approach avoids additional electromagnetic simulations and provides a direct bridge between analytical IEA and MEM models for bare particles and those with multilayer shells. As simple as the original IEA and MEM, the developed analytical extensions provide accurate extinction and scattering spectra for coated particles compared to exact calculations by separation of variable method and COMSOL. The possibility and accuracy of analytical models are illustrated by extensive simulations for prolate and oblate gold and silver nanoparticles with a maximal size of up to 200 nm, aspect ratio from 2 to 6, and 3-30 nm dielectric coating.


title: Mitigating annotation shift in cancer classification using single image generative models

abstract: Artificial Intelligence (AI) has emerged as a valuable tool for assisting radiologists in breast cancer detection and diagnosis. However, the success of AI applications in this domain is restricted by the quantity and quality of available data, posing challenges due to limited and costly data annotation procedures that often lead to annotation shifts. This study simulates, analyses and mitigates annotation shifts in cancer classification in the breast mammography domain. First, a high-accuracy cancer risk prediction model is developed, which effectively distinguishes benign from malignant lesions. Next, model performance is used to quantify the impact of annotation shift. We uncover a substantial impact of annotation shift on multiclass classification performance particularly for malignant lesions. We thus propose a training data augmentation approach based on single-image generative models for the affected class, requiring as few as four in-domain annotations to considerably mitigate annotation shift, while also addressing dataset imbalance. Lastly, we further increase performance by proposing and validating an ensemble architecture based on multiple models trained under different data augmentation regimes. Our study offers key insights into annotation shift in deep learning breast cancer classification and explores the potential of single-image generative models to overcome domain shift challenges.


title: Developing a Comprehensive Measurement Tool for Assessing the Rate of BIM Adoption in the Construction Industry

abstract: Building Information Modeling (BIM) is a crucial technology in the construction industry, offering benefits such as enhanced collaboration, real-time decision-making, and significant cost and time savings. Despite its advantages, BIM adoption faces numerous barriers. This study aims to create a reliable tool to assess the Rate of BIM Adoption (RBA), drawing on Attributes of Innovation theory and empirical data from the literature. This research integrates theoretical insights with empirical data, providing quantitative items to measure BAR in the construction industry. The quantitative approach helps decision-makers and policymakers to mandate BIM and establish appropriate implementation standards. Its implications are significant for the construction industry, policymakers, and the academic community, offering a systematic approach to assess BIM adoption, identify barriers, and implement targeted strategies. The reliability of this approach is ensured through a solid theoretical foundation, item development, pilot testing, and statistical analysis, making it a valuable resource for improving BIM implementation and fostering innovation in the construction industry.


title: Upper deviation probabilities for the range of a supercritical super-Brownian motion

abstract: Let $\{X_t\}_{t\geq 0 }$ be a $d$-dimensional supercritical super-Brownian motion started from the origin with branching mechanism $\psi$. Denote by $R_t:=\inf\{r>0:X_s(\{x\in \mathbb{R}^d:|x|\geq r\})=0,~\forall~0\leq s\leq t\}$ the radius of the minimal ball (centered at the origin) containing the range of $\{X_s\}_{s\geq 0 }$ up to time $t$. In \cite{Pinsky}, Pinsky proved that condition on non-extinction, $\lim_{t\to\infty}R_t/t=\sqrt{2\beta}$ in probability, where $\beta:=-\psi'(0)$. Afterwards, Engl\"{a}nder \cite{Englander04} studied the lower deviation probabilities of $R_t$. For the upper deviation probabilities, he \cite[Conjecture 8]{Englander04} conjectured that for $\rho>\sqrt {2\beta}$, $$ \lim_{t\to\infty}\frac{1}{t}\log\mathbb{P}(R_t\geq \rho t)=-\left(\frac{\rho^2}{2}-\beta\right). $$ In this note, we confirmed this conjecture.


title: Improving SMOTE via Fusing Conditional VAE for Data-adaptive Noise Filtering

abstract: Recent advances in a generative neural network model extend the development of data augmentation methods. However, the augmentation methods based on the modern generative models fail to achieve notable performance for class imbalance data compared to the conventional model, the SMOTE. We investigate the problem of the generative model for imbalanced classification and introduce a framework to enhance the SMOTE algorithm using Variational Autoencoders (VAE). Our approach systematically quantifies the density of data points in a low-dimensional latent space using the VAE, simultaneously incorporating information on class labels and classification difficulty. Then, the data points potentially degrading the augmentation are systematically excluded, and the neighboring observations are directly augmented on the data space. Empirical studies on several imbalanced datasets represent that this simple process innovatively improves the conventional SMOTE algorithm over the deep learning models. Consequently, we conclude that the selection of minority data and the interpolation in the data space are beneficial for imbalanced classification problems with a relatively small number of data points.


title: InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning

abstract: Learning abstract state representations and knowledge is crucial for long-horizon robot planning. We present InterPreT, an LLM-powered framework for robots to learn symbolic predicates from language feedback of human non-experts during embodied interaction. The learned predicates provide relational abstractions of the environment state, facilitating the learning of symbolic operators that capture action preconditions and effects. By compiling the learned predicates and operators into a PDDL domain on-the-fly, InterPreT allows effective planning toward arbitrary in-domain goals using a PDDL planner. In both simulated and real-world robot manipulation domains, we demonstrate that InterPreT reliably uncovers the key predicates and operators governing the environment dynamics. Although learned from simple training tasks, these predicates and operators exhibit strong generalization to novel tasks with significantly higher complexity. In the most challenging generalization setting, InterPreT attains success rates of 73% in simulation and 40% in the real world, substantially outperforming baseline methods.


title: Periodic localized traveling waves in the two-dimensional suspension bridge equation

abstract: In the dynamics generated by the suspension bridge equation, traveling waves are an essential feature. The existing literature focuses primarily on the idealized one-dimensional case, while traveling structures in two spatial dimensions have only been studied via numerical simulations. We use computer-assisted proof methods based on a Newton-Kantorovich type argument to find and prove periodic localized traveling waves in two dimensions. The main obstacle is the exponential nonlinearity in combination with the resulting large amplitude of the localized waves. Our analysis hinges on establishing computable bounds to control the aliasing error in the computed Fourier coefficients. This leads to existence proofs of different traveling wave solutions, accompanied by small, explicit, rigorous bounds on the deficiency of numerical approximations. This approach is directly extendable to other wave equation models and elliptic partial differential equations with analytic nonlinearities, in two as well as in higher dimensions.


title: Identifiability of a statistical model with two latent vectors: Importance of the dimensionality relation and application to graph embedding

abstract: Identifiability of statistical models is a key notion in unsupervised representation learning. Recent work of nonlinear independent component analysis (ICA) employs auxiliary data and has established identifiable conditions. This paper proposes a statistical model of two latent vectors with single auxiliary data generalizing nonlinear ICA, and establishes various identifiability conditions. Unlike previous work, the two latent vectors in the proposed model can have arbitrary dimensions, and this property enables us to reveal an insightful dimensionality relation among two latent vectors and auxiliary data in identifiability conditions. Furthermore, surprisingly, we prove that the indeterminacies of the proposed model has the same as \emph{linear} ICA under certain conditions: The elements in the latent vector can be recovered up to their permutation and scales. Next, we apply the identifiability theory to a statistical model for graph data. As a result, one of the identifiability conditions includes an appealing implication: Identifiability of the statistical model could depend on the maximum value of link weights in graph data. Then, we propose a practical method for identifiable graph embedding. Finally, we numerically demonstrate that the proposed method well-recovers the latent vectors and model identifiability clearly depends on the maximum value of link weights, which supports the implication of our theoretical results


title: Revisiting CNNs for Trajectory Similarity Learning

abstract: Similarity search is a fundamental but expensive operator in querying trajectory data, due to its quadratic complexity of distance computation. To mitigate the computational burden for long trajectories, neural networks have been widely employed for similarity learning and each trajectory is encoded as a high-dimensional vector for similarity search with linear complexity. Given the sequential nature of trajectory data, previous efforts have been primarily devoted to the utilization of RNNs or Transformers. In this paper, we argue that the common practice of treating trajectory as sequential data results in excessive attention to capturing long-term global dependency between two sequences. Instead, our investigation reveals the pivotal role of local similarity, prompting a revisit of simple CNNs for trajectory similarity learning. We introduce ConvTraj, incorporating both 1D and 2D convolutions to capture sequential and geo-distribution features of trajectories, respectively. In addition, we conduct a series of theoretical analyses to justify the effectiveness of ConvTraj. Experimental results on three real-world large-scale datasets demonstrate that ConvTraj achieves state-of-the-art accuracy in trajectory similarity search. Owing to the simple network structure of ConvTraj, the training and inference speed on the Porto dataset with 1.6 million trajectories are increased by at least $240$x and $2.16$x, respectively. The source code and dataset can be found at \textit{\url{https://github.com/Proudc/ConvTraj}}.


title: The Kosmosis Use-Case of Crypto Rug Pull Detection and Prevention

abstract: Current methods to prevent crypto asset fraud are based on the analysis of transaction graphs within blockchain networks. While effective for identifying transaction patterns indicative of fraud, it does not capture the semantics of transactions and is constrained to blockchain data. Consequently, preventive methods based on transaction graphs are inherently limited. In response to these limitations, we propose the Kosmosis approach, which aims to incrementally construct a knowledge graph as new blockchain and social media data become available. During construction, it aims to extract the semantics of transactions and connect blockchain addresses to their real-world entities by fusing blockchain and social media data in a knowledge graph. This enables novel preventive methods against rug pulls as a form of crypto asset fraud. To demonstrate the effectiveness and practical applicability of the Kosmosis approach, we examine a series of real-world rug pulls from 2021. Through this case, we illustrate how Kosmosis can aid in identifying and preventing such fraudulent activities by leveraging the insights from the constructed knowledge graph.


title: Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding

abstract: Recent strides in large language models (LLMs) have yielded remarkable performance, leveraging reinforcement learning from human feedback (RLHF) to significantly enhance generation and alignment capabilities. However, RLHF encounters numerous challenges, including the objective mismatch issue, leading to suboptimal performance in Natural Language Understanding (NLU) tasks. To address this limitation, we propose a novel Reinforcement Learning framework enhanced with Label-sensitive Reward (RLLR) to amplify the performance of LLMs in NLU tasks. By incorporating label-sensitive pairs into reinforcement learning, our method aims to adeptly capture nuanced label-sensitive semantic features during RL, thereby enhancing natural language understanding. Experiments conducted on five diverse foundation models across eight tasks showcase promising results. In comparison to Supervised Fine-tuning models (SFT), RLLR demonstrates an average performance improvement of 1.54%. Compared with RLHF models, the improvement averages at 0.69%. These results reveal the effectiveness of our method for LLMs in NLU tasks. Code and data available at: https://github.com/MagiaSN/ACL2024_RLLR.


title: Macro-scale roughness reveals the complex history of asteroids Didymos and Dimorphos

abstract: Morphological mapping is a fundamental step in studying the processes that shaped an asteroid surface. Yet, it is challenging and often requires multiple independent assessments by trained experts. Here, we present fast methods to detect and characterize meaningful terrains from the topographic roughness: entropy of information, and local mean surface orientation. We apply our techniques to Didymos and Dimorphos, the target asteroids of NASA's DART mission: first attempt to deflect an asteroid. Our methods reliably identify morphological units at multiple scales. The comparative study reveals various terrain types, signatures of processes that transformed Didymos and Dimorphos. Didymos shows the most heterogeneity and morphology that indicate recent resurfacing events. Dimorphos is comparatively rougher than Didymos, which may result from the formation process of the binary pair and past interaction between the two bodies. Our methods can be readily applied to other bodies and data sets.


title: Towards Unified Multi-granularity Text Detection with Interactive Attention

abstract: Existing OCR engines or document image analysis systems typically rely on training separate models for text detection in varying scenarios and granularities, leading to significant computational complexity and resource demands. In this paper, we introduce "Detect Any Text" (DAT), an advanced paradigm that seamlessly unifies scene text detection, layout analysis, and document page detection into a cohesive, end-to-end model. This design enables DAT to efficiently manage text instances at different granularities, including *word*, *line*, *paragraph* and *page*. A pivotal innovation in DAT is the across-granularity interactive attention module, which significantly enhances the representation learning of text instances at varying granularities by correlating structural information across different text queries. As a result, it enables the model to achieve mutually beneficial detection performances across multiple text granularities. Additionally, a prompt-based segmentation module refines detection outcomes for texts of arbitrary curvature and complex layouts, thereby improving DAT's accuracy and expanding its real-world applicability. Experimental results demonstrate that DAT achieves state-of-the-art performances across a variety of text-related benchmarks, including multi-oriented/arbitrarily-shaped scene text detection, document layout analysis and page detection tasks.