title: Automated Bi-Fold Weighted Ensemble Algorithms and its Application to Brain Tumor Detection and Classification

abstract: The uncontrolled and unstructured growth of brain cells is known as brain tumor, which has one of the highest mortality rates among diseases from all types of cancers. Due to limited diagnostic and treatment capabilities, they pose significant challenges, especially in third-world countries. Early diagnosis plays a vital role in effectively managing brain tumors and reducing mortality rates. However, the availability of diagnostic methods is hindered by various limitations, including high costs and lengthy result acquisition times, impeding early detection of the disease. In this study, we present two cutting-edge bi-fold weighted voting ensemble models that aim to boost the effectiveness of weighted ensemble methods. These two proposed methods combine the classification outcomes from multiple classifiers and determine the optimal result by selecting the one with the highest probability in the first approach, and the highest weighted prediction in the second technique. These approaches significantly improve the overall performance of weighted ensemble techniques. In the first proposed method, we improve the soft voting technique (SVT) by introducing a novel unsupervised weight calculating schema (UWCS) to enhance its weight assigning capability, known as the extended soft voting technique (ESVT). Secondly, we propose a novel weighted method (NWM) by using the proposed UWCS. Both of our approaches incorporate three distinct models: a custom-built CNN, VGG-16, and InceptionResNetV2 which has been trained on publicly available datasets. The effectiveness of our proposed systems is evaluated through blind testing, where exceptional results are achieved. We then establish a comparative analysis of the performance of our proposed methods with that of SVT to show their superiority and effectiveness.


title: Probing Baryogenesis in $f(Q)$ gravity

abstract: The origin of matter domination in the Universe is one of the most exciting open puzzles in particle physics and cosmology. Despite many theoretical developments, the actual reason behind baryon-antibaryon asymmetry is still unknown. Our aim here is to examine this phenomenon in the framework of modified gravity theories, which have impressively elucidated the contemporary accelerated expansion of the universe as well as the early phase. Consequently, this letter sets its sights on the task of constraining a specific variant of modified gravity, namely, $f(Q)$ gravity, in conjunction with gravitational baryogenesis. The Power Law model and recently proposed DGP-like $f(Q)$ models are considered to find the baryon-to-entropy ratio and compare them with the observed value, that is ${n_B}/s=9.42\times 10^{-11}$. Furthermore, we impose constraints on the additional degrees of freedom introduced by this modified theory of gravity.


title: M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models

abstract: Medical image analysis is essential to clinical diagnosis and treatment, which is increasingly supported by multi-modal large language models (MLLMs). However, previous research has primarily focused on 2D medical images, leaving 3D images under-explored, despite their richer spatial information. This paper aims to advance 3D medical image analysis with MLLMs. To this end, we present a large-scale 3D multi-modal medical dataset, M3D-Data, comprising 120K image-text pairs and 662K instruction-response pairs specifically tailored for various 3D medical tasks, such as image-text retrieval, report generation, visual question answering, positioning, and segmentation. Additionally, we propose M3D-LaMed, a versatile multi-modal large language model for 3D medical image analysis. Furthermore, we introduce a new 3D multi-modal medical benchmark, M3D-Bench, which facilitates automatic evaluation across eight tasks. Through comprehensive evaluation, our method proves to be a robust model for 3D medical image analysis, outperforming existing solutions. All code, data, and models are publicly available at: https://github.com/BAAI-DCAI/M3D.


title: A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)

abstract: Traditional recommender systems (RS) have used user-item rating histories as their primary data source, with collaborative filtering being one of the principal methods. However, generative models have recently developed abilities to model and sample from complex data distributions, including not only user-item interaction histories but also text, images, and videos - unlocking this rich data for novel recommendation tasks. Through this comprehensive and multi-disciplinary survey, we aim to connect the key advancements in RS using Generative Models (Gen-RecSys), encompassing: a foundational overview of interaction-driven generative models; the application of large language models (LLM) for generative recommendation, retrieval, and conversational recommendation; and the integration of multimodal models for processing and generating image and video content in RS. Our holistic perspective allows us to highlight necessary paradigms for evaluating the impact and harm of Gen-RecSys and identify open challenges. A more up-to-date version of the papers is maintained at: https://github.com/yasdel/LLM-RecSys.


title: Every $T_1$ connected first-countable space is a continuous open image of a connected metrizable space

abstract: Answering a question posed by Vladimir Tkachuk, we prove that every $T_1$ connected first-countable space is a continuous open image of a connected metrizable space.


title: Correspondence between Composite Theories and Distributive Laws

abstract: Composite theories are the algebraic equivalent of distributive laws. In this paper, we delve into the details of this correspondence and concretely show how to construct a composite theory from a distributive law and vice versa. Using term rewriting methods, we also describe when a minimal set of equations axiomatises the composite theory.


title: Complex Neural Network based Joint AoA and AoD Estimation for Bistatic ISAC

abstract: Integrated sensing and communication (ISAC) in wireless systems has emerged as a promising paradigm, offering the potential for improved performance, efficient resource utilization, and mutually beneficial interactions between radar sensing and wireless communications, thereby shaping the future of wireless technologies. In this work, we present two novel methods to address the joint angle of arrival and angle of departure estimation problem for bistatic ISAC systems. Our proposed methods consist of a deep learning (DL) solution leveraging complex neural networks, in addition to a parameterized algorithm. By exploiting the estimated channel matrix and incorporating a preprocessing step consisting of a coarse timing estimation, we are able to notably reduce the input size and improve the computational efficiency. In our findings, we emphasize the remarkable potential of our DL-based approach, which demonstrates comparable performance to the parameterized method that explicitly exploits the multiple-input multiple-output (MIMO) model, while exhibiting significantly lower computational complexity.


title: If our chaotic operator is derived correctly, then the Riemann hypothesis holds true

abstract: In this paper, we explore novel chaotic dynamics derived from the Riemann and von Mangoldt function formula regarding the distribution of nontrivial zeros of the Riemann zeta function. By computing Lyapunov exponents, we demonstrate that the derived dynamics exhibit chaotic behavior when the gaps between zeros are within a certain bound, specifically up to 2.4. Beyond this threshold, the dynamics do not display chaotic behavior. Furthermore, we derive a chaotic operator for the Riemann zeta function within the critical strip, utilizing the correction term from the Riemann-von Mangoldt formula. We establish the chaotic nature and Hermiticity of this operator, and discuss its diagonalization properties. Moreover, our study reveals a remarkable compatibility between our derived chaotic operator and the quantum hydrogen model, as evidenced by the analysis of its eigenvalues resembling the energy levels of hydrogen. Numerical evidence, including Lyapunov exponents, bifurcation analysis, and entropy computation, underscores the unpredictability of the system. Additionally, we establish a connection between our chaotic operator and the prime number theorem regarding the density of primes. Furthermore, our investigation suggests that this chaotic operator strongly supports the validity of the Riemann hypothesis, as proposed by Hilbert and Polya. These findings shed light on the intricate relationship between chaotic dynamics, number theory, and quantum mechanics, offering new perspectives on the behavior of the Riemann zeta function and its zeros. Finally, we demonstrate the Hermiticity and diagonalization properties of our operator using the spectral theorem, further elucidating its mathematical properties and unboundedness.


title: Quantum Heat Transformers

abstract: We propose a quantum heat transformer (QHT) designed to function analogous to classical voltage transformers. Unlike the classical counterparts, which regulate voltage, a QHT regulates temperature differences between its terminals. We initially design the device for a three-qubit system, representing the smallest possible self-contained heat transformer model. Subsequently we extend to four-qubit systems, with a specific emphasis on exploring the step-down mode for identifying the primary figure of merit. We showcase the versatility and adaptability of the models by demonstrating the availability of various self-contained setups. A key performance indicator, the capacity of thermal control, is defined to measure the capability of QHTs. An important effect in this study is the proof of existence of a necessarily transient step-down quantum heat transformer, that has a dual-mode characteristic, wherein the desired step-down mode can be realized within the transient regime of an originally designed step-up mode of the QHT. We also investigate how to control this transient domain up to which the necessarily transient mode can be achieved, by regulating the initial temperature of the qubits in the four-qubit settings. Therefore, this quantum heat transformer model not only acts as an analog to the classical voltage transformer, but also enjoys advanced characteristics, enabling it to function in both step-up and step-down modes within the same setup, unattainable for voltage transformers.


title: Openness of the frame set on the hyperbolas

abstract: We prove that for the functions of the form $g(x) = h(x) + \frac{C}{x+i}$, where $h$ belongs to the continuous Wiener algebra $W_0$, the intersection of the frame set $\mathcal{F}_g$ with every hyperbola $\{\alpha, \beta > 0 \mid \alpha\beta = c\}$ is open in the relative topology. In particular, this applies to all rational functions $g$.


title: RLGNet: Repeating-Local-Global History Network for Temporal Knowledge Graph Reasoning

abstract: Temporal Knowledge Graph (TKG) reasoning is based on historical information to predict the future. Therefore, parsing and mining historical information is key to predicting the future. Most existing methods fail to concurrently address and comprehend historical information from both global and local perspectives. Neglecting the global view might result in overlooking macroscopic trends and patterns, while ignoring the local view can lead to missing critical detailed information. Additionally, some methods do not focus on learning from high-frequency repeating events, which means they may not fully grasp frequently occurring historical events. To this end, we propose the \textbf{R}epetitive-\textbf{L}ocal-\textbf{G}lobal History \textbf{Net}work(RLGNet). We utilize a global history encoder to capture the overarching nature of historical information. Subsequently, the local history encoder provides information related to the query timestamp. Finally, we employ the repeating history encoder to identify and learn from frequently occurring historical events. In the evaluation on six benchmark datasets, our approach generally outperforms existing TKG reasoning models in multi-step and single-step reasoning tasks.


title: A uniqueness theory on determining the nonlinear energy potential in phase-field system

abstract: The phase-field system is a nonlinear model that has significant applications in material sciences. In this paper, we are concerned with the uniqueness of determining the nonlinear energy potential in a phase-field system consisted of Cahn-Hilliard and Allen-Cahn equations. This system finds widespread applications in the development of alloys engineered to withstand extreme temperatures and pressures. The goal is to reconstruct the nonlinear energy potential through the measurements of concentration fields. We establish the local well-posedness of the phase-field system based on the implicit function theorem in Banach spaces. Both of the uniqueness results for recovering time-independent and time-dependent energy potential functions are provided through the higher order linearization technique.


title: Memory-based Cross-modal Semantic Alignment Network for Radiology Report Generation

abstract: Generating radiology reports automatically reduces the workload of radiologists and helps the diagnoses of specific diseases. Many existing methods take this task as modality transfer process. However, since the key information related to disease accounts for a small proportion in both image and report, it is hard for the model to learn the latent relation between the radiology image and its report, thus failing to generate fluent and accurate radiology reports. To tackle this problem, we propose a memory-based cross-modal semantic alignment model (MCSAM) following an encoder-decoder paradigm. MCSAM includes a well initialized long-term clinical memory bank to learn disease-related representations as well as prior knowledge for different modalities to retrieve and use the retrieved memory to perform feature consolidation. To ensure the semantic consistency of the retrieved cross modal prior knowledge, a cross-modal semantic alignment module (SAM) is proposed. SAM is also able to generate semantic visual feature embeddings which can be added to the decoder and benefits report generation. More importantly, to memorize the state and additional information while generating reports with the decoder, we use learnable memory tokens which can be seen as prompts. Extensive experiments demonstrate the promising performance of our proposed method which generates state-of-the-art performance on the MIMIC-CXR dataset.


title: Harnessing the Power of Large Language Model for Uncertainty Aware Graph Processing

abstract: Handling graph data is one of the most difficult tasks. Traditional techniques, such as those based on geometry and matrix factorization, rely on assumptions about the data relations that become inadequate when handling large and complex graph data. On the other hand, deep learning approaches demonstrate promising results in handling large graph data, but they often fall short of providing interpretable explanations. To equip the graph processing with both high accuracy and explainability, we introduce a novel approach that harnesses the power of a large language model (LLM), enhanced by an uncertainty-aware module to provide a confidence score on the generated answer. We experiment with our approach on two graph processing tasks: few-shot knowledge graph completion and graph classification. Our results demonstrate that through parameter efficient fine-tuning, the LLM surpasses state-of-the-art algorithms by a substantial margin across ten diverse benchmark datasets. Moreover, to address the challenge of explainability, we propose an uncertainty estimation based on perturbation, along with a calibration scheme to quantify the confidence scores of the generated answers. Our confidence measure achieves an AUC of 0.8 or higher on seven out of the ten datasets in predicting the correctness of the answer generated by LLM.


title: CuSINeS: Curriculum-driven Structure Induced Negative Sampling for Statutory Article Retrieval

abstract: In this paper, we introduce CuSINeS, a negative sampling approach to enhance the performance of Statutory Article Retrieval (SAR). CuSINeS offers three key contributions. Firstly, it employs a curriculum-based negative sampling strategy guiding the model to focus on easier negatives initially and progressively tackle more difficult ones. Secondly, it leverages the hierarchical and sequential information derived from the structural organization of statutes to evaluate the difficulty of samples. Lastly, it introduces a dynamic semantic difficulty assessment using the being-trained model itself, surpassing conventional static methods like BM25, adapting the negatives to the model's evolving competence. Experimental results on a real-world expert-annotated SAR dataset validate the effectiveness of CuSINeS across four different baselines, demonstrating its versatility.


title: Task-Space Riccati Feedback based Whole Body Control for Underactuated Legged Locomotion

abstract: This manuscript primarily aims to enhance the performance of whole-body controllers(WBC) for underactuated legged locomotion. We introduce a systematic parameter design mechanism for the floating-base feedback control within the WBC. The proposed approach involves utilizing the linearized model of unactuated dynamics to formulate a Linear Quadratic Regulator(LQR) and solving a Riccati gain while accounting for potential physical constraints through a second-order approximation of the log-barrier function. And then the user-tuned feedback gain for the floating base task is replaced by a new one constructed from the solved Riccati gain. Extensive simulations conducted in MuJoCo with a point bipedal robot, as well as real-world experiments performed on a quadruped robot, demonstrate the effectiveness of the proposed method. In the different bipedal locomotion tasks, compared with the user-tuned method, the proposed approach is at least 12% better and up to 50% better at linear velocity tracking, and at least 7% better and up to 47% better at angular velocity tracking. In the quadruped experiment, linear velocity tracking is improved by at least 3% and angular velocity tracking is improved by at least 23% using the proposed method.


title: Experimental status of $|V_{cd}|$ and $|V_{cs}|$

abstract: The Cabibbo-Kobayashi-Maskawa (CKM) matrix elements $|V_{cd}|$ and $|V_{cs}|$ are essential to test the unitary of CKM matrix. Before 2014, many results of $|V_{cd}|$ and $|V_{cs}|$ had been reported at BaBar, Belle, and CLEO experiments. The precisions of the most accurate results of $|V_{cd}|$ and $|V_{cs}|$ are 4.4\% and 3.3\%, respectively. After that, benefitting from larger data samples collected at BESIII, the precisions of $|V_{cd}|$ and $|V_{cs}|$ are improved to 1.8\% and 0.9\%, respectively.


title: LAESI: Leaf Area Estimation with Synthetic Imagery

abstract: We introduce LAESI, a Synthetic Leaf Dataset of 100,000 synthetic leaf images on millimeter paper, each with semantic masks and surface area labels. This dataset provides a resource for leaf morphology analysis primarily aimed at beech and oak leaves. We evaluate the applicability of the dataset by training machine learning models for leaf surface area prediction and semantic segmentation, using real images for validation. Our validation shows that these models can be trained to predict leaf surface area with a relative error not greater than an average human annotator. LAESI also provides an efficient framework based on 3D procedural models and generative AI for the large-scale, controllable generation of data with potential further applications in agriculture and biology. We evaluate the inclusion of generative AI in our procedural data generation pipeline and show how data filtering based on annotation consistency results in datasets which allow training the highest performing vision models.


title: LexAbSumm: Aspect-based Summarization of Legal Decisions

abstract: Legal professionals frequently encounter long legal judgments that hold critical insights for their work. While recent advances have led to automated summarization solutions for legal documents, they typically provide generic summaries, which may not meet the diverse information needs of users. To address this gap, we introduce LexAbSumm, a novel dataset designed for aspect-based summarization of legal case decisions, sourced from the European Court of Human Rights jurisdiction. We evaluate several abstractive summarization models tailored for longer documents on LexAbSumm, revealing a challenge in conditioning these models to produce aspect-specific summaries. We release LexAbSum to facilitate research in aspect-based summarization for legal domain.


title: Query-driven Relevant Paragraph Extraction from Legal Judgments

abstract: Legal professionals often grapple with navigating lengthy legal judgements to pinpoint information that directly address their queries. This paper focus on this task of extracting relevant paragraphs from legal judgements based on the query. We construct a specialized dataset for this task from the European Court of Human Rights (ECtHR) using the case law guides. We assess the performance of current retrieval models in a zero-shot way and also establish fine-tuning benchmarks using various models. The results highlight the significant gap between fine-tuned and zero-shot performance, emphasizing the challenge of handling distribution shift in the legal domain. We notice that the legal pre-training handles distribution shift on the corpus side but still struggles on query side distribution shift, with unseen legal queries. We also explore various Parameter Efficient Fine-Tuning (PEFT) methods to evaluate their practicality within the context of information retrieval, shedding light on the effectiveness of different PEFT methods across diverse configurations with pre-training and model architectures influencing the choice of PEFT method.


title: ECtHR-PCR: A Dataset for Precedent Understanding and Prior Case Retrieval in the European Court of Human Rights

abstract: In common law jurisdictions, legal practitioners rely on precedents to construct arguments, in line with the doctrine of \emph{stare decisis}. As the number of cases grow over the years, prior case retrieval (PCR) has garnered significant attention. Besides lacking real-world scale, existing PCR datasets do not simulate a realistic setting, because their queries use complete case documents while only masking references to prior cases. The query is thereby exposed to legal reasoning not yet available when constructing an argument for an undecided case as well as spurious patterns left behind by citation masks, potentially short-circuiting a comprehensive understanding of case facts and legal principles. To address these limitations, we introduce a PCR dataset based on judgements from the European Court of Human Rights (ECtHR), which explicitly separate facts from arguments and exhibit precedential practices, aiding us to develop this PCR dataset to foster systems' comprehensive understanding. We benchmark different lexical and dense retrieval approaches with various negative sampling strategies, adapting them to deal with long text sequences using hierarchical variants. We found that difficulty-based negative sampling strategies were not effective for the PCR task, highlighting the need for investigation into domain-specific difficulty criteria. Furthermore, we observe performance of the dense models degrade with time and calls for further research into temporal adaptation of retrieval models. Additionally, we assess the influence of different views , Halsbury's and Goodhart's, in practice in ECtHR jurisdiction using PCR task.


title: Parameter and Data-Efficient Spectral StyleDCGAN

abstract: We present a simple, highly parameter, and data-efficient adversarial network for unconditional face generation. Our method: Spectral Style-DCGAN or SSD utilizes only 6.574 million parameters and 4739 dog faces from the Animal Faces HQ (AFHQ) dataset as training samples while preserving fidelity at low resolutions up to 64x64. Code available at https://github.com/Aryan-Garg/StyleDCGAN.


title: Robust Beamforming Design and Antenna Selection for Dynamic HRIS-aided Massive MIMO Systems

abstract: In this paper, a dynamic hybrid active-passive reconfigurable intelligent surface (HRIS) is proposed to further enhance the massive multiple-input-multiple-output (MIMO) system, since it supports the dynamic placement of active and passive elements. Specifically, considering the impact of the hardware impairments (HWIs), we investigate the channel-aware configuration of the receive antennas at the base station (BS) and the active/passive elements at the HRIS to improve the reliability of system. To this end, we investigate the average mean-square-error (MSE) minimization problem for the HRIS-aided massive MIMO system by jointly optimizing the BS receive antenna selection matrix, the reflection phase coefficients, the reflection amplitude matrix, and the mode selection matrix of the HRIS under the power budget of the HRIS. To tackle the non-convexity and intractability of this problem, we first transform the binary and discrete variables into continuous ones, and then propose a penalty-based exact block coordinate descent (BCD) algorithm to solve these subproblems alternately. Numerical simulations demonstrate the great superiority of the proposed scheme over the conventional benchmark schemes.


title: EvoCodeBench: An Evolving Code Generation Benchmark Aligned with Real-World Code Repositories

abstract: How to evaluate Large Language Models (LLMs) in code generation is an open question. Existing benchmarks demonstrate poor alignment with real-world code repositories and are insufficient to evaluate the coding abilities of LLMs. This paper proposes a new benchmark - EvoCodeBench to address the preceding problems, which has three primary advances. (1) EvoCodeBench aligns with real-world repositories in multiple dimensions, e.g., code distributions and dependency distributions. (2) EvoCodeBench offers comprehensive annotations (e.g., requirements, reference code, and reference dependencies), and robust evaluation metrics (e.g., Pass@k and Recall@k). (3) EvoCodeBench is an evolving benchmark to avoid data leakage. We build an automatic pipeline to update EvoCodeBench from the latest repositories. We release the first version - EvoCodeBench-2403, containing 275 samples from 25 real-world repositories. Based on EvoCodeBench, we propose repository-level code generation and evaluate 10 popular LLMs (e.g., gpt-4, gpt-3.5, DeepSeek Coder, StarCoder 2, CodeLLaMa, Gemma, and Qwen 1.5). Our experiments reveal the coding abilities of these LLMs in real-world repositories. For example, the highest Pass@1 of gpt-4 only is 20.73% in our experiments. We also analyze failed cases and summarize the shortcomings of existing LLMs in EvoCodeBench. We release EvoCodeBench, all prompts, and LLMs' completions for further community analysis.


title: AI Act and Large Language Models (LLMs): When critical issues and privacy impact require human and ethical oversight

abstract: The imposing evolution of artificial intelligence systems and, specifically, of Large Language Models (LLM) makes it necessary to carry out assessments of their level of risk and the impact they may have in the area of privacy, personal data protection and at an ethical level, especially on the weakest and most vulnerable. This contribution addresses human oversight, ethical oversight, and privacy impact assessment.


title: The paradigm of tax-reward and tax-punishment strategies in the advancement of public resource management dynamics

abstract: In contemporary society, the effective utilization of public resources remains a subject of significant concern. A common issue arises from defectors seeking to obtain an excessive share of these resources for personal gain, potentially leading to resource depletion. To mitigate this tragedy and ensure sustainable development of resources, implementing mechanisms to either reward those who adhere to distribution rules or penalize those who do not, appears advantageous. We introduce two models: a tax-reward model and a tax-punishment model, to address this issue. Our analysis reveals that in the tax-reward model, the evolutionary trajectory of the system is influenced not only by the tax revenue collected but also by the natural growth rate of the resources. Conversely, the tax-punishment model exhibits distinct characteristics when compared to the tax-reward model, notably the potential for bistability. In such scenarios, the selection of initial conditions is critical, as it can determine the system's path. Furthermore, our study identifies instances where the system lacks stable points, exemplified by a limit cycle phenomenon, underscoring the complexity and dynamism inherent in managing public resources using these models.


title: 1-out-of-n Oblivious Signatures: Security Revisited and a Generic Construction with an Efficient Communication Cost

abstract: 1-out-of-n oblivious signature by Chen (ESORIC 1994) is a protocol between the user and the signer. In this scheme, the user makes a list of n messages and chooses the message that the user wants to obtain a signature from the list. The user interacts with the signer by providing this message list and obtains the signature for only the chosen message without letting the signer identify which messages the user chooses. Tso et al. (ISPEC 2008) presented a formal treatment of 1-out-of-n oblivious signatures. They defined unforgeability and ambiguity for 1-out-of-n oblivious signatures as a security requirement. In this work, first, we revisit the unforgeability security definition by Tso et al. and point out that their security definition has problems. We address these problems by modifying their security model and redefining unforgeable security. Second, we improve the generic construction of a 1-out-of-n oblivious signature scheme by Zhou et al. (IEICE Trans 2022). We reduce the communication cost by modifying their scheme with a Merkle tree. Then we prove the security of our modified scheme.


title: Weak Distribution Detectors Lead to Stronger Generalizability of Vision-Language Prompt Tuning

abstract: We propose a generalized method for boosting the generalization ability of pre-trained vision-language models (VLMs) while fine-tuning on downstream few-shot tasks. The idea is realized by exploiting out-of-distribution (OOD) detection to predict whether a sample belongs to a base distribution or a novel distribution and then using the score generated by a dedicated competition based scoring function to fuse the zero-shot and few-shot classifier. The fused classifier is dynamic, which will bias towards the zero-shot classifier if a sample is more likely from the distribution pre-trained on, leading to improved base-to-novel generalization ability. Our method is performed only in test stage, which is applicable to boost existing methods without time-consuming re-training. Extensive experiments show that even weak distribution detectors can still improve VLMs' generalization ability. Specifically, with the help of OOD detectors, the harmonic mean of CoOp and ProGrad increase by 2.6 and 1.5 percentage points over 11 recognition datasets in the base-to-novel setting.


title: Extensive Self-Contrast Enables Feedback-Free Language Model Alignment

abstract: Reinforcement learning from human feedback (RLHF) has been a central technique for recent large language model (LLM) alignment. However, its heavy dependence on costly human or LLM-as-Judge preference feedback could stymie its wider applications. In this work, we introduce Self-Contrast, a feedback-free large language model alignment method via exploiting extensive self-generated negatives. With only supervised fine-tuning (SFT) targets, Self-Contrast leverages the LLM itself to generate massive diverse candidates, and harnesses a pre-trained embedding model to filter multiple negatives according to text similarity. Theoretically, we illustrate that in this setting, merely scaling negative responses can still effectively approximate situations with more balanced positive and negative preference annotations. Our experiments with direct preference optimization (DPO) on three datasets show that, Self-Contrast could consistently outperform SFT and standard DPO training by large margins. And as the number of self-generated negatives increases, the performance of Self-Contrast continues to grow. Code and data are available at https://github.com/THUDM/Self-Contrast.


title: Sparse Extended Mean-Variance-CVaR Portfolios with Short-selling

abstract: This paper introduces a novel penalty decomposition algorithm customized for addressing the non-differentiable and nonconvex problem of extended mean-variance-CVaR portfolio optimization with short-selling and cardinality constraints. The proposed algorithm solves a sequence of penalty subproblems using a block coordinate descent (BCD) method while striving to fully exploit each component of the objective function or constraints. Through rigorous analysis, the well-posed nature of each subproblem of the BCD method is established, and closed-form solutions are derived where possible. A comprehensive theoretical convergence analysis is provided to confirm the efficacy of the introduced algorithm in reaching a local minimizer of this intractable optimization problem in finance, whereas generic optimization techniques either only capture a partial minimum or are not efficient. Numerical experiments conducted on real-world datasets validate the practical applicability, effectiveness, and robustness of the introduced algorithm across various criteria. Notably, the existence of closed-form solutions within the BCD subproblems prominently underscores the efficiency of our algorithm when compared to state-of-the-art methods.


title: "Sound and Fury": Nonlinear Functionals of Volatility Matrix in the Presence of Jump and Noise

abstract: This paper resolves a pivotal open problem on nonparametric inference for nonlinear functionals of volatility matrix. Multiple prominent statistical tasks can be formulated as functionals of volatility matrix, yet a unified statistical theory of general nonlinear functionals based on noisy data remains challenging and elusive. Nonetheless, this paper shows it can be achieved by combining the strengths of pre-averaging, jump truncation and nonlinearity bias correction. In light of general nonlinearity, bias correction beyond linear approximation becomes necessary. Resultant estimators are nonparametric and robust over a wide spectrum of stochastic models. Moreover, the estimators can be rate-optimal and stable central limit theorems are obtained. The proposed framework lends itself conveniently to uncertainty quantification and permits fully feasible inference. With strong theoretical guarantees, this paper provides an inferential foundation for a wealth of statistical methods for noisy high-frequency data, such as realized principal component analysis, continuous-time linear regression, realized Laplace transform, generalized method of integrated moments and specification tests, hence extends current application scopes to noisy data which is more prevalent in practice.


title: A Refinement of a Theorem of Diaconis-Evans-Graham

abstract: The note is dedicated to refining a theorem by Diaconis, Evans, and Graham concerning successions and fixed points of permutations. This refinement specifically addresses non-adjacent successions, predecessors, excedances, and drops of permutations.


title: Sample Complexity of Chance Constrained Optimization in Dynamic Environment

abstract: We study the scenario approach for solving chance-constrained optimization in time-coupled dynamic environments. Scenario generation methods approximate the true feasible region from scenarios generated independently and identically from the actual distribution. In this paper, we consider this problem in a dynamic environment, where the scenarios are assumed to be drawn sequentially from an unknown and time-varying distribution. Such dynamic environments are driven by changing environmental conditions that could be found in many real-world applications such as energy systems. We couple the time-varying distributions using the Wasserstein metric between the sequence of scenario-generating distributions and the actual chance-constrained distribution. Our main results are bounds on the number of samples essential for ensuring the ex-post risk in chance-constrained optimization problems when the underlying feasible set is convex or non-convex. Finally, our results are illustrated on multiple numerical experiments for both types of feasible sets.


title: Strong maximum principle for generalized solutions to equations of the Monge-Amp\`ere type

abstract: In this paper, we investigate the strong maximum principle for generalized solutions of Monge-Amp\`ere type equations. We prove that the strong maximum principle holds at points where the function is strictly convex but not necessarily $C^{1,1}$ smooth, and show that it fails at non-strictly convex points. The results we obtain can be applied to various Minkowski type problems in convex geometry by the virtue of the Gauss image map.


title: RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation

abstract: Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in unseen scenarios. To tackle these challenges, Retrieval-Augmented Generation (RAG) addresses this by incorporating external, relevant documents into the response generation process, thus leveraging non-parametric knowledge alongside LLMs' in-context learning abilities. However, existing RAG implementations primarily focus on initial input for context retrieval, overlooking the nuances of ambiguous or complex queries that necessitate further clarification or decomposition for accurate responses. To this end, we propose learning to Refine Query for Retrieval Augmented Generation (RQ-RAG) in this paper, endeavoring to enhance the model by equipping it with capabilities for explicit rewriting, decomposition, and disambiguation. Our experimental results indicate that our method, when applied to a 7B Llama2 model, surpasses the previous state-of-the-art (SOTA) by an average of 1.9\% across three single-hop QA datasets, and also demonstrates enhanced performance in handling complex, multi-hop QA datasets. Our code is available at https://github.com/chanchimin/RQ-RAG.


abstract: In copy-move tampering operations, perpetrators often employ techniques, such as blurring, to conceal tampering traces, posing significant challenges to the detection of object-level targets with intact structures. Focus on these challenges, this paper proposes an Object-level Copy-Move Forgery Image Detection based on Inconsistency Mining (IMNet). To obtain complete object-level targets, we customize prototypes for both the source and tampered regions and dynamically update them. Additionally, we extract inconsistent regions between coarse similar regions obtained through self-correlation calculations and regions composed of prototypes. The detected inconsistent regions are used as supplements to coarse similar regions to refine pixel-level detection. We operate experiments on three public datasets which validate the effectiveness and the robustness of the proposed IMNet.


title: Resource Allocation for Green Probabilistic Semantic Communication with Rate Splitting

abstract: In this paper, the energy efficient design for probabilistic semantic communication (PSC) system with rate splitting multiple access (RSMA) is investigated. Basic principles are first reviewed to show how the PSC system works to extract, compress and transmit the semantic information in a task-oriented transmission. Subsequently, the process of how multiuser semantic information can be represented, compressed and transmitted with RSMA is presented, during which the semantic compression ratio (SCR) is introduced to directly measure the computation overhead in a transmission task, and communication overhead is indirectly described as well. Hence, the problem of wireless resource allocation jointly considering the computation and communication consumption for the PSC system with RSMA is investigated. Both conventional wireless resource constraints and unique constraints on semantic communication are considered to maximize the energy efficiency (EE). Simulation results verify the effectiveness of the proposed scheme.


title: On $(\theta, \Theta)$-cyclic codes and their applications in constructing QECCs

abstract: Let $\mathbb F_q$ be a finite field, where $q$ is an odd prime power. Let $R=\mathbb{F}_q+u\mathbb{F}_q+v\mathbb{F}_q+uv\mathbb F_q$ with $u^2=u,v^2=v,uv=vu$. In this paper, we study the algebraic structure of $(\theta, \Theta)$-cyclic codes of block length $(r,s )$ over $\mathbb{F}_qR.$ Specifically, we analyze the structure of these codes as left $R[x:\Theta]$-submodules of $\mathfrak{R}_{r,s} = \frac{\mathbb{F}_q[x:\theta]}{\langle x^r-1\rangle} \times \frac{R[x:\Theta]}{\langle x^s-1\rangle}$. Our investigation involves determining generator polynomials and minimal generating sets for this family of codes. Further, we discuss the algebraic structure of separable codes. A relationship between the generator polynomials of $(\theta, \Theta)$-cyclic codes over $\mathbb F_qR$ and their duals is established. Moreover, we calculate the generator polynomials of dual of $(\theta, \Theta)$-cyclic codes. As an application of our study, we provide a construction of quantum error-correcting codes (QECCs) from $(\theta, \Theta)$-cyclic codes of block length $(r,s)$ over $\mathbb{F}_qR$. We support our theoretical results with illustrative examples.


title: Learning to Plan for Language Modeling from Unlabeled Data

abstract: By training to predict the next token in an unlabeled corpus, large language models learn to perform many tasks without any labeled data. However, their next-token-prediction objective arguably limits their performance in scenarios that require planning, such as writing a coherent article. In this paper, we train a module for planning the future writing process via a self-supervised learning objective. By conditioning on generated latent plans, our model extends the successful language model formula to more abstract planning in an unsupervised way. Empirically, we demonstrate that our method improves language modeling performance in general, particularly with respect to the text structure. Because our framework uses a planner module that is unsupervised and external to the language model, new planner modules can be trained at large scale and easily be shared with the community.


title: Harmonic chain driven by active Rubin bath: transport properties and steady-state correlations

abstract: Characterizing the properties of an extended system driven by active reservoirs is a question of increasing importance. Here we address this question in two steps. We start by investigating the dynamics of a probe particle connected to an `active Rubin bath' -- a linear chain of overdamped run-and-tumble particles. We derive exact analytical expressions for the effective noise and dissipation kernels, acting on the probe, and show that the active nature of the bath leads to a modified fluctuation-dissipation relation. In the next step, we study the properties of an activity-driven system, modeled by a chain of harmonic oscillators connected to two such active reservoirs at the two ends. We show that the system reaches a nonequilibrium stationary state (NESS), remarkably different from that generated due to a thermal gradient. We characterize this NESS by computing the kinetic temperature profile, spatial and temporal velocity correlations of the oscillators, and the average energy current flowing through the system. It turns out that, the activity drive leads to the emergence of two characteristic length scales, proportional to the activities of the reservoirs. Strong signatures of activity are also manifest in the anomalous short-time decay of the velocity autocorrelations. Finally, we find that the energy current shows a non-monotonic dependence on the activity drive and reversal in direction, corroborating previous findings.


title: Prospects of nuclear-coupled-dark-matter detection via correlation spectroscopy of I$_2^+$ and Ca$^+$

abstract: The nature of dark matter (DM) and its interaction with the Standard Model (SM) is one of the biggest open questions in physics nowadays. The vast majority of theoretically-motivated Ultralight-DM (ULDM) models predict that ULDM couples dominantly to the SM strong/nuclear sector. This coupling leads to oscillations of nuclear parameters that are detectable by comparing clocks with different sensitivities to these nature's constants. Vibrational transitions of molecular clocks are more sensitive to a change in the nuclear parameters than the electronic transitions of atomic clocks. Here, we propose the iodine molecular ion, I$_2^+$, as a sensitive detector for such a class of ULDM models. The iodine's dense spectrum allows us to match its transition frequency to that of an optical atomic clock (Ca$^+$) and perform correlation spectroscopy between the two clock species. With this technique, we project a few-orders-of-magnitude improvement over the most sensitive clock comparisons performed to date. We also briefly consider the robustness of the corresponding "Earth-bound" under modifications of the $Z_N$-QCD axion model.


title: Geometric and information-theoretic aspects of quantum thermodynamics

abstract: In this thesis, I investigate various aspects of one of the most fundamental questions in thermodynamics: what state transformations can quantum systems undergo while interacting with a thermal bath under specific constraints? These constraints may involve total energy conservation, memory effects, or finite-size considerations. Addressing this question leads to (i) a characterisation of the structure of the thermodynamic arrow of time, (ii) a framework bridging the gap between memoryless and arbitrarily non-Markovian thermodynamic processes, and (iii) a derivation of the famous fluctuation-dissipation relation within a quantum information framework. Finally, the last part of this thesis focuses on studying a ubiquitous phenomenon in science, so-called catalysis. It involves using an auxiliary system (a catalyst) to enable processes that would otherwise be impossible. Over the last two decades, this notion has spread to the field of quantum physics. However, this effect is typically described within a highly abstract framework. Despite its successes, this approach struggles to fully capture the behaviour of physically realisable systems, thereby limiting the applicability of quantum catalysis in practical scenarios. Strikingly, I will demonstrate this effect in a paradigmatic quantum optics setup, namely the Jaynes-Cummings model, where an atom interacts with an optical cavity. The atom plays the role of the catalyst and allows for the deterministic generation of non-classical light in the cavity, as evidenced by sub-Poissonian statistics or Wigner negativity.


title: A Multi-Branched Radial Basis Network Approach to Predicting Complex Chaotic Behaviours

abstract: In this study, we propose a multi branched network approach to predict the dynamics of a physics attractor characterized by intricate and chaotic behavior. We introduce a unique neural network architecture comprised of Radial Basis Function (RBF) layers combined with an attention mechanism designed to effectively capture nonlinear inter-dependencies inherent in the attractor's temporal evolution. Our results demonstrate successful prediction of the attractor's trajectory across 100 predictions made using a real-world dataset of 36,700 time-series observations encompassing approximately 28 minutes of activity. To further illustrate the performance of our proposed technique, we provide comprehensive visualizations depicting the attractor's original and predicted behaviors alongside quantitative measures comparing observed versus estimated outcomes. Overall, this work showcases the potential of advanced machine learning algorithms in elucidating hidden structures in complex physical systems while offering practical applications in various domains requiring accurate short-term forecasting capabilities.


title: Examples of Ricci limit spaces with infinite holes

abstract: Let $n\geq 3$, $\lambda \in \mathbb{R} $, and $(X,h)$ be an $n$-dimensional smooth complete Riemannian manifold with ${\rm Ric}_h > \lambda $. In this paper, we construct, for each given $\epsilon >0$, a sequence of $(n+2)$-dimensional manifolds $(M_{i} ,g_i ) \stackrel{GH}{\longrightarrow} (X_\epsilon ,d_\epsilon ) $ with ${\rm Ric}_{g_i} > \lambda $, such that $d_{GH} (X,X_\epsilon ) \leq \epsilon $, and $X_\epsilon $ is homeomorphic to the space obtained by removing an infinite number of balls from $X$. Hence $X_\epsilon $ has dense boundary with an infinite number of connected components. Moreover, $X_\epsilon $ has no open subset which is topologically a manifold. This generalizes Hupp-Naber-Wang's result (arxiv: 2308.03909) from $4$-dimensional case to the general case of dimension $n\geq 3$. Our construction differs from that of Hupp-Naber-Wang. In their approach, Hupp-Naber-Wang considered doing an infinite number of blow-ups on the local complex surface structure of $X$, thus relying on the $4$-dimensional condition. However, our method involves removing an infinite number of balls from $X$, allowing us to construct in the general case of dimensions greater than or equal to $3$. As a corollary, we provide a solution to an open problem posed by Naber in the $3$-dimensional case.


title: Reporting Eye-Tracking Data Quality: Towards a New Standard

abstract: Eye-tracking datasets are often shared in the format used by their creators for their original analyses, usually resulting in the exclusion of data considered irrelevant to the primary purpose. In order to increase re-usability of existing eye-tracking datasets for more diverse and initially not considered use cases, this work advocates a new approach of sharing eye-tracking data. Instead of publishing filtered and pre-processed datasets, the eye-tracking data at all pre-processing stages should be published together with data quality reports. In order to transparently report data quality and enable cross-dataset comparisons, we develop data quality reporting standards and metrics that can be automatically applied to a dataset, and integrate them into the open-source Python package pymovements (https://github.com/aeye-lab/pymovements).


title: Multimodal Pretraining, Adaptation, and Generation for Recommendation: A Survey

abstract: Personalized recommendation serves as a ubiquitous channel for users to discover information or items tailored to their interests. However, traditional recommendation models primarily rely on unique IDs and categorical features for user-item matching, potentially overlooking the nuanced essence of raw item contents across multiple modalities such as text, image, audio, and video. This underutilization of multimodal data poses a limitation to recommender systems, especially in multimedia services like news, music, and short-video platforms. The recent advancements in pretrained multimodal models offer new opportunities and challenges in developing content-aware recommender systems. This survey seeks to provide a comprehensive exploration of the latest advancements and future trajectories in multimodal pretraining, adaptation, and generation techniques, as well as their applications to recommender systems. Furthermore, we discuss open challenges and opportunities for future research in this domain. We hope that this survey, along with our tutorial materials, will inspire further research efforts to advance this evolving landscape.


title: OpenMines: A Light and Comprehensive Mining Simulation Environment for Truck Dispatching

abstract: Mine fleet management algorithms can significantly reduce operational costs and enhance productivity in mining systems. Most current fleet management algorithms are evaluated based on self-implemented or proprietary simulation environments, posing challenges for replication and comparison. This paper models the simulation environment for mine fleet management from a complex systems perspective. Building upon previous work, we introduce probabilistic, user-defined events for random event simulation and implement various evaluation metrics and baselines, effectively reflecting the robustness of fleet management algorithms against unforeseen incidents. We present ``OpenMines'', an open-source framework encompassing the entire process of mine system modeling, algorithm development, and evaluation, facilitating future algorithm comparison and replication in the field. Code is available in https://github.com/370025263/openmines.


title: Variational Autoencoders for exteroceptive perception in reinforcement learning-based collision avoidance

abstract: Modern control systems are increasingly turning to machine learning algorithms to augment their performance and adaptability. Within this context, Deep Reinforcement Learning (DRL) has emerged as a promising control framework, particularly in the domain of marine transportation. Its potential for autonomous marine applications lies in its ability to seamlessly combine path-following and collision avoidance with an arbitrary number of obstacles. However, current DRL algorithms require disproportionally large computational resources to find near-optimal policies compared to the posed control problem when the searchable parameter space becomes large. To combat this, our work delves into the application of Variational AutoEncoders (VAEs) to acquire a generalized, low-dimensional latent encoding of a high-fidelity range-finding sensor, which serves as the exteroceptive input to a DRL agent. The agent's performance, encompassing path-following and collision avoidance, is systematically tested and evaluated within a stochastic simulation environment, presenting a comprehensive exploration of our proposed approach in maritime control systems.


title: On The Friendly Number Of 10

abstract: To answer the question "Is $10$ a solitary number?", we have established a necessary and sufficient condition on primes $p$ and $q$ so that $p$ divides $\sigma(q^{2a})$($a\in\mathbb{Z^+}$). Also We have found the form of $q$ whenever $p$ divides $\sigma(q^{2a})$ for $q>p$ . Using these two, we have proved that if $n$ is a friend of $10$ then it is an odd square with at least seven distinct prime factors, $5$ being the least one. Moreover there exists a prime factor $p$ of $n$ such that $2a+1\equiv 0 \pmod f$ where $f$ is the smallest odd positive integer greater than $1$ and less than or equal to $\min\{ 2a+1,p-1\}$ such that $5^{f}\equiv 1 \pmod p$, provided $5^{2a}\mid \mid n$, $a\in \mathbb{Z^+}$. Further, there exist prime factors $p$ and $q$ not necessarily distinct of $n$ such that $p\equiv1 \pmod {10}$ and $q\equiv 1\pmod 6$. Besides, we have proved that if a Fermat prime $F_k$ divides $n$ then $n$ must have a prime factor congruent to $1$ modulo $2F_k$.


title: Scalable second-order consensus of hierarchical groups

abstract: Motivated by widespread dominance hierarchy, growth of group sizes, and feedback mechanisms in social species, we are devoted to exploring the scalable second-order consensus of hierarchical groups. More specifically, a hierarchical group consists of a collection of agents with double-integrator dynamics on a directed acyclic graph with additional reverse edges, which characterize feedback mechanisms across hierarchical layers. As the group size grows and the reverse edges appear, we investigate whether the absolute velocity protocol and the relative velocity protocol can preserve the system consensus property without tuning the control gains. It is rigorously proved that the absolute velocity protocol is able to achieve completely scalable second-order consensus but the relative velocity protocol cannot. This result theoretically reveals how the scalable coordination behavior in hierarchical groups is determined by local interaction rules. Moreover, we develop a hierarchical structure in order to achieve scalable second-order consensus for networks of any size and with any number of reverse edges.


title: Domain Generalizable Person Search Using Unreal Dataset

abstract: Collecting and labeling real datasets to train the person search networks not only requires a lot of time and effort, but also accompanies privacy issues. The weakly-supervised and unsupervised domain adaptation methods have been proposed to alleviate the labeling burden for target datasets, however, their generalization capability is limited. We introduce a novel person search method based on the domain generalization framework, that uses an automatically labeled unreal dataset only for training but is applicable to arbitrary unseen real datasets. To alleviate the domain gaps when transferring the knowledge from the unreal source dataset to the real target datasets, we estimate the fidelity of person instances which is then used to train the end-to-end network adaptively. Moreover, we devise a domain-invariant feature learning scheme to encourage the network to suppress the domain-related features. Experimental results demonstrate that the proposed method provides the competitive performance to existing person search methods even though it is applicable to arbitrary unseen datasets without any prior knowledge and re-training burdens.


title: A cohomological study of modified Rota-Baxter associative algebras with derivations

abstract: This paper presents a cohomological study of modified Rota-Baxter associative algebras in the presence of derivations. The Modified Rota-Baxter operator, which is a modified version and closely related to the classical Rota-Baxter operator, has garnered significant attention due to its applications in various mathematical and physical contexts. In this study, we define a cohomology theory and also investigate a one-parameter formal deformation theory and abelian extensions of modified Rota-Baxter associative algebras under the influence of derivations.


title: Fluid Antenna Relay Assisted Communication Systems Through Antenna Location Optimization

abstract: In this paper, we investigate the problem of resource allocation for fluid antenna relay (FAR) system with antenna location optimization. In the considered model, each user transmits information to a base station (BS) with help of FAR. The antenna location of the FAR is flexible and can be adapted to dynamic location distribution of the users. We formulate a sum rate maximization problem through jointly optimizing the antenna location and bandwidth allocation with meeting the minimum rate requirements, total bandwidth budget, and feasible antenna region constraints. To solve this problem, we obtain the optimal bandwidth in closed form. Based on the optimal bandwidth, the original problem is reduced to the antenna location optimization problem and an alternating algorithm is proposed. Simulation results verify the effectiveness of the proposed algorithm and the sum rate can be increased by up to 125% compared to the conventional schemes.


title: Against The Achilles' Heel: A Survey on Red Teaming for Generative Models

abstract: Generative models are rapidly gaining popularity and being integrated into everyday applications, raising concerns over their safety issues as various vulnerabilities are exposed. Faced with the problem, the field of red teaming is experiencing fast-paced growth, which highlights the need for a comprehensive organization covering the entire pipeline and addressing emerging topics for the community. Our extensive survey, which examines over 120 papers, introduces a taxonomy of fine-grained attack strategies grounded in the inherent capabilities of language models. Additionally, we have developed the searcher framework that unifies various automatic red teaming approaches. Moreover, our survey covers novel areas including multimodal attacks and defenses, risks around multilingual models, overkill of harmless queries, and safety of downstream applications. We hope this survey can provide a systematic perspective on the field and unlock new areas of research.


title: Sobolev Calibration of Imperfect Computer Models

abstract: Calibration refers to the statistical estimation of unknown model parameters in computer experiments, such that computer experiments can match underlying physical systems. This work develops a new calibration method for imperfect computer models, Sobolev calibration, which can rule out calibration parameters that generate overfitting calibrated functions. We prove that the Sobolev calibration enjoys desired theoretical properties including fast convergence rate, asymptotic normality and semiparametric efficiency. We also demonstrate an interesting property that the Sobolev calibration can bridge the gap between two influential methods: $L_2$ calibration and Kennedy and O'Hagan's calibration. In addition to exploring the deterministic physical experiments, we theoretically justify that our method can transfer to the case when the physical process is indeed a Gaussian process, which follows the original idea of Kennedy and O'Hagan's. Numerical simulations as well as a real-world example illustrate the competitive performance of the proposed method.


title: Network-Assisted Full-Duplex Cell-Free mmWave Networks: Hybrid MIMO Processing and Multi-Agent DRL-Based Power Allocation

abstract: This paper investigates the network-assisted full-duplex (NAFD) cell-free millimeter-wave (mmWave) networks, where the distribution of the transmitting access points (T-APs) and receiving access points (R-APs) across distinct geographical locations mitigates cross-link interference, facilitating the attainment of a truly flexible duplex mode. To curtail deployment expenses and power consumption for mmWave band operations, each AP incorporates a hybrid digital-analog structure encompassing precoder/combiner functions. However, this incorporation introduces processing intricacies within channel estimation and precoding/combining design. In this paper, we first present a hybrid multiple-input multiple-output (MIMO) processing framework and derive explicit expressions for both uplink and downlink achievable rates. Then we formulate a power allocation problem to maximize the weighted bidirectional sum rates. To tackle this non-convex problem, we develop a collaborative multi-agent deep reinforcement learning (MADRL) algorithm called multi-agent twin delayed deep deterministic policy gradient (MATD3) for NAFD cell-free mmWave networks. Specifically, given the tightly coupled nature of both uplink and downlink power coefficients in NAFD cell-free mmWave networks, the MATD3 algorithm resolves such coupled conflicts through an interactive learning process between agents and the environment. Finally, the simulation results validate the effectiveness of the proposed channel estimation methods within our hybrid MIMO processing paradigm, and demonstrate that our MATD3 algorithm outperforms both multi-agent deep deterministic policy gradient (MADDPG) and conventional power allocation strategies.


title: What happens when we add impartial loopy games and impartial entailing games?

abstract: The disjunctive sum of impartial games is analyzed by Sprague-Grundy theory. The theory has been extended to loopy games and entailing games by early results. In this study, we consider further extension of this theory and show partial algebraic structure of the sum of loopy positions and entailing positions.


title: IPT-V2: Efficient Image Processing Transformer using Hierarchical Attentions

abstract: Recent advances have demonstrated the powerful capability of transformer architecture in image restoration. However, our analysis indicates that existing transformerbased methods can not establish both exact global and local dependencies simultaneously, which are much critical to restore the details and missing content of degraded images. To this end, we present an efficient image processing transformer architecture with hierarchical attentions, called IPTV2, adopting a focal context self-attention (FCSA) and a global grid self-attention (GGSA) to obtain adequate token interactions in local and global receptive fields. Specifically, FCSA applies the shifted window mechanism into the channel self-attention, helps capture the local context and mutual interaction across channels. And GGSA constructs long-range dependencies in the cross-window grid, aggregates global information in spatial dimension. Moreover, we introduce structural re-parameterization technique to feed-forward network to further improve the model capability. Extensive experiments demonstrate that our proposed IPT-V2 achieves state-of-the-art results on various image processing tasks, covering denoising, deblurring, deraining and obtains much better trade-off for performance and computational complexity than previous methods. Besides, we extend our method to image generation as latent diffusion backbone, and significantly outperforms DiTs.


title: Designing Human-AI Systems: Anthropomorphism and Framing Bias on Human-AI Collaboration

abstract: AI is redefining how humans interact with technology, leading to a synergetic collaboration between the two. Nevertheless, the effects of human cognition on this collaboration remain unclear. This study investigates the implications of two cognitive biases, anthropomorphism and framing effect, on human-AI collaboration within a hiring setting. Subjects were asked to select job candidates with the help of an AI-powered recommendation tool. The tool was manipulated to have either human-like or robot-like characteristics and presented its recommendations in either positive or negative frames. The results revealed that the framing of AI's recommendations had no significant influence on subjects' decisions. In contrast, anthropomorphism significantly affected subjects' agreement with AI recommendations. Contrary to expectations, subjects were less likely to agree with the AI if it had human-like characteristics. These findings demonstrate that cognitive biases can impact human-AI collaboration and highlight the need for tailored approaches to AI product design, rather than a single, universal solution.


title: Popov Mirror-Prox for solving Variational Inequalities

abstract: We consider the mirror-prox algorithm for solving monotone Variational Inequality (VI) problems. As the mirror-prox algorithm is not practically implementable, except in special instances of VIs (such as affine VIs), we consider its implementation with Popov method updates. We provide convergence rate analysis of our proposed method for a monotone VI with a Lipschitz continuous mapping. We establish a convergence rate of $O(1/t)$, in terms of the number $t$ of iterations, for the dual gap function. Simulations on a two player matrix game corroborate our findings.


title: Learning to Generate Conditional Tri-plane for 3D-aware Expression Controllable Portrait Animation

abstract: In this paper, we present Export3D, a one-shot 3D-aware portrait animation method that is able to control the facial expression and camera view of a given portrait image. To achieve this, we introduce a tri-plane generator that directly generates a tri-plane of 3D prior by transferring the expression parameter of 3DMM into the source image. The tri-plane is then decoded into the image of different view through a differentiable volume rendering. Existing portrait animation methods heavily rely on image warping to transfer the expression in the motion space, challenging on disentanglement of appearance and expression. In contrast, we propose a contrastive pre-training framework for appearance-free expression parameter, eliminating undesirable appearance swap when transferring a cross-identity expression. Extensive experiments show that our pre-training framework can learn the appearance-free expression representation hidden in 3DMM, and our model can generate 3D-aware expression controllable portrait image without appearance swap in the cross-identity manner.


title: Imaginarity measure induced by relative entropy

abstract: Quantum resource theories provide a new perspective and method for the development and application of science. Imaginary numbers are used to describe and solve many complex problems. Therefore imaginarity resource theory proposed recently has become increasingly important and it is worthy of research. In this paper, we find two imaginarity measures, one of which is induced by $\alpha$--$z$--R\'enyi relative entropy and the other defined for positive definite density matrices is induced by Tsallis relative operator entropy. The relationships between different imaginarity measures and their properties are also discussed.


title: HypeBoy: Generative Self-Supervised Representation Learning on Hypergraphs

abstract: Hypergraphs are marked by complex topology, expressing higher-order interactions among multiple nodes with hyperedges, and better capturing the topology is essential for effective representation learning. Recent advances in generative self-supervised learning (SSL) suggest that hypergraph neural networks learned from generative self supervision have the potential to effectively encode the complex hypergraph topology. Designing a generative SSL strategy for hypergraphs, however, is not straightforward. Questions remain with regard to its generative SSL task, connection to downstream tasks, and empirical properties of learned representations. In light of the promises and challenges, we propose a novel generative SSL strategy for hypergraphs. We first formulate a generative SSL task on hypergraphs, hyperedge filling, and highlight its theoretical connection to node classification. Based on the generative SSL task, we propose a hypergraph SSL method, HypeBoy. HypeBoy learns effective general-purpose hypergraph representations, outperforming 16 baseline methods across 11 benchmark datasets.


title: RL-MUL: Multiplier Design Optimization with Deep Reinforcement Learning

abstract: Multiplication is a fundamental operation in many applications, and multipliers are widely adopted in various circuits. However, optimizing multipliers is challenging and non-trivial due to the huge design space. In this paper, we propose RL-MUL, a multiplier design optimization framework based on reinforcement learning. Specifically, we utilize matrix and tensor representations for the compressor tree of a multiplier, based on which the convolutional neural networks can be seamlessly incorporated as the agent network. The agent can learn to optimize the multiplier structure based on a Pareto-driven reward which is customized to accommodate the trade-off between area and delay. Additionally, the capability of RL-MUL is extended to optimize the fused multiply-accumulator (MAC) designs. Experiments are conducted on different bit widths of multipliers. The results demonstrate that the multipliers produced by RL-MUL can dominate all baseline designs in terms of area and delay. The performance gain of RL-MUL is further validated by comparing the area and delay of processing element arrays using multipliers from RL-MUL and baseline approaches.


title: Face It Yourselves: An LLM-Based Two-Stage Strategy to Localize Configuration Errors via Logs

abstract: Configurable software systems are prone to configuration errors, resulting in significant losses to companies. However, diagnosing these errors is challenging due to the vast and complex configuration space. These errors pose significant challenges for both experienced maintainers and new end-users, particularly those without access to the source code of the software systems. Given that logs are easily accessible to most end-users, we conduct a preliminary study to outline the challenges and opportunities of utilizing logs in localizing configuration errors. Based on the insights gained from the preliminary study, we propose an LLM-based two-stage strategy for end-users to localize the root-cause configuration properties based on logs. We further implement a tool, LogConfigLocalizer, aligned with the design of the aforementioned strategy, hoping to assist end-users in coping with configuration errors through log analysis. To the best of our knowledge, this is the first work to localize the root-cause configuration properties for end-users based on Large Language Models~(LLMs) and logs. We evaluate the proposed strategy on Hadoop by LogConfigLocalizer and prove its efficiency with an average accuracy as high as 99.91%. Additionally, we also demonstrate the effectiveness and necessity of different phases of the methodology by comparing it with two other variants and a baseline tool. Moreover, we validate the proposed methodology through a practical case study to demonstrate its effectiveness and feasibility.


title: Polynomial Bogolyubov for special linear groups via tensor rank

abstract: We prove a polynomial Bogolyubov type lemma for the special linear group over finite fields. Specifically, we show that there exists an absolute constant $C>0,$ such that if $A$ is a density $\alpha$ subset of the special linear group, then the set $AA^{-1}AA^{-1}$ contains a subgroup $H$ of density $\alpha^C$. Moreover, this subgroup is isomorphic to a special linear group of a smaller rank. We also show that if $A$ is an approximate subgroups then it can be covered by the union of few cosets of $H$. Our proof makes use of the Gurevich--Howe notion of tensor rank, and of a strengthened Bonami type Lemma for global functions on the bilinear scheme. We also present applications to spectral bounds for global convolution operators, global product free sets, and covering numbers corresponding to global sets.


title: Bloch-Landau-Zener oscillations in a quasi-periodic potential

abstract: Bloch oscillations and Landau-Zener tunneling are ubiquitous phenomena which are sustained by a band-gap spectrum of a periodic Hamiltonian and can be observed in dynamics of a quantum particle or a wavepacket in a periodic potential under action of a linear force. Such physical setting remains meaningful for aperiodic potentials too, although band-gap structure does not exist anymore. Here we consider the dynamics of noninteracting atoms and Bose-Einstein condensates in a quasi-periodic one-dimensional optical lattice subjected to a weak linear force. Excited states with energies below the mobility edge, and thus localized in space, are considered. We show that the observed oscillatory behavior is enabled by tunneling between the initial state and a state (or several states) located nearby in the coordinate-energy space. The states involved in such Bloch-Landau-Zener oscillations are determined by the selection rule consisting of the condition of their spatial proximity and condition of quasi-resonances occurring at avoided crossings of the energy levels. The latter condition is formulated mathematically using the Gershgorin circle theorem. The effect of the inter-atomic interactions on the dynamics can also be predicted on the bases of the developed theory. The reported results can be observed in any physical system allowing for observation of the Bloch oscillations, upon introducing incommensurablity in the governing Hamiltonian.


title: Study of Viable Compact Stellar Structures in Non-Riemannian Geometry

abstract: The main objective of this article is to study the viable compact stellar structures in non-Riemannian geometry, i.e., $f(\mathbb{Q},T)$ theory, where $\mathbb{Q}$ defines the non-metricity and $T$ represents trace of the stress-energy tensor. In this perspective, we consider a static spherical metric with anisotropic matter configuration to examine the geometry of considered compact stars. A specific model of this theory is used to derive the explicit expressions of energy density and pressure components that govern the relationship between matter and geometry. The unknown parameters are evaluated by using the continuity of inner and outer spacetimes to examine the configuration of spherical stellar structures. Physical parameters such as fluid characteristics, energy constraints and equation of state parameters are analyzed to examine the viability of the considered stellar objects. Further, we use Tolman-Oppenheimer-Volkoff equation, sound speed and adiabatic index methods to analyze the equilibrium state and stability of the proposed stellar objects. The rigorous analysis and satisfaction of necessary conditions lead to the conclusion that the stellar objects studied in this framework are viable and stable.


title: SoK: Liquid Staking Tokens (LSTs)

abstract: Liquid Staking Tokens (LSTs) function as tokenized representations of staked native assets while also accruing staking rewards. They emerged as a preferred method of staking within Proof of Stake (PoS) blockchains, owing to their ease of use and tradability. In this Systematization of Knowledge (SoK), we establish a general framework describing the design choices and protocols underlying liquid staking. We then employ the framework to systematically compare the top LST implementations, examining their node operator selection, validator operations, and staking rewards distribution models. We further discuss security concerns associated with liquid staking, its implications for PoS blockchain security, and Distributed Validator technology (DVT) as a potential solution. Finally, we empirically analyze LSTs' performance and find that the design choices and market events affect peg stability; particularly, LSTs with centralized governance and operations are more efficient in tracking staking rewards.


title: Attire-Based Anomaly Detection in Restricted Areas Using YOLOv8 for Enhanced CCTV Security

abstract: This research introduces an innovative security enhancement approach, employing advanced image analysis and soft computing. The focus is on an intelligent surveillance system that detects unauthorized individuals in restricted areas by analyzing attire. Traditional security measures face challenges in monitoring unauthorized access. Leveraging YOLOv8, an advanced object detection algorithm, our system identifies authorized personnel based on their attire in CCTV footage. The methodology involves training the YOLOv8 model on a comprehensive dataset of uniform patterns, ensuring precise recognition in specific regions. Soft computing techniques enhance adaptability to dynamic environments and varying lighting conditions. This research contributes to image analysis and soft computing, providing a sophisticated security solution. Emphasizing uniform-based anomaly detection, it establishes a foundation for robust security systems in restricted areas. The outcomes highlight the potential of YOLOv8-based surveillance in ensuring safety in sensitive locations.


title: Primordial black holes from slow phase transitions: a model-building perspective

abstract: We investigate the formation of primordial black holes (PBHs) through delayed vacuum decay during slow cosmic first-order phase transitions. Two specific models, the polynomial potential and the real singlet extension of the Standard Model, are used as illustrative examples. Our findings reveal that models with zero-temperature scalar potential barriers are conducive to the realization of this mechanism, as the phase transition duration is extended by the U-shaped Euclidean action. We find that the resulting PBH density is highly sensitive to the barrier height, with abundant PBH formation observed for sufficiently high barriers. Notably, the phase transition needs not to be ultra-supercooled (i.e. the parameter $\alpha\gg1$), and the commonly used exponential nucleation approximation $\Gamma(t)\sim e^{\beta t}$ fails to capture the PBH formation dynamics in such models.


title: ALMA Confirmation of Millimeter Time Variability in the Gamma-Ray Detected Seyfert Galaxy GRS 1734-292

abstract: GRS 1734-292 is a radio-quiet galaxy, exhibiting neither intense starburst nor jet activities. However, Fermi-LAT detected this object in the GeV band. The origin of non-thermal activity in this Seyfert galaxy is an intriguing question. We report Atacama Large Millimeter/submillimeter Array (ALMA) observations of GRS 1734-292 at frequencies of 97.5, 145, and 225 GHz. These observations confirmed the millimeter excess within the central <100 pc region and its time variability based on two separate observations conducted four days apart. The timescale of variability aligns with the light crossing time for a compact source smaller than <100 Schwarzschild radius. If we take into account the power-law synchrotron emission originating from the corona (i.e., the hot plasma located above the accretion disk), the millimeter spectrum indicates the coronal magnetic field of ~10 G and the size of ~10 Schwarzschild radius. An alternative explanation for this millimeter emission could be synchrotron and free-free emission from disk winds (i.e., fast wide-opening angle outflows from the disk) with the size of ~10 pc, although it may be difficult to explain the fast variability. Future millimeter observations with higher resolution (~0.01") will enable the differentiation between these two scenarios. Such observations will provide insights into the acceleration sites of high-energy particles at the core of active galactic nuclei.


title: SpiralMLP: A Lightweight Vision MLP Architecture

abstract: We present SpiralMLP, a novel architecture that introduces a Spiral FC layer as a replacement for the conventional Token Mixing approach. Differing from several existing MLP-based models that primarily emphasize axes, our Spiral FC layer is designed as a deformable convolution layer with spiral-like offsets. We further adapt Spiral FC into two variants: Self-Spiral FC and Cross-Spiral FC, which enable both local and global feature integration seamlessly, eliminating the need for additional processing steps. To thoroughly investigate the effectiveness of the spiral-like offsets and validate our design, we conduct ablation studies and explore optimal configurations. In empirical tests, SpiralMLP reaches state-of-the-art performance, similar to Transformers, CNNs, and other MLPs, benchmarking on ImageNet-1k, COCO and ADE20K. SpiralMLP still maintains linear computational complexity O(HW) and is compatible with varying input image resolutions. Our study reveals that targeting the full receptive field is not essential for achieving high performance, instead, adopting a refined approach offers better results.


title: Calculation of the total 10-th order QED contribution to the electron magnetic moment

abstract: The total 5-loop quantum electrodynamics universal contribution to the anomalous magnetic moments of the leptons was calculated by the author. The obtained value $A_1^{(10)}=5.891(61)$ provides the first complete verification of the previously known value obtained by T. Aoyama, M. Hayakawa, T. Kinoshita, M. Nio (AHKN). The discrepancy is $5 \sigma$. The computation includes the recalculation of the part that the author calculated in 2019 using a slightly different method and the calculation of the remaining part of the coefficient. A comparison with the AHKN values in 32 gauge-invariant classes is provided. In addition, the results are divided into 95 small gauge-invariant classes that subdivide the former ones. Such a detailzation is provided for the first time. The method described in previous works of the author was used in general. However, the Monte Carlo integration method is new and is described in detail. Some useful technical information and information on numerical cancellations is also given.


title: Deep Instruction Tuning for Segment Anything Model

abstract: Recently, Segment Anything Model (SAM) has become a research hotspot in the fields of multimedia and computer vision, which exhibits powerful yet versatile capabilities on various (un) conditional image segmentation tasks. Although SAM can support different types of segmentation prompts, we note that, compared to point- and box-guided segmentations, it performs much worse on text-instructed tasks, e.g., referring image segmentation (RIS). In this paper, we argue that deep text instruction tuning is key to mitigate such shortcoming caused by the shallow fusion scheme in its default light-weight mask decoder. To address this issue, we propose two simple yet effective deep instruction tuning (DIT) methods for SAM, one is end-to-end and the other is layer-wise. With minimal modifications, DITs can directly transform the image encoder of SAM as a stand-alone vision-language learner in contrast to building another deep fusion branch, maximizing the benefit of its superior segmentation capability. Extensive experiments on three highly competitive benchmark datasets of RIS show that a simple end-to-end DIT can improve SAM by a large margin, while the layer-wise DIT can further boost the performance to state-of-the-art with much less data and training expenditures. Our code is released at: https://github.com/wysnzzzz/DIT.


title: Learning Off-policy with Model-based Intrinsic Motivation For Active Online Exploration

abstract: Recent advancements in deep reinforcement learning (RL) have demonstrated notable progress in sample efficiency, spanning both model-based and model-free paradigms. Despite the identification and mitigation of specific bottlenecks in prior works, the agent's exploration ability remains under-emphasized in the realm of sample-efficient RL. This paper investigates how to achieve sample-efficient exploration in continuous control tasks. We introduce an RL algorithm that incorporates a predictive model and off-policy learning elements, where an online planner enhanced by a novelty-aware terminal value function is employed for sample collection. Leveraging the forward predictive error within a latent state space, we derive an intrinsic reward without incurring parameters overhead. This reward establishes a solid connection to model uncertainty, allowing the agent to effectively overcome the asymptotic performance gap. Through extensive experiments, our method shows competitive or even superior performance compared to prior works, especially the sparse reward cases.


title: Principal polarizations on products of abelian varieties over finite fields

abstract: We refine and generalize the results of K. E. Lauter and E. W. Howe on principal polarizations on products of abelian varieties over finite fields. Firstly, we study the reasons for the absence of an irreducible principal polarization in the isogeny class of the product of an ordinary and a supersingular abelian varieties. Secondly, we provide a necessary condition for the existence of a principal polarization on an abelian variety in the isogeny class of the product of a geometrically simple abelian surface and an elliptic curve. As an application we get that this abelian threefold or its quadratic twist is a Jacobian.


title: Dual DETRs for Multi-Label Temporal Action Detection

abstract: Temporal Action Detection (TAD) aims to identify the action boundaries and the corresponding category within untrimmed videos. Inspired by the success of DETR in object detection, several methods have adapted the query-based framework to the TAD task. However, these approaches primarily followed DETR to predict actions at the instance level (i.e., identify each action by its center point), leading to sub-optimal boundary localization. To address this issue, we propose a new Dual-level query-based TAD framework, namely DualDETR, to detect actions from both instance-level and boundary-level. Decoding at different levels requires semantics of different granularity, therefore we introduce a two-branch decoding structure. This structure builds distinctive decoding processes for different levels, facilitating explicit capture of temporal cues and semantics at each level. On top of the two-branch design, we present a joint query initialization strategy to align queries from both levels. Specifically, we leverage encoder proposals to match queries from each level in a one-to-one manner. Then, the matched queries are initialized using position and content prior from the matched action proposal. The aligned dual-level queries can refine the matched proposal with complementary cues during subsequent decoding. We evaluate DualDETR on three challenging multi-label TAD benchmarks. The experimental results demonstrate the superior performance of DualDETR to the existing state-of-the-art methods, achieving a substantial improvement under det-mAP and delivering impressive results under seg-mAP.


title: Freeze-in sterile neutrino dark matter in feeble gauged $B-L$ model

abstract: We consider the gauged $U(1)_{B-L}$ model and examine the situation where the sterile neutrino is a dark matter candidate produced by the freeze-in mechanism. In our model, the dark matter $N$ is mainly produced by the decay of a $U(1)_{B-L}$ breaking scalar field $\phi$. We point out that the on-shell production of $\phi$ through annihilation of the $U(1)_{B-L}$ gauge field $Z'$ plays an important role. We find that the single production of $Z'$ from the photon bath is one of the main production processes of $Z'$. To prevent $N$ from being overproduced, we show that the $U(1)_{B-L}$ gauge coupling constant $g_{B-L}$ must be as small as $10^{-13}$-$10^{-10}$. We also consider the case where the decay of $\phi$ into $N$ is kinematically forbidden. In this case, $N$ is generated by the scattering of $Z'$ and the $g_{B-L}$ takes values of $10^{-7}$-$10^{-6}$, which can be explored in collider experiments like FASER.


title: Characterizing GSVD by singular value expansion of linear operators and its computation

abstract: The generalized singular value decomposition (GSVD) of a matrix pair $\{A, L\}$ with $A\in\mathbb{R}^{m\times n}$ and $L\in\mathbb{R}^{p\times n}$ generalizes the singular value decomposition (SVD) of a single matrix. In this paper, we provide a new understanding of GSVD from the viewpoint of SVD, based on which we propose a new iterative method for computing nontrivial GSVD components of a large-scale matrix pair. By introducing two linear operators $\mathcal{A}$ and $\mathcal{L}$ induced by $\{A, L\}$ between two finite-dimensional Hilbert spaces and applying the theory of singular value expansion (SVE) for linear compact operators, we show that the GSVD of $\{A, L\}$ is nothing but the SVEs of $\mathcal{A}$ and $\mathcal{L}$. This result characterizes completely the structure of GSVD for any matrix pair with the same number of columns. As a direct application of this result, we generalize the standard Golub-Kahan bidiagonalization (GKB) that is a basic routine for large-scale SVD computation such that the resulting generalized GKB (gGKB) process can be used to approximate nontrivial extreme GSVD components of $\{A, L\}$, which is named the gGKB\_GSVD algorithm. We use the GSVD of $\{A, L\}$ to study several basic properties of gGKB and also provide preliminary results about convergence and accuracy of gGKB\_GSVD for GSVD computation. Numerical experiments are presented to demonstrate the effectiveness of this method.


title: WavLLM: Towards Robust and Adaptive Speech Large Language Model

abstract: The recent advancements in large language models (LLMs) have revolutionized the field of natural language processing, progressively broadening their scope to multimodal perception and generation. However, effectively integrating listening capabilities into LLMs poses significant challenges, particularly with respect to generalizing across varied contexts and executing complex auditory tasks. In this work, we introduce WavLLM, a robust and adaptive speech large language model with dual encoders, and a prompt-aware LoRA weight adapter, optimized by a two-stage curriculum learning approach. Leveraging dual encoders, we decouple different types of speech information, utilizing a Whisper encoder to process the semantic content of speech, and a WavLM encoder to capture the unique characteristics of the speaker's identity. Within the curriculum learning framework, WavLLM first builds its foundational capabilities by optimizing on mixed elementary single tasks, followed by advanced multi-task training on more complex tasks such as combinations of the elementary tasks. To enhance the flexibility and adherence to different tasks and instructions, a prompt-aware LoRA weight adapter is introduced in the second advanced multi-task training stage. We validate the proposed model on universal speech benchmarks including tasks such as ASR, ST, SV, ER, and also apply it to specialized datasets like Gaokao English listening comprehension set for SQA, and speech Chain-of-Thought (CoT) evaluation set. Experiments demonstrate that the proposed model achieves state-of-the-art performance across a range of speech tasks on the same model size, exhibiting robust generalization capabilities in executing complex tasks using CoT approach. Furthermore, our model successfully completes Gaokao tasks without specialized training. The codes, models, audio, and Gaokao evaluation set can be accessed at \url{aka.ms/wavllm}.


title: Observations on Building RAG Systems for Technical Documents

abstract: Retrieval augmented generation (RAG) for technical documents creates challenges as embeddings do not often capture domain information. We review prior art for important factors affecting RAG and perform experiments to highlight best practices and potential challenges to build RAG systems for technical documents.


title: KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimation

abstract: This paper presents a novel Kinematics and Trajectory Prior Knowledge-Enhanced Transformer (KTPFormer), which overcomes the weakness in existing transformer-based methods for 3D human pose estimation that the derivation of Q, K, V vectors in their self-attention mechanisms are all based on simple linear mapping. We propose two prior attention modules, namely Kinematics Prior Attention (KPA) and Trajectory Prior Attention (TPA) to take advantage of the known anatomical structure of the human body and motion trajectory information, to facilitate effective learning of global dependencies and features in the multi-head self-attention. KPA models kinematic relationships in the human body by constructing a topology of kinematics, while TPA builds a trajectory topology to learn the information of joint motion trajectory across frames. Yielding Q, K, V vectors with prior knowledge, the two modules enable KTPFormer to model both spatial and temporal correlations simultaneously. Extensive experiments on three benchmarks (Human3.6M, MPI-INF-3DHP and HumanEva) show that KTPFormer achieves superior performance in comparison to state-of-the-art methods. More importantly, our KPA and TPA modules have lightweight plug-and-play designs and can be integrated into various transformer-based networks (i.e., diffusion-based) to improve the performance with only a very small increase in the computational overhead. The code is available at: https://github.com/JihuaPeng/KTPFormer.


title: Sign-reversal Anomalous Hall effect driven by a magnetic transition in Cr$_{7-\delta}$Te$_8$

abstract: The search for exotic spin configurations and related novel transport properties continues to be fueled by the promise of new electronic states and outstanding candidate components for spintronic applications. In layered Cr$_{7-\delta}$Te$_8$, the applied field drives a before unreported magnetic transition revealed by the alternating current magnetic susceptibility measurements around room temperature. This observed magnetic transition results in a sign change for the anomalous Hall effect which exhibits non-monotonous temperature dependence. The prominent topological Hall effect (THE) with a large value of 1$\mu \Omega \cdot cm$ has been observed without breaking the inversion symmetry for Cr$_{7-\delta}$Te$_8$. This robust THE can persist up to room temperature attributed to the nonzero fluctuation-driven scalar spin chirality. The complicated interactions of long-range and short-range magnetic orders lead to rich exotic magnetic states with related novel transport properties in Cr$_{7-\delta}$Te$_8$.


title: Real-space renormalisation approach to the Chalker-Coddington model revisited: improved statistics

abstract: The real-space renormalisation group method can be applied to the Chalker-Coddington model of the quantum Hall transition to provide a convenient numerical estimation of the localisation critical exponent, $\nu$. Previous such studies found $\nu\sim 2.39$ which falls considerably short of the current best estimates by transfer matrix ($\nu\approx 2.593$) and exact-diagonalisation studies ($\nu=2.58(3)$). By increasing the amount of data $500$ fold we can now measure closer to the critical point and find an improved estimate $\nu\approx 2.51$. This deviates only $\sim 3\%$ from the previous two values and is already better than the $\sim 7\%$ accuracy of the classical small-cell renormalisation approach from which our method is adapted. We also study a previously proposed mixing of the Chalker-Coddington model with a classical scattering model which is meant to provide a route to understanding why experimental estimates give a lower $\nu\sim 2.3$. Upon implementing this mixing into our RG unit, we find only further increases to the value of $\nu$.