title: Unlabeled Sensing Using Rank-One Moment Matrix Completion

abstract: We study the unlabeled sensing problem that aims to solve a linear system of equations $A x =\pi(y) $ for an unknown permutation $\pi$. For a generic matrix $A$ and a generic vector $y$, we construct a system of polynomial equations whose unique solution satisfies $ A\xi^*=\pi(y)$. In particular, $\xi^*$ can be recovered by solving the rank-one moment matrix completion problem. We propose symbolic and numeric algorithms to compute the unique solution. Some numerical experiments are conducted to show the efficiency and robustness of the proposed algorithms.


title: Reconfiguration and Enumeration of Optimal Cyclic Ladder Lotteries

abstract: A ladder lottery, known as ``Amidakuji'' in Japan, is a common way to decide an assignment at random. In this paper, we investigate reconfiguration and enumeration problems of cyclic ladder lotteries. First, when a permutation $\pi$ and an optimal displacement vector $\mathbf{x}$ are given, we investigate the reconfiguration and enumeration problems of the ``optimal'' cyclic ladder lotteries of $\pi$ and $\mathbf{x}$. Next, for a give permutation $\pi$ we consider reconfiguration and enumeration problems of the optimal displacement vectors of $\pi$.


title: Network Interdiction Goes Neural

abstract: Network interdiction problems are combinatorial optimization problems involving two players: one aims to solve an optimization problem on a network, while the other seeks to modify the network to thwart the first player's objectives. Such problems typically emerge in an attacker-defender context, encompassing areas such as military operations, disease spread analysis, and communication network management. The primary bottleneck in network interdiction arises from the high time complexity of using conventional exact solvers and the challenges associated with devising efficient heuristic solvers. GNNs, recognized as a cutting-edge methodology, have shown significant effectiveness in addressing single-level CO problems on graphs, such as the traveling salesman problem, graph matching, and graph edit distance. Nevertheless, network interdiction presents a bi-level optimization challenge, which current GNNs find difficult to manage. To address this gap, we represent network interdiction problems as Mixed-Integer Linear Programming (MILP) instances, then apply a multipartite GNN with sufficient representational capacity to learn these formulations. This approach ensures that our neural network is more compatible with the mathematical algorithms designed to solve network interdiction problems, resulting in improved generalization. Through two distinct tasks, we demonstrate that our proposed method outperforms theoretical baseline models and provides advantages over traditional exact solvers.


title: Looking for a Refined Monster

abstract: We discuss some categorical aspects of the objects that appear in the construction of the Monster and other sporadic simple groups. We define the basic representation of the categorical torus $\mathcal T$ classified by an even symmetric bilinear form $I$ and of the semi-direct product of $\mathcal T$ with its canonical involution. We compute the centraliser of the basic representation of $\mathcal T\rtimes\{\pm1\}$ and find it to be a categorical extension of the extraspecial $2$-group with commutator $I\mod 2$. We study the inertia groupoid of a categorical torus and find that it is given by the torsor of the topological Looijenga line bundle, so that $2$-class functions on $\mathcal T$ are canonically theta-functions. We discuss how discontinuity of the categorical character in our formalism means that the character of the basic representation fails to be a categorical class function. We compute the automorphisms of $\mathcal T$ and of $\mathcal T\rtimes\{\pm1\}$ and relate these to the Conway groups.


title: Tensor Attention Training: Provably Efficient Learning of Higher-order Transformers

abstract: Tensor Attention, a multi-view attention that is able to capture high-order correlations among multiple modalities, can overcome the representational limitations of classical matrix attention. However, the $\Omega(n^3)$ time complexity of tensor attention poses a significant obstacle to its practical implementation in transformers, where $n$ is the input sequence length. In this work, we prove that the backward gradient of tensor attention training can be computed in almost linear $n^{1+o(1)}$ time, the same complexity as its forward computation under a bounded entries assumption. We provide a closed-form solution for the gradient and propose a fast computation method utilizing polynomial approximation methods and tensor algebraic tricks. Furthermore, we prove the necessity and tightness of our assumption through hardness analysis, showing that slightly weakening it renders the gradient problem unsolvable in truly subcubic time. Our theoretical results establish the feasibility of efficient higher-order transformer training and may facilitate practical applications of tensor attention architectures.


title: KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledge

abstract: Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus either on training KGE models solely based on graph structure or fine-tuning pre-trained language models with classification data in KG, KG-FIT leverages LLM-guided refinement to construct a semantically coherent hierarchical structure of entity clusters. By incorporating this hierarchical knowledge along with textual information during the fine-tuning process, KG-FIT effectively captures both global semantics from the LLM and local semantics from the KG. Extensive experiments on the benchmark datasets FB15K-237, YAGO3-10, and PrimeKG demonstrate the superiority of KG-FIT over state-of-the-art pre-trained language model-based methods, achieving improvements of 14.4%, 13.5%, and 11.9% in the Hits@10 metric for the link prediction task, respectively. Furthermore, KG-FIT yields substantial performance gains of 12.6%, 6.7%, and 17.7% compared to the structure-based base models upon which it is built. These results highlight the effectiveness of KG-FIT in incorporating open-world knowledge from LLMs to significantly enhance the expressiveness and informativeness of KG embeddings.


title: Augmented Risk Prediction for the Onset of Alzheimer's Disease from Electronic Health Records with Large Language Models

abstract: Alzheimer's disease (AD) is the fifth-leading cause of death among Americans aged 65 and older. Screening and early detection of AD and related dementias (ADRD) are critical for timely intervention and for identifying clinical trial participants. The widespread adoption of electronic health records (EHRs) offers an important resource for developing ADRD screening tools such as machine learning based predictive models. Recent advancements in large language models (LLMs) demonstrate their unprecedented capability of encoding knowledge and performing reasoning, which offers them strong potential for enhancing risk prediction. This paper proposes a novel pipeline that augments risk prediction by leveraging the few-shot inference power of LLMs to make predictions on cases where traditional supervised learning methods (SLs) may not excel. Specifically, we develop a collaborative pipeline that combines SLs and LLMs via a confidence-driven decision-making mechanism, leveraging the strengths of SLs in clear-cut cases and LLMs in more complex scenarios. We evaluate this pipeline using a real-world EHR data warehouse from Oregon Health \& Science University (OHSU) Hospital, encompassing EHRs from over 2.5 million patients and more than 20 million patient encounters. Our results show that our proposed approach effectively combines the power of SLs and LLMs, offering significant improvements in predictive performance. This advancement holds promise for revolutionizing ADRD screening and early detection practices, with potential implications for better strategies of patient management and thus improving healthcare.


title: PPRSteg: Printing and Photography Robust QR Code Steganography via Attention Flow-Based Model

abstract: Image steganography can hide information in a host image and obtain a stego image that is perceptually indistinguishable from the original one. This technique has tremendous potential in scenarios like copyright protection, information retrospection, etc. Some previous studies have proposed to enhance the robustness of the methods against image disturbances to increase their applicability. However, they generally cannot achieve a satisfying balance between the steganography quality and robustness. In this paper, we focus on the issue of QR Code steganography that is robust to real-world printing and photography. Different from common image steganography, QR Code steganography aims to embed a non-natural image into a natural image and the restored QR Code is required to be recognizable, which increases the difficulty of data concealing and revealing. Inspired by the recent developments in transformer-based vision models, we discover that the tokenized representation of images is naturally suitable for steganography. In this paper, we propose a novel QR Code embedding framework, called Printing and Photography Robust Steganography (PPRSteg), which is competent to hide QR Code in a host image with unperceivable changes and can restore it even if the stego image is printed out and photoed. We outline a transition process to reduce the artifacts in stego images brought by QR Codes. We also propose a steganography model based on normalizing flow, which combines the attention mechanism to enhance its performance. To our best knowledge, this is the first work that integrates the advantages of transformer models into normalizing flow. We conduct comprehensive and detailed experiments to demonstrate the effectiveness of our method and the result shows that PPRSteg has great potential in robust, secure and high-quality QR Code steganography.


title: Exploring the Unexpected: Disharmonized Harmonic Pulsation Modes in High-Amplitude $\delta$ Scuti Stars

abstract: Harmonics are a ubiquitous feature across various pulsating stars, traditionally viewed as mere replicas of the independent primary pulsation modes, and have thus been excluded from asteroseismological models. Recent research, however, has uncovered a significant discrepancy: in high-amplitude $\delta$ Scuti stars (HADS), harmonics exhibit uncorrelated variations in amplitude and frequency relative to their parent modes. The serendipitous nature of these disharmonized harmonics is a question of critical importance. In our study, we analyzed five triple-mode HADS stars observed by the Transiting Exoplanet Survey Satellite (TESS) and discovered some pervasive patterns of disharmonized harmonics in both the fundamental ($f_0$) and first overtone ($f_1$) pulsation modes. Intriguingly, through an in-depth frequency interaction analysis of V1393 Cen, we identified $2f_1$ as an independent pulsation mode, distinct from $f_1$, and pinpointed it as the progenitor of the frequency variations observed in $3f_1$, $4f_1$, $5f_1$, and $6f_1$. Notably, we found an interesting pattern in decomposing of the harmonics, which uncovers the generation process of harmonics for the first time. These findings serve as a new window on the research of harmonics, which remains a hidden corner of contemporary astroseismology.


title: Kinematical and Ellipsoidal Properties of the Inner-Halo Hot Subdwarfs Observed in Gaia DR3 and LAMOST DR7

abstract: Here, we report the kinematical parameters of inner-halo hot subdwarfs located within (d lower than or equal 15 kpc) at high Galactic latitudes (b^o greater than or equal 20). The study included three program stars for one of the extreme He-rich groups (eHe-1) with eccentricity (e=0.65) and the z-component of the angular momentum (J_z=4288.66 kpc km s-1), the inner halo program I with 121 points (T_eff greater than or equal 24,000) and their subsections, i.e. inner halo program II (sdB; 79 points) with (40,000 greater than or equal T_eff greater than or equal 24,000) and inner halo program III (sdO; 42 points) with (80,000 greater than or equal T_eff greater than or equal 40,000). First, we calculated the spatial velocities (U_avg, V_avg, W_avg; km s-1) along the Galactic coordinates and subsequently their subsections sdB and sdO. Second, we calculated the vertex longitudes (l_2) and the Solar motion (S_sun=41.24 +/- 6.42 km s-1) as well as their subsections. Finally, based on the kinematic relation of the ratio (s_2/s_1) and our previously computed numerical value of the angular rotation rate (|A-B|=26.07 +/- 5.10; km s-1 kpc-1), we obtained the average Oort's constant.


title: CRoFT: Robust Fine-Tuning with Concurrent Optimization for OOD Generalization and Open-Set OOD Detection

abstract: Recent vision-language pre-trained models (VL-PTMs) have shown remarkable success in open-vocabulary tasks. However, downstream use cases often involve further fine-tuning of VL-PTMs, which may distort their general knowledge and impair their ability to handle distribution shifts. In real-world scenarios, machine learning systems inevitably encounter both covariate shifts (e.g., changes in image styles) and semantic shifts (e.g., test-time unseen classes). This highlights the importance of enhancing out-of-distribution (OOD) generalization on covariate shifts and simultaneously detecting semantic-shifted unseen classes. Thus a critical but underexplored question arises: How to improve VL-PTMs' generalization ability to closed-set OOD data, while effectively detecting open-set unseen classes during fine-tuning? In this paper, we propose a novel objective function of OOD detection that also serves to improve OOD generalization. We show that minimizing the gradient magnitude of energy scores on training data leads to domain-consistent Hessians of classification loss, a strong indicator for OOD generalization revealed by theoretical analysis. Based on this finding, we have developed a unified fine-tuning framework that allows for concurrent optimization of both tasks. Extensive experiments have demonstrated the superiority of our method. The code is available at https://github.com/LinLLLL/CRoFT.


title: Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective

abstract: Diffusion models have made rapid progress in generating high-quality samples across various domains. However, a theoretical understanding of the Lipschitz continuity and second momentum properties of the diffusion process is still lacking. In this paper, we bridge this gap by providing a detailed examination of these smoothness properties for the case where the target data distribution is a mixture of Gaussians, which serves as a universal approximator for smooth densities such as image data. We prove that if the target distribution is a $k$-mixture of Gaussians, the density of the entire diffusion process will also be a $k$-mixture of Gaussians. We then derive tight upper bounds on the Lipschitz constant and second momentum that are independent of the number of mixture components $k$. Finally, we apply our analysis to various diffusion solvers, both SDE and ODE based, to establish concrete error guarantees in terms of the total variation distance and KL divergence between the target and learned distributions. Our results provide deeper theoretical insights into the dynamics of the diffusion process under common data distributions.


title: Enhancing Feature Diversity Boosts Channel-Adaptive Vision Transformers

abstract: Multi-Channel Imaging (MCI) contains an array of challenges for encoding useful feature representations not present in traditional images. For example, images from two different satellites may both contain RGB channels, but the remaining channels can be different for each imaging source. Thus, MCI models must support a variety of channel configurations at test time. Recent work has extended traditional visual encoders for MCI, such as Vision Transformers (ViT), by supplementing pixel information with an encoding representing the channel configuration. However, these methods treat each channel equally, i.e., they do not consider the unique properties of each channel type, which can result in needless and potentially harmful redundancies in the learned features. For example, if RGB channels are always present, the other channels can focus on extracting information that cannot be captured by the RGB channels. To this end, we propose DiChaViT, which aims to enhance the diversity in the learned features of MCI-ViT models. This is achieved through a novel channel sampling strategy that encourages the selection of more distinct channel sets for training. Additionally, we employ regularization and initialization techniques to increase the likelihood that new information is learned from each channel. Many of our improvements are architecture agnostic and could be incorporated into new architectures as they are developed. Experiments on both satellite and cell microscopy datasets, CHAMMI, JUMP-CP, and So2Sat, report DiChaViT yields a 1.5-5.0% gain over the state-of-the-art.


title: M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitions

abstract: Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting focus on crucial memories and introducing noise. In this paper, we introduce a multiple partition paradigm for RAG (called M-RAG), where each database partition serves as a basic unit for RAG execution. Based on this paradigm, we propose a novel framework that leverages LLMs with Multi-Agent Reinforcement Learning to optimize different language generation tasks explicitly. Through comprehensive experiments conducted on seven datasets, spanning three language generation tasks and involving three distinct language model architectures, we confirm that M-RAG consistently outperforms various baseline methods, achieving improvements of 11%, 8%, and 12% for text summarization, machine translation, and dialogue generation, respectively.


title: Towards Sustainable IoT: Challenges, Solutions, and Future Directions for Device Longevity

abstract: In an era dominated by the Internet of Things, ensuring the longevity and sustainability of IoT devices has emerged as a pressing concern. This study explores the various complex difficulties which contributed to the early decommissioning of IoT devices and suggests methods to improve their lifespan management. By examining factors such as security vulnerabilities, user awareness gaps, and the influence of fashion-driven technology trends, the paper underscores the need for legislative interventions, consumer education, and industry accountability. Additionally, it explores innovative approaches to improving IoT longevity, including the integration of sustainability considerations into architectural design through requirements engineering methodologies. Furthermore, the paper discusses the potential of distributed ledger technology, or blockchain, to promote transparent and decentralized processes for device provisioning and tracking. This study promotes a sustainable IoT ecosystem by integrating technology innovation, legal change, and social awareness to reduce environmental impact and enhance resilience for the digital future


title: AI-Generated Text Detection and Classification Based on BERT Deep Learning Algorithm

abstract: AI-generated text detection plays an increasingly important role in various fields. In this study, we developed an efficient AI-generated text detection model based on the BERT algorithm, which provides new ideas and methods for solving related problems. In the data preprocessing stage, a series of steps were taken to process the text, including operations such as converting to lowercase, word splitting, removing stop words, stemming extraction, removing digits, and eliminating redundant spaces, to ensure data quality and accuracy. By dividing the dataset into a training set and a test set in the ratio of 60% and 40%, and observing the changes in the accuracy and loss values during the training process, we found that the model performed well during the training process. The accuracy increases steadily from the initial 94.78% to 99.72%, while the loss value decreases from 0.261 to 0.021 and converges gradually, which indicates that the BERT model is able to detect AI-generated text with high accuracy and the prediction results are gradually approaching the real classification results. Further analysis of the results of the training and test sets reveals that in terms of loss value, the average loss of the training set is 0.0565, while the average loss of the test set is 0.0917, showing a slightly higher loss value. As for the accuracy, the average accuracy of the training set reaches 98.1%, while the average accuracy of the test set is 97.71%, which is not much different from each other, indicating that the model has good generalisation ability. In conclusion, the AI-generated text detection model based on the BERT algorithm proposed in this study shows high accuracy and stability in experiments, providing an effective solution for related fields.


title: Energy flux and waveform of gravitational wave generated by coalescing slow-spinning binary system in effective one-body theory

abstract: We extend our research on the energy flux and waveform characteristics of gravitational waves generated by merging nonspinning binary black holes through self-consistent effective one-body theory \cite{L2023} to include binary systems with slowly spinning black holes. Initially, we decompose the equation for the null tetrad component of the gravitationally perturbed Weyl tensor $\psi^B_{4}$ into radial and angular parts, leveraging the second-order approximation of the rotation parameter $a$. Subsequently, we derive an analytical solution for the radial equation and observe that our results are contingent upon the parameters $a_2$, $a_3$ and $a$, which represent the second- and third-order correction parameters, respectively. Ultimately, we calculate the energy flux, the radiation-reaction force and the waveform for the ``plus" and ``cross" modes of the gravitational waves generated by merging slowly spinning binary black holes.


title: Improving Health Professionals' Onboarding with AI and XAI for Trustworthy Human-AI Collaborative Decision Making

abstract: With advanced AI/ML, there has been growing research on explainable AI (XAI) and studies on how humans interact with AI and XAI for effective human-AI collaborative decision-making. However, we still have a lack of understanding of how AI systems and XAI should be first presented to users without technical backgrounds. In this paper, we present the findings of semi-structured interviews with health professionals (n=12) and students (n=4) majoring in medicine and health to study how to improve onboarding with AI and XAI. For the interviews, we built upon human-AI interaction guidelines to create onboarding materials of an AI system for stroke rehabilitation assessment and AI explanations and introduce them to the participants. Our findings reveal that beyond presenting traditional performance metrics on AI, participants desired benchmark information, the practical benefits of AI, and interaction trials to better contextualize AI performance, and refine the objectives and performance of AI. Based on these findings, we highlight directions for improving onboarding with AI and XAI and human-AI collaborative decision-making.


title: Dipolar bosons in a twisted bilayer geometry

abstract: In recent years, twisted bilayer systems such as bilayer graphene have attracted a great deal of attention as the twist angle introduces a degree of freedom which can be used to non-trivially modify system properties. This idea has been picked up in the cold atom community, first with a theoretical proposal to simulate twisted bilayers in state-dependent optical lattices, and, more recently, with an experimental realization of twisted bilayers with bosonic atoms in two different spin states. In this manuscript, we theoretically investigate dipolar bosons in a twisted bilayer geometry. The interplay between dipolar interaction and the twist between the layers results in the emergence of quantum states not observed in the absence of twist. We study how system properties vary as we change the twist angle at fixed distance between the layers and fixed dipolar interaction. We find that at a twist angle $\theta=0.1^{\circ}$, the observed quantum phases are consistent with those seen in the absence of twist angle, i.e. paired superfluid, paired supersolid, and paired solid phases. However, a slight increase in the twist angle to $\theta=0.2^{\circ}$ disrupts these paired phases in favor of a phase separation between checkerboard solid and superfluid regions. Notably, at a twist angle of $\theta=5.21^{\circ}$, the local occupation number follows the moir\'e pattern of the underlying moir\'e bilayers so that a periodic structure of insulating islands is formed. These insulating islands are surrounded by a superfluid.


title: Segmentation of Maya hieroglyphs through fine-tuned foundation models

abstract: The study of Maya hieroglyphic writing unlocks the rich history of cultural and societal knowledge embedded within this ancient civilization's visual narrative. Artificial Intelligence (AI) offers a novel lens through which we can translate these inscriptions, with the potential to allow non-specialists access to reading these texts and to aid in the decipherment of those hieroglyphs which continue to elude comprehensive interpretation. Toward this, we leverage a foundational model to segment Maya hieroglyphs from an open-source digital library dedicated to Maya artifacts. Despite the initial promise of publicly available foundational segmentation models, their effectiveness in accurately segmenting Maya hieroglyphs was initially limited. Addressing this challenge, our study involved the meticulous curation of image and label pairs with the assistance of experts in Maya art and history, enabling the fine-tuning of these foundational models. This process significantly enhanced model performance, illustrating the potential of fine-tuning approaches and the value of our expanding dataset. We plan to open-source this dataset for encouraging future research, and eventually to help make the hieroglyphic texts legible to a broader community, particularly for Maya heritage community members.


title: On the connectivity of the generating and rank graphs of finite groups

abstract: The generating graph encodes how generating pairs are spread among the elements of a group. For more than ten years it has been conjectured that this graph is connected for every finite group. In this paper, we give evidence supporting this conjecture: we prove that it holds for all but a finite number of almost simple groups and give a reduction to groups without non-trivial soluble normal subgroups. Let $d(G)$ be the minimal cardinality of a generating set for $G$. When $d(G)\geq3$, the generating graph is empty and the conjecture is trivially true. We consider it in the more general setting of the rank graph, which encodes how pairs of elements belonging to generating sets of minimal cardinality spread among the elements of a group. It carries information even when $d(G)\geq3$ and corresponds to the generating graph when $d(G)=2$. We prove that it is connected whenever $d(G)\geq3$, giving tools and ideas that may be used to address the original conjecture.


title: Crystal facet orientation and temperature dependence of charge and spin Hall effects in noncollinear antiferromagnet: A first-principles investigation

abstract: Noncollinear antiferromagnets (nc-AFMs) have attracted increasing research attention in spintronics due to their unique spin structures and fascinating charge and spin transport properties. By using first-principles calculations, we comprehensively investigate the charge and spin Hall effects in representative noncollinear antiferromagnet Mn3Pt. Our study reveals that the Hall effects in nc-AFMs are critically dependent on the crystal facet orientation and temperature. For (001) orientated Mn3Pt, each charge and spin Hall conductivity element is comprised of both time reversal odd (T-odd) and even (T-even) contribution, associated with longitudinal conductivity, which leads to sizable and highly anisotropic Hall conductivity. The temperature dependence of charge and spin Hall conductivity has been elucidated by considering both phonon and spin disorder scattering. The scaling relations between Hall conductivity and longitudinal conductivity have also been investigated. The existence of prominent spin Hall effect in nc-AFMs may generate spin current with Sz spin polarization, which is advantageous for field free switching of perpendicular magnetization. Our work may provide unambiguous understanding on the charge and spin transport in noncollinear antiferromagnets and pave their way for applications in antiferromagnetic spintronics.


title: On a Generalized Moment Integral containing Riemann's Zeta Function: Analysis and Experiment

abstract: Here, we study both analytically and numerically, an integral $Z(\sigma,r)$ related to the mean value of a generalized moment of Riemann's zeta function. Analytically, we predict finite, but discontinuous values and verify the prediction numerically, employing a modified form of Ces\`aro summation. Further, it is proven and verified numerically that for certain values of $\sigma$, the derivative function $Z^{\prime}(\sigma,n)$ equates to one generalized tine of the Dirac comb function without recourse to the use of limits, test functions or distributions. A surprising outcome of the numerical study arises from the observation that the proper integral form of the derivative function is quasi-periodic, which in turn suggests a periodicity of the integrand. This possibility is also explored and it is found experimentally that zeta function values offset (shifted) over certain segments of the imaginary complex number line are moderately auto-correlated.


title: GAMEOPT+: Improving Fuel Efficiency in Unregulated Heterogeneous Traffic Intersections via Optimal Multi-agent Cooperative Control

abstract: Better fuel efficiency leads to better financial security as well as a cleaner environment. We propose a novel approach for improving fuel efficiency in unstructured and unregulated traffic environments. Existing intelligent transportation solutions for improving fuel efficiency, however, apply only to traffic intersections with sparse traffic or traffic where drivers obey the regulations, or both. We propose GameOpt+, a novel hybrid approach for cooperative intersection control in dynamic, multi-lane, unsignalized intersections. GameOpt+ is a hybrid solution that combines an auction mechanism and an optimization-based trajectory planner. It generates a priority entrance sequence for each agent and computes velocity controls in real-time, taking less than 10 milliseconds even in high-density traffic with over 10,000 vehicles per hour. Compared to fully optimization-based methods, it operates 100 times faster while ensuring fairness, safety, and efficiency. Tested on the SUMO simulator, our algorithm improves throughput by at least 25%, reduces the time to reach the goal by at least 70%, and decreases fuel consumption by 50% compared to auction-based and signaled approaches using traffic lights and stop signs. GameOpt+ is also unaffected by unbalanced traffic inflows, whereas some of the other baselines encountered a decrease in performance in unbalanced traffic inflow environments.


title: Monte-Carlo Study Of Higher-Order Cumulants of Net-Particle Distributions in $p+p$ Collisions at $\sqrt{s}$ = 13 TeV

abstract: Measurement of higher order cumulants of the distributions of conserved quantities, like net-charge, net-baryon and net-strangeness in heavy-ion collisions, is proposed as a sensitive tool to determine the freeze-out parameters and the nature of phase transitions at the LHC energies. Baseline measurements for heavy-ion collisions are essential to understand the experimental measurements. Recently, several experimental observations have shown some QGP-like scenarios in small systems (pp collisions). We report the first Monte-Carlo study of the measurements of cumulants and their ratios for net-charge, net-hadron, net-kaon, net-baryon, and net-proton distributions in pp collisions at $\sqrt{s}$=13 TeV using pQCD models like Pythia8 and Herwig. We also discuss the effect of different particle production mechanisms on the higher-order cumulants. This simulation study will serve as a baseline for future measurements at the LHC. Furthermore, it will shed more light on the measurement of cumulants and the connection between small systems and heavy-ion collisions at the LHC.


title: Revealing the hidden Dirac gap in a topological antiferromagnet using Floquet-Bloch manipulation

abstract: Manipulating solids using the time-periodic drive of a laser pulse is a promising route to generate new phases of matter. Whether such `Floquet-Bloch' manipulation can be achieved in topological magnetic systems with disorder has so far been unclear. In this work, we realize Floquet-Bloch manipulation of the Dirac surface-state mass of the topological antiferromagnet (AFM) MnBi$_2$Te$_4$. Using time- and angle-resolved photoemission spectroscopy (tr-ARPES), we show that opposite helicities of mid-infrared circularly polarized light result in substantially different Dirac mass gaps in the AFM phase, despite the equilibrium Dirac cone being massless. We explain our findings in terms of a Dirac fermion with a random mass. Our results underscore Floquet-Bloch manipulation as a powerful tool for controlling topology even in the presence of disorder, and for uncovering properties of materials that may elude conventional probes.


title: CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling

abstract: Using large language models (LLMs) to assist psychological counseling is a significant but challenging task at present. Attempts have been made on improving empathetic conversations or acting as effective assistants in the treatment with LLMs. However, the existing datasets lack consulting knowledge, resulting in LLMs lacking professional consulting competence. Moreover, how to automatically evaluate multi-turn dialogues within the counseling process remains an understudied area. To bridge the gap, we propose CPsyCoun, a report-based multi-turn dialogue reconstruction and evaluation framework for Chinese psychological counseling. To fully exploit psychological counseling reports, a two-phase approach is devised to construct high-quality dialogues while a comprehensive evaluation benchmark is developed for the effective automatic evaluation of multi-turn psychological consultations. Competitive experimental results demonstrate the effectiveness of our proposed framework in psychological counseling. We open-source the datasets and model for future research at https://github.com/CAS-SIAT-XinHai/CPsyCoun


title: The Importance of Directional Feedback for LLM-based Optimizers

abstract: We study the potential of using large language models (LLMs) as an interactive optimizer for solving maximization problems in a text space using natural language and numerical feedback. Inspired by the classical optimization literature, we classify the natural language feedback into directional and non-directional, where the former is a generalization of the first-order feedback to the natural language space. We find that LLMs are especially capable of optimization when they are provided with {directional feedback}. Based on this insight, we design a new LLM-based optimizer that synthesizes directional feedback from the historical optimization trace to achieve reliable improvement over iterations. Empirically, we show our LLM-based optimizer is more stable and efficient in solving optimization problems, from maximizing mathematical functions to optimizing prompts for writing poems, compared with existing techniques.


title: Structure-aware Semantic Node Identifiers for Learning on Graphs

abstract: We present a novel graph tokenization framework that generates structure-aware, semantic node identifiers (IDs) in the form of a short sequence of discrete codes, serving as symbolic representations of nodes. We employs vector quantization to compress continuous node embeddings from multiple layers of a graph neural network (GNN), into compact, meaningful codes, under both self-supervised and supervised learning paradigms. The resulting node IDs capture a high-level abstraction of graph data, enhancing the efficiency and interpretability of GNNs. Through extensive experiments on 34 datasets, including node classification, graph classification, link prediction, and attributed graph clustering tasks, we demonstrate that our generated node IDs not only improve computational efficiency but also achieve competitive performance compared to current state-of-the-art methods.


title: Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer

abstract: Aligning generative models with human preference via RLHF typically suffers from overoptimization, where an imperfectly learned reward model can misguide the generative model to output undesired responses. We investigate this problem in a principled manner by identifying the source of the misalignment as a form of distributional shift and uncertainty in learning human preferences. To mitigate overoptimization, we first propose a theoretical algorithm that chooses the best policy for an adversarially chosen reward model; one that simultaneously minimizes the maximum likelihood estimation of the loss and a reward penalty term. Here, the reward penalty term is introduced to prevent the policy from choosing actions with spurious high proxy rewards, resulting in provable sample efficiency of the algorithm under a partial coverage style condition. Moving from theory to practice, the proposed algorithm further enjoys an equivalent but surprisingly easy-to-implement reformulation. Using the equivalence between reward models and the corresponding optimal policy, the algorithm features a simple objective that combines: (i) a preference optimization loss that directly aligns the policy with human preference, and (ii) a supervised learning loss that explicitly imitates the policy with a (suitable) baseline distribution. In the context of aligning large language models (LLM), this objective fuses the direct preference optimization (DPO) loss with the supervised fune-tuning (SFT) loss to help mitigate the overoptimization towards undesired responses, for which we name the algorithm Regularized Preference Optimization (RPO). Experiments of aligning LLMs demonstrate the improved performance of RPO compared with DPO baselines. Our work sheds light on the interplay between preference optimization and SFT in tuning LLMs with both theoretical guarantees and empirical evidence.


title: Incremental Pseudo-Labeling for Black-Box Unsupervised Domain Adaptation

abstract: Black-Box unsupervised domain adaptation (BBUDA) learns knowledge only with the prediction of target data from the source model without access to the source data and source model, which attempts to alleviate concerns about the privacy and security of data. However, incorrect pseudo-labels are prevalent in the prediction generated by the source model due to the cross-domain discrepancy, which may substantially degrade the performance of the target model. To address this problem, we propose a novel approach that incrementally selects high-confidence pseudo-labels to improve the generalization ability of the target model. Specifically, we first generate pseudo-labels using a source model and train a crude target model by a vanilla BBUDA method. Second, we iteratively select high-confidence data from the low-confidence data pool by thresholding the softmax probabilities, prototype labels, and intra-class similarity. Then, we iteratively train a stronger target network based on the crude target model to correct the wrongly labeled samples to improve the accuracy of the pseudo-label. Experimental results demonstrate that the proposed method achieves state-of-the-art black-box unsupervised domain adaptation performance on three benchmark datasets.


title: Analysis of Cosmic Evolution admitting Garcia-Salcedo Ghost and Generalized Ghost Dark Energy Models

abstract: This study aims to explore the Garcia-Salcedo ghost dark energy and generalized ghost dark energy models in the context of $f(\mathrm{R},\mathrm{T^2})$ theory, where $\mathrm{R}$ is the Ricci scalar and $\mathrm{T^2}$ is the self-contraction of stress-energy tensor. We investigate the non-interacting case only corresponding to flat Friedmann-Robertson-Walker universe. We reconstruct the corresponding $f(\mathrm{R},\mathrm{T^2})$ gravity models using the considered dark energy models by taking two particular models of this gravity. The stability analysis is performed for all the cases. The behavior of the equation of state parameter is also checked. It is found that some of the reconstructed $f(\mathrm{R},\mathrm{T^2})$ models successfully describe both the phantom and quintessence epochs of the universe, which support the current cosmic accelerated expansion. This exploration reveals the intricate connections between dark energy models and modified gravitational theory, providing significant understanding into the dynamics of the cosmos on a large scale.


title: Towards Imitation Learning in Real World Unstructured Social Mini-Games in Pedestrian Crowds

abstract: Imitation Learning (IL) strategies are used to generate policies for robot motion planning and navigation by learning from human trajectories. Recently, there has been a lot of excitement in applying IL in social interactions arising in urban environments such as university campuses, restaurants, grocery stores, and hospitals. However, obtaining numerous expert demonstrations in social settings might be expensive, risky, or even impossible. Current approaches therefore, focus only on simulated social interaction scenarios. This raises the question: \textit{How can a robot learn to imitate an expert demonstrator from real world multi-agent social interaction scenarios}? It remains unknown which, if any, IL methods perform well and what assumptions they require. We benchmark representative IL methods in real world social interaction scenarios on a motion planning task, using a novel pedestrian intersection dataset collected at the University of Texas at Austin campus. Our evaluation reveals two key findings: first, learning multi-agent cost functions is required for learning the diverse behavior modes of agents in tightly coupled interactions and second, conditioning the training of IL methods on partial state information or providing global information in simulation can improve imitation learning, especially in real world social interaction scenarios.


title: MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting

abstract: In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state space models (SSMs), has emerged as a competitive alternative to Transformer, offering comparable performance with higher throughput and linear complexity related to sequence length. In this study, we analyze the limitations of current Mamba in LTSF and propose four targeted improvements, leading to MambaTS. We first introduce variable scan along time to arrange the historical information of all the variables together. We suggest that causal convolution in Mamba is not necessary for LTSF and propose the Temporal Mamba Block (TMB). We further incorporate a dropout mechanism for selective parameters of TMB to mitigate model overfitting. Moreover, we tackle the issue of variable scan order sensitivity by introducing variable permutation training. We further propose variable-aware scan along time to dynamically discover variable relationships during training and decode the optimal variable scan order by solving the shortest path visiting all nodes problem during inference. Extensive experiments conducted on eight public datasets demonstrate that MambaTS achieves new state-of-the-art performance.


title: Categorical Flow Matching on Statistical Manifolds

abstract: We introduce Statistical Flow Matching (SFM), a novel and mathematically rigorous flow-matching framework on the manifold of parameterized probability measures inspired by the results from information geometry. We demonstrate the effectiveness of our method on the discrete generation problem by instantiating SFM on the manifold of categorical distributions whose geometric properties remain unexplored in previous discrete generative models. Utilizing the Fisher information metric, we equip the manifold with a Riemannian structure whose intrinsic geometries are effectively leveraged by following the shortest paths of geodesics. We develop an efficient training and sampling algorithm that overcomes numerical stability issues with a diffeomorphism between manifolds. Our distinctive geometric perspective of statistical manifolds allows us to apply optimal transport during training and interpret SFM as following the steepest direction of the natural gradient. Unlike previous models that rely on variational bounds for likelihood estimation, SFM enjoys the exact likelihood calculation for arbitrary probability measures. We manifest that SFM can learn more complex patterns on the statistical manifold where existing models often fail due to strong prior assumptions. Comprehensive experiments on real-world generative tasks ranging from image, text to biological domains further demonstrate that SFM achieves higher sampling quality and likelihood than other discrete diffusion or flow-based models.


title: Development of an open education resources (OER) system: a comparative analysis and implementation approach

abstract: Several institutions are collaborating on the development of a new web-based Open Education Resources (OER) system designed exclusively for non-commercial educational purposes. This initiative is underpinned by meticulous research aimed at constructing an OER system that optimizes user experiences across diverse user profiles. A significant emphasis is placed on utilizing open-source tools, frameworks, and technologies. The project includes a comparative analysis of the top five open-source Learning Management Systems (LMS), providing critical insights to inform the development process. The primary objective is to create a web-based system that facilitates the sharing of educational resources for non-commercial users, leveraging information and communication technologies. The project is structured around two key teams: a research team and a development team. This comprehensive approach is intended to establish a robust, user-centric OER system, informed by insights from existing platforms and the latest advancements in open education resource development.


title: 3D View Optimization for Improving Image Aesthetics

abstract: Achieving aesthetically pleasing photography necessitates attention to multiple factors, including composition and capture conditions, which pose challenges to novices. Prior research has explored the enhancement of photo aesthetics post-capture through 2D manipulation techniques; however, these approaches offer limited search space for aesthetics. We introduce a pioneering method that employs 3D operations to simulate the conditions at the moment of capture retrospectively. Our approach extrapolates the input image and then reconstructs the 3D scene from the extrapolated image, followed by an optimization to identify camera parameters and image aspect ratios that yield the best 3D view with enhanced aesthetics. Comparative qualitative and quantitative assessments reveal that our method surpasses traditional 2D editing techniques with superior aesthetics.


title: CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion

abstract: Large language models (LLMs) often incorporate multiple text chunks in their inputs to provide the necessary contexts. To speed up the prefill of the long LLM inputs, one can pre-compute the KV cache of a text and re-use the KV cache when the context is reused as the prefix of another LLM input. However, the reused text chunks are not always the input prefix, and when they are not, their precomputed KV caches cannot be directly used since they ignore the text's cross-attention with the preceding text in the LLM input. Thus, the benefits of reusing KV caches remain largely unrealized. This paper tackles just one question: when an LLM input contains multiple text chunks, how to quickly combine their precomputed KV caches in order to achieve the same generation quality as the expensive full prefill (i.e., without reusing KV cache)? We present CacheBlend, a scheme that reuses the pre-computed KV caches, regardless prefix or not, and selectively recomputes the KV values of a small subset of tokens to partially update each reused KV cache. In the meantime,the small extra delay for recomputing some tokens can be pipelined with the retrieval of KV caches within the same job,allowing CacheBlend to store KV caches in slower devices with more storage capacity while retrieving them without increasing the inference delay. By comparing CacheBlend with the state-of-the-art KV cache reusing schemes on three open-source LLMs of various sizes and four popular benchmark datasets of different tasks, we show that CacheBlend reduces time-to-first-token (TTFT) by 2.2-3.3X and increases the inference throughput by 2.8-5X, compared with full KV recompute, without compromising generation quality or incurring more storage cost.


title: Robotic Path Planning Implementation using Search Algorithms

abstract: Till now, many path planning algorithms have been proposed in the literature. The objective of these algorithms is to find the quickest path between initial position to the end position in a certain environment. The complexity of these algorithms depends on the internal parameters such as motor speed or sensor range and on other external parameters, including the accuracy of the map, size of the environment, and the number of obstacles. In this paper, we are giving information about how path planning algorithm finds the optimal path in an uneven terrain with a multiple obstacle using TurtleBot3 robot into the Gazebo environment using Dijkstra's and A(star).


title: A New Solution for MU-MISO Symbol-Level Precoding: Extrapolation and Deep Unfolding

abstract: Constructive interference (CI) precoding, which converts the harmful multi-user interference into beneficial signals, is a promising and efficient interference management scheme in multi-antenna communication systems. However, CI-based symbol-level precoding (SLP) experiences high computational complexity as the number of symbol slots increases within a transmission block, rendering it unaffordable in practical communication systems. In this paper, we propose a symbol-level extrapolation (SLE) strategy to extrapolate the precoding matrix by leveraging the relationship between different symbol slots within in a transmission block, during which the channel state information (CSI) remains constant, where we design a closed-form iterative algorithm based on SLE for both PSK and QAM modulation. In order to further reduce the computational complexity, a sub-optimal closed-form solution based on SLE is further developed for PSK and QAM, respectively. Moreover, we design an unsupervised SLE-based neural network (SLE-Net) to unfold the proposed iterative algorithm, which helps enhance the interpretability of the neural network. By carefully designing the loss function of the SLE-Net, the time-complexity of the network can be reduced effectively. Extensive simulation results illustrate that the proposed algorithms can dramatically reduce the computational complexity and time complexity with only marginal performance loss, compared with the conventional SLP design methods.


title: Fast Asymmetric Factorization for Large Scale Multiple Kernel Clustering

abstract: Kernel methods are extensively employed for nonlinear data clustering, yet their effectiveness heavily relies on selecting suitable kernels and associated parameters, posing challenges in advance determination. In response, Multiple Kernel Clustering (MKC) has emerged as a solution, allowing the fusion of information from multiple base kernels for clustering. However, both early fusion and late fusion methods for large-scale MKC encounter challenges in memory and time constraints, necessitating simultaneous optimization of both aspects. To address this issue, we propose Efficient Multiple Kernel Concept Factorization (EMKCF), which constructs a new sparse kernel matrix inspired by local regression to achieve memory efficiency. EMKCF learns consensus and individual representations by extending orthogonal concept factorization to handle multiple kernels for time efficiency. Experimental results demonstrate the efficiency and effectiveness of EMKCF on benchmark datasets compared to state-of-the-art methods. The proposed method offers a straightforward, scalable, and effective solution for large-scale MKC tasks.


title: Understanding of linear operators through Wigner analysis

abstract: In this work, we extend Wigner's original framework to analyze linear operators by examining the relationship between their Wigner and Schwartz kernels. Our approach includes the introduction of (quasi-)algebras of Fourier integral operators (FIOs), which encompass FIOs of type I and II. The symbols of these operators reside in (weighted) modulation spaces, particularly in Sj\"ostrand's class, known for its favorable properties in time-frequency analysis. One of the significant results of our study is demonstrating the inverse-closedness of these symbol classes. Our analysis includes fundamental examples such as pseudodifferential operators and Fourier integral operators related to Schr{\"o}dinger-type equations. These examples typically feature classical Hamiltonian flows governed by linear symplectic transformations $S \in Sp(d, \mathbb{R})$. The core idea of our approach is to utilize the Wigner kernel to transform a Fourier integral operator $ T $ on $ \mathbb{R}^d $ into a pseudodifferential operator $ K$ on $ \mathbb{R}^{2d}$. This transformation involves a symbol $\sigma$ well-localized around the manifold defined by $ z = S w $.


title: Reinforcement Learning for Jump-Diffusions

abstract: We study continuous-time reinforcement learning (RL) for stochastic control in which system dynamics are governed by jump-diffusion processes. We formulate an entropy-regularized exploratory control problem with stochastic policies to capture the exploration--exploitation balance essential for RL. Unlike the pure diffusion case initially studied by Wang et al. (2020), the derivation of the exploratory dynamics under jump-diffusions calls for a careful formulation of the jump part. Through a theoretical analysis, we find that one can simply use the same policy evaluation and q-learning algorithms in Jia and Zhou (2022a, 2023), originally developed for controlled diffusions, without needing to check a priori whether the underlying data come from a pure diffusion or a jump-diffusion. However, we show that the presence of jumps ought to affect parameterizations of actors and critics in general. Finally, we investigate as an application the mean-variance portfolio selection problem with stock price modelled as a jump-diffusion, and show that both RL algorithms and parameterizations are invariant with respect to jumps.


title: Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search

abstract: Programmatic reinforcement learning (PRL) has been explored for representing policies through programs as a means to achieve interpretability and generalization. Despite promising outcomes, current state-of-the-art PRL methods are hindered by sample inefficiency, necessitating tens of millions of program-environment interactions. To tackle this challenge, we introduce a novel LLM-guided search framework (LLM-GS). Our key insight is to leverage the programming expertise and common sense reasoning of LLMs to enhance the efficiency of assumption-free, random-guessing search methods. We address the challenge of LLMs' inability to generate precise and grammatically correct programs in domain-specific languages (DSLs) by proposing a Pythonic-DSL strategy - an LLM is instructed to initially generate Python codes and then convert them into DSL programs. To further optimize the LLM-generated programs, we develop a search algorithm named Scheduled Hill Climbing, designed to efficiently explore the programmatic search space to consistently improve the programs. Experimental results in the Karel domain demonstrate the superior effectiveness and efficiency of our LLM-GS framework. Extensive ablation studies further verify the critical role of our Pythonic-DSL strategy and Scheduled Hill Climbing algorithm.


title: From Macro to Micro: Boosting micro-expression recognition via pre-training on macro-expression videos

abstract: Micro-expression recognition (MER) has drawn increasing attention in recent years due to its potential applications in intelligent medical and lie detection. However, the shortage of annotated data has been the major obstacle to further improve deep-learning based MER methods. Intuitively, utilizing sufficient macro-expression data to promote MER performance seems to be a feasible solution. However, the facial patterns of macro-expressions and micro-expressions are significantly different, which makes naive transfer learning methods difficult to deploy directly. To tacle this issue, we propose a generalized transfer learning paradigm, called \textbf{MA}cro-expression \textbf{TO} \textbf{MI}cro-expression (MA2MI). Under our paradigm, networks can learns the ability to represent subtle facial movement by reconstructing future frames. In addition, we also propose a two-branch micro-action network (MIACNet) to decouple facial position features and facial action features, which can help the network more accurately locate facial action locations. Extensive experiments on three popular MER benchmarks demonstrate the superiority of our method.


title: Triangle-free triple systems

abstract: There are four non-isomorphic configurations of triples that can form a triangle in a $3$-uniform hypergraph. Forbidding different combinations of these four configurations, fifteen extremal problems can be defined, several of which already appeared in the literature in some different context. Here we systematically study all of these problems solving the new cases exactly or asymptotically. In many cases we also characterize the extremal constructions.


title: A Slices Perspective for Incremental Nonparametric Inference in High Dimensional State Spaces

abstract: We introduce an innovative method for incremental nonparametric probabilistic inference in high-dimensional state spaces. Our approach leverages \slices from high-dimensional surfaces to efficiently approximate posterior distributions of any shape. Unlike many existing graph-based methods, our \slices perspective eliminates the need for additional intermediate reconstructions, maintaining a more accurate representation of posterior distributions. Additionally, we propose a novel heuristic to balance between accuracy and efficiency, enabling real-time operation in nonparametric scenarios. In empirical evaluations on synthetic and real-world datasets, our \slices approach consistently outperforms other state-of-the-art methods. It demonstrates superior accuracy and achieves a significant reduction in computational complexity, often by an order of magnitude.


title: Cross-Matching of OGLE, GAIA, and Hubble Catalogs: Evaluating the Probability of Resolving Lens Stars in Microlensing Events

abstract: This study commenced by cross-matching data from the GAIA and OGLE telescopes with the aim of resolving the source star, long after microlensing is finished. The aim is breaking degeneracy between parameters of the microlensing equation, and ultimately calculating the mass of lens. We have examined different catalogs and found no evidence. Subsequently, employing the Monte Carlo method and guided by sensible assumptions, we embarked a simulation to discern the distribution of angular separation and to probe the feasibility of detecting this phenomenon. The results revealed that a mere 0.029% of gravitational microlensing events exhibited separations exceeding 50 milliarcseconds. Consequently, the likelihood of observing this phenomenon utilizing the OGLE and GAIA telescopes appears exceedingly far available. However, it is worth noting that instruments with very high angular resolution in the range of several tens of milliarcseconds present a viable avenue for such observations. Finally, we proposed 60 microlensing events for which the observation of separation is more probable based on the measured proper velocity.

categories: astro-ph.IM astro-ph.GA astro-ph.SR gr-qc


title: On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization

abstract: Accurately aligning large language models (LLMs) with human preferences is crucial for informing fair, economically sound, and statistically efficient decision-making processes. However, we argue that reinforcement learning from human feedback (RLHF) -- the predominant approach for aligning LLMs with human preferences through a reward model -- suffers from an inherent algorithmic bias due to its Kullback--Leibler-based regularization in optimization. In extreme cases, this bias could lead to a phenomenon we term preference collapse, where minority preferences are virtually disregarded. To mitigate this algorithmic bias, we introduce preference matching (PM) RLHF, a novel approach that provably aligns LLMs with the preference distribution of the reward model under the Bradley--Terry--Luce/Plackett--Luce model. Central to our approach is a PM regularizer that takes the form of the negative logarithm of the LLM's policy probability distribution over responses, which helps the LLM balance response diversification and reward maximization. Notably, we obtain this regularizer by solving an ordinary differential equation that is necessary for the PM property. For practical implementation, we introduce a conditional variant of PM RLHF that is tailored to natural language generation. Finally, we empirically validate the effectiveness of conditional PM RLHF through experiments on the OPT-1.3B and Llama-2-7B models, demonstrating a 29% to 41% improvement in alignment with human preferences, as measured by a certain metric, compared to standard RLHF.


title: Dominant Shuffle: A Simple Yet Powerful Data Augmentation for Time-series Prediction

abstract: Recent studies have suggested frequency-domain Data augmentation (DA) is effec tive for time series prediction. Existing frequency-domain augmentations disturb the original data with various full-spectrum noises, leading to excess domain gap between augmented and original data. Although impressive performance has been achieved in certain cases, frequency-domain DA has yet to be generalized to time series prediction datasets. In this paper, we found that frequency-domain augmentations can be significantly improved by two modifications that limit the perturbations. First, we found that limiting the perturbation to only dominant frequencies significantly outperforms full-spectrum perturbations. Dominant fre quencies represent the main periodicity and trends of the signal and are more important than other frequencies. Second, we found that simply shuffling the dominant frequency components is superior over sophisticated designed random perturbations. Shuffle rearranges the original components (magnitudes and phases) and limits the external noise. With these two modifications, we proposed dominant shuffle, a simple yet effective data augmentation for time series prediction. Our method is very simple yet powerful and can be implemented with just a few lines of code. Extensive experiments with eight datasets and six popular time series models demonstrate that our method consistently improves the baseline performance under various settings and significantly outperforms other DA methods. Code can be accessed at https://kaizhao.net/time-series.


title: Entanglement island and Page curve for one-sided charged black hole

abstract: In this paper, we extend the method of calculating the entanglement entropy of Hawking radiation of black holes using the "in" vacuum state, which describes one-sided asymptotically flat neutral black hole formed by gravitational collapse, to dynamic charged black holes. We explore the influence of charge on the position of the boundary of island $\partial I$ and the Page time. Due to their distinct geometric structures, we discuss non-extremal and extremal charged black holes separately. In non-extremal cases, the emergence of island saves the bound of entropy at late times, and the entanglement entropy of Hawking radiation satisfies the Page curve. Moreover, we also find that the position of the boundary of island $\partial I$ depends on the position of the cutoff surface (observers), differing from the behavior in eternal charged black holes. In extremal black holes, when the island exists, the entanglement entropy is approximately equal to the Bekenstein-Hawking entropy, while the entanglement entropy becomes ill-defined when island is absent. Our analysis underscores how different geometric configurations significantly influence the behavior of entropy.


title: Comparing experiments in discounted problems

abstract: This paper compares statistical experiments in discounted problems, ranging from the simplest ones where the state is fixed and the flow of information exogenous to more complex ones, where the decision-maker controls the flow of information or the state changes over time.


title: Pattern formation in three-state systems: Towards understanding morphology formation in the presence of evaporation

abstract: Inspired by experimental evidence collected when processing thin films from ternary solutions made of two solutes, typically polymers, and one solvent, we computationally study the morphology formation of domains obtained in three-state systems using both a lattice model and a continuum counterpart. The lattice-based approach relies on the Blume-Capel nearest neighbor model with bulk conservative Kawasaki dynamics, whereas as continuum system we consider a coupled system of evolution equations that is derived as hydrodynamic limit when replacing the nearest neighbor interaction in the lattice case by a suitable Kac potential. We explore how the obtained morphology depends on the solvent content in the mixture. In particular, we study how these scenarios change when the solvent is allowed to evaporate.


title: Probabilistic Contrastive Learning with Explicit Concentration on the Hypersphere

abstract: Self-supervised contrastive learning has predominantly adopted deterministic methods, which are not suited for environments characterized by uncertainty and noise. This paper introduces a new perspective on incorporating uncertainty into contrastive learning by embedding representations within a spherical space, inspired by the von Mises-Fisher distribution (vMF). We introduce an unnormalized form of vMF and leverage the concentration parameter, kappa, as a direct, interpretable measure to quantify uncertainty explicitly. This approach not only provides a probabilistic interpretation of the embedding space but also offers a method to calibrate model confidence against varying levels of data corruption and characteristics. Our empirical results demonstrate that the estimated concentration parameter correlates strongly with the degree of unforeseen data corruption encountered at test time, enables failure analysis, and enhances existing out-of-distribution detection methods.


title: On the rate of convergence in the Hall-Janson coverage theorem

abstract: Consider a spherical Poisson Boolean model $Z$ in Euclidean $d$-space with $d \geq 2$, with Poisson intensity $t$ and radii distributed like $rY$ with $r \geq 0$ a scaling parameter and $Y$ a fixed nonnegative random variable with finite $(2d-2)$-nd moment (or if $d=2$, a finite $(2 + \varepsilon)$-moment condition for some $\varepsilon >0$). Let $A \subset {\bf R}^d$ be compact with a nice boundary. Let $\alpha $ be the expected volume of a ball of radius $Y$, and suppose $r=r(t)$ is chosen so that $\alpha t r^d - \log t - (d-1) \log \log t$ is a constant independent of $t$. A classical result of Hall and of Janson determines the (non-trivial) large-$t$ limit of the probability that $A$ is fully covered by $Z$. In this paper we provide an $O((\log \log t)/\log t)$ bound on the rate of convergence in that result. With a slight adjustment to $r(t)$, this can be improved to $O(1/\log t)$.


title: Global and local existence of solutions for nonlinear systems of time-fractional diffusion equations

abstract: In this paper, we consider initial-boundary value problems for two-component nonlinear systems of time-fractional diffusion equations with the homogeneous Neumann boundary condition and non-negative initial values. The main results are the existence of solutions global in time and the blow-up. Our approach involves the truncation of the nonlinear terms, which enables us to handle all local Lipschitz continuous nonlinear terms, provided their sum is less than or equal to zero. By employing a comparison principle for the corresponding linear system, we establish also the non-negativity of the nonlinear system.


title: InfoMat: A Tool for the Analysis and Visualization Sequential Information Transfer

abstract: Despite the popularity of information measures in analysis of probabilistic systems, proper tools for their visualization are not common. This work develops a simple matrix representation of information transfer in sequential systems, termed information matrix (InfoMat). The simplicity of the InfoMat provides a new visual perspective on existing decomposition formulas of mutual information, and enables us to prove new relations between sequential information theoretic measures. We study various estimation schemes of the InfoMat, facilitating the visualization of information transfer in sequential datasets. By drawing a connection between visual patterns in the InfoMat and various dependence structures, we observe how information transfer evolves in the dataset. We then leverage this tool to visualize the effect of capacity-achieving coding schemes on the underlying exchange of information. We believe the InfoMat is applicable to any time-series task for a better understanding of the data at hand.


title: Multi-Modal UAV Detection, Classification and Tracking Algorithm -- Technical Report for CVPR 2024 UG2 Challenge

abstract: This technical report presents the 1st winning model for UG2+, a task in CVPR 2024 UAV Tracking and Pose-Estimation Challenge. This challenge faces difficulties in drone detection, UAV-type classification and 2D/3D trajectory estimation in extreme weather conditions with multi-modal sensor information, including stereo vision, various Lidars, Radars, and audio arrays. Leveraging this information, we propose a multi-modal UAV detection, classification, and 3D tracking method for accurate UAV classification and tracking. A novel classification pipeline which incorporates sequence fusion, region of interest (ROI) cropping, and keyframe selection is proposed. Our system integrates cutting-edge classification techniques and sophisticated post-processing steps to boost accuracy and robustness. The designed pose estimation pipeline incorporates three modules: dynamic points analysis, a multi-object tracker, and trajectory completion techniques. Extensive experiments have validated the effectiveness and precision of our approach. In addition, we also propose a novel dataset pre-processing method and conduct a comprehensive ablation study for our design. We finally achieved the best performance in the classification and tracking of the MMUAD dataset. The code and configuration of our method are available at https://github.com/dtc111111/Multi-Modal-UAV.


title: An Optical Daytime Astronomy Pathfinder for the Huntsman Telescope

abstract: Observing stars and satellites in optical wavelengths during the day (optical daytime astronomy) has begun a resurgence of interest. The recent dramatic dimming event of Betelgeuse has spurred interest in continuous monitoring of the brightest variable stars, even when an object is only visible during the day due to their proximity to the Sun. In addition, an exponential increase in the number of satellites being launched into low Earth orbit in recent years has driven an interest in optical daytime astronomy for the detection and monitoring of satellites in space situational awareness (SSA) networks. In this paper we explore the use of the Huntsman Telescope as an optical daytime astronomy facility, by conducting an exploratory survey using a pathfinder instrument. We find that an absolute photometric accuracy between 1 - 10% can be achieved during the day, with a detection limit of V band 4.6 mag at midday in sloan g and r wavelengths. In addition we characterise the daytime sky brightness, colour and observing conditions in order to achieve the most reliable and highest signal-to-noise observations within the limitations of the bright sky background. We undertake a 7 month survey of the brightness of Betelgeuse during the day and demonstrate that our results are in agreement with measurements from other observatories. Finally we present our preliminary results that demonstrate obtaining absolute photometric measurements of the International Space Station during the day.


title: High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost

abstract: Multi-timestep simulation of brain-inspired Spiking Neural Networks (SNNs) boost memory requirements during training and increase inference energy cost. Current training methods cannot simultaneously solve both training and inference dilemmas. This work proposes a novel Temporal Reversible architecture for SNNs (T-RevSNN) to jointly address the training and inference challenges by altering the forward propagation of SNNs. We turn off the temporal dynamics of most spiking neurons and design multi-level temporal reversible interactions at temporal turn-on spiking neurons, resulting in a $O(L)$ training memory. Combined with the temporal reversible nature, we redesign the input encoding and network organization of SNNs to achieve $O(1)$ inference energy cost. Then, we finely adjust the internal units and residual connections of the basic SNN block to ensure the effectiveness of sparse temporal information interaction. T-RevSNN achieves excellent accuracy on ImageNet, while the memory efficiency, training time acceleration, and inference energy efficiency can be significantly improved by $8.6 \times$, $2.0 \times$, and $1.6 \times$, respectively. This work is expected to break the technical bottleneck of significantly increasing memory cost and training time for large-scale SNNs while maintaining high performance and low inference energy cost. Source code and models are available at: https://github.com/BICLab/T-RevSNN.


title: Two-way fixed effects instrumental variable regressions in staggered DID-IV designs

abstract: Many studies run two-way fixed effects instrumental variable (TWFEIV) regressions, leveraging variation in the timing of policy adoption across units as an instrument for treatment. This paper studies the properties of the TWFEIV estimator in staggered instrumented difference-in-differences (DID-IV) designs. We show that in settings with the staggered adoption of the instrument across units, the TWFEIV estimator can be decomposed into a weighted average of all possible two-group/two-period Wald-DID estimators. Under staggered DID-IV designs, a causal interpretation of the TWFEIV estimand hinges on the stable effects of the instrument on the treatment and the outcome over time. We illustrate the use of our decomposition theorem for the TWFEIV estimator through an empirical application.


title: Module-theoretic approach to dualizable Grothendieck categories

abstract: We prove that every dualizable Grothendieck category whose dual is again a Grothendieck category satisfies Grothendieck's conditions Ab6 and Ab4*, by taking a module-theoretic approach based on the Gabriel-Popescu embedding. Combining this with a result by Stefanich, we conclude that the class of dualizable linear cocomplete categories is precisely the class of linear Grothendieck category satisfying Ab6 and Ab4*. This provides a complete answer to a modified conjecture on the dualizability, originally posed by Brandenburg, Chirvasitu, and Johnson-Freyd.


title: On Correlation Coefficients

abstract: In the present paper, we discuss the Pearson, Spearman, Kendall correlation coefficients and their statistical analogues. We propose a new correlation coefficient r and its statistical analogue. The coefficient r is based on Kendal's and Spearman's correlation coefficients. A new extension of the Pearson correlation coefficient is also discussed. We conduct simulation experiments and study the behavior of the above correlation coefficients. We observe that the behavior of Pearson's sample correlation coefficient can be very different from the behavior of the rank correlation coefficients, which, in turn, behave in a similar way. The question arises: which correlation coefficient better measures the dependence rate? We try to answer this question in the final conclusion.


title: Image Deraining with Frequency-Enhanced State Space Model

abstract: Removing rain artifacts in images is recognized as a significant issue. In this field, deep learning-based approaches, such as convolutional neural networks (CNNs) and Transformers, have succeeded. Recently, State Space Models (SSMs) have exhibited superior performance across various tasks in both natural language processing and image processing due to their ability to model long-range dependencies. This study introduces SSM to rain removal and proposes a Deraining Frequency-Enhanced State Space Model (DFSSM). To effectively remove rain streaks, which produce high-intensity frequency components in specific directions, we employ frequency domain processing concurrently with SSM. Additionally, we develop a novel mixed-scale gated-convolutional block, which uses convolutions with multiple kernel sizes to capture various scale degradations effectively and integrates a gating mechanism to manage the flow of information. Finally, experiments on synthetic and real-world rainy image datasets show that our method surpasses state-of-the-art methods.


title: Performance Optimization in RSMA-assisted Uplink xURLLC IIoT Networks with Statistical QoS Provisioning

abstract: Industry 5.0 and beyond networks have driven the emergence of numerous mission-critical applications, prompting contemplation of the neXt-generation ultra-reliable low-latency communication (xURLLC). To guarantee low-latency requirements, xURLLC heavily relies on short-blocklength packets with sporadic arrival traffic. As a disruptive multi-access technique, rate-splitting multiple access (RSMA) has emerged as a promising avenue to enhance quality of service (QoS) and flexibly manage interference for next-generation communication networks. In this paper, we investigate an innovative RSMA-assisted uplink xURLLC industrial internet-of-things (IIoT) (RSMA-xURLLC-IIoT) network. To unveil reliable insights into the statistical QoS provisioning (SQP) for our proposed network with sporadic arrival traffic, we leverage stochastic network calculus (SNC) to develop a dependable theoretical framework. Building upon this theoretical framework, we formulate the SQP-driven short-packet size maximization problem and the SQP-driven transmit power minimization problem, aiming to guarantee the SQP performance to latency, decoding, and reliability while maximizing the short-packet size and minimizing the transmit power, respectively. By exploiting Monte-Carlo methods, we have thoroughly validated the dependability of the developed theoretical framework. Moreover, through extensive comparison analysis with state-of-the-art multi-access techniques, including non-orthogonal multiple access (NOMA) and orthogonal multiple access (OMA), we have demonstrated the superior performance gains achieved by the proposed RSMA-xURLLC-IIoT networks.


title: Multi-Level Additive Modeling for Structured Non-IID Federated Learning

abstract: The primary challenge in Federated Learning (FL) is to model non-IID distributions across clients, whose fine-grained structure is important to improve knowledge sharing. For example, some knowledge is globally shared across all clients, some is only transferable within a subgroup of clients, and some are client-specific. To capture and exploit this structure, we train models organized in a multi-level structure, called ``Multi-level Additive Models (MAM)'', for better knowledge-sharing across heterogeneous clients and their personalization. In federated MAM (FeMAM), each client is assigned to at most one model per level and its personalized prediction sums up the outputs of models assigned to it across all levels. For the top level, FeMAM trains one global model shared by all clients as FedAvg. For every mid-level, it learns multiple models each assigned to a subgroup of clients, as clustered FL. Every bottom-level model is trained for one client only. In the training objective, each model aims to minimize the residual of the additive predictions by the other models assigned to each client. To approximate the arbitrary structure of non-IID across clients, FeMAM introduces more flexibility and adaptivity to FL by incrementally adding new models to the prediction of each client and reassigning another if necessary, automatically optimizing the knowledge-sharing structure. Extensive experiments show that FeMAM surpasses existing clustered FL and personalized FL methods in various non-IID settings. Our code is available at https://github.com/shutong043/FeMAM.


title: M$^3$CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought

abstract: Multi-modal Chain-of-Thought (MCoT) requires models to leverage knowledge from both textual and visual modalities for step-by-step reasoning, which gains increasing attention. Nevertheless, the current MCoT benchmark still faces some challenges: (1) absence of visual modal reasoning, (2) single-step visual modal reasoning, and (3) Domain missing, thereby hindering the development of MCoT. Motivated by this, we introduce a novel benchmark (M$^3$CoT) to address the above challenges, advancing the multi-domain, multi-step, and multi-modal CoT. Additionally, we conduct a thorough evaluation involving abundant MCoT approaches on Vision Large Language Models (VLLMs). In addition, we highlight that the current VLLMs still struggle to correctly reason in M$^3$CoT and there remains a large gap between existing VLLMs and human performance in M$^3$CoT, despite their superior results on previous MCoT benchmarks. To our knowledge, we take the first meaningful step toward the multi-domain, multi-step, and multi-modal scenario in MCoT. We hope that M$^3$CoT can serve as a valuable resource, providing a pioneering foundation in multi-domain, multi-step, multi-modal chain-of-thought research.


title: Inaccurate Label Distribution Learning with Dependency Noise

abstract: In this paper, we introduce the Dependent Noise-based Inaccurate Label Distribution Learning (DN-ILDL) framework to tackle the challenges posed by noise in label distribution learning, which arise from dependencies on instances and labels. We start by modeling the inaccurate label distribution matrix as a combination of the true label distribution and a noise matrix influenced by specific instances and labels. To address this, we develop a linear mapping from instances to their true label distributions, incorporating label correlations, and decompose the noise matrix using feature and label representations, applying group sparsity constraints to accurately capture the noise. Furthermore, we employ graph regularization to align the topological structures of the input and output spaces, ensuring accurate reconstruction of the true label distribution matrix. Utilizing the Alternating Direction Method of Multipliers (ADMM) for efficient optimization, we validate our method's capability to recover true labels accurately and establish a generalization error bound. Extensive experiments demonstrate that DN-ILDL effectively addresses the ILDL problem and outperforms existing LDL methods.


title: Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Models

abstract: The pursuit of high perceptual quality in image restoration has driven the development of revolutionary generative models, capable of producing results often visually indistinguishable from real data. However, as their perceptual quality continues to improve, these models also exhibit a growing tendency to generate hallucinations - realistic-looking details that do not exist in the ground truth images. The presence of hallucinations introduces uncertainty regarding the reliability of the models' predictions, raising major concerns about their practical application. In this paper, we employ information-theory tools to investigate this phenomenon, revealing a fundamental tradeoff between uncertainty and perception. We rigorously analyze the relationship between these two factors, proving that the global minimal uncertainty in generative models grows in tandem with perception. In particular, we define the inherent uncertainty of the restoration problem and show that attaining perfect perceptual quality entails at least twice this uncertainty. Additionally, we establish a relation between mean squared-error distortion, uncertainty and perception, through which we prove the aforementioned uncertainly-perception tradeoff induces the well-known perception-distortion tradeoff. This work uncovers fundamental limitations of generative models in achieving both high perceptual quality and reliable predictions for image restoration. We demonstrate our theoretical findings through an analysis of single image super-resolution algorithms. Our work aims to raise awareness among practitioners about this inherent tradeoff, empowering them to make informed decisions and potentially prioritize safety over perceptual performance.


title: KiNETGAN: Enabling Distributed Network Intrusion Detection through Knowledge-Infused Synthetic Data Generation

abstract: In the realm of IoT/CPS systems connected over mobile networks, traditional intrusion detection methods analyze network traffic across multiple devices using anomaly detection techniques to flag potential security threats. However, these methods face significant privacy challenges, particularly with deep packet inspection and network communication analysis. This type of monitoring is highly intrusive, as it involves examining the content of data packets, which can include personal and sensitive information. Such data scrutiny is often governed by stringent laws and regulations, especially in environments like smart homes where data privacy is paramount. Synthetic data offers a promising solution by mimicking real network behavior without revealing sensitive details. Generative models such as Generative Adversarial Networks (GANs) can produce synthetic data, but they often struggle to generate realistic data in specialized domains like network activity. This limitation stems from insufficient training data, which impedes the model's ability to grasp the domain's rules and constraints adequately. Moreover, the scarcity of training data exacerbates the problem of class imbalance in intrusion detection methods. To address these challenges, we propose a Privacy-Driven framework that utilizes a knowledge-infused Generative Adversarial Network for generating synthetic network activity data (KiNETGAN). This approach enhances the resilience of distributed intrusion detection while addressing privacy concerns. Our Knowledge Guided GAN produces realistic representations of network activity, validated through rigorous experimentation. We demonstrate that KiNETGAN maintains minimal accuracy loss in downstream tasks, effectively balancing data privacy and utility.


title: Toffoli gates solve the tetrahedron equations

abstract: The circuit model of quantum computation can be interpreted as a scattering process. In particular, factorised scattering operators result in integrable quantum circuits that provide universal quantum computation and are potentially less noisy. These are realized through Yang-Baxter or 2-simplex operators. A natural question is to extend this construction to higher qubit gates, like the Toffoli gates, which also lead to universal quantum computation but with shallower circuits. We show that unitary families of such operators are constructed by the 3-dimensional generalizations of the Yang-Baxter operators known as tetrahedron or 3-simplex operators. The latter satisfy a spectral parameter-dependent tetrahedron equation. This construction goes through for $n$-Toffoli gates realized using $n$-simplex operators.

categories: quant-ph cond-mat.stat-mech hep-th math-ph math.MP


title: Vision-Based Approach for Food Weight Estimation from 2D Images

abstract: In response to the increasing demand for efficient and non-invasive methods to estimate food weight, this paper presents a vision-based approach utilizing 2D images. The study employs a dataset of 2380 images comprising fourteen different food types in various portions, orientations, and containers. The proposed methodology integrates deep learning and computer vision techniques, specifically employing Faster R-CNN for food detection and MobileNetV3 for weight estimation. The detection model achieved a mean average precision (mAP) of 83.41\%, an average Intersection over Union (IoU) of 91.82\%, and a classification accuracy of 100\%. For weight estimation, the model demonstrated a root mean squared error (RMSE) of 6.3204, a mean absolute percentage error (MAPE) of 0.0640\%, and an R-squared value of 98.65\%. The study underscores the potential applications of this technology in healthcare for nutrition counseling, fitness and wellness for dietary intake assessment, and smart food storage solutions to reduce waste. The results indicate that the combination of Faster R-CNN and MobileNetV3 provides a robust framework for accurate food weight estimation from 2D images, showcasing the synergy of computer vision and deep learning in practical applications.


title: Differentiable Proximal Graph Matching

abstract: Graph matching is a fundamental tool in computer vision and pattern recognition. In this paper, we introduce an algorithm for graph matching based on the proximal operator, referred to as differentiable proximal graph matching (DPGM). Specifically, we relax and decompose the quadratic assignment problem for the graph matching into a sequence of convex optimization problems. The whole algorithm can be considered as a differentiable map from the graph affinity matrix to the prediction of node correspondence. Therefore, the proposed method can be organically integrated into an end-to-end deep learning framework to jointly learn both the deep feature representation and the graph affinity matrix. In addition, we provide a theoretical guarantee to ensure the proposed method converges to a stable point with a reasonable number of iterations. Numerical experiments show that PGM outperforms existing graph matching algorithms on diverse datasets such as synthetic data, and CMU House. Meanwhile, PGM can fully harness the capability of deep feature extractors and achieve state-of-art performance on PASCAL VOC keypoints.


title: Understanding Of Size And Scale And Order-Of-Magnitude Reasoning In Secondary Science: A Teaching Experiment With Worked Examples As Educational Scaffold

abstract: Understanding size and scale (USS) and order-of-magnitude reasoning (OMR) are critical for scientific literacy. This study examines an educational approach to enhance these skills in high school science, considering the cognitive prerequisites and challenges. It explores worked examples (WEs) as an effective method to teach USS and OMR, comparing their impact on students' knowledge and transfer abilities with conventional tasks in a quasi-experimental study. The results indicate significant improvements in procedural and conceptual knowledge, effective for diverse learners regardless of prior knowledge.


title: Studies on particle creation during the universe expansion with a laser system

abstract: While two highly intensive laser beams collide, they create a region where the refractive index varies so quickly that photons are created. The variance of the refractive index is analog to the universe scale factor variance. Therefore, this laser system can be an analog to the expansion of the universe. We find that several hundreds of photons can be created under feasible conditions. This system can demonstrate the particle creation during inflation or other similar periods.


title: DarijaBanking: A New Resource for Overcoming Language Barriers in Banking Intent Detection for Moroccan Arabic Speakers

abstract: Navigating the complexities of language diversity is a central challenge in developing robust natural language processing systems, especially in specialized domains like banking. The Moroccan Dialect (Darija) serves as the common language that blends cultural complexities, historical impacts, and regional differences. The complexities of Darija present a special set of challenges for language models, as it differs from Modern Standard Arabic with strong influence from French, Spanish, and Tamazight, it requires a specific approach for effective communication. To tackle these challenges, this paper introduces \textbf{DarijaBanking}, a novel Darija dataset aimed at enhancing intent classification in the banking domain, addressing the critical need for automatic banking systems (e.g., chatbots) that communicate in the native language of Moroccan clients. DarijaBanking comprises over 1,800 parallel high-quality queries in Darija, Modern Standard Arabic (MSA), English, and French, organized into 24 intent classes. We experimented with various intent classification methods, including full fine-tuning of monolingual and multilingual models, zero-shot learning, retrieval-based approaches, and Large Language Model prompting. One of the main contributions of this work is BERTouch, our BERT-based language model for intent classification in Darija. BERTouch achieved F1-scores of 0.98 for Darija and 0.96 for MSA on DarijaBanking, outperforming the state-of-the-art alternatives including GPT-4 showcasing its effectiveness in the targeted application.


title: Enhancing Reliability in LEO Satellite Networks via High-Speed Inter-Satellite Links

abstract: Low Earth orbit (LEO) satellites play a crucial role in providing global connectivity for non-terrestrial networks (NTNs) and supporting various Internet-of-Remote-Things (IoRT) applications. Each LEO satellite functions as a relay node in the sky, employing store-and-forward transmission strategies that necessitate the use of buffers. However, due to the finite size of these buffers, occurrences of buffer overflow leading to packet loss are inevitable. In this paper, we demonstrate how inter-satellite links (ISLs) can mitigate the probability of buffer overflow. Specifically, we propose an approach to reallocate packets among LEO satellites via ISLs to minimize the occurrence of buffer overflow events. Consequently, the implementation of ISLs can lead to a more reliable satellite network, enabling efficient packet reallocation to reduce the probability of buffer overflow.


title: Accurate Measurement of the Lensing Magnification by BOSS CMASS Galaxies and Its Implications for Cosmology and Dark Matter

abstract: Magnification serves as an independent and complementary gravitational lensing measurement to shear. We develop a novel method to achieve an accurate and robust magnification measurement around BOSS CMASS galaxies across physical scales of $0.016h^{-1}\,{\rm Mpc} < r_{\rm p} < 10h^{-1}\,{\rm Mpc}$. We first measure the excess total flux density $\delta M$ of the source galaxies in deep DECaLS photometric catalog that are lensed by CMASS galaxies. We convert $\delta M$ to magnification $\mu$ by establishing the $\delta \mu-\delta M$ relation using a deeper photometric sample. By comparing magnification measurements in three optical bands ($grz$), we constrain the dust attenuation curve and its radial distribution, discovering a steep attenuation curve in the circumgalactic medium of CMASS galaxies. We further compare dust-corrected magnification measurements to model predictions from high-resolution dark matter-only (DMO) simulations in WMAP and Planck cosmologies, as well as the hydrodynamic simulation TNG300-1, using precise galaxy-halo connections from the Photometric objects Around Cosmic webs method and the accurate ray-tracing algorithm P3MLens. For $r_{\rm p} > 70h^{-1}\,$kpc, our magnification measurements are in good agreement with both WMAP and Planck cosmologies. Assuming a linear correlation between the magnification signal and the fluctuation amplitude $S_8$, we obtain a tight constraint of $S_8 = 0.816 \pm 0.024$. However, at $r_{\rm p} < 70h^{-1}\,$kpc, we observe an excess magnification signal, which is higher than the DMO model in Planck cosmology at $2.8\sigma$ and would be exacerbated if significant baryon feedback is included. Implications of the potential small scale discrepancy for the nature of dark matter and for the processes governing galaxy formation are discussed.