title: Generative Kaleidoscopic Networks

abstract: We discovered that the neural networks, especially the deep ReLU networks, demonstrate an `over-generalization' phenomenon. That is, the output values for the inputs that were not seen during training are mapped close to the output range that were observed during the learning process. In other words, the neural networks learn a many-to-one mapping and this effect is more prominent as we increase the number of layers or the depth of the neural network. We utilize this property of neural networks to design a dataset kaleidoscope, termed as `Generative Kaleidoscopic Networks'. Briefly, if we learn a model to map from input $x\in\mathbb{R}^D$ to itself $f_\mathcal{N}(x)\rightarrow x$, the proposed `Kaleidoscopic sampling' procedure starts with a random input noise $z\in\mathbb{R}^D$ and recursively applies $f_\mathcal{N}(\cdots f_\mathcal{N}(z)\cdots )$. After a burn-in period duration, we start observing samples from the input distribution and the quality of samples recovered improves as we increase the depth of the model. Scope: We observed this phenomenon to various degrees for the other deep learning architectures like CNNs, Transformers & U-Nets and we are currently investigating them further.


title: Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generation

abstract: Retrieval-augmented generation framework can address the limitations of large language models by enabling real-time knowledge updates for more accurate answers. An efficient way in the training phase of retrieval-augmented models is attention distillation, which uses attention scores as a supervision signal instead of manually annotated query-document pairs. Despite its growing popularity, the detailed mechanisms behind the success of attention distillation remain unexplored, particularly the specific patterns it leverages to benefit training. In this paper, we address this gap by conducting a comprehensive review of attention distillation workflow and identifying key factors influencing the learning quality of retrieval-augmented language models. We further propose indicators for optimizing models' training methods and avoiding ineffective training.


title: The Maximum Singularity Degree for Linear and Semidefinite Programming

abstract: The singularity degree plays a crucial role in understanding linear and semidefinite programming, providing a theoretical framework for analyzing these problems. It is defined as the minimum number of facial reduction (FR) steps needed to reach strict feasibility for a convex set. On the other hand, the maximum singularity degree (MSD) is the maximum number of steps required. Recent progress in the applications of MSD has motivated us to explore its fundamental properties in this paper. For semidefinite programming, we establish a necessary condition for an FR sequence to be the longest. Additionally, we propose an upper bound for MSD, which can be computed more easily. By leveraging these findings, we prove that computing MSD is NP-hard. This complexity result complements the existing algorithms for computing the singularity degree found in the literature. For linear programming, we provide a characterization for the longest FR sequences, which also serves as a polynomial-time algorithm for constructing such a sequence. In addition, we introduce two operations that ensure the longest FR sequences remain the longest. Lastly, we prove that MSD is equivalent to a novel parameter called the implicit problem singularity.


title: Affine FR : an Effective Facial Reduction Algorithm for Semidefinite Relaxations of Combinatorial Problems

abstract: We develop a new method called affine FR for recovering Slater's condition for semidefinite programming (SDP) relaxations of combinatorial optimization (CO) problems. Affine FR is a user-friendly method, as it is fully automatic and only requires a description of the problem. We provide a rigorous analysis of differences between affine FR and the existing methods. We also present numerical results to demonstrate the effectiveness of affine FR in reducing the size of SDP relaxations for CO problems.


title: Suspended Magnetometer Survey for Mineral Data Acquisition with Vertical Take-off and Landing Fixed-wing Aircraft

abstract: Multirotor Unmanned Aerial Vehicles (UAV)s have recently become an important instrument for collecting mineral data, enabling more effective and accurate geological investigations. This paper explores the difficulties in mounting high-sensitivity sensors on a UAV platform, including electromagnetic interference, payload dynamics, and maintaining stable sensor performance while in flight. It is highlighted how the specific solutions provided to deal with these problems have the potential to alter the collection of mineral data assisted by UAVs. The work also shows experimental findings that demonstrate the creative potential of these solutions in UAV-based mineral data collecting, leading to improvements in effective mineral exploration through careful design, testing, and assessment of these systems. These innovations resulted in a platform that is quickly deployable in remote areas and able to operate more efficiently compared to traditional multirotor UAVs while still producing equal or higher quality mineral data. This allows for much higher efficiency and lower operating costs for high-production UAV-based mineral data acquisition.


title: Breaks in the Hall-Petch Relationship after Severe Plastic Deformation of Magnesium, Aluminum, Copper, and Iron

abstract: Strengthening by grain refinement via the Hall-Petch mechanism and softening by nanograin formation via the inverse Hall-Petch mechanism have been the subject of argument for decades, particularly for ultrafine-grained materials. In this study, the Hall-Petch relationship is examined for ultrafine-grained magnesium, aluminum, copper, and iron produced by severe plastic deformation in the literature. Magnesium, aluminum, copper, and their alloys follow the Hall-Petch relationship with a low slope, but an up-break appears when the grain sizes are reduced below 500-1000 nm. This extra strengthening, which is mainly due to the enhanced contribution of dislocations, is followed by a down-break for grain sizes smaller than 70-150 nm due to the diminution of the dislocation contribution and an enhancement of thermally-activated phenomena. For pure iron with a lower dislocation mobility, the Hall-Petch breaks are not evident, but the strength at the nanometer grain size range is lower than the expected Hall-Petch trend in the submicrometer range. The strength of nanograined iron can be increased to the expected trend by stabilizing grain boundaries via impurity atoms. Detailed analyses of the data confirm that grain refinement to the nanometer level is not necessarily a solution to achieve extra strengthening, but other strategies such as microstructural stabilization by segregation or precipitation are required.


title: Decentralized Multi-Robot Navigation for Autonomous Surface Vehicles with Distributional Reinforcement Learning

abstract: Collision avoidance algorithms for Autonomous Surface Vehicles (ASV) that follow the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs) have been proposed in recent years. However, it may be difficult and unsafe to follow COLREGs in congested waters, where multiple ASVs are navigating in the presence of static obstacles and strong currents, due to the complex interactions. To address this problem, we propose a decentralized multi-ASV collision avoidance policy based on Distributional Reinforcement Learning, which considers the interactions among ASVs as well as with static obstacles and current flows. We evaluate the performance of the proposed Distributional RL based policy against a traditional RL-based policy and two classical methods, Artificial Potential Fields (APF) and Reciprocal Velocity Obstacles (RVO), in simulation experiments, which show that the proposed policy achieves superior performance in navigation safety, while requiring minimal travel time and energy. A variant of our framework that automatically adapts its risk sensitivity is also demonstrated to improve ASV safety in highly congested environments.


title: Stochastic Approximation with Delayed Updates: Finite-Time Rates under Markovian Sampling

abstract: Motivated by applications in large-scale and multi-agent reinforcement learning, we study the non-asymptotic performance of stochastic approximation (SA) schemes with delayed updates under Markovian sampling. While the effect of delays has been extensively studied for optimization, the manner in which they interact with the underlying Markov process to shape the finite-time performance of SA remains poorly understood. In this context, our first main contribution is to show that under time-varying bounded delays, the delayed SA update rule guarantees exponentially fast convergence of the \emph{last iterate} to a ball around the SA operator's fixed point. Notably, our bound is \emph{tight} in its dependence on both the maximum delay $\tau_{max}$, and the mixing time $\tau_{mix}$. To achieve this tight bound, we develop a novel inductive proof technique that, unlike various existing delayed-optimization analyses, relies on establishing uniform boundedness of the iterates. As such, our proof may be of independent interest. Next, to mitigate the impact of the maximum delay on the convergence rate, we provide the first finite-time analysis of a delay-adaptive SA scheme under Markovian sampling. In particular, we show that the exponent of convergence of this scheme gets scaled down by $\tau_{avg}$, as opposed to $\tau_{max}$ for the vanilla delayed SA rule; here, $\tau_{avg}$ denotes the average delay across all iterations. Moreover, the adaptive scheme requires no prior knowledge of the delay sequence for step-size tuning. Our theoretical findings shed light on the finite-time effects of delays for a broad class of algorithms, including TD learning, Q-learning, and stochastic gradient descent under Markovian sampling.


title: Enhancing Empathetic Response Generation by Augmenting LLMs with Small-scale Empathetic Models

abstract: Empathetic response generation is increasingly significant in AI, necessitating nuanced emotional and cognitive understanding coupled with articulate response expression. Current large language models (LLMs) excel in response expression; however, they lack the ability to deeply understand emotional and cognitive nuances, particularly in pinpointing fine-grained emotions and their triggers. Conversely, small-scale empathetic models (SEMs) offer strength in fine-grained emotion detection and detailed emotion cause identification. To harness the complementary strengths of both LLMs and SEMs, we introduce a Hybrid Empathetic Framework (HEF). HEF regards SEMs as flexible plugins to improve LLM's nuanced emotional and cognitive understanding. Regarding emotional understanding, HEF implements a two-stage emotion prediction strategy, encouraging LLMs to prioritize primary emotions emphasized by SEMs, followed by other categories, substantially alleviates the difficulties for LLMs in fine-grained emotion detection. Regarding cognitive understanding, HEF employs an emotion cause perception strategy, prompting LLMs to focus on crucial emotion-eliciting words identified by SEMs, thus boosting LLMs' capabilities in identifying emotion causes. This collaborative approach enables LLMs to discern emotions more precisely and formulate empathetic responses. We validate HEF on the Empathetic-Dialogue dataset, and the findings indicate that our framework enhances the refined understanding of LLMs and their ability to convey empathetic responses.


title: Quantum soliton-trains of strongly correlated impurities in Bose-Einstein condensates

abstract: Strongly correlated impurities immersed in a Bose-Einstein condensate (BEC) can form a periodic structure of tightly localized single atoms due to competing inter- and intra-species interactions, leading to a self-organized pinned state. In this work, we show numerically that the impurities in the self-pinned state form a soliton-train, as a consequence of a BEC-mediated attractive self-interaction and ordering due to the exclusion principle. The dynamics of the impurities possess similar characteristics to bright matter-wave solitons as they appear in attractive BECs, however in the few impurities case, the detailed nature of collisions is determined by their quantum statistics.


title: Eigenvalue estimates on shrinkers

abstract: We prove an eigenvalue estimate which holds on every properly embedded self-similar shrinker for mean curvature flow.


title: LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphs

abstract: Knowledge Graph (KG) inductive reasoning, which aims to infer missing facts from new KGs that are not seen during training, has been widely adopted in various applications. One critical challenge of KG inductive reasoning is handling low-resource scenarios with scarcity in both textual and structural aspects. In this paper, we attempt to address this challenge with Large Language Models (LLMs). Particularly, we utilize the state-of-the-art LLMs to generate a graph-structural prompt to enhance the pre-trained Graph Neural Networks (GNNs), which brings us new methodological insights into the KG inductive reasoning methods, as well as high generalizability in practice. On the methodological side, we introduce a novel pretraining and prompting framework ProLINK, designed for low-resource inductive reasoning across arbitrary KGs without requiring additional training. On the practical side, we experimentally evaluate our approach on 36 low-resource KG datasets and find that ProLINK outperforms previous methods in three-shot, one-shot, and zero-shot reasoning tasks, exhibiting average performance improvements by 20%, 45%, and 147%, respectively. Furthermore, ProLINK demonstrates strong robustness for various LLM promptings as well as full-shot scenarios.


title: Theory of the spectral function of Fermi polarons at finite temperature

abstract: We develop a general theory of Fermi polarons at nonzero temperature, including particle-hole excitations of the Fermi sea shake-up to arbitrarily high orders. The exact set of equations of the spectral function is derived by using both Chevy ansatz and diagrammatic approach, and their equivalence is clarified to hold in free space only, with an unregularized infinitesimal interaction strength. The correction to the polaron spectral function arising from two-particle-hole excitations is explicitly examined, for an exemplary case of Fermi polarons in one-dimensional optical lattices. We find quantitative improvements at low temperatures with the inclusion of two-particle-hole excitations, in both polaron energies and decay rates. Our exact theory of Fermi polarons with arbitrary orders of particle-hole excitations might be used to better understand the intriguing polaron dynamical responses in two or three dimensions, whether in free space or within lattices.


title: Building a Hierarchical Architecture and Communication Model for the Quantum Internet

abstract: The research of architecture has tremendous significance in realizing quantum Internet. Although there is not yet a standard quantum Internet architecture, the distributed architecture is one of the possible solutions, which utilizes quantum repeaters or dedicated entanglement sources in a flat structure for entanglement preparation & distribution. In this paper, we analyze the distributed architecture in detail and demonstrate that it has three limitations: 1) possible high maintenance overhead, 2) possible low-performance entanglement distribution, and 3) unable to support optimal entanglement routing. We design a hierarchical quantum Internet architecture and a communication model to solve the problems above. We also present a W-state Based Centralized Entanglement Preparation & Distribution (W-state Based CEPD) scheme and a Centralized Entanglement Routing (CER) algorithm within our hierarchical architecture and perform an experimental comparison with other entanglement preparation & distribution schemes and entanglement routing algorithms within the distributed architecture. The evaluation results show that the entanglement distribution efficiency of hierarchical architecture is 11.5% higher than that of distributed architecture on average (minimum 3.3%, maximum 37.3%), and the entanglement routing performance of hierarchical architecture is much better than that of a distributed architecture according to the fidelity and throughput.


title: Density estimation for elliptic PDE with random input by preintegration and quasi-Monte Carlo methods

abstract: In this paper, we apply quasi-Monte Carlo (QMC) methods with an initial preintegration step to estimate cumulative distribution functions and probability density functions in uncertainty quantification (UQ). The distribution and density functions correspond to a quantity of interest involving the solution to an elliptic partial differential equation (PDE) with a lognormally distributed coefficient and a normally distributed source term. There is extensive previous work on using QMC to compute expected values in UQ, which have proven very successful in tackling a range of different PDE problems. However, the use of QMC for density estimation applied to UQ problems will be explored here for the first time. Density estimation presents a more difficult challenge compared to computing the expected value due to discontinuities present in the integral formulations of both the distribution and density. Our strategy is to use preintegration to eliminate the discontinuity by integrating out a carefully selected random parameter, so that QMC can be used to approximate the remaining integral. First, we establish regularity results for the PDE quantity of interest that are required for smoothing by preintegration to be effective. We then show that an $N$-point lattice rule can be constructed for the integrands corresponding to the distribution and density, such that after preintegration the QMC error is of order $\mathcal{O}(N^{-1+\epsilon})$ for arbitrarily small $\epsilon>0$. This is the same rate achieved for computing the expected value of the quantity of interest. Numerical results are presented to reaffirm our theory.


title: Bohr inequalities via proper combinations for a certain class of close-to-convex harmonic mappings

abstract: Let $ \mathcal{H}(\Omega) $ be the class of complex-valued functions harmonic in $ \Omega\subset\mathbb{C} $ and each $f=h+\overline{g}\in \mathcal{H}(\Omega)$, where $ h $ and $ g $ are analytic. In the study of Bohr phenomenon for certain class of harmonic mappings, it is to find a constant $ r_f\in (0, 1) $ such that the inequality \begin{align*} M_f(r):=r+\sum_{n=2}^{\infty}\left(|a_n|+|b_n|\right)r^n\leq d\left(f(0), \partial\Omega\right) \;\mbox{for}\;|z|=r\leq r_f, \end{align*} where $ d\left(f(0), \partial\Omega\right) $ is the Euclidean distance between $ f(0) $ and the boundary of $ \Omega:=f(\mathbb{D}) $. The largest such radius $ r_f $ is called the Bohr radius and the inequality $ M_f(r)\leq d\left(f(0), \partial\Omega\right) $ is called the Bohr inequality for the class $ \mathcal{H}(\Omega) $. In this paper, we study Bohr phenomenon for the class of close-to-convex harmonic mappings establishing several inequalities. All the results are proved to be sharp.


title: Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding

abstract: This research aims to accelerate the inference speed of large language models (LLMs) with billions of parameters. We propose \textbf{S}mart \textbf{P}arallel \textbf{A}uto-\textbf{C}orrect d\textbf{E}coding (SPACE), an innovative approach designed for achieving lossless acceleration of LLMs. By integrating semi-autoregressive inference and speculative decoding capabilities, SPACE uniquely enables autoregressive LLMs to parallelize token generation and verification. This is realized through a specialized semi-autoregressive supervised fine-tuning process that equips existing LLMs with the ability to simultaneously predict multiple tokens. Additionally, an auto-correct decoding algorithm facilitates the simultaneous generation and verification of token sequences within a single model invocation. Through extensive experiments on a range of LLMs, SPACE has demonstrated inference speedup ranging from 2.7x-4.0x on HumanEval-X while maintaining output quality.


title: Sensor Integration and Performance Optimizations for Mineral Exploration using Large-scale Hybrid Multirotor UAVs

abstract: In this paper, the focus is on improving the efficiency and precision of mineral data collection using UAVs by addressing key challenges associated with sensor integration. These challenges include mitigating electromagnetic interference, reducing vibration noise, and ensuring consistent sensor performance during flight. The paper demonstrates how innovative approaches to these issues can significantly transform UAV-assisted mineral data collection. Through meticulous design, testing, and evaluation, the study presents experimental evidence of the efficacy of these methods in collecting mineral data via UAVs. The advancements achieved in this research enable the UAV platform to remain airborne up to 6$\times$ longer than standard battery-powered multirotors, while still gathering high-quality mineral data. This leads to increased operational efficiency and reduced costs in UAV-based mineral data-gathering processes


title: FIPO: Free-form Instruction-oriented Prompt Optimization with Preference Dataset and Modular Fine-tuning Schema

abstract: When the quality of naive prompts is carefully optimized by human experts, the task performance of large language models (LLMs) can be significantly improved. However, expert-based prompt optimizations are expensive. Herein, some works have proposed Automatic Prompt Optimization (APO), to optimize naive prompts according to task outputs of given in-box testing models, with the help of advanced LLMs (e.g., GPT-4) in an ad-hoc way. Although effective, existing schemes suffer from poor generalization ability and privacy risk. To this end, we collect the first large-scale Prompt Optimization Preference dataset (POP), fine-tune offline local LLM-based optimizers, then fairly test with various downstream models. Our method allows accurate optimization of the core task instruction part within the naive prompt in a model-agnostic manner, and thus is named Free-from Instruction-oriented Prompt Optimization (FIPO). In specific, FIPO uses a modular APO template that dynamically integrate the naive task instruction, optional instruction responses, and optional ground truth to produce finely optimized prompts. The POP dataset is meticulously constructed using advanced LLMs, undergoing rigorous cross-validation by human experts and analytical models. Leveraging insights from the data with Tulu2 models and diverse fine-tuning strategies, we validate the efficacy of FIPO framework across five public benchmarks and three testing models. Check codes and data here: https://github.com/LuJunru/FIPO_Project.


title: Interpretable Embedding for Ad-hoc Video Search

abstract: Answering query with semantic concepts has long been the mainstream approach for video search. Until recently, its performance is surpassed by concept-free approach, which embeds queries in a joint space as videos. Nevertheless, the embedded features as well as search results are not interpretable, hindering subsequent steps in video browsing and query reformulation. This paper integrates feature embedding and concept interpretation into a neural network for unified dual-task learning. In this way, an embedding is associated with a list of semantic concepts as an interpretation of video content. This paper empirically demonstrates that, by using either the embedding features or concepts, considerable search improvement is attainable on TRECVid benchmarked datasets. Concepts are not only effective in pruning false positive videos, but also highly complementary to concept-free search, leading to large margin of improvement compared to state-of-the-art approaches.


title: A novel framework for adaptive stress testing of autonomous vehicles in highways

abstract: Guaranteeing the safe operations of autonomous vehicles (AVs) is crucial for their widespread adoption and public acceptance. It is thus of a great significance to not only assess the AV against the standard safety tests, but also discover potential corner cases of the AV under test that could lead to unsafe behaviour or scenario. In this paper, we propose a novel framework to systematically explore corner cases that can result in safety concerns in a highway traffic scenario. The framework is based on an adaptive stress testing (AST) approach, an emerging validation method that leverages a Markov decision process to formulate the scenarios and deep reinforcement learning (DRL) to discover the desirable patterns representing corner cases. To this end, we develop a new reward function for DRL to guide the AST in identifying crash scenarios based on the collision probability estimate between the AV under test (i.e., the ego vehicle) and the trajectory of other vehicles on the highway. The proposed framework is further integrated with a new driving model enabling us to create more realistic traffic scenarios capturing both the longitudinal and lateral movements of vehicles on the highway. In our experiment, we calibrate our model using real-world crash statistics involving automated vehicles in California, and then we analyze the characteristics of the AV and the framework. Quantitative and qualitative analyses of our experimental results demonstrate that our framework outperforms other existing AST schemes. The study can help discover crash scenarios of AV that are unknown or absent in human driving, thereby enhancing the safety and trustworthiness of AV technology.


title: An Empirical Evaluation of LLMs for Solving Offensive Security Challenges

abstract: Capture The Flag (CTF) challenges are puzzles related to computer security scenarios. With the advent of large language models (LLMs), more and more CTF participants are using LLMs to understand and solve the challenges. However, so far no work has evaluated the effectiveness of LLMs in solving CTF challenges with a fully automated workflow. We develop two CTF-solving workflows, human-in-the-loop (HITL) and fully-automated, to examine the LLMs' ability to solve a selected set of CTF challenges, prompted with information about the question. We collect human contestants' results on the same set of questions, and find that LLMs achieve higher success rate than an average human participant. This work provides a comprehensive evaluation of the capability of LLMs in solving real world CTF challenges, from real competition to fully automated workflow. Our results provide references for applying LLMs in cybersecurity education and pave the way for systematic evaluation of offensive cybersecurity capabilities in LLMs.


title: HU at SemEval-2024 Task 8A: Can Contrastive Learning Learn Embeddings to Detect Machine-Generated Text?

abstract: This paper describes our system developed for SemEval-2024 Task 8, ``Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection'' Machine-generated texts have been one of the main concerns due to the use of large language models (LLM) in fake text generation, phishing, cheating in exams, or even plagiarizing copyright materials. A lot of systems have been developed to detect machine-generated text. Nonetheless, the majority of these systems rely on the text-generating model. This limitation is impractical in real-world scenarios, as it's often impossible to know which specific model the user has used for text generation. In this work, we propose a $\textbf{single}$ model based on contrastive learning, which uses $\textbf{$\approx$40% of the baseline's parameters}$ (149M vs. 355M) but shows a comparable performance on the test dataset $(\textbf{21st out of 137 participants})$. Our key finding is that even without an ensemble of multiple models, a single base model can have comparable performance with the help of data augmentation and contrastive learning. Our code is publicly available at https://github.com/dipta007/SemEval24-Task8.


title: Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning

abstract: Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a phenomenon where the trained model captures only a limited portion of the information from the input data while overlooking other potentially valuable content. This issue often leads to indistinguishable representations for visually similar but semantically different inputs, adversely affecting downstream task performance, particularly those requiring rigorous semantic comprehension. To address this challenge, we propose a novel model-agnostic Multistage Contrastive Learning (MCL) framework. Unlike standard contrastive learning which inherently captures one single biased feature distribution, MCL progressively learns previously unlearned features through feature-aware negative sampling at each stage, where the negative samples of an anchor are exclusively selected from the cluster it was assigned to in preceding stages. Meanwhile, MCL preserves the previously well-learned features by cross-stage representation integration, integrating features across all stages to form final representations. Our comprehensive evaluation demonstrates MCL's effectiveness and superiority across both unimodal and multimodal contrastive learning, spanning a range of model architectures from ResNet to Vision Transformers (ViT). Remarkably, in tasks where the original CLIP model has shown limitations, MCL dramatically enhances performance, with improvements up to threefold on specific attributes in the recently proposed MMVP benchmark.


title: EMU/GAMA: A Technique for Detecting Active Galactic Nuclei in Low Mass Systems

abstract: We propose a new method for identifying active galactic nuclei (AGN) in low mass ($\rm M_*\leq10^{10}M_\odot$) galaxies. This method relies on spectral energy distribution (SED) fitting to identify galaxies whose radio flux density has an excess over that expected from star formation alone. Combining data in the Galaxy and Mass Assembly (GAMA) G23 region from GAMA, Evolutionary Map of the Universe (EMU) early science observations, and Wide-field Infrared Survey Explorer (WISE), we compare this technique with a selection of different AGN diagnostics to explore the similarities and differences in AGN classification. We find that diagnostics based on optical and near-infrared criteria (the standard BPT diagram, the WISE colour criterion, and the mass-excitation, or MEx diagram) tend to favour detection of AGN in high mass, high luminosity systems, while the ``ProSpect'' SED fitting tool can identify AGN efficiently in low mass systems. We investigate an explanation for this result in the context of proportionally lower mass black holes in lower mass galaxies compared to higher mass galaxies and differing proportions of emission from AGN and star formation dominating the light at optical and infrared wavelengths as a function of galaxy stellar mass. We conclude that SED-derived AGN classification is an efficient approach to identify low mass hosts with low radio luminosity AGN.


title: Where It Really Matters: Few-Shot Environmental Conservation Media Monitoring for Low-Resource Languages

abstract: Environmental conservation organizations routinely monitor news content on conservation in protected areas to maintain situational awareness of developments that can have an environmental impact. Existing automated media monitoring systems require large amounts of data labeled by domain experts, which is only feasible at scale for high-resource languages like English. However, such tools are most needed in the global south where news of interest is mainly in local low-resource languages, and far fewer experts are available to annotate datasets sustainably. In this paper, we propose NewsSerow, a method to automatically recognize environmental conservation content in low-resource languages. NewsSerow is a pipeline of summarization, in-context few-shot classification, and self-reflection using large language models (LLMs). Using at most 10 demonstration example news articles in Nepali, NewsSerow significantly outperforms other few-shot methods and achieves comparable performance with models fully fine-tuned using thousands of examples. The World Wide Fund for Nature (WWF) has deployed NewsSerow for media monitoring in Nepal, significantly reducing their operational burden, and ensuring that AI tools for conservation actually reach the communities that need them the most. NewsSerow has also been deployed for countries with other languages like Colombia.


title: Head-wise Shareable Attention for Large Language Models

abstract: Large Language Models (LLMs) suffer from huge number of parameters, which restricts their deployment on edge devices. Weight sharing is one promising solution that encourages weight reuse, effectively reducing memory usage with less performance drop. However, current weight sharing techniques primarily focus on small-scale models like BERT and employ coarse-grained sharing rules, e.g., layer-wise. This becomes limiting given the prevalence of LLMs and sharing an entire layer or block obviously diminishes the flexibility of weight sharing. In this paper, we present a perspective on $\textit{$\textbf{head-wise shareable attention for large language models}$}$. We further propose two memory-efficient methods that share parameters across attention heads, with a specific focus on LLMs. Both of them use the same dynamic strategy to select the shared weight matrices. The first method directly reuses the pre-trained weights without retraining, denoted as $\textbf{DirectShare}$. The second method first post-trains with constraint on weight matrix similarity and then shares, denoted as $\textbf{PostShare}$. Experimental results reveal our head-wise shared models still maintain satisfactory capabilities, demonstrating the feasibility of fine-grained weight sharing applied to LLMs.


title: A critical analysis of cognitive load measurement methods for evaluating the usability of different types of interfaces: guidelines and framework for Human-Computer Interaction

abstract: Usability testing is an essential part of product design, particularly for user interfaces. To enhance the reliability of usability evaluations, employing cognitive load measurement methods can be highly effective in assessing the mental effort required to complete tasks during user testing. This review aims to provide an overview of the most suitable cognitive load measurement methods for evaluating various types of user interfaces, serving as a valuable resource for guiding usability assessments. To bridge the existing gap in the literature, a systematic review was conducted, analyzing 76 articles with experimental study designs that met the eligibility criteria. The review encompasses different methods of measuring cognitive load applicable to assessing the usability of diverse user interfaces, including computer software, information systems, video games, web and mobile applications, robotics, and virtual reality applications. The results highlight the most widely utilized cognitive load measurement methods in software usability, their respective usage percentages, and their application in evaluating the usability of each user interface type. Additionally, the advantages and disadvantages of each method are discussed. Furthermore, the review proposes a framework to assist usability testers in selecting an appropriate cognitive load measurement method for conducting accurate usability evaluations.


title: Microstructures and Accuracy of Graph Recall by Large Language Models

abstract: Graphs data is crucial for many applications, and much of it exists in the relations described in textual format. As a result, being able to accurately recall and encode a graph described in earlier text is a basic yet pivotal ability that LLMs need to demonstrate if they are to perform reasoning tasks that involve graph-structured information. Human performance at graph recall has been studied by cognitive scientists for decades, and has been found to often exhibit certain structural patterns of bias that align with human handling of social relationships. To date, however, we know little about how LLMs behave in analogous graph recall tasks: do their recalled graphs also exhibit certain biased patterns, and if so, how do they compare with humans and affect other graph reasoning tasks? In this work, we perform the first systematical study of graph recall by LLMs, investigating the accuracy and biased microstructures (local structural patterns) in their recall. We find that LLMs not only underperform often in graph recall, but also tend to favor more triangles and alternating 2-paths. Moreover, we find that more advanced LLMs have a striking dependence on the domain that a real-world graph comes from -- by yielding the best recall accuracy when the graph is narrated in a language style consistent with its original domain.


title: Optical Chiral Response of MXene Nanoantenna Lattice

abstract: The chiral response from nanoantennas is useful for enabling advanced applications in areas such as optical communication, sensing, and imaging, due to its ability to selectively interact with circularly polarized light. Lattice resonances in periodic nanoantenna arrays can enhance the optical response of the nanostructure and facilitate stronger light-matter interaction. We design a nanoantenna array made of highly conductive layered MXene material, capitalizing on the lattice's unique properties to control the optical response. We demonstrate the chiral properties of this periodic array of MXene nanoantennas, and these properties are defined by the lattice periodicity. Despite being a lossy optical material in the near-infrared range, the lattice arrangement of MXene facilitates the excitation of stronger resonances, thereby enhancing its overall response. Utilizing chiral periodic lattices presents a promising avenue to significantly enhance the chiral response in lossy materials, including but not limited to MXene, transition metal dichalcogenides, and lossy metals.


title: Identifying Periods of Cyclical Stress in University Students Using Wearables In-the-Wild

abstract: University students encounter various forms of stress during their academic journey, including cyclical stress associated with final exams. Supporting their well-being means helping them manage their stress levels. In this study, we used a wearable health-tracking ring on a cohort of 103 Japanese university students for up to 28 months in the wild. The study aimed to investigate whether group-wide biomarkers of stress can be identified in a sample having similar daily schedules and whether these occurrences can be pinpointed to specific periods of the academic year. We found population-wide increased stress markers during exams, New Year's, and job hunting season, a Japanese job market peculiarity. Our results highlight the available potential of unobtrusive, in-situ detection of the current mental state of university student populations using off-the-shelf wearables from noisy data, with significant implications for the well-being of the users. Our approach and method of analysis allows for monitoring the student body's stress level without singling out individuals and therefore represents a privacy-preserving method. This way, new and sudden stress increases can be recognized, which can help identify the stressor and inform the design and introduction of counter measures.


title: Moir\'{e} optical phonons dancing with heavy electrons in magic-angle twisted bilayer graphene

abstract: Electron-phonon coupling in magic-angle twisted bilayer graphene is an important but difficult topic. We propose a scheme to simplify and understand this problem. Weighted by the coupling strength with the low-energy heavy electrons ($f$ orbitals), several moir\'{e} optical phonons are singled out which strongly couple to the flat bands. These modes have localized envelopes in the moir\'{e} scale, while in the atomic scale they inherit the monolayer oscillations like the Kekul\'{e} pattern. They flip the flavor of $f$ orbitals, helping stabilize some symmetry-breaking orders. Such electron-phonon couplings are incorporated into an effective extended Holstein model, where both phonons and electrons are written as moir\'{e} scale basis. We hope this model will inspire some insights guiding further studies about the superconductivity and other correlated effects in this system.


title: Photoelectron Polarization Vortexes in Strong-Field Ionization

abstract: The spin polarization of photoelectrons induced by an intense linearly polarized laser field is investigated using numerical solutions of the time-dependent Schr\"odinger equation in companion with our analytic treatment via the spin-resolved strong-field approximation and classical trajectory Monte Carlo simulations. We demonstrate that, even though the total polarization vanishes upon averaging over the photoelectron momentum, momentum-resolved spin polarization is significant, typically exhibiting a vortex structure relative to the laser polarization axis. The polarization arises from the transfer of spin-orbital coupling in the bound state to the spin-correlated quantum orbits in the continuum. The rescattering of photoelectrons at the atomic core plays an important role in forming the polarization vortex structure, while there is no significant effect of the spin-orbit coupling during the continuum dynamics. Furthermore, spin-polarized electron holography is demonstrated, feasible for extracting fine structural information about the atom.


title: Unveiling the Depths: A Multi-Modal Fusion Framework for Challenging Scenarios

abstract: Monocular depth estimation from RGB images plays a pivotal role in 3D vision. However, its accuracy can deteriorate in challenging environments such as nighttime or adverse weather conditions. While long-wave infrared cameras offer stable imaging in such challenging conditions, they are inherently low-resolution, lacking rich texture and semantics as delivered by the RGB image. Current methods focus solely on a single modality due to the difficulties to identify and integrate faithful depth cues from both sources. To address these issues, this paper presents a novel approach that identifies and integrates dominant cross-modality depth features with a learning-based framework. Concretely, we independently compute the coarse depth maps with separate networks by fully utilizing the individual depth cues from each modality. As the advantageous depth spreads across both modalities, we propose a novel confidence loss steering a confidence predictor network to yield a confidence map specifying latent potential depth areas. With the resulting confidence map, we propose a multi-modal fusion network that fuses the final depth in an end-to-end manner. Harnessing the proposed pipeline, our method demonstrates the ability of robust depth estimation in a variety of difficult scenarios. Experimental results on the challenging MS$^2$ and ViViD++ datasets demonstrate the effectiveness and robustness of our method.


title: Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversational Search

abstract: Conversational search, unlike single-turn retrieval tasks, requires understanding the current question within a dialogue context. The common approach of rewrite-then-retrieve aims to decontextualize questions to be self-sufficient for off-the-shelf retrievers, but most existing methods produce sub-optimal query rewrites due to the limited ability to incorporate signals from the retrieval results. To overcome this limitation, we present a novel framework RetPO (Retriever's Preference Optimization), which is designed to optimize a language model (LM) for reformulating search queries in line with the preferences of the target retrieval systems. The process begins by prompting a large LM to produce various potential rewrites and then collects retrieval performance for these rewrites as the retrievers' preferences. Through the process, we construct a large-scale dataset called RF collection, containing Retrievers' Feedback on over 410K query rewrites across 12K conversations. Furthermore, we fine-tune a smaller LM using this dataset to align it with the retrievers' preferences as feedback. The resulting model achieves state-of-the-art performance on two recent conversational search benchmarks, significantly outperforming existing baselines, including GPT-3.5.


title: Scaling Limit of Asymptotically-free Self-interacting Random Walks to Brownian Motion Perturbed at Extrema

abstract: We show convergence of a family of one-dimensional self-interacting random walks to Brownian motion perturbed at extrema under the diffusive scaling. This completes the functional limit theorem in [KMP23] for the asymptotically free case when $0<p \leq \frac{1}{2}$. The approach is to approximate the total drift experienced by the walker via analyzing directed edge local times, described by the branching-like processes. The analysis depends on the diffusion approximation of the branching-like processes obtained in the Ray-Knight type framework.


title: Deployment of Advanced and Intelligent Logistics Vehicles with Enhanced Tracking and Security Features

abstract: This study focuses on the implementation of modern and intelligent logistics vehicles equipped with advanced tracking and security features. In response to the evolving landscape of logistics management, the proposed system integrates cutting edge technologies to enhance efficiency and ensure the security of the entire logistics process. The core component of this implementation is the incorporation of state-of-the art tracking mechanisms, enabling real-time monitoring of vehicle locations and movements. Furthermore, the system addresses the paramount concern of security by introducing advanced security measures. Through the utilization of sophisticated tracking technologies and security protocols, the proposed logistics vehicles aim to safeguard both customer and provider data. The implementation includes the integration of QR code concepts, creating a binary image system that conceals sensitive information and ensures access only to authorized users. In addition to tracking and security, the study delves into the realm of information mining, employing techniques such as classification, clustering, and recommendation to extract meaningful patterns from vast datasets. Collaborative filtering techniques are incorporated to enhance customer experience by recommending services based on user preferences and historical data. This abstract encapsulates the comprehensive approach of deploying modern logistics vehicles, emphasizing their intelligence through advanced tracking, robust security measures, and data-driven insights. The proposed system aims to revolutionize logistics management, providing a seamless and secure experience for both customers and service providers in the dynamic logistics landscape.


title: Maximum Likelihood Quantum Error Mitigation for Algorithms with a Single Correct Output

abstract: Quantum error mitigation is an important technique to reduce the impact of noise in quantum computers. With more and more qubits being supported on quantum computers, there are two emerging fundamental challenges. First, the number of shots required for quantum algorithms with large numbers of qubits needs to increase in order to obtain a meaningful distribution or expected value of an observable. Second, although steady progress has been made in improving the fidelity of each qubit, circuits with a large number of qubits are likely to produce erroneous results. This low-shot, high-noise regime calls for highly scalable error mitigation techniques. In this paper, we propose a simple and effective mitigation scheme, qubit-wise majority vote, for quantum algorithms with a single correct output. We show that our scheme produces the maximum likelihood (ML) estimate under certain assumptions, and bound the number of shots required. Our experimental results on real quantum devices confirm that our proposed approach requires fewer shots than existing ones, and can sometimes recover the correct answers even when they are not observed from the measurement results.


title: Rock Classification Based on Residual Networks

abstract: Rock Classification is an essential geological problem since it provides important formation information. However, exploration on this problem using convolutional neural networks is not sufficient. To tackle this problem, we propose two approaches using residual neural networks. We first adopt data augmentation methods to enlarge our dataset. By modifying kernel sizes, normalization methods and composition based on ResNet34, we achieve an accuracy of 70.1% on the test dataset, with an increase of 3.5% compared to regular Resnet34. Furthermore, using a similar backbone like BoTNet that incorporates multihead self attention, we additionally use internal residual connections in our model. This boosts the model's performance, achieving an accuracy of 73.7% on the test dataset. We also explore how the number of bottleneck transformer blocks may influence model performance. We discover that models with more than one bottleneck transformer block may not further improve performance. Finally, we believe that our approach can inspire future work related to this problem and our model design can facilitate the development of new residual model architectures.


title: Thermodynamic Analysis of Algorithmic Cooling Protocols: Efficiency Metrics and Improved Designs

abstract: Algorithmic cooling (AC) protocols have been predominantly studied for their cooling capabilities, with limited attention paid to their thermodynamic properties. This work explores a novel perspective by analyzing a broad family of AC protocols from a thermodynamic standpoint. First, we give an in-depth review and formal classification of standard AC protocols. Leveraging the transfer matrix formalism, we achieve a consistent calculation of performance metrics, encompassing both cooling limits and target state evolution. We obtained a unification of these diverse cooling limits into a single, coherent mathematical expression, streamlining comparative analyses. Then, to assess the efficiency of coherent cooling protocols, we introduce two generic metrics: the coefficient of performance $K$ and the Landauer Ratio $R_L$, and establish a direct interrelation. Applying these metrics, we thoroughly evaluate selected AC protocols, highlighting their relative strengths. Finally, we propose improved versions of AC protocols that exhibit enhanced thermodynamic performance, achieving desired target temperatures with lower work inputs. This research contributes to a deeper understanding of AC protocols and provides valuable insights for designing efficient cooling strategies in various applications.


title: Approximation of plurisubharmonic functions by logarithms of Gaussian analytic functions

abstract: Let $\Omega$ be a bounded pseudoconvex domain in $\mathbb{C}^N$. Given a continuous plurisubharmonic function $u$ on $\Omega$, we construct a sequence of Gaussian analytic functions $f_n$ on $\Omega$ associated with $u$ such that $\frac{1}{n}\log|f_n|$ converges to $u$ in $L^1_{loc}(\Omega)$ almost surely, as $n\rightarrow\infty$. Gaussian analytic function $f_n$ is constructed by its covariance, or equivalently by its reproducing kernel Hilbert space, which is given by weighed Bergman space with weight $e^{-2nu}$ with respect to the Lebesgue measure. We show the normalized zeros of $f_n$ converge to $dd^c u$ in the sense of currents.


title: Terahertz User-Centric Clustering in the Presence of Beam Misalignment

abstract: Beam misalignment is one of the main challenges for the design of reliable wireless systems in terahertz (THz) bands. This paper investigates how to apply user-centric base station (BS) clustering as a valuable add-on in THz networks. In particular, to reduce the impact of beam misalignment, a user-centric BS clustering design that provides multi-connectivity via BS cooperation is investigated. The coverage probability is derived by leveraging an accurate approximation of the aggregate interference distribution that captures the effect of beam misalignment and THz fading. The numerical results reveal the impact of beam misalignment with respect to crucial link parameters, such as the transmitter's beam width and the serving cluster size, demonstrating that user-centric BS clustering is a promising enabler of THz networks.


title: Easy as ABCs: Unifying Boltzmann Q-Learning and Counterfactual Regret Minimization

abstract: We propose ABCs (Adaptive Branching through Child stationarity), a best-of-both-worlds algorithm combining Boltzmann Q-learning (BQL), a classic reinforcement learning algorithm for single-agent domains, and counterfactual regret minimization (CFR), a central algorithm for learning in multi-agent domains. ABCs adaptively chooses what fraction of the environment to explore each iteration by measuring the stationarity of the environment's reward and transition dynamics. In Markov decision processes, ABCs converges to the optimal policy with at most an O(A) factor slowdown compared to BQL, where A is the number of actions in the environment. In two-player zero-sum games, ABCs is guaranteed to converge to a Nash equilibrium (assuming access to a perfect oracle for detecting stationarity), while BQL has no such guarantees. Empirically, ABCs demonstrates strong performance when benchmarked across environments drawn from the OpenSpiel game library and OpenAI Gym and exceeds all prior methods in environments which are neither fully stationary nor fully nonstationary.


title: DIO: Dataset of 3D Mesh Models of Indoor Objects for Robotics and Computer Vision Applications

abstract: The creation of accurate virtual models of real-world objects is imperative to robotic simulations and applications such as computer vision, artificial intelligence, and machine learning. This paper documents the different methods employed for generating a database of mesh models of real-world objects. These methods address the tedious and time-intensive process of manually generating the models using CAD software. Essentially, DSLR/phone cameras were employed to acquire images of target objects. These images were processed using a photogrammetry software known as Meshroom to generate a dense surface reconstruction of the scene. The result produced by Meshroom was edited and simplified using MeshLab, a mesh-editing software to produce the final model. Based on the obtained models, this process was effective in modelling the geometry and texture of real-world objects with high fidelity. An active 3D scanner was also utilized to accelerate the process for large objects. All generated models and captured images are made available on the website of the project.


title: Self-Guided Robust Graph Structure Refinement

abstract: Recent studies have revealed that GNNs are vulnerable to adversarial attacks. To defend against such attacks, robust graph structure refinement (GSR) methods aim at minimizing the effect of adversarial edges based on node features, graph structure, or external information. However, we have discovered that existing GSR methods are limited by narrowassumptions, such as assuming clean node features, moderate structural attacks, and the availability of external clean graphs, resulting in the restricted applicability in real-world scenarios. In this paper, we propose a self-guided GSR framework (SG-GSR), which utilizes a clean sub-graph found within the given attacked graph itself. Furthermore, we propose a novel graph augmentation and a group-training strategy to handle the two technical challenges in the clean sub-graph extraction: 1) loss of structural information, and 2) imbalanced node degree distribution. Extensive experiments demonstrate the effectiveness of SG-GSR under various scenarios including non-targeted attacks, targeted attacks, feature attacks, e-commerce fraud, and noisy node labels. Our code is available at https://github.com/yeonjun-in/torch-SG-GSR.


title: UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction

abstract: Urban spatio-temporal prediction is crucial for informed decision-making, such as traffic management, resource optimization, and emergence response. Despite remarkable breakthroughs in pretrained natural language models that enable one model to handle diverse tasks, a universal solution for spatio-temporal prediction remains challenging Existing prediction approaches are typically tailored for specific spatio-temporal scenarios, requiring task-specific model designs and extensive domain-specific training data. In this study, we introduce UniST, a universal model designed for general urban spatio-temporal prediction across a wide range of scenarios. Inspired by large language models, UniST achieves success through: (i) utilizing diverse spatio-temporal data from different scenarios, (ii) effective pre-training to capture complex spatio-temporal dynamics, (iii) knowledge-guided prompts to enhance generalization capabilities. These designs together unlock the potential of building a universal model for various scenarios Extensive experiments on more than 20 spatio-temporal scenarios demonstrate UniST's efficacy in advancing state-of-the-art performance, especially in few-shot and zero-shot prediction. The datasets and code implementation are released on https://github.com/tsinghua-fib-lab/UniST.


title: An enhanced Teaching-Learning-Based Optimization (TLBO) with Grey Wolf Optimizer (GWO) for text feature selection and clustering

abstract: Text document clustering can play a vital role in organizing and handling the everincreasing number of text documents. Uninformative and redundant features included in large text documents reduce the effectiveness of the clustering algorithm. Feature selection (FS) is a well-known technique for removing these features. Since FS can be formulated as an optimization problem, various meta-heuristic algorithms have been employed to solve it. Teaching-Learning-Based Optimization (TLBO) is a novel meta-heuristic algorithm that benefits from the low number of parameters and fast convergence. A hybrid method can simultaneously benefit from the advantages of TLBO and tackle the possible entrapment in the local optimum. By proposing a hybrid of TLBO, Grey Wolf Optimizer (GWO), and Genetic Algorithm (GA) operators, this paper suggests a filter-based FS algorithm (TLBO-GWO). Six benchmark datasets are selected, and TLBO-GWO is compared with three recently proposed FS algorithms with similar approaches, the main TLBO and GWO. The comparison is conducted based on clustering evaluation measures, convergence behavior, and dimension reduction, and is validated using statistical tests. The results reveal that TLBO-GWO can significantly enhance the effectiveness of the text clustering technique (K-means).


title: An Endoscopic Chisel: Intraoperative Imaging Carves 3D Anatomical Models

abstract: Purpose: Preoperative imaging plays a pivotal role in sinus surgery where CTs offer patient-specific insights of complex anatomy, enabling real-time intraoperative navigation to complement endoscopy imaging. However, surgery elicits anatomical changes not represented in the preoperative model, generating an inaccurate basis for navigation during surgery progression. Methods: We propose a first vision-based approach to update the preoperative 3D anatomical model leveraging intraoperative endoscopic video for navigated sinus surgery where relative camera poses are known. We rely on comparisons of intraoperative monocular depth estimates and preoperative depth renders to identify modified regions. The new depths are integrated in these regions through volumetric fusion in a truncated signed distance function representation to generate an intraoperative 3D model that reflects tissue manipulation. Results: We quantitatively evaluate our approach by sequentially updating models for a five-step surgical progression in an ex vivo specimen. We compute the error between correspondences from the updated model and ground-truth intraoperative CT in the region of anatomical modification. The resulting models show a decrease in error during surgical progression as opposed to increasing when no update is employed. Conclusion: Our findings suggest that preoperative 3D anatomical models can be updated using intraoperative endoscopy video in navigated sinus surgery. Future work will investigate improvements to monocular depth estimation as well as removing the need for external navigation systems. The resulting ability to continuously update the patient model may provide surgeons with a more precise understanding of the current anatomical state and paves the way toward a digital twin paradigm for sinus surgery.


title: ASGNet: Adaptive Semantic Gate Networks for Log-Based Anomaly Diagnosis

abstract: Logs are widely used in the development and maintenance of software systems. Logs can help engineers understand the runtime behavior of systems and diagnose system failures. For anomaly diagnosis, existing methods generally use log event data extracted from historical logs to build diagnostic models. However, we find that existing methods do not make full use of two types of features, (1) statistical features: some inherent statistical features in log data, such as word frequency and abnormal label distribution, are not well exploited. Compared with log raw data, statistical features are deterministic and naturally compatible with corresponding tasks. (2) semantic features: Logs contain the execution logic behind software systems, thus log statements share deep semantic relationships. How to effectively combine statistical features and semantic features in log data to improve the performance of log anomaly diagnosis is the key point of this paper. In this paper, we propose an adaptive semantic gate networks (ASGNet) that combines statistical features and semantic features to selectively use statistical features to consolidate log text semantic representation. Specifically, ASGNet encodes statistical features via a variational encoding module and fuses useful information through a well-designed adaptive semantic threshold mechanism. The threshold mechanism introduces the information flow into the classifier based on the confidence of the semantic features in the decision, which is conducive to training a robust classifier and can solve the overfitting problem caused by the use of statistical features. The experimental results on the real data set show that our method proposed is superior to all baseline methods in terms of various performance indicators.


title: CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking

abstract: Transformer based code models have impressive performance in many software engineering tasks. However, their effectiveness degrades when symbols are missing or not informative. The reason is that the model may not learn to pay attention to the right correlations/contexts without the help of symbols. We propose a new method to pre-train general code models when symbols are lacking. We observe that in such cases, programs degenerate to something written in a very primitive language. We hence propose to use program analysis to extract contexts a priori (instead of relying on symbols and masked language modeling as in vanilla models). We then leverage a novel attention masking method to only allow the model attending to these contexts, e.g., bi-directional program dependence transitive closures and token co-occurrences. In the meantime, the inherent self-attention mechanism is utilized to learn which of the allowed attentions are more important compared to others. To realize the idea, we enhance the vanilla tokenization and model architecture of a BERT model, construct and utilize attention masks, and introduce a new pre-training algorithm. We pre-train this BERT-like model from scratch, using a dataset of 26 million stripped binary functions with explicit program dependence information extracted by our tool. We apply the model in three downstream tasks: binary similarity, type inference, and malware family classification. Our pre-trained model can improve the SOTAs in these tasks from 53% to 64%, 49% to 60%, and 74% to 94%, respectively. It also substantially outperforms other general pre-training techniques of code understanding models.


title: WildFake: A Large-scale Challenging Dataset for AI-Generated Images Detection

abstract: The extraordinary ability of generative models enabled the generation of images with such high quality that human beings cannot distinguish Artificial Intelligence (AI) generated images from real-life photographs. The development of generation techniques opened up new opportunities but concurrently introduced potential risks to privacy, authenticity, and security. Therefore, the task of detecting AI-generated imagery is of paramount importance to prevent illegal activities. To assess the generalizability and robustness of AI-generated image detection, we present a large-scale dataset, referred to as WildFake, comprising state-of-the-art generators, diverse object categories, and real-world applications. WildFake dataset has the following advantages: 1) Rich Content with Wild collection: WildFake collects fake images from the open-source community, enriching its diversity with a broad range of image classes and image styles. 2) Hierarchical structure: WildFake contains fake images synthesized by different types of generators from GANs, diffusion models, to other generative models. These key strengths enhance the generalization and robustness of detectors trained on WildFake, thereby demonstrating WildFake's considerable relevance and effectiveness for AI-generated detectors in real-world scenarios. Moreover, our extensive evaluation experiments are tailored to yield profound insights into the capabilities of different levels of generative models, a distinctive advantage afforded by WildFake's unique hierarchical structure.


title: Probing the accretion geometry of the atoll source 4U 1702-429 in different spectral states with NICER, NuSTAR, and AstroSat

abstract: We perform a comprehensive spectral study of a carefully selected sample (total exposure $\sim 50.5$ ks) of NICER observations of the atoll neutron star low-mass X-ray binary 4U 1702-429. Our sample encompasses nearly all classical spectral states found within the NICER dataset. We require two thermal emission components, originating from the accretion disc and the boundary layer, to describe the soft state spectra in the energy band 0.3-10.0 keV. In contrast, in our model, only the disc component directly contributes to the intermediate/hard state. Additionally, we use a thermally Comptonized component (or a power-law with pegged normalization) to represent the hard coronal emission in the soft and intermediate/hard state spectra. The boundary layer emerges as the principal source providing soft seed photons for Comptonization across all spectral states. In contrast to a previously held assertion regarding this source, our analyses reveal a decrease in the inner disc temperature coupled with the retreat of the inner disc from the neutron star surface as the source evolves from the soft to the intermediate/hard state. The reflection features are either absent or weak ($\sim 3\sigma-4\sigma$) in all these observations. Further investigation using broad-band NuSTAR (3.0-50.0 keV) and AstroSat spectra (1.3-25.0 keV) shows a slightly stronger iron emission line ($\sim 5.8\sigma$) in the NuSTAR spectra. However, this feature is not significantly detected in the AstroSat observation. The AstroSat data suggests a highly ionized disc, explaining the absence of reflection features. In the case of NuSTAR, a truncated disc is likely responsible for the weak reflection features.


title: Modularized Networks for Few-shot Hateful Meme Detection

abstract: In this paper, we address the challenge of detecting hateful memes in the low-resource setting where only a few labeled examples are available. Our approach leverages the compositionality of Low-rank adaptation (LoRA), a widely used parameter-efficient tuning technique. We commence by fine-tuning large language models (LLMs) with LoRA on selected tasks pertinent to hateful meme detection, thereby generating a suite of LoRA modules. These modules are capable of essential reasoning skills for hateful meme detection. We then use the few available annotated samples to train a module composer, which assigns weights to the LoRA modules based on their relevance. The model's learnable parameters are directly proportional to the number of LoRA modules. This modularized network, underpinned by LLMs and augmented with LoRA modules, exhibits enhanced generalization in the context of hateful meme detection. Our evaluation spans three datasets designed for hateful meme detection in a few-shot learning context. The proposed method demonstrates superior performance to traditional in-context learning, which is also more computationally intensive during inference.We then use the few available annotated samples to train a module composer, which assigns weights to the LoRA modules based on their relevance. The model's learnable parameters are directly proportional to the number of LoRA modules. This modularized network, underpinned by LLMs and augmented with LoRA modules, exhibits enhanced generalization in the context of hateful meme detection. Our evaluation spans three datasets designed for hateful meme detection in a few-shot learning context. The proposed method demonstrates superior performance to traditional in-context learning, which is also more computationally intensive during inference.


title: UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Models

abstract: The technological advancements in diffusion models (DMs) have demonstrated unprecedented capabilities in text-to-image generation and are widely used in diverse applications. However, they have also raised significant societal concerns, such as the generation of harmful content and copyright disputes. Machine unlearning (MU) has emerged as a promising solution, capable of removing undesired generative capabilities from DMs. However, existing MU evaluation systems present several key challenges that can result in incomplete and inaccurate assessments. To address these issues, we propose UnlearnCanvas, a comprehensive high-resolution stylized image dataset that facilitates the evaluation of the unlearning of artistic styles and associated objects. This dataset enables the establishment of a standardized, automated evaluation framework with 7 quantitative metrics assessing various aspects of the unlearning performance for DMs. Through extensive experiments, we benchmark 9 state-of-the-art MU methods for DMs, revealing novel insights into their strengths, weaknesses, and underlying mechanisms. Additionally, we explore challenging unlearning scenarios for DMs to evaluate worst-case performance against adversarial prompts, the unlearning of finer-scale concepts, and sequential unlearning. We hope that this study can pave the way for developing more effective, accurate, and robust DM unlearning methods, ensuring safer and more ethical applications of DMs in the future. The dataset, benchmark, and codes are publicly available at https://unlearn-canvas.netlify.app/.


title: A Study Guide to "Kaufman and Falconer estimates for radial projections"

abstract: This expository piece expounds on major themes and clarifies technical details of the paper "Kaufman and Falconer estimates for radial projections and a continuum version of Beck's theorem" of Orponen, Shmerkin, and Wang.


title: Comparison of solar multifrequency microwave data with other solar indices for understanding solar and stellar microwave data

abstract: Thermal microwave emissions detected from stellar atmospheres contain information on stellar activity. However, even for the Sun, the relationship between multifrequency microwave data and other activity indices remains unclear. We investigated the relationships among the thermal microwave fluxes with 1, 2, 3.75 and 9.4 GHz, their circular polarizations, and several activity indices recorded during recent solar cycles and observed that these relationships can be categorized into two groups. In the first group, the relationship between the microwave fluxes and solar indices, which are strongly related to the active regions, can be well-fitted by using a linear function. In the second group, the fitting function is dependent on frequency. Specifically, the microwave fluxes at 1 and 2 GHz can be well-fitted to the total unsigned magnetic and extreme ultraviolet fluxes by employing a power-law function. The trend changes around 3.75 GHz, and of the trend for the 9.4 GHz fluxes can be fitted by using a linear function. For the first time, we present the relationship between circular polarization and solar indices. Moreover, we extrapolated these relationships of the solar microwave fluxes to higher values and compared them with the solar-type stars. We found that epsilon Eri, whose microwave emission originates from thermal plasma, follows the extrapolated relationship. However, to date, only one star's emission at 1--10 GHz has been confirmed as thermal emission. More solar-type stars should be observed with future radio interferometers to confirm that relationships based on solar data can be applied to stellar microwave data.


title: ComFusion: Personalized Subject Generation in Multiple Specific Scenes From Single Image

abstract: Recent advancements in personalizing text-to-image (T2I) diffusion models have shown the capability to generate images based on personalized visual concepts using a limited number of user-provided examples. However, these models often struggle with maintaining high visual fidelity, particularly in manipulating scenes as defined by textual inputs. Addressing this, we introduce ComFusion, a novel approach that leverages pretrained models generating composition of a few user-provided subject images and predefined-text scenes, effectively fusing visual-subject instances with textual-specific scenes, resulting in the generation of high-fidelity instances within diverse scenes. ComFusion integrates a class-scene prior preservation regularization, which leverages composites the subject class and scene-specific knowledge from pretrained models to enhance generation fidelity. Additionally, ComFusion uses coarse generated images, ensuring they align effectively with both the instance image and scene texts. Consequently, ComFusion maintains a delicate balance between capturing the essence of the subject and maintaining scene fidelity.Extensive evaluations of ComFusion against various baselines in T2I personalization have demonstrated its qualitative and quantitative superiority.


title: The Molecular Exoskeleton of the Ring-like Planetary Nebula NGC 3132

abstract: We present Submillimeter Array (SMA) mapping of $^{12}$CO $J=2\rightarrow 1$, $^{13}$CO $J=2\rightarrow 1$, and CN $N=2\rightarrow 1$ emission from the Ring-like planetary nebula (PN) NGC 3132, one of the subjects of JWST Early Release Observation (ERO) near-infrared imaging. The $\sim$5$''$ resolution SMA data demonstrate that the Southern Ring's main, bright, molecule-rich ring is indeed an expanding ring, as opposed to a limb-brightened shell, in terms of its intrinsic (physical) structure. This suggests that NGC 3132 is a bipolar nebula viewed more or less pole-on (inclination $\sim$15--30$^\circ$). The SMA data furthermore reveal that the nebula harbors a second expanding molecular ring that is aligned almost orthogonally to the main, bright molecular ring. We propose that this two-ring structure is the remnant of an ellipsoidal molecular envelope of ejecta that terminated the progenitor star's asymptotic giant branch evolution and was subsequently disrupted by a series of misaligned fast, collimated outflows or jets resulting from interactions between the progenitor and one or more companions.


title: Exponential contractivity and propagation of chaos for Langevin dynamics of McKean-Vlasov type with L\'evy noises

abstract: By the probabilistic coupling approach which combines a new refined basic coupling with the synchronous coupling for L\'evy processes, we obtain explicit exponential contraction rates in terms of the standard $L^1$-Wasserstein distance for the following Langevin dynamic $(X_t,Y_t)_{t\ge0}$ of McKean-Vlasov type on $\mathbb{R}^{2d}$: \begin{equation*}\left\{\begin{array}{l} dX_t=Y_tdt,\\ dY_t=\left(b(X_t)+\displaystyle\int_{\mathbb{R}^d}\tilde{b}(X_t,z)\mu^X_t(dz)-\gamma Y_t\right)dt+dL_t,\quad \mu^X_t={\rm Law}(X_t),\end{array}\right. \end{equation*} where $\gamma>0$, $b:\mathbb{R}^d\rightarrow\mathbb{R}^d$ and $\tilde{b}:\mathbb{R}^{2d}\rightarrow\mathbb{R}^d$ are two globally Lipschitz continuous functions, and $(L_t)_{t\ge0}$ is an $\mathbb{R}^d$-valued pure jump L\'evy process. The proof is also based on a novel distance function, which is designed according to the distance of the marginals associated with the constructed coupling process. Furthermore, by applying the coupling technique above with some modifications, we also provide the propagation of chaos uniformly in time for the corresponding mean-field interacting particle systems with L\'evy noises in the standard $L^1$-Wasserstein distance as well as with explicit bounds.


title: Forcing techniques for Cicho\'n's Maximum: Lecture notes for the mini-course at the University of Vienna

abstract: Cicho\'n's diagram describes the connections between combinatorial notions related to measure, category, and compactness of sets of irrational numbers. In the second part of the 2010's decade, Goldstern, Kellner and Shelah constructed a forcing model of Cicho\'n's Maximum (meaning that all non-dependent cardinal characteristics are pairwise different) by using large cardinals. Some years later, we eliminated this large cardinal assumption. In this mini-course, we explore the forcing techniques to construct the Cicho\'n's Maximum model and much more.


title: Beyond Voice Assistants: Exploring Advantages and Risks of an In-Car Social Robot in Real Driving Scenarios

abstract: In-car Voice Assistants (VAs) play an increasingly critical role in automotive user interface design. However, existing VAs primarily perform simple 'query-answer' tasks, limiting their ability to sustain drivers' long-term attention. In this study, we investigate the effectiveness of an in-car Robot Assistant (RA) that offers functionalities beyond voice interaction. We aim to answer the question: How does the presence of a social robot impact user experience in real driving scenarios? Our study begins with a user survey to understand perspectives on in-car VAs and their influence on driving experiences. We then conduct non-driving and on-road experiments with selected participants to assess user experiences with an RA. Additionally, we conduct subjective ratings to evaluate user perceptions of the RA's personality, which is crucial for robot design. We also explore potential concerns regarding ethical risks. Finally, we provide a comprehensive discussion and recommendations for the future development of in-car RAs.


title: Geometric States

abstract: We introduce a special family of distributional alpha-densities and give a transversality criterion stating when their product is defined, closely related to Hormander's criterion for general distributions. Moreover, we show that for the subspace of distributional half-densities in this family the distribution product naturally yields a pairing that extends the usual one on smooth half-densities.


title: TriSampler: A Better Negative Sampling Principle for Dense Retrieval

abstract: Negative sampling stands as a pivotal technique in dense retrieval, essential for training effective retrieval models and significantly impacting retrieval performance. While existing negative sampling methods have made commendable progress by leveraging hard negatives, a comprehensive guiding principle for constructing negative candidates and designing negative sampling distributions is still lacking. To bridge this gap, we embark on a theoretical analysis of negative sampling in dense retrieval. This exploration culminates in the unveiling of the quasi-triangular principle, a novel framework that elucidates the triangular-like interplay between query, positive document, and negative document. Fueled by this guiding principle, we introduce TriSampler, a straightforward yet highly effective negative sampling method. The keypoint of TriSampler lies in its ability to selectively sample more informative negatives within a prescribed constrained region. Experimental evaluation show that TriSampler consistently attains superior retrieval performance across a diverse of representative retrieval models.


title: Exponential attractors for a nonlocal delayed reaction-diffusion equation on an unbounded domain

abstract: The main objective of this paper is to investigate exponential attractors for a nonlocal delayed reaction-diffusion equation on an unbounded domain. We first obtain the existence of a globally attractive absorbing set for the dynamical system generated by the equation under the assumption that the nonlinear term is bounded. Then, we construct exponential attractors of the equation directly in its natural phase space, i.e., a Banach space with explicit fractal dimension by combining squeezing properties of the system as well as a covering lemma of finite subspace of Banach spaces. Our result generalizes the methods established in Hilbert spaces and weighted spaces, and the fractal dimension of the obtained exponential attractor does not depend on the entropy number but only depends on some inner characteristic of the studied equation.


title: Communication-Efficient Distributed Learning with Local Immediate Error Compensation

abstract: Gradient compression with error compensation has attracted significant attention with the target of reducing the heavy communication overhead in distributed learning. However, existing compression methods either perform only unidirectional compression in one iteration with higher communication cost, or bidirectional compression with slower convergence rate. In this work, we propose the Local Immediate Error Compensated SGD (LIEC-SGD) optimization algorithm to break the above bottlenecks based on bidirectional compression and carefully designed compensation approaches. Specifically, the bidirectional compression technique is to reduce the communication cost, and the compensation technique compensates the local compression error to the model update immediately while only maintaining the global error variable on the server throughout the iterations to boost its efficacy. Theoretically, we prove that LIEC-SGD is superior to previous works in either the convergence rate or the communication cost, which indicates that LIEC-SGD could inherit the dual advantages from unidirectional compression and bidirectional compression. Finally, experiments of training deep neural networks validate the effectiveness of the proposed LIEC-SGD algorithm.


title: Stochastic Hessian Fittings with Lie Groups

abstract: This paper studies the fitting of Hessian or its inverse for stochastic optimizations using a Hessian fitting criterion from the preconditioned stochastic gradient descent (PSGD) method, which is intimately related to many commonly used second order and adaptive gradient optimizers, e.g., BFGS, Gaussian-Newton and natural gradient descent, AdaGrad, etc. Our analyses reveal the efficiency and reliability differences among a wide range of preconditioner fitting methods, from closed-form to iterative solutions, using Hessian-vector products or stochastic gradients only, with Hessian fittings in the Euclidean space, the manifold of symmetric positive definite (SPL) matrices, to a variety of Lie groups. The most intriguing discovery is that the Hessian fitting itself as an optimization problem is strongly convex under mild conditions with a specific yet general enough Lie group. This discovery turns Hessian fitting into a well behaved optimization problem, and facilitates the designs of highly efficient and elegant Lie group sparse preconditioner fitting methods for large scale stochastic optimizations.


title: Multistep severe plastic deformation to achieve non-rare earth bulk magnets with high {\alpha}-MnBi phase content

abstract: The ferromagnetic {\alpha}-MnBi phase as non-rare earth magnetic material has gained increasing interest, but fabrication of large volumes containing a significant amount of {\alpha}-MnBi is still challenging. Targeting successful processing strategies, we apply multistep severe plastic deformation with intermediate magnetic field assisted annealing. The subsequent severe plastic deformation renewed the high amount of material defects and lead to microstructural refinement of the previously formed {\alpha}-MnBi phase. Thus, {\alpha}-MnBi phase content is enhanced during final annealing. Secondly, the magnetic coercivity increases. These results suggest that further optimization will pave the way towards non-rare-earth bulk magnetic materials with enhanced {\alpha}-MnBi phase content.


title: The weighted projective superspace with weights $+1, -1$ and an analog of the Fubini--Study form

abstract: As a by-product of our work on super Pl\"{u}cker embedding, we came to the notion of a weighted projective superspace $P_{+1,-1}(V\oplus W)$ with weights $+1,-1$. The construction is not in itself super and makes sense in ordinary (purely even) framework. Unlike the familiar weighted projective spaces with positive weights, the (super)space $P_{+1,-1}(V\oplus W)$ is a smooth (super)manifold. We describe its structure and show that it possesses an analog of the Fubini--Study form.


title: Searching for QPOs in BATSE Short Gamma-ray Bursts Based on Narrowband and Broadband Features

abstract: Gamma-ray bursts (GRBs), especially short GRBs, are often considered potential candidates for exhibiting kilohertz quasi-periodic oscillations (QPOs) due to their origin from binary mergers. It has already been discovered that two bursts exhibit QPOs. While systematic searches for QPOs in GRBs typically concentrate on the kilohertz range, there has been no comprehensive exploration in the hundred-hertz range. In this study, we systematically conducted QPO searches on all BATSE short burst data within the 0-1000 Hz range. Using nested significance tests, we observed that the reference distributions for different GRBs are quite similar. This observation prompted us to analyze the data by selectively focusing on those with larger statistical values, obviating the need to iterate through all the data and significantly reducing computational workload. Ultimately, our findings did not reveal any compelling evidence for QPOs, which may suggest that the GRB jet has lost the early merging memory.


title: The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment

abstract: Organizations rely on phishing interventions to enhance employees' vigilance and safe responses to phishing emails that bypass technical solutions. While various resources are available to counteract phishing, studies emphasize the need for interactive and practical training approaches. To investigate the effectiveness of such an approach, we developed and delivered two anti-phishing trainings, group discussion and role-playing, at a European university. We conducted a pre-registered experiment (N = 105), incorporating repeated measures at three time points, a control group, and three in-situ phishing tests. Both trainings enhanced employees' anti-phishing self-efficacy and support-seeking intention in within-group analyses. Only the role-playing training significantly improved support-seeking intention when compared to the control group. Participants in both trainings reported more phishing tests and demonstrated heightened vigilance to phishing attacks compared to the control group. We discuss practical implications for evaluating and improving phishing interventions and promoting safe responses to phishing threats within organizations.


title: How Interpretable are Reasoning Explanations from Prompting Large Language Models?

abstract: Prompt Engineering has garnered significant attention for enhancing the performance of large language models across a multitude of tasks. Techniques such as the Chain-of-Thought not only bolster task performance but also delineate a clear trajectory of reasoning steps, offering a tangible form of explanation for the audience. Prior works on interpretability assess the reasoning chains yielded by Chain-of-Thought solely along a singular axis, namely faithfulness. We present a comprehensive and multifaceted evaluation of interpretability, examining not only faithfulness but also robustness and utility across multiple commonsense reasoning benchmarks. Likewise, our investigation is not confined to a single prompting technique; it expansively covers a multitude of prevalent prompting techniques employed in large language models, thereby ensuring a wide-ranging and exhaustive evaluation. In addition, we introduce a simple interpretability alignment technique, termed Self-Entailment-Alignment Chain-of-thought, that yields more than 70\% improvements across multiple dimensions of interpretability. Code is available at https://github.com/SenticNet/CoT_interpretability


title: The Price of Information

abstract: When an investor is faced with the option to purchase additional information regarding an asset price, how much should she pay? To address this question, we solve for the indifference price of information in a setting where a trader maximizes her expected utility of terminal wealth over a finite time horizon. If she does not purchase the information, then she solves a partial information stochastic control problem, while, if she does purchase the information, then she pays a cost and receives partial information about the asset's trajectory. We further demonstrate that when the investor can purchase the information at any stopping time prior to the end of the trading horizon, she chooses to do so at a deterministic time.


title: Entanglement Measure Based on Optimal Entanglement Witness

abstract: We introduce a new entanglement measure based on optimal entanglement witness. First of all, we show that the entanglement measure satisfies some necessary properties, including zero entanglements for all separable states, convexity, continuity, invariance under local unitary operations and non-increase under local operations and classical communication(LOCC). More than that, we give a specific mathematical expression for the lower bound of this entanglement measure for any bipartite mixed states. We further improve the lower bound for 2$ \otimes $2 systems. Finally, we numerically simulate the lower bound of several types of specific quantum states.


title: Two Online Map Matching Algorithms Based on Analytic Hierarchy Process and Fuzzy Logic

abstract: Our aim of this paper is to develop new map matching algorithms and to improve upon previous work. We address two key approaches: Analytic Hierarchy Process (AHP) map matching and fuzzy logic map matching. AHP is a decision-making method that combines mathematical analysis with human judgment, and fuzzy logic is an approach to computing based on the degree of truth and aims at modeling the imprecise modes of reasoning from 0 to 1 rather than the usual boolean logic. Of these algorithms, the way of our applying AHP to map matching is newly developed in this paper, meanwhile, our application of fuzzy logic to map matching is mostly the same as existing research except for some small changes. Because of the common characteristic that both methods are designed to handle imprecise information and simplicity for implementation, we decided to use these methods.


title: LoRA Training in the NTK Regime has No Spurious Local Minima

abstract: Low-rank adaptation (LoRA) has become the standard approach for parameter-efficient fine-tuning of large language models (LLM), but our theoretical understanding of LoRA has been limited. In this work, we theoretically analyze LoRA fine-tuning in the neural tangent kernel (NTK) regime with $N$ data points, showing: (i) full fine-tuning (without LoRA) admits a low-rank solution of rank $r\lesssim \sqrt{N}$; (ii) using LoRA with rank $r\gtrsim \sqrt{N}$ eliminates spurious local minima, allowing gradient descent to find the low-rank solutions; (iii) the low-rank solution found using LoRA generalizes well.


title: Recent Extensions of the ZKCM Library for Parallel and Accurate MPS Simulation of Quantum Circuits

abstract: A C++ library ZKCM and its extension library ZKCM_QC have been developed since 2011 for multiple-precision matrix computation and accurate matrix-product-state (MPS) quantum circuit simulation, respectively. In this report, a recent progress in the extensions of these libraries is described, which are mainly for parallel processing with the OpenMP and CUDA frameworks.


title: Orbital-rotated Fermi-Hubbard model as a benchmarking problem for quantum chemistry with the exact solution

abstract: Evaluating the relative performance of different quantum algorithms for quantum computers is of great significance in the research of quantum algorithms. In this study, we consider the problem of quantum chemistry, which is considered one of the important applications of quantum algorithms. While evaluating these algorithms in systems with a large number of qubits is essential to see the scalability of the algorithms, the solvable models usually used for such evaluations typically have a small number of terms compared to the molecular Hamiltonians used in quantum chemistry. The large number of terms in molecular Hamiltonians is a major bottleneck when applying quantum algorithms to quantum chemistry. Various methods are being considered to address this problem, highlighting its importance in developing quantum algorithms for quantum chemistry. Based on these points, a solvable model with a number of terms comparable to the molecular Hamiltonian is essential to evaluate the performance of such algorithms. In this paper, we propose a set of exactly solvable Hamiltonians that has a comparable order of terms with molecular Hamiltonians by applying a spin-involving orbital rotation to the one-dimensional Fermi-Hubbard Hamiltonian. We verify its similarity to the molecular Hamiltonian from some prospectives and investigate whether the difficulty of calculating the ground-state energy changes before and after orbital rotation by applying the density matrix renormalization group up to 24 sites corresponding to 48 qubits. This proposal would enable proper evaluation of the performance of quantum algorithms for quantum chemistry, serving as a guiding framework for algorithm development.


title: Cooperative Backscatter Communications with Reconfigurable Intelligent Surfaces: An APSK Approach

abstract: In this paper, a novel amplitude phase shift keying (APSK) modulation scheme for cooperative backscatter communications aided by a reconfigurable intelligent surface (RIS-CBC) is presented, according to which the RIS is configured to modulate backscatter information onto unmodulated or PSK-modulated signals impinging on its surface via APSK. We consider both passive and active RISs, with the latter including an amplification unit at each reflecting element. In the passive (resp. active) RIS-CBC-APSK, backscatter information is conveyed through the number of RIS reflecting elements being on the ON state (resp. active mode) and their phase shift values. By using the optimal APSK constellation to ensure that reflected signals from the RIS undergo APSK modulation, a bit-mapping mechanism is presented. Assuming maximum-likelihood detection, we also present closed-form upper bounds for the symbol error rate (SER) performance for both passive and active RIS-CBC-APSK schemes over Rician fading channels. In addition, we devise a low-complexity detector that can achieve flexible trade-offs between performance and complexity. Finally, we extend RIS-CBC-APSK to multiple-input single-output scenarios and present an alternating optimization approach for the joint design of transmit beamforming and RIS reflection. Our extensive simulation results on the SER performance corroborate our conducted performance analysis and showcase the superiority of the proposed RIS-CBC-APSK schemes over the state-of-the-art RIS-CBC benchmarks.


title: From Reals to Logic and Back: Inventing Symbolic Vocabularies, Actions, and Models for Planning from Raw Data

abstract: Hand-crafted, logic-based state and action representations have been widely used to overcome the intractable computational complexity of long-horizon robot planning problems, including task and motion planning problems. However, creating such representations requires experts with strong intuitions and detailed knowledge about the robot and the tasks it may need to accomplish in a given setting. Removing this dependency on human intuition is a highly active research area. This paper presents the first approach for autonomously learning generalizable, logic-based relational representations for abstract states and actions starting from unannotated high-dimensional, real-valued robot trajectories. The learned representations constitute auto-invented PDDL-like domain models. Empirical results in deterministic settings show that powerful abstract representations can be learned from just a handful of robot trajectories; the learned relational representations include but go beyond classical, intuitive notions of high-level actions; and that the learned models allow planning algorithms to scale to tasks that were previously beyond the scope of planning without hand-crafted abstractions.