title: Unexpected Uncertainty Principle for Disc Banach Spaces

abstract: Let $(\{f_n\}_{n=1}^\infty, \{\tau_n\}_{n=1}^\infty)$ and $(\{g_n\}_{n=1}^\infty, \{\omega_n\}_{n=1}^\infty)$ be unbounded continuous p-Schauder frames ($0<p<1$) for a disc Banach space $\mathcal{X}$. Then for every $x \in ( \mathcal{D}(\theta_f) \cap\mathcal{D}(\theta_g))\setminus\{0\}$, we show that \begin{align}\label{UB} (1) \quad \quad \quad \quad \|\theta_f x\|_0\|\theta_g x\|_0 \geq \frac{1}{\left(\displaystyle\sup_{n,m \in \mathbb{N} }|f_n(\omega_m)|\right)^p\left(\displaystyle\sup_{n, m \in \mathbb{N}}|g_m(\tau_n)|\right)^p}, \end{align} where \begin{align*} & \theta_f: \mathcal{D}(\theta_f) \ni x \mapsto \theta_fx := \{f_n(x)\}_{n=1}^\infty\in \ell^p(\mathbb{N}), \quad \theta_g: \mathcal{D}(\theta_g) \ni x \mapsto \theta_gx := \{g_n(x)\}_{n=1}^\infty\in \ell^p(\mathbb{N}). \end{align*} Inequality (1) is unexpectedly different from both bounded uncertainty principle arXiv:2308.00312v1 and unbounded uncertainty principle arXiv:2312.00366v1 for Banach spaces.


title: Clues in Bailey Diagrams Indicate that the Horizontal Branch Evolutionary Effect Is the Direct Reason for Oosterhoff Phenomenon

abstract: Noticing the potential relationship between the pulsation amplitude of fundamental mode RR Lyrae stars and their average effective temperatures, we derived the relation between them from observational data. Using these relationships, we present the zero-age horizontal branch lines and corresponding evolutionary tracks in the Bailey diagrams. We first find that the trends of zero-age horizontal branch lines are consistent with the distributions of Oosterhoff I RR Lyrae stars, and there is a period shift effect in relatively metal-rich samples ([Fe/H] > -1). Main results show that evolutionary effects are the direct cause of the Oosterhoff dichotomy. The vast majority of Oosterhoff I RR Lyrae stars are in the early stage of horizontal branch evolution, while most of the Oosterhoff II stars are near the end of the horizontal branch phase. Our Bailey diagrams can intuitively explain some Oosterhoff phenomena (e.g., long-period RR Lyrae stars in the metal-rich globular clusters NGC 6388 and NGC 6441), and also have the potential to become an important tool for in-depth study of RR Lyrae stars. Further research is needed on the Oosterhoff dichotomy to explore the formations and evolutionary processes of the Milky Way and its substructures.


title: Inference in Randomized Least Squares and PCA via Normality of Quadratic Forms

abstract: Randomized algorithms can be used to speed up the analysis of large datasets. In this paper, we develop a unified methodology for statistical inference via randomized sketching or projections in two of the most fundamental problems in multivariate statistical analysis: least squares and PCA. The methodology applies to fixed datasets -- i.e., is data-conditional -- and the only randomness is due to the randomized algorithm. We propose statistical inference methods for a broad range of sketching distributions, such as the subsampled randomized Hadamard transform (SRHT), Sparse Sign Embeddings (SSE) and CountSketch, sketching matrices with i.i.d. entries, and uniform subsampling. To our knowledge, no comparable methods are available for SSE and for SRHT in PCA. Our novel theoretical approach rests on showing the asymptotic normality of certain quadratic forms. As a contribution of broader interest, we show central limit theorems for quadratic forms of the SRHT, relying on a novel proof via a dyadic expansion that leverages the recursive structure of the Hadamard transform. Numerical experiments using both synthetic and empirical datasets support the efficacy of our methods, and in particular suggest that sketching methods can have better computation-estimation tradeoffs than recently proposed optimal subsampling methods.


title: LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction

abstract: Existing methods to fine-tune LLMs, like Adapter, Prefix-tuning, and LoRA, which introduce extra modules or additional input sequences to inject new skills or knowledge, may compromise the innate abilities of LLMs. In this paper, we propose LLaMA-Excitor, a lightweight method that stimulates the LLMs' potential to better follow instructions by gradually paying more attention to worthwhile information. Specifically, the LLaMA-Excitor does not directly change the intermediate hidden state during the self-attention calculation of the transformer structure. We designed the Excitor block as a bypass module for the similarity score computation in LLMs' self-attention to reconstruct keys and change the importance of values by learnable prompts. LLaMA-Excitor ensures a self-adaptive allocation of additional attention to input instructions, thus effectively preserving LLMs' pre-trained knowledge when fine-tuning LLMs on low-quality instruction-following datasets. Furthermore, we unify the modeling of multi-modal tuning and language-only tuning, extending LLaMA-Excitor to a powerful visual instruction follower without the need for complex multi-modal alignment. Our proposed approach is evaluated in language-only and multi-modal tuning experimental scenarios. Notably, LLaMA-Excitor is the only method that maintains basic capabilities while achieving a significant improvement (+6%) on the MMLU benchmark. In the visual instruction tuning, we achieve a new state-of-the-art image captioning performance of 157.5 CIDEr on MSCOCO, and a comparable performance (88.39%) on ScienceQA to cutting-edge models with more parameters and extensive vision-language pertaining.


title: Token-Efficient Leverage Learning in Large Language Models

abstract: Large Language Models (LLMs) have excelled in various tasks but perform better in high-resource scenarios, which presents challenges in low-resource scenarios. Data scarcity and the inherent difficulty of adapting LLMs to specific tasks compound the challenge. To address the twin hurdles, we introduce \textbf{Leverage Learning}. We present a streamlined implement of this methodology called Token-Efficient Leverage Learning (TELL). TELL showcases the potential of Leverage Learning, demonstrating effectiveness across various LLMs and low-resource tasks, ranging from $10^4$ to $10^6$ tokens. It reduces task data requirements by up to nearly an order of magnitude compared to conventional Supervised Fine-Tuning (SFT) while delivering competitive performance. With the same amount of task data, TELL leads in improving task performance compared to SFT. We discuss the mechanism of Leverage Learning, suggesting it aligns with quantization hypothesis and explore its promising potential through empirical testing.


title: Scalable 3D Registration via Truncated Entry-wise Absolute Residuals

abstract: Given an input set of $3$D point pairs, the goal of outlier-robust $3$D registration is to compute some rotation and translation that align as many point pairs as possible. This is an important problem in computer vision, for which many highly accurate approaches have been recently proposed. Despite their impressive performance, these approaches lack scalability, often overflowing the $16$GB of memory of a standard laptop to handle roughly $30,000$ point pairs. In this paper, we propose a $3$D registration approach that can process more than ten million ($10^7$) point pairs with over $99\%$ random outliers. Moreover, our method is efficient, entails low memory costs, and maintains high accuracy at the same time. We call our method TEAR, as it involves minimizing an outlier-robust loss that computes Truncated Entry-wise Absolute Residuals. To minimize this loss, we decompose the original $6$-dimensional problem into two subproblems of dimensions $3$ and $2$, respectively, solved in succession to global optimality via a customized branch-and-bound method. While branch-and-bound is often slow and unscalable, this does not apply to TEAR as we propose novel bounding functions that are tight and computationally efficient. Experiments on various datasets are conducted to validate the scalability and efficiency of our method.


title: Gyro-based Neural Single Image Deblurring

abstract: In this paper, we present GyroDeblurNet, a novel single image deblurring method that utilizes a gyro sensor to effectively resolve the ill-posedness of image deblurring. The gyro sensor provides valuable information about camera motion during exposure time that can significantly improve deblurring quality. However, effectively exploiting real-world gyro data is challenging due to significant errors from various sources including sensor noise, the disparity between the positions of a camera module and a gyro sensor, the absence of translational motion information, and moving objects whose motions cannot be captured by a gyro sensor. To handle gyro error, GyroDeblurNet is equipped with two novel neural network blocks: a gyro refinement block and a gyro deblurring block. The gyro refinement block refines the error-ridden gyro data using the blur information from the input image. On the other hand, the gyro deblurring block removes blur from the input image using the refined gyro data and further compensates for gyro error by leveraging the blur information from the input image. For training a neural network with erroneous gyro data, we propose a training strategy based on the curriculum learning. We also introduce a novel gyro data embedding scheme to represent real-world intricate camera shakes. Finally, we present a synthetic dataset and a real dataset for the training and evaluation of gyro-based single image deblurring. Our experiments demonstrate that our approach achieves state-of-the-art deblurring quality by effectively utilizing erroneous gyro data.


title: Continuous crossover between insulating ferroelectrics and the polar metals: \textit{Ab initio} calculation of structural phase transitions of Li$B$O$_3$ ($B$ = Ta, W, Re, Os)

abstract: Inspired by the recent discovery of a new polar metal LiReO$_3$ by K. Murayama, \textit{et al}, we calculate the temperature($T$)-dependent crystal structures of Li$B$O3 with $B$ = Ta, W, Re, Os, using the self-consistent phonon (SCPH) theory. We have reproduced the experimentally observed polar-nonpolar structural phase transitions and the transition temperatures ($T_c$) of LiTaO$_3$, LiReO$_3$, and LiOsO$_3$. From the calculation, we predict that LiWO$_3$ is a polar metal, which is yet to be tested experimentally. Upon doping electrons to the insulating LiTaO$_3$, the predicted $T_c$ is quickly suppressed and approaches those of the polar metals. Thus, there is a continuous crossover between ferroelectric insulators and polar metals if we dope electrons to the polar metals. Investigating the detailed material dependence of the interatomic force constants (IFCs), we explicitly show that the suppression of $T_c$ in polar metals can be ascribed to the screening of the long-range Li-O interaction, which is caused by the presence of the itinerant electrons.


title: Rethinking Saliency-Guided Weakly-Supervised Semantic Segmentation

abstract: This paper presents a fresh perspective on the role of saliency maps in weakly-supervised semantic segmentation (WSSS) and offers new insights and research directions based on our empirical findings. We conduct comprehensive experiments and observe that the quality of the saliency map is a critical factor in saliency-guided WSSS approaches. Nonetheless, we find that the saliency maps used in previous works are often arbitrarily chosen, despite their significant impact on WSSS. Additionally, we observe that the choice of the threshold, which has received less attention before, is non-trivial in WSSS. To facilitate more meaningful and rigorous research for saliency-guided WSSS, we introduce \texttt{WSSS-BED}, a standardized framework for conducting research under unified conditions. \texttt{WSSS-BED} provides various saliency maps and activation maps for seven WSSS methods, as well as saliency maps from unsupervised salient object detection models.


title: Nishimori's self-tuning as evidence for the existence of God

abstract: Apparent violations of Naturalness may be explained by positing the existence of an omniscient but disinterested and possibly fallible Observer who regularly performs von Neumann measurements on us (and everything else). We comment briefly on the implications for the construction of scalable quantum computers.


title: Farside-dominant quasinuclear rainbow in refractive $\alpha$+$\alpha$ scattering

abstract: $\alpha$+$\alpha$ scattering has a long history since the first experiment by Rutherford and Chadwick in 1927 and has been studied thoroughly experimentally and theoretically. However, $\alpha$+$\alpha$ scattering has never been paid attention from the viewpoint of refractive scattering. I have successfully analyzed the experimental angular distributions in $\alpha$+$\alpha$ scattering systematically over a wide range of incident energies $E_L$=53.4 - 280 MeV using a phenomenological optical model with a deep real potential. The existence of a farside-dominant quasinuclear rainbow with no well-defined rainbow angle and no supernumerary bow in the lit side followed by the shadow, which is not a genuine rainbow but a refractive scattering from a marginally small droplet at high energies, is found for the first time in $\alpha$+$\alpha$ scattering. The refraction due to the deep potentials with an attractive core at short distances are discussed from the viewpoint of the Luneburg. The deep vs shallow problem of the potential and the nuclear rainbow scattering in inelastic channels are also discussed.


title: Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting

abstract: This paper presents a new practical training method for human matting, which demands delicate pixel-level human region identification and significantly laborious annotations. To reduce the annotation cost, most existing matting approaches often rely on image synthesis to augment the dataset. However, the unnaturalness of synthesized training images brings in a new domain generalization challenge for natural images. To address this challenge, we introduce a new learning paradigm, weakly semi-supervised human matting (WSSHM), which leverages a small amount of expensive matte labels and a large amount of budget-friendly segmentation labels, to save the annotation cost and resolve the domain generalization problem. To achieve the goal of WSSHM, we propose a simple and effective training method, named Matte Label Blending (MLB), that selectively guides only the beneficial knowledge of the segmentation and matte data to the matting model. Extensive experiments with our detailed analysis demonstrate our method can substantially improve the robustness of the matting model using a few matte data and numerous segmentation data. Our training method is also easily applicable to real-time models, achieving competitive accuracy with breakneck inference speed (328 FPS on NVIDIA V100 GPU). The implementation code is available at \url{https://github.com/clovaai/WSSHM}.


title: Towards Memorization-Free Diffusion Models

abstract: Pretrained diffusion models and their outputs are widely accessible due to their exceptional capacity for synthesizing high-quality images and their open-source nature. The users, however, may face litigation risks owing to the models' tendency to memorize and regurgitate training data during inference. To address this, we introduce Anti-Memorization Guidance (AMG), a novel framework employing three targeted guidance strategies for the main causes of memorization: image and caption duplication, and highly specific user prompts. Consequently, AMG ensures memorization-free outputs while maintaining high image quality and text alignment, leveraging the synergy of its guidance methods, each indispensable in its own right. AMG also features an innovative automatic detection system for potential memorization during each step of inference process, allows selective application of guidance strategies, minimally interfering with the original sampling process to preserve output utility. We applied AMG to pretrained Denoising Diffusion Probabilistic Models (DDPM) and Stable Diffusion across various generation tasks. The results demonstrate that AMG is the first approach to successfully eradicates all instances of memorization with no or marginal impacts on image quality and text-alignment, as evidenced by FID and CLIP scores.


title: MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurements

abstract: Simultaneous localization and mapping is essential for position tracking and scene understanding. 3D Gaussian-based map representations enable photorealistic reconstruction and real-time rendering of scenes using multiple posed cameras. We show for the first time that using 3D Gaussians for map representation with unposed camera images and inertial measurements can enable accurate SLAM. Our method, MM3DGS, addresses the limitations of prior neural radiance field-based representations by enabling faster rendering, scale awareness, and improved trajectory tracking. Our framework enables keyframe-based mapping and tracking utilizing loss functions that incorporate relative pose transformations from pre-integrated inertial measurements, depth estimates, and measures of photometric rendering quality. We also release a multi-modal dataset, UT-MM, collected from a mobile robot equipped with a camera and an inertial measurement unit. Experimental evaluation on several scenes from the dataset shows that MM3DGS achieves 3x improvement in tracking and 5% improvement in photometric rendering quality compared to the current 3DGS SLAM state-of-the-art, while allowing real-time rendering of a high-resolution dense 3D map. Project Webpage: https://vita-group.github.io/MM3DGS-SLAM


title: BadPart: Unified Black-box Adversarial Patch Attacks against Pixel-wise Regression Tasks

abstract: Pixel-wise regression tasks (e.g., monocular depth estimation (MDE) and optical flow estimation (OFE)) have been widely involved in our daily life in applications like autonomous driving, augmented reality and video composition. Although certain applications are security-critical or bear societal significance, the adversarial robustness of such models are not sufficiently studied, especially in the black-box scenario. In this work, we introduce the first unified black-box adversarial patch attack framework against pixel-wise regression tasks, aiming to identify the vulnerabilities of these models under query-based black-box attacks. We propose a novel square-based adversarial patch optimization framework and employ probabilistic square sampling and score-based gradient estimation techniques to generate the patch effectively and efficiently, overcoming the scalability problem of previous black-box patch attacks. Our attack prototype, named BadPart, is evaluated on both MDE and OFE tasks, utilizing a total of 7 models. BadPart surpasses 3 baseline methods in terms of both attack performance and efficiency. We also apply BadPart on the Google online service for portrait depth estimation, causing 43.5% relative distance error with 50K queries. State-of-the-art (SOTA) countermeasures cannot defend our attack effectively.


title: LLMs are Good Sign Language Translators

abstract: Sign Language Translation (SLT) is a challenging task that aims to translate sign videos into spoken language. Inspired by the strong translation capabilities of large language models (LLMs) that are trained on extensive multilingual text corpora, we aim to harness off-the-shelf LLMs to handle SLT. In this paper, we regularize the sign videos to embody linguistic characteristics of spoken language, and propose a novel SignLLM framework to transform sign videos into a language-like representation for improved readability by off-the-shelf LLMs. SignLLM comprises two key modules: (1) The Vector-Quantized Visual Sign module converts sign videos into a sequence of discrete character-level sign tokens, and (2) the Codebook Reconstruction and Alignment module converts these character-level tokens into word-level sign representations using an optimal transport formulation. A sign-text alignment loss further bridges the gap between sign and text tokens, enhancing semantic compatibility. We achieve state-of-the-art gloss-free results on two widely-used SLT benchmarks.


title: Two prover perfect zero knowledge for MIP*

abstract: The recent MIP*=RE theorem of Ji, Natarajan, Vidick, Wright, and Yuen shows that the complexity class MIP* of multiprover proof systems with entangled provers contains all recursively enumerable languages. Prior work of Grilo, Slofstra, and Yuen [FOCS '19] further shows (via a technique called simulatable codes) that every language in MIP* has a perfect zero knowledge (PZK) MIP* protocol. The MIP*=RE theorem uses two-prover one-round proof systems, and hence such systems are complete for MIP*. However, the construction in Grilo, Slofstra, and Yuen uses six provers, and there is no obvious way to get perfect zero knowledge with two provers via simulatable codes. This leads to a natural question: are there two-prover PZK-MIP* protocols for all of MIP*? In this paper, we show that every language in MIP* has a two-prover one-round PZK-MIP* protocol, answering the question in the affirmative. For the proof, we use a new method based on a key consequence of the MIP*=RE theorem, which is that every MIP* protocol can be turned into a family of boolean constraint system (BCS) nonlocal games. This makes it possible to work with MIP* protocols as boolean constraint systems, and in particular allows us to use a variant of a construction due to Dwork, Feige, Kilian, Naor, and Safra [Crypto '92] which gives a classical MIP protocol for 3SAT with perfect zero knowledge. To show quantum soundness of this classical construction, we develop a toolkit for analyzing quantum soundness of reductions between BCS games, which we expect to be useful more broadly. This toolkit also applies to commuting operator strategies, and our argument shows that every language with a commuting operator BCS protocol has a two prover PZK commuting operator protocol.


title: Construction of Permutation Polynomials over Finite Fields with the help of SCR polynomials

abstract: In this paper we take a deeper look at the self conjugate reciprocal (SCR) polynomials, which towards the end of the paper aid the construction of new classes of permutation trinomials and quadrinomials over $\mathbb{F}_{q^{2}}$. The paper focuses on the conditions required for a certain class of degree 2 and degree 3 SCR polynomials to have no roots in $\mu_{q+1}$ (the set of $(q+1)-\emph{th}$ roots of unity), which helps in the determination of polynomials that permute $\mathbb{F}_{q^{2}}$. In the due course we also look upon some higher degree SCR polynomials which can be reduced down to a degree 2 SCR polynomial over both odd and even ordered fields. We furthur look upon the SCR polynomials of type $ax^{q+1}+bx^{q}+bx+a^{q}$ taking both the cases under consideration where $a\in \mathbb{F}_{q}$ and $a\in\mathbb{F}_{q^{2}}\setminus\mathbb{F}_{q}$.


title: Instance-Aware Group Quantization for Vision Transformers

abstract: Post-training quantization (PTQ) is an efficient model compression technique that quantizes a pretrained full-precision model using only a small calibration set of unlabeled samples without retraining. PTQ methods for convolutional neural networks (CNNs) provide quantization results comparable to full-precision counterparts. Directly applying them to vision transformers (ViTs), however, incurs severe performance degradation, mainly due to the differences in architectures between CNNs and ViTs. In particular, the distribution of activations for each channel vary drastically according to input instances, making PTQ methods for CNNs inappropriate for ViTs. To address this, we introduce instance-aware group quantization for ViTs (IGQ-ViT). To this end, we propose to split the channels of activation maps into multiple groups dynamically for each input instance, such that activations within each group share similar statistical properties. We also extend our scheme to quantize softmax attentions across tokens. In addition, the number of groups for each layer is adjusted to minimize the discrepancies between predictions from quantized and full-precision models, under a bit-operation (BOP) constraint. We show extensive experimental results on image classification, object detection, and instance segmentation, with various transformer architectures, demonstrating the effectiveness of our approach.


title: A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias

abstract: Based on the foundation of Large Language Models (LLMs), Multilingual Large Language Models (MLLMs) have been developed to address the challenges of multilingual natural language processing tasks, hoping to achieve knowledge transfer from high-resource to low-resource languages. However, significant limitations and challenges still exist, such as language imbalance, multilingual alignment, and inherent bias. In this paper, we aim to provide a comprehensive analysis of MLLMs, delving deeply into discussions surrounding these critical issues. First of all, we start by presenting an overview of MLLMs, covering their evolution, key techniques, and multilingual capacities. Secondly, we explore widely utilized multilingual corpora for MLLMs' training and multilingual datasets oriented for downstream tasks that are crucial for enhancing the cross-lingual capability of MLLMs. Thirdly, we survey the existing studies on multilingual representations and investigate whether the current MLLMs can learn a universal language representation. Fourthly, we discuss bias on MLLMs including its category and evaluation metrics, and summarize the existing debiasing techniques. Finally, we discuss existing challenges and point out promising research directions. By demonstrating these aspects, this paper aims to facilitate a deeper understanding of MLLMs and their potentiality in various domains.


title: PSYDIAL: Personality-based Synthetic Dialogue Generation using Large Language Models

abstract: We present a novel end-to-end personality-based synthetic dialogue data generation pipeline, specifically designed to elicit responses from large language models via prompting. We design the prompts to generate more human-like dialogues considering real-world scenarios when users engage with chatbots. We introduce PSYDIAL, the first Korean dialogue dataset focused on personality-based dialogues, curated using our proposed pipeline. Notably, we focus on the Extraversion dimension of the Big Five personality model in our research. Experimental results indicate that while pre-trained models and those fine-tuned with a chit-chat dataset struggle to generate responses reflecting personality, models trained with PSYDIAL show significant improvements. The versatility of our pipeline extends beyond dialogue tasks, offering potential for other non-dialogue related applications. This research opens doors for more nuanced, personality-driven conversational AI in Korean and potentially other languages. Our code is publicly available at https://github.com/jiSilverH/psydial.


title: GOV-NeSF: Generalizable Open-Vocabulary Neural Semantic Fields

abstract: Recent advancements in vision-language foundation models have significantly enhanced open-vocabulary 3D scene understanding. However, the generalizability of existing methods is constrained due to their framework designs and their reliance on 3D data. We address this limitation by introducing Generalizable Open-Vocabulary Neural Semantic Fields (GOV-NeSF), a novel approach offering a generalizable implicit representation of 3D scenes with open-vocabulary semantics. We aggregate the geometry-aware features using a cost volume, and propose a Multi-view Joint Fusion module to aggregate multi-view features through a cross-view attention mechanism, which effectively predicts view-specific blending weights for both colors and open-vocabulary features. Remarkably, our GOV-NeSF exhibits state-of-the-art performance in both 2D and 3D open-vocabulary semantic segmentation, eliminating the need for ground truth semantic labels or depth priors, and effectively generalize across scenes and datasets without fine-tuning.


title: Minimal resolutions of Iwasawa modules

abstract: In this paper, we study the module-theoretic structure of classical Iwasawa modules. More precisely, for a finite abelian $p$-extension $K/k$ of totally real fields and the cyclotomic $\mathbb{Z}_p$-extension $K_{\infty}/K$, we consider $X_{K_{\infty},S}={\rm Gal}(M_{K_{\infty},S}/K_{\infty})$ where $S$ is a finite set of places of $k$ containing all ramifying places in $K_{\infty}$ and archimedean places, and $M_{K_{\infty},S}$ is the maximal abelian pro-$p$-extension of $K_{\infty}$ unramified outside $S$. We give lower and upper bounds of the minimal numbers of generators and of relations of $X_{K_{\infty},S}$ as a $\mathbb{Z}_p[[{\rm Gal}(K_{\infty}/k)]]$-module, using the $p$-rank of ${\rm Gal}(K/k)$. This result explains the complexity of $X_{K_{\infty},S}$ as a $\mathbb{Z}_p[[{\rm Gal}(K_{\infty}/k)]]$-module when the $p$-rank of ${\rm Gal}(K/k)$ is large. Moreover, we prove an analogous theorem in the setting that $K/k$ is non-abelian. We also study the Iwasawa adjoint of $X_{K_{\infty},S}$, and the minus part of the unramified Iwasawa module for a CM-extension. In order to prove these theorems, we systematically study the minimal resolutions of $X_{K_{\infty},S}$.


title: Constraining ultra slow roll inflation using cosmological datasets

abstract: In recent years, the detection of gravitational waves by LIGO and PTA collaborations have raised the intriguing possibility of excess matter power at small scales. Such an increase can be achieved by ultra slow roll (USR) phase during inflationary epoch. We constrain excess power over small scales within the framework of such models using cosmological datasets, particularly of CMB anisotropies and Lyman-$\alpha$. We parameterize the USR phase in terms of the e-fold at the onset of USR (counted from the end of inflation) $\bar N_1$ and the duration of USR phase $\Delta N$. The former dictates the scale of enhancement in the primordial power spectrum, while the latter determines the amplitude of such an enhancement. From a joint dataset of CMB, SNIa and galaxy surveys, we obtain $\bar N_1 \lesssim 45$ with no bound on $\Delta N$. This in turn implies that the scales over which the power spectrum can deviate significantly from the nearly scale invariant behavior of a typical slow-roll model is $k \gtrsim 1 \, \rm Mpc^{-1}$. On the other hand, the Lyman-$\alpha$ data is sensitive to baryonic power spectrum along the line of sight. We consider a semi-analytic theoretical method and high spectral-resolution Lyman-$\alpha$ data to constrain the model. The Lyman-$\alpha$ data limits both the USR parameters: $\bar N_1 \lesssim 41$ and $\Delta N \lesssim 0.4$. This constrains the amplitude of the power spectrum enhancement to be less than a factor of hundred over scales $1 \lesssim k/{\rm Mpc^{-1}} \lesssim 100$, thereby considerably improving the constraint on power over these scales as compared to the bounds arrived at from CMB spectral distortion.


title: ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback

abstract: ChatGLM is a free-to-use AI service powered by the ChatGLM family of large language models (LLMs). In this paper, we present the ChatGLM-RLHF pipeline -- a reinforcement learning from human feedback (RLHF) system -- designed to enhance ChatGLM's alignment with human preferences. ChatGLM-RLHF encompasses three major components: the collection of human preference data, the training of the reward model, and the optimization of policies. Throughout the process of integrating ChatGLM-RLHF into production, we encountered and addressed several unprecedented challenges. We introduce the strategies to mitigate reward variance for stabilized large-scale training, implement model parallelism with fused gradient-descent, and design regularization constraints to avoid catastrophic forgetting in LLMs. Experiments show that ChatGLM-RLHF brings significant improvements in alignment tasks compared to the supervised fine-tuned (SFT) version of ChatGLM. For instance, it achieves on average 15\% more wins against ChatGLM-SFT in Chinese alignment tasks. The work presents our practices of aligning LLMs with human preferences, offering insights into the challenges and solutions in RLHF implementations.


title: Random Circuit Sampling: Fourier Expansion and Statistics

abstract: Considerable effort in experimental quantum computing is devoted to noisy intermediate scale quantum computers (NISQ computers). Understanding the effect of noise is important for various aspects of this endeavor including notable claims for achieving quantum supremacy and attempts to demonstrate quantum error correcting codes. In this paper we use Fourier methods combined with statistical analysis to study the effect of noise. In particular, we use Fourier analysis to refine the linear cross-entropy fidelity estimator. We use both analytical methods and simulations to study the effect of readout and gate errors, and we use our analysis to study the samples of Google's 2019 quantum supremacy experiment.


title: A Comprehensive Review of Knowledge Distillation in Computer Vision

abstract: Deep learning techniques have been demonstrated to surpass preceding cutting-edge machine learning techniques in recent years, with computer vision being one of the most prominent examples. However, deep learning models suffer from significant drawbacks when deployed in resource-constrained environments due to their large model size and high complexity. Knowledge Distillation is one of the prominent solutions to overcome this challenge. This review paper examines the current state of research on knowledge distillation, a technique for compressing complex models into smaller and simpler ones. The paper provides an overview of the major principles and techniques associated with knowledge distillation and reviews the applications of knowledge distillation in the domain of computer vision. The review focuses on the benefits of knowledge distillation, as well as the problems that must be overcome to improve its effectiveness.


title: The Interaction Between Stars and Past AGN Disk: Possible Explanation for the Kinematic Distributions of S-stars in the Galactic Center

abstract: The presence of young stars, aged around several million years and situated within the range of $\sim 0.04-1$ pc from our Galactic center raises a question about their origins and dynamical evolutions. Their kinematics provide an opportunity to explore their formation or possible subsequent dynamical evolution. If Sagittarius A* was active in the past as suggested by several observations, the accretion disk may have a significant impact on the dynamics of stars in the Galactic center. The drag force exerted on stars during star-disk interaction could lead some of them to sink into the accretion disk, and these embedded stars will rapidly migrate inward and eventually be disrupted within $\sim10^5$ yr. This could roughly explain the absence of stars within $2.5 \times 10^4 R_{\rm g}$ ($\sim$ 1000 au). Additionally, Kozai-Lidov oscillations, induced by the gravitational perturbation of the disk, could contribute to the bimodal distribution of S-star inclinations and drive a majority of stars into high eccentricity orbits.


title: How Can Large Language Models Enable Better Socially Assistive Human-Robot Interaction: A Brief Survey

abstract: Socially assistive robots (SARs) have shown great success in providing personalized cognitive-affective support for user populations with special needs such as older adults, children with autism spectrum disorder (ASD), and individuals with mental health challenges. The large body of work on SAR demonstrates its potential to provide at-home support that complements clinic-based interventions delivered by mental health professionals, making these interventions more effective and accessible. However, there are still several major technical challenges that hinder SAR-mediated interactions and interventions from reaching human-level social intelligence and efficacy. With the recent advances in large language models (LLMs), there is an increased potential for novel applications within the field of SAR that can significantly expand the current capabilities of SARs. However, incorporating LLMs introduces new risks and ethical concerns that have not yet been encountered, and must be carefully be addressed to safely deploy these more advanced systems. In this work, we aim to conduct a brief survey on the use of LLMs in SAR technologies, and discuss the potentials and risks of applying LLMs to the following three major technical challenges of SAR: 1) natural language dialog; 2) multimodal understanding; 3) LLMs as robot policies.


title: Rational Homotopy Theory

abstract: This is a survey of Rational Homotopy Theory, intended for a Mathematical Physics readership.


title: Sequential Decision-Making under Uncertainty: A Robust MDPs review

abstract: Fueled by both advances in robust optimization theory and applications of reinforcement learning, robust Markov Decision Processes (RMDPs) have gained increasing attention, due to their powerful capability for sequential decision-making under uncertainty. This review provides an in-depth overview of the evolution and advances in RMDPs formulations, particularly in ambiguity modeling, and classifies these methods for representing uncertainty into three principal approaches: parametric, moment-based, and discrepancy-based, elaborating the trade-offs among the alternative representations. Meanwhile, the review delves into the rectangular assumptions, which guarantee the tractability of RMDPs yet are noted for their conservatism. The review summarizes three popular rectangular conditions and develops a new proof to attest to the NP-hardness of non-rectangular RMDPs. Out of the traditional RMDPs scope, recent efforts without conventional rectangular assumptions and new fashions within the RMDPs community are also reviewed. These studies foster the development of more flexible and practical modeling frameworks and enhance the adaptability and performance of RMDPs.


title: Repeating Nuclear Transients as Candidate Electromagnetic Counterparts of LISA Extreme Mass Ratio Inspirals

abstract: Extreme-mass-ratio inspirals (EMRIs) are one of the primary targets for the recently adopted millihertz gravitational-wave (GW) observatory LISA. Some previous studies have argued that a fraction of all EMRIs form in matter-rich environments, and can potentially explain the dozens of soft X-ray band ($\sim 10^{-1} \rm keV$), low-frequency ($\sim 0.1$ mHz) periodic phenomena known as quasi-periodic eruptions (QPEs) and quasi-periodic oscillations (QPOs). Here, using a representative EMRI population retrofitted with cutoffs on LISA-band SNRs and luminosity distances to account for the sensitivity of current instruments, we estimate the mean frequency band in which QPEs and QPOs originating from detectable LISA EMRIs may be emitting an X-ray signal ``today'' (i.e., in 2024) to be $0.46 \pm 0.22$ mHz. We also model the well-known QPO source, RE J1034+396, which falls in this frequency band, as an EMRI assuming its primary black hole mass to be $10^6-10^7 M_\odot$. Through a prior-predictive analysis, we estimate the orbiting compact object's mass to be $46^{+ 10}_{-40} M_\odot$ and the source's LISA-band SNR as $\approx 14$, highlighting it as a candidate multi-messenger EMRI target. We also highlight the role of current and near-future X-ray and UV observatories in enabling multi-messenger observations of EMRIs in conjunction with LISA, and conclude with a discussion of caveats of the current analysis, such as the exclusion of eccentricity and inclination from the model, and the measurability of sub-solar mass compact object EMRIs.


title: Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs

abstract: The advent of Large Language Models (LLMs) has significantly transformed the AI landscape, enhancing machine learning and AI capabilities. Factuality issue is a critical concern for LLMs, as they may generate factually incorrect responses. In this paper, we propose GraphEval to evaluate an LLM's performance using a substantially large test dataset. Specifically, the test dataset is retrieved from a large knowledge graph with more than 10 million facts without expensive human efforts. Unlike conventional methods that evaluate LLMs based on generated responses, GraphEval streamlines the evaluation process by creating a judge model to estimate the correctness of the answers given by the LLM. Our experiments demonstrate that the judge model's factuality assessment aligns closely with the correctness of the LLM's generated outputs, while also substantially reducing evaluation costs. Besides, our findings offer valuable insights into LLM performance across different metrics and highlight the potential for future improvements in ensuring the factual integrity of LLM outputs. The code is publicly available at https://github.com/xz-liu/GraphEval.


title: Evalverse: Unified and Accessible Library for Large Language Model Evaluation

abstract: This paper introduces Evalverse, a novel library that streamlines the evaluation of Large Language Models (LLMs) by unifying disparate evaluation tools into a single, user-friendly framework. Evalverse enables individuals with limited knowledge of artificial intelligence to easily request LLM evaluations and receive detailed reports, facilitated by an integration with communication platforms like Slack. Thus, Evalverse serves as a powerful tool for the comprehensive assessment of LLMs, offering both researchers and practitioners a centralized and easily accessible evaluation framework. Finally, we also provide a demo video for Evalverse, showcasing its capabilities and implementation in a two-minute format.


title: Spiral Galaxies' Disk Dominance and Testing MOND

abstract: Many Hubble type S galaxies have a flat rotation curve, V extending into the outer disk. The surface brightness there is too low to create V from stars of a reasonable mass-to-light ratio. To maintain a stable disk, a massive dark matter halo is usually assumed to dominate in creating V. Gravitational arm amplification is used here to estimate whether V is created by a disk mixture, or by a 100 percent halo. The disk surface density is not estimated from the disk surface brightness and an assumed mass to light ratio. The observed arm pitch angle is presumed to be long term maximally amplified. This permits calculation of the disk surface mass density with radius relative to a 100 percent disk which would fully create V. NGC 7217's tightly wound 4.8 degree arm pitch angle indicates a disk component contributing 43 percent of the observed V for the range over the spiral arms (important but not dominant). It has too low a disk density to create V with the rest presumably arising from a halo. V is proportional to the square root of surface density. By contrast a loose arm galaxy disk can dominate in creating V. For example NGC 3198's arm pitch angle of 30 degrees implies a disk surface density sufficient to account for 88 percent of V which is a dominant fraction. Little dark matter halo is needed for galaxies like this. Observationally, the dark outer disk may be molecular hydrogen. NGC 3198's dominant disk also provides a counter example to the need for any universal (MOND) force law modification over the outer disk spiral arms.


title: Generalized Kummer surfaces over finite fields

abstract: In this paper we prove a refinement of the Katsura theorem on finite groups acting on abelian surfaces such that the quotient is birational to a $K3$ surface. As an application we extend our results on zeta functions of Kummer surfaces to supersingular generalized Kummer surfaces over finite fields of odd degree.


title: Exploring the Efficacy of Group-Normalization in Deep Learning Models for Alzheimer's Disease Classification

abstract: Batch Normalization is an important approach to advancing deep learning since it allows multiple networks to train simultaneously. A problem arises when normalizing along the batch dimension because B.N.'s error increases significantly as batch size shrinks because batch statistics estimates are inaccurate. As a result, computer vision tasks like detection, segmentation, and video, which require tiny batches based on memory consumption, aren't suitable for using Batch Normalization for larger model training and feature transfer. Here, we explore Group Normalization as an easy alternative to using Batch Normalization A Group Normalization is a channel normalization method in which each group is divided into different channels, and the corresponding mean and variance are calculated for each group. Group Normalization computations are accurate across a wide range of batch sizes and are independent of batch size. When trained using a large ImageNet database on ResNet-50, GN achieves a very low error rate of 10.6% compared to Batch Normalization. when a smaller batch size of only 2 is used. For usual batch sizes, the performance of G.N. is comparable to that of Batch Normalization, but at the same time, it outperforms other normalization techniques. Implementing Group Normalization as a direct alternative to B.N to combat the serious challenges faced by the Batch Normalization in deep learning models with comparable or improved classification accuracy. Additionally, Group Normalization can be naturally transferred from the pre-training to the fine-tuning phase. .


title: Towards an In-Depth Comprehension of Case Relevance for Better Legal Retrieval

abstract: Legal retrieval techniques play an important role in preserving the fairness and equality of the judicial system. As an annually well-known international competition, COLIEE aims to advance the development of state-of-the-art retrieval models for legal texts. This paper elaborates on the methodology employed by the TQM team in COLIEE2024.Specifically, we explored various lexical matching and semantic retrieval models, with a focus on enhancing the understanding of case relevance. Additionally, we endeavor to integrate various features using the learning-to-rank technique. Furthermore, fine heuristic pre-processing and post-processing methods have been proposed to mitigate irrelevant information. Consequently, our methodology achieved remarkable performance in COLIEE2024, securing first place in Task 1 and third place in Task 3. We anticipate that our proposed approach can contribute valuable insights to the advancement of legal retrieval technology.


abstract: This is an English (annotated) translation of the German paper by Max Planck (1916) "On the absolute entropy of monatomic bodies" (\"Uber die absolute Entropie einatomiger K\"orper).


title: Harnessing The Power of Attention For Patch-Based Biomedical Image Classification

abstract: Biomedical image analysis is of paramount importance for the advancement of healthcare and medical research. Although conventional convolutional neural networks (CNNs) are frequently employed in this domain, facing limitations in capturing intricate spatial and temporal relationships at the pixel level due to their reliance on fixed-sized windows and immutable filter weights post-training. These constraints impede their ability to adapt to input fluctuations and comprehend extensive long-range contextual information. To overcome these challenges, a novel architecture based on self-attention mechanisms as an alternative to conventional CNNs.The proposed model utilizes attention-based mechanisms to surpass the limitations of CNNs. The key component of our strategy is the combination of non-overlapping (vanilla patching) and novel overlapped Shifted Patching Techniques (S.P.T.s), which enhances the model's capacity to capture local context and improves generalization. Additionally, we introduce the Lancoz5 interpolation technique, which adapts variable image sizes to higher resolutions, facilitating better analysis of high-resolution biomedical images. Our methods address critical challenges faced by attention-based vision models, including inductive bias, weight sharing, receptive field limitations, and efficient data handling. Experimental evidence shows the effectiveness of proposed model in generalizing to various biomedical imaging tasks. The attention-based model, combined with advanced data augmentation methodologies, exhibits robust modeling capabilities and superior performance compared to existing approaches. The integration of S.P.T.s significantly enhances the model's ability to capture local context, while the Lancoz5 interpolation technique ensures efficient handling of high-resolution images.


title: AISPACE at SemEval-2024 task 8: A Class-balanced Soft-voting System for Detecting Multi-generator Machine-generated Text

abstract: SemEval-2024 Task 8 provides a challenge to detect human-written and machine-generated text. There are 3 subtasks for different detection scenarios. This paper proposes a system that mainly deals with Subtask B. It aims to detect if given full text is written by human or is generated by a specific Large Language Model (LLM), which is actually a multi-class text classification task. Our team AISPACE conducted a systematic study of fine-tuning transformer-based models, including encoderonly, decoder-only and encoder-decoder models. We compared their performance on this task and identified that encoder-only models performed exceptionally well. We also applied a weighted Cross Entropy loss function to address the issue of data imbalance of different class samples. Additionally, we employed softvoting strategy over multi-models ensemble to enhance the reliability of our predictions. Our system ranked top 1 in Subtask B, which sets a state-of-the-art benchmark for this new challenge.


title: Adapting CSI-Guided Imaging Across Diverse Environments: An Experimental Study Leveraging Continuous Learning

abstract: This study explores the feasibility of adapting CSI-guided imaging across varied environments. Focusing on continuous model learning through continuous updates, we investigate CSI-Imager's adaptability in dynamically changing settings, specifically transitioning from an office to an industrial environment. Unlike traditional approaches that may require retraining for new environments, our experimental study aims to validate the potential of CSI-guided imaging to maintain accurate imaging performance through Continuous Learning (CL). By conducting experiments across different scenarios and settings, this work contributes to understanding the limitations and capabilities of existing CSI-guided imaging systems in adapting to new environmental contexts.


title: The quantum hypothesis for molecules with multiple degrees of freedom; Remarks on the entropy constant of diatomic gases

abstract: An English (2024) translation by P. Marquet of 3 German papers about "Die Quantenhypothese f\"ur Molekeln mit mehreren Freiheitsgraden (The quantum hypothesis for molecules with multiple degrees of freedom)" and "Bemerkung \"uber die Entropiekonstante zweiatomiger Gase (Remarks on the entropy constant of diatomic gases)" by Max Planck (1915,a,b,c)


title: Movable Antenna-Aided Hybrid Beamforming for Multi-User Communications

abstract: In this correspondence, we propose a movable antenna (MA)-aided multi-user hybrid beamforming scheme with a sub-connected structure, where multiple movable sub-arrays can independently change their positions within different local regions. To maximize the system sum rate, we jointly optimize the digital beamformer, analog beamformer, and positions of subarrays, under the constraints of unit modulus, finite movable regions, and power budget. Due to the non-concave/non-convex objective function/constraints, as well as the highly coupled variables, the formulated problem is challenging to solve. By employing fractional programming, we develop an alternating optimization framework to solve the problem via a combination of Lagrange multipliers, penalty method, and gradient descent. Numerical results reveal that the proposed MA-aided hybrid beamforming scheme significantly improves the sum rate compared to its fixed-position antenna (FPA) counterpart. Moreover, with sufficiently large movable regions, the proposed scheme with sub-connected MA arrays even outperforms the fully-connected FPA array.


title: Digital Twins for Supporting AI Research with Autonomous Vehicle Networks

abstract: Digital twins (DTs), which are virtual environments that simulate, predict, and optimize the performance of their physical counterparts, are envisioned to be essential technologies for advancing next-generation wireless networks. While DTs have been studied extensively for wireless networks, their use in conjunction with autonomous vehicles with programmable mobility remains relatively under-explored. In this paper, we study DTs used as a development environment to design, deploy, and test artificial intelligence (AI) techniques that use real-time observations, e.g. radio key performance indicators, for vehicle trajectory and network optimization decisions in an autonomous vehicle networks (AVN). We first compare and contrast the use of simulation, digital twin (software in the loop (SITL)), sandbox (hardware-in-the-loop (HITL)), and physical testbed environments for their suitability in developing and testing AI algorithms for AVNs. We then review various representative use cases of DTs for AVN scenarios. Finally, we provide an example from the NSF AERPAW platform where a DT is used to develop and test AI-aided solutions for autonomous unmanned aerial vehicles for localizing a signal source based solely on link quality measurements. Our results in the physical testbed show that SITL DTs, when supplemented with data from real-world (RW) measurements and simulations, can serve as an ideal environment for developing and testing innovative AI solutions for AVNs.


title: On the number of points with bounded dynamical canonical height

abstract: This paper discusses the number of points for which the dynamical canonical height is less than or equal to a given value. The height function is a fundamental and important tool in number theory to capture the ``number-theoretic complexity" of a point. Asymptotic formulas for the number of points in projective space below a given height have been studied by Schanuel, for example, and their coefficients can be written by class numbers, regulators, special values of the Dedekind zeta function, and other number theoretically interesting values. We consider an analogous problem for dynamical canonical height, a dynamical analogue of the height function in number theory, introduced by Call-Silverman . The main tool of this study is the dynamical height zeta function studied by Hsia. In this paper, we give explicit formulas for the dynamical height zeta function in special cases, derive general formulas for obtaining asymptotic behavior from certain functions, and combine them to derive asymptotic behavior for the number of points with bounded dynamical canonical height.


title: Parallel finite-element codes for the Bogoliubov-de Gennes stability analysis of Bose-Einstein condensates

abstract: We present and distribute a parallel finite-element toolbox written in the free software FreeFem for computing the Bogoliubov-de Gennes (BdG) spectrum of stationary solutions to one- and two-component Gross-Pitaevskii (GP) equations, in two or three spatial dimensions. The parallelization of the toolbox relies exclusively upon the recent interfacing of FreeFem with the PETSc library. The latter contains itself a wide palette of state-of-the-art linear algebra libraries, graph partitioners, mesh generation and domain decomposition tools, as well as a suite of eigenvalue solvers that are embodied in the SLEPc library. Within the present toolbox, stationary states of the GP equations are computed by a Newton method. Branches of solutions are constructed using an adaptive step-size continuation algorithm. The combination of mesh adaptivity tools from FreeFem with the parallelization features from PETSc makes the toolbox efficient and reliable for the computation of stationary states. Their BdG spectrum is computed using the SLEPc eigenvalue solver. We perform extensive tests and validate our programs by comparing the toolbox's results with known theoretical and numerical findings that have been reported in the literature.


title: Four-Derivative Yang-Mills Couplings in Heterotic Theory through T-Duality

abstract: This study delves into the dimensional reduction of the classical effective action of heterotic string theory on a circle, along with its T-duality symmetry, with the aim of identifying the bosonic couplings. To achieve this, we propose a truncation scheme for the generalized Buscher rules and the reduced action, specifically targeting the truncation of the nonlinear appearance of the scalar component of the Yang-Mills field in the base space. By imposing this truncated T-duality on the reduced action, we successfully determine the four-derivative bosonic couplings in the minimal basis, where field redefinition is imposed. Notably, these couplings, which are associated with the Lorentz Chern-Simons coupling $H\Omega$, exhibit an exact correspondence with the NS-NS couplings found in the Metsaev-Tseytlin action. Furthermore, we investigate the bosonic couplings in the maximal basis, where field redefinition is not imposed. In this scenario, the truncated T-duality fixes the effective action up to 17 arbitrary parameters. By assigning specific values to these parameters, we establish a framework in which the NS-NS couplings align with those in the Meissner action. Remarkably, within this scheme, the Yang-Mills couplings precisely coincide with those obtained through the S-matrix method.


title: Positive steady states of a class of power law systems with independent decompositions

abstract: Power law systems have been studied extensively due to their wide-ranging applications, particularly in chemistry. In this work, we focus on power law systems that can be decomposed into stoichiometrically independent subsystems. We show that for such systems where the ranks of the augmented matrices containing the kinetic order vectors of the underlying subnetworks sum up to the rank of the augmented matrix containing the kinetic order vectors of the entire network, then the existence of the positive steady states of each stoichiometrically independent subsystem is a necessary and sufficient condition for the existence of the positive steady states of the given power law system. We demonstrate the result through illustrative examples. One of which is a network of a carbon cycle model that satisfies the assumption, while the other network fails to meet the assumption. Finally, using the aforementioned result, we present a systematic method for deriving positive steady state parametrizations for the mentioned subclass of power law systems, which is a generalization of our recent method for mass action systems.


title: Equivariant Local Reference Frames for Unsupervised Non-rigid Point Cloud Shape Correspondence

abstract: Unsupervised non-rigid point cloud shape correspondence underpins a multitude of 3D vision tasks, yet itself is non-trivial given the exponential complexity stemming from inter-point degree-of-freedom, i.e., pose transformations. Based on the assumption of local rigidity, one solution for reducing complexity is to decompose the overall shape into independent local regions using Local Reference Frames (LRFs) that are invariant to SE(3) transformations. However, the focus solely on local structure neglects global geometric contexts, resulting in less distinctive LRFs that lack crucial semantic information necessary for effective matching. Furthermore, such complexity introduces out-of-distribution geometric contexts during inference, thus complicating generalization. To this end, we introduce 1) EquiShape, a novel structure tailored to learn pair-wise LRFs with global structural cues for both spatial and semantic consistency, and 2) LRF-Refine, an optimization strategy generally applicable to LRF-based methods, aimed at addressing the generalization challenges. Specifically, for EquiShape, we employ cross-talk within separate equivariant graph neural networks (Cross-GVP) to build long-range dependencies to compensate for the lack of semantic information in local structure modeling, deducing pair-wise independent SE(3)-equivariant LRF vectors for each point. For LRF-Refine, the optimization adjusts LRFs within specific contexts and knowledge, enhancing the geometric and semantic generalizability of point features. Our overall framework surpasses the state-of-the-art methods by a large margin on three benchmarks. Code and models will be publicly available.


title: Randomized Nystr\"om approximation of non-negative self-adjoint operators

abstract: The randomized singular value decomposition (SVD) has become a popular approach to computing cheap, yet accurate, low-rank approximations to matrices due to its efficiency and strong theoretical guarantees. Recent work by Boull\'e and Townsend (FoCM, 2023) presents an infinite-dimensional analog of the randomized SVD to approximate Hilbert-Schmidt operators. However, many applications involve computing low-rank approximations to symmetric positive semi-definite matrices. In this setting, it is well-established that the randomized Nystr{\"o}m approximation is usually preferred over the randomized SVD. This paper explores an infinite-dimensional analog of the Nystr{\"o}m approximation to compute low-rank approximations to non-negative self-adjoint trace-class operators. We present an analysis of the method and, along the way, improve the existing infinite-dimensional bounds for the randomized SVD. Our analysis yields bounds on the expected value and tail bounds for the Nystr{\"o}m approximation error in the operator, trace, and Hilbert-Schmidt norms. Numerical experiments for simple integral operators validate the proposed framework.


title: Orchestrating UAVs for Prioritized Data Harvesting: A Cross-Layer Optimization Perspective

abstract: This work describes the orchestration of a fleet of rotary-wing Unmanned Aerial Vehicles (UAVs) for harvesting prioritized traffic from random distributions of heterogeneous users with Multiple Input Multiple Output (MIMO) capabilities. In a finite-horizon offline setting, the goal is to optimize the beam-forming design, the 3D UAV positioning and trajectory solution, and the user association/scheduling policy, to maximize the cumulative fleet-wide reward obtained by satisfying the quality-of-service mandates imposed on each user uplink request, subject to an average per-UAV mobility power constraint. With a probabilistic air-to-ground channel model, a multi-user MIMO uplink communication model with prioritized traffic, and a novel 3D mobility model for rotary-wing UAVs, the fleet-wide reward maximization problem is solved via a cross-layer optimization framework: first, K-means clustering is employed to obtain user clusters; then, equipped with a zero-forcing beam-forming design, the positions of the UAVs are optimized via two-stage grid search; next, treating these optimal positions as the graph vertices of a fully-connected mesh, the 3D UAV trajectories (i.e., graph edges) are designed via a learning based competitive swarm optimization algorithm, under an average UAV power consumption constraint, coupled with projected subgradient ascent for dual optimization; consequently, the user association/scheduling strategy is solved via a graphical branch-and-bound method on the underlying multiple traveling salesman problem. Numerical evaluations demonstrate that the proposed solution outperforms static UAV deployments, adaptive Voronoi decomposition techniques, and state-of-the-art iterative fleet control algorithms, with respect to user quality-of-service and per-UAV average power consumption.


title: Diffusion-Driven Domain Adaptation for Generating 3D Molecules

abstract: Can we train a molecule generator that can generate 3D molecules from a new domain, circumventing the need to collect data? This problem can be cast as the problem of domain adaptive molecule generation. This work presents a novel and principled diffusion-based approach, called GADM, that allows shifting a generative model to desired new domains without the need to collect even a single molecule. As the domain shift is typically caused by the structure variations of molecules, e.g., scaffold variations, we leverage a designated equivariant masked autoencoder (MAE) along with various masking strategies to capture the structural-grained representations of the in-domain varieties. In particular, with an asymmetric encoder-decoder module, the MAE can generalize to unseen structure variations from the target domains. These structure variations are encoded with an equivariant encoder and treated as domain supervisors to control denoising. We show that, with these encoded structural-grained domain supervisors, GADM can generate effective molecules within the desired new domains. We conduct extensive experiments across various domain adaptation tasks over benchmarking datasets. We show that our approach can improve up to 65.6% in terms of success rate defined based on molecular validity, uniqueness, and novelty compared to alternative baselines.


title: Inversion and Tunability of Van Hove Singularities in $A$V$_{3}$Sb$_{5}$ ($A$ = K, Rb, and Cs) kagome metals

abstract: To understand the alkali-metal-dependent material properties of recently discovered $A$V$_{3}$Sb$_{5}$ ($A$ = K, Rb, and Cs), we conducted a detailed electronic structure analysis based on first-principles density functional theory calculations. Contrary to the case of $A$ = K and Rb, the energetic positions of the low-lying Van Hove singularities are reversed in CsV$_{3}$Sb$_{5}$, and the characteristic higher-order Van Hove point gets closer to the Fermi level. We found that this notable difference can be attributed to the chemical effect, apart from structural differences. Due to their different orbital compositions, Van Hove points show qualitatively different responses to the structure changes. A previously unnoticed highest lying point can be lowered, locating close to or even below the other ones in response to a reasonable range of bi- and uni-axial strain. Our results can be useful in better understanding the material-dependent features reported in this family and in realizing experimental control of exotic quantum phases.


title: S2RC-GCN: A Spatial-Spectral Reliable Contrastive Graph Convolutional Network for Complex Land Cover Classification Using Hyperspectral Images

abstract: Spatial correlations between different ground objects are an important feature of mining land cover research. Graph Convolutional Networks (GCNs) can effectively capture such spatial feature representations and have demonstrated promising results in performing hyperspectral imagery (HSI) classification tasks of complex land. However, the existing GCN-based HSI classification methods are prone to interference from redundant information when extracting complex features. To classify complex scenes more effectively, this study proposes a novel spatial-spectral reliable contrastive graph convolutional classification framework named S2RC-GCN. Specifically, we fused the spectral and spatial features extracted by the 1D- and 2D-encoder, and the 2D-encoder includes an attention model to automatically extract important information. We then leveraged the fused high-level features to construct graphs and fed the resulting graphs into the GCNs to determine more effective graph representations. Furthermore, a novel reliable contrastive graph convolution was proposed for reliable contrastive learning to learn and fuse robust features. Finally, to test the performance of the model on complex object classification, we used imagery taken by Gaofen-5 in the Jiang Xia area to construct complex land cover datasets. The test results show that compared with other models, our model achieved the best results and effectively improved the classification performance of complex remote sensing imagery.


title: Inhomogeneous confinement and chiral symmetry breaking induced by imaginary angular velocity

abstract: We investigate detailed properties of imaginary rotating matter with gluons and quarks at high temperature. Previously, we showed that imaginary rotation induces perturbative confinement of gluons at the rotation center. We perturbatively calculate the Polyakov loop potential and find inhomogeneous confinement above a certain threshold of imaginary angular velocity. We also evaluate the quark contribution to the Polyakov loop potential and confirm that spontaneous chiral symmetry breaking occurs in the perturbatively confined phase.


title: GTS: GPU-based Tree Index for Fast Similarity Search

abstract: Similarity search, the task of identifying objects most similar to a given query object under a specific metric, has gathered significant attention due to its practical applications. However, the absence of coordinate information to accelerate similarity search and the high computational cost of measuring object similarity hinder the efficiency of existing CPU-based methods. Additionally, these methods struggle to meet the demand for high throughput data management. To address these challenges, we propose GTS, a GPU-based tree index designed for the parallel processing of similarity search in general metric spaces, where only the distance metric for measuring object similarity is known. The GTS index utilizes a pivot-based tree structure to efficiently prune objects and employs list tables to facilitate GPU computing. To efficiently manage concurrent similarity queries with limited GPU memory, we have developed a two-stage search method that combines batch processing and sequential strategies to optimize memory usage. The paper also introduces an effective update strategy for the proposed GPU-based index, encompassing streaming data updates and batch data updates. Additionally, we present a cost model to evaluate search performance. Extensive experiments on five real-life datasets demonstrate that GTS achieves efficiency gains of up to two orders of magnitude over existing CPU baselines and up to 20x efficiency improvements compared to state-of-the-art GPU-based methods.


title: Designing gradient coils with the shape derivative and the closed B-spline curves

abstract: This study proposes a versatile and efficient optimisation method for discrete coils that induce a magnetic field by their steady currents. The prime target is gradient coils for MRI (Magnetic Resonance Imaging). The derivative (gradient) of the $z$-component the magnetic field, which is calculated by the Biot--Savart's law, with respect to the $z$-coordinate in the Cartesian $xyz$ coordinate system is considered as the objective function. Then, the derivative of the objective function with respect to a change of coils in shape is formulated according to the concept of shape optimisation. The resulting shape derivative (as well as the Biot--Savart's law) is smoothly discretised with the closed B-spline curves. In this case, the control points (CPs) of the curves are naturally selected as the design variables. As a consequence, the shape derivative is discretised to the sensitivities of the objective function with respect to the CPs. Those sensitivities are available to solve the present shape-optimisation problem with a certain gradient-based nonlinear-programming solver. The numerical examples exhibit the mathematical reliability, computational efficiency, and engineering applicability of the proposed methodology based on the shape derivative/sensitivities and the closed B-spline curves.


title: Optimal Bidding Strategies in Network-Constrained Demand Response: A Distributed Aggregative Game Theoretic Approach

abstract: Demand response has been a promising solution for accommodating renewable energy in power systems. In this study, we consider a demand response scheme within a distribution network facing an energy supply deficit. The utility company incentivizes load aggregators to adjust their pre-scheduled energy consumption and generation to match the supply. Each aggregator, which represents a group of prosumers, aims to maximize its revenue by bidding strategically in the demand response scheme. Since aggregators act in their own self-interest and their revenues and feasible bids influence one another, we model their competition as a network-constrained aggregative game. This model incorporates power flow constraints to prevent potential line congestion. Given that there are no coordinators and aggregators can only communicate with their neighbours, we introduce a fully distributed generalized Nash equilibrium seeking algorithm to determine the optimal bidding strategies for aggregators in this game. Within this algorithm, only estimates of the aggregate and certain auxiliary variables are communicated among neighbouring aggregators. We demonstrate the convergence of this algorithm by constructing an equivalent iteration using the forward-backward splitting technique.


title: Connection formula for the Jackson integral of Riemann-Papperitz type

abstract: We give a connection formula for the Jackson integral of Riemann-Papperitz type. This includes a solution of the connection problem for the variant of $q$-hypergeometric equation of degree three introduced by Hatano-Matsunawa-Sato-Takemura. Using this formula we show a linear relation for the Kajihara's $q$-hypergeometric series $W^{M,2}$, whose $q$-difference equation is recently obtained by one of the author.


title: Effect of magnetic field on the Bose-Einstein condensation of quantum well exciton-polaritons

abstract: We theoretically examine the effect of the magnetic field on the relaxation process of the exciton-polariton toward the Bose-Einstein condensation in GaAs quantum wells. As a result of the modification of the exciton's effective mass, Rabi splitting, and dispersion, the relaxation rate of polaritons toward condensation has been significantly modified. Using a continuous pumping, the dynamics of total and condensated polariton versus magnetic field has been clarified. It has been shown that for low-energy pumping, the condensation is significantly reduced with a magnetic field, and this arises from the reduction of the scattering rate between energy levels when the steepness of the dispersion at higher energy is reduced. Increasing of pump energy together with the magnetic field could lead to a more effective relaxation and a much higher number of condensated polariton is obtained.


title: Exploring and Evaluating Hallucinations in LLM-Powered Code Generation

abstract: The rise of Large Language Models (LLMs) has significantly advanced many applications on software engineering tasks, particularly in code generation. Despite the promising performance, LLMs are prone to generate hallucinations, which means LLMs might produce outputs that deviate from users' intent, exhibit internal inconsistencies, or misalign with the factual knowledge, making the deployment of LLMs potentially risky in a wide range of applications. Existing work mainly focuses on investing the hallucination in the domain of natural language generation (NLG), leaving a gap in understanding the types and extent of hallucinations in the context of code generation. To bridge the gap, we conducted a thematic analysis of the LLM-generated code to summarize and categorize the hallucinations present in it. Our study established a comprehensive taxonomy of hallucinations in LLM-generated code, encompassing 5 primary categories of hallucinations depending on the conflicting objectives and varying degrees of deviation observed in code generation. Furthermore, we systematically analyzed the distribution of hallucinations, exploring variations among different LLMs and their correlation with code correctness. Based on the results, we proposed HalluCode, a benchmark for evaluating the performance of code LLMs in recognizing hallucinations. Hallucination recognition and mitigation experiments with HalluCode and HumanEval show existing LLMs face great challenges in recognizing hallucinations, particularly in identifying their types, and are hardly able to mitigate hallucinations. We believe our findings will shed light on future research about hallucination evaluation, detection, and mitigation, ultimately paving the way for building more effective and reliable code LLMs in the future.


title: Cross-channel Recommendation for Multi-channel Retail

abstract: An increasing number of brick-and-mortar retailers are expanding their channels to the online domain, transforming them into multi-channel retailers. This transition emphasizes the need for cross-channel recommender systems, aiming to enhance revenue across both offline and online channels. Given that each retail channel represents a separate domain with a unique context, this can be regarded as a cross-domain recommendation (CDR). However, the existing studies on CDR did not address the scenarios where both users and items partially overlap across multi-retail channels which we define as "cross-channel retail recommendation (CCRR)". This paper introduces our original work on CCRR using real-world datasets from a multi-channel retail store. Specifically, (1) we present significant challenges in integrating user preferences across both channels. (2) Accordingly, we propose a novel model for CCRR using a channel-wise attention mechanism to capture different user preferences for the same item on each channel. We empirically validate our model's superiority in addressing CCRR over existing models. (3) Finally, we offer implications for future research on CCRR, delving into our experiment results.


title: VideoDistill: Language-aware Vision Distillation for Video Question Answering

abstract: Significant advancements in video question answering (VideoQA) have been made thanks to thriving large image-language pretraining frameworks. Although these image-language models can efficiently represent both video and language branches, they typically employ a goal-free vision perception process and do not interact vision with language well during the answer generation, thus omitting crucial visual cues. In this paper, we are inspired by the human recognition and learning pattern and propose VideoDistill, a framework with language-aware (i.e., goal-driven) behavior in both vision perception and answer generation process. VideoDistill generates answers only from question-related visual embeddings and follows a thinking-observing-answering approach that closely resembles human behavior, distinguishing it from previous research. Specifically, we develop a language-aware gating mechanism to replace the standard cross-attention, avoiding language's direct fusion into visual representations. We incorporate this mechanism into two key components of the entire framework. The first component is a differentiable sparse sampling module, which selects frames containing the necessary dynamics and semantics relevant to the questions. The second component is a vision refinement module that merges existing spatial-temporal attention layers to ensure the extraction of multi-grained visual semantics associated with the questions. We conduct experimental evaluations on various challenging video question-answering benchmarks, and VideoDistill achieves state-of-the-art performance in both general and long-form VideoQA datasets. In Addition, we verify that VideoDistill can effectively alleviate the utilization of language shortcut solutions in the EgoTaskQA dataset.


title: Improving Visual Recognition with Hyperbolical Visual Hierarchy Mapping

abstract: Visual scenes are naturally organized in a hierarchy, where a coarse semantic is recursively comprised of several fine details. Exploring such a visual hierarchy is crucial to recognize the complex relations of visual elements, leading to a comprehensive scene understanding. In this paper, we propose a Visual Hierarchy Mapper (Hi-Mapper), a novel approach for enhancing the structured understanding of the pre-trained Deep Neural Networks (DNNs). Hi-Mapper investigates the hierarchical organization of the visual scene by 1) pre-defining a hierarchy tree through the encapsulation of probability densities; and 2) learning the hierarchical relations in hyperbolic space with a novel hierarchical contrastive loss. The pre-defined hierarchy tree recursively interacts with the visual features of the pre-trained DNNs through hierarchy decomposition and encoding procedures, thereby effectively identifying the visual hierarchy and enhancing the recognition of an entire scene. Extensive experiments demonstrate that Hi-Mapper significantly enhances the representation capability of DNNs, leading to an improved performance on various tasks, including image classification and dense prediction tasks.


title: On the Superiority of the University of Arizona's Physics Club

abstract: We present an analysis on Physics Club's supremacy over the Astronomy Club at the University of Arizona. Through a thorough investigation of each club's history and content, and subsequent diligent calculations, we have proven without a doubt that the Physics Club is superior to Astronomy Club.


title: Yet anOther Dose Algorithm (YODA) for independent computations of dose and dose changes due to anatomical changes

abstract: $\textbf{Purpose:}$ To assess the viability of a physics-based, deterministic and adjoint-capable algorithm for performing treatment planning system independent dose calculations and for computing dosimetric differences caused by anatomical changes. $\textbf{Methods:}$ A semi-numerical approach is employed to solve two partial differential equations for the proton phase-space density which determines the deposited dose. Lateral hetereogeneities are accounted for by an optimized (Gaussian) beam splitting scheme. Adjoint theory is applied to approximate the change in the deposited dose caused by a new underlying patient anatomy. $\textbf{Results:}$ The quality of the dose engine was benchmarked through three-dimensional gamma index comparisons against Monte Carlo simulations done in TOPAS. The worst passing rate for the gamma index with (1 mm, 1 %, 10 % dose cut-off) criteria is 95.62 %. The effect of delivering treatment plans on repeat CTs was also tested. For a non-robustly optimized plan the adjoint component was accurate to 6.2 % while for a robustly optimized plan it was accurate to 1 %. $\textbf{Conclusions:}$ YODA is capable of accurate dose computations in both single and multi spot irradiations when compared to TOPAS. Moreover, it is able to compute dosimetric differences due to anatomical changes with small to moderate errors thereby facilitating its use for patient-specific quality assurance in online adaptive proton therapy.


title: Nonlinear dynamical social and political prediction algorithm for city planning and public participation using the Impulse Pattern Formulation

abstract: A nonlinear-dynamical algorithm for city planning is proposed as an Impulse Pattern Formulation (IPF) for predicting relevant parameters like health, artistic freedom, or financial developments of different social or political stakeholders over the cause of a planning process. The IPF has already shown high predictive precision at low computational cost in musical instrument simulations, brain dynamics, and human-human interactions. The social and political IPF consists of three basic equations of system state developments, self-adaptation of stakeholders, two adaptive interactions, and external impact terms suitable for respective planning situations. Typical scenarios of stakeholder interactions and developments are modeled by adjusting a set of system parameters. These include stakeholder reaction to external input, enhanced system stability through self-adaptation, stakeholder convergence due to adaptive interaction, as well as complex dynamics in terms of fixed stakeholder impacts. A workflow for implementing the algorithm in real city planning scenarios is outlined. This workflow includes machine learning of a suitable set of parameters suggesting best-practice planning to aim at the desired development of the planning process and its output.


title: Prior Constraints-based Reward Model Training for Aligning Large Language Models

abstract: Reinforcement learning with human feedback for aligning large language models (LLMs) trains a reward model typically using ranking loss with comparison pairs.However, the training procedure suffers from an inherent problem: the uncontrolled scaling of reward scores during reinforcement learning due to the lack of constraints while training the reward model.This paper proposes a Prior Constraints-based Reward Model (namely PCRM) training method to mitigate this problem. PCRM incorporates prior constraints, specifically, length ratio and cosine similarity between outputs of each comparison pair, during reward model training to regulate optimization magnitude and control score margins. We comprehensively evaluate PCRM by examining its rank correlation with human preferences and its effectiveness in aligning LLMs via RL. Experimental results demonstrate that PCRM significantly improves alignment performance by effectively constraining reward score scaling. As another bonus, our method is easily integrated into arbitrary rank-based alignment methods, such as direct preference optimization, and can yield consistent improvement.


title: PDF: A Probability-Driven Framework for Open World 3D Point Cloud Semantic Segmentation

abstract: Existing point cloud semantic segmentation networks cannot identify unknown classes and update their knowledge, due to a closed-set and static perspective of the real world, which would induce the intelligent agent to make bad decisions. To address this problem, we propose a Probability-Driven Framework (PDF) for open world semantic segmentation that includes (i) a lightweight U-decoder branch to identify unknown classes by estimating the uncertainties, (ii) a flexible pseudo-labeling scheme to supply geometry features along with probability distribution features of unknown classes by generating pseudo labels, and (iii) an incremental knowledge distillation strategy to incorporate novel classes into the existing knowledge base gradually. Our framework enables the model to behave like human beings, which could recognize unknown objects and incrementally learn them with the corresponding knowledge. Experimental results on the S3DIS and ScanNetv2 datasets demonstrate that the proposed PDF outperforms other methods by a large margin in both important tasks of open world semantic segmentation.


title: CAMO: Correlation-Aware Mask Optimization with Modulated Reinforcement Learning

abstract: Optical proximity correction (OPC) is a vital step to ensure printability in modern VLSI manufacturing. Various OPC approaches based on machine learning have been proposed to pursue performance and efficiency, which are typically data-driven and hardly involve any particular considerations of the OPC problem, leading to potential performance or efficiency bottlenecks. In this paper, we propose CAMO, a reinforcement learning-based OPC system that specifically integrates important principles of the OPC problem. CAMO explicitly involves the spatial correlation among the movements of neighboring segments and an OPC-inspired modulation for movement action selection. Experiments are conducted on both via layer patterns and metal layer patterns. The results demonstrate that CAMO outperforms state-of-the-art OPC engines from both academia and industry.


title: Classification of three-dimensional anti-dendriform algebras

abstract: This article is devoted to the classification of anti-dendriform algebras that are associated with associativity. They are characterized as algebras with two operations whose sum is associative. In particular, the paper is devoted to classifying anti-dendriform algebras associated with null-filiform associative algebras and three-dimensional algebras. It is known that any finite-dimensional associative algebra without a non-zero idempotent element is nilpotent. If an associative algebra has a non-zero idempotent element, then there does not exist a compatible anti-dendriform algebra structure associated with associative algebras.


title: Wideband Channel Capacity Maximization With Beyond Diagonal RIS Reflection Matrices

abstract: Following the promising beamforming gains offered by reconfigurable intelligent surfaces (RISs), a new hardware architecture, known as \emph{beyond diagonal RIS (BD-RIS)}, has recently been proposed. This architecture enables controllable signal flows between the RIS elements, thereby providing greater design flexibility. However, the physics-imposed symmetry and orthogonality conditions on the non-diagonal reflection matrix make the design challenging. In this letter, we analyze how a BD-RIS can improve a wideband channel, starting from fundamental principles and deriving the capacity. Our analysis considers the effects of various channel taps and their frequency-domain characteristics. We introduce a new algorithm designed to optimize the configuration of the BD-RIS to maximize wideband capacity. The proposed algorithm has better performance than the benchmarks. A BD-RIS is beneficial compared to a conventional RIS in the absence of static path or when the Rician $\kappa$-factor is smaller than $10$.


title: Continual Learning for Smart City: A Survey

abstract: With the digitization of modern cities, large data volumes and powerful computational resources facilitate the rapid update of intelligent models deployed in smart cities. Continual learning (CL) is a novel machine learning paradigm that constantly updates models to adapt to changing environments, where the learning tasks, data, and distributions can vary over time. Our survey provides a comprehensive review of continual learning methods that are widely used in smart city development. The content consists of three parts: 1) Methodology-wise. We categorize a large number of basic CL methods and advanced CL frameworks in combination with other learning paradigms including graph learning, spatial-temporal learning, multi-modal learning, and federated learning. 2) Application-wise. We present numerous CL applications covering transportation, environment, public health, safety, networks, and associated datasets related to urban computing. 3) Challenges. We discuss current problems and challenges and envision several promising research directions. We believe this survey can help relevant researchers quickly familiarize themselves with the current state of continual learning research used in smart city development and direct them to future research trends.


title: Stabilization and high thermoelectric performance of high-entropy-type cubic AgBi(S, Se, Te)2

abstract: As thermoelectric generators can convert waste heat into electricity, they play an important role in energy harvesting. The metal chalcogenide AgBiSe2 is one of the high-performance thermoelectric materials with low lattice thermal conductivity (klat), but it exhibits temperature-dependent crystal structural transitions from hexagonal to rhombohedral, and finally a cubic phase as the temperature rises. The high figure-of-merit ZT is obtained only for the high-temperature cubic phase. In this study, we utilized the high-entropy-alloy (HEA) concept for AgBiSe2 to stabilize the cubic phase throughout the entire temperature range with enhanced thermoelectric performance. We synthesized high-entropy-type AgBiSe2-2xSxTex bulk polycrystals and realized the stabilization of the cubic phase from room temperature to 800 K for x > 0.6. The ultra-low klat at of 0.30 Wm^-1K^-1 and the high peak ZT 0.9 at around 750 K were realized for cubic AgBiSe2-2xSxTex without carrier tuning. In addition, the average ZT value of x = 0.6 and 0.7 for the temperature range of 360-750 K increased to 0.38 and 0.40, respectively, which are comparable to the highest previously reported values.


title: Long time stability and instability in the two-dimensional Boussinesq system with kinematic viscosity

abstract: In this paper, we investigate the long-time behavior of the two-dimensional incompressible Boussinesq system with kinematic viscosity in a periodic channel, focusing on instability and asymptotic stability near hydrostatic equilibria. Firstly, we prove that any hydrostatic equilibrium reveals long-time instability when the initial data are perturbed in Sobolev spaces of low regularity. Secondly, we establish asymptotic stability of the stratified density, which is strictly decreasing in the vertical direction, under sufficiently regular perturbations, proving that the solution converges to the unique minimizer of the total energy. Our analysis is based on the energy method. Although the total energy dissipates due to kinematic viscosity, such mechanism cannot capture the stratification of the density. We overcome this difficulty by discovering another Lyapunov functional which exhibits the density stratification in a quantitative manner.


title: Make Continual Learning Stronger via C-Flat

abstract: Model generalization ability upon incrementally acquiring dynamically updating knowledge from sequentially arriving tasks is crucial to tackle the sensitivity-stability dilemma in Continual Learning (CL). Weight loss landscape sharpness minimization seeking for flat minima lying in neighborhoods with uniform low loss or smooth gradient is proven to be a strong training regime improving model generalization compared with loss minimization based optimizer like SGD. Yet only a few works have discussed this training regime for CL, proving that dedicated designed zeroth-order sharpness optimizer can improve CL performance. In this work, we propose a Continual Flatness (C-Flat) method featuring a flatter loss landscape tailored for CL. C-Flat could be easily called with only one line of code and is plug-and-play to any CL methods. A general framework of C-Flat applied to all CL categories and a thorough comparison with loss minima optimizer and flat minima based CL approaches is presented in this paper, showing that our method can boost CL performance in almost all cases. Code will be publicly available upon publication.


title: FlexiDreamer: Single Image-to-3D Generation with FlexiCubes

abstract: 3D content generation has wide applications in various fields. One of its dominant paradigms is by sparse-view reconstruction using multi-view images generated by diffusion models. However, since directly reconstructing triangle meshes from multi-view images is challenging, most methodologies opt to an implicit representation (such as NeRF) during the sparse-view reconstruction and acquire the target mesh by a post-processing extraction. However, the implicit representation takes extensive time to train and the post-extraction also leads to undesirable visual artifacts. In this paper, we propose FlexiDreamer, a novel framework that directly reconstructs high-quality meshes from multi-view generated images. We utilize an advanced gradient-based mesh optimization, namely FlexiCubes, for multi-view mesh reconstruction, which enables us to generate 3D meshes in an end-to-end manner. To address the reconstruction artifacts owing to the inconsistencies from generated images, we design a hybrid positional encoding scheme to improve the reconstruction geometry and an orientation-aware texture mapping to mitigate surface ghosting. To further enhance the results, we respectively incorporate eikonal and smooth regularizations to reduce geometric holes and surface noise. Our approach can generate high-fidelity 3D meshes in the single image-to-3D downstream task with approximately 1 minute, significantly outperforming previous methods.


title: Distributed Satellite-Terrestrial Cooperative Routing Strategy Based on Minimum Hop-Count Analysis in Mega LEO Satellite Constellation

abstract: Mega low earth orbit (LEO) satellite constellation is promising in achieving global coverage with high capacity. However, forwarding packets in mega constellation faces long end-to-end delay caused by multi-hop routing and high-complexity routing table construction, which will detrimentally impair the network transmission efficiency. To overcome this issue, a distributed low-complexity satellite-terrestrial cooperative routing approach is proposed in this paper, and its core idea is that each node forwards packets to next-hop node under the constraints of minimum end-to-end hop-count and queuing delay. Particularly, to achieve an accurate and low-complexity minimum end-to-end hop-count estimation in satellite-terrestrial cooperative routing scenario, we first introduce a satellite real-time position based graph (RTPG) to simplify the description of three-dimensional constellation, and further abstract RTPG into a key node based graph (KNBG). Considering the frequent regeneration of KNBG due to satellite movement, a low complexity generation method of KNBG is studied as well. Finally, utilizing KNBG as input, we design the minimum end-to-end hop-count estimation method (KNBG-MHCE). Meanwhile, the computational complexity, routing path survival probability and practical implementation of our proposal are all deeply discussed. Extensive simulations are also conducted in systems with Ka and laser band inter-satellite links to verify the superiority of our proposal.