title: Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factors

abstract: Test-time adaptation (TTA) fine-tunes pre-trained deep neural networks for unseen test data. The primary challenge of TTA is limited access to the entire test dataset during online updates, causing error accumulation. To mitigate it, TTA methods have utilized the model output's entropy as a confidence metric that aims to determine which samples have a lower likelihood of causing error. Through experimental studies, however, we observed the unreliability of entropy as a confidence metric for TTA under biased scenarios and theoretically revealed that it stems from the neglect of the influence of latent disentangled factors of data on predictions. Building upon these findings, we introduce a novel TTA method named Destroy Your Object (DeYO), which leverages a newly proposed confidence metric named Pseudo-Label Probability Difference (PLPD). PLPD quantifies the influence of the shape of an object on prediction by measuring the difference between predictions before and after applying an object-destructive transformation. DeYO consists of sample selection and sample weighting, which employ entropy and PLPD concurrently. For robust adaptation, DeYO prioritizes samples that dominantly incorporate shape information when making predictions. Our extensive experiments demonstrate the consistent superiority of DeYO over baseline methods across various scenarios, including biased and wild. Project page is publicly available at https://whitesnowdrop.github.io/DeYO/.


title: Observations of spiral and streamer on a candidate proto-brown dwarf

abstract: Spirals and streamers are the hallmarks of mass accretion during the early stages of star formation. We present the first observations of a large-scale spiral and a streamer towards a very young brown dwarf candidate in its early formation stages. These observations show, for the first time, the influence of external environment that results in asymmetric mass accretion via feeding filaments onto a candidate proto-brown dwarf in the making. The impact of the streamer has produced emission in warm carbon-chain species close to the candidate proto-brown dwarf. Two contrasting scenarios, a pseudo-disk twisted by core rotation and the collision of dense cores, can both explain these structures. The former argues for the presence of a strong magnetic field in brown dwarf formation while the latter suggests that a minimal magnetic field allows large-scale spirals and clumps to form far from the candidate proto-brown dwarf.


title: Groups with infinite linearly ordered products

abstract: We introduce a formalism for considering infinite, linearly ordered products in groups. Using this, we define infinite compositions in certain groups of formal power series and show that such series can sometimes be represented as infinite, linearly ordered, semidirect products of ordered Abelian groups.


title: Textual Knowledge Matters: Cross-Modality Co-Teaching for Generalized Visual Class Discovery

abstract: In this paper, we study the problem of Generalized Category Discovery (GCD), which aims to cluster unlabeled data from both known and unknown categories using the knowledge of labeled data from known categories. Current GCD methods rely on only visual cues, which however neglect the multi-modality perceptive nature of human cognitive processes in discovering novel visual categories. To address this, we propose a two-phase TextGCD framework to accomplish multi-modality GCD by exploiting powerful Visual-Language Models. TextGCD mainly includes a retrieval-based text generation (RTG) phase and a cross-modality co-teaching (CCT) phase. First, RTG constructs a visual lexicon using category tags from diverse datasets and attributes from Large Language Models, generating descriptive texts for images in a retrieval manner. Second, CCT leverages disparities between textual and visual modalities to foster mutual learning, thereby enhancing visual GCD. In addition, we design an adaptive class aligning strategy to ensure the alignment of category perceptions between modalities as well as a soft-voting mechanism to integrate multi-modality cues. Experiments on eight datasets show the large superiority of our approach over state-of-the-art methods. Notably, our approach outperforms the best competitor, by 7.7% and 10.8% in All accuracy on ImageNet-1k and CUB, respectively.


title: Superconducting switching jump induced missing first Shapiro step in Al-InSb nanosheet Josephson junctions

abstract: The absence of odd-order Shapiro steps is one of the predicted signatures for topological superconductors. Experimentally, the missing first-order Shapiro step has been reported in several superconducting systems presumably to be topologically non-trivial, as well as in the topologically trivial regime of superconductor-semiconductor Josephson junctions. In this work, we revisit the missing first Shapiro step signature in the topologically trivial regime of Al-InSb nanosheet Josephson junctions under microwave irradiation. The missing first Shapiro step is found to be accompanied by a sharp voltage jump during the superconducting switching and reappears when the jump is softened by increasing temperature or magnetic field. The missing first Shapiro step also reappears with an increased microwave frequency. The sharp switching jump, existing without microwave irradiation, deviates from the relation given by the standard resistively shunted junction (RSJ) model. Missing Shapiro step signatures are qualitatively captured by introducing the sharp voltage jump into the RSJ model. This work reveals a common, yet overlooked, phenomenon that leads to the missing first Shapiro step, providing a new perspective on fractional Josephson experiments.


title: Time-Efficient and Identity-Consistent Virtual Try-On Using A Variant of Altered Diffusion Models

abstract: This study discusses the critical issues of Virtual Try-On in contemporary e-commerce and the prospective metaverse, emphasizing the challenges of preserving intricate texture details and distinctive features of the target person and the clothes in various scenarios, such as clothing texture and identity characteristics like tattoos or accessories. In addition to the fidelity of the synthesized images, the efficiency of the synthesis process presents a significant hurdle. Various existing approaches are explored, highlighting the limitations and unresolved aspects, e.g., identity information omission, uncontrollable artifacts, and low synthesis speed. It then proposes a novel diffusion-based solution that addresses garment texture preservation and user identity retention during virtual try-on. The proposed network comprises two primary modules - a warping module aligning clothing with individual features and a try-on module refining the attire and generating missing parts integrated with a mask-aware post-processing technique ensuring the integrity of the individual's identity. It demonstrates impressive results, surpassing the state-of-the-art in speed by nearly 20 times during inference, with superior fidelity in qualitative assessments. Quantitative evaluations confirm comparable performance with the recent SOTA method on the VITON-HD and Dresscode datasets.


title: Eliminating Cross-modal Conflicts in BEV Space for LiDAR-Camera 3D Object Detection

abstract: Recent 3D object detectors typically utilize multi-sensor data and unify multi-modal features in the shared bird's-eye view (BEV) representation space. However, our empirical findings indicate that previous methods have limitations in generating fusion BEV features free from cross-modal conflicts. These conflicts encompass extrinsic conflicts caused by BEV feature construction and inherent conflicts stemming from heterogeneous sensor signals. Therefore, we propose a novel Eliminating Conflicts Fusion (ECFusion) method to explicitly eliminate the extrinsic/inherent conflicts in BEV space and produce improved multi-modal BEV features. Specifically, we devise a Semantic-guided Flow-based Alignment (SFA) module to resolve extrinsic conflicts via unifying spatial distribution in BEV space before fusion. Moreover, we design a Dissolved Query Recovering (DQR) mechanism to remedy inherent conflicts by preserving objectness clues that are lost in the fusion BEV feature. In general, our method maximizes the effective information utilization of each modality and leverages inter-modal complementarity. Our method achieves state-of-the-art performance in the highly competitive nuScenes 3D object detection dataset. The code is released at https://github.com/fjhzhixi/ECFusion.


title: Calibration of VELC detectors on-board Aditya-L1 mission

abstract: Aditya-L1 is the first Indian space mission to explore the Sun and solar atmosphere with seven multi-wavelength payloads, with Visible Emission Line Coronagraph (VELC) being the prime payload. It is an internally occulted coronagraph with four channels to image the Sun at 5000 \AA~ in the field of view 1.05 - 3 \rsun, and to pursue spectroscopy at 5303 \AA, 7892 \AA~ and 10747 \AA~ channels in the FOV (1.05 - 1.5 \rsun). In addition, spectropolarimetry is planned at 10747 \AA~ channel. Therefore, VELC has three sCMOS detectors and one InGaAs detector. In this article, we aim to describe the technical details and specifications of the detectors achieved by way of thermo-vacuum calibration at the CREST campus of the Indian Institute of Astrophysics, Bangalore, India. Furthermore, we report the estimated conversion gain, full-well capacity, and readout noise at different temperatures. Based on the numbers, it is thus concluded that it is essential to operate the sCMOS detectors and InGaAs detectors at $-5^{\circ}$ and $-17^{\circ}$ C, respectively, at the spacecraft level.


title: Free submonoids of hyperbolic monoids

abstract: In this paper, we prove that infinite cancellative finitely generated hyperbolic monoids never contain $\mathbb N\times\mathbb N$ as a submonoid but that they contain an element of infinite order and, if they are elementary, then they also contain a free monoid of rank at least 2. As a corollary we obtain that the latter have exponential growth. We prove these results by analysing the monoid of self-embeddings of hyperbolic digraphs and proving fixed-point theorems for them.


title: A Novel Method to Constrain Tidal Quality Factor from A Non-synchronized Exoplanetary System

abstract: We propose a novel method to constrain the tidal quality factor, $Q'$, from a non-synchronized star-planet system consisting of a slowly rotating low-mass star and a close-in Jovian planet, taking into account the tidal interaction and the magnetic braking. On the basis of dynamical system theory, the track of the co-evolution of angular momentum for such a system exhibits the existence of a forbidden region in the $\Omega_\mathrm{orb}$ -- $\Omega_\mathrm{spin}$ plane , where $\Omega_\mathrm{spin}$ and $\Omega_\mathrm{orb}$ denote the angular velocity of the stellar spin and planetary orbit, respectively. The forbidden region is determined primarily by the strength of the tidal interaction. By comparing ($\Omega_\mathrm{orb},\Omega_\mathrm{spin}$) of a single star-planet system to the forbidden region, we can constrain the tidal quality factor regardless of the evolutionary history of the system. The application of this method to the star-planet system, NGTS-10 -- NGTS-10 b, gives $Q' \gtrsim 10^8$, leading to an tight upper bound on the tidal torque. Since this cannot be explained by previous theoretical predictions for non-synchronized star-planet systems, our result requires mechanisms that suppress the tidal interaction in such systems.


title: NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoning

abstract: Vision-and-Language Navigation (VLN), as a crucial research problem of Embodied AI, requires an embodied agent to navigate through complex 3D environments following natural language instructions. Recent research has highlighted the promising capacity of large language models (LLMs) in VLN by improving navigational reasoning accuracy and interpretability. However, their predominant use in an offline manner usually suffers from substantial domain gap between the VLN task and the LLM training corpus. This paper introduces a novel strategy called Navigational Chain-of-Thought (NavCoT), where we fulfill parameter-efficient in-domain training to enable self-guided navigational decision, leading to a significant mitigation of the domain gap in a cost-effective manner. Specifically, at each timestep, the LLM is prompted to forecast the navigational chain-of-thought by: 1) acting as a world model to imagine the next observation according to the instruction, 2) selecting the candidate observation that best aligns with the imagination, and 3) determining the action based on the reasoning from the prior steps. Through constructing formalized labels for training, the LLM can learn to generate desired and reasonable chain-of-thought outputs for improving the action decision. Experimental results across various training settings and popular VLN benchmarks (e.g., Room-to-Room (R2R), Room-across-Room (RxR), Room-for-Room (R4R)) show the significant superiority of NavCoT over the direct action prediction variants. Through simple parameter-efficient finetuning, our NavCoT outperforms a recent GPT4-based approach with ~7% relative improvement on the R2R dataset. We believe that NavCoT will help unlock more task-adaptive and scalable LLM-based embodied agents, which are helpful for developing real-world robotics applications. Code is available at https://github.com/expectorlin/NavCoT.


title: Generic simplicity of ellipses

abstract: We prove that the Laplace spectrum of the generic ellipse is simple, both with Neumann and Dirichlet boundary condition. We rely on the known multiplicities in the spectrum of the disk (Bourget's hypothesis) and on a refined version of our method of asymptotic separation of variables.


title: SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression

abstract: The advancements in Large Language Models (LLMs) have been hindered by their substantial sizes, which necessitate LLM compression methods for practical deployment. Singular Value Decomposition (SVD) offers a promising solution for LLM compression. However, state-of-the-art SVD-based LLM compression methods have two key limitations: truncating smaller singular values may lead to higher compression loss, and the lack of update on the compressed weight after SVD truncation. In this work, we propose SVD-LLM, a new SVD-based LLM compression method that addresses the limitations of existing methods. SVD-LLM incorporates a truncation-aware data whitening strategy to ensure a direct mapping between singular values and compression loss. Moreover, SVD-LLM adopts a layer-wise closed-form model parameter update strategy to compensate for accuracy degradation under high compression ratios. We evaluate SVD-LLM on a total of 10 datasets and eight models from three different LLM families at four different scales. Our results demonstrate the superiority of SVD-LLM over state-of-the-arts, especially at high model compression ratios.


title: Hallmarks of Optimization Trajectories in Neural Networks: Directional Exploration and Redundancy

abstract: We propose a fresh take on understanding the mechanisms of neural networks by analyzing the rich directional structure of optimization trajectories, represented by their pointwise parameters. Towards this end, we introduce some natural notions of the complexity of optimization trajectories, both qualitative and quantitative, which hallmark the directional nature of optimization in neural networks: when is there redundancy, and when exploration. We use them to reveal the inherent nuance and interplay involved between various optimization choices, such as momentum and weight decay. Further, the trajectory perspective helps us see the effect of scale on regularizing the directional nature of trajectories, and as a by-product, we also observe an intriguing heterogeneity of Q,K,V dynamics in the middle attention layers in LLMs and which is homogenized by scale. Importantly, we put the significant directional redundancy observed to the test by demonstrating that training only scalar batchnorm parameters some while into training matches the performance of training the entire network, which thus exhibits the potential of hybrid optimization schemes that are geared towards efficiency.


title: Gabor-guided transformer for single image deraining

abstract: Image deraining have have gained a great deal of attention in order to address the challenges posed by the effects of harsh weather conditions on visual tasks. While convolutional neural networks (CNNs) are popular, their limitations in capturing global information may result in ineffective rain removal. Transformer-based methods with self-attention mechanisms have improved, but they tend to distort high-frequency details that are crucial for image fidelity. To solve this problem, we propose the Gabor-guided tranformer (Gabformer) for single image deraining. The focus on local texture features is enhanced by incorporating the information processed by the Gabor filter into the query vector, which also improves the robustness of the model to noise due to the properties of the filter. Extensive experiments on the benchmarks demonstrate that our method outperforms state-of-the-art approaches.


title: The solenoidal Heisenberg Virasoro algebra and its simple weight modules

abstract: Let $A_n=\mathbb{C}[t_i^{\pm1},~1\leq i\leq n]$ and $\mathbf{W}(n)_\mu=A_nd_\mu$ the solenoidal Lie algebra introduced by Y.Billig and V.Futorny in \cite{BiFu2}, where $\mu=(\mu_1,\ldots,\mu_n)\in\mathbb{C}^n$ is a generic vector and $$d_\mu=\sum_{i=1}^n\mu_it_i\frac{\partial}{\partial t_i}.$$ We consider the semi-direct product Lie algebra $\mathbf{WA}(n)_\mu:=\mathbf{W}(n)_\mu\ltimes A_n$. In the first part, We prove that $\mathbf{WA}(n)_\mu$ has a unique three-dimensional universal central extension. In fact we construct a higher rank Heisenberg-Virasoro algebra (see \cite{LiuGuo, LdZ}). It will be denoted by $\mathbf{HVir}(n)_\mu$ and it will be called the solenoidal Heisenberg-Virasoro algebra. Then we will study Harish-Chandra modules of $\mathbf{HVir}(n)_\mu$ following \cite{LiuGuo}. We will obtain two classes of Harich-Chandra modules: generalized highest weight modules(\textbf{GHW} modules) and intermediate series modules. Our results are particular cases of \cite{LiuGuo}. In the end, we will construct $\mathbf{HVir}(n)_\mu$ Verma modules using the lexicographic order on $\mathbb{Z}^{n}$. In particular we give examples of irreducible weight modules which have infinite dimensional weight spaces.


title: Plasmon-driven creation of magnetic topological structures

abstract: In the present research, we demonstrate the usage of plasmonic effects in thin film structures to control magnetic topological textures, specifically skyrmions and skyrmioniums. We investigate numerically the generation and alteration of these topological structures caused by hemisphere gold nanoparticle placed over a magnetic layer coated with a dielectric material. The electromagnetic and photothermal models are used to clarify the processes of producing heat and absorption, and the results were implemented in micromagnetic formalism to reveal the dynamics of magnetization under various conditions. Our findings demonstrate the significance of the laser pulse duration and the contact area between nanoparticles and the underlying magnetic layer in forming topological textures. In particular, we show how to generate a single skyrmion, multiple skyrmions, and skyrmioniums, and how to dynamically transition between these states. These results highlight the possibility of manipulating magnetic textures by using plasmonic effects, which presents significant opportunities for spintronics and non-conventional computer applications.


title: Homogeneous quandles with commutative inner automorphism groups

abstract: In this paper, we give a characterization for homogeneous quandles with commutative inner automorphism groups. In particular, it is shown that such a quandle is expressed as an abelian extension of a trivial quandle. Our construction is a generalization of the recent work by Furuki and Tamaru, which gives the construction of disconnected flat quandles.


title: SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models

abstract: Despite the effectiveness of data selection for large language models (LLMs) during pretraining and instruction fine-tuning phases, improving data efficiency in supervised fine-tuning (SFT) for specialized domains poses significant challenges due to the complexity of fine-tuning data. To bridge this gap, we introduce an effective and scalable data selection method for SFT, SmallToLarge (S2L), which leverages training trajectories from small models to guide the data selection for larger models. We demonstrate through extensive experiments that S2L significantly improves data efficiency in SFT for mathematical problem-solving, reducing the training data to just 11% of the original MathInstruct dataset (Yue et al., 2023) to match full dataset performance while outperforming state-of-the-art data selection algorithms by an average of 4.7% across 6 in- and out-domain evaluation datasets. Remarkably, selecting only 50K data for SFT, S2L achieves a 32.7% accuracy on the most challenging MATH (Hendrycks et al., 2021) benchmark, improving Phi-2 (Li et al., 2023b) by 16.6%. In clinical text summarization on the MIMIC-III dataset (Johnson et al., 2016), S2L again outperforms training on the full dataset using only 50% of the data. Notably, S2L can perform data selection using a reference model 40x smaller than the target model, proportionally reducing the cost of data selection.


title: Phases and Duality in Fundamental Kazakov-Migdal Model on the Graph

abstract: We examine the fundamental Kazakov-Migdal (FKM) model on a generic graph, whose partition function is represented by the Ihara zeta function weighted by unitary matrices. The FKM model becomes unstable in the critical strip of the Ihara zeta function. We discover a duality between small and large couplings, associated with the functional equation of the Ihara zeta function for regular graphs. Although the duality is not precise for irregular graphs, we show that the effective action in the large coupling region can be represented by a summation of all possible Wilson loops on the graph similar to that in the small coupling region. We estimate the phase structure of the FKM model both in the small and large coupling regions by comparing it with the Gross-Witten-Wadia (GWW) model. We further validate the theoretical analysis through detailed numerical simulations.


title: Multi-source Scheduling and Resource Allocation for Age-of-Semantic-Importance Optimization in Status Update Systems

abstract: In recent years, semantic communication is progressively emerging as an effective means of facilitating intelligent and context-aware communication. However, current researches seldom simultaneously consider the reliability and timeliness of semantic communication, where scheduling and resource allocation (SRA) plays a crucial role. In contrast, conventional age-based approaches cannot seamlessly extend to semantic communication due to their oversight of semantic importance. To bridge this gap, we introduce a novel metric: Age of Semantic Importance (AoSI), which adaptly captures both the freshness of information and its semantic importance. Utilizing AoSI, we formulate an average AoSI minimization problem by optimizing multi-source SRA. To address this problem, we proposed a AoSI-aware joint SRA algorithm based on Deep Q-Network (DQN). Simulation results validate the effectiveness of our proposed method, demonstrating its ability to facilitate timely and reliable semantic communication.


title: Combinatorics of generalized parking-function polytopes

abstract: For $\mathbf{b}=(b_1,\dots,b_n)\in \mathbb{Z}_{>0}^n$, a $\mathbf{b}$-parking function is defined to be a sequence $(\beta_1,\dots,\beta_n)$ of positive integers whose nondecreasing rearrangement $\beta'_1\leq \beta'_2\leq \cdots \leq \beta'_n$ satisfies $\beta'_i\leq b_1+\cdots + b_i$. The $\mathbf{b}$-parking-function polytope $\mathfrak{X}_n(\mathbf{b})$ is the convex hull of all $\mathbf{b}$-parking functions of length $n$ in $\mathbb{R}^n$. Geometric properties of $\mathfrak{X}_n(\mathbf{b})$ were previously explored in the specific case where $\mathbf{b}=(a,b,b,\dots,b)$ and were shown to generalize those of the classical parking-function polytope. In this work, we study $\mathfrak{X}_n(\mathbf{b})$ in full generality. We present a minimal inequality and vertex description for $\mathfrak{X}_n(\mathbf{b})$, prove it is a generalized permutahedron, and study its $h$-polynomial. Furthermore, we investigate $\mathfrak{X}_n(\mathbf{b})$ through the perspectives of building sets and polymatroids, allowing us to identify its combinatorial types and obtain bounds on its combinatorial and circuit diameters.


title: Understanding the shear modulus of dense microgel suspensions

abstract: Polymer microgels exhibit intriguing macroscopic flow properties arising from their unique microscopic structure. Microgel colloids comprise a crosslinked polymer network with a radially decaying density profile, resulting in a dense core surrounded by a fuzzy corona. Notably, microgels synthesized from poly(N-isopropylacrylamide) (PNIPAM) are thermoresponsive, capable of adjusting their size and density profile based on temperature. Above the lower critical solution temperature ($T_\text{LCST}\sim 33$ $^\circ$C), the microgel's polymer network collapses, leading to the expulsion of water through a reversible process. Conversely, below $33$ $^\circ$C, the microgel's network swells, becoming highly compressible and allowing overpacking to effective volume fractions exceeding one. Under conditions of dense packing, microgels undergo deformation in distinct stages: corona compression and faceting, interpenetration, and finally, isotropic compression. Each stage exhibits a characteristic signature in the yield stress and elastic modulus of the dense microgel suspensions. Here, we introduce a model for the linear elastic shear modulus through the minimization of a quasi-equilibrium free energy, encompassing all relevant energetic contributions. We validate our model by comparing its predictions to experimental results from oscillatory shear rheology tests on microgel suspensions at different densities and temperatures. Our findings demonstrate that combining macroscopic rheological measurements with the model allows for temperature-dependent characterization of polymer interaction parameters.


title: Auxiliary CycleGAN-guidance for Task-Aware Domain Translation from Duplex to Monoplex IHC Images

abstract: Generative models enable the translation from a source image domain where readily trained models are available to a target domain unseen during training. While Cycle Generative Adversarial Networks (GANs) are well established, the associated cycle consistency constrain relies on that an invertible mapping exists between the two domains. This is, however, not the case for the translation between images stained with chromogenic monoplex and duplex immunohistochemistry (IHC) assays. Focusing on the translation from the latter to the first, we propose - through the introduction of a novel training design, an alternative constrain leveraging a set of immunofluorescence (IF) images as an auxiliary unpaired image domain. Quantitative and qualitative results on a downstream segmentation task show the benefit of the proposed method in comparison to baseline approaches.


title: Learning Correction Errors via Frequency-Self Attention for Blind Image Super-Resolution

abstract: Previous approaches for blind image super-resolution (SR) have relied on degradation estimation to restore high-resolution (HR) images from their low-resolution (LR) counterparts. However, accurate degradation estimation poses significant challenges. The SR model's incompatibility with degradation estimation methods, particularly the Correction Filter, may significantly impair performance as a result of correction errors. In this paper, we introduce a novel blind SR approach that focuses on Learning Correction Errors (LCE). Our method employs a lightweight Corrector to obtain a corrected low-resolution (CLR) image. Subsequently, within an SR network, we jointly optimize SR performance by utilizing both the original LR image and the frequency learning of the CLR image. Additionally, we propose a new Frequency-Self Attention block (FSAB) that enhances the global information utilization ability of Transformer. This block integrates both self-attention and frequency spatial attention mechanisms. Extensive ablation and comparison experiments conducted across various settings demonstrate the superiority of our method in terms of visual quality and accuracy. Our approach effectively addresses the challenges associated with degradation estimation and correction errors, paving the way for more accurate blind image SR.


title: Towards adiabatic-connection interpolation model with broader applicability

abstract: The Adiabatic Connection Integrand Interpolation (ACII) method represents a general path for calculating correlation energies in electronic systems within the Den sity Functional Theory. ACII functionals include both exact-exchange and the second-order correlation energy, as well as an interpolating function toward the strictly-correlated electron (SCE) regime. Several interpolating functions have been proposed in the last years targeting different properties, yet an accurate ACII approach with broad applicability is sti ll missing. Recently, we have proposed an ACII functional that was made accurate for the three-dimensional (3D) uniform electron gas as well as for model metal clusters. In this work we present an ACII functional (named genISI2) which is very accurate for both three-dimensional (3D) and two-dimensional (2D) uniform electron gases and for the q uasi-2D infinite barrier model, where most of the exchange-correlation functionals fail badly, as well as for strongly correlated two-electrons systems. Using the exact-exchange Kohn-Sham orbitals, we have also assessed the genISI2 for various molecular systems, showing a superior performance with respect to the o ther ACII methods for total energies, atomization energies, and ionization potentials. The genISI2 functional can thus find application in a broad range of systems and properties.


title: ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictions

abstract: Although Vision Transformer (ViT) has achieved significant success in computer vision, it does not perform well in dense prediction tasks due to the lack of inner-patch information interaction and the limited diversity of feature scale. Most existing studies are devoted to designing vision-specific transformers to solve the above problems, which introduce additional pre-training costs. Therefore, we present a plain, pre-training-free, and feature-enhanced ViT backbone with Convolutional Multi-scale feature interaction, named ViT-CoMer, which facilitates bidirectional interaction between CNN and transformer. Compared to the state-of-the-art, ViT-CoMer has the following advantages: (1) We inject spatial pyramid multi-receptive field convolutional features into the ViT architecture, which effectively alleviates the problems of limited local information interaction and single-feature representation in ViT. (2) We propose a simple and efficient CNN-Transformer bidirectional fusion interaction module that performs multi-scale fusion across hierarchical features, which is beneficial for handling dense prediction tasks. (3) We evaluate the performance of ViT-CoMer across various dense prediction tasks, different frameworks, and multiple advanced pre-training. Notably, our ViT-CoMer-L achieves 64.3% AP on COCO val2017 without extra training data, and 62.1% mIoU on ADE20K val, both of which are comparable to state-of-the-art methods. We hope ViT-CoMer can serve as a new backbone for dense prediction tasks to facilitate future research. The code will be released at https://github.com/Traffic-X/ViT-CoMer.


title: Learning on the correct class for domain inverse problems of gravimetry

abstract: We consider end-to-end learning approaches for inverse problems of gravimetry. Due to ill-posedness of the inverse gravimetry, the reliability of learning approaches is questionable. To deal with this problem, we propose the strategy of learning on the correct class. The well-posedness theorems are employed when designing the neural-network architecture and constructing the training set. Given the density-contrast function as a priori information, the domain of mass can be uniquely determined under certain constrains, and the domain inverse problem is a correct class of the inverse gravimetry. Under this correct class, we design the neural network for learning by mimicking the level-set formulation for the inverse gravimetry. Numerical examples illustrate that the method is able to recover mass models with non-constant density contrast.


title: A regularization theorem for bounded-degree self-maps

abstract: Let $K$ be an algebraically closed field of arbitrary characteristic and let $X$ be an irreducible projective variety over $K$. Let $G\subseteq\text{Bir}(X)$ be a bounded-degree subgroup. We prove that there exists an irreducible projective variety $Y$ birational to $X$, such that every element of $G$ becomes an automorphism of $Y$ after the birational transformation. If $K=\mathbb{C}$, this result is stated in [Can14, Theorem 2.5] and the proof backs to [HZ96, Section 5]. The proof in [HZ96] is not purely algebraic. Inheriting the methods in [HZ96], we give a purely algebraic proof of this statement in arbitrary characteristic. We will also discuss a corollary of this result which is useful in arithmetic dynamics.


title: Predicting the Slowing of Stellar Differential Rotation by Instability-Driven Turbulence

abstract: Differentially rotating stars and planets transport angular momentum internally due to turbulence at rates that have long been a challenge to predict reliably. We develop a self-consistent saturation theory, using a statistical closure approximation, for hydrodynamic turbulence driven by the axisymmetric Goldreich--Schubert--Fricke (GSF) instability at the stellar equator with radial differential rotation. This instability arises when fast thermal diffusion eliminates the stabilizing effects of buoyancy forces in a system where a stabilizing entropy gradient dominates over the destabilizing angular momentum gradient. Our turbulence closure invokes a dominant three-wave coupling between pairs of linearly unstable eigenmodes and a near-zero frequency, viscously damped eigenmode that features latitudinal jets. We derive turbulent transport rates of momentum and heat, and provide them in analytic forms. Such formulae, free of tunable model parameters, are tested against direct numerical simulations; the comparison shows good agreement. They improve upon prior quasi-linear or ``parasitic saturation" models containing a free parameter. Given model correspondences, we also extend this theory to heat and compositional transport for axisymmetric thermohaline instability-driven turbulence in certain regimes.


title: Crystal design of altermagnetism

abstract: Symmetry plays a fundamental role in condensed matter. The unique entanglement between magnetic sublattices and alternating crystal environment in altermagnets provides a unique opportunity for designing magnetic space symmetry. There have been extensive experimental efforts concentrated on tuning the Neel vector to reconstruct altermagnetic symmetry. However, it remains challenging to modulate the altermagnetic symmetry through the crystal aspect. Here, the crystal design of altermagnetism is successfully realized, by breaking glide mirrors and magnetic mirrors of the (0001) crystallographic plane in CrSb films via crystal distortion. We establish a locking relationship between altermagnetic symmetry and the emergent Dzyaloshinskii-Moriya (DM) vectors in different CrSb films, realizing unprecedentedly room-temperature spontaneous anomalous Hall effect in an altermagnetic metal. The concept of exchange-coupling torques is broadened to include both antiferromagnetic exchange-coupling torque and DM torque. Their relationship is designable, determining electrical manipulation modes, e.g., field-assisted switching for CrSb(1-100)/Pt and field-free switching for W/CrSb(11-20). Particularly, the unprecedentedly field-free 100-percent switching of Neel vectors is realized by making these two torques parallel or antiparallel, dependent on Neel vector orientation. Besides unravelling the rich mechanisms for electrical manipulation of altermagnetism rooted in broadened concept of exchange-coupling torques, we list other material candidates and propose that crystal design of altermagnetism would bring rich designability to magnonics, topology, etc.


title: Skyrmion flow in periodically modulated channels

abstract: Magnetic skyrmions, topologically stabilized chiral magnetic textures with particle-like properties have so far primarily been studied statically. Here, we experimentally investigate the dynamics of skyrmion ensembles in metallic thin film conduits where they behave as quasi-particle fluids. By exploiting our access to the full trajectories of all fluid particles by means of time-resolved magneto-optical Kerr microscopy, we demonstrate that boundary conditions of skyrmion fluids can be tuned by modulation of the channel geometry. We observe as a function of channel width deviations from classical flow profiles even into the no- or partial-slip regime. Unlike conventional colloids, the skyrmion Hall effect can also introduce transversal flow-asymmetries and even local motion of single skyrmions against the driving force which we explore with particle-based simulations, demonstrating the unique properties of skyrmion liquid flow that uniquely deviates from previously known behavior of other quasi-particles.


title: Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs

abstract: Event commonsense reasoning requires the ability to reason about the relationship between events, as well as infer implicit context underlying that relationship. However, data scarcity makes it challenging for language models to learn to generate commonsense inferences for contexts and questions involving interactions between complex events. To address this demand, we present COM2 (COMplex COMmonsense), a new dataset created by sampling multi-hop logical queries (e.g., the joint effect or cause of both event A and B, or the effect of the effect of event C) from an existing commonsense knowledge graph (CSKG), and verbalizing them using handcrafted rules and large language models into multiple-choice and text generation questions. Our experiments show that language models trained on COM2 exhibit significant improvements in complex reasoning ability, resulting in enhanced zero-shot performance in both in-domain and out-of-domain tasks for question answering and generative commonsense reasoning, without expensive human annotations. Code and data are available at https://github.com/tqfang/complex-commonsense-reasoning.


title: Automorphisms of Hilbert schemes of Cayley's K3 surfaces

abstract: We prove that the automorphism group of Hilbert square of a Cayley's K3 surface of Picard number 2 is the free product of three cyclic groups of order two. The generators are three Beauville involutions.


title: Boundedness of energy for N-body Schr\"odinger equations with time dependent small potentials

abstract: We prove that Sobolev norms of solutions to time dependent Schr\"odinger equations for $d$-dimensional $N$-partcles interacting via time dependent two body potentials are bounded in time if certain Lebesgue norms of the potentials are small uniformly in time. The proof uses the scattering theory in the extended phase space which proves that all particles scatter freely in the remote past and far future.


title: Constraining the Initial Mass function in the Epoch of Reionization from Astrophysical and Cosmological data

abstract: [abridged] We aim to constrain the stellar initial mass function (IMF) during the epoch of reionization. To this purpose, we build up a semi-empirical model for the reionization history of the Universe, based on various ingredients: the latest determination of the UV galaxy luminosity function from JWST out to redshift $z\lesssim 12$; data-inferred and simulation-driven assumptions on the redshift-dependent escape fraction of ionizing photons from primordial galaxies; a simple yet flexible parameterization of the IMF $\phi(m_\star)\sim m_\star^\xi\, e^{-m_{\star,\rm c}/m_\star}$ in terms of a high-mass end slope $\xi<0$ and of a characteristic mass $m_{\star,\rm c}$ below which a flattening or a bending sets in; the PARSEC stellar evolution code to compute the UV and ionizing emission from different star's masses as a function of age and metallicity; a few physical constraints related to stellar and galaxy formation in faint galaxies at the reionization redshifts. We compare our model outcomes with the reionization observables from different astrophysical and cosmological probes, and perform Bayesian inference on the IMF parameters. We find that the IMF slope $\xi$ is within the range from $-2.8$ to $-2.3$, while appreciably flatter slopes are excluded at great significance. However, the bestfit value of the IMF characteristic mass $m_{\star,\rm c}\sim$ a few $M_\odot$ implies a suppression in the formation of small stellar masses, at variance with the IMF in the local Universe; this may be induced by the thermal background $\sim 20-30$ K provided by CMB photons at the reionization redshifts. Finally, we investigate the implications of our reconstructed IMF on the recent JWST detections of massive galaxies at and beyond the reionization epoch, showing that any putative tension with the standard cosmological framework is substantially alleviated.


title: Renormalization of Complex Networks with Partition Functions

abstract: While renormalization groups are fundamental in physics, renormalization of complex networks remains vague in its conceptual definition and methodology. Here, we propose a novel strategy to renormalize complex networks. Rather than resorting to handling the bare structure of a network, we overlay it with a readily renormalizable physical model, which reflects real-world scenarios with a broad generality. From the renormalization of the overlying system, we extract a rigorous and simple renormalization group transformation of arbitrary networks. In this way, we obtain a transparent, model-dependent physical meaning of the network renormalization, which in our case is a scale transformation preserving the transition dynamics of low-density particles. We define the strength of a node in accordance with the physical model and trace the change of its distribution under our renormalization process. This analysis demonstrates that the strength distributions of scale-free networks remain scale-invariant, whereas those of homogeneous random networks do not.


title: From Canteen Food to Daily Meals: Generalizing Food Recognition to More Practical Scenarios

abstract: The precise recognition of food categories plays a pivotal role for intelligent health management, attracting significant research attention in recent years. Prominent benchmarks, such as Food-101 and VIREO Food-172, provide abundant food image resources that catalyze the prosperity of research in this field. Nevertheless, these datasets are well-curated from canteen scenarios and thus deviate from food appearances in daily life. This discrepancy poses great challenges in effectively transferring classifiers trained on these canteen datasets to broader daily-life scenarios encountered by humans. Toward this end, we present two new benchmarks, namely DailyFood-172 and DailyFood-16, specifically designed to curate food images from everyday meals. These two datasets are used to evaluate the transferability of approaches from the well-curated food image domain to the everyday-life food image domain. In addition, we also propose a simple yet effective baseline method named Multi-Cluster Reference Learning (MCRL) to tackle the aforementioned domain gap. MCRL is motivated by the observation that food images in daily-life scenarios exhibit greater intra-class appearance variance compared with those in well-curated benchmarks. Notably, MCRL can be seamlessly coupled with existing approaches, yielding non-trivial performance enhancements. We hope our new benchmarks can inspire the community to explore the transferability of food recognition models trained on well-curated datasets toward practical real-life applications.


title: Accelerated Inference and Reduced Forgetting: The Dual Benefits of Early-Exit Networks in Continual Learning

abstract: Driven by the demand for energy-efficient employment of deep neural networks, early-exit methods have experienced a notable increase in research attention. These strategies allow for swift predictions by making decisions early in the network, thereby conserving computation time and resources. However, so far the early-exit networks have only been developed for stationary data distributions, which restricts their application in real-world scenarios with continuous non-stationary data. This study aims to explore the continual learning of the early-exit networks. We adapt existing continual learning methods to fit with early-exit architectures and investigate their behavior in the continual setting. We notice that early network layers exhibit reduced forgetting and can outperform standard networks even when using significantly fewer resources. Furthermore, we analyze the impact of task-recency bias on early-exit inference and propose Task-wise Logits Correction (TLC), a simple method that equalizes this bias and improves the network performance for every given compute budget in the class-incremental setting. We assess the accuracy and computational cost of various continual learning techniques enhanced with early-exits and TLC across standard class-incremental learning benchmarks such as 10 split CIFAR100 and ImageNetSubset and show that TLC can achieve the accuracy of the standard methods using less than 70\% of their computations. Moreover, at full computational budget, our method outperforms the accuracy of the standard counterparts by up to 15 percentage points. Our research underscores the inherent synergy between early-exit networks and continual learning, emphasizing their practical utility in resource-constrained environments.


title: Radon Concentration Measurement with a High-Sensitivity Radon Detector at the Yemilab

abstract: The radiation emitted from radon is a critical background in rare event search experiments conducted at the Yemi Underground Laboratory (Yemilab) in Jeongseon, Korea. A Radon Reduction System(RRS) has been developed and installed in Yemilab to reduce radon concentration in the air. The RRS primarily provides a purified air of 50 m3/h to the cleanroom used to assemble crystal detectors in the AMoRE, a neutrinoless double beta decay search experiment. RRS can reduce the radon level by a factor of 300, so a high-sensitivity radon detector was required. A highly sensitive radon detector was constructed using a 70 L chamber with a large PIN photodiode to measure radon concentration in the purified air. The radon detector shows an excellent resolution of 72 keV (FWHM) for 6.003 MeV alphas from 218Po decay and a sensitivity down to 23.8 +- 2.1 mBq/m3 with a boil-off N2 gas sample. The radon concentration level from the RRS measured by the radon detector was below 0.29 Bq/m3 with a reduction factor of about 300.

categories: physics.ins-det astro-ph.IM hep-ex nucl-ex


title: FeTrIL++: Feature Translation for Exemplar-Free Class-Incremental Learning with Hill-Climbing

abstract: Exemplar-free class-incremental learning (EFCIL) poses significant challenges, primarily due to catastrophic forgetting, necessitating a delicate balance between stability and plasticity to accurately recognize both new and previous classes. Traditional EFCIL approaches typically skew towards either model plasticity through successive fine-tuning or stability by employing a fixed feature extractor beyond the initial incremental state. Building upon the foundational FeTrIL framework, our research extends into novel experimental domains to examine the efficacy of various oversampling techniques and dynamic optimization strategies across multiple challenging datasets and incremental settings. We specifically explore how oversampling impacts accuracy relative to feature availability and how different optimization methodologies, including dynamic recalibration and feature pool diversification, influence incremental learning outcomes. The results from these comprehensive experiments, conducted on CIFAR100, Tiny-ImageNet, and an ImageNet-Subset, under-score the superior performance of FeTrIL in balancing accuracy for both new and past classes against ten contemporary methods. Notably, our extensions reveal the nuanced impacts of oversampling and optimization on EFCIL, contributing to a more refined understanding of feature-space manipulation for class incremental learning. FeTrIL and its extended analysis in this paper FeTrIL++ pave the way for more adaptable and efficient EFCIL methodologies, promising significant improvements in handling catastrophic forgetting without the need for exemplars.


title: In-context learning enables multimodal large language models to classify cancer pathology images

abstract: Medical image classification requires labeled, task-specific datasets which are used to train deep learning networks de novo, or to fine-tune foundation models. However, this process is computationally and technically demanding. In language processing, in-context learning provides an alternative, where models learn from within prompts, bypassing the need for parameter updates. Yet, in-context learning remains underexplored in medical image analysis. Here, we systematically evaluate the model Generative Pretrained Transformer 4 with Vision capabilities (GPT-4V) on cancer image processing with in-context learning on three cancer histopathology tasks of high importance: Classification of tissue subtypes in colorectal cancer, colon polyp subtyping and breast tumor detection in lymph node sections. Our results show that in-context learning is sufficient to match or even outperform specialized neural networks trained for particular tasks, while only requiring a minimal number of samples. In summary, this study demonstrates that large vision language models trained on non-domain specific data can be applied out-of-the box to solve medical image-processing tasks in histopathology. This democratizes access of generalist AI models to medical experts without technical background especially for areas where annotated data is scarce.


title: NightHaze: Nighttime Image Dehazing via Self-Prior Learning

abstract: Masked autoencoder (MAE) shows that severe augmentation during training produces robust representations for high-level tasks. This paper brings the MAE-like framework to nighttime image enhancement, demonstrating that severe augmentation during training produces strong network priors that are resilient to real-world night haze degradations. We propose a novel nighttime image dehazing method with self-prior learning. Our main novelty lies in the design of severe augmentation, which allows our model to learn robust priors. Unlike MAE that uses masking, we leverage two key challenging factors of nighttime images as augmentation: light effects and noise. During training, we intentionally degrade clear images by blending them with light effects as well as by adding noise, and subsequently restore the clear images. This enables our model to learn clear background priors. By increasing the noise values to approach as high as the pixel intensity values of the glow and light effect blended images, our augmentation becomes severe, resulting in stronger priors. While our self-prior learning is considerably effective in suppressing glow and revealing details of background scenes, in some cases, there are still some undesired artifacts that remain, particularly in the forms of over-suppression. To address these artifacts, we propose a self-refinement module based on the semi-supervised teacher-student framework. Our NightHaze, especially our MAE-like self-prior learning, shows that models trained with severe augmentation effectively improve the visibility of input haze images, approaching the clarity of clear nighttime images. Extensive experiments demonstrate that our NightHaze achieves state-of-the-art performance, outperforming existing nighttime image dehazing methods by a substantial margin of 15.5% for MUSIQ and 23.5% for ClipIQA.


title: Universal Slepian-Wolf coding for individual sequences

abstract: We establish a coding theorem and a matching converse theorem for separate encodings and joint decoding of individual sequences using finite-state machines. The achievable rate region is characterized in terms of the Lempel-Ziv (LZ) complexities, the conditional LZ complexities and the joint LZ complexity of the two source sequences. An important feature that is needed to this end, which may be interesting on its own right, is a certain asymptotic form of a chain rule for LZ complexities, which we establish in this work. The main emphasis in the achievability scheme is on the universal decoder and its properties. We then show that the achievable rate region is universally attainable by a modified version of Draper's universal incremental Slepian-Wolf (SW) coding scheme, provided that there exists a low-rate reliable feedback link.


title: Polylog-Competitive Deterministic Local Routing and Scheduling

abstract: This paper addresses point-to-point packet routing in undirected networks, which is the most important communication primitive in most networks. The main result proves the existence of routing tables that guarantee a polylog-competitive completion-time $\textbf{deterministically}$: in any undirected network, it is possible to give each node simple stateless deterministic local forwarding rules, such that, any adversarially chosen set of packets are delivered as fast as possible, up to polylog factors. All previous routing strategies crucially required randomization for both route selection and packet scheduling. The core technical contribution of this paper is a new local packet scheduling result of independent interest. This scheduling strategy integrates well with recent sparse semi-oblivious path selection strategies. Such strategies deterministically select not one but several candidate paths for each packet and require a global coordinator to select a single good path from those candidates for each packet. Another challenge is that, even if a single path is selected for each packet, no strategy for scheduling packets along low-congestion paths that is both local and deterministic is known. Our novel scheduling strategy utilizes the fact that every semi-oblivious routing strategy uses only a small (polynomial) subset of candidate routes. It overcomes the issue of global coordination by furthermore being provably robust to adversarial noise. This avoids the issue of having to choose a single path per packet because congestion caused by ineffective candidate paths can be treated as noise. Our results imply the first deterministic universally-optimal algorithms in the distributed supported-CONGEST model for many important global distributed tasks, including computing minimum spanning trees, approximate shortest paths, and part-wise aggregates.


title: Cube tilings with linear constraints

abstract: We consider tilings $(\mathcal{Q},\Phi)$ of $\mathbb{R}^d$ where $\mathcal{Q}$ is the $d$-dimensional unit cube and the set of translations $\Phi$ is constrained to lie in a pre-determined lattice $A \mathbb{Z}^d$ in $\mathbb{R}^d$. We provide a full characterization of matrices $A$ for which such cube tilings exist when $\Phi$ is a sublattice of $A\mathbb{Z}^d$ with any $d \in \mathbb{N}$ or a generic subset of $A\mathbb{Z}^d$ with $d\leq 7$. As a direct consequence of our results, we obtain a criterion for the existence of linearly constrained frequency sets, that is, $\Phi \subseteq A\mathbb{Z}^d$, such that the respective set of complex exponential functions $\mathcal{E} (\Phi)$ is an orthogonal Fourier basis for the space of square integrable functions supported on a parallelepiped $B\mathcal{Q}$, where $A, B \in \mathbb{R}^{d \times d}$ are nonsingular matrices given a priori. Similarly constructed Riesz bases are considered in a companion paper.


title: GPU-Accelerated Vecchia Approximations of Gaussian Processes for Geospatial Data using Batched Matrix Computations

abstract: Gaussian processes (GPs) are commonly used for geospatial analysis, but they suffer from high computational complexity when dealing with massive data. For instance, the log-likelihood function required in estimating the statistical model parameters for geospatial data is a computationally intensive procedure that involves computing the inverse of a covariance matrix with size n X n, where n represents the number of geographical locations. As a result, in the literature, studies have shifted towards approximation methods to handle larger values of n effectively while maintaining high accuracy. These methods encompass a range of techniques, including low-rank and sparse approximations. Vecchia approximation is one of the most promising methods to speed up evaluating the log-likelihood function. This study presents a parallel implementation of the Vecchia approximation, utilizing batched matrix computations on contemporary GPUs. The proposed implementation relies on batched linear algebra routines to efficiently execute individual conditional distributions in the Vecchia algorithm. We rely on the KBLAS linear algebra library to perform batched linear algebra operations, reducing the time to solution compared to the state-of-the-art parallel implementation of the likelihood estimation operation in the ExaGeoStat software by up to 700X, 833X, 1380X on 32GB GV100, 80GB A100, and 80GB H100 GPUs, respectively. We also successfully manage larger problem sizes on a single NVIDIA GPU, accommodating up to 1M locations with 80GB A100 and H100 GPUs while maintaining the necessary application accuracy. We further assess the accuracy performance of the implemented algorithm, identifying the optimal settings for the Vecchia approximation algorithm to preserve accuracy on two real geospatial datasets: soil moisture data in the Mississippi Basin area and wind speed data in the Middle East.


title: Learning-Augmented Algorithms with Explicit Predictors

abstract: Recent advances in algorithmic design show how to utilize predictions obtained by machine learning models from past and present data. These approaches have demonstrated an enhancement in performance when the predictions are accurate, while also ensuring robustness by providing worst-case guarantees when predictions fail. In this paper we focus on online problems; prior research in this context was focused on a paradigm where the predictor is pre-trained on past data and then used as a black box (to get the predictions it was trained for). In contrast, in this work, we unpack the predictor and integrate the learning problem it gives rise for within the algorithmic challenge. In particular we allow the predictor to learn as it receives larger parts of the input, with the ultimate goal of designing online learning algorithms specifically tailored for the algorithmic task at hand. Adopting this perspective, we focus on a number of fundamental problems, including caching and scheduling, which have been well-studied in the black-box setting. For each of the problems we consider, we introduce new algorithms that take advantage of explicit learning algorithms which we carefully design towards optimizing the overall performance. We demonstrate the potential of our approach by deriving performance bounds which improve over those established in previous work.


title: Strong asymptotic giant branch stars' spectral features in distant quiescent galaxies: Impact on galaxy evolution

abstract: Age-dating and weighting stellar populations in galaxies at various cosmic epochs are essential steps to study galaxy formation through cosmic times. Evolutionary population synthesis models with different input physics are used towards this aim. In particular, the contribution from the thermally pulsing asymptotic-giant-branch (TP-AGB) stellar phase, which peaks for intermediate-age 0.6-2 Gyr systems, has been debated upon for decades. Here we report the detection of strong cool star signatures in the rest-frame near-infrared spectra of three young (~1 Gyr), massive (~10^10 Msun) quiescent galaxies at large look-back time, z=1-2, using JWST/NIRSpec. The co-existence of oxygen- and carbon-type absorption features, spectral edges and features from rare species such as Vanadium, and possibly Zirconium, reveal a strong contribution from TP-AGB stars. Population synthesis models with significant TP-AGB contribution reproduce the observations considerably better than those with weak TP-AGB, which are those commonly used. These findings call for revisions of published stellar population fitting results, pointing to lower masses and younger ages, with additional implications on cosmic dust production and chemical enrichment. These results will stimulate new generations of improved models informed by these and future observations.


title: Frequency-explicit stability estimates for time-harmonic elastodynamic problems in nearly incompressible materials

abstract: We consider time-harmonic elastodynamic problems in heterogeneous media.cWe focus on scattering problems in the high-frequency regime and incnearly incompressible media, where the the angular frequency $\omega$ and ratio of the Lam\'e parameters $\lambda/\mu$ may both be large. We derive stability estimates controlling the norm of the solution by the norm of the right-hand side up to a fully-explicit constant. Crucially, under natural assumptions on the domain and coefficients, this constant increases linearly with $\omega$ and is uniform in the ratio $\lambda/\mu$.


title: Grain growth competition and formation of grain boundaries during solidification of hcp alloys

abstract: Grain growth competition during directional solidification of a polycrystal with hexagonal (hcp) symmetry (Mg-1wt%Gd alloy) is studied by phase-field modeling, exploring the effect of the temperature gradient G on the resulting grain boundary (GB) orientation selection. Results show that selection mechanisms and scaling laws derived for cubic (fcc, bcc) crystals also apply to hcp materials (within their basal plane), provided a re-estimation of fitting parameters and re-scaling to account for the sixfold symmetry. While grain growth competition remains stochastic with rare events of unexpected elimination or side-branching along the developing GBs, we also confirm an overall transition from a geometrical limit to a favorably oriented grain limit behavior with an increase of thermal gradient within the dendritic regime, and the progressive alignment of dendrites and GBs toward the temperature gradient direction with an increase of G during the dendritic-to-cellular morphological transition. Comparisons with original thin-sample directional solidification experiments show a qualitative agreement with PF results, yet with notable discrepancies, which nonetheless can be explained based on the stochastic variability of selected GB orientations, and the statistically limited experimental sample size. Overall, our results extend the understanding of GB formation and grain growth competition during solidification of hcp materials, and the effect of thermal conditions, nonetheless concluding on the challenges of extending the current studies to three dimensions, and the need for much broader (statistically significant) data sets of GB orientation selected under well-identified solidification conditions.


title: Cabello's nonlocality argument for multisetting high-dimensional systems and its experimental test

abstract: Recent advancements have expanded Hardy's nonlocality arguments into multisetting and multidimensional systems to enhance quantum correlations. In comparison with Hardy's nonlocal argument, Cabello's nonlocal argument (CNA) emerges as a superior choice for illustrating nonlocal features. An open question persists regarding the potential extension of CNA to arbitrary (k, d) scenarios. Here, we answer this question both in theory and experiment. Theoretically, by utilizing compatibility graphs, we construct a new logical framework for multisetting and multidimensional CNA, demonstrating an increase in the maximum successful probability with setting k and dimension d. Experimentally, by employing controllable photonic orbital angular momentum entanglement, we exhibit nonlocality with an experimentally recorded probability of 20.29% in the (2, 4) scenario and 28.72% in the (6, 2) scenario. Our work showcases a sharper contradiction between quantum mechanics and classical theory, surpassing the bound limited by the original version.


title: $\lambda$-shaped random matrices, $\lambda$-plane trees, and $\lambda$-Dyck paths

abstract: We consider random matrices whose shape is the dilation $N\lambda$ of a self-conjugate Young diagram $\lambda$. In the large-$N$ limit, the empirical distribution of the squared singular values converges almost surely to a probability distribution $F^{\lambda}$. The moments of $F^{\lambda}$ enumerate two combinatorial objects: $\lambda$-plane trees and $\lambda$-Dyck paths, which we introduce and show to be in bijection. We also prove that the distribution $F^{\lambda}$ is algebraic, in the sense of Rao and Edelman. In the case of fat hook shapes we provide explicit formulae for $F^{\lambda}$ and we express it as a free convolution of two measures involving a Marchenko-Pastur and a Bernoulli distribution.


title: Quenching and flow of charm and bottom quarks via semi-leptonic decay of $D$ and $B$ mesons in Pb+Pb collisions at the LHC

abstract: Heavy flavor particles provide important probes of the microscopic structure and thermodynamic properties of the quark-gluon plasma (QGP) produced in high-energy nucleus-nucleus collisions. We study the energy loss and flow of charm and bottom quarks inside the QGP via the nuclear modification factor ($R_\mathrm{AA}$) and elliptic flow coefficient ($v_2$) of their decayed leptons in heavy-ion collisions at the LHC. The dynamical evolution of the QGP is performed using the (3+1)-dimensional viscous hydrodynamics model CLVisc; the evolution of heavy quarks inside the QGP is simulated with our improved Langevin model that takes into account both collisional and radiative energy loss of heavy quarks; the hadronization of heavy quarks is simulated via our hybrid coalescence-fragmentation model; and the semi-leptonic decay of $D$ and $B$ mesons is simulated via PYTHIA. By using the same spatial diffusion coefficient for charm and bottom quarks, we obtain smaller $R_\mathrm{AA}$ and larger $v_2$ of charm decayed leptons than bottom decayed leptons, indicating stronger energy loss of charm quarks than bottom quarks inside the QGP within our current model setup.


title: DragAnything: Motion Control for Anything using Entity Representation

abstract: We introduce DragAnything, which utilizes a entity representation to achieve motion control for any object in controllable video generation. Comparison to existing motion control methods, DragAnything offers several advantages. Firstly, trajectory-based is more userfriendly for interaction, when acquiring other guidance signals (e.g., masks, depth maps) is labor-intensive. Users only need to draw a line (trajectory) during interaction. Secondly, our entity representation serves as an open-domain embedding capable of representing any object, enabling the control of motion for diverse entities, including background. Lastly, our entity representation allows simultaneous and distinct motion control for multiple objects. Extensive experiments demonstrate that our DragAnything achieves state-of-the-art performance for FVD, FID, and User Study, particularly in terms of object motion control, where our method surpasses the previous methods (e.g., DragNUWA) by 26% in human voting.


title: On the Borel complexity and the complete metrizability of spaces of metrics

abstract: Given a metrizable space $X$, let $AM(X)$ be the space of continuous bounded admissible metrics on $X$, which is endowed with the sup-metric. In this paper, we shall investigate the Borel complexity and the complete metrizability of $AM(X)$ and show that a separable metrizable space $X$ is $\sigma$-compact if and only if $AM(X)$ is completely metrizable.


title: Persistent Upflows and Downflows at Active Region boundaries Observed by SUTRI and AIA

abstract: Upflows and downflows at active region (AR) boundaries have been frequently observed with spectroscopic observations at extreme ultraviolet (EUV) passbands. In this paper, we report the coexistence of upflows and downflows at the AR boundaries with imaging observations from the Solar Upper Transition Region Imager (SUTRI) and the Atmospheric Imaging Assembly (AIA). With their observations from 2022 September 21 to 2022 September 30, we find 17 persistent opposite flows occurring along the AR coronal loops. The upflows are prominent in the AIA 193 \AA images with a velocity of 50-200 km/s, while the downflows are best seen in the SUTRI 465 \AA and AIA 131 \AA images with a slower velocity of tens of kilometers per second (characteristic temperatures (log T(K)) for 193 \AA, 465 \AA and 131 \AA are 6.2, 5.7, 5.6, respectively). We also analyze the center-to-limb variation of the velocities for both upflows and downflows. The simultaneous observations of downflows and upflows can be explained by the chromosphere-corona mass-cycling process, in which the localized chromospheric plasma is impulsively heated to coronal temperature forming a upflow and then these upflows experience radiative cooling producing a downflow with the previously heated plasma returning to the lower atmosphere. In particular, the persistent downflows seen by SUTRI provide strong evidence of the cooling process in the mass cycle. For upflows associated with open loops, part of the plasma is able to escape outward and into the heliosphere as solar wind.


title: On the locomotion of the slider within a self-adaptive beam-slider system

abstract: A beam-slider system is considered whose passive self-adaption relies on an intricate locomotion process involving both frictional and unilateral contact. The system also exploits geometric nonlinearity to achieve broadband efficacy. The dynamics of the system take place on three distinct time scales: On the fast time scale of the harmonic base excitation are the vibrations and the locomotion cycle. On the slow time scale, the slider changes its position along the beam, and the overall vibration level varies. Finally, on an intermediate time scale, strong modulations of the vibration amplitude may take place. In the present work, first, an analytical approximation of the beam's response on the slow time scale is derived as function of the slider position, which is a crucial prerequisite for identifying the main drivers of the slider's locomotion. Then, the most important forms of locomotion are described and approximations of their individual contribution to the overall slider transport are estimated. Finally, the theoretical results are compared against numerical results obtained from an experimentally validated model.


title: Automated Discovery of Anomalous Features in Ultra-Large Planetary Remote Sensing Datasets using Variational Autoencoders

abstract: The NASA Lunar Reconnaissance Orbiter (LRO) has returned petabytes of lunar high spatial resolution surface imagery over the past decade, impractical for humans to fully review manually. Here we develop an automated method using a deep generative visual model that rapidly retrieves scientifically interesting examples of LRO surface imagery representing the first planetary image anomaly detector. We give quantitative experimental evidence that our method preferentially retrieves anomalous samples such as notable geological features and known human landing and spacecraft crash sites. Our method addresses a major capability gap in planetary science and presents a novel way to unlock insights hidden in ever-increasing remote sensing data archives, with numerous applications to other science domains. We publish our code and data along with this paper.


title: Modulational instability of nonuniformly damped, broad-banded waves: applications to waves in sea-ice

abstract: This paper sets out to explore the modulational (or Benjamin-Feir) instability of a monochromatic wave propagating in the presence of damping such as that induced by sea-ice on the ocean surface. The fundamental wave motion is modelled using the spatial Zakharov equation, to which either uniform or non-uniform (frequency dependent) damping is added. By means of mode truncation the spatial analogue of the classical Benjamin-Feir instability can be studied analytically using dynamical systems techniques. The formulation readily yields the free surface envelope, giving insight into the physical implications of damping on the modulational instability. The evolution of an initially unstable mode is also studied numerically by integrating the damped, spatial Zakharov equation, in order to complement the analytical theory. This sheds light on the effects of damping on spectral broadening arising from this instability.


title: Self-phoretic oscillatory motion in a harmonic trap

abstract: We consider the motion of a harmonically trapped overdamped particle, which is submitted to a self-phoretic force, that is proportional to the gradient of a diffusive field for which the particle itself is the source. In agreement with existing results for free particles or particles in a bounded domain, we find that the system exhibits a transition between an immobile phase, where the particle stays at the center of the trap, and an oscillatory state. We perform an exact analysis giving access to the bifurcation threshold, as well as the frequency of oscillations and their amplitude near the threshold. Our analysis also characterizes the shape of two-dimensional oscillations, that take place along a circle or a straight line. Our results are confirmed by numerical simulations.


title: White dwarf systems: exoplanets and debris disks

abstract: Although there is abundant and diverse observational evidence in support of white dwarf stars hosting planets or debris disks which form in the catastrophic destruction of various planetary bodies, the key processes that explain these observations are still being intensely investigated. The study of white dwarf planetary systems offers a unique perspective on exo-solar composition, that cannot be obtained by any other means. This chapter describes the various observational techniques that are used in order to find and characterize exo-planets and debris disks around white dwarfs. In turn, it discusses how to theoretically interpret these observations by surveying an array of various research tools and models currently employed in this field.


title: Input Data Adaptive Learning (IDAL) for Sub-acute Ischemic Stroke Lesion Segmentation

abstract: In machine learning larger databases are usually associated with higher classification accuracy due to better generalization. This generalization may lead to non-optimal classifiers in some medical applications with highly variable expressions of pathologies. This paper presents a method for learning from a large training base by adaptively selecting optimal training samples for given input data. In this way heterogeneous databases are supported two-fold. First, by being able to deal with sparsely annotated data allows a quick inclusion of new data set and second, by training an input-dependent classifier. The proposed approach is evaluated using the SISS challenge. The proposed algorithm leads to a significant improvement of the classification accuracy.


title: Dual orthogonally-polarized lasing assisted by imaginary Fermi arcs in organic microcavities

abstract: The polarization control of micro/nano lasers is an important topic in nanophotonics. Up to now, the simultaneous generation of two distinguishable orthogonally-polarized lasing modes from a single organic microlaser remains a critical challenge. Here, we demonstrate simultaneously orthogonally-polarized dual lasing from a microcavity filled with an organic single crystal exhibiting selective strong coupling. We show that the non-Hermiticity due to polarization-dependent losses leads to the formation of real and imaginary Fermi arcs with exceptional points. Simultaneous orthogonally-polarized lasing becomes possible thanks to the eigenstate mixing by the photonic spin-orbit coupling at the imaginary Fermi arcs. Our work provides a novel way to develop linearly-polarized lasers and paves the way for the future fundamental research in topological photonics, non-Hermitian optics, and other fields.


title: Spatially oscillating correlation functions in $\left(2+1\right)$-dimensional four-fermion models: The mixing of scalar and vector modes at finite density

abstract: In this work, we demonstrate that the mixing of scalar and vector condensates produces spatially oscillating, but exponentially damped correlation functions in fermionic theories at finite density and temperature. We find a regime exhibiting this oscillatory behavior in a Gross-Neveu-type model that also features vector interactions within the mean-field approximation. The existence of this regime aligns with expectations based on symmetry arguments, that are also applicable to QCD at finite baryon density. We compute the phase diagram including both homogeneous phases and regions with spatially oscillating, exponentially damped correlation functions at finite temperature and chemical potential for different strengths of the vector coupling. Furthermore, we find that inhomogeneous condensates are disfavored compared to homogeneous ones akin to previous findings without vector interactions. We show that our results are valid for a broad class of $\left(2+1\right)$-dimensional models with local four-fermion interactions.


title: Knowledge Transfer across Multiple Principal Component Analysis Studies

abstract: Transfer learning has aroused great interest in the statistical community. In this article, we focus on knowledge transfer for unsupervised learning tasks in contrast to the supervised learning tasks in the literature. Given the transferable source populations, we propose a two-step transfer learning algorithm to extract useful information from multiple source principal component analysis (PCA) studies, thereby enhancing estimation accuracy for the target PCA task. In the first step, we integrate the shared subspace information across multiple studies by a proposed method named as Grassmannian barycenter, instead of directly performing PCA on the pooled dataset. The proposed Grassmannian barycenter method enjoys robustness and computational advantages in more general cases. Then the resulting estimator for the shared subspace from the first step is further utilized to estimate the target private subspace in the second step. Our theoretical analysis credits the gain of knowledge transfer between PCA studies to the enlarged eigenvalue gap, which is different from the existing supervised transfer learning tasks where sparsity plays the central role. In addition, we prove that the bilinear forms of the empirical spectral projectors have asymptotic normality under weaker eigenvalue gap conditions after knowledge transfer. When the set of informativesources is unknown, we endow our algorithm with the capability of useful dataset selection by solving a rectified optimization problem on the Grassmann manifold, which in turn leads to a computationally friendly rectified Grassmannian K-means procedure. In the end, extensive numerical simulation results and a real data case concerning activity recognition are reported to support our theoretical claims and to illustrate the empirical usefulness of the proposed transfer learning methods.


title: Bring Event into RGB and LiDAR: Hierarchical Visual-Motion Fusion for Scene Flow

abstract: Single RGB or LiDAR is the mainstream sensor for the challenging scene flow, which relies heavily on visual features to match motion features. Compared with single modality, existing methods adopt a fusion strategy to directly fuse the cross-modal complementary knowledge in motion space. However, these direct fusion methods may suffer the modality gap due to the visual intrinsic heterogeneous nature between RGB and LiDAR, thus deteriorating motion features. We discover that event has the homogeneous nature with RGB and LiDAR in both visual and motion spaces. In this work, we bring the event as a bridge between RGB and LiDAR, and propose a novel hierarchical visual-motion fusion framework for scene flow, which explores a homogeneous space to fuse the cross-modal complementary knowledge for physical interpretation. In visual fusion, we discover that event has a complementarity (relative v.s. absolute) in luminance space with RGB for high dynamic imaging, and has a complementarity (local boundary v.s. global shape) in scene structure space with LiDAR for structure integrity. In motion fusion, we figure out that RGB, event and LiDAR are complementary (spatial-dense, temporal-dense v.s. spatiotemporal-sparse) to each other in correlation space, which motivates us to fuse their motion correlations for motion continuity. The proposed hierarchical fusion can explicitly fuse the multimodal knowledge to progressively improve scene flow from visual space to motion space. Extensive experiments have been performed to verify the superiority of the proposed method.


title: Baryonic Vortex Phase and Magnetic Field Generation in QCD with Isospin and Baryon Chemical Potentials

abstract: We propose a novel baryonic vortex phase in low energy dense QCD with finite baryon and isospin chemical potentials. It is known that the homogeneous charged pion condensate emerges as a ground state at finite isospin chemical potential, and therein arises the Abrikosov vortex lattice with an applied magnetic field. We first demonstrate that a vortex with the same quantized magnetic flux as the conventional Abrikosov vortex, carries a baryon number captured by the third homotopy group of Skyrmions, once we take into account a modulation of the neutral pion inside the vortex core. Such a vortex-Skyrmion state is therefore dubbed the baryonic vortex. We further reveal that when the baryon chemical potential is above a critical value, the baryonic vortex has negative tension measured from the charged pion condensation. It implies that the phase, in which such vortices emerge spontaneously without an external magnetic field, would take over the ground state at high baryon density. Such a new phase contributes to the comprehension of QCD phase diagram and relates to the generation of magnetic fields inside neutron stars.


title: DALSA: Domain Adaptation for Supervised Learning From Sparsely Annotated MR Images

abstract: We propose a new method that employs transfer learning techniques to effectively correct sampling selection errors introduced by sparse annotations during supervised learning for automated tumor segmentation. The practicality of current learning-based automated tissue classification approaches is severely impeded by their dependency on manually segmented training databases that need to be recreated for each scenario of application, site, or acquisition setup. The comprehensive annotation of reference datasets can be highly labor-intensive, complex, and error-prone. The proposed method derives high-quality classifiers for the different tissue classes from sparse and unambiguous annotations and employs domain adaptation techniques for effectively correcting sampling selection errors introduced by the sparse sampling. The new approach is validated on labeled, multi-modal MR images of 19 patients with malignant gliomas and by comparative analysis on the BraTS 2013 challenge data sets. Compared to training on fully labeled data, we reduced the time for labeling and training by a factor greater than 70 and 180 respectively without sacrificing accuracy. This dramatically eases the establishment and constant extension of large annotated databases in various scenarios and imaging setups and thus represents an important step towards practical applicability of learning-based approaches in tissue classification.


title: Broadened-beam Uniform Rectangular Array Coefficient Design in LEO SatComs Under Quality of Service and Constant Modulus Constraints

abstract: Satellite communications (SatComs) are anticipated to provide global Internet access. Low Earth orbit (LEO) satellites (SATs) have the advantage of providing higher downlink capacity owing to their smaller link budget compared with medium Earth orbit (MEO) and geostationary Earth orbit (GEO) SATs. In this paper, beam-broadening algorithms for uniform rectangular arrays (URAs) in LEO SatComs were studied. The proposed method is the first of its kind that jointly considers the path loss variation from SAT to user terminal (UT) due to the Earth's curvature to guarantee quality of service (QoS) inspired by the synthesis of isoflux radiation patterns in the literature, constant modulus constraint (CMC) favored for maximizing power amplifier (PA) efficiency, and out-of-beam radiation suppression to avoid interference. A URA design problem is formulated and decomposed into two uniform linear array (ULA) design subproblems utilizing the idea of Kronecker product beamforming to reduce the computational complexity of designing URA.The non-convex ULA subproblems are solved by a convex iterative algorithm. Simulation results reveal the advantages of the proposed method for suppressing out-of-beam radiation and achieving design criteria. In addition, channel capacity evaluation is carried out and shows that the proposed ``broadened-beam" beamformers can offer capacities that are at least four times greater than ``narrow-beam" beamformers employing an array steering vector when beam transition time is taken into account. The proposed method holds potential for LEO broadcasting applications such as digital video broadcasting (DVB).


title: JSTR: Joint Spatio-Temporal Reasoning for Event-based Moving Object Detection

abstract: Event-based moving object detection is a challenging task, where static background and moving object are mixed together. Typically, existing methods mainly align the background events to the same spatial coordinate system via motion compensation to distinguish the moving object. However, they neglect the potential spatial tailing effect of moving object events caused by excessive motion, which may affect the structure integrity of the extracted moving object. We discover that the moving object has a complete columnar structure in the point cloud composed of motion-compensated events along the timestamp. Motivated by this, we propose a novel joint spatio-temporal reasoning method for event-based moving object detection. Specifically, we first compensate the motion of background events using inertial measurement unit. In spatial reasoning stage, we project the compensated events into the same image coordinate, discretize the timestamp of events to obtain a time image that can reflect the motion confidence, and further segment the moving object through adaptive threshold on the time image. In temporal reasoning stage, we construct the events into a point cloud along timestamp, and use RANSAC algorithm to extract the columnar shape in the cloud for peeling off the background. Finally, we fuse the results from the two reasoning stages to extract the final moving object region. This joint spatio-temporal reasoning framework can effectively detect the moving object from motion confidence and geometric structure. Moreover, we conduct extensive experiments on various datasets to verify that the proposed method can improve the moving object detection accuracy by 13\%.


title: Category-Agnostic Pose Estimation for Point Clouds

abstract: The goal of object pose estimation is to visually determine the pose of a specific object in the RGB-D input. Unfortunately, when faced with new categories, both instance-based and category-based methods are unable to deal with unseen objects of unseen categories, which is a challenge for pose estimation. To address this issue, this paper proposes a method to introduce geometric features for pose estimation of point clouds without requiring category information. The method is based only on the patch feature of the point cloud, a geometric feature with rotation invariance. After training without category information, our method achieves as good results as other category-based methods. Our method successfully achieved pose annotation of no category information instances on the CAMERA25 dataset and ModelNet40 dataset.


title: Experimental analysis of the TRC benchmark system

abstract: The Tribomechadynamics Research Challenge (TRC) was a blind prediction of the vibration behavior of a thin plate clamped on two sides using bolted joints. The first bending mode's natural frequency and damping ratio were requested as function of the amplitude, starting from the linear regime until high levels, where both frictional contact and nonlinear bending-stretching coupling become relevant. The predictions were confronted with experimental results in a companion paper; the present article addresses the experimental analysis of this benchmark system. Amplitude-dependent modal data was obtained from phase resonance and response controlled tests. An original variant of response controlled testing is proposed: Instead of a fixed frequency interval, a fixed phase interval is analyzed. This way, the high excitation levels required outside resonance, which could activate unwanted exciter nonlinearity, are avoided. Consistency of testing methods is carefully analyzed. Overall, these measures have permitted to gain high confidence in the acquired modal data. The different sources of the remaining uncertainty were further analyzed. A low reassembly-variability but a moderate time-variability were identified, where the latter is attributed to some thermal sensitivity of the system. Two nominally identical plates were analyzed, which both have an appreciable initial curvature, and a significant effect on the vibration behavior was found depending on whether the plate is aligned/misaligned with the support structure. Further, a 1:2 nonlinear modal interaction with the first torsion mode was observed, which only occurs in the aligned configurations.


title: Renewal theorems in a periodic environment

abstract: We study a renewal problem within a periodic environment, departing from the classical renewal theory by relaxing the assumption of independent and identically distributed inter-arrival times. Instead, the conditional distribution of the next arrival time, given the current one, is governed by a periodic kernel, denoted as $H$. The periodicity property of $H$ is expressed as $\mathbb{P}(T_{k+1} > t ~ |~ T_k) = H(t, T_k)$, where $H(t+T,s+T) = H(t, s)$. For a fixed time $t$, we define $N_t$ as the count of events occurring up to time $t$. The focus is on two temporal aspects: $Y_t$, the time elapsed since the last event, and $X_t$, the time until the next event occurs, given by $Y_t = t - T_{N_t}$ and $X_t = T_{N_{t}+1} - t$. The study explores the long-term behavior of the distributions of $X_t$ and $Y_t$.


title: Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning

abstract: Fine-tuning techniques based on Large Pretrained Language Models (LPLMs) have been proven to significantly enhance model performance on a variety of downstream tasks and effectively control the output behaviors of LPLMs. Recent studies have proposed numerous methods for fine-tuning a small number of parameters based on open-source LPLMs, reducing the demand for computational and storage resources. Among these, reparameterization fine-tuning methods represented by LoRA (Low-Rank Adaptation) have gained popularity. We find that although these methods perform well in many aspects, there is still considerable room for improvement in terms of complex task adaptability, performance, stability, and algorithm complexity. In response to this, inspired by the idea that the functions of the brain are shaped by its geometric structure, this paper integrates this idea into LoRA technology and proposes a new matrix transformation-based reparameterization method for efficient fine-tuning, named Matrix-Transformation based Low-Rank Adaptation (MTLoRA). MTLoRA aims to dynamically alter its spatial geometric structure by applying a transformation-matrix T to perform linear transformations, such as rotation, scaling, and translation, on the task-specific parameter matrix, generating new matrix feature patterns (eigenvectors) to mimic the fundamental influence of complex geometric structure feature patterns in the brain on functions, thereby enhancing the model's performance in downstream tasks. In Natural Language Understanding (NLU) tasks, it is evaluated using the GLUE benchmark test, and the results reveal that MTLoRA achieves an overall performance increase of about 1.0% across eight tasks; in Natural Language Generation (NLG) tasks, MTLoRA improves performance by an average of 0.95% and 0.56% in the DART and WebNLG tasks, respectively.


title: Exploring the Nuclear Shape Phase Transition in Ultra-Relativistic $^{129}$Xe+$^{129}$Xe Collisions at the LHC

abstract: The shape phase transition for certain isotope or isotone chains, associated with the quantum phase transition of finite nuclei, is an intriguing phenomenon in nuclear physics. A notable case is the Xe isotope chain, where the structure transits from a $\gamma$-soft rotor to a spherical vibrator, with the second-order shape phase transition occurring in the vicinity of $^{128-130}$Xe. In this letter, we focus on investigating the $\gamma$-soft deformation of $^{129}$Xe associated with the second-order shape phase transition by constructing novel correlators for ultra-relativistic $^{129}$Xe+$^{129}$Xe collisions. In particular, our iEBE-VISHNU model calculations show that the $v_2^2-[p_T]$ correlation $\rho_{2}$ and the mean transverse momentum fluctuation $\Gamma_{p_T}$, which were previously interpreted as the evidence for the rigid triaxial deformation of $^{129}$Xe, can also be well explained by the $\gamma$-soft deformation of $^{129}$Xe. We also propose two novel correlators $\rho_{4,2}$ and $\rho_{2,4}$, which carry non-trivial higher-order correlations and show unique capabilities to distinguish between the $\gamma$-soft and the rigid triaxial deformation of $^{129}$Xe in $^{129}$Xe+$^{129}$Xe collisions at the LHC. The present study also provides a novel way to explore the second-order shape phase transition of finite nuclei with ultra-relativistic heavy ion collisions.


title: Proxy Methods for Domain Adaptation

abstract: We study the problem of domain adaptation under distribution shift, where the shift is due to a change in the distribution of an unobserved, latent variable that confounds both the covariates and the labels. In this setting, neither the covariate shift nor the label shift assumptions apply. Our approach to adaptation employs proximal causal learning, a technique for estimating causal effects in settings where proxies of unobserved confounders are available. We demonstrate that proxy variables allow for adaptation to distribution shift without explicitly recovering or modeling latent variables. We consider two settings, (i) Concept Bottleneck: an additional ''concept'' variable is observed that mediates the relationship between the covariates and labels; (ii) Multi-domain: training data from multiple source domains is available, where each source domain exhibits a different distribution over the latent confounder. We develop a two-stage kernel estimation approach to adapt to complex distribution shifts in both settings. In our experiments, we show that our approach outperforms other methods, notably those which explicitly recover the latent confounder.


title: Magnetic Phase Diagram and Skyrmions of the Hubbard Model on the Beta-Mn Type Lattice

abstract: Magnetic phase diagram for the Hubbard model on the Beta-Mn type lattice has been calculated as a function of the Coulomb interaction energy parameter U and the electron number per atom n by using the generalized Hartree-Fock approximation combined with the recursion method for electronic-structure calculations. The ferromagnetic state, the ferrimagnetic state, and the helimagnetic state as well as the 3Q multiple spin density waves (3QMSDW) states have been obtained on the U-n plane. Their detailed structures are examined with use of the Fourier analysis. It is shown that the calculated phase diagram and the Dzyaloshinskii-Moriya interaction elucidate the magnetic interactions for the itinerant-electron skyrmions in transition metal alloys and compounds on the Beta-Mn type lattice.