title: TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learning

abstract: Deep neural networks, including transformers and convolutional neural networks, have significantly improved multivariate time series classification (MTSC). However, these methods often rely on supervised learning, which does not fully account for the sparsity and locality of patterns in time series data (e.g., diseases-related anomalous points in ECG). To address this challenge, we formally reformulate MTSC as a weakly supervised problem, introducing a novel multiple-instance learning (MIL) framework for better localization of patterns of interest and modeling time dependencies within time series. Our novel approach, TimeMIL, formulates the temporal correlation and ordering within a time-aware MIL pooling, leveraging a tokenized transformer with a specialized learnable wavelet positional token. The proposed method surpassed 26 recent state-of-the-art methods, underscoring the effectiveness of the weakly supervised TimeMIL in MTSC. The code will be available at https://github.com/xiwenc1/TimeMIL.


title: Automatic Ultrasound Curve Angle Measurement via Affinity Clustering for Adolescent Idiopathic Scoliosis Evaluation

abstract: The current clinical gold standard for evaluating adolescent idiopathic scoliosis (AIS) is X-ray radiography, using Cobb angle measurement. However, the frequent monitoring of the AIS progression using X-rays poses a challenge due to the cumulative radiation exposure. Although 3D ultrasound has been validated as a reliable and radiation-free alternative for scoliosis assessment, the process of measuring spinal curvature is still carried out manually. Consequently, there is a considerable demand for a fully automatic system that can locate bony landmarks and perform angle measurements. To this end, we introduce an estimation model for automatic ultrasound curve angle (UCA) measurement. The model employs a dual-branch network to detect candidate landmarks and perform vertebra segmentation on ultrasound coronal images. An affinity clustering strategy is utilized within the vertebral segmentation area to illustrate the affinity relationship between candidate landmarks. Subsequently, we can efficiently perform line delineation from a clustered affinity map for UCA measurement. As our method is specifically designed for UCA calculation, this method outperforms other state-of-the-art methods for landmark and line detection tasks. The high correlation between the automatic UCA and Cobb angle (R$^2$=0.858) suggests that our proposed method can potentially replace manual UCA measurement in ultrasound scoliosis assessment.


title: Weak diamond and pcf theory

abstract: We obtain bounds on the cardinality of $pcf(\mathfrak{a})$ from instances of weak diamond. Consequently, under mild assumptions there are many singular cardinals of the from $\aleph_\delta$ for which $2^{\aleph_\delta}<\aleph_{(|\delta|^{+3})}$. For example, if every limit cardinal is a strong limit cardinal then this bound holds at a class of singular cardinals.


title: A novel fourth-order scheme for two-dimensional Riesz space fractional nonlinear reaction-diffusion equations and its optimal preconditioned solver

abstract: A novel fourth-order finite difference formula coupling the Crank-Nicolson explicit linearized method is proposed to solve Riesz space fractional nonlinear reaction-diffusion equations in two dimensions. Theoretically, under the Lipschitz assumption on the nonlinear term, the proposed high-order scheme is proved to be unconditionally stable and convergent in the discrete $L_2$-norm. Moreover, a $\tau$-matrix based preconditioner is developed to speed up the convergence of the conjugate gradient method with an optimal convergence rate (a convergence rate independent of mesh sizes) for solving the symmetric discrete linear system. Theoretical analysis shows that the spectra of the preconditioned matrices are uniformly bounded in the open interval $(3/8,2)$. To the best of our knowledge, this is the first attempt to develop a preconditioned iterative solver with a mesh-independent convergence rate for the linearized high-order scheme. Numerical examples are given to validate the accuracy of the scheme and the effectiveness of the proposed preconditioned solver.


title: PTQ4SAM: Post-Training Quantization for Segment Anything

abstract: Segment Anything Model (SAM) has achieved impressive performance in many computer vision tasks. However, as a large-scale model, the immense memory and computation costs hinder its practical deployment. In this paper, we propose a post-training quantization (PTQ) framework for Segment Anything Model, namely PTQ4SAM. First, we investigate the inherent bottleneck of SAM quantization attributed to the bimodal distribution in post-Key-Linear activations. We analyze its characteristics from both per-tensor and per-channel perspectives, and propose a Bimodal Integration strategy, which utilizes a mathematically equivalent sign operation to transform the bimodal distribution into a relatively easy-quantized normal distribution offline. Second, SAM encompasses diverse attention mechanisms (i.e., self-attention and two-way cross-attention), resulting in substantial variations in the post-Softmax distributions. Therefore, we introduce an Adaptive Granularity Quantization for Softmax through searching the optimal power-of-two base, which is hardware-friendly. Extensive experimental results across various vision tasks (instance segmentation, semantic segmentation and object detection), datasets and model variants show the superiority of PTQ4SAM. For example, when quantizing SAM-L to 6-bit, we achieve lossless accuracy for instance segmentation, about 0.5\% drop with theoretical 3.9$\times$ acceleration. The code is available at \url{https://github.com/chengtao-lv/PTQ4SAM}.


title: Projection-Free Method for the Full Frank-Oseen Model of Liquid Crystals

abstract: Liquid crystals are materials that experience an intermediate phase where the material can flow like a liquid, but the molecules maintain an orientation order. The Frank-Oseen model is a continuum model of a liquid crystal. The model represents the liquid crystal orientation as a vector field and posits that the vector field minimizes some elastic energy subject to a pointwise unit length constraint, which is a nonconvex constraint. Previous numerical methods in the literature assumed restrictions on the physical constants or had regularity assumptions that ruled out point defects, which are important physical phenomena to model. We present a finite element discretization of the full Frank-Oseen model and a projection free gradient flow algorithm for the discrete problem in the spirit of Bartels (2016). We prove Gamma-convergence of the discrete to the continuous problem: weak convergence of subsequences of discrete minimizers and convergence of energies. We also prove that the gradient flow algorithm has a desirable energy decrease property. Our analysis only requires that the physical constants are positive, which presents challenges due to the additional nonlinearities from the elastic energy.


title: Quantifying the Capabilities of LLMs across Scale and Precision

abstract: Scale is often attributed as one of the factors that cause an increase in the performance of LLMs, resulting in models with billion and trillion parameters. One of the limitations of such large models is the high computational requirements that limit their usage, deployment, and debugging in resource-constrained scenarios. Two commonly used alternatives to bypass these limitations are to use the smaller versions of LLMs (e.g. Llama 7B instead of Llama 70B) and lower the memory requirements by using quantization. While these approaches effectively address the limitation of resources, their impact on model performance needs thorough examination. In this study, we perform a comprehensive evaluation to investigate the effect of model scale and quantization on the performance. We experiment with two major families of open-source instruct models ranging from 7 billion to 70 billion parameters. Our extensive zero-shot experiments across various tasks including natural language understanding, reasoning, misinformation detection, and hallucination reveal that larger models generally outperform their smaller counterparts, suggesting that scale remains an important factor in enhancing performance. We found that larger models show exceptional resilience to precision reduction and can maintain high accuracy even at 4-bit quantization for numerous tasks and they serve as a better solution than using smaller models at high precision under similar memory requirements.


title: Data Format Standardization and DICOM Integration for Hyperpolarized 13C MRI

abstract: Hyperpolarized (HP) 13C MRI has shown promise as a valuable modality for in vivo measurements of metabolism and is currently in human trials at 15 research sites worldwide. With this growth it is important to adopt standardized data storage practices as it will allow sites to meaningfully compare data. In this paper we (1) describe data that we believe should be stored and (2) demonstrate pipelines and methods that utilize the Digital Imaging and Communications in Medicine (DICOM) standard. This includes proposing a set of minimum set of information that is specific to HP 13C MRI studies. We then show where the majority of these can be fit into existing DICOM Attributes, primarily via the "Contrast/Bolus" module. We also demonstrate pipelines for utilizing DICOM for HP 13C MRI. DICOM is the most common standard for clinical medical image storage and provides the flexibility to accommodate the unique aspects of HP 13C MRI, including the HP agent information but also spectroscopic and metabolite dimensions. The pipelines shown include creating DICOM objects for studies on human and animal imaging systems with various pulse sequences. We also show a python-based method to efficiently modify DICOM objects to incorporate the unique HP 13C MRI information that is not captured by existing pipelines. Moreover, we propose best practices for HP 13C MRI data storage that will support future multi-site trials, research studies and technical developments of this imaging technique.


title: Counting Subnetworks Under Gene Duplication in Genetic Regulatory Networks

abstract: Gene duplication is a fundamental evolutionary mechanism that contributes to biological complexity and diversity (Fortna et al., 2004). Traditionally, research has focused on the duplication of gene sequences (Zhang, 1914). However, evidence suggests that the duplication of regulatory elements may also play a significant role in the evolution of genomic functions (Teichmann and Babu, 2004; Hallin and Landry, 2019). In this work, the evolution of regulatory relationships belonging to gene-specific-substructures in a GRN are modeled. In the model, a network grows from an initial configuration by repeatedly choosing a random gene to duplicate. The likelihood that the regulatory relationships associated with the selected gene are retained through duplication is determined by a vector of probabilities. Occurrences of gene-family-specific substructures are counted under the gene duplication model. In this thesis, gene-family-specific substructures are referred to as subnetwork motifs. These subnetwork motifs are motivated by network motifs which are patterns of interconnections that recur more often in a specialized network than in a random network (Milo et al., 2002). Subnetwork motifs differ from network motifs in the way that subnetwork motifs are instances of gene-family-specific substructures while network motifs are isomorphic substructures. These subnetwork motifs are counted under Full and Partial Duplication, which differ in the way in which regulation relationships are inherited. Full duplication occurs when all regulatory links are inherited at each duplication step, and Partial Duplication occurs when regulation inheritance varies at each duplication step. Moments for the number of occurrences of subnetwork motifs are determined in each model. The results presented offer a method for discovering subnetwork motifs that are significant in a GRN under gene duplication.


title: Observing S-Matrix Pole Flow in Resonance Interplay: Cold Collisions of Ultracold Atoms in a Miniature Laser-based Accelerator

abstract: We provide an overview of experiments exploring resonances in the collision of ultracold clouds of atoms. Using a laser-based accelerator that capitalizes on the energy resolution provided by the ultracold atomic setting, we unveil resonance phenomena such as Feshbach and shape resonances in their quintessential form by literally photographing the halo of outgoing scattered atoms. We exploit the tunability of magnetic Feshbach resonances to instigate an interplay between scattering resonances. By experimentally recording the scattering in a parameter space spanned by collision energy and magnetic field, we capture the imprint of the $S$-matrix pole flow in the complex energy plane. After revisiting experiments that place a Feshbach resonance in the proximity of a shape resonance and an anti-bound state, respectively, we discuss the possibility of using $S$-matrix pole interplay between two Feshbach resonances to create a bound-state-in-the-continuum.


title: Video Diffusion Models: A Survey

abstract: Diffusion generative models have recently become a robust technique for producing and modifying coherent, high-quality video. This survey offers a systematic overview of critical elements of diffusion models for video generation, covering applications, architectural choices, and the modeling of temporal dynamics. Recent advancements in the field are summarized and grouped into development trends. The survey concludes with an overview of remaining challenges and an outlook on the future of the field. Website: https://github.com/ndrwmlnk/Awesome-Video-Diffusion-Models


title: Time Series Stock Price Forecasting Based on Genetic Algorithm (GA)-Long Short-Term Memory Network (LSTM) Optimization

abstract: In this paper, a time series algorithm based on Genetic Algorithm (GA) and Long Short-Term Memory Network (LSTM) optimization is used to forecast stock prices effectively, taking into account the trend of the big data era. The data are first analyzed by descriptive statistics, and then the model is built and trained and tested on the dataset. After optimization and adjustment, the mean absolute error (MAE) of the model gradually decreases from 0.11 to 0.01 and tends to be stable, indicating that the model prediction effect is gradually close to the real value. The results on the test set show that the time series algorithm optimized based on Genetic Algorithm (GA)-Long Short-Term Memory Network (LSTM) is able to accurately predict the stock prices, and is highly consistent with the actual price trends and values, with strong generalization ability. The MAE on the test set is 2.41, the MSE is 9.84, the RMSE is 3.13, and the R2 is 0.87. This research result not only provides a novel stock price prediction method, but also provides a useful reference for financial market analysis using computer technology and big data.


title: MMGER: Multi-modal and Multi-granularity Generative Error Correction with LLM for Joint Accent and Speech Recognition

abstract: Despite notable advancements in automatic speech recognition (ASR), performance tends to degrade when faced with adverse conditions. Generative error correction (GER) leverages the exceptional text comprehension capabilities of large language models (LLM), delivering impressive performance in ASR error correction, where N-best hypotheses provide valuable information for transcription prediction. However, GER encounters challenges such as fixed N-best hypotheses, insufficient utilization of acoustic information, and limited specificity to multi-accent scenarios. In this paper, we explore the application of GER in multi-accent scenarios. Accents represent deviations from standard pronunciation norms, and the multi-task learning framework for simultaneous ASR and accent recognition (AR) has effectively addressed the multi-accent scenarios, making it a prominent solution. In this work, we propose a unified ASR-AR GER model, named MMGER, leveraging multi-modal correction, and multi-granularity correction. Multi-task ASR-AR learning is employed to provide dynamic 1-best hypotheses and accent embeddings. Multi-modal correction accomplishes fine-grained frame-level correction by force-aligning the acoustic features of speech with the corresponding character-level 1-best hypothesis sequence. Multi-granularity correction supplements the global linguistic information by incorporating regular 1-best hypotheses atop fine-grained multi-modal correction to achieve coarse-grained utterance-level correction. MMGER effectively mitigates the limitations of GER and tailors LLM-based ASR error correction for the multi-accent scenarios. Experiments conducted on the multi-accent Mandarin KeSpeech dataset demonstrate the efficacy of MMGER, achieving a 26.72% relative improvement in AR accuracy and a 27.55% relative reduction in ASR character error rate, compared to a well-established standard baseline.


title: Exploring the Potential of the Large Language Models (LLMs) in Identifying Misleading News Headlines

abstract: In the digital age, the prevalence of misleading news headlines poses a significant challenge to information integrity, necessitating robust detection mechanisms. This study explores the efficacy of Large Language Models (LLMs) in identifying misleading versus non-misleading news headlines. Utilizing a dataset of 60 articles, sourced from both reputable and questionable outlets across health, science & tech, and business domains, we employ three LLMs- ChatGPT-3.5, ChatGPT-4, and Gemini-for classification. Our analysis reveals significant variance in model performance, with ChatGPT-4 demonstrating superior accuracy, especially in cases with unanimous annotator agreement on misleading headlines. The study emphasizes the importance of human-centered evaluation in developing LLMs that can navigate the complexities of misinformation detection, aligning technical proficiency with nuanced human judgment. Our findings contribute to the discourse on AI ethics, emphasizing the need for models that are not only technically advanced but also ethically aligned and sensitive to the subtleties of human interpretation.


title: Learning Nonlinear Dynamics Using Kalman Smoothing

abstract: Identifying Ordinary Differential Equations (ODEs) from measurement data requires both fitting the dynamics and assimilating, either implicitly or explicitly, the measurement data. The Sparse Identification of Nonlinear Dynamics (SINDy) method involves a derivative estimation step (and optionally, smoothing) and a sparse regression step on a library of candidate ODE terms. Kalman smoothing is a classical framework for assimilating the measurement data with known noise statistics. Previously, derivatives in SINDy and its python package, pysindy, had been estimated by finite difference, L1 total variation minimization, or local filters like Savitzky-Golay. In contrast, Kalman allows discovering ODEs that best recreate the essential dynamics in simulation, even in cases when it does not perform as well at recovering coefficients, as measured by their F1 score and mean absolute error. We have incorporated Kalman smoothing, along with hyperparameter optimization, into the existing pysindy architecture, allowing for rapid adoption of the method. Numerical experiments on a number of dynamical systems show Kalman smoothing to be the most amenable to parameter selection and best at preserving problem structure in the presence of noise.


title: CushSense: Soft, Stretchable, and Comfortable Tactile-Sensing Skin for Physical Human-Robot Interaction

abstract: Whole-arm tactile feedback is crucial for robots to ensure safe physical interaction with their surroundings. This paper introduces CushSense, a fabric-based soft and stretchable tactile-sensing skin designed for physical human-robot interaction (pHRI) tasks such as robotic caregiving. Using stretchable fabric and hyper-elastic polymer, CushSense identifies contacts by monitoring capacitive changes due to skin deformation. CushSense is cost-effective ($\sim$US\$7 per taxel) and easy to fabricate. We detail the sensor design and fabrication process and perform characterization, highlighting its high sensing accuracy (relative error of 0.58%) and durability (0.054% accuracy drop after 1000 interactions). We also present a user study underscoring its perceived safety and comfort for the assistive task of limb manipulation. We open source all sensor-related resources on https://emprise.cs.cornell.edu/cushsense.


title: Strain Induced Kramers-Weyl Phase in III-V Zinc Blende Systems

abstract: We present theoretical observations on the topological nature of strained III-V semiconductors. By $k \cdot p$ perturbation, it can be shown that the strain-engineered conduction band hosts a Kramers-Weyl node at the $\Gamma$ point. It is theoretically shown a curated strain can create and then tune the sign of the topological charge. Furthermore, we outline experimental methods for both the realization and detection of strain-induced topological phase transitions.


title: Primordial power spectrum at N3LO in effective theories of inflation

abstract: We develop a systematic framework to compute the primordial power spectrum up to next-to-next-to-next to leading order (N3LO) in the Hubble-flow parameters for a large class of effective theories of inflation. We assume that the quadratic action for perturbations is characterized by two functions of time, the kinetic amplitude and the speed of sound, that are independent of the Fourier mode $k$. Using the Green's function method introduced by Stewart $\&$ Gong and developed by Auclair $\&$ Ringeval, we determine the primordial power spectrum, including its amplitude, spectral indices, their running and running of their running, starting from a given generic action for perturbations. As a check, we reproduce the state-of-the-art results for scalar and the tensor power spectrum of the simplest "vanilla" models of single-field inflation. The framework applies to Weinberg's effective field theory of inflation (with the condition of no parity violation) and to effective theory of spontaneous de Sitter-symmetry breaking. As a concrete application, we provide the expression for the N3LO power spectrum of $R+R^2$ Starobinsky inflation, without a field redefinition. All expressions are provided in terms of an expansion in one single parameter, the number of inflationary e-foldings $N_*$. Surprisingly we find that, compared to previous leading-order calculations, for $N_* = 55$ the N3LO correction results in a $7\%$ decrease of the predicted tensor-to-scalar ratio, in addition to a deviation from the consistency relation. These results provide precise theoretical predictions for the next generation of CMB observations.


title: Decentralized Online Learning in General-Sum Stackelberg Games

abstract: We study an online learning problem in general-sum Stackelberg games, where players act in a decentralized and strategic manner. We study two settings depending on the type of information for the follower: (1) the limited information setting where the follower only observes its own reward, and (2) the side information setting where the follower has extra side information about the leader's reward. We show that for the follower, myopically best responding to the leader's action is the best strategy for the limited information setting, but not necessarily so for the side information setting -- the follower can manipulate the leader's reward signals with strategic actions, and hence induce the leader's strategy to converge to an equilibrium that is better off for itself. Based on these insights, we study decentralized online learning for both players in the two settings. Our main contribution is to derive last-iterate convergence and sample complexity results in both settings. Notably, we design a new manipulation strategy for the follower in the latter setting, and show that it has an intrinsic advantage against the best response strategy. Our theories are also supported by empirical results.


title: DeepMpMRI: Tensor-decomposition Regularized Learning for Fast and High-Fidelity Multi-Parametric Microstructural MR Imaging

abstract: Deep learning has emerged as a promising approach for learning the nonlinear mapping between diffusion-weighted MR images and tissue parameters, which enables automatic and deep understanding of the brain microstructures. However, the efficiency and accuracy in the multi-parametric estimations are still limited since previous studies tend to estimate multi-parametric maps with dense sampling and isolated signal modeling. This paper proposes DeepMpMRI, a unified framework for fast and high-fidelity multi-parametric estimation from various diffusion models using sparsely sampled q-space data. DeepMpMRI is equipped with a newly designed tensor-decomposition-based regularizer to effectively capture fine details by exploiting the correlation across parameters. In addition, we introduce a Nesterov-based adaptive learning algorithm that optimizes the regularization parameter dynamically to enhance the performance. DeepMpMRI is an extendable framework capable of incorporating flexible network architecture. Experimental results demonstrate the superiority of our approach over 5 state-of-the-art methods in simultaneously estimating multi-parametric maps for various diffusion models with fine-grained details both quantitatively and qualitatively, achieving 4.5 - 22.5$\times$ acceleration compared to the dense sampling of a total of 270 diffusion gradients.


title: Moore Determinant of Dual Quaternion Hermitian Matrices

abstract: In this paper, we extend the Chen and Moore determinants of quaternion Hermitian} matrices to dual quaternion Hermitian matrices. We show the Chen determinant of dual quaternion Hermitian {matrices is invariant under addition, switching, multiplication, and unitary operations at the both hand sides. We then show the Chen and Moore determinants of dual quaternion Hermitian matrices are equal to each other, and they are also equal to the products of eigenvalues. The characteristic polynomial of a dual quaternion Hermitian matrix is also studied.


title: Solutions to ${\rm SU}(n+1)$ Toda system with cone singularities via toric curves on compact Riemann surfaces

abstract: On a compact Riemann surface (X) with finite punctures (P_1, \ldots, P_k), we define toric curves as multi-valued, totally unramified holomorphic maps to (\mathbb{P}^n) with monodromy in a maximal torus of ({\rm PSU}(n+1)). \textit{Toric solutions} for the ({\rm SU}(n+1)) system on $X\setminus\{P_1,\ldots, P_k\}$ are recognized by their associated {\it toric} curves in (\mathbb{P}^n). We introduce a character n-ensemble as an (n)-tuple of meromorphic one-forms with simple poles and purely imaginary periods, generating toric curves on (X) minus finitely many points. We establish on $X$ a correspondence between character $n$-ensembles and toric solutions to the ({\rm SU}(n+1)) system with finitely many cone singularities. Our approach not only broadens seminal solutions for up to two cone singularities on the Riemann sphere, as classified by Jost-Wang (Int. Math. Res. Not., (6):277-290, 2002) and Lin-Wei-Ye (Invent. Math., 190(1):169-207, 2012), but also advances beyond the limits of Lin-Yang-Zhong's existence theorems (J. Differential Geom., 114(2):337-391, 2020) by introducing a new solution class.


title: Advancing Multimodal Medical Capabilities of Gemini

abstract: Many clinical tasks require an understanding of specialized data, such as medical images and genomics, which is not typically found in general-purpose large multimodal models. Building upon Gemini's multimodal models, we develop several models within the new Med-Gemini family that inherit core capabilities of Gemini and are optimized for medical use via fine-tuning with 2D and 3D radiology, histopathology, ophthalmology, dermatology and genomic data. Med-Gemini-2D sets a new standard for AI-based chest X-ray (CXR) report generation based on expert evaluation, exceeding previous best results across two separate datasets by an absolute margin of 1% and 12%, where 57% and 96% of AI reports on normal cases, and 43% and 65% on abnormal cases, are evaluated as "equivalent or better" than the original radiologists' reports. We demonstrate the first ever large multimodal model-based report generation for 3D computed tomography (CT) volumes using Med-Gemini-3D, with 53% of AI reports considered clinically acceptable, although additional research is needed to meet expert radiologist reporting quality. Beyond report generation, Med-Gemini-2D surpasses the previous best performance in CXR visual question answering (VQA) and performs well in CXR classification and radiology VQA, exceeding SoTA or baselines on 17 of 20 tasks. In histopathology, ophthalmology, and dermatology image classification, Med-Gemini-2D surpasses baselines across 18 out of 20 tasks and approaches task-specific model performance. Beyond imaging, Med-Gemini-Polygenic outperforms the standard linear polygenic risk score-based approach for disease risk prediction and generalizes to genetically correlated diseases for which it has never been trained. Although further development and evaluation are necessary in the safety-critical medical domain, our results highlight the potential of Med-Gemini across a wide range of medical tasks.


title: Magnetic Ordering of Ammonium Cations in NH$_4$I, NH$_4$Br and NH$_4$Cl

abstract: The different types of magnetism arise mainly from how electrons move and interact with each other. In this work, we show how protons (H$^+$) also exhibit magnetic behavior. We measured the magnetic susceptibility of the ammonium halides and identified pronounced increases at 232 K, 233 K and 243 K for NH$_4$I, NH$_4$Br and NH$_4$Cl, respectively, which all coincide to the geometric ordering of its ammonium cations. With extensive literature establishing the fact that the ammonium cations exhibit rotational motion even towards the lowest temperatures, we take into account that the orbital motion of the protons carries a magnetic moment and find it to be larger than that of the paired electrons. Consequently, the structural phase transitions are magnetically-driven as the system attempts to lift 8-fold energy degeneracies of the proton orbitals via Jahn-Teller distortions. Our findings identify that NH$_4$$^+$ cations are capable of comprising magnetism which appears to be ubiquitous in ammonia-based molecular solids.


title: The Role of Predictive Uncertainty and Diversity in Embodied AI and Robot Learning

abstract: Uncertainty has long been a critical area of study in robotics, particularly when robots are equipped with analytical models. As we move towards the widespread use of deep neural networks in robots, which have demonstrated remarkable performance in research settings, understanding the nuances of uncertainty becomes crucial for their real-world deployment. This guide offers an overview of the importance of uncertainty and provides methods to quantify and evaluate it from an applications perspective.


title: Crystal orbital overlap population based on all-electron ab initio simulation with numeric atom-centered orbitals and its application to chemical-bonding analysis in Li-intercalated layered materials

abstract: Crystal Orbital Overlap Population (COOP) is one of the effective tools for chemical-bonding analysis, and thus it has been utilized in the materials development and characterization. In this study, we developed a code to perform the COOP-based chemical-bonding analysis based on the wavefunction obtained from a first principles all-electron calculation with numeric atom-centered orbitals. The chemical-bonding analysis using the developed code was demonstrated for F2 and Si. Furthermore, we applied the method to analyze the chemical-bonding changes associated with a Li intercalation in three representative layered materials: graphite, MoS2, and ZrNCl, because of their great industrial importance, particularly for the applications in battery and superconducting materials. The COOP analysis provided some insights for understanding the intercalation mechanism and the stability of the intercalated materials from a chemical-bonding viewpoint.


title: An Efficient All-to-All GCD Algorithm for Low Entropy RSA Key Factorization

abstract: RSA is an incredibly successful and useful asymmetric encryption algorithm. One of the types of implementation flaws in RSA is low entropy of the key generation, specifically the prime number creation stage. This can occur due to flawed usage of random prime number generator libraries, or on computers where there is a lack of a source of external entropy. These implementation flaws result in some RSA keys sharing prime factors, which means that the full factorization of the public modulus can be recovered incredibly efficiently by performing a computation GCD between the two public key moduli that share the prime factor. However, since one does not know which of the composite moduli share a prime factor a-priori, to determine if any such shared prime factors exist, an all-to-all GCD attack (also known as a batch GCD attack, or a bulk GCD attack) can be performed on the available public keys so as to recover any shared prime factors. This study describes a novel all-to-all batch GCD algorithm, which will be referred to as the binary tree batch GCD algorithm, that is more efficient than the current best batch GCD algorithm (the remainder tree batch GCD algorithm). A comparison against the best existing batch GCD method (which is a product tree followed by a remainder tree computation) is given using a dataset of random RSA moduli that are constructed such that some of the moduli share prime factors. This proposed binary tree batch GCD algorithm has better runtime than the existing remainder tree batch GCD algorithm, although asymptotically it has nearly identical scaling and its complexity is dependent on how many shared prime factors exist in the set of RSA keys. In practice, the implementation of the proposed binary tree batch GCD algorithm has a roughly 6x speedup compared to the standard remainder tree batch GCD approach.


title: TF4CTR: Twin Focus Framework for CTR Prediction via Adaptive Sample Differentiation

abstract: Effective feature interaction modeling is critical for enhancing the accuracy of click-through rate (CTR) prediction in industrial recommender systems. Most of the current deep CTR models resort to building complex network architectures to better capture intricate feature interactions or user behaviors. However, we identify two limitations in these models: (1) the samples given to the model are undifferentiated, which may lead the model to learn a larger number of easy samples in a single-minded manner while ignoring a smaller number of hard samples, thus reducing the model's generalization ability; (2) differentiated feature interaction encoders are designed to capture different interactions information but receive consistent supervision signals, thereby limiting the effectiveness of the encoder. To bridge the identified gaps, this paper introduces a novel CTR prediction framework by integrating the plug-and-play Twin Focus (TF) Loss, Sample Selection Embedding Module (SSEM), and Dynamic Fusion Module (DFM), named the Twin Focus Framework for CTR (TF4CTR). Specifically, the framework employs the SSEM at the bottom of the model to differentiate between samples, thereby assigning a more suitable encoder for each sample. Meanwhile, the TF Loss provides tailored supervision signals to both simple and complex encoders. Moreover, the DFM dynamically fuses the feature interaction information captured by the encoders, resulting in more accurate predictions. Experiments on five real-world datasets confirm the effectiveness and compatibility of the framework, demonstrating its capacity to enhance various representative baselines in a model-agnostic manner. To facilitate reproducible research, our open-sourced code and detailed running logs will be made available at: https://github.com/salmon1802/TF4CTR.


title: Fate of Two-Particle Bound States in the Continuum in non-Hermitian Systems

abstract: We unveil the existence of two-particle bound state in the continuum (BIC) in a one-dimensional interacting nonreciprocal lattice with a generalized boundary condition. By applying the Bethe-ansatz method, we can exactly solve the wavefunction and eigenvalue of the bound state in the continuum band, which enable us to precisely determine the phase diagrams of BIC. Our results demonstrate that the non-reciprocal hopping can delocalize the bound state and thus shrink the region of BIC. By analyzing the wavefunction, we identify the existence of two types of BICs with different spatial distributions and analytically derive the corresponding threshold values for the breakdown of BICs. The BIC with similar properties is also found to exist in another system with an impurity potential.


title: SOC-MartNet: A Martingale Neural Network for the Hamilton-Jacobi-Bellman Equation without Explicit inf H in Stochastic Optimal Controls

abstract: In this work, we propose a martingale based neural network, SOC-MartNet, for solving high-dimensional Hamilton-Jacobi-Bellman (HJB) equations where no explicit expression is needed for the Hamiltonian $\inf_{u \in U} H(t,x,u, z,p)$, and stochastic optimal control problems with controls on both drift and volatility. We reformulate the HJB equations into a stochastic neural network learning process, i.e., training a control network and a value network such that the associated Hamiltonian process is minimized and the cost process becomes a martingale.To enforce the martingale property for the cost process, we employ an adversarial network and construct a loss function based on the projection property of conditional expectations. Then, the control/value networks and the adversarial network are trained adversarially, such that the cost process is driven towards a martingale and the minimum principle is satisfied for the control.Numerical results show that the proposed SOC-MartNet is effective and efficient for solving HJB-type equations and SOCP with a dimension up to $500$ in a small number of training epochs.


title: Oracle-Checker Scheme for Evaluating a Generative Large Language Model

abstract: This work presents a novel approach called oracle-checker scheme for evaluating the answer given by a generative large language model (LLM). Two types of checkers are presented. The first type of checker follows the idea of property testing. The second type of checker follows the idea of program checking. Their applications are demonstrated in two separate contexts, entity extraction and paraphrase decision, respectively.


title: Magnetoelectric Coupling Based on Protons in Ammonium Sulfate

abstract: Most ferroelectric crystals have their own set of unique characteristics and ammonium sulfate (NH$_4$)$_2$SO$_4$ is no exception. We report on two previously unidentified features in ammonium sulfate: 1) that there are at least two successive transitions instead of one occurring at the Curie temperature $T$$_C$ = 223 K according to dielectric constant measurements; and 2) pronounced step-like anomalies are found in the magnetic susceptibility exactly at $T$$_C$. To explain these results, we take into account that there exists a previously unidentified linear coupling between the magnetic and electric dipole moments of the NH$_4$$^+$ tetrahedra due to their rapid reorientations and distorted geometry, respectively. The magnetic moments are small, 0.0016 $\mu$$_B$ for every $C$$_3$ reorientation which involve three protons (H$^+$) undergoing orbital motion. Nevertheless, short-range correlations exist in the paraelectric phase because the magnetic moments are restricted to only point along 14 possible orientations due to the symmetry and periodic nature of the potential wells. At $T$$_C$, $C$$_2$ reorientations (involving four protons) are no longer energetically feasible so the reduction in the degrees of freedom to 8 further enhances the effect of the magnetic interactions. This triggers long-range ordering of the orbital moments in an antiferromagnetic configuration along the $ab$-plane, which via Dzyaloshinskii-Moriya interactions, end up canting slightly toward the $c$-axis direction. Since there exists two types of inequivalent NH$_4$$^+$ groups that reorient at different frequencies with temperature and do not have the same degree of distortion, the emerging polar phase is ferrielectric.


title: Dimensional reduction gauge and low-dimensionalization in four dimensional QCD

abstract: Motivated by one-dimensional color-electric flux-tube formation in four-dimensional (4D) QCD, we investigate a possibility of low-dimensionalization in 4D QCD. We propose a new gauge fixing of ``dimensional reduction (DR) gauge" defined so as to minimize $R_{\mathrm{DR}}~\equiv~\int d^{4}s ~ \mathrm{Tr} \left[ A_{x}^{2}(s) + A_{y}^{2}(s) \right]$, which has a residual gauge symmetry for the gauge function $\Omega (t,z)$ like 2D QCD on the $t$-$z$ plane. We investigate low-dimensionalization in the DR gauge in SU(3) lattice QCD at $\beta = 6.0$. The amplitude of $A_{x}(s)$ and $A_{y}(s)$ are found to be strongly suppressed in the DR gauge. We consider ``$tz$-projection'' of $A_{x,y}(s) \to 0$ for the gauge configuration generated in the DR gauge, in a similar sense to Abelian projection in the maximally Abelian gauge. By the $tz$-projection in the DR gauge, the interquark potential is not changed, and $A_{t}(s)$ and $A_{z}(s)$ play a dominant role in quark confinement. In the DR gauge, we calculate a spatial correlation $\langle \mathrm{Tr} A_{\perp}(s) A_{\perp}(s+ra_{\perp}) \rangle ~ (\perp = x,y)$ and estimate the spatial mass of $A_{\perp}(s) ~ (\perp = x,y)$ as $M \simeq 1.7 ~ \mathrm{GeV}$. It is conjectured that this large mass makes $A_{\perp}(s)$ inactive and realizes the dominance of $A_{t}(s)$ and $A_{z}(s)$ in infrared region in the DR gauge. We also calculate the spatial correlation of two temporal link-variables and find that the correlation decreases as $\exp (-mr)$ with $m \simeq 0.6 ~ \mathrm{GeV}$. Using a crude approximation, 4D QCD is reduced into an ensemble of 2D QCD systems with the coupling of $g_{\rm 2D} = g m$.


title: Performance Upper Bound of Grover-Mixer Quantum Alternating Operator Ansatz

abstract: The Quantum Alternating Operator Ansatz (QAOA) represents a branch of quantum algorithms for solving combinatorial optimization problems. A specific variant, the Grover-Mixer Quantum Alternating Operator Ansatz (GM-QAOA), ensures uniform amplitude across states that share equivalent objective values. This property makes the algorithm independent of the problem structure, focusing instead on the distribution of objective values within the problem. In this work, we prove the probability upper bound for measuring a computational basis state from a GM-QAOA circuit with a given depth, which is a critical factor in QAOA cost. Using this, we derive the upper bounds for the probability of sampling an optimal solution, and for the approximation ratio of maximum optimization problems, both dependent on the objective value distribution. Through numerical analysis, we link the distribution to the problem size and build the regression models that relate the problem size, QAOA depth, and performance upper bound. Our results suggest that the GM-QAOA provides a quadratic enhancement in sampling probability and requires circuit depth that scales exponentially with problem size to maintain consistent performance.


title: Beam energy dependence of transverse momentum distribution and elliptic flow in Au-Au collisions using HYDJET++ model

abstract: In this work, we present the transverse momentum spectra and elliptic flow ($v_2$) of $\pi^\pm,k^\pm,$ $p$ and $\bar{p}$ in Au-Au collisions at $\sqrt{s_{NN}}=$ 62.4, 39.0, 27.0, 19.6 and 11.5 GeV using HYDJET++ model. For each beam energy the transverse momentum spectra are shown in four centrality classes at mid rapidity $|y|\le$ 0.1 and for elliptic flow ($v_2$) we have shown results for minimum bias events. We have performed a qualitative comparison between the hard and soft processes at different beam energies. The HYDJET++ model calculations for particle ratios, $p_T$ spectra, and $v_2$ agree well with the available experimental data. The HYDJET++ parameters like baryonic and strangeness chemical potential, and chemical and thermal freeze-out temperature vary with collision energy. Azimuthal spatial anisotropy ($\epsilon$) and azimuthal momentum anisotropy ($\delta$) decrease with collision energy which leads to a smaller value of $v_2$ at lower collision energies. Furthermore, the hadrons containing strange quarks tend to have smaller values of spatial and momentum anisotropy than the non-strange hadrons.


title: Limits via relations

abstract: In this paper, we study operations on functors in the category of abelian groups simplar to the derivation in the sense of Dold-Puppe. They are defined as derived limits of a functor applied to the relation subgroup over a category of free presentations of the group. The integral homology of the Eilenberg-Maclane space $K(\mathbb Z,3)$ appears as a part of description of these operations applied to symmetric powers.


title: FIMP-HGA: A Novel Approach to Addressing the Partitioning Min-Max Weighted Matching Problem

abstract: The Partitioning Min-Max Weighted Matching (PMMWM) problem, being a practical NP-hard problem, integrates the task of partitioning the vertices of a bipartite graph into disjoint sets of limited size with the classical Maximum-Weight Perfect Matching (MPWM) problem. Initially introduced in 2015, the state-of-the-art method for addressing PMMWM is the MP$_{\text{LS}}$. In this paper, we present a novel approach, the Fast Iterative Match-Partition Hybrid Genetic Algorithm (FIMP-HGA), for addressing PMMWM. Similar to MP$_{\text{LS}}$, FIMP-HGA divides the solving into match and partition stages, iteratively refining the solution. In the match stage, we propose the KM-M algorithm, which reduces matching complexity through incremental adjustments, significantly enhancing runtime efficiency. For the partition stage, we introduce a Hybrid Genetic Algorithm (HGA) incorporating an elite strategy and design a Greedy Partition Crossover (GPX) operator alongside a Multilevel Local Search (MLS) to optimize individuals in the population. Population initialization employs various methods, including the multi-way Karmarkar-Karp (KK) algorithm, ensuring both quality and diversity. At each iteration, the bipartite graph is adjusted based on the current solution, aiming for continuous improvement. To conduct comprehensive experiments, we develop a new instance generation method compatible with existing approaches, resulting in four benchmark groups. Extensive experiments evaluate various algorithm modules, accurately assessing each module's impact on improvement. Evaluation results on our benchmarks demonstrate that the proposed FIMP-HGA significantly enhances solution quality compared to MP$_{\text{LS}}$, meanwhile reducing runtime by 3 to 20 times.


title: Transformer-based RGB-T Tracking with Channel and Spatial Feature Fusion

abstract: Complementary RGB and TIR modalities enable RGB-T tracking to achieve competitive performance in challenging scenarios. Therefore, how to better fuse cross-modal features is the core issue of RGB-T tracking. Some previous methods either insufficiently fuse RGB and TIR features, or depend on intermediaries containing information from both modalities to achieve cross-modal information interaction. The former does not fully exploit the potential of using only RGB and TIR information of the template or search region for channel and spatial feature fusion, and the latter lacks direct interaction between the template and search area, which limits the model's ability to fully exploit the original semantic information of both modalities. To alleviate these limitations, we explore how to improve the performance of a visual Transformer by using direct fusion of cross-modal channels and spatial features, and propose CSTNet. CSTNet uses ViT as a backbone and inserts cross-modal channel feature fusion modules (CFM) and cross-modal spatial feature fusion modules (SFM) for direct interaction between RGB and TIR features. The CFM performs parallel joint channel enhancement and joint multilevel spatial feature modeling of RGB and TIR features and sums the features, and then globally integrates the sum feature with the original features. The SFM uses cross-attention to model the spatial relationship of cross-modal features and then introduces a convolutional feedforward network for joint spatial and channel integration of multimodal features. Comprehensive experiments show that CSTNet achieves state-of-the-art performance on three public RGB-T tracking benchmarks. Code is available at https://github.com/LiYunfengLYF/CSTNet.


title: POPDG: Popular 3D Dance Generation with PopDanceSet

abstract: Generating dances that are both lifelike and well-aligned with music continues to be a challenging task in the cross-modal domain. This paper introduces PopDanceSet, the first dataset tailored to the preferences of young audiences, enabling the generation of aesthetically oriented dances. And it surpasses the AIST++ dataset in music genre diversity and the intricacy and depth of dance movements. Moreover, the proposed POPDG model within the iDDPM framework enhances dance diversity and, through the Space Augmentation Algorithm, strengthens spatial physical connections between human body joints, ensuring that increased diversity does not compromise generation quality. A streamlined Alignment Module is also designed to improve the temporal alignment between dance and music. Extensive experiments show that POPDG achieves SOTA results on two datasets. Furthermore, the paper also expands on current evaluation metrics. The dataset and code are available at https://github.com/Luke-Luo1/POPDG.


title: Solutions of the equation $a_n + (a_{n-1} + \cdots (a_2 + (a_1 + x^{r_1})^{r_2}\cdots )^{r_{n}} = b\, x$

abstract: We establish a novel upper bound for the real solutions of the equation specified in the title, employing a generalized derivation-division algorithm. As a consequence, we also derive a new set of Chebyshev functions adapted specifically for this problem.


title: Braced Fourier Continuation and Regression for Anomaly Detection

abstract: In this work, the concept of Braced Fourier Continuation and Regression (BFCR) is introduced. BFCR is a novel and computationally efficient means of finding nonlinear regressions or trend lines in arbitrary one-dimensional data sets. The Braced Fourier Continuation (BFC) and BFCR algorithms are first outlined, followed by a discussion of the properties of BFCR as well as demonstrations of how BFCR trend lines may be used effectively for anomaly detection both within and at the edges of arbitrary one-dimensional data sets. Finally, potential issues which may arise while using BFCR for anomaly detection as well as possible mitigation techniques are outlined and discussed. All source code and example data sets are either referenced or available via GitHub, and all associated code is written entirely in Python.


title: Collaborative Satellite Computing through Adaptive DNN Task Splitting and Offloading

abstract: Satellite computing has emerged as a promising technology for next-generation wireless networks. This innovative technology provides data processing capabilities, which facilitates the widespread implementation of artificial intelligence (AI)-based applications, especially for image processing tasks involving deep neural network (DNN). With the limited computing resources of an individual satellite, independently handling DNN tasks generated by diverse user equipments (UEs) becomes a significant challenge. One viable solution is dividing a DNN task into multiple subtasks and subsequently distributing them across multiple satellites for collaborative computing. However, it is challenging to partition DNN appropriately and allocate subtasks into suitable satellites while ensuring load balancing. To this end, we propose a collaborative satellite computing system designed to improve task processing efficiency in satellite networks. Based on this system, a workload-balanced adaptive task splitting scheme is developed to equitably distribute the workload of DNN slices for collaborative inference, consequently enhancing the utilization of satellite computing resources. Additionally, a self-adaptive task offloading scheme based on a genetic algorithm (GA) is introduced to determine optimal offloading decisions within dynamic network environments. The numerical results illustrate that our proposal can outperform comparable methods in terms of task completion rate, delay, and resource utilization.


title: Reference-free dual-comb spectroscopy with inbuilt coherence

abstract: We demonstrate a simple system for dual-comb spectroscopy based on two inherently coherent optical frequency combs generated via seeded parametric down-conversion. The inbuilt coherence is established by making the two combs share a common comb line. We show that the inbuilt coherence makes it possible to use a simple numerical post-processing procedure to compensate for small drifts of the dual-comb interferogram arrival-time and phase. This enables long-time coherent averaging of the interferograms.


title: Impact of EIP-4844 on Ethereum: Consensus Security, Ethereum Usage, Rollup Transaction Dynamics, and Blob Gas Fee Markets

abstract: On March 13, 2024, Ethereum implemented EIP-4844, designed to enhance its role as a data availability layer. While this upgrade reduces data posting costs for rollups, it also raises concerns about its impact on the consensus layer due to increased propagation sizes. Moreover, the broader effects on the overall Ethereum ecosystem remain largely unexplored. In this paper, we conduct an empirical analysis of the impact of EIP-4844 on consensus security, Ethereum usage, rollup transaction dynamics, and the blob gas fee mechanism. We explore changes in synchronization times, provide quantitative assessments of rollup and user behaviors, and deepen the understanding of the blob gas fee mechanism, highlighting both enhancements and areas of concern post-upgrade.


title: Kolmogorovian Censorship, Predictive Incompleteness, and the locality loophole in Bell experiments

abstract: In the foundations of quantum mechanics, the Kolmogorovian Censorship (KC) stipulates that quantum probabilities can be identified with classical, Kolmogorovian probabilities when considering a specified measurement context. Then in any given measurement context it is possible to build a Kolmogorovian probability distribution, or equivalently a hidden variable theory; however this distribution must be matched to the chosen context. In a loophole-free Bell test, the remote random choices of measurements (polarizers orientations) have the purpose to prevent that this matching can be obtained from any relativistically causal transmission between the source and the detectors. Then the matching (required to violate Bell's inequalities) may be obtained either by an instantaneous influence at a distance between the source and the detectors (explicit nonlocality), or by assuming that it is pre-established before the actual experiment takes place (super-determinism). If both influence at a distance and super-determinism are not accepted on physical grounds, a third way is still available, called "predictive incompleteness": it tells that the usual quantum state $\psi$ is incomplete, as long as the measurement context has not been specified. In agreement with the general quantum framework called CSM (Contexts, Systems and Modalities) we argue that predictive incompleteness is the correct quantum way to understand the violation of Bell's inequalities.


title: Spatiotemporal Implicit Neural Representation as a Generalized Traffic Data Learner

abstract: Spatiotemporal Traffic Data (STTD) measures the complex dynamical behaviors of the multiscale transportation system. Existing methods aim to reconstruct STTD using low-dimensional models. However, they are limited to data-specific dimensions or source-dependent patterns, restricting them from unifying representations. Here, we present a novel paradigm to address the STTD learning problem by parameterizing STTD as an implicit neural representation. To discern the underlying dynamics in low-dimensional regimes, coordinate-based neural networks that can encode high-frequency structures are employed to directly map coordinates to traffic variables. To unravel the entangled spatial-temporal interactions, the variability is decomposed into separate processes. We further enable modeling in irregular spaces such as sensor graphs using spectral embedding. Through continuous representations, our approach enables the modeling of a variety of STTD with a unified input, thereby serving as a generalized learner of the underlying traffic dynamics. It is also shown that it can learn implicit low-rank priors and smoothness regularization from the data, making it versatile for learning different dominating data patterns. We validate its effectiveness through extensive experiments in real-world scenarios, showcasing applications from corridor to network scales. Empirical results not only indicate that our model has significant superiority over conventional low-rank models, but also highlight that the versatility of the approach extends to different data domains, output resolutions, and network topologies. Comprehensive model analyses provide further insight into the inductive bias of STTD. We anticipate that this pioneering modeling perspective could lay the foundation for universal representation of STTD in various real-world tasks.


title: On the invariants of L-functions of degree 2, I: twisted degree and internal shift

abstract: This is the first part of a series of papers where the behaviour of the invariants under twist by Dirichlet characters is studied for $L$-functions of degree 2. Here we show, under suitable conditions, that degree and internal shift remain unchanged under twist. The ultimate goal of the series is to prove a general version of Weil converse theorem with minimal assumptions on the shape of the functional equation of the twists.


title: LURAD: Design Study of a Comprehensive Radiation Monitor Package for the Gateway and the Lunar Surface

abstract: Moon is an auspicious environment for the study of Galactic cosmic rays (GCR) and Solar particle events (SEP) due to the absence of magnetic field and atmosphere. The same characteristics raise the radiation risk for human presence in orbit around it or at the lunar surface. The secondary (albedo) radiation resulting from the interaction of the primary radiation with the lunar soil adds an extra risk factor, because neutrons are produced, but also it can be exploited to study the soil composition. In this paper, the design of a comprehensive radiation monitor package tailored to the lunar environment is presented. The detector, named LURAD, will perform spectroscopic measurements of protons, electrons, heavy ions, as well as gamma-rays, and neutrons. A microdosimetry monitor subsystem is foreseen which can provide measurements of LET(Si) spectra in a wide dynamic range of LET(Si) and flux for SPE and GCR, detection of neutrons and biological dose for radiation protection of astronauts. The LURAD design leverages on the following key enabling technologies: (a) Fully depleted Si monolithic active pixel sensors; (b) Scintillators read by silicon photomultipliers (SiPM); (c) Silicon on Insulator (SOI) microdosimetry sensors; These technologies promise miniaturization and mass reduction with state-of-the-art performance. The instrument's design is presented, and the Monte Carlo study of the feasibility of particle identification and kinetic energy determination is discussed


title: Hyperbolic Geometric Latent Diffusion Model for Graph Generation

abstract: Diffusion models have made significant contributions to computer vision, sparking a growing interest in the community recently regarding the application of them to graph generation. Existing discrete graph diffusion models exhibit heightened computational complexity and diminished training efficiency. A preferable and natural way is to directly diffuse the graph within the latent space. However, due to the non-Euclidean structure of graphs is not isotropic in the latent space, the existing latent diffusion models effectively make it difficult to capture and preserve the topological information of graphs. To address the above challenges, we propose a novel geometrically latent diffusion framework HypDiff. Specifically, we first establish a geometrically latent space with interpretability measures based on hyperbolic geometry, to define anisotropic latent diffusion processes for graphs. Then, we propose a geometrically latent diffusion process that is constrained by both radial and angular geometric properties, thereby ensuring the preservation of the original topological properties in the generative graphs. Extensive experimental results demonstrate the superior effectiveness of HypDiff for graph generation with various topologies.


title: Coarsening in Bent-core Liquid Crystals: Intermediate Splay Bend State en route to the Twist Bend Phase

abstract: We use molecular dynamics simulations to study coarsening dynamics in achiral banana-shaped bent-core liquid crystals following a quench from the high concentration polar smectic (SmX) phase to lower concentrations that favor the exotic twist-bend (TB) phase. Our novel result is the identification of an intermediate splay-bend state emerging prior to the eventual TB phase. The latter coarsens via the annihilation of {\it beta lines} which are analogous to string defects in nematic liquid crystals. Our findings are relevant for a large class of chiral systems assembled from achiral entities.


title: Adapting Dual-encoder Vision-language Models for Paraphrased Retrieval

abstract: In the recent years, the dual-encoder vision-language models (\eg CLIP) have achieved remarkable text-to-image retrieval performance. However, we discover that these models usually results in very different retrievals for a pair of paraphrased queries. Such behavior might render the retrieval system less predictable and lead to user frustration. In this work, we consider the task of paraphrased text-to-image retrieval where a model aims to return similar results given a pair of paraphrased queries. To start with, we collect a dataset of paraphrased image descriptions to facilitate quantitative evaluation for this task. We then hypothesize that the undesired behavior of existing dual-encoder model is due to their text towers which are trained on image-sentence pairs and lack the ability to capture the semantic similarity between paraphrased queries. To improve on this, we investigate multiple strategies for training a dual-encoder model starting from a language model pretrained on a large text corpus. Compared to public dual-encoder models such as CLIP and OpenCLIP, the model trained with our best adaptation strategy achieves a significantly higher ranking similarity for paraphrased queries while maintaining similar zero-shot classification and retrieval accuracy.


title: Exploiting Matrix Information Geometry for Integrated Decoding of Massive Uncoupled Unsourced Random Access

abstract: In this paper, we explore an efficient uncoupled unsourced random access (UURA) scheme for 6G massive communication. UURA is a typical framework of unsourced random access that addresses the problems of codeword detection and message stitching, without the use of check bits. Firstly, we establish a framework for UURA, allowing for immediate decoding of sub-messages upon arrival. Thus, the processing delay is effectively reduced due to the decreasing waiting time. Next, we propose an integrated decoding algorithm for sub-messages by leveraging matrix information geometry (MIG) theory. Specifically, MIG is applied to measure the feature similarities of codewords belonging to the same user equipment, and thus sub-message can be stitched once it is received. This enables the timely recovery of a portion of the original message by simultaneously detecting and stitching codewords within the current sub-slot. Furthermore, we analyze the performance of the proposed integrated decoding-based UURA scheme in terms of computational complexity and convergence rate. Finally, we present extensive simulation results to validate the effectiveness of the proposed scheme in 6G wireless networks.


title: QuadraNet V2: Efficient and Sustainable Training of High-Order Neural Networks with Quadratic Adaptation

abstract: Machine learning is evolving towards high-order models that necessitate pre-training on extensive datasets, a process associated with significant overheads. Traditional models, despite having pre-trained weights, are becoming obsolete due to architectural differences that obstruct the effective transfer and initialization of these weights. To address these challenges, we introduce a novel framework, QuadraNet V2, which leverages quadratic neural networks to create efficient and sustainable high-order learning models. Our method initializes the primary term of the quadratic neuron using a standard neural network, while the quadratic term is employed to adaptively enhance the learning of data non-linearity or shifts. This integration of pre-trained primary terms with quadratic terms, which possess advanced modeling capabilities, significantly augments the information characterization capacity of the high-order network. By utilizing existing pre-trained weights, QuadraNet V2 reduces the required GPU hours for training by 90\% to 98.4\% compared to training from scratch, demonstrating both efficiency and effectiveness.


title: Exploring Frequencies via Feature Mixing and Meta-Learning for Improving Adversarial Transferability

abstract: Recent studies have shown that Deep Neural Networks (DNNs) are susceptible to adversarial attacks, with frequency-domain analysis underscoring the significance of high-frequency components in influencing model predictions. Conversely, targeting low-frequency components has been effective in enhancing attack transferability on black-box models. In this study, we introduce a frequency decomposition-based feature mixing method to exploit these frequency characteristics in both clean and adversarial samples. Our findings suggest that incorporating features of clean samples into adversarial features extracted from adversarial examples is more effective in attacking normally-trained models, while combining clean features with the adversarial features extracted from low-frequency parts decomposed from the adversarial samples yields better results in attacking defense models. However, a conflict issue arises when these two mixing approaches are employed simultaneously. To tackle the issue, we propose a cross-frequency meta-optimization approach comprising the meta-train step, meta-test step, and final update. In the meta-train step, we leverage the low-frequency components of adversarial samples to boost the transferability of attacks against defense models. Meanwhile, in the meta-test step, we utilize adversarial samples to stabilize gradients, thereby enhancing the attack's transferability against normally trained models. For the final update, we update the adversarial sample based on the gradients obtained from both meta-train and meta-test steps. Our proposed method is evaluated through extensive experiments on the ImageNet-Compatible dataset, affirming its effectiveness in improving the transferability of attacks on both normally-trained CNNs and defense models. The source code is available at https://github.com/WJJLL/MetaSSA.


title: CityLLaVA: Efficient Fine-Tuning for VLMs in City Scenario

abstract: In the vast and dynamic landscape of urban settings, Traffic Safety Description and Analysis plays a pivotal role in applications ranging from insurance inspection to accident prevention. This paper introduces CityLLaVA, a novel fine-tuning framework for Visual Language Models (VLMs) designed for urban scenarios. CityLLaVA enhances model comprehension and prediction accuracy through (1) employing bounding boxes for optimal visual data preprocessing, including video best-view selection and visual prompt engineering during both training and testing phases; (2) constructing concise Question-Answer sequences and designing textual prompts to refine instruction comprehension; (3) implementing block expansion to fine-tune large VLMs efficiently; and (4) advancing prediction accuracy via a unique sequential questioning-based prediction augmentation. Demonstrating top-tier performance, our method achieved a benchmark score of 33.4308, securing the leading position on the leaderboard. The code can be found: https://github.com/alibaba/AICITY2024_Track2_AliOpenTrek_CityLLaVA


title: Probing dark energy using anisotropies in the clustering of post-EoR HI distribution

abstract: We propose an anisotropy quantifier of the HI 21-cm signal traditionally used to clock the astrophysics of the reionization era as a post-reionization dark energy diagnostic. We find that the anisotropy probe can be measured at SNR $\sim 10$ in both auto-correlation and in cross-correlation with the Ly-$\alpha$ forest over a wide $z$ and $k-$range. We propose to use the BAO signature on the anisotropy signal to measure $( H(z), D_A(z))$. Subsequently, we put constraints on a dark energy model involving a negative cosmological constant on top of a quintessence scalar field and find that such a model is consistent with futuristic observations.


title: Design and Analysis of Massive Uncoupled Unsourced Random Access with Bayesian Joint Decoding

abstract: In this paper, we investigate unsourced random access for massive machine-type communications (mMTC) in the sixth-generation (6G) wireless networks. Firstly, we establish a high-efficiency uncoupled framework for massive unsourced random access without extra parity check bits. Then, we design a low-complexity Bayesian joint decoding algorithm, including codeword detection and stitching. In particular, we present a Bayesian codeword detection approach by exploiting Bayes-optimal divergence-free orthogonal approximate message passing in the case of unknown priors. The output long-term channel statistic information is well leveraged to stitch codewords for recovering the original message. Thus, the spectral efficiency is improved by avoiding the use of parity bits. Moreover, we analyze the performance of the proposed Bayesian joint decoding-based massive uncoupled unsourced random access scheme in terms of computational complexity and error probability of decoding. Furthermore, by asymptotic analysis, we obtain some useful insights for the design of massive unsourced random access. Finally, extensive simulation results confirm the effectiveness of the proposed scheme in 6G wireless networks.


title: StyleSeg V2: Towards Robust One-shot Segmentation of Brain Tissue via Optimization-free Registration Error Perception

abstract: One-shot segmentation of brain tissue requires training registration-segmentation (reg-seg) dual-model iteratively, where reg-model aims to provide pseudo masks of unlabeled images for seg-model by warping a carefully-labeled atlas. However, the imperfect reg-model induces image-mask misalignment, poisoning the seg-model subsequently. Recent StyleSeg bypasses this bottleneck by replacing the unlabeled images with their warped copies of atlas, but needs to borrow the diverse image patterns via style transformation. Here, we present StyleSeg V2, inherited from StyleSeg but granted the ability of perceiving the registration errors. The motivation is that good registration behaves in a mirrored fashion for mirrored images. Therefore, almost at no cost, StyleSeg V2 can have reg-model itself "speak out" incorrectly-aligned regions by simply mirroring (symmetrically flipping the brain) its input, and the registration errors are symmetric inconsistencies between the outputs of original and mirrored inputs. Consequently, StyleSeg V2 allows the seg-model to make use of correctly-aligned regions of unlabeled images and also enhances the fidelity of style-transformed warped atlas image by weighting the local transformation strength according to registration errors. The experimental results on three public datasets demonstrate that our proposed StyleSeg V2 outperforms other state-of-the-arts by considerable margins, and exceeds StyleSeg by increasing the average Dice by at least 2.4%.


title: Stability Evaluation via Distributional Perturbation Analysis

abstract: The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability evaluation criterion is defined as the minimal perturbation required on our observed dataset to induce a prescribed deterioration in risk evaluation. In this paper, we utilize the optimal transport (OT) discrepancy with moment constraints on the \textit{(sample, density)} space to quantify this perturbation. Therefore, our stability evaluation criterion can address both \emph{data corruptions} and \emph{sub-population shifts} -- the two most common types of distribution shifts in real-world scenarios. To further realize practical benefits, we present a series of tractable convex formulations and computational methods tailored to different classes of loss functions. The key technical tool to achieve this is the strong duality theorem provided in this paper. Empirically, we validate the practical utility of our stability evaluation criterion across a host of real-world applications. These empirical studies showcase the criterion's ability not only to compare the stability of different learning models and features but also to provide valuable guidelines and strategies to further improve models.


title: Boosting MLPs with a Coarsening Strategy for Long-Term Time Series Forecasting

abstract: Deep learning methods have been exerting their strengths in long-term time series forecasting. However, they often struggle to strike a balance between expressive power and computational efficiency. Resorting to multi-layer perceptrons (MLPs) provides a compromising solution, yet they suffer from two critical problems caused by the intrinsic point-wise mapping mode, in terms of deficient contextual dependencies and inadequate information bottleneck. Here, we propose the Coarsened Perceptron Network (CP-Net), featured by a coarsening strategy that alleviates the above problems associated with the prototype MLPs by forming information granules in place of solitary temporal points. The CP-Net utilizes primarily a two-stage framework for extracting semantic and contextual patterns, which preserves correlations over larger timespans and filters out volatile noises. This is further enhanced by a multi-scale setting, where patterns of diverse granularities are fused towards a comprehensive prediction. Based purely on convolutions of structural simplicity, CP-Net is able to maintain a linear computational complexity and low runtime, while demonstrates an improvement of 4.1% compared with the SOTA method on seven forecasting benchmarks.


title: A Dynamical Simulation Model of a Cement Clinker Rotary Kiln

abstract: This study provides a systematic description and results of a dynamical simulation model of a rotary kiln for clinker, based on first engineering principles. The model is built upon thermophysical, chemical, and transportation models for both the formation of clinker phases and fuel combustion in the kiln. The model is presented as a 1D model with counter-flow between gas and clinker phases and is demonstrated by a simulation using industrially relevant input. An advantage of the proposed model is that it provides the evolution of the individual compounds for both the fuel and clinker. As such, the model comprises a stepping stone for evaluating the development of process control systems for existing cement plants.


title: Experimental Investigation of Repurposed Kaplan Turbines as Variable-Speed Propellers for Maximizing Frequency Containment Reserve

abstract: This study explores the practical viability of repurposing aging Kaplan turbines into variable-speed propellers by employing full-size frequency converters. The motivation behind this approach is to improve the provision of \emph{Frequency Containment Reserve} (FCR) while reducing fatigue in the Kaplan blades servomechanism. We evaluate the performance of these modified Kaplan turbines against the one of another hydro asset composed of the same Kaplan turbine hybridized with a \emph{Battery Energy Storage System} (BESS). Experiments are conducted on a one-of-its-kind reduced-scale model testing platform. Our findings reveal that Kaplan turbines repurposed as variable-speed propellers exhibit similar dynamic response characteristics compared to the standalone Kaplan operation, with the added benefit of effectively eliminating blade movements. Furthermore, the ability to control the speed increases the hydraulic efficiency for certain operating points. In summary, investment in variable speed technology emerges as a viable alternative to BESS-based hydropower hybridization.


title: Hierarchical Space-Time Attention for Micro-Expression Recognition

abstract: Micro-expression recognition (MER) aims to recognize the short and subtle facial movements from the Micro-expression (ME) video clips, which reveal real emotions. Recent MER methods mostly only utilize special frames from ME video clips or extract optical flow from these special frames. However, they neglect the relationship between movements and space-time, while facial cues are hidden within these relationships. To solve this issue, we propose the Hierarchical Space-Time Attention (HSTA). Specifically, we first process ME video frames and special frames or data parallelly by our cascaded Unimodal Space-Time Attention (USTA) to establish connections between subtle facial movements and specific facial areas. Then, we design Crossmodal Space-Time Attention (CSTA) to achieve a higher-quality fusion for crossmodal data. Finally, we hierarchically integrate USTA and CSTA to grasp the deeper facial cues. Our model emphasizes temporal modeling without neglecting the processing of special data, and it fuses the contents in different modalities while maintaining their respective uniqueness. Extensive experiments on the four benchmarks show the effectiveness of our proposed HSTA. Specifically, compared with the latest method on the CASME3 dataset, it achieves about 3% score improvement in seven-category classification.


title: Sharp estimates, uniqueness and spikes condensation for superlinear free boundary problems arising in plasma physics

abstract: We are concerned with Grad-Shafranov type equations, describing in dimension $N=2$ the equilibrium configurations of a plasma in a Tokamak. We obtain a sharp superlinear generalization of the result of Temam (1977) about the linear case, implying the first general uniqueness result ever for superlinear free boundary problems arising in plasma physics. Previous general uniqueness results of Beresticky-Brezis (1980) were concerned with globally Lipschitz nonlinearities. In dimension $N\geq 3$ the uniqueness result is new but not sharp, motivating the local analysis of a spikes condensation-quantization phenomenon for superlinear and subcritical singularly perturbed Grad-Shafranov type free boundary problems, implying among other things a converse of the results about spikes condensation in Flucher-Wei (1998) and Wei (2001). Interestingly enough, in terms of the "physical" global variables, we come up with a concentration-quantization-compactness result sharing the typical features of critical problems (Yamabe $N\geq 3$, Liouville $N=2$) but in a subcritical setting, the singular behavior being induced by a sort of infinite mass limit, in the same spirit of Brezis-Merle (1991).


title: Extension groups for the $C^*$-algebras associated with $\lambda$-graph systems

abstract: A $\lambda$-graph system is a labeled Bratteli diagram with certain additional structure, which presents a subshift. The class of the $C^*$-algebras $\mathcal{O}_{\frak L}$ associated with the $\lambda$-graph systems is a generalized class of the class of Cuntz--Krieger algebras. In this paper, we will compute the strong extension groups $\operatorname{Ext}_{\operatorname{s}}(\mathcal{O}_{\frak L})$ for the $C^*$-algebras associated with $\lambda$-graph systems ${\frak L}$ and study their relation with the weak extension group $\operatorname{Ext}_{\operatorname{w}}(\mathcal{O}_{\frak L})$.


title: Anchored Answers: Unravelling Positional Bias in GPT-2's Multiple-Choice Questions

abstract: Large Language Models (LLMs), such as the GPT-4 and LLaMA families, have demonstrated considerable success across diverse tasks, including multiple-choice questions (MCQs). However, these models exhibit a positional bias, particularly an even worse anchored bias in the GPT-2 family, where they consistently favour the first choice 'A' in MCQs during inference. This anchored bias challenges the integrity of GPT-2's decision-making process, as it skews performance based on the position rather than the content of the choices in MCQs. In this study, we utilise the mechanistic interpretability approach to identify the internal modules within GPT-2 models responsible for this bias. We focus on the Multi-Layer Perceptron (MLP) layers and attention heads, using the "logit lens" method to trace and modify the specific value vectors that contribute to the bias. By updating these vectors within MLP and recalibrating attention patterns to neutralise the preference for the first choice 'A', we effectively mitigate the anchored bias. Our interventions not only mitigate the bias but also improve the overall MCQ prediction accuracy for the GPT-2 family across various datasets. This work represents the first comprehensive mechanistic analysis of anchored bias in MCQs within the GPT-2 models, introducing targeted, minimal-intervention strategies that significantly enhance GPT2 model robustness and accuracy in MCQs. Our code is available at https://github.com/ruizheliUOA/Anchored_Bias_GPT2.


title: Vietnamese AI Generated Text Detection

abstract: In recent years, Large Language Models (LLMs) have become integrated into our daily lives, serving as invaluable assistants in completing tasks. Widely embraced by users, the abuse of LLMs is inevitable, particularly in using them to generate text content for various purposes, leading to difficulties in distinguishing between text generated by LLMs and that written by humans. In this study, we present a dataset named ViDetect, comprising 6.800 samples of Vietnamese essay, with 3.400 samples authored by humans and the remainder generated by LLMs, serving the purpose of detecting text generated by AI. We conducted evaluations using state-of-the-art methods, including ViT5, BartPho, PhoBERT, mDeberta V3, and mBERT. These results contribute not only to the growing body of research on detecting text generated by AI but also demonstrate the adaptability and effectiveness of different methods in the Vietnamese language context. This research lays the foundation for future advancements in AI-generated text detection and provides valuable insights for researchers in the field of natural language processing.


title: A Philosophical Introduction to Language Models - Part II: The Way Forward

abstract: In this paper, the second of two companion pieces, we explore novel philosophical questions raised by recent progress in large language models (LLMs) that go beyond the classical debates covered in the first part. We focus particularly on issues related to interpretability, examining evidence from causal intervention methods about the nature of LLMs' internal representations and computations. We also discuss the implications of multimodal and modular extensions of LLMs, recent debates about whether such systems may meet minimal criteria for consciousness, and concerns about secrecy and reproducibility in LLM research. Finally, we discuss whether LLM-like systems may be relevant to modeling aspects of human cognition, if their architectural characteristics and learning scenario are adequately constrained.


title: A First-Engineering Principles Model for Dynamical Simulation of a Calciner in Cement Production

abstract: We present an index-1 differential-algebraic equation (DAE) model for dynamic simulation of a calciner in the pyro-section of a cement plant. The model is based on first engineering principles and integrates reactor geometry, thermo-physical properties, transport phenomena, stoichiometry and kinetics, mass and energy balances, and algebraic volume and internal energy equations in a systematic manner. The model can be used for dynamic simulation of the calciner. We also provide simulation results that are qualitatively correct. The calciner model is part of an overall model for dynamical simulation of the pyro-section in a cement plant. This model can be used in design of control and optimization systems to improve the energy efficiency and \ce{CO2} emission from cement plants.


title: Evidence for a cyclotron absorption line and spectral transition in EXO 2030+375 during 2021 giant outburst

abstract: Based on HXMT observations of EXO 2030+375 during its 2021 giant outburst, we report the analysis of pulse variations and the broadband X-ray spectrum, and find the presence of a potential cyclotron resonant scattering feature with the fundamental line at 47 keV from both average spectra and phase-resolved spectroscopy. During the outburst, the source reached an X-ray luminosity of $\sim 1\times 10^{38}$ erg /cm/s from 2-105 keV at a distance of 7.1 kpc. The X-ray pulsar at the spin period of 41.27 seconds exhibits complex timing and spectral variations with both energy and luminosity during the outburst. The shapes of the pulses profiles show the single main peak above 20 keV, while appear to exhibit multi-peak patterns in low energy bands, and the transition of pulse profiles from multi-peak to single-peak is observed at $0.8\times 10^{38}$ erg /cm/s, which suggests the evolution from the subcritical luminosity (pencil-beam dominated) to supercritical luminosity (fan-beam dominated) regimes. A dip structure before the energy of the cyclotron resonant scattering features is found in the pulse fraction-energy relation near the peak luminosity. A detailed analysis of spectral parameters showed that the power-law photon index exhibits three distinct trends as luminosity increases, and these changes also signify a spectral transition from sub-critical to super-critical regimes. The critical luminosity infers the magnetic field of $(4.8-6.0)\times 10^{12}$ G, which supports the presence of the cyclotron line at 47 keV. A Comptonization model applied for the broad X-ray spectra during the outburst also suggests the surface magnetic field ranging from $(5-9)\times 10^{12}$ G.


title: Magnetic dipole transition in proton-deuteron radiative capture at BBN energies within potential model

abstract: The $pd$ radiative capture reaction plays a vital role in Big Bang nucleosynthesis and stellar proton-proton chain. The study of the low-energy reaction is challenging in both experiments and theories. Using the framework of potential model, we analyze $pd$ radiative capture below 1 MeV for both electric dipole ($E1$) and magnetic dipole ($M1$) transitions. The obtained astrophysical $S$ factors agree well with recent results, especially at energies relevant to sensitive deuterium abundance. The calculated reaction rate shows good agreement, with less than a 5\% difference compared to recent works. The extrapolated value for $S(0)$ including both transitions is determined to be $0.211 \pm 0.016$ eV b. A comparison with experimental data using the $\chi^2$ test reveals the sensitivity of the $M1$ cross section at low energies to the scattering potential depth.


title: On bursty star formation during cosmological reionization - how does it influence the baryon mass content of dark matter halos?

abstract: The baryon mass content of dark matter halos in the early Universe depends on global factors - e.g. ionising ultraviolet (UV) radiation background - and local factors - e.g. star formation efficiency and assembly history. We use a lightweight semi-analytical model to investigate how local and global factors impact halo baryon mass content at redshifts of $z\geq 5$. Our model incorporates a time delay between when stars form and when they produce feedback, which drive bursts of star formation, and a mass and redshift dependent UV background, which captures the influence of cosmological reionization on gas accretion onto halos. We use statistically representative halo assembly histories and assume that the cosmological gas accretion rate is proportional to the halo mass accretion rate. Delayed feedback leads to oscillations in gas mass with cosmic time, behaviour that cannot be captured with instantaneous feedback. Highly efficient star formation drives stronger oscillations, while strong feedback impacts when oscillations occur; in contrast, inefficient star formation and weak feedback produce similar long-term behaviour to that observed in instantaneous feedback models. If the delayed feedback timescale is too long, a halo retains its gas reservoir but the feedback suppresses star formation. Our model predicts that lower mass systems ($\leq 10^7 \text{M}_\odot$) at $z \leq 10$ should be strongly gas deficient, whereas higher mass systems retain their gas reservoirs because they are sufficiently massive to continue accreting gas through cosmological reionization. Interestingly, in higher mass halos, the median $m_\star/(m_\star+m_\text{g}) \simeq 0.01-0.05$, but is a factor of 3-5 smaller when feedback is delayed. Our model does not include seed supermassive black hole feedback, which is necessary to explain massive quenched galaxies in the early Universe.


title: Using magnetic dynamics to measure the spin gap in a candidate Kitaev material

abstract: Materials potentially hosting Kitaev spin-liquid states are considered crucial for realizing topological quantum computing. However, the intricate nature of spin interactions within these materials complicates the precise measurement of low-energy spin excitations indicative of fractionalized excitations. Using Na$_{2}$Co$_2$TeO$_{6}$ as an example, we study these low-energy spin excitations using the time-resolved resonant elastic x-ray scattering (tr-REXS). Our observations unveil remarkably slow spin dynamics at the magnetic peak, whose recovery timescale is several nanoseconds. This timescale aligns with the extrapolated spin gap of $\sim$ 1 $\mu$eV, obtained by density matrix renormalization group (DMRG) simulations in the thermodynamic limit. The consistency demonstrates the efficacy of tr-REXS in discerning low-energy spin gaps inaccessible to conventional spectroscopic techniques.


title: On the coincidence of the Hausdorff and box dimensions for some affine-invariant sets

abstract: Let $ K $ be a compact subset of the $d$-torus invariant under an expanding diagonal endomorphism with $ s $ distinct eigenvalues. Suppose the symbolic coding of $K$ satisfies weak specification. When $ s \leq 2 $, we prove that the following three statements are equivalent: (A) the Hausdorff and box dimensions of $ K $ coincide; (B) with respect to some gauge function, the Hausdorff measure of $ K $ is positive and finite; (C) the Hausdorff dimension of the measure of maximal entropy on $ K $ attains the Hausdorff dimension of $ K $. When $ s \geq 3 $, we find some examples in which (A) does not hold but (C) holds, which is a new phenomenon not appearing in the planar cases. Through a different probabilistic approach, we establish the equivalence of (A) and (B) for Bedford-McMullen sponges.


title: Asymptotic behavior toward viscous shock for impermeable wall and inflow problem of barotropic Navier-Stokes equations

abstract: We consider the compressible barotropic Navier-Stokes equations in a half-line and study the time-asymptotic behavior toward the outgoing viscous shock wave. Precisely, we consider the two boundary problems: impermeable wall and inflow problems, where the velocity at the boundary is given as a constant state. For both problems, when the asymptotic profile determined by the prescribed constant states at the boundary and far-fields is a viscous shock, we show that the solution asymptotically converges to the shifted viscous shock profiles uniformly in space, under the condition that initial perturbation is small enough in H1 norm. We do not impose the zero mass condition on initial data, which improves the previous results by Matsumura and Mei [20] for impermeable case, and by Huang, Matsumura and Shi [8] for inflow case. Moreover, for the inflow case, we remove the assumption in [8]. Our results are based on the method of a-contraction with shifts, as the first extension of the method to the boundary value problems.


title: OMP-Engineer: Bridging Syntax Analysis and In-Context Learning for Efficient Automated OpenMP Parallelization

abstract: In advancing parallel programming, particularly with OpenMP, the shift towards NLP-based methods marks a significant innovation beyond traditional S2S tools like Autopar and Cetus. These NLP approaches train on extensive datasets of examples to efficiently generate optimized parallel code, streamlining the development process. This method's strength lies in its ability to swiftly produce parallelized code that runs efficiently. However, this reliance on NLP models, without direct code analysis, can introduce inaccuracies, as these models might not fully grasp the nuanced semantics of the code they parallelize. We build OMP-Engineer, which balances the efficiency and scalability of NLP models with the accuracy and reliability of traditional methods, aiming to enhance the performance of automating parallelization while navigating its inherent challenges.


title: On the nonvanishing condition for $A_{\mathfrak q}(\lambda)$ of $U(p,q)$ in the mediocre range

abstract: The modules $A_\mathfrak{q}(\lambda)$ of $U(p,q)$ can be parameterized by their annihilators and asymptotic supports, both of which can be identified using Young tableaux. Trapa developed an algorithm for determining the tableaux of the modules $A_\mathfrak{q}(\lambda)$ in the mediocre range, along with an equivalent condition to determine non-vanishing. The condition involves a combinatorial concept called the overlap, which is not straightforward to compute. In this paper, we establish a formula for the overlap and simplify the condition for ease of use. We then apply it to $K$-types and the Dirac index of $A_\mathfrak{q}(\lambda)$.


title: PCG: Mitigating Conflict-based Cache Side-channel Attacks with Prefetching

abstract: To defend against conflict-based cache side-channel attacks, cache partitioning or remapping techniques were proposed to prevent set conflicts between different security domains or obfuscate the locations of such conflicts. But such techniques complicate cache design and may result in significant performance penalties. Therefore, there have been lightweight prefetching-based schemes proposed to introduce noise to confuse attackers' observation. However, we have validated experimentally that relying on prefetching to only introduce noise is insufficient, as attackers can still reliably distinguish the victim's cache accesses. This paper proposes a novel prefetching-based scheme, called PCG. It combines adding victim-irrelevant cache occupancy changes and reducing victim-relevant cache occupancy changes to disrupt attackers by generating noisy and indistinguishable cache access patterns. Additionally, PCG can either work independently or seamlessly be integrated with most of the commonly used prefetchers. We have implemented and evaluated PCG in both gem5 and the open-source RISC-V core BOOMv3. The evaluation results show the PCG's robust security superior to the existing solutions, while without resulting in significant performance degradation. According to the evaluation based on the SPEC CPU 2017 benchmark suite, PCG even shows an average performance improvement of about 1.64%. Moreover, it incurs only 1.26% overhead on hardware resource consumption.


title: Elevator, Escalator or Neither? Classifying Pedestrian Conveyor State Using Inertial Navigation System

abstract: Classifying a pedestrian in one of the three conveyor states of "elevator," "escalator" and "neither" is fundamental to many applications such as indoor localization and people flow analysis. We estimate, for the first time, the pedestrian conveyor state given the inertial navigation system (INS) readings of accelerometer, gyroscope and magnetometer sampled from the phone. Our problem is challenging because the INS signals of the conveyor state are coupled and perturbed by unpredictable arbitrary human actions, confusing the decision process. We propose ELESON, a novel, effective and lightweight INS-based deep learning approach to classify whether a pedestrian is in an elevator, escalator or neither. ELESON utilizes a motion feature extractor to decouple the conveyor state from human action in the feature space, and a magnetic feature extractor to account for the speed difference between elevator and escalator. Given the results of the extractors, it employs an evidential state classifier to estimate the confidence of the pedestrian states. Based on extensive experiments conducted on twenty hours of real pedestrian data, we demonstrate that ELESON outperforms significantly the state-of-the-art approaches (where combined INS signals of both the conveyor state and human actions are processed together), with 15% classification improvement in F1 score, stronger confidence discriminability with 10% increase in AUROC (Area Under the Receiver Operating Characteristics), and low computational and memory requirements on smartphones.