title: Our Deep CNN Face Matchers Have Developed Achromatopsia

abstract: Modern deep CNN face matchers are trained on datasets containing color images. We show that such matchers achieve essentially the same accuracy on the grayscale or the color version of a set of test images. We then consider possible causes for deep CNN face matchers ``not seeing color''. Popular web-scraped face datasets actually have 30 to 60\% of their identities with one or more grayscale images. We analyze whether this grayscale element in the training set impacts the accuracy achieved, and conclude that it does not. Further, we show that even with a 100\% grayscale training set, comparable accuracy is achieved on color or grayscale test images. Then we show that the skin region of an individual's images in a web-scraped training set exhibit significant variation in their mapping to color space. This suggests that color, at least for web-scraped, in-the-wild face datasets, carries limited identity-related information for training state-of-the-art matchers. Finally, we verify that comparable accuracy is achieved from training using single-channel grayscale images, implying that a larger dataset can be used within the same memory limit, with a less computationally intensive early layer.


title: Magnetospheric physics of magnetars

abstract: Several aspects of the magnetospheric physics of magnetars are summarized, including: GeV and hard X-ray emissions of magnetars, timing behaviors during magnetar outburst (soft X-ray observations), optical/IR observations of magnetars, radio emission of magnetars, and accreting magnetars. A unified picture for pulsars and magnetars are adopted, especially wind braking of magnetars, magnetar+ fallback disk systems, twisted dipole magnetic field, and accreting low magnetic field magnetars etc. It is pointed out that magnetars are related to a broad range of astrophysical phenomena.


title: Graph Matching in Correlated Stochastic Block Models for Improved Graph Clustering

abstract: We consider community detection from multiple correlated graphs sharing the same community structure. The correlated graphs are generated by independent subsampling of a parent graph sampled from the stochastic block model. The vertex correspondence between the correlated graphs is assumed to be unknown. We consider the two-step procedure where the vertex correspondence between the correlated graphs is first revealed, and the communities are recovered from the union of the correlated graphs, which becomes denser than each single graph. We derive the information-theoretic limits for exact graph matching in general density regimes and the number of communities, and then analyze the regime of graph parameters, where one can benefit from the matching of the correlated graphs in recovering the latent community structure of the graphs.


title: Data Summarization beyond Monotonicity: Non-monotone Two-Stage Submodular Maximization

abstract: The objective of a two-stage submodular maximization problem is to reduce the ground set using provided training functions that are submodular, with the aim of ensuring that optimizing new objective functions over the reduced ground set yields results comparable to those obtained over the original ground set. This problem has applications in various domains including data summarization. Existing studies often assume the monotonicity of the objective function, whereas our work pioneers the extension of this research to accommodate non-monotone submodular functions. We have introduced the first constant-factor approximation algorithms for this more general case.


title: SIM-Sync: From Certifiably Optimal Synchronization over the 3D Similarity Group to Scene Reconstruction with Learned Depth

abstract: This paper presents SIM-Sync, a certifiably optimal algorithm that estimates camera trajectory and 3D scene structure directly from multiview image keypoints. SIM-Sync fills the gap between pose graph optimization and bundle adjustment; the former admits efficient global optimization but requires relative pose measurements and the latter directly consumes image keypoints but is difficult to optimize globally (due to camera projective geometry). The bridge to this gap is a pretrained depth prediction network. Given a graph with nodes representing monocular images taken at unknown camera poses and edges containing pairwise image keypoint correspondences, SIM-Sync first uses a pretrained depth prediction network to lift the 2D keypoints into 3D scaled point clouds, where the scaling of the per-image point cloud is unknown due to the scale ambiguity in monocular depth prediction. SIM-Sync then seeks to synchronize jointly the unknown camera poses and scaling factors (i.e., over the 3D similarity group). The SIM-Sync formulation, despite nonconvex, allows designing an efficient certifiably optimal solver that is almost identical to the SE-Sync algorithm. We demonstrate the tightness, robustness, and practical usefulness of SIM-Sync in both simulated and real experiments. In simulation, we show (i) SIM-Sync compares favorably with SE-Sync in scale-free synchronization, and (ii) SIM-Sync can be used together with robust estimators to tolerate a high amount of outliers. In real experiments, we show (a) SIM-Sync achieves similar performance as Ceres on bundle adjustment datasets, and (b) SIM-Sync performs on par with ORB-SLAM3 on the TUM dataset with zero-shot depth prediction.


title: Convergence of Density Operators and Security of Discrete Modulated CVQKD Protocols

abstract: This communication deals with the problem of bounding the approximation error on weak convergence of mixed coherent state towards a Gaussian thermal state. In the context of CVQKD with discrete modulation, we develop expressions for two specific cases. The first one is the distance between the Gaussian equivalent bipartite state and a reference Gaussian modulated (GG02) and the second one is for the trace distance between the constellation and a thermal state with same photon number. Since, in the convex set of density operators, weak convergence implies convergence in the trace norm, knowing how fast the sequence gets close to the equivalent Gaussian state has implication on the security of QKD Protocols. Here we derive two bounds on the $L_1$ distance, one of them related with an energy test that can be used in the security proof.


title: HiLM-D: Towards High-Resolution Understanding in Multimodal Large Language Models for Autonomous Driving

abstract: Autonomous driving systems generally employ separate models for different tasks resulting in intricate designs. For the first time, we leverage singular multimodal large language models (MLLMs) to consolidate multiple autonomous driving tasks from videos, i.e., the Risk Object Localization and Intention and Suggestion Prediction (ROLISP) task. ROLISP uses natural language to simultaneously identify and interpret risk objects, understand ego-vehicle intentions, and provide motion suggestions, eliminating the necessity for task-specific architectures. However, lacking high-resolution (HR) information, existing MLLMs often miss small objects (e.g., traffic cones) and overly focus on salient ones (e.g., large trucks) when applied to ROLISP. We propose HiLM-D (Towards High-Resolution Understanding in MLLMs for Autonomous Driving), an efficient method to incorporate HR information into MLLMs for the ROLISP task. Especially, HiLM-D integrates two branches: (i) the low-resolution reasoning branch, can be any MLLMs, processes low-resolution videos to caption risk objects and discern ego-vehicle intentions/suggestions; (ii) the high-resolution perception branch (HR-PB), prominent to HiLM-D,, ingests HR images to enhance detection by capturing vision-specific HR feature maps and prioritizing all potential risks over merely salient objects. Our HR-PB serves as a plug-and-play module, seamlessly fitting into current MLLMs. Experiments on the ROLISP benchmark reveal HiLM-D's notable advantage over leading MLLMs, with improvements of 4.8% in BLEU-4 for captioning and 17.2% in mIoU for detection.


title: Haptic Guidance and Haptic Error Amplification in a Virtual Surgical Robotic Training Environment

abstract: Teleoperated robotic systems have introduced more intuitive control for minimally invasive surgery, but the optimal method for training remains unknown. Recent motor learning studies have demonstrated that exaggeration of errors helps trainees learn to perform tasks with greater speed and accuracy. We hypothesized that training in a force field that pushes the operator away from a desired path would improve their performance on a virtual reality ring-on-wire task. Forty surgical novices trained under a no-force, guidance, or error-amplifying force field over five days. Completion time, translational and rotational path error, and combined error-time were evaluated under no force field on the final day. The groups significantly differed in combined error-time, with the guidance group performing the worst. Error-amplifying field participants showed the most improvement and did not plateau in their performance during training, suggesting that learning was still ongoing. Guidance field participants had the worst performance on the final day, confirming the guidance hypothesis. Participants with high initial path error benefited more from guidance. Participants with high initial combined error-time benefited more from guidance and error-amplifying force field training. Our results suggest that error-amplifying and error-reducing haptic training for robot-assisted telesurgery benefits trainees of different abilities differently.


title: Quantitative Convergence Analysis of Path Integral Representations for Quantum Thermal Average

abstract: The quantum thermal average is a central topic in quantum physics and can be represented by the path integrals. For the computational perspective, the path integral representation (PIR) needs to be approximated in a finite-dimensional space, and the convergence of such approximation is termed as the convergence of the PIR. In this paper, we establish the Trotter product formula in the trace form, which connects the quantum thermal average and the Boltzmann distribution of a continuous loop in a rigorous way. We prove the qualitative convergence of the standard PIR, and obtain the explicit convergence rates of the continuous loop PIR. These results showcase various approaches to approximate the quantum thermal average, which provide theoretical guarantee for the path integral approaches of quantum thermal equilibrium systems, such as the path integral molecular dynamics.

categories: quant-ph cs.NA math-ph math.MP math.NA math.PR


title: Super-Eddington Accretion as a Possible Scenario to Form GW190425

abstract: On 2019 April 25, the LIGO/Virgo Scientific Collaboration detected a compact binary coalescence, GW190425. Under the assumption of the binary neutron star (BNS), the total mass of $3.4^{+0.3}_{-0.1}\, M_\odot$ lies five standard deviations away from the known Galactic population mean. In the standard common envelope scenario, the immediate progenitor of GW190425 is a close binary system composed of an NS and a He-rich star. With the detailed binary evolutionary modeling, we find that in order to reproduce GW190425-like events, super-Eddington accretion (e.g., $1,000\,\dot{M}_{\rm Edd}$) from a He-rich star onto the first-born NS with a typical mass of 1.33 $M_\odot$ via stable Case BB mass transfer (MT) is necessarily required. Furthermore, the immediate progenitors should potentially have an initial mass of $M_{\rm ZamsHe}$ in a range of $3.0-3.5$ $M_\odot$ and an initial orbital period of $P_{\rm init}$ from 0.08 days to 0.12 days, respectively. The corresponding mass accreted onto NSs via stable Case BB MT phase varies from $0.70\, M_\odot$ to $0.77\, M_\odot$. After the formation of the second-born NS, the BNSs are expected to be merged due to gravitational wave emission from $\sim$ 11 Myr to $\sim$ 190 Myr.


title: Asymptotic results for the Poisson distribution of order k

abstract: The Poisson distribution of order $k$ is a special case of a compound Poisson distribution. Its mean and variance are known, but results for its median and mode are difficult to obtain, although a few cases have been solved and upper/lower bounds for the mode have been established. This note points out that asymptotic results, for both the median and mode, exhibit simple patterns. The calculations are numerical, hence the results are presented as conjectures. The purpose of this note is to discern patterns for the median and mode, including expressions for exact limits and rates of convergence and (possibly sharp) upper/lower bounds, in a sense to be made precise in the text. The derivation of proofs of the results is left for future work.


title: Projective real calculi and Levi-Civita connections

abstract: Based on its central role in the framework of real calculi, the existence of the Levi-Civita connection for real calculi over projective modules is studied, with a special emphasis placed on the simple module of N-dimensional complex vectors over the algebra of complex N-by-N matrices. It is demonstrated that existence of the Levi-Civita connection in this case depends on the Lie algebra g of hermitian derivations, and necessary and sufficient conditions for the possibility of constructing a real calculus for which there exists a Levi-Civita connection are given in this case. Furthermore, in the general case of real calculi over projective modules, necessary and sufficient conditions for the existence of the Levi-Civita connection are given in terms of explicit projection coefficients.


title: Towards Viewpoint Robustness in Bird's Eye View Segmentation

abstract: Autonomous vehicles (AV) require that neural networks used for perception be robust to different viewpoints if they are to be deployed across many types of vehicles without the repeated cost of data collection and labeling for each. AV companies typically focus on collecting data from diverse scenarios and locations, but not camera rig configurations, due to cost. As a result, only a small number of rig variations exist across most fleets. In this paper, we study how AV perception models are affected by changes in camera viewpoint and propose a way to scale them across vehicle types without repeated data collection and labeling. Using bird's eye view (BEV) segmentation as a motivating task, we find through extensive experiments that existing perception models are surprisingly sensitive to changes in camera viewpoint. When trained with data from one camera rig, small changes to pitch, yaw, depth, or height of the camera at inference time lead to large drops in performance. We introduce a technique for novel view synthesis and use it to transform collected data to the viewpoint of target rigs, allowing us to train BEV segmentation models for diverse target rigs without any additional data collection or labeling cost. To analyze the impact of viewpoint changes, we leverage synthetic data to mitigate other gaps (content, ISP, etc). Our approach is then trained on real data and evaluated on synthetic data, enabling evaluation on diverse target rigs. We release all data for use in future work. Our method is able to recover an average of 14.7% of the IoU that is otherwise lost when deploying to new rigs.


title: Nonlocal elliptic and parabolic equations with general stable operators in weighted Sobolev spaces

abstract: We study nonlocal elliptic and parabolic equations on $C^{1,\tau}$ open sets in weighted Sobolev spaces, where $\tau\in (0,1)$. The operators we consider are infinitesimal generators of symmetric stable L\'evy processes, whose L\'evy measures are allowed to be very singular. Additionally, for parabolic equations, the measures are assumed to be merely measurable in the time variable.


title: Numerical study on mechanism of C-J deflagration

abstract: The mechanism of detonation instability and deflagration-to-detonation transition is studied by one-dimensional numerical simulation with overall one-step chemical reaction kinetics in this paper. The detonation is ignited at the left closed end of the one-dimensional detonation tube and propagates downstream. The activation energy is increased to trigger the instability of detonation. The numerical results show that the C-J detonation is stable at lower activation energy. The stable detonation does not have the von Neumann spike and the gas Mach number at detonation front is subsonic. The von Neumann spike appears and the gas Mach number becomes supersonic as the activation energy is increased. The detonation instability appears with the von Neumann spike synchronously. At very higher activation energy, the detonation quenches abruptly and degenerates into a C-J deflagration. The detonation is extinguished abruptly by the rarefaction wave induced by the higher von Neumann spike. Then the rarefaction wave moves in front of the heat release region and weakens the leading shock wave gradually. The C-J deflagration is composed of a precursor shock wave and a flame front, and the flame front is completely decoupled from the shock wave. The gas static temperature behind the leading shock wave is too low to ignite the mixture. The rarefaction wave from the wall ceases the mixture behind the leading shock, increases its static temperature and decrease its pressure. As a result, the combustion takes place at the interface. The pressure rise caused by the combustion at the interface offsets the influence of rarefaction wave, and this mechanism makes the C-J deflagration propagate downstream with a relatively constant velocity for a long time.


title: Cloud-mediated self-triggered synchronization of a general linear multi-agent system over a directed graph

abstract: This paper proposes a self-triggered synchronization control method of a general high-order linear time-invariant multi-agent system through a cloud repository. In the cloud-mediated self-triggered control, each agent asynchronously accesses the cloud repository to get past information on its neighboring agents. Then, the agent predicts future behaviors of its neighbors as well as of its own, and locally determines its next access time to the cloud repository. In the case of a general high-order linear agent dynamics, each agent has to estimate exponential evolution of its trajectory characterized by eigenvalues of a system matrix, which is different from single/double integrator or first-order linear agents. Our proposed method deals with exponential behaviors of the agents by tightly evaluating the bounds on matrix exponentials. Based on these bound, we design the self-triggered controller through a cloud which achieves bounded state synchronization of the closed-loop system without exhibiting any Zeno behaviors. The effectiveness of the proposed method is demonstrated through the numerical simulation.


title: Does Writing with Language Models Reduce Content Diversity?

abstract: Large language models (LLMs) have led to a surge in collaborative writing with model assistance. As different users incorporate suggestions from the same model, there is a risk of decreased diversity in the produced content, potentially limiting diverse perspectives in public discourse. In this work, we measure the impact of co-writing on diversity via a controlled experiment, where users write argumentative essays in three setups -- using a base LLM (GPT3), a feedback-tuned LLM (InstructGPT), and writing without model help. We develop a set of diversity metrics and find that writing with InstructGPT (but not the GPT3) results in a statistically significant reduction in diversity. Specifically, it increases the similarity between the writings of different authors and reduces the overall lexical and content diversity. We additionally find that this effect is mainly attributable to InstructGPT contributing less diverse text to co-written essays. In contrast, the user-contributed text remains unaffected by model collaboration. This suggests that the recent improvement in generation quality from adapting models to human feedback might come at the cost of more homogeneous and less diverse content.


title: Learning Sequential Acquisition Policies for Robot-Assisted Feeding

abstract: A robot providing mealtime assistance must perform specialized maneuvers with various utensils in order to pick up and feed a range of food items. Beyond these dexterous low-level skills, an assistive robot must also plan these strategies in sequence over a long horizon to clear a plate and complete a meal. Previous methods in robot-assisted feeding introduce highly specialized primitives for food handling without a means to compose them together. Meanwhile, existing approaches to long-horizon manipulation lack the flexibility to embed highly specialized primitives into their frameworks. We propose Visual Action Planning OveR Sequences (VAPORS), a framework for long-horizon food acquisition. VAPORS learns a policy for high-level action selection by leveraging learned latent plate dynamics in simulation. To carry out sequential plans in the real world, VAPORS delegates action execution to visually parameterized primitives. We validate our approach on complex real-world acquisition trials involving noodle acquisition and bimanual scooping of jelly beans. Across 38 plates, VAPORS acquires much more efficiently than baselines, generalizes across realistic plate variations such as toppings and sauces, and qualitatively appeals to user feeding preferences in a survey conducted across 49 individuals. Code, datasets, videos, and supplementary materials can be found on our website: https://sites.google.com/view/vaporsbot.


title: Dissipative Instability of Magnetohydrodynamic Sausage Waves in a Compressional Cylindrical Plasma: Effect of Flow Shear and Viscosity Shear

abstract: The shear flow influences the stability of magnetohydrodynamic (MHD) waves. In the presence of a dissipation mechanism, flow shear may induce a MHD wave instability below the threshold of the Kelvin-Helmholtz instability (KHI), which is called dissipative instability (DI). This phenomenon is also called negative energy wave instability (NEWI) because it is closely related to the backward wave which has negative wave energy. Considering viscosity as a dissipation mechanism, we derive an analytical dispersion relation for the slow sausage modes in a straight cylinder with a discontinuous boundary. It is assumed that the steady flow is inside and dynamic and bulk viscosities are outside the circular flux tube under photospheric condition. When the two viscosities are weak, it is found that for the slow surface mode, the growth rate is proportional to the axial wavenumber and flow shear, consistent with in the incompressible limit. For a slow body mode, the growth rate has a peak at certain axial wavenumber and its order of magnitude is similar to surface mode. The linear relationship between the growth rate and the dynamic viscosity established in the incompressible limit develops nonlinearly when the flow shear and/or the two viscosities are sufficiently strong.


title: A Note Related to Graph Theory

abstract: This article foucuses on $(P_3\cup P_2,K_4)$-free graph. In this paper, we prove that if G is $(P_3\cup P_2,K_4)$-free, then $\chi(G)\le 7$. We then use our result to obtain the upper bound of order and chromatic number of $(4K_1,\overline{P_3\cup P_2},K_{\omega})$-free graph .


title: CARE: Confidence-rich Autonomous Robot Exploration using Bayesian Kernel Inference and Optimization

abstract: In this paper, we consider improving the efficiency of information-based autonomous robot exploration in unknown and complex environments. We first utilize Gaussian process (GP) regression to learn a surrogate model to infer the confidence-rich mutual information (CRMI) of querying control actions, then adopt an objective function consisting of predicted CRMI values and prediction uncertainties to conduct Bayesian optimization (BO), i.e., GP-based BO (GPBO). The trade-off between the best action with the highest CRMI value (exploitation) and the action with high prediction variance (exploration) can be realized. To further improve the efficiency of GPBO, we propose a novel lightweight information gain inference method based on Bayesian kernel inference and optimization (BKIO), achieving an approximate logarithmic complexity without the need for training. BKIO can also infer the CRMI and generate the best action using BO with bounded cumulative regret, which ensures its comparable accuracy to GPBO with much higher efficiency. Extensive numerical and real-world experiments show the desired efficiency of our proposed methods without losing exploration performance in different unstructured, cluttered environments. We also provide our open-source implementation code at https://github.com/Shepherd-Gregory/BKIO-Exploration.


title: Two is Better Than One: Answering Complex Questions by Multiple Knowledge Sources with Generalized Links

abstract: Incorporating multiple knowledge sources is proven to be beneficial for answering complex factoid questions. To utilize multiple knowledge bases (KB), previous works merge all KBs into a single graph via entity alignment and reduce the problem to question-answering (QA) over the fused KB. In reality, various link relations between KBs might be adopted in QA over multi-KBs. In addition to the identity between the alignable entities (i.e. full link), unalignable entities expressing the different aspects or types of an abstract concept may also be treated identical in a question (i.e. partial link). Hence, the KB fusion in prior works fails to represent all types of links, restricting their ability to comprehend multi-KBs for QA. In this work, we formulate the novel Multi-KB-QA task that leverages the full and partial links among multiple KBs to derive correct answers, a benchmark with diversified link and query types is also constructed to efficiently evaluate Multi-KB-QA performance. Finally, we propose a method for Multi-KB-QA that encodes all link relations in the KB embedding to score and rank candidate answers. Experiments show that our method markedly surpasses conventional KB-QA systems in Multi-KB-QA, justifying the necessity of devising this task.


title: Graph-Aware Contrasting for Multivariate Time-Series Classification

abstract: Contrastive learning, as a self-supervised learning paradigm, becomes popular for Multivariate Time-Series (MTS) classification. It ensures the consistency across different views of unlabeled samples and then learns effective representations for these samples. Existing contrastive learning methods mainly focus on achieving temporal consistency with temporal augmentation and contrasting techniques, aiming to preserve temporal patterns against perturbations for MTS data. However, they overlook spatial consistency that requires the stability of individual sensors and their correlations. As MTS data typically originate from multiple sensors, ensuring spatial consistency becomes essential for the overall performance of contrastive learning on MTS data. Thus, we propose Graph-Aware Contrasting for spatial consistency across MTS data. Specifically, we propose graph augmentations including node and edge augmentations to preserve the stability of sensors and their correlations, followed by graph contrasting with both node- and graph-level contrasting to extract robust sensor- and global-level features. We further introduce multi-window temporal contrasting to ensure temporal consistency in the data for each sensor. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on various MTS classification tasks. The code is available at https://github.com/Frank-Wang-oss/TS-GAC.


title: From Artificially Real to Real: Leveraging Pseudo Data from Large Language Models for Low-Resource Molecule Discovery

abstract: Molecule discovery serves as a cornerstone in numerous scientific domains, fueling the development of new materials and innovative drug designs. Recent developments of in-silico molecule discovery have highlighted the promising results of cross-modal techniques, which bridge molecular structures with their descriptive annotations. However, these cross-modal methods frequently encounter the issue of data scarcity, hampering their performance and application. In this paper, we address the low-resource challenge by utilizing artificially-real data generated by Large Language Models (LLMs). We first introduce a retrieval-based prompting strategy to construct high-quality pseudo data, then explore the optimal method to effectively leverage this pseudo data. Experiments show that using pseudo data for domain adaptation outperforms all existing methods, while also requiring a smaller model scale, reduced data size and lower training cost, highlighting its efficiency. Furthermore, our method shows a sustained improvement as the volume of pseudo data increases, revealing the great potential of pseudo data in advancing low-resource cross-modal molecule discovery. Our code and data are available at https://github.com/SCIR-HI/ArtificiallyR2R.


title: Accelerated Proximal Iterative re-Weighted $\ell_1$ Alternating Minimization for Image Deblurring

abstract: The quadratic penalty alternating minimization (AM) method is widely used for solving the convex $\ell_1$ total variation (TV) image deblurring problem. However, quadratic penalty AM for solving the nonconvex nonsmooth $\ell_p$, $0 < p < 1$ TV image deblurring problems is less studied. In this paper, we propose two algorithms, namely proximal iterative re-weighted $\ell_1$ AM (PIRL1-AM) and its accelerated version, accelerated proximal iterative re-weighted $\ell_1$ AM (APIRL1-AM) for solving the nonconvex nonsmooth $\ell_p$ TV image deblurring problem. The proposed algorithms are derived from the proximal iterative re-weighted $\ell_1$ (IRL1) algorithm and the proximal gradient algorithm. Numerical results show that PIRL1-AM is effective in retaining sharp edges in image deblurring while APIRL1-AM can further provide convergence speed up in terms of the number of algorithm iterations and computational time.


title: A Review of the Applications of Quantum Machine Learning in Optical Communication Systems

abstract: In the context of optical signal processing, quantum and quantum-inspired machine learning algorithms have massive potential for deployment. One of the applications is in error correction protocols for the received noisy signals. In some scenarios, non-linear and unknown errors can lead to noise that bypasses linear error correction protocols that optical receivers generally implement. In those cases, machine learning techniques are used to recover the transmitted signal from the received signal through various estimation procedures. Since quantum machine learning algorithms promise advantage over classical algorithms, we expect that optical signal processing can benefit from these advantages. In this review, we survey several proposed quantum and quantum-inspired machine learning algorithms and their applicability with current technology to optical signal processing.


title: Influence Maximization in Ising Models

abstract: Given a complex high-dimensional distribution over $\{\pm 1\}^n$, what is the best way to increase the expected number of $+1$'s by controlling the values of only a small number of variables? Such a problem is known as influence maximization and has been widely studied in social networks, biology, and computer science. In this paper, we consider influence maximization on the Ising model which is a prototypical example of undirected graphical models and has wide applications in many real-world problems. We establish a sharp computational phase transition for influence maximization on sparse Ising models under a bounded budget: In the high-temperature regime, we give a linear-time algorithm for finding a small subset of variables and their values which achieve nearly optimal influence; In the low-temperature regime, we show that the influence maximization problem cannot be solved in polynomial time under commonly-believed complexity assumption. The critical temperature coincides with the tree uniqueness/non-uniqueness threshold for Ising models which is also a critical point for other computational problems including approximate sampling and counting.


title: Insights into the Energy Transfers in Hydrodynamic Turbulence Using Field-theoretic Tools

abstract: Turbulent flows exhibit intriguing energy transfers. In this paper, we compute the renormalized viscosities, mode-to-mode energy transfers, energy fluxes, and shell-to-shell energy transfers for the two-dimensional (2D) and three-dimensional (3D) hydrodynamic turbulence (HDT) using field-theoretic methods. We employ Craya-Herring basis that provides separate renormalized viscosities and energy transfers for its two components. In addition, Craya-Herring basis eliminates complex tensor algebra and simplifies the calculations considerably. In the $k^{-5/3}$ spectral regime of 2D HDT, the energy transfers between neighbouring (local) wavenumbers are forward, but they are backwards for distant (nonlocal) wavenumbers. The individual transfers between the distant wavenumber shells are small, but their cumulative sum is significant and it overcomes the forward local transfer to yield a constant inverse energy cascade. For 3D HDT, the mode-to-mode and shell-to-shell energy transfers reveal forward energy transfers for both local and nonlocal wavenumbers. More importantly, using scale-by-scale energy transfers we show that the cumulative nonlocal and local energy transfers are of the same order, which is contrary to the assumption of local energy transfers in turbulence. For 3D HDT, the renormalized viscosity, $\nu_2(k)$, computed by us and other authors are in general agreement, and it varies as $k^{-4/3}$. For 2D HDT, our the renormalized viscosity, $\nu_1(k)>0$, but $\nu_1(k)$ reported in literature shows significant variations including a negative $\nu_1(k)$. In this paper, we argue that the inconsistencies in $\nu_1(k)$ indicate inadequacy of renormalization group analysis that takes into account only local interactions and excludes nonlocal ones. In 2D HDT, the opposing nature of local and nonlocal energy transfers amplifies the error in $\nu_1(k)$.

categories: physics.flu-dyn cond-mat.stat-mech hep-th nlin.CD


title: Quaternion MLP Neural Networks Based on the Maximum Correntropy Criterion

abstract: We propose a gradient ascent algorithm for quaternion multilayer perceptron (MLP) networks based on the cost function of the maximum correntropy criterion (MCC). In the algorithm, we use the split quaternion activation function based on the generalized Hamilton-real quaternion gradient. By introducing a new quaternion operator, we first rewrite the early quaternion single layer perceptron algorithm. Secondly, we propose a gradient descent algorithm for quaternion multilayer perceptron based on the cost function of the mean square error (MSE). Finally, the MSE algorithm is extended to the MCC algorithm. Simulations show the feasibility of the proposed method.


title: Phase-Specific Augmented Reality Guidance for Microscopic Cataract Surgery Using Long-Short Spatiotemporal Aggregation Transformer

abstract: Phacoemulsification cataract surgery (PCS) is a routine procedure conducted using a surgical microscope, heavily reliant on the skill of the ophthalmologist. While existing PCS guidance systems extract valuable information from surgical microscopic videos to enhance intraoperative proficiency, they suffer from non-phasespecific guidance, leading to redundant visual information. In this study, our major contribution is the development of a novel phase-specific augmented reality (AR) guidance system, which offers tailored AR information corresponding to the recognized surgical phase. Leveraging the inherent quasi-standardized nature of PCS procedures, we propose a two-stage surgical microscopic video recognition network. In the first stage, we implement a multi-task learning structure to segment the surgical limbus region and extract limbus region-focused spatial feature for each frame. In the second stage, we propose the long-short spatiotemporal aggregation transformer (LS-SAT) network to model local fine-grained and global temporal relationships, and combine the extracted spatial features to recognize the current surgical phase. Additionally, we collaborate closely with ophthalmologists to design AR visual cues by utilizing techniques such as limbus ellipse fitting and regional restricted normal cross-correlation rotation computation. We evaluated the network on publicly available and in-house datasets, with comparison results demonstrating its superior performance compared to related works. Ablation results further validated the effectiveness of the limbus region-focused spatial feature extractor and the combination of temporal features. Furthermore, the developed system was evaluated in a clinical setup, with results indicating remarkable accuracy and real-time performance. underscoring its potential for clinical applications.


title: Understanding the Impact of Post-Training Quantization on Large Language Models

abstract: Large language models (LLMs) are rapidly increasing in size, with the number of parameters becoming a key factor in the success of many commercial models, such as ChatGPT, Claude, and Bard. Even the recently released publicly accessible models for commercial usage, such as Falcon and Llama2, come equipped with billions of parameters. This significant increase in the number of parameters makes deployment and operation very costly. The remarkable progress in the field of quantization for large neural networks in general and LLMs in particular, has made these models more accessible by enabling them to be deployed on consumer-grade GPUs. Quantized models generally demonstrate comparable performance levels to their unquantized base counterparts. Nonetheless, there exists a notable gap in our comprehensive understanding of how these quantized models respond to hyperparameters, such as temperature, max new tokens, and topk, particularly for next word prediction. The present analysis reveals that nf4 and fp4 are equally proficient 4-bit quantization techniques, characterized by similar attributes such as inference speed, memory consumption, and the quality of generated content. the study identifies nf4 as displaying greater resilience to temperature variations in the case of the llama2 series of models at lower temperature, while fp4 and fp4-dq proves to be a more suitable choice for falcon series of models. It is noteworthy that, in general, 4-bit quantized models of varying sizes exhibit higher sensitivity to temperature in the range of 0.5 to 0.8, unlike their unquantized counterparts. Additionally, int8 quantization is associated with significantly slower inference speeds, whereas unquantized bfloat16 models consistently yield the fastest inference speeds across models of all sizes.


title: On Quaternion Higher-Order Singular Value Decomposition: Models and Analysis

abstract: Higher-order singular value decomposition (HOSVD) is one of the most celebrated tensor decompositions that generalizes matrix SVD to higher-order tensors. It was recently extended to the quaternion domain \cite{miao2023quat} (we refer to it as L-QHOSVD in this work). However, due to the non-commutativity of quaternion multiplications, L-QHOSVD is not consistent with matrix SVD when the order of the quaternion tensor reduces to 2; moreover, theoretical guaranteed truncated L-QHOSVD was not investigated. To derive a more natural higher-order generalization of the quaternion matrix SVD, we first utilize the feature that left and right multiplications of quaternions are inconsistent to define left and right quaternion tensor unfoldings and left and right mode-k products. Then, by using these basic tools, we propose a two-sided quaternion higher-order singular value decomposition (TS-QHOSVD). TS-QHOSVD has the following two main features: 1) it computes two factor matrices at a time from SVDs of left and right unfoldings, inheriting certain parallel properties of the original HOSVD; 2) it is consistent with matrix SVD when the order of the tensor is 2. In addition, we study truncated TS-QHOSVD and establish its error bound measured by the tail energy; correspondingly, we also present truncated L-QHOSVD and its error bound. Deriving the error bounds is nontrivial, as the proofs are more complicated than their real counterparts, again due to the non-commutativity of quaternion multiplications. Finally, we illustrate the derived properties of TS-QHOSVD and its efficacy via some numerical examples.


title: Extended Josephson junction qubit system

abstract: Circuit quantum electrodynamics (QED) has emerged as a promising platform for implementing quantum computation and simulation. Typically, junctions in these systems are of a sufficiently small size, such that only the lowest plasma oscillation is relevant. The interplay between the Josephson effect and charging energy renders this mode nonlinear, forming the basis of a qubit. In this work, we introduce a novel QED architecture based on extended Josephson Junctions (JJs), which possess a non-negligible spatial extent. We present a comprehensive microscopic analysis and demonstrate that each extended junction can host multiple nonlinear plasmon modes, effectively functioning as a multi-qubit interacting system, in contrast to conventional JJs. Furthermore, the phase modes exhibit distinct spatial profiles, enabling individual addressing through frequency-momentum selective coupling to photons. Our platform has potential applications in quantum computation, specifically in implementing single- and two-qubit gates within a single junction. We also investigate a setup comprising several driven extended junctions interacting via a multimode electromagnetic waveguide. This configuration serves as a powerful platform for simulating the generalized Bose-Hubbard model, as the photon-mediated coupling between junctions can create a lattice in both real and synthetic dimensions. This allows for the exploration of novel quantum phenomena, such as topological phases of interacting many-body systems.


title: Towards Federated Learning Under Resource Constraints via Layer-wise Training and Depth Dropout

abstract: Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across many clients. However, federated learning can be difficult to scale to large models when clients have limited resources. This challenge often results in a trade-off between model size and access to diverse data. To mitigate this issue and facilitate training of large models on edge devices, we introduce a simple yet effective strategy, Federated Layer-wise Learning, to simultaneously reduce per-client memory, computation, and communication costs. Clients train just a single layer each round, reducing resource costs considerably with minimal performance degradation. We also introduce Federated Depth Dropout, a complementary technique that randomly drops frozen layers during training, to further reduce resource usage. Coupling these two techniques enables us to effectively train significantly larger models on edge devices. Specifically, we reduce training memory usage by 5x or more in federated self-supervised representation learning and demonstrate that performance in downstream tasks is comparable to conventional federated self-supervised learning.


title: Angle Range and Identity Similarity Enhanced Gaze and Head Redirection based on Synthetic data

abstract: In this paper, we propose a method for improving the angular accuracy and photo-reality of gaze and head redirection in full-face images. The problem with current models is that they cannot handle redirection at large angles, and this limitation mainly comes from the lack of training data. To resolve this problem, we create data augmentation by monocular 3D face reconstruction to extend the head pose and gaze range of the real data, which allows the model to handle a wider redirection range. In addition to the main focus on data augmentation, we also propose a framework with better image quality and identity preservation of unseen subjects even training with synthetic data. Experiments show that our method significantly improves redirection performance in terms of redirection angular accuracy while maintaining high image quality, especially when redirecting to large angles.


title: A discrete uniformization theorem for decorated piecewise Euclidean metrics on surfaces

abstract: In this paper, we introduce a new discretization of the Gaussian curvature on surfaces, which is defined as the quotient of the angle defect and the area of some dual cell of a weighted triangulation at the conic singularity. A discrete uniformization theorem for this discrete Gaussian curvature is established on surfaces with non-positive Euler number. The main tools are Bobenko-Lutz's discrete conformal theory for decorated piecewise Euclidean metrics on surfaces and variational principles with constraints.


title: 2-derivators

abstract: Introduced independently by Grothendieck and Heller in the 1980s, derivators provide a formal way to study homotopy theories by working in some quotient category such as the homotopy category of a model category. In 2015 Riehl and Verity introduced $\infty$-cosmoi, which are particular $(\infty,2)$-categories where one can develop $(\infty,1)$-category theory in a synthetic way. They noticed that much of the theory of $\infty$-cosmoi can be developed inside a quotient, the homotopy $2$-category. In the following, we begin a program that aims to formalise the $\infty$-cosmological approach to $\infty$-category theory in a derivator-like framework. In this paper we introduce some axioms and demonstrate they hold in a variety of models, including common models related to $\infty$-category theory. We also prove that these axioms are stable under a particular shift operation.


title: Quantifying and Attributing the Hallucination of Large Language Models via Association Analysis

abstract: Although demonstrating superb performance on various NLP tasks, large language models (LLMs) still suffer from the hallucination problem, which threatens the reliability of LLMs. To measure the level of hallucination of LLMs, previous works first categorize the hallucination according to the phenomenon similarity, then quantify the proportion that model outputs contain hallucinatory contents. However, such hallucination rates could easily be distorted by confounders. Moreover, such hallucination rates could not reflect the reasons for the hallucination, as similar hallucinatory phenomena may originate from different sources. To address these issues, we propose to combine the hallucination level quantification and hallucination reason investigation through an association analysis, which builds the relationship between the hallucination rate of LLMs with a set of risk factors. In this way, we are able to observe the hallucination level under each value of each risk factor, examining the contribution and statistical significance of each risk factor, meanwhile excluding the confounding effect of other factors. Additionally, by recognizing the risk factors according to a taxonomy of model capability, we reveal a set of potential deficiencies in commonsense memorization, relational reasoning, and instruction following, which may further provide guidance for the pretraining and supervised fine-tuning process of LLMs to mitigate the hallucination.


title: Constrained Correlated Equilibria

abstract: This paper introduces constrained correlated equilibrium, a solution concept combining correlation and coupled constraints in finite non-cooperative games. In the general case of an arbitrary correlation device and coupled constraints in the extended game, we study the conditions for equilibrium. In the particular case of constraints induced by a feasible set of probability distributions over action profiles, we first show that canonical correlation devices are sufficient to characterize the set of constrained correlated equilibrium distributions and provide conditions of their existence. Second, it is shown that constrained correlated equilibria of the mixed extension of the game do not lead to additional equilibrium distributions. Third, we show that the constrained correlated equilibrium distributions may not belong to the polytope of correlated equilibrium distributions. Finally, we illustrate these results through numerical examples.


title: Valley splitting by extended zone effective mass approximation incorporating strain in silicon

abstract: Silicon metal-oxide-semiconductor field effect transistors (MOSFETs) fabricated on a SIMOX (001) substrate, which is a kind of silicon on insulator (SOI) substrate, that is annealed at high temperature for a long time are known to exhibit large valley splitting, but the origin of this splitting has long been unknown. Extended zone effective-mass approximation (EMA) predicts that strain significantly affects valley splitting. In this study, we analyzed valley splitting based on this theory and found that the shear strain along <110> of approximately 5% near the buried oxide (BOX) interface is a promising source for large valley splitting.


title: Revisiting 3D Flat Holography: Causality Structure and Modular flow

abstract: Flat space holography is an open and hard problem existing several different approaches, which may finally turn out to be consistent with each other, in the literature to tackle it. Focusing on how bulk emergent spacetime is encoded in quantum information of null boundaries, we choose a specific toy model called the flat$_3$/BMSFT model, which conjectures the duality between boundary BMS$_3$ invariant field theory and bulk quantum gravity in 3D asymptotic flat spacetimes (AFS), to explore. Aiming to find an entanglement wedge like quantity for single interval and a connected entanglement wedge for multi-intervals in flat$_3$/BMSFT model, we explore the bulk causality structures related to the holographic swing surface proposal through both boundary and bulk local modular flow, make a corresponding decomposition of the global Minkowski spacetime and look at the entanglement phase transition. As a byproduct, we solve the problem about the existence of partial entanglement entropy (PEE) correspondence in this model which is a bit nontrivial due to the unusual behavior of boundary modular flow in BMS$_3$ field theory. Among the literature considering quantum information aspects of flat$_3$/BMSFT model, there are several substantial, unusual but overlooked phenomena which need to be emphasized and revisited to gain more deserved attention. Thus another motivation of this paper is to find where these unusual phenomena come from, and physically show in a manifest way what they may imply. After reading we hope readers can feel sincerely what we present about the above mentioned second aim is more valuable than the mathematical results in the present paper.


title: Exploring the Law of Numbers: Evidence from China's Real Estate

abstract: The renowned proverb, Numbers do not lie, underscores the reliability and insight that lie beneath numbers, a concept of undisputed importance, especially in economics and finance etc. Despite the prosperity of Benford's Law in the first digit analysis, its scope fails to remain comprehensiveness when it comes to deciphering the laws of number. This paper delves into number laws by taking the financial statements of China real estate as a representative, quantitatively study not only the first digit, but also depict the other two dimensions of numbers: frequency and length. The research outcomes transcend mere reservations about data manipulation and open the door to discussions surrounding number diversity and the delineation of the usage insights. This study wields both economic significance and the capacity to foster a deeper comprehension of numerical phenomena.


title: Facilitating Practical Fault-tolerant Quantum Computing Based on Color Codes

abstract: Color code is a promising topological code for fault-tolerant quantum computing. Insufficient research on the color code has delayed its practical application. In this work, we address several key issues to facilitate practical fault-tolerant quantum computing based on color codes. First, by introducing decoding graphs with error-rate-related weights, we obtained the threshold of $0.47\%$ of the 6,6,6 triangular color code under the standard circuit-level noise model, narrowing the gap to that of the surface code. Second, our work firstly investigates the circuit-level decoding of color code lattice surgery, and gives an efficient decoding algorithm, which is crucial for performing logical operations in a quantum computer with two-dimensional architectures. Lastly, a new state injection protocol of the triangular color code is proposed, reducing the output magic state error rate in one round of 15 to 1 distillation by two orders of magnitude compared to a previous rough protocol. We have also proven that our protocol offers the lowest logical error rates for state injection among all possible CSS codes.


title: Relation between spectral indices and binary fractions in GCs

abstract: Context. We study the relation between the known binary fraction and spectral absorption feature index to judge whether (and potentially which) spectral absorption feature indices are suitable for determining the binary fraction. Aims. The determination of the binary fraction is important in studies of binary star formation, evolutionary population synthesis models, and other works. The number of binary stars is difficult to determine for nearly all stellar systems because the individual stars are need to be resolved photometrically or spectroscopically. By comparison, their integrated spectra or spectral absorption feature indices are relatively easy to obtain. Results. We find that the low-resolution (15\,\AA) spectrum is not suitable for this study and the binary fraction type would affect the results: $f$($q$>0.5) and $f$(tot)$^{\rm mc}$ exhibit better correlations with the spectral absorption feature index than $f$(tot)$^{\rm mf}$ and the difference in metallicity would significantly affect the above relationship. % Finally, to eliminate the effects of metallicity, age, and dynamical evolution, we only used those GCs with multiple spectra observed among different regions. % We find that OIII-1, OIII-2, H$_{\rm \gamma F}$, H$_{\rm \delta F}$, H$_{\rm \gamma A}$, H$_{\rm \delta A}$, H$_{\rm \beta}$, Ca4455, C$_2$4668, and TiO$_1$ indices have strong correlations with binary fraction. % The two OIII indices are the most sensitive to the binary fraction, followed by four Balmer indices -- the two narrower central bandpass Balmer indices ($\sim$20\AA, F-definition) are more sensitive than the wider two ($\sim$40\AA, A-definition) and, lastly, the Ca4455, C$_2$4668, and TiO$_1$ indices.


title: SparseSwin: Swin Transformer with Sparse Transformer Block

abstract: Advancements in computer vision research have put transformer architecture as the state of the art in computer vision tasks. One of the known drawbacks of the transformer architecture is the high number of parameters, this can lead to a more complex and inefficient algorithm. This paper aims to reduce the number of parameters and in turn, made the transformer more efficient. We present Sparse Transformer (SparTa) Block, a modified transformer block with an addition of a sparse token converter that reduces the number of tokens used. We use the SparTa Block inside the Swin T architecture (SparseSwin) to leverage Swin capability to downsample its input and reduce the number of initial tokens to be calculated. The proposed SparseSwin model outperforms other state of the art models in image classification with an accuracy of 86.96%, 97.43%, and 85.35% on the ImageNet100, CIFAR10, and CIFAR100 datasets respectively. Despite its fewer parameters, the result highlights the potential of a transformer architecture using a sparse token converter with a limited number of tokens to optimize the use of the transformer and improve its performance.


title: Topological sequence entropy of nonautonomous dynamical systems

abstract: Let $f_{0,\infty}=\{f_n\}_{n=0}^{\infty}$ be a sequence of continuous self-maps on a compact metric space $X$. Firstly, we obtain the relations between topological sequence entropy of a nonautonomous dynamical system $(X,f_{0,\infty})$ and that of its finite-to-one extension. We then prove that the topological sequence entropy of $(X,f_{0,\infty})$ is no less than its corresponding measure sequence entropy if $X$ has finite covering dimension. Secondly, we study the supremum topological sequence entropy of $(X,f_{0,\infty})$, and confirm that it equals to that of its $n$-th compositions system if $f_{0,\infty}$ is equi-continuous; and we prove the supremum topological sequence entropy of $(X,f_{i,\infty})$ is no larger than that of $(X,f_{j,\infty})$ if $i\leq j$, and they are equal if $f_{0,\infty}$ is equi-continuous and surjective. Thirdly, we investigate the topological sequence entropy relations between $(X,f_{0,\infty})$ and $(\mathcal{M}(X),\hat{f}_{0,\infty})$ induced on the space $\mathcal{M}(X)$ of all Borel probability measures, and obtain that given any sequence, the topological sequence entropy of $(X,f_{0,\infty})$ is zero if and only if that of $(\mathcal{M}(X),\hat{f}_{0,\infty})$ is zero; the topological sequence entropy of $(X,f_{0,\infty})$ is positive if and only if that of $(\mathcal{M}(X),\hat{f}_{0,\infty})$ is infinite. By applying this result, we obtain some big differences between entropies of nonautonomous dynamical systems and that of autonomous dynamical systems. Finally, we study whether multi-sensitivity of $(X,f_{0,\infty})$ imply positive or infinite topological sequence entropy.


title: Joint Beamforming and Compression Design for Per-Antenna Power Constrained Cooperative Cellular Networks

abstract: In the cooperative cellular network, relay-like base stations are connected to the central processor (CP) via rate-limited fronthaul links and the joint processing is performed at the CP, which thus can effectively mitigate the multiuser interference. In this paper, we consider the joint beamforming and compression problem with per-antenna power constraints in the cooperative cellular network. We first establish the equivalence between the considered problem and its semidefinite relaxation (SDR). Then we further derive the partial Lagrangian dual of the SDR problem and show that the objective function of the obtained dual problem is differentiable. Based on the differentiability, we propose two efficient projected gradient ascent algorithms for solving the dual problem, which are projected exact gradient ascent (PEGA) and projected inexact gradient ascent (PIGA). While PEGA is guaranteed to find the global solution of the dual problem (and hence the global solution of the original problem), PIGA is more computationally efficient due to the lower complexity in inexactly computing the gradient. Global optimality and high efficiency of the proposed algorithms are demonstrated via numerical experiments.


title: Detecting Natural Language Biases with Prompt-based Learning

abstract: In this project, we want to explore the newly emerging field of prompt engineering and apply it to the downstream task of detecting LM biases. More concretely, we explore how to design prompts that can indicate 4 different types of biases: (1) gender, (2) race, (3) sexual orientation, and (4) religion-based. Within our project, we experiment with different manually crafted prompts that can draw out the subtle biases that may be present in the language model. We apply these prompts to multiple variations of popular and well-recognized models: BERT, RoBERTa, and T5 to evaluate their biases. We provide a comparative analysis of these models and assess them using a two-fold method: use human judgment to decide whether model predictions are biased and utilize model-level judgment (through further prompts) to understand if a model can self-diagnose the biases of its own prediction.


title: Magnetic anisotropy driven by ligand in 4d transition metal oxide SrRuO3

abstract: The origin of magnetic anisotropy in magnetic compounds is a longstanding issue in solid state physics and nonmagnetic ligand ions are considered to contribute little to magnetic anisotropy. Here, we introduce the concept of ligand driven magnetic anisotropy in a complex transition-metal oxide. We conducted X ray absorption and X ray magnetic circular dichroism spectroscopies at the Ru and O edges in the 4d ferromagnetic metal SrRuO3. Systematic variation of the sample thickness in the range below 10 nm allowed us to control the localization of Ru 4d t2g states, which affects the magnetic coupling between the Ru and O ions. We found that the orbital magnetization of the ligand induced via hybridization with the Ru 4d orbital determines the magnetic anisotropy in SrRuO3.


title: Galois Symmetry of Topological Manifolds

abstract: In 1970 Nice ICM report, Sullivan defined simply connected $p$-adic formal manifolds and an abelianized Galois action on them, for $p$ odd. He also had a suggestion for $p=2$. The Galois action $Gal(\overline{\mathbb{Q}}/\mathbb{Q})$ on a variety over $\overline{\mathbb{Q}}$ does not change its \'etale homotopy type by Artin-Mazur. There is also a claim in Sullivan's 1970s MIT notes that the Galois action on the elements reprensented by varieties of the `structure set' on an \'etale homotopy type passes through the abelianized Galois action. We define simply connected $p$-adic formal manifolds and the abelianized Galois action on them, for both $p$ odd and $p=2$. Then we formulate the $p$-adic structure set on a $p$-adic formal manifold and define an abelianized Galois action on these structure sets. We prove that the Galois action on smooth projective varieties over $\overline{\mathbb{Q}}$ is equivalent to the abelianized Galois action on the $p$-adic structure sets.


title: The Fence Complexity of Persistent Sets

abstract: We study the psync complexity of concurrent sets in the non-volatile shared memory model. Flush instructions are used in non-volatile memory to force shared state to be written back to non-volatile memory and must typically be accompanied by the use of expensive fence instructions to enforce ordering among such flushes. Collectively we refer to a flush and a fence as a psync. The safety property of strict linearizability forces crashed operations to take effect before the crash or not take effect at all; the weaker property of durable linearizability enforces this requirement only for operations that have completed prior to the crash event. We consider lock-free implementations of list-based sets and prove two lower bounds. We prove that for any durable linearizable lock-free set there must exist an execution where some process must perform at least one redundant psync as part of an update operation. We introduce an extension to strict linearizability specialized for persistent sets that we call strict limited effect (SLE) linearizability. SLE linearizability explicitly ensures that operations do not take effect after a crash which better reflects the original intentions of strict linearizability. We show that it is impossible to implement SLE linearizable lock-free sets in which read-only (or search) operations do not flush or fence. We undertake an empirical study of persistent sets that examines various algorithmic design techniques and the impact of flush instructions in practice. We present concurrent set algorithms that provide matching upper bounds and rigorously evaluate them against existing persistent sets to expose the impact of algorithmic design and safety properties on psync complexity in practice as well as the cost of recovering the data structure following a system crash.


title: Branched Covering and Profinite Completion

abstract: Artin-Mazur established the \'etale homotopy theory of schemes and proved the generalized Riemann existence theorem, i.e., all \'etale morphisms of a complex finite type scheme induce its profinite completion. We generalize it to piecewise linear pseudomanifolds and prove that all branched coverings of a pseudomanifold induce its profinite completion.


title: The spin measurement of MAXI J1348-630 using the Insight-HXMT data

abstract: We report the results of fitting Insight-HXMT data to the black hole X-ray binary MAXI J1348-430, which was discovered on January 26th, 2019, with the Gas Slit Camera (GSC) on-board MAXI. Several observations at the beginning of the first burst were selected, with a total of 10 spectra. From the residuals of fits using disk plus power law models, X-ray reflection signatures were clearly visible in some of these observations. We use the state-of the-art relxill series reflection model to fit six spectra with distinct reflection signatures and a joint fit to these spectra. In particular, we focus on the results for the black hole spin values. Assuming Rin = RISCO, the spin parameter is constrained to be 0.82+0.04-0.03 with 90% confidence level (statistical only).


title: Uniform bounds for Kloosterman sums of half-integral weight, same-sign case

abstract: In the previous paper [Sun23], the author proved a uniform bound for sums of half-integral weight Kloosterman sums. This bound was applied to prove an exact formula for partitions of rank modulo 3. That uniform estimate provides a more precise bound for a certain class of multipliers compared to the 1983 result by Goldfeld and Sarnak and generalizes the 2009 result from Sarnak and Tsimerman to the half-integral weight case. However, the author only considered the case when the parameters satisfied $\tilde m\tilde n<0$. In this paper, we prove the same uniform bound when $\tilde m\tilde n>0$ for further applications.


title: High-dimensional time-frequency entanglement in a singly-filtered biphoton frequency comb

abstract: High-dimensional quantum entanglement is a cornerstone for advanced technology enabling large-scale noise-tolerant quantum systems, fault-tolerant quantum computing, and distributed quantum networks. The recently developed biphoton frequency comb (BFC) provides a powerful platform for high-dimensional quantum information processing in its spectral and temporal quantum modes. Here we propose and generate a singly-filtered high-dimensional BFC via spontaneous parametric down-conversion by spectrally shaping only the signal photons with a Fabry-Perot cavity. High-dimensional energy-time entanglement is verified through Franson-interference recurrences and temporal correlation with low-jitter detectors. Frequency- and temporal- entanglement of our singly-filtered BFC is then quantified by Schmidt mode decomposition. Subsequently, we distribute the high-dimensional singly-filtered BFC state over a 10 km fiber link with a post-distribution time-bin dimension lower bounded to be at least 168. Our demonstrations of high-dimensional entanglement and entanglement distribution show the capability of the singly-filtered quantum frequency comb for high-efficiency quantum information processing and high-capacity quantum networks.


title: P2LSG: Powers-of-2 Low-Discrepancy Sequence Generator for Stochastic Computing

abstract: Stochastic Computing (SC) is an unconventional computing paradigm processing data in the form of random bit-streams. The accuracy and energy efficiency of SC systems highly depend on the stochastic number generator (SNG) unit that converts the data from conventional binary to stochastic bit-streams. Recent work has shown significant improvement in the efficiency of SC systems by employing low-discrepancy (LD) sequences such as Sobol and Halton sequences in the SNG unit. Still, the usage of many well-known random sequences for SC remains unexplored. This work studies some new random sequences for potential application in SC. Our design space exploration proposes a promising random number generator for accurate and energy-efficient SC. We propose P2LSG, a low-cost and energy-efficient Low-discrepancy Sequence Generator derived from Powers-of-2 VDC (Van der Corput) sequences. We evaluate the performance of our novel bit-stream generator for two SC image and video processing case studies: image scaling and scene merging. For the scene merging task, we propose a novel SC design for the first time. Our experimental results show higher accuracy and lower hardware cost and energy consumption compared to the state-of-the-art.


title: Discovery of millihertz Quasi-Periodic Oscillations in the Low Mass X-Ray Binary XTE J1701$-$462 from a Search of the RXTE Legacy data set

abstract: We report the detection of millihertz quasi-periodic oscillations ($\mathrm{mHz}$ QPOs) from the low-mass X-ray binary XTE J1701$-$462. The discovery came from a search of the legacy data set of the Rossi X-ray Timing Explorer, in order to detect the periodic signals in all observations of sources exhibiting thermonuclear bursts. We found that $47$ out of $860$ observations of XTE J1701$-$462; covering the 2006-7 outburst exhibits signals with a significance above the detection threshold, which was determined separately for each observation via a Monte Carlo approach. We chose the four strongest candidates, each with maximum power exceeding $4\sigma$ of the simulated wavelet noise power distribution, to demonstrate the properties of the QPOs. The frequencies of the signals in the four observations are $\sim 3.5\;\text{to}\;5.6\; \mathrm{mHz}$, and the fractional R.M.S. amplitudes vary between $0.74 \pm 0.05\,\%$ and $3.54 \pm 0.04\,\%$. Although previously reported signals in other sources typically disappear immediately before a burst, we do not observe this behaviour in XTE J1701$-$462. Instead, we found that the QPOs and bursts occurred in separate accretion regimes. When the persistent luminosity dropped near the end of the outburst, the source showed bursts and no QPOs were detected, which is the behaviour predicted by theory for the transition from stable to unstable burning. On the basis of this new detection, we reassess the cases for identifying these $\mathrm{mHz}$ QPOs in this and other sources as arising from marginally stable burning.


title: Axial view on pseudo-composition algebras and train algebras of rank 3

abstract: We show that pseudo-composition algebras and train algebras of rank 3 generated by idempotents are characterized as axial algebras with fusion laws derived from the Peirce decompositions of idempotents in these classes of algebras. The corresponding axial algebras are called $\mathcal{PC}(\eta)$-axial algebras, where $\eta$ is an element of the ground field. As a first step towards their classification, we describe $2-$ and $3$-generated subalgebras of such algebras.


title: Generating Natural Language Queries for More Effective Systematic Review Screening Prioritisation

abstract: Screening prioritisation in medical systematic reviews aims to rank the set of documents retrieved by complex Boolean queries. Prioritising the most important documents ensures that subsequent review steps can be carried out more efficiently and effectively. The current state of the art uses the final title of the review as a query to rank the documents using BERT-based neural rankers. However, the final title is only formulated at the end of the review process, which makes this approach impractical as it relies on ex post facto information. At the time of screening, only a rough working title is available, with which the BERT-based ranker performs significantly worse than with the final title. In this paper, we explore alternative sources of queries for prioritising screening, such as the Boolean query used to retrieve the documents to be screened and queries generated by instruction-based generative large-scale language models such as ChatGPT and Alpaca. Our best approach is not only viable based on the information available at the time of screening, but also has similar effectiveness to the final title.


title: HAT: Hybrid Attention Transformer for Image Restoration

abstract: Transformer-based methods have shown impressive performance in image restoration tasks, such as image super-resolution and denoising. However, we find that these networks can only utilize a limited spatial range of input information through attribution analysis. This implies that the potential of Transformer is still not fully exploited in existing networks. In order to activate more input pixels for better restoration, we propose a new Hybrid Attention Transformer (HAT). It combines both channel attention and window-based self-attention schemes, thus making use of their complementary advantages. Moreover, to better aggregate the cross-window information, we introduce an overlapping cross-attention module to enhance the interaction between neighboring window features. In the training stage, we additionally adopt a same-task pre-training strategy to further exploit the potential of the model for further improvement. Extensive experiments have demonstrated the effectiveness of the proposed modules. We further scale up the model to show that the performance of the SR task can be greatly improved. Besides, we extend HAT to more image restoration applications, including real-world image super-resolution, Gaussian image denoising and image compression artifacts reduction. Experiments on benchmark and real-world datasets demonstrate that our HAT achieves state-of-the-art performance both quantitatively and qualitatively. Codes and models are publicly available at https://github.com/XPixelGroup/HAT.


title: Coupled-cluster theory for trapped bosonic mixtures

abstract: We develop a coupled-cluster theory for bosonic mixtures of binary species in external traps, providing a promising theoretical approach to demonstrate highly accurately the many-body physics of mixtures of Bose-Einstein condensates. The coupled-cluster wavefunction for the binary species is obtained when an exponential cluster operator $e^T$, where $T=T^{(1)}+T^{(2)}+T^{(12)}$ and $T^{(1)}$ accounts for excitations in species-1, $T^{(2)}$ for excitations in species-2, and $T^{(12)}$ for combined excitations in both species, acts on the ground state configuration prepared by accumulating all bosons in a single orbital for each species. We have explicitly derived the working equations for the bosonic mixtures by truncating the cluster operator upto the single and double excitations and using an arbitrary sets of orthonormal orbitals for each of the species. Further, the comparatively simplified version of the working equations are formulated using the Fock-like operators. Finally, using an exactly solvable many-body model for bosonic mixtures that exists in the literature allows us to implement and test the performance and accuracy of the coupled-cluster theory for situations with balanced as well as imbalanced boson numbers and for weak to moderately strong intra- and inter-species interaction strengths. The comparison between our computed results using coupled-cluster theory with the respective analytical exact results displays remarkable agreement exhibiting excellent success of the coupled-cluster theory for bosonic mixtures. All in all, the correlation exhaustive coupled-cluster theory shows encouraging results and it could be a promising approach in paving the way for high-accuracy modelling of various bosonic mixture systems.


title: Measurement of the neutron timelike electromagnetic form factor with the SND detector

abstract: The results of the measurement of the $e^+e^- \to n \bar{n}$ cross section and effective neutron timelike form factor are presented. The data taking was carried out in 2020-2021 at the VEPP-2000 $e^+e^-$ collider in the center-of-mass energy range from 1891 to 2007 MeV. The general purpose nonmagnetic detector SND is used to detect neutron-antineutron events. The event selection is performed using the time-of-flight technique. The measured cross section is 0.4-0.6 nb. The neutron form factor in the energy range under study varies from 0.3 to 0.2.


title: A Flexible Architecture for Broadcast Broadband Convergence in Beyond 5G

abstract: There has been an exponential increase in the usage of multimedia services in mobile networks in recent years. To address this accelerating data demand, mobile networks are experiencing a subtle transformation in their architecture. One of the changes in this direction is the support of Multicast/Broadcast Service (MBS) in the Third Generation Partnership Project (3GPP) Fifth Generation (5G) network. The MBS has been introduced to enhance resource utilization and user experience in 3GPP 5G networks. However, there are certain limitations in the 3GPP 5G MBS architecture, such as the selection of the delivery method (unicast or broadcast) by the core network (may result in sub-optimal radio resource utilization) and no provision for converging non-3GPP broadcast technologies (like digital terrestrial television) with cellular (3GPP 5G) broadband. In this context, we propose a new architecture for the convergence of cellular broadband and non-3GPP broadcast networks. A novelty of the architecture is that it treats signalling exchange with User Equipment (UE) as data (service) which results in improved scalability of mobile networks. The architecture supports enhanced flexibility in choosing a delivery method (3GPP 5G unicast, 3GPP 5G broadcast, or non-3GPP broadcast) for user data. We evaluate the performance of the proposed architecture using process algebra-based simulations, demonstrating a significant reduction in the number of signalling messages exchanged between the UE and the network for MBS session establishment as compared to the 3GPP 5G network.


title: Interplay of disorder and interaction in the bilayer band-insulator : A Determinant Quantum Monte Carlo study

abstract: Earlier work [arXiv:1206.2407,arXiv:2206.06085] have shown the band insulator (BI) to superfluid (SF) phase transition in the half-filled bilayer attractive Hubbard model. In this paper we append the effects of random on-site disorder on the single particle properties and two particle pair-pair correlations in that model. Using the determinant quantum Monte Carlo simulation we observe that the on-site random disorder plays a significant role in the localization of on-site pairs, hence in the reduction of the effective hopping. This results in an increase of the double occupancy, which is an effect similiar to the attractive interaction. We find no change in the critical value of the interaction at which the model undergoes from BI to SF regime even though the pair-pair correlations get suppressed for finite on-site disorder strengths V_d/t=0.1-0.8. We also confirm that the weak disorder suppresses the SF phase largely in the strong-coupling limit. Hence the region of the SF phase reduces in the presence of random on-site disorder. Finally, through finite-size scaling we have estimated the critical disorder strength V_d^c/t~1.44 at |U|/t=5.


title: The cosmological collider signal in the non-BD initial states

abstract: We investigate the cosmological collider (CC) signal arising from the tree-level exchange of a scalar spectator particle with a non-Bunch Davies (BD) initial state. We decompose the inflaton correlators into seed integrals, which we compute analytically by solving the bootstrap equations. We show that the non-BD initial state eliminates the Hubble scale Boltzmann suppression $e^{-\pi m /H}$ that usually affects the CC signal. Consequently, in this scenario, the CC can probe an energy scale much higher than the inflationary Hubble scale $H$.


title: Ground-state Properties and Bogoliubov Modes of a Harmonically Trapped One-Dimensional Quantum Droplet

abstract: We study the stationary and excitation properties of a one-dimensional quantum droplet in the two-component Bose mixture trapped in a harmonic potential. By constructing the energy functional for the inhomogeneous mixture, we elaborate the extended the Gross-Pitaevskii equation applicable to both symmetric and asymmetric mixtures into a universal form, and the equations in two different dimensionless schemes are in a duality relation, i.e. the unique parameters left are inverse of each other. The Bogoliubov equations for the trapped droplet are obtained by linearizing the small density fluctuation around the ground state and the low-lying excitation modes are calculated numerically.It is found that the confinement trap changes easily the flat-top structure for large droplets and alters the mean square radius and the chemical potential intensively. The breathing mode of the confined droplet connects the self-bound and ideal gas limits, with the excitation in the weakly interacting Bose condensate for large particle numbers lying in between. We explicitly show how the continuum spectrum of the excitation is split into discrete modes, and finally taken over by the harmonic trap. Two critical particle numbers are identified by the minimum size of the trapped droplet and the maximum breathing mode energy, both of which are found to decrease exponentially with the trapping parameter.


title: Deep photonic reservoir computing recurrent network

abstract: Deep neural networks usually process information through multiple hidden layers. However, most hardware reservoir computing recurrent networks only have one hidden reservoir layer, which significantly limits the capability of solving real-world complex tasks. Here we show a deep photonic reservoir computing (PRC) architecture, which is constructed by cascading injection-locked semiconductor lasers. In particular, the connection between successive hidden layers is all optical, without any optical-electrical conversion or analog-digital conversion. The proof of concept is demonstrated on a PRC consisting of 4 hidden layers and 320 interconnected neurons. In addition, we apply the deep PRC in the real-world signal equalization of an optical fiber communication system. It is found that the deep PRC owns strong ability to compensate the nonlinearity of fibers.


title: l-connectivity, l-edge-connectivity and spectral radius of graphs

abstract: Let G be a connected graph. The toughness of G is defined as t(G)=min{\frac{|S|}{c(G-S)}}, in which the minimum is taken over all proper subsets S\subset V(G) such that c(G-S)\geq 2 where c(G-S) denotes the number of components of G-S. Confirming a conjecture of Brouwer, Gu [SIAM J. Discrete Math. 35 (2021) 948--952] proved a tight lower bound on toughness of regular graphs in terms of the second largest absolute eigenvalue. Fan, Lin and Lu [European J. Combin. 110 (2023) 103701] then studied the toughness of simple graphs from the spectral radius perspective. While the toughness is an important concept in graph theory, it is also very interesting to study |S| for which c(G-S)\geq l for a given integer l\geq 2. This leads to the concept of the l-connectivity, which is defined to be the minimum number of vertices of G whose removal produces a disconnected graph with at least l components or a graph with fewer than l vertices. Gu [European J. Combin. 92 (2021) 103255] discovered a lower bound on the l-connectivity of regular graphs via the second largest absolute eigenvalue. As a counterpart, we discover the connection between the l-connectivity of simple graphs and the spectral radius. We also study similar problems for digraphs and an edge version.


title: Enhancing Speaker Diarization with Large Language Models: A Contextual Beam Search Approach

abstract: Large language models (LLMs) have shown great promise for capturing contextual information in natural language processing tasks. We propose a novel approach to speaker diarization that incorporates the prowess of LLMs to exploit contextual cues in human dialogues. Our method builds upon an acoustic-based speaker diarization system by adding lexical information from an LLM in the inference stage. We model the multi-modal decoding process probabilistically and perform joint acoustic and lexical beam search to incorporate cues from both modalities: audio and text. Our experiments demonstrate that infusing lexical knowledge from the LLM into an acoustics-only diarization system improves overall speaker-attributed word error rate (SA-WER). The experimental results show that LLMs can provide complementary information to acoustic models for the speaker diarization task via proposed beam search decoding approach showing up to 39.8% relative delta-SA-WER improvement from the baseline system. Thus, we substantiate that the proposed technique is able to exploit contextual information that is inaccessible to acoustics-only systems which is represented by speaker embeddings. In addition, these findings point to the potential of using LLMs to improve speaker diarization and other speech processing tasks by capturing semantic and contextual cues.


title: Evaluating Visual Odometry Methods for Autonomous Driving in Rain

abstract: The increasing demand for autonomous vehicles has created a need for robust navigation systems that can also operate effectively in adverse weather conditions. Visual odometry is a technique used in these navigation systems, enabling the estimation of vehicle position and motion using input from onboard cameras. However, visual odometry accuracy can be significantly impacted in challenging weather conditions, such as heavy rain, snow, or fog. In this paper, we evaluate a range of visual odometry methods, including our DROID-SLAM based heuristic approach. Specifically, these algorithms are tested on both clear and rainy weather urban driving data to evaluate their robustness. We compiled a dataset comprising of a range of rainy weather conditions from different cities. This includes, the Oxford Robotcar dataset from Oxford, the 4Seasons dataset from Munich and an internal dataset collected in Singapore. We evaluated different visual odometry algorithms for both monocular and stereo camera setups using the Absolute Trajectory Error (ATE). From the range of approaches evaluated, our findings suggest that the Depth and Flow for Visual Odometry (DF-VO) algorithm with monocular setup performed the best for short range distances (< 500m) and our proposed DROID-SLAM based heuristic approach for the stereo setup performed relatively well for long-term localization. Both VO algorithms suggested a need for a more robust sensor fusion based approach for localization in rain.


title: Iterative Phase Retrieval Algorithms for Scanning Transmission Electron Microscopy

abstract: Scanning transmission electron microscopy (STEM) has been extensively used for imaging complex materials down to atomic resolution. The most commonly employed STEM modality, annular dark-field imaging, produces easily-interpretable contrast, but is dose-inefficient and produces little to no discernible contrast for light elements and weakly-scattering samples. An alternative is to use STEM phase retrieval imaging, enabled by high speed detectors able to record full images of a diffracted STEM probe over a grid of scan positions. Phase retrieval imaging in STEM is highly dose-efficient, enabling the measurement of the structure of beam-sensitive materials such as biological samples. Here, we comprehensively describe the theoretical background, algorithmic implementation details, and perform both simulated and experimental tests for three iterative phase retrieval STEM methods: focused-probe differential phase contrast, defocused-probe parallax imaging, and a generalized ptychographic gradient descent method implemented in two and three dimensions. We discuss the strengths and weaknesses of each of these approaches by comparing the transfer of information using analytical expressions and numerical results for a white-noise model. This presentation of STEM phase retrieval methods aims to make these methods more approachable, reproducible, and more readily adoptable for many classes of samples.


title: Multi3DRefer: Grounding Text Description to Multiple 3D Objects

abstract: We introduce the task of localizing a flexible number of objects in real-world 3D scenes using natural language descriptions. Existing 3D visual grounding tasks focus on localizing a unique object given a text description. However, such a strict setting is unnatural as localizing potentially multiple objects is a common need in real-world scenarios and robotic tasks (e.g., visual navigation and object rearrangement). To address this setting we propose Multi3DRefer, generalizing the ScanRefer dataset and task. Our dataset contains 61926 descriptions of 11609 objects, where zero, single or multiple target objects are referenced by each description. We also introduce a new evaluation metric and benchmark methods from prior work to enable further investigation of multi-modal 3D scene understanding. Furthermore, we develop a better baseline leveraging 2D features from CLIP by rendering object proposals online with contrastive learning, which outperforms the state of the art on the ScanRefer benchmark.


title: A severe challenge to the MOND phenomenology in our Galaxy

abstract: Modified Newtonian Dynamics (MOND) is one of the most popular alternative theories of dark matter to explain the missing mass problem in galaxies. Although it remains controversial regarding MOND as a fundamental theory, MOND phenomenology has been shown to widely apply in different galaxies, which gives challenges to the standard $\Lambda$ cold dark matter model. In this article, we derive analytically the galactic rotation curve gradient in the MOND framework and present a rigorous analysis to examine the MOND phenomenology in our Galaxy. By assuming a benchmark baryonic disk density profile and two popular families of MOND interpolating functions, we show for the first time that the recent discovery of the declining Galactic rotation curve in the outer region ($R \approx 17-23$ kpc) can almost rule out the MOND phenomenology at more than $5\sigma$. This strongly supports some of the previous studies claiming that MOND is neither a fundamental theory nor a universal description of galactic properties.


title: A quantum tug of war between randomness and symmetries on homogeneous spaces

abstract: We explore the interplay between symmetry and randomness in quantum information. Adopting a geometric approach, we consider states as $H$-equivalent if related by a symmetry transformation characterized by the group $H$. We then introduce the Haar measure on the homogeneous space $\mathbb{U}/H$, characterizing true randomness for $H$-equivalent systems. While this mathematical machinery is well-studied by mathematicians, it has seen limited application in quantum information: we believe our work to be the first instance of utilizing homogeneous spaces to characterize symmetry in quantum information. This is followed by a discussion of approximations of true randomness, commencing with $t$-wise independent approximations and defining $t$-designs on $\mathbb{U}/H$ and $H$-equivalent states. Transitioning further, we explore pseudorandomness, defining pseudorandom unitaries and states within homogeneous spaces. Finally, as a practical demonstration of our findings, we study the expressibility of quantum machine learning ansatze in homogeneous spaces. Our work provides a fresh perspective on the relationship between randomness and symmetry in the quantum world.


title: Towards Better Data Exploitation in Self-Supervised Monocular Depth Estimation

abstract: Depth estimation plays an important role in the robotic perception system. Self-supervised monocular paradigm has gained significant attention since it can free training from the reliance on depth annotations. Despite recent advancements, existing self-supervised methods still underutilize the available training data, limiting their generalization ability. In this paper, we take two data augmentation techniques, namely Resizing-Cropping and Splitting-Permuting, to fully exploit the potential of training datasets. Specifically, the original image and the generated two augmented images are fed into the training pipeline simultaneously and we leverage them to conduct self-distillation. Additionally, we introduce the detail-enhanced DepthNet with an extra full-scale branch in the encoder and a grid decoder to enhance the restoration of fine details in depth maps. Experimental results demonstrate our method can achieve state-of-the-art performance on the KITTI benchmark, with both raw ground truth and improved ground truth. Moreover, our models also show superior generalization performance when transferring to Make3D and NYUv2 datasets. Our codes are available at https://github.com/Sauf4896/BDEdepth.


title: A Locking-Free Weak Galerkin Finite Element Method for Linear Elasticity Problems

abstract: In this paper, we introduce and analyze a lowest-order locking-free weak Galerkin (WG) finite element scheme for the grad-div formulation of linear elasticity problems. The scheme uses linear functions in the interior of mesh elements and constants on edges (2D) or faces (3D), respectively, to approximate the displacement. An $H(div)$-conforming displacement reconstruction operator is employed to modify test functions in the right-hand side of the discrete form, in order to eliminate the dependence of the $Lam\acute{e}$ parameter $\lambda$ in error estimates, i.e., making the scheme locking-free. The method works without requiring $\lambda \|\nabla\cdot \mathbf{u}\|_1$ to be bounded. We prove optimal error estimates, independent of $\lambda$, in both the $H^1$-norm and the $L^2$-norm. Numerical experiments validate that the method is effective and locking-free.


title: Examining the Effect of Pre-training on Time Series Classification

abstract: Although the pre-training followed by fine-tuning paradigm is used extensively in many fields, there is still some controversy surrounding the impact of pre-training on the fine-tuning process. Currently, experimental findings based on text and image data lack consensus. To delve deeper into the unsupervised pre-training followed by fine-tuning paradigm, we have extended previous research to a new modality: time series. In this study, we conducted a thorough examination of 150 classification datasets derived from the Univariate Time Series (UTS) and Multivariate Time Series (MTS) benchmarks. Our analysis reveals several key conclusions. (i) Pre-training can only help improve the optimization process for models that fit the data poorly, rather than those that fit the data well. (ii) Pre-training does not exhibit the effect of regularization when given sufficient training time. (iii) Pre-training can only speed up convergence if the model has sufficient ability to fit the data. (iv) Adding more pre-training data does not improve generalization, but it can strengthen the advantage of pre-training on the original data volume, such as faster convergence. (v) While both the pre-training task and the model structure determine the effectiveness of the paradigm on a given dataset, the model structure plays a more significant role.


title: FusionFormer: A Multi-sensory Fusion in Bird's-Eye-View and Temporal Consistent Transformer for 3D Object Detection

abstract: Multi-sensor modal fusion has demonstrated strong advantages in 3D object detection tasks. However, existing methods that fuse multi-modal features require transforming features into the bird's eye view space and may lose certain information on Z-axis, thus leading to inferior performance. To this end, we propose a novel end-to-end multi-modal fusion transformer-based framework, dubbed FusionFormer, that incorporates deformable attention and residual structures within the fusion encoding module. Specifically, by developing a uniform sampling strategy, our method can easily sample from 2D image and 3D voxel features spontaneously, thus exploiting flexible adaptability and avoiding explicit transformation to the bird's eye view space during the feature concatenation process. We further implement a residual structure in our feature encoder to ensure the model's robustness in case of missing an input modality. Through extensive experiments on a popular autonomous driving benchmark dataset, nuScenes, our method achieves state-of-the-art single model performance of 72.6% mAP and 75.1% NDS in the 3D object detection task without test time augmentation.


title: Tensors Over Banach Spaces: Completeness, Algebra and Interpolation

abstract: Can polynomial interpolation be extended to a Banach space setting? Are tensors whose elements are non-commutative Banach space elements legitimate objects with notable analytic and algebraic properties? Here we explore these questions and present the ground work conducted to successfully interpolate a left-sided polynomial whose inputs are general Banach space elements, when the Banach space admits an associative algebra, submultiplicative norm and a multiplicative identity. We start with introductions and propose theorems and lemmas equipped for general tensors over a Banach space for those whose research interests lie outside of Lagrange interpolation, transitioning into algebraic properties inspired by Maksimov's work on cubic matrices, gradually narrowing down to the interpolation itself for left-sided polynomials in the last section of the article.


title: A physics-informed and attention-based graph learning approach for regional electric vehicle charging demand prediction

abstract: Along with the proliferation of electric vehicles (EVs), optimizing the use of EV charging space can significantly alleviate the growing load on intelligent transportation systems. As the foundation to achieve such an optimization, a spatiotemporal method for EV charging demand prediction in urban areas is required. Although several solutions have been proposed by using data-driven deep learning methods, it can be found that these performance-oriented methods may suffer from misinterpretations to correctly handle the reverse relationship between charging demands and prices. To tackle the emerging challenges of training an accurate and interpretable prediction model, this paper proposes a novel approach that enables the integration of graph and temporal attention mechanisms for feature extraction and the usage of physic-informed meta-learning in the model pre-training step for knowledge transfer. Evaluation results on a dataset of 18,013 EV charging piles in Shenzhen, China, show that the proposed approach, named PAG, can achieve state-of-the-art forecasting performance and the ability in understanding the adaptive changes in charging demands caused by price fluctuations.