title: Interactive Distance Field Mapping and Planning to Enable Human-Robot Collaboration

abstract: Human-robot collaborative applications require scene representations that are kept up-to-date and facilitate safe motions in dynamic scenes. In this letter, we present an interactive distance field mapping and planning (IDMP) framework that handles dynamic objects and collision avoidance through an efficient representation. We define \textit{interactive} mapping and planning as the process of creating and updating the representation of the scene online while simultaneously planning and adapting the robot's actions based on that representation. Given depth sensor data, our framework builds a continuous field that allows to query the distance and gradient to the closest obstacle at any required position in 3D space. The key aspect of this work is an efficient Gaussian Process field that performs incremental updates and implicitly handles dynamic objects with a simple and elegant formulation based on a temporary latent model. In terms of mapping, IDMP is able to fuse point cloud data from single and multiple sensors, query the free space at any spatial resolution, and deal with moving objects without semantics. In terms of planning, IDMP allows seamless integration with gradient-based motion planners facilitating fast re-planning for collision-free navigation. The framework is evaluated on both real and synthetic datasets. A comparison with similar state-of-the-art frameworks shows superior performance when handling dynamic objects and comparable or better performance in the accuracy of the computed distance and gradient field. Finally, we show how the framework can be used for fast motion planning in the presence of moving objects. An accompanying video, code, and datasets are made publicly available https://uts-ri.github.io/IDMP.


title: Dispersive decay for the mass-critical nonlinear Schr\"odinger equation

abstract: We prove dispersive decay, pointwise in time, for solutions to the mass-critical nonlinear Schr\"odinger equation in spatial dimensions $d=1,2,3$.


title: CLOSURE: Fast Quantification of Pose Uncertainty Sets

abstract: We investigate uncertainty quantification of 6D pose estimation from learned noisy measurements (e.g. keypoints and pose hypotheses). Assuming unknown-but-bounded measurement noises, a pose uncertainty set (PURSE) is a subset of SE(3) that contains all possible 6D poses compatible with the measurements. Despite being simple to formulate and its ability to embed uncertainty, the PURSE is difficult to manipulate and interpret due to the many abstract nonconvex polynomial constraints. An appealing simplification of PURSE is to find its minimum enclosing geodesic ball (MEGB), i.e., a point pose estimation with minimum worst-case error bound. We contribute (i) a geometric interpretation of the nonconvex PURSE, and (ii) a fast algorithm to inner approximate the MEGB. Particularly, we show the PURSE corresponds to the feasible set of a constrained dynamical system or the intersection of multiple geodesic balls, and this perspective allows us to design an algorithm to densely sample the boundary of the PURSE through strategic random walks. We then use the miniball algorithm to compute the MEGB of PURSE samples, leading to an inner approximation. Our algorithm is named CLOSURE (enClosing baLl frOm purSe boUndaRy samplEs) and it enables computing a certificate of approximation tightness by calculating the relative size ratio between the inner approximation and the outer approximation. Running on a single RTX 3090 GPU, CLOSURE achieves the relative ratio of 92.8% on the LM-O dataset, 91.4% on the 3DMatch dataset and 96.6% on the LM dataset with the average runtime less than 0.3 second. Obtaining comparable worst-case error bound but 398x 833x and 23.6x faster than the outer approximation GRCC, CLOSURE enables uncertainty quantification of 6D pose estimation to be implemented in real-time robot perception applications.


title: DDPS: Dynamic Differential Pricing-based Edge Offloading System with Energy Harvesting Devices

abstract: Mobile edge computing (MEC) paves the way to alleviate the burden of energy and computation of mobile users (MUs) by offloading tasks to the network edge. To enhance the MEC server utilization by optimizing its resource allocation, a well-designed pricing strategy is indispensable. In this paper, we consider the edge offloading scenario with energy harvesting devices, and propose a dynamic differential pricing system (DDPS), which determines the price per unit time according to the usage of computing resources to improve the edge server utilization. Firstly, we propose an offloading decision algorithm to decide whether to conduct the offloading operation and how much data to be offloaded if conducted, the algorithm determines offloading operation by balancing the energy harvested with the energy consumed. Secondly, for the offloading case, we formulate the game between the MUs and the server as a Stackelberg game, and propose a differential pricing algorithm to determine the optimal computing resources required by MUs. Furthermore, the proposed algorithm also reallocates computing resources for delay-sensitive devices while server resources are surplus after the initial allocation, aiming to make full use of the server computing resources. Extensive simulations are conducted to demonstrate the effectiveness of the proposed DDPS scheme.


title: Contracting isometries and differentiability of the escape rate

abstract: Let $G$ be a countable group whose action on a metric space $X$ involves a contracting isometry. This setting naturally encompasses groups acting on Gromov hyperbolic spaces, Teichm\"uller space, Culler-Vogtmann Outer space and CAT(0) spaces. We discuss continuity and differentiability of the escape rate of random walks on $G$. For mapping class groups, relatively hyperbolic groups, CAT(-1) groups and CAT(0) cubical groups, we further discuss analyticity of the escape rate. Finally, assuming that the action of $G$ on $X$ is weakly properly discontinuous (WPD), we discuss continuity of the asymptotic entropy of random walks on $G$.


title: TRG-Net: An Interpretable and Controllable Rain Generator

abstract: Exploring and modeling rain generation mechanism is critical for augmenting paired data to ease training of rainy image processing models. Against this task, this study proposes a novel deep learning based rain generator, which fully takes the physical generation mechanism underlying rains into consideration and well encodes the learning of the fundamental rain factors (i.e., shape, orientation, length, width and sparsity) explicitly into the deep network. Its significance lies in that the generator not only elaborately design essential elements of the rain to simulate expected rains, like conventional artificial strategies, but also finely adapt to complicated and diverse practical rainy images, like deep learning methods. By rationally adopting filter parameterization technique, we first time achieve a deep network that is finely controllable with respect to rain factors and able to learn the distribution of these factors purely from data. Our unpaired generation experiments demonstrate that the rain generated by the proposed rain generator is not only of higher quality, but also more effective for deraining and downstream tasks compared to current state-of-the-art rain generation methods. Besides, the paired data augmentation experiments, including both in-distribution and out-of-distribution (OOD), further validate the diversity of samples generated by our model for in-distribution deraining and OOD generalization tasks.


title: Even quantum advice is unlikely to solve PP

abstract: We give a corrected proof that if PP $\subseteq$ BQP/qpoly, then the Counting Hierarchy collapses, as originally claimed by [Aaronson 2006 arXiv:cs/0504048]. This recovers the related unconditional claim that PP does not have circuits of any fixed size $n^k$ even with quantum advice. We do so by proving that YQP*, an oblivious version of (QMA $\cap$ coQMA), is contained in APP, and so is PP-low.


title: Toric ranks and component groups of Jacobians of modular curves

abstract: Let $p\neq{2,3}$ be a prime number and let $\Gamma \subset \mathrm{SL}_{2}(\mathbb{Z})$ be a congruence subgroup with modular curve $X_{\Gamma}/K$ and Jacobian $J(X_{\Gamma})$. In this paper we give an explicit group-theoretic description of the semistable toric rank and component group of $J(X_{\Gamma})$ at the finite places of $K$ lying over $p$. We first produce a suitable deformation retract of the minimal Berkovich skeleton of $X_{H}$ in terms of Hecke-Iwahori double coset spaces. We call this deformation retract the pruned skeleton of the curve. Our description of this skeleton includes a group-theoretic formula for the edge lengths, allowing us to give the component group of the modular curve as the quotient of a lattice using the monodromy pairing. For $X_{0}(N)$, $X_{1}(N)$, $X_{sp}(N)$ and $X_{sp}^{+}(N)$, we explicitly determine the pruned skeleta using a set of coset schemes over $\mathbb{Z}$. This in particular recovers results by Deligne-Rapoport, Edixhoven, Coleman-McMurdy and Tsushima on the semistable reduction type of $X_{0}(p^{n})$ for $n\leq{4}$. Finally, we determine the geometric Tamagawa number and the prime-to-$2$ structure of the component group of $X_{0}(N)$ over the extension given by Krir's theorem.


title: MEDPNet: Achieving High-Precision Adaptive Registration for Complex Die Castings

abstract: Due to their complex spatial structure and diverse geometric features, achieving high-precision and robust point cloud registration for complex Die Castings has been a significant challenge in the die-casting industry. Existing point cloud registration methods primarily optimize network models using well-established high-quality datasets, often neglecting practical application in real scenarios. To address this gap, this paper proposes a high-precision adaptive registration method called Multiscale Efficient Deep Closest Point (MEDPNet) and introduces a die-casting point cloud dataset, DieCastCloud, specifically designed to tackle the challenges of point cloud registration in the die-casting industry. The MEDPNet method performs coarse die-casting point cloud data registration using the Efficient-DCP method, followed by precision registration using the Multiscale feature fusion dual-channel registration (MDR) method. We enhance the modeling capability and computational efficiency of the model by replacing the attention mechanism of the Transformer in DCP with Efficient Attention and implementing a collaborative scale mechanism through the combination of serial and parallel blocks. Additionally, we propose the MDR method, which utilizes multilayer perceptrons (MLP), Normal Distributions Transform (NDT), and Iterative Closest Point (ICP) to achieve learnable adaptive fusion, enabling high-precision, scalable, and noise-resistant global point cloud registration. Our proposed method demonstrates excellent performance compared to state-of-the-art geometric and learning-based registration methods when applied to complex die-casting point cloud data.


title: Identifying Health Risks from Family History: A Survey of Natural Language Processing Techniques

abstract: Electronic health records include information on patients' status and medical history, which could cover the history of diseases and disorders that could be hereditary. One important use of family history information is in precision health, where the goal is to keep the population healthy with preventative measures. Natural Language Processing (NLP) and machine learning techniques can assist with identifying information that could assist health professionals in identifying health risks before a condition is developed in their later years, saving lives and reducing healthcare costs. We survey the literature on the techniques from the NLP field that have been developed to utilise digital health records to identify risks of familial diseases. We highlight that rule-based methods are heavily investigated and are still actively used for family history extraction. Still, more recent efforts have been put into building neural models based on large-scale pre-trained language models. In addition to the areas where NLP has successfully been utilised, we also identify the areas where more research is needed to unlock the value of patients' records regarding data collection, task formulation and downstream applications.


title: FBPT: A Fully Binary Point Transformer

abstract: This paper presents a novel Fully Binary Point Cloud Transformer (FBPT) model which has the potential to be widely applied and expanded in the fields of robotics and mobile devices. By compressing the weights and activations of a 32-bit full-precision network to 1-bit binary values, the proposed binary point cloud Transformer network significantly reduces the storage footprint and computational resource requirements of neural network models for point cloud processing tasks, compared to full-precision point cloud networks. However, achieving a fully binary point cloud Transformer network, where all parts except the modules specific to the task are binary, poses challenges and bottlenecks in quantizing the activations of Q, K, V and self-attention in the attention module, as they do not adhere to simple probability distributions and can vary with input data. Furthermore, in our network, the binary attention module undergoes a degradation of the self-attention module due to the uniform distribution that occurs after the softmax operation. The primary focus of this paper is on addressing the performance degradation issue caused by the use of binary point cloud Transformer modules. We propose a novel binarization mechanism called dynamic-static hybridization. Specifically, our approach combines static binarization of the overall network model with fine granularity dynamic binarization of data-sensitive components. Furthermore, we make use of a novel hierarchical training scheme to obtain the optimal model and binarization parameters. These above improvements allow the proposed binarization method to outperform binarization methods applied to convolution neural networks when used in point cloud Transformer structures. To demonstrate the superiority of our algorithm, we conducted experiments on two different tasks: point cloud classification and place recognition.


title: The first measurements of carbon isotopic ratios in post-RGB stars: SZ Mon and DF Cyg. E-iSpec: A spectral analysis tool to derive elemental abundances and isotopic ratios for evolved stars

abstract: Dusty post-red giant branch (post-RGB) stars are low- and intermediate-mass stars where the RGB evolution was prematurely terminated by a poorly understood binary interaction. These binary stars are considered to be low-luminosity analogues of post-asymptotic giant branch (post-AGB) binary stars. In this study, we investigated the chemical composition of two dusty post-RGB binary stars, SZ Mon and DF Cyg, using multi-wavelength spectroscopic data from HERMES/Mercator (optical) and the APOGEE survey (near-infrared). Owing to challenges posed by existing spectral analysis tools for the study of evolved stars with complex atmospheres, we developed E-iSpec: a dedicated spectral analysis tool for evolved stars, to consistently determine atmospheric parameters, elemental abundances, and carbon isotopic ratios. Our abundance analysis revealed that observed depletion patterns and estimated depletion efficiencies resemble those found in post-AGB binary stars. However, the onset of chemical depletion in post-RGB targets occurs at higher condensation temperatures ($T_{\rm turn-off, post-RGB}\approx1400$ K), than in most post-AGB stars ($T_{\rm turn-off, post-AGB}\approx1100$ K). Additionally, our study resulted in the first estimates of carbon isotopic ratios for post-RGB stars ($^{12}$C/$^{13}$C$_{\rm SZ Mon}=8\pm4$, $^{12}$C/$^{13}$C$_{\rm DF Cyg}=12\pm3$). We found that the observationally derived CNO abundances and the carbon isotopic ratios of our post-RGB binary targets are in good agreement with theoretical predictions from the ATON single star evolutionary models involving first dredge-up and moderately-deep extra mixing. This agreement emphasises that in post-RGB binary targets, the observed CNO abundances reflect the chemical composition expected from single star nucleosynthesis (i.e., convective and non-convective mixing processes) occurring during the RGB phase before it is terminated.


title: Federated Learning with Anomaly Detection via Gradient and Reconstruction Analysis

abstract: In the evolving landscape of Federated Learning (FL), the challenge of ensuring data integrity against poisoning attacks is paramount, particularly for applications demanding stringent privacy preservation. Traditional anomaly detection strategies often struggle to adapt to the distributed nature of FL, leaving a gap our research aims to bridge. We introduce a novel framework that synergizes gradient-based analysis with autoencoder-driven data reconstruction to detect and mitigate poisoned data with unprecedented precision. Our approach uniquely combines detecting anomalous gradient patterns with identifying reconstruction errors, significantly enhancing FL model security. Validated through extensive experiments on MNIST and CIFAR-10 datasets, our method outperforms existing solutions by 15\% in anomaly detection accuracy while maintaining a minimal false positive rate. This robust performance, consistent across varied data types and network sizes, underscores our framework's potential in securing FL deployments in critical domains such as healthcare and finance. By setting new benchmarks for anomaly detection within FL, our work paves the way for future advancements in distributed learning security.


title: Visual Foundation Models Boost Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentation

abstract: Unsupervised domain adaptation (UDA) is vital for alleviating the workload of labeling 3D point cloud data and mitigating the absence of labels when facing a newly defined domain. Various methods of utilizing images to enhance the performance of cross-domain 3D segmentation have recently emerged. However, the pseudo labels, which are generated from models trained on the source domain and provide additional supervised signals for the unseen domain, are inadequate when utilized for 3D segmentation due to their inherent noisiness and consequently restrict the accuracy of neural networks. With the advent of 2D visual foundation models (VFMs) and their abundant knowledge prior, we propose a novel pipeline VFMSeg to further enhance the cross-modal unsupervised domain adaptation framework by leveraging these models. In this work, we study how to harness the knowledge priors learned by VFMs to produce more accurate labels for unlabeled target domains and improve overall performance. We first utilize a multi-modal VFM, which is pre-trained on large scale image-text pairs, to provide supervised labels (VFM-PL) for images and point clouds from the target domain. Then, another VFM trained on fine-grained 2D masks is adopted to guide the generation of semantically augmented images and point clouds to enhance the performance of neural networks, which mix the data from source and target domains like view frustums (FrustumMixing). Finally, we merge class-wise prediction across modalities to produce more accurate annotations for unlabeled target domains. Our method is evaluated on various autonomous driving datasets and the results demonstrate a significant improvement for 3D segmentation task.


title: Fast Group Scheduling for Downlink Large-Scale Multi-Group Multicast Beamforming

abstract: Next-generation wireless networks need to handle massive user access effectively. This paper addresses the problem of joint group scheduling and multicast beamforming for downlink transmission with many active user groups. Aiming to maximize the minimum user throughput, we propose a three-phase approach to tackle this difficult joint optimization problem efficiently. In Phase 1, we utilize the optimal multicast beamforming structure obtained recently to find the group-channel directions for all groups. We propose two low-complexity group scheduling algorithms in Phase 2, which determine the subset of groups in each time slot sequentially and the total number of time slots required for all groups. The first algorithm measures the level of spatial separation among groups and selects the dissimilar groups that maximize the minimum user rate into the same time slot. In contrast, the second algorithm first identifies the spatially correlated groups via a learning-based clustering method based on the group-channel directions, and then separates spatially similar groups into different time slots. Finally, the multicast beamformers for the scheduled groups are obtained in each time slot by a computationally efficient method. Simulation results show that our proposed scheduling methods can effectively capture the level of spatial separation among groups to improve the minimum user throughput over the conventional approach that serves all groups in a single time slot or one group per time slot, and can be executed with low computational complexity.


title: An improved light-cone harmonic oscillator model for the $\phi$-meson longitudinal leading-twist light-cone distribution amplitude

abstract: In the present paper, we study the properties of $\phi$-meson longitudinal leading-twist light-cone distribution amplitude $\phi_{2;{\phi}}^{\|}(x,\mu)$ by starting from a light-cone harmonic oscillator model for its wavefunction. To fix the input parameters, we derive the first ten $\xi$-moments of $\phi_{2;{\phi}}^{\|}(x,\mu)$ by using the QCD sum rules approach under the background field theory. The shape of $\phi_{2;{\phi}}^{\|}(x,\mu=2~{\rm GeV})$ tends to be a single-peak behavior, which is consistent with the latest Lattice QCD result. As an application, we derive the $D^+_s \to \phi$ transition form factors (TFFs) by using the light-cone sum rules approach. At the large recoil point, we obtain $A_1(0) = 0.512_{-0.020}^{+0.030}$, $A_2(0) = 0.402_{-0.067}^{+0.078}$, $A_0(0) = 0.596_{-0.020}^{+0.025}$ and $V(0) = 0.882_{-0.036}^{+0.040}$. As for the two typical ratios $\gamma_V$ and $\gamma_2$, we obtain $\gamma_V = 1.723_{-0.021}^{+0.023}$ and $\gamma_2 = 0.785_{-0.104}^{+0.100}$. After extrapolating those TFFs to the physically allowable region, we then obtain the transverse, longitudinal and total decay widths for semi-leptonic decay $D^+_s\to\phi\ell^+\nu_{\ell}$. Then the branching fractions are ${\cal B}(D^+_s\to \phi e^+\nu_e) = (2.367_{-0.132}^{+0.256})\times 10^{-3}$ and ${\cal B}(D^+_s\to \phi \mu^+\nu_{\mu}) = (2.349_{-0.132}^{+0.255})\times 10^{-3}$, which show good agreement with the data issued by the BESIII, the CLEO, and the BABAR Collaborations. We finally calculate $D^+_s\to\phi\ell^+ \nu_\ell$ polarization and asymmetry parameters.


title: ST-LDM: A Universal Framework for Text-Grounded Object Generation in Real Images

abstract: We present a novel image editing scenario termed Text-grounded Object Generation (TOG), defined as generating a new object in the real image spatially conditioned by textual descriptions. Existing diffusion models exhibit limitations of spatial perception in complex real-world scenes, relying on additional modalities to enforce constraints, and TOG imposes heightened challenges on scene comprehension under the weak supervision of linguistic information. We propose a universal framework ST-LDM based on Swin-Transformer, which can be integrated into any latent diffusion model with training-free backward guidance. ST-LDM encompasses a global-perceptual autoencoder with adaptable compression scales and hierarchical visual features, parallel with deformable multimodal transformer to generate region-wise guidance for the subsequent denoising process. We transcend the limitation of traditional attention mechanisms that only focus on existing visual features by introducing deformable feature alignment to hierarchically refine spatial positioning fused with multi-scale visual and linguistic information. Extensive Experiments demonstrate that our model enhances the localization of attention mechanisms while preserving the generative capabilities inherent to diffusion models.


title: Securing Federated Learning with Control-Flow Attestation: A Novel Framework for Enhanced Integrity and Resilience against Adversarial Attacks

abstract: The advent of Federated Learning (FL) as a distributed machine learning paradigm has introduced new cybersecurity challenges, notably adversarial attacks that threaten model integrity and participant privacy. This study proposes an innovative security framework inspired by Control-Flow Attestation (CFA) mechanisms, traditionally used in cybersecurity, to ensure software execution integrity. By integrating digital signatures and cryptographic hashing within the FL framework, we authenticate and verify the integrity of model updates across the network, effectively mitigating risks associated with model poisoning and adversarial interference. Our approach, novel in its application of CFA principles to FL, ensures contributions from participating nodes are authentic and untampered, thereby enhancing system resilience without compromising computational efficiency or model performance. Empirical evaluations on benchmark datasets, MNIST and CIFAR-10, demonstrate our framework's effectiveness, achieving a 100\% success rate in integrity verification and authentication and notable resilience against adversarial attacks. These results validate the proposed security enhancements and open avenues for more secure, reliable, and privacy-conscious distributed machine learning solutions. Our work bridges a critical gap between cybersecurity and distributed machine learning, offering a foundation for future advancements in secure FL.


title: Graph Enhanced Reinforcement Learning for Effective Group Formation in Collaborative Problem Solving

abstract: This study addresses the challenge of forming effective groups in collaborative problem-solving environments. Recognizing the complexity of human interactions and the necessity for efficient collaboration, we propose a novel approach leveraging graph theory and reinforcement learning. Our methodology involves constructing a graph from a dataset where nodes represent participants, and edges signify the interactions between them. We conceptualize each participant as an agent within a reinforcement learning framework, aiming to learn an optimal graph structure that reflects effective group dynamics. Clustering techniques are employed to delineate clear group structures based on the learned graph. Our approach provides theoretical solutions based on evaluation metrics and graph measurements, offering insights into potential improvements in group effectiveness and reductions in conflict incidences. This research contributes to the fields of collaborative work and educational psychology by presenting a data-driven, analytical approach to group formation. It has practical implications for organizational team building, classroom settings, and any collaborative scenario where group dynamics are crucial. The study opens new avenues for exploring the application of graph theory and reinforcement learning in social and behavioral sciences, highlighting the potential for empirical validation in future work.


title: Compositionally Verifiable Vector Neural Lyapunov Functions for Stability Analysis of Interconnected Nonlinear Systems

abstract: While there has been increasing interest in using neural networks to compute Lyapunov functions, verifying that these functions satisfy the Lyapunov conditions and certifying stability regions remain challenging due to the curse of dimensionality. In this paper, we demonstrate that by leveraging the compositional structure of interconnected nonlinear systems, it is possible to verify neural Lyapunov functions for high-dimensional systems beyond the capabilities of current satisfiability modulo theories (SMT) solvers using a monolithic approach. Our numerical examples employ neural Lyapunov functions trained by solving Zubov's partial differential equation (PDE), which characterizes the domain of attraction for individual subsystems. These examples show a performance advantage over sums-of-squares (SOS) polynomial Lyapunov functions derived from semidefinite programming.


title: Language to Map: Topological map generation from natural language path instructions

abstract: In this paper, a method for generating a map from path information described using natural language (textual path) is proposed. In recent years, robotics research mainly focus on vision-and-language navigation (VLN), a navigation task based on images and textual paths. Although VLN is expected to facilitate user instructions to robots, its current implementation requires users to explain the details of the path for each navigation session, which results in high explanation costs for users. To solve this problem, we proposed a method that creates a map as a topological map from a textual path and automatically creates a new path using this map. We believe that large language models (LLMs) can be used to understand textual path. Therefore, we propose and evaluate two methods, one for storing implicit maps in LLMs, and the other for generating explicit maps using LLMs. The implicit map is in the LLM's memory. It is created using prompts. In the explicit map, a topological map composed of nodes and edges is constructed and the actions at each node are stored. This makes it possible to estimate the path and actions at waypoints on an undescribed path, if enough information is available. Experimental results on path instructions generated in a real environment demonstrate that generating explicit maps achieves significantly higher accuracy than storing implicit maps in the LLMs.


title: Cardiac Magnetic Resonance 2D+T Short- and Long-axis Segmentation via Spatio-temporal SAM Adaptation

abstract: Accurate 2D+T myocardium segmentation in cine cardiac magnetic resonance (CMR) scans is essential to analyze LV motion throughout the cardiac cycle comprehensively. The Segment Anything Model (SAM), known for its accurate segmentation and zero-shot generalization, has not yet been tailored for CMR 2D+T segmentation. We therefore introduce CMR2D+T-SAM, a novel approach to adapt SAM for CMR 2D+T segmentation using spatio-temporal adaption. This approach also incorporates a U-Net framework for multi-scale feature extraction, as well as text prompts for accurate segmentation on both short-axis (SAX) and long-axis (LAX) views using a single model. CMR2D+T-SAM outperforms existing deep learning methods on the STACOM2011 dataset, achieving a myocardium Dice score of 0.885 and a Hausdorff distance (HD) of 2.900 pixels. It also demonstrates superior zero-shot generalization on the ACDC dataset with a Dice score of 0.840 and a HD of 4.076 pixels.


title: Measurements of All-Particle Energy Spectrum and Mean Logarithmic Mass of Cosmic Rays from 0.3 to 30 PeV with LHAASO-KM2A

abstract: We present the measurements of all-particle energy spectrum and mean logarithmic mass of cosmic rays in the energy range of 0.3-30 PeV using data collected from LHAASO-KM2A between September 2021 and December 2022, which is based on a nearly composition-independent energy reconstruction method, achieving unprecedented accuracy. Our analysis reveals the position of the knee at $3.67 \pm 0.05 \pm 0.15$ PeV. Below the knee, the spectral index is found to be -$2.7413 \pm 0.0004 \pm 0.0050$, while above the knee, it is -$3.128 \pm 0.005 \pm 0.027$, with the sharpness of the transition measured with a statistical error of 2%. The mean logarithmic mass of cosmic rays is almost heavier than helium in the whole measured energy range. It decreases from 1.7 at 0.3 PeV to 1.3 at 3 PeV, representing a 24% decline following a power law with an index of -$0.1200 \pm 0.0003 \pm 0.0341$. This is equivalent to an increase in abundance of light components. Above the knee, the mean logarithmic mass exhibits a power law trend towards heavier components, which is reversal to the behavior observed in the all-particle energy spectrum. Additionally, the knee position and the change in power-law index are approximately the same. These findings suggest that the knee observed in the all-particle spectrum corresponds to the knee of the light component, rather than the medium-heavy components.


title: Clustering and chaotic motion of heavy inertial particles in an isolated non-axisymmetric vortex

abstract: We investigate the dynamics of heavy inertial particles in a flow field due to an isolated, non-axisymmetric vortex. For our study, we consider a canonical elliptical vortex - the Kirchhoff vortex and its strained variant, the Kida vortex. Contrary to the anticipated centrifugal dispersion of inertial particles, which is typical in open vortical flows, we observe the clustering of particles around co-rotating attractors near the Kirchhoff vortex due to its non-axisymmetric nature. We analyze the inertia-modified stability characteristics of the fixed points, highlighting how some of the fixed points migrate in physical space, collide and then annihilate with increasing particle inertia. The introduction of external straining, the Kida vortex being an example, introduces chaotic tracer transport. Using a Melnikov analysis, we show that particle inertia and external straining can compete, where chaotic transport can be suppressed beyond a critical value of particle inertia.


title: Real-World Computational Aberration Correction via Quantized Domain-Mixing Representation

abstract: Relying on paired synthetic data, existing learning-based Computational Aberration Correction (CAC) methods are confronted with the intricate and multifaceted synthetic-to-real domain gap, which leads to suboptimal performance in real-world applications. In this paper, in contrast to improving the simulation pipeline, we deliver a novel insight into real-world CAC from the perspective of Unsupervised Domain Adaptation (UDA). By incorporating readily accessible unpaired real-world data into training, we formalize the Domain Adaptive CAC (DACAC) task, and then introduce a comprehensive Real-world aberrated images (Realab) dataset to benchmark it. The setup task presents a formidable challenge due to the intricacy of understanding the target aberration domain. To this intent, we propose a novel Quntized Domain-Mixing Representation (QDMR) framework as a potent solution to the issue. QDMR adapts the CAC model to the target domain from three key aspects: (1) reconstructing aberrated images of both domains by a VQGAN to learn a Domain-Mixing Codebook (DMC) which characterizes the degradation-aware priors; (2) modulating the deep features in CAC model with DMC to transfer the target domain knowledge; and (3) leveraging the trained VQGAN to generate pseudo target aberrated images from the source ones for convincing target domain supervision. Extensive experiments on both synthetic and real-world benchmarks reveal that the models with QDMR consistently surpass the competitive methods in mitigating the synthetic-to-real gap, which produces visually pleasant real-world CAC results with fewer artifacts. Codes and datasets will be made publicly available.


title: LyZNet: A Lightweight Python Tool for Learning and Verifying Neural Lyapunov Functions and Regions of Attraction

abstract: In this paper, we describe a lightweight Python framework that provides integrated learning and verification of neural Lyapunov functions for stability analysis. The proposed tool, named LyZNet, learns neural Lyapunov functions using physics-informed neural networks (PINNs) to solve Zubov's equation and verifies them using satisfiability modulo theories (SMT) solvers. What distinguishes this tool from others in the literature is its ability to provide verified regions of attraction close to the domain of attraction. This is achieved by encoding Zubov's partial differential equation (PDE) into the PINN approach. By embracing the non-convex nature of the underlying optimization problems, we demonstrate that in cases where convex optimization, such as semidefinite programming, fails to capture the domain of attraction, our neural network framework proves more successful. The tool also offers automatic decomposition of coupled nonlinear systems into a network of low-dimensional subsystems for compositional verification. We illustrate the tool's usage and effectiveness with several numerical examples, including both non-trivial low-dimensional nonlinear systems and high-dimensional systems. The repository of the tool can be found at https://git.uwaterloo.ca/hybrid-systems-lab/lyznet.


title: NNCTC: Physical Layer Cross-Technology Communication via Neural Networks

abstract: Cross-technology communication(CTC) enables seamless interactions between diverse wireless technologies. Most existing work is based on reversing the transmission path to identify the appropriate payload to generate the waveform that the target devices can recognize. However, this method suffers from many limitations, including dependency on specific technologies and the necessity for intricate algorithms to mitigate distortion. In this work, we present NNCTC, a Neural-Network-based Cross-Technology Communication framework inspired by the adaptability of trainable neural models in wireless communications. By converting signal processing components within the CTC pipeline into neural models, the NNCTC is designed for end-to-end training without requiring labeled data. This enables the NNCTC system to autonomously derive the optimal CTC payload, which significantly eases the development complexity and showcases the scalability potential for various CTC links. Particularly, we construct a CTC system from Wi-Fi to ZigBee. The NNCTC system outperforms the well-recognized WEBee and WIDE design in error performance, achieving an average packet reception rate(PRR) of 92.3% and an average symbol error rate(SER) as low as 1.3%.


title: Linear optimal transport subspaces for point set classification

abstract: Learning from point sets is an essential component in many computer vision and machine learning applications. Native, unordered, and permutation invariant set structure space is challenging to model, particularly for point set classification under spatial deformations. Here we propose a framework for classifying point sets experiencing certain types of spatial deformations, with a particular emphasis on datasets featuring affine deformations. Our approach employs the Linear Optimal Transport (LOT) transform to obtain a linear embedding of set-structured data. Utilizing the mathematical properties of the LOT transform, we demonstrate its capacity to accommodate variations in point sets by constructing a convex data space, effectively simplifying point set classification problems. Our method, which employs a nearest-subspace algorithm in the LOT space, demonstrates label efficiency, non-iterative behavior, and requires no hyper-parameter tuning. It achieves competitive accuracies compared to state-of-the-art methods across various point set classification tasks. Furthermore, our approach exhibits robustness in out-of-distribution scenarios where training and test distributions vary in terms of deformation magnitudes.


title: On the Existence and Regularity for Stationary Boltzmann Equation in a Small Domain

abstract: In this article, we study the stationary Boltzmann equation with the incoming boundary condition for the hard potential cases. Assuming the smallness of the domain and a suitable normal curvature condition on the boundary, we find a suitable solution space which is a proper subset of the $W^{1,p}$ space for $1 \leq p <3$.


title: Generation of isolated attosecond electron bunches by the diffraction of a polarization-tailored intense laser beam

abstract: We propose utilizing a polarization-tailored high-power laser pulse to extract and accelerate electrons from the edge of a solid foil target to produce isolated attosecond electron bunches. The laser pulse consists of two orthogonally-polarized components with a time delay comparable to the pulse duration, such that the polarization in the middle of the pulse rapidly rotates over 90$^\circ$ within few optical cycles. Three-dimensional (3D) Particle-in-Cell simulations show that when such a light pulse diffracts at the edge of a plasma foil, a series of isolated relativistic electron bunches are emitted into separated azimuthal angles determined by the varying polarization. In comparison with most other methods that require an ultra-short drive laser, we show the proposed scheme works well with typical multi-cycle ($\sim 30~$fs) pulses from high-power laser facilities. The generated electron bunches have typical durations of a few hundred attoseconds and charges of tens of picocoulombs.


title: Sample complexity of matrix product states at finite temperature

abstract: For quantum many-body systems in one dimension, computational complexity theory reveals that the evaluation of ground-state energy remains elusive on quantum computers, contrasting the existence of a classical algorithm for temperatures higher than the inverse logarithm of the system size. This highlights a qualitative difference between low- and high-temperature states in terms of computational complexity. Here, we describe finite-temperature states using the matrix product state formalism. Within the framework of random samplings, we derive an analytical formula for the required number of samples, which provides both quantitative and qualitative measures of computational complexity. At high and low temperatures, its scaling behavior with system size is linear and quadratic, respectively, demonstrating a distinct crossover between these numerically difficult regimes of quantitative difference.


title: Thermal control of long delay lines in a high-resolution astrophotonic spectrograph

abstract: High-resolution astronomical spectroscopy carried out with a photonic Fourier transform spectrograph (FTS) requires long asymmetrical optical delay lines that can be dynamically tuned. For example, to achieve a spectral resolution of R = 30,000, a delay line as long as 1.5 cm would be required. Such delays are inherently prone to phase errors caused by temperature fluctuations. This is due to the relatively large thermo-optic coefficient and long lengths of the waveguides, in this case composed of SiN, resulting in thermally dependent changes to the optical path length. To minimize phase error to the order of 0.05 radians, thermal stability of the order of 0.05{\deg} C is necessary. A thermal control system capable of stability such as this would require a fast thermal response and minimal overshoot/undershoot. With a PID temperature control loop driven by a Peltier cooler and thermistor, we minimized interference fringe phase error to +/- 0.025 radians and achieved temperature stability on the order of 0.05{\deg} C. We present a practical system for precision temperature control of a foundry-fabricated and packaged FTS device on a SiN platform with delay lines ranging from 0.5 to 1.5 cm in length using inexpensive off-the-shelf components, including design details, control loop optimization, and considerations for thermal control of integrated photonics.


title: Lost in Overlap: Exploring Watermark Collision in LLMs

abstract: The proliferation of large language models (LLMs) in generating content raises concerns about text copyright. Watermarking methods, particularly logit-based approaches, embed imperceptible identifiers into text to address these challenges. However, the widespread use of watermarking across diverse LLMs has led to an inevitable issue known as watermark collision during common tasks like question answering and paraphrasing. This study focuses on dual watermark collisions, where two watermarks are present simultaneously in the same text. The research demonstrates that watermark collision poses a threat to detection performance for detectors of both upstream and downstream watermark algorithms.


title: Time-Frequency Jointed Imperceptible Adversarial Attack to Brainprint Recognition with Deep Learning Models

abstract: EEG-based brainprint recognition with deep learning models has garnered much attention in biometric identification. Yet, studies have indicated vulnerability to adversarial attacks in deep learning models with EEG inputs. In this paper, we introduce a novel adversarial attack method that jointly attacks time-domain and frequency-domain EEG signals by employing wavelet transform. Different from most existing methods which only target time-domain EEG signals, our method not only takes advantage of the time-domain attack's potent adversarial strength but also benefits from the imperceptibility inherent in frequency-domain attack, achieving a better balance between attack performance and imperceptibility. Extensive experiments are conducted in both white- and grey-box scenarios and the results demonstrate that our attack method achieves state-of-the-art attack performance on three datasets and three deep-learning models. In the meanwhile, the perturbations in the signals attacked by our method are barely perceptible to the human visual system.


title: Lifelong Person Re-Identification with Backward-Compatibility

abstract: Lifelong person re-identification (LReID) assumes a practical scenario where the model is sequentially trained on continuously incoming datasets while alleviating the catastrophic forgetting in the old datasets. However, not only the training datasets but also the gallery images are incrementally accumulated, that requires a huge amount of computational complexity and storage space to extract the features at the inference phase. In this paper, we address the above mentioned problem by incorporating the backward-compatibility to LReID for the first time. We train the model using the continuously incoming datasets while maintaining the model's compatibility toward the previously trained old models without re-computing the features of the old gallery images. To this end, we devise the cross-model compatibility loss based on the contrastive learning with respect to the replay features across all the old datasets. Moreover, we also develop the knowledge consolidation method based on the part classification to learn the shared representation across different datasets for the backward-compatibility. We suggest a more practical methodology for performance evaluation as well where all the gallery and query images are considered together. Experimental results demonstrate that the proposed method achieves a significantly higher performance of the backward-compatibility compared with the existing methods. It is a promising tool for more practical scenarios of LReID.


title: Measurement-device-independent quantum random number generation over 23 Mbps with imperfect single-photon sources

abstract: Quantum randomness relies heavily on the accurate characterization of the generator implementation, where the device imperfection or inaccurate characterization can lead to incorrect entropy estimation and practical bias, significantly affecting the reliability of the generated randomness. Measurement-device-independent (MDI) quantum random number generation (QRNG) endeavors to produce certified randomness, utilizing uncharacterized and untrusted measurement devices that are vulnerable to numerous attack schemes targeting measurement loopholes. However, existing implementations have shown insufficient performance thus far. Here, we propose a high-speed MDI-QRNG scheme based on a robust measurement tomography approach against the imperfection of single-photon sources. Compared with the conventional approach, the decoy-state method is introduced to obtain more accurate tomography results and a tighter lower bound of randomness. Finally, by using a high-speed time-bin encoding system, we experimentally demonstrated the scheme and obtained a reliable min-entropy lower bound of $7.37 \times 10^{-2}$ bits per pulse, corresponding to a generation rate over 23 Mbps, which substantially outperforms the existing realizations and makes a record in discrete-variable semi-device-independent QRNGs.


title: MR-MT3: Memory Retaining Multi-Track Music Transcription to Mitigate Instrument Leakage

abstract: This paper presents enhancements to the MT3 model, a state-of-the-art (SOTA) token-based multi-instrument automatic music transcription (AMT) model. Despite SOTA performance, MT3 has the issue of instrument leakage, where transcriptions are fragmented across different instruments. To mitigate this, we propose MR-MT3, with enhancements including a memory retention mechanism, prior token sampling, and token shuffling are proposed. These methods are evaluated on the Slakh2100 dataset, demonstrating improved onset F1 scores and reduced instrument leakage. In addition to the conventional multi-instrument transcription F1 score, new metrics such as the instrument leakage ratio and the instrument detection F1 score are introduced for a more comprehensive assessment of transcription quality. The study also explores the issue of domain overfitting by evaluating MT3 on single-instrument monophonic datasets such as ComMU and NSynth. The findings, along with the source code, are shared to facilitate future work aimed at refining token-based multi-instrument AMT models.


title: Microscopic Modeling, Multi-magnon condensation and Strain effect in chain compound NaVOPO$_4$

abstract: Employing first-principles modelling and many-body methods, the magnetic properties of spin-1/2 chain compound NaVOPO$_4$ are explored. The extensive first-principles calculations establish an intricate three-dimensionally coupled model that consists of weakly alternating $J$-$J^{'}$ antiferromagnetic chains running along cris-cross directions between two consecutive $ab$ planes, connected via two subleading couplings, a ferromagnetic exchange along the $c$ direction ($J_c$) and a weaker antiferromagnetic exchange ($J_a$) along the body diagonal direction. The exact diagonalization and density matrix renormalized group study have been carried out on a two-dimensional spin model with $J$-$J^{'}$-$J_c$ and effective $J_d$ couplings, constructed based on the full model, for numerical ease. The $J_c$-$J_d$ phase diagram is found to host a {\it disorder} phase with finite spin gap for comparable values of $J_c$ and $J_d$, arising out of the competing nature of these two interactions, other than two ordered phases. The predominant manifestation of $J_c$ and $J_d$ in the disorder phase happens in stabilisation of a multi-magnon condensed phase, upon gap closing by application of an external magnetic field. We further explore the effect of tensile uniaxial strain, which is found to drive the system from gapful to gapless ground state.


title: High sensitivity and large scanning range optical antennas enabled by multi-casting ridge-waveguide subwavelength structure arrays

abstract: With the rapid development of large-scale integrated photonics, optical phased array (OPA) is an effective way to realize highly integrated, stable and low-cost beam control system. Achieving a large field of view (FOV) in the longitudinal direction without increasing fabrication cost and system complexity is still a significant challenge in OPA antennas. Here, a high sensitivity and large scanning range antenna based on subwavelength structure array is proposed to enhance the longitudinal scanning and free-space radiating efficiency by using the ridge-waveguide structure and backward-emitting. A millimeter-long grating antenna with a far-field beam divergence of 0.13{\deg} and a wavelength sensitivity of 0.237{\deg}/nm is experimentally demonstrated. Furthermore, by using different sideband periods, we introduce a multi-casting grating antenna with a large scanning range up to 42.6{\deg}. The proposed devices show significant improvement in longitudinal wavelength sensitivity compared with the typical waveguide grating antennas.


title: Magneto-optical properties of a quantum dot array interacting with a far-infrared photon mode of a cylindrical cavity

abstract: We model the equilibrium properties of a two-dimensional electron gas in a square lateral superlattice of quantum dots in a GaAs heterostructure subject to an external homogeneous perpendicular magnetic field and a far-infrared circular cylindrical photon cavity with one quantized mode, the TE011 mode. In a truncated linear basis constructed by a tensor product of the single-electron states of the noninteracting system and the eigenstates of the photon number operator, a local spin density approximation of density functional theory is used to compute the electron-photon states of the two-dimensional electron gas in the cavity. The common spatial symmetry of the vector fields for the external magnetic field and the cavity photon field in the long wavelength approximation enhances higher order magnetic single- and multi-photon processes for both the para- and the diamagnetic electron-photon interactions. The electron-photon coupling introduces explicit photon replicas into the bandstructure and all subbands gain a photon content, constant for each subband, that can deviate from an integer value as the coupling is increased or the photon energy is varied. The subbands show a complex Rabi anticrossing behavior when the photon energy and the coupling bring subbands into resonances. The complicated energy subband structure leads to photon density variations in reciprocal space when resonances occur in the spectrum. The electron-photon coupling polarizes the charge density and tends to reduce the Coulomb exchange effects as the coupling strength increases.


title: Nonmagnetic Ground State in RuO$_2$ Revealed by Muon Spin Rotation

abstract: The magnetic ground state of single crystalline RuO$_2$ was investigated by the muon spin rotation/relaxation ($\mu$SR) experiment. The spin precession signal due to the spontaneous internal magnetic field $B_{\rm loc}$, which is expected in the magnetically ordered phase, was not observed in the temperature range 5--400~K. Muon sites were evaluated by first-principles calculations using dilute hydrogen simulating muon as pseudo-hydrogen, and $B_{\rm loc}$ was simulated for the antiferromagnetic (AFM) structures with a Ru magnetic moment $|{\bf m}_{\rm Ru}|\approx0.05\mu_\mathrm{B}$ suggested from diffraction experiments. As a result, the possibility was ruled out that muons are localized at sites where $B_{\rm loc}$ accidentally cancels. Conversely, assuming that the slow relaxation observed in $\mu$SR spectra was part of the precession signal, the upper limit for the magnitude of $|{\bf m}_{\rm Ru}|$ was estimated to be $4.8(2)\times10^{-4}\mu_{\rm B}$, which is significantly less than $0.05\mu_\mathrm{B}$. These results indicate that the AFM order, as reported, is unlikely to exist in the bulk crystal.


title: Low-cost and Convenient Fabrication of Polymer Micro/Nanopores with the Needle Punching Process and Their Applications in Nanofluidic Sensing

abstract: Solid-state micro/nanopores play an important role in the sensing field because of their high stability and controllable size. Aiming at problems of complex processes and high costs in pore manufacturing, we propose a convenient and low-cost micro/nanopore fabrication technique based on the needle punching method. The thin film is pierced by controlling the feed of a microscale tungsten needle, and the size variations of the micropore are monitored by the current feedback system. Based on the positive correlation between the micropore size and the current threshold, the size-controllable preparation of micropores is achieved. The preparation of nanopores is realized by the combination of needle punching and chemical etching. Firstly, a conical defect is prepared on the film with the tungsten needle. Then, nanopores are obtained by unilateral chemical etching of the film. Using the prepared conical micropores resistive-pulse detection of nanoparticles is performed. Significant ionic current rectification is also obtained with our conical nanopores. It is proved that the properties of micro/nanopores prepared by our method are comparable to those prepared by the track-etching method. The simple and controllable fabrication process proposed here will advance the development of low-cost micro/nanopore sensors.


title: Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers

abstract: Vision Transformer (ViT) has emerged as a prominent backbone for computer vision. For more efficient ViTs, recent works lessen the quadratic cost of the self-attention layer by pruning or fusing the redundant tokens. However, these works faced the speed-accuracy trade-off caused by the loss of information. Here, we argue that token fusion needs to consider diverse relations between tokens to minimize information loss. In this paper, we propose a Multi-criteria Token Fusion (MCTF), that gradually fuses the tokens based on multi-criteria (e.g., similarity, informativeness, and size of fused tokens). Further, we utilize the one-step-ahead attention, which is the improved approach to capture the informativeness of the tokens. By training the model equipped with MCTF using a token reduction consistency, we achieve the best speed-accuracy trade-off in the image classification (ImageNet1K). Experimental results prove that MCTF consistently surpasses the previous reduction methods with and without training. Specifically, DeiT-T and DeiT-S with MCTF reduce FLOPs by about 44% while improving the performance (+0.5%, and +0.3%) over the base model, respectively. We also demonstrate the applicability of MCTF in various Vision Transformers (e.g., T2T-ViT, LV-ViT), achieving at least 31% speedup without performance degradation. Code is available at https://github.com/mlvlab/MCTF.


title: Moduli difference of inverse logarithmic coefficients of univalent functions

abstract: Let $f$ be analytic in the unit disk and $\mathcal{S}$ be the subclass of normalized univalent functions with $f(0) = 0$, and $f'(0) = 1$. Let $F$ be the inverse function of $f$, given by $F(w)=w+\sum_{n=2}^{\infty}A_nw^n$ defined on some disk $|w|\le r_0(f)$. The inverse logarithmic coefficients $\Gamma_n$, $n \in \mathbb{N}$, of $f$ are defined by the equation $ \log(F(w)/w)=2\sum_{n=1}^{\infty}\Gamma_{n}w^{n},\,|w|<1/4.$ In this paper, we find the sharp upper and lower bounds for moduli difference of second and first inverse logarithmic coefficients, {\em i.e.,} $|\Gamma_2|-|\Gamma_1|$ for functions in class $\mathcal{S}$ and for functions in some important subclasses of univalent functions.


title: Quantum Circuits for partial differential equations via Schr\"odingerisation

abstract: Quantum computing has emerged as a promising avenue for achieving significant speedup, particularly in large-scale PDE simulations, compared to classical computing. One of the main quantum approaches involves utilizing Hamiltonian simulation, which is directly applicable only to Schr\"odinger-type equations. To address this limitation, Schr\"odingerisation techniques have been developed, employing the warped transformation to convert general linear PDEs into Schr\"odinger-type equations. However, despite the development of Schr\"odingerisation techniques, the explicit implementation of the corresponding quantum circuit for solving general PDEs remains to be designed. In this paper, we present detailed implementation of a quantum algorithm for general PDEs using Schr\"odingerisation techniques. We provide examples of the heat equation, and the advection equation approximated by the upwind scheme, to demonstrate the effectiveness of our approach. Complexity analysis is also carried out to demonstrate the quantum advantages of these algorithms in high dimensions over their classical counterparts.


title: Ipelets for the Convex Polygonal Geometry

abstract: There are many structures, both classical and modern, involving convex polygonal geometries whose deeper understanding would be facilitated through interactive visualizations. The Ipe extensible drawing editor, developed by Otfried Cheong, is a widely used software system for generating geometric figures. One of its features is the capability to extend its functionality through programs called Ipelets. In this media submission, we showcase a collection of new Ipelets that construct a variety of geometric objects based on polygonal geometries. These include Macbeath regions, metric balls in the forward and reverse Funk distance, metric balls in the Hilbert metric, polar bodies, the minimum enclosing ball of a point set, and minimum spanning trees in both the Funk and Hilbert metrics. We also include a number of utilities on convex polygons, including union, intersection, subtraction, and Minkowski sum (previously implemented as a CGAL Ipelet). All of our Ipelets are programmed in Lua and are freely available.


title: Inference for Heterogeneous Graphical Models using Doubly High-Dimensional Linear-Mixed Models

abstract: Motivated by the problem of inferring the graph structure of functional connectivity networks from multi-level functional magnetic resonance imaging data, we develop a valid inference framework for high-dimensional graphical models that accounts for group-level heterogeneity. We introduce a neighborhood-based method to learn the graph structure and reframe the problem as that of inferring fixed effect parameters in a doubly high-dimensional linear mixed model. Specifically, we propose a LASSO-based estimator and a de-biased LASSO-based inference framework for the fixed effect parameters in the doubly high-dimensional linear mixed model, leveraging random matrix theory to deal with challenges induced by the identical fixed and random effect design matrices arising in our setting. Moreover, we introduce consistent estimators for the variance components to identify subject-specific edges in the inferred graph. To illustrate the generality of the proposed approach, we also adapt our method to account for serial correlation by learning heterogeneous graphs in the setting of a vector autoregressive model. We demonstrate the performance of the proposed framework using real data and benchmark simulation studies.


title: Giant Spin Splitting and its Origin in Methylhydrazinium Lead Halide Perovskites

abstract: Spin splitting, or removal of spin degeneracy in the electronic energy band/level is often a measure of spin-orbit coupling strength and a way to manipulate spin degrees of freedom. We use first-principles simulations to predict giant spin splitting in methylhydrazinium lead halide (MHyPbX$_3$, MHy = CH$_3$NH$_2$NH$_2$, X = Br and Cl) hybrid organic-inorganic perovskites. The values can reach up to 408.0~meV at zero Kelvin and 281.6~meV at room temperature. The origin of the effect is traced to the large distortion of PbX$_3$ framework, driven primarily by Pb ions in the ferroelectric $\Gamma^{3-}$ mode. The Pb displacements consist of combination of polar and antipolar arrangements and result in up to 39.2~meV/atom enhancement of the spin-orbit coupling energy in the polar phase of the materials. The spin-orbit coupling gives origin to highly persistent spin textures in MHyPbX$_3$, which are desirable for applications in spintronics and quantum computing. Our findings reveal an additional functionality for hybrid organic-inorganic perovskite and open a way for the design of more materials with giant spin splitting.


title: SparseFusion: Efficient Sparse Multi-Modal Fusion Framework for Long-Range 3D Perception

abstract: Multi-modal 3D object detection has exhibited significant progress in recent years. However, most existing methods can hardly scale to long-range scenarios due to their reliance on dense 3D features, which substantially escalate computational demands and memory usage. In this paper, we introduce SparseFusion, a novel multi-modal fusion framework fully built upon sparse 3D features to facilitate efficient long-range perception. The core of our method is the Sparse View Transformer module, which selectively lifts regions of interest in 2D image space into the unified 3D space. The proposed module introduces sparsity from both semantic and geometric aspects which only fill grids that foreground objects potentially reside in. Comprehensive experiments have verified the efficiency and effectiveness of our framework in long-range 3D perception. Remarkably, on the long-range Argoverse2 dataset, SparseFusion reduces memory footprint and accelerates the inference by about two times compared to dense detectors. It also achieves state-of-the-art performance with mAP of 41.2% and CDS of 32.1%. The versatility of SparseFusion is also validated in the temporal object detection task and 3D lane detection task. Codes will be released upon acceptance.


title: Knowledge Condensation and Reasoning for Knowledge-based VQA

abstract: Knowledge-based visual question answering (KB-VQA) is a challenging task, which requires the model to leverage external knowledge for comprehending and answering questions grounded in visual content. Recent studies retrieve the knowledge passages from external knowledge bases and then use them to answer questions. However, these retrieved knowledge passages often contain irrelevant or noisy information, which limits the performance of the model. To address the challenge, we propose two synergistic models: Knowledge Condensation model and Knowledge Reasoning model. We condense the retrieved knowledge passages from two perspectives. First, we leverage the multimodal perception and reasoning ability of the visual-language models to distill concise knowledge concepts from retrieved lengthy passages, ensuring relevance to both the visual content and the question. Second, we leverage the text comprehension ability of the large language models to summarize and condense the passages into the knowledge essence which helps answer the question. These two types of condensed knowledge are then seamlessly integrated into our Knowledge Reasoning model, which judiciously navigates through the amalgamated information to arrive at the conclusive answer. Extensive experiments validate the superiority of the proposed method. Compared to previous methods, our method achieves state-of-the-art performance on knowledge-based VQA datasets (65.1% on OK-VQA and 60.1% on A-OKVQA) without resorting to the knowledge produced by GPT-3 (175B).


title: The Table of the Structure Constants for the Complex Simple Lie Algebra of Type E_6 and Chevalley Commutator Formulas in the Chevalley Group of Type E_6 over a Field

abstract: This article is the third in the series. It is devoted the calculation of the structure constants for the complex simple Lie algebra of type E_6 and Chevalley commutator formulas.


title: Rethinking Low-quality Optical Flow in Unsupervised Surgical Instrument Segmentation

abstract: Video-based surgical instrument segmentation plays an important role in robot-assisted surgeries. Unlike supervised settings, unsupervised segmentation relies heavily on motion cues, which are challenging to discern due to the typically lower quality of optical flow in surgical footage compared to natural scenes. This presents a considerable burden for the advancement of unsupervised segmentation techniques. In our work, we address the challenge of enhancing model performance despite the inherent limitations of low-quality optical flow. Our methodology employs a three-pronged approach: extracting boundaries directly from the optical flow, selectively discarding frames with inferior flow quality, and employing a fine-tuning process with variable frame rates. We thoroughly evaluate our strategy on the EndoVis2017 VOS dataset and Endovis2017 Challenge dataset, where our model demonstrates promising results, achieving a mean Intersection-over-Union (mIoU) of 0.75 and 0.72, respectively. Our findings suggest that our approach can greatly decrease the need for manual annotations in clinical environments and may facilitate the annotation process for new datasets. The code is available at https://github.com/wpr1018001/Rethinking-Low-quality-Optical-Flow.git


title: Histo-Genomic Knowledge Distillation For Cancer Prognosis From Histopathology Whole Slide Images

abstract: Histo-genomic multi-modal methods have recently emerged as a powerful paradigm, demonstrating significant potential for improving cancer prognosis. However, genome sequencing, unlike histopathology imaging, is still not widely accessible in underdeveloped regions, limiting the application of these multi-modal approaches in clinical settings. To address this, we propose a novel Genome-informed Hyper-Attention Network, termed G-HANet, which is capable of effectively distilling the histo-genomic knowledge during training to elevate uni-modal whole slide image (WSI)-based inference for the first time. Compared with traditional knowledge distillation methods (i.e., teacher-student architecture) in other tasks, our end-to-end model is superior in terms of training efficiency and learning cross-modal interactions. Specifically, the network comprises the cross-modal associating branch (CAB) and hyper-attention survival branch (HSB). Through the genomic data reconstruction from WSIs, CAB effectively distills the associations between functional genotypes and morphological phenotypes and offers insights into the gene expression profiles in the feature space. Subsequently, HSB leverages the distilled histo-genomic associations as well as the generated morphology-based weights to achieve the hyper-attention modeling of the patients from both histopathology and genomic perspectives to improve cancer prognosis. Extensive experiments are conducted on five TCGA benchmarking datasets and the results demonstrate that G-HANet significantly outperforms the state-of-the-art WSI-based methods and achieves competitive performance with genome-based and multi-modal methods. G-HANet is expected to be explored as a useful tool by the research community to address the current bottleneck of insufficient histo-genomic data pairing in the context of cancer prognosis and precision oncology.


title: Towards Embedding Dynamic Personas in Interactive Robots: Masquerading Animated Social Kinematics (MASK)

abstract: This paper presents the design and development of an innovative interactive robotic system to enhance audience engagement using character-like personas. Built upon the foundations of persona-driven dialog agents, this work extends the agent application to the physical realm, employing robots to provide a more immersive and interactive experience. The proposed system, named the Masquerading Animated Social Kinematics (MASK), leverages an anthropomorphic robot which interacts with guests using non-verbal interactions, including facial expressions and gestures. A behavior generation system based upon a finite-state machine structure effectively conditions robotic behavior to convey distinct personas. The MASK framework integrates a perception engine, a behavior selection engine, and a comprehensive action library to enable real-time, dynamic interactions with minimal human intervention in behavior design. Throughout the user subject studies, we examined whether the users could recognize the intended character in film-character-based persona conditions. We conclude by discussing the role of personas in interactive agents and the factors to consider for creating an engaging user experience.


title: Accurate and Data-Efficient Micro-XRD Phase Identification Using Multi-Task Learning: Application to Hydrothermal Fluids

abstract: Traditional analysis of highly distorted micro-X-ray diffraction ({\mu}-XRD) patterns from hydrothermal fluid environments is a time-consuming process, often requiring substantial data preprocessing and labeled experimental data. This study demonstrates the potential of deep learning with a multitask learning (MTL) architecture to overcome these limitations. We trained MTL models to identify phase information in {\mu}-XRD patterns, minimizing the need for labeled experimental data and masking preprocessing steps. Notably, MTL models showed superior accuracy compared to binary classification CNNs. Additionally, introducing a tailored cross-entropy loss function improved MTL model performance. Most significantly, MTL models tuned to analyze raw and unmasked XRD patterns achieved close performance to models analyzing preprocessed data, with minimal accuracy differences. This work indicates that advanced deep learning architectures like MTL can automate arduous data handling tasks, streamline the analysis of distorted XRD patterns, and reduce the reliance on labor-intensive experimental datasets.


title: GeoPro-VO: Dynamic Obstacle Avoidance with Geometric Projector Based on Velocity Obstacle

abstract: Optimization-based approaches are widely employed to generate optimal robot motions while considering various constraints, such as robot dynamics, collision avoidance, and physical limitations. It is crucial to efficiently solve the optimization problems in practice, yet achieving rapid computations remains a great challenge for optimization-based approaches with nonlinear constraints. In this paper, we propose a geometric projector for dynamic obstacle avoidance based on velocity obstacle (GeoPro-VO) by leveraging the projection feature of the velocity cone set represented by VO. Furthermore, with the proposed GeoPro-VO and the augmented Lagrangian spectral projected gradient descent (ALSPG) algorithm, we transform an initial mixed integer nonlinear programming problem (MINLP) in the form of constrained model predictive control (MPC) into a sub-optimization problem and solve it efficiently. Numerical simulations are conducted to validate the fast computing speed of our approach and its capability for reliable dynamic obstacle avoidance.


title: SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Model

abstract: Controllable spherical panoramic image generation holds substantial applicative potential across a variety of domains.However, it remains a challenging task due to the inherent spherical distortion and geometry characteristics, resulting in low-quality content generation.In this paper, we introduce a novel framework of SphereDiffusion to address these unique challenges, for better generating high-quality and precisely controllable spherical panoramic images.For the spherical distortion characteristic, we embed the semantics of the distorted object with text encoding, then explicitly construct the relationship with text-object correspondence to better use the pre-trained knowledge of the planar images.Meanwhile, we employ a deformable technique to mitigate the semantic deviation in latent space caused by spherical distortion.For the spherical geometry characteristic, in virtue of spherical rotation invariance, we improve the data diversity and optimization objectives in the training process, enabling the model to better learn the spherical geometry characteristic.Furthermore, we enhance the denoising process of the diffusion model, enabling it to effectively use the learned geometric characteristic to ensure the boundary continuity of the generated images.With these specific techniques, experiments on Structured3D dataset show that SphereDiffusion significantly improves the quality of controllable spherical image generation and relatively reduces around 35% FID on average.


title: Towards Adversarially Robust Dataset Distillation by Curvature Regularization

abstract: Dataset distillation (DD) allows datasets to be distilled to fractions of their original size while preserving the rich distributional information so that models trained on the distilled datasets can achieve a comparable accuracy while saving significant computational loads. Recent research in this area has been focusing on improving the accuracy of models trained on distilled datasets. In this paper, we aim to explore a new perspective of DD. We study how to embed adversarial robustness in distilled datasets, so that models trained on these datasets maintain the high accuracy and meanwhile acquire better adversarial robustness. We propose a new method that achieves this goal by incorporating curvature regularization into the distillation process with much less computational overhead than standard adversarial training. Extensive empirical experiments suggest that our method not only outperforms standard adversarial training on both accuracy and robustness with less computation overhead but is also capable of generating robust distilled datasets that can withstand various adversarial attacks.


title: Suppression of shear ionic motions in bismuth by coupling with large-amplitude internal displacement

abstract: Bismuth, with its rhombohedral crystalline structure and two Raman active phonon modes corresponding to the internal displacement ($A_{1g}$) and shear ($E_{g}$) ionic motions, offers an ideal target for the investigation of the phonon-phonon and electron-phonon couplings under photoexcitation. We perform transient reflectivity measurements of bismuth single crystal at 11 K over wide range of absorbed laser fluence up to $F_\text{abs}=9$ mJ/cm$^2$, at which a sign of an irreversible surface damage is observed. At the minimum fluence examined (0.1 mJ/cm$^2$) the coherent $A_{1g}$ and $E_g$ oscillations are a cosine and a sine functions of time, as are consistent with their generations in the displacive and impulsive limits, respectively. With increasing fluence the initial phases of the both modes deviate from their low-fluence values, indicating a finite time required for the transition from the ground-state potential energy surface (PES) to the excited-state one. Surprisingly, the $E_g$ amplitude increases with increasing fluence up to 3 mJ/cm$^2$ and then turns to an apparent decrease, in contrast to the monotonic increase of the $A_{1g}$ amplitude up to 6 mJ/cm$^2$. The contrasted behaviors can be understood by considering a two-dimensional PES, where the strongly driven $A_{1g}$ oscillation leads to a temporal fluctuation of the PES along the $E_g$ coordinate and thereby to a loss in the $E_g$ oscillation coherence at high fluences.


title: TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model

abstract: Existing scene text spotters are designed to locate and transcribe texts from images. However, it is challenging for a spotter to achieve precise detection and recognition of scene texts simultaneously. Inspired by the glimpse-focus spotting pipeline of human beings and impressive performances of Pre-trained Language Models (PLMs) on visual tasks, we ask: 1) "Can machines spot texts without precise detection just like human beings?", and if yes, 2) "Is text block another alternative for scene text spotting other than word or character?" To this end, our proposed scene text spotter leverages advanced PLMs to enhance performance without fine-grained detection. Specifically, we first use a simple detector for block-level text detection to obtain rough positional information. Then, we finetune a PLM using a large-scale OCR dataset to achieve accurate recognition. Benefiting from the comprehensive language knowledge gained during the pre-training phase, the PLM-based recognition module effectively handles complex scenarios, including multi-line, reversed, occluded, and incomplete-detection texts. Taking advantage of the fine-tuned language model on scene recognition benchmarks and the paradigm of text block detection, extensive experiments demonstrate the superior performance of our scene text spotter across multiple public benchmarks. Additionally, we attempt to spot texts directly from an entire scene image to demonstrate the potential of PLMs, even Large Language Models (LLMs).


title: Angular and radial stabilities of spontaneously scalarized black holes in the presence of scalar-Gauss-Bonnet couplings

abstract: We study the linear stability of spontaneously scalarized black holes (BHs) induced by a scalar field $\phi$ coupled to a Gauss-Bonnet (GB) invariant $R_{\rm GB}^2$. For the scalar-GB coupling $\xi(\phi)=(\eta/8) (\phi^2+\alpha \phi^4)$, where $\eta$ and $\alpha$ are constants, we first show that there are no angular Laplacian instabilities of even-parity perturbations far away from the horizon for large multipoles $l \gg 1$. The deviation of angular propagation speeds from the speed of light is largest on the horizon, whose property can be used to put constraints on the model parameters. For $\alpha \gtrsim -1$, the region in which the scalarized BH is subject to angular Laplacian instabilities can emerge. Provided that $\alpha \lesssim -1$ and $-1/2<\alpha \phi_0^2<-0.1155$, where $\phi_0$ is the field value on the horizon with a unit of the reduced Planck mass $M_{\rm Pl}=1$, there are scalarized BH solutions satisfying all the linear stability conditions throughout the horizon exterior. We also study the stability of spontaneously scalarized BHs in scalar-GB theories with a nonminimal coupling $-\beta \phi^2 R/16$, where $\beta$ is a positive constant and $R$ is a Ricci scalar. As the amplitude of the field on the horizon approaches an upper limit $|\phi_0|=4/\sqrt{\beta}$, one of the squared angular propagation speeds $c_{\Omega-}^2$ enters the instability region $c_{\Omega-}^2<0$. So long as $|\phi_0|$ is smaller than a maximum value determined for each $\beta$ in the range $\beta>5$, however, the scalarized BHs are linearly stable in both angular and radial directions.


title: PPM : A Pre-trained Plug-in Model for Click-through Rate Prediction

abstract: Click-through rate (CTR) prediction is a core task in recommender systems. Existing methods (IDRec for short) rely on unique identities to represent distinct users and items that have prevailed for decades. On one hand, IDRec often faces significant performance degradation on cold-start problem; on the other hand, IDRec cannot use longer training data due to constraints imposed by iteration efficiency. Most prior studies alleviate the above problems by introducing pre-trained knowledge(e.g. pre-trained user model or multi-modal embeddings). However, the explosive growth of online latency can be attributed to the huge parameters in the pre-trained model. Therefore, most of them cannot employ the unified model of end-to-end training with IDRec in industrial recommender systems, thus limiting the potential of the pre-trained model. To this end, we propose a $\textbf{P}$re-trained $\textbf{P}$lug-in CTR $\textbf{M}$odel, namely PPM. PPM employs multi-modal features as input and utilizes large-scale data for pre-training. Then, PPM is plugged in IDRec model to enhance unified model's performance and iteration efficiency. Upon incorporating IDRec model, certain intermediate results within the network are cached, with only a subset of the parameters participating in training and serving. Hence, our approach can successfully deploy an end-to-end model without causing huge latency increases. Comprehensive offline experiments and online A/B testing at JD E-commerce demonstrate the efficiency and effectiveness of PPM.


title: Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing

abstract: 3D Gaussian splatting, emerging as a groundbreaking approach, has drawn increasing attention for its capabilities of high-fidelity reconstruction and real-time rendering. However, it couples the appearance and geometry of the scene within the Gaussian attributes, which hinders the flexibility of editing operations, such as texture swapping. To address this issue, we propose a novel approach, namely Texture-GS, to disentangle the appearance from the geometry by representing it as a 2D texture mapped onto the 3D surface, thereby facilitating appearance editing. Technically, the disentanglement is achieved by our proposed texture mapping module, which consists of a UV mapping MLP to learn the UV coordinates for the 3D Gaussian centers, a local Taylor expansion of the MLP to efficiently approximate the UV coordinates for the ray-Gaussian intersections, and a learnable texture to capture the fine-grained appearance. Extensive experiments on the DTU dataset demonstrate that our method not only facilitates high-fidelity appearance editing but also achieves real-time rendering on consumer-level devices, e.g. a single RTX 2080 Ti GPU.


title: Accelerating Regular Path Queries over Graph Database with Processing-in-Memory

abstract: Regular path queries (RPQs) in graph databases are bottlenecked by the memory wall. Emerging processing-in-memory (PIM) technologies offer a promising solution to dispatch and execute path matching tasks in parallel within PIM modules. We present Moctopus, a PIM-based data management system for graph databases that supports efficient batch RPQs and graph updates. Moctopus employs a PIM-friendly dynamic graph partitioning algorithm, which tackles graph skewness and preserves graph locality with low overhead for RPQ processing. Moctopus enables efficient graph update by amortizing the host CPU's update overhead to PIM modules. Evaluation of Moctopus demonstrates superiority over the state-of-the-art traditional graph database.


title: T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory

abstract: Trajectory prediction is a challenging problem that requires considering interactions among multiple actors and the surrounding environment. While data-driven approaches have been used to address this complex problem, they suffer from unreliable predictions under distribution shifts during test time. Accordingly, several online learning methods have been proposed using regression loss from the ground truth of observed data leveraging the auto-labeling nature of trajectory prediction task. We mainly tackle the following two issues. First, previous works underfit and overfit as they only optimize the last layer of the motion decoder. To this end, we employ the masked autoencoder (MAE) for representation learning to encourage complex interaction modeling in shifted test distribution for updating deeper layers. Second, utilizing the sequential nature of driving data, we propose an actor-specific token memory that enables the test-time learning of actor-wise motion characteristics. Our proposed method has been validated across various challenging cross-dataset distribution shift scenarios including nuScenes, Lyft, Waymo, and Interaction. Our method surpasses the performance of existing state-of-the-art online learning methods in terms of both prediction accuracy and computational efficiency. The code is available at https://github.com/daeheepark/T4P.


title: Group-Mix SAM: Lightweight Solution for Industrial Assembly Line Applications

abstract: Since the advent of the Segment Anything Model(SAM) approximately one year ago, it has engendered significant academic interest and has spawned a large number of investigations and publications from various perspectives. However, the deployment of SAM in practical assembly line scenarios has yet to materialize due to its large image encoder, which weighs in at an imposing 632M. In this study, we have replaced the heavyweight image encoder with a lightweight one, thereby enabling the deployment of SAM in practical assembly line scenarios. Specifically, we have employed decoupled distillation to train the encoder of MobileSAM in a resource-limited setting. The entire knowledge distillation experiment can be completed in a single day on a single RTX 4090. The resulting lightweight SAM, referred to as Group-Mix SAM, had 37.63% (2.16M) fewer parameters and 42.5% (15614.7M) fewer floating-point operations compared to MobileSAM. However, on our constructed industrial dataset, MALSD, its mIoU was only marginally lower than that of MobileSAM, at 0.615. Finally, we conducted a comprehensive comparative experiment to demonstrate the superiority of Group-Mix SAM in the industrial domain. With its exceptional performance, our Group-Mix SAM is more suitable for practical assembly line applications.


title: Control and Automation for Industrial Production Storage Zone: Generation of Optimal Route Using Image Processing

abstract: Digital image processing (DIP) is of great importance in validating and guaranteeing parameters that ensure the quality of mass-produced products. Therefore, this article focused on developing an industrial automation method for a zone of a production line model using the DIP. The neo-cascade methodology employed allowed for defining each of the stages in an adequate way, ensuring the inclusion of the relevant methods for its development, which finally incurred in the modeling, design, implementation, and testing of an optimal route generation system for a warehouse area, using DIP with optimization guidelines, in conjunction with an embedded platform and the connection to programmable logic controllers (PLCs) for its execution. The system was based on the OpenCV library; tool focused on artificial vision, which was implemented on an object-oriented programming (OOP) platform based on Java language. It generated the optimal route for the automation of processes in a scale warehouse area, using the segmentation of objects and the optimization of flow in networks as pillars, ending with the connection to PLCs as a method of action, which in case of implementation would eliminate constraints such as process inefficiency, the use of manpower to perform these tasks, inadequate use of resources, among others


title: Revealing mysteries in gamma-ray bursts: the role of gluon condensation

abstract: We use a newly recognized gluon distribution in the nucleon, which was predicted by a QCD evolution equation to consistently explain several intriguing phenomena associated with gamma-ray bursts. They are the GeV-TeV spectra of GRB 221009A, the remarkably symmetrical explosion cloud in kilonova AT2017gfo, and the absence of a very high-energy gamma-ray signature in GRB 170817A. We find that these occurrences can be attributed to the gluon condensation within nucleons, i.e., a significant number of soft gluons within nucleons are condensed at a critical momentum, resulting in the emergence of a steep and high peak in the gluon distributions. Through this profound connection between microscopic and macroscopic phenomena, we have not only expanded the applications of the hadronic scenario in cosmic gamma-ray emissions but also presented new evidence for the existence of gluon condensation.


title: Don't Half-listen: Capturing Key-part Information in Continual Instruction Tuning

abstract: Instruction tuning for large language models (LLMs) can drive them to produce results consistent with human goals in specific downstream tasks. However, the process of continual instruction tuning (CIT) for LLMs may bring about the catastrophic forgetting (CF) problem, where previously learned abilities are degraded. Recent methods try to alleviate the CF problem by modifying models or replaying data, which may only remember the surface-level pattern of instructions and get confused on held-out tasks. In this paper, we propose a novel continual instruction tuning method based on Key-part Information Gain (KPIG). Our method computes the information gain on masked parts to dynamically replay data and refine the training objective, which enables LLMs to capture task-aware information relevant to the correct response and alleviate overfitting to general descriptions in instructions. In addition, we propose two metrics, P-score and V-score, to measure the generalization and instruction-following abilities of LLMs. Experiments demonstrate our method achieves superior performance on both seen and held-out tasks.


title: Spectral Energy Distributions of Disc-Embedded Accreting Protoplanets

abstract: Many dozens of protoplanetary discs show signatures of sculpting by planets. To help find these protoplanets by direct imaging, we compute their broadband spectral energy distributions, which overlap with the JWST (James Webb Space Telescope) and ALMA (Atacama Large Millimeter Array) passbands. We consider circumplanetary spherical envelopes, and combinations of circumplanetary discs and envelopes, heated by protoplanet accretion and external irradiation. Searches with JWST's NIRCam (Near-Infrared Camera) and the blue portion of MIRI (Mid-Infrared Instrument) are most promising since $\sim$300--1000 K protoplanets outshine their $\sim$20--50 K circumstellar environs at wavelengths of $\sim$2--20 $\mu$m. Detection is easier if circumplanetary dust settles into discs (more likely for more massive planets) or is less abundant per unit mass gas (because of grain growth or filtration). At wavelengths longer than 20 $\mu$m, circumplanetary material is difficult to see against the circumstellar disc's surface layers that directly absorb starlight and reprocess it to the far-infrared. Such contaminating circumstellar emission can be serious even within the evacuated gaps observed by ALMA. Only in strongly depleted regions, like the cavity of the transitional disc PDS 70 where two protoplanets have been confirmed, may long-wavelength windows open for protoplanet study. We compile a list of candidate protoplanets and identify those with potentially the highest accretion luminosities, all peaking in the near-infrared.


title: RID-TWIN: An end-to-end pipeline for automatic face de-identification in videos

abstract: Face de-identification in videos is a challenging task in the domain of computer vision, primarily used in privacy-preserving applications. Despite the considerable progress achieved through generative vision models, there remain multiple challenges in the latest approaches. They lack a comprehensive discussion and evaluation of aspects such as realism, temporal coherence, and preservation of non-identifiable features. In our work, we propose RID-Twin: a novel pipeline that leverages the state-of-the-art generative models, and decouples identity from motion to perform automatic face de-identification in videos. We investigate the task from a holistic point of view and discuss how our approach addresses the pertinent existing challenges in this domain. We evaluate the performance of our methodology on the widely employed VoxCeleb2 dataset, and also a custom dataset designed to accommodate the limitations of certain behavioral variations absent in the VoxCeleb2 dataset. We discuss the implications and advantages of our work and suggest directions for future research.


title: Repoformer: Selective Retrieval for Repository-Level Code Completion

abstract: Recent advances in retrieval-augmented generation (RAG) have initiated a new era in repository-level code completion. However, the invariable use of retrieval in existing methods exposes issues in both efficiency and robustness, with a large proportion of the retrieved contexts proving unhelpful or harmful to code language models (code LMs). In this paper, we propose a selective RAG framework to avoid retrieval when unnecessary. To power this framework, we design a self-supervised learning approach to enable a code LM to accurately self-evaluate whether retrieval can improve its output quality and robustly leverage the potentially noisy retrieved contexts. Using this LM as both the selective RAG policy and the generation model, our framework achieves state-of-the-art repository-level code completion performance on diverse benchmarks including RepoEval, CrossCodeEval, and CrossCodeLongEval, a new long-form code completion benchmark. Meanwhile, our analyses show that selectively retrieving brings as much as 70% inference speedup in the online serving setting without harming the performance. We further demonstrate that our framework is able to accommodate different generation models, retrievers, and programming languages. These advancements position our framework as an important step towards more accurate and efficient repository-level code completion.


title: Global rigidity of smooth ${\mathbb Z}\ltimes_\lambda{\mathbb R}$-actions on ${\mathbb T}^2$

abstract: For $\lambda>1$, we consider the locally free ${\mathbb Z}\ltimes_\lambda{\mathbb R}$ actions on ${\mathbb T}^2$. We show that, if the action is $C^r$ with $r\geq2$, then it is $C^{r-\epsilon}$-conjugate to an affine action generated by a hyperbolic automorphism and a linear translation flow along expanding eigen-direction of the automorphism. In contrast, there exists a $C^{1+\alpha}$-action which is semi-conjugate, but not topologically conjugate to an affine action.


title: PAME: Self-Supervised Masked Autoencoder for No-Reference Point Cloud Quality Assessment

abstract: No-reference point cloud quality assessment (NR-PCQA) aims to automatically predict the perceptual quality of point clouds without reference, which has achieved remarkable performance due to the utilization of deep learning-based models. However, these data-driven models suffer from the scarcity of labeled data and perform unsatisfactorily in cross-dataset evaluations. To address this problem, we propose a self-supervised pre-training framework using masked autoencoders (PAME) to help the model learn useful representations without labels. Specifically, after projecting point clouds into images, our PAME employs dual-branch autoencoders, reconstructing masked patches from distorted images into the original patches within reference and distorted images. In this manner, the two branches can separately learn content-aware features and distortion-aware features from the projected images. Furthermore, in the model fine-tuning stage, the learned content-aware features serve as a guide to fuse the point cloud quality features extracted from different perspectives. Extensive experiments show that our method outperforms the state-of-the-art NR-PCQA methods on popular benchmarks in terms of prediction accuracy and generalizability.


title: Product of rectangular Toeplitz (Hankel) matrices

abstract: In this paper, we study products of asymmetric Toeplitz matrices, we give necessary and sufficient conditions for the product of two asymmetric Toeplitz matrices compatible sizes is asymmetric Toeplitz matrix. We also give some results related to the isometry.