title: Continual All-in-One Adverse Weather Removal with Knowledge Replay on a Unified Network Structure

abstract: In real-world applications, image degeneration caused by adverse weather is always complex and changes with different weather conditions from days and seasons. Systems in real-world environments constantly encounter adverse weather conditions that are not previously observed. Therefore, it practically requires adverse weather removal models to continually learn from incrementally collected data reflecting various degeneration types. Existing adverse weather removal approaches, for either single or multiple adverse weathers, are mainly designed for a static learning paradigm, which assumes that the data of all types of degenerations to handle can be finely collected at one time before a single-phase learning process. They thus cannot directly handle the incremental learning requirements. To address this issue, we made the earliest effort to investigate the continual all-in-one adverse weather removal task, in a setting closer to real-world applications. Specifically, we develop a novel continual learning framework with effective knowledge replay (KR) on a unified network structure. Equipped with a principal component projection and an effective knowledge distillation mechanism, the proposed KR techniques are tailored for the all-in-one weather removal task. It considers the characteristics of the image restoration task with multiple degenerations in continual learning, and the knowledge for different degenerations can be shared and accumulated in the unified network structure. Extensive experimental results demonstrate the effectiveness of the proposed method to deal with this challenging task, which performs competitively to existing dedicated or joint training image restoration methods. Our code is available at https://github.com/xiaojihh/CL_all-in-one.


title: Stability and Sharp Decay Estimates for 3D MHD Equations with Only Vertical Dissipation Near a Background Magnetic Field

abstract: This paper is concerned with the stability and large-time behavior of 3D incompressible MHD equations with only vertical dissipation near a background magnetic field. By making full use of the dissipation generated by the background magnetic field, we first establish the global stability of the solutions in $H^3$-norm. Then, the optimal decay rates of the solutions are obtained, which are consistent with the 2D classical heat equation. Moreover, some enhanced decay rates of $(u_1,b_1)$ are also achieved. In other words, the decay estimates of the second or third component of velocity/magnetic field coincide with those of 2D heat kernel, while the first component behaves like the 3D heat kernel. This is mainly due to the divergence-free condition and the anisotropic structure. The results obtained improve the previous ones due to Lin-Wu-Zhu [24,25].


title: Graph Data Condensation via Self-expressive Graph Structure Reconstruction

abstract: With the increasing demands of training graph neural networks (GNNs) on large-scale graphs, graph data condensation has emerged as a critical technique to relieve the storage and time costs during the training phase. It aims to condense the original large-scale graph to a much smaller synthetic graph while preserving the essential information necessary for efficiently training a downstream GNN. However, existing methods concentrate either on optimizing node features exclusively or endeavor to independently learn node features and the graph structure generator. They could not explicitly leverage the information of the original graph structure and failed to construct an interpretable graph structure for the synthetic dataset. To address these issues, we introduce a novel framework named \textbf{G}raph Data \textbf{C}ondensation via \textbf{S}elf-expressive Graph Structure \textbf{R}econstruction (\textbf{GCSR}). Our method stands out by (1) explicitly incorporating the original graph structure into the condensing process and (2) capturing the nuanced interdependencies between the condensed nodes by reconstructing an interpretable self-expressive graph structure. Extensive experiments and comprehensive analysis validate the efficacy of the proposed method across diverse GNN models and datasets. Our code is available at \url{https://github.com/zclzcl0223/GCSR}.


title: Tight error bounds for log-determinant cones without constraint qualifications

abstract: In this paper, without requiring any constraint qualifications, we establish tight error bounds for the log-determinant cone, which is the closure of the hypograph of the perspective function of the log-determinant function. This error bound is obtained using the recently developed framework based on one-step facial residual functions.


title: Advancements in Continuous Glucose Monitoring: Integrating Deep Learning and ECG Signal

abstract: This paper presents a novel approach to noninvasive hyperglycemia monitoring utilizing electrocardiograms (ECG) from an extensive database comprising 1119 subjects. Previous research on hyperglycemia or glucose detection using ECG has been constrained by challenges related to generalization and scalability, primarily due to using all subjects' ECG in training without considering unseen subjects as a critical factor for developing methods with effective generalization. We designed a deep neural network model capable of identifying significant features across various spatial locations and examining the interdependencies among different features within each convolutional layer. To expedite processing speed, we segment the ECG of each user to isolate one heartbeat or one cycle of the ECG. Our model was trained using data from 727 subjects, while 168 were used for validation. The testing phase involved 224 unseen subjects, with a dataset consisting of 9,000 segments. The result indicates that the proposed algorithm effectively detects hyperglycemia with a 91.60% area under the curve (AUC), 81.05% sensitivity, and 85.54% specificity.


title: Optical detection of bacterial cells on stainless-steel surface with a low-magnification light microscope

abstract: A Rapid and cost-effective method for detecting bacterial cells on surfaces is critical to protect public health from various aspects, including food safety, clinical hygiene, and pharmacy quality. Herein, we first established an optical detection method based on a gold chip coating with 3-mercaptophenylboronic acid (3-MPBA) to capture bacterial cells, which allows for the detection and quantification of bacterial cells with a standard light microscope under low-magnification (10 fold) objective lens. Then, integrating the developed optical detection method with swab sampling to achieve to detect bacterial cells loading on stainless-steel surfaces. Using Salmonella enterica (SE1045) and Escherichia coli as model bacterial cells, we achieved a capture efficiency of up to 76.0 % for SE1045 cells and 81.1 % for E. coli cells at Log 3 CFU/mL upon the optimized conditions. Our assay showed good linear relationship between the concentrations of bacterial cells with the cell counting in images with the limit of detection (LOD) of Log 3 CFU/mL for both SE1045 and E. coli cells. A further increase in sensitivity in detecting E. coli cells was achieved through a heat treatment, enabling the LOD to be pushed as low as Log 2 CFU/mL. Furthermore, successful application was observed in assessing bacterial contamination on stainless-steel surface following integrating with swab collection, achieving a recovery rate of approximately 70 % suggests future prospects for evaluating the cleanliness of surfaces. The entire process was completed within around 2 hours, with a cost of merely 2 dollars per sample. Given a standard light microscope cost around 250 dollars, our developed method has shown great potential in practical industrial applications for bacterial contamination control on surfaces in low-resource settings.


title: Multiple elliptic integrals and differential equations

abstract: We introduce and prove evaluations for families of multiple elliptic integrals by solving special types of ordinary and partial differential equations. As an application, we obtain new expressions of Ramanujan-type series of level 4 and associated singular values for the complete elliptic integral $\mathbf K$ with integrals involving $\mathbf K$.


title: Modelling response time contrasts in superconducting nanowire single photon detectors

abstract: Superconducting Nanowire Single Photon Detector (SNSPD) emerges as a potential candidate in the multiple fields requiring sensitive and fast photodetection. While nanowires of low temperature superconducting detectors are mature with commercial solutions, other material options with higher transition temperature and faster responses are currently being explored. Towards this goal, we develop a generalized numerical model that incorporates the thermodynamic properties of the superconducting material and identifies the minimum resolvable photon count for a given bias and device parameters. A phase diagram of detection and latching phases with the minimum number of photons as a function of biasing current and biasing temperature for each material system is presented. We show using the developed model that while low temperature superconducting (LTS) nanowires are more sensitive to the incident photon at different wavelengths, the ultimate limit of a single photon can be achieved using high temperature superconducting (HTS) material such as YBa2Cu3O7-{\delta}, albeit at stringent biasing conditions. On the contrary, ultrafast response time with three orders of magnitude smaller response times can be achieved in select HTS materials making it an appealing for several practical applications.


title: CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuning

abstract: Deep learning (e.g., Transformer) has been widely and successfully used in multivariate time series forecasting (MTSF). Unlike existing methods that focus on training models from a single modal of time series input, large language models (LLMs) based MTSF methods with cross-modal text and time series input have recently shown great superiority, especially with limited temporal data. However, current LLM-based MTSF methods usually focus on adapting and fine-tuning LLMs, while neglecting the distribution discrepancy between textual and temporal input tokens, thus leading to sub-optimal performance. To address this issue, we propose a novel Cross-Modal LLM Fine-Tuning (CALF) framework for MTSF by reducing the distribution discrepancy between textual and temporal data, which mainly consists of the temporal target branch with temporal input and the textual source branch with aligned textual input. To reduce the distribution discrepancy, we develop the cross-modal match module to first align cross-modal input distributions. Additionally, to minimize the modality distribution gap in both feature and output spaces, feature regularization loss is developed to align the intermediate features between the two branches for better weight updates, while output consistency loss is introduced to allow the output representations of both branches to correspond effectively. Thanks to the modality alignment, CALF establishes state-of-the-art performance for both long-term and short-term forecasting tasks with low computational complexity, and exhibiting favorable few-shot and zero-shot abilities similar to that in LLMs. Code is available at \url{https://github.com/Hank0626/LLaTA}.


title: Let Storytelling Tell Vivid Stories: An Expressive and Fluent Multimodal Storyteller

abstract: Storytelling aims to generate reasonable and vivid narratives based on an ordered image stream. The fidelity to the image story theme and the divergence of story plots attract readers to keep reading. Previous works iteratively improved the alignment of multiple modalities but ultimately resulted in the generation of simplistic storylines for image streams. In this work, we propose a new pipeline, termed LLaMS, to generate multimodal human-level stories that are embodied in expressiveness and consistency. Specifically, by fully exploiting the commonsense knowledge within the LLM, we first employ a sequence data auto-enhancement strategy to enhance factual content expression and leverage a textual reasoning architecture for expressive story generation and prediction. Secondly, we propose SQ-Adatpter module for story illustration generation which can maintain sequence consistency. Numerical results are conducted through human evaluation to verify the superiority of proposed LLaMS. Evaluations show that LLaMS achieves state-of-the-art storytelling performance and 86% correlation and 100% consistency win rate as compared with previous SOTA methods. Furthermore, ablation experiments are conducted to verify the effectiveness of proposed sequence data enhancement and SQ-Adapter.


title: The Kerr Memory Effect at Null Infinity

abstract: We compute the memory effect due to a gravitational wave striking a Kerr black hole as seen by an observer at null infinity. This is done by working in Bondi--Sachs coordinates. It was shown by Hawking, Perry, and Strominger (HPS) that the memory effect due to a gravitational shockwave is seen as a pure BMS supertranslation from null infinity. Hence, it is of interest to compute the supertranslated Kerr solution in Bondi--Sachs coordinates. Finally, the gravitational wave is said to implant soft supertranslation hair on the event horizon of the black hole which carries superrotation charge. We will explicitly calculate the change in superrotation charge on the event horizon due to the supertranslation hair.


title: Dynamic U-Net: Adaptively Calibrate Features for Abdominal Multi-organ Segmentation

abstract: U-Net has been widely used for segmenting abdominal organs, achieving promising performance. However, when it is used for multi-organ segmentation, first, it may be limited in exploiting global long-range contextual information due to the implementation of standard convolutions. Second, the use of spatial-wise downsampling (e.g., max pooling or strided convolutions) in the encoding path may lead to the loss of deformable or discriminative details. Third, features upsampled from the higher level are concatenated with those that persevered via skip connections. However, repeated downsampling and upsampling operations lead to misalignments between them and their concatenation degrades segmentation performance. To address these limitations, we propose Dynamically Calibrated Convolution (DCC), Dynamically Calibrated Downsampling (DCD), and Dynamically Calibrated Upsampling (DCU) modules, respectively. The DCC module can utilize global inter-dependencies between spatial and channel features to calibrate these features adaptively. The DCD module enables networks to adaptively preserve deformable or discriminative features during downsampling. The DCU module can dynamically align and calibrate upsampled features to eliminate misalignments before concatenations. We integrated the proposed modules into a standard U-Net, resulting in a new architecture, termed Dynamic U-Net. This architectural design enables U-Net to dynamically adjust features for different organs. We evaluated Dynamic U-Net in two abdominal multi-organ segmentation benchmarks. Dynamic U-Net achieved statistically improved segmentation accuracy compared with standard U-Net. Our code is available at https://github.com/sotiraslab/DynamicUNet.


title: Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models

abstract: Large Multimodal Model (LMM) is a hot research topic in the computer vision area and has also demonstrated remarkable potential across multiple disciplinary fields. A recent trend is to further extend and enhance the perception capabilities of LMMs. The current methods follow the paradigm of adapting the visual task outputs to the format of the language model, which is the main component of a LMM. This adaptation leads to convenient development of such LMMs with minimal modifications, however, it overlooks the intrinsic characteristics of diverse visual tasks and hinders the learning of perception capabilities. To address this issue, we propose a novel LMM architecture named Lumen, a Large multimodal model with versatile vision-centric capability enhancement. We decouple the LMM's learning of perception capabilities into task-agnostic and task-specific stages. Lumen first promotes fine-grained vision-language concept alignment, which is the fundamental capability for various visual tasks. Thus the output of the task-agnostic stage is a shared representation for all the tasks we address in this paper. Then the task-specific decoding is carried out by flexibly routing the shared representation to lightweight task decoders with negligible training efforts. Comprehensive experimental results on a series of vision-centric and VQA benchmarks indicate that our Lumen model not only achieves or surpasses the performance of existing LMM-based approaches in a range of vision-centric tasks while maintaining general visual understanding and instruction following capabilities. The code will be released at https://github.com/SxJyJay/Lumen.


title: Integrated Communications and Localization for Massive MIMO LEO Satellite Systems

abstract: Integrated communications and localization (ICAL) will play an important part in future sixth generation (6G) networks for the realization of Internet of Everything (IoE) to support both global communications and seamless localization. Massive multiple-input multiple-output (MIMO) low earth orbit (LEO) satellite systems have great potential in providing wide coverage with enhanced gains, and thus are strong candidates for realizing ubiquitous ICAL. In this paper, we develop a wideband massive MIMO LEO satellite system to simultaneously support wireless communications and localization operations in the downlink. In particular, we first characterize the signal propagation properties and derive a localization performance bound. Based on these analyses, we focus on the hybrid analog/digital precoding design to achieve high communication capability and localization precision. Numerical results demonstrate that the proposed ICAL scheme supports both the wireless communication and localization operations for typical system setups.


title: A Spin model for global flat-foldability of random origami

abstract: We map the problem of determining flat-foldability of the origami diagram onto the ground-state search problem of spin glass model on random graphs. If the origami diagram is locally flat-foldable around each vertex, a pre-folded diagram, showing the planar-positional relationship of the facet, can be obtained. For remaining combinatorial problem on layer ordering of facets can be described as a spin model. A spin variable is assigned for the layer-ordering of each pair of facets which have an overlap in the pre-folded diagram. The interactions to prohibit the intrusion of each facet into the other component of the same origami diagram are introduced among two or four spins. The flat-foldability of the diagram is closely related to the (non-)existence of frustrated loops on the spin model with the interactions on the random (hyper)graph.


title: Asymptotic behavior of saxion-axion system in stringy quintessence model

abstract: We study the late time behavior of the slow-roll parameter in the stringy quintessence model when axion as well as saxion is allowed to move. Even though the potential is independent of the axion at tree level, the axion can move through its coupling to the saxion and the background geometry. Then the contributions of the axion kinetic energy to the slow-roll parameter and the vacuum energy density are not negligible when the slow-roll approximation does not hold. As the dimension of the field space is doubled, the fixed point at which the time variation of the slow-roll parameter vanishes is not always stable. We find that the fixed point in the saxion-axion system is at most partially stable, in particular when the volume modulus and the axio-dilaton, the essential ingredients of the string compactification, are taken into account. It seems that as we consider more saxion-axion pairs, the stability of the fixed point becomes difficult to achieve.


title: Verification-Aided Learning of Neural Network Barrier Functions with Termination Guarantees

abstract: Barrier functions are a general framework for establishing a safety guarantee for a system. However, there is no general method for finding these functions. To address this shortcoming, recent approaches use self-supervised learning techniques to learn these functions using training data that are periodically generated by a verification procedure, leading to a verification-aided learning framework. Despite its immense potential in automating barrier function synthesis, the verification-aided learning framework does not have termination guarantees and may suffer from a low success rate of finding a valid barrier function in practice. In this paper, we propose a holistic approach to address these drawbacks. With a convex formulation of the barrier function synthesis, we propose to first learn an empirically well-behaved NN basis function and then apply a fine-tuning algorithm that exploits the convexity and counterexamples from the verification failure to find a valid barrier function with finite-step termination guarantees: if there exist valid barrier functions, the fine-tuning algorithm is guaranteed to find one in a finite number of iterations. We demonstrate that our fine-tuning method can significantly boost the performance of the verification-aided learning framework on examples of different scales and using various neural network verifiers.


title: Reinforced Sequential Decision-Making for Sepsis Treatment: The POSNEGDM Framework with Mortality Classifier and Transformer

abstract: Sepsis, a life-threatening condition triggered by the body's exaggerated response to infection, demands urgent intervention to prevent severe complications. Existing machine learning methods for managing sepsis struggle in offline scenarios, exhibiting suboptimal performance with survival rates below 50%. This paper introduces the POSNEGDM -- ``Reinforcement Learning with Positive and Negative Demonstrations for Sequential Decision-Making" framework utilizing an innovative transformer-based model and a feedback reinforcer to replicate expert actions while considering individual patient characteristics. A mortality classifier with 96.7\% accuracy guides treatment decisions towards positive outcomes. The POSNEGDM framework significantly improves patient survival, saving 97.39% of patients, outperforming established machine learning algorithms (Decision Transformer and Behavioral Cloning) with survival rates of 33.4% and 43.5%, respectively. Additionally, ablation studies underscore the critical role of the transformer-based decision maker and the integration of a mortality classifier in enhancing overall survival rates. In summary, our proposed approach presents a promising avenue for enhancing sepsis treatment outcomes, contributing to improved patient care and reduced healthcare costs.


title: How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance

abstract: Group imbalance has been a known problem in empirical risk minimization (ERM), where the achieved high average accuracy is accompanied by low accuracy in a minority group. Despite algorithmic efforts to improve the minority group accuracy, a theoretical generalization analysis of ERM on individual groups remains elusive. By formulating the group imbalance problem with the Gaussian Mixture Model, this paper quantifies the impact of individual groups on the sample complexity, the convergence rate, and the average and group-level testing performance. Although our theoretical framework is centered on binary classification using a one-hidden-layer neural network, to the best of our knowledge, we provide the first theoretical analysis of the group-level generalization of ERM in addition to the commonly studied average generalization performance. Sample insights of our theoretical results include that when all group-level co-variance is in the medium regime and all mean are close to zero, the learning performance is most desirable in the sense of a small sample complexity, a fast training rate, and a high average and group-level testing accuracy. Moreover, we show that increasing the fraction of the minority group in the training data does not necessarily improve the generalization performance of the minority group. Our theoretical results are validated on both synthetic and empirical datasets, such as CelebA and CIFAR-10 in image classification.


title: Knowledge Graph Large Language Model (KG-LLM) for Link Prediction

abstract: The task of predicting multiple links within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, a challenge increasingly resolvable due to advancements in natural language processing (NLP) and KG embedding techniques. This paper introduces a novel methodology, the Knowledge Graph Large Language Model Framework (KG-LLM), which leverages pivotal NLP paradigms, including chain-of-thought (CoT) prompting and in-context learning (ICL), to enhance multi-hop link prediction in KGs. By converting the KG to a CoT prompt, our framework is designed to discern and learn the latent representations of entities and their interrelations. To show the efficacy of the KG-LLM Framework, we fine-tune three leading Large Language Models (LLMs) within this framework, employing both non-ICL and ICL tasks for a comprehensive evaluation. Further, we explore the framework's potential to provide LLMs with zero-shot capabilities for handling previously unseen prompts. Our experimental findings discover that integrating ICL and CoT not only augments the performance of our approach but also significantly boosts the models' generalization capacity, thereby ensuring more precise predictions in unfamiliar scenarios.


title: Multi-task Manipulation Policy Modeling with Visuomotor Latent Diffusion

abstract: Modeling a generalized visuomotor policy has been a longstanding challenge for both computer vision and robotics communities. Existing approaches often fail to efficiently leverage cross-dataset resources or rely on heavy Vision-Language models, which require substantial computational resources, thereby limiting their multi-task performance and application potential. In this paper, we introduce a novel paradigm that effectively utilizes latent modeling of manipulation skills and an efficient visuomotor latent diffusion policy, which enhances the utilizing of existing cross-embodiment and cross-environment datasets, thereby improving multi-task capabilities. Our methodology consists of two decoupled phases: action modeling and policy modeling. Firstly, we introduce a task-agnostic, embodiment-aware trajectory latent autoencoder for unified action skills modeling. This step condenses action data and observation into a condensed latent space, effectively benefiting from large-scale cross-datasets. Secondly, we propose to use a visuomotor latent diffusion policy that recovers target skill latent from noises for effective task execution. We conducted extensive experiments on two widely used benchmarks, and the results demonstrate the effectiveness of our proposed paradigms on multi-tasking and pre-training. Code is available at https://github.com/AlbertTan404/RoLD.


title: Cosmology with shear ratios: a joint study of weak lensing and spectroscopic redshift datasets

abstract: The ratio of the average tangential shear signal of different weak lensing source populations around the same lens galaxies, also known as a shear ratio, provides an important test of lensing systematics and a potential source of cosmological information. In this paper we measure shear ratios of three current weak lensing surveys -- KiDS, DES, and HSC -- using overlapping data from the Baryon Oscillation Spectroscopic Survey. We apply a Bayesian method to reduce bias in shear ratio measurement, and assess the degree to which shear ratio information improves the determination of important astrophysical parameters describing the source redshift distributions and intrinsic galaxy alignments, as well as cosmological parameters, in comparison with cosmic shear and full 3x2-pt correlations (cosmic shear, galaxy-galaxy lensing, and galaxy clustering). We consider both Fisher matrix forecasts, as well as full likelihood analyses of the data. We find that the addition of shear ratio information to cosmic shear allows the mean redshifts of the source samples and intrinsic alignment parameters to be determined significantly more accurately. Although the additional constraining power enabled by the shear ratio is less than that obtained by introducing an accurate prior in the mean source redshift using photometric redshift calibration, the shear ratio allows for a useful cross-check. The inclusion of shear ratio data consistently benefits the determination of cosmological parameters such as S_8, for which we obtain improvements up to 34%. However these improvements are less significant when shear ratio is combined with the full 3x2-pt correlations. We conclude that shear ratio tests will remain a useful source of cosmological information and cross-checks for lensing systematics, whose application will be further enhanced by upcoming datasets such as the Dark Energy Spectroscopic Instrument.


title: Customizable Avatars with Dynamic Facial Action Coded Expressions (CADyFACE) for Improved User Engagement

abstract: Customizable 3D avatar-based facial expression stimuli may improve user engagement in behavioral biomarker discovery and therapeutic intervention for autism, Alzheimer's disease, facial palsy, and more. However, there is a lack of customizable avatar-based stimuli with Facial Action Coding System (FACS) action unit (AU) labels. Therefore, this study focuses on (1) FACS-labeled, customizable avatar-based expression stimuli for maintaining subjects' engagement, (2) learning-based measurements that quantify subjects' facial responses to such stimuli, and (3) validation of constructs represented by stimulus-measurement pairs. We propose Customizable Avatars with Dynamic Facial Action Coded Expressions (CADyFACE) labeled with AUs by a certified FACS expert. To measure subjects' AUs in response to CADyFACE, we propose a novel Beta-guided Correlation and Multi-task Expression learning neural network (BeCoME-Net) for multi-label AU detection. The beta-guided correlation loss encourages feature correlation with AUs while discouraging correlation with subject identities for improved generalization. We train BeCoME-Net for unilateral and bilateral AU detection and compare with state-of-the-art approaches. To assess construct validity of CADyFACE and BeCoME-Net, twenty healthy adult volunteers complete expression recognition and mimicry tasks in an online feasibility study while webcam-based eye-tracking and video are collected. We test validity of multiple constructs, including face preference during recognition and AUs during mimicry.


title: Secant variety and syzygies of Hilbert scheme of two points

abstract: In this paper, we prove that the singular locus of $\mathrm{Sec} (X^{[2]})$ coincides with $X^{[2]}$ under the Grothendieck-Pl\"ucker embedding $X^{[2]} \hookrightarrow \mathbb{P}^N$ when $X$ is embedded by a $4$-very ample line bundle. We also prove that the embedding $X^{[2]} \hookrightarrow \mathbb{P}^N$ satisfies Green's condition $(N_p)$ when the embedding of $X$ is positive enough. As an application, we describe the geometry of a resolution of singularities from the secant bundle to $\mathrm{Sec}(X^{[2]})$ when $X$ is a surface.


title: Simplicial complexes with many facets are vertex decomposable

abstract: Let $\Delta$ be a pure simplicial complex on $n$ vertices having dimension $d$ and codimension $c = n-d-1$ in the simplex. Terai and Yoshida proved that if the number of facets of $\Delta$ is at least $\binom{n}{c}-2c+1$, then $\Delta$ is Cohen-Macaulay. We improve this result by showing that these hypotheses imply the stronger condition that $\Delta$ is vertex decomposable. We give examples to show that this bound is optimal, and that the conclusion cannot be strengthened to the class of matroids or shifted complexes. We explore an application to Simon's Conjecture and discuss connections to other results from the literature.


title: GMPC: Geometric Model Predictive Control for Wheeled Mobile Robot Trajectory Tracking

abstract: The configuration of most robotic systems lies in continuous transformation groups. However, in mobile robot trajectory tracking, many recent works still naively utilize optimization methods for elements in vector space without considering the manifold constraint of the robot configuration. In this letter, we propose a geometric model predictive control (MPC) framework for wheeled mobile robot trajectory tracking. We first derive the error dynamics of the wheeled mobile robot trajectory tracking by considering its manifold constraint and kinematic constraint simultaneously. After that, we utilize the relationship between the Lie group and Lie algebra to convexify the tracking control problem, which enables us to solve the problem efficiently. Thanks to the Lie group formulation, our method tracks the trajectory more smoothly than existing nonlinear MPC. Simulations and physical experiments verify the effectiveness of our proposed methods. Our pure Python-based simulation platform is publicly available to benefit further research in the community.


title: Test for high-dimensional linear hypothesis of mean vectors via random integration

abstract: In this paper, we investigate hypothesis testing for the linear combination of mean vectors across multiple populations through the method of random integration. We have established the asymptotic distributions of the test statistics under both null and alternative hypotheses. Additionally, we provide a theoretical explanation for the special use of our test statistics in situations when the nonzero signal in the linear combination of the true mean vectors is weakly dense. Moreover, Monte-Carlo simulations are presented to evaluate the suggested test against existing high-dimensional tests. The findings from these simulations reveal that our test not only aligns with the performance of other tests in terms of size but also exhibits superior power.


title: Efficient Diffusion Model for Image Restoration by Residual Shifting

abstract: While diffusion-based image restoration (IR) methods have achieved remarkable success, they are still limited by the low inference speed attributed to the necessity of executing hundreds or even thousands of sampling steps. Existing acceleration sampling techniques, though seeking to expedite the process, inevitably sacrifice performance to some extent, resulting in over-blurry restored outcomes. To address this issue, this study proposes a novel and efficient diffusion model for IR that significantly reduces the required number of diffusion steps. Our method avoids the need for post-acceleration during inference, thereby avoiding the associated performance deterioration. Specifically, our proposed method establishes a Markov chain that facilitates the transitions between the high-quality and low-quality images by shifting their residuals, substantially improving the transition efficiency. A carefully formulated noise schedule is devised to flexibly control the shifting speed and the noise strength during the diffusion process. Extensive experimental evaluations demonstrate that the proposed method achieves superior or comparable performance to current state-of-the-art methods on three classical IR tasks, namely image super-resolution, image inpainting, and blind face restoration, \textit{\textbf{even only with four sampling steps}}. Our code and model are publicly available at \url{https://github.com/zsyOAOA/ResShift}.


title: Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding

abstract: Neural compression has brought tremendous progress in designing lossy compressors with good rate-distortion (RD) performance at low complexity. Thus far, neural compression design involves transforming the source to a latent vector, which is then rounded to integers and entropy coded. While this approach has been shown to be optimal in a one-shot sense on certain sources, we show that it is highly sub-optimal on i.i.d. sequences, and in fact always recovers scalar quantization of the original source sequence. We demonstrate that the sub-optimality is due to the choice of quantization scheme in the latent space, and not the transform design. By employing lattice quantization instead of scalar quantization in the latent space, we demonstrate that Lattice Transform Coding (LTC) is able to recover optimal vector quantization at various dimensions and approach the asymptotically-achievable rate-distortion function at reasonable complexity. On general vector sources, LTC improves upon standard neural compressors in one-shot coding performance. LTC also enables neural compressors that perform block coding on i.i.d. vector sources, which yields coding gain over optimal one-shot coding.


title: GPT-generated Text Detection: Benchmark Dataset and Tensor-based Detection Method

abstract: As natural language models like ChatGPT become increasingly prevalent in applications and services, the need for robust and accurate methods to detect their output is of paramount importance. In this paper, we present GPT Reddit Dataset (GRiD), a novel Generative Pretrained Transformer (GPT)-generated text detection dataset designed to assess the performance of detection models in identifying generated responses from ChatGPT. The dataset consists of a diverse collection of context-prompt pairs based on Reddit, with human-generated and ChatGPT-generated responses. We provide an analysis of the dataset's characteristics, including linguistic diversity, context complexity, and response quality. To showcase the dataset's utility, we benchmark several detection methods on it, demonstrating their efficacy in distinguishing between human and ChatGPT-generated responses. This dataset serves as a resource for evaluating and advancing detection techniques in the context of ChatGPT and contributes to the ongoing efforts to ensure responsible and trustworthy AI-driven communication on the internet. Finally, we propose GpTen, a novel tensor-based GPT text detection method that is semi-supervised in nature since it only has access to human-generated text and performs on par with fully-supervised baselines.


title: A Question-centric Multi-experts Contrastive Learning Framework for Improving the Accuracy and Interpretability of Deep Sequential Knowledge Tracing Models

abstract: Knowledge tracing (KT) plays a crucial role in predicting students' future performance by analyzing their historical learning processes. Deep neural networks (DNNs) have shown great potential in solving the KT problem. However, there still exist some important challenges when applying deep learning techniques to model the KT process. The first challenge lies in taking the individual information of the question into modeling. This is crucial because, despite questions sharing the same knowledge component (KC), students' knowledge acquisition on homogeneous questions can vary significantly. The second challenge lies in interpreting the prediction results from existing deep learning-based KT models. In real-world applications, while it may not be necessary to have complete transparency and interpretability of the model parameters, it is crucial to present the model's prediction results in a manner that teachers find interpretable. This makes teachers accept the rationale behind the prediction results and utilize them to design teaching activities and tailored learning strategies for students. However, the inherent black-box nature of deep learning techniques often poses a hurdle for teachers to fully embrace the model's prediction results. To address these challenges, we propose a Question-centric Multi-experts Contrastive Learning framework for KT called Q-MCKT. We have provided all the datasets and code on our website at https://github.com/rattlesnakey/Q-MCKT.


title: Discrete-Time Modeling and Handover Analysis of Intelligent Reflecting Surface-Assisted Networks

abstract: Owning to the reflection gain and double path loss featured by intelligent reflecting surface (IRS) channels, handover (HO) locations become irregular and the signal strength fluctuates sharply with variations in IRS connections during HO, the risk of HO failures (HOFs) is exacerbated and thus HO parameters require reconfiguration. However, existing HO models only assume monotonic negative exponential path loss and cannot obtain sound HO parameters. This paper proposes a discrete-time model to explicitly track the HO process with variations in IRS connections, where IRS connections and HO process are discretized as finite states by measurement intervals, and transitions between states are modeled as stochastic processes. Specifically, to capture signal fluctuations during HO, IRS connection state-dependent distributions of the user-IRS distance are modified by the correlation between measurement intervals. In addition, states of the HO process are formed with Time-to-Trigger and HO margin whose transition probabilities are integrated concerning all IRS connection states. Trigger location distributions and probabilities of HO, HOF, and ping-pong (PP) are obtained by tracing user HO states. Results show IRSs mitigate PPs by 48% but exacerbate HOFs by 90% under regular parameters. Optimal parameters are mined ensuring probabilities of HOF and PP are both less than 0.1%.


title: Observation of room temperature gate tunable quantum confinement effect in photodoped junctionless MOSFET

abstract: In the pursuit of room temperature quantum hardware, our study introduces a gate voltage tunable quantum wire within a tri-gated n-type junctionless MOSFET. The application of gate voltage alters the parabolic potential well of the tri-gated junctionless MOSFET, enabling modification of the nanowire's potential well profile. In the presence of light, photogenerated electrons accumulate at the center of the junctionless nanowire, aligning with the modified potential well profile influenced by gate bias. These carriers at the center are far from interfaces and experience less interfacial noise. Therefore, such clean photo-doping shows clear, repeatable peaks in current for specific gate biases compared to the dark condition, considering different operating drain-to-source voltages at room temperature. We propose that photodoping-induced subband occupation of gate tunable potential well of the nanowire is the underlying phenomenon responsible for this kind of observation. This study reveals experimental findings demonstrating gate-induced switching from semi-classical to the quantum domain, followed by the optical occupancy of electronic sub-bands at room temperature. We developed a compact model based on the Nonequilibrium Green's function formalism to understand this phenomenon in our illuminated device better. This work reveals the survival of the quantum confinement effect at room temperature in such semi-classical transport.


title: Gauge Symmetries and Conserved Currents in AdS/BCFT

abstract: In this paper, we study massless/massive vector and $p$-form field perturbations in AdS spacetime with an end-of-the-world brane. By imposing $U(1)$ preserving Neumann boundary condition on the end-of-the-world brane, we study their spectrum and discuss their implications for dual BCFT operators. When the perturbation is massless, the dual BCFT operator is a conserved current and we show that such an operator indeed satisfies the $U(1)$ preserving conformal boundary condition. On the other hand, when the perturbation is massive, in general there exists non-vanishing perpendicular components of the dual BCFT operator, even in the massless limit. We explain this difference between massless and massive perturbations from the point of view of the bulk gauge symmetry, or equivalently from different structure of equations of motion. We also find several brane-tension-independent modes in massless perturbations, and these are understood as boundary-condition-independent modes from the dual BCFT point of view.


title: SGE: Structured Light System Based on Gray Code with an Event Camera

abstract: Fast and accurate depth sensing has long been a significant research challenge. Event camera, as a device that quickly responds to intensity changes, provides a new solution for structured light (SL) systems. In this paper, we introduce Gray code into event-based SL systems for the first time. Our setup includes an event camera and Digital Light Processing (DLP) projector, enabling depth estimation through high-speed projection and decoding of Gray code patterns. By employing spatio-temporal encoding for point matching, our method is immune to timestamp noise, realizing high-speed depth estimation without loss of accuracy. The binary nature of events and Gray code minimizes data redundancy, enabling us to fully utilize sensor bandwidth at 100%. Experimental results show that our approach achieves accuracy comparable to state-of-the-art scanning methods while surpassing them in data acquisition speed (up to 41 times improvement) without sacrificing accuracy. Our proposed approach offers a highly promising solution for ultra-fast, real-time, and high-precision dense depth estimation. Code and dataset will be publicly available.


title: Challenges in the extraction of physics beyond the Standard Model from electron scattering

abstract: Precise measurements of electron and positron scattering, including parity violation, offer great promise in the search for physics beyond the Standard Model. In this context it is crucial to understand the corrections which might arise from charge symmetry violation, as well as the less well known strange and charm quark distributions. Our analysis, using state of the art parton distributions, suggests that these contributions lead to corrections in the extraction of the weak couplings $g^{eq}_{AV}$ and $g^{eq}_{VA}$ of the order $(1-2)\%$, while they are as large as $4\%$ for $g^{eq}_{AA}$, at a typical scale of $Q^2 = 10\ {\rm GeV}^2$. These results underline the importance of carrying out high precision measurements, which will not only provide information on physics beyond the Standard Model but also reduce the current uncertainties on our knowledge of the strange and charm quark distributions in the proton.


title: Satisfiability to Coverage in Presence of Fairness, Matroid, and Global Constraints

abstract: In MaxSAT with Cardinality Constraint problem (CC-MaxSAT), we are given a CNF-formula $\Phi$, and $k \ge 0$, and the goal is to find an assignment $\beta$ with at most $k$ variables set to true (also called a weight $k$-assignment) such that the number of clauses satisfied by $\beta$ is maximized. MaxCov can be seen as a special case of CC-MaxSAT, where the formula $\Phi$ is monotone, i.e., does not contain any negative literals. CC-MaxSAT and MaxCov are extremely well-studied problems in the approximation algorithms as well as parameterized complexity literature. Our first contribution is that the two problems are equivalent to each other in the context of FPT-Approximation parameterized by $k$ (approximation is in terms of number of clauses satisfied/elements covered). We give a randomized reduction from CC-MaxSAT to MaxCov in time $O(1/\epsilon)^{k} \cdot (m+n)^{O(1)}$ that preserves the approximation guarantee up to a factor of $1-\epsilon$. Furthermore, this reduction also works in the presence of fairness and matroid constraints. Armed with this reduction, we focus on designing FPT-Approximation schemes (FPT-ASes) for MaxCov and its generalizations. Our algorithms are based on a novel combination of a variety of ideas, including a carefully designed probability distribution that exploits sparse coverage functions. These algorithms substantially generalize the results in Jain et al. [SODA 2023] for CC-MaxSAT and MaxCov for $K_{d,d}$-free set systems (i.e., no $d$ sets share $d$ elements), as well as a recent FPT-AS for Matroid-Constrained MaxCov by Sellier [ESA 2023] for frequency-$d$ set systems.


title: Unknown Domain Inconsistency Minimization for Domain Generalization

abstract: The objective of domain generalization (DG) is to enhance the transferability of the model learned from a source domain to unobserved domains. To prevent overfitting to a specific domain, Sharpness-Aware Minimization (SAM) reduces source domain's loss sharpness. Although SAM variants have delivered significant improvements in DG, we highlight that there's still potential for improvement in generalizing to unknown domains through the exploration on data space. This paper introduces an objective rooted in both parameter and data perturbed regions for domain generalization, coined Unknown Domain Inconsistency Minimization (UDIM). UDIM reduces the loss landscape inconsistency between source domain and unknown domains. As unknown domains are inaccessible, these domains are empirically crafted by perturbing instances from the source domain dataset. In particular, by aligning the loss landscape acquired in the source domain to the loss landscape of perturbed domains, we expect to achieve generalization grounded on these flat minima for the unknown domains. Theoretically, we validate that merging SAM optimization with the UDIM objective establishes an upper bound for the true objective of the DG task. In an empirical aspect, UDIM consistently outperforms SAM variants across multiple DG benchmark datasets. Notably, UDIM shows statistically significant improvements in scenarios with more restrictive domain information, underscoring UDIM's generalization capability in unseen domains. Our code is available at \url{https://github.com/SJShin-AI/UDIM}.


title: The potential of QQQ in the anisotropic background

abstract: In this work, we use the AdS/CFT correspondence to study the behavior of a triply heavy baryon within anisotropic backgrounds. Beginning with the total action of the three quarks, we derive the balance equation for the three-quark system and compute the separation distance and potential energy. Our results reveal a consistent decrease in both the separation distance and potential energy for the A configuration and the B configuration as the anisotropy coefficient $a$ increases. This suggests that the presence of an anisotropic background promotes the dissolution of the three-quark system. Additionally, we compare the potential energies of the A and B configurations and observe that the A configuration has a slightly smaller potential energy, suggesting greater stability compared to the B configuration.


title: LIST: Learning to Index Spatio-Textual Data for Embedding based Spatial Keyword Queries

abstract: With the proliferation of spatio-textual data, Top-k KNN spatial keyword queries (TkQs), which return a list of objects based on a ranking function that evaluates both spatial and textual relevance, have found many real-life applications. Existing geo-textual indexes for TkQs use traditional retrieval models like BM25 to compute text relevance and usually exploit a simple linear function to compute spatial relevance, but its effectiveness is limited. To improve effectiveness, several deep learning models have recently been proposed, but they suffer severe efficiency issues. To the best of our knowledge, there are no efficient indexes specifically designed to accelerate the top-k search process for these deep learning models. To tackle these issues, we propose a novel technique, which Learns to Index the Spatio-Textual data for answering embedding based spatial keyword queries (called LIST). LIST is featured with two novel components. Firstly, we propose a lightweight and effective relevance model that is capable of learning both textual and spatial relevance. Secondly, we introduce a novel machine learning based Approximate Nearest Neighbor Search (ANNS) index, which utilizes a new learning-to-cluster technique to group relevant queries and objects together while separating irrelevant queries and objects. Two key challenges in building an effective and efficient index are the absence of high-quality labels and unbalanced clustering results. We develop a novel pseudo-label generation technique to address the two challenges. Experimental results show that LIST significantly outperforms state-of-the-art methods on effectiveness, with improvements up to 19.21% and 12.79% in terms of NDCG@1 and Recall@10, and is three orders of magnitude faster than the most effective baseline.


title: LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation

abstract: In clinical practice, medical image segmentation provides useful information on the contours and dimensions of target organs or tissues, facilitating improved diagnosis, analysis, and treatment. In the past few years, convolutional neural networks (CNNs) and Transformers have dominated this area, but they still suffer from either limited receptive fields or costly long-range modeling. Mamba, a State Space Sequence Model (SSM), recently emerged as a promising paradigm for long-range dependency modeling with linear complexity. In this paper, we introduce a Large Kernel Vision Mamba U-shape Network, or LKM-UNet, for medical image segmentation. A distinguishing feature of our LKM-UNet is its utilization of large Mamba kernels, excelling in locally spatial modeling compared to small kernel-based CNNs and Transformers, while maintaining superior efficiency in global modeling compared to self-attention with quadratic complexity. Additionally, we design a novel hierarchical and bidirectional Mamba block to further enhance Mamba's global and neighborhood spatial modeling capability for vision inputs. Comprehensive experiments demonstrate the feasibility and the effectiveness of using large-size Mamba kernels to achieve large receptive fields. Codes are available at https://github.com/wjh892521292/LKM-UNet.


title: Development of generic no-scale inflation

abstract: We develop generalized no-scale supergravity models of inflation, and then study the corresponding cosmological predictions as well as the formation of primordial black holes (PBHs) and scalar-induced gravitational waves (SIGWs). With a new parameter $0<\alpha\leq 1$, the $\alpha$-generalized no-scale supergravity provides the continuous connections among the generic no-scale supergravity from string theory compactifications. The resulting prediction of the CMB, spectrum index $n_s$, and tensor-to-scalar ratio $r$ can be highly consistent with the latest Planck/BICEP/Keck Array observations. Notably, the models with $\alpha\neq 1$ give a smaller ratio $r\leq 10^{-3}$, which is flexible even under the anticipated tighter observational constraints at the future experiments. Additionally, these models have the potential to generate a broad-band stochastic gravitational wave background, and thus explain the NANOGrav 15yr signal. Furthermore, they predict the formation of PBHs with various mass scales, which could account for a significant portion of dark matter relic density in the Universe.


title: From the Fokker-Planck equation to a contact Hamiltonian system

abstract: The Fokker-Planck equation is one of the fundamental equations in nonequilibrium statistical mechanics, and this equation is known to be derived from the Wasserstein gradient flow equation with a free energy. This gradient flow equation describes relaxation processes and is formulated on Riemannian manifolds. Meanwhile contact Hamiltonian systems are also known to describe relaxation processes. Hence a relation between these two equations is expected to be clarified, which gives a solid foundation in geometric statistical mechanics. In this paper a class of contact Hamiltonian systems is derived from a class of the Fokker-Planck equations on Riemannian manifolds. In the course of the derivation, the Fokker-Planck equation is shown to be written as a diffusion equation with a weighted Laplacian without any approximation, which enables to employ a theory of eigenvalue problems.


title: Out-of-time-order correlator as a detector of baryonic phase structure in holographic QCD with a theta angle

abstract: We study the out-of-time-order correlators (OTOC) of Skyrmion as baryon in the D0-D4/D8 model which is holographically dual to QCD with an non-zero theta angle. The baryon state is identified to the excitation of the Skyrmion which is described by a quantum mechanical system in holography. By employing the definition of OTOC in quantum mechanics, we derive the formulas and demonstrate explicitly the numerical calculations of the OTOC. Our calculation illustrates the quantum OTOC with imaginary Lyapunov coefficient indicates the possibly metastable baryonic status in the presence of the theta angle while the classical OTOC can not, thus it reveals the theta-dependent features of QCD are dominated basically by its quantum properties. Furthermore, the OTOC also implies the baryonic phase becomes really chaotic with real Lyapunov exponent if the theta angle increases sufficiently which agrees with the unstable baryon spectrum presented in this model. In this sense, we believe the OTOC may be treated as a tool to detect the baryonic phase structure of QCD.


title: Mathematical analysis and numerical comparison of energy-conservative schemes for the Zakharov equations

abstract: Furihata and Matsuo proposed in 2010 an energy-conserving scheme for the Zakharov equations, as an application of the discrete variational derivative method (DVDM). This scheme is distinguished from conventional methods (in particular the one devised by Glassey in 1992) in that the invariants are consistent with respect to time, but it has not been sufficiently studied both theoretically and numerically. In this study, we theoretically prove the solvability under the loosest possible assumptions. We also prove the convergence of this DVDM scheme by improving the argument by Glassey. Furthermore, we perform intensive numerical experiments for comparing the above two schemes. It is found that the DVDM scheme is superior in terms of accuracy, but since it is fully-implicit, the linearly-implicit Glassey scheme is better for practical efficiency. In addition, we proposed a way to choose a solution for the first step that would allow Glassey's scheme to work more efficiently.


title: Analysis of Intelligent Reflecting Surface-Enhanced Mobility Through a Line-of-Sight State Transition Model

abstract: Rapid signal fluctuations due to blockage effects cause excessive handovers (HOs) and degrade mobility performance. By reconfiguring line-of-sight (LoS) Links through passive reflections, intelligent reflective surface (IRS) has the potential to address this issue. Due to the lack of introducing blocking effects, existing HO analyses cannot capture excessive HOs or exploit enhancements via IRSs. This paper proposes an LoS state transition model enabling analysis of mobility enhancement achieved by IRS-reconfigured LoS links, where LoS link blocking and reconfiguration utilizing IRS during user movement are explicitly modeled as stochastic processes. Specifically, the condition for blocking LoS links is characterized as a set of possible blockage locations, the distribution of available IRSs is thinned by the criteria for reconfiguring LoS links. In addition, BSs potentially handed over are categorized by probabilities of LoS states to enable HO decision analysis. By projecting distinct gains of LoS states onto a uniform equivalent distance criterion, mobility enhanced by IRS is quantified through the compact expression of HO probability. Results show the probability of dropping into non-LoS decreases by 70% when deploying IRSs with the density of 93/km$^2$, and HOs decrease by 67% under the optimal IRS distributed deployment parameter.


title: D$^2$-JSCC: Digital Deep Joint Source-channel Coding for Semantic Communications

abstract: Semantic communications (SemCom) have emerged as a new paradigm for supporting sixth-generation applications, where semantic features of data are transmitted using artificial intelligence algorithms to attain high communication efficiencies. Most existing SemCom techniques utilize deep neural networks (DNNs) to implement analog source-channel mappings, which are incompatible with existing digital communication architectures. To address this issue, this paper proposes a novel framework of digital deep joint source-channel coding (D$^2$-JSCC) targeting image transmission in SemCom. The framework features digital source and channel codings that are jointly optimized to reduce the end-to-end (E2E) distortion. First, deep source coding with an adaptive density model is designed to encode semantic features according to their distributions. Second, digital channel coding is employed to protect encoded features against channel distortion. To facilitate their joint design, the E2E distortion is characterized as a function of the source and channel rates via the analysis of the Bayesian model and Lipschitz assumption on the DNNs. Then to minimize the E2E distortion, a two-step algorithm is proposed to control the source-channel rates for a given channel signal-to-noise ratio. Simulation results reveal that the proposed framework outperforms classic deep JSCC and mitigates the cliff and leveling-off effects, which commonly exist for separation-based approaches.


title: IM-Unpack: Training and Inference with Arbitrarily Low Precision Integers

abstract: GEneral Matrix Multiply (GEMM) is a central operation in deep learning and corresponds to the largest chunk of the compute footprint. Therefore, improving its efficiency is an active topic of ongoing research. A popular strategy is the use of low bit-width integers to approximate the original entries in a matrix. This allows efficiency gains, but often requires sophisticated techniques to control the rounding error incurred. In this work, we first verify/check that when the low bit-width restriction is removed, for a variety of Transformer-based models, whether integers are sufficient for all GEMMs need -- for {\em both} training and inference stages, and can achieve parity with floating point counterparts. No sophisticated techniques are needed. We find that while a large majority of entries in matrices (encountered in such models) can be easily represented by {\em low} bit-width integers, the existence of a few heavy hitter entries make it difficult to achieve efficiency gains via the exclusive use of low bit-width GEMMs alone. To address this issue, we develop a simple algorithm, Integer Matrix Unpacking (IM-Unpack), to {\em unpack} a matrix with large integer entries into a larger matrix whose entries all lie within the representable range of arbitrarily low bit-width integers. This allows {\em equivalence} with the original GEMM, i.e., the exact result can be obtained using purely low bit-width integer GEMMs. This comes at the cost of additional operations -- we show that for many popular models, this overhead is quite small.


title: Direct and inverse time-harmonic scattering by Dirichlet periodic curves with local perturbations

abstract: This is a continuation of the authors' previous work (A. Kirsch, Math. Meth. Appl. Sci., 45 (2022): 5737-5773.) on well-posedness of time-harmonic scattering by locally perturbed periodic curves of Dirichlet kind. The scattering interface is supposed to be given by a non-self-intersecting Lipschitz curve. We study properties of the Green's function and prove new well-posedness results for scattering of plane waves at a propagative wave number. In such a case there exist guided waves to the unperturbed problem, which are also known as Bounded States in the Continuity (BICs) in physics. In this paper uniqueness of the forward scattering follows from an orthogonal constraint condition enforcing on the total field to the unperturbed scattering problem. This constraint condition, which is also valid under the Neumann boundary condition, is derived from the singular perturbation arguments and also from the approach of approximating a plane wave by point source waves. For the inverse problem of determining the defect, we prove several uniqueness results using a finite or infinite number of point source and plane waves, depending on whether a priori information on the size and height of the defect is available.


title: Non-linear characterization of Jordan $*$-isomorphisms via maps on positive cones of $C^*$-algebras

abstract: We study maps between positive definite or positive semidefinite cones of unital $C^*$-algebras. We describe surjective maps that preserve (1) the norm of the quotient or multiplication of elements; (2) the spectrum of the quotient or multiplication of elements; (3) the spectral seminorm of the quotient or multiplication of elements. These maps relate to the Jordan $*$-isomorphisms between the specified $C^*$-algebras. While a surjection between positive definite cones that preserves the norm of the quotient of elements may not be extended to a linear map between the underlying $C^*$-algebras, the other types of surjections can be extended to a Jordan $*$-isomorphism or a Jordan $*$-isomorphism followed by the implementation by a positive invertible element. We also study conditions for the centrality of positive invertible elements. We generalize "the corollary" regarding surjections between positive semidefinite cones of unital $C^*$-algebras. Applying it, we provide positive solutions to the problem posed by Moln\'ar for general unital $C^*$-algebras.


title: Rethinking ASTE: A Minimalist Tagging Scheme Alongside Contrastive Learning

abstract: Aspect Sentiment Triplet Extraction (ASTE) is a burgeoning subtask of fine-grained sentiment analysis, aiming to extract structured sentiment triplets from unstructured textual data. Existing approaches to ASTE often complicate the task with additional structures or external data. In this research, we propose a novel tagging scheme and employ a contrastive learning approach to mitigate these challenges. The proposed approach demonstrates comparable or superior performance in comparison to state-of-the-art techniques, while featuring a more compact design and reduced computational overhead. Notably, even in the era of Large Language Models (LLMs), our method exhibits superior efficacy compared to GPT 3.5 and GPT 4 in a few-shot learning scenarios. This study also provides valuable insights for the advancement of ASTE techniques within the paradigm of large language models.


title: Large fluctuations in the Sky

abstract: Renormalization of quantum loop effects generated from large fluctuations is a hugely debatable topic of research these days which rules out the Primordial Black Hole (PBH) formation within the framework of single-field inflation. In this article, we briefly discuss that the correct implementation of regularization, renormalization, and resummation techniques in a setup described by an ultra-slow-roll phase sandwiched between two slow-roll phases in the presence of smooth or sharp transitions can lead to a stringent constraint on the PBH mass (i.e. ${\cal O}(10^{2}{\rm gm}$)), which we advertise as a new No-go theorem. Finally, we will give some of the possible way-outs using which one can evade this proposed No-go theorem and produce solar/sub-solar mass PBHs.


title: Electronic Structure of Superconducting Infinite-Layer Lanthanum Nickelates

abstract: Revealing the momentum-resolved electronic structure of infinite-layer nickelates is essential for understanding this new class of unconventional superconductors, but has been hindered by the formidable challenges in improving the sample quality. In this work, we report for the first time the angle-resolved photoemission spectroscopy of superconducting La$_{0.8}$Sr$_{0.2}$NiO$_{2}$ films prepared by molecular beam epitaxy and ${\mathrm{\textit{in situ}}}$ atomic-hydrogen reduction. The measured Fermi topology closely matches theoretical calculations, showing a large Ni-$d_{x^2-y^2}$ derived Fermi sheet that evolves from hole-like to electron-like along $k_{z}$, and a three-dimensional (3D) electron pocket centered at Brillouin zone corner. The Ni-$d_{x^2-y^2}$ derived bands show a mass enhancement ($m^*/m_{\rm{DFT}}$) of 2-3,while the 3D electron band shows negligible band renormalization. Moreover, the Ni-$d_{x^2-y^2}$ derived states also display a band dispersion anomaly at higher binding energy, reminiscent of the waterfall feature and kinks observed in cuprates.


title: The transition operator of a random walk perturbated by sparse potentials

abstract: We consider an operator $P_V=(1+V)P$ on $\ell^2(Z^d)$, where $P$ is the transition operator of a symmetric irreducible random walk, and $V$ is a ``sparse'' potential. We first characterize the essential spectra of this operator. Secondly, we prove that all the eigenfunctions which correspond to discrete spectra decay exponentially fast. Thirdly, we give a sufficient condition for this operator to have an absolute spectral gap at the right edge of the spectra. Finally, as an application of the absolute spectral gap and the exponential decay of the eigenfunctions, we prove a limit theorem for the random walk under the Gibbs measure associated to the potential $V$.


title: Complementing Event Streams and RGB Frames for Hand Mesh Reconstruction

abstract: Reliable hand mesh reconstruction (HMR) from commonly-used color and depth sensors is challenging especially under scenarios with varied illuminations and fast motions. Event camera is a highly promising alternative for its high dynamic range and dense temporal resolution properties, but it lacks key texture appearance for hand mesh reconstruction. In this paper, we propose EvRGBHand -- the first approach for 3D hand mesh reconstruction with an event camera and an RGB camera compensating for each other. By fusing two modalities of data across time, space, and information dimensions,EvRGBHand can tackle overexposure and motion blur issues in RGB-based HMR and foreground scarcity and background overflow issues in event-based HMR. We further propose EvRGBDegrader, which allows our model to generalize effectively in challenging scenes, even when trained solely on standard scenes, thus reducing data acquisition costs. Experiments on real-world data demonstrate that EvRGBHand can effectively solve the challenging issues when using either type of camera alone via retaining the merits of both, and shows the potential of generalization to outdoor scenes and another type of event camera.


title: Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecture

abstract: Video Motion Magnification (VMM) aims to reveal subtle and imperceptible motion information of objects in the macroscopic world. Prior methods directly model the motion field from the Eulerian perspective by Representation Learning that separates shape and texture or Multi-domain Learning from phase fluctuations. Inspired by the frequency spectrum, we observe that the low-frequency components with stable energy always possess spatial structure and less noise, making them suitable for modeling the subtle motion field. To this end, we present FD4MM, a new paradigm of Frequency Decoupling for Motion Magnification with a Multi-level Isomorphic Architecture to capture multi-level high-frequency details and a stable low-frequency structure (motion field) in video space. Since high-frequency details and subtle motions are susceptible to information degradation due to their inherent subtlety and unavoidable external interference from noise, we carefully design Sparse High/Low-pass Filters to enhance the integrity of details and motion structures, and a Sparse Frequency Mixer to promote seamless recoupling. Besides, we innovatively design a contrastive regularization for this task to strengthen the model's ability to discriminate irrelevant features, reducing undesired motion magnification. Extensive experiments on both Real-world and Synthetic Datasets show that our FD4MM outperforms SOTA methods. Meanwhile, FD4MM reduces FLOPs by 1.63$\times$ and boosts inference speed by 1.68$\times$ than the latest method. Our code is available at https://github.com/Jiafei127/FD4MM.


title: Linear and smooth oriented equivalence of orthogonal representations of finite groups

abstract: Let $n\le 5$ be an integer, and let $\Gamma$ be a finite group. We prove that if $\rho , \rho': \Gamma \to O(n)$ are two representations that are conjugate by an orientation-preserving diffeomorphism, then they are conjugate by an element of $SO(n)$. In the process, we prove that if $G \subset O(4)$ is a finite group, then exactly one of the following is true: the elements of $G$ have a common invariant $1$-dimensional subspace in $\mathbb{R}^4$; some element of $G$ has no invariant $1$-dimensional subspace; or $G$ is conjugate to a specific group $K \subset O(4)$ of order $16$.


title: On Mirror Symmetry and Irrationality of Zeta Values

abstract: A fundamental object of study in mirror symmetry of $n$-dimensional Fano varieties is the A-side connection on small quantum cohomology. When the Picard rank is 1, the Borel transform relates the quantum differential operator of the Fano to the Picard-Fuchs operator of the mirror to the associated pencil of anticanonical Calabi-Yau $(n-1)$-folds on the Fano variety. Expanding on related work by W. Yang on the Beukers-Peters pencil of K3 surfaces associated with Ap\'ery's proof for the irrationality of $\zeta(3)$, for such operators we define holomorphic prepotentials, virtual Yukawa couplings, and virtual instanton numbers, analogous to the usual ingredients of Calabi-Yau mirror symmetry. We prove that when the underlying Calabi-Yau operator is modular, the virtual Yukawa coupling is a modular form of weight-$(n+1)$, with the holomorphic prepotential as an Eichler integral. We then analyze the quantum differential operators for modular pencils of K3 surfaces arising as Dolgachev-Nikulin-Pinkham mirrors for the anticanonical linear systems for the 17 deformation classes of Fano threefolds of Picard rank-1 classified by Iskovskikh from the perspective of Golyshev & Zagier's proof of the Gamma conjecture for such Fanos, the natural setting of Yang's work. Here, the virtual instanton numbers are proven to be periodic integers with period equal to the level of the modular subgroup. Finally, we conjecture that the geometric nature of these virtual instanton numbers can be understood in terms of relative genus zero Gromov-Witten invariants of the associated log Calabi-Yau pair from the Fano threefold and anticanonical K3.


title: VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark

abstract: Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model components, and data for LVLMs editing are limited. The existing LVLM editing benchmark, which comprises three metrics (Reliability, Locality, and Generality), falls short in the quality of synthesized evaluation images and cannot assess whether models apply edited knowledge in relevant content. Therefore, we employ more reliable data collection methods to construct a new Large $\textbf{V}$ision-$\textbf{L}$anguage Model $\textbf{K}$nowledge $\textbf{E}$diting $\textbf{B}$enchmark, $\textbf{VLKEB}$, and extend the Portability metric for more comprehensive evaluation. Leveraging a multi-modal knowledge graph, our image data are bound with knowledge entities. This can be further used to extract entity-related knowledge, which constitutes the base of editing data. We conduct experiments of different editing methods on five LVLMs, and thoroughly analyze how do they impact the models. The results reveal strengths and deficiencies of these methods and hopefully provide insights for future research. The codes and dataset are available at: $\href{https://github.com/VLKEB/VLKEB}{\text{https://github.com/VLKEB/VLKEB}}$.


title: An Effective Way to Determine the Separability of Quantum State

abstract: We propose in this work a practical approach, by virtue of correlation matrices of the generic observables, to study the long lasting tough issue of quantum separability. Some general separability conditions are set up through constructing a measurement-induced Bloch space. In essence, these conditions are established due to the self constraint in the space of quantum states. The new approach can not only reproduce many of the prevailing entanglement criteria, but also lead to even stronger results and manifest superiority for some bound entangled states. Moreover, as a by product, the new criteria are found directly transformable to the entanglement witness operators.


title: Predicting the Scaling Relations between the Dark Matter Halo Mass and Observables from Generalised Profiles I: Kinematic Tracers

abstract: We investigate the relationship between a dark matter halo's mass profile and measures of the velocity dispersion of kinematic tracers within its gravitational potential. By predicting the scaling relation of the halo mass with the aperture velocity dispersion, $M_\mathrm{vir} - \sigma_\mathrm{ap}$, we present the expected form and dependence of this halo mass tracer on physical parameters within our analytic halo model: parameterised by the halo's negative inner logarithmic density slope, $\alpha$, its concentration parameter, $c$, and its velocity anisotropy parameter, $\beta$. For these idealised halos, we obtain a general solution to the Jeans equation, which is projected over the line of sight and averaged within an aperture to form the corresponding aperture velocity dispersion profile. Through dimensional analysis, the $M_\mathrm{vir} - \sigma_\mathrm{ap}$ scaling relation is devised explicitly in terms of analytical bounds for these aperture velocity dispersion profiles: allowing constraints to be placed on this relation for motivated parameter choices. We predict the $M_{200} - \sigma_\mathrm{ap}$ and $M_{500} - \sigma_\mathrm{ap}$ scaling relations, each with an uncertainty of $60.5\%$ and $56.2\%$, respectively. These halo mass estimates are found to be weakly sensitive to the halo's concentration and mass scale, and most sensitive to the size of the aperture radius in which the aperture velocity dispersion is measured, the maximum value for the halo's inner slope, and the minimum and maximum values of the velocity anisotropy. Our results show that a halo's structural and kinematic profiles impose only a minor uncertainty in estimating its mass. Consequently, spectroscopic surveys aimed at constraining the halo mass using kinematic tracers can focus on characterising other, more complex sources of uncertainty and observational systematics.


title: Graph Unlearning with Efficient Partial Retraining

abstract: Graph Neural Networks (GNNs) have achieved remarkable success in various real-world applications. However, GNNs may be trained on undesirable graph data, which can degrade their performance and reliability. To enable trained GNNs to efficiently unlearn unwanted data, a desirable solution is retraining-based graph unlearning, which partitions the training graph into subgraphs and trains sub-models on them, allowing fast unlearning through partial retraining. However, the graph partition process causes information loss in the training graph, resulting in the low model utility of sub-GNN models. In this paper, we propose GraphRevoker, a novel graph unlearning framework that better maintains the model utility of unlearnable GNNs. Specifically, we preserve the graph property with graph property-aware sharding and effectively aggregate the sub-GNN models for prediction with graph contrastive sub-model aggregation. We conduct extensive experiments to demonstrate the superiority of our proposed approach.


title: BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin

abstract: Skeleton-based motion representations are robust for action localization and understanding for their invariance to perspective, lighting, and occlusion, compared with images. Yet, they are often ambiguous and incomplete when taken out of context, even for human annotators. As infants discern gestures before associating them with words, actions can be conceptualized before being grounded with labels. Therefore, we propose the first unsupervised pre-training framework, Boundary-Interior Decoding (BID), that partitions a skeleton-based motion sequence into discovered semantically meaningful pre-action segments. By fine-tuning our pre-training network with a small number of annotated data, we show results out-performing SOTA methods by a large margin.


title: Vector Quantization for Deep-Learning-Based CSI Feedback in Massive MIMO Systems

abstract: This paper presents a finite-rate deep-learning (DL)-based channel state information (CSI) feedback method for massive multiple-input multiple-output (MIMO) systems. The presented method provides a finite-bit representation of the latent vector based on a vector-quantized variational autoencoder (VQ-VAE) framework while reducing its computational complexity based on shape-gain vector quantization. In this method, the magnitude of the latent vector is quantized using a non-uniform scalar codebook with a proper transformation function, while the direction of the latent vector is quantized using a trainable Grassmannian codebook. A multi-rate codebook design strategy is also developed by introducing a codeword selection rule for a nested codebook along with the design of a loss function. Simulation results demonstrate that the proposed method reduces the computational complexity associated with VQ-VAE while improving CSI reconstruction performance under a given feedback overhead.


title: Premonition: Using Generative Models to Preempt Future Data Changes in Continual Learning

abstract: Continual learning requires a model to adapt to ongoing changes in the data distribution, and often to the set of tasks to be performed. It is rare, however, that the data and task changes are completely unpredictable. Given a description of an overarching goal or data theme, which we call a realm, humans can often guess what concepts are associated with it. We show here that the combination of a large language model and an image generation model can similarly provide useful premonitions as to how a continual learning challenge might develop over time. We use the large language model to generate text descriptions of semantically related classes that might potentially appear in the data stream in future. These descriptions are then rendered using Stable Diffusion to generate new labelled image samples. The resulting synthetic dataset is employed for supervised pre-training, but is discarded prior to commencing continual learning, along with the pre-training classification head. We find that the backbone of our pre-trained networks can learn representations useful for the downstream continual learning problem, thus becoming a valuable input to any existing continual learning method. Although there are complexities arising from the domain gap between real and synthetic images, we show that pre-training models in this manner improves multiple Class Incremenal Learning (CIL) methods on fine-grained image classification benchmarks. Supporting code can be found at https://github.com/cl-premonition/premonition.


title: Real-time observation of picosecond-timescale optical quantum entanglement toward ultrafast quantum information processing

abstract: Entanglement is a fundamental resource of various optical quantum-information-processing (QIP) applications. Towards high-speed QIP system, entanglement should be encoded in short wavepackets. We report real-time observation of ultrafast optical Einstein-Podolsky-Rosen (EPR) correlation at a picosecond timescale in a continuous-wave (CW) system. Optical phase-sensitive amplification using 6-THz-bandwidth waveguide-optical-parametric amplifier enhances the effective efficiency of 70-GHz-bandwidth homodyne detectors, mainly used in 5th-generation telecommunication, enabling its use in real-time quantum-state measurement. While power measurement using frequency scanning, i.e., optical spectrum analyzer, is not performed in real-time, our observation is demonstrated through real-time amplitude measurement and can be directly employed in QIP applications. Observed EPR states show quantum correlation of 4.5 dB below shotnoise level encoded in wavepackets with 40-ps period, equivalent to 25-GHz repetition -- ${10^3}$ times faster than previous entanglement observation in CW system. The quantum correlation of 4.5 dB is already sufficient for several QIP applications, and our system can be readily extended to large-scale entanglement. Moreover, our scheme has high compatibility with optical communication technology such as wavelength-division multiplexing, and femtosecond-timescale observation is also feasible. Our demonstration is paradigm shift in accelerating accessible quantum correlation, the foundational resource of all quantum applications, from the nanosecond to picosecond timescale, enabling ultra-fast optical QIP.


title: A novel fast iterative moment method for near-continuum flows

abstract: In this paper, we develop a novel fast iterative moment method for the steady-state simulation of near-continuum flows, which are modeled by the high-order moment system derived from the Boltzmann-BGK equation. The fast convergence of the present method is mainly achieved by alternately solving the moment system and the hydrodynamic equations with compatible constitutive relations and boundary conditions. To be specific, the compatible hydrodynamic equations are solved in each iteration to get improved predictions of macroscopic quantities, which are subsequently utilized to expedite the evolution of the moment system. Additionally, a semi-implicit scheme treating the collision term implicitly is introduced for the moment system. With cell-by-cell sweeping strategy, the resulting alternating iteration can be further accelerated for steady-state computation. It is also worth mentioning that such an alternating iteration works well with the nonlinear multigrid method. Numerical experiments for planar Couette flow, shock structure, and lid-driven cavity flow are carried out to investigate the performance of the proposed fast iterative moment method, and all results show wonderful efficiency and robustness.


title: FSC: Few-point Shape Completion

abstract: While previous studies have demonstrated successful 3D object shape completion with a sufficient number of points, they often fail in scenarios when a few points, e.g. tens of points, are observed. Surprisingly, via entropy analysis, we find that even a few points, e.g. 64 points, could retain substantial information to help recover the 3D shape of the object. To address the challenge of shape completion with very sparse point clouds, we then propose Few-point Shape Completion (FSC) model, which contains a novel dual-branch feature extractor for handling extremely sparse inputs, coupled with an extensive branch for maximal point utilization with a saliency branch for dynamic importance assignment. This model is further bolstered by a two-stage revision network that refines both the extracted features and the decoder output, enhancing the detail and authenticity of the completed point cloud. Our experiments demonstrate the feasibility of recovering 3D shapes from a few points. The proposed Few-point Shape Completion (FSC) model outperforms previous methods on both few-point inputs and many-point inputs, and shows good generalizability to different object categories.


title: Optimization of Pressure Management Strategies for Geological CO2 Sequestration Using Surrogate Model-based Reinforcement Learning

abstract: Injecting greenhouse gas into deep underground reservoirs for permanent storage can inadvertently lead to fault reactivation, caprock fracturing and greenhouse gas leakage when the injection-induced stress exceeds the critical threshold. Extraction of pre-existing fluids at various stages of injection process, referred as pressure management, can mitigate associated risks and lessen environmental impact. However, identifying optimal pressure management strategies typically requires thousands of full-order simulations due to the need for function evaluations, making the process computationally prohibitive. This paper introduces a novel surrogate model-based reinforcement learning method for devising optimal pressure management strategies for geological CO2 sequestration efficiently. Our approach comprises two steps. Firstly, a surrogate model is developed through the embed to control method, which employs an encoder-transition-decoder structure to learn latent dynamics. Leveraging this proxy model, reinforcement learning is utilized to find an optimal strategy that maximizes economic benefits while satisfying various control constraints. The reinforcement learning agent receives the latent state space representation and immediate reward tailored for CO2 sequestration and choose real-time controls which are subject to predefined engineering constraints in order to maximize the long-term cumulative rewards. To demonstrate its effectiveness, this framework is applied to a compositional simulation model where CO2 is injected into saline aquifer. The results reveal that our surrogate model-based reinforcement learning approach significantly optimizes CO2 sequestration strategies, leading to notable economic gains compared to baseline scenarios.


title: Migration of two Interacting Micro-Confined Deformable Drops Under an Imposed Temperature Gradient

abstract: A tiny drop of one liquid, suspended within another, may be set into motion aligned with an imposed thermal gradient, as influenced by thermocapillary action stemming from the gradients in interfacial tension due to the local variations in temperature. In real-world situations, however, such drops do not remain in isolation, as they interact with their neighbouring entities including other drops in the proximity as well as a nearby solid boundary, setting up a complex interplay between the confinement-mediated interactions and three-dimensional nature of the droplet dynamics. In this study, we present numerical solutions for the migration dynamics of a tightly-confined drop-couple, incorporating deformable interfaces, film flow, and Marangoni effects in the presence of dynamically evolving thermocapillary stresses induced by an imposed uniform temperature gradient. Unlike prior investigations, our work highlights the influence of the confinement towards orchestrating non-trivial features of drop migration, as dictated by an intricate coupling of the thermal and flow fields amidst the interferences of the domain boundaries. The study reveals that hydrodynamic interactions resulting from a juxtaposition of these influences deform the drops in a unique manner as compared to the characteristics evidenced from previously reported studies, causing a distortion of the local thermal fields around them. The consequent alteration in the drop velocities is shown to govern their migration in a distinctive manner, presenting unique signatures as compared to more restrictive scenarios studied previously. These findings hold significance in designing thermocapillary-driven micro-confined systems for controlling drop trajectories under an imposed thermal field, bearing far-reaching implications in a plethora of overarching applications ranging from droplet microfluidics to space technology.


title: Challenging Forgets: Unveiling the Worst-Case Forget Sets in Machine Unlearning

abstract: The trustworthy machine learning (ML) community is increasingly recognizing the crucial need for models capable of selectively 'unlearning' data points after training. This leads to the problem of machine unlearning (MU), aiming to eliminate the influence of chosen data points on model performance, while still maintaining the model's utility post-unlearning. Despite various MU methods for data influence erasure, evaluations have largely focused on random data forgetting, ignoring the vital inquiry into which subset should be chosen to truly gauge the authenticity of unlearning performance. To tackle this issue, we introduce a new evaluative angle for MU from an adversarial viewpoint. We propose identifying the data subset that presents the most significant challenge for influence erasure, i.e., pinpointing the worst-case forget set. Utilizing a bi-level optimization principle, we amplify unlearning challenges at the upper optimization level to emulate worst-case scenarios, while simultaneously engaging in standard training and unlearning at the lower level, achieving a balance between data influence erasure and model utility. Our proposal offers a worst-case evaluation of MU's resilience and effectiveness. Through extensive experiments across different datasets (including CIFAR-10, 100, CelebA, Tiny ImageNet, and ImageNet) and models (including both image classifiers and generative models), we expose critical pros and cons in existing (approximate) unlearning strategies. Our results illuminate the complex challenges of MU in practice, guiding the future development of more accurate and robust unlearning algorithms. The code is available at https://github.com/OPTML-Group/Unlearn-WorstCase.


title: A New Random Forest Ensemble of Intuitionistic Fuzzy Decision Trees

abstract: Classification is essential to the applications in the field of data mining, artificial intelligence, and fault detection. There exists a strong need in developing accurate, suitable, and efficient classification methods and algorithms with broad applicability. Random forest is a general algorithm that is often used for classification under complex conditions. Although it has been widely adopted, its combination with diverse fuzzy theory is still worth exploring. In this paper, we propose the intuitionistic fuzzy random forest (IFRF), a new random forest ensemble of intuitionistic fuzzy decision trees (IFDT). Such trees in forest use intuitionistic fuzzy information gain to select features and consider hesitation in information transmission. The proposed method enjoys the power of the randomness from bootstrapped sampling and feature selection, the flexibility of fuzzy logic and fuzzy sets, and the robustness of multiple classifier systems. Extensive experiments demonstrate that the IFRF has competitative and superior performance compared to other state-of-the-art fuzzy and ensemble algorithms. IFDT is more suitable for ensemble learning with outstanding classification accuracy. This study is the first to propose a random forest ensemble based on the intuitionistic fuzzy theory.


title: Hybrid Kinetics Embedding Framework for Dynamic PET Reconstruction

abstract: In dynamic positron emission tomography (PET) reconstruction, the importance of leveraging the temporal dependence of the data has been well appreciated. Current deep-learning solutions can be categorized in two groups in the way the temporal dynamics is modeled: data-driven approaches use spatiotemporal neural networks to learn the temporal dynamics of tracer kinetics from data, which relies heavily on data supervision; physics-based approaches leverage \textit{a priori} tracer kinetic models to focus on inferring their parameters, which relies heavily on the accuracy of the prior kinetic model. In this paper, we marry the strengths of these two approaches in a hybrid kinetics embedding (HyKE-Net) framework for dynamic PET reconstruction. We first introduce a novel \textit{hybrid} model of tracer kinetics consisting of a physics-based function augmented by a neural component to account for its gap to data-generating tracer kinetics, both identifiable from data. We then embed this hybrid model at the latent space of an encoding-decoding framework to enable both supervised and unsupervised identification of the hybrid kinetics and thereby dynamic PET reconstruction. Through both phantom and real-data experiments, we demonstrate the benefits of HyKE-Net -- especially in unsupervised reconstructions -- over existing physics-based and data-driven baselines as well as its ablated formulations where the embedded tracer kinetics are purely physics-based, purely neural, or hybrid but with a non-adaptable neural component.


title: On exactly solvable Yang-Baxter models and enhanced symmetries

abstract: We study Yang-Baxter deformations of the flat space string that result in exactly solvable models, finding the Nappi-Witten model and its higher dimensional generalizations. We then consider the spectra of these models obtained by canonical quantization in light-cone gauge, and match them with an integrability-based Bethe ansatz approach. By considering a generalized light-cone gauge we can describe the model by a nontrivially Drinfel'd twisted S matrix, explicitly verifying the twisted structure expected for such deformations. Next, the reformulation of the Nappi-Witten model as a Yang-Baxter deformation shows that Yang-Baxter models can have more symmetries than suggested by the $r$ matrix defining the deformation. We discuss these enhanced symmetries in more detail for some trivial and nontrivial examples. Finally, we observe that there are nonunimodular but Weyl-invariant Yang-Baxter models of a type not previously considered.