title: Bayesian segmented Gaussian copula factor model for single-cell sequencing data

abstract: Single-cell sequencing technologies have significantly advanced molecular and cellular biology, offering unprecedented insights into cellular heterogeneity by allowing for the measurement of gene expression at an individual cell level. However, the analysis of such data is challenged by the prevalence of low counts due to dropout events and the skewed nature of the data distribution, which conventional Gaussian factor models struggle to handle effectively. To address these challenges, we propose a novel Bayesian segmented Gaussian copula model to explicitly account for inflation of zero and near-zero counts, and to address the high skewness in the data. By employing a Dirichlet-Laplace prior for each column of the factor loadings matrix, we shrink the loadings of unnecessary factors towards zero, which leads to a simple approach to automatically determine the number of latent factors, and resolve the identifiability issue inherent in factor models due to the rotational invariance of the factor loadings matrix. Through simulation studies, we demonstrate the superior performance of our method over existing approaches in conducting factor analysis on data exhibiting the characteristics of single-cell data, such as excessive low counts and high skewness. Furthermore, we apply the proposed method to a real single-cell RNA-sequencing dataset from a lymphoblastoid cell line, successfully identifying biologically meaningful latent factors and detecting previously uncharacterized cell subtypes.


title: Initial data sets with vanishing mass are contained in pp-wave spacetimes

abstract: In 1981, Schoen-Yau and Witten showed that in General Relativity both the total energy $E$ and the total mass $m$ of an initial data set modelling an isolated gravitational system are non-negative. Moreover, if $E=0$, the initial data set must be contained in Minkowski space. In this paper, we show that if $m=0$, i.e. if $E$ equals the total momentum $|P|$, the initial data set must be contained in a pp-wave spacetime. Our proof combines spinorial methods with spacetime harmonic functions and works in all dimensions. Additionally, we find the decay rate threshold where the embedding has to be within Minkowski space and construct non-vacuum initial data sets with $m=0$ in the borderline case. As a consequence, this completely settles the rigidity of the spacetime positive mass theorem for spin manifolds.


title: Persuasion or Insulting? Unpacking Discursive Strategies of Gender Debate in Everyday Feminism in China

abstract: Speaking out for women's daily needs on social media has become a crucial form of everyday feminism in China. Gender debate naturally intertwines with such feminist advocacy, where users in opposite stances discuss gender-related issues through intense discourse. The complexities of gender debate necessitate a systematic understanding of discursive strategies for achieving effective gender communication that balances civility and constructiveness. To address this problem, we adopted a mixed-methods study to navigate discursive strategies in gender debate, focusing on 38,636 posts and 187,539 comments from two representative cases in China. Through open coding, we identified a comprehensive taxonomy of linguistic strategies in gender debate, capturing five overarching themes including derogation, gender distinction, intensification, mitigation, and cognizance guidance. Further, we applied regression analysis to unveil these strategies' correlations with user participation and response, illustrating the tension between debating tactics and public engagement. We discuss design implications to facilitate feminist advocacy on social media.


title: Exact Work Distribution and Jarzynski's Equality of a Relativistic Particle in an Expanding Piston

abstract: We study the non-equilibrium work in a pedagogical model of relativistic ideal gas. We obtain the exact work distribution and verify the Jarzynski's equality. In the non-relativistic limit, our results recover the non-relativistic results [arXiv:cond-mat/0502434]. We also find that, unlike the non-relativistic case, the work distribution no longer has zeros and the number of collisions in this relativistic gas model is finite. In addition, based on an analysis of the experimental parameters, we conclude that it is difficult to detect the relativistic effects of the work distribution of the ideal gas in a piston system with the current experimental techniques.


title: Term rewriting on nestohedra

abstract: We define term rewriting systems on the vertices and faces of nestohedra, and show that the former are confluent and terminating. While the associated poset on vertices generalizes Barnard--McConville's flip order for graph-associahedra, the preorder on faces likely generalizes the facial weak order for permutahedra. Moreover, we define and study contextual families of nestohedra, whose local confluence diagrams satisfy a certain uniformity condition. Among them are associahedra and operahedra, whose associated proofs of confluence for their rewriting systems reproduce proofs of categorical coherence theorems for monoidal categories and categorified operads.


title: Infinite dimensional open-loop linear quadratic stochastic optimal control problems and related games

abstract: We investigate the linear quadratic stochastic optimal control problems in infinite dimension without Markovian restriction for coefficients. The necessary and sufficient conditions for open-loop optimal controls are presented. We prove the Fr\'echet differentiable of the cost functional with respect to the control variable, and the Fr\'echet derivatives are characterized in detail by operators derived from dual analysis, which are proven to be the stationary conditions. Transposition methods are adopted to deal with the adjoint equations. As applications, we employ the results to study open-loop Nash equilibria for two-person stochastic differential games.


title: Knowledge-guided Machine Learning: Current Trends and Future Prospects

abstract: This paper presents an overview of scientific modeling and discusses the complementary strengths and weaknesses of ML methods for scientific modeling in comparison to process-based models. It also provides an introduction to the current state of research in the emerging field of scientific knowledge-guided machine learning (KGML) that aims to use both scientific knowledge and data in ML frameworks to achieve better generalizability, scientific consistency, and explainability of results. We discuss different facets of KGML research in terms of the type of scientific knowledge used, the form of knowledge-ML integration explored, and the method for incorporating scientific knowledge in ML. We also discuss some of the common categories of use cases in environmental sciences where KGML methods are being developed, using illustrative examples in each category.


title: Mars Spectrometry 2: Gas Chromatography -- Second place solution

abstract: The Mars Spectrometry 2: Gas Chromatography challenge was sponsored by NASA and run on the DrivenData competition platform in 2022. This report describes the solution which achieved the second-best score on the competition's test dataset. The solution utilized two-dimensional, image-like representations of the competition's chromatography data samples. A number of different Convolutional Neural Network models were trained and ensembled for the final submission.


title: Key varieties for prime $\mathbb{Q}$-Fano threefolds defined by Jordan algebras of cubic forms. Part II

abstract: Subsequent to the previous paper [Tak5], we are concerned with the classification of complex prime $\mathbb{Q}$-Fano $3$-folds of anti-canonical codimension 4 which are produced, as weighted complete intersections of appropriate weighted projectivizations of certain affine varieties related with $\mathbb{P}^{2}\times\mathbb{P}^{2}$-fibrations. Such affine varieties or their appropriate weighted projectivizations (possibly allowing some coordinates have weights $0$) are called key varieties for prime $\mathbb{Q}$-Fano 3-folds. The purpose of this paper is to give new constructions of a $14$-dimensional affine variety $\Upsilon_{\mathbb{A}}^{14}$ and a $15$-dimensional affine variety $\Pi_{\mathbb{A}}^{15}$ related with $\mathbb{P}^{2}\times\mathbb{P}^{2}$-fibration, which were constructed and were shown to be key varieties in the papers [Tak3,Tak4] and [Tay]. It is well-known that the affine cone of the Segre embedded $\mathbb{P}^{2}\times\mathbb{P}^{2}$ is defined as the null loci of the so called $\sharp$-mapping of a 9-dimensional nondegenerate quadratic Jordan algebra $J$ of a cubic form. Inspired with this fact, we construct $\Upsilon_{\mathbb{A}}^{14}$ and $\Pi_{\mathbb{A}}^{15}$ in the same way coordinatizing $J$ with 9 and 10 parameters, respectively. The coordinatization with $9$ parameters is derived by using a fixed primitive idempotent, and the associated Peirce decomposition. The coordinatization with $10$ parameters is derived from the construction of a quadratic Jordan subalgebra generated by $\sharp$-products of two elements due to Petersson [Pe1].


title: BIMCV-R: A Landmark Dataset for 3D CT Text-Image Retrieval

abstract: The burgeoning integration of 3D medical imaging into healthcare has led to a substantial increase in the workload of medical professionals. To assist clinicians in their diagnostic processes and alleviate their workload, the development of a robust system for retrieving similar case studies presents a viable solution. While the concept holds great promise, the field of 3D medical text-image retrieval is currently limited by the absence of robust evaluation benchmarks and curated datasets. To remedy this, our study presents a groundbreaking dataset, BIMCV-R (This dataset will be released upon acceptance.), which includes an extensive collection of 8,069 3D CT volumes, encompassing over 2 million slices, paired with their respective radiological reports. Expanding upon the foundational work of our dataset, we craft a retrieval strategy, MedFinder. This approach employs a dual-stream network architecture, harnessing the potential of large language models to advance the field of medical image retrieval beyond existing text-image retrieval solutions. It marks our preliminary step towards developing a system capable of facilitating text-to-image, image-to-text, and keyword-based retrieval tasks.


title: Robust-Locomotion-by-Logic: Perturbation-Resilient Bipedal Locomotion via Signal Temporal Logic Guided Model Predictive Control

abstract: This study introduces a robust planning framework that utilizes a model predictive control (MPC) approach, enhanced by incorporating signal temporal logic (STL) specifications. This marks the first-ever study to apply STL-guided trajectory optimization for bipedal locomotion, specifically designed to handle both translational and orientational perturbations. Existing recovery strategies often struggle with reasoning complex task logic and evaluating locomotion robustness systematically, making them susceptible to failures caused by inappropriate recovery strategies or lack of robustness. To address these issues, we design an analytical robustness metric for bipedal locomotion and quantify this metric using STL specifications, which guide the generation of recovery trajectories to achieve maximum locomotion robustness. To enable safe and computational-efficient crossed-leg maneuver, we design data-driven self-leg-collision constraints that are $1000$ times faster than the traditional inverse-kinematics-based approach. Our framework outperforms a state-of-the-art locomotion controller, a standard MPC without STL, and a linear-temporal-logic-based planner in a high-fidelity dynamic simulation, especially in scenarios involving crossed-leg maneuvers. Additionally, the Cassie bipedal robot achieves robust performance under horizontal and orientational perturbations such as those observed in ship motions. These environments are validated in simulations and deployed on hardware. Furthermore, our proposed method demonstrates versatility on stepping stones and terrain-agnostic features on inclined terrains.


title: Multi-Scale Spatio-Temporal Graph Convolutional Network for Facial Expression Spotting

abstract: Facial expression spotting is a significant but challenging task in facial expression analysis. The accuracy of expression spotting is affected not only by irrelevant facial movements but also by the difficulty of perceiving subtle motions in micro-expressions. In this paper, we propose a Multi-Scale Spatio-Temporal Graph Convolutional Network (SpoT-GCN) for facial expression spotting. To extract more robust motion features, we track both short- and long-term motion of facial muscles in compact sliding windows whose window length adapts to the temporal receptive field of the network. This strategy, termed the receptive field adaptive sliding window strategy, effectively magnifies the motion features while alleviating the problem of severe head movement. The subtle motion features are then converted to a facial graph representation, whose spatio-temporal graph patterns are learned by a graph convolutional network. This network learns both local and global features from multiple scales of facial graph structures using our proposed facial local graph pooling (FLGP). Furthermore, we introduce supervised contrastive learning to enhance the discriminative capability of our model for difficult-to-classify frames. The experimental results on the SAMM-LV and CAS(ME)^2 datasets demonstrate that our method achieves state-of-the-art performance, particularly in micro-expression spotting. Ablation studies further verify the effectiveness of our proposed modules.


title: Dimensionally Reducing Generalized Symmetries from (3+1)-Dimensions

abstract: Recently there has been an increasing interest in the study of generalized symmetries in dimensions higher than two. This has lead to the discovery of various manifestations of generalized symmetries, notably higher-group and non-invertible symmetries, in four dimensions. In this paper we shall examine what happens to this structure when the 4d theory is compactified to lower dimensions, specifically to 3d and 2d, where we shall be mainly interested in generalized symmetry structures whose origin can be linked to mixed flavor-gauge anomalies. We discuss several aspects of the compactification, and in particular argue that under certain conditions the discussed generalized symmetry structure may trivialize in the infrared. Nevertheless, we show that even when this happens the presence of the 4d generalized symmetry structure may still leave an imprint on the low-energy theory in terms of additional 't Hooft anomalies or by breaking part of the symmetry. We apply and illustrate this using known examples of compactifications from four dimensions, particularly, the reduction of 4d $\mathcal{N}=1$ $U(N_c)$ SQCD on a circle to 3d and on a sphere to 2d.


title: A unified kinematic wave theory for melt infiltration into firn

abstract: Motivated by the refreezing of melt water in firn we revisit the one-dimensional percolation of liquid water and non-reactive gas in porous ice. We analyze the dynamics of infiltration in the absence of capillary forces and heat conduction to understand the coupling between advective heat and mass transport in firn. In this limit, we formulate a kinematic wave theory that results in a 2X2-system of hyperbolic partial differential equations (PDEs) corresponding to the conservation of composition and enthalpy. For simple initial conditions (Riemann problems) this system admits self-similar solutions that illuminate the structure of melting/refreezing fronts and analytical solutions are provided for 12 basic cases of physical relevance encountered in the literature. Further we develop an extended kinematic theory that encompasses the cases when the firn saturates completely to form a perched water table governed by elliptic PDE so that the model is no longer fully hyperbolic (local). These solutions provide benchmarks for numerical models of melt infiltration into firn. They also provide insight into important physical processes such as the formation of frozen fringes, the perching of meltwater on pre-existing low porosity layers and the conditions required for impermeable ice lens formation. Lastly, these analytic solutions can be utilized to improve and compare the performance of the firn hydrology, ice-sheet and Earth system models. Our analysis provides a theoretical framework to understand these important processes in firn which affect the partitioning between meltwater infiltration and surface runoff and therefore determine the surface mass loss from ice sheets and its contribution to sea level rise.


title: On the Navier-Stokes equations and the Hamilton-Jacobi-Bellman equation on the group of volume preserving diffeomorphisms

abstract: In this paper, we give a new derivation of the incompressible Navier-Stokes equations on a compact Riemannian manifold $M$ via the Bellman dynamic programming principle on the infinite dimensional group of volume preserving diffeomorphisms $G={\rm SDiff}(M)$. In particular, when the viscosity vanishes, we give a new derivation of the incompressible Euler equation on a compact Riemannian manifold. The main result of this paper indicates an interesting relationship between the incompressible Navier-Stokes equations on $M$ and the Hamilton-Jacobi-Bellman equation on $G={\rm SDiff}(M)$.


title: Output Feedback Control of Suspended Sediment Load Entrainment in Water Canals and Reservoirs

abstract: This paper addresses the management of water flow in a rectangular open channel, considering the dynamic nature of both the channel's bathymetry and the suspended sediment particles caused by entrainment and deposition effects. The control-oriented model under study is a set of coupled nonlinear partial differential equations (PDEs) describing conservation of mass and momentum while accounting for constitutive relations that govern sediment erosion and deposition phenomena. The proposed boundary control problem presents a fresh perspective in water canal management and expands Saint-Venant Exner (SVE) control frameworks by integrating dynamics related to the transport of fine particles. After linearization, PDE backstepping design is employed to stabilize both the bathymetry, the water dynamics together with the concentration of suspended sediment particles. Two underflow sluice gates are used for flow control at the upstream and downstream boundaries with only the downstream component being actuated. An observer-based backstepping control design is carried out for the downstream gate using state measurement at the upstream gate to globally exponentially stabilize the linearized system to a desired equilibrium point in $\mathscr{L}^2$ sense. The stability analysis is performed on the linearized model which is a system of four coupled PDEs, three of which are rightward convecting and one leftward. The proposed control design has the potential to facilitate efficient reservoir flushing operations. Consistent simulation results are presented to illustrate the feasibility of the designed control law.


title: Near-Optimal differentially private low-rank trace regression with guaranteed private initialization

abstract: We study differentially private (DP) estimation of a rank-$r$ matrix $M \in \mathbb{R}^{d_1\times d_2}$ under the trace regression model with Gaussian measurement matrices. Theoretically, the sensitivity of non-private spectral initialization is precisely characterized, and the differential-privacy-constrained minimax lower bound for estimating $M$ under the Schatten-$q$ norm is established. Methodologically, the paper introduces a computationally efficient algorithm for DP-initialization with a sample size of $n \geq \widetilde O (r^2 (d_1\vee d_2))$. Under certain regularity conditions, the DP-initialization falls within a local ball surrounding $M$. We also propose a differentially private algorithm for estimating $M$ based on Riemannian optimization (DP-RGrad), which achieves a near-optimal convergence rate with the DP-initialization and sample size of $n \geq \widetilde O(r (d_1 + d_2))$. Finally, the paper discusses the non-trivial gap between the minimax lower bound and the upper bound of low-rank matrix estimation under the trace regression model. It is shown that the estimator given by DP-RGrad attains the optimal convergence rate in a weaker notion of differential privacy. Our powerful technique for analyzing the sensitivity of initialization requires no eigengap condition between $r$ non-zero singular values.


title: Stochastic maximum principle for weighted mean-field system with jump

abstract: In this article, we consider a weighted mean-field control problem with jump-diffusion as its state process. The main difficulty is from the non-Lipschitz property of the coefficients. We overcome this difficulty by an $L_{p,q}$-estimate of the solution processes with a suitably chosen $p$ and $q$. Convex pertubation method combining with the aforementioned $L_{p,q}$-estimation method is utilized to derive the stochastic maximum principle for this control problem. A sufficient condition for the optimality is also given.


title: Fine-Grained Assertion-Based Test Selection

abstract: For large software applications, running the whole test suite after each code change is time- and resource-intensive. Regression test selection techniques aim at reducing test execution time by selecting only the tests that are affected by code changes. However, existing techniques select test entities at coarse granularity levels such as test class, which causes imprecise test selection and executing unaffected tests. We propose a novel approach that increases the selection precision by analyzing test code at statement level and treating test assertions as the unit for selection. We implement our fine-grained test selection approach in a tool called SELERTION and evaluate it by comparing against two state-of-the-art test selection techniques using 11 open-source subjects. Our results show that SELERTION increases selection precision for all the subjects. Our test selection reduces, on average, 63% of the overall test time, making regression testing up to 23% faster than the other techniques. Our results also indicate that subjects with longer test execution time benefit more by our fine-grained selection technique.


title: SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking

abstract: Multimodal Visual Object Tracking (VOT) has recently gained significant attention due to its robustness. Early research focused on fully fine-tuning RGB-based trackers, which was inefficient and lacked generalized representation due to the scarcity of multimodal data. Therefore, recent studies have utilized prompt tuning to transfer pre-trained RGB-based trackers to multimodal data. However, the modality gap limits pre-trained knowledge recall, and the dominance of the RGB modality persists, preventing the full utilization of information from other modalities. To address these issues, we propose a novel symmetric multimodal tracking framework called SDSTrack. We introduce lightweight adaptation for efficient fine-tuning, which directly transfers the feature extraction ability from RGB to other domains with a small number of trainable parameters and integrates multimodal features in a balanced, symmetric manner. Furthermore, we design a complementary masked patch distillation strategy to enhance the robustness of trackers in complex environments, such as extreme weather, poor imaging, and sensor failure. Extensive experiments demonstrate that SDSTrack outperforms state-of-the-art methods in various multimodal tracking scenarios, including RGB+Depth, RGB+Thermal, and RGB+Event tracking, and exhibits impressive results in extreme conditions. Our source code is available at https://github.com/hoqolo/SDSTrack.


title: Diverse Representation Embedding for Lifelong Person Re-Identification

abstract: Lifelong Person Re-Identification (LReID) aims to continuously learn from successive data streams, matching individuals across multiple cameras. The key challenge for LReID is how to effectively preserve old knowledge while incrementally learning new information, which is caused by task-level domain gaps and limited old task datasets. Existing methods based on CNN backbone are insufficient to explore the representation of each instance from different perspectives, limiting model performance on limited old task datasets and new task datasets. Unlike these methods, we propose a Diverse Representations Embedding (DRE) framework that first explores a pure transformer for LReID. The proposed DRE preserves old knowledge while adapting to new information based on instance-level and task-level layout. Concretely, an Adaptive Constraint Module (ACM) is proposed to implement integration and push away operations between multiple overlapping representations generated by transformer-based backbone, obtaining rich and discriminative representations for each instance to improve adaptive ability of LReID. Based on the processed diverse representations, we propose Knowledge Update (KU) and Knowledge Preservation (KP) strategies at the task-level layout by introducing the adjustment model and the learner model. KU strategy enhances the adaptive learning ability of learner models for new information under the adjustment model prior, and KP strategy preserves old knowledge operated by representation-level alignment and logit-level supervision in limited old task datasets while guaranteeing the adaptive learning information capacity of the LReID model. Compared to state-of-the-art methods, our method achieves significantly improved performance in holistic, large-scale, and occluded datasets.


title: A Federated Parameter Aggregation Method for Node Classification Tasks with Different Graph Network Structures

abstract: Over the past few years, federated learning has become widely used in various classical machine learning fields because of its collaborative ability to train data from multiple sources without compromising privacy. However, in the area of graph neural networks, the nodes and network structures of graphs held by clients are different in many practical applications, and the aggregation method that directly shares model gradients cannot be directly applied to this scenario. Therefore, this work proposes a federated aggregation method FLGNN applied to various graph federation scenarios and investigates the aggregation effect of parameter sharing at each layer of the graph neural network model. The effectiveness of the federated aggregation method FLGNN is verified by experiments on real datasets. Additionally, for the privacy security of FLGNN, this paper designs membership inference attack experiments and differential privacy defense experiments. The results show that FLGNN performs good robustness, and the success rate of privacy theft is further reduced by adding differential privacy defense methods.


title: Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrieval

abstract: We study the zero-shot Composed Image Retrieval (ZS-CIR) task, which is to retrieve the target image given a reference image and a description without training on the triplet datasets. Previous works generate pseudo-word tokens by projecting the reference image features to the text embedding space. However, they focus on the global visual representation, ignoring the representation of detailed attributes, e.g., color, object number and layout. To address this challenge, we propose a Knowledge-Enhanced Dual-stream zero-shot composed image retrieval framework (KEDs). KEDs implicitly models the attributes of the reference images by incorporating a database. The database enriches the pseudo-word tokens by providing relevant images and captions, emphasizing shared attribute information in various aspects. In this way, KEDs recognizes the reference image from diverse perspectives. Moreover, KEDs adopts an extra stream that aligns pseudo-word tokens with textual concepts, leveraging pseudo-triplets mined from image-text pairs. The pseudo-word tokens generated in this stream are explicitly aligned with fine-grained semantics in the text embedding space. Extensive experiments on widely used benchmarks, i.e. ImageNet-R, COCO object, Fashion-IQ and CIRR, show that KEDs outperforms previous zero-shot composed image retrieval methods.


title: Crypto Inverse-Power Options and Fractional Stochastic Volatility

abstract: Recent empirical evidence has highlighted the crucial role of jumps in both price and volatility within the cryptocurrency market. In this paper, we introduce an analytical model framework featuring fractional stochastic volatility, accommodating price--volatility co-jumps and volatility short-term dependency concurrently. We particularly focus on inverse options, including the emerging Quanto inverse options and their power-type generalizations, aimed at mitigating cryptocurrency exchange rate risk and adjusting inherent risk exposure. Characteristic function-based pricing--hedging formulas are derived for these inverse options. The general model framework is then applied to asymmetric Laplace jump-diffusions and Gaussian-mixed tempered stable-type processes, employing three types of fractional kernels, for an extensive empirical analysis involving model calibration on two independent Bitcoin options data sets, during and after the COVID-19 pandemic. Key insights from our theoretical analysis and empirical findings include: (1) the superior performance of fractional stochastic-volatility models compared to various benchmark models, including those incorporating jumps and stochastic volatility, (2) the practical necessity of jumps in both price and volatility, along with their co-jumps and rough volatility, in the cryptocurrency market, (3) stability of calibrated parameter values in line with stylized facts, and (4) the suggestion that a piecewise kernel offers much higher computational efficiency relative to the commonly used Riemann--Liouville kernel in constructing fractional models, yet maintaining the same accuracy level, thanks to its potential for obtaining explicit model characteristic functions.


title: Uniformly nonsquare Banach spaces have the fixed point property 1

abstract: Another proof that uniformly nonsquare Banach spaces have the fixed point property is presented.


title: CBT-LLM: A Chinese Large Language Model for Cognitive Behavioral Therapy-based Mental Health Question Answering

abstract: The recent advancements in artificial intelligence highlight the potential of language models in psychological health support. While models trained on data from mental health service platform have achieved preliminary success, challenges persist in areas such as data scarcity, quality, and ensuring a solid foundation in psychological techniques. To address these challenges, this study introduces a novel approach to enhance the precision and efficacy of psychological support through large language models. Specifically, we design a specific prompt derived from principles of Cognitive Behavioral Therapy (CBT) and have generated the CBT QA dataset, specifically for Chinese psychological health Q&A based on CBT structured intervention strategies. Unlike previous methods, our dataset emphasizes professional and structured response. Utilizing this dataset, we fine-tuned the large language model, giving birth to CBT-LLM, the large-scale language model specifically designed for Cognitive Behavioral Therapy techniques. Empirical evaluations demonstrate that CBT-LLM excels in generating structured, professional, and highly relevant responses in psychological health support tasks, showcasing its practicality and quality. The model is available on Hugging Face: https://huggingface.co/Hongbin37/CBT-LLM.


title: SM2C: Boost the Semi-supervised Segmentation for Medical Image by using Meta Pseudo Labels and Mixed Images

abstract: Recently, machine learning-based semantic segmentation algorithms have demonstrated their potential to accurately segment regions and contours in medical images, allowing the precise location of anatomical structures and abnormalities. Although medical images are difficult to acquire and annotate, semi-supervised learning methods are efficient in dealing with the scarcity of labeled data. However, overfitting is almost inevitable due to the limited images for training. Furthermore, the intricate shapes of organs and lesions in medical images introduce additional complexity in different cases, preventing networks from acquiring a strong ability to generalize. To this end, we introduce a novel method called Scaling-up Mix with Multi-Class (SM2C). This method uses three strategies - scaling-up image size, multi-class mixing, and object shape jittering - to improve the ability to learn semantic features within medical images. By diversifying the shape of the segmentation objects and enriching the semantic information within each sample, the SM2C demonstrates its potential, especially in the training of unlabelled data. Extensive experiments demonstrate the effectiveness of the SM2C on three benchmark medical image segmentation datasets. The proposed framework shows significant improvements over state-of-the-art counterparts.


title: Aperiodic approximants bridging quasicrystals and modulated structures

abstract: Aperiodic crystals constitute a fascinating class of materials that includes incommensurate (IC) modulated structures and quasicrystals (QCs). Although these two categories share a common foundation in the concept of superspace, the relationship between them has remained enigmatic and largely unexplored. Here, we show "any metallic-mean" QCs, surpassing the confines of Penrose-like structures, and explore their connection with IC modulated structures. In contrast to periodic approximants of QCs, our work introduces the pivotal role of "aperiodic approximants", articulated through a series of $k$-th metallic-mean tilings serving as aperiodic approximants for the honeycomb crystal, while simultaneously redefining this tiling as a metallic-mean IC modulated structure, highlighting the intricate interplay between these crystallographic phenomena. We extend our findings to real-world applications, discovering these unique tiles in a terpolymer/homopolymer blend and applying our QC theory to a colloidal simulation displaying planar IC structures. In these structures, domain walls are viewed as essential components of a quasicrystal, introducing additional dimensions in superspace. Our research provides a fresh perspective on the intricate world of aperiodic crystals, shedding light on their broader implications for domain wall structures across various fields.


title: Uncovering the Ghostly Remains of an Extremely Diffuse Satellite in the Remote Halo of NGC 253

abstract: We present the discovery of NGC253-SNFC-dw1, a new satellite galaxy in the remote stellar halo of the Sculptor Group spiral, NGC 253. The system was revealed using deep resolved star photometry obtained as part of the Subaru Near-Field Cosmology Survey that uses the Hyper Suprime-Cam on the Subaru Telescope. Although rather luminous ($\rm{M_{V}} = -11.7 \pm 0.2$) and massive ($M_* \sim 1.25\times 10^7~\rm{M}_{\odot}$), the system is one of the most diffuse satellites yet known, with a half-light radius of $\rm{R_{h}} = 3.37 \pm 0.36$ kpc and an average surface brightness of $\sim 30.1$ mag arcmin$^{-2}$ within the $\rm{R_{h}}$. The colour-magnitude diagram shows a dominant old ($\sim 10$ Gyr) and metal-poor ($\rm{[M/H]}=-1.5 \pm 0.1$ dex) stellar population, as well as several candidate thermally-pulsing asymptotic giant branch stars. The distribution of red giant branch stars is asymmetrical and displays two elongated tidal extensions pointing towards NGC 253, suggestive of a highly disrupted system being observed at apocenter. NGC253-SNFC-dw1 has a size comparable to that of the puzzling Local Group dwarfs Andromeda XIX and Antlia 2 but is two magnitudes brighter. While unambiguous evidence of tidal disruption in these systems has not yet been demonstrated, the morphology of NGC253-SNFC-dw1 clearly shows that this is a natural path to produce such diffuse and extended galaxies. The surprising discovery of this system in a previously well-searched region of the sky emphasizes the importance of surface brightness limiting depth in satellite searches.


title: Determination of Hilbert modular forms using squarefree coefficients

abstract: Let $F$ (over $\mathbb{Q}$) be a totally real number field of narrow class number $1$. We generalize a result of Kohnen on the determination of half integral weight modular forms by their Fourier coefficients supported on squarefree (algebraic) integers. We also give a soft proof that infinitely many Fourier coefficients supported on squarefree integers are non-vanishing.


title: Performance evaluation of accelerated complex multiple-precision LU decomposition

abstract: The direct method is one of the most important algorithms for solving linear systems of equations, with LU decomposition comprising a significant portion of its computation time. This study explores strategies to accelerate complex LU decomposition using multiple-precision floating-point arithmetic of the multiple-component type. Specifically, we explore the potential efficiency gains using a combination of SIMDization and the 3M method for complex matrix multiplication. Our benchmark tests compare this approach with the direct method implementation in MPLAPACK, focusing on computation time and numerical errors.


title: Explicit form of simplified Grad's 13 moments distribution function-based moment gas kinetic solver with unstructured meshes for the multiscale rarefied flow

abstract: It is essential to efficiently solve multiscale flows covering the continuum regime to the rarefied regime. The explicit form of Grad's 13 moments distribution function-based moment gas kinetic solver (G13-MGKS) has been proposed in our previous work [Comput. Math. Appl., 137 (2023), pp. 112-125], which demonstrates the potential for efficiently simulating continuum flows accurately and presenting reasonable predictions for rarefied flows at moderate Knudsen numbers on structured meshes. To further extend the solver's applicability to unstructured meshes, we propose the simplified version of the Grad's 13 moments distribution function-based moment gas kinetic solver (SG13-MGKS) with an explicit form of the numerical flux in the present paper. The Shakhov collision model has been adopted and validated within the framework of SG13-MGKS to ensure the correct Prandtl number in the simulation. Additionally, a simplified treatment for the numerical fluxes has been adopted to minimize the need for complex calculations of the gradient of integral coefficients. The performance of SG13-MGKS has been evaluated in numerical cases of Couette flow with temperature differences, flow passing through a NACA0012 airfoil, and pressure-driven flow in a variable-diameter circular pipe. Our results demonstrate that SG13-MGKS can achieve reasonably accurate computational results at Knudsen numbers below 0.2. Benefiting from the avoidance of discretization in velocity space, G13-MGKS is able to be two orders of magnitude faster compared to the conventional discrete velocity method. Furthermore, the simplified form of numerical fluxes and the fewer gradients of integration coefficients enable the performance of SG13-MGKS on unstructured grids with a saving of about 4 times the computation time and 3 times the memory cost compared to the previous version of G13-MGKS.


title: MQE: Unleashing the Power of Interaction with Multi-agent Quadruped Environment

abstract: The advent of deep reinforcement learning (DRL) has significantly advanced the field of robotics, particularly in the control and coordination of quadruped robots. However, the complexity of real-world tasks often necessitates the deployment of multi-robot systems capable of sophisticated interaction and collaboration. To address this need, we introduce the Multi-agent Quadruped Environment (MQE), a novel platform designed to facilitate the development and evaluation of multi-agent reinforcement learning (MARL) algorithms in realistic and dynamic scenarios. MQE emphasizes complex interactions between robots and objects, hierarchical policy structures, and challenging evaluation scenarios that reflect real-world applications. We present a series of collaborative and competitive tasks within MQE, ranging from simple coordination to complex adversarial interactions, and benchmark state-of-the-art MARL algorithms. Our findings indicate that hierarchical reinforcement learning can simplify task learning, but also highlight the need for advanced algorithms capable of handling the intricate dynamics of multi-agent interactions. MQE serves as a stepping stone towards bridging the gap between simulation and practical deployment, offering a rich environment for future research in multi-agent systems and robot learning. For open-sourced code and more details of MQE, please refer to https://ziyanx02.github.io/multiagent-quadruped-environment/ .


title: Fill in the ____ (a Diffusion-based Image Inpainting Pipeline)

abstract: Image inpainting is the process of taking an image and generating lost or intentionally occluded portions. Inpainting has countless applications including restoring previously damaged pictures, restoring the quality of images that have been degraded due to compression, and removing unwanted objects/text. Modern inpainting techniques have shown remarkable ability in generating sensible completions for images with mask occlusions. In our paper, an overview of the progress of inpainting techniques will be provided, along with identifying current leading approaches, focusing on their strengths and weaknesses. A critical gap in these existing models will be addressed, focusing on the ability to prompt and control what exactly is generated. We will additionally justify why we think this is the natural next progressive step that inpainting models must take, and provide multiple approaches to implementing this functionality. Finally, we will evaluate the results of our approaches by qualitatively checking whether they generate high-quality images that correctly inpaint regions with the objects that they are instructed to produce.


title: Generalized Kramers-Wanier Duality from Bilinear Phase Map

abstract: We present the Bilinear Phase Map (BPM), a concept that extends the Kramers-Wannier (KW) transformation to investigate unconventional gapped phases, their dualities, and phase transitions. Defined by a matrix of $\mathbb{Z}_2$ elements, the BPM not only encapsulates the essence of KW duality but also enables exploration of a broader spectrum of generalized quantum phases and dualities. By analyzing the BPM's linear algebraic properties, we elucidate the loss of unitarity in duality transformations and derive general non-invertible fusion rules. Applying this framework to (1+1)D systems yields the discovery of new dualities, shedding light on the interplay between various Symmetry Protected Topological (SPT) and Spontaneous Symmetry Breaking (SSB) phases. Additionally, we construct a duality web that interconnects these phases and their transitions, offering valuable insights into relations between different quantum phases.

categories: cond-mat.str-el cond-mat.stat-mech math-ph math.MP


title: Understanding the Impact of Referent Design on Scale Perception in Immersive Data Visualization

abstract: Referents are often used to enhance scale perception in immersive visualizations. Common referent designs include the considerations of referent layout (side-by-side vs. in-situ) and referent size (small vs. medium vs. large). This paper introduces a controlled user study to assess how different referent designs affect the efficiency and accuracy of scale perception across different data scales, on the performance of the size-matching task in the virtual environment. Our results reveal that in-situ layouts significantly enhance accuracy and confidence across various data scales, particularly with large referents. Linear regression analyses further confirm that in-situ layouts exhibit greater resilience to changes in data scale. For tasks requiring efficiency, medium-sized referents emerge as the preferred choice. Based on these findings, we offer design guidelines for selecting referent layouts and sizes in immersive visualizations.


title: Shaping a Surface Microdroplet by Marangoni Forces along a Moving Contact Line of Four Immiscible Phases

abstract: The ability to transfer microdroplets between fluid phases offers numerous advantages in various fields, enabling better control, manipulation, and utilization of small volumes of fluids in pharmaceutical formulations, microfluidics, and lab-on-a-chip devices, single-cell analysis or droplet-based techniques for nanomaterial synthesis. This study focuses on the stability and morphology of a sessile oil microdroplet at the four-phase contact line of solid-water-oil-air during the droplet transfer from underwater to air. We observed a distinct transition in microdroplet dynamics, characterized by a shift from a scenario dominated by Marangoni forces to one dominated by capillary forces. In the regime dominated by Marangoni forces, the oil microdroplets spread in response to the contact between the water-air interface and the water-oil interface and the emergence of an oil concentration gradient along the water-air interface. The spreading distance along the four-phase contact line follows a power law relationship of $t^{3/4}$, reflecting the balance between Marangoni forces and viscous forces. On the other hand, in the capillarity-dominated regime, the oil microdroplets remain stable at the contact line and after being transferred into the air. We identify the crossover between these two regimes in the parameter space defined by three factors: the approaching velocity of the solid-water-air contact line ($v_{cl}$), the radius of the oil microdroplet ($r_o$), and the radius of the water drop ($r_w$). Furthermore, we demonstrate how to use the four-phase contact line for shaping oil microdroplets using a full liquid process by the contact line lithography. The findings in this study may be also applied to materials synthesis where nanoparticles, microspheres, or nanocapsules are produced by microdroplet-based techniques.


title: PaPr: Training-Free One-Step Patch Pruning with Lightweight ConvNets for Faster Inference

abstract: As deep neural networks evolve from convolutional neural networks (ConvNets) to advanced vision transformers (ViTs), there is an increased need to eliminate redundant data for faster processing without compromising accuracy. Previous methods are often architecture-specific or necessitate re-training, restricting their applicability with frequent model updates. To solve this, we first introduce a novel property of lightweight ConvNets: their ability to identify key discriminative patch regions in images, irrespective of model's final accuracy or size. We demonstrate that fully-connected layers are the primary bottleneck for ConvNets performance, and their suppression with simple weight recalibration markedly enhances discriminative patch localization performance. Using this insight, we introduce PaPr, a method for substantially pruning redundant patches with minimal accuracy loss using lightweight ConvNets across a variety of deep learning architectures, including ViTs, ConvNets, and hybrid transformers, without any re-training. Moreover, the simple early-stage one-step patch pruning with PaPr enhances existing patch reduction methods. Through extensive testing on diverse architectures, PaPr achieves significantly higher accuracy over state-of-the-art patch reduction methods with similar FLOP count reduction. More specifically, PaPr reduces about 70% of redundant patches in videos with less than 0.8% drop in accuracy, and up to 3.7x FLOPs reduction, which is a 15% more reduction with 2.5% higher accuracy.


title: Digital Twin Assisted Intelligent Network Management for Vehicular Applications

abstract: The emerging data-driven methods based on artificial intelligence (AI) have paved the way for intelligent, flexible, and adaptive network management in vehicular applications. To enhance network management towards network automation, this article presents a digital twin (DT) assisted two-tier learning framework, which facilitates the automated life-cycle management of machine learning based intelligent network management functions (INMFs). Specifically, at a high tier, meta learning is employed to capture different levels of general features for the INMFs under nonstationary network conditions. At a low tier, individual learning models are customized for local networks based on fast model adaptation. Hierarchical DTs are deployed at the edge and cloud servers to assist the two-tier learning process, through closed-loop interactions with the physical network domain. Finally, a case study demonstrates the fast and accurate model adaptation ability of meta learning in comparison with benchmark schemes.


title: Roles of boundary and equation-of-motion terms in cosmological correlation functions

abstract: We revisit the properties of total time-derivative terms as well as terms proportional to the free equation of motion (EOM) in a Schwinger-Keldysh formalism. They are relevant to the correct calculation of correlation functions of curvature perturbations in the context of inflationary Universe. We show that these two contributions to the action play different roles in the operator or the path-integral formalism, but they give the same correlation functions as each other. As a concrete example, we confirm that the Maldacena's consistency relations for the three-point correlation function in the slow-roll inflationary scenario driven by a minimally coupled canonical scalar field hold in both the operator and path-integral formalisms. We also give some comments on loop calculations.


title: RPMArt: Towards Robust Perception and Manipulation for Articulated Objects

abstract: Articulated objects are commonly found in daily life. It is essential that robots can exhibit robust perception and manipulation skills for articulated objects in real-world robotic applications. However, existing methods for articulated objects insufficiently address noise in point clouds and struggle to bridge the gap between simulation and reality, thus limiting the practical deployment in real-world scenarios. To tackle these challenges, we propose a framework towards Robust Perception and Manipulation for Articulated Objects (RPMArt), which learns to estimate the articulation parameters and manipulate the articulation part from the noisy point cloud. Our primary contribution is a Robust Articulation Network (RoArtNet) that is able to predict both joint parameters and affordable points robustly by local feature learning and point tuple voting. Moreover, we introduce an articulation-aware classification scheme to enhance its ability for sim-to-real transfer. Finally, with the estimated affordable point and articulation joint constraint, the robot can generate robust actions to manipulate articulated objects. After learning only from synthetic data, RPMArt is able to transfer zero-shot to real-world articulated objects. Experimental results confirm our approach's effectiveness, with our framework achieving state-of-the-art performance in both noise-added simulation and real-world environments. The code and data will be open-sourced for reproduction. More results are published on the project website at https://r-pmart.github.io .


title: A Unified Module for Accelerating STABLE-DIFFUSION: LCM-LORA

abstract: This paper presents a comprehensive study on the unified module for accelerating stable-diffusion processes, specifically focusing on the lcm-lora module. Stable-diffusion processes play a crucial role in various scientific and engineering domains, and their acceleration is of paramount importance for efficient computational performance. The standard iterative procedures for solving fixed-source discrete ordinates problems often exhibit slow convergence, particularly in optically thick scenarios. To address this challenge, unconditionally stable diffusion-acceleration methods have been developed, aiming to enhance the computational efficiency of transport equations and discrete ordinates problems. This study delves into the theoretical foundations and numerical results of unconditionally stable diffusion synthetic acceleration methods, providing insights into their stability and performance for model discrete ordinates problems. Furthermore, the paper explores recent advancements in diffusion model acceleration, including on device acceleration of large diffusion models via gpu aware optimizations, highlighting the potential for significantly improved inference latency. The results and analyses in this study provide important insights into stable diffusion processes and have important ramifications for the creation and application of acceleration methods specifically, the lcm-lora module in a variety of computing environments.


title: Electromagnetic-Field-Based Circuit Theory and Charge-Flux-Flow Diagrams

abstract: The conventional circuit diagrams and graph-based circuit theory are used for the phase-independent circuits such as resistor-inductor-capacitor (RLC) circuits and semiconductor transistor circuits, rather than the phase-dependent circuits such as Josephson junction circuits and quantum-phase-slip (QPS) junction circuits. in the age of artificial intelligence (AI), we present an electromagnetic-field-based circuit theory to unify the phase-independent and phase-dependent electric circuits. This theory drives two general system models for all electric circuits, and visualizes the dynamics of circuit devices with electric-charge-flow (ECF) diagrams and the magnetic-flux-flow (MFF) diagrams. ECF and MFF diagrams enable electric circuits to be designed and analyzed like the molecules composed of two kinds of atoms; they are promising for the language to train AI-aided electronic-design-automation (EDA) tools.


title: A transformer-based neural operator for large-eddy simulation of turbulence

abstract: Predicting the large-scale dynamics of three-dimensional (3D) turbulence is challenging for machine learning approaches. This paper introduces a transformer-based neural operator (TNO) to achieve precise and efficient predictions in the large-eddy simulation (LES) of 3D turbulence. The performance of the proposed TNO model is systematically tested and compared with LES using classical sub-grid scale (SGS) models, including the dynamic Smagorinsky model (DSM) and the dynamic mixed model (DMM), as well as the original Fourier neural operator (FNO) model, in homogeneous isotropic turbulence (HIT) and free-shear turbulent mixing layer. The numerical simulations comprehensively evaluate the performance of these models on a variety of flow statistics, including the velocity spectrum, the probability density functions (PDFs) of vorticity, the PDFs of velocity increments, the evolution of turbulent kinetic energy, and the iso-surface of the Q-criterion. The results indicate that the accuracy of the TNO model is comparable to the LES with DSM model, and outperforms the FNO model and LES using DMM in HIT. In the free-shear turbulence, the TNO model exhibits superior accuracy compared to other models. Moreover, the TNO model has fewer parameters than the FNO model and enables long-term stable predictions, which the FNO model cannot achieve. The well-trained TNO model is significantly faster than traditional LES with DSM and DMM models, and can be generalized to higher Taylor-Reynolds number cases, indicating its strong potential for 3D nonlinear engineering applications.


title: Many-one reducibility with realizability

abstract: In this article, we propose a new classification of $\Sigma^0_2$ formulas under the realizability interpretation of many-one reducibility (i.e., Levin reducibility). For example, ${\sf Fin}$, the decision of being eventually zero for sequences, is many-one/Levin complete among $\Sigma^0_2$ formulas of the form $\exists n\forall m\geq n.\varphi(m,x)$, where $\varphi$ is decidable. The decision of boundedness for sequences ${\sf BddSeq}$ and for width of posets ${\sf FinWidth}$ are many-one/Levin complete among $\Sigma^0_2$ formulas of the form $\exists n\forall m\geq n\forall k.\varphi(m,k,x)$, where $\varphi$ is decidable. However, unlike the classical many-one reducibility, none of the above is $\Sigma^0_2$-complete. The decision of non-density of linear order ${\sf NonDense}$ is truly $\Sigma^0_2$-complete.


title: Exploring the Impact of Dataset Bias on Dataset Distillation

abstract: Dataset Distillation (DD) is a promising technique to synthesize a smaller dataset that preserves essential information from the original dataset. This synthetic dataset can serve as a substitute for the original large-scale one, and help alleviate the training workload. However, current DD methods typically operate under the assumption that the dataset is unbiased, overlooking potential bias issues within the dataset itself. To fill in this blank, we systematically investigate the influence of dataset bias on DD. To the best of our knowledge, this is the first exploration in the DD domain. Given that there are no suitable biased datasets for DD, we first construct two biased datasets, CMNIST-DD and CCIFAR10-DD, to establish a foundation for subsequent analysis. Then we utilize existing DD methods to generate synthetic datasets on CMNIST-DD and CCIFAR10-DD, and evaluate their performance following the standard process. Experiments demonstrate that biases present in the original dataset significantly impact the performance of the synthetic dataset in most cases, which highlights the necessity of identifying and mitigating biases in the original datasets during DD. Finally, we reformulate DD within the context of a biased dataset. Our code along with biased datasets are available at https://github.com/yaolu-zjut/Biased-DD.


title: Planning Charging Stations and Service Operations of Dockless Electric Micromobility Systems

abstract: Dockless electric micro-mobility services (e.g., shared e-scooters and e-bikes) have been increasingly popular in the recent decade, and a variety of charging technologies have emerged for these services. The use of charging stations, to/from which service vehicles are transported by the riders for charging, poses as a promising approach because it reduces the need for dedicated staff or contractors. However, unique challenges also arise, such as how to incentivize riders to drop off vehicles at stations and how to efficiently utilize the vehicles being charged at the stations. This paper focuses on dockless e-scooters as an example and develops a new spatial queuing network model to capture the steady-state scooter service cycles, battery consumption and charging processes, and the associated pricing and management mechanisms. Building upon this model, a system of closed-form equations is formulated and incorporated into a constrained nonlinear program to optimize the deployment of the service fleet, the design of charging stations (i.e., number, location, and capacity), user-based charging price promotions and priorities, and repositioning truck operations (i.e., headway and truck load). The proposed queuing network model is found to match very well with agent-based simulations. It is applied to a series of numerical experiments to draw insights into the optimal designs and the system performance. The numerical results reveal strong advantages of using charging stations for shared dockless electric micro-mobility services as compared to state-of-the-art alternatives. The proposed model can also be used to analyze other micromobility services and other charging approaches.


title: VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections

abstract: Graph transformer has been proven as an effective graph learning method for its adoption of attention mechanism that is capable of capturing expressive representations from complex topological and feature information of graphs. Graph transformer conventionally performs dense attention (or global attention) for every pair of nodes to learn node representation vectors, resulting in quadratic computational costs that are unaffordable for large-scale graph data. Therefore, mini-batch training for graph transformers is a promising direction, but limited samples in each mini-batch can not support effective dense attention to encode informative representations. Facing this bottleneck, (1) we start by assigning each node a token list that is sampled by personalized PageRank (PPR) and then apply standard multi-head self-attention only on this list to compute its node representations. This PPR tokenization method decouples model training from complex graph topological information and makes heavy feature engineering offline and independent, such that mini-batch training of graph transformers is possible by loading each node's token list in batches. We further prove this PPR tokenization is viable as a graph convolution network with a fixed polynomial filter and jumping knowledge. However, only using personalized PageRank may limit information carried by a token list, which could not support different graph inductive biases for model training. To this end, (2) we rewire graphs by introducing multiple types of virtual connections through structure- and content-based super nodes that enable PPR tokenization to encode local and global contexts, long-range interaction, and heterophilous information into each node's token list, and then formalize our Virtual Connection Ranking based Graph Transformer (VCR-Graphormer).


title: Learning Directed Acyclic Graphs from Partial Orderings

abstract: Directed acyclic graphs (DAGs) are commonly used to model causal relationships among random variables. In general, learning the DAG structure is both computationally and statistically challenging. Moreover, without additional information, the direction of edges may not be estimable from observational data. In contrast, given a complete causal ordering of the variables, the problem can be solved efficiently, even in high dimensions. In this paper, we consider the intermediate problem of learning DAGs when a partial causal ordering of variables is available. We propose a general estimation framework for leveraging the partial ordering and present efficient estimation algorithms for low- and high-dimensional problems. The advantages of the proposed framework are illustrated via numerical studies.


title: FineWAVE: Fine-Grained Warning Verification of Bugs for Automated Static Analysis Tools

abstract: Automated Static Analysis Tools (ASATs) have evolved over time to assist in detecting bugs. However, the excessive false warnings can impede developers' productivity and confidence in the tools. Previous research efforts have explored learning-based methods to validate the reported warnings. Nevertheless, their coarse granularity, focusing on either long-term warnings or function-level alerts, which are insensitive to individual bugs. Also, they rely on manually crafted features or solely on source code semantics, which is inadequate for effective learning. In this paper, we propose FineWAVE, a learning-based approach that verifies bug-sensitive warnings at a fine-grained granularity. Specifically, we design a novel LSTM-based model that captures multi-modal semantics of source code and warnings from ASATs and highlights their correlations with cross-attention. To tackle the data scarcity of training and evaluation, we collected a large-scale dataset of 280,273 warnings. We conducted extensive experiments on the dataset to evaluate FineWAVE. The experimental results demonstrate the effectiveness of our approach, with an F1-score of 97.79\% for reducing false alarms and 67.06% for confirming actual warnings, significantly outperforming all baselines. Moreover, we have applied our FineWAVE to filter out about 92% warnings in four popular real-world projects, and found 25 new bugs with minimal manual effort.


title: Node Classification via Semantic-Structural Attention-Enhanced Graph Convolutional Networks

abstract: Graph data, also known as complex network data, is omnipresent across various domains and applications. Prior graph neural network models primarily focused on extracting task-specific structural features through supervised learning objectives, but they fell short in capturing the inherent semantic and structural features of the entire graph. In this paper, we introduce the semantic-structural attention-enhanced graph convolutional network (SSA-GCN), which not only models the graph structure but also extracts generalized unsupervised features to enhance vertex classification performance. The SSA-GCN's key contributions lie in three aspects: firstly, it derives semantic information through unsupervised feature extraction from a knowledge graph perspective; secondly, it obtains structural information through unsupervised feature extraction from a complex network perspective; and finally, it integrates these features through a cross-attention mechanism. By leveraging these features, we augment the graph convolutional network, thereby enhancing the model's generalization capabilities. Our experiments on the Cora and CiteSeer datasets demonstrate the performance improvements achieved by our proposed method. Furthermore, our approach also exhibits excellent accuracy under privacy settings, making it a robust and effective solution for graph data analysis.


title: V2X-Real: a Largs-Scale Dataset for Vehicle-to-Everything Cooperative Perception

abstract: Recent advancements in Vehicle-to-Everything (V2X) technologies have enabled autonomous vehicles to share sensing information to see through occlusions, greatly boosting the perception capability. However, there are no real-world datasets to facilitate the real V2X cooperative perception research -- existing datasets either only support Vehicle-to-Infrastructure cooperation or Vehicle-to-Vehicle cooperation. In this paper, we propose a dataset that has a mixture of multiple vehicles and smart infrastructure simultaneously to facilitate the V2X cooperative perception development with multi-modality sensing data. Our V2X-Real is collected using two connected automated vehicles and two smart infrastructures, which are all equipped with multi-modal sensors including LiDAR sensors and multi-view cameras. The whole dataset contains 33K LiDAR frames and 171K camera data with over 1.2M annotated bounding boxes of 10 categories in very challenging urban scenarios. According to the collaboration mode and ego perspective, we derive four types of datasets for Vehicle-Centric, Infrastructure-Centric, Vehicle-to-Vehicle, and Infrastructure-to-Infrastructure cooperative perception. Comprehensive multi-class multi-agent benchmarks of SOTA cooperative perception methods are provided. The V2X-Real dataset and benchmark codes will be released.


title: Strongly asymmetric magnetization switching and programmable complete Boolean logic enabled by long-range intralayer Dzyaloshinskii-Moriya interaction

abstract: Electrical switching of magnetization is central to spintronics. Despite the enormous efforts on the spin torques and the Dzyaloshinskii-Moriya interaction (DMI) effects, some fundamental physics for electrical switching of magnetization is still missing as indicated by a number of remarkable long-standing puzzles. Here, we report the discovery of the long-range intralayer DMI effect widely existing in magnetic heterostructure, which is distinct from the yet-known DMI effects as it describes the chiral coupling of two orthogonal magnetic domains within the same magnetic layer via the mediation of an adjacent heavy metal layer. The long-range intralayer DMI generates a strong perpendicular effective magnetic field (H_DMI^z) on the perpendicular magnetization. Characteristically, H_DMI^z varies with the sign/magnitude of the interfacial DMI constant, the applied in-plane magnetic fields, and the distribution of the perpendicular magnetic anisotropy. The long-range intralayer DMI results in striking consequences including the strongly asymmetric current/field switching of perpendicular magnetization, hysteresis loop shift of perpendicular magnetization in the absence of in-plane direct current, and sharp, complete switching of perpendicular magnetization purely by an in-plane magnetic field. Utilizing the long-range intralayer DMI effect, we demonstrate programable, complete Boolean logic operations (i.e., AND, NAND, NOT, OR, and NOR) within a single spin-orbit torque device. These results will stimulate the investigation of the long-range intralayer DMI effect and its impacts on a variety of spintronic devices.


title: Left $\theta$-derivations on weighted convolution algebras

abstract: Let $\theta$ be a homomorphism on $L_0^\infty({\Bbb R}^+, \omega)^*$. In this paper, we study left $\theta$-derivations on $L_0^\infty({\Bbb R}^+, \omega)^*$. We show that every left $\theta$-derivation on $L_0^\infty({\Bbb R}^+, \omega)^*$ is always a $\theta$-derivation, and if $\theta$ is isomorphism, then $L_0^\infty({\Bbb R}^+, \omega)^*$ has no non-zero left $\theta$-derivation. We also investigate automatic continuity, Singer-Wermer's conjecture and Posner's first theorem for left $\theta-$derivations on $L_0^\infty({\Bbb R}^+, \omega)^*$.


title: Knowledge-aware Dual-side Attribute-enhanced Recommendation

abstract: \textit{Knowledge-aware} recommendation methods (KGR) based on \textit{graph neural networks} (GNNs) and \textit{contrastive learning} (CL) have achieved promising performance. However, they fall short in modeling fine-grained user preferences and further fail to leverage the \textit{preference-attribute connection} to make predictions, leading to sub-optimal performance. To address the issue, we propose a method named \textit{\textbf{K}nowledge-aware \textbf{D}ual-side \textbf{A}ttribute-enhanced \textbf{R}ecommendation} (KDAR). Specifically, we build \textit{user preference representations} and \textit{attribute fusion representations} upon the attribute information in knowledge graphs, which are utilized to enhance \textit{collaborative filtering} (CF) based user and item representations, respectively. To discriminate the contribution of each attribute in these two types of attribute-based representations, a \textit{multi-level collaborative alignment contrasting} mechanism is proposed to align the importance of attributes with CF signals. Experimental results on four benchmark datasets demonstrate the superiority of KDAR over several state-of-the-art baselines. Further analyses verify the effectiveness of our method. The code of KDAR is released at: \href{https://github.com/TJTP/KDAR}{https://github.com/TJTP/KDAR}.


title: Monotonic Paraphrasing Improves Generalization of Language Model Prompting

abstract: Performance of large language models (LLMs) may vary with different prompts or instructions of even the same task. One commonly recognized factor for this phenomenon is the model's familiarity with the given prompt or instruction, which is typically estimated by its perplexity. However, finding the prompt with the lowest perplexity is challenging, given the enormous space of possible prompting phrases. In this paper, we propose monotonic paraphrasing (MonoPara), an end-to-end decoding strategy that paraphrases given prompts or instructions into their lower perplexity counterparts based on an ensemble of a paraphrase LM for prompt (or instruction) rewriting, and a target LM (i.e. the prompt or instruction executor) that constrains the generation for lower perplexity. The ensemble decoding process can efficiently paraphrase the original prompt without altering its semantic meaning, while monotonically decreasing the perplexity of each generation as calculated by the target LM. We explore in detail both greedy and search-based decoding as two alternative decoding schemes of MonoPara. Notably, MonoPara does not require any training and can monotonically lower the perplexity of the paraphrased prompt or instruction, leading to improved performance of zero-shot LM prompting as evaluated on a wide selection of tasks. In addition, MonoPara is also shown to effectively improve LMs' generalization on perturbed and unseen task instructions.


title: Robust estimations from distribution structures: III. Invariant Moments

abstract: Descriptive statistics for parametric models are currently highly sensative to departures, gross errors, and/or random errors. Here, leveraging the structures of parametric distributions and their central moment kernel distributions, a class of estimators, consistent simultanously for both a semiparametric distribution and a distinct parametric distribution, is proposed. These efficient estimators are robust to both gross errors and departures from parametric assumptions, making them ideal for estimating the mean and central moments of common unimodal distributions. This article opens up the possibility of utilizing the common nature of probability models to construct near-optimal estimators that are suitable for various scenarios.


title: General One-loop Generating Function by IBP relations

abstract: In this paper we have studied the most general generating function of reduction for one loop integrals with arbitrary tensor structure in numerator and arbitrary power distribution of propagators in denominator. Using IBP relations, we have established the partial differential equations for these generating functions and solved them analytically. These results provide useful guidance for applying generating function method to reductions of higher loop integrals.


title: KG-particles in a cosmic string rainbow gravity spacetime in mixed magnetic fields

abstract: We investigate and report the effects of rainbow gravity on the spectroscopic structure of KG-oscillators in a mixed magnetic field (in the sense that it has the usually described as a uniform and a non-uniform magnetic fields, each at a time) introduced by the 4-vector potential $A_\mu=(0,0,A_\varphi,0)$, where $A_\varphi=B_1 r^2/2+B_2 r$, and $B_1$ and $B_2$ are magnetic field strengths. We also discuss and report the effects of such a mixed magnetic field on the spectra of KG-oscillators in cosmic string rainbow gravity. In so doing, we introduce a new and quite handy \textit{conditionally exact solution} associated with the truncation of the biconfluent Heun functions into polynomials. Using a loop quantum gravity motivated rainbow functions, we observe interesting effects when the magnetic field strength $B_2$ grows up from zero. Such effects include energy levels crossings which, in this case, turns the spectra of the KG-oscillators upside down. Moreover, Landau-like signature on the spectra are observed and discussed. Yet, interestingly, we also observe that rainbow gravity affects the magnetic field as well, in the sense that the magnetic field becomes probe particle energy-dependent one.


title: Force Controlled Printing for Material Extrusion Additive Manufacturing

abstract: In material extrusion additive manufacturing, the extrusion process is commonly controlled in a feed-forward fashion. The amount of material to be extruded at each printing location is pre-computed by a planning software. This approach is inherently unable to adapt the extrusion to external and unexpected disturbances, and the quality of the results strongly depends on a number of modeling and tuning parameters. To overcome these limitations, we propose the first framework for Force Controlled Printing for material extrusion additive manufacturing. We utilize a custom-built extruder to measure the extrusion force in real time, and use this quantity as feedback to continuously control the material flow in closed-loop. We demonstrate the existence of a strong correlation between extrusion force and line width, which we exploit to deposit lines of desired width in a width range of 33 % up to 233 % of the nozzle diameter. We also show how Force Controlled Printing outperforms conventional feed-forward extrusion in print quality and disturbance rejection, while requiring little tuning and automatically adapting to changes in the hardware settings. With no adaptation, Force Controlled Printing can deposit lines of desired width under severe disturbances in bed leveling, such as at layer heights ranging between 20 % and 200 % of the nominal height.


title: Semantic Is Enough: Only Semantic Information For NeRF Reconstruction

abstract: Recent research that combines implicit 3D representation with semantic information, like Semantic-NeRF, has proven that NeRF model could perform excellently in rendering 3D structures with semantic labels. This research aims to extend the Semantic Neural Radiance Fields (Semantic-NeRF) model by focusing solely on semantic output and removing the RGB output component. We reformulate the model and its training procedure to leverage only the cross-entropy loss between the model semantic output and the ground truth semantic images, removing the colour data traditionally used in the original Semantic-NeRF approach. We then conduct a series of identical experiments using the original and the modified Semantic-NeRF model. Our primary objective is to obverse the impact of this modification on the model performance by Semantic-NeRF, focusing on tasks such as scene understanding, object detection, and segmentation. The results offer valuable insights into the new way of rendering the scenes and provide an avenue for further research and development in semantic-focused 3D scene understanding.


title: Hybrid classical-quantum image processing via polar Walsh basis functions

abstract: We propose a novel hybrid classical-quantum approach for image processing based on polar Walsh basis functions. Using this approach, we present an algorithm for the removal of the circular banding noise (including Airy pattern noise) and the azimuthal banding noise. This approach is based on a formulation of Walsh basis functions in polar coordinates for image representations. This approach also builds upon an earlier work on a hybrid classical-quantum algorithm for Walsh-Hadamard transforms. We provide two kinds of polar representations using uniform area measure and uniform radial measure. Effective smoothening and interpolating techniques are devised relevant to the transformations between Cartesian and polar coordinates, mitigating the challenges posed by the non-injectivity of the transformation in the context of digital images. The hybrid classical-quantum approach presented here involves an algorithm for Walsh-Hadamard transforms, which has a lower computational complexity of $\mathcal{O}(N)$ compared to the well-known classical Fast Walsh-Hadamard Transform, which has a computational complexity of $\mathcal{O}(N \log_2 N)$. We demonstrated the applicability of our approach through computational examples involving the removal of the circular banding noise (including Airy pattern noise) and the azimuthal banding noise.


title: MIMO with Analogue 1-bit Phase Shifters: A Quantum Annealing Perspective

abstract: In this letter, we study the analogue pre/post-coding vector design for a point-to-point multiple-input multiple-output (MIMO) system with 1-bit phase shifters. Specifically, we focus on the signal-to-noise ratio (SNR) maximization problem which corresponds to a combinatorial NP-hard due to the binary phase resolution. Two classical computation heuristics are proposed i.e., i) an 1-bit real-valued approximation of the optimal digital designs, and ii) an alternating optimization where a Rayleigh quotient problem is solved at each iteration. An iterative quantum annealing (QA)-based heuristic is also investigated, which outperforms classical counterparts and achieves near-optimal performance while ensuring polynomial time complexity. Experimental results in a real-world D-WAVE QA device validate the efficiency of the proposed QA approach.


title: Digital control of negative imaginary systems: a discrete-time hybrid integrator-gain system approach

abstract: A hybrid integrator-gain system (HIGS) is a control element that switches between an integrator and a gain, which overcomes some inherent limitations of linear controllers. In this paper, we consider using discrete-time HIGS controllers for the digital control of negative imaginary (NI) systems. We show that the discrete-time HIGS themselves are step-advanced negative imaginary systems. For a minimal linear NI system, there always exists a HIGS controller that can asymptotically stablize it. An illustrative example is provided, where we use the proposed HIGS control method to stabilize a discrete-time mass-spring system.


title: Elemental Patterns from the Erd\H{o}s Straus Conjecture

abstract: This paper makes the following conjecture: For every prime $p$ there exists a positive integer $x$ with $\left\lceil \frac{p}{4} \right\rceil \leq x \leq \left\lceil \frac{p}{2} \right\rceil$ and a positive divisor $d|x^2$ so that either: (1) $ d \bmod \left( 4x - p \right) \equiv -px$; or (2) $d \leq x$ and $ d \bmod \left( 4x - p \right) \equiv -x$. Furthermore this paper proves that the solutions to these modular equations are in one-to-one correspondence with the solutions of the diophantine equation used in the Erd\H{o}s Straus conjecture.


title: Edit3K: Universal Representation Learning for Video Editing Components

abstract: This paper focuses on understanding the predominant video creation pipeline, i.e., compositional video editing with six main types of editing components, including video effects, animation, transition, filter, sticker, and text. In contrast to existing visual representation learning of visual materials (i.e., images/videos), we aim to learn visual representations of editing actions/components that are generally applied on raw materials. We start by proposing the first large-scale dataset for editing components of video creation, which covers about $3,094$ editing components with $618,800$ videos. Each video in our dataset is rendered by various image/video materials with a single editing component, which supports atomic visual understanding of different editing components. It can also benefit several downstream tasks, e.g., editing component recommendation, editing component recognition/retrieval, etc. Existing visual representation methods perform poorly because it is difficult to disentangle the visual appearance of editing components from raw materials. To that end, we benchmark popular alternative solutions and propose a novel method that learns to attend to the appearance of editing components regardless of raw materials. Our method achieves favorable results on editing component retrieval/recognition compared to the alternative solutions. A user study is also conducted to show that our representations cluster visually similar editing components better than other alternatives. Furthermore, our learned representations used to transition recommendation tasks achieve state-of-the-art results on the AutoTransition dataset. The code and dataset will be released for academic use.


title: Improving Demand Forecasting in Open Systems with Cartogram-Enhanced Deep Learning

abstract: Predicting temporal patterns across various domains poses significant challenges due to their nuanced and often nonlinear trajectories. To address this challenge, prediction frameworks have been continuously refined, employing data-driven statistical methods, mathematical models, and machine learning. Recently, as one of the challenging systems, shared transport systems such as public bicycles have gained prominence due to urban constraints and environmental concerns. Predicting rental and return patterns at bicycle stations remains a formidable task due to the system's openness and imbalanced usage patterns across stations. In this study, we propose a deep learning framework to predict rental and return patterns by leveraging cartogram approaches. The cartogram approach facilitates the prediction of demand for newly installed stations with no training data as well as long-period prediction, which has not been achieved before. We apply this method to public bicycle rental-and-return data in Seoul, South Korea, employing a spatial-temporal convolutional graph attention network. Our improved architecture incorporates batch attention and modified node feature updates for better prediction accuracy across different time scales. We demonstrate the effectiveness of our framework in predicting temporal patterns and its potential applications.


title: Heterogeneous Federated Learning with Splited Language Model

abstract: Federated Split Learning (FSL) is a promising distributed learning paradigm in practice, which gathers the strengths of both Federated Learning (FL) and Split Learning (SL) paradigms, to ensure model privacy while diminishing the resource overhead of each client, especially on large transformer models in a resource-constrained environment, e.g., Internet of Things (IoT). However, almost all works merely investigate the performance with simple neural network models in FSL. Despite the minor efforts focusing on incorporating Vision Transformers (ViT) as model architectures, they train ViT from scratch, thereby leading to enormous training overhead in each device with limited resources. Therefore, in this paper, we harness Pre-trained Image Transformers (PITs) as the initial model, coined FedV, to accelerate the training process and improve model robustness. Furthermore, we propose FedVZ to hinder the gradient inversion attack, especially having the capability compatible with black-box scenarios, where the gradient information is unavailable. Concretely, FedVZ approximates the server gradient by utilizing a zeroth-order (ZO) optimization, which replaces the backward propagation with just one forward process. Empirically, we are the first to provide a systematic evaluation of FSL methods with PITs in real-world datasets, different partial device participations, and heterogeneous data splits. Our experiments verify the effectiveness of our algorithms.


title: Segment Anything Model for Road Network Graph Extraction

abstract: We propose SAM-Road, an adaptation of the Segment Anything Model (SAM) for extracting large-scale, vectorized road network graphs from satellite imagery. To predict graph geometry, we formulate it as a dense semantic segmentation task, leveraging the inherent strengths of SAM. The image encoder of SAM is fine-tuned to produce probability masks for roads and intersections, from which the graph vertices are extracted via simple non-maximum suppression. To predict graph topology, we designed a lightweight transformer-based graph neural network, which leverages the SAM image embeddings to estimate the edge existence probabilities between vertices. Our approach directly predicts the graph vertices and edges for large regions without expensive and complex post-processing heuristics, and is capable of building complete road network graphs spanning multiple square kilometers in a matter of seconds. With its simple, straightforward, and minimalist design, SAM-Road achieves comparable accuracy with the state-of-the-art method RNGDet++, while being 40 times faster on the City-scale dataset. We thus demonstrate the power of a foundational vision model when applied to a graph learning task. The code is available at https://github.com/htcr/sam_road.


title: Symmetric bi-derivations on certain Banach algebras

abstract: Let $A$ be a Banach algebra with a right identity $u$ such that $uA$ is commutative and semisimple. In this paper, we investigate symmetric bi-derivations of $A$ and detremine their range. We also study symmetric bi-derivations of $A$ with their $k$-centralizing trace. Finally, we prove every symmetric Jordan bi-derivation of $A$ is a symmetric bi-derivation.


title: Quantitatively predicting angle-resolved polarized Raman intensity of black phosphorus flakes

abstract: In-plane anisotropic layered materials (ALMs), such as black phosphorus (BP), exhibit unique angle-resolved polarized Raman (ARPR) spectroscopy characteristics, as attributed to birefringence, linear dichroism and complex Raman tensor. Moreover, the ARPR intensity profiles of BP flakes deposited on multilayer dielectrics are notably sensitive to their thickness, owing to interference effects. The intricate anisotropic effects present challenges in accurately predicting the ARPR intensity of BP flakes. In this study, we propose a comprehensive strategy for predicting the ARPR intensity of BP flakes by explicitly considering optical anisotropy, encompassing birefringence, linear dichroism, and anisotropic cavity interference effects within multilayered structures. Through this approach, we have identified the intrinsic complex Raman tensors for phonon modes, independent of the BP flake thickness. By leveraging this methodology, we have elucidated the flake thickness-dependent effective complex Raman tensor elements, allowing for precise prediction of the observed ARPR intensity profile for the BP flake. This work provides a profound understanding of ARPR behaviors for ALM flakes.


title: Many-hypercube codes: High-rate quantum error-correcting codes for high-performance fault-tolerant quantum computation

abstract: Conventional approaches to quantum error correction for fault-tolerant quantum computation are based on encoding a single logical qubit into many physical qubits, resulting in asymptotically zero encoding rates and therefore huge resource overheads. To overcome this issue, high-rate quantum codes, such as quantum low-density parity-check codes, have been studied over the past decade. However, such codes have complex structure, making it difficult to perform logical gate operations in parallel without sacrificing their advantage. Observing the simple structure and high rates of quantum error-detecting codes, here we propose concatenated high-rate quantum error-detecting codes as a new family of high-rate quantum codes. Their simple structure allows for a geometrical interpretation using hypercubes, each of which corresponds to a logical qubit. We thus call them many-hypercube codes. The encoding rate is remarkably high, e.g., 30% (64 logical qubits are encoded into 216 physical qubits). Developing a dedicated high-performance decoder, we achieve high error thresholds even in a circuit-level noise model. Logical gate operations are also parallelizable. Thus, the many-hypercube codes will pave the way to high-performance fault-tolerant quantum computation.


title: Modal-adaptive Knowledge-enhanced Graph-based Financial Prediction from Monetary Policy Conference Calls with LLM

abstract: Financial prediction from Monetary Policy Conference (MPC) calls is a new yet challenging task, which targets at predicting the price movement and volatility for specific financial assets by analyzing multimodal information including text, video, and audio. Although the existing work has achieved great success using cross-modal transformer blocks, it overlooks the potential external financial knowledge, the varying contributions of different modalities to financial prediction, as well as the innate relations among different financial assets. To tackle these limitations, we propose a novel Modal-Adaptive kNowledge-enhAnced Graph-basEd financial pRediction scheme, named MANAGER. Specifically, MANAGER resorts to FinDKG to obtain the external related knowledge for the input text. Meanwhile, MANAGER adopts BEiT-3 and Hidden-unit BERT (HuBERT) to extract the video and audio features, respectively. Thereafter, MANAGER introduces a novel knowledge-enhanced cross-modal graph that fully characterizes the semantic relations among text, external knowledge, video and audio, to adaptively utilize the information in different modalities, with ChatGLM2 as the backbone. Extensive experiments on a publicly available dataset Monopoly verify the superiority of our model over cutting-edge methods.


title: Qibo: A Large Language Model for Traditional Chinese Medicine

abstract: Large Language Models (LLMs) has made significant progress in a number of professional fields, including medicine, law, and finance. However, in traditional Chinese medicine (TCM), there are challenges such as the essential differences between theory and modern medicine, the lack of specialized corpus resources, and the fact that relying only on supervised fine-tuning may lead to overconfident predictions. To address these challenges, we propose a two-stage training approach that combines continuous pre-training and supervised fine-tuning. A notable contribution of our study is the processing of a 2GB corpus dedicated to TCM, constructing pre-training and instruction fine-tuning datasets for TCM, respectively. In addition, we have developed Qibo-Benchmark, a tool that evaluates the performance of LLM in the TCM on multiple dimensions, including subjective, objective, and three TCM NLP tasks. The medical LLM trained with our pipeline, named $\textbf{Qibo}$, exhibits significant performance boosts. Compared to the baselines, the average subjective win rate is 63%, the average objective accuracy improved by 23% to 58%, and the Rouge-L scores for the three TCM NLP tasks are 0.72, 0.61, and 0.55. Finally, we propose a pipline to apply Qibo to TCM consultation and demonstrate the model performance through the case study.


title: Anisotropic auxetic composite laminates: a polar approach

abstract: The problem of obtaining anisotropic auxetic composite laminates, i.e. having a negative Poisson's ratio for at least some directions, is examined in this paper. In particular, the possibility of obtaining auxeticity stacking uni-directional identical plies is considered. It is shown that if the ply is composed by isotropic matrix and fibers, then it is impossible to obtain totally auxetic orthotropic laminates, i.e. auxeticity for each direction, unless at least one among matrix and fibers is auxetic itself. Moreover, it is shown what are the conditions, in terms of the mechanical properties of the constituents and of the volume fraction of the fibers, to fabricate uni-directional plies with which to realize laminates having a negative Poisson's ratio for some directions. Several existing materials are also examined. All the analysis is done using the polar formalism, very effective for the study of plane anisotropic problems.


title: Exponential mixing of constrained random dynamical systems via controllability conditions

abstract: We provide deterministic controllability conditions that imply exponential mixing properties for randomly forced constrained dynamical systems with possibly unbounded state space. As an application, new ergodicity results are obtained for non-smooth models in elasto-plasticity driven by various types of noise, including white noise. It is thereby illustrated how tools from control theory can be utilized to tackle regularity issues that commonly arise in the qualitative study of constrained systems.


title: Manifold Regularization Classification Model Based On Improved Diffusion Map

abstract: Manifold regularization model is a semi-supervised learning model that leverages the geometric structure of a dataset, comprising a small number of labeled samples and a large number of unlabeled samples, to generate classifiers. However, the original manifold norm limits the performance of models to local regions. To address this limitation, this paper proposes an approach to improve manifold regularization based on a label propagation model. We initially enhance the probability transition matrix of the diffusion map algorithm, which can be used to estimate the Neumann heat kernel, enabling it to accurately depict the label propagation process on the manifold. Using this matrix, we establish a label propagation function on the dataset to describe the distribution of labels at different time steps. Subsequently, we extend the label propagation function to the entire data manifold. We prove that the extended label propagation function converges to a stable distribution after a sufficiently long time and can be considered as a classifier. Building upon this concept, we propose a viable improvement to the manifold regularization model and validate its superiority through experiments.


title: Port Forwarding Services Are Forwarding Security Risks

abstract: We conduct the first comprehensive security study on representative port forwarding services (PFS), which emerge in recent years and make the web services deployed in internal networks available on the Internet along with better usability but less complexity compared to traditional techniques (e.g., NAT traversal techniques). Our study is made possible through a set of novel methodologies, which are designed to uncover the technical mechanisms of PFS, experiment attack scenarios for PFS protocols, automatically discover and snapshot port-forwarded websites (PFWs) at scale, and classify PFWs into well-observed categories. Leveraging these methodologies, we have observed the widespread adoption of PFS with millions of PFWs distributed across tens of thousands of ISPs worldwide. Furthermore, 32.31% PFWs have been classified into website categories that serve access to critical data or infrastructure, such as, web consoles for industrial control systems, IoT controllers, code repositories, and office automation systems. And 18.57% PFWs didn't enforce any access control for external visitors. Also identified are two types of attacks inherent in the protocols of Oray (one well-adopted PFS provider), and the notable abuse of PFSes by malicious actors in activities such as malware distribution, botnet operation and phishing.