title: Uniqueness of lump solutions of KP-I equation

abstract: The KP-I equation has family of solutions which decay to zero at space infinity. One of these solutions is the classical lump solution. This is a traveling wave, and the KP-I equation in this case reduces to the Boussinesq equation. In this paper we classify the lump type solutions of the Boussinesq equation. Using a robust inverse scattering transform developed by Bilman-Miller, we show that the lump type solutions are rational and their tau function has to be a polynomial of degree $k(k+1)$. In particular, this implies that the lump solution is the unique ground state of the KP-I equation (as conjectured by Klein and Saut in \cite{Klein0}). Our result generalizes a theorem by Airault-McKean-Moser on the classification of rational solutions for the KdV equation.


title: A solid-state high harmonic generation spectrometer with cryogenic cooling

abstract: Solid-state high harmonic generation spectroscopy (sHHG) is a promising technique for studying electronic structure, symmetry, and dynamics in condensed matter systems. Here, we report on the implementation of an advanced sHHG spectrometer based on a vacuum chamber and closed-cycle helium cryostat. Using an in situ temperature probe, it is demonstrated that the sample interaction region retains cryogenic temperature during the application of high-intensity femtosecond laser pulses that generate high harmonics. The presented implementation opens the door for temperature-dependent sHHG measurements down to few Kelvin, which makes sHHG spectroscopy a new tool for studying phases of matter that emerge at low temperatures, which is particularly interesting for highly correlated materials.


title: Efficient Curriculum based Continual Learning with Informative Subset Selection for Remote Sensing Scene Classification

abstract: We tackle the problem of class incremental learning (CIL) in the realm of landcover classification from optical remote sensing (RS) images in this paper. The paradigm of CIL has recently gained much prominence given the fact that data are generally obtained in a sequential manner for real-world phenomenon. However, CIL has not been extensively considered yet in the domain of RS irrespective of the fact that the satellites tend to discover new classes at different geographical locations temporally. With this motivation, we propose a novel CIL framework inspired by the recent success of replay-memory based approaches and tackling two of their shortcomings. In order to reduce the effect of catastrophic forgetting of the old classes when a new stream arrives, we learn a curriculum of the new classes based on their similarity with the old classes. This is found to limit the degree of forgetting substantially. Next while constructing the replay memory, instead of randomly selecting samples from the old streams, we propose a sample selection strategy which ensures the selection of highly confident samples so as to reduce the effects of noise. We observe a sharp improvement in the CIL performance with the proposed components. Experimental results on the benchmark NWPU-RESISC45, PatternNet, and EuroSAT datasets confirm that our method offers improved stability-plasticity trade-off than the literature.


title: On Galois self-orthogonal algebraic geometry codes

abstract: Galois self-orthogonal (SO) codes are generalizations of Euclidean and Hermitian SO codes. Algebraic geometry (AG) codes are the first known class of linear codes exceeding the Gilbert-Varshamov bound. Both of them have attracted much attention for their rich algebraic structures and wide applications in these years. In this paper, we consider them together and study Galois SO AG codes. A criterion for an AG code being Galois SO is presented. Based on this criterion, we construct several new classes of maximum distance separable (MDS) Galois SO AG codes from projective lines and several new classes of Galois SO AG codes from projective elliptic curves, hyper-elliptic curves and hermitian curves. In addition, we give an embedding method that allows us to obtain more MDS Galois SO codes from known MDS Galois SO AG codes.


title: From Vlasov-Maxwell-Landau system with Coulomb potential to two-fluid incompressible Navier-Stokes-Fourier-Maxwell system with Ohm's law

abstract: In the diffusive regime, we obtain the uniform in Knudsen number estimate on the two-species Vlasov-Maxwell-Landau system with Coulomb potential around the global equilibrium. As a consequence, we justify the limit to the two-fluid incompressible Navier-Stokes-Fourier-Maxwell (NSFM) system with Ohm's law. This is the first result on the global in time uniform in Knudsen number estimate on the Boltzmann and Landau type equations with Coulomb potential coupled Vlasov-Maxwell equations.


title: An inequality for the Delta-genus of toric varieties

abstract: For a polarized toric variety (X,L) of dimension n less than 5, we give a lower bound of the Delta-genus by using the vanishing number of adjoint bundle of a multiple of L. We show that for a polarized toric variety of dimension n with non-vanishing adjoint bundle, the Delta-genus is more than or equal to n-1.


title: Self-Purification and Entanglement Revival in Lambda Matter

abstract: In this study, we explore the dynamics of entanglement in an ensemble of three-level systems with a lambda-type level structure interacting with single-mode bosons. Our investigation focuses on zero-energy states within the subspace of totally symmetric wave functions. Remarkably, we observe a universal two-stage dynamics of entanglement with intriguing revival behavior. The revival of entanglement is a consequence of the self-purification process, where the quantum state relaxes and converges universally to a special dark state within the system.


title: Integration of Vision-based Object Detection and Grasping for Articulated Manipulator in Lunar Conditions

abstract: The integration of vision-based frameworks to achieve lunar robot applications faces numerous challenges such as terrain configuration or extreme lighting conditions. This paper presents a generic task pipeline using object detection, instance segmentation and grasp detection, that can be used for various applications by using the results of these vision-based systems in a different way. We achieve a rock stacking task on a non-flat surface in difficult lighting conditions with a very good success rate of 92%. Eventually, we present an experiment to assemble 3D printed robot components to initiate more complex tasks in the future.


title: Diagnosing the role of observable distribution shift in scientific replications

abstract: Many researchers have identified distribution shift as a likely contributor to the reproducibility crisis in behavioral and biomedical sciences. The idea is that if treatment effects vary across individual characteristics and experimental contexts, then studies conducted in different populations will estimate different average effects. This paper uses ``generalizability" methods to quantify how much of the effect size discrepancy between an original study and its replication can be explained by distribution shift on observed unit-level characteristics. More specifically, we decompose this discrepancy into ``components" attributable to sampling variability (including publication bias), observable distribution shifts, and residual factors. We compute this decomposition for several directly-replicated behavioral science experiments and find little evidence that observable distribution shifts contribute appreciably to non-replicability. In some cases, this is because there is too much statistical noise. In other cases, there is strong evidence that controlling for additional moderators is necessary for reliable replication.


title: Key varieties for prime $\mathbb{Q}$-Fano threefolds defined by Freudenthal triple systems

abstract: In this paper, we concern with the classification of complex prime $\mathbb{Q}$-Fano $3$-folds of anti-canonical codimension 4 which are produced, as weighted complete intersections of appropriate weighted projectivizations of certain affine varieties related with $\mathbb{P}^{1}\times\mathbb{P}^{1}\times\mathbb{P}^{1}$-fibrations. Such affine varieties or their appropriate weighted projectivizations are called key varieties for prime $\mathbb{Q}$-Fano 3-folds. We realize that the equations of the key varieties can be described conceptually by Freudenthal triple systems (FTS, for short). The paper consists of two parts. In Part 1, we revisit the general theory of FTS; the main purpose of Part 1 is to derive the conditions of so called strictly regular elements in FTS so as to fit with our description of key varieties. Then, in Part 2, we define several key varieties for prime $\mathbb{Q}$-Fano 3-folds from the conditions of strictly regular elements in FTS. Among other things obtained in Part 2, we show that there exists a $14$-dimensional factorial affine variety $\mathfrak{U}_{\mathbb{A}}^{14}$ of codimension $4$ in an affine $18$-space with only Gorenstein terminal singularities, and we construct examples of prime $\mathbb{Q}$-Fano $3$-folds of No.20544 in [GRDB] as weighted complete intersections of the weighted projectivization of $\mathfrak{U}_{\mathbb{A}}^{14}$ in the weighted projective space $\mathbb{P}(1^{15},2^{2},3)$. We also clarify in Part 2 a relation between $\mathfrak{U}_{\mathbb{A}}^{14}$ and the $G_{2}^{(4)}$-cluster variety, which is a key variety for prime $\mathbb{Q}$-Fano 3-folds constructed in [CD].


title: Nonradiating sources of the biharmonic wave equation

abstract: This paper offers an extensive exploration of nonradiating sources for the two- and three-dimensional biharmonic wave equations. Various equivalent characterizations are derived to reveal the nature of a nonradiating source. Additionally, we establish the connection between nonradiating sources in the biharmonic wave equation and those in the Helmholtz equation as well as the modified Helmholtz equation. Several illustrative examples are explicitly constructed to showcase the existence of nonradiating sources. One significant implication of the existence of nonradiating sources is that it undermines the uniqueness of the inverse source problem when utilizing boundary data at a fixed frequency.


title: $L$-function of CM elliptic curves and generalized hypergeometric functions

abstract: In this paper, we express special values of the $L$-functions of certain CM elliptic curves which are related to Fermat curves in terms of the special values of generalized hypergeometric functions by comparing Bloch's element with Ross's element in the motivic cohomology group.


title: Radiative $B$ to axial-vector meson decays at NLO in Soft-Collinear Effective Theory

abstract: The rare decay $B\rightarrow A\gamma$, with $A$ representing axial-vector mesons such as $K_1 (1270),\; K_1 (1400),\; b_1(1300),\; a_1(1260)$, is studied at next-to-leading order (NLO) in soft collinear effective theory (SCET). The large outgoing meson energy encourages the study of the decay with an appropriate factorization scheme that separates the factorizable and non-factorizable parts systematically. We have analyzed the leading-power and $\mathcal{O}(\alpha_s)$ diagrams that contribute to matching to SCET$_I$. The new intermediate theory is matched onto SCET$_{II}$ and the running of SCET$_I$ operators is performed to sum large perturbative logarithms. The values of soft-overlap function $\zeta_{\perp}$ for $K_1 (1270,\;1400), a_{1}$ and $b_{1}$ mesons are estimated from the light cone-sum-rules (LCSR), and later using it the corresponding branching fractions for $B \to \left(K_{1}(1270,\; 1400),\; a_{1},\; b_{1}\right)\gamma$ decays are calculated. We find that in case of $B \to K_{1}(1270,\; 1400)\gamma$ decays the results are in good agreement with their experimental measurements. Also the estimated values of the branching ratios of the $B \to (b_{1},\; a_1)\gamma$ decays are potentially large to be measured at the LHCb and future B-factories.


title: Primitively $2$-universal senary integral quadratic forms

abstract: For a positive integer $m$, a (positive definite integral) quadratic form is called primitively $m$-universal if it primitively represents all quadratic forms of rank $m$. It was proved in arXiv:2202.13573 that there are exactly $107$ equivalence classes of primitively $1$-universal quaternary quadratic forms. In this article, we prove that the minimal rank of primitively $2$-universal quadratic forms is six, and there are exactly $201$ equivalence classes of primitively $2$-universal senary quadratic forms.


title: Validation of the Wiedemann-Franz Law in solid and molten tungsten above 2000 K through thermal conductivity measurements via steady state temperature differential radiometry

abstract: We measure the thermal conductivity of solid and molten tungsten using Steady State Temperature Differential Radiometry. We demonstrate that the thermal conductivity can be well described by application of Wiedemann-Franz Law to electrical resistivity data, thus suggesting the validity of Wiedemann-Franz Law to capture the electronic thermal conductivity of metals in their molten phase. We further support this conclusion using ab initio molecular dynamics simulations with a machine-learned potential. Our results show that at these high temperatures, the vibrational contribution to thermal conductivity is negligible compared to the electronic component.


title: Semi-supervised 3D Video Information Retrieval with Deep Neural Network and Bi-directional Dynamic-time Warping Algorithm

abstract: This paper presents a novel semi-supervised deep learning algorithm for retrieving similar 2D and 3D videos based on visual content. The proposed approach combines the power of deep convolutional and recurrent neural networks with dynamic time warping as a similarity measure. The proposed algorithm is designed to handle large video datasets and retrieve the most related videos to a given inquiry video clip based on its graphical frames and contents. We split both the candidate and the inquiry videos into a sequence of clips and convert each clip to a representation vector using an autoencoder-backed deep neural network. We then calculate a similarity measure between the sequences of embedding vectors using a bi-directional dynamic time-warping method. This approach is tested on multiple public datasets, including CC\_WEB\_VIDEO, Youtube-8m, S3DIS, and Synthia, and showed good results compared to state-of-the-art. The algorithm effectively solves video retrieval tasks and outperforms the benchmarked state-of-the-art deep learning model.


title: Influence of Publication Capacity on Journal Impact Factor for International Open Access Journals from China: Insights from Microeconomic Analysis

abstract: The evolving landscape of open access (OA) journal publishing holds significant importance for policymakers and stakeholders who seek to make informed decisions and develop strategies that foster sustainable growth and advancements in open access initiatives within China. This study addressed the shortcomings of the current journal evaluation system and recognized the necessity of researching the elasticity of annual publication capacity (PUB) in relation to the Journal Impact Factor (JIF). By constructing an economic model of elasticity, a comparative analysis of the characteristics and dynamics of international OA journals from China and overseas was conducted. The analysis categorized OA journals based on their respective elasticity values and provided specific recommendations tailored to each category. These recommendations offer valuable insights into the development and growth potential of both OA journals from China and overseas. Moreover, the findings underscore the importance of strategic decision-making to strike a balance between quantity and quality in OA journal management. By comprehending the dynamic nature of elasticity, China can enhance its OA journal landscape, effectively meet the academic demand from domestic researchers, minimize the outflow of OA publications to overseas markets, and fortify its position within the global scholarly community.


title: Optimizing Mobile-Edge AI-Generated Everything (AIGX) Services by Prompt Engineering: Fundamental, Framework, and Case Study

abstract: As the next-generation paradigm for content creation, AI-Generated Content (AIGC), i.e., generating content automatically by Generative AI (GAI) based on user prompts, has gained great attention and success recently. With the ever-increasing power of GAI, especially the emergence of Pretrained Foundation Models (PFMs) that contain billions of parameters and prompt engineering methods (i.e., finding the best prompts for the given task), the application range of AIGC is rapidly expanding, covering various forms of information for human, systems, and networks, such as network designs, channel coding, and optimization solutions. In this article, we present the concept of mobile-edge AI-Generated Everything (AIGX). Specifically, we first review the building blocks of AIGX, the evolution from AIGC to AIGX, as well as practical AIGX applications. Then, we present a unified mobile-edge AIGX framework, which employs edge devices to provide PFM-empowered AIGX services and optimizes such services via prompt engineering. More importantly, we demonstrate that suboptimal prompts lead to poor generation quality, which adversely affects user satisfaction, edge network performance, and resource utilization. Accordingly, we conduct a case study, showcasing how to train an effective prompt optimizer using ChatGPT and investigating how much improvement is possible with prompt engineering in terms of user experience, quality of generation, and network performance.


title: AB2CD: AI for Building Climate Damage Classification and Detection

abstract: We explore the implementation of deep learning techniques for precise building damage assessment in the context of natural hazards, utilizing remote sensing data. The xBD dataset, comprising diverse disaster events from across the globe, serves as the primary focus, facilitating the evaluation of deep learning models. We tackle the challenges of generalization to novel disasters and regions while accounting for the influence of low-quality and noisy labels inherent in natural hazard data. Furthermore, our investigation quantitatively establishes that the minimum satellite imagery resolution essential for effective building damage detection is 3 meters and below 1 meter for classification using symmetric and asymmetric resolution perturbation analyses. To achieve robust and accurate evaluations of building damage detection and classification, we evaluated different deep learning models with residual, squeeze and excitation, and dual path network backbones, as well as ensemble techniques. Overall, the U-Net Siamese network ensemble with F-1 score of 0.812 performed the best against the xView2 challenge benchmark. Additionally, we evaluate a Universal model trained on all hazards against a flood expert model and investigate generalization gaps across events, and out of distribution from field data in the Ahr Valley. Our research findings showcase the potential and limitations of advanced AI solutions in enhancing the impact assessment of climate change-induced extreme weather events, such as floods and hurricanes. These insights have implications for disaster impact assessment in the face of escalating climate challenges.

categories: cs.CV cs.AI cs.CY eess.IV physics.geo-ph


title: MQENet: A Mesh Quality Evaluation Neural Network Based on Dynamic Graph Attention

abstract: With the development of computational fluid dynamics, the requirements for the fluid simulation accuracy in industrial applications have also increased. The quality of the generated mesh directly affects the simulation accuracy. However, previous mesh quality metrics and models cannot evaluate meshes comprehensively and objectively. To this end, we propose MQENet, a structured mesh quality evaluation neural network based on dynamic graph attention. MQENet treats the mesh evaluation task as a graph classification task for classifying the quality of the input structured mesh. To make graphs generated from structured meshes more informative, MQENet introduces two novel structured mesh preprocessing algorithms. These two algorithms can also improve the conversion efficiency of structured mesh data. Experimental results on the benchmark structured mesh dataset NACA-Market show the effectiveness of MQENet in the mesh quality evaluation task.


title: A Cartesian grid-based boundary integral method for moving interface problems

abstract: This paper proposes a Cartesian grid-based boundary integral method for efficiently and stably solving two representative moving interface problems, the Hele-Shaw flow and the Stefan problem. Elliptic and parabolic partial differential equations (PDEs) are reformulated into boundary integral equations and are then solved with the matrix-free generalized minimal residual (GMRES) method. The evaluation of boundary integrals is performed by solving equivalent and simple interface problems with finite difference methods, allowing the use of fast PDE solvers, such as fast Fourier transform (FFT) and geometric multigrid methods. The interface curve is evolved utilizing the $\theta-L$ variables instead of the more commonly used $x-y$ variables. This choice simplifies the preservation of mesh quality during the interface evolution. In addition, the $\theta-L$ approach enables the design of efficient and stable time-stepping schemes to remove the stiffness that arises from the curvature term. Ample numerical examples, including simulations of complex viscous fingering and dendritic solidification problems, are presented to showcase the capability of the proposed method to handle challenging moving interface problems.


title: Separable Hamiltonian Neural Networks

abstract: Hamiltonian neural networks (HNNs) are state-of-the-art models that regress the vector field of a dynamical system under the learning bias of Hamilton's equations. A recent observation is that embedding a bias regarding the additive separability of the Hamiltonian reduces the regression complexity and improves regression performance. We propose separable HNNs that embed additive separability within HNNs using observational, learning, and inductive biases. We show that the proposed models are more effective than the HNN at regressing the Hamiltonian and the vector field, and have the capability to interpret the kinetic and potential energy of the system.


title: Multidomain transformer-based deep learning for early detection of network intrusion

abstract: Timely response of Network Intrusion Detection Systems (NIDS) is constrained by the flow generation process which requires accumulation of network packets. This paper introduces Multivariate Time Series (MTS) early detection into NIDS to identify malicious flows prior to their arrival at target systems. With this in mind, we first propose a novel feature extractor, Time Series Network Flow Meter (TS-NFM), that represents network flow as MTS with explainable features, and a new benchmark dataset is created using TS-NFM and the meta-data of CICIDS2017, called SCVIC-TS-2022. Additionally, a new deep learning-based early detection model called Multi-Domain Transformer (MDT) is proposed, which incorporates the frequency domain into Transformer. This work further proposes a Multi-Domain Multi-Head Attention (MD-MHA) mechanism to improve the ability of MDT to extract better features. Based on the experimental results, the proposed methodology improves the earliness of the conventional NIDS (i.e., percentage of packets that are used for classification) by 5x10^4 times and duration-based earliness (i.e., percentage of duration of the classified packets of a flow) by a factor of 60, resulting in a 84.1% macro F1 score (31% higher than Transformer) on SCVIC-TS-2022. Additionally, the proposed MDT outperforms the state-of-the-art early detection methods by 5% and 6% on ECG and Wafer datasets, respectively.


title: Business Process Text Sketch Automation Generation Using Large Language Model

abstract: Business Process Management (BPM) is gaining increasing attention as it has the potential to cut costs while boosting output and quality. Business process document generation is a crucial stage in BPM. However, due to a shortage of datasets, data-driven deep learning techniques struggle to deliver the expected results. We propose an approach to transform Conditional Process Trees (CPTs) into Business Process Text Sketches (BPTSs) using Large Language Models (LLMs). The traditional prompting approach (Few-shot In-Context Learning) tries to get the correct answer in one go, and it can find the pattern of transforming simple CPTs into BPTSs, but for close-domain and CPTs with complex hierarchy, the traditional prompts perform weakly and with low correctness. We suggest using this technique to break down a difficult CPT into a number of basic CPTs and then solve each one in turn, drawing inspiration from the divide-and-conquer strategy. We chose 100 process trees with depths ranging from 2 to 5 at random, as well as CPTs with many nodes, many degrees of selection, and cyclic nesting. Experiments show that our method can achieve a correct rate of 93.42%, which is 45.17% better than traditional prompting methods. Our proposed method provides a solution for business process document generation in the absence of datasets, and secondly, it becomes potentially possible to provide a large number of datasets for the process model extraction (PME) domain.


title: Channel Attention Separable Convolution Network for Skin Lesion Segmentation

abstract: Skin cancer is a frequently occurring cancer in the human population, and it is very important to be able to diagnose malignant tumors in the body early. Lesion segmentation is crucial for monitoring the morphological changes of skin lesions, extracting features to localize and identify diseases to assist doctors in early diagnosis. Manual de-segmentation of dermoscopic images is error-prone and time-consuming, thus there is a pressing demand for precise and automated segmentation algorithms. Inspired by advanced mechanisms such as U-Net, DenseNet, Separable Convolution, Channel Attention, and Atrous Spatial Pyramid Pooling (ASPP), we propose a novel network called Channel Attention Separable Convolution Network (CASCN) for skin lesions segmentation. The proposed CASCN is evaluated on the PH2 dataset with limited images. Without excessive pre-/post-processing of images, CASCN achieves state-of-the-art performance on the PH2 dataset with Dice similarity coefficient of 0.9461 and accuracy of 0.9645.


title: Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embodied Reference Understanding

abstract: Embodied Reference Understanding studies the reference understanding in an embodied fashion, where a receiver is required to locate a target object referred to by both language and gesture of the sender in a shared physical environment. Its main challenge lies in how to make the receiver with the egocentric view access spatial and visual information relative to the sender to judge how objects are oriented around and seen from the sender, i.e., spatial and visual perspective-taking. In this paper, we propose a REasoning from your Perspective (REP) method to tackle the challenge by modeling relations between the receiver and the sender and the sender and the objects via the proposed novel view rotation and relation reasoning. Specifically, view rotation first rotates the receiver to the position of the sender by constructing an embodied 3D coordinate system with the position of the sender as the origin. Then, it changes the orientation of the receiver to the orientation of the sender by encoding the body orientation and gesture of the sender. Relation reasoning models the nonverbal and verbal relations between the sender and the objects by multi-modal cooperative reasoning in gesture, language, visual content, and spatial position. Experiment results demonstrate the effectiveness of REP, which consistently surpasses all existing state-of-the-art algorithms by a large margin, i.e., +5.22% absolute accuracy in terms of Prec0.5 on YouRefIt.


title: Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models

abstract: The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension, leading to escalating computational complexity and parameter proliferation, thus posing challenges for modeling dynamical systems with high-dimensional latent states. To surmount this obstacle, we propose to integrate the efficient transformed Gaussian process (ETGP) into the GPSSM, which involves pushing a shared GP through multiple normalizing flows to efficiently model the transition function in high-dimensional latent state space. Additionally, we develop a corresponding variational inference algorithm that surpasses existing methods in terms of parameter count and computational complexity. Experimental results on diverse synthetic and real-world datasets corroborate the efficiency of the proposed method, while also demonstrating its ability to achieve similar inference performance compared to existing methods. Code is available at \url{https://github.com/zhidilin/gpssmProj}.


title: Muti-Stage Hierarchical Food Classification

abstract: Food image classification serves as a fundamental and critical step in image-based dietary assessment, facilitating nutrient intake analysis from captured food images. However, existing works in food classification predominantly focuses on predicting 'food types', which do not contain direct nutritional composition information. This limitation arises from the inherent discrepancies in nutrition databases, which are tasked with associating each 'food item' with its respective information. Therefore, in this work we aim to classify food items to align with nutrition database. To this end, we first introduce VFN-nutrient dataset by annotating each food image in VFN with a food item that includes nutritional composition information. Such annotation of food items, being more discriminative than food types, creates a hierarchical structure within the dataset. However, since the food item annotations are solely based on nutritional composition information, they do not always show visual relations with each other, which poses significant challenges when applying deep learning-based techniques for classification. To address this issue, we then propose a multi-stage hierarchical framework for food item classification by iteratively clustering and merging food items during the training process, which allows the deep model to extract image features that are discriminative across labels. Our method is evaluated on VFN-nutrient dataset and achieve promising results compared with existing work in terms of both food type and food item classification.


title: Federated Few-shot Learning for Cough Classification with Edge Devices

abstract: Automatically classifying cough sounds is one of the most critical tasks for the diagnosis and treatment of respiratory diseases. However, collecting a huge amount of labeled cough dataset is challenging mainly due to high laborious expenses, data scarcity, and privacy concerns. In this work, our aim is to develop a framework that can effectively perform cough classification even in situations when enormous cough data is not available, while also addressing privacy concerns. Specifically, we formulate a new problem to tackle these challenges and adopt few-shot learning and federated learning to design a novel framework, termed F2LCough, for solving the newly formulated problem. We illustrate the superiority of our method compared with other approaches on COVID-19 Thermal Face & Cough dataset, in which F2LCough achieves an average F1-Score of 86%. Our results show the feasibility of few-shot learning combined with federated learning to build a classification model of cough sounds. This new methodology is able to classify cough sounds in data-scarce situations and maintain privacy properties. The outcomes of this work can be a fundamental framework for building support systems for the detection and diagnosis of cough-related diseases.


title: Robust Adversarial Defense by Tensor Factorization

abstract: As machine learning techniques become increasingly prevalent in data analysis, the threat of adversarial attacks has surged, necessitating robust defense mechanisms. Among these defenses, methods exploiting low-rank approximations for input data preprocessing and neural network (NN) parameter factorization have shown potential. Our work advances this field further by integrating the tensorization of input data with low-rank decomposition and tensorization of NN parameters to enhance adversarial defense. The proposed approach demonstrates significant defense capabilities, maintaining robust accuracy even when subjected to the strongest known auto-attacks. Evaluations against leading-edge robust performance benchmarks reveal that our results not only hold their ground against the best defensive methods available but also exceed all current defense strategies that rely on tensor factorizations. This study underscores the potential of integrating tensorization and low-rank decomposition as a robust defense against adversarial attacks in machine learning.


title: UnsMOT: Unified Framework for Unsupervised Multi-Object Tracking with Geometric Topology Guidance

abstract: Object detection has long been a topic of high interest in computer vision literature. Motivated by the fact that annotating data for the multi-object tracking (MOT) problem is immensely expensive, recent studies have turned their attention to the unsupervised learning setting. In this paper, we push forward the state-of-the-art performance of unsupervised MOT methods by proposing UnsMOT, a novel framework that explicitly combines the appearance and motion features of objects with geometric information to provide more accurate tracking. Specifically, we first extract the appearance and motion features using CNN and RNN models, respectively. Then, we construct a graph of objects based on their relative distances in a frame, which is fed into a GNN model together with CNN features to output geometric embedding of objects optimized using an unsupervised loss function. Finally, associations between objects are found by matching not only similar extracted features but also geometric embedding of detections and tracklets. Experimental results show remarkable performance in terms of HOTA, IDF1, and MOTA metrics in comparison with state-of-the-art methods.


title: Three-dimensional angular deviation and diffraction efficiency of a grating in Littrow-configuration ECDL

abstract: We consider in this paper the angular deviation and diffraction efficiency of the reflection gratings in Littrow-configuration for applications of external cavity diode laser using the rigorous coupled-wave analysis method. We consider the three-dimensional diffraction case in general, where the incidence plane is un-parallel with the grating vector, i.e. conical diffraction. The angular tolerance of arbitrary gratings under plane and conical diffraction are thus derived and presented. A typical blazed grating is chosen as an example to calculate its diffraction efficiency using the rigorous coupled-wave analysis method. Furthermore, we point out that the angular tolerance and reflection efficiency can be improved if the appropriate parameter settings are selected for Littrow-configuration devices, including incidence angle, diffraction order, grating period and blazed angle. Otherwise, a tiny slanting angle of the grating vector deviated from the incidence plane will deviate the feedback light away from entering the laser-diode-chip and halt laser oscillation in the external cavity. Finally, a general rule for the parameter settings in Littrow-configuration is provided as a benchmark.


title: Quantum geometric formulation of Brans-Dicke theory for Bianchi I spacetime

abstract: We consider a formulation of the Brans-Dicke theory in Jordan's frame for Bianchi-I spacetime within the framework of loop quantum gravity. The robustness of singularity resolutions due to the quantum effects is explicitly verified. We also present an exploration of the effects of quantum geometry on the background dynamics. In particular, starting with a detailed constraint analysis, we present the off-shell Lie algebra of the full theory in the geometrodynamic phase space. This is followed by casting the theory in terms of the Yang-Mills phase space variables suitable for invoking loop quantization and show that the system is highly nonlinear. Finally, we present the quantum-corrected effective dynamics that resolve the initial singularity

categories: gr-qc astro-ph.CO hep-th math-ph math.MP


title: Orientation-Independent Chinese Text Recognition in Scene Images

abstract: Scene text recognition (STR) has attracted much attention due to its broad applications. The previous works pay more attention to dealing with the recognition of Latin text images with complex backgrounds by introducing language models or other auxiliary networks. Different from Latin texts, many vertical Chinese texts exist in natural scenes, which brings difficulties to current state-of-the-art STR methods. In this paper, we take the first attempt to extract orientation-independent visual features by disentangling content and orientation information of text images, thus recognizing both horizontal and vertical texts robustly in natural scenes. Specifically, we introduce a Character Image Reconstruction Network (CIRN) to recover corresponding printed character images with disentangled content and orientation information. We conduct experiments on a scene dataset for benchmarking Chinese text recognition, and the results demonstrate that the proposed method can indeed improve performance through disentangling content and orientation information. To further validate the effectiveness of our method, we additionally collect a Vertical Chinese Text Recognition (VCTR) dataset. The experimental results show that the proposed method achieves 45.63% improvement on VCTR when introducing CIRN to the baseline model.


title: Tropical Geometric Tools for Machine Learning: the TML package

abstract: In the last decade, developments in tropical geometry have provided a number of uses directly applicable to problems in statistical learning. The TML package is the first R package which contains a comprehensive set of tools and methods used for basic computations related to tropical convexity, visualization of tropically convex sets, as well as supervised and unsupervised learning models using the tropical metric under the max-plus algebra over the tropical projective torus. Primarily, the TML package employs a Hit and Run Markov chain Monte Carlo sampler in conjunction with the tropical metric as its main tool for statistical inference. In addition to basic computation and various applications of the tropical HAR sampler, we also focus on several supervised and unsupervised methods incorporated in the TML package including tropical principal component analysis, tropical logistic regression and tropical kernel density estimation.


title: Chinese Text Recognition with A Pre-Trained CLIP-Like Model Through Image-IDS Aligning

abstract: Scene text recognition has been studied for decades due to its broad applications. However, despite Chinese characters possessing different characteristics from Latin characters, such as complex inner structures and large categories, few methods have been proposed for Chinese Text Recognition (CTR). Particularly, the characteristic of large categories poses challenges in dealing with zero-shot and few-shot Chinese characters. In this paper, inspired by the way humans recognize Chinese texts, we propose a two-stage framework for CTR. Firstly, we pre-train a CLIP-like model through aligning printed character images and Ideographic Description Sequences (IDS). This pre-training stage simulates humans recognizing Chinese characters and obtains the canonical representation of each character. Subsequently, the learned representations are employed to supervise the CTR model, such that traditional single-character recognition can be improved to text-line recognition through image-IDS matching. To evaluate the effectiveness of the proposed method, we conduct extensive experiments on both Chinese character recognition (CCR) and CTR. The experimental results demonstrate that the proposed method performs best in CCR and outperforms previous methods in most scenarios of the CTR benchmark. It is worth noting that the proposed method can recognize zero-shot Chinese characters in text images without fine-tuning, whereas previous methods require fine-tuning when new classes appear. The code is available at https://github.com/FudanVI/FudanOCR/tree/main/image-ids-CTR.


title: Rotational Variability and Detection of Superflares in a Young Brown Dwarf by TESS

abstract: We present a comprehensive analysis of a Transiting Exoplanet Survey Satellite (TESS) high-quality light curve for a young brown dwarf, MHO~4 having spectral type M7.0, in the Taurus star-forming region. We investigate the rotation periods and characterize the BD's dynamic atmosphere and surface features. We present light curve analysis of MHO~4, and estimate the rotation period to be around 2.224~d. Remarkably, MHO~4 exhibits two significant flaring events. Furthermore, we also estimated bolometric flare energies to be within the energy range of $10^{34}$ to $10^{35}$ erg, which sits in the superflare category.


title: The evolution of a quantum vortices system: the spatio-temporal scale hierarchy and the turbulence in the critical mode

abstract: This paper investigates the evolution and interaction of the quantum vortex loops with the small radius of the core $a$. The quantization scheme of the classical vortex system is based on the approach proposed by the author earlier. We consider the small variations of the ring-shaped loops only, which include both helical-type shape variations and small excitations of the flow in the vortex core. The quantization of both an initial radius of the vortex ring $R$ and the circulation $\Gamma$ is deduced from the quantum theory first principles but is not postulated separately. The constructed model leads to the appearance of a spatio-temporal scale hierarchy in the quantum description of the vortices. The method of random Hamiltonians is used to describe the interaction of vortex loops. The specific type of these loops interaction is chosen in way that the constructed theory can serve as the model of turbulent flow at the critical mode.

categories: math-ph math.MP physics.flu-dyn quant-ph


title: MILA: Memory-Based Instance-Level Adaptation for Cross-Domain Object Detection

abstract: Cross-domain object detection is challenging, and it involves aligning labeled source and unlabeled target domains. Previous approaches have used adversarial training to align features at both image-level and instance-level. At the instance level, finding a suitable source sample that aligns with a target sample is crucial. A source sample is considered suitable if it differs from the target sample only in domain, without differences in unimportant characteristics such as orientation and color, which can hinder the model's focus on aligning the domain difference. However, existing instance-level feature alignment methods struggle to find suitable source instances because their search scope is limited to mini-batches. Mini-batches are often so small in size that they do not always contain suitable source instances. The insufficient diversity of mini-batches becomes problematic particularly when the target instances have high intra-class variance. To address this issue, we propose a memory-based instance-level domain adaptation framework. Our method aligns a target instance with the most similar source instance of the same category retrieved from a memory storage. Specifically, we introduce a memory module that dynamically stores the pooled features of all labeled source instances, categorized by their labels. Additionally, we introduce a simple yet effective memory retrieval module that retrieves a set of matching memory slots for target instances. Our experiments on various domain shift scenarios demonstrate that our approach outperforms existing non-memory-based methods significantly.


title: Stabilize to Act: Learning to Coordinate for Bimanual Manipulation

abstract: Key to rich, dexterous manipulation in the real world is the ability to coordinate control across two hands. However, while the promise afforded by bimanual robotic systems is immense, constructing control policies for dual arm autonomous systems brings inherent difficulties. One such difficulty is the high-dimensionality of the bimanual action space, which adds complexity to both model-based and data-driven methods. We counteract this challenge by drawing inspiration from humans to propose a novel role assignment framework: a stabilizing arm holds an object in place to simplify the environment while an acting arm executes the task. We instantiate this framework with BimanUal Dexterity from Stabilization (BUDS), which uses a learned restabilizing classifier to alternate between updating a learned stabilization position to keep the environment unchanged, and accomplishing the task with an acting policy learned from demonstrations. We evaluate BUDS on four bimanual tasks of varying complexities on real-world robots, such as zipping jackets and cutting vegetables. Given only 20 demonstrations, BUDS achieves 76.9% task success across our task suite, and generalizes to out-of-distribution objects within a class with a 52.7% success rate. BUDS is 56.0% more successful than an unstructured baseline that instead learns a BC stabilizing policy due to the precision required of these complex tasks. Supplementary material and videos can be found at https://sites.google.com/view/stabilizetoact .


title: Geometry, mechanics and actuation of intrinsically curved folds

abstract: We combine theory and experiments to explore the kinematics and actuation of intrinsically curved folds (ICFs) in otherwise developable shells. Unlike origami folds, ICFs are not bending isometries of flat sheets, but arise via non-isometric processes (growth/moulding) or by joining sheets along curved boundaries. Experimentally, we implement both, first making joined ICFs from paper, then fabricating flat liquid crystal elastomer (LCE) sheets that morph into ICFs upon heating/swelling via programmed metric changes. Theoretically, an ICF's intrinsic geometry is defined by the geodesic curvatures on either side, $\kappa_{g_i}$. Given these, and a target 3D fold-line, one can construct the entire surface isometrically, and compute the bending energy. This construction shows ICFs are bending mechanisms, with a continuous family of isometries trading fold angle against fold-line curvature. In ICFs with symmetric $\kappa_{g_i}$, straightening the fold-line culminates in a fully-folded flat state that is deployable but weak, while asymmetric ICFs ultimately lock with a mechanically strong finite-angle. When unloaded, freely-hinged ICFs simply adopt the (thickness $t$ independent) isometry that minimizes the bend energy. In contrast, in LCE ICFs a competition between flank and ridge selects a ridge curvature that, unusually, scales as $t^{-1/7}$. Finally, we demonstrate how multiple ICFs can be combined in one LCE sheet, to create a versatile stretch-strong gripper that lifts $\sim$40x its own weight.


title: Study of vacancy ordering and the boson peak in metastable cubic Ge-Sb-Te using machine learning potentials

abstract: The mechanism of the vacancy ordering in metastable cubic Ge-Sb-Te (c-GST) that underlies the ultrafast phase-change dynamics and prominent thermoelectric properties remains elusive. Achieving a comprehensive understanding of the vacancy-ordering process at an atomic level is challenging because of enormous computational demands required to simulate disordered structures on large temporal and spatial scales. In this study, we investigate the vacancy ordering in c-GST by performing large-scale molecular dynamics simulations using machine learning potentials. The initial c-GST structure with randomly distributed vacancies rearranges to develop a semi-ordered cubic structure with layer-like ordered vacancies after annealing at 700~K for 100~ns. The vacancy ordering significantly affects the lattice dynamical properties of c-GST. In the initial structure with fully disordered vacancies, we observe a boson peak, usually associated with amorphous solids, that consists of localized modes at $\sim$0.575~THz. The boson peak modes are highly localized around specific atomic arrangements of straight vacancy-Te-vacancy trios. As vacancies become ordered, the boson peak disappears and the Debye-Waller thermal \textit{B} factor of Te decreases substantially. This finding indicates that the c-GST undergoes a transition from amorphous-like to crystalline-like solid state by thermal annealing in low-frequency dynamics.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.app-ph physics.comp-ph


title: Liquid Democracy in DPoS Blockchains

abstract: Voting mechanisms play a crucial role in decentralized governance of blockchain systems. Liquid democracy, also known as delegative voting, allows voters to vote directly or delegate their voting power to others, thereby contributing to the resolution of problems such as low voter turnout. In recent years, liquid democracy has been widely adopted by Delegated-Proof-of-Stake (DPoS) blockchains and implemented successfully on platforms with millions of users. However, little is known regarding the characteristics and actual effectiveness of liquid democracy in decentralized governance. This paper explored for the first time the practical implementation of liquid democracy in DPoS blockchain systems. Using actual data collected from two major DPoS blockchains, EOS and Steem, our study compared and evaluated the participation of different types of users of DPoS blockchain systems in liquid democracy, as well as extracting and analyzing the delegation chains and networks formed during the process of liquid democracy within the systems. We believe that the findings of this paper will contribute to further studies on the design and implementation of liquid democracy and other voting mechanisms in decentralized governance.


title: Dynamical analysis of Maclaurin disk with velocity dispersion and its influence on bar formation

abstract: We investigate the influence of Toomre's $Q$ parameter on the bar-forming dynamics of Maclaurin disk using $N$-body simulations. According to the Toomre's criterion, local velocity dispersion parametrized by $Q\geq 1$ is required to suppress the local axisymmetric instability but, in turn, it deviates particle orbits from nearly circular limit in which particle natural frequencies are calculated. We resolve this by including the effect of velocity dispersion, as the pressure potential, into the effective potential with the gravitational potential. With this formulation, circular orbit approximation is retrieved. The effective potential hypothesis can describe the $Q$-dependences of angular and epicyclic motions of the bar-forming processes and the established bars reasonably well provided that $Q\geq 1$. This indicates the influence of initial $Q$ that is imprinted in the entire disk dynamics, not only that $Q$ serves as the stability indicator. In addition, we perform the stability test for the disk-in-halo systems. With the presence of halo, disks are more susceptible to the bar formation as seen by the elevated critical $Q$ than that for the isolated disk. This is attributed to the differential rotation that builds the unstable non-axisymmetric spiral modes more efficiently which are the ingredients of bar instability.


title: Face Clustering for Connection Discovery from Event Images

abstract: Social graphs are very useful for many applications, such as recommendations and community detections. However, they are only accessible to big social network operators due to both data availability and privacy concerns. Event images also capture the interactions among the participants, from which social connections can be discovered to form a social graph. Unlike online social graphs, social connections carried by event images can be extracted without user inputs, and hence many social graph-based applications become possible, even without access to online social graphs. This paper proposes a system to discover social connections from event images. By utilizing the social information from even images, such as co-occurrence, a face clustering method is proposed and implemented, and connections can be discovered without the identity of the event participants. By collecting over 40000 faces from over 3000 participants, it is shown that the faces can be well clustered with 80% in F1 score, and social graphs can be constructed. Utilizing offline event images may create a long-term impact on social network analytics.


title: CoTDet: Affordance Knowledge Prompting for Task Driven Object Detection

abstract: Task driven object detection aims to detect object instances suitable for affording a task in an image. Its challenge lies in object categories available for the task being too diverse to be limited to a closed set of object vocabulary for traditional object detection. Simply mapping categories and visual features of common objects to the task cannot address the challenge. In this paper, we propose to explore fundamental affordances rather than object categories, i.e., common attributes that enable different objects to accomplish the same task. Moreover, we propose a novel multi-level chain-of-thought prompting (MLCoT) to extract the affordance knowledge from large language models, which contains multi-level reasoning steps from task to object examples to essential visual attributes with rationales. Furthermore, to fully exploit knowledge to benefit object recognition and localization, we propose a knowledge-conditional detection framework, namely CoTDet. It conditions the detector from the knowledge to generate object queries and regress boxes. Experimental results demonstrate that our CoTDet outperforms state-of-the-art methods consistently and significantly (+15.6 box AP and +14.8 mask AP) and can generate rationales for why objects are detected to afford the task.


title: Circuit-theoretic phenomenological model of an electrostatic gate-controlled bi-SQUID

abstract: A numerical model based on a lumped circuit element approximation for a bi-superconducting quantum interference device (bi-SQUID) operating in the presence of an external magnetic field is presented in this paper. Included in the model is the novel ability to capture the resultant behaviour of the device when a strong electric field is applied to its Josephson junctions by utilising gate electrodes. The model is used to simulate an all-metallic SNS (Al-Cu-Al) bi-SQUID, where good agreement is observed between the simulated results and the experimental data. The results discussed in this work suggest that the primary consequences of the superconducting field effect induced by the gating of the Josephson junctions are accounted for in our minimal model; namely, the suppression of the junctions super-current. Although based on a simplified semi-empirical model, our results may guide the search for a microscopic origin of this effect by providing a means to model the voltage response of gated SQUIDs. Also, the possible applications of this effect regarding the operation of SQUIDs as ultra-high precision sensors, where the performance of such devices can be improved via careful tuning of the applied gate voltages, are discussed at the end of the paper.


title: Reducing laser beam fluence and intensity fluctuations in symmetric and asymmetric compressors

abstract: All space-time coupling effects arising in an asymmetric optical compressor [1] consisting of two non-identical pairs of diffraction gratings are described analytically. In each pair, the gratings are identical and parallel to each other, whereas the distance between the gratings, the groove density, and the angle of incidence are different in different pairs. It is shown that the compressor asymmetry does not affect the far field fluence and on-axis focal intensity. The main distinctive feature of the asymmetric compressor is spatial noise lagging behind or overtaking the main pulse in proportion to the transverse wave vector. This results in a degraded contrast but reduces beam fluence fluctuations at the compressor output. Exact expressions are obtained for the spectrum of fluence fluctuations and fluence rms that depends only on one parameter characterizing compressor asymmetry. The efficiency of small-scale self-focusing suppression at subsequent pulse post-compression is estimated.


title: Constructing a type-adjustable mechanism to yield Pareto-optimal outcomes

abstract: In mechanism design theory, agents' types are described as their private information, and the designer may reveal some public information to affect agents' types in order to obtain more payoffs. Traditionally, each agent's private type and the public information are represented as a random variable respectively. In this paper, we propose a type-adjustable mechanism where each agent's private type is represented as a function of two parameters, \emph{i.e.}, his intrinsic factor and an external factor. Each agent's intrinsic factor is modeled as a private random variable, and the external factor is modeled as a solution of the designer's optimization problem. If the designer chooses an optimal value of external factor as public information, the type-adjustable mechanism may yield Pareto-optimal outcomes, which let the designer and each agent obtain more expected payoffs than what they would obtain at most in the traditional optimal mechanisms. As a comparison, in an auction with interdependent values, only the seller will benefit from public information which is represented as a random variable. We propose a revised version of revelation principle for type-adjustable Bayesian equilibrium. In the end, we compare the type-adjustable mechanism with other relevant models.


title: An infinite dimensional balanced embedding problem I:existence

abstract: We investigate the problem of balanced embedding of a non-compact complex manifold into an infinite-dimensional projective space. In this paper we prove the existence of such an embedding in a model case. The strategy is by using a gradient flow in a Hilbert space; both the long-time existence and convergence at infinite time are non-trivial. The long time existence is established by choosing a perturbation of the ODE; the convergence depends on a priori bounds that uses techniques in the proof of the Tauber-Hardy-Littlewood theorem.


title: martFL: Enabling Utility-Driven Data Marketplace with a Robust and Verifiable Federated Learning Architecture

abstract: The development of machine learning models requires a large amount of training data. Data marketplaces are essential for trading high-quality, private-domain data not publicly available online. However, due to growing data privacy concerns, direct data exchange is inappropriate. Federated Learning (FL) is a distributed machine learning paradigm that exchanges data utilities (in form of local models or gradients) among multiple parties without directly sharing the raw data. However, several challenges exist when applying existing FL architectures to construct a data marketplace: (i) In existing FL architectures, Data Acquirers (DAs) cannot privately evaluate local models from Data Providers (DPs) prior to trading; (ii) Model aggregation protocols in existing FL designs struggle to exclude malicious DPs without "overfitting" to the DA's (possibly biased) root dataset; (iii) Prior FL designs lack a proper billing mechanism to enforce the DA to fairly allocate the reward according to contributions made by different DPs. To address above challenges, we propose martFL, the first federated learning architecture that is specifically designed to enable a secure utility-driven data marketplace. At a high level, martFL is powered by two innovative designs: (i) a quality-aware model aggregation protocol that achieves robust local model aggregation even when the DA's root dataset is biased; (ii) a verifiable data transaction protocol that enables the DA to prove, both succinctly and in zero-knowledge, that it has faithfully aggregates the local models submitted by different DPs according to the committed aggregation weights, based on which the DPs can unambiguously claim the corresponding reward. We implement a prototype of martFL and evaluate it extensively over various tasks. The results show that martFL can improve the model accuracy by up to 25% while saving up to 64% data acquisition cost.


title: Enhancing Infrared Small Target Detection Robustness with Bi-Level Adversarial Framework

abstract: The detection of small infrared targets against blurred and cluttered backgrounds has remained an enduring challenge. In recent years, learning-based schemes have become the mainstream methodology to establish the mapping directly. However, these methods are susceptible to the inherent complexities of changing backgrounds and real-world disturbances, leading to unreliable and compromised target estimations. In this work, we propose a bi-level adversarial framework to promote the robustness of detection in the presence of distinct corruptions. We first propose a bi-level optimization formulation to introduce dynamic adversarial learning. Specifically, it is composited by the learnable generation of corruptions to maximize the losses as the lower-level objective and the robustness promotion of detectors as the upper-level one. We also provide a hierarchical reinforced learning strategy to discover the most detrimental corruptions and balance the performance between robustness and accuracy. To better disentangle the corruptions from salient features, we also propose a spatial-frequency interaction network for target detection. Extensive experiments demonstrate our scheme remarkably improves 21.96% IOU across a wide array of corruptions and notably promotes 4.97% IOU on the general benchmark. The source codes are available at https://github.com/LiuZhu-CV/BALISTD.


title: The twisted Gan-Gross-Prasad problem for finite classical groups

abstract: In this paper, we study the twisted Gan-Gross-Prasad problem for classical groups over finite fields. We formulate a multiplicity formula for Deligne-Lusztig characters and give a complete answer for cuspidal representations arising from anisotropic torus modulo the center.


title: M2HGCL: Multi-Scale Meta-Path Integrated Heterogeneous Graph Contrastive Learning

abstract: Inspired by the successful application of contrastive learning on graphs, researchers attempt to impose graph contrastive learning approaches on heterogeneous information networks. Orthogonal to homogeneous graphs, the types of nodes and edges in heterogeneous graphs are diverse so that specialized graph contrastive learning methods are required. Most existing methods for heterogeneous graph contrastive learning are implemented by transforming heterogeneous graphs into homogeneous graphs, which may lead to ramifications that the valuable information carried by non-target nodes is undermined thereby exacerbating the performance of contrastive learning models. Additionally, current heterogeneous graph contrastive learning methods are mainly based on initial meta-paths given by the dataset, yet according to our deep-going exploration, we derive empirical conclusions: only initial meta-paths cannot contain sufficiently discriminative information; and various types of meta-paths can effectively promote the performance of heterogeneous graph contrastive learning methods. To this end, we propose a new multi-scale meta-path integrated heterogeneous graph contrastive learning (M2HGCL) model, which discards the conventional heterogeneity-homogeneity transformation and performs the graph contrastive learning in a joint manner. Specifically, we expand the meta-paths and jointly aggregate the direct neighbor information, the initial meta-path neighbor information and the expanded meta-path neighbor information to sufficiently capture discriminative information. A specific positive sampling strategy is further imposed to remedy the intrinsic deficiency of contrastive learning, i.e., the hard negative sample sampling issue. Through extensive experiments on three real-world datasets, we demonstrate that M2HGCL outperforms the current state-of-the-art baseline models.


title: Dual Adversarial Resilience for Collaborating Robust Underwater Image Enhancement and Perception

abstract: Due to the uneven scattering and absorption of different light wavelengths in aquatic environments, underwater images suffer from low visibility and clear color deviations. With the advancement of autonomous underwater vehicles, extensive research has been conducted on learning-based underwater enhancement algorithms. These works can generate visually pleasing enhanced images and mitigate the adverse effects of degraded images on subsequent perception tasks. However, learning-based methods are susceptible to the inherent fragility of adversarial attacks, causing significant disruption in results. In this work, we introduce a collaborative adversarial resilience network, dubbed CARNet, for underwater image enhancement and subsequent detection tasks. Concretely, we first introduce an invertible network with strong perturbation-perceptual abilities to isolate attacks from underwater images, preventing interference with image enhancement and perceptual tasks. Furthermore, we propose a synchronized attack training strategy with both visual-driven and perception-driven attacks enabling the network to discern and remove various types of attacks. Additionally, we incorporate an attack pattern discriminator to heighten the robustness of the network against different attacks. Extensive experiments demonstrate that the proposed method outputs visually appealing enhancement images and perform averagely 6.71% higher detection mAP than state-of-the-art methods.


title: Multi-Relational Contrastive Learning for Recommendation

abstract: Personalized recommender systems play a crucial role in capturing users' evolving preferences over time to provide accurate and effective recommendations on various online platforms. However, many recommendation models rely on a single type of behavior learning, which limits their ability to represent the complex relationships between users and items in real-life scenarios. In such situations, users interact with items in multiple ways, including clicking, tagging as favorite, reviewing, and purchasing. To address this issue, we propose the Relation-aware Contrastive Learning (RCL) framework, which effectively models dynamic interaction heterogeneity. The RCL model incorporates a multi-relational graph encoder that captures short-term preference heterogeneity while preserving the dedicated relation semantics for different types of user-item interactions. Moreover, we design a dynamic cross-relational memory network that enables the RCL model to capture users' long-term multi-behavior preferences and the underlying evolving cross-type behavior dependencies over time. To obtain robust and informative user representations with both commonality and diversity across multi-behavior interactions, we introduce a multi-relational contrastive learning paradigm with heterogeneous short- and long-term interest modeling. Our extensive experimental studies on several real-world datasets demonstrate the superiority of the RCL recommender system over various state-of-the-art baselines in terms of recommendation accuracy and effectiveness.


title: Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detection

abstract: Malicious use of deepfakes leads to serious public concerns and reduces people's trust in digital media. Although effective deepfake detectors have been proposed, they are substantially vulnerable to adversarial attacks. To evaluate the detector's robustness, recent studies have explored various attacks. However, all existing attacks are limited to 2D image perturbations, which are hard to translate into real-world facial changes. In this paper, we propose adversarial head turn (AdvHeat), the first attempt at 3D adversarial face views against deepfake detectors, based on face view synthesis from a single-view fake image. Extensive experiments validate the vulnerability of various detectors to AdvHeat in realistic, black-box scenarios. For example, AdvHeat based on a simple random search yields a high attack success rate of 96.8% with 360 searching steps. When additional query access is allowed, we can further reduce the step budget to 50. Additional analyses demonstrate that AdvHeat is better than conventional attacks on both the cross-detector transferability and robustness to defenses. The adversarial images generated by AdvHeat are also shown to have natural looks. Our code, including that for generating a multi-view dataset consisting of 360 synthetic views for each of 1000 IDs from FaceForensics++, is available at https://github.com/twowwj/AdvHeaT.


title: A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture

abstract: This study presents a method for implementing generative AI services by utilizing the Large Language Models (LLM) application architecture. With recent advancements in generative AI technology, LLMs have gained prominence across various domains. In this context, the research addresses the challenge of information scarcity and proposes specific remedies by harnessing LLM capabilities. The investigation delves into strategies for mitigating the issue of inadequate data, offering tailored solutions. The study delves into the efficacy of employing fine-tuning techniques and direct document integration to alleviate data insufficiency. A significant contribution of this work is the development of a Retrieval-Augmented Generation (RAG) model, which tackles the aforementioned challenges. The RAG model is carefully designed to enhance information storage and retrieval processes, ensuring improved content generation. The research elucidates the key phases of the information storage and retrieval methodology underpinned by the RAG model. A comprehensive analysis of these steps is undertaken, emphasizing their significance in addressing the scarcity of data. The study highlights the efficacy of the proposed method, showcasing its applicability through illustrative instances. By implementing the RAG model for information storage and retrieval, the research not only contributes to a deeper comprehension of generative AI technology but also facilitates its practical usability within enterprises utilizing LLMs. This work holds substantial value in advancing the field of generative AI, offering insights into enhancing data-driven content generation and fostering active utilization of LLM-based services within corporate settings.


title: AdvMono3D: Advanced Monocular 3D Object Detection with Depth-Aware Robust Adversarial Training

abstract: Monocular 3D object detection plays a pivotal role in the field of autonomous driving and numerous deep learning-based methods have made significant breakthroughs in this area. Despite the advancements in detection accuracy and efficiency, these models tend to fail when faced with such attacks, rendering them ineffective. Therefore, bolstering the adversarial robustness of 3D detection models has become a crucial issue that demands immediate attention and innovative solutions. To mitigate this issue, we propose a depth-aware robust adversarial training method for monocular 3D object detection, dubbed DART3D. Specifically, we first design an adversarial attack that iteratively degrades the 2D and 3D perception capabilities of 3D object detection models(IDP), serves as the foundation for our subsequent defense mechanism. In response to this attack, we propose an uncertainty-based residual learning method for adversarial training. Our adversarial training approach capitalizes on the inherent uncertainty, enabling the model to significantly improve its robustness against adversarial attacks. We conducted extensive experiments on the KITTI 3D datasets, demonstrating that DART3D surpasses direct adversarial training (the most popular approach) under attacks in 3D object detection $AP_{R40}$ of car category for the Easy, Moderate, and Hard settings, with improvements of 4.415%, 4.112%, and 3.195%, respectively.


title: Solving Non-Rectangular Reward-Robust MDPs via Frequency Regularization

abstract: In robust Markov decision processes (RMDPs), it is assumed that the reward and the transition dynamics lie in a given uncertainty set. By targeting maximal return under the most adversarial model from that set, RMDPs address performance sensitivity to misspecified environments. Yet, to preserve computational tractability, the uncertainty set is traditionally independently structured for each state. This so-called rectangularity condition is solely motivated by computational concerns. As a result, it lacks a practical incentive and may lead to overly conservative behavior. In this work, we study coupled reward RMDPs where the transition kernel is fixed, but the reward function lies within an $\alpha$-radius from a nominal one. We draw a direct connection between this type of non-rectangular reward-RMDPs and applying policy visitation frequency regularization. We introduce a policy-gradient method and prove its convergence. Numerical experiments illustrate the learned policy's robustness and its less conservative behavior when compared to rectangular uncertainty.


title: Acoustic-to-articulatory inversion for dysarthric speech: Are pre-trained self-supervised representations favorable?

abstract: Acoustic-to-articulatory inversion (AAI) involves mapping from the acoustic to the articulatory space. Signal-processing features like the MFCCs, have been widely used for the AAI task. For subjects with dysarthric speech, AAI is challenging because of an imprecise and indistinct pronunciation. In this work, we perform AAI for dysarthric speech using representations from pre-trained self-supervised learning (SSL) models. We demonstrate the impact of different pre-trained features on this challenging AAI task, at low-resource conditions. In addition, we also condition x-vectors to the extracted SSL features to train a BLSTM network. In the seen case, we experiment with three AAI training schemes (subject-specific, pooled, and fine-tuned). The results, consistent across training schemes, reveal that DeCoAR, in the fine-tuned scheme, achieves a relative improvement of the Pearson Correlation Coefficient (CC) by ~1.81% and ~4.56% for healthy controls and patients, respectively, over MFCCs. We observe similar average trends for different SSL features in the unseen case. Overall, SSL networks like wav2vec, APC, and DeCoAR, trained with feature reconstruction or future timestep prediction tasks, perform well in predicting dysarthric articulatory trajectories.


title: Extending the unified subhalo model to warm dark matter

abstract: Using a set of high-resolution N-body simulations, we extend the unified distribution model of cold dark matter (CDM) subhaloes to the warm dark matter(WDM) case. The same model framework combining the unevolved mass function, unevolved radial distribution, and tidal stripping can predict the mass function and spatial distribution of subhaloes in both CDM and WDM simulations. The dependence of the model on the DM particle property is universally parameterized through the half-mode mass of the initial power spectrum. Compared with the CDM model, the WDM model differs most notably in two aspects. 1) In contrast to the power-law form in CDM, the unevolved subhalo mass function for WDM is scale-dependent at the low mass end due to the cut-off in the initial power spectrum. 2) WDM subhaloes are more vulnerable to tidal stripping and disruption due to their lower concentrations at accretion time. Their survival rate is also found to depend on the infall mass. Accounting for these differences, the model predicts a final WDM subhalo mass function that is also proportional to the unevolved subhalo mass function. The radial distribution of WDM subhaloes is predicted to be mass-dependent. For low mass subhaloes, the radial distribution is flatter in the inner halo and steeper in the outer halo compared to the CDM counterpart, due to the scale-dependent unevolved mass function and the enhanced tidal stripping. The code for sampling subhaloes according to our generalized model is available at https://github.com/fhtouma/subgen2 .


title: Relaxed Agreement Forests

abstract: There are multiple factors which can cause the phylogenetic inference process to produce two or more conflicting hypotheses of the evolutionary history of a set X of biological entities. That is: phylogenetic trees with the same set of leaf labels X but with distinct topologies. This leads naturally to the goal of quantifying the difference between two such trees T_1 and T_2. Here we introduce the problem of computing a 'maximum relaxed agreement forest' (MRAF) and use this as a proxy for the dissimilarity of T_1 and T_2, which in this article we assume to be unrooted binary phylogenetic trees. MRAF asks for a partition of the leaf labels X into a minimum number of blocks S_1, S_2, ... S_k such that for each i, the subtrees induced in T_1 and T_2 by S_i are isomorphic up to suppression of degree-2 nodes and taking the labels X into account. Unlike the earlier introduced maximum agreement forest (MAF) model, the subtrees induced by the S_i are allowed to overlap. We prove that it is NP-hard to compute MRAF, by reducing from the problem of partitioning a permutation into a minimum number of monotonic subsequences (PIMS). Furthermore, we show that MRAF has a polynomial time O(log n)-approximation algorithm where n=|X| and permits exact algorithms with single-exponential running time. When at least one of the two input trees has a caterpillar topology, we prove that testing whether a MRAF has size at most k can be answered in polynomial time when k is fixed. We also note that on two caterpillars the approximability of MRAF is related to that of PIMS. Finally, we establish a number of bounds on MRAF, compare its behaviour to MAF both in theory and in an experimental setting and discuss a number of open problems.


title: ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Models

abstract: Colonoscopy analysis, particularly automatic polyp segmentation and detection, is essential for assisting clinical diagnosis and treatment. However, as medical image annotation is labour- and resource-intensive, the scarcity of annotated data limits the effectiveness and generalization of existing methods. Although recent research has focused on data generation and augmentation to address this issue, the quality of the generated data remains a challenge, which limits the contribution to the performance of subsequent tasks. Inspired by the superiority of diffusion models in fitting data distributions and generating high-quality data, in this paper, we propose an Adaptive Refinement Semantic Diffusion Model (ArSDM) to generate colonoscopy images that benefit the downstream tasks. Specifically, ArSDM utilizes the ground-truth segmentation mask as a prior condition during training and adjusts the diffusion loss for each input according to the polyp/background size ratio. Furthermore, ArSDM incorporates a pre-trained segmentation model to refine the training process by reducing the difference between the ground-truth mask and the prediction mask. Extensive experiments on segmentation and detection tasks demonstrate the generated data by ArSDM could significantly boost the performance of baseline methods.


title: Swing Leg Motion Strategy for Heavy-load Legged Robot Based on Force Sensing

abstract: The heavy-load legged robot has strong load carrying capacity and can adapt to various unstructured terrains. But the large weight results in higher requirements for motion stability and environmental perception ability. In order to utilize force sensing information to improve its motion performance, in this paper, we propose a finite state machine model for the swing leg in the static gait by imitating the movement of the elephant. Based on the presence or absence of additional terrain information, different trajectory planning strategies are provided for the swing leg to enhance the success rate of stepping and save energy. The experimental results on a novel quadruped robot show that our method has strong robustness and can enable heavy-load legged robots to pass through various complex terrains autonomously and smoothly.


title: Hybrid-Supervised Dual-Search: Leveraging Automatic Learning for Loss-free Multi-Exposure Image Fusion

abstract: Multi-exposure image fusion (MEF) has emerged as a prominent solution to address the limitations of digital imaging in representing varied exposure levels. Despite its advancements, the field grapples with challenges, notably the reliance on manual designs for network structures and loss functions, and the constraints of utilizing simulated reference images as ground truths. Consequently, current methodologies often suffer from color distortions and exposure artifacts, further complicating the quest for authentic image representation. In addressing these challenges, this paper presents a Hybrid-Supervised Dual-Search approach for MEF, dubbed HSDS-MEF, which introduces a bi-level optimization search scheme for automatic design of both network structures and loss functions. More specifically, we harnesses a unique dual research mechanism rooted in a novel weighted structure refinement architecture search. Besides, a hybrid supervised contrast constraint seamlessly guides and integrates with searching process, facilitating a more adaptive and comprehensive search for optimal loss functions. We realize the state-of-the-art performance in comparison to various competitive schemes, yielding a 10.61% and 4.38% improvement in Visual Information Fidelity (VIF) for general and no-reference scenarios, respectively, while providing results with high contrast, rich details and colors.


title: MedChatZH: a Better Medical Adviser Learns from Better Instructions

abstract: Generative large language models (LLMs) have shown great success in various applications, including question-answering (QA) and dialogue systems. However, in specialized domains like traditional Chinese medical QA, these models may perform unsatisfactorily without fine-tuning on domain-specific datasets. To address this, we introduce MedChatZH, a dialogue model designed specifically for traditional Chinese medical QA. Our model is pre-trained on Chinese traditional medical books and fine-tuned with a carefully curated medical instruction dataset. It outperforms several solid baselines on a real-world medical dialogue dataset. We release our model, code, and dataset on https://github.com/tyang816/MedChatZH to facilitate further research in the domain of traditional Chinese medicine and LLMs.


title: Multicollinearity Resolution Based on Machine Learning: A Case Study of Carbon Emissions in Sichuan Province

abstract: This study preprocessed 2000-2019 energy consumption data for 46 key Sichuan industries using matrix normalization. DBSCAN clustering identified 16 feature classes to objectively group industries. Penalized regression models were then applied for their advantages in overfitting control, high-dimensional data processing, and feature selection - well-suited for the complex energy data. Results showed the second cluster around coal had highest emissions due to production needs. Emissions from gasoline-focused and coke-focused clusters were also significant. Based on this, emission reduction suggestions included clean coal technologies, transportation management, coal-electricity replacement in steel, and industry standardization. The research introduced unsupervised learning to objectively select factors and aimed to explore new emission reduction avenues. In summary, the study identified industry groupings, assessed emissions drivers, and proposed scientific reduction strategies to better inform decision-making using algorithms like DBSCAN and penalized regression models.


title: Who Made This Copy? An Empirical Analysis of Code Clone Authorship

abstract: Code clones are code snippets that are identical or similar to other snippets within the same or different files. They are often created through copy-and-paste practices during development and maintenance activities. Since code clones may require consistent updates and coherent management, they present a challenging issue in software maintenance. Therefore, many studies have been conducted to find various types of clones with accuracy, scalability, or performance. However, the exploration of the nature of code clones has been limited. Even the fundamental question of whether code snippets in the same clone set were written by the same author or different authors has not been thoroughly investigated. In this paper, we investigate the characteristics of code clones with a focus on authorship. We analyzed the authorship of code clones at the line-level granularity for Java files in 153 Apache projects stored on GitHub and addressed three research questions. Based on these research questions, we found that there are a substantial number of clone lines across all projects (an average of 18.5\% for all projects). Furthermore, authors who contribute to many non-clone lines also contribute to many clone lines. Additionally, we found that one-third of clone sets are primarily contributed to by multiple leading authors. These results confirm our intuitive understanding of clone characteristics, although no previous publications have provided empirical validation data from multiple projects. As the results could assist in designing better clone management techniques, we will explore the implications of developing an effective clone management tool.


title: GICAR algebras and dynamics on determinantal point processes: discrete orthogonal polynomial ensemble case

abstract: It is known that determinantal point processes have an intimate relation to operator algebras. In the paper, we extend this relationship to encompass dynamical aspects. Especially, we delve into two types of determinantal point processes. One is related to discrete orthogonal polynomials of hypergeometric type, and another is $z$-measures, which arise in the asymptotic representation theory of the symmetric groups. Within the framework of operator algebras, we investigate both unitary and stochastic dynamics on these point processes.


title: The enriched $q$-monomial basis of the quasisymmetric functions

abstract: We construct a new family $\left( \eta_{\alpha}^{\left( q\right) }\right) _{\alpha\in\operatorname*{Comp}}$ of quasisymmetric functions for each element $q$ of the base ring. We call them the "enriched $q$-monomial quasisymmetric functions". When $r:=q+1$ is invertible, this family is a basis of $\operatorname{QSym}$. It generalizes Hoffman's "essential quasi-symmetric functions" (obtained for $q=0$) and Hsiao's "monomial peak functions" (obtained for $q=1$), but also includes the monomial quasisymmetric functions as a limiting case. We describe these functions $\eta_{\alpha}^{\left( q\right) }$ by several formulas, and compute their products, coproducts and antipodes. The product expansion is given by an exotic variant of the shuffle product which we call the "stufufuffle product" due to its ability to pick several consecutive entries from each composition. This "stufufuffle product" has previously appeared in recent work by Bouillot, Novelli and Thibon, generalizing the "block shuffle product" from the theory of multizeta values.


title: Jacobi polynomials for the first-order generalized Reed--Muller codes

abstract: In this paper, we give the Jacobi polynomials for first-order generalized Reed--Muller codes. We show as a corollary the nonexistence of combinatorial $3$-designs in these codes.


title: Double Clipping: Less-Biased Variance Reduction in Off-Policy Evaluation

abstract: "Clipping" (a.k.a. importance weight truncation) is a widely used variance-reduction technique for counterfactual off-policy estimators. Like other variance-reduction techniques, clipping reduces variance at the cost of increased bias. However, unlike other techniques, the bias introduced by clipping is always a downward bias (assuming non-negative rewards), yielding a lower bound on the true expected reward. In this work we propose a simple extension, called $\textit{double clipping}$, which aims to compensate this downward bias and thus reduce the overall bias, while maintaining the variance reduction properties of the original estimator.


title: Competing order in two-band Bose-Hubbard chains with extended-range interactions

abstract: Motivated by the recent progress in realizing and controlling extended Bose-Hubbard systems using excitonic or atomic devices, the present Letter theoretically investigates the case of a two-band Bose-Hubbard chain with nearest-neighbor interactions. Specifically, this study concentrates on the scenario where, due to the interactions, one band supports a density wave phase, i.e. a correlated insulating phase with spontaneous breaking of translational symmetry in the lattice, while the other band supports superfluid behavior. Using the density matrix renormalization group method, we show that supersolid order can emerge from such a combination, that is, an elusive quantum state that combines crystalline order with long-range phase coherence. Depending on the filling of the bands and the interband interaction strength, the supersolid phase competes with phase-separation, superfluid order, or Mott insulating density-wave order. As a possible setup to observe supersolidity, we propose the combination of a lower band supporting density-wave order and a thermally excited band that supports superfluidity due to weaker lattice confinement.


title: AI driven B-cell Immunotherapy Design

abstract: Antibodies, a prominent class of approved biologics, play a crucial role in detecting foreign antigens. The effectiveness of antigen neutralisation and elimination hinges upon the strength, sensitivity, and specificity of the paratope-epitope interaction, which demands resource-intensive experimental techniques for characterisation. In recent years, artificial intelligence and machine learning methods have made significant strides, revolutionising the prediction of protein structures and their complexes. The past decade has also witnessed the evolution of computational approaches aiming to support immunotherapy design. This review focuses on the progress of machine learning-based tools and their frameworks in the domain of B-cell immunotherapy design, encompassing linear and conformational epitope prediction, paratope prediction, and antibody design. We mapped the most commonly used data sources, evaluation metrics, and method availability and thoroughly assessed their significance and limitations, discussing the main challenges ahead.


title: On the determinant of the $Q$-walk matrix of rooted product with a path

abstract: Let $G$ be an $n$-vertex graph and $Q(G)$ be its signless Laplacian matrix. The $Q$-walk matrix of $G$, denoted by $W_Q(G)$, is $[e,Q(G)e,\ldots,Q^{n-1}(G)e]$, where $e$ is the all-one vector. Let $G\circ P_m$ be the graph obtained from $G$ and $n$ copies of the path $P_m$ by identifying the $i$-th vertex of $G$ with an endvertex of the $i$-th copy of $P_m$ for each $i$. We prove that, $$\det W_Q(G\circ P_m)=\pm (\det Q(G))^{m-1}(\det W_Q(G))^m$$ holds for any $m\ge 2$. This gives a signless Laplacian counterpart of the following recently established identity [17]: $$\det W_A(G\circ P_m)=\pm (\det A(G))^{\lfloor\frac{m}{2}\rfloor}(\det W_A(G))^m,$$ where $A(G)$ is the adjacency matrix of $G$ and $W_A(G)=[e,A(G)e,\ldots,A^{n-1}(G)e]$. We also propose a conjecture to unify the above two equalities.


title: Distribution System Power-Flow Solution by Hierarchical Artificial Neural Networks Structure

abstract: In this paper, a new method for solving the power flow problem in distribution systems which is fast, parallel, as well as modular, straightforward, simplified and generic is proposed. This approach is based on a hierarchical construction of an ANNs tree. The power system is divided into multiple clusters, with a modular architecture. For each cluster an ANN is constructed, were the ANNs of the different clusters are organized in a hierarchical manner in which the data from a lower-level layer is fed into an upper layer in accordance with the electric correlation between the clusters. The solution time is fast as it is based on the neural networks predictions and also enables parallel computing of all clusters in any given layer. The various clusters have a uniform designed single-hidden-layer ANNs, thus providing a straightforward, simple and generic architectural implementation. The suggested methodology is an important milestone for bypassing power flow classical methods and introducing a novel machine learning based approach. The solution for three-phase unbalance IEEE-123 system as well as EPRI Ckt5 system are presented. The predictions of the ANNs of the hierarchical structures are compared to the solution as calculated by OpenDSS simulation software, with very promising results.


title: AutoML-GPT: Large Language Model for AutoML

abstract: With the emerging trend of GPT models, we have established a framework called AutoML-GPT that integrates a comprehensive set of tools and libraries. This framework grants users access to a wide range of data preprocessing techniques, feature engineering methods, and model selection algorithms. Through a conversational interface, users can specify their requirements, constraints, and evaluation metrics. Throughout the process, AutoML-GPT employs advanced techniques for hyperparameter optimization and model selection, ensuring that the resulting model achieves optimal performance. The system effectively manages the complexity of the machine learning pipeline, guiding users towards the best choices without requiring deep domain knowledge. Through our experimental results on diverse datasets, we have demonstrated that AutoML-GPT significantly reduces the time and effort required for machine learning tasks. Its ability to leverage the vast knowledge encoded in large language models enables it to provide valuable insights, identify potential pitfalls, and suggest effective solutions to common challenges faced during model training.


title: Proceedings of the 16th International Conference on Automata and Formal Languages

abstract: The 16th International Conference on Automata and Formal Languages (AFL 2023) was held in Eger, September 5-7, 2023. It was organized by the Eszterh\'azy K\'aroly Catholic University of Eger, Hungary, and the University of Szeged, Hungary. Topics of interest covered the theory and applications of automata and formal languages and related areas. This volume contains the texts of the 3 invited presentations and the 18 papers selected by the International Program Committee from a total of 23 submissions. We would like to thank everybody who submitted a paper to the conference.


title: Financial Fraud Detection using Quantum Graph Neural Networks

abstract: Financial fraud detection is essential for preventing significant financial losses and maintaining the reputation of financial institutions. However, conventional methods of detecting financial fraud have limited effectiveness, necessitating the need for new approaches to improve detection rates. In this paper, we propose a novel approach for detecting financial fraud using Quantum Graph Neural Networks (QGNNs). QGNNs are a type of neural network that can process graph-structured data and leverage the power of Quantum Computing (QC) to perform computations more efficiently than classical neural networks. Our approach uses Variational Quantum Circuits (VQC) to enhance the performance of the QGNN. In order to evaluate the efficiency of our proposed method, we compared the performance of QGNNs to Classical Graph Neural Networks using a real-world financial fraud detection dataset. The results of our experiments showed that QGNNs achieved an AUC of $0.85$, which outperformed classical GNNs. Our research highlights the potential of QGNNs and suggests that QGNNs are a promising new approach for improving financial fraud detection.


title: Unlocking Retrospective Prevalent Information in EHRs -- a Pairwise Pseudolikelihood Approach

abstract: Typically, electronic health record data are not collected towards a specific research question. Instead, they comprise numerous observations recruited at different ages, whose medical, environmental and oftentimes also genetic data are being collected. Some phenotypes, such as disease-onset ages, may be reported retrospectively if the event preceded recruitment, and such observations are termed ``prevalent". The standard method to accommodate this ``delayed entry" conditions on the entire history up to recruitment, hence the retrospective prevalent failure times are conditioned upon and cannot participate in estimating the disease-onset age distribution. An alternative approach conditions just on survival up to recruitment age, plus the recruitment age itself. This approach allows incorporating the prevalent information but brings about numerical and computational difficulties. In this work we develop consistent estimators of the coefficients in a regression model for the age-at-onset, while utilizing the prevalent data. Asymptotic results are provided, and simulations are conducted to showcase the substantial efficiency gain that may be obtained by the proposed approach. In particular, the method is highly useful in leveraging large-scale repositories for replicability analysis of genetic variants. Indeed, analysis of urinary bladder cancer data reveals that the proposed approach yields about twice as many replicated discoveries compared to the popular approach.