title: Experimental Evaluation of Methods for Estimating Frequency Response Functions of a 6-axes Robot

abstract: Nonparametric estimates of frequency response functions (FRFs) are often suitable for describing the dynamics of a mechanical system. If treating these estimates as measurement inputs, they can be used for parametric identification of, e.g., a gray-box model. Classical methods for nonparametric FRF estimation of MIMO systems require at least as many experiments as the system has inputs. Local parametric FRF estimation methods have been developed for avoiding multiple experiments. In this paper, these local methods are adapted and applied for estimating the FRFs of a 6-axes robotic manipulator, which is a nonlinear MIMO system operating in closed loop. The aim is to reduce the experiment time and amount of data needed for identification. The resulting FRFs are analyzed in an experimental study and compared to estimates obtained by classical MIMO techniques. It is furthermore shown that an accurate parametric model identification is possible based on local parametric FRF estimates and that the total experiment time can be significantly reduced.


title: Edge-State-Mediated RKKY Coupling in Graphene Nanoflakes

abstract: We investigate the long-range behavior and size dependence of the Ruderman-Kittel-Kasuya-Yosida (RKKY) interaction in hexagonal and triangular graphene nanoflakes with zigzag and arm-chair edges. We employ the tight-binding model with exact diagonalization to calculate the RKKY interaction as a function of the distance between magnetic impurities, nanoflake size, and edge geometry. Our findings demonstrate a strong dependency of the RKKY interaction on edge geometry and flake size, with notable changes in the RKKY interaction strength. We further analyze the influence of structural defects on the interaction strength of exchange interactions.


title: Semi-analytic PINN methods for boundary layer problems in a rectangular domain

abstract: Singularly perturbed boundary value problems pose a significant challenge for their numerical approximations because of the presence of sharp boundary layers. These sharp boundary layers are responsible for the stiffness of solutions, which leads to large computational errors, if not properly handled. It is well-known that the classical numerical methods as well as the Physics-Informed Neural Networks (PINNs) require some special treatments near the boundary, e.g., using extensive mesh refinements or finer collocation points, in order to obtain an accurate approximate solution especially inside of the stiff boundary layer. In this article, we modify the PINNs and construct our new semi-analytic SL-PINNs suitable for singularly perturbed boundary value problems. Performing the boundary layer analysis, we first find the corrector functions describing the singular behavior of the stiff solutions inside boundary layers. Then we obtain the SL-PINN approximations of the singularly perturbed problems by embedding the explicit correctors in the structure of PINNs or by training the correctors together with the PINN approximations. Our numerical experiments confirm that our new SL-PINN methods produce stable and accurate approximations for stiff solutions.


title: Regional Correlation Aided Mobile Traffic Prediction with Spatiotemporal Deep Learning

abstract: Mobile traffic data in urban regions shows differentiated patterns during different hours of the day. The exploitation of these patterns enables highly accurate mobile traffic prediction for proactive network management. However, recent Deep Learning (DL) driven studies have only exploited spatiotemporal features and have ignored the geographical correlations, causing high complexity and erroneous mobile traffic predictions. This paper addresses these limitations by proposing an enhanced mobile traffic prediction scheme that combines the clustering strategy of daily mobile traffic peak time and novel multi Temporal Convolutional Network with a Long Short Term Memory (multi TCN-LSTM) model. The mobile network cells that exhibit peak traffic during the same hour of the day are clustered together. Our experiments on large-scale real-world mobile traffic data show up to 28% performance improvement compared to state-of-the-art studies, which confirms the efficacy and viability of the proposed approach.


title: Adaptive Compression of the Latent Space in Variational Autoencoders

abstract: Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its hyperparameters, such as the latent space size. This paper presents a simple extension of VAEs for automatically determining the optimal latent space size during the training process by gradually decreasing the latent size through neuron removal and observing the model performance. The proposed method is compared to traditional hyperparameter grid search and is shown to be significantly faster while still achieving the best optimal dimensionality on four image datasets. Furthermore, we show that the final performance of our method is comparable to training on the optimal latent size from scratch, and might thus serve as a convenient substitute.


title: EQ-Bench: An Emotional Intelligence Benchmark for Large Language Models

abstract: We introduce EQ-Bench, a novel benchmark designed to evaluate aspects of emotional intelligence in Large Language Models (LLMs). We assess the ability of LLMs to understand complex emotions and social interactions by asking them to predict the intensity of emotional states of characters in a dialogue. The benchmark is able to discriminate effectively between a wide range of models. We find that EQ-Bench correlates strongly with comprehensive multi-domain benchmarks like MMLU (Hendrycks et al., 2020) (r=0.97), indicating that we may be capturing similar aspects of broad intelligence. Our benchmark produces highly repeatable results using a set of 60 English-language questions. We also provide open-source code for an automated benchmarking pipeline at https://github.com/EQ-bench/EQ-Bench and a leaderboard at https://eqbench.com


title: Rank-Metric Codes and Their Parameters

abstract: We present the theory of linear rank-metric codes from the point of view of their fundamental parameters. These are: the minimum rank distance, the rank distribution, the maximum rank, the covering radius, and the field size. The focus of this chapter is on the interplay among these parameters and on their significance for the code's (combinatorial) structure. The results covered in this chapter span from the theory of optimal codes and anticodes to very recent developments on the asymptotic density of MRD codes.


title: Extrapolating tipping points and simulating non-stationary dynamics of complex systems using efficient machine learning

abstract: Model-free and data-driven prediction of tipping point transitions in nonlinear dynamical systems is a challenging and outstanding task in complex systems science. We propose a novel, fully data-driven machine learning algorithm based on next-generation reservoir computing to extrapolate the bifurcation behavior of nonlinear dynamical systems using stationary training data samples. We show that this method can extrapolate tipping point transitions. Furthermore, it is demonstrated that the trained next-generation reservoir computing architecture can be used to predict non-stationary dynamics with time-varying bifurcation parameters. In doing so, post-tipping point dynamics of unseen parameter regions can be simulated.


title: Static magnetic order with strong quantum fluctuations in spin-1/2 honeycomb magnet Na2Co2TeO6

abstract: Kitaev interactions, arising from the interplay of frustration and bond anisotropy, can lead to strong quantum fluctuations and, in an ideal case, to a quantum-spin-liquid state. However, in many nonideal materials, spurious non-Kitaev interactions typically promote a zigzag antiferromagnetic order in the d-orbital transition metal compounds. By combining neutron scattering with muon-spin rotation and relaxation techniques, we provide new insights into the exotic properties of Na2Co2TeO6, a candidate Kitaev material. Below TN, the zero-field muon-spin relaxation rate becomes almost constant (at 0.45 us-1). We attribute this temperature-independent muon-spin relaxation rate to the strong quantum fluctuations, as well as to the frustrated Kitaev interactions. As the magnetic field increases, neutron scattering data indicate a much broader spin-wave-excitation gap at the K-point. Therefore, quantum fluctuations seem not only robust, but are even enhanced by the applied magnetic field. Our findings provide valuable hints for understanding the onset of the quantum-spin-liquid state in Kitaev materials.


title: Compensation Sampling for Improved Convergence in Diffusion Models

abstract: Diffusion models achieve remarkable quality in image generation, but at a cost. Iterative denoising requires many time steps to produce high fidelity images. We argue that the denoising process is crucially limited by an accumulation of the reconstruction error due to an initial inaccurate reconstruction of the target data. This leads to lower quality outputs, and slower convergence. To address this issue, we propose compensation sampling to guide the generation towards the target domain. We introduce a compensation term, implemented as a U-Net, which adds negligible computation overhead during training and, optionally, inference. Our approach is flexible and we demonstrate its application in unconditional generation, face inpainting, and face de-occlusion using benchmark datasets CIFAR-10, CelebA, CelebA-HQ, FFHQ-256, and FSG. Our approach consistently yields state-of-the-art results in terms of image quality, while accelerating the denoising process to converge during training by up to an order of magnitude.


title: Late Engine Activity in Neutron Star Mergers and Its Cocoon: An Alternative Scenario for the Blue Kilonova

abstract: Follow-up observations of short gamma-ray bursts (sGRBs) have continuously unveiled late extended/plateau emissions, attributed to jet launch due to late engine activity, the nature of which remains enigmatic. Observations of GW170817 confirmed that sGRBs are linked to neutron star (NS) mergers, and discovered a kilonova (KN) transient. Nevertheless, the origin of the early "blue" KN in GW170817 remains unclear. Here, we investigate the propagation of late jets in the merger ejecta. By analytically modeling jet dynamics, we determine the properties of the jet heated cocoon, and estimate its cooling emission. Our results reveal that late jets generate significantly brighter cocoons compared to prompt jets, primarily due to reduced energy loss by adiabatic cooling. Notably, with typical late jets, emission from the cocoon trapped inside the ejecta can reproduce the blue KN emission. We estimate that the forthcoming Einstein Probe mission will detect the early cocoon emission with a rate of $\sim 2.1_{-1.6}^{+3.2}$ yr$^{-1}$, and that optical/UV follow-ups in the LIGO-VIRGO-KAGRA O5 run will be able to detect $\sim 1.0_{-0.7}^{+1.5}$ cocoon emission events. As an electromagnetic counterpart, this emission provides an independent tool to probe NS mergers in the Universe, complementing insights from sGRBs and gravitational waves.


title: Overcoming Cognitive Distraction and Measurement Noise: Strategies for Humans and Engineering Systems

abstract: Cognitive distraction and measurement noise are two distinct factors that significantly impact the performance of humans and engineering systems. Cognitive distraction occurs when an individual's attention is diverted from a task, while measurement noise refers to the random variation that can occur in system measurements. Although humans and engineering systems employ different methods to overcome these obstacles, the ultimate goal is to achieve optimal performance. An intriguing question arises: what are the similarities and differences between using the term "noise" in engineering and cognitive psychology? Additionally, it is worthwhile to explore whether the human brain and engineering control systems use similar or different approaches to attenuate noise. While this article does not provide a definitive answer, it emphasizes the importance of addressing this question and encourages further investigation.


title: Analysis and computations of a stochastic Cahn-Hilliard model for tumor growth with chemotaxis and variable mobility

abstract: In this work, we present and analyze a system of PDEs, which models tumor growth by considering chemotaxis, active transport, and random effects. The stochasticity of the system is modelled by random initial data and Wiener noises that appear in the tumor and nutrient equations. The volume fraction of the tumor is governed by a stochastic phase-field equation of Cahn-Hilliard type, and the mass density of the nutrients is modelled by a stochastic reaction-diffusion equation. We allow a variable mobility function and non-increasing growth functions, such as logistic and Gompertzian growth. Via approximation and stochastic compactness arguments, we prove the existence of a probabilistic weak solution and, in the case of constant mobilities, the well-posedness of the model in the strong probabilistic sense. Lastly, we propose a numerical approximation based on the Galerkin finite element method in space and the semi-implicit Euler-Maruyama scheme in time. We illustrate the effects of the stochastic forcing in the tumor growth in several numerical simulations.


title: A graphical framework for interpretable correlation matrix models

abstract: In this work, we present a new approach for constructing models for correlation matrices with a user-defined graphical structure. The graphical structure makes correlation matrices interpretable and avoids the quadratic increase of parameters as a function of the dimension. We suggest an automatic approach to define a prior using a natural sequence of simpler models within the Penalized Complexity framework for the unknown parameters in these models. We illustrate this approach with three applications: a multivariate linear regression of four biomarkers, a multivariate disease mapping, and a multivariate longitudinal joint modelling. Each application underscores our method's intuitive appeal, signifying a substantial advancement toward a more cohesive and enlightening model that facilitates a meaningful interpretation of correlation matrices.


title: Exploiting Label Skews in Federated Learning with Model Concatenation

abstract: Federated Learning (FL) has emerged as a promising solution to perform deep learning on different data owners without exchanging raw data. However, non-IID data has been a key challenge in FL, which could significantly degrade the accuracy of the final model. Among different non-IID types, label skews have been challenging and common in image classification and other tasks. Instead of averaging the local models in most previous studies, we propose FedConcat, a simple and effective approach that concatenates these local models as the base of the global model to effectively aggregate the local knowledge. To reduce the size of the global model, we adopt the clustering technique to group the clients by their label distributions and collaboratively train a model inside each cluster. We theoretically analyze the advantage of concatenation over averaging by analyzing the information bottleneck of deep neural networks. Experimental results demonstrate that FedConcat achieves significantly higher accuracy than previous state-of-the-art FL methods in various heterogeneous label skew distribution settings and meanwhile has lower communication costs. Our code is publicly available at https://github.com/sjtudyq/FedConcat.


title: Towards a phase diagram of the topologically frustrated XY chain

abstract: Landau theory's implicit assumption that microscopic details cannot affect the system's phases has been challenged only recently in systems such as antiferromagnetic quantum spin chains with periodic boundary conditions, where topological frustration can be induced. In this work, we show that the latter modifies the zero temperature phase diagram of the XY chain in a transverse magnetic field by inducing new quantum phase transitions. In doing so, we come across the first case of second order boundary quantum phase transition characterized by a quartic dispersion relation. Our analytical results are supported by numerical investigations and lay the foundation for understanding the phase diagram of this frustrated model.


title: HoLLiE C -- A Multifunctional Bimanual Mobile Robot Supporting Versatile Care Applications

abstract: Care robotics as a research field has developed a lot in recent years, driven by the rapidly increasing need for it. However, these technologies are mostly limited to a very concrete and usually relatively simple use case. The bimanual robot House of Living Labs intelligent Escort (HoLLiE) includes an omnidirectional mobile platform. This paper presents how HoLLiE is adapted, by flexible software and hardware modules, for different care applications. The design goal of HoLLiE was to be human-like but abstract enough to ensure a high level of acceptance, which is very advantageous for its use in hospitals. After a short retrospect of previous generations of HoLLiE, it is highlighted how the current version is equipped with a variety of additional sensors and actuators to allow a wide range of possible applications. Then, the software stack of HoLLiE is depicted, with the focus on navigation and force sensitive intention recognition.


title: Mobile Edge Computing and AI Enabled Web3 Metaverse over 6G Wireless Communications: A Deep Reinforcement Learning Approach

abstract: The Metaverse is gaining attention among academics as maturing technologies empower the promises and envisagements of a multi-purpose, integrated virtual environment. An interactive and immersive socialization experience between people is one of the promises of the Metaverse. In spite of the rapid advancements in current technologies, the computation required for a smooth, seamless and immersive socialization experience in the Metaverse is overbearing, and the accumulated user experience is essential to be considered. The computation burden calls for computation offloading, where the integration of virtual and physical world scenes is offloaded to an edge server. This paper introduces a novel Quality-of-Service (QoS) model for the accumulated experience in multi-user socialization on a multichannel wireless network. This QoS model utilizes deep reinforcement learning approaches to find the near-optimal channel resource allocation. Comprehensive experiments demonstrate that the adoption of the QoS model enhances the overall socialization experience.


title: A generalized Dean-Kawasaki equation for an interacting Brownian gas in a partially absorbing medium

abstract: The Dean-Kawasaki (DK) equation is a stochastic partial differential equation (SPDE) for the global density $\rho$ of a gas of $N$ over-damped Brownian particles. In the thermodynamic limit $N\rightarrow \infty$ with weak pairwise interactions, the expectation ${\mathbb E}[\rho]$ converges in distribution to the solution of a McKean-Vlasov (MV) equation. In this paper we derive a generalized DK equation for an interacting Brownian gas in a partially absorbing one-dimensional medium. In the case of the half-line with a totally reflecting boundary at $x=0$, the generalized DK equation is an SPDE for the joint global density $\rho(x,\ell,t)=N^{-1}\sum_{j=1}^N\delta(x-X_j(t))\delta(\ell-L_j(t))$, where $X_j(t)$ and $L_j(t)$ denote the position and local time of the $j$th particle, respectively. Assuming the DK equation has a well-defined mean field limit, we derive the MV equation on the half-line with a reflecting boundary, and analyze stationary solutions for a Curie-Weiss (quadratic) interaction potential. We then use an encounter-based approach to develop the analogous theory for a partially absorbing boundary at $x=0$. Each particle is independently absorbed when its local time $L_j(t)$ exceeds a random threshold $\widehat{\ell}_j$ with probability distribution $\Psi(\ell)=\P[\widehat{\ell}_j>\ell]$. The joint global density is now summed over the set of particles that have not yet been absorbed, and expectations are taken with respect to the Gaussian noise and the random thresholds $\widehat{\ell}_j$. Extensions to finite intervals and partially absorbing traps are also considered.


title: Cataract-1K: Cataract Surgery Dataset for Scene Segmentation, Phase Recognition, and Irregularity Detection

abstract: In recent years, the landscape of computer-assisted interventions and post-operative surgical video analysis has been dramatically reshaped by deep-learning techniques, resulting in significant advancements in surgeons' skills, operation room management, and overall surgical outcomes. However, the progression of deep-learning-powered surgical technologies is profoundly reliant on large-scale datasets and annotations. Particularly, surgical scene understanding and phase recognition stand as pivotal pillars within the realm of computer-assisted surgery and post-operative assessment of cataract surgery videos. In this context, we present the largest cataract surgery video dataset that addresses diverse requisites for constructing computerized surgical workflow analysis and detecting post-operative irregularities in cataract surgery. We validate the quality of annotations by benchmarking the performance of several state-of-the-art neural network architectures for phase recognition and surgical scene segmentation. Besides, we initiate the research on domain adaptation for instrument segmentation in cataract surgery by evaluating cross-domain instrument segmentation performance in cataract surgery videos. The dataset and annotations will be publicly available upon acceptance of the paper.


title: Measuring Approximate Functional Dependencies: a Comparative Study

abstract: Approximate functional dependencies (AFDs) are functional dependencies (FDs) that "almost" hold in a relation. While various measures have been proposed to quantify the level to which an FD holds approximately, they are difficult to compare and it is unclear which measure is preferable when one needs to discover FDs in real-world data, i.e., data that only approximately satisfies the FD. In response, this paper formally and qualitatively compares AFD measures. We obtain a formal comparison through a novel presentation of measures in terms of Shannon and logical entropy. Qualitatively, we perform a sensitivity analysis w.r.t. structural properties of input relations and quantitatively study the effectiveness of AFD measures for ranking AFDs on real world data. Based on this analysis, we give clear recommendations for the AFD measures to use in practice.


title: MMDesign: Multi-Modality Transfer Learning for Generative Protein Design

abstract: Protein design involves generating protein sequences based on their corresponding protein backbones. While deep generative models show promise for learning protein design directly from data, the lack of publicly available structure-sequence pairings limits their generalization capabilities. Previous efforts of generative protein design have focused on architectural improvements and pseudo-data augmentation to overcome this bottleneck. To further address this challenge, we propose a novel protein design paradigm called MMDesign, which leverages multi-modality transfer learning. To our knowledge, MMDesign is the first framework that combines a pretrained structural module with a pretrained contextual module, using an auto-encoder (AE) based language model to incorporate prior semantic knowledge of protein sequences. We also introduce a cross-layer cross-modal alignment algorithm to enable the structural module to learn long-term temporal information and ensure consistency between structural and contextual modalities. Experimental results, only training with the small CATH dataset, demonstrate that our MMDesign framework consistently outperforms other baselines on various public test sets. To further assess the biological plausibility of the generated protein sequences and data distribution, we present systematic quantitative analysis techniques that provide interpretability and reveal more about the laws of protein design.


title: Musical Sonification of Daily Physical Activity Data: A Proof of Concept Study

abstract: arXiv admin comment: This version has been removed by arXiv administrators as the submitter did not have the rights to agree to the license at the time of submission


title: RCA-NOC: Relative Contrastive Alignment for Novel Object Captioning

abstract: In this paper, we introduce a novel approach to novel object captioning which employs relative contrastive learning to learn visual and semantic alignment. Our approach maximizes compatibility between regions and object tags in a contrastive manner. To set up a proper contrastive learning objective, for each image, we augment tags by leveraging the relative nature of positive and negative pairs obtained from foundation models such as CLIP. We then use the rank of each augmented tag in a list as a relative relevance label to contrast each top-ranked tag with a set of lower-ranked tags. This learning objective encourages the top-ranked tags to be more compatible with their image and text context than lower-ranked tags, thus improving the discriminative ability of the learned multi-modality representation. We evaluate our approach on two datasets and show that our proposed RCA-NOC approach outperforms state-of-the-art methods by a large margin, demonstrating its effectiveness in improving vision-language representation for novel object captioning.


title: New approach to extract important degrees of freedom in quantum dynamics using singular value decomposition: Application to linear optical spectrum in two-dimensional Mott insulators

abstract: We propose a new approach to extract the important degrees of freedom in quantum dynamics induced by an external stimulus. We calculate the coefficient matrix numerically, where the $i-l$ element of the matrix is the coefficient of the lth basis state at the ith discretized time in the solution of the time-dependent Schr\"odinger equation induced by the external stimulus. By performing a randomized singular value decomposition of the coefficient matrix, a practically exact solution is obtained using a linear combination of the important modes, where the number of modes is much smaller than the dimensions of the Hilbert space in many cases. We apply this method to analysis of the light absorption spectrum in two-dimensional (2D) Mott insulators using an effective model of the 2D Hubbard model in the strong interaction case. From the dynamics induced by an ultrashort weak light pulse, we find that the practically exact light absorption spectrum can be reproduced by as few as 1000 energy eigenstates in the $1.7 \times 10^{7}$-dimension Hilbert space of a 26-site cluster. These one-photon active energy eigenstates are classified into free holon and doublon (H-D) and localized H-D states. In the free H-D states, the main effect of the spin degrees of freedom on the transfer of a holon (H) and a doublon (D) is the phase shift, and the H and the D move freely. In the localized H-D states, an H and a D are localized with relative distances of $\sqrt{5}$ or $\sqrt{13}$. The antiferromagnetic (AF) spin orders in the localized H-D states are much stronger than those in the free H-D states, and the charge localization is of magnetic origin. There are sharp peaks caused by excitations to the localized H-D states below the broad band caused by excitations to the free H-D states in the light absorption spectrum.


title: Invariants of magnetic lines for Yang-Mills solutions

abstract: We construct a new Yang-Mills 3D-solution on the space of negative scalar curvarure. We discuss a problem of non-abelian gauge symmetry is broken with the assumption that a scalar curvature of the domain is a negative small parameter. In this case we use the following fact: a geometrical scale related with Vassiliev's discriminant of magnetic lines coincids with a physical Kolmogorov scale. This gives an estimation of $\alpha$-effect by the dispersion of the asymptotic ergodic Hopf invariant in the limite with a negative scalar curvature parameter.


title: Non-iterative Methods in Inhomogeneous Background Inverse Scattering Imaging Problem Assisted by Swin Transformer Network

abstract: A deep learning-assisted inversion method is proposed to solve the inhomogeneous background imaging problem. Three non-iterative methods, namely the distorted-Born (DB) major current coefficients method, the DB modified Born approximation method, and the DB connection method, are introduced to address the inhomogeneous background inverse scattering problem. These methods retain the multiple scattering information by utilizing the major current obtained through singular value decomposition of the Green's function and the scattered field, without resourcing to optimization techniques. As a result, the proposed methods offer improved reconstruction resolution and accuracy for unknown objects embedded in inhomogeneous backgrounds, surpassing the backpropagation scheme (BPS) and Born approximation (BA) method that disregard the multiple scattering effect. To further enhance the resolution and accuracy of the reconstruction, a Shifted-Window (Swin) transformer network is employed for capturing super-resolution information in the images. The attention mechanism incorporated in the shifted window facilitates global interactions between objects, thereby enhancing the performance of the inhomogeneous background imaging algorithm while reducing computational complexity. Moreover, an adaptive training method is proposed to enhance the generalization ability of the network. The effectiveness of the proposed methods is demonstrated through both synthetic data and experimental data. Notably, super-resolution imaging is achieved with quasi real-time speed, indicating promising application potential for the proposed algorithms.


title: Symmetry Breaking and Rainbow Trapping: Insights from Coupled Cavity Photonic Crystal Waveguides

abstract: This study focuses on achieving rainbow trapping in photonic crystal coupled cavity waveguides via symmetry reduction at the cavity region. Employing both plane wave expansion and finite-difference time domain methods, we explore the impact of integrating an auxiliary rod at varying angles to the primary cavity rod. Our simulations reveal that strategic angle variations maximize the group index and group velocity while investigating group velocity dispersion and third order dispersion within the slow light region. Leveraging these results, we demonstrate effective rainbow trapping by manipulating the auxiliary rod angles in photonic crystal coupled cavity waveguides. Our results have encouraging implications for optical buffering, multiplexing, demultiplexing, advanced time-domain and spatial signal-processing.


title: Orchestrated Robust Controller for the Precision Control of Heavy-duty Hydraulic Manipulators

abstract: Vast industrial investment along with increased academic research on hydraulic heavy-duty manipulators has unavoidably paved the way for their automatization, necessitating the design of robust and high-precision controllers. In this study, an orchestrated robust controller is designed to address the mentioned issue. To do so, the entire robotic system is decomposed into subsystems, and a robust controller is designed at each local subsystem by considering unknown model uncertainties, unknown disturbances, and compound input constraints, thanks to virtual decomposition control (VDC). As such, radial basic function neural networks (RBFNNs) are incorporated into VDC to tackle unknown disturbances and uncertainties, resulting in novel decentralized RBFNNs. All these robust local controllers designed at each local subsystem are, then, orchestrated to accomplish high-precision control. In the end, for the first time in the context of VDC, a semi-globally uniformly ultimate boundedness is achieved under the designed controller. The validity of the theoretical results is verified by performing extensive simulations and experiments on a 6-degrees-of-freedom industrial manipulator with a nominal lifting capacity of $600\, kg$ at $5$ meters reach. Comparing the simulation result to state-of-the-art controller along with provided experimental results, demonstrates that the proposed method established all the promises and performed excellently.


title: A Meta-Level Learning Algorithm for Sequential Hyper-Parameter Space Reduction in AutoML

abstract: AutoML platforms have numerous options for the algorithms to try for each step of the analysis, i.e., different possible algorithms for imputation, transformations, feature selection, and modelling. Finding the optimal combination of algorithms and hyper-parameter values is computationally expensive, as the number of combinations to explore leads to an exponential explosion of the space. In this paper, we present the Sequential Hyper-parameter Space Reduction (SHSR) algorithm that reduces the space for an AutoML tool with negligible drop in its predictive performance. SHSR is a meta-level learning algorithm that analyzes past runs of an AutoML tool on several datasets and learns which hyper-parameter values to filter out from consideration on a new dataset to analyze. SHSR is evaluated on 284 classification and 375 regression problems, showing an approximate 30% reduction in execution time with a performance drop of less than 0.1%.


title: Attribute Annotation and Bias Evaluation in Visual Datasets for Autonomous Driving

abstract: This paper addresses the often overlooked issue of fairness in the autonomous driving domain, particularly in vision-based perception and prediction systems, which play a pivotal role in the overall functioning of Autonomous Vehicles (AVs). We focus our analysis on biases present in some of the most commonly used visual datasets for training person and vehicle detection systems. We introduce an annotation methodology and a specialised annotation tool, both designed to annotate protected attributes of agents in visual datasets. We validate our methodology through an inter-rater agreement analysis and provide the distribution of attributes across all datasets. These include annotations for the attributes age, sex, skin tone, group, and means of transport for more than 90K people, as well as vehicle type, colour, and car type for over 50K vehicles. Generally, diversity is very low for most attributes, with some groups, such as children, wheelchair users, or personal mobility vehicle users, being extremely underrepresented in the analysed datasets. The study contributes significantly to efforts to consider fairness in the evaluation of perception and prediction systems for AVs. This paper follows reproducibility principles. The annotation tool, scripts and the annotated attributes can be accessed publicly at https://github.com/ec-jrc/humaint_annotator.


title: Shower formation constraints on cubic Lorentz Invariance Violation parameters in quantum electrodynamics

abstract: We present shower formation constraints on the Lorentz Invariance Violation (LIV) energy scale for photons with cubic dispersion relation from recent gamma ray observations in $100$ TeV -- PeV energy range by LHAASO observatory. We assume Myers-Pospelov effective field theory framework, and calculate the suppression for the Bethe-Heitler process which is mainly responsible for the formation of photon-initiated atmosphere showers. Comparing the high-energy photon events with the suppressed flux predictions we obtain $95\%$ CL constraints on the LIV energy scale. The obtained shower constraint $E_{\rm LIV} \gtrsim \mathcal{O} \left( 10^{20} \mbox{ GeV}\right)$ is significantly weaker than existing birefringence constraints but is independent.


title: Extracting Yang-Mills topological structures with adjoint modes

abstract: We report on how adjoint zero modes can be used to filter out the topological structures of gauge configurations from the UV fluctuations. We will use the Adjoint Filtering Method (AFM) which relies on the existence of a particular Supersymmetric Zero Mode (SZM) that follows closely the (anti)self-dual part of the action density. In contrast, it is not guaranteed that summing over the lowest lying modes in the fundamental representation reproduces the topological density. We present preliminary qualitative results on smooth, heated, and Monte-Carlo generated configurations with non-trivial content of fractional instantons. The method is capable of distinguishing the underlying topological structures without significantly modifying the gauge field as opposed to smoothing techniques. The method looks promising as a tool to investigate and extend recent studies based on semiclassical methods.


title: An unsupervised learning approach to evaluate questionnaire data -- what one can learn from violations of measurement invariance

abstract: In several branches of the social sciences and humanities, surveys based on standardized questionnaires are a prominent research tool. While there are a variety of ways to analyze the data, some standard procedures have become established. When those surveys want to analyze differences in the answer patterns of different groups (e.g., countries, gender, age, ...), these procedures can only be carried out in a meaningful way if there is measurement invariance, i.e., the measured construct has psychometric equivalence across groups. As recently raised as an open problem by Sauerwein et al. (2021), new evaluation methods that work in the absence of measurement invariance are needed. This paper promotes an unsupervised learning-based approach to such research data by proposing a procedure that works in three phases: data preparation, clustering of questionnaires, and measuring similarity based on the obtained clustering and the properties of each group. We generate synthetic data in three data sets, which allows us to compare our approach with the PCA approach under measurement invariance and under violated measurement invariance. As a main result, we obtain that the approach provides a natural comparison between groups and a natural description of the response patterns of the groups. Moreover, it can be safely applied to a wide variety of data sets, even in the absence of measurement invariance. Finally, this approach allows us to translate (violations of) measurement invariance into a meaningful measure of similarity.


title: Development of the Lifelike Head Unit for a Humanoid Cybernetic Avatar `Yui' and Its Operation Interface

abstract: In the context of avatar-mediated communication, it is crucial for the face-to-face interlocutor to sense the operator's presence and emotions via the avatar. Although androids resembling humans have been developed to convey presence through appearance and movement, few studies have prioritized deepening the communication experience for both operator and interlocutor using android robot as an avatar. Addressing this gap, we introduce the ``Cybernetic Avatar `Yui','' featuring a human-like head unit with 28 degrees of freedom, capable of expressing gaze, facial emotions, and speech-related mouth movements. Through an eye-tracking unit in a Head-Mounted Display (HMD) and degrees of freedom on both eyes of Yui, operators can control the avatar's gaze naturally. Additionally, microphones embedded in Yui's ears allow operators to hear surrounding sounds in three dimensions, enabling them to discern the direction of calls based solely on auditory information. An HMD's face-tracking unit synchronizes the avatar's facial movements with those of the operator. This immersive interface, coupled with Yui's human-like appearance, enables real-time emotion transmission and communication, enhancing the sense of presence for both parties. Our experiments demonstrate Yui's facial expression capabilities, and validate the system's efficacy through teleoperation trials, suggesting potential advancements in avatar technology.


title: Change of regularity in controllability and observability of systems of wave equations

abstract: Solutions of a system of wave equations are constructed for both homogeneous and inhomogeneous Dirichlet boundary conditions at every regularity level. We prove that boundary observability, and thus boundary exact controllability, at some regularity level is equivalent to boundary observability at all levels. The main ingredient is the ellipticity of a time-derivative on the Neumann trace of the solution, which is proved by microlocal techniques.


title: Aspects of Machian Gravity (III): Testing Theory against Galaxy Cluster mass

abstract: The general theory of relativity (GR) has excelled in explaining gravitational phenomena at the scale of the solar system with remarkable precision. However, when extended to the galactic or cosmological scale, it requires dark matter and dark energy to explain observations. In our previous article arXiv:2308.04503, we've formulated a gravity theory based in Mach's principle, known as Machian gravity. We demonstrated that the theory successfully explains galactic velocity profiles without requiring additional dark matter components. In previous studies, for a selected set of galaxy clusters, we also showed its ability to explain the velocity dispersion in the clusters without extra unseen matter components. This paper primarily explores the mass profiles of galaxy clusters. We test the Machian Gravity acceleration law on two distinct sets comprising approximately 150 galaxy clusters sourced from various studies. We fitted the dynamic mass profiles using the Machian gravity model. The outcomes of our study show exceptional agreement between the theory and observational results.


title: Single-step Chemical Vapor Deposition of Methyl Ammonium Lead Halide Perovskite for p-i-n Solar Cells

abstract: Metal halide perovskite solar cells being one of the fastest emerging technologies for renewable energy still has to become more industry friendly in a way that will allow using it for thin film modules or tandems with conventional silicon devices. The simplest way to achieve this is to use chemical vapor deposition (CVD) technique for tandem production. In this work, we show a method for a single step production of MAPbI3 films in a simple two-zone CVD reactor from lead diacetate and methyl-ammonium iodide powders. Obtained films show highly ordered cubic MAPbI3 phase with a thickness of 400-500 um, good photoluminescence response and absorption band edge similar to spin-coated film. We used those films to produce p-i-n solar cells with ITO/NiO/MAPbI3/C60/Cu structure. The best cell showed negligible 0.23 % PCE right after the manufacturing but significantly improved to 5.5 % PCE after 8 hours of storage in the dark. The main limiting factor affecting the efficiency is low current density, which we attribute to non-optimized growth conditions; however, our approach is a first step to a single step CVD deposition of MAPbI3 on any type of substrates including texturized silicon subcells for better overall efficiency.


title: DMS*: Minimizing Makespan for Multi-Agent Combinatorial Path Finding

abstract: Multi-Agent Combinatorial Path Finding (MCPF) seeks collision-free paths for multiple agents from their initial to goal locations, while visiting a set of intermediate target locations in the middle of the paths. MCPF is challenging as it involves both planning collision-free paths for multiple agents and target sequencing, i.e., solving traveling salesman problems to assign targets to and find the visiting order for the agents. Recent work develops methods to address MCPF while minimizing the sum of individual arrival times at goals. Such a problem formulation may result in paths with different arrival times and lead to a long makespan, the maximum arrival time, among the agents. This paper proposes a min-max variant of MCPF, denoted as MCPF-max, that minimizes the makespan of the agents. While the existing methods (such as MS*) for MCPF can be adapted to solve MCPF-max, we further develop two new techniques based on MS* to defer the expensive target sequencing during planning to expedite the overall computation. We analyze the properties of the resulting algorithm Deferred MS* (DMS*), and test DMS* with up to 20 agents and 80 targets. We demonstrate the use of DMS* on differential-drive robots.


title: GPTBIAS: A Comprehensive Framework for Evaluating Bias in Large Language Models

abstract: Warning: This paper contains content that may be offensive or upsetting. There has been a significant increase in the usage of large language models (LLMs) in various applications, both in their original form and through fine-tuned adaptations. As a result, LLMs have gained popularity and are being widely adopted by a large user community. However, one of the concerns with LLMs is the potential generation of socially biased content. The existing evaluation methods have many constraints, and their results exhibit a limited degree of interpretability. In this work, we propose a bias evaluation framework named GPTBIAS that leverages the high performance of LLMs (e.g., GPT-4 \cite{openai2023gpt4}) to assess bias in models. We also introduce prompts called Bias Attack Instructions, which are specifically designed for evaluating model bias. To enhance the credibility and interpretability of bias evaluation, our framework not only provides a bias score but also offers detailed information, including bias types, affected demographics, keywords, reasons behind the biases, and suggestions for improvement. We conduct extensive experiments to demonstrate the effectiveness and usability of our bias evaluation framework.


title: SemiSAM: Exploring SAM for Enhancing Semi-Supervised Medical Image Segmentation with Extremely Limited Annotations

abstract: Semi-supervised learning has attracted much attention due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods, which is especially important for medical image segmentation which typically requires intensive pixel/voxel-wise labeling by domain experts. Although semi-supervised methods can improve the performance by utilizing unlabeled data, there are still gaps between fully supervised methods under extremely limited annotation scenarios. In this paper, we propose a simple yet efficient strategy to explore the usage of the Segment Anything Model (SAM) for enhancing semi-supervised medical image segmentation. Concretely, the segmentation model trained with domain knowledge provides information for localization and generating input prompts to the SAM. Then the generated pseudo-labels of SAM are utilized as additional supervision to assist in the learning procedure of the semi-supervised framework. Experimental results demonstrate that SAM's assistance significantly enhances the performance of existing semi-supervised frameworks, especially when only one or a few labeled images are available.


title: Flow Symmetrization for Parameterized Constrained Diffeomorphisms

abstract: Diffeomorphisms play a crucial role while searching for shapes with fixed topological properties, allowing for smooth deformation of template shapes. Several approaches use diffeomorphism for shape search. However, these approaches employ only unconstrained diffeomorphisms. In this work, we develop Flow Symmetrization - a method to represent a parametric family of constrained diffeomorphisms that contain additional symmetry constraints such as periodicity, rotation equivariance, and transflection equivariance. Our representation is differentiable in nature, making it suitable for gradient-based optimization approaches for shape search. As these symmetry constraints naturally arise in tiling classes, our method is ideal for representing tile shapes belonging to any tiling class. To demonstrate the efficacy of our method, we design two frameworks for addressing the challenging problems of Escherization and Density Estimation. The first framework is dedicated to the Escherization problem, where we parameterize tile shapes belonging to different isohedral classes. Given a target shape, the template tile is deformed using gradient-based optimization to resemble the target shape. The second framework focuses on density estimation in identification spaces. By leveraging the inherent link between tiling theory and identification topology, we design constrained diffeomorphisms for the plane that result in unconstrained diffeomorphisms on the identification spaces. Specifically, we perform density estimation on identification spaces such as torus, sphere, Klein bottle, and projective plane. Through results and experiments, we demonstrate that our method obtains impressive results for Escherization on the Euclidean plane and density estimation on non-Euclidean identification spaces.


title: On p-divisibility of Fourier coefficients of Hermitian modular forms

abstract: We describe the $p$-divisibility transposition for the Fourier coefficients of Hermitian modular forms. The results show that the same phenomenon as that for Siegel modular forms holds for Hermitian modular forms.


title: Superdiffusion of vortices in two-component quantum fluids of light

abstract: The quantum diffusion of a vortex in a two-component quantum fluid of light is investigated. In these systems, the Kerr nonlinearity promotes interactions between the photons, displaying features that are analogue of a Bose-Einstein condensates. Quantum fluids of light have the advantage of simulating matter-wave phenomena at room temperatures. While the analogy is true at the mean field level, the full quantum dynamics of an impurity in quantum fluids of light of, and therefore the ability of featuring genuine quantum noise, has never been considered. We numerically solve the problem by simulating a vortex-like impurity in the presence of noise with the Bogoliubov spectral density, and show that the vortex undergoes superdiffusion. We support our results with a theory that has been previously developed for the brownian motion of point-like particles.

categories: cond-mat.quant-gas cond-mat.other cond-mat.stat-mech quant-ph


title: Noise-based Correction for Electrical Impedance Tomography

abstract: Introduction. Noisy measurements frequently cause noisy and inaccurate images in impedance imaging. No post-processing technique exists to calculate the propagation of measurement noise and use this to suppress noise in the image. Objectives. The objectives of this work were (1) to develop a post-processing method for noise-based correction (NBC) in impedance tomography, (2) to test whether NBC improves image quality in electrical impedance tomography (EIT), (3) to determine whether it is preferable to use correlated or uncorrelated noise for NBC, (4) to test whether NBC works with in vivo data and (5) to test whether NBC is stable across model and perturbation geometries. Methods. EIT was performed in silico in a 2D homogeneous circular domain and an anatomically realistic, heterogeneous 3D human head domain for four perturbations and 25 noise levels in each case. This was validated by performing EIT for four perturbations in a circular, saline tank in 2D as well as a human head-shaped saline tank with a realistic skull-like layer in 3D. Images were assessed on the weighted spatial variance (WSV) with respect to the target image. The effect of NBC was also tested for example in vivo EIT data of lung ventilation in a human thorax and cortical activity in a rat brain. Results. On visual inspection, NBC maintained or increased image quality for all perturbations and noise levels in 2D and 3D experimentally and in silico. Analysis of the WSV showed that NBC significantly improved the WSV in nearly all cases. When the WSV was inferior with NBC, this was either visually imperceptible or a transformation between noisy images. For in vivo data, NBC improved image quality in all cases and preserved the expected shape of the reconstructed perturbation. In practice, uncorrelated NBC performed better than correlated NBC and is recommended as a general-use post-processing technique in EIT.


title: Construction of Superconducting Dome and Emergence of Quantum Critical Region in Holography

abstract: In this work, we investigate an extended model of holographic superconductor by a non-linear electrodynamic interaction coupled to a complex scalar field. This non-linear interaction term can make a quantum phase transition at zero temperature with finite charge carrier density. By solving full equations of motion, we can construct various shapes of the superconducting phase in the phase diagram. With a specific choice of interaction coefficients, we can construct a phase diagram with a superconducting dome. Also, we find a new geometric solution inside the superconducting dome, which turns out to be a Lifshitz-type geometry. This geometry is characterized by a dynamical critical exponent, which plays a crucial role near the quantum critical point. We refer to this region in the phase diagram as a `quantum critical region.'


title: On the hierarchy of classicality and symmetry of quantum states

abstract: The interrelation between classicality/quantumness and symmetry of states is discussed within the phase-space formulation of finite-dimensional quantum systems. We derive representations for classicality measures $\mathcal{Q}_N[H_{\varrho}]$ of states from the stratum of given symmetry type $[H_{\varrho}]$ for the Hilbert-Schmidt ensemble of qudits. The expressions for measures are given in terms of the permanents of matrices constructed from the vertices of the special Wigner function's positivity polytope. The supposition about the partial order of classicality indicators $\mathcal{Q}_N[H_{\varrho}]$ in accordance with the symmetry type of stratum is formulated.


title: Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models

abstract: Prompt learning has become a prevalent strategy for adapting vision-language foundation models to downstream tasks. As large language models (LLMs) have emerged, recent studies have explored the use of category-related descriptions as input to enhance prompt effectiveness. Nevertheless, conventional descriptions fall short of structured information that effectively represents the interconnections among entities or attributes linked to a particular category. To address this limitation and prioritize harnessing structured knowledge, this paper advocates for leveraging LLMs to build a graph for each description to model the entities and attributes describing the category, as well as their correlations. Preexisting prompt tuning methods exhibit inadequacies in managing this structured knowledge. Consequently, we propose a novel approach called Hierarchical Prompt Tuning (HPT), which enables simultaneous modeling of both structured and conventional linguistic knowledge. Specifically, we introduce a relationship-guided attention module to capture pair-wise associations among entities and attributes for low-level prompt learning. In addition, by incorporating high-level and global-level prompts modeling overall semantics, the proposed hierarchical structure forges cross-level interlinks and empowers the model to handle more complex and long-term relationships. Extensive experiments demonstrate that our HPT shows strong effectiveness and generalizes much better than existing SOTA methods. Our code is available at https://github.com/Vill-Lab/2024-AAAI-HPT.


title: Thermodynamic Topology of $D=4,5$ Horava Lifshitz Black Hole in Two Ensembles

abstract: We study the thermodynamic topology of four and five dimensional Horava Lifshitz (HL) black holes in Horava gravity. These exotic black hole solutions belong to a special class of of black holes whose thermodynamics exhibit a line of (continuous) second order phase transitions known as $\lambda$ phase transitions akin to those observed in the superfluidity of liquid $^{4}He$. To analyze their thermodynamic topology, we treat the Horava Lifshitz (HL) black holes as topological defects in their thermodynamic spaces and compute the winding numbers at those defects. We work in two different ensembles: fixed $\epsilon$ ensemble and fixed $\zeta$ ensemble, where $\epsilon$ is a parameter of the HL black holes and $\zeta$ is its conjugate parameter. In the fixed $\epsilon$ ensemble, three different horizon types are considered : the spherical horizon for $k=+1$, the flat horizon for $k=0$, and the hyperbolic horizon for $k=-1$. In the fixed $\zeta$ ensemble, two different horizon types are considered : the spherical horizon for $k=+1$, and the hyperbolic horizon for $k=-1$.


title: Representations of Toroidal and Full toroidal Lie algebras over polynomial algebras

abstract: Toroidal Lie algebras are $n$ variable generalizations of affine Kac-Moody Lie algebras. Full toroidal Lie algebra is the semidirect product of derived Lie algebra of toroidal Lie algebra and Witt algebra, also it can be thought of $n$-variable generalization of Affine-Virasoro algebras. Let $\tilde{\mathfrak{h}}$ be a Cartan subalgebra of a toroidal Lie algebra as well as full toroidal Lie algebra without containing the zero-degree central elements. In this paper, we classify the module structure on $U(\tilde{\mathfrak{h}})$ for all toroidal Lie algebras as well as full toroidal Lie algebras which are free $U(\tilde{\mathfrak{h}})$-modules of rank 1. These modules exist only for type $A_l (l\geq 1)$, $C_l (l\geq2)$ toroidal Lie algebras and the same is true for full toroidal Lie algebras. Also, we determined the irreducibility condition for these classes of modules for both the Lie algebras.


title: Examples of topologically unknotted tori

abstract: We show that certain smooth tori with group $\mathbb{Z}$ in $S^4$ have exteriors with standard equivariant intersection forms, and so are topologically unknotted. These include the turned 1-twist-spun tori in the 4-sphere constructed by Boyle, the union of the genus one Seifert surface of Cochran and Davis that has no slice derivative with a ribbon disc, and tori with precisely four critical points whose middle level set is a 2-component link with vanishing Alexander polynomial. This gives evidence towards the conjecture that all $\mathbb{Z}$-surfaces in $S^4$ are topologically unknotted, which is open for genus one and two. It is unclear whether these tori are smoothly unknotted, except for tori with four critical points whose middle level set is a split link. The double cover of $S^4$ branched along any of these surfaces is a potentially exotic copy of $S^2 \times S^2$, and, in the case of turned twisted tori, we show they cannot be distinguished from $S^2 \times S^2$ using Seiberg-Witten invariants.


title: Fast nuclear-spin entangling gates compatible with large-scale atomic arrays

abstract: Nuclear-spin entangling gates with divalent atoms can be executed by one global laser pulse when $\Delta_{\text{Z}}<\Omega$, where $\Delta_{\text{Z}}$ is the Zeeman-splitting-dominated frequency difference for the clock-Rydberg transitions of the two nuclear-spin qubit states and $\Omega$ is the maximal Rabi frequency. Concerning the sensitivity of Rydberg-state energy to magnetic fluctuation, the gate is compatible with large-scale atomic arrays for weaker magnetic field is suitable for ensuring uniform field in a large qubit array. The gate can have a high fidelity because the relaxation and dephasing of Rydberg states, which limit the fidelity and grow with $1/\Omega$, can be mitigated with easily attainable large $\Omega$.

categories: quant-ph physics.app-ph physics.atom-ph physics.optics


title: TPRNN: A Top-Down Pyramidal Recurrent Neural Network for Time Series Forecasting

abstract: Time series refer to a series of data points indexed in time order, which can be found in various fields, e.g., transportation, healthcare, and finance. Accurate time series forecasting can enhance optimization planning and decision-making support. Time series have multi-scale characteristics, i.e., different temporal patterns at different scales, which presents a challenge for time series forecasting. In this paper, we propose TPRNN, a Top-down Pyramidal Recurrent Neural Network for time series forecasting. We first construct subsequences of different scales from the input, forming a pyramid structure. Then by executing a multi-scale information interaction module from top to bottom, we model both the temporal dependencies of each scale and the influences of subsequences of different scales, resulting in a complete modeling of multi-scale temporal patterns in time series. Experiments on seven real-world datasets demonstrate that TPRNN has achieved the state-of-the-art performance with an average improvement of 8.13% in MSE compared to the best baseline.


title: The future muon collider for the research of the anomalous neutral quartic $Z\gamma\gamma\gamma$, $ZZ\gamma\gamma$, and $ZZZ\gamma$ couplings

abstract: In the post-LHC era, the muon collider represents a frontier project capable of providing high-energy and high-luminosity leptonic collisions among future lepton-lepton particle accelerators. In addition, it provides significantly cleaner final states than those produced in hadron collisions. With this expectation in mind, in this article, we research the sensitivity of the anomalous neutral gauge boson couplings $Z\gamma\gamma\gamma$, $ZZ\gamma \gamma$, and $ZZZ\gamma$ defined by dimension-8 operators, through the $\mu^+\mu^- \to \mu^+\mu^-Z\gamma$ signal, with the $Z$-boson decaying to neutrino pair. The projections of new physics at the future muon collider with the center-of-mass energy of $\sqrt{s}=10$ TeV, integrated luminosity of ${\cal L}=10$ $\rm ab^{-1}$, and systematic uncertainties of $\delta_{sys}=0\%, 3\%, 5\%$, for extraction of expected sensitivity on the anomalous $f_ {T,j}/\Lambda^4$ couplings at $95\%$ confidence level, are of the order of ${\cal O}(10^{-4}- 10^{-3})$. Compared with the research of the ATLAS and CMS Collaborations on the anomalous quartic gauge couplings, we find that the high-luminosity future muon collider could have better sensitivity.


title: Navigating Open Set Scenarios for Skeleton-based Action Recognition

abstract: In real-world scenarios, human actions often fall outside the distribution of training data, making it crucial for models to recognize known actions and reject unknown ones. However, using pure skeleton data in such open-set conditions poses challenges due to the lack of visual background cues and the distinct sparse structure of body pose sequences. In this paper, we tackle the unexplored Open-Set Skeleton-based Action Recognition (OS-SAR) task and formalize the benchmark on three skeleton-based datasets. We assess the performance of seven established open-set approaches on our task and identify their limits and critical generalization issues when dealing with skeleton information. To address these challenges, we propose a distance-based cross-modality ensemble method that leverages the cross-modal alignment of skeleton joints, bones, and velocities to achieve superior open-set recognition performance. We refer to the key idea as CrossMax - an approach that utilizes a novel cross-modality mean max discrepancy suppression mechanism to align latent spaces during training and a cross-modality distance-based logits refinement method during testing. CrossMax outperforms existing approaches and consistently yields state-of-the-art results across all datasets and backbones. The benchmark, code, and models will be released at https://github.com/KPeng9510/OS-SAR.


title: Semantic Connectivity-Driven Pseudo-labeling for Cross-domain Segmentation

abstract: Presently, self-training stands as a prevailing approach in cross-domain semantic segmentation, enhancing model efficacy by training with pixels assigned with reliable pseudo-labels. However, we find two critical limitations in this paradigm. (1) The majority of reliable pixels exhibit a speckle-shaped pattern and are primarily located in the central semantic region. This presents challenges for the model in accurately learning semantics. (2) Category noise in speckle pixels is difficult to locate and correct, leading to error accumulation in self-training. To address these limitations, we propose a novel approach called Semantic Connectivity-driven pseudo-labeling (SeCo). This approach formulates pseudo-labels at the connectivity level and thus can facilitate learning structured and low-noise semantics. Specifically, SeCo comprises two key components: Pixel Semantic Aggregation (PSA) and Semantic Connectivity Correction (SCC). Initially, PSA divides semantics into 'stuff' and 'things' categories and aggregates speckled pseudo-labels into semantic connectivity through efficient interaction with the Segment Anything Model (SAM). This enables us not only to obtain accurate boundaries but also simplifies noise localization. Subsequently, SCC introduces a simple connectivity classification task, which enables locating and correcting connectivity noise with the guidance of loss distribution. Extensive experiments demonstrate that SeCo can be flexibly applied to various cross-domain semantic segmentation tasks, including traditional unsupervised, source-free, and black-box domain adaptation, significantly improving the performance of existing state-of-the-art methods. The code is available at https://github.com/DZhaoXd/SeCo.


title: Coherence-preserving cooling of nuclear spin qubits in a weak magnetic field

abstract: Nuclear spin memories of divalent neutral atoms can allow spin-preserving resolved-sideband cooling in a strong magnetic field [Phys. Rev. Lett. 99, 123001 (2007)]. We present a theory for cooling $^{87}$Sr nuclear-spin qubits in a weak magnetic field. The theory depends on laser excitation of $5s5p~^1P_1$ to a nearby state which results in $m_J$-dependent AC Stark shifts large compared to the hyperfine interaction. This effectively suppresses the nuclear-spin mixing due to the hyperfine interaction. Sideband cooling via the clock state quenched by the AC Stark-shifted $^1P_1$ state leads to nuclear-spin-preserving spontaneous emission back to the ground state. More than being compatible with low magnetic fields, the theory is applicable when the nuclear spin qubits are defined by the two lowest Zeeman substates.


title: Refinements of Strichartz estimates on tori and applications

abstract: We show trilinear Strichartz estimates in one and two dimensions on frequency-dependent time intervals. These improve on the corresponding linear estimates of periodic solutions to the Schr\"odinger equation. The proof combines decoupling iterations with bilinear short-time Strichartz estimates. Secondly, we use decoupling to show new linear Strichartz estimates on frequency dependent time intervals. We apply these in case of the Airy propagator to obtain the sharp Sobolev regularity for the existence of solutions to the modified Korteweg-de Vries equation.


title: Model validation for aggregate inferences in out-of-sample prediction

abstract: Generalization to new samples is a fundamental rationale for statistical modeling. For this purpose, model validation is particularly important, but recent work in survey inference has suggested that simple aggregation of individual prediction scores does not give a good measure of the score for population aggregate estimates. In this manuscript we explain why this occurs, propose two scoring metrics designed specifically for this problem, and demonstrate their use in three different ways. We show that these scoring metrics correctly order models when compared to the true score, although they do underestimate the magnitude of the score. We demonstrate with a problem in survey research, where multilevel regression and poststratification (MRP) has been used extensively to adjust convenience and low-response surveys to make population and subpopulation estimates.


title: Dropout is all you need: robust two-qubit gate with reinforcement learning

abstract: In the realm of quantum control, reinforcement learning, a prominent branch of machine learning, emerges as a competitive candidate for computer-assisted optimal design for experiments. This study investigates the extent to which guidance from human experts is necessary for the effective implementation of reinforcement learning in designing quantum control protocols. Specifically, we focus on the engineering of a robust two-qubit gate within a nuclear magnetic resonance system, utilizing a combination of analytical solutions as prior knowledge and techniques from the field of computer science. Through extensive benchmarking of different models, we identify dropout, a widely-used method for mitigating overfitting in machine learning, as an especially robust approach. Our findings demonstrate the potential of incorporating computer science concepts to propel the development of advanced quantum technologies.


title: Vehicle Lane Change Prediction based on Knowledge Graph Embeddings and Bayesian Inference

abstract: Prediction of vehicle lane change maneuvers has gained a lot of momentum in the last few years. Some recent works focus on predicting a vehicle's intention by predicting its trajectory first. This is not enough, as it ignores the context of the scene and the state of the surrounding vehicles (as they might be risky to the target vehicle). Other works assessed the risk made by the surrounding vehicles only by considering their existence around the target vehicle, or by considering the distance and relative velocities between them and the target vehicle as two separate numerical features. In this work, we propose a solution that leverages Knowledge Graphs (KGs) to anticipate lane changes based on linguistic contextual information in a way that goes well beyond the capabilities of current perception systems. Our solution takes the Time To Collision (TTC) with surrounding vehicles as input to assess the risk on the target vehicle. Moreover, our KG is trained on the HighD dataset using the TransE model to obtain the Knowledge Graph Embeddings (KGE). Then, we apply Bayesian inference on top of the KG using the embeddings learned during training. Finally, the model can predict lane changes two seconds ahead with 97.95% f1-score, which surpassed the state of the art, and three seconds before changing lanes with 93.60% f1-score.


title: Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations

abstract: The main task of Multimodal Emotion Recognition in Conversations (MERC) is to identify the emotions in modalities, e.g., text, audio, image and video, which is a significant development direction for realizing machine intelligence. However, many data in MERC naturally exhibit an imbalanced distribution of emotion categories, and researchers ignore the negative impact of imbalanced data on emotion recognition. To tackle this problem, we systematically analyze it from three aspects: data augmentation, loss sensitivity, and sampling strategy, and propose the Class Boundary Enhanced Representation Learning (CBERL) model. Concretely, we first design a multimodal generative adversarial network to address the imbalanced distribution of {emotion} categories in raw data. Secondly, a deep joint variational autoencoder is proposed to fuse complementary semantic information across modalities and obtain discriminative feature representations. Finally, we implement a multi-task graph neural network with mask reconstruction and classification optimization to solve the problem of overfitting and underfitting in class boundary learning, and achieve cross-modal emotion recognition. We have conducted extensive experiments on the IEMOCAP and MELD benchmark datasets, and the results show that CBERL has achieved a certain performance improvement in the effectiveness of emotion recognition. Especially on the minority class fear and disgust emotion labels, our model improves the accuracy and F1 value by 10% to 20%.


title: BoschAI @ Causal News Corpus 2023: Robust Cause-Effect Span Extraction using Multi-Layer Sequence Tagging and Data Augmentation

abstract: Understanding causality is a core aspect of intelligence. The Event Causality Identification with Causal News Corpus Shared Task addresses two aspects of this challenge: Subtask 1 aims at detecting causal relationships in texts, and Subtask 2 requires identifying signal words and the spans that refer to the cause or effect, respectively. Our system, which is based on pre-trained transformers, stacked sequence tagging, and synthetic data augmentation, ranks third in Subtask 1 and wins Subtask 2 with an F1 score of 72.8, corresponding to a margin of 13 pp. to the second-best system.


title: Inelastic Light Scattering in the Vicinity of a Single-Atom Quantum Point Contact in a Plasmonic Picocavity

abstract: Here, using low-temperature optical scanning tunneling microscopy (STM), we investigate inelastic light scattering (ILS) in the vicinity of a single-atom quantum point contact (QPC). A vibration mode localized at the single Ag adatom on the Ag(111) surface is resolved in the ILS spectrum, resulting from tip-enhanced Raman scattering (TERS) by the atomically-confined plasmonic field in the STM junction. Furthermore, we trace how TERS from the single adatom evolves as a function of the gap distance. The exceptional stability of the low-temperature STM allows to examine distinctly different electron transport regimes of the picocavity, namely in the tunneling and quantum point contact (QPC) regimes. This measurement shows that the vibration mode localized at the adatom and its TERS intensity exhibits a sharp change upon the QPC formation, indicating that the atomic-level structure has a crucial impact on the plasmonic properties. To gain microscopic insights into picocavity optomechanics, we scrutinize the structure and plasmonic field in the STM junction using time-dependent density functional theory. The simulations reveal that atomic-scale structural relaxation at the single-atom QPC results in a discrete change of the plasmonic field strength, volume, and distribution as well as the vibration mode localized at the single atom. These findings give a qualitative explanation for the experimental observations. Furthermore, we demonstrate that strong ILS is a characteristic feature of QPC by continuously forming, breaking, and reforming the atomic contact, and how the plasmonic resonance evolves throughout the non-tunneling, tunneling, and QPC regimes.


title: Adaptive Shape-Servoing for Vision-based Robotic Manipulation with Model Estimation and Performance Regulation

abstract: This paper introduces a manipulation framework for the elastic rod, including shape representation, sensorimotor-model estimation, and shape controller. Until now, the manipulation of the elastic rod has faced several challenges: 1) shape learning from high-dimensional to low-space dimensional; 2) the modeling of robot manipulation of the elastic rod; 3) the determination of the shape controller. A novel manipulation framework for the elastic rod is presented in this paper, which only uses the input and output data of the system without any prior knowledge of the robot, camera, and object. The proposed approach runs in a model-free manner. For the approximation of the sensorimotor model, adaptive Kalman filtering (AKF) is used as the online estimation. Model-free adaptive control (MFAC) is designed according to the obtained differential model of robot-object configuration and then is combined with the performance regulation requirement to give the final format of the shape controller. Hence, the proposed approach can enhance the autonomous capability of deformation object manipulation. Detailed simulation results are conducted with a single robot manipulation to evaluate the effectiveness of the proposed manipulation framework.


title: Fractional tempered variational calculus

abstract: In this paper, we derive sufficient conditions ensuring the existence of a weak solution $u$ for a tempered fractional Euler-Lagrange equations $$ \frac{\partial L}{\partial x}(u,{^C}\mathbb{D}_{a^+}^{\alpha, \sigma} u, t) + \mathbb{D}_{b^-}^{\alpha, \sigma}\left(\frac{\partial L}{\partial y}(u, {^C}\mathbb{D}_{a^+}^{\alpha, \sigma}u, t) \right) = 0 $$ on a real interval $[a,b]$ and ${^C}\mathbb{D}_{a^+}^{\alpha, \sigma}, \mathbb{D}_{b^-}^{\alpha, \sigma}$ are the left and right Caputo and Riemann-Liouville tempered fractional derivatives respectively of order $\alpha$. Furthermore, we study a fractional tempered version of Noether theorem and we provide a very explicit expression of a constant of motion in terms of symmetry group and Lagrangian for fractional problems of calculus of variations. Finally we study a mountain pass type solution of the cited problem.


title: Detecting Contextual Network Anomalies with Graph Neural Networks

abstract: Detecting anomalies on network traffic is a complex task due to the massive amount of traffic flows in today's networks, as well as the highly-dynamic nature of traffic over time. In this paper, we propose the use of Graph Neural Networks (GNN) for network traffic anomaly detection. We formulate the problem as contextual anomaly detection on network traffic measurements, and propose a custom GNN-based solution that detects traffic anomalies on origin-destination flows. In our evaluation, we use real-world data from Abilene (6 months), and make a comparison with other widely used methods for the same task (PCA, EWMA, RNN). The results show that the anomalies detected by our solution are quite complementary to those captured by the baselines (with a max. of 36.33% overlapping anomalies for PCA). Moreover, we manually inspect the anomalies detected by our method, and find that a large portion of them can be visually validated by a network expert (64% with high confidence, 18% with mid confidence, 18% normal traffic). Lastly, we analyze the characteristics of the anomalies through two paradigmatic cases that are quite representative of the bulk of anomalies.


title: RankMatch: A Novel Approach to Semi-Supervised Label Distribution Learning Leveraging Inter-label Correlations

abstract: This paper introduces RankMatch, an innovative approach for Semi-Supervised Label Distribution Learning (SSLDL). Addressing the challenge of limited labeled data, RankMatch effectively utilizes a small number of labeled examples in conjunction with a larger quantity of unlabeled data, reducing the need for extensive manual labeling in Deep Neural Network (DNN) applications. Specifically, RankMatch introduces an ensemble learning-inspired averaging strategy that creates a pseudo-label distribution from multiple weakly augmented images. This not only stabilizes predictions but also enhances the model's robustness. Beyond this, RankMatch integrates a pairwise relevance ranking (PRR) loss, capturing the complex inter-label correlations and ensuring that the predicted label distributions align with the ground truth. We establish a theoretical generalization bound for RankMatch, and through extensive experiments, demonstrate its superiority in performance against existing SSLDL methods.


title: Learning Robust Policies for Uncertain Parametric Markov Decision Processes

abstract: Synthesising verifiably correct controllers for dynamical systems is crucial for safety-critical problems. To achieve this, it is important to account for uncertainty in a robust manner, while at the same time it is often of interest to avoid being overly conservative with the view of achieving a better cost. We propose a method for verifiably safe policy synthesis for a class of finite state models, under the presence of structural uncertainty. In particular, we consider uncertain parametric Markov decision processes (upMDPs), a special class of Markov decision processes, with parameterised transition functions, where such parameters are drawn from a (potentially) unknown distribution. Our framework leverages recent advancements in the so-called scenario approach theory, where we represent the uncertainty by means of scenarios, and provide guarantees on synthesised policies satisfying probabilistic computation tree logic (PCTL) formulae. We consider several common benchmarks/problems and compare our work to recent developments for verifying upMDPs.


title: The Hubble Deep Hydrogen Alpha (HDH$\alpha$) Project: I. Catalog of Emission-line Galaxies

abstract: We present the first results of the Hubble Deep Hydrogen Alpha (HDH$\alpha$) project, which analyzes the space-borne deep H$\alpha$ narrowband imaging data in the GOODS-S region. The HDH$\alpha$ data comprises 72 orbits' images taken with the HST ACS/WFC F658N filter. The exposure time varies across a total area of $\sim$76.1 $\rm{arcmin}^2$, adding up to a total exposure time of 195.7 ks, among which 68.8 ks are spent in the deepest region. These images are aligned, reprojected, and combined to have the same pixel grid as the Hubble Legacy Fields (HLF). The scientific goals of the HDH$\alpha$ include establishing a sample of emission-line galaxies (ELGs) including [O III] emitters at $z\sim$ 0.3, [O II] emitters at $z\sim$ 0.8, and Lyman-$\alpha$ emitters (LAEs) at $z \sim 4.4$, studying the line morphology of ELGs with high resolution imaging data, and statistically analyzing the line luminosity functions and line equivalent-width distributions of ELGs selected with HST. Furthermore, the HDH$\alpha$ project enhances the legacy value of the GOODS-S field by contributing the first HST-based narrowband image to the existing data sets, which includes the HST broadband data and other ancillary data from X-ray to radio taken by other facilities. In this paper, we describe the data reduction process of the HDH$\alpha$, select ELGs based on HST's F658N and broadband data, validate the redshifts of the selected candidates by cross matching with the public spectroscopic catalogs in the GOODS-S, and present a final catalog of the confirmed [O III] emitters at $z\sim$ 0.3, [O II] emitters at $z\sim$ 0.8, and LAEs at $z \sim 4.4$.


title: Stability Analysis of LQR-ANFIS Control Schemes on 2-degree-of-freedom Inverted Pendulum Systems

abstract: The concepts of stability and balance represent many critical problems faced by engineering today. The inverted pendulum on a cart is one such non-linear, unstable, multivariate system whose goal is to determine a suitable control action given to the cart such that it stabilizes the pendulum in an upright vertical position. This paper therefore, aims to design and study a highly robust MISO control structure using Linear Quadratic Regulation, Fuzzy logic and Neural Networks called Two-Stage LQR-based-ANFIS (referred to as TS-LA) for the stabilization of Inverted Pendulums. The proposed controller is implemented on a Simulink model of the Inverted Pendulum constructed through relevant mathematical and state space modelling using Newtonian and Lagrangian mechanics. Applying external disturbances, transient parameters are obtained and are benchmarked against standard conventional controllers to perform comparative analysis and showcase its disturbance rejection capabilities.


title: Weyl calculus perspective on the discrete Stokes' formula in octonions

abstract: Octonions are 8-dimensional hypercomplex numbers which form the biggest normed division algebras over the real numbers. Motivated by applications in theoretical physics, continuous octonionic analysis has become an area of active research in recent year. Looking at possible practical applications, it is beneficial to work directly with discrete structures, rather than approximate continuous objects. Therefore, in previous papers, we have proposed some ideas towards the discrete octonionic analysis. It is well known, that there are several possibilities to discretise the continuous setting, and the Weyl calculus approach, which is typically used in the discrete Clifford analysis, to octonions has not been studied yet. Therefore, in this paper, we close this gap by presenting the discretisation of octonionic analysis based on the Weyl calculus.


title: DiffAIL: Diffusion Adversarial Imitation Learning

abstract: Imitation learning aims to solve the problem of defining reward functions in real-world decision-making tasks. The current popular approach is the Adversarial Imitation Learning (AIL) framework, which matches expert state-action occupancy measures to obtain a surrogate reward for forward reinforcement learning. However, the traditional discriminator is a simple binary classifier and doesn't learn an accurate distribution, which may result in failing to identify expert-level state-action pairs induced by the policy interacting with the environment. To address this issue, we propose a method named diffusion adversarial imitation learning (DiffAIL), which introduces the diffusion model into the AIL framework. Specifically, DiffAIL models the state-action pairs as unconditional diffusion models and uses diffusion loss as part of the discriminator's learning objective, which enables the discriminator to capture better expert demonstrations and improve generalization. Experimentally, the results show that our method achieves state-of-the-art performance and significantly surpasses expert demonstration on two benchmark tasks, including the standard state-action setting and state-only settings. Our code can be available at the link https://github.com/ML-Group-SDU/DiffAIL.


title: DoA-Aided MMSE Channel Estimation for Wireless Communication Systems

abstract: This paper investigates the combination of parametric channel estimation with minimum mean square error (MMSE) estimation. We propose a direction-of-arrival (DoA)-aided two-stage channel estimation technique that utilizes the decomposition of wireless communication channels into a line-of-sight (LoS) path and its orthogonal subspace. After estimating the channel along the dominant direction, we utilize a Gaussian mixture model to estimate the conditionally Gaussian distributed random vector, which represents the multipath propagation. The proposed two-stage estimator allows pre-computing the respective estimation filters, tremendously reducing the computational complexity. Numerical simulations with typical channel models depict the superior performance of our proposed two-stage estimation approach compared to state-of-the-art methods.


title: How do particles with complex interactions self-assemble?

abstract: In living cells, proteins self-assemble into large functional structures based on specific interactions between molecularly complex patches. Due to this complexity, protein self-assembly results from a competition between a large number of distinct interaction energies, of the order of one per pair of patches. Current self-assembly models however typically ignore this aspect, and the principles by which it determines the large-scale structure of protein assemblies are largely unknown. Here, we use Monte-Carlo simulations and machine learning to start to unravel these principles. We observe that despite widespread geometrical frustration, aggregates of particles with complex interactions fall within only a few categories that often display high degrees of spatial order, including crystals, fibers, and micelles. We then successfully identify the most relevant aspect of the interaction complexity in predicting these outcomes, namely the particles' ability to form periodic structures. Our results provide a first characterization of the rich design space associated with identical particles with complex interactions, and could inspire engineered self-assembling nanoobjects as well as help understand the emergence of robust functional protein structures.


title: Evaluation of Large Language Models for Decision Making in Autonomous Driving

abstract: Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their coordinate and velocity information, and then outputting the subsequent movements of the vehicle. When using LLMs for such purposes, capabilities such as spatial recognition and planning are essential. In particular, two foundational capabilities are required: (1) spatial-aware decision making, which is the ability to recognize space from coordinate information and make decisions to avoid collisions, and (2) the ability to adhere to traffic rules. However, quantitative research has not been conducted on how accurately different types of LLMs can handle these problems. In this study, we quantitatively evaluated these two abilities of LLMs in the context of autonomous driving. Furthermore, to conduct a Proof of Concept (POC) for the feasibility of implementing these abilities in actual vehicles, we developed a system that uses LLMs to drive a vehicle.


title: NuScenes-MQA: Integrated Evaluation of Captions and QA for Autonomous Driving Datasets using Markup Annotations

abstract: Visual Question Answering (VQA) is one of the most important tasks in autonomous driving, which requires accurate recognition and complex situation evaluations. However, datasets annotated in a QA format, which guarantees precise language generation and scene recognition from driving scenes, have not been established yet. In this work, we introduce Markup-QA, a novel dataset annotation technique in which QAs are enclosed within markups. This approach facilitates the simultaneous evaluation of a model's capabilities in sentence generation and VQA. Moreover, using this annotation methodology, we designed the NuScenes-MQA dataset. This dataset empowers the development of vision language models, especially for autonomous driving tasks, by focusing on both descriptive capabilities and precise QA. The dataset is available at https://github.com/turingmotors/NuScenes-MQA.


title: Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes

abstract: Pre-trained large language models (LLMs) need fine-tuning to improve their responsiveness to natural language instructions. Federated learning offers a way to fine-tune LLMs using the abundant data on end devices without compromising data privacy. Most existing federated fine-tuning methods for LLMs rely on parameter-efficient fine-tuning techniques, which may not reach the performance height possible with full-parameter tuning. However, federated full-parameter tuning of LLMs is a non-trivial problem due to the immense communication cost. This work introduces FedKSeed that employs zeroth-order optimization with a finite set of random seeds. It significantly reduces transmission requirements between the server and clients to just a few random seeds and scalar gradients, amounting to only a few thousand bytes, making federated full-parameter tuning of billion-sized LLMs possible on devices. Building on it, we develop a strategy enabling probability-differentiated seed sampling, prioritizing perturbations with greater impact on model accuracy. Experiments across six scenarios with various LLMs, datasets and data partitions demonstrate that our approach outperforms existing federated LLM fine-tuning methods in both communication efficiency and new task generalization.


title: PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization

abstract: Recent advancements in personalized image generation using diffusion models have been noteworthy. However, existing methods suffer from inefficiencies due to the requirement for subject-specific fine-tuning. This computationally intensive process hinders efficient deployment, limiting practical usability. Moreover, these methods often grapple with identity distortion and limited expression diversity. In light of these challenges, we propose PortraitBooth, an innovative approach designed for high efficiency, robust identity preservation, and expression-editable text-to-image generation, without the need for fine-tuning. PortraitBooth leverages subject embeddings from a face recognition model for personalized image generation without fine-tuning. It eliminates computational overhead and mitigates identity distortion. The introduced dynamic identity preservation strategy further ensures close resemblance to the original image identity. Moreover, PortraitBooth incorporates emotion-aware cross-attention control for diverse facial expressions in generated images, supporting text-driven expression editing. Its scalability enables efficient and high-quality image creation, including multi-subject generation. Extensive results demonstrate superior performance over other state-of-the-art methods in both single and multiple image generation scenarios.


title: Linguistic and Structural Basis of Engineering Design Knowledge

abstract: Artefact descriptions are the primary carriers of engineering design knowledge that is both an outcome and a driver of the design process. While an artefact could be described in different connotations, the design process requires a description to embody engineering design knowledge, which is expressed in the text through intricate placement of entities and relationships. As large-language models learn from all kinds of text merely as a sequence of characters/tokens, these are yet to generate text that embodies explicit engineering design facts. Existing ontological design theories are less likely to guide the large-language models whose applications are currently limited to ideation and learning purposes. In this article, we explicate engineering design knowledge as knowledge graphs from a large sample of 33,881 patent documents. We examine the constituents of these knowledge graphs to understand the linguistic and structural basis of engineering design knowledge. In terms of linguistic basis, we observe that entities and relationships could be generalised to 64 and 24 linguistic syntaxes. While relationships mainly capture attributes ('of'), structure ('in', 'with'), purpose ('to', 'for'), hierarchy ('include'), exemplification ('such as'), and behaviour ('to', 'from'), the hierarchical relationships could specifically be identified using 75 unique syntaxes. To understand the structural basis, we draw inspiration from various studies on biological/ecological networks and discover motifs from patent knowledge graphs. We identify four 3-node and four 4-node patterns that could further be converged and simplified into sequence [->...->], aggregation [->...<-], and hierarchy [<-...->]. Expected to guide large-language model based design tools, we propose few regulatory precepts for concretising abstract entities and relationships within subgraphs, while explicating hierarchical structures.


title: Explicit description of a basis for derivations of a Coxeter multiarrangement of type $B_2$

abstract: In this article, we consider the multiarrangements whose underlying arrangements are the Coxeter arrangement of type $B_2$. For some special multiplicities, we give an explicit description of bases for the derivation modules. As an application, we also describe the lower derivations of bases for the derivation modules of some Coxeter multiarrangements of type $A_2$, which are different from ones given by Wakamiko.


title: FOSS: A Self-Learned Doctor for Query Optimizer

abstract: Various works have utilized deep reinforcement learning (DRL) to address the query optimization problem in database system. They either learn to construct plans from scratch in a bottom-up manner or guide the plan generation behavior of traditional optimizer using hints. While these methods have achieved some success, they face challenges in either low training efficiency or limited plan search space. To address these challenges, we introduce FOSS, a novel DRL-based framework for query optimization. FOSS initiates optimization from the original plan generated by a traditional optimizer and incrementally refines suboptimal nodes of the plan through a sequence of actions. Additionally, we devise an asymmetric advantage model to evaluate the advantage between two plans. We integrate it with a traditional optimizer to form a simulated environment. Leveraging this simulated environment, FOSS can bootstrap itself to rapidly generate a large amount of high-quality simulated experiences. FOSS then learns and improves its optimization capability from these simulated experiences. We evaluate the performance of FOSS on Join Order Benchmark, TPC-DS, and Stack Overflow. The experimental results demonstrate that FOSS outperforms the state-of-the-art methods in terms of latency performance and optimization time. Compared to PostgreSQL, FOSS achieves savings ranging from 15% to 83% in total latency across different benchmarks.


title: Intraoperative 2D/3D Image Registration via Differentiable X-ray Rendering

abstract: Surgical decisions are informed by aligning rapid portable 2D intraoperative images (e.g., X-rays) to a high-fidelity 3D preoperative reference scan (e.g., CT). 2D/3D image registration often fails in practice: conventional optimization methods are prohibitively slow and susceptible to local minima, while neural networks trained on small datasets fail on new patients or require impractical landmark supervision. We present DiffPose, a self-supervised approach that leverages patient-specific simulation and differentiable physics-based rendering to achieve accurate 2D/3D registration without relying on manually labeled data. Preoperatively, a CNN is trained to regress the pose of a randomly oriented synthetic X-ray rendered from the preoperative CT. The CNN then initializes rapid intraoperative test-time optimization that uses the differentiable X-ray renderer to refine the solution. Our work further proposes several geometrically principled methods for sampling camera poses from $\mathbf{SE}(3)$, for sparse differentiable rendering, and for driving registration in the tangent space $\mathfrak{se}(3)$ with geodesic and multiscale locality-sensitive losses. DiffPose achieves sub-millimeter accuracy across surgical datasets at intraoperative speeds, improving upon existing unsupervised methods by an order of magnitude and even outperforming supervised baselines. Our code is available at https://github.com/eigenvivek/DiffPose.