title: BrainMass: Advancing Brain Network Analysis for Diagnosis with Large-scale Self-Supervised Learning

abstract: Foundation models pretrained on large-scale datasets via self-supervised learning demonstrate exceptional versatility across various tasks. Due to the heterogeneity and hard-to-collect medical data, this approach is especially beneficial for medical image analysis and neuroscience research, as it streamlines broad downstream tasks without the need for numerous costly annotations. However, there has been limited investigation into brain network foundation models, limiting their adaptability and generalizability for broad neuroscience studies. In this study, we aim to bridge this gap. In particular, (1) we curated a comprehensive dataset by collating images from 30 datasets, which comprises 70,781 samples of 46,686 participants. Moreover, we introduce pseudo-functional connectivity (pFC) to further generates millions of augmented brain networks by randomly dropping certain timepoints of the BOLD signal. (2) We propose the BrainMass framework for brain network self-supervised learning via mask modeling and feature alignment. BrainMass employs Mask-ROI Modeling (MRM) to bolster intra-network dependencies and regional specificity. Furthermore, Latent Representation Alignment (LRA) module is utilized to regularize augmented brain networks of the same participant with similar topological properties to yield similar latent representations by aligning their latent embeddings. Extensive experiments on eight internal tasks and seven external brain disorder diagnosis tasks show BrainMass's superior performance, highlighting its significant generalizability and adaptability. Nonetheless, BrainMass demonstrates powerful few/zero-shot learning abilities and exhibits meaningful interpretation to various diseases, showcasing its potential use for clinical applications.


title: Microcavity induced by few-layer GaSe crystal on silicon photonic crystal waveguide for efficient optical frequency conversion

abstract: We demonstrate the post-induction of high-quality microcavity on silicon photonic crystal (PC) waveguide by integrating few-layer GaSe crystal, which promises highly efficient on-chip optical frequency conversions. The integration of GaSe shifts the dispersion bands of the PC waveguide mode into the bandgap, resulting in localized modes confined by the bare PC waveguides. Thanks to the small contrast of refractive index at the boundaries of microcavity, it is reliably to obtain quality (Q) factors exceeding 10^4. With the enhanced light-GaSe interaction by the microcavity modes and high second-order nonlinearity of GaSe, remarkable second-harmonic generation (SHG) and sum-frequency generation (SFG) are achieved. A record-high on-chip SHG conversion efficiency of 131100% W^-1 is obtained, enabling the clear SHG imaging of the resonant modes with the pump of sub-milliwatts continuous-wave (CW) laser. Driven by a pump of on-resonance CW laser, strong SFGs are successfully carried out with the other pump of a CW laser spanning over the broad telecom-band. Broadband frequency conversion of an incoherent superluminescent light-emitting diode with low spectral power density is also realized in the integrated GaSe-PC waveguide. Our results are expected to provide new strategies for high-efficiency light-matter interactions, nonlinear photonics and light source generation in silicon photonic integrated circuits.


title: Distributed Least-Squares Optimization Solvers with Differential Privacy

abstract: This paper studies the distributed least-squares optimization problem with differential privacy requirement of local cost functions, for which two differentially private distributed solvers are proposed. The first is established on the distributed gradient tracking algorithm, by appropriately perturbing the initial values and parameters that contain the privacy-sensitive data with Gaussian and truncated Laplacian noises, respectively. Rigorous proofs are established to show the achievable trade-off between the ({\epsilon}, {\delta})-differential privacy and the computation accuracy. The second solver is established on the combination of the distributed shuffling mechanism and the average consensus algorithm, which enables each agent to obtain a noisy version of parameters characterizing the global gradient. As a result, the least-squares optimization problem can be eventually solved by each agent locally in such a way that any given ({\epsilon}, {\delta})-differential privacy requirement can be preserved while the solution may be computed with the accuracy independent of the network size, which makes the latter more suitable for large-scale distributed least-squares problems. Numerical simulations are presented to show the effectiveness of both solvers.


title: Thermodynamics of the 3-dimensional Einstein-Maxwell system

abstract: Recently, I studied the thermodynamical properties of the Einstein-Maxwell system with a box boundary in 4-dimensions [1](JHEP 04 (2024) 083). In this paper, I investigate those in 3-dimensions using the zero-loop saddle-point approximation and focusing only on a simple topology sector as usual. Similar to the 4-dimensional case, the system is thermodynamically well-behaved when $\Lambda<0$ (due to the contribution of the "bag of gold" saddles). However, when $\Lambda=0$, a crucial difference to the 4-dimensional case appears, i.e. the 3-dimensional system turns out to be thermodynamically unstable, while the 4-dimensional one is thermodynamically stable. This may offer two options for how we think about the thermodynamics of 3-dimensional gravity with $\Lambda=0$. One is that the zero-loop approximation or restricting the simple topology sector is not sufficient for 3-dimensions with $\Lambda=0$. The other is that 3-dimensional gravity is really thermodynamically unstable when $\Lambda=0$.


title: GPTSee: Enhancing Moment Retrieval and Highlight Detection via Description-Based Similarity Features

abstract: Moment retrieval (MR) and highlight detection (HD) aim to identify relevant moments and highlights in video from corresponding natural language query. Large language models (LLMs) have demonstrated proficiency in various computer vision tasks. However, existing methods for MR\&HD have not yet been integrated with LLMs. In this letter, we propose a novel two-stage model that takes the output of LLMs as the input to the second-stage transformer encoder-decoder. First, MiniGPT-4 is employed to generate the detailed description of the video frame and rewrite the query statement, fed into the encoder as new features. Then, semantic similarity is computed between the generated description and the rewritten queries. Finally, continuous high-similarity video frames are converted into span anchors, serving as prior position information for the decoder. Experiments demonstrate that our approach achieves a state-of-the-art result, and by using only span anchors and similarity scores as outputs, positioning accuracy outperforms traditional methods, like Moment-DETR.


title: Privacy-Preserving Collaborative Split Learning Framework for Smart Grid Load Forecasting

abstract: Accurate load forecasting is crucial for energy management, infrastructure planning, and demand-supply balancing. Smart meter data availability has led to the demand for sensor-based load forecasting. Conventional ML allows training a single global model using data from multiple smart meters requiring data transfer to a central server, raising concerns for network requirements, privacy, and security. We propose a split learning-based framework for load forecasting to alleviate this issue. We split a deep neural network model into two parts, one for each Grid Station (GS) responsible for an entire neighbourhood's smart meters and the other for the Service Provider (SP). Instead of sharing their data, client smart meters use their respective GSs' model split for forward pass and only share their activations with the GS. Under this framework, each GS is responsible for training a personalized model split for their respective neighbourhoods, whereas the SP can train a single global or personalized model for each GS. Experiments show that the proposed models match or exceed a centrally trained model's performance and generalize well. Privacy is analyzed by assessing information leakage between data and shared activations of the GS model split. Additionally, differential privacy enhances local data privacy while examining its impact on performance. A transformer model is used as our base learner.


title: Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis

abstract: Point cloud analysis has achieved outstanding performance by transferring point cloud pre-trained models. However, existing methods for model adaptation usually update all model parameters, i.e., full fine-tuning paradigm, which is inefficient as it relies on high computational costs (e.g., training GPU memory) and massive storage space. In this paper, we aim to study parameter-efficient transfer learning for point cloud analysis with an ideal trade-off between task performance and parameter efficiency. To achieve this goal, we freeze the parameters of the default pre-trained models and then propose the Dynamic Adapter, which generates a dynamic scale for each token, considering the token significance to the downstream task. We further seamlessly integrate Dynamic Adapter with Prompt Tuning (DAPT) by constructing Internal Prompts, capturing the instance-specific features for interaction. Extensive experiments conducted on five challenging datasets demonstrate that the proposed DAPT achieves superior performance compared to the full fine-tuning counterparts while significantly reducing the trainable parameters and training GPU memory by 95% and 35%, respectively. Code is available at https://github.com/LMD0311/DAPT.


title: Pyramid Feature Attention Network for Monocular Depth Prediction

abstract: Deep convolutional neural networks (DCNNs) have achieved great success in monocular depth estimation (MDE). However, few existing works take the contributions for MDE of different levels feature maps into account, leading to inaccurate spatial layout, ambiguous boundaries and discontinuous object surface in the prediction. To better tackle these problems, we propose a Pyramid Feature Attention Network (PFANet) to improve the high-level context features and low-level spatial features. In the proposed PFANet, we design a Dual-scale Channel Attention Module (DCAM) to employ channel attention in different scales, which aggregate global context and local information from the high-level feature maps. To exploit the spatial relationship of visual features, we design a Spatial Pyramid Attention Module (SPAM) which can guide the network attention to multi-scale detailed information in the low-level feature maps. Finally, we introduce scale-invariant gradient loss to increase the penalty on errors in depth-wise discontinuous regions. Experimental results show that our method outperforms state-of-the-art methods on the KITTI dataset.


title: On a mod $3$ property of $\ell $-tuples of pairwise commuting permutations

abstract: Let $S_n$ denote the symmetric group of permutations acting on $n$ elements. We investigate the double sequence $\{N_{\ell}(n)\}$ counting the number of $\ell$ tuples of elements of the symmetric group $S_n$, where the components commute, normalized by the order of $S_n$. Our focus lies on exploring log-concavity with respect to $n$: $$ N_{\ell}(n)^2 - N_{\ell}(n-1) \,\, N_{\ell}(n+1) \geq 0.$$ We establish that this depends on $n \pmod{3}$ for sufficiently large $\ell$. These numbers are studied by Bryan and Fulman as the $n$th orbifold characteristics, generalizing work of Macdonald and Hirzebruch--Hofer concerning the ordinary and string-theoretic Euler characteristics of symmetric products. Notably, $N_2(n)$ represents the partition numbers $p(n)$, while $N_{3}(n)$ represents the number of non-equivalent $n$-sheeted coverings of a torus studied by Liskovets and Medynkh. The numbers also appear in algebra since $ \vert S_n \vert \,\, N_{\ell}(n) = \left\vert Hom \left( \mathbb{Z}^{\ell},S_n\right) \right\vert $.


title: Optimistic and pessimistic approaches for cooperative games

abstract: Cooperative game theory aims to study how to divide a joint value created by a set of players. These games are often studied through the characteristic function form with transferable utility, which represents the value obtainable by each coalition. In the presence of externalities, there are many ways to define this value. Various models that account for different levels of player cooperation and the influence of external players on coalition value have been studied. Although there are different approaches, typically, the optimistic and pessimistic approaches provide sufficient insights into strategic interactions. This paper clarifies the interpretation of these approaches by providing a unified framework. We show that making sure that no coalition receives more than their (optimistic) upper bounds is always at least as difficult as guaranteeing their (pessimistic) lower bounds. We also show that if externalities are negative, providing these guarantees is always feasible. Then, we explore applications and show how our findings can be applied to derive results from the existing literature.


title: Fabry-P\'{e}rot nanocavities controlled by Casimir forces in electrolyte solutions

abstract: We propose a design for tuning the resonant spectra of Fabry-P\'{e}rot nanocavities mediated by the Casimir force. The system involves a suspended gold nanoplate approaching to a dielectric-coated gold substrate in a univalent electrolyte solution. The gold nanoplate can be stably suspended due to the delicate balance between repulsive and attractive components of the Casimir forces. In an electrolyte solution, the presence of ionic-charge fluctuations can partially or totally screen the thermal $n$=0 Matsubara term, resulting in strongly modified interactions. As a result, the separation between the gold nanoplate and the substrate experiences a significant modulation in response to variations in salt concentration. Under proper conditions, we find that the modulation of the Casimir force would strongly shift the resonances of Fabry-P\'{e}rot nanocavities at the optical frequencies, when the Debye length of the electrolyte decreases from 1000 nm to 10 nm. Finally, the temperature dependence of the thermal Casimir force would provide an additional modulation of Fabry-P\'{e}rot nanocavity resonances for their eventual fine tuning. These results open up a promising venue for general tuning of the optical resonances with potential applications in re-configurable microfluidic nanophotonics.


title: 3DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos

abstract: Constructing photo-realistic Free-Viewpoint Videos (FVVs) of dynamic scenes from multi-view videos remains a challenging endeavor. Despite the remarkable advancements achieved by current neural rendering techniques, these methods generally require complete video sequences for offline training and are not capable of real-time rendering. To address these constraints, we introduce 3DGStream, a method designed for efficient FVV streaming of real-world dynamic scenes. Our method achieves fast on-the-fly per-frame reconstruction within 12 seconds and real-time rendering at 200 FPS. Specifically, we utilize 3D Gaussians (3DGs) to represent the scene. Instead of the na\"ive approach of directly optimizing 3DGs per-frame, we employ a compact Neural Transformation Cache (NTC) to model the translations and rotations of 3DGs, markedly reducing the training time and storage required for each FVV frame. Furthermore, we propose an adaptive 3DG addition strategy to handle emerging objects in dynamic scenes. Experiments demonstrate that 3DGStream achieves competitive performance in terms of rendering speed, image quality, training time, and model storage when compared with state-of-the-art methods.


title: Neutron stars as a dense liquid drop at equilibrium within the effective surface approximation

abstract: The macroscopic model for a neutron star (NS) as a perfect liquid drop at the equilibrium is formulated for derivations of the particle number density $\rho$, equation of state (EoS) for the pressure $P=P(\rho)$, and the NS mass expressions, $M=M(R)$. We use the leptodermic approximation $a/R<<1$, where $a$ is the crust thickness of the effective NS surface (ES), and $R$ is the mean radius of the ES curvature. Within the approximate Schwarzschild metric solution to the general relativity theory equations for the spherically symmetric systems, the macroscopic gravitation is taken into account in terms of the total separation energy and incompressibility in the simplest form as expansion of a gravitational potential $\Phi(\rho)$ in powers of $\rho-\overline{\rho} $, where $\overline{\rho}$ is the saturation density, up to second order. Density distribution $\rho$ across the ES in the normal direction to the ES was obtained analytically for a general form of the energy density $\mathcal{E}(\rho)$ in the leading order of parameter $a/R \ll 1$. For the typical crust thickness, $a \sim 1$ km, and effective radii, $R\sim 10$ km, one finds the leading expression for the density $\rho$. NS masses are analytically calculated as a sum of the volume and surface terms, $M(R)=M_{\rm V}+M_{\rm S}$, taking into account the radial curvature of the Schwarzschild metric space, in reasonable agreement with recently measured masses, $M=(1.4-2.0) M_\odot$, and radii, $R=10-14$ km, for several neutron stars. The energy tension coefficient is derived with accounting for the Schwarzschild metric correction. We derive the simple macroscopic equation of state, $P=P(\rho)$, with the surface correction. The analytical and numerical solutions to Tolman-Oppenheimer-Volkoff equations for the pressure are in good agreement with the volume part of our EoS.


title: GuardT2I: Defending Text-to-Image Models from Adversarial Prompts

abstract: Recent advancements in Text-to-Image (T2I) models have raised significant safety concerns about their potential misuse for generating inappropriate or Not-Safe-For-Work (NSFW) contents, despite existing countermeasures such as NSFW classifiers or model fine-tuning for inappropriate concept removal. Addressing this challenge, our study unveils GuardT2I, a novel moderation framework that adopts a generative approach to enhance T2I models' robustness against adversarial prompts. Instead of making a binary classification, GuardT2I utilizes a Large Language Model (LLM) to conditionally transform text guidance embeddings within the T2I models into natural language for effective adversarial prompt detection, without compromising the models' inherent performance. Our extensive experiments reveal that GuardT2I outperforms leading commercial solutions like OpenAI-Moderation and Microsoft Azure Moderator by a significant margin across diverse adversarial scenarios.


title: Derivation, characterization, and application of complete orthonormal sequences for representing general three-dimensional states of residual stress

abstract: Residual stresses are self-equilibrated stresses on unloaded bodies. Owing to their complex origins, it is useful to develop functions that can be linearly combined to represent any sufficiently regular residual stress field. In this work, we develop orthonormal sequences that span the set of all square-integrable residual stress fields on a given three-dimensional region. These sequences are obtained by extremizing the most general quadratic, positive-definite functional of the stress gradient on the set of all sufficiently regular residual stress fields subject to a prescribed normalization condition; each such functional yields a sequence. For the special case where the sixth-order coefficient tensor in the functional is homogeneous and isotropic and the fourth-order coefficient tensor in the normalization condition is proportional to the identity tensor, we obtain a three-parameter subfamily of sequences. Upon a suitable parameter normalization, we find that the viable parameter space corresponds to a semi-infinite strip. For a further specialized spherically symmetric case, we obtain analytical expressions for the sequences and the associated Lagrange multipliers. Remarkably, these sequences change little across the entire parameter strip. To illustrate the applicability of our theoretical findings, we employ three such spherically symmetric sequences to accurately approximate two standard residual stress fields. Our work opens avenues for future exploration into the implications of different sequences, achieved by altering both the spatial distribution and the material symmetry class of the coefficient tensors, toward specific objectives.


title: Locally adjointable operators on Hilbert $C^*$-modules

abstract: In the theory of Hilbert $C^*$-modules over a $C^*$-algebra $A$ (in contrast with the theory of Hilbert spaces) not each bounded operator ($A$-homomorphism) admits an adjoint. The interplay between the sets of adjointable and non-adjointable operators plays a very important role in the theory. We study an intermediate notion of locally adjointable operator $F:M \to N$, i.e. such an operator that $F\circ g$ is adjointable for any adjointable $g: A \to M$. We have introduced this notion recently and it has demonstrated its usefulness in the context of theory of uniform structures on Hilbert $C^*$-modules. In the present paper we obtain an explicit description of locally adjointable operators in important cases.


title: DUFOMap: Efficient Dynamic Awareness Mapping

abstract: The dynamic nature of the real world is one of the main challenges in robotics. The first step in dealing with it is to detect which parts of the world are dynamic. A typical benchmark task is to create a map that contains only the static part of the world to support, for example, localization and planning. Current solutions are often applied in post-processing, where parameter tuning allows the user to adjust the setting for a specific dataset. In this paper, we propose DUFOMap, a novel dynamic awareness mapping framework designed for efficient online processing. Despite having the same parameter settings for all scenarios, it performs better or is on par with state-of-the-art methods. Ray casting is utilized to identify and classify fully observed empty regions. Since these regions have been observed empty, it follows that anything inside them at another time must be dynamic. Evaluation is carried out in various scenarios, including outdoor environments in KITTI and Argoverse 2, open areas on the KTH campus, and with different sensor types. DUFOMap outperforms the state of the art in terms of accuracy and computational efficiency. The source code, benchmarks, and links to the datasets utilized are provided. See https://kth-rpl.github.io/dufomap for more details.


title: Collision-Free Robot Navigation in Crowded Environments using Learning based Convex Model Predictive Control

abstract: Navigating robots safely and efficiently in crowded and complex environments remains a significant challenge. However, due to the dynamic and intricate nature of these settings, planning efficient and collision-free paths for robots to track is particularly difficult. In this paper, we uniquely bridge the robot's perception, decision-making and control processes by utilizing the convex obstacle-free region computed from 2D LiDAR data. The overall pipeline is threefold: (1) We proposes a robot navigation framework that utilizes deep reinforcement learning (DRL), conceptualizing the observation as the convex obstacle-free region, a departure from general reliance on raw sensor inputs. (2) We design the action space, derived from the intersection of the robot's kinematic limits and the convex region, to enable efficient sampling of inherently collision-free reference points. These actions assists in guiding the robot to move towards the goal and interact with other obstacles during navigation. (3) We employ model predictive control (MPC) to track the trajectory formed by the reference points while satisfying constraints imposed by the convex obstacle-free region and the robot's kinodynamic limits. The effectiveness of proposed improvements has been validated through two sets of ablation studies and a comparative experiment against the Timed Elastic Band (TEB), demonstrating improved navigation performance in crowded and complex environments.


title: Enhancing Data Provenance and Model Transparency in Federated Learning Systems -- A Database Approach

abstract: Federated Learning (FL) presents a promising paradigm for training machine learning models across decentralized edge devices while preserving data privacy. Ensuring the integrity and traceability of data across these distributed environments, however, remains a critical challenge. The ability to create transparent artificial intelligence, such as detailing the training process of a machine learning model, has become an increasingly prominent concern due to the large number of sensitive (hyper)parameters it utilizes; thus, it is imperative to strike a reasonable balance between openness and the need to protect sensitive information. In this paper, we propose one of the first approaches to enhance data provenance and model transparency in federated learning systems. Our methodology leverages a combination of cryptographic techniques and efficient model management to track the transformation of data throughout the FL process, and seeks to increase the reproducibility and trustworthiness of a trained FL model. We demonstrate the effectiveness of our approach through experimental evaluations on diverse FL scenarios, showcasing its ability to tackle accountability and explainability across the board. Our findings show that our system can greatly enhance data transparency in various FL environments by storing chained cryptographic hashes and client model snapshots in our proposed design for data decoupled FL. This is made possible by also employing multiple optimization techniques which enables comprehensive data provenance without imposing substantial computational loads. Extensive experimental results suggest that integrating a database subsystem into federated learning systems can improve data provenance in an efficient manner, encouraging secure FL adoption in privacy-sensitive applications and paving the way for future advancements in FL transparency and security features.


title: Impact of wavefront shape on nonlinear ultrasound imaging of monodisperse microbubbles

abstract: The field of contrast-enhanced ultrasound (CEUS) combines nonlinear, resonant microbubbles (MBs) with dedicated pulse sequences to reveal the vascular function of organs. Clinical ultrasound contrast agents consist of polydisperse MB suspensions with diameters ranging from 0.5 to 10 um and resonance frequencies ranging from 1 to 15 MHz. As a result, just a small fraction of MBs resonates at a given ultrasound frequency. MB suspensions with narrow size distributions can be tuned for a specific imaging frequency, boost CEUS sensitivity and enable deeper vascular imaging. However, their enhanced nonlinear behavior makes imaging susceptible to nonlinear wave propagation artifacts. Here, we numerically investigate the impact of the acoustic wavefront shape on the imaging of nonlinear, monodisperse MBs. Specifically, our approach relies on an extension of the Iterative Nonlinear Contrast Source (INCS) method that accounts for all nonlinear effects in CEUS. We demonstrate that supersonic x-shaped wavefronts referred to as x-waves can be used to generate ultrasound images of monodisperse MBs without nonlinear wave propagation artifacts. On the contrary, imaging based on focused, planar and diverging wavefronts leads to significant nonlinear artifacts. Taken together, our results show that x-waves can harness the full potential of monodisperse MBs by enabling their sensitive and specific detection in a tissue context.


title: The rigidity of minimal Legendrian submanifolds in the Euclidean spheres via eigenvalues of fundamental matrices

abstract: In this paper, we study the rigidity problem for compact minimal Legendrian submanifolds in the unit Euclidean spheres via eigenvalues of fundamental matrices, which measure the squared norms of the second fundamental form on all normal directions. By using Lu's inequality on the upper bound of the squared norm of Lie brackets of symmetric matrices, we establish an optimal pinching theorem for such submanifolds of all dimensions, giving a new characterization for the Calabi tori. This pinching condition can also be described by the eigenvalues of the Ricci curvature tensor. Moreover, when the third large eigenvalue of the fundamental matrix vanishes everywhere, we get an optimal rigidity theorem under a weaker pinching condition.


title: Maximum Length RLL Sequences in de Bruijn Graph

abstract: A timing and synchronization system based on a de Bruijn sequence has been proposed and studied recently for a channel associated with quantum communication that requires reliable synchronization. To avoid a long period of no-pulse in such a system on-off pulses are used to simulate a zero and on-on pulses are used to simulate a one. However, these sequences have high redundancy. To reduce the redundancy, run-length limited sequences in the de Bruijn graph are proposed for the same purpose. The maximum length of such sequences in the de Bruijn graph is studied and an efficient algorithm to construct a large set of these sequences is presented. A maximum length sequence for which the position of each window can be computed efficiently is constructed. Finally, an enumeration of the number of such sequences is given and some generalizations are discussed.


title: Anomalous impurity effect in the heavy-fermion superconductor CeCu$_2$Si$_2$

abstract: Recent observations of contradictory impurity effect in the heavy-fermion superconductor CeCu$_2$Si$_2$ at ambient pressure have hindered the identification of its pairing symmetry. Here we perform theoretical analyses with both intraband and interband impurity scatterings for the nodeless $s^\pm$-wave pairing, and report an anomalous nonmonotonic variation of its $T_c$ suppression with the scattering strength. Our results reproduce the prominent reduction of $T_c$ in good agreement with earlier experiments by atomic substitution and explains as well its robustness against electron irradiation. We ascribe the latter to the screening of the interband impurity potential in the strong scattering or unitary region. This resolves the seeming contradiction in different experimental probes and provides an important support to the nodeless $s^\pm$-wave scenario in CeCu$_2$Si$_2$ at ambient pressure. Our theory may be extended to other narrow band systems such as twisted bilayer graphene and the recently discovered bilayer or trilayer nickelate superconductors, and provide a useful way to distinguish different paring candidates thereof.


title: Controlling Cloze-test Question Item Difficulty with PLM-based Surrogate Models for IRT Assessment

abstract: Item difficulty plays a crucial role in adaptive testing. However, few works have focused on generating questions of varying difficulty levels, especially for multiple-choice (MC) cloze tests. We propose training pre-trained language models (PLMs) as surrogate models to enable item response theory (IRT) assessment, avoiding the need for human test subjects. We also propose two strategies to control the difficulty levels of both the gaps and the distractors using ranking rules to reduce invalid distractors. Experimentation on a benchmark dataset demonstrates that our proposed framework and methods can effectively control and evaluate the difficulty levels of MC cloze tests.


title: Logic Rules as Explanations for Legal Case Retrieval

abstract: In this paper, we address the issue of using logic rules to explain the results from legal case retrieval. The task is critical to legal case retrieval because the users (e.g., lawyers or judges) are highly specialized and require the system to provide logical, faithful, and interpretable explanations before making legal decisions. Recently, research efforts have been made to learn explainable legal case retrieval models. However, these methods usually select rationales (key sentences) from the legal cases as explanations, failing to provide faithful and logically correct explanations. In this paper, we propose Neural-Symbolic enhanced Legal Case Retrieval (NS-LCR), a framework that explicitly conducts reasoning on the matching of legal cases through learning case-level and law-level logic rules. The learned rules are then integrated into the retrieval process in a neuro-symbolic manner. Benefiting from the logic and interpretable nature of the logic rules, NS-LCR is equipped with built-in faithful explainability. We also show that NS-LCR is a model-agnostic framework that can be plugged in for multiple legal retrieval models. To showcase NS-LCR's superiority, we enhance existing benchmarks by adding manually annotated logic rules and introducing a novel explainability metric using Large Language Models (LLMs). Our comprehensive experiments reveal NS-LCR's effectiveness for ranking, alongside its proficiency in delivering reliable explanations for legal case retrieval.


title: Semi-vortex solitons and their excited states in spin-orbit-coupled binary bosonic condensates

abstract: It is known that two-dimensional two-component fundamental solitons of the semi-vortex (SV) type, with vorticities $(s_{+},s_{-})=(0,1)$ in their components, are stable ground states (GSs) in the spin-orbit-coupled (SOC) binary Bose-Einstein condensate with the contact self-attraction acting in both components, in spite of the possibility of the critical collapse in the system. However, excited states(ESs) of the SV solitons, with the vorticity set $(s_{+},s_{-})=( S_{+},S_{+}+1)$ and $S_{+}=1,2,3,...$, are unstable in the same system. We construct ESs of SV solitons in the SOC system with opposite signs of the self-interaction in the two components. The main finding is stability of the ES-SV solitons, with the extra vorticity (at least) up to $S_{+}=6$. The threshold value of the norm for the onset of the critical collapse, $N_{\mathrm{thr}}$, in these excited states is higher than the commonly known critical value, $N_{c}\approx 5.85$,associated with the single-component Townes solitons, $N_{\mathrm{thr}}$ increasing with the growth of $S_{+}$. A velocity interval for stable motion of the GS-SV solitons is found too. The results suggest a solution for the challenging problem of the creation of stable vortex solitons with high topological charges.


title: Integrable geodesic flow in 3D and webs of maximal rank

abstract: We characterize geodesic flows, admitting two commuting quadratic integrals with common principal directions, in terms of the geodesic 4-webs such that the tangents to the web leaves are common zero directions of the integrals. We prove that, under some natural geometric hypothesis, the metric is of St\"ackel type.


abstract: The large-scale multi-view clustering algorithms, based on the anchor graph, have shown promising performance and efficiency and have been extensively explored in recent years. Despite their successes, current methods lack interpretability in the clustering process and do not sufficiently consider the complementary information across different views. To address these shortcomings, we introduce the One-Step Multi-View Clustering Based on Transition Probability (OSMVC-TP). This method adopts a probabilistic approach, which leverages the anchor graph, representing the transition probabilities from samples to anchor points. Our method directly learns the transition probabilities from anchor points to categories, and calculates the transition probabilities from samples to categories, thus obtaining soft label matrices for samples and anchor points, enhancing the interpretability of clustering. Furthermore, to maintain consistency in labels across different views, we apply a Schatten p-norm constraint on the tensor composed of the soft labels. This approach effectively harnesses the complementary information among the views. Extensive experiments have confirmed the effectiveness and robustness of OSMVC-TP.


title: Answerability in Retrieval-Augmented Open-Domain Question Answering

abstract: The performance of Open-Domain Question Answering (ODQA) retrieval systems can exhibit sub-optimal behavior, providing text excerpts with varying degrees of irrelevance. Unfortunately, many existing ODQA datasets lack examples specifically targeting the identification of irrelevant text excerpts. Previous attempts to address this gap have relied on a simplistic approach of pairing questions with random text excerpts. This paper aims to investigate the effectiveness of models trained using this randomized strategy, uncovering an important limitation in their ability to generalize to irrelevant text excerpts with high semantic overlap. As a result, we observed a substantial decrease in predictive accuracy, from 98% to 1%. To address this limitation, we discovered an efficient approach for training models to recognize such excerpts. By leveraging unanswerable pairs from the SQuAD 2.0 dataset, our models achieve a nearly perfect (~100%) accuracy when confronted with these challenging text excerpts.


title: Application of the concept of hierarchical subordination to chain reactions in a nuclear reactor

abstract: Based on the theory of hierarchical structures, a correspondence has been established between the dynamics for the number of neutrons obtained from the theory of branching processes, the number of neutrons of the n-th generation, the number of nodes at the n-th level of the hierarchy, the rate of change in the probability of a chain reaction, the type of intensity and strength of the hierarchical connection, the degree reactor criticality, and neutron trajectories in the reactor. A connection has been found between the probabilities of the formation of a certain generation of the number of neutrons and the probability of the occurrence of a self-sustaining chain reaction of nuclear fission. It is shown that the Tsallis and R\'enyi distributions describing these processes are related by relations of deformed algebra, and under certain conditions can be accompanying with respect to each other.


title: An Authentic Algorithm for Ciphering and Deciphering Called Latin Djokovic

abstract: The question that is a motivation of writing is how many devote themselves to discovering something in the world of science where much is discerned and revealed, but at the same time, much is unknown. The insightful elements of this algorithm are the ciphering and deciphering algorithms of Playfair, Caesar, and Vigenere. Only a few of their main properties are taken and modified, with the aim of forming a specific functionality of the algorithm called Latin Djokovic. Specifically, a string is entered as input data. A key k is given, with a random value between the values a and b = a + 3. The obtained value is stored in a variable with the aim of being constant during the run of the algorithm. In correlation to the given key, the string is divided into several groups of substrings, and each substring has a length of k characters. The next step involves encoding each substring from the list of existing substrings. Encoding is performed using the basis of the Caesar algorithm, i.e., shifting with k characters. However, that k is incremented by 1 when moving to the next substring in that list. When the value of k becomes greater than b + 1, it will return to its initial value. The algorithm is executed, following the same procedure, until the last substring in the list is traversed. Using this polyalphabetic method, ciphering and deciphering of strings are achieved. The algorithm also works for a 100-character string. The x character is not used when the number of characters in a substring is incompatible with the expected length. The algorithm is simple to implement, but it is questionable if it works better than the other methods from the point of view of execution time and storage space.


title: Digraphs, pro-$p$ groups and Massey products in Galois cohomology

abstract: Let $p$ be a prime. We characterize the oriented right-angled Artin pro-$p$ groups whose $\mathbb{F}_p$-cohomology algebra yields no essential $n$-fold Massey products for every $n>2$, in terms of the associated digraph. Moreover, we show that the $\mathbb{F}_p$-cohomology algebra of such oriented right-angled Artin pro-$p$ groups is isomorphic to the exterior Stanley-Reisner $\mathbb{F}_p$-algebra associated to the same digraph. This work also aims at providing a concrete and group-theoretic introduction to the study of Massey products in Galois cohomology for non-specialists, especially graduate students working in profinite group theory.


title: Multiview Subspace Clustering of Hyperspectral Images based on Graph Convolutional Networks

abstract: High-dimensional and complex spectral structures make clustering of hy-perspectral images (HSI) a challenging task. Subspace clustering has been shown to be an effective approach for addressing this problem. However, current subspace clustering algorithms are mainly designed for a single view and do not fully exploit spatial or texture feature information in HSI. This study proposed a multiview subspace clustering of HSI based on graph convolutional networks. (1) This paper uses the powerful classification ability of graph convolutional network and the learning ability of topologi-cal relationships between nodes to analyze and express the spatial relation-ship of HSI. (2) Pixel texture and pixel neighbor spatial-spectral infor-mation were sent to construct two graph convolutional subspaces. (3) An attention-based fusion module was used to adaptively construct a more discriminative feature map. The model was evaluated on three popular HSI datasets, including Indian Pines, Pavia University, and Houston. It achieved overall accuracies of 92.38%, 93.43%, and 83.82%, respectively and significantly outperformed the state-of-the-art clustering methods. In conclusion, the proposed model can effectively improve the clustering ac-curacy of HSI.


title: Multiple plateaus of high-sideband generation from Floquet matters

abstract: We theoretically report that high-order sideband generation (HSG) from Floquet matters driven by a strong terahertz light while engineered by weak infrared light can achieve multiple plateau HSG. The Floquet-engineering systems exhibit distinctive spectroscopic characteristics that go beyond the HSG processes in field-free band-structure systems. The spatial-temporal dynamics analyses under Floquet-Bloch and time-reversal-symmetry theories clarify the spectral and its odd-even characteristics in the HSG spectrum. Our work demonstrates the HSG of Floquet matters via Floquet engineering and indicates a promising way to extract Floquet material parameters in future experiments.


title: Collaborate to Adapt: Source-Free Graph Domain Adaptation via Bi-directional Adaptation

abstract: Unsupervised Graph Domain Adaptation (UGDA) has emerged as a practical solution to transfer knowledge from a label-rich source graph to a completely unlabelled target graph. However, most methods require a labelled source graph to provide supervision signals, which might not be accessible in the real-world settings due to regulations and privacy concerns. In this paper, we explore the scenario of source-free unsupervised graph domain adaptation, which tries to address the domain adaptation problem without accessing the labelled source graph. Specifically, we present a novel paradigm called GraphCTA, which performs model adaptation and graph adaptation collaboratively through a series of procedures: (1) conduct model adaptation based on node's neighborhood predictions in target graph considering both local and global information; (2) perform graph adaptation by updating graph structure and node attributes via neighborhood contrastive learning; and (3) the updated graph serves as an input to facilitate the subsequent iteration of model adaptation, thereby establishing a collaborative loop between model adaptation and graph adaptation. Comprehensive experiments are conducted on various public datasets. The experimental results demonstrate that our proposed model outperforms recent source-free baselines by large margins.


title: Properties of the entropic risk measure EVaR in relation to selected distributions

abstract: Entropic Value-at-Risk (EVaR) measure is a convenient coherent risk measure. Due to certain difficulties in finding its analytical representation, it was previously calculated explicitly only for the normal distribution. We succeeded to overcome these difficulties and to calculate Entropic Value-at-Risk (EVaR) measure for Poisson, compound Poisson, Gamma, Laplace, exponential, chi-squared, inverse Gaussian distribution and normal inverse Gaussian distribution with the help of Lambert function that is a special function, generally speaking, with two branches.


title: KorMedMCQA: Multi-Choice Question Answering Benchmark for Korean Healthcare Professional Licensing Examinations

abstract: We introduce KorMedMCQA, the first Korean multiple-choice question answering (MCQA) benchmark derived from Korean healthcare professional licensing examinations, covering from the year 2012 to year 2023. This dataset consists of a selection of questions from the license examinations for doctors, nurses, and pharmacists, featuring a diverse array of subjects. We conduct baseline experiments on various large language models, including proprietary/open-source, multilingual/Korean-additional pretrained, and clinical context pretrained models, highlighting the potential for further enhancements. We make our data publicly available on HuggingFace (https://huggingface.co/datasets/sean0042/KorMedMCQA) and provide a evaluation script via LM-Harness, inviting further exploration and advancement in Korean healthcare environments.


title: Is in-domain data beneficial in transfer learning for landmarks detection in x-ray images?

abstract: In recent years, deep learning has emerged as a promising technique for medical image analysis. However, this application domain is likely to suffer from a limited availability of large public datasets and annotations. A common solution to these challenges in deep learning is the usage of a transfer learning framework, typically with a fine-tuning protocol, where a large-scale source dataset is used to pre-train a model, further fine-tuned on the target dataset. In this paper, we present a systematic study analyzing whether the usage of small-scale in-domain x-ray image datasets may provide any improvement for landmark detection over models pre-trained on large natural image datasets only. We focus on the multi-landmark localization task for three datasets, including chest, head, and hand x-ray images. Our results show that using in-domain source datasets brings marginal or no benefit with respect to an ImageNet out-of-domain pre-training. Our findings can provide an indication for the development of robust landmark detection systems in medical images when no large annotated dataset is available.


title: Preserving correlations: A statistical method for generating synthetic data

abstract: We propose a method to generate statistically representative synthetic data. The main goal is to be able to maintain in the synthetic dataset the correlations of the features present in the original one, while offering a comfortable privacy level that can be eventually tailored on specific customer demands. We describe in detail our algorithm used both for the analysis of the original dataset and for the generation of the synthetic data points. The approach is tested using a large energy-related dataset. We obtain good results both qualitatively (e.g. via vizualizing correlation maps) and quantitatively (in terms of suitable $\ell^1$-type error norms used as evaluation metrics). The proposed methodology is general in the sense that it does not rely on the used test dataset. We expect it to be applicable in a much broader context than indicated here.


title: WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protection

abstract: Embedding as a Service (EaaS) has become a widely adopted solution, which offers feature extraction capabilities for addressing various downstream tasks in Natural Language Processing (NLP). Prior studies have shown that EaaS can be prone to model extraction attacks; nevertheless, this concern could be mitigated by adding backdoor watermarks to the text embeddings and subsequently verifying the attack models post-publication. Through the analysis of the recent watermarking strategy for EaaS, EmbMarker, we design a novel CSE (Clustering, Selection, Elimination) attack that removes the backdoor watermark while maintaining the high utility of embeddings, indicating that the previous watermarking approach can be breached. In response to this new threat, we propose a new protocol to make the removal of watermarks more challenging by incorporating multiple possible watermark directions. Our defense approach, WARDEN, notably increases the stealthiness of watermarks and has been empirically shown to be effective against CSE attack.


title: Squares of symmetric operators

abstract: Using the approach proposed in [5] , in an infinite-dimensional separable complex Hilbert space we give abstract constructions of families $\{{\mathcal T}_z\}_{{\rm Im\,} z>0}$ of closed densely defined symmetric operators with the properties: (I) the domain of ${\mathcal T}_z^2$ is a core of ${\mathcal T}_z$, (II) the domain of ${\mathcal T}_z^2$ is dense but note a core of ${\mathcal T}_z$, (III) the domain of ${\mathcal T}_z^2$ is nontrivial but non-dense. For this purpose a class of maximal dissipative operators is defined and studied. The case ${\rm dom\,} {\mathcal T}_z^2=\{0\}$ has been considered in [5]. Given a densely defined closed symmetric operator $S$, in terms of the intersection of the domain of $S$ with ${\rm ran\,} (S-\lambda I)$ and the projection of the domain of the adjoint $S^*$ on ${\rm ran\,} (S-\lambda I)$, $\lambda\in{\mathbb C}\setminus{\mathbb R}$, necessary and sufficient conditions for the cases (I)--(III) related to the domain of $S^2$, are obtained.


title: Companion matrix, Vandermonde matrix, Jordan form, Interpolating Polynomials, and Linear Transformations

abstract: Let $\mathbb{F}$ be a field, and let $C$ be the $n\times n$ companion matrix of the monic polynomial $f(x)\in \mathbb{F}[x]$ such that $f(x) = \det(xI-C) = (x - \lambda_1)^{n_1} \cdots (x - \lambda_m)^{n_m}$ for $m$ distinct elements $\lambda_1, \dots, \lambda_m \in \mathbb{F}$. It is shown that there is a generalized Vandermonde matrix $V$ associated with $f(x)$ such that $VCV^{-1}$ is in Jordan form, and the columns of $V^{-1}$ are connected to the Hermite interpolating polynomials, whose higher derivatives will have specific values at $\lambda_1, \dots, \lambda_m$. If $m = n$ and $n_1 = \cdots = n_m = 1$, then the results reduce to the fact that the (classical) Vandermonde $V$ of $\lambda_1, \dots, \lambda_n$ satisfies $VCV^{-1}$ is a diagonal matrix and that the columns of $V^{-1}$ correspond to the Lagrange interpolating polynomials. This shows that the results for real polynomials and matrices also hold for polynomials and matrices over an arbitrary field $\mathbb{F}$. Moreover, interpretations and insights of the results are given in terms of linear transformation between $\mathbb{F}^n$ and the linear space of polynomials in $\mathbb{F}[x]$ with degree less than $n$.


title: Representation Learning on Heterophilic Graph with Directional Neighborhood Attention

abstract: Graph Attention Network (GAT) is one of the most popular Graph Neural Network (GNN) architecture, which employs the attention mechanism to learn edge weights and has demonstrated promising performance in various applications. However, since it only incorporates information from immediate neighborhood, it lacks the ability to capture long-range and global graph information, leading to unsatisfactory performance on some datasets, particularly on heterophilic graphs. To address this limitation, we propose the Directional Graph Attention Network (DGAT) in this paper. DGAT is able to combine the feature-based attention with the global directional information extracted from the graph topology. To this end, a new class of Laplacian matrices is proposed which can provably reduce the diffusion distance between nodes. Based on the new Laplacian, topology-guided neighbour pruning and edge adding mechanisms are proposed to remove the noisy and capture the helpful long-range neighborhood information. Besides, a global directional attention is designed to enable a topological-aware information propagation. The superiority of the proposed DGAT over the baseline GAT has also been verified through experiments on real-world benchmarks and synthetic data sets. It also outperforms the state-of-the-art (SOTA) models on 6 out of 7 real-world benchmark datasets.


title: CCC: Color Classified Colorization

abstract: Automatic colorization of gray images with objects of different colors and sizes is challenging due to inter- and intra-object color variation and the small area of the main objects due to extensive backgrounds. The learning process often favors dominant features, resulting in a biased model. In this paper, we formulate the colorization problem into a multinomial classification problem and then apply a weighted function to classes. We propose a set of formulas to transform color values into color classes and vice versa. Class optimization and balancing feature distribution are the keys for good performance. Observing class appearance on various extremely large-scale real-time images in practice, we propose 215 color classes for our colorization task. During training, we propose a class-weighted function based on true class appearance in each batch to ensure proper color saturation of individual objects. We establish a trade-off between major and minor classes to provide orthodox class prediction by eliminating major classes' dominance over minor classes. As we apply regularization to enhance the stability of the minor class, occasional minor noise may appear at the object's edges. We propose a novel object-selective color harmonization method empowered by the SAM to refine and enhance these edges. We propose a new color image evaluation metric, the Chromatic Number Ratio (CNR), to quantify the richness of color components. We compare our proposed model with state-of-the-art models using five different datasets: ADE, Celeba, COCO, Oxford 102 Flower, and ImageNet, in both qualitative and quantitative approaches. The experimental results show that our proposed model outstrips other models in visualization and CNR measurement criteria while maintaining satisfactory performance in regression (MSE, PSNR), similarity (SSIM, LPIPS, UIQI), and generative criteria (FID).


title: Two-phase rejective sampling

abstract: Rejective sampling improves design and estimation efficiency of single-phase sampling when auxiliary information in a finite population is available. When such auxiliary information is unavailable, we propose to use two-phase rejective sampling (TPRS), which involves measuring auxiliary variables for the sample of units in the first phase, followed by the implementation of rejective sampling for the outcome in the second phase. We explore the asymptotic design properties of double expansion and regression estimators under TPRS. We show that TPRS enhances the efficiency of the double expansion estimator, rendering it comparable to a regression estimator. We further refine the design to accommodate varying importance of covariates and extend it to multi-phase sampling.


title: Distributed Discrete-time Dynamic Outer Approximation of the Intersection of Ellipsoids

abstract: This paper presents the first discrete-time distributed algorithm to track the tightest ellipsoids that outer approximates the global dynamic intersection of ellipsoids. The ellipsoids are defined as time-varying positive definite matrices. On the other hand, given an undirected network, each node is equipped with one of these ellipsoids. The solution is based on a novel distributed reformulation of the original centralized semi-definite outer L\"owner-John program, characterized by a non-separable objective function and global constraints. We prove finite-time convergence to the global minima of the centralized problem in the static case and finite-time bounded tracking error in the dynamic case. Moreover, we prove boundedness of estimation in the tracking of the global optimum and robustness in the estimation against time-varying inputs. As a by-product, the proposed algorithm extends min/max dynamic consensus algorithms to positive definite matrices. We illustrate the properties of the algorithm with different simulated examples, including a distributed estimation showcase where our proposal is integrated into a distributed Kalman filter to surpass the state-of-the-art in mean square error performance.


title: Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation

abstract: The advent of scalable deep models and large datasets has improved the performance of Neural Machine Translation. Knowledge Distillation (KD) enhances efficiency by transferring knowledge from a teacher model to a more compact student model. However, KD approaches to Transformer architecture often rely on heuristics, particularly when deciding which teacher layers to distill from. In this paper, we introduce the 'Align-to-Distill' (A2D) strategy, designed to address the feature mapping problem by adaptively aligning student attention heads with their teacher counterparts during training. The Attention Alignment Module in A2D performs a dense head-by-head comparison between student and teacher attention heads across layers, turning the combinatorial mapping heuristics into a learning problem. Our experiments show the efficacy of A2D, demonstrating gains of up to +3.61 and +0.63 BLEU points for WMT-2022 De->Dsb and WMT-2014 En->De, respectively, compared to Transformer baselines.


title: Deep Learning-based Design of Uplink Integrated Sensing and Communication

abstract: In this paper, we investigate the issue of uplink integrated sensing and communication (ISAC) in 6G wireless networks where the sensing echo signal and the communication signal are received simultaneously at the base station (BS). To effectively mitigate the mutual interference between sensing and communication caused by the sharing of spectrum and hardware resources, we provide a joint sensing transmit waveform and communication receive beamforming design with the objective of maximizing the weighted sum of normalized sensing rate and normalized communication rate. It is formulated as a computationally complicated non-convex optimization problem, which is quite difficult to be solved by conventional optimization methods. To this end, we first make a series of equivalent transformation on the optimization problem to reduce the design complexity, and then develop a deep learning (DL)-based scheme to enhance the overall performance of ISAC. Both theoretical analysis and simulation results confirm the effectiveness and robustness of the proposed DL-based scheme for ISAC in 6G wireless networks.


title: Infusing Knowledge into Large Language Models with Contextual Prompts

abstract: Knowledge infusion is a promising method for enhancing Large Language Models for domain-specific NLP tasks rather than pre-training models over large data from scratch. These augmented LLMs typically depend on additional pre-training or knowledge prompts from an existing knowledge graph, which is impractical in many applications. In contrast, knowledge infusion directly from relevant documents is more generalisable and alleviates the need for structured knowledge graphs while also being useful for entities that are usually not found in any knowledge graph. With this motivation, we propose a simple yet generalisable approach for knowledge infusion by generating prompts from the context in the input text. Our experiments show the effectiveness of our approach which we evaluate by probing the fine-tuned LLMs.


title: EAGLE: Eigen Aggregation Learning for Object-Centric Unsupervised Semantic Segmentation

abstract: Semantic segmentation has innately relied on extensive pixel-level annotated data, leading to the emergence of unsupervised methodologies. Among them, leveraging self-supervised Vision Transformers for unsupervised semantic segmentation (USS) has been making steady progress with expressive deep features. Yet, for semantically segmenting images with complex objects, a predominant challenge remains: the lack of explicit object-level semantic encoding in patch-level features. This technical limitation often leads to inadequate segmentation of complex objects with diverse structures. To address this gap, we present a novel approach, EAGLE, which emphasizes object-centric representation learning for unsupervised semantic segmentation. Specifically, we introduce EiCue, a spectral technique providing semantic and structural cues through an eigenbasis derived from the semantic similarity matrix of deep image features and color affinity from an image. Further, by incorporating our object-centric contrastive loss with EiCue, we guide our model to learn object-level representations with intra- and inter-image object-feature consistency, thereby enhancing semantic accuracy. Extensive experiments on COCO-Stuff, Cityscapes, and Potsdam-3 datasets demonstrate the state-of-the-art USS results of EAGLE with accurate and consistent semantic segmentation across complex scenes.


title: BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

abstract: Bronchoscopy plays a significant role in the early diagnosis and treatment of lung diseases. This process demands physicians to maneuver the flexible endoscope for reaching distal lesions, particularly requiring substantial expertise when examining the airways of the upper lung lobe. With the development of artificial intelligence and robotics, reinforcement learning (RL) method has been applied to the manipulation of interventional surgical robots. However, unlike human physicians who utilize multimodal information, most of the current RL methods rely on a single modality, limiting their performance. In this paper, we propose BronchoCopilot, a multimodal RL agent designed to acquire manipulation skills for autonomous bronchoscopy. BronchoCopilot specifically integrates images from the bronchoscope camera and estimated robot poses, aiming for a higher success rate within challenging airway environment. We employ auxiliary reconstruction tasks to compress multimodal data and utilize attention mechanisms to achieve an efficient latent representation of this data, serving as input for the RL module. This framework adopts a stepwise training and fine-tuning approach to mitigate the challenges of training difficulty. Our evaluation in the realistic simulation environment reveals that BronchoCopilot, by effectively harnessing multimodal information, attains a success rate of approximately 90\% in fifth generation airways with consistent movements. Additionally, it demonstrates a robust capacity to adapt to diverse cases.


title: Observation of SOMO-HOMO inversion in a polycyclic conjugated hydrocarbon

abstract: We report the generation of a non-benzenoid polycyclic conjugated hydrocarbon, which consists of a biphenyl moiety substituted by indenyl units at the 4,4' positions, on ultra-thin sodium chloride films by tip-induced chemistry. Single-molecule characterization by scanning tunneling and atomic force microscopy reveals an open-shell biradical ground state, with a peculiar electronic configuration wherein the singly-occupied molecular orbitals (SOMOs) are lower in energy than the highest occupied molecular orbital (HOMO).


title: Approximations to the Fisher Information Metric of Deep Generative Models for Out-Of-Distribution Detection

abstract: Likelihood-based deep generative models such as score-based diffusion models and variational autoencoders are state-of-the-art machine learning models approximating high-dimensional distributions of data such as images, text, or audio. One of many downstream tasks they can be naturally applied to is out-of-distribution (OOD) detection. However, seminal work by Nalisnick et al. which we reproduce showed that deep generative models consistently infer higher log-likelihoods for OOD data than data they were trained on, marking an open problem. In this work, we analyse using the gradient of a data point with respect to the parameters of the deep generative model for OOD detection, based on the simple intuition that OOD data should have larger gradient norms than training data. We formalise measuring the size of the gradient as approximating the Fisher information metric. We show that the Fisher information matrix (FIM) has large absolute diagonal values, motivating the use of chi-square distributed, layer-wise gradient norms as features. We combine these features to make a simple, model-agnostic and hyperparameter-free method for OOD detection which estimates the joint density of the layer-wise gradient norms for a given data point. We find that these layer-wise gradient norms are weakly correlated, rendering their combined usage informative, and prove that the layer-wise gradient norms satisfy the principle of (data representation) invariance. Our empirical results indicate that this method outperforms the Typicality test for most deep generative models and image dataset pairings.


title: An RBF partition of unity method for geometry reconstruction and PDE solution in thin structures

abstract: The main respiratory muscle, the diaphragm, is an example of a thin structure. We aim to perform detailed numerical simulations of the muscle mechanics based on individual patient data. This requires a representation of the diaphragm geometry extracted from medical image data. We design an adaptive reconstruction method based on a least-squares radial basis function partition of unity method. The method is adapted to thin structures by subdividing the structure rather than the surrounding space, and by introducing an anisotropic scaling of local subproblems. The resulting representation is an infinitely smooth level set function, which is stabilized such that there are no spurious zero level sets. We show reconstruction results for 2D cross sections of the diaphragm geometry as well as for the full 3D geometry. We also show solutions to basic PDE test problems in the reconstructed geometries.


title: InfiMM-HD: A Leap Forward in High-Resolution Multimodal Understanding

abstract: Multimodal Large Language Models (MLLMs) have experienced significant advancements recently. Nevertheless, challenges persist in the accurate recognition and comprehension of intricate details within high-resolution images. Despite being indispensable for the development of robust MLLMs, this area remains underinvestigated. To tackle this challenge, our work introduces InfiMM-HD, a novel architecture specifically designed for processing images of different resolutions with low computational overhead. This innovation facilitates the enlargement of MLLMs to higher-resolution capabilities. InfiMM-HD incorporates a cross-attention module and visual windows to reduce computation costs. By integrating this architectural design with a four-stage training pipeline, our model attains improved visual perception efficiently and cost-effectively. Empirical study underscores the robustness and effectiveness of InfiMM-HD, opening new avenues for exploration in related areas. Codes and models can be found at https://huggingface.co/Infi-MM/infimm-hd


title: Analytic weak-stable manifolds in unfoldings of saddle-nodes

abstract: Any attracting, hyperbolic and proper node of a two-dimensional analytic vector-field has a unique strong-stable manifold. This manifold is analytic. The corresponding weak-stable manifolds are, on the other hand, not unique, but in the nonresonant case there is a unique weak-stable manifold that is analytic. As the system approaches a saddle-node (under parameter variation), a sequence of resonances (of increasing order) occur. In this paper, we give a detailed description of the analytic weak-stable manifolds during this process. In particular, we relate a ``flapping-mechanism'', corresponding to a dramatic change of the position of the analytic weak-stable manifold as the parameter passes through the infinitely many resonances, to the lack of analyticity of the center manifold at the saddle-node. Our work is motivated and inspired by the work of Merle, Rapha\"{e}l, Rodnianski, and Szeftel, where this flapping mechanism is the crucial ingredient in the construction of $C^\infty$-smooth self-similar solutions of the compressible Euler equations.


title: Regeneration Based Training-free Attribution of Fake Images Generated by Text-to-Image Generative Models

abstract: Text-to-image generative models have recently garnered significant attention due to their ability to generate images based on prompt descriptions. While these models have shown promising performance, concerns have been raised regarding the potential misuse of the generated fake images. In response to this, we have presented a simple yet effective training-free method to attribute fake images generated by text-to-image models to their source models. Given a test image to be attributed, we first inverse the textual prompt of the image, and then put the reconstructed prompt into different candidate models to regenerate candidate fake images. By calculating and ranking the similarity of the test image and the candidate images, we can determine the source of the image. This attribution allows model owners to be held accountable for any misuse of their models. Note that our approach does not limit the number of candidate text-to-image generative models. Comprehensive experiments reveal that (1) Our method can effectively attribute fake images to their source models, achieving comparable attribution performance with the state-of-the-art method; (2) Our method has high scalability ability, which is well adapted to real-world attribution scenarios. (3) The proposed method yields satisfactory robustness to common attacks, such as Gaussian blurring, JPEG compression, and Resizing. We also analyze the factors that influence the attribution performance, and explore the boost brought by the proposed method as a plug-in to improve the performance of existing SOTA. We hope our work can shed some light on the solutions to addressing the source of AI-generated images, as well as to prevent the misuse of text-to-image generative models.


title: Time delay interferometry with minimal null frequencies

abstract: Time delay interferometry (TDI) is a key technique employed in gravitational wave (GW) space missions to mitigate laser frequency noise by combining multiple laser links and establishing an equivalent equal arm interferometry. The null frequencies will be introduced in noise spectra and GW response when the periodical signal/noise is canceled in synthesized laser links. These frequencies are characteristic frequencies (CFs) of a TDI which related to its geometry of combination. In this work, we implement a second-generation TDI configuration referred to as hybrid Relay to perform noise suppressions and data analysis, whose CFs are only one-quarter that of the fiducial second-generation Michelson observables. We examine the performance of TDI configuration in laser noise cancellation and clock noise suppression and justify its essential capabilities. To assess its robustness for signal extraction, we simulate data containing GW signals from massive black hole binaries and perform parameter inferences with comparisons against the fiducial Michelson TDI configuration. The results demonstrate that the alternative TDI solution could be more robust than Michelson in fulfilling data analysis.


title: Ultimate linear block and convolutional codes

abstract: A linear block code over a field can be derived from a unit scheme. Looking at codes as structures within a unit scheme greatly extends the availability of linear block and convolutional codes and allows the construction of the codes to required length, rate, distance and type. Properties of a code emanate from properties of the unit from which it was derived. Orthogonal units, units in group rings, Fourier/Vandermonde units and related units are used to construct and analyse linear block and convolutional codes and to construct these to predefined length, rate, distance and type. Self-dual, dual containing, quantum error-correcting and complementary dual linear block and convolutional codes are constructed. Low density parity check linear block and convolutional codes are constructed using group rings and are constructed with no short cycles in the control matrix. From a single unit, multiple codes of a required type are derivable.


title: Some results on total weight choosability

abstract: A graph $G=(V,E)$ is called $(k,k')$-choosable if for any total list assignment $L$ which assigns to each vertex $v$ a set $L(v)$ of $k$ real numbers, and assigns to each edge $e$ a set $L(e)$ of $k'$ real numbers, there is a mapping $f:V\cup E\rightarrow \mathbb{R}$ such that $f(y)\in L(y)$ for any $y\in V\cup E$ and for any two adjacent vertices $v, v'$, $\sum_{e\in E(v)}f(e)+f(v)\neq \sum_{e\in E(v')}f(e)+f(v')$, where $E(x)$ denotes the set of incident edges of a vertex $x\in V(G)$. In this paper, we characterize a sufficient condition on $(1,2)$-choosable of graphs. We show that every connected $(n,m)$-graph is both $(2,2)$-choosable and $(1,3)$-choosable if $m=n$ or $n+1$, where $(n,m)$-graph denotes the graph with $n$ vertices and $m$ edges. Furthermore, we prove that some graphs obtained by some graph operations are $(2,2)$-choosable.


title: ConvTimeNet: A Deep Hierarchical Fully Convolutional Model for Multivariate Time Series Analysis

abstract: This paper introduces ConvTimeNet, a novel deep hierarchical fully convolutional network designed to serve as a general-purpose model for time series analysis. The key design of this network is twofold, designed to overcome the limitations of traditional convolutional networks. Firstly, we propose an adaptive segmentation of time series into sub-series level patches, treating these as fundamental modeling units. This setting avoids the sparsity semantics associated with raw point-level time steps. Secondly, we design a fully convolutional block by skillfully integrating deepwise and pointwise convolution operations, following the advanced building block style employed in Transformer encoders. This backbone network allows for the effective capture of both global sequence and cross-variable dependence, as it not only incorporates the advancements of Transformer architecture but also inherits the inherent properties of convolution. Furthermore, multi-scale representations of given time series instances can be learned by controlling the kernel size flexibly. Extensive experiments are conducted on both time series forecasting and classification tasks. The results consistently outperformed strong baselines in most situations in terms of effectiveness.The code is publicly available.


title: PAVITS: Exploring Prosody-aware VITS for End-to-End Emotional Voice Conversion

abstract: In this paper, we propose Prosody-aware VITS (PAVITS) for emotional voice conversion (EVC), aiming to achieve two major objectives of EVC: high content naturalness and high emotional naturalness, which are crucial for meeting the demands of human perception. To improve the content naturalness of converted audio, we have developed an end-to-end EVC architecture inspired by the high audio quality of VITS. By seamlessly integrating an acoustic converter and vocoder, we effectively address the common issue of mismatch between emotional prosody training and run-time conversion that is prevalent in existing EVC models. To further enhance the emotional naturalness, we introduce an emotion descriptor to model the subtle prosody variations of different speech emotions. Additionally, we propose a prosody predictor, which predicts prosody features from text based on the provided emotion label. Notably, we introduce a prosody alignment loss to establish a connection between latent prosody features from two distinct modalities, ensuring effective training. Experimental results show that the performance of PAVITS is superior to the state-of-the-art EVC methods. Speech Samples are available at https://jeremychee4.github.io/pavits4EVC/ .


title: Thermodynamics of the arbitrary dimensional FRW universe: Joule-Thomson expansion

abstract: In this paper, we investigate the thermodynamics especially the Joule-Thomson expansion of the $n$-dimensional FRW (Friedmann-Robertson-Walker) universe with a perfect fluid. We derive the thermodynamic equations of state $P=P(V, T)$ for the $n$-dimensional FRW universe in Einstein gravity and Einstein-Gauss-Bonnet gravity, where the thermodynamic pressure $P$ defined by the work density $W$ of the perfect fluid, $i.e.$ $P\equiv W$. Furthermore, we present the Joule-Thomson expansion as an application of these equations of state to elucidate the cooling-heating properties of the $n$-dimensional FRW universe. We determine the inversion temperature and inversion pressure in the FRW universe with arbitrary dimensions for the first time, and illustrate the characteristics of inversion curves and isenthalpic curves in the $T$-$P$ plane. This study offers insights into deepening our comprehension of cooling and heating regions in the FRW universe, thereby revealing its expansion mechanisms.


title: A face-centred finite volume method for laminar and turbulent incompressible flows

abstract: This work develops, for the first time, a face-centred finite volume (FCFV) solver for the simulation of laminar and turbulent viscous incompressible flows. The formulation relies on the Reynolds-averaged Navier-Stokes (RANS) equations coupled with the negative Spalart-Allmaras (SA) model and three novel convective stabilisations, inspired by Riemann solvers, are derived and compared numerically. The resulting method achieves first-order convergence of the velocity, the velocity-gradient tensor and the pressure. FCFV accurately predicts engineering quantities of interest, such as drag and lift, on unstructured meshes and, by avoiding gradient reconstruction, the method is less sensitive to mesh quality than other FV methods, even in the presence of highly distorted and stretched cells. A monolithic and a staggered solution strategies for the RANS-SA system are derived and compared numerically. Numerical benchmarks, involving laminar and turbulent, steady and transient cases are used to assess the performance, accuracy and robustness of the proposed FCFV method.


title: Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancement

abstract: Underwater visuals undergo various complex degradations, inevitably influencing the efficiency of underwater vision tasks. Recently, diffusion models were employed to underwater image enhancement (UIE) tasks, and gained SOTA performance. However, these methods fail to consider the physical properties and underwater imaging mechanisms in the diffusion process, limiting information completion capacity of diffusion models. In this paper, we introduce a novel UIE framework, named PA-Diff, designed to exploiting the knowledge of physics to guide the diffusion process. PA-Diff consists of Physics Prior Generation (PPG) Branch, Implicit Neural Reconstruction (INR) Branch, and Physics-aware Diffusion Transformer (PDT) Branch. Our designed PPG branch aims to produce the prior knowledge of physics. With utilizing the physics prior knowledge to guide the diffusion process, PDT branch can obtain underwater-aware ability and model the complex distribution in real-world underwater scenes. INR Branch can learn robust feature representations from diverse underwater image via implicit neural representation, which reduces the difficulty of restoration for PDT branch. Extensive experiments prove that our method achieves best performance on UIE tasks.


title: On the anticyclotomic Mazur-Tate conjecture for elliptic curves with supersingular reduction

abstract: In this short note, we study the anticyclotomic analogue of the "weak" main conjecture of Mazur-Tate on Fitting ideals of Selmer groups for elliptic curves with supersingular reduction.


title: Normalising Flow-based Differentiable Particle Filters

abstract: Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian state-space models in complex environments. Existing differentiable particle filters are mostly constructed with vanilla neural networks that do not allow density estimation. As a result, they are either restricted to a bootstrap particle filtering framework or employ predefined distribution families (e.g. Gaussian distributions), limiting their performance in more complex real-world scenarios. In this paper we present a differentiable particle filtering framework that uses (conditional) normalising flows to build its dynamic model, proposal distribution, and measurement model. This not only enables valid probability densities but also allows the proposed method to adaptively learn these modules in a flexible way, without being restricted to predefined distribution families. We derive the theoretical properties of the proposed filters and evaluate the proposed normalising flow-based differentiable particle filters' performance through a series of numerical experiments.


title: On the adjoint Selmer groups of semi-stable elliptic curves and Flach's zeta elements

abstract: We explicitly construct the rank one primitive Stark (equivalently, Kolyvagin) system extending a constant multiple of Flach's zeta elements for semi-stable elliptic curves. As its arithmetic applications, we obtain the equivalence between a specific behavior of the Stark system and the minimal modularity lifting theorem, and we also discuss the cyclicity of the adjoint Selmer groups. This Stark system construction yields a more refined interpretation of the collection of Flach's zeta elements than the "geometric Euler system" approach due to Flach, Wiles, Mazur, and Weston.


title: Applying Self-supervised Learning to Network Intrusion Detection for Network Flows with Graph Neural Network

abstract: Graph Neural Networks (GNNs) have garnered intensive attention for Network Intrusion Detection System (NIDS) due to their suitability for representing the network traffic flows. However, most present GNN-based methods for NIDS are supervised or semi-supervised. Network flows need to be manually annotated as supervisory labels, a process that is time-consuming or even impossible, making NIDS difficult to adapt to potentially complex attacks, especially in large-scale real-world scenarios. The existing GNN-based self-supervised methods focus on the binary classification of network flow as benign or not, and thus fail to reveal the types of attack in practice. This paper studies the application of GNNs to identify the specific types of network flows in an unsupervised manner. We first design an encoder to obtain graph embedding, that introduces the graph attention mechanism and considers the edge information as the only essential factor. Then, a self-supervised method based on graph contrastive learning is proposed. The method samples center nodes, and for each center node, generates subgraph by it and its direct neighbor nodes, and corresponding contrastive subgraph from the interpolated graph, and finally constructs positive and negative samples from subgraphs. Furthermore, a structured contrastive loss function based on edge features and graph local topology is introduced. To the best of our knowledge, it is the first GNN-based self-supervised method for the multiclass classification of network flows in NIDS. Detailed experiments conducted on four real-world databases (NF-Bot-IoT, NF-Bot-IoT-v2, NF-CSE-CIC-IDS2018, and NF-CSE-CIC-IDS2018-v2) systematically compare our model with the state-of-the-art supervised and self-supervised models, illustrating the considerable potential of our method. Our code is accessible through https://github.com/renj-xu/NEGSC.


title: Oscillating-charged Andreev Bound States and Their Appearance in UTe$_2$

abstract: In a superconductor with a sublattice degree of freedom, we find unconventional Andreev bound states whose charge density oscillates in sign between the two sublattices. The appearance of these oscillating-charged Andreev bound states is characterized by a Zak phase, rather than a conventional topological invariant. In contrast to conventional Andreev bound states, for oscillating-charged Andreev bound states the proportionality between the electron-like spectral function, the local density of states and the tunneling conductance is broken. We examine the possible appearance of these novel Andreev bound states in UTe$_2$ and locally noncentrosymmetric superconductors.


title: Stochastic star formation in the Milky Way inferred from the unity index of KS law

abstract: We performed a correlation analysis between the brightness temperature of the CO line and number density of HII regions in the longitude--velocity diagram (LVD) of the Milky Way in order to investigate the volumetric star-formation law. We determined the index $\alpha$ of the Kennicutt-Schmidt (KS) law for the molecular gas defined by $\rho_{\rm SFR} \propto \rho_{\rm H_2}^\alpha$, where $\rho_{\rm SFR}$ is the SFR (star-formation rate) density and $\rho_{\rm H_2}$ is the molecular-gas density. We obtained $\alpha= 1.053 \pm 0.075$ and $1.031 \pm 0.067$ for the CO-line data from the Nobeyama 45-m and Columbia 1.2-m telescope Galactic plane surveys, respectively. This result is consistent with the KS indices currently determined for the molecular gas in the Milky Way as well as in spiral and starburst galaxies. We argue that an index close to 1 is universal in favour of stochastic (spontaneous) star formation, but is inconsistent with cloud-collision model, which predicts a steeper index of $\alpha=2$. We also suggest that the efficiency of star formation in the Galactic Centre is an order of magnitude lower than that in the disc.


title: Spin and Orbital Angular Momenta of Electromagnetic Waves: From Classical to Quantum Forms

abstract: Angular momenta of electromagnetic waves are important both in concepts and applications. In this work, we systematically discuss two types of angular momenta, i.e., spin angular momentum and orbital angular momentum in various cases, e.g., with source and without source, in classical and quantum forms. Numerical results demonstrating how to extract the topological charge of a classical vortex beam by spectral method are also presented.

categories: physics.optics math-ph math.MP physics.app-ph


title: SCott: Accelerating Diffusion Models with Stochastic Consistency Distillation

abstract: The iterative sampling procedure employed by diffusion models (DMs) often leads to significant inference latency. To address this, we propose Stochastic Consistency Distillation (SCott) to enable accelerated text-to-image generation, where high-quality generations can be achieved with just 1-2 sampling steps, and further improvements can be obtained by adding additional steps. In contrast to vanilla consistency distillation (CD) which distills the ordinary differential equation solvers-based sampling process of a pretrained teacher model into a student, SCott explores the possibility and validates the efficacy of integrating stochastic differential equation (SDE) solvers into CD to fully unleash the potential of the teacher. SCott is augmented with elaborate strategies to control the noise strength and sampling process of the SDE solver. An adversarial loss is further incorporated to strengthen the sample quality with rare sampling steps. Empirically, on the MSCOCO-2017 5K dataset with a Stable Diffusion-V1.5 teacher, SCott achieves an FID (Frechet Inceptio Distance) of 22.1, surpassing that (23.4) of the 1-step InstaFlow (Liu et al., 2023) and matching that of 4-step UFOGen (Xue et al., 2023b). Moreover, SCott can yield more diverse samples than other consistency models for high-resolution image generation (Luo et al., 2023a), with up to 16% improvement in a qualified metric. The code and checkpoints are coming soon.


title: A new family of $2$-scattered subspaces and related MRD codes

abstract: Scattered subspaces and $h$-scattered subspaces have been extensively studied in recent decades for both theoretical purposes and their connections to various applications. While numerous constructions of scattered subspaces exist, relatively few are known about $h$-scattered subspaces with $h\geq2$. In this paper, we establish the existence of maximum $2$-scattered $\F_q$-subspaces in $V(r,q^6)$ whenever $r\geq 3$, $r\ne 5$, and $q$ is an odd power of $2$. Additionally, we explore the corresponding MRD codes.


title: ISSF: The Intelligent Security Service Framework for Cloud-Native Operation

abstract: The growing system complexity from microservice architectures and the bilateral enhancement of artificial intelligence (AI) for both attackers and defenders presents increasing security challenges for cloud-native operations. In particular, cloud-native operators require a holistic view of the dynamic security posture for the cloud-native environment from a defense aspect. Additionally, both attackers and defenders can adopt advanced AI technologies. This makes the dynamic interaction and benchmark among different intelligent offense and defense strategies more crucial. Hence, following the multi-agent deep reinforcement learning (RL) paradigm, this research develops an agent-based intelligent security service framework (ISSF) for cloud-native operation. It includes a dynamic access graph model to represent the cloud-native environment and an action model to represent offense and defense actions. Then we develop an approach to enable the training, publishing, and evaluating of intelligent security services using diverse deep RL algorithms and training strategies, facilitating their systematic development and benchmark. The experiments demonstrate that our framework can sufficiently model the security posture of a cloud-native system for defenders, effectively develop and quantitatively benchmark different services for both attackers and defenders and guide further service optimization.


title: Soft Reasoning on Uncertain Knowledge Graphs

abstract: The study of machine learning-based logical query-answering enables reasoning with large-scale and incomplete knowledge graphs. This paper further advances this line of research by considering the uncertainty in the knowledge. The uncertain nature of knowledge is widely observed in the real world, but \textit{does not} align seamlessly with the first-order logic underpinning existing studies. To bridge this gap, we study the setting of soft queries on uncertain knowledge, which is motivated by the establishment of soft constraint programming. We further propose an ML-based approach with both forward inference and backward calibration to answer soft queries on large-scale, incomplete, and uncertain knowledge graphs. Theoretical discussions present that our methods share the same complexity as state-of-the-art inference algorithms for first-order queries. Empirical results justify the superior performance of our approach against previous ML-based methods with number embedding extensions.


title: Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semantics

abstract: Large language models have achieved remarkable success in general language understanding tasks. However, as a family of generative methods with the objective of next token prediction, the semantic evolution with the depth of these models are not fully explored, unlike their predecessors, such as BERT-like architectures. In this paper, we specifically investigate the bottom-up evolution of lexical semantics for a popular LLM, namely Llama2, by probing its hidden states at the end of each layer using a contextualized word identification task. Our experiments show that the representations in lower layers encode lexical semantics, while the higher layers, with weaker semantic induction, are responsible for prediction. This is in contrast to models with discriminative objectives, such as mask language modeling, where the higher layers obtain better lexical semantics. The conclusion is further supported by the monotonic increase in performance via the hidden states for the last meaningless symbols, such as punctuation, in the prompting strategy. Our codes are available at https://github.com/RyanLiut/LLM_LexSem.


title: End-to-End Human Instance Matting

abstract: Human instance matting aims to estimate an alpha matte for each human instance in an image, which is extremely challenging and has rarely been studied so far. Despite some efforts to use instance segmentation to generate a trimap for each instance and apply trimap-based matting methods, the resulting alpha mattes are often inaccurate due to inaccurate segmentation. In addition, this approach is computationally inefficient due to multiple executions of the matting method. To address these problems, this paper proposes a novel End-to-End Human Instance Matting (E2E-HIM) framework for simultaneous multiple instance matting in a more efficient manner. Specifically, a general perception network first extracts image features and decodes instance contexts into latent codes. Then, a united guidance network exploits spatial attention and semantics embedding to generate united semantics guidance, which encodes the locations and semantic correspondences of all instances. Finally, an instance matting network decodes the image features and united semantics guidance to predict all instance-level alpha mattes. In addition, we construct a large-scale human instance matting dataset (HIM-100K) comprising over 100,000 human images with instance alpha matte labels. Experiments on HIM-100K demonstrate the proposed E2E-HIM outperforms the existing methods on human instance matting with 50% lower errors and 5X faster speed (6 instances in a 640X640 image). Experiments on the PPM-100, RWP-636, and P3M datasets demonstrate that E2E-HIM also achieves competitive performance on traditional human matting.


title: Multiscale Biomolecular Simulations in the Exascale Era

abstract: The complexity of biological systems and processes, spanning molecular to macroscopic scales, necessitates the use of multiscale simulations to get a comprehensive understanding. Quantum mechanics/molecular mechanics (QM/MM) molecular dynamics (MD) simulations are crucial for capturing processes beyond the reach of classical MD simulations. The advent of exascale computing offers unprecedented opportunities for scientific exploration, not least within life sciences, where simulations are essential to unravel intricate molecular mechanisms underlying biological processes. However, leveraging the immense computational power of exascale computing requires innovative algorithms and software designs. In this context, we discuss the current status and future prospects of multiscale biomolecular simulations on exascale supercomputers with a focus on QM/MM MD. We highlight our own efforts in developing a versatile and high-performance multiscale simulation framework with the aim of efficient utilization of state-of-the-art supercomputers. We showcase its application in uncovering complex biological mechanisms and its potential for leveraging exascale computing.


title: Cooperative Automated Driving for Bottleneck Scenarios in Mixed Traffic

abstract: Connected automated vehicles (CAV), which incorporate vehicle-to-vehicle (V2V) communication into their motion planning, are expected to provide a wide range of benefits for individual and overall traffic flow. A frequent constraint or required precondition is that compatible CAVs must already be available in traffic at high penetration rates. Achieving such penetration rates incrementally before providing ample benefits for users presents a chicken-and-egg problem that is common in connected driving development. Based on the example of a cooperative driving function for bottleneck traffic flows (e.g. at a roadblock), we illustrate how such an evolutionary, incremental introduction can be achieved under transparent assumptions and objectives. To this end, we analyze the challenge from the perspectives of automation technology, traffic flow, human factors and market, and present a principle that 1) accounts for individual requirements from each domain; 2) provides benefits for any penetration rate of compatible CAVs between 0 % and 100 % as well as upward-compatibility for expected future developments in traffic; 3) can strictly limit the negative effects of cooperation for any participant and 4) can be implemented with close-to-market technology. We discuss the technical implementation as well as the effect on traffic flow over a wide parameter spectrum for human and technical aspects.