title: Coexisting steady-state solutions of a class of reaction-diffusion systems with different boundary conditions

abstract: In this work, we investigate a reaction-diffusion system in which both species are influenced by self-diffusion. Due to Hopf's boundary lemma, we obtain the boundedness of the classical solution of the system. By considering a particular function, we provide a complete characterization of the parameter ranges such that coexisting solutions of the system do not exist under three boundary conditions. Then based on the maximum principle, a sufficient condition for the existence of constant coexisting solutions of the system under Neumann boundary conditions was derived.


title: Temperature and Pressure Dependent Luminescence Mechanism of Zinc-Blende Structured ZnS:Mn Nanophosphor under UV and X-ray Excitations

abstract: A comprehensive photoluminescence and mechanoluminescence analysis of ZnS:Mn2+ nano-phosphor with zinc blende structure is presented. The sample containing quantum dot-sized nanocrystallites were synthesized by the chemical precipitation method and shows excellent orange luminescence at ambient conditions related to the 4T1->6A1 transition. The sample shows stable and identical luminescence behavior under both UV and X-ray excitation at ambient conditions and also shows excellent self-powered mechanoluminescence properties. The pressure and temperature-induced luminescence mechanism of the phosphor is also established. The shift of the 4T1->6A1 luminescence band of Mn2+ with both pressure and temperature and the luminescence mechanism is explained via the d5 Tanabe Sugano diagram. The broad luminescence band of 4T1->6A1 transition shifts from visible to near-infrared range at a rate of -35.8 meV/GPa with the increase of pressure and it is subsequently quenched completely at a pressure of 16.41 GPa due to a reversible phase transition from zinc blende to rocksalt phase. The high-pressure and temperature-dependent decay kinetics measurements of the sample luminescence are also reported.


title: A Survey on Federated Analytics: Taxonomy, Enabling Techniques, Applications and Open Issues

abstract: The escalating influx of data generated by networked edge devices, coupled with the growing awareness of data privacy, has promoted a transformative shift in computing paradigms from centralized data processing to privacy-preserved distributed data processing. Federated analytics (FA) is an emerging technique to support collaborative data analytics among diverse data owners without centralizing the raw data. Despite the wide applications of FA in industry and academia, a comprehensive examination of existing research efforts in FA has been notably absent. This survey aims to bridge this gap by first providing an overview of FA, elucidating key concepts, and discussing its relationship with similar concepts. We then conduct a thorough examination of FA, including its taxonomy, key challenges, and enabling techniques. Diverse FA applications, including statistical metrics, set computation, frequency-related applications, database query operations, model-based applications, FL-assisting FA tasks, and other wireless network applications are then carefully reviewed. We complete the survey with several open research issues and future directions. This survey intends to provide a holistic understanding of the emerging FA techniques and foster the continued evolution of privacy-preserving distributed data processing in the emerging networked society.


title: Detecting Out-Of-Distribution Earth Observation Images with Diffusion Models

abstract: Earth Observation imagery can capture rare and unusual events, such as disasters and major landscape changes, whose visual appearance contrasts with the usual observations. Deep models trained on common remote sensing data will output drastically different features for these out-of-distribution samples, compared to those closer to their training dataset. Detecting them could therefore help anticipate changes in the observations, either geographical or environmental. In this work, we show that the reconstruction error of diffusion models can effectively serve as unsupervised out-of-distribution detectors for remote sensing images, using them as a plausibility score. Moreover, we introduce ODEED, a novel reconstruction-based scorer using the probability-flow ODE of diffusion models. We validate it experimentally on SpaceNet 8 with various scenarios, such as classical OOD detection with geographical shift and near-OOD setups: pre/post-flood and non-flooded/flooded image recognition. We show that our ODEED scorer significantly outperforms other diffusion-based and discriminative baselines on the more challenging near-OOD scenarios of flood image detection, where OOD images are close to the distribution tail. We aim to pave the way towards better use of generative models for anomaly detection in remote sensing.


title: Nucleon microscopy in proton-nucleus scattering via analysis of bremsstrahlung emission: role of incoherent emission

abstract: We study electromagnetic form factors of protons in proton-nucleus scattering via analysing of experimental cross-sections of accompanying bremsstrahlung photons. A new bremsstrahlung model for proton-nucleus scattering is developed, where a main focus is given on incoherent bremsstrahlung that has not been considered previously. In analysis we choose experimental bremsstrahlung data of $p$ + $^{197}$Au scattering at proton beam energy of 190 MeV obtained by TAPS collaboration. We find the following. (1) Inclusion of incoherent emission to calculations improves agreements with experimental data essentially, contribution of incoherent bremsstrahlung is essentially larger than coherent one. (2) Inclusion of form factors of the scattered proton improves agreement with experimental data in comparison with calculations with coherent and incoherent contributions without form factors. (3) Sensitivity of model in study of form factors of the scattered proton is high. This demonstrates a new opportunity to study internal structure of protons under influence of nuclear forces in nuclear scattering.


title: Comparison of Two-Moment and Three-Moment Bulk Microphysics Schemes in Thunderstorm Simulations over Indian Subcontinent

abstract: We have performed three-dimensional thunderstorm real simulations using the two-moment and three-moment bulk microphysics schemes in the Weather Research and Forecasting (WRF) model. We have analyzed three cases to understand the potential differences between the double-moment (Morrison-2M) and National Taiwan University triple-moment (NTU-3M) microphysics parameterizations in capturing the characteristics of lightning events over the Indian subcontinent. Despite general resemblances in these schemes, the simulations reveal distinct differences in storm structure, cloud hydrometeors formation, and precipitation. The lightning flash counts from the in situ lightning detection network (LDN) are also used to compare the simulation of storms. The Lightning Potential Index (LPI) is computed for Morrison-2M and NTU-3M microphysics schemes and compared it with the Lightning Detection Network (LDN) observation. In most cases, the Morrison-2M shows more LPI than the NTU-3M scheme. Both the schemes also differ in simulating rainfall and other thermodynamical, dynamical, and microphysical parameters in the model. Here, we have attempted to identify the basic differences between these two schemes, which may be responsible for the discrepancies in the simulations. In particular, the Morrison-2M produced much higher surface precipitation rates. The effects on the size distributions cloud hydrometeors between two microphysical schemes are important to simulate the biases in the precipitation and lightning flash counts. The inclusions of ice crystal shapes are responsible for many of the key differences between the two microphysics simulations. Different approaches in treating cloud ice, snow, and graupel may have an impact on the simulation of lightning and precipitation. Results show that the simulation of lightning events is sensitive to microphysical parameterization schemes in NWP models.


title: Towards Human-centered Proactive Conversational Agents

abstract: Recent research on proactive conversational agents (PCAs) mainly focuses on improving the system's capabilities in anticipating and planning action sequences to accomplish tasks and achieve goals before users articulate their requests. This perspectives paper highlights the importance of moving towards building human-centered PCAs that emphasize human needs and expectations, and that considers ethical and social implications of these agents, rather than solely focusing on technological capabilities. The distinction between a proactive and a reactive system lies in the proactive system's initiative-taking nature. Without thoughtful design, proactive systems risk being perceived as intrusive by human users. We address the issue by establishing a new taxonomy concerning three key dimensions of human-centered PCAs, namely Intelligence, Adaptivity, and Civility. We discuss potential research opportunities and challenges based on this new taxonomy upon the five stages of PCA system construction. This perspectives paper lays a foundation for the emerging area of conversational information retrieval research and paves the way towards advancing human-centered proactive conversational systems.


title: Disentangling gamma-beta: the 4th-order velocity moments based on spherical Jeans analysis

abstract: Distinguishing a core and a cusp within dark matter halos is complexified by the existence of mass-anisotropy degeneracy, where various combinations of velocity anisotropy ($\beta$) and inner density slope ($\gamma$) yield similar observational signatures. We construct a dynamical model that incorporates the 4th-order velocity moments to alleviate this challenge. The inclusion of the 4th-order velocity moments enables stars' line-of-sight velocity distribution (LOSVD) to be flexible. This flexible LOSVD can cover from a thin-tailed to a heavy-tailed distribution that is inaccessible if only the 2nd-order moments are considered. We test our dynamical model using mock galaxies and find that a ratio of the global line-of-sight velocity dispersion of the mock galaxy to the velocity error measurement $\sigma_{\mathrm{los,global}} / \Delta v_{\mathrm{los}} \gtrsim 4$ is required to avoid obtaining systematically biased results. This bias arises from the strong dependency of the 4th-order moments on the LOSVD tails, and not even increasing the sample size to $10^4$ stars can mitigate this effect. In that velocity ratio, $\beta$ is recovered within $\sim 1 \sigma$ even when the sample size is only 500 stars, regardless of the recovery of the other parameters. However, the estimation of $\gamma$ varies, depending on the degree to which LOSVDs deviate from Gaussianity. Because of the more significant change in its LOSVDs, a cored dark halo is more likely to be identified than a cusp.


title: Speeding up VSLMS adaptation algorithms using dynamic adaptation gain: Analysis and Applications

abstract: The paper explores the use of dynamic adaptation gain/step size (DAG) for improving the adaptation transient performance of variable step-size LMS (VS-LMS) adaptation algorithms. A generic form for the implementation of the DAG within the VS-LMS algorithms is provided. The properties of the VS-LMS algorithms using dynamic adaptation gain are discussed in detail. Stability issues in deterministic environment and convergence properties in stochastic environment are examined. A transient performance analysis is proposed. Criteria for the selection of the coefficients of the DAG filter are provided.The potential of the VS-LMS adaptation algorithms using a DAG is then illustrated by simulation results (adaptive line enhancer, filter identification) and experimental results obtained on a relevant adaptive active noise attenuation system.


title: Enhanced plasma ion heating by lasers in inhomogeneous external magnetic field

abstract: Recent studies have shown direct ion heating (vashistha2020new,Juneja_2023) by lasers EM (Electromagnetic) wave interacting with a plasma threaded by an external uniform magnetic field. The EM wave frequency was near the lower hybrid (LH) resonance frequency. The LH resonance occurs at the edge of the pass band of the magnetized dispersion relation. The group speed of the wave is negligible at resonance. In these studies, the energy absorption remains essentially confined at the plasma surface. However, to heat the ions in the bulk plasma and at a desired location, a tailored inhomogeneous external magnetic field profile has been chosen here. The strength of the magnetic field at the plasma edge is such that the EM wave frequency lies inside the pass band, where the group velocity has a significant value. It enables the wave to enter the bulk plasma. The external magnetic field is then spatially tailored appropriately to have the LH resonance at a desired spatial location inside the plasma. The Particle-In-Cell (PIC) simulations using the OSIRIS4.0 platform have been carried out, which demonstrates that the EM wave pulse comes to a standstill at the location of the resonance. The wave pulse is observed to break down subsequently, and the energy consequently goes dominantly to the local plasma ions. The absorption is significantly enhanced compared to the case in which the magnetic field profile was homogeneous. The dependence of absorption on the choice of magnetic field profile, the laser intensity, etc., has also been carried out.


title: Towards Universal Performance Modeling for Machine Learning Training on Multi-GPU Platforms

abstract: Characterizing and predicting the training performance of modern machine learning (ML) workloads on compute systems with compute and communication spread between CPUs, GPUs, and network devices is not only the key to optimization and planning but also a complex goal to achieve. The primary challenges include the complexity of synchronization and load balancing between CPUs and GPUs, the variance in input data distribution, and the use of different communication devices and topologies (e.g., NVLink, PCIe, network cards) that connect multiple compute devices, coupled with the desire for flexible training configurations. Built on top of our prior work for single-GPU platforms, we address these challenges and enable multi-GPU performance modeling by incorporating (1) data-distribution-aware performance models for embedding table lookup, and (2) data movement prediction of communication collectives, into our upgraded performance modeling pipeline equipped with inter-and intra-rank synchronization for ML workloads trained on multi-GPU platforms. Beyond accurately predicting the per-iteration training time of DLRM models with random configurations with a geomean error of 5.21% on two multi-GPU platforms, our prediction pipeline generalizes well to other types of ML workloads, such as Transformer-based NLP models with a geomean error of 3.00%. Moreover, even without actually running ML workloads like DLRMs on the hardware, it is capable of generating insights such as quickly selecting the fastest embedding table sharding configuration (with a success rate of 85%).


title: ESPM-D: Efficient Sparse Polynomial Multiplication for Dilithium on ARM Cortex-M4 and Apple M2

abstract: Dilithium is a lattice-based digital signature scheme standardized by the NIST post-quantum cryptography (PQC) project. In this study, we focus on developing efficient sparse polynomial multiplication implementations of Dilithium for ARM Cortex-M4 and Apple M2, which are both based on the ARM architecture. The ARM Cortex-M4 is commonly utilized in resource-constrained devices such as sensors. Conversely, the Apple M2 is typically found on mobile devices, emphasizing high performance and versatility. Accordingly, our optimization strategies differ between ARM Cortex-M4 and Apple M2. We prioritize optimizing stack usage for the former while enhancing computational efficiency for the latter. Our optimized sparse polynomial multiplication achieves significant speedups of up to 30% on ARM Cortex-M4 and 55% on Apple M2 compared to the state-of-the-art Number-Theoretic Transform (NTT) implementation. Additionally, we integrate the sparse polynomial multiplication with the infinity norm judgments in the Dilithium signing process, further enhancing signing efficiency. Our optimized implementation not only reduces stack usage by 10.8%, 1.2%, and 7.7% in the signing procedure of Dilithium2, Dilithium3, and Dilithium5, respectively, but also enhances signing performance by 0.4% to 0.8% compared to the state-of-the-art ARM Cortex-M4 implementation. Furthermore, we optimize polynomial sampling, rounding functions, and polynomial packing and unpacking using ARM Cortex-M4 DSP instructions, resulting in a 0.4%-3.2% improvement in key generation and verification procedures. On the MacBook Air 2022, our Dilithium implementation achieves 10% to 11% speedups in the signing procedure. To the best of our knowledge, our work sets new performance records for Dilithium on both ARM Cortex-M4 and Apple M2 platforms.


title: Teaching Divisibility and Binomials with Coq

abstract: The goal of this contribution is to provide worksheets in Coq for students to learn about divisibility and binomials. These basic topics are a good case study as they are widely taught in the early academic years (or before in France). We present here our technical and pedagogical choices and the numerous exercises we developed. As expected, it required additional Coq material such as other lemmas and dedicated tactics. The worksheets are freely available and flexible in several ways.


title: Deciding factor for detecting a particle within a subspace via dark and bright states

abstract: In a measurement-induced continuous-time quantum walk, we address the problem of detecting a particle in a subspace, instead of a fixed position. In this configuration, we develop an approach of bright and dark states based on the unit and vanishing detection probability respectively for a particle-detection in the subspace. Specifically, by employing the rank-nullity theorem, we determine several properties of dark and bright states in terms of energy spectrum of the Hamiltonian used for a quantum walk and the projectors applied to detect the subspace. We provide certain conditions on the position and the rank of the subspace to be detected, resulting in the unit total detection probability, which has broad implications for quantum computing. Further, we illustrate the forms of dark as well as bright states and the dependence of detection probability on the number of dark states by considering a cyclic graph with nearest-neighbor and next nearest-neighbor hopping. Moreover, we observe that the divergence in the average number of measurements for detecting a particle successfully in a subspace can be reduced by performing high rank projectors.


title: Exploring Interactive Semantic Alignment for Efficient HOI Detection with Vision-language Model

abstract: Human-Object Interaction (HOI) detection aims to localize human-object pairs and comprehend their interactions. Recently, two-stage transformer-based methods have demonstrated competitive performance. However, these methods frequently focus on object appearance features and ignore global contextual information. Besides, vision-language model CLIP which effectively aligns visual and text embeddings has shown great potential in zero-shot HOI detection. Based on the former facts, We introduce a novel HOI detector named ISA-HOI, which extensively leverages knowledge from CLIP, aligning interactive semantics between visual and textual features. We first extract global context of image and local features of object to Improve interaction Features in images (IF). On the other hand, we propose a Verb Semantic Improvement (VSI) module to enhance textual features of verb labels via cross-modal fusion. Ultimately, our method achieves competitive results on the HICO-DET and V-COCO benchmarks with much fewer training epochs, and outperforms the state-of-the-art under zero-shot settings.


title: MLSD-GAN -- Generating Strong High Quality Face Morphing Attacks using Latent Semantic Disentanglement

abstract: Face-morphing attacks are a growing concern for biometric researchers, as they can be used to fool face recognition systems (FRS). These attacks can be generated at the image level (supervised) or representation level (unsupervised). Previous unsupervised morphing attacks have relied on generative adversarial networks (GANs). More recently, researchers have used linear interpolation of StyleGAN-encoded images to generate morphing attacks. In this paper, we propose a new method for generating high-quality morphing attacks using StyleGAN disentanglement. Our approach, called MLSD-GAN, spherically interpolates the disentangled latents to produce realistic and diverse morphing attacks. We evaluate the vulnerability of MLSD-GAN on two deep-learning-based FRS techniques. The results show that MLSD-GAN poses a significant threat to FRS, as it can generate morphing attacks that are highly effective at fooling these systems.


title: VoxAtnNet: A 3D Point Clouds Convolutional Neural Network for Generalizable Face Presentation Attack Detection

abstract: Facial biometrics are an essential components of smartphones to ensure reliable and trustworthy authentication. However, face biometric systems are vulnerable to Presentation Attacks (PAs), and the availability of more sophisticated presentation attack instruments such as 3D silicone face masks will allow attackers to deceive face recognition systems easily. In this work, we propose a novel Presentation Attack Detection (PAD) algorithm based on 3D point clouds captured using the frontal camera of a smartphone to detect presentation attacks. The proposed PAD algorithm, VoxAtnNet, processes 3D point clouds to obtain voxelization to preserve the spatial structure. Then, the voxelized 3D samples were trained using the novel convolutional attention network to detect PAs on the smartphone. Extensive experiments were carried out on the newly constructed 3D face point cloud dataset comprising bona fide and two different 3D PAIs (3D silicone face mask and wrap photo mask), resulting in 3480 samples. The performance of the proposed method was compared with existing methods to benchmark the detection performance using three different evaluation protocols. The experimental results demonstrate the improved performance of the proposed method in detecting both known and unknown face presentation attacks.


title: Les valeurs linguistiques et culturelles des documents num{\'e}riques et leur traitement s{\'e}mantique dans les syst{\`e}mes d'information {\'e}lectroniques

abstract: The digital document evolves rapidly and spectacularly in its structure and information content conveyed on networks and information systems. Generally understood as a neutral support for information carrying a semantic value, the digital document nevertheless carries parameters that denote certain cultural and linguistic values specific to its creator. This document attempts to emphasize some technical aspects that reflect this intrinsic identity of electronic documents. The objective is to define a set of parameters and recommendations capable of preserving the digital document a cultural and linguistic identity which will identify it to its potential users in open and distributed information systems. Ultimately, it aims to offer "good practice" recommendations for producers of fully or partially Arabic digital documents.


title: Floquet engineering tunable periodic gauge fields and simulating real topological phases in cold alkaline-earth atom optical lattice

abstract: We propose to synthesize tunable periodic gauge fields via Floquet engineering cold alkaline-earth atoms in one-dimensional optical lattice. The artificial magnetic flux is designed to emerge during the combined process of Floquet photon assisted tunneling and internal state transitions. By varying initial phases of driving protocol, our proposal presents the ability to smoothly tune the periodic flux. Moreover, we demonstrate that the effective two-leg flux ladder model can simulate one typical real topological insulator, which is described by the first Stiefel Whitney class and protected by the $PT$ symmetry. Benefiting from the long lifetime of excited states of alkaline-earth atoms, our work opens new possibilities for exploiting the physics related to gauge fields, such as topological phases, in the current cold atom platform.


title: A Containerized Microservice Architecture for a ROS 2 Autonomous Driving Software: An End-to-End Latency Evaluation

abstract: The automotive industry is transitioning from traditional ECU-based systems to software-defined vehicles. A central role of this revolution is played by containers, lightweight virtualization technologies that enable the flexible consolidation of complex software applications on a common hardware platform. Despite their widespread adoption, the impact of containerization on fundamental real-time metrics such as end-to-end latency, communication jitter, as well as memory and CPU utilization has remained virtually unexplored. This paper presents a microservice architecture for a real-world autonomous driving application where containers isolate each service. Our comprehensive evaluation shows the benefits in terms of end-to-end latency of such a solution even over standard bare-Linux deployments. Specifically, in the case of the presented microservice architecture, the mean end-to-end latency can be improved by 5-8 %. Also, the maximum latencies were significantly reduced using container deployment.


title: Estimating weak periodic vector autoregressive time series

abstract: This article develops the asymptotic distribution of the least squares estimator of the model parameters in periodicvector autoregressive time series models (hereafter PVAR) with uncorrelated but dependent innovations. When theinnovations are dependent, this asymptotic distributions can be quite different from that of PVAR models with in-dependent and identically distributed (iid for short) innovations developed in Ursu and Duchesne (2009). Modifiedversions of the Wald tests are proposed for testing linear restrictions on the parameters. These asymptotic results are illustrated by Monte Carlo experiments. An application to a bivariate real financial data is also proposed


title: Portmanteau test for a class of multivariate asymmetric power GARCH model

abstract: We establish the asymptotic behaviour of the sum of squared residuals autocovariances and autocorrelations for the class of multi-variate power transformed asymmetric models. We then derive a portmanteau test. We establish the asymptotic distribution of the proposed statistics. These asymptotic results are illustrated by Monte Carlo experiments. An application to a bivariate real financial data is also proposed.


title: The MONUMENT Experiment: Ordinary Muon Capture studies for 0$\nu\beta\beta$ decay

abstract: The MONUMENT experiment measures ordinary muon capture (OMC) on isotopes relevant for neutrinoless double-beta (0$\nu\beta\beta$) decay and nuclear astrophysics. OMC is a particularly attractive tool for improving the theoretical description of 0$\nu\beta\beta$ decay. It involves similar momentum transfers and allows testing the virtual transitions involved in 0$\nu\beta\beta$ decay against experimental data. During the 2021 campaign, MONUMENT measured OMC on $^{76}$Se and $^{136}$Ba, the isotopes relevant for next-generation 0$\nu\beta\beta$ decay searches, like LEGEND and nEXO. The experimental setup has been designed to accurately extract the total and partial muon capture rates, which requires precise reconstruction of energies and time-dependent intensities of the OMC-related $\gamma$ rays. The setup also includes a veto counter system to allow selecting a clean sample of OMC events. This work provides a detailed description of the MONUMENT setup operated during the 2021 campaign, its two DAQ systems, calibration and analysis approaches, and summarises the achieved detector performance. Future improvements are also discussed.


title: Electronic structure and resonant inelastic x-ray scattering in Ca3Ru2O7

abstract: We have investigated the electronic structure of the transition metal oxide Ca3Ru2O7 within density functional theory using the generalized gradient approximation while considering strong Coulomb correlations in the framework of the fully relativistic spin-polarized Dirac linear muffin-tin orbital band-structure method. Ca3Ru2O7 can be classified as a Mott insulator since it was expected to be metallic from band structure calculations. We have investigated the resonant inelastic x-ray scattering spectra at the Ru and Ca K, L3, and M3 edges as well as at the O K edge. The experimentally measured resonance inelastic x-ray spectrum of Ca3Ru2O7 at the Ru L3 edge possesses a sharp feature below 2 electron-volts corresponding to transitions within the Ru t_2g levels. The excitation located from 2 to 4 electron-volts is due to t2g -> e_g transitions. The third wide structure situated at 4.5-11 electron-volts appears due to transitions between the Ru 4dO states derived from the tails of oxygen 2p states and t_2g and e_g states. The measured resonance inelastic x-ray spectra at the Ru L3 and M3 edges are very similar. However, the corresponding measured resonance inelastic x-ray spectra at the Ca site quite differ from each other due to the significant difference in the widths of core-levels.


title: Change of Measure for Bayesian Field Inversion with Hierarchical Hyperparameters Sampling

abstract: This paper proposes an effective treatment of hyperparameters in the Bayesian inference of a scalar field from indirect observations. Obtaining the joint posterior distribution of the field and its hyperparameters is challenging. The infinite dimensionality of the field requires a finite parametrization that usually involves hyperparameters to reflect the limited prior knowledge. In the present work, we consider a Karhunen-Lo{\`e}ve (KL) decomposition for the random field and hyperparameters to account for the lack of prior knowledge of its autocovariance function. The hyperparameters must be inferred. To efficiently sample jointly the KL coordinates of the field and the autocovariance hyperparameters, we introduce a change of measure to reformulate the joint posterior distribution into a hierarchical Bayesian form. The likelihood depends only on the field's coordinates in a fixed KL basis, with a prior conditioned on the hyperparameters. We exploit this structure to derive an efficient Markov Chain Monte Carlo (MCMC) sampling scheme based on an adapted Metropolis-Hasting algorithm. We rely on surrogate models (Polynomial Chaos expansions) of the forward model predictions to further accelerate the MCMC sampling. A first application to a transient diffusion problem shows that our method is consistent with other approaches based on a change of coordinates (Sraj et al., 2016). A second application to a seismic traveltime tomography highlights the importance of inferring the hyperparameters.


title: Can LLMs Understand Computer Networks? Towards a Virtual System Administrator

abstract: Recent advancements in Artificial Intelligence, and particularly Large Language Models (LLMs), offer promising prospects for aiding system administrators in managing the complexity of modern networks. However, despite this potential, a significant gap exists in the literature regarding the extent to which LLMs can understand computer networks. Without empirical evidence, system administrators might rely on these models without assurance of their efficacy in performing network-related tasks accurately. In this paper, we are the first to conduct an exhaustive study on LLMs' comprehension of computer networks. We formulate several research questions to determine whether LLMs can provide correct answers when supplied with a network topology and questions on it. To assess them, we developed a thorough framework for evaluating LLMs' capabilities in various network-related tasks. We evaluate our framework on multiple computer networks employing private (e.g., GPT4) and open-source (e.g., Llama2) models. Our findings demonstrate promising results, with the best model achieving an average accuracy of 79.3%. Private LLMs achieve noteworthy results in small and medium networks, while challenges persist in comprehending complex network topologies, particularly for open-source models. Moreover, we provide insight into how prompt engineering can enhance the accuracy of some tasks.


title: Leading Giant graviton expansion of Schur correlators in large representations

abstract: We consider 4d $\mathcal N=4$ $U(N)$ SYM and the leading giant graviton correction to the Schur defect 2-point functions of $\frac{1}{2}$-BPS Wilson lines in rank-$k$ symmetric and antisymmetric representations. We study in particular the large $k$ limit for the symmetric case and the regime $1\ll k \ll N$ in the antisymmetric one. We present exact results for the correction in agreement with matrix model evaluation at finite $N,k$. The Wilson lines in symmetric/antisymmetric representations admit a description in terms of D3$_{k}$ and D5$_{k}$ brane probes representing a collection of $k$ fundamental strings. In this picture, giant graviton corrections come from fluctuations of brane probes in presence of a wrapped D3 brane giant graviton. In particular, for the antisymmetric case, our leading correction matches the half-index of the 3d $\mathcal N=4$ Maxwell theory living on the 3d disk which is a part of the giant graviton divided out by the D5$_{k}$ probe, as recently proposed in arXiv:2404.08302. For the symmetric case at large $k$, we derive an explicit exact residue formula for the leading correction.


title: Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them?

abstract: New capabilities in foundation models are owed in large part to massive, widely-sourced, and under-documented training data collections. Existing practices in data collection have led to challenges in documenting data transparency, tracing authenticity, verifying consent, privacy, representation, bias, copyright infringement, and the overall development of ethical and trustworthy foundation models. In response, regulation is emphasizing the need for training data transparency to understand foundation models' limitations. Based on a large-scale analysis of the foundation model training data landscape and existing solutions, we identify the missing infrastructure to facilitate responsible foundation model development practices. We examine the current shortcomings of common tools for tracing data authenticity, consent, and documentation, and outline how policymakers, developers, and data creators can facilitate responsible foundation model development by adopting universal data provenance standards.


title: Diagnostic Checking in Multivariate ARMA Models With Dependent Errors Using Normalized Residual Autocorrelations

abstract: In this paper we derive the asymptotic distribution of normalized residual empirical autocovariances and autocorrelations under weak assumptions on the noise. We propose new portmanteau statistics for vector autoregressive moving-average (VARMA) models with uncorrelated but non-independent innovations by using a self-normalization approach. We establish the asymptotic distribution of the proposed statistics. This asymptotic distribution is quite different from the usual chi-squared approximation used under the independent and identically distributed assumption on the noise, or the weighted sum of independent chi-squared random variables obtained under nonindependent innovations. A set of Monte Carlo experiments and an application to the daily returns of the CAC40 is presented.


title: Improving Chinese Character Representation with Formation Tree

abstract: Learning effective representations for Chinese characters presents unique challenges, primarily due to the vast number of characters and their continuous growth, which requires models to handle an expanding category space. Additionally, the inherent sparsity of character usage complicates the generalization of learned representations. Prior research has explored radical-based sequences to overcome these issues, achieving progress in recognizing unseen characters. However, these approaches fail to fully exploit the inherent tree structure of such sequences. To address these limitations and leverage established data properties, we propose Formation Tree-CLIP (FT-CLIP). This model utilizes formation trees to represent characters and incorporates a dedicated tree encoder, significantly improving performance in both seen and unseen character recognition tasks. We further introduce masking for to both character images and tree nodes, enabling efficient and effective training. This approach accelerates training significantly (by a factor of 2 or more) while enhancing accuracy. Extensive experiments show that processing characters through formation trees aligns better with their inherent properties than direct sequential methods, significantly enhancing the generality and usability of the representations.


title: ESC: Evolutionary Stitched Camera Calibration in the Wild

abstract: This work introduces a novel end-to-end approach for estimating extrinsic parameters of cameras in multi-camera setups on real-life sports fields. We identify the source of significant calibration errors in multi-camera environments and address the limitations of existing calibration methods, particularly the disparity between theoretical models and actual sports field characteristics. We propose the Evolutionary Stitched Camera calibration (ESC) algorithm to bridge this gap. It consists of image segmentation followed by evolutionary optimization of a novel loss function, providing a unified and accurate multi-camera calibration solution with high visual fidelity. The outcome allows the creation of virtual stitched views from multiple video sources, being as important for practical applications as numerical accuracy. We demonstrate the superior performance of our approach compared to state-of-the-art methods across diverse real-life football fields with varying physical characteristics.


title: Electrification of Clay Calcination: A First Look into Dynamic Modeling and Energy Management for Integration with Sustainable Power Grids

abstract: This article explores the electrification in clay calcination, proposing a dynamic model and energy management strategy for the integration of electrified calcination plants into sustainable power grids. A theoretical dynamic modeling of the electrified calcination process is introduced, aiming at outlining temperature profiles and energy usage - thus exploring the feasibility of electrification. The model serves as a tool for optimizing parameters, estimating system behavior, and enabling model-based process control. An innovative energy management model is also presented, ensuring efficient assimilation of electrified calcination plants into the power grid. It encapsulates demand-supply balancing and optimizes renewable energy usage. In essence, we provide an insightful pathway to a more sustainable cement production, underlining the value of renewable energy sources and effective energy management in the context of clay calcination.


title: Gaussian dependence structure pairwise goodness-of-fit testing based on conditional covariance and the 20/60/20 rule

abstract: We present a novel data-oriented statistical framework that assesses the presumed Gaussian dependence structure in a pairwise setting. This refers to both multivariate normality and normal copula goodness-of-fit testing. The proposed test clusters the data according to the 20/60/20 rule and confronts conditional covariance (or correlation) estimates on the obtained subsets. The corresponding test statistic has a natural practical interpretation, desirable statistical properties, and asymptotic pivotal distribution under the multivariate normality assumption. We illustrate the usefulness of the introduced framework using extensive power simulation studies and show that our approach outperforms popular benchmark alternatives. Also, we apply the proposed methodology to commodities market data.


title: On groups whose conjugacy class sizes are not divisible by each other

abstract: Let $G$ be a finite group and $N(G)$ be the set of its conjugacy class sizes excluding~$1$. Let us define a directed graph $\Gamma(G)$, the set of vertices of this graph is $N(G)$ and the vertices $x$ and $y$ are connected by a directed edge from $x$ to $y$ if $x$ divides $y$ and $N(G)$ does not contain a number $z$ different from $x$ and $y$ such that $x$ divides $z$ and $z$ divides $y$. We will call the graph $\Gamma(G)$ the conjugate graph of the group $G$. In this work, we will study finite groups whose conjugate graph is a set of points.


title: Neural Semantic Parsing with Extremely Rich Symbolic Meaning Representations

abstract: Current open-domain neural semantics parsers show impressive performance. However, closer inspection of the symbolic meaning representations they produce reveals significant weaknesses: sometimes they tend to merely copy character sequences from the source text to form symbolic concepts, defaulting to the most frequent word sense based in the training distribution. By leveraging the hierarchical structure of a lexical ontology, we introduce a novel compositional symbolic representation for concepts based on their position in the taxonomical hierarchy. This representation provides richer semantic information and enhances interpretability. We introduce a neural "taxonomical" semantic parser to utilize this new representation system of predicates, and compare it with a standard neural semantic parser trained on the traditional meaning representation format, employing a novel challenge set and evaluation metric for evaluation. Our experimental findings demonstrate that the taxonomical model, trained on much richer and complex meaning representations, is slightly subordinate in performance to the traditional model using the standard metrics for evaluation, but outperforms it when dealing with out-of-vocabulary concepts. This finding is encouraging for research in computational semantics that aims to combine data-driven distributional meanings with knowledge-based symbolic representations.


title: SOPHON: Non-Fine-Tunable Learning to Restrain Task Transferability For Pre-trained Models

abstract: Instead of building deep learning models from scratch, developers are more and more relying on adapting pre-trained models to their customized tasks. However, powerful pre-trained models may be misused for unethical or illegal tasks, e.g., privacy inference and unsafe content generation. In this paper, we introduce a pioneering learning paradigm, non-fine-tunable learning, which prevents the pre-trained model from being fine-tuned to indecent tasks while preserving its performance on the original task. To fulfill this goal, we propose SOPHON, a protection framework that reinforces a given pre-trained model to be resistant to being fine-tuned in pre-defined restricted domains. Nonetheless, this is challenging due to a diversity of complicated fine-tuning strategies that may be adopted by adversaries. Inspired by model-agnostic meta-learning, we overcome this difficulty by designing sophisticated fine-tuning simulation and fine-tuning evaluation algorithms. In addition, we carefully design the optimization process to entrap the pre-trained model within a hard-to-escape local optimum regarding restricted domains. We have conducted extensive experiments on two deep learning modes (classification and generation), seven restricted domains, and six model architectures to verify the effectiveness of SOPHON. Experiment results verify that fine-tuning SOPHON-protected models incurs an overhead comparable to or even greater than training from scratch. Furthermore, we confirm the robustness of SOPHON to three fine-tuning methods, five optimizers, various learning rates and batch sizes. SOPHON may help boost further investigations into safe and responsible AI.


title: Understanding the anomalous thermoelectric behaviour of Fe-V-W-Al based thin films

abstract: We have investigated the thermoelectric and thermal behaviour of Fe-V-W-Al based thin films prepared using radio frequency magnetron sputtering technique at different base pressures (0.1 ~ 1.0 X 10-2 Pa) and on different substrates (n, p and undoped Si). Interestingly, at lower base pressure, formation of bcc type of Heusler structure was observed in deposited samples, whereas at higher base pressure, we have noted the development of non-Heusler amorphous structure in these samples. Our findings indicates that the moderately oxidized Fe-V-W-Al amorphous thin film deposited on n-Si substrate, possesses large magnitude of absoulte S ~ 1098 microvolt per kelvin near room temperature, which is almost the double the previously reported value for thin films. Additionally, the power factor indicated enormously large values ~ 33.9 milliwatt per meter per kelvin sqaure near 320 K. The thermal conductivity of the amorphous thin film is also found to be 2.75 watt per meter per kelvin, which is quite lower compared to bulk alloys. As a result, the maximum figure of merit is estimated to be extremely high i.e. ~ 3.9 near 320 K, which is among one of the highest reported values so far. The anomalously large value of Seebeck coefficient and power factor has been ascribed to formation of amorphous structure and composite effect of thin film and substrate.


title: Exploiting New Properties of String Net Frequency for Efficient Computation

abstract: Knowing which strings in a massive text are significant -- that is, which strings are common and distinct from other strings -- is valuable for several applications, including text compression and tokenization. Frequency in itself is not helpful for significance, because the commonest strings are the shortest strings. A compelling alternative is net frequency, which has the property that strings with positive net frequency are of maximal length. However, net frequency remains relatively unexplored, and there is no prior art showing how to compute it efficiently. We first introduce a characteristic of net frequency that simplifies the original definition. With this, we study strings with positive net frequency in Fibonacci words. We then use our characteristic and solve two key problems related to net frequency. First, \textsc{single-nf}, how to compute the net frequency of a given string of length $m$, in an input text of length $n$ over an alphabet size $\sigma$. Second, \textsc{all-nf}, given length-$n$ input text, how to report every string of positive net frequency. Our methods leverage suffix arrays, components of the Burrows-Wheeler transform, and solution to the coloured range listing problem. We show that, for both problems, our data structure has $O(n)$ construction cost: with this structure, we solve \textsc{single-nf} in $O(m + \sigma)$ time and \textsc{all-nf} in $O(n)$ time. Experimentally, we find our method to be around 100 times faster than reasonable baselines for \textsc{single-nf}. For \textsc{all-nf}, our results show that, even with prior knowledge of the set of strings with positive net frequency, simply confirming that their net frequency is positive takes longer than with our purpose-designed method.


title: Modeling Multi-Granularity Context Information Flow for Pavement Crack Detection

abstract: Crack detection has become an indispensable, interesting yet challenging task in the computer vision community. Specially, pavement cracks have a highly complex spatial structure, a low contrasting background and a weak spatial continuity, posing a significant challenge to an effective crack detection method. In this paper, we address these problems from a view that utilizes contexts of the cracks and propose an end-to-end deep learning method to model the context information flow. To precisely localize crack from an image, it is critical to effectively extract and aggregate multi-granularity context, including the fine-grained local context around the cracks (in spatial-level) and the coarse-grained semantics (in segment-level). Concretely, in Convolutional Neural Network (CNN), low-level features extracted by the shallow layers represent the local information, while the deep layers extract the semantic features. Additionally, a second main insight in this work is that the semantic context should be an guidance to local context feature. By the above insights, the proposed method we first apply the dilated convolution as the backbone feature extractor to model local context, then we build a context guidance module to leverage semantic context to guide local feature extraction at multiple stages. To handle label alignment between stages, we apply the Multiple Instance Learning (MIL) strategy to align the high-level feature to the low-level ones in the stage-wise context flow. In addition, compared with these public crack datasets, to our best knowledge, we release the largest, most complex and most challenging Bitumen Pavement Crack (BPC) dataset. The experimental results on the three crack datasets demonstrate that the proposed method performs well and outperforms the current state-of-the-art methods.


title: GAL{\AE}XI: Solving complex compressible flows with high-order discontinuous Galerkin methods on accelerator-based systems

abstract: This work presents GAL{\AE}XI as a novel, energy-efficient flow solver for the simulation of compressible flows on unstructured meshes leveraging the parallel computing power of modern Graphics Processing Units (GPUs). GAL{\AE}XI implements the high-order Discontinuous Galerkin Spectral Element Method (DGSEM) using shock capturing with a finite-volume subcell approach to ensure the stability of the high-order scheme near shocks. This work provides details on the general code design, the parallelization strategy, and the implementation approach for the compute kernels with a focus on the element local mappings between volume and surface data due to the unstructured mesh. GAL{\AE}XI exhibits excellent strong scaling properties up to 1024 GPUs if each GPU is assigned a minimum of one million degrees of freedom degrees of freedom. To verify its implementation, a convergence study is performed that recovers the theoretical order of convergence of the implemented numerical schemes. Moreover, the solver is validated using both the incompressible and compressible formulation of the Taylor-Green-Vortex at a Mach number of 0.1 and 1.25, respectively. A mesh convergence study shows that the results converge to the high-fidelity reference solution and that the results match the original CPU implementation. Finally, GAL{\AE}XI is applied to a large-scale wall-resolved large eddy simulation of a linear cascade of the NASA Rotor 37. Here, the supersonic region and shocks at the leading edge are captured accurately and robustly by the implemented shock-capturing approach. It is demonstrated that GAL{\AE}XI requires less than half of the energy to carry out this simulation in comparison to the reference CPU implementation. This renders GAL{\AE}XI as a potent tool for accurate and efficient simulations of compressible flows in the realm of exascale computing and the associated new HPC architectures.


title: A Clean-graph Backdoor Attack against Graph Convolutional Networks with Poisoned Label Only

abstract: Graph Convolutional Networks (GCNs) have shown excellent performance in dealing with various graph structures such as node classification, graph classification and other tasks. However,recent studies have shown that GCNs are vulnerable to a novel threat known as backdoor attacks. However, all existing backdoor attacks in the graph domain require modifying the training samples to accomplish the backdoor injection, which may not be practical in many realistic scenarios where adversaries have no access to modify the training samples and may leads to the backdoor attack being detected easily. In order to explore the backdoor vulnerability of GCNs and create a more practical and stealthy backdoor attack method, this paper proposes a clean-graph backdoor attack against GCNs (CBAG) in the node classification task,which only poisons the training labels without any modification to the training samples, revealing that GCNs have this security vulnerability. Specifically, CBAG designs a new trigger exploration method to find important feature dimensions as the trigger patterns to improve the attack performance. By poisoning the training labels, a hidden backdoor is injected into the GCNs model. Experimental results show that our clean graph backdoor can achieve 99% attack success rate while maintaining the functionality of the GCNs model on benign samples.


title: Integrated Sensing and Communication enabled Multiple Base Stations Cooperative UAV Detection

abstract: Integrated sensing and communication (ISAC) exhibits notable potential for sensing the unmanned aerial vehicles (UAVs), facilitating real-time monitoring of UAVs for security insurance. Due to the low sensing accuracy of single base stations (BSs), a cooperative UAV sensing method by multi-BS is proposed in this paper to achieve high-accuracy sensing. Specifically, a multiple signal classification (MUSIC)-based symbol-level fusion method is proposed for UAV localization and velocity estimation, consisting of a single-BS preprocessing step and a lattice points searching step. The preprocessing procedure enhances the single-BS accuracy by superposing multiple spectral functions, thereby establishing a reference value for subsequent lattice points searching. Furthermore, the lattice point with minimal error compared to the preprocessing results is determined as the fusion result. Extensive simulation results reveal that the proposed symbol-level fusion method outperforms the benchmarking methods in localization and velocity estimation.


title: On balanced homodyne measurement -- simple proof of wave function collapse

abstract: Using only elementary calculus we prove that the balanced homodyne detector measures the quadrature phase amplitude of a signal. More precisely, after the measurement of photon numbers $l$, the collapse of the composite state of a strong laser beam and a signal approximates the collapse of the signal to the eigen-state of quadrature phase amplitude with eigen-value $r$.


title: Cosmology from String T-duality and zero-point length

abstract: Inspired by String T-duality and taking into account the zero-point length correction, $l_0$, to the gravitational potential, we construct modified Friedmann equations by applying the first law of thermodynamics on the apparent horizon of the Friedmann-Robertson-Walker (FRW) Universe. The cosmological viability of this extended scenario is investigated by studying influences on the evolution of the early Universe and performing the cosmographic analysis. Furthermore, we explore the inflationary paradigm under the slow-roll condition. By testing the model against observational data, the zero-point length is constrained around the Planck scale, in compliance with the original assumption from String T-duality. We also study the growth of density perturbations in the linear regime. It is shown that the zero-point length stands out as an alternative characterization for the broken-power-law spectrum, which provides a better fitting for the experimental measurements comparing to the simple power-law potential. Finally, we focus on implications for the primordial gravitational waves (PGWs) spectrum. Should the zero-point length be running over energy scales, as is the case for all parameters and coupling constants in quantum gravity under renormalization group considerations, deviations from General Relativity (GR) might be potentially tested through upcoming PGW observatories.


title: Magnetic-field driven evolution of zero-energy mode on Bi islands deposited on Fe(Te,Se)

abstract: We investigate the magnetic-field dependent evolution of the zero-bias conductance peaks (ZBCPs) on the nanoscale bismuth islands grown on the FeTe$_{0.55}$Se$_{0.45}$ substrate. The ZBCPs can be observed throughout the entire region on these islands, and their characteristics align with the signatures of Majorana zero modes. Remarkably, the evolution of ZBCPs on these islands exhibits anomalous behavior under varying magnetic fields: The magnitude of ZBCPs is first enhanced at weak fields lower than 2 T and then suppressed as the fields further increase. We attribute the non-monotonic evolution of the ZBCPs to the magnetic-field-enhanced topological edge states on these Bi islands. Our findings provide valuable insights into the probable origin of the Majorana zero modes in the Bi-island platform and the magnetic-field response of topological edge states.


title: Atypical values at infinity of real polynomial maps with $2$-dimensional fibers

abstract: We characterize atypical values at infinity of a real polynomial function of three variables by a certain sum of indices of the gradient vector field of the function restricted to a sphere with a sufficiently large radius. This is an analogy of a result of Coste and de la Puente for real polynomial functions with two variables. We also give a characterization of atypical values at infinity of a real polynomial map whose regular fibers are $2$-dimensional surfaces.


title: FedMeS: Personalized Federated Continual Learning Leveraging Local Memory

abstract: We focus on the problem of Personalized Federated Continual Learning (PFCL): a group of distributed clients, each with a sequence of local tasks on arbitrary data distributions, collaborate through a central server to train a personalized model at each client, with the model expected to achieve good performance on all local tasks. We propose a novel PFCL framework called Federated Memory Strengthening FedMeS to address the challenges of client drift and catastrophic forgetting. In FedMeS, each client stores samples from previous tasks using a small amount of local memory, and leverages this information to both 1) calibrate gradient updates in training process; and 2) perform KNN-based Gaussian inference to facilitate personalization. FedMeS is designed to be task-oblivious, such that the same inference process is applied to samples from all tasks to achieve good performance. FedMeS is analyzed theoretically and evaluated experimentally. It is shown to outperform all baselines in average accuracy and forgetting rate, over various combinations of datasets, task distributions, and client numbers.


abstract: Temperature plays a pivotal role in moderating label softness in the realm of knowledge distillation (KD). Traditional approaches often employ a static temperature throughout the KD process, which fails to address the nuanced complexities of samples with varying levels of difficulty and overlooks the distinct capabilities of different teacher-student pairings. This leads to a less-than-ideal transfer of knowledge. To improve the process of knowledge propagation, we proposed Dynamic Temperature Knowledge Distillation (DTKD) which introduces a dynamic, cooperative temperature control for both teacher and student models simultaneously within each training iterafion. In particular, we proposed "\textbf{sharpness}" as a metric to quantify the smoothness of a model's output distribution. By minimizing the sharpness difference between the teacher and the student, we can derive sample-specific temperatures for them respectively. Extensive experiments on CIFAR-100 and ImageNet-2012 demonstrate that DTKD performs comparably to leading KD techniques, with added robustness in Target Class KD and None-target Class KD scenarios.The code is available at https://github.com/JinYu1998/DTKD.


title: uTRAND: Unsupervised Anomaly Detection in Traffic Trajectories

abstract: Deep learning-based approaches have achieved significant improvements on public video anomaly datasets, but often do not perform well in real-world applications. This paper addresses two issues: the lack of labeled data and the difficulty of explaining the predictions of a neural network. To this end, we present a framework called uTRAND, that shifts the problem of anomalous trajectory prediction from the pixel space to a semantic-topological domain. The framework detects and tracks all types of traffic agents in bird's-eye-view videos of traffic cameras mounted at an intersection. By conceptualizing the intersection as a patch-based graph, it is shown that the framework learns and models the normal behaviour of traffic agents without costly manual labeling. Furthermore, uTRAND allows to formulate simple rules to classify anomalous trajectories in a way suited for human interpretation. We show that uTRAND outperforms other state-of-the-art approaches on a dataset of anomalous trajectories collected in a real-world setting, while producing explainable detection results.


title: Energy Conserved Failure Detection for NS-IoT Systems

abstract: Nowadays, network slicing (NS) technology has gained widespread adoption within Internet of Things (IoT) systems to meet diverse customized requirements. In the NS based IoT systems, the detection of equipment failures necessitates comprehensive equipment monitoring, which leads to significant resource utilization, particularly within large-scale IoT ecosystems. Thus, the imperative task of reducing failure rates while optimizing monitoring costs has emerged. In this paper, we propose a monitor application function (MAF) based dynamic dormancy monitoring mechanism for the novel NS-IoT system, which is based on a network data analysis function (NWDAF) framework defined in Rel-17. Within the NS-IoT system, all nodes are organized into groups, and multiple MAFs are deployed to monitor each group of nodes. We also propose a dormancy monitor mechanism to mitigate the monitoring energy consumption by placing the MAFs, which is monitoring non-failure devices, in a dormant state. We propose a reinforcement learning based PPO algorithm to guide the dynamic dormancy of MAFs. Simulation results demonstrate that our dynamic dormancy strategy maximizes energy conservation, while proposed algorithm outperforms alternatives in terms of efficiency and stability.


title: Lasing and spasing with active individual core-shell plasmonic nanoresonators

abstract: Active core-shell nanoresonators were designed in order to achieve large near-field enhancement, large power-outflow and minimal spaser threshold in the pump E-field strength. Gain-metal-dielectric (GMD) and gain-metal-gain (GMG) nanoresonator compositions were optimized with corresponding objective functions. The average local E-field, power-outflow and extinction cross-section were mapped above the pump E-field strength and dye concentration parameter plane with the criterion that the local E-field is smaller than the damage threshold of the nanoresonator. Regions, corresponding to the maxima in the average local E-field, the highest power-outflow, or to the zero-crossing of the extinction cross-section, were selected for detailed studies. The spectral distribution of the near-field enhancement, optical cross-sections, optical responses, quantum efficiencies, as well as the polar angle distribution of the far-field radiated power and the local charge distribution of dominant modes were inspected. Based on the results the GMD nanoresonator composition is proposed to maximize local E-field in near-field amplifiers, to maximize power-outflow in far-field-emitting lasers and to minimize threshold E-field in spasers. Comparing the complete characteristics, both compositions are suitable for different operation regions, the GMG is proposed as near-field amplifier and far-field out-coupling nanolaser, whereas the GMD is unambiguously preferable to achieve optimal spaser properties.


title: Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel Collaboration

abstract: Large language models (LLMs) exhibit complementary strengths in various tasks, motivating the research of LLM ensembling. However, existing work focuses on training an extra reward model or fusion model to select or combine all candidate answers, posing a great challenge to the generalization on unseen data distributions. Besides, prior methods use textual responses as communication media, ignoring the valuable information in the internal representations. In this work, we propose a training-free ensemble framework DeePEn, fusing the informative probability distributions yielded by different LLMs at each decoding step. Unfortunately, the vocabulary discrepancy between heterogeneous LLMs directly makes averaging the distributions unfeasible due to the token misalignment. To address this challenge, DeePEn maps the probability distribution of each model from its own probability space to a universal relative space based on the relative representation theory, and performs aggregation. Next, we devise a search-based inverse transformation to transform the aggregated result back to the probability space of one of the ensembling LLMs (main model), in order to determine the next token. We conduct extensive experiments on ensembles of different number of LLMs, ensembles of LLMs with different architectures, and ensembles between the LLM and the specialist model. Experimental results show that (i) DeePEn achieves consistent improvements across six benchmarks covering subject examination, reasoning, and knowledge, (ii) a well-performing specialist model can benefit from a less effective LLM through distribution fusion, and (iii) DeePEn has complementary strengths with other ensemble methods such as voting.


title: Plasmonic nanoprism distributions to promote enhanced and uniform energy deposition in passive and active targets

abstract: Passive and active targets, implanted with gold nanoprisms, were designed to achieve enhanced and uniform power absorption during two-sided illumination by short laser pulses. The target length was adjusted to match the short laser pulse-length. Capabilities of three different, uniform, single-peaked Gaussian and adjusted, nanoresonator number density distributions were compared. The average local E-field inside the gain medium and on the surface of the nanoprisms were mapped as a function of the pump E-field strength and dye concentration, assuming a uniform nanoresonator distribution. The optimal parameters were adopted to each inspected nanoprism distributions. The time-evolution of the near-field enhancement (NFE), integrated power-loss and deposited energy were determined, additionally, the time-evolution of the standard deviation of these quantities was monitored. A comparative study was performed on passive and active targets, to determine the most advantageous nanoprism number density distribution type and to consider the advantages of dye doping. Based on the results, the adjusted distribution is proposed both in passive and active targets. Doping with the dye is advantageous in every inspected distribution in decreasing the minimal standard deviation of the NFE. It is advantageous in decreasing the delay of the minimal standard deviation in the power-loss and deposited energy, the standard deviation of the NFE as well as in increasing the FOM of the NFE in the uniform and adjusted distributions. In addition, doping allows for decreasing the delay of the minimal standard deviation in the NFE / increasing the mean NFE / decreasing the standard deviation of the power-loss and deposited energy in the uniform / Gaussian / adjusted distribution.


title: Show and Grasp: Few-shot Semantic Segmentation for Robot Grasping through Zero-shot Foundation Models

abstract: The ability of a robot to pick an object, known as robot grasping, is crucial for several applications, such as assembly or sorting. In such tasks, selecting the right target to pick is as essential as inferring a correct configuration of the gripper. A common solution to this problem relies on semantic segmentation models, which often show poor generalization to unseen objects and require considerable time and massive data to be trained. To reduce the need for large datasets, some grasping pipelines exploit few-shot semantic segmentation models, which are capable of recognizing new classes given a few examples. However, this often comes at the cost of limited performance and fine-tuning is required to be effective in robot grasping scenarios. In this work, we propose to overcome all these limitations by combining the impressive generalization capability reached by foundation models with a high-performing few-shot classifier, working as a score function to select the segmentation that is closer to the support set. The proposed model is designed to be embedded in a grasp synthesis pipeline. The extensive experiments using one or five examples show that our novel approach overcomes existing performance limitations, improving the state of the art both in few-shot semantic segmentation on the Graspnet-1B (+10.5% mIoU) and Ocid-grasp (+1.6% AP) datasets, and real-world few-shot grasp synthesis (+21.7% grasp accuracy). The project page is available at: https://leobarcellona.github.io/showandgrasp.github.io/


title: Improving Prediction Accuracy of Semantic Segmentation Methods Using Convolutional Autoencoder Based Pre-processing Layers

abstract: In this paper, we propose a method to improve prediction accuracy of semantic segmentation methods as follows: (1) construct a neural network that has pre-processing layers based on a convolutional autoencoder ahead of a semantic segmentation network, and (2) train the entire network initialized by the weights of the pre-trained autoencoder. We applied this method to the fully convolutional network (FCN) and experimentally compared its prediction accuracy on the cityscapes dataset. The Mean IoU of the proposed target model with the He normal initialization is 18.7% higher than that of FCN with the He normal initialization. In addition, those of the modified models of the target model are significantly higher than that of FCN with the He normal initialization. The accuracy and loss curves during the training showed that these are resulting from the improvement of the generalization ability. All of these results provide strong evidence that the proposed method is significantly effective in improving the prediction accuracy of FCN. The proposed method has the following features: it is comparatively simple, whereas the effect on improving the generalization ability and prediction accuracy of FCN is significant; the increase in the number of parameters by using it is very small, and that in the computation time is substantially large. In principle, the proposed method can be applied to other semantic segmentation methods. For semantic segmentation, at present, there is no effective way to improve the prediction accuracy of existing methods. None have published a method which is the same as or similar to our method and none have used such a method in practice. Therefore, we believe that our method is useful in practice and worthy of being widely known and used.


title: Detecting Galaxy Groups and AGNs populating the local Universe in the eROSITA era

abstract: The eROSITA will deliver an unprecedented volume of X-ray survey observations, 20-30 times more sensitive than ROSAT in the soft band (0.5-2 keV) and for the first time imaging in the hard band (2-10 keV) including galaxy clusters and groups along with obscured and unobscured AGNs. This calls for a powerful theoretical effort to control the systematics and biases that may affect the data analysis. We investigate the detection technique and selection effects in the galaxy group and AGN populations of a mock eROSITA survey at the depth of eRASS:4. We create a $30\times 30$ deg$^{2}$ mock observation based on the cosmological hydrodynamical simulation Magneticum Pathfinder within z=0-0.2. We combine a physical background extracted from the real eFEDS background analysis with realistic simulations of X-ray emission for the hot gas, AGNs and X-ray binaries. We apply a detection procedure equivalent to the reduction done on eRASS data and evaluate the completeness and contamination to reconstruct the luminosity functions of the extended and point sources in the catalogue. We assess the completeness of extended detections as a function of the input X-ray flux and halo. We achieve full recovery of the brightest (most massive) clusters and AGNs. However, a significant fraction of galaxy groups remains undetected. Examining the gas properties between the detected and undetected galaxy groups at fixed halo mass, we observe that the detected population exhibits, on average, higher X-ray brightness compared to the undetected ones. Moreover, we find that X-ray luminosity primarily correlates with the hot gas fraction, rather than temperature or metallicity. Our simulation suggests the presence of a systematic selection effect in current surveys, resulting in X-ray survey catalogues predominantly composed of the lowest-entropy, gas-richest, and highest surface brightness halos on galaxy group scales.


title: PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answering

abstract: Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world documents with sparse text, while challenges persist in comprehending the hierarchical semantic relations among multiple pages to locate multimodal components. To address this gap, we propose PDF-MVQA, which is tailored for research journal articles, encompassing multiple pages and multimodal information retrieval. Unlike traditional machine reading comprehension (MRC) tasks, our approach aims to retrieve entire paragraphs containing answers or visually rich document entities like tables and figures. Our contributions include the introduction of a comprehensive PDF Document VQA dataset, allowing the examination of semantically hierarchical layout structures in text-dominant documents. We also present new VRD-QA frameworks designed to grasp textual contents and relations among document layouts simultaneously, extending page-level understanding to the entire multi-page document. Through this work, we aim to enhance the capabilities of existing vision-and-language models in handling challenges posed by text-dominant documents in VRD-QA.


title: Generalized Few-Shot Meets Remote Sensing: Discovering Novel Classes in Land Cover Mapping via Hybrid Semantic Segmentation Framework

abstract: Land-cover mapping is one of the vital applications in Earth observation, aiming at classifying each pixel's land-cover type of remote-sensing images. As natural and human activities change the landscape, the land-cover map needs to be rapidly updated. However, discovering newly appeared land-cover types in existing classification systems is still a non-trivial task hindered by various scales of complex land objects and insufficient labeled data over a wide-span geographic area. In this paper, we propose a generalized few-shot segmentation-based framework, named SegLand, to update novel classes in high-resolution land-cover mapping. Specifically, the proposed framework is designed in three parts: (a) Data pre-processing: the base training set and the few-shot support sets of novel classes are analyzed and augmented; (b) Hybrid segmentation structure; Multiple base learners and a modified Projection onto Orthogonal Prototypes (POP) network are combined to enhance the base-class recognition and to dig novel classes from insufficient labels data; (c) Ultimate fusion: the semantic segmentation results of the base learners and POP network are reasonably fused. The proposed framework has won first place in the leaderboard of the OpenEarthMap Land Cover Mapping Few-Shot Challenge. Experiments demonstrate the superiority of the framework for automatically updating novel land-cover classes with limited labeled data.


title: TOI-4336 A b: A temperate sub-Neptune ripe for atmospheric characterization in a nearby triple M-dwarf system

abstract: Small planets transiting bright nearby stars are essential to our understanding of the formation and evolution of exoplanetary systems. However, few constitute prime targets for atmospheric characterization, and even fewer are part of multiple star systems. This work aims to validate TOI-4336 A b, a sub-Neptune-sized exoplanet candidate identified by the TESS space-based transit survey around a nearby M-dwarf. We validate the planetary nature of TOI-4336 A b through the global analysis of TESS and follow-up multi-band high-precision photometric data from ground-based telescopes, medium- and high-resolution spectroscopy of the host star, high-resolution speckle imaging, and archival images. The newly discovered exoplanet TOI-4336 A b has a radius of 2.1$\pm$0.1R$_{\oplus}$. Its host star is an M3.5-dwarf star of mass 0.33$\pm$0.01M$_{\odot}$ and radius 0.33$\pm$0.02R$_{\odot}$ member of a hierarchical triple M-dwarf system 22 pc away from the Sun. The planet's orbital period of 16.3 days places it at the inner edge of the Habitable Zone of its host star, the brightest of the inner binary pair. The parameters of the system make TOI-4336 A b an extremely promising target for the detailed atmospheric characterization of a temperate sub-Neptune by transit transmission spectroscopy with JWST.


title: Virasoro constraints for K3 surfaces and monodromy operators

abstract: The Virasoro constraints for moduli spaces of stable torsion free sheaves on a surface with only $(p,p)$-cohomology were recently proved by Bojko-Moreira-Lim. The rank 1 case, which is not restricted to surfaces with only $(p,p)$-cohomology, was established by Moreira. We prove Virasoro constraints for K3 surfaces using Markman monodromy operators, which allow us to reduce to the rank 1 case. We also prove new Virasoro constraints in rank 0. Finally, for K3 surfaces, we introduce new Virasoro operators in negative degree which, together with the previous Virasoro operators, give a representation of Virasoro algebra with central charge $24$.


title: Graph Convolutional Network For Semi-supervised Node Classification With Subgraph Sketching

abstract: In this paper, we propose the Graph-Learning-Dual Graph Convolutional Neural Network called GLDGCN based on the classic Graph Convolutional Neural Network(GCN) by introducing dual convolutional layer and graph learning layer. We apply GLDGCN to the semi-supervised node classification task. Compared with the baseline methods, we achieve higher classification accuracy on three citation networks Citeseer, Cora and Pubmed, and we also analyze and discussabout selection of the hyperparameters and network depth. GLDGCN also perform well on the classic social network KarateClub and the new Wiki-CS dataset. For the insufficient ability of our algorithm to process large graphs during the experiment, we also introduce subgraph clustering and stochastic gradient descent methods into GCN and design a semi-supervised node classification algorithm based on the CLustering Graph Convolutional neural Network, which enables GCN to process large graph and improves its application value. We complete semi-supervised node classification experiments on two classic large graph which are PPI dataset (more than 50,000 nodes) and Reddit dataset (more than 200,000 nodes), and also perform well.


title: Separate in the Speech Chain: Cross-Modal Conditional Audio-Visual Target Speech Extraction

abstract: The integration of visual cues has revitalized the performance of the target speech extraction task, elevating it to the forefront of the field. Nevertheless, this multi-modal learning paradigm often encounters the challenge of modality imbalance. In audio-visual target speech extraction tasks, the audio modality tends to dominate, potentially overshadowing the importance of visual guidance. To tackle this issue, we propose AVSepChain, drawing inspiration from the speech chain concept. Our approach partitions the audio-visual target speech extraction task into two stages: speech perception and speech production. In the speech perception stage, audio serves as the dominant modality, while visual information acts as the conditional modality. Conversely, in the speech production stage, the roles are reversed. This transformation of modality status aims to alleviate the problem of modality imbalance. Additionally, we introduce a contrastive semantic matching loss to ensure that the semantic information conveyed by the generated speech aligns with the semantic information conveyed by lip movements during the speech production stage. Through extensive experiments conducted on multiple benchmark datasets for audio-visual target speech extraction, we showcase the superior performance achieved by our proposed method.


title: Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works

abstract: Large language models (LLMs) have demonstrated impressive performance and spurred numerous AI applications, in which role-playing agents (RPAs) are particularly popular, especially for fictional characters. The prerequisite for these RPAs lies in the capability of LLMs to understand characters from fictional works. Previous efforts have evaluated this capability via basic classification tasks or characteristic imitation, failing to capture the nuanced character understanding with LLMs. In this paper, we propose evaluating LLMs' character understanding capability via the character profiling task, i.e., summarizing character profiles from corresponding materials, a widely adopted yet understudied practice for RPA development. Specifically, we construct the CroSS dataset from literature experts and assess the generated profiles by comparing ground truth references and their applicability in downstream tasks. Our experiments, which cover various summarization methods and LLMs, have yielded promising results. These results strongly validate the character understanding capability of LLMs. We believe our constructed resource will promote further research in this field. Resources are available at https://github.com/Joanna0123/character_profiling.


title: Characterizations of open and semi-open maps of compact Hausdorff spaces by induced maps

abstract: Let $f\colon X\rightarrow Y$ be a continuous surjection of compact Hausdorff spaces. By $$f_*\colon\mathfrak{M}(X)\rightarrow\mathfrak{M}(Y),\ \mu\mapsto \mu\circ f^{-1} \quad{\rm and}\quad 2^f\colon2^X\rightarrow2^Y,\ A\mapsto f[A]$$ we denote the induced continuous surjections on the probability measure spaces and hyperspaces, respectively. In this paper we mainly show the following facts: (1) If $f_*$ is semi-open, then $f$ is semi-open. (2) If $f$ is semi-open densely open, then $f_*$ is semi-open densely open. (3) $f$ is open iff $2^f$ is open. (4) $f$ is semi-open iff $2^f$ is semi-open. (5) $f$ is irreducible iff $2^f$ is irreducible.


title: Relevant or Random: Can LLMs Truly Perform Analogical Reasoning?

abstract: Analogical reasoning is a unique ability of humans to address unfamiliar challenges by transferring strategies from relevant past experiences. One key finding in psychology is that compared with irrelevant past experiences, recalling relevant ones can help humans better handle new tasks. Coincidentally, the NLP community has also recently found that self-generating relevant examples in the context can help large language models (LLMs) better solve a given problem than hand-crafted prompts. However, it is yet not clear whether relevance is the key factor eliciting such capability, i.e., can LLMs benefit more from self-generated relevant examples than irrelevant ones? In this work, we systematically explore whether LLMs can truly perform analogical reasoning on a diverse set of reasoning tasks. With extensive experiments and analysis, we show that self-generated random examples can surprisingly achieve comparable or even better performance, e.g., 4% performance boost on GSM8K with random biological examples. We find that the accuracy of self-generated examples is the key factor and subsequently design two improved methods with significantly reduced inference costs. Overall, we aim to advance a deeper understanding of LLM analogical reasoning and hope this work stimulates further research in the design of self-generated contexts.


title: Demonstration of quantum projective simulation on a single-photon-based quantum computer

abstract: Variational quantum algorithms show potential in effectively operating on noisy intermediate-scale quantum devices. A novel variational approach to reinforcement learning has been recently proposed, incorporating linear-optical interferometers and a classical learning model known as projective simulation (PS). PS is a decision-making tool for reinforcement learning and can be classically represented as a random walk on a graph that describes the agent's memory. In its optical quantum version, this approach utilizes quantum walks of single photons on a mesh of tunable beamsplitters and phase shifters to select actions. In this work, we present the implementation of this algorithm on Ascella, a single-photon-based quantum computer from Quandela. The focus is drawn on solving a test bed task to showcase the potential of the quantum agent with respect to the classical agent.


title: PATE-TripleGAN: Privacy-Preserving Image Synthesis with Gaussian Differential Privacy

abstract: Conditional Generative Adversarial Networks (CGANs) exhibit significant potential in supervised learning model training by virtue of their ability to generate realistic labeled images. However, numerous studies have indicated the privacy leakage risk in CGANs models. The solution DPCGAN, incorporating the differential privacy framework, faces challenges such as heavy reliance on labeled data for model training and potential disruptions to original gradient information due to excessive gradient clipping, making it difficult to ensure model accuracy. To address these challenges, we present a privacy-preserving training framework called PATE-TripleGAN. This framework incorporates a classifier to pre-classify unlabeled data, establishing a three-party min-max game to reduce dependence on labeled data. Furthermore, we present a hybrid gradient desensitization algorithm based on the Private Aggregation of Teacher Ensembles (PATE) framework and Differential Private Stochastic Gradient Descent (DPSGD) method. This algorithm allows the model to retain gradient information more effectively while ensuring privacy protection, thereby enhancing the model's utility. Privacy analysis and extensive experiments affirm that the PATE-TripleGAN model can generate a higher quality labeled image dataset while ensuring the privacy of the training data.


title: Near-Quantum-limited Haloscope Detection of Dark Photon Dark Matter Enhanced by a High-Q Superconducting Cavit

abstract: We report new experimental results on the search for dark photons based on a near-quantum-limited haloscope equipped with a superconducting cavity. The loaded quality factor of the superconducting cavity is $6\times10^{5}$, so that the expected signal from dark photon dark matter can be enhanced by more than one order compared to a copper cavity. A Josephson parametric amplifier with a near-quantum-limited noise temperature has been utilized to minimize the noise during the search. Furthermore, a digital acquisition card based on field programmable gate arrays has been utilized to maximize data collection efficiency with a duty cycle being 100$\%$. This work has established the most stringent constraints on dark photons at around 26.965 $\mu$eV. In the future, our apparatus can be extended to search for other dark matter candidates, such as axions and axion-like particles, and scrutinize new physics beyond the Standard Model.


title: Stability, convergence, and pressure-robustness of numerical schemes for incompressible flows with hybrid velocity and pressure

abstract: In this work we study the stability, convergence, and pressure-robustness of discretization methods for incompressible flows with hybrid velocity and pressure. Specifically, focusing on the Stokes problem, we identify a set of assumptions that yield inf-sup stability as well as error estimates which distinguish the velocity- and pressure-related contributions to the error. We additionally identify the key properties under which the pressure-related contributions vanish in the estimate of the velocity, thus leading to pressure-robustness. Several examples of existing and new schemes that fit into the framework are provided, and extensive numerical validation of the theoretical properties is provided.


title: The free energy of Dirac's vacuum in purely magnetic fields

abstract: The QED vacuum is a non-linear polarisable medium rather than an empty space. In this work, we present the first rigorous derivation of the one-loop effective magnetic Lagrangian at positive temperature, a non-linear functional describing the free energy of quantum vacuum in a classical magnetic field. We start by properly defining the free energy functional using the Pauli-Villars regularisation technique in order to remove the worst ultraviolet divergence which represents a well known issue of the theory. Then, we study the limit of slowly varying classical magnetic fields. In this regime, we prove the convergence of this functional to the Euler-Heisenberg formula with thermal corrections, by recovering the effective Lagrangian first derived by Dittrich in 1979.


title: DLoRA-TrOCR: Mixed Text Mode Optical Character Recognition Based On Transformer

abstract: With the continuous development of Optical Character Recognition (OCR) and the expansion of application fields, text recognition in complex scenes has become a key challenge. Factors such as multiple fonts, mixed scenes and complex layouts seriously affect the recognition accuracy of traditional OCR models. Although OCR models based on deep learning have performed well in specific fields or similar datasets in recent years, the generalization ability and robustness of the model are still a big challenge when facing complex environments with multiple scenes. Furthermore, training an OCR model from scratch or fine-tuning all parameters is very demanding on computing resources and inference time, which limits the flexibility of its application. This study focuses on a fundamental aspect of mixed text recognition in response to the challenges mentioned above, which involves effectively fine-tuning the pre-trained basic OCR model to demonstrate exceptional performance across various downstream tasks. To this end, we propose a parameter-efficient mixed text recognition method based on pre-trained OCR Transformer, namely DLoRA-TrOCR. This method embeds DoRA into the image encoder and LoRA into the internal structure of the text decoder, enabling efficient parameter fine-tuning for downstream tasks. Experiments show that compared to similar parameter adjustment methods, our model DLoRA-TrOCR has the smallest number of parameters and performs better. It can achieve state-of-the-art performance on complex scene datasets involving simultaneous recognition of mixed handwritten, printed and street view texts.


title: Enumerating low-frequency nonphononic vibrations in computer glasses

abstract: In addition to Goldstone phonons that generically emerge in the low-frequency vibrational spectrum of any solid, crystalline or glassy, structural glasses also feature other low-frequency vibrational modes. The nature and statistical properties of these modes -- often termed `excess modes' -- have been the subject of decades-long investigation. Studying them, even using well-controlled computer glasses, has proven challenging due to strong spatial hybridization effects between phononic and nonphononic excitations, which hinder quantitative analyses of the nonphononic contribution ${\cal D}_{\rm G}(\omega)$ to the total spectrum ${\cal D}(\omega)$, per frequency $\omega$. Here, using recent advances indicating that ${\cal D}_{\rm G}(\omega)\!=\!{\cal D}(\omega)-{\cal D}_{\rm D}(\omega)$, where ${\cal D}_{\rm D}(\omega)$ is Debye's spectrum of phonons, we present a simple and straightforward scheme to enumerate nonphononic modes in computer glasses. Our analysis establishes that nonphononic modes in computer glasses indeed make an additive contribution to the total spectrum, including in the presence of strong hybridizations. Moreover, it cleanly reveals the universal ${\cal D}_{\rm G}(\omega)\!\sim\!\omega^4$ tail of the nonphononic spectrum, and opens the way for related analyses of experimental spectra of glasses.


title: Large Language Model Supply Chain: A Research Agenda

abstract: The rapid advancements in pre-trained Large Language Models (LLMs) and Large Multimodal Models (LMMs) have ushered in a new era of intelligent applications, transforming fields ranging from natural language processing to content generation. The LLM supply chain represents a crucial aspect of the contemporary artificial intelligence landscape. It encompasses the entire lifecycle of pre-trained models, from its initial development and training to its final deployment and application in various domains. This paper presents a comprehensive overview of the LLM supply chain, highlighting its three core elements: 1) the model infrastructure, encompassing datasets and toolchain for training, optimization, and deployment; 2) the model lifecycle, covering training, testing, releasing, and ongoing maintenance; and 3) the downstream application ecosystem, enabling the integration of pre-trained models into a wide range of intelligent applications. However, this rapidly evolving field faces numerous challenges across these key components, including data privacy and security, model interpretability and fairness, infrastructure scalability, and regulatory compliance. Addressing these challenges is essential for harnessing the full potential of LLMs and ensuring their ethical and responsible use. This paper provides a future research agenda for the LLM supply chain, aiming at driving the continued advancement and responsible deployment of these transformative LLMs.


title: LLM App Store Analysis: A Vision and Roadmap

abstract: The rapid growth and popularity of large language model (LLM) app stores have created new opportunities and challenges for researchers, developers, users, and app store managers. As the LLM app ecosystem continues to evolve, it is crucial to understand the current landscape and identify potential areas for future research and development. This paper presents a forward-looking analysis of LLM app stores, focusing on key aspects such as data mining, security risk identification, development assistance, etc. By examining these aspects, we aim to provide a vision for future research directions and highlight the importance of collaboration among stakeholders to address the challenges and opportunities within the LLM app ecosystem. The insights and recommendations provided in this paper serve as a foundation for driving innovation, ensuring responsible development, and creating a thriving, user-centric LLM app landscape.


title: DeviceRadar: Online IoT Device Fingerprinting in ISPs using Programmable Switches

abstract: Device fingerprinting can be used by Internet Service Providers (ISPs) to identify vulnerable IoT devices for early prevention of threats. However, due to the wide deployment of middleboxes in ISP networks, some important data, e.g., 5-tuples and flow statistics, are often obscured, rendering many existing approaches invalid. It is further challenged by the high-speed traffic of hundreds of terabytes per day in ISP networks. This paper proposes DeviceRadar, an online IoT device fingerprinting framework that achieves accurate, real-time processing in ISPs using programmable switches. We innovatively exploit "key packets" as a basis of fingerprints only using packet sizes and directions, which appear periodically while exhibiting differences across different IoT devices. To utilize them, we propose a packet size embedding model to discover the spatial relationships between packets. Meanwhile, we design an algorithm to extract the "key packets" of each device, and propose an approach that jointly considers the spatial relationships and the key packets to produce a neighboring key packet distribution, which can serve as a feature vector for machine learning models for inference. Last, we design a model transformation method and a feature extraction process to deploy the model on a programmable data plane within its constrained arithmetic operations and memory to achieve line-speed processing. Our experiments show that DeviceRadar can achieve state-of-the-art accuracy across 77 IoT devices with 40 Gbps throughput, and requires only 1.3% of the processing time compared to GPU-accelerated approaches.


title: The Solution for the CVPR2024 NICE Image Captioning Challenge

abstract: This report introduces a solution to the Topic 1 Zero-shot Image Captioning of 2024 NICE : New frontiers for zero-shot Image Captioning Evaluation. In contrast to NICE 2023 datasets, this challenge involves new annotations by humans with significant differences in caption style and content. Therefore, we enhance image captions effectively through retrieval augmentation and caption grading methods. At the data level, we utilize high-quality captions generated by image caption models as training data to address the gap in text styles. At the model level, we employ OFA (a large-scale visual-language pre-training model based on handcrafted templates) to perform the image captioning task. Subsequently, we propose caption-level strategy for the high-quality caption data generated by the image caption models and integrate them with retrieval augmentation strategy into the template to compel the model to generate higher quality, more matching, and semantically enriched captions based on the retrieval augmentation prompts. Our approach achieves a CIDEr score of 234.11.