title: Internal null controllability for the one-dimensional heat equation with dynamic boundary conditions

abstract: The primary focus of this paper is to establish the internal null controllability for the one-dimensional heat equation featuring dynamic boundary conditions. This achievement is realized by introducing a new Carleman estimate and an observability inequality for the corresponding backward system. In conclusion, the paper includes a set of numerical experiments that serve to confirm the validity of the theoretical findings and underscore the effectiveness of the designed control with a minimal L2-norm.


title: The Schwarzian from gauge theories

abstract: The continuum of holographic dual gravitational charges is recovered out of the discrete spectrum of $U(N)$ $\mathcal{N}=4$ SYM on $\mathbb{R}\times S^3\,$. In such a limit, the free energy of the free gauge theory is computed up to logarithmic contributions and exponentially suppressed contributions. Assuming the supergravity dual prediction to correctly capture strong-coupling results in field theory, the answer is bound to encode a complete low-temperature expansion of the Gibbons-Hawking gravitational on-shell action, valid well beyond the vicinity of supersymmetric black hole solutions. The formula recovers the long awaited Schwarzian contribution at low enough temperatures. The computed mass-gap matches the conjectured strong-coupling result obtained by Boruch, Heydeman, Iliesiu and Turiaci in supergravity. The emergent reparameterizations, broken by the Schwarzian, correspond to redefinitions of the relevant cutoff scale. Observations are made regarding the existence of $\frac{1}{8}$-BPS black holes and how this is in tension with BPS inequalities. The RG-flow procedure leading to these results opens the way to understanding the emergence of chaos in gauge theories and its relation to non-extremal and non-supersymmetric black hole physics.


title: The effects of environment on galaxies' dynamical structures: From simulations to observations

abstract: We studied the effects of cluster environments on galactic structures by using the TNG50 cosmological simulation and observed galaxies in the Fornax cluster. We focused on galaxies with stellar masses of $10^{8-12}M_{\odot}$ at z=0 that reside in Fornax-like clusters with total masses of $M_{200c} = 10^{13.4-14.3}M_{\odot}$. We characterized the stellar structures by decomposing each galaxy into a dynamically cold disk and a hot non-disk component, and studied the evolution of both the stellar and gaseous constituents. In TNG50, we find that the cold gas is quickly removed when a galaxy falls into a Fornax-mass cluster. About 87\% of the galaxies have lost $80\%$ of their star-forming gas at 4 billion years after infall, with the remaining gas concentrating in the inner regions of the galaxy. The radius of the star-forming gaseous disk decreases to half its original size at 4 billion years after infall for 66\% of the galaxies. As a result, star formation in the extended dynamically cold disk sharply decreases, even though a low level of SF persists at the center for a few additional gigayears. This leads to a tight correlation between the average stellar age in the dynamically cold disk and the infall time of galaxies. Furthermore, the luminosity fraction of the dynamically cold disk in ancient infallers is only about 1/3 of that in recent infallers, controlling for galaxy stellar mass. This quantitatively agrees with what is observed in early-type galaxies in the Fornax cluster. Gas removal stops the possible growth of the disk, with gas removed earlier in galaxies that fell in earlier, and hence the cold-disk fraction is correlated with the infall time. The stellar disk can be significantly disrupted by tidal forces after infall, through a long-term process that enhances the difference among cluster galaxies with different infall times.


title: Predicting the Performance of Foundation Models via Agreement-on-the-Line

abstract: Estimating the out-of-distribution performance in regimes where labels are scarce is critical to safely deploy foundation models. Recently, it was shown that ensembles of neural networks observe the phenomena ``agreement-on-the-line'', which can be leveraged to reliably predict OOD performance without labels. However, in contrast to classical neural networks that are trained on in-distribution data from scratch for numerous epochs, foundation models undergo minimal finetuning from heavily pretrained weights, which may reduce the ensemble diversity needed to observe agreement-on-the-line. In our work, we demonstrate that when lightly finetuning multiple runs from a $\textit{single}$ foundation model, the choice of randomness during training (linear head initialization, data ordering, and data subsetting) can lead to drastically different levels of agreement-on-the-line in the resulting ensemble. Surprisingly, only random head initialization is able to reliably induce agreement-on-the-line in finetuned foundation models across vision and language benchmarks. Second, we demonstrate that ensembles of $\textit{multiple}$ foundation models pretrained on different datasets but finetuned on the same task can also show agreement-on-the-line. In total, by careful construction of a diverse ensemble, we can utilize agreement-on-the-line-based methods to predict the OOD performance of foundation models with high precision.


title: Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapes

abstract: 3D head avatars built with neural implicit volumetric representations have achieved unprecedented levels of photorealism. However, the computational cost of these methods remains a significant barrier to their widespread adoption, particularly in real-time applications such as virtual reality and teleconferencing. While attempts have been made to develop fast neural rendering approaches for static scenes, these methods cannot be simply employed to support realistic facial expressions, such as in the case of a dynamic facial performance. To address these challenges, we propose a novel fast 3D neural implicit head avatar model that achieves real-time rendering while maintaining fine-grained controllability and high rendering quality. Our key idea lies in the introduction of local hash table blendshapes, which are learned and attached to the vertices of an underlying face parametric model. These per-vertex hash-tables are linearly merged with weights predicted via a CNN, resulting in expression dependent embeddings. Our novel representation enables efficient density and color predictions using a lightweight MLP, which is further accelerated by a hierarchical nearest neighbor search method. Extensive experiments show that our approach runs in real-time while achieving comparable rendering quality to state-of-the-arts and decent results on challenging expressions.


title: A new gap in the critical exponent for semi-linear structurally damped evolution equations

abstract: Our aim in this paper is to discuss the critical exponent in semi-linear structurally damped wave and beam equations with additional dispersion term. The special model we have in mind is $$ u_{tt}(t,x)+(-\Delta)^{\sigma}u(t,x)+(-\Delta)^{2\delta}u(t,x)+2(-\Delta)^{\delta}u_{t}(t,x)=\left|u(t,x)\right| ^{p} $$ where the initial displacement $u(0,x)=u_{0}(x)$, the initial velocity $u_{t}(0,x)=u_{1}(x)$ and the parameters $ t\in [0,\infty)$, $x\in \mathbb{R}^{n}$, $\sigma\geq 1$, $\delta\in(0,\frac{\sigma}{2})$, $p>1$. The solution to the linear equation at low frequency region involves an interplay of diffusion and oscillation phenomena represented by a real-complex Fourier multiplier of the form $$m(t,\xi)=\frac{e^{-|\xi|^{2\delta}t\pm i|\xi|^{\sigma}t}}{2i|\xi|^{\sigma}}, \ \ \xi\in \mathbb{R}^{n}, \ \ i=\sqrt{-1}.$$ The scaling argument shows that the diffusive part leads to faster decay rates compared to the oscillatory one. This interplay creates a new gap in the critical exponent between the blow up (in finite time) result when $1<p<1+\frac{4\delta}{n-2\delta}$ (sub-critical case) and the global (in time) existence result when $p>1+\frac{\sigma+2\delta}{n-\sigma}$ (super-critical case). We leave an open to show if this gap will be closed at least in low or high space dimensions because, to the best of authors knowledge, the necessary Fourier multiplier that leads to the sub-critical case does not explicitly appear in $m(t,\xi)$.


title: Burning Random Trees

abstract: Let $\mathcal{T}$ be a Galton-Watson tree with a given offspring distribution $\xi$, where $\xi$ is a $Z_{\geq 0}$-valued random variable with $E[\xi] = 1$ and $0 < \sigma^{2}:=Var[\xi] < \infty$. For $n \geq 1$, let $T_{n}$ be the tree $\mathcal{T}$ conditioned to have $n$ vertices. In this paper we investigate $b(T_n)$, the burning number of $T_n$. Our main result shows that asymptotically almost surely $b(T_n)$ is of the order of $n^{1/3}$.


title: Time-Varying Matrix Factor Models

abstract: Matrix-variate data of high dimensions are frequently observed in finance and economics, spanning extended time periods, such as the long-term data on international trade flows among numerous countries. To address potential structural shifts and explore the matrix structure's informational context, we propose a time-varying matrix factor model. This model accommodates changing factor loadings over time, revealing the underlying dynamic structure through nonparametric principal component analysis and facilitating dimension reduction. We establish the consistency and asymptotic normality of our estimators under general conditions that allow for weak correlations across time, rows, or columns of the noise. A novel approach is introduced to overcome rotational ambiguity in the estimators, enhancing the clarity and interpretability of the estimated loading matrices. Our simulation study highlights the merits of the proposed estimators and the effective of the smoothing operation. In an application to international trade flow, we investigate the trading hubs, centrality, patterns, and trends in the trading network.


title: Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining

abstract: How to effectively explore multi-scale representations of rain streaks is important for image deraining. In contrast to existing Transformer-based methods that depend mostly on single-scale rain appearance, we develop an end-to-end multi-scale Transformer that leverages the potentially useful features in various scales to facilitate high-quality image reconstruction. To better explore the common degradation representations from spatially-varying rain streaks, we incorporate intra-scale implicit neural representations based on pixel coordinates with the degraded inputs in a closed-loop design, enabling the learned features to facilitate rain removal and improve the robustness of the model in complex scenarios. To ensure richer collaborative representation from different scales, we embed a simple yet effective inter-scale bidirectional feedback operation into our multi-scale Transformer by performing coarse-to-fine and fine-to-coarse information communication. Extensive experiments demonstrate that our approach, named as NeRD-Rain, performs favorably against the state-of-the-art ones on both synthetic and real-world benchmark datasets. The source code and trained models are available at https://github.com/cschenxiang/NeRD-Rain.


title: mChartQA: A universal benchmark for multimodal Chart Question Answer based on Vision-Language Alignment and Reasoning

abstract: In the fields of computer vision and natural language processing, multimodal chart question-answering, especially involving color, structure, and textless charts, poses significant challenges. Traditional methods, which typically involve either direct multimodal processing or a table-to-text conversion followed by language model analysis, have limitations in effectively handling these complex scenarios. This paper introduces a novel multimodal chart question-answering model, specifically designed to address these intricate tasks. Our model integrates visual and linguistic processing, overcoming the constraints of existing methods. We adopt a dual-phase training approach: the initial phase focuses on aligning image and text representations, while the subsequent phase concentrates on optimizing the model's interpretative and analytical abilities in chart-related queries. This approach has demonstrated superior performance on multiple public datasets, particularly in handling color, structure, and textless chart questions, indicating its effectiveness in complex multimodal tasks.


title: Octopus: On-device language model for function calling of software APIs

abstract: In the rapidly evolving domain of artificial intelligence, Large Language Models (LLMs) play a crucial role due to their advanced text processing and generation abilities. This study introduces a new strategy aimed at harnessing on-device LLMs in invoking software APIs. We meticulously compile a dataset derived from software API documentation and apply fine-tuning to LLMs with capacities of 2B, 3B and 7B parameters, specifically to enhance their proficiency in software API interactions. Our approach concentrates on refining the models' grasp of API structures and syntax, significantly enhancing the accuracy of API function calls. Additionally, we propose \textit{conditional masking} techniques to ensure outputs in the desired formats and reduce error rates while maintaining inference speeds. We also propose a novel benchmark designed to evaluate the effectiveness of LLMs in API interactions, establishing a foundation for subsequent research. Octopus, the fine-tuned model, is proved to have better performance than GPT-4 for the software APIs calling. This research aims to advance automated software development and API integration, representing substantial progress in aligning LLM capabilities with the demands of practical software engineering applications.


title: Perfecting Periodic Trajectory Tracking: Model Predictive Control with a Periodic Observer ($\Pi$-MPC)

abstract: In Model Predictive Control (MPC), discrepancies between the actual system and the predictive model can lead to substantial tracking errors and significantly degrade performance and reliability. While such discrepancies can be alleviated with more complex models, this often complicates controller design and implementation. By leveraging the fact that many trajectories of interest are periodic, we show that perfect tracking is possible when incorporating a simple observer that estimates and compensates for periodic disturbances. We present the design of the observer and the accompanying tracking MPC scheme, proving that their combination achieves zero tracking error asymptotically, regardless of the complexity of the unmodelled dynamics. We validate the effectiveness of our method, demonstrating asymptotically perfect tracking on a high-dimensional soft robot with nearly 10,000 states and a fivefold reduction in tracking errors compared to a baseline MPC on small-scale autonomous race car experiments.


title: Multi-Agent Reinforcement Learning with Control-Theoretic Safety Guarantees for Dynamic Network Bridging

abstract: Addressing complex cooperative tasks in safety-critical environments poses significant challenges for Multi-Agent Systems, especially under conditions of partial observability. This work introduces a hybrid approach that integrates Multi-Agent Reinforcement Learning with control-theoretic methods to ensure safe and efficient distributed strategies. Our contributions include a novel setpoint update algorithm that dynamically adjusts agents' positions to preserve safety conditions without compromising the mission's objectives. Through experimental validation, we demonstrate significant advantages over conventional MARL strategies, achieving comparable task performance with zero safety violations. Our findings indicate that integrating safe control with learning approaches not only enhances safety compliance but also achieves good performance in mission objectives.


title: The use of the open innovation paradigm in the public sector: a systematic review of published studies

abstract: The use of the open innovation paradigm has been, over the past years, getting special attention in the public sector. Motivated by an urban environment that is increasingly more complex and challenging, several government agencies have been allocating financial resources and efforts to promote open and participative government initiatives. As a way to try and understand this scenario, a systematic review of the literature was conducted, to provide a comprehensive analysis of the scientific papers that were published, seeking to capture, classify, evaluate and synthesize how the use of this paradigm has been put into practice in the public sector. In total, 4,741 preliminary studies were analyzed. From this number, only 37 articles were classified as potentially relevant and moved forward, going through the process of data extraction and analysis. From the data obtained, it was possible to verify that the use of this paradigm started to be reported with a higher frequency in the literature since 2013 and, among the main findings, we highlight the reports of experiences, approach propositions, of understanding how the phenomenon occurs and theoretical reflections. It was also possible to verify that the use of open innovation through social media was one of the pioneer techniques of engagement between the public sector and citizens. In conclusion, the reports confirm that the main challenges of this paradigm applied to the public sector are associated with their respective bureaucratic aspects, therefore lacking a bigger reflection on the procedures and methods to be used in the public sphere.


title: A CT Image Denoising Method with Residual Encoder-Decoder Network

abstract: Utilizing a low-dose CT approach significantly reduces the radiation exposure for patients, yet it introduces challenges, such as increased noise and artifacts in the resultant images, which can hinder accurate medical diagnostics. Traditional methods for noise reduction struggle with preserving image textures due to the complexity of modeling statistical properties directly within the image domain. To address these limitations, this study introduces an enhanced noise-reduction technique centered around an advanced residual encoder-decoder network. By incorporating recursive processing into the foundational network, this method reduces computational complexity and enhances the effectiveness of noise reduction. Furthermore, the introduction of a root-mean-square error and perceptual loss functions aims to retain the integrity of the images' textural details. The enhanced technique also includes optimized tissue segmentation, improving artifact management post-improvement. Validation using the TCGA-COAD clinical dataset demonstrates superior performance in both noise reduction and image quality, as measured by post-denoising PSNR and SSIM, compared to the existing WGAN approach. This advancement in CT image processing offers a practical solution for clinical applications, achieving lower computational demands and faster processing times without compromising image quality.


title: FT2Ra: A Fine-Tuning-Inspired Approach to Retrieval-Augmented Code Completion

abstract: The rise of code pre-trained models has significantly enhanced various coding tasks, such as code completion, and tools like GitHub Copilot. However, the substantial size of these models, especially large models, poses a significant challenge when it comes to fine-tuning them for specific downstream tasks. As an alternative approach, retrieval-based methods have emerged as a promising solution, augmenting model predictions without the need for fine-tuning. Despite their potential, a significant challenge is that the designs of these methods often rely on heuristics, leaving critical questions about what information should be stored or retrieved and how to interpolate such information for augmenting predictions. To tackle this challenge, we first perform a theoretical analysis of the fine-tuning process, highlighting the importance of delta logits as a catalyst for improving model predictions. Building on this insight, we develop a novel retrieval-based method, FT2Ra, which aims to mimic genuine fine-tuning. While FT2Ra adopts a retrieval-based mechanism, it uniquely adopts a paradigm with a learning rate and multi-epoch retrievals, which is similar to fine-tuning.In token-level completion, which represents a relatively easier task, FT2Ra achieves a 4.29% improvement in accuracy compared to the best baseline method on UniXcoder. In the more challenging line-level completion task, we observe a substantial more than twice increase in Exact Match (EM) performance, indicating the significant advantages of our theoretical analysis. Notably, even when operating without actual fine-tuning, FT2Ra exhibits competitive performance compared to the models with real fine-tuning.


title: First homology groups of the Milnor fiber boundary for generic hyperplane arrangements in $\mathbb{C}^{3}$

abstract: We study the Milnor fiber boundary for hyperplane arrangements in $\mathbb{C}^3$. This is one of the examples of non-isolated surface singularities, which are studied by N\'emethi--Szil\'ard. In this paper, we compute the first homology group of the Milnor fiber boundary for a generic arrangement and prove it is combinatorially determined. In particular, this gives the affirmative answer to the conjecture of Suciu.


title: Blind QSO reconstruction challenge: Exploring methods to reconstruct the Ly$\alpha$ emission line of QSOs

abstract: Reconstructing the intrinsic Ly$\alpha$ line flux from high-$z$ QSOs can place constraints on the neutral hydrogen content of the intergalactic medium during reionisation. There are now $\gtrsim10$ different Ly$\alpha$ reconstruction pipelines using different methodologies to predict the Ly$\alpha$ line flux from correlations with the spectral information redward of Ly$\alpha$. However, there have been few attempts to directly compare the performance of these pipelines. Therefore, we devised a blind QSO challenge to compare these reconstruction pipelines on a uniform set of objects. Each author was provided de-identified, observed rest-frame QSO spectra with spectral information only redward of 1260\AA\ rest-frame to ensure unbiased reconstruction. We constructed two samples of 30 QSOs, from X-Shooter and SDSS both spanning $3.5<z<4.5$. Importantly, the purpose of this comparison study was not to champion a single, best performing reconstruction pipeline but rather to explore the relative performance of these pipelines over a range of QSOs with broad observational characteristics to infer general trends. In summary, we find machine learning approaches in general provide the strongest ``best guesses" but underestimate the accompanying statistical uncertainty, although these can be recalibrated, whilst pipelines that decompose the spectral information, for example principal component or factor analysis generally perform better at predicting the Ly$\alpha$ profile. Further, we found that reconstruction pipelines trained on SDSS QSOs performed similarly on average for both the X-Shooter and SDSS samples indicating no discernible biases owing to differences in the observational characteristics of the training set or QSO being reconstructed, although the recovered distributions of reconstructions for X-Shooter were broader likely due to an increased fraction of outliers.


title: Distributed Autonomous Swarm Formation for Dynamic Network Bridging

abstract: Effective operation and seamless cooperation of robotic systems are a fundamental component of next-generation technologies and applications. In contexts such as disaster response, swarm operations require coordinated behavior and mobility control to be handled in a distributed manner, with the quality of the agents' actions heavily relying on the communication between them and the underlying network. In this paper, we formulate the problem of dynamic network bridging in a novel Decentralized Partially Observable Markov Decision Process (Dec-POMDP), where a swarm of agents cooperates to form a link between two distant moving targets. Furthermore, we propose a Multi-Agent Reinforcement Learning (MARL) approach for the problem based on Graph Convolutional Reinforcement Learning (DGN) which naturally applies to the networked, distributed nature of the task. The proposed method is evaluated in a simulated environment and compared to a centralized heuristic baseline showing promising results. Moreover, a further step in the direction of sim-to-real transfer is presented, by additionally evaluating the proposed approach in a near Live Virtual Constructive (LVC) UAV framework.


title: Automated User Story Generation with Test Case Specification Using Large Language Model

abstract: Modern Software Engineering era is moving fast with the assistance of artificial intelligence (AI), especially Large Language Models (LLM). Researchers have already started automating many parts of the software development workflow. Requirements Engineering (RE) is a crucial phase that begins the software development cycle through multiple discussions on a proposed scope of work documented in different forms. RE phase ends with a list of user-stories for each unit task identified through discussions and usually these are created and tracked on a project management tool such as Jira, AzurDev etc. In this research we developed a tool "GeneUS" using GPT-4.0 to automatically create user stories from requirements document which is the outcome of the RE phase. The output is provided in JSON format leaving the possibilities open for downstream integration to the popular project management tools. Analyzing requirements documents takes significant effort and multiple meetings with stakeholders. We believe, automating this process will certainly reduce additional load off the software engineers, and increase the productivity since they will be able to utilize their time on other prioritized tasks.


title: Minimal model program for algebraically integrable foliations on klt varieties

abstract: We prove the contraction theorem and the existence of flips for algebraically integrable foliations on klt varieties which strengthen a result of Cascini and Spicer by removing the assumption on termination of flips. Thus we establish the minimal model program for algebraically integrable foliations on klt varieties unconditionally. As a consequence, for algebraically integrable foliations polarized with ample divisors, we prove the existence of minimal models and Mori fiber spaces either when the ambient variety is klt or in the sense of Birkar-Shokurov. We also show the existence of a Shokurov-type polytope for algebraically integrable foliations.


title: Brightest Cluster Galaxies and the Intracluster Light

abstract: In this chapter, we delve into the formation and primary characteristics of two significant components within galaxy clusters: the brightest cluster galaxies and the intracluster light. Drawing upon recent and pertinent studies in the field, we explore the mechanisms driving their growth from high redshift to the present day. We also examine how these formation mechanisms are intertwined with the dynamical state of their host clusters, suggesting their potential utility as luminous tracers of dark matter.


title: Coalescing sets preserving cospectrality of graphs arising from block similarity matrices

abstract: Coalescing involves gluing one or more rooted graphs onto another graph. Under specific conditions, it is possible to start with cospectral graphs that are coalesced in similar ways that will result in new cospectral graphs. We present a sufficient condition for this based on the block structure of similarity matrices, possibly with additional constraints depending on which type of matrix is being considered. The matrices considered in this paper include the adjacency, Laplacian, signless Laplacian, distance, and generalized distance matrix.


title: Efficient, indistinguishable telecom C-band photons using a tapered nanobeam

abstract: Telecom C-band single photons exhibit the lowest attenuation in optical fibers, enabling long-haul quantum-secured communication. However, efficient coupling with optical fibers is crucial for these single photons to be effective carriers in long-distance transmission. In this work, we demonstrate an efficient fiber-coupled single photon source at the telecom C-band using InAs/InP quantum dots coupled to a tapered nanobeam. The tapered nanobeam structure facilitates directional emission that is mode-matched to a lensed fiber, resulting in a collection efficiency of up to 65% from the nanobeam to a single-mode fiber. Using this approach, we demonstrate single photon count rates of 575 $\pm$ 5 Kcps and a single photon purity of $g^2$ (0) = 0.015 $\pm$ 0.003. Additionally, we demonstrate Hong-Ou Mandel interference from the emitted photons with a visibility of 0.84 $\pm$ 0.06. From these measurements, we determine a photon coherence time of 450 $\pm$ 20 ps, a factor of just 8.3 away from the lifetime limit. This work represents an important step towards the development of telecom C-band single-photon sources emitting bright, pure, and indistinguishable photons, which are necessary to realize fiber-based long-distance quantum networks


title: Two-Phase Multi-Dose-Level PET Image Reconstruction with Dose Level Awareness

abstract: To obtain high-quality positron emission tomography (PET) while minimizing radiation exposure, a range of methods have been designed to reconstruct standard-dose PET (SPET) from corresponding low-dose PET (LPET) images. However, most current methods merely learn the mapping between single-dose-level LPET and SPET images, but omit the dose disparity of LPET images in clinical scenarios. In this paper, to reconstruct high-quality SPET images from multi-dose-level LPET images, we design a novel two-phase multi-dose-level PET reconstruction algorithm with dose level awareness, containing a pre-training phase and a SPET prediction phase. Specifically, the pre-training phase is devised to explore both fine-grained discriminative features and effective semantic representation. The SPET prediction phase adopts a coarse prediction network utilizing pre-learned dose level prior to generate preliminary result, and a refinement network to precisely preserve the details. Experiments on MICCAI 2022 Ultra-low Dose PET Imaging Challenge Dataset have demonstrated the superiority of our method.


title: The radiative decay of scalar glueball from lattice QCD

abstract: We perform the first lattice QCD study on the radiative decay of the scalar glueball to the vector meson $\phi$ in the quenched approximation. The calculations are carried out on three gauge ensembles with different lattice spaicings, which enable us to do the continuum extrapolation. We first revisit the radiative $J/\psi$ decay into the scalar glueball $G$ and obtain the partial decay width $\Gamma(J/\psi \to \gamma G)=0.449(44)~\text{keV}$ and the branching fraction $\text{Br}(J/\psi \to \gamma G) = 4.8(5)\times 10^{-3}$, which are in agreement with the previous lattice results. We then extend the similar calculation to the process $G\to \gamma \phi$ and get the partial decay width $\Gamma(G \to \gamma \phi)= 0.074(47)~\text{keV}$, which implies that the combined branching fraction of $J/\psi\to\gamma G\to \gamma\gamma\phi$ is as small as $\mathcal{O}(10^{-9})$ such that this process is hardly detected by the BESIII experiment even with the large $J/\psi$ sample of $\mathcal{O}(10^{10})$. With the vector meson dominance model, the two-photon decay width of the scalar glueball is estimated to be $\Gamma(G\to\gamma\gamma)=0.53(46)~\text{eV}$, which results in a large stickiness $S(G)\sim \mathcal{O}(10^4)$ of the scalar glueball by assuming the stickiness of $f_2(1270)$ to be one.


title: Accurate determination of thermoelectric figure of merit using ac Harman method with a four-probe configuration

abstract: The ac Harman method has been used for the direct estimation of dimensionless thermoelectric figure of merit (zT) through ac/dc resistance measurements. However, accurate zT estimation with a four-probe configuration is difficult owing to the occurrence of a thermal phase-delay in the heat flow with a low frequency current. This study reports an exact solution for zT estimation by solving the heat conduction equation. The analysis can explain the reverse heat flow, which is the main source of the error in the four-probe configuration, and the experimentally obtained behavior of the frequency dependence of zT of (Bi,Sb)$_2$Te$_3$. Approximately 20 % of the error is caused by a thermal phase-delay, unless an appropriate current frequency and voltage-terminal position are chosen. Thus, an accurate zT evaluation using a four-probe configuration at any voltage terminal position is achieved. These findings can lead to interesting thermoelectric metrology and could serve as a powerful tool to search for promising thermoelectric materials.


title: Heterogeneous Treatment Effects and Causal Mechanisms

abstract: The credibility revolution advances the use of research designs that permit identification and estimation of causal effects. However, understanding which mechanisms produce measured causal effects remains a challenge. A dominant current approach to the quantitative evaluation of mechanisms relies on the detection of heterogeneous treatment effects with respect to pre-treatment covariates. This paper develops a framework to understand when the existence of such heterogeneous treatment effects can support inferences about the activation of a mechanism. We show first that this design cannot provide evidence of mechanism activation without an additional, generally implicit, assumption. Further, even when this assumption is satisfied, if a measured outcome is produced by a non-linear transformation of a directly-affected outcome of theoretical interest, heterogeneous treatment effects are not informative of mechanism activation. We provide novel guidance for interpretation and research design in light of these findings.


title: PyCPL: The ESO Common Pipeline Library in Python v1.0

abstract: PyCPL provides full access to ESO's Common Pipeline Library ( CPL) for astronomical data reduction within a Python environment. Not only does it offer a Python interface to the robust CPL library, but it also lets users and developers fully utilise the rest of the scientific Python ecosystem. We have written a C++ layer to CPL and with pybind11 (a third-party library) created a Pythonic API to CPL. Since CPL has been around for so long, it has been thoroughly tested and understood. In 2003 it was developed in C due to its efficiency and speed of execution. With the community however moving away from C/C++ programming and embracing Python for data processing tasks, there is a need to provide access to the CPL utilities within a Python environment. With the latest version being released users can now install PyCPL to run existing CPL recipes (written in C) and access the results from Python. It also provides the ability to create new recipes in Python using the functionality provided by CPL.


title: A Linear Time and Space Local Point Cloud Geometry Encoder via Vectorized Kernel Mixture (VecKM)

abstract: We propose VecKM, a local point cloud geometry encoder that is descriptive and efficient to compute. VecKM leverages a unique approach by vectorizing a kernel mixture to represent the local point cloud. Such representation's descriptiveness is supported by two theorems that validate its ability to reconstruct and preserve the similarity of the local shape. Unlike existing encoders downsampling the local point cloud, VecKM constructs the local geometry encoding using all neighboring points, producing a more descriptive encoding. Moreover, VecKM is efficient to compute and scalable to large point cloud inputs: VecKM reduces the memory cost from $(n^2+nKd)$ to $(nd+np)$; and reduces the major runtime cost from computing $nK$ MLPs to $n$ MLPs, where $n$ is the size of the point cloud, $K$ is the neighborhood size, $d$ is the encoding dimension, and $p$ is a marginal factor. The efficiency is due to VecKM's unique factorizable property that eliminates the need of explicitly grouping points into neighbors. In the normal estimation task, VecKM demonstrates not only 100x faster inference speed but also highest accuracy and strongest robustness. In classification and segmentation tasks, integrating VecKM as a preprocessing module achieves consistently better performance than the PointNet, PointNet++, and point transformer baselines, and runs consistently faster by up to 10 times.


title: Evaluating Large Language Models Using Contrast Sets: An Experimental Approach

abstract: In the domain of Natural Language Inference (NLI), especially in tasks involving the classification of multiple input texts, the Cross-Entropy Loss metric is widely employed as a standard for error measurement. However, this metric falls short in effectively evaluating a model's capacity to understand language entailments. In this study, we introduce an innovative technique for generating a contrast set for the Stanford Natural Language Inference (SNLI) dataset. Our strategy involves the automated substitution of verbs, adverbs, and adjectives with their synonyms to preserve the original meaning of sentences. This method aims to assess whether a model's performance is based on genuine language comprehension or simply on pattern recognition. We conducted our analysis using the ELECTRA-small model. The model achieved an accuracy of 89.9% on the conventional SNLI dataset but showed a reduced accuracy of 72.5% on our contrast set, indicating a substantial 17% decline. This outcome led us to conduct a detailed examination of the model's learning behaviors. Following this, we improved the model's resilience by fine-tuning it with a contrast-enhanced training dataset specifically designed for SNLI, which increased its accuracy to 85.5% on the contrast sets. Our findings highlight the importance of incorporating diverse linguistic expressions into datasets for NLI tasks. We hope that our research will encourage the creation of more inclusive datasets, thereby contributing to the development of NLI models that are both more sophisticated and effective.


title: DCP and VarDis: An Ad-Hoc Protocol Stack for Dynamic Swarms and Formations of Drones -- Extended Version

abstract: Recently, swarms or formations of drones have received increased interest both in the literature and in applications. To dynamically adapt to their operating environment, swarm members need to communicate wirelessly for control and coordination tasks. One fundamental communication pattern required for basic safety purposes, such as collision avoidance, is beaconing, where drones frequently transmit information about their position, speed, heading, and other operational data to a local neighbourhood, using a local broadcast service. In this paper, we propose and analyse a protocol stack which allows to use the recurring-beaconing primitive for additional purposes. In particular, we propose the VarDis (Variable Dissemination) protocol, which creates the abstraction of variables to which all members of a drone swarm have (read) access, and which can naturally be used for centralized control of a swarm, amongst other applications. We describe the involved protocols and provide a mainly simulation-based performance analysis of VarDis.


title: Leveraging YOLO-World and GPT-4V LMMs for Zero-Shot Person Detection and Action Recognition in Drone Imagery

abstract: In this article, we explore the potential of zero-shot Large Multimodal Models (LMMs) in the domain of drone perception. We focus on person detection and action recognition tasks and evaluate two prominent LMMs, namely YOLO-World and GPT-4V(ision) using a publicly available dataset captured from aerial views. Traditional deep learning approaches rely heavily on large and high-quality training datasets. However, in certain robotic settings, acquiring such datasets can be resource-intensive or impractical within a reasonable timeframe. The flexibility of prompt-based Large Multimodal Models (LMMs) and their exceptional generalization capabilities have the potential to revolutionize robotics applications in these scenarios. Our findings suggest that YOLO-World demonstrates good detection performance. GPT-4V struggles with accurately classifying action classes but delivers promising results in filtering out unwanted region proposals and in providing a general description of the scenery. This research represents an initial step in leveraging LMMs for drone perception and establishes a foundation for future investigations in this area.


title: Tropical cyclone genesis potential using a ventilated potential intensity

abstract: Genesis potential indices (GPIs) are widely used to understand the climatology of tropical cyclones (TCs). However, the sign of projected future changes depends on how they incorporate environmental moisture. Recent theory combines potential intensity and mid-tropospheric moisture into a single quantity called the ventilated potential intensity, which removes this ambiguity. This work proposes a new GPI ($GPI_v$) that is proportional to the product of the ventilated potential intensity and the absolute vorticity raised to a power. This power is estimated to be approximately 5 by fitting observed tropical cyclone best-track and ECMWF Reanalysis v5 (ERA5) data. Fitting the model with separate exponents yields nearly identical values, indicating that their product likely constitutes a single joint parameter. Likewise, results are nearly identical for a Poisson model as for the power law. $GPI_v$ performs comparably well to existing indices in reproducing the climatological distribution of tropical cyclone genesis and its covariability with El Ni\~no-Southern Oscillation, while only requiring a single fitting exponent. When applied to Coupled Model Intercomparison Project Phase 6 (CMIP6) projections, $GPI_v$ predicts that environments globally will become gradually more favorable for TC genesis with warming, consistent with prior work based on the normalized entropy deficit, though significant changes emerge only at higher latitudes under relatively strong warming. $GPI_v$ helps resolve the debate over the treatment of the moisture term and its implication for changes in TC genesis favorability with warming, and its clearer physical interpretation may offer a step forward towards a theory for genesis across climate states.


title: Hydrogen embrittlement susceptibility of additively manufactured 316L stainless steel: influence of post-processing, printing direction, temperature and pre-straining

abstract: The influence of post-build processing on the hydrogen embrittlement behavior of additively manufactured (AM) 316L stainless steel fabricated using laser powder bed fusion was assessed at both room temperature and -50$^\circ$ C via uniaxial tensile experiments. In the absence of hydrogen at ambient temperature, all four evaluated AM conditions (as-built (AB), annealed (ANN), hot isostatic pressed (HIP), and HIP plus cold worked (CW) to 30\%) exhibit notably reduced ductility relative to conventionally manufactured (CM) 316L stainless steel. The AM material exhibits sensitivity to the build direction, both in the presence and absence of hydrogen, with a notable increase in yield strength in the X direction and enhanced ductility in the Z direction. Conversely, testing of non-charged specimens at -50$^\circ$ C revealed similar ductility between the CM, AB, ANN, and HIP conditions. Upon hydrogen charging, the ductility of all four AM conditions was found to be similar to that of CM 316L at ambient temperature, with the HIP condition actually exceeding the CM material. Critically, testing of hydrogen-charged samples at -50$^\circ$ C revealed that the ductility of the HIP AM 316L condition was nearly double that observed in the CM 316L. This improved performance persisted even after cold working, as the CW AM 316L exhibited comparable ductility to CM 316L at -50 C after hydrogen charging, despite having a 2-fold higher yield strength. Feritscope measurements suggest this increased performance is related to the reduced propensity for AM 316L to form strain-induced martensite during deformation, even after significant post-processing treatments. These results demonstrate that AM 316L can be post-processed using typical procedures to exhibit similar to or even improved resistance to hydrogen embrittlement relative to CM 316L.


title: Multi-granular Adversarial Attacks against Black-box Neural Ranking Models

abstract: Adversarial ranking attacks have gained increasing attention due to their success in probing vulnerabilities, and, hence, enhancing the robustness, of neural ranking models. Conventional attack methods employ perturbations at a single granularity, e.g., word or sentence level, to target documents. However, limiting perturbations to a single level of granularity may reduce the flexibility of adversarial examples, thereby diminishing the potential threat of the attack. Therefore, we focus on generating high-quality adversarial examples by incorporating multi-granular perturbations. Achieving this objective involves tackling a combinatorial explosion problem, which requires identifying an optimal combination of perturbations across all possible levels of granularity, positions, and textual pieces. To address this challenge, we transform the multi-granular adversarial attack into a sequential decision-making process, where perturbations in the next attack step build on the perturbed document in the current attack step. Since the attack process can only access the final state without direct intermediate signals, we use reinforcement learning to perform multi-granular attacks. During the reinforcement learning process, two agents work cooperatively to identify multi-granular vulnerabilities as attack targets and organize perturbation candidates into a final perturbation sequence. Experimental results show that our attack method surpasses prevailing baselines in both attack effectiveness and imperceptibility.


title: Real-Time Hybrid Simulation for Infrastructure Degradation Assessment: Conceptual Framework and Illustrative Application

abstract: To date, the prospect of using real-time hybrid simulation (RTHS) to study the effects of long-term or 'wear-and-tear' loads, such as exposure to harmful environmental conditions or fatigue, has remained underexplored. This study presents a conceptual framework to assess the impact of long-term degradation on infrastructure systems. The framework integrates the capabilities of RTHS with accelerated degradation techniques to evaluate the behavior of a degrading system over time. Experimental results obtained in this way not only capture the complex interactions but also provide a reliability-based method to determine the expected time-to-failure of the evaluated system. The developed framework is demonstrated using a virtual RTHS platform designed to test fiber-reinforced elastomeric isolators.


title: Leveraging Digital Perceptual Technologies for Remote Perception and Analysis of Human Biomechanical Processes: A Contactless Approach for Workload and Joint Force Assessment

abstract: This study presents an innovative computer vision framework designed to analyze human movements in industrial settings, aiming to enhance biomechanical analysis by integrating seamlessly with existing software. Through a combination of advanced imaging and modeling techniques, the framework allows for comprehensive scrutiny of human motion, providing valuable insights into kinematic patterns and kinetic data. Utilizing Convolutional Neural Networks (CNNs), Direct Linear Transform (DLT), and Long Short-Term Memory (LSTM) networks, the methodology accurately detects key body points, reconstructs 3D landmarks, and generates detailed 3D body meshes. Extensive evaluations across various movements validate the framework's effectiveness, demonstrating comparable results to traditional marker-based models with minor differences in joint angle estimations and precise estimations of weight and height. Statistical analyses consistently support the framework's reliability, with joint angle estimations showing less than a 5-degree difference for hip flexion, elbow flexion, and knee angle methods. Additionally, weight estimation exhibits an average error of less than 6 % for weight and less than 2 % for height when compared to ground-truth values from 10 subjects. The integration of the Biomech-57 landmark skeleton template further enhances the robustness and reinforces the framework's credibility. This framework shows significant promise for meticulous biomechanical analysis in industrial contexts, eliminating the need for cumbersome markers and extending its utility to diverse research domains, including the study of specific exoskeleton devices' impact on facilitating the prompt return of injured workers to their tasks.


title: Broadband Visible Wavelength Microcomb Generation In Silicon Nitride Microrings Through Air-Clad Dispersion Engineering

abstract: The development of broadband microresonator frequency combs at visible wavelengths is pivotal for the advancement of compact and fieldable optical atomic clocks and spectroscopy systems. Yet, their realization necessitates resonators with anomalous dispersion, an arduous task due to the prevailing normal dispersion regime of materials within the visible spectrum. In this work, we evince that silicon nitride microring resonators with air cladding on top and sides -- a deviation from the frequently employed silica-embedded resonators -- allows for the direct generation of broadband microcombs in the visible range. We experimentally demonstrate combs pumped at 1060~nm (283~THz) that reach wavelengths as short as 680~nm (440 THz), and combs pumped at 780~nm (384 THz) that reach wavelengths as short as 630 nm (475 THz). We further show through simulations that microcombs extending to wavelengths as low as 461 nm (650 THz) should be accessible in this platform.


title: GLEMOS: Benchmark for Instantaneous Graph Learning Model Selection

abstract: The choice of a graph learning (GL) model (i.e., a GL algorithm and its hyperparameter settings) has a significant impact on the performance of downstream tasks. However, selecting the right GL model becomes increasingly difficult and time consuming as more and more GL models are developed. Accordingly, it is of great significance and practical value to equip users of GL with the ability to perform a near-instantaneous selection of an effective GL model without manual intervention. Despite the recent attempts to tackle this important problem, there has been no comprehensive benchmark environment to evaluate the performance of GL model selection methods. To bridge this gap, we present GLEMOS in this work, a comprehensive benchmark for instantaneous GL model selection that makes the following contributions. (i) GLEMOS provides extensive benchmark data for fundamental GL tasks, i.e., link prediction and node classification, including the performances of 366 models on 457 graphs on these tasks. (ii) GLEMOS designs multiple evaluation settings, and assesses how effectively representative model selection techniques perform in these different settings. (iii) GLEMOS is designed to be easily extended with new models, new graphs, and new performance records. (iv) Based on the experimental results, we discuss the limitations of existing approaches and highlight future research directions. To promote research on this significant problem, we make the benchmark data and code publicly available at https://github.com/facebookresearch/glemos.


title: Diffusion Deepfake

abstract: Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general public complicates the identification of these sophisticated deepfakes. Acknowledging the urgency to address the vulnerability of current deepfake detectors to this evolving threat, our paper introduces two extensive deepfake datasets generated by state-of-the-art diffusion models as other datasets are less diverse and low in quality. Our extensive experiments also showed that our dataset is more challenging compared to the other face deepfake datasets. Our strategic dataset creation not only challenge the deepfake detectors but also sets a new benchmark for more evaluation. Our comprehensive evaluation reveals the struggle of existing detection methods, often optimized for specific image domains and manipulations, to effectively adapt to the intricate nature of diffusion deepfakes, limiting their practical utility. To address this critical issue, we investigate the impact of enhancing training data diversity on representative detection methods. This involves expanding the diversity of both manipulation techniques and image domains. Our findings underscore that increasing training data diversity results in improved generalizability. Moreover, we propose a novel momentum difficulty boosting strategy to tackle the additional challenge posed by training data heterogeneity. This strategy dynamically assigns appropriate sample weights based on learning difficulty, enhancing the model's adaptability to both easy and challenging samples. Extensive experiments on both existing and newly proposed benchmarks demonstrate that our model optimization approach surpasses prior alternatives significantly.


title: Learning Temporal Cues by Predicting Objects Move for Multi-camera 3D Object Detection

abstract: In autonomous driving and robotics, there is a growing interest in utilizing short-term historical data to enhance multi-camera 3D object detection, leveraging the continuous and correlated nature of input video streams. Recent work has focused on spatially aligning BEV-based features over timesteps. However, this is often limited as its gain does not scale well with long-term past observations. To address this, we advocate for supervising a model to predict objects' poses given past observations, thus explicitly guiding to learn objects' temporal cues. To this end, we propose a model called DAP (Detection After Prediction), consisting of a two-branch network: (i) a branch responsible for forecasting the current objects' poses given past observations and (ii) another branch that detects objects based on the current and past observations. The features predicting the current objects from branch (i) is fused into branch (ii) to transfer predictive knowledge. We conduct extensive experiments with the large-scale nuScenes datasets, and we observe that utilizing such predictive information significantly improves the overall detection performance. Our model can be used plug-and-play, showing consistent performance gain.


title: Random 3-Manifolds Have No Totally Geodesic Submanifolds

abstract: Murphy and the second author showed that a generic closed Riemannian manifold has no totally geodesic submanifolds, provided it is at least four dimensional. Lytchak and Petrunin established the same thing in dimension 3. For the higher dimensional result, the generic set is open and dense in the $C^{q}$--topology for any $% q\geq 2.$ In Lytchak and Petrunin's work, the generic set is a dense $G_{\delta }$ in the $C^{q}$-topology for any $q\geq 2.$ Here we show that the set of such metrics on a compact $3$-manifold contains a set that is open and dense in the $C^{q}$-topology for any $q\geq 3.$


title: BERT-Enhanced Retrieval Tool for Homework Plagiarism Detection System

abstract: Text plagiarism detection task is a common natural language processing task that aims to detect whether a given text contains plagiarism or copying from other texts. In existing research, detection of high level plagiarism is still a challenge due to the lack of high quality datasets. In this paper, we propose a plagiarized text data generation method based on GPT-3.5, which produces 32,927 pairs of text plagiarism detection datasets covering a wide range of plagiarism methods, bridging the gap in this part of research. Meanwhile, we propose a plagiarism identification method based on Faiss with BERT with high efficiency and high accuracy. Our experiments show that the performance of this model outperforms other models in several metrics, including 98.86\%, 98.90%, 98.86%, and 0.9888 for Accuracy, Precision, Recall, and F1 Score, respectively. At the end, we also provide a user-friendly demo platform that allows users to upload a text library and intuitively participate in the plagiarism analysis.


title: Defining Problem from Solutions: Inverse Reinforcement Learning (IRL) and Its Applications for Next-Generation Networking

abstract: Performance optimization is a critical concern in networking, on which Deep Reinforcement Learning (DRL) has achieved great success. Nonetheless, DRL training relies on precisely defined reward functions, which formulate the optimization objective and indicate the positive/negative progress towards the optimal. With the ever-increasing environmental complexity and human participation in Next-Generation Networking (NGN), defining appropriate reward functions become challenging. In this article, we explore the applications of Inverse Reinforcement Learning (IRL) in NGN. Particularly, if DRL aims to find optimal solutions to the problem, IRL finds a problem from the optimal solutions, where the optimal solutions are collected from experts, and the problem is defined by reward inference. Specifically, we first formally introduce the IRL technique, including its fundamentals, workflow, and difference from DRL. Afterward, we present the motivations of IRL applications in NGN and survey existing studies. Furthermore, to demonstrate the process of applying IRL in NGN, we perform a case study about human-centric prompt engineering in Generative AI-enabled networks. We demonstrate the effectiveness of using both DRL and IRL techniques and prove the superiority of IRL.


title: Versatile LiDAR-Inertial Odometry With SE (2) Constraints for Ground Vehicles

abstract: LiDAR SLAM has become one of the major localization systems for ground vehicles since LiDAR Odometry And Mapping (LOAM). Many extension works on LOAM mainly leverage one specific constraint to improve the performance, e.g., information from on-board sensors such as loop closure and inertial state; prior conditions such as ground level and motion dynamics. In many robotic applications, these conditions are often known partially, hence a SLAM system can be a comprehensive problem due to the existence of numerous constraints. Therefore, we can achieve a better SLAM result by fusing them properly. In this paper, we propose a hybrid LiDAR-inertial SLAM framework that leverages both the on-board perception system and prior information such as motion dynamics to improve localization performance. In particular, we consider the case for ground vehicles, which are commonly used for autonomous driving and warehouse logistics. We present a computationally efficient LiDAR-inertial odometry method that directly parameterizes ground vehicle poses on SE(2). The out-of-SE(2) motion perturbations are not neglected but incorporated into an integrated noise term of a novel SE(2)-constraints model. For odometric measurement processing, we propose a versatile, tightly coupled LiDAR-inertial odometry to achieve better pose estimation than traditional LiDAR odometry. Thorough experiments are performed to evaluate our proposed method's performance in different scenarios, including localization for both indoor and outdoor environments. The proposed method achieves superior performance in accuracy and robustness.


title: FLEXIS: FLEXible Frequent Subgraph Mining using Maximal Independent Sets

abstract: Frequent Subgraph Mining (FSM) is the process of identifying common subgraph patterns that surpass a predefined frequency threshold. While FSM is widely applicable in fields like bioinformatics, chemical analysis, and social network anomaly detection, its execution remains time-consuming and complex. This complexity stems from the need to recognize high-frequency subgraphs and ascertain if they exceed the set threshold. Current approaches to identifying these patterns often rely on edge or vertex extension methods. However, these strategies can introduce redundancies and cause increased latency. To address these challenges, this paper introduces a novel approach for identifying potential k-vertex patterns by combining two frequently observed (k - 1)-vertex patterns. This method optimizes the breadth-]first search, which allows for quicker search termination based on vertices count and support value. Another challenge in FSM is the validation of the presumed pattern against a specific threshold. Existing metrics, such as Maximum Independent Set (MIS) and Minimum Node Image (MNI), either demand significant computational time or risk overestimating pattern counts. Our innovative approach aligns with the MIS and identifies independent subgraphs. Through the "Maximal Independent Set" metric, this paper offers an efficient solution that minimizes latency and provides users with control over pattern overlap. Through extensive experimentation, our proposed method achieves an average of 10.58x speedup when compared to GraMi and an average 3x speedup when compared to T-FSM


title: Efficient Computation of Mean field Control based Barycenters from Reaction-Diffusion Systems

abstract: We develop a class of barycenter problems based on mean field control problems in three dimensions with associated reactive-diffusion systems of unnormalized multi-species densities. This problem is the generalization of the Wasserstein barycenter problem for single probability density functions. The primary objective is to present a comprehensive framework for efficiently computing the proposed variational problem: generalized Benamou-Brenier formulas with multiple input density vectors as boundary conditions. Our approach involves the utilization of high-order finite element discretizations of the spacetime domain to achieve improved accuracy. The discrete optimization problem is then solved using the primal-dual hybrid gradient (PDHG) algorithm, a first-order optimization method for effectively addressing a wide range of constrained optimization problems. The efficacy and robustness of our proposed framework are illustrated through several numerical examples in three dimensions, such as the computation of the barycenter of multi-density systems consisting of Gaussian distributions and reactive-diffusive multi-density systems involving 3D voxel densities. Additional examples highlighting computations on 2D embedded surfaces are also provided.


title: TSCM: A Teacher-Student Model for Vision Place Recognition Using Cross-Metric Knowledge Distillation

abstract: Visual place recognition (VPR) plays a pivotal role in autonomous exploration and navigation of mobile robots within complex outdoor environments. While cost-effective and easily deployed, camera sensors are sensitive to lighting and weather changes, and even slight image alterations can greatly affect VPR efficiency and precision. Existing methods overcome this by exploiting powerful yet large networks, leading to significant consumption of computational resources. In this paper, we propose a high-performance teacher and lightweight student distillation framework called TSCM. It exploits our devised cross-metric knowledge distillation to narrow the performance gap between the teacher and student models, maintaining superior performance while enabling minimal computational load during deployment. We conduct comprehensive evaluations on large-scale datasets, namely Pittsburgh30k and Pittsburgh250k. Experimental results demonstrate the superiority of our method over baseline models in terms of recognition accuracy and model parameter efficiency. Moreover, our ablation studies show that the proposed knowledge distillation technique surpasses other counterparts. The code of our method has been released at https://github.com/nubot-nudt/TSCM.


title: Hallucination Diversity-Aware Active Learning for Text Summarization

abstract: Large Language Models (LLMs) have shown propensity to generate hallucinated outputs, i.e., texts that are factually incorrect or unsupported. Existing methods for alleviating hallucinations typically require costly human annotations to identify and correct hallucinations in LLM outputs. Moreover, most of these methods focus on a specific type of hallucination, e.g., entity or token errors, which limits their effectiveness in addressing various types of hallucinations exhibited in LLM outputs. To our best knowledge, in this paper we propose the first active learning framework to alleviate LLM hallucinations, reducing costly human annotations of hallucination needed. By measuring fine-grained hallucinations from errors in semantic frame, discourse and content verifiability in text summarization, we propose HAllucination Diversity-Aware Sampling (HADAS) to select diverse hallucinations for annotations in active learning for LLM finetuning. Extensive experiments on three datasets and different backbone models demonstrate advantages of our method in effectively and efficiently mitigating LLM hallucinations.


title: Classifying Cancer Stage with Open-Source Clinical Large Language Models

abstract: Cancer stage classification is important for making treatment and care management plans for oncology patients. Information on staging is often included in unstructured form in clinical, pathology, radiology and other free-text reports in the electronic health record system, requiring extensive work to parse and obtain. To facilitate the extraction of this information, previous NLP approaches rely on labeled training datasets, which are labor-intensive to prepare. In this study, we demonstrate that without any labeled training data, open-source clinical large language models (LLMs) can extract pathologic tumor-node-metastasis (pTNM) staging information from real-world pathology reports. Our experiments compare LLMs and a BERT-based model fine-tuned using the labeled data. Our findings suggest that while LLMs still exhibit subpar performance in Tumor (T) classification, with the appropriate adoption of prompting strategies, they can achieve comparable performance on Metastasis (M) classification and improved performance on Node (N) classification.


title: Non-finitely generated monoids corresponding to finitely generated homogeneous subalgebras

abstract: The goal of this paper is to study the possible monoids appearing as the associated monoids of the initial algebra of a finitely generated homogeneous $\Bbbk$-subalgebra of a polynomial ring $\Bbbk[x_1,\ldots,x_n]$. Clearly, any affine monoid can be realized since the initial algebra of the affine monoid $\Bbbk$-algebra is itself. On the other hand, the initial algebra of a finitely generated homogeneous $\Bbbk$-algebra is not necessarily finitely generated. In this paper, we provide a new family of non-finitely generated monoids which can be realized as the initial algebras of finitely generated homogeneous $\Bbbk$-algebras. Moreover, we also provide an example of a non-finitely generated monoid which cannot be realized as the initial algebra of any finitely generated homogeneous $\Bbbk$-algebra.


title: Language Model Guided Interpretable Video Action Reasoning

abstract: While neural networks have excelled in video action recognition tasks, their black-box nature often obscures the understanding of their decision-making processes. Recent approaches used inherently interpretable models to analyze video actions in a manner akin to human reasoning. These models, however, usually fall short in performance compared to their black-box counterparts. In this work, we present a new framework named Language-guided Interpretable Action Recognition framework (LaIAR). LaIAR leverages knowledge from language models to enhance both the recognition capabilities and the interpretability of video models. In essence, we redefine the problem of understanding video model decisions as a task of aligning video and language models. Using the logical reasoning captured by the language model, we steer the training of the video model. This integrated approach not only improves the video model's adaptability to different domains but also boosts its overall performance. Extensive experiments on two complex video action datasets, Charades & CAD-120, validates the improved performance and interpretability of our LaIAR framework. The code of LaIAR is available at https://github.com/NingWang2049/LaIAR.


title: Structural, magnetic and magnetocaloric properties of triangular-lattice transition-metal phosphates

abstract: The recent discovery of the spin supersolid candidate Na$_2$BaCo(PO$_4$)$_2$ stimulates numerous research interest on the triangular-lattice transition-metal phosphates. Here we report a comprehensive study on the structural, magnetic and magnetocaloric properties of polycrystalline Na$_2$$A$$T$(PO$_4$)$_2$ ($A$ = Ba, Sr; $T$ = Co, Ni, Mn). X-ray and neutron diffraction measurements confirm that Na$_2$Ba$T$(PO$_4$)$_2$ (NB$T$P) crystallizes in a trigonal structure, while Na$_2$Sr$T$(PO$_4$)$_2$ (NS$T$P) forms a monoclinic structure with a slight distortion of the triangular network of $T^{2+}$ ions. The dc magnetization data show that all six compounds order antiferromagnetically below 2 K, and the N\'{e}el temperatures of NS$T$P are consistently higher than those of NB$T$P for $T$ = Co, Ni, and Mn, due to the release of geometrical frustration by monoclinic distortions. Further magnetocaloric measurements show that trigonal NB$T$P can reach a lower temperature in the quasi-adiabatic demagnetization process and thus shows a better performance in the magnetic refrigeration, compared with monoclinic NS$T$P. Our findings highlight the outstanding magnetocaloric performances of the trigonal transition-metal phosphates, and disclose two necessary ingredients for a superior magnetic coolant that can reach an ultra-low temperature, including a perfect geometrically frustrated lattice and a small effective spin number associated with the magnetic ions.


title: Optimizing Distributed Protocols with Query Rewrites [Technical Report]

abstract: Distributed protocols such as 2PC and Paxos lie at the core of many systems in the cloud, but standard implementations do not scale. New scalable distributed protocols are developed through careful analysis and rewrites, but this process is ad hoc and error-prone. This paper presents an approach for scaling any distributed protocol by applying rule-driven rewrites, borrowing from query optimization. Distributed protocol rewrites entail a new burden: reasoning about spatiotemporal correctness. We leverage order-insensitivity and data dependency analysis to systematically identify correct coordination-free scaling opportunities. We apply this analysis to create preconditions and mechanisms for coordination-free decoupling and partitioning, two fundamental vertical and horizontal scaling techniques. Manual rule-driven applications of decoupling and partitioning improve the throughput of 2PC by $5\times$ and Paxos by $3\times$, and match state-of-the-art throughput in recent work. These results point the way toward automated optimizers for distributed protocols based on correct-by-construction rewrite rules.


title: Estimates of discrete time derivatives for the parabolic-parabolic Robin-Robin coupling method

abstract: We consider a loosely coupled, non-iterative Robin-Robin coupling method proposed and analyzed in [J. Numer. Math., 31(1):59--77, 2023] for a parabolic-parabolic interface problem and prove estimates for the discrete time derivatives of the scalar field in different norms. When the interface is flat and perpendicular to two of the edges of the domain we prove error estimates in the $H^2$-norm. Such estimates are key ingredients to analyze a defect correction method for the parabolic-parabolic interface problem. Numerical results are shown to support our findings.


title: Propensity Score Alignment of Unpaired Multimodal Data

abstract: Multimodal representation learning techniques typically rely on paired samples to learn common representations, but paired samples are challenging to collect in fields such as biology where measurement devices often destroy the samples. This paper presents an approach to address the challenge of aligning unpaired samples across disparate modalities in multimodal representation learning. We draw an analogy between potential outcomes in causal inference and potential views in multimodal observations, which allows us to use Rubin's framework to estimate a common space in which to match samples. Our approach assumes we collect samples that are experimentally perturbed by treatments, and uses this to estimate a propensity score from each modality, which encapsulates all shared information between a latent state and treatment and can be used to define a distance between samples. We experiment with two alignment techniques that leverage this distance -- shared nearest neighbours (SNN) and optimal transport (OT) matching -- and find that OT matching results in significant improvements over state-of-the-art alignment approaches in both a synthetic multi-modal setting and in real-world data from NeurIPS Multimodal Single-Cell Integration Challenge.


title: PhysORD: A Neuro-Symbolic Approach for Physics-infused Motion Prediction in Off-road Driving

abstract: Motion prediction is critical for autonomous off-road driving, however, it presents significantly more challenges than on-road driving because of the complex interaction between the vehicle and the terrain. Traditional physics-based approaches encounter difficulties in accurately modeling dynamic systems and external disturbance. In contrast, data-driven neural networks require extensive datasets and struggle with explicitly capturing the fundamental physical laws, which can easily lead to poor generalization. By merging the advantages of both methods, neuro-symbolic approaches present a promising direction. These methods embed physical laws into neural models, potentially significantly improving generalization capabilities. However, no prior works were evaluated in real-world settings for off-road driving. To bridge this gap, we present PhysORD, a neural-symbolic approach integrating the conservation law, i.e., the Euler-Lagrange equation, into data-driven neural models for motion prediction in off-road driving. Our experiments showed that PhysORD can accurately predict vehicle motion and tolerate external disturbance by modeling uncertainties. It outperforms existing methods both in accuracy and efficiency and demonstrates data-efficient learning and generalization ability in long-term prediction.


title: On the permutations that strongly avoid the pattern 312 or 231

abstract: In 2019, B\'ona and Smith introduced the notion of \emph{strong pattern avoidance}, that is, a permutation and its square both avoid a given pattern. In this paper, we enumerate the set of permutations $\pi$ which not only strongly avoid the pattern $312$ or $231$ but also avoid the pattern $\tau$, for $\tau\in S_3$ and some $\tau\in S_4$. One of them is to give a positive answer to a conjecture of Archer and Geary.


title: Extremum-Seeking Action Selection for Accelerating Policy Optimization

abstract: Reinforcement learning for control over continuous spaces typically uses high-entropy stochastic policies, such as Gaussian distributions, for local exploration and estimating policy gradient to optimize performance. Many robotic control problems deal with complex unstable dynamics, where applying actions that are off the feasible control manifolds can quickly lead to undesirable divergence. In such cases, most samples taken from the ambient action space generate low-value trajectories that hardly contribute to policy improvement, resulting in slow or failed learning. We propose to improve action selection in this model-free RL setting by introducing additional adaptive control steps based on Extremum-Seeking Control (ESC). On each action sampled from stochastic policies, we apply sinusoidal perturbations and query for estimated Q-values as the response signal. Based on ESC, we then dynamically improve the sampled actions to be closer to nearby optima before applying them to the environment. Our methods can be easily added in standard policy optimization to improve learning efficiency, which we demonstrate in various control learning environments.


title: A second-order correction method for loosely coupled discretizations applied to parabolic-parabolic interface problems

abstract: We consider a parabolic-parabolic interface problem and construct a loosely coupled prediction-correction scheme based on the Robin-Robin splitting method analyzed in [J. Numer. Math., 31(1):59--77, 2023]. We show that the errors of the correction step converge at $\mathcal O((\Delta t)^2)$, under suitable convergence rate assumptions on the discrete time derivative of the prediction step, where $\Delta t$ stands for the time-step length. Numerical results are shown to support our analysis and the assumptions.


title: C-type antiferromagnetic structure of topological semimetal CaMnSb$_2$

abstract: Determination of the magnetic structure and confirmation of the presence or absence of inversion ($\mathcal{P}$) and time reversal ($\mathcal{T}$) symmetry is imperative for correctly understanding the topological magnetic materials. Here high-quality single crystals of the layered manganese pnictide CaMnSb$_2$ are synthesized using the self-flux method. De Haas-van Alphen oscillations indicate a nontrivial Berry phase of $\sim$ $\pi$ and a notably small cyclotron effective mass, supporting the Dirac semimetal nature of CaMnSb$_2$. Neutron diffraction measurements identify a C-type antiferromagnetic (AFM) structure below $T\rm_{N}$ = 303(1) K with the Mn moments aligned along the $a$ axis, which is well supported by the density functional theory (DFT) calculations. The corresponding magnetic space group is $Pn'm'a'$, preserving a $\mathcal{P}\times\mathcal{T}$ symmetry. Adopting the experimentally determined magnetic structure, band crossings near the Y point in momentum space and linear dispersions of the Sb $5p_{y,z}$ bands are revealed by the DFT calculations. Furthermore, our study predicts the possible existence of an intrinsic second-order nonlinear Hall effect in CaMnSb$_2$, offering a promising platform to study the impact of topological properties on nonlinear electrical transports in antiferromagnets.


title: What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks

abstract: We study the capabilities of the transformer architecture with varying depth. Specifically, we designed a novel set of sequence learning tasks to systematically evaluate and comprehend how the depth of transformer affects its ability to perform memorization, reasoning, generalization, and contextual generalization. We show a transformer with only one attention layer can excel in memorization but falls short in other tasks. Then, we show that exhibiting reasoning and generalization ability requires the transformer to have at least two attention layers, while context generalization ability may necessitate three attention layers. Additionally, we identify a class of simple operations that a single attention layer can execute, and show that the complex tasks can be approached as the combinations of these simple operations and thus can be resolved by stacking multiple attention layers. This sheds light on studying more practical and complex tasks beyond our design. Numerical experiments corroborate our theoretical findings.


title: Helmsman of the Masses? Evaluate the Opinion Leadership of Large Language Models in the Werewolf Game

abstract: Large language models (LLMs) have exhibited memorable strategic behaviors in social deductive games. However, the significance of opinion leadership exhibited by LLM-based agents has been overlooked, which is crucial for practical applications in multi-agent and human-AI interaction settings. Opinion leaders are individuals who have a noticeable impact on the beliefs and behaviors of others within a social group. In this work, we employ the Werewolf game as a simulation platform to assess the opinion leadership of LLMs. The game features the role of the Sheriff, tasked with summarizing arguments and recommending decision options, and therefore serves as a credible proxy for an opinion leader. We develop a framework integrating the Sheriff role and devise two novel metrics for evaluation based on the critical characteristics of opinion leaders. The first metric measures the reliability of the opinion leader, and the second assesses the influence of the opinion leader on other players' decisions. We conduct extensive experiments to evaluate LLMs of different scales. In addition, we collect a Werewolf question-answering dataset (WWQA) to assess and enhance LLM's grasp of the game rules, and we also incorporate human participants for further analysis. The results suggest that the Werewolf game is a suitable test bed to evaluate the opinion leadership of LLMs and few LLMs possess the capacity for opinion leadership.


title: Understanding spin currents from magnon dispersion and polarization: Spin-Seebeck effect and neutron scattering study on Tb3Fe5O12

abstract: Magnon spin currents in the ferrimagnetic garnet Tb3Fe5O12 with 4f electrons were examined through the spin-Seebeck effect and neutron scattering measurements. The compound shows a magnetic compensation, where the spin-Seebeck signal reverses above and below Tcomp = 249.5(4) K. Unpolarized neutron scattering unveils two major magnon branches with finite energy gaps, which are well-explained in the framework of spin-wave theory. Their temperature dependencies and the direction of the precession motion of magnetic moments, i.e. magnon polarization, defined using polarized neutrons, explain the reversal at Tcomp and decay of the spin-Seebeck signals at low temperatures. We illustrate an example that momentum- and energy-resolved microscopic information is a prerequisite to understanding the magnon spin current.


title: WaveDH: Wavelet Sub-bands Guided ConvNet for Efficient Image Dehazing

abstract: The surge in interest regarding image dehazing has led to notable advancements in deep learning-based single image dehazing approaches, exhibiting impressive performance in recent studies. Despite these strides, many existing methods fall short in meeting the efficiency demands of practical applications. In this paper, we introduce WaveDH, a novel and compact ConvNet designed to address this efficiency gap in image dehazing. Our WaveDH leverages wavelet sub-bands for guided up-and-downsampling and frequency-aware feature refinement. The key idea lies in utilizing wavelet decomposition to extract low-and-high frequency components from feature levels, allowing for faster processing while upholding high-quality reconstruction. The downsampling block employs a novel squeeze-and-attention scheme to optimize the feature downsampling process in a structurally compact manner through wavelet domain learning, preserving discriminative features while discarding noise components. In our upsampling block, we introduce a dual-upsample and fusion mechanism to enhance high-frequency component awareness, aiding in the reconstruction of high-frequency details. Departing from conventional dehazing methods that treat low-and-high frequency components equally, our feature refinement block strategically processes features with a frequency-aware approach. By employing a coarse-to-fine methodology, it not only refines the details at frequency levels but also significantly optimizes computational costs. The refinement is performed in a maximum 8x downsampled feature space, striking a favorable efficiency-vs-accuracy trade-off. Extensive experiments demonstrate that our method, WaveDH, outperforms many state-of-the-art methods on several image dehazing benchmarks with significantly reduced computational costs. Our code is available at https://github.com/AwesomeHwang/WaveDH.


title: Division properties of commuting polynomials

abstract: Polynomials commute under composition are referred to as commuting polynomials. In this paper, we study division properties for commuting polynomials with rational (and integer) coefficients. As a consequence, we show an algebraic particularity of the commuting polynomials coming from weighted sums for cycle graphs with pendant edges (arXiv:2402.07209v1.).


title: Haina Storage: A Decentralized Secure Storage Framework Based on Improved Blockchain Structure

abstract: Although the decentralized storage technology based on the blockchain can effectively realize secure data storage on cloud services. However, there are still some problems in the existing schemes, such as low storage capacity and low efficiency. To address related issues, we propose a novel decentralized storage framework, which mainly includes four aspects: (1) we proposed a Bi-direction Circular Linked Chain Structure (BCLCS), which improves data's storage capacity and applicability in decentralized storage. (2) A Proof of Resources (PoR) decision model is proposed. By introducing the network environment as an essential evaluation parameter of storage right decision, the energy and time consumption of decision-making are reduced, and the fairness of decision-making is improved. (3) A chain structure dynamic locking mechanism (CSDLM) is designed to realize anti-traverse and access control. (4) A Bi-directional data Access Mechanism (BDAM) is proposed, which improves the efficiency of data access and acquisition in decentralized storage mode. The experimental results show that the framework has significantly improved the shortcomings of the current decentralized storage.


title: Migration barriers for diffusion of As and P atoms in InP and InAs via vacancies and interstitial atoms

abstract: Processes of diffusion of As and P atoms in InP and InAs, and atomic and energy structure of group-V vacancies and interstitial P and As atoms in InP and InAs have been investigated using density functional theory. Formation energies of group-V vacancies in InP and InAs and P and As interstitial atoms in InP and InAs have been calculated with hybrid functional. The main types of migration jumps have been determined, and the energy favorable migration paths and migration barriers of As and P atoms diffusion in InP and InAs via vacancies and interstitial atoms have been calculated using climbing image nudged elastic band method. In the case of diffusion of As and P atoms in InP and InAs via interstitial atoms the diffusion process occurs via indirect interstitial mechanism. The migration energy barriers for the vacancy diffusion mechanism are 1.5-2.0 eV, the migration energy barriers for the interstitialcy mechanism are 0.3-0.6 eV. The interstitial atoms have higher formation energies compared to the formation energies of the vacancies, and total activation energies of the diffusion are comparable for the vacancy and interstitialcy mechanisms. The obtained results will be useful for modeling of the diffusion processes in semiconductor structures based on InP and InAs.


title: FAIRM: Learning invariant representations for algorithmic fairness and domain generalization with minimax optimality

abstract: Machine learning methods often assume that the test data have the same distribution as the training data. However, this assumption may not hold due to multiple levels of heterogeneity in applications, raising issues in algorithmic fairness and domain generalization. In this work, we address the problem of fair and generalizable machine learning by invariant principles. We propose a training environment-based oracle, FAIRM, which has desirable fairness and domain generalization properties under a diversity-type condition. We then provide an empirical FAIRM with finite-sample theoretical guarantees under weak distributional assumptions. We then develop efficient algorithms to realize FAIRM in linear models and demonstrate the nonasymptotic performance with minimax optimality. We evaluate our method in numerical experiments with synthetic data and MNIST data and show that it outperforms its counterparts.


title: Identifying the Largest RoCoF and Its Implications

abstract: The rate of change of frequency (RoCoF) is a critical factor in ensuring frequency security, particularly in power systems with low inertia. Currently, most RoCoF security constrained optimal inertia dispatch methods and inertia market mechanisms predominantly rely on the center of inertia (COI) model. This model, however, does not account for the disparities in post-contingency frequency dynamics across different regions of a power system. Specifically, regional buses can exhibit significantly larger RoCoFs than that predicted by the system's COI, particularly in systems characterized by unevenly distributed inertia. In this letter, a post-contingency nodal RoCoF model is established, and the maximal initial RoCoF is further proven to occur at generator buses equipped with inertia, rather than at inertia-less load buses. This finding facilitates the development of the optimal nodal inertia dispatch method and the nodal inertia market mechanism in a convex and concise form. Our argument is further verified by the simulation results of the South East Australia power system under various scenarios.


title: Fractional mean field equations on finite graphs

abstract: In this paper, the author considers the fractional mean field equation on a finite graph $G=(V,E)$, say \begin{equation*} (-\Delta)^s u=\rho\left(\dfrac{he^u}{\int_V he^ud\mu}-\dfrac{1}{|V|}\right),\quad\forall\,x\in V, \end{equation*} where $s\in(0,\,1)$, $\rho\in(-\infty,\,0)\cup(0,\,+\infty)$ are some fixed parameters, $h$ denotes a given real value function on $V$. Based on the sign of the prescribed function $h$, via the variational method, topological degree and two mean field type heat flows, the author obtains the existence of solutions for the above problem in three cases respectively. These results extend the relevant research of Lin-Yang (Calc. Var., 2021), Sun-Wang (Adv. Math., 2022) and Liu-Zhang (J. Math. Anal. Appl., 2023) in the case of $s=1$.


title: Audio Simulation for Sound Source Localization in Virtual Evironment

abstract: Non-line-of-sight localization in signal-deprived environments is a challenging yet pertinent problem. Acoustic methods in such predominantly indoor scenarios encounter difficulty due to the reverberant nature. In this study, we aim to locate sound sources to specific locations within a virtual environment by leveraging physically grounded sound propagation simulations and machine learning methods. This process attempts to overcome the issue of data insufficiency to localize sound sources to their location of occurrence especially in post-event localization. We achieve 0.786+/- 0.0136 F1-score using an audio transformer spectrogram approach.


title: Spin-UP: Spin Light for Natural Light Uncalibrated Photometric Stereo

abstract: Natural Light Uncalibrated Photometric Stereo (NaUPS) relieves the strict environment and light assumptions in classical Uncalibrated Photometric Stereo (UPS) methods. However, due to the intrinsic ill-posedness and high-dimensional ambiguities, addressing NaUPS is still an open question. Existing works impose strong assumptions on the environment lights and objects' material, restricting the effectiveness in more general scenarios. Alternatively, some methods leverage supervised learning with intricate models while lacking interpretability, resulting in a biased estimation. In this work, we proposed Spin Light Uncalibrated Photometric Stereo (Spin-UP), an unsupervised method to tackle NaUPS in various environment lights and objects. The proposed method uses a novel setup that captures the object's images on a rotatable platform, which mitigates NaUPS's ill-posedness by reducing unknowns and provides reliable priors to alleviate NaUPS's ambiguities. Leveraging neural inverse rendering and the proposed training strategies, Spin-UP recovers surface normals, environment light, and isotropic reflectance under complex natural light with low computational cost. Experiments have shown that Spin-UP outperforms other supervised / unsupervised NaUPS methods and achieves state-of-the-art performance on synthetic and real-world datasets. Codes and data are available at https://github.com/LMozart/CVPR2024-SpinUP.


title: Identification of High-dimensional ARMA Models with Binary-Valued Observations

abstract: This paper studies system identification of high-dimensional ARMA models with binary-valued observations. Compared with existing quantized identification of ARMA models, this problem is more challenging since the accessible information is much less. Different from the identification of FIR models with binary-valued observations, the prediction of original system output and the parameter both need to be estimated in ARMA models. We propose an online identification algorithm consisting of parameter estimation and prediction of original system output. The parameter estimation and the prediction of original output are strongly coupled but mutually reinforcing. By analyzing the two estimates at the same time instead of analyzing separately, we finally prove that the parameter estimate can converge to the true parameter with convergence rate $O(1/k)$ under certain conditions. Simulations are given to demonstrate the theoretical results.


title: LR-FPN: Enhancing Remote Sensing Object Detection with Location Refined Feature Pyramid Network

abstract: Remote sensing target detection aims to identify and locate critical targets within remote sensing images, finding extensive applications in agriculture and urban planning. Feature pyramid networks (FPNs) are commonly used to extract multi-scale features. However, existing FPNs often overlook extracting low-level positional information and fine-grained context interaction. To address this, we propose a novel location refined feature pyramid network (LR-FPN) to enhance the extraction of shallow positional information and facilitate fine-grained context interaction. The LR-FPN consists of two primary modules: the shallow position information extraction module (SPIEM) and the contextual interaction module (CIM). Specifically, SPIEM first maximizes the retention of solid location information of the target by simultaneously extracting positional and saliency information from the low-level feature map. Subsequently, CIM injects this robust location information into different layers of the original FPN through spatial and channel interaction, explicitly enhancing the object area. Moreover, in spatial interaction, we introduce a simple local and non-local interaction strategy to learn and retain the saliency information of the object. Lastly, the LR-FPN can be readily integrated into common object detection frameworks to improve performance significantly. Extensive experiments on two large-scale remote sensing datasets (i.e., DOTAV1.0 and HRSC2016) demonstrate that the proposed LR-FPN is superior to state-of-the-art object detection approaches. Our code and models will be publicly available.


title: Collaborative human-AI trust (CHAI-T): A process framework for active management of trust in human-AI collaboration

abstract: Collaborative human-AI (HAI) teaming combines the unique skills and capabilities of humans and machines in sustained teaming interactions leveraging the strengths of each. In tasks involving regular exposure to novelty and uncertainty, collaboration between adaptive, creative humans and powerful, precise artificial intelligence (AI) promises new solutions and efficiencies. User trust is essential to creating and maintaining these collaborative relationships. Established models of trust in traditional forms of AI typically recognize the contribution of three primary categories of trust antecedents: characteristics of the human user, characteristics of the technology, and environmental factors. The emergence of HAI teams, however, requires an understanding of human trust that accounts for the specificity of task contexts and goals, integrates processes of interaction, and captures how trust evolves in a teaming environment over time. Drawing on both the psychological and computer science literature, the process framework of trust in collaborative HAI teams (CHAI-T) presented in this paper adopts the tripartite structure of antecedents established by earlier models, while incorporating team processes and performance phases to capture the dynamism inherent to trust in teaming contexts. These features enable active management of trust in collaborative AI systems, with practical implications for the design and deployment of collaborative HAI teams.


title: Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems

abstract: Large language models (LLMs) are trained on text-only data that go far beyond the languages with paired speech and text data. At the same time, Dual Encoder (DE) based retrieval systems project queries and documents into the same embedding space and have demonstrated their success in retrieval and bi-text mining. To match speech and text in many languages, we propose using LLMs to initialize multi-modal DE retrieval systems. Unlike traditional methods, our system doesn't require speech data during LLM pre-training and can exploit LLM's multilingual text understanding capabilities to match speech and text in languages unseen during retrieval training. Our multi-modal LLM-based retrieval system is capable of matching speech and text in 102 languages despite only training on 21 languages. Our system outperforms previous systems trained explicitly on all 102 languages. We achieve a 10% absolute improvement in Recall@1 averaged across these languages. Additionally, our model demonstrates cross-lingual speech and text matching, which is further enhanced by readily available machine translation data.