title: Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark

abstract: Despite the recent emergence of video captioning models, how to generate the text description with specific entity names and fine-grained actions is far from being solved, which however has great applications such as basketball live text broadcast. In this paper, a new multimodal knowledge graph supported basketball benchmark for video captioning is proposed. Specifically, we construct a multimodal basketball game knowledge graph (KG_NBA_2022) to provide additional knowledge beyond videos. Then, a multimodal basketball game video captioning (VC_NBA_2022) dataset that contains 9 types of fine-grained shooting events and 286 players' knowledge (i.e., images and names) is constructed based on KG_NBA_2022. We develop a knowledge guided entity-aware video captioning network (KEANet) based on a candidate player list in encoder-decoder form for basketball live text broadcast. The temporal contextual information in video is encoded by introducing the bi-directional GRU (Bi-GRU) module. And the entity-aware module is designed to model the relationships among the players and highlight the key players. Extensive experiments on multiple sports benchmarks demonstrate that KEANet effectively leverages extera knowledge and outperforms advanced video captioning models. The proposed dataset and corresponding codes will be publicly available soon


title: Can quantum theory be underpinned by a non-local hidden variable theory ?

abstract: In this paper we consider the description by a general Bell-type non-local hidden variable theory (NLHVT) of bipartite quantum states with two observables per sub-system. We derive Bell inequalities of the Collins-Gisin.-Liden-Massar-Popescu (CGLMP) type which involve combinations of the probabilities of related outcomes for measurements for the four pairs of sub-system observables. It is shown that the corresponding quantum theory expressions violate the Bell inequalities in the case of the maximally entangled state of the bipartitite system. The CHSH Bell inequality is also derived from this general CGLMP Bell-type non-local hidden variable theory. This shows that quantum theory can not be underpinned by a Bell-type non-local hidden variable theory. So as a general Bell-type local hidden variable theory has already been shown to conflict with quantum theory, it follows that quantum theory can not be understood in terms of any CGLMP Bell-type hidden variable theory - local or non-local.


title: Discrete Hawkes process with flexible residual distribution and filtered historical simulation

abstract: We introduce a new model which can be considered as a extended version of the Hawkes process in a discrete sense. This model enables the integration of various residual distributions while preserving the fundamental properties of the original Hawkes process. The rich nature of this model enables a filtered historical simulation which incorporate the properties of original time series more accurately. The process naturally extends to multi-variate models with easy implementations of estimation and simulation. We investigate the effect of flexible residual distribution on estimation of high frequency financial data compared with the Hawkes process.


title: Text to speech synthesis

abstract: Text-to-speech (TTS) synthesis is a technology that converts written text into spoken words, enabling a natural and accessible means of communication. This abstract explores the key aspects of TTS synthesis, encompassing its underlying technologies, applications, and implications for various sectors. The technology utilizes advanced algorithms and linguistic models to convert textual information into life like speech, allowing for enhanced user experiences in diverse contexts such as accessibility tools, navigation systems, and virtual assistants. The abstract delves into the challenges and advancements in TTS synthesis, including considerations for naturalness, multilingual support, and emotional expression in synthesized speech.


title: Contribution of $\pi^0$ Exchange in Elastic Muon-Proton Scattering

abstract: The effect of the lepton's mass is significantly enhanced when the beam's energy is on the order of the lepton's mass. In the case of electrons, this corresponds to beam momenta on the order of a few MeV and is negligible in higher energy experiments. In this study, we calculate the differential cross section $d\sigma/ d\Omega$ for the helicity-flip meson exchange interference in elastic muon-proton $(\mu p)$ scattering $\mu^- p \rightarrow \mu^- p$. In particular, we examine the $\pi^0$ meson exchange in the $t$-channel for a longitudinally polarized beam and a transversely polarized target. We demonstrate the contribution to be larger for muons due to the lepton mass difference. Then we construct the corresponding beam-target double-spin asymmetries for the target polarized normal and parallel to the momentum transfer in the Breit frame, and then consider the model dependence of the calculation from the estimation of the $\pi^0 \mu \mu$ vertex. The contribution was found to be on the order of $\sim .15\%$ for muons in the kinematic region of the MUSE experiment.


title: A Survey on Indoor Visible Light Positioning Systems: Fundamentals, Applications, and Challenges

abstract: The growing demand for location-based services in areas like virtual reality, robot control, and navigation has intensified the focus on indoor localization. Visible light positioning (VLP), leveraging visible light communications (VLC), becomes a promising indoor positioning technology due to its high accuracy and low cost. This paper provides a comprehensive survey of VLP systems. In particular, since VLC lays the foundation for VLP, we first present a detailed overview of the principles of VLC. The performance of each positioning algorithm is also compared in terms of various metrics such as accuracy, coverage, and orientation limitation. Beyond the physical layer studies, the network design for a VLP system is also investigated, including multi-access technologies resource allocation, and light-emitting diode (LED) placements. Next, the applications of the VLP systems are overviewed. Finally, this paper outlines open issues, challenges, and future research directions for the research field. In a nutshell, this paper constitutes the first holistic survey on VLP from state-of-the-art studies to practical uses.


title: Energies and angular momenta of periodic Schwarzschild geodesics

abstract: We consider physical parameters of Levin and Perez-Giz's `periodic table of orbits' around the Schwarzschild black hole, where each periodic orbit is classified according to three integers $(z,w,v)$. In particular, we chart its distribution in terms of its angular momenta $L$ and energy $E$. In the $(L,E)$-parameter space, the set of all periodic orbits can be partitioned into domains according to their whirl number $w$, where the limit of infinite $w$ approaches the branch of unstable circular orbits. Within each domain of a given whirl number $w$, the infinite zoom limit $\lim_{z\rightarrow\infty}(z,w,v)$ converges to the common boundary with the adjacent domain of whirl number $w-1$. The distribution of the periodic orbit branches can also be inferred from perturbing stable circular orbits, using the fact that every stable circular orbit is the zero-eccentricity limit of some periodic orbit, or arbitrarily close to one.


title: Monte-Carlo simulations of the capture and cooling of alkali-metal atoms by a supersonic helium jet

abstract: We present three-dimensional Monte-Carlo simulations of the capture of 1000 K $^7$Li or 500 K $^{87}$Rb atoms by a continuous supersonic $^4$He jet and show that intense alkali-metal beams form with narrow transverse and longitudinal velocity distributions. The nozzle creating the $^4$He jet is held at approximately 4 K. These conditions are similar to those in the cold $^7$Li source developed by some of us as described in [Phy. Rev. A 107, 013302 (2023)]. The simulations use differential cross-sections obtained from quantum scattering calculations of $^7$Li or $^{87}$Rb atoms with $^4$He atoms for relative collision energies between $k\times 1$ mK to $k\times 3000$ K, where $k$ is the Boltzmann constant. For collision energies larger than $\approx k\times 4$ K the collisions favor forward scattering, deflecting the $^7$Li or $^{87}$Rb atoms by no more than a few degrees. From the simulations, we find that about 1$\%$ of the lithium atoms are captured into the $^4$He jet, resulting in a lithium beam with a most probable velocity of about $210$ m/s and number densities on the order of $10^{8}$ cm$^{-3}$. Simulations predict narrow yet asymmetric velocity distributions which are verified by comparing to fluorescence measurements of the seeded $^7$Li atoms. We find agreement between simulated and experimentally measured seeded $^7$Li densities to be better than 50$\%$ across a range of $^4$He flow rates. We make predictions for capture efficiency and cooling of $^{87}$Rb by a supersonic $^4$He jet. The capture efficiency for $^{87}$Rb is expected to be similar to $^7$Li.


title: Photon propagation in a charged Bose-Einstein condensate

abstract: We consider the propagation of photons in the background of a Bose-Einstein (BE) condensate of a charged scalar field, by extending a method recently proposed to treat the propagation of fermions in a BE condensate. We determine the dispersion relations of the collective modes of the system, as well as the photon polarization tensor and the dielectric constant that result after the symmetry breaking associated with the BE condensation in the model. Two modes correspond to the transverse photon polarizations, and their dispersion relations have the usual form of the transverse photons in a plasma. The other two modes, which we denote as the $(\pm)$ modes, are combinations of the longitudinal photon and the massive scalar field. The dispersion relation of the $(-)$ mode decreases as a function of the momentum in a given range, and the corresponding group velocity is negative in that range. We also determine the wavefunctions of the $(\pm)$ modes, which can be used to obtain the corrections to the dispersion relations (e.g., imaginary parts due the damping effects) and/or the effects of scattering, due to the interactions with the excitations of the system. The results can be useful in various physical contexts that have been considered in the literature involving the electrodynamics of a charged scalar BE condensate.


title: Computationally-Efficient Linear Periodically Time-Variant Digital PLL Modeling Using Conversion Matrices and Uncorrelated Upsampling

abstract: This paper introduces a conversion matrix method for linear periodically time-variant (LPTV) digital phase-locked loop (DPLL) phase noise modeling that offers precise and computationally efficient results to enable rapid design iteration and optimization. Unlike many previous studies, which either assume linear time-invariance (LTI) and therefore overlook phase noise aliasing effects, or solve LPTV systems with noise folding and multiple sampling rate conversions that heightens modeling and computational complexity, the proposed conversion matrix method allows the designer to represent the LPTV systems using intuitive LTI-like transfer functions with excellent accuracy. Additionally, computational efficiency is improved through the uncorrelated upsampling method, which eliminates the need to consider beat frequency of noise sources with different sampling rates. The proposed algorithm is applied to modeling a DPLL with time-varying proportional loop gain, and the modeling accuracy is validated with Simulink transient simulations.


title: Cross-Modal Prototype based Multimodal Federated Learning under Severely Missing Modality

abstract: Multimodal federated learning (MFL) has emerged as a decentralized machine learning paradigm, allowing multiple clients with different modalities to collaborate on training a machine learning model across diverse data sources without sharing their private data. However, challenges, such as data heterogeneity and severely missing modalities, pose crucial hindrances to the robustness of MFL, significantly impacting the performance of global model. The absence of a modality introduces misalignment during the local training phase, stemming from zero-filling in the case of clients with missing modalities. Consequently, achieving robust generalization in global model becomes imperative, especially when dealing with clients that have incomplete data. In this paper, we propose Multimodal Federated Cross Prototype Learning (MFCPL), a novel approach for MFL under severely missing modalities by conducting the complete prototypes to provide diverse modality knowledge in modality-shared level with the cross-modal regularization and modality-specific level with cross-modal contrastive mechanism. Additionally, our approach introduces the cross-modal alignment to provide regularization for modality-specific features, thereby enhancing overall performance, particularly in scenarios involving severely missing modalities. Through extensive experiments on three multimodal datasets, we demonstrate the effectiveness of MFCPL in mitigating these challenges and improving the overall performance.


title: Differential Energy Equalities for Weak Solutions to the Navier-Stokes Equation

abstract: We prove new results for general weak solutions of the incompressible Navier-Stokes equations on the three-dimensional torus, without using the strong energy inequality or other regularity assumptions. Specifically, we prove two types of differential energy equalities, in which $(d/dt)\lVert u\rVert^2$ is replaced by $2\langle \partial_t u,u\rangle$ and $\lim_{N\rightarrow\infty}(d/dt)\lVert u_N\rVert^2$, where the $u_N$ are projections of the original weak solution $u$. We also provide a new characterization of Leray-Hopf solutions, as weak solutions having a version for which the energy is monotonically decreasing. In order to prove these results, we first prove that both $\partial_t u$ and $\Delta u$ are in $L^{4/3}(\epsilon, T; L^{6/5})$, results that were previously known only for Leray-Hopf weak solutions.


title: 3d gravity from Virasoro TQFT: Holography, wormholes and knots

abstract: We further develop the description of three-dimensional quantum gravity with negative cosmological constant in terms of Virasoro TQFT formulated in our previous paper arXiv:2304.13650. We compare the partition functions computed in the Virasoro TQFT formalism to the semiclassical evaluation of Euclidean gravity partition functions. This matching is highly non-trivial, but can be checked directly in some examples. We then showcase the formalism in action, by computing the gravity partition functions of many relevant topologies. For holographic applications, we focus on the partition functions of Euclidean multi-boundary wormholes with three-punctured spheres as boundaries. This precisely quantifies the higher moments of the structure constants in the proposed ensemble boundary dual and subjects the proposal to thorough checks. Finally, we investigate in detail the example of the figure eight knot complement as a hyperbolic 3-manifold. We show that the Virasoro TQFT partition function is identical to the partition function computed in Teichm\"uller theory, thus giving strong evidence for the equivalence of these TQFTs. We also show how to produce a large class of manifolds via Dehn surgery on the figure eight knot.


title: Extending the Synchronous Fellow Traveler Property

abstract: We introduce an extension of the fellow traveler property which allows fellow travelers to be at distance bounded from above by a function $f(n)$ growing slower than any linear function. We study normal forms satisfying this extended fellow traveler property and certain geometric constraints that naturally generalize two fundamental properties of an automatic normal form - the regularity of its language and the bounded length difference property. We show examples of such normal forms and prove some non-existence theorems.


title: Reduction of Plane Quartics and Dixmier-Ohno invariants

abstract: We characterise, in terms of Dixmier-Ohno invariants, the types of singularities that a plane quartic curve can have. We then use these results to obtain new criteria for determining the stable reduction types of non-hyperelliptic curves of genus 3.


title: Alternative Interfaces for Human-initiated Natural Language Communication and Robot-initiated Haptic Feedback: Towards Better Situational Awareness in Human-Robot Collaboration

abstract: This article presents an implementation of a natural-language speech interface and a haptic feedback interface that enables a human supervisor to provide guidance to, request information, and receive status updates from a Spot robot. We provide insights gained during preliminary user testing of the interface in a realistic robot exploration scenario.


title: Empowering Machines to Think Like Chemists: Unveiling Molecular Structure-Polarity Relationships with Hierarchical Symbolic Regression

abstract: Thin-layer chromatography (TLC) is a crucial technique in molecular polarity analysis. Despite its importance, the interpretability of predictive models for TLC, especially those driven by artificial intelligence, remains a challenge. Current approaches, utilizing either high-dimensional molecular fingerprints or domain-knowledge-driven feature engineering, often face a dilemma between expressiveness and interpretability. To bridge this gap, we introduce Unsupervised Hierarchical Symbolic Regression (UHiSR), combining hierarchical neural networks and symbolic regression. UHiSR automatically distills chemical-intuitive polarity indices, and discovers interpretable equations that link molecular structure to chromatographic behavior.


title: Dynamic embedded topic models and change-point detection for exploring literary-historical hypotheses

abstract: We present a novel combination of dynamic embedded topic models and change-point detection to explore diachronic change of lexical semantic modality in classical and early Christian Latin. We demonstrate several methods for finding and characterizing patterns in the output, and relating them to traditional scholarship in Comparative Literature and Classics. This simple approach to unsupervised models of semantic change can be applied to any suitable corpus, and we conclude with future directions and refinements aiming to allow noisier, less-curated materials to meet that threshold.


title: Big monodromy for higher Prym representations

abstract: Let $\Sigma_{g'}\to \Sigma_g$ be a cover of an orientable surface of genus g by an orientable surface of genus g', branched at n points, with Galois group H. Such a cover induces a virtual action of the mapping class group $\text{Mod}_{g,n+1}$ of a genus g surface with n+1 marked points on $H^1(\Sigma_{g'}, \mathbb{C})$. When g is large in terms of the group H, we calculate precisely the connected monodromy group of this action. The methods are Hodge-theoretic and rely on a "generic Torelli theorem with coefficients."


title: No More Distractions: an Adaptive Up-Sampling Algorithm to Reduce Data Artifacts

abstract: Researchers recently found out that sometimes language models achieve high accuracy on benchmark data set, but they can not generalize very well with even little changes to the original data set. This is sometimes due to data artifacts, model is learning the spurious correlation between tokens and labels, instead of the semantics and logic. In this work, we analyzed SNLI data and visualized such spurious correlations. We proposed an adaptive up-sampling algorithm to correct the data artifacts, which is simple and effective, and does not need human edits or annotation. We did an experiment applying the algorithm to fix the data artifacts in SNLI data and the model trained with corrected data performed significantly better than the model trained with raw SNLI data, overall, as well as on the subset we corrected.


title: Constraining the spin-gravity coupling effects with dual-species atom interferometers

abstract: Spin is one fundamental property of microscopic particles. A lot of theoretical work postulated the possible coupling between spin and gravitation, which could result in the violation of equivalence principle. In a recent joint mass-and-energy test of weak equivalence principle (WEP) with a 10-meter $^{85}$Rb-$^{87}$Rb dual-species atom interferometer, the E${\rm \ddot{o}}$tv${\rm \ddot{o}}$s parameters of four $^{85}$Rb-$^{87}$Rb combinations with specific atomic spin states were measured to the $10^{-10}$-level. These experimental results are used to constrain the postulated spin-gravity coupling effects in a robust way. The bounds on the spin-independent and spin-dependent anomalous passive gravitational mass tensors are consistently set to the $10^{-10}$-level, which improve existing bounds by three orders of magnitude.


title: A Spinorial proof of the positivity of Quasi-Local mass

abstract: We provide spinor-based proof of the positivity of the Wang-Yau \cite{yau} quasi-local mass. More precisely we prove under an appropriate spin assumption that the gravitational mass bounded by a spacelike topological $2-$sphere is non-negative in a generic spacetime verifying dominant energy condition and vanishes only if the surface is embedded in the Minkowski space. This proof is purely quasi-local in nature and in particular does not rely on Bartanik's gluing and asymptotic extension construction \cite{bartnik1993quasi} and subsequent application of the Schoen-Yau \cite{schoen1979proof,schoen1981proof} positive mass theorem.


title: Spatiotemporal optical vortices with controllable radial and azimuthal quantum numbers

abstract: Optical spatiotemporal vortices with transverse photon orbital angular momentum (OAM) have recently become a focal point of research. In this work we theoretically and experimentally investigate optical spatiotemporal vortices with radial and azimuthal quantum numbers, known as spatiotemporal Laguerre-Gaussian (STLG) wavepackets. These 3D wavepackets exhibit phase singularities and cylinder-shaped edge dislocations, resulting in a multi-ring topology in its spatiotemporal profile. Unlike conventional ST optical vortices, STLG wavepackets with non-zero p and l values carry a composite transverse OAM consisting of two directionally opposite components. We further demonstrate mode conversion between an STLG wavepacket and an ST Hermite-Gaussian wavepacket through the application of strong spatiotemporal astigmatism. The converted STHG wavepacket is de-coupled in intensity in space-time domain that can be utilized to implement the efficient and accurate recognition of ultrafast STLG wavepackets carried various p and l. This study may offer new insights into high-dimensional quantum information, photonic topology, and nonlinear optics, while promising potential applications in other wave phenomena such as acoustics and electron waves.


title: Explicit evaluation of the Stokes matrices for certain quantum confluent hypergeometric equations

abstract: In this paper, we compute the Stokes matrices of a special quantum confluent hypergeometric system with Poincar\'e rank one. The sources of the interests in the Stokes phenomenon of such system are from representation theory and the theory of isomonodromy deformation.


title: A Survey of Deep Learning and Foundation Models for Time Series Forecasting

abstract: Deep Learning has been successfully applied to many application domains, yet its advantages have been slow to emerge for time series forecasting. For example, in the well-known Makridakis (M) Competitions, hybrids of traditional statistical or machine learning techniques have only recently become the top performers. With the recent architectural advances in deep learning being applied to time series forecasting (e.g., encoder-decoders with attention, transformers, and graph neural networks), deep learning has begun to show significant advantages. Still, in the area of pandemic prediction, there remain challenges for deep learning models: the time series is not long enough for effective training, unawareness of accumulated scientific knowledge, and interpretability of the model. To this end, the development of foundation models (large deep learning models with extensive pre-training) allows models to understand patterns and acquire knowledge that can be applied to new related problems before extensive training data becomes available. Furthermore, there is a vast amount of knowledge available that deep learning models can tap into, including Knowledge Graphs and Large Language Models fine-tuned with scientific domain knowledge. There is ongoing research examining how to utilize or inject such knowledge into deep learning models. In this survey, several state-of-the-art modeling techniques are reviewed, and suggestions for further work are provided.


title: Spectral Clustering for Discrete Distributions

abstract: Discrete distribution clustering (D2C) was often solved by Wasserstein barycenter methods. These methods are under a common assumption that clusters can be well represented by barycenters, which may not hold in many real applications. In this work, we propose a simple yet effective framework based on spectral clustering and distribution affinity measures (e.g., maximum mean discrepancy and Wasserstein distance) for D2C. To improve the scalability, we propose to use linear optimal transport to construct affinity matrices efficiently on large datasets. We provide theoretical guarantees for the success of the proposed methods in clustering distributions. Experiments on synthetic and real data show that our methods outperform the baselines largely in terms of both clustering accuracy and computational efficiency.


title: Analog Beamforming for In-Band Full-Duplex Phased Arrays with Quantized Phase Shifters under a Per-Antenna Received Power Constraint

abstract: This letter develops a novel transmit beamforming (BF) design for canceling self-interference (SI) in analog in-band full-duplex phased arrays. Our design maximizes transmit BF gain in a desired direction while simultaneously reducing SI power to below a specified threshold on per-antenna basis to avoid saturating receive-chain components, such as LNAs. Core to our approach is that it accounts for real-world phase shifters used in analog phased array systems, whose limited resolution imposes non-convex constraints on BF design. We overcome this by transforming these non-convex constraints into convex polygon constraints, which we then solve through semidefinite relaxation and a rank refinement procedure. Numerical results show that our proposed BF scheme reliably cancels SI to the target power threshold at each receive antenna while sacrificing little in transmit BF gain, even with modest phase shifter resolution.


title: Pedal and contrapedal curves of mixed-type Minkowski plane curves

abstract: Pedal and contrapedal curves are important study objects of plane curves. As for a mixed-type Minkowski plane curve, since the definitions of the pedal and contrapedal curves at lightlike points can not always be given, the investigation of them is difficult. We have done some research on the pedal curves of a mixed-type curve. In this paper, we discuss when the contrapedal curves of a mixed-type curve exist and give the definition of them when they exist. Then, we study when the contrapedal curves of the mixed-type curve have singular points. Meanwhile, we consider the types of the points on the contrapedal curves. Moreover, we investigate the relationship between the pedal and contrapedal curves of a mixed-type curve, as well as the relationship among them and the evolute of the base curve.


title: A Comparative Analysis of Scale-invariant Phenomena in Repeating Fast Radio Bursts and Glitching Pulsars

abstract: The recent discoveries of a remarkable glitch/antiglitch accompanied by fast radio burst (FRB)-like bursts from the Galactic magnetar SGR J1935+2154 have revealed the physical connection between the two. In this work, we study the statistical properties of radio bursts from the hyperactive repeating source FRB 20201124A and of glitches from the pulsar PSR B1737--30. For FRB 20201124A, we confirm that the probability density functions of fluctuations of energy, peak flux, duration, and waiting time well follow the Tsallis q-Gaussian distribution. The derived q values from q-Gaussian distribution keep approximately steady for different temporal interval scales, which indicate that there is a common scale-invariant structure in repeating FRBs. Similar scale-invariant property can be found in PSR B1737--30's glitches, implying an underlying association between the origins of repeating FRBs and pulsar glitches. These statistical features can be well understood within the same physical framework of self-organized criticality systems.


title: Doubly charmed tetraquark $T_{cc}^+$ in (2+1)-flavor QCD near physical point

abstract: We study the doubly charmed tetraquark state $T_{cc}^+$ by the HAL QCD method applied to the $D^*D$ system in $(2+1)$ flavor lattice QCD at nearly physical pion mass, $m_\pi= 146$ MeV. We obtain the attractive potential at all distances in the $S$-wave of the isoscalar $D^* D$ system, whose long distance behavior is well described by the two-pion exchange (TPE), and it generates a virtual pole near $D^* D$ threshold with a pole position $E_{\rm pole} = -59 (^{+53}_{-99}) (^{+2}_{-67})$ keV and an inverse scattering length $1/a_0=0.05(5)(^{+2}_{-2})$ fm$^{-1}$. The virtual pole turns into a loosely bound state pole if the pion mass in the TPE potential is extrapolated to the physical value, $m_\pi =135$ MeV. The potential at the physical pion mass is shown to give a semi-quantitative description of the $D^0 D^0\pi^+$ mass spectrum at the LHCb.


title: Measuring M31 globular cluster ages and metallicities using both photometry and spectroscopy

abstract: The ages and metallicities of globular clusters play an important role not just in testing models for their formation and evolution but in understanding the assembly history for their host galaxies. Here we use a combination of imaging and spectroscopy to measure the ages and metallicities of globular clusters in M31, the closest massive galaxy to our own. We use the strength of the near-infrared calcium triplet spectral feature to provide a relatively age insensitive prior on the metallicity when fitting stellar population models to the observed photometry. While the age-extinction degeneracy is an issue for globular clusters projected onto the disc of M31, we find generally old ages for globular clusters in the halo of M31 and in its satellite galaxy NGC 205 in line with previous studies. We measure ages for a number of outer halo globular clusters for the first time, finding that globular clusters associated with halo substructure extend to younger ages and higher metallicities than those associated with the smooth halo. This is in line with the expectation that the smooth halo was accreted earlier than the substructured halo.


title: WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models

abstract: The rapid advancement of large language models (LLMs) has led to a new era marked by the development of autonomous applications in real-world scenarios, which drives innovation in creating advanced web agents. Existing web agents typically only handle one input modality and are evaluated only in simplified web simulators or static web snapshots, greatly limiting their applicability in real-world scenarios. To bridge this gap, we introduce WebVoyager, an innovative Large Multimodal Model (LMM) powered web agent that can complete user instructions end-to-end by interacting with real-world websites. Moreover, we establish a new benchmark by compiling real-world tasks from 15 popular websites and introduce an automatic evaluation protocol leveraging multimodal understanding abilities of GPT-4V to evaluate open-ended web agents. We show that WebVoyager achieves a 59.1% task success rate on our benchmark, significantly surpassing the performance of both GPT-4 (All Tools) and the WebVoyager (text-only) setups, underscoring the exceptional capability of WebVoyager. The proposed automatic evaluation metric achieves 85.3% agreement with human judgment, indicating its effectiveness in providing reliable and accurate assessments of web agents.


title: LocMoE: A Low-Overhead MoE for Large Language Model Training

abstract: The Mixtures-of-Experts (MoE) model is a widespread distributed and integrated learning method for large language models (LLM), which is favored due to its ability to sparsify and expand models efficiently. However, the performance of MoE is limited by load imbalance and high latency of All-to-All communication, along with relatively redundant computation owing to large expert capacity. Load imbalance may result from existing routing policies that consistently tend to select certain experts. The frequent inter-node communication in the All-to-All procedure also significantly prolongs the training time. To alleviate the above performance problems, we propose a novel routing strategy that combines load balance and locality by converting partial inter-node communication to that of intra-node. Notably, we elucidate that there is a minimum threshold for expert capacity, calculated through the maximal angular deviation between the gating weights of the experts and the assigned tokens. We port these modifications on the PanGu-Sigma model based on the MindSpore framework with multi-level routing and conduct experiments on Ascend clusters. The experiment results demonstrate that the proposed LocMoE reduces training time per epoch by 12.68% to 22.24% compared to classical routers, such as hash router and switch router, without impacting the model accuracy.


title: Intelli-Z: Toward Intelligible Zero-Shot TTS

abstract: Although numerous recent studies have suggested new frameworks for zero-shot TTS using large-scale, real-world data, studies that focus on the intelligibility of zero-shot TTS are relatively scarce. Zero-shot TTS demands additional efforts to ensure clear pronunciation and speech quality due to its inherent requirement of replacing a core parameter (speaker embedding or acoustic prompt) with a new one at the inference stage. In this study, we propose a zero-shot TTS model focused on intelligibility, which we refer to as Intelli-Z. Intelli-Z learns speaker embeddings by using multi-speaker TTS as its teacher and is trained with a cycle-consistency loss to include mismatched text-speech pairs for training. Additionally, it selectively aggregates speaker embeddings along the temporal dimension to minimize the interference of the text content of reference speech at the inference stage. We substantiate the effectiveness of the proposed methods with an ablation study. The Mean Opinion Score (MOS) increases by 9% for unseen speakers when the first two methods are applied, and it further improves by 16% when selective temporal aggregation is applied.


title: Simplified Successive Cancellation List Decoding of PAC Codes

abstract: Polar codes are the first class of structured channel codes that achieve the symmetric capacity of binary channels with efficient encoding and decoding. In 2019, Arikan proposed a new polar coding scheme referred to as polarization-adjusted convolutional (PAC)} codes. In contrast to polar codes, PAC codes precode the information word using a convolutional code prior to polar encoding. This results in material coding gain over polar code under Fano sequential decoding as well as successive cancellation list (SCL) decoding. Given the advantages of SCL decoding over Fano decoding in certain scenarios such as low-SNR regime or where a constraint on the worst case decoding latency exists, in this paper, we focus on SCL decoding and present a simplified SCL (SSCL) decoding algorithm for PAC codes. SSCL decoding of PAC codes reduces the decoding latency by identifying special nodes in the decoding tree and processing them at the intermediate stages of the graph. Our simulation results show that the performance of PAC codes under SSCL decoding is almost similar to the SCL decoding while having lower decoding latency.


title: Towards 3D Molecule-Text Interpretation in Language Models

abstract: Language Models (LMs) have greatly influenced diverse domains. However, their inherent limitation in comprehending 3D molecular structures has considerably constrained their potential in the biomolecular domain. To bridge this gap, we focus on 3D molecule-text interpretation, and propose 3D-MoLM: 3D-Molecular Language Modeling. Specifically, 3D-MoLM enables an LM to interpret and analyze 3D molecules by equipping the LM with a 3D molecular encoder. This integration is achieved by a 3D molecule-text projector, bridging the 3D molecular encoder's representation space and the LM's input space. Moreover, to enhance 3D-MoLM's ability of cross-modal molecular understanding and instruction following, we meticulously curated a 3D molecule-centric instruction tuning dataset -- 3D-MoIT. Through 3D molecule-text alignment and 3D molecule-centric instruction tuning, 3D-MoLM establishes an integration of 3D molecular encoder and LM. It significantly surpasses existing baselines on downstream tasks, including molecule-text retrieval, molecule captioning, and more challenging open-text molecular QA tasks, especially focusing on 3D-dependent properties. We release our codes and datasets at https://github.com/lsh0520/3D-MoLM.


title: ChatGPT and Human Synergy in Black-Box Testing: A Comparative Analysis

abstract: In recent years, large language models (LLMs), such as ChatGPT, have been pivotal in advancing various artificial intelligence applications, including natural language processing and software engineering. A promising yet underexplored area is utilizing LLMs in software testing, particularly in black-box testing. This paper explores the test cases devised by ChatGPT in comparison to those created by human participants. In this study, ChatGPT (GPT-4) and four participants each created black-box test cases for three applications based on specifications written by the authors. The goal was to evaluate the real-world applicability of the proposed test cases, identify potential shortcomings, and comprehend how ChatGPT could enhance human testing strategies. ChatGPT can generate test cases that generally match or slightly surpass those created by human participants in terms of test viewpoint coverage. Additionally, our experiments demonstrated that when ChatGPT cooperates with humans, it can cover considerably more test viewpoints than each can achieve alone, suggesting that collaboration between humans and ChatGPT may be more effective than human pairs working together. Nevertheless, we noticed that the test cases generated by ChatGPT have certain issues that require addressing before use.


title: The Galois Group of $x^{2p}+bx^p+c^p$ over $\mathbb{Q}$

abstract: We prove an irreducibility criterion for polynomials of the form $h(x)=x^{2m} + bx^m + c_1 \in F[x]$ relating to the Dickson polynomials of the first kind $D_p$. In the case when $F = \mathbb{Q}$, $m$ is a prime $p>3$, and $c_1=c^p$, for $c\in\mathbb{Q}$, we explicitly determine the Galois group of $d_h= D_p(x, c) + b$, which is $\mathrm{Aff}(\mathbb{F}_p)$ or $C_p \rtimes C_{(p - 1)/2} \vartriangleleft \mathrm{Aff}(\mathbb{F}_p)$, and the Galois group of $h$, which is $C_2 \times \mathrm{Aff}(\mathbb{F}_p), \mathrm{Aff}(\mathbb{F}_p)$, or $C_2 \times (C_p \rtimes C_{(p - 1)/2}) \vartriangleleft C_2 \times \mathrm{Aff}(\mathbb{F}_p)$.


title: Iterative Methods in GPU-Resident Linear Solvers for Nonlinear Constrained Optimization

abstract: Linear solvers are major computational bottlenecks in a wide range of decision support and optimization computations. The challenges become even more pronounced on heterogeneous hardware, where traditional sparse numerical linear algebra methods are often inefficient. For example, methods for solving ill-conditioned linear systems have relied on conditional branching, which degrades performance on hardware accelerators such as graphical processing units (GPUs). To improve the efficiency of solving ill-conditioned systems, our computational strategy separates computations that are efficient on GPUs from those that need to run on traditional central processing units (CPUs). Our strategy maximizes the reuse of expensive CPU computations. Iterative methods, which thus far have not been broadly used for ill-conditioned linear systems, play an important role in our approach. In particular, we extend ideas from [1] to implement iterative refinement using inexact LU factors and flexible generalized minimal residual (FGMRES), with the aim of efficient performance on GPUs. We focus on solutions that are effective within broader application contexts, and discuss how early performance tests could be improved to be more predictive of the performance in a realistic environment


title: Adaptive Text Watermark for Large Language Models

abstract: The advancement of Large Language Models (LLMs) has led to increasing concerns about the misuse of AI-generated text, and watermarking for LLM-generated text has emerged as a potential solution. However, it is challenging to generate high-quality watermarked text while maintaining strong security, robustness, and the ability to detect watermarks without prior knowledge of the prompt or model. This paper proposes an adaptive watermarking strategy to address this problem. To improve the text quality and maintain robustness, we adaptively add watermarking to token distributions with high entropy measured using an auxiliary model and keep the low entropy token distributions untouched. For the sake of security and to further minimize the watermark's impact on text quality, instead of using a fixed green/red list generated from a random secret key, which can be vulnerable to decryption and forgery, we adaptively scale up the output logits in proportion based on the semantic embedding of previously generated text using a well designed semantic mapping model. Our experiments involving various LLMs demonstrate that our approach achieves comparable robustness performance to existing watermark methods. Additionally, the text generated by our method has perplexity comparable to that of \emph{un-watermarked} LLMs while maintaining security even under various attacks.


title: Image based Crop Monitoring Technologies in Protected Horticulture: A Review

abstract: Future food security is a major concern of the 21st century with the growing global population and climate changes. In addressing these challenges, protected cropping ensures food production year-round and increases crop production per land area by controlling environment conditions. Maintaining the growth and health of crops in these facilities is essential to ensure optimum food production. However, this is a laborious work and is currently done manually. Image-based non-destructive plant phenotyping is an emerging research area that reduces the skilled labour cost while enhancing the monitoring of crop growth, health, and identifying phenotype-genotype relations for plant breeding. With the proliferations of protected infrastructures and targeted plants, different technologies and sensor setups are needed for image-based crop monitoring. Conveyor-type plant-to-sensor systems, bench-top or gantry-based systems are commonly found in research facilities focussing on phenotyping of small, relatively short, or movable model plants. This review examines the literature on crop monitoring and phenotyping platforms in both field and protected facilities and explains different camera technologies and their ability to extract different plant traits. The review highlights the future research directions of image-based monitoring of commercial scale protected crops where crops can be relatively tall or vertically supported under semi controlled environments, which presents new challenges and is rarely covered in the literature.


title: Reinforcement Learning with Hidden Markov Models for Discovering Decision-Making Dynamics

abstract: Major depressive disorder (MDD) presents challenges in diagnosis and treatment due to its complex and heterogeneous nature. Emerging evidence indicates that reward processing abnormalities may serve as a behavioral marker for MDD. To measure reward processing, patients perform computer-based behavioral tasks that involve making choices or responding to stimulants that are associated with different outcomes. Reinforcement learning (RL) models are fitted to extract parameters that measure various aspects of reward processing to characterize how patients make decisions in behavioral tasks. Recent findings suggest the inadequacy of characterizing reward learning solely based on a single RL model; instead, there may be a switching of decision-making processes between multiple strategies. An important scientific question is how the dynamics of learning strategies in decision-making affect the reward learning ability of individuals with MDD. Motivated by the probabilistic reward task (PRT) within the EMBARC study, we propose a novel RL-HMM framework for analyzing reward-based decision-making. Our model accommodates learning strategy switching between two distinct approaches under a hidden Markov model (HMM): subjects making decisions based on the RL model or opting for random choices. We account for continuous RL state space and allow time-varying transition probabilities in the HMM. We introduce a computationally efficient EM algorithm for parameter estimation and employ a nonparametric bootstrap for inference. We apply our approach to the EMBARC study to show that MDD patients are less engaged in RL compared to the healthy controls, and engagement is associated with brain activities in the negative affect circuitry during an emotional conflict task.


title: Ideal Spin-Orbit-Free Dirac Semimetal and Diverse Topological Transitions in Pr$_8$CoGa$_3$ Family

abstract: We propose from first-principles calculations that spin-orbit-free materials in the $RE_8\mathrm{Co}X_3$ group ($RE$ = rare earth elements, $X$ = Al, Ga, or In) are ideal spinless Dirac semimetals whose Fermi surfaces are fourfold degenerate band-crossing points (without including spin degeneracy). Despite the lack of space inversion symmetry in these materials, Dirac points are formed on the rotation-symmetry axis due to accidental degeneracies of two bands corresponding to different 2-dimensional irreducible representations of $C_{6v}$ group. The surface states have two midgap bands emanating from the projection in the surface Brillouin zone of the bulk Dirac points, in accordance with nontrivial Zak phases for each glide sector. We also investigate, through first-principles calculations and effective model analysis, various phase transitions caused by lattice distortion or elemental substitutions from the Dirac semimetal phase to distinct topological semimetallic phases such as nonmagnetic linked-nodal-line and Weyl semimetals (characterized by the second Stiefel-Whitney class) and ferromagnetic Weyl semimetals.


title: Precise Robotic Weed Spot-Spraying for Reduced Herbicide Usage and Improved Environmental Outcomes -- A Real-World Case Study

abstract: Precise robotic weed control plays an essential role in precision agriculture. It can help significantly reduce the environmental impact of herbicides while reducing weed management costs for farmers. In this paper, we demonstrate that a custom-designed robotic spot spraying tool based on computer vision and deep learning can significantly reduce herbicide usage on sugarcane farms. We present results from field trials that compare robotic spot spraying against industry-standard broadcast spraying, by measuring the weed control efficacy, the reduction in herbicide usage, and the water quality improvements in irrigation runoff. The average results across 25 hectares of field trials show that spot spraying on sugarcane farms is 97% as effective as broadcast spraying and reduces herbicide usage by 35%, proportionally to the weed density. For specific trial strips with lower weed pressure, spot spraying reduced herbicide usage by up to 65%. Water quality measurements of irrigation-induced runoff, three to six days after spraying, showed reductions in the mean concentration and mean load of herbicides of 39% and 54%, respectively, compared to broadcast spraying. These promising results reveal the capability of spot spraying technology to reduce herbicide usage on sugarcane farms without impacting weed control and potentially providing sustained water quality benefits.


title: Best constants in the vector-valued Littlewood-Paley-Stein theory

abstract: Let $L$ be a sectorial operator of type $\alpha$ ($0 \leq \alpha < \pi/2$) on $L^2(\mathbb{R}^d)$ with the kernels of $\{e^{-tL}\}_{t>0}$ satisfying certain size and regularity conditions. Define $$ S_{q,L}(f)(x) = \left(\int_0^{\infty}\int_{|y-x| < t} \|tL{e^{-tL}} (f)(y) \|_X^q \,\frac{{\rm d} y{\rm d} t}{t^{d+1}} \right)^{\frac{1}{q}},$$ $$G_{q,{L}}(f)=\left( \int_0^{\infty} \left\|t{L}{e^{-t{L}}} (f)(y) \right\|_X^q \,\frac{{\rm d} t}{t}\right)^{\frac{1}{q}}.$$ We show that for $\underline{\mathrm{any}}$ Banach space $X$, $1 \leq p < \infty$ and $1 < q < \infty$ and $f\in C_c(\mathbb R^d)\otimes X$, there hold \begin{align*} p^{-\frac{1}{q}}\| S_{q,{\sqrt{\Delta}}}(f) \|_p \lesssim_{d, \gamma, \beta} \| S_{q,L}(f) \|_p \lesssim_{d, \gamma, \beta} p^{\frac{1}{q}}\| S_{q,{\sqrt{\Delta}}}(f) \|_p, \end{align*} \begin{align*} p^{-\frac{1}{q}}\| S_{q,L}(f) \|_p \lesssim_{d, \gamma, \beta} \| G_{q,L}(f) \|_p \lesssim_{d, \gamma, \beta} p^{\frac{1}{q}}\| S_{q,L}(f) \|_p, \end{align*} where $\Delta$ is the standard Laplacian; moreover all the orders appeared above are {\it optimal} as $p\rightarrow1$. This, combined with the existing results in [29, 33], allows us to resolve partially Problem 1.8, Problem A.1 and Conjecture A.4 regarding the optimal Lusin type constant and the characterization of martingale type in a recent remarkable work due to Xu [48]. Several difficulties originate from the arbitrariness of $X$, which excludes the use of vector-valued Calder\'on-Zygmund theory. To surmount the obstacles, we introduce the novel vector-valued Hardy and BMO spaces associated with sectorial operators; in addition to Mei's duality techniques and Wilson's intrinsic square functions developed in this setting, the key new input is the vector-valued tent space theory and its unexpected amalgamation with these `old' techniques.


title: Solutions to the First Order Difference Equations in the Multivariate Difference Field

abstract: The bivariate difference field provides an algebraic framework for a sequence satisfying a recurrence of order two. Based on this, we focus on sequences satisfying a recurrence of higher order, and consider the multivariate difference field, in which the summation problem could be transformed into solving the first order difference equations. We then show a criterion for deciding whether the difference equation has a rational solution and present an algorithm for computing one rational solution of such a difference equation, if it exists. Moreover we get the rational solution set of such an equation.


title: MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration

abstract: Capturing voxel-wise spatial correspondence across distinct modalities is crucial for medical image analysis. However, current registration approaches are not practical enough in terms of registration accuracy and clinical applicability. In this paper, we introduce MambaMorph, a novel multi-modality deformable registration framework. Specifically, MambaMorph utilizes a Mamba-based registration module and a fine-grained, yet simple, feature extractor for efficient long-range correspondence modeling and high-dimensional feature learning, respectively. Additionally, we develop a well-annotated brain MR-CT registration dataset, SR-Reg, to address the scarcity of data in multi-modality registration. To validate MambaMorph's multi-modality registration capabilities, we conduct quantitative experiments on both our SR-Reg dataset and a public T1-T2 dataset. The experimental results on both datasets demonstrate that MambaMorph significantly outperforms the current state-of-the-art learning-based registration methods in terms of registration accuracy. Further study underscores the efficiency of the Mamba-based registration module and the lightweight feature extractor, which achieve notable registration quality while maintaining reasonable computational costs and speeds. We believe that MambaMorph holds significant potential for practical applications in medical image registration. The code for MambaMorph is available at: https://github.com/Guo-Stone/MambaMorph.


title: A New Paradigm for Counterfactual Reasoning in Fairness and Recourse

abstract: Counterfactuals and counterfactual reasoning underpin numerous techniques for auditing and understanding artificial intelligence (AI) systems. The traditional paradigm for counterfactual reasoning in this literature is the interventional counterfactual, where hypothetical interventions are imagined and simulated. For this reason, the starting point for causal reasoning about legal protections and demographic data in AI is an imagined intervention on a legally-protected characteristic, such as ethnicity, race, gender, disability, age, etc. We ask, for example, what would have happened had your race been different? An inherent limitation of this paradigm is that some demographic interventions -- like interventions on race -- may not translate into the formalisms of interventional counterfactuals. In this work, we explore a new paradigm based instead on the backtracking counterfactual, where rather than imagine hypothetical interventions on legally-protected characteristics, we imagine alternate initial conditions while holding these characteristics fixed. We ask instead, what would explain a counterfactual outcome for you as you actually are or could be? This alternate framework allows us to address many of the same social concerns, but to do so while asking fundamentally different questions that do not rely on demographic interventions.


title: Learning-based sensing and computing decision for data freshness in edge computing-enabled networks

abstract: As the demand on artificial intelligence (AI)-based applications increases, the freshness of sensed data becomes crucial in the wireless sensor networks. Since those applications require a large amount of computation for processing the sensed data, it is essential to offload the computation load to the edge computing (EC) server. In this paper, we propose the sensing and computing decision (SCD) algorithms for data freshness in the EC-enabled wireless sensor networks. We define the {\eta}-coverage probability to show the probability of maintaining fresh data for more than {\eta} ratio of the network, where the spatial-temporal correlation of information is considered. We then propose the probability-based SCD for the single pre-charged sensor case with providing the optimal point after deriving the {\eta}-coverage probability. We also propose the reinforcement learning (RL)- based SCD by training the SCD policy of sensors for both the single pre-charged and multiple energy harvesting (EH) sensor cases, to make a real-time decision based on its observation. Our simulation results verify the performance of the proposed algorithms under various environment settings, and show that the RL-based SCD algorithm achieves higher performance compared to baseline algorithms for both the single pre-charged sensor and multiple EH sensor cases.


title: Self-supervised Video Object Segmentation with Distillation Learning of Deformable Attention

abstract: Video object segmentation is a fundamental research problem in computer vision. Recent techniques have often applied attention mechanism to object representation learning from video sequences. However, due to temporal changes in the video data, attention maps may not well align with the objects of interest across video frames, causing accumulated errors in long-term video processing. In addition, existing techniques have utilised complex architectures, requiring highly computational complexity and hence limiting the ability to integrate video object segmentation into low-powered devices. To address these issues, we propose a new method for self-supervised video object segmentation based on distillation learning of deformable attention. Specifically, we devise a lightweight architecture for video object segmentation that is effectively adapted to temporal changes. This is enabled by deformable attention mechanism, where the keys and values capturing the memory of a video sequence in the attention module have flexible locations updated across frames. The learnt object representations are thus adaptive to both the spatial and temporal dimensions. We train the proposed architecture in a self-supervised fashion through a new knowledge distillation paradigm where deformable attention maps are integrated into the distillation loss. We qualitatively and quantitatively evaluate our method and compare it with existing methods on benchmark datasets including DAVIS 2016/2017 and YouTube-VOS 2018/2019. Experimental results verify the superiority of our method via its achieved state-of-the-art performance and optimal memory usage.


title: A variational formulation of Griffith phase-field fracture with material strength

abstract: In this expository Note, it is shown that the Griffith phase-field theory of fracture accounting for material strength originally introduced by Kumar, Francfort, and Lopez-Pamies (J Mech Phys Solids 112, 523--551, 2018) in the form of PDEs can be recast as a variational theory. In particular, the solution pair $(\textbf{u},v)$ defined by the PDEs for the displacement field $\textbf{u}$ and the phase field $v$ is shown to correspond to the fields that minimize separately two different functionals, much like the solution pair $(\textbf{u},v)$ defined by the original phase-field theory of fracture without material strength implemented in terms of alternating minimization. The merits of formulating a complete theory of fracture nucleation and propagation via such a variational approach -- in terms of the minimization of two different functionals -- are discussed.


title: Estimation of the slope of nuclear symmetry energy via charge radii of mirror nuclei

abstract: Charge radii of mirror nuclei are calculated by implementing pairing effects with the Hartree-Fock Bogoliubov approximation. Correlations between the difference of charge radii ($\Delta R_{ch}$) and slope of nuclear symmetry energy (L) are examined for different mirror nuclei pairs of varying masses using 40 different Skyrme energy density functionals. $\Delta R_{ch}-L $ correlations are found to be robust for the binding constraints imposed on density functionals. We observe that $\Delta R_{ch}$ and $L$ show better correlations in relatively heavier pairs than those obtained in the lighter pairs. Our calculations impose a constraint on the slope of nuclear symmetry energy as -20 MeV $\leq L \leq$ 55 MeV with 68\% confidence band using available measurements on charge radii. This is a moderately soft symmetry energy, in contrast to stiff and soft symmetry energy indicated by PREX-II and CREX measurements of neutron skin thickness in $^{208}Pb$ and $^{48}Ca$, respectively. Our result is also in agreement with celestial constraints obtained from observational data for neutron stars.


title: How Are Paid and Volunteer Open Source Developers Different? A Study of the Rust Project

abstract: It is now commonplace for organizations to pay developers to work on specific open source software (OSS) projects to pursue their business goals. Such paid developers work alongside voluntary contributors, but given the different motivations of these two groups of developers, conflict may arise, which may pose a threat to a project's sustainability. This paper presents an empirical study of paid developers and volunteers in Rust, a popular open source programming language project. Rust is a particularly interesting case given considerable concerns about corporate participation. We compare volunteers and paid developers through contribution characteristics and long-term participation, and solicit volunteers' perceptions on paid developers. We find that core paid developers tend to contribute more frequently; commits contributed by one-time paid developers have bigger sizes; peripheral paid developers implement more features; and being paid plays a positive role in becoming a long-term contributor. We also find that volunteers do have some prejudices against paid developers. This study suggests that the dichotomous view of paid vs. volunteer developers is too simplistic and that further subgroups can be identified. Companies should become more sensitive to how they engage with OSS communities, in certain ways as suggested by this study.


title: AC-Driven Series Elastic Electrohydraulic Actuator for Stable and Smooth Displacement Output

abstract: Soft electrohydraulic actuators known as HASEL actuators have attracted widespread research interest due to their outstanding dynamic performance and high output power. However, the displacement of electrohydraulic actuators usually declines with time under constant DC voltage, which hampers its prospective application. A mathematical model is firstly established to not only explain the decrease in displacement under DC voltage but also predict the relatively stable displacement with oscillation under AC square wave voltage. The mathematical model is validated since the actual displacement confirms the trend observed by our model. To smooth the displacement oscillation introduced by AC voltage, a serial elastic component is incorporated to form a SE-HASEL actuator. A feedback control with a proportion-integration algorithm enables the SE-HASEL actuator to eliminate the obstinate displacement hysteresis. Our results revealed that, through our methodology, the SE-HASEL actuator can give stable and smooth displacement and is capable of absorbing external impact disturbance simultaneously. A rotary joint based on the SE-HASEL actuator is developed to reflect its possibility to generate a common rotary motion for wide robotic applications. More importantly, this paper also proposes a highly accurate needle biopsy robot that can be utilized in MRI-guide surgical procedures. Overall, we have achieved AC-driven series elastic electrohydraulic actuators that can exhibit stable and smooth displacement output.


title: StyleInject: Parameter Efficient Tuning of Text-to-Image Diffusion Models

abstract: The ability to fine-tune generative models for text-to-image generation tasks is crucial, particularly facing the complexity involved in accurately interpreting and visualizing textual inputs. While LoRA is efficient for language model adaptation, it often falls short in text-to-image tasks due to the intricate demands of image generation, such as accommodating a broad spectrum of styles and nuances. To bridge this gap, we introduce StyleInject, a specialized fine-tuning approach tailored for text-to-image models. StyleInject comprises multiple parallel low-rank parameter matrices, maintaining the diversity of visual features. It dynamically adapts to varying styles by adjusting the variance of visual features based on the characteristics of the input signal. This approach significantly minimizes the impact on the original model's text-image alignment capabilities while adeptly adapting to various styles in transfer learning. StyleInject proves particularly effective in learning from and enhancing a range of advanced, community-fine-tuned generative models. Our comprehensive experiments, including both small-sample and large-scale data fine-tuning as well as base model distillation, show that StyleInject surpasses traditional LoRA in both text-image semantic consistency and human preference evaluation, all while ensuring greater parameter efficiency.


title: Is the age pension in Australia sustainable and fair? Evidence from forecasting the old-age dependency ratio using the Hamilton-Perry model

abstract: The age pension aims to assist eligible elderly Australians meet specific age and residency criteria in maintaining basic living standards. In designing efficient pension systems, government policymakers seek to satisfy the expectations of the overall aging population in Australia. However, the population's unique demographic characteristics at the state and territory level are often overlooked due to the lack of available data. We use the Hamilton-Perry model, which requires minimum input, to model and forecast the evolution of age-specific populations at the state level. We also integrate the obtained sub-national demographic information to determine sustainable pension ages up to 2051. We also investigate pension welfare distribution in all states and territories to identify disadvantaged residents under the current pension system. Using the sub-national mortality data for Australia from 1971 to 2021 obtained from AHMD (2023), we implement the Hamilton-Perry model with the help of functional time series forecasting techniques. With forecasts of age-specific population sizes for each state and territory, we compute the old age dependency ratio to determine the nationwide sustainable pension age.


title: Zeroth-order Random Subspace Algorithm for Non-smooth Convex Optimization

abstract: Zeroth-order optimization, which does not use derivative information, is one of the significant research areas in the field of mathematical optimization and machine learning. Although various studies have explored zeroth-order algorithms, one of the theoretical limitations is that oracle complexity depends on the dimension, i.e., on the number of variables, of the optimization problem. In this paper, to reduce the dependency of the dimension in oracle complexity, we propose a zeroth-order random subspace algorithm by combining the famous gradient-free algorithm from Nesterov and Spokoiny (2017) with random projection. We derive the worst-case oracle complexity of our proposed method in non-smooth and convex settings. While we show that our method has a global convergence rate equivalent to standard results for full-dimensional non-smooth convex algorithms, we prove that ours also has a local convergence rate independent of the original dimension under additional assumptions. In addition to the theoretical results, numerical experiments show that when an objective function has a specific structure, the proposed method can become experimentally more efficient due to random projection.


title: General Automatic Solution Generation of Social Problems

abstract: Given the escalating intricacy and multifaceted nature of contemporary social systems, manually generating solutions to address pertinent social issues has become a formidable task. In response to this challenge, the rapid development of artificial intelligence has spurred the exploration of computational methodologies aimed at automatically generating solutions. However, current methods for auto-generation of solutions mainly concentrate on local social regulations that pertain to specific scenarios. Here, we report an automatic social operating system (ASOS) designed for general social solution generation, which is built upon agent-based models, enabling both global and local analyses and regulations of social problems across spatial and temporal dimensions. ASOS adopts a hypergraph with extensible social semantics for a comprehensive and structured representation of social dynamics. It also incorporates a generalized protocol for standardized hypergraph operations and a symbolic hybrid framework that delivers interpretable solutions, yielding a balance between regulatory efficacy and function viability. To demonstrate the effectiveness of ASOS, we apply it to the domain of averting extreme events within international oil futures markets. By generating a new trading role supplemented by new mechanisms, ASOS can adeptly discern precarious market conditions and make front-running interventions for non-profit purposes. This study demonstrates that ASOS provides an efficient and systematic approach for generating solutions for enhancing our society.


title: A polynomial-time quantum algorithm for solving the ground states of a class of classically hard Hamiltonians

abstract: In this work, we present a polynomial-time quantum algorithm for solving the ground states of a class of classically hard Hamiltonians. The mechanism of the exponential speedup that appeared in our algorithm is different from all existing quantum algorithms. The idea is to introduce a mapping $f:\text{ }\rho\rightarrow |\rho\rangle$ to use density matrices to represent pure states. We show that this mapping makes sense by giving an efficient method to obtain the information of $|\rho\rangle$ from measurements on $\rho$. Under this mapping, the Lindblad master equation (LME) becomes a Schr\"odinger equation with non-Hermitian Hamiltonian which contains natural imaginary time evolution. The steady state of the LME, therefore, corresponds to the ground state of $L^\dag L$ with $L$ the Liouvillian operator of the LME. We show the runtime of the LME has the $\mathcal{O}(log(\zeta^{-1}))$ scaling with $\zeta$ the overlap between the initial state and the ground state compared with the $\mathcal{O}(poly(\zeta^{-1}))$ scaling in other algorithms. The Hamiltonians $L^\dag L$ are guaranteed to be difficult for classical computers if we believe the simulation of LME is difficult. Further, for any given local Hamiltonian $H$ with known ground energy $E_0$, we give a polynomial-time classical procedure to judge and solve whether there exists $L$ such that $H-E_0=L^\dag L$. Later, We discuss and analyze several important aspects of the algorithm including the non-linear dynamics that appeared in the algorithm.


title: Networked Multiagent Reinforcement Learning for Peer-to-Peer Energy Trading

abstract: Utilizing distributed renewable and energy storage resources in local distribution networks via peer-to-peer (P2P) energy trading has long been touted as a solution to improve energy systems' resilience and sustainability. Consumers and prosumers (those who have energy generation resources), however, do not have the expertise to engage in repeated P2P trading, and the zero-marginal costs of renewables present challenges in determining fair market prices. To address these issues, we propose multi-agent reinforcement learning (MARL) frameworks to help automate consumers' bidding and management of their solar PV and energy storage resources, under a specific P2P clearing mechanism that utilizes the so-called supply-demand ratio. In addition, we show how the MARL frameworks can integrate physical network constraints to realize voltage control, hence ensuring physical feasibility of the P2P energy trading and paving way for real-world implementations.


title: Z-estimation system: a modular approach to asymptotic analysis

abstract: Asymptotic analysis for related inference problems often involves similar steps and proofs. These intermediate results could be shared across problems if each of them is made self-contained and easily identified. However, asymptotic analysis using Taylor expansions is limited for result borrowing because it is a step-to-step procedural approach. This article introduces EEsy, a modular system for estimating finite and infinitely dimensional parameters in related inference problems. It is based on the infinite-dimensional Z-estimation theorem, Donsker and Glivenko-Cantelli preservation theorems, and weight calibration techniques. This article identifies the systematic nature of these tools and consolidates them into one system containing several modules, which can be built, shared, and extended in a modular manner. This change to the structure of method development allows related methods to be developed in parallel and complex problems to be solved collaboratively, expediting the development of new analytical methods. This article considers four related inference problems -- estimating parameters with random sampling, two-phase sampling, auxiliary information incorporation, and model misspecification. We illustrate this modular approach by systematically developing 9 parameter estimators and 18 variance estimators for the four related inference problems regarding semi-parametric additive hazards models. Simulation studies show the obtained asymptotic results for these 27 estimators are valid. In the end, I describe how this system can simplify the use of empirical process theory, a powerful but challenging tool to be adopted by the broad community of methods developers. I discuss challenges and the extension of this system to other inference problems.


title: Asymptotic decay for the Chern-Simons-Higgs equations

abstract: In this paper, we study the long time asymptotic behaviors for solutions to the Chern-Simons-Higgs equation with a pure power defocusing nonlinearity. We obtain quantitative inverse polynomial time decay for the potential energy for all data with finite conformal energy. Consequently, the solution decays in time in the pointwise sense for all power. We also show that for sufficiently large power the solution decays as quickly as linear waves. Key ingredients for the proof include vector field method, conformal compactification and the geometric bilinear trace theorem for null hypersurface developed by Klainerman-Rodnianski.


title: AM-SORT: Adaptable Motion Predictor with Historical Trajectory Embedding for Multi-Object Tracking

abstract: Many multi-object tracking (MOT) approaches, which employ the Kalman Filter as a motion predictor, assume constant velocity and Gaussian-distributed filtering noises. These assumptions render the Kalman Filter-based trackers effective in linear motion scenarios. However, these linear assumptions serve as a key limitation when estimating future object locations within scenarios involving non-linear motion and occlusions. To address this issue, we propose a motion-based MOT approach with an adaptable motion predictor, called AM-SORT, which adapts to estimate non-linear uncertainties. AM-SORT is a novel extension of the SORT-series trackers that supersedes the Kalman Filter with the transformer architecture as a motion predictor. We introduce a historical trajectory embedding that empowers the transformer to extract spatio-temporal features from a sequence of bounding boxes. AM-SORT achieves competitive performance compared to state-of-the-art trackers on DanceTrack, with 56.3 IDF1 and 55.6 HOTA. We conduct extensive experiments to demonstrate the effectiveness of our method in predicting non-linear movement under occlusions.


title: Atomic multiplet and charge-transfer screening effects in 1$s$ and 2$p$ core-level X-ray photoelectron spectra of early 3$d$ transition-metal oxides

abstract: We present a comparative analysis of 1$s$ and 2$p$ core-level hard X-ray photoelectron spectroscopy (HAXPES) spectra in metallic VO$_2$ and CrO$_2$. Even though the V 1$s$ and 2$p$ spectra in VO$_2$ display similar line shapes except the absence or presence of a spin-orbit coupling splitting, the Cr 1$s$ and 2$p$ spectra exhibit distinct main-line shapes. The experimental HAXPES spectra are analyzed by the Anderson impurity model based on the density functional theory + dynamical mean-field theory and a conventional MO$_6$ cluster model. We elucidate the complex interplay between formation of the intra-atomic multiplet and charge transfer effect on the chemical bonding followed by the 1$s$ and 2$p$ core electron excitations. We demonstrate the advantage of the 1$s$ excitations to the routinely-employed 2$p$ excitations for distinguishing between metal-ligand and metal-metal charge transfer contributions in early 3$d$ transition-metal oxides.


title: Randomized Response with Gradual Release of Privacy Budget

abstract: An algorithm is developed to gradually relax the Differential Privacy (DP) guarantee of a randomized response. The output from each relaxation maintains the same probability distribution as a standard randomized response with the equivalent DP guarantee, ensuring identical utility as the standard approach. The entire relaxation process is proven to have the same DP guarantee as the most recent relaxed guarantee. The DP relaxation algorithm is adaptable to any Local Differential Privacy (LDP) mechanisms relying on randomized response. It has been seamlessly integrated into RAPPOR, an LDP crowdsourcing string-collecting tool, to optimize the utility of estimating the frequency of collected data. Additionally, it facilitates the relaxation of the DP guarantee for mean estimation based on randomized response. Finally, numerical experiments have been conducted to validate the utility and DP guarantee of the algorithm.


title: Accelerating Structural Optimization through Fingerprinting Space Integration on the Potential Energy Surface

abstract: Structural optimization has been a crucial component in computational materials research, and structure predictions have relied heavily on this technique in particular. In this study, we introduce a novel method that enhances the efficiency of local optimization by integrating an extra fingerprint space into the optimization process. Our approach utilizes a mixed energy concept in the hyper potential energy surface (PES), combining real energy and a newly introduced fingerprint energy derived from the symmetry of local atomic environment. This method strategically guides the optimization process toward high-symmetry, low-energy structures by leveraging the intrinsic symmetry of atomic configurations. The effectiveness of our approach was demonstrated through structural optimizations of silicon, silicon carbide, and Lennard-Jones cluster systems. Our results show that the fingerprint space biasing technique significantly enhances the performance and probability of discovering energetically favorable, high-symmetry structures, as compared to conventional optimizations. The proposed method is anticipated to streamline the search for new materials and facilitate the discovery of novel, energetically favorable configurations.


title: Effects of Chemical Short Range Order on Percolation in Binary Alloys

abstract: We develop a percolation model for face centered cubic binary alloys with chemical short-range order (SRO) to account for chemical ordering/clustering that occurs in nominally random solid solutions. We employ a Monte Carlo lattice generation scheme that directly utilizes the first nearest neighbor Warren-Cowley SRO parameter to generate the lattice. We quantify the effects of SRO on the first nearest neighbor 3D site percolation threshold using the large cell Monte Carlo renormalization group method and find that the 3D site percolation threshold is a function of the SRO parameter. We analyze the effects of SRO on the chemical heterogeneity of the percolated structures and find that short-ranged clustering promotes the formation of a dominant spanning cluster. Furthermore, we find that the scaling exponents of percolation are independent of SRO. We also examine the effects of SRO on the 2D-3D percolation crossover and find that the thickness of the thin film for percolation crossover is a function of the SRO parameter. We combine these results to develop a percolation crossover model to understand the electrochemical passivation behavior in binary alloys. The percolation crossover model provides a theoretical framework to understand the critical composition of passivating elements for protective oxide formation. With this model, we show that SRO can be used as a processing parameter to improve corrosion resistance.


title: Existence of solution for two classes of quasilinear systems defined on a non-reflexive Orlicz-Sobolev Spaces

abstract: This paper proves the existence of nontrivial solution for two classes of quasilinear systems of the type \begin{equation*} \left\{\; \begin{aligned} -\Delta_{\Phi_{1}} u&=F_u(x,u,v)+\lambda R_u(x,u,v)\;\text{ in } \Omega& \\ -\Delta_{\Phi_{2}} v&=-F_v(x,u,v)-\lambda R_v(x,u,v)\;\text{ in } \Omega& \\ u=v&=0\;\text{ on } \partial\Omega& \end{aligned} \right. \end{equation*} where $\lambda > 0$ is a parameter, $\Omega$ is a bounded domain in $\mathbb{R}^N$($N \geq 2$) with smooth boundary $\partial \Omega$. The first class we drop the $\Delta_2$-condition of the functions $\tilde{\Phi}_i$($i=1,2$) and assume that $F$ has a double criticality. For this class, we use a linking theorem without the Palais-Smale condition for locally Lipschitz functionals combined with a concentration-compactness lemma for nonreflexive Orlicz-Sobolev space. The second class, we relax the $\Delta_2$-condition of the functions ${\Phi}_i$($i=1,2$). For this class, we consider $F=0$ and $\lambda=1$ and obtain the proof based on a saddle-point theorem of Rabinowitz without the Palais-Smale condition for functionals Frechet differentiable combined with some properties of the weak$^*$ topology.


title: A New Image Quality Database for Multiple Industrial Processes

abstract: Recent years have witnessed a broader range of applications of image processing technologies in multiple industrial processes, such as smoke detection, security monitoring, and workpiece inspection. Different kinds of distortion types and levels must be introduced into an image during the processes of acquisition, compression, transmission, storage, and display, which might heavily degrade the image quality and thus strongly reduce the final display effect and clarity. To verify the reliability of existing image quality assessment methods, we establish a new industrial process image database (IPID), which contains 3000 distorted images generated by applying different levels of distortion types to each of the 50 source images. We conduct the subjective test on the aforementioned 3000 images to collect their subjective quality ratings in a well-suited laboratory environment. Finally, we perform comparison experiments on IPID database to investigate the performance of some objective image quality assessment algorithms. The experimental results show that the state-of-the-art image quality assessment methods have difficulty in predicting the quality of images that contain multiple distortion types.


title: Automatic Tissue Traction with Haptics-Enabled Forceps for Minimally Invasive Surgery

abstract: A common limitation of autonomous tissue manipulation in robotic minimally invasive surgery (MIS) is the absence of force sensing and control at the tool level. Recently, our team has developed haptics-enabled forceps that can simultaneously measure the grasping and pulling forces during tissue manipulation. Based on this design, here we further present a method to automate tissue traction with controlled grasping and pulling forces. Specifically, the grasping stage relies on a controlled grasping force, while the pulling stage is under the guidance of a controlled pulling force. Notably, during the pulling process, the simultaneous control of both grasping and pulling forces is also enabled for more precise tissue traction, achieved through force decoupling. The force controller is built upon a static model of tissue manipulation, considering the interaction between the haptics-enabled forceps and soft tissue. The efficacy of this force control approach is validated through a series of experiments comparing targeted, estimated, and actual reference forces. To verify the feasibility of the proposed method in surgical applications, various tissue resections are conducted on ex vivo tissues employing a dual-arm robotic setup. Finally, we discuss the benefits of multi-force control in tissue traction, evidenced through comparative analyses of various ex vivo tissue resections. The results affirm the feasibility of implementing automatic tissue traction using micro-sized forceps with multi-force control, suggesting its potential to promote autonomous MIS. A video demonstrating the experiments can be found at https://youtu.be/8fe8o8IFrjE.


title: Unveiling a Novel Metal-to-Metal Transition in LuH2: Critically Challenging Superconductivity Claims in Lutetium Hydrides

abstract: Following the recent report by Dasenbrock-Gammon et al. (2023) of near-ambient superconductivity in nitrogen-doped lutetium trihydride (LuH3-{\delta}N{\epsilon}), significant debate has emerged surrounding the composition and interpretation of the observed sharp resistance drop. Here, we meticulously revisit these claims through comprehensive characterization and investigations. We definitively identify the reported material as lutetium dihydride (LuH2), resolving the ambiguity surrounding its composition. Under similar conditions (270-295 K and 1-2 GPa), we replicate the reported sharp decrease in electrical resistance with a 30% success rate, aligning with Dasenbrock-Gammon et al.'s observations. However, our extensive investigations reveal this phenomenon to be a novel, pressure-induced metal-to-metal transition intrinsic to LuH2, distinct from superconductivity. Intriguingly, nitrogen doping exerts minimal impact on this transition. Our work not only elucidates the fundamental properties of LuH2 and LuH3 but also critically challenges the notion of superconductivity in these lutetium hydride systems. These findings pave the way for future research on lutetium hydride systems while emphasizing the crucial importance of rigorous verification in claims of ambient temperature superconductivity.


title: Conditional Neural Video Coding with Spatial-Temporal Super-Resolution

abstract: This document is an expanded version of a one-page abstract originally presented at the 2024 Data Compression Conference. It describes our proposed method for the video track of the Challenge on Learned Image Compression (CLIC) 2024. Our scheme follows the typical hybrid coding framework with some novel techniques. Firstly, we adopt Spynet network to produce accurate motion vectors for motion estimation. Secondly, we introduce the context mining scheme with conditional frame coding to fully exploit the spatial-temporal information. As for the low target bitrates given by CLIC, we integrate spatial-temporal super-resolution modules to improve rate-distortion performance. Our team name is IMCLVC.


title: Temperature Compensation through Kinetic Regulation in Biochemical Oscillators

abstract: Nearly all circadian clocks maintain a period that is insensitive to temperature changes, a phenomenon known as temperature compensation (TC). Yet, it is unclear whether there is any common feature among different systems that exhibit TC. From a general timescale invariance, we show that TC relies on existence of certain period-lengthening reactions wherein the period of the system increases strongly with the rates in these reactions. By studying several generic oscillator models, we show that this counter-intuitive dependence is nonetheless a common feature of oscillators in the nonlinear (far-from-onset) regime where the oscillation can be separated into fast and slow phases. The increase of the period with the period-lengthening reaction rates occurs when the amplitude of the slow phase in the oscillation increases with these rates while the progression-speed in the slow phase is controlled by other rates of the system. The positive dependence of the period on the period-lengthening rates balances its inverse dependence on other kinetic rates in the system, which gives rise to robust TC in a wide range of parameters. We demonstrate the existence of such period-lengthening reactions and their relevance for TC in all four model systems we considered. Theoretical results for a model of the Kai system are supported by experimental data. A study of the energy dissipation also shows that better TC performance requires higher energy consumption. Our study unveils a general mechanism by which a biochemical oscillator achieves TC by operating at regimes far from the onset where period-lengthening reactions exist.


title: TriSAM: Tri-Plane SAM for zero-shot cortical blood vessel segmentation in VEM images

abstract: While imaging techniques at macro and mesoscales have garnered substantial attention and resources, microscale Volume Electron Microscopy (vEM) imaging, capable of revealing intricate vascular details, has lacked the necessary benchmarking infrastructure. In this paper, we address a significant gap in this field of neuroimaging by introducing the first-in-class public benchmark, BvEM, designed specifically for cortical blood vessel segmentation in vEM images. Our BvEM benchmark is based on vEM image volumes from three mammals: adult mouse, macaque, and human. We standardized the resolution, addressed imaging variations, and meticulously annotated blood vessels through semi-automatic, manual, and quality control processes, ensuring high-quality 3D segmentation. Furthermore, we developed a zero-shot cortical blood vessel segmentation method named TriSAM, which leverages the powerful segmentation model SAM for 3D segmentation. To extend SAM from 2D to 3D volume segmentation, TriSAM employs a multi-seed tracking framework, leveraging the reliability of certain image planes for tracking while using others to identify potential turning points. This approach effectively achieves long-term 3D blood vessel segmentation without model training or fine-tuning. Experimental results show that TriSAM achieved superior performances on the BvEM benchmark across three species. Our dataset, code, and model are available online at \url{https://jia-wan.github.io/bvem}.


title: An inf-sup Approach to $C_0$-Semigroup Generation for An Interactive Composite Structure-Stokes PDE Dynamics

abstract: In this work, we investigate the existence and uniqueness properties of a composite structure (multilayered) fluid interaction PDE system which arises in multi-physics problems, and particularly in biofluidic applications related to the mammalian blood transportation process. The PDE system under consideration consists of the interactive coupling of 3D Stokes flow and 3D elastic dynamics which gives rise to an additional 2D elastic equation on the boundary interface between these 3D PDE systems. By means of a nonstandard mixed variational formulation we show that the PDE system generates a $C_0$-semigroup on the associated finite energy space of data. In this work, the presence of the pressure term in the 3D Stokes equation adds a great challenge to our analysis. To overcome this difficulty, we follow a methodology which is based on the necessarily non-Leray based elimination of the associated pressure term, via appropriate nonlocal operators. Moreover, while we express the fluid solution variable via decoupling of the Stokes equation, we construct the elastic solution variables by solving a mixed variational formulation via a Babuska-Brezzi approach.


title: Hawking-Page transition on a spin chain

abstract: The accessibility of the Hawking-Page transition in AdS$_5$ through a 1d Heisenberg spin chain is demonstrated. We use the random matrix formulation of the Loschmidt echo for a set of spin chains, and randomize the ferromagnetic spin interaction. It is shown that the thermal Loschmidt echo, when averaged, detects the predicted increase in entropy across the Hawking-Page transition. This suggests that a 1d spin chain exhibits characteristics of black hole physics in 4+1 dimensions. We show that this approach is equally applicable to free fermion systems with a general dispersion relation.


title: An Extensible Framework for Open Heterogeneous Collaborative Perception

abstract: Collaborative perception aims to mitigate the limitations of single-agent perception, such as occlusions, by facilitating data exchange among multiple agents. However, most current works consider a homogeneous scenario where all agents use identity sensors and perception models. In reality, heterogeneous agent types may continually emerge and inevitably face a domain gap when collaborating with existing agents. In this paper, we introduce a new open heterogeneous problem: how to accommodate continually emerging new heterogeneous agent types into collaborative perception, while ensuring high perception performance and low integration cost? To address this problem, we propose HEterogeneous ALliance (HEAL), a novel extensible collaborative perception framework. HEAL first establishes a unified feature space with initial agents via a novel multi-scale foreground-aware Pyramid Fusion network. When heterogeneous new agents emerge with previously unseen modalities or models, we align them to the established unified space with an innovative backward alignment. This step only involves individual training on the new agent type, thus presenting extremely low training costs and high extensibility. To enrich agents' data heterogeneity, we bring OPV2V-H, a new large-scale dataset with more diverse sensor types. Extensive experiments on OPV2V-H and DAIR-V2X datasets show that HEAL surpasses SOTA methods in performance while reducing the training parameters by 91.5% when integrating 3 new agent types. We further implement a comprehensive codebase at: https://github.com/yifanlu0227/HEAL


title: Improving Pseudo-labelling and Enhancing Robustness for Semi-Supervised Domain Generalization

abstract: Beyond attaining domain generalization (DG), visual recognition models should also be data-efficient during learning by leveraging limited labels. We study the problem of Semi-Supervised Domain Generalization (SSDG) which is crucial for real-world applications like automated healthcare. SSDG requires learning a cross-domain generalizable model when the given training data is only partially labelled. Empirical investigations reveal that the DG methods tend to underperform in SSDG settings, likely because they are unable to exploit the unlabelled data. Semi-supervised learning (SSL) shows improved but still inferior results compared to fully-supervised learning. A key challenge, faced by the best-performing SSL-based SSDG methods, is selecting accurate pseudo-labels under multiple domain shifts and reducing overfitting to source domains under limited labels. In this work, we propose new SSDG approach, which utilizes a novel uncertainty-guided pseudo-labelling with model averaging (UPLM). Our uncertainty-guided pseudo-labelling (UPL) uses model uncertainty to improve pseudo-labelling selection, addressing poor model calibration under multi-source unlabelled data. The UPL technique, enhanced by our novel model averaging (MA) strategy, mitigates overfitting to source domains with limited labels. Extensive experiments on key representative DG datasets suggest that our method demonstrates effectiveness against existing methods. Our code and chosen labelled data seeds are available on GitHub: https://github.com/Adnan-Khan7/UPLM


title: The Avoidance Principle for Noncompact Hypersurfaces Moving by Mean Curvature Flow

abstract: Consider a pair of smooth, possibly noncompact, properly immersed hypersurfaces moving by mean curvature flow, or, more generally, a pair of weak set flows. We prove that if the ambient space is Euclidean space and if the distance between the two surfaces is initially nonzero, then the surfaces remain disjoint at all subsequent times. We prove the same result when the ambient space is a complete Riemannian manifold of nonzero injectivity radius, provided the curvature tensor (of the ambient space) and all its derivatives are bounded.


title: Perceptual-oriented Learned Image Compression with Dynamic Kernel

abstract: In this paper, we extend our prior research named DKIC and propose the perceptual-oriented learned image compression method, PO-DKIC. Specifically, DKIC adopts a dynamic kernel-based dynamic residual block group to enhance the transform coding and an asymmetric space-channel context entropy model to facilitate the estimation of gaussian parameters. Based on DKIC, PO-DKIC introduces PatchGAN and LPIPS loss to enhance visual quality. Furthermore, to maximize the overall perceptual quality under a rate constraint, we formulate this challenge into a constrained programming problem and use the Linear Integer Programming method for resolution. The experiments demonstrate that our proposed method can generate realistic images with richer textures and finer details when compared to state-of-the-art image compression techniques.


title: Dynamic Long-Term Time-Series Forecasting via Meta Transformer Networks

abstract: A reliable long-term time-series forecaster is highly demanded in practice but comes across many challenges such as low computational and memory footprints as well as robustness against dynamic learning environments. This paper proposes Meta-Transformer Networks (MANTRA) to deal with the dynamic long-term time-series forecasting tasks. MANTRA relies on the concept of fast and slow learners where a collection of fast learners learns different aspects of data distributions while adapting quickly to changes. A slow learner tailors suitable representations to fast learners. Fast adaptations to dynamic environments are achieved using the universal representation transformer layers producing task-adapted representations with a small number of parameters. Our experiments using four datasets with different prediction lengths demonstrate the advantage of our approach with at least $3\%$ improvements over the baseline algorithms for both multivariate and univariate settings. Source codes of MANTRA are publicly available in \url{https://github.com/anwarmaxsum/MANTRA}.


title: Small-size reflectionless band-pass filter

abstract: The paper presents a reflectionless stripline filter with reduced dimensions having a single bandwidth over a wide frequency range. The filter consists of coupled strip lines and RLC circuits included in the diagonal ports of the coupled strip lines. Calculations and measurements of the reflectionless stripline filter layout in the frequency range up to 4.8 GHz have been carried out. The obtained results show that the dimensions are reduced by a factor of two compared to previously developed reflectionless stripline filter designs. It is achieved by folding the coupled lines in the form of a meander formed by horizontally and vertically arranged conductors on horizontally and vertically oriented dielectric substrates. The proposed reflectionless stripline filter allows to solve the problem of improving the mass-dimensional parameters of the equipment and to provide signal selection with minimum reflection at out-of-band frequencies. It can be in demand in multichannel systems of wireless communications, radar, and measurements.