title: Inferring potential landscapes: A Schr\"odinger bridge approach to Maximum Caliber

abstract: Schr\"odinger bridges have emerged as an enabling framework for unveiling the stochastic dynamics of systems based on marginal observations at different points in time. The terminology "bridge'' refers to a probability law that suitably interpolates such marginals. The theory plays a pivotal role in a variety of contemporary developments in machine learning, stochastic control, thermodynamics, and biology, to name a few, impacting disciplines such as single-cell genomics, meteorology, and robotics. In this work, we extend Schr\"odinger's paradigm of bridges to account for integral constraints along paths, in a way akin to Maximum Caliber - a Maximum Entropy principle applied in a dynamic context. The Maximum Caliber principle has proven useful to infer the dynamics of complex systems e.g., that model gene circuits and protein folding. We unify these two problems via a maximum likelihood formulation to reconcile stochastic dynamics with ensemble-path data. A variety of data types can be encompassed, ranging from distribution moments to average currents along paths. The framework enables inference of time-varying potential landscapes that drive the process. The resulting forces can be interpreted as the optimal control that drives the system in a way that abides by specified integral constraints. Analogous results are presented in a discrete-time, discrete-space setting and specialized to steady-state dynamics. We finish by illustrating the practical applicability of the framework through paradigmatic examples, such as that of bit erasure or protein folding. In doing so, we highlight the strengths of the proposed framework, namely, the generality of the theory, the ease of computation, and the ability to interpret results in terms of system dynamics. This is in contrast to Maximum-Caliber problems where the focus is typically on updating a probability law on paths.


title: On odd-normal numbers

abstract: A real number $x$ is considered normal in an integer base $b \geq 2$ if its digit expansion in this base is ``equitable'', ensuring that for each $k \geq 1$, every ordered sequence of $k$ digits from $\{0, 1, \ldots, b-1\}$ occurs in the digit expansion of $x$ with the same limiting frequency. Borel's classical result \cite{b09} asserts that Lebesgue-almost every $x \in \mathbb R$ is normal in every base $b \geq 2$. This paper serves as a case study of the measure-theoretic properties of Lebesgue-null sets containing numbers that are normal only in certain bases. We consider the set $\mathscr N(\mathscr{O}, \mathscr{E})$ of reals that are normal in odd bases but not in even ones. This set has full Hausdorff dimension \cite{p81} but zero Fourier dimension. The latter condition means that $\mathscr N(\mathscr{O}, \mathscr{E})$ cannot support a probability measure whose Fourier transform has power decay at infinity. Our main result is that $\mathscr N(\mathscr{O}, \mathscr{E})$ supports a Rajchman measure $\mu$, whose Fourier transform $\widehat{\mu}(\xi)$ approaches 0 as $|\xi| \rightarrow \infty$ by definiton, albeit slower than any negative power of $|\xi|$. Moreover, the decay rate of $\widehat{\mu}$ is essentially optimal, subject to the constraints of its support. The methods draw inspiration from the number-theoretic results of Schmidt \cite{s60} and a construction of Lyons \cite{l86}. As a consequence, $\mathscr N(\mathscr{O}, \mathscr{E})$ emerges as a set of multiplicity, in the sense of Fourier analysis. This addresses a question posed by Kahane and Salem \cite{Kahane-Salem-64} in the special case of $\mathscr N(\mathscr{O}, \mathscr{E})$.


title: ModelWriter: Text & Model-Synchronized Document Engineering Platform

abstract: The ModelWriter platform provides a generic framework for automated traceability analysis. In this paper, we demonstrate how this framework can be used to trace the consistency and completeness of technical documents that consist of a set of System Installation Design Principles used by Airbus to ensure the correctness of aircraft system installation. We show in particular, how the platform allows the integration of two types of reasoning: reasoning about the meaning of text using semantic parsing and description logic theorem proving; and reasoning about document structure using first-order relational logic and finite model finding for traceability analysis.


title: "Digitwashing": The Gap between Words and Deeds in Digital Transformation and Stock Price Crash Risk

abstract: The contrast between companies' "fleshy" promises and the "skeletal" performance in digital transformation may lead to a higher risk of stock price crash. This paper selects a sample of Shanghai and Shenzhen A-share listed companies from 2010 to 2021, empirically analyses the specific impact of the gap between words and deeds in digital transformation (GDT) on the stock price crash risk, and explores the possible causes of GDT. We found that GDT significantly increases the stock price crash risk, and this finding is still valid after a series of robustness tests. In a further study, a deeper examination of the causes of GDT reveals that firms' perceptions of economic policy uncertainty significantly increase GDT, and the effect is more pronounced in the sample of loss-making firms. At the same time, the results of the heterogeneity test suggest that investors are more tolerant of state-owned enterprises when they are in the GDT situation. Taken together, we provide a concrete bridge between the two measures of digital transformation - digital text frequency and digital technology share - and offer new insights to enhance capital market stability.


title: Bandit Profit-maximization for Targeted Marketing

abstract: We study a sequential profit-maximization problem, optimizing for both price and ancillary variables like marketing expenditures. Specifically, we aim to maximize profit over an arbitrary sequence of multiple demand curves, each dependent on a distinct ancillary variable, but sharing the same price. A prototypical example is targeted marketing, where a firm (seller) wishes to sell a product over multiple markets. The firm may invest different marketing expenditures for different markets to optimize customer acquisition, but must maintain the same price across all markets. Moreover, markets may have heterogeneous demand curves, each responding to prices and marketing expenditures differently. The firm's objective is to maximize its gross profit, the total revenue minus marketing costs. Our results are near-optimal algorithms for this class of problems in an adversarial bandit setting, where demand curves are arbitrary non-adaptive sequences, and the firm observes only noisy evaluations of chosen points on the demand curves. We prove a regret upper bound of $\widetilde{\mathcal{O}}\big(nT^{3/4}\big)$ and a lower bound of $\Omega\big((nT)^{3/4}\big)$ for monotonic demand curves, and a regret bound of $\widetilde{\Theta}\big(nT^{2/3}\big)$ for demands curves that are monotonic in price and concave in the ancillary variables.


title: Enhancing Retinal Vascular Structure Segmentation in Images With a Novel Design Two-Path Interactive Fusion Module Model

abstract: Precision in identifying and differentiating micro and macro blood vessels in the retina is crucial for the diagnosis of retinal diseases, although it poses a significant challenge. Current autoencoding-based segmentation approaches encounter limitations as they are constrained by the encoder and undergo a reduction in resolution during the encoding stage. The inability to recover lost information in the decoding phase further impedes these approaches. Consequently, their capacity to extract the retinal microvascular structure is restricted. To address this issue, we introduce Swin-Res-Net, a specialized module designed to enhance the precision of retinal vessel segmentation. Swin-Res-Net utilizes the Swin transformer which uses shifted windows with displacement for partitioning, to reduce network complexity and accelerate model convergence. Additionally, the model incorporates interactive fusion with a functional module in the Res2Net architecture. The Res2Net leverages multi-scale techniques to enlarge the receptive field of the convolutional kernel, enabling the extraction of additional semantic information from the image. This combination creates a new module that enhances the localization and separation of micro vessels in the retina. To improve the efficiency of processing vascular information, we've added a module to eliminate redundant information between the encoding and decoding steps. Our proposed architecture produces outstanding results, either meeting or surpassing those of other published models. The AUC reflects significant enhancements, achieving values of 0.9956, 0.9931, and 0.9946 in pixel-wise segmentation of retinal vessels across three widely utilized datasets: CHASE-DB1, DRIVE, and STARE, respectively. Moreover, Swin-Res-Net outperforms alternative architectures, demonstrating superior performance in both IOU and F1 measure metrics.


title: On smooth adic spaces over $\mathbb{B}_{\mathrm{dR}}^+$ and sheafified $p$-adic Riemann--Hilbert correspondence

abstract: Inspired by Heuer's paper, we consider adic spaces over a de Rham period ring of a perfectoid Tate--Huber ring and their sheafified Riemann--Hilbert correspondence. We will prove that for any smooth adic space $X$ over $\mathbb{B}_{\mathrm{dR},\alpha}^+(K,K^+)$, there is a canonical sheaf isomorphism $$R^1\nu_*\left(\mathrm{GL}_r({\mathbb{B}_{\mathrm{dR}}^+}_{,\bar{X}}/t^\alpha)\right)\cong t-\mathrm{MIC}_r(X).$$ Moreover, we will define $v$-prestacks of $\mathbb{B}_{\mathrm{dR}}^+$-local systems and $t$-connections, and prove that they are small $v$-stacks.


title: Improving Cross-lingual Representation for Semantic Retrieval with Code-switching

abstract: Semantic Retrieval (SR) has become an indispensable part of the FAQ system in the task-oriented question-answering (QA) dialogue scenario. The demands for a cross-lingual smart-customer-service system for an e-commerce platform or some particular business conditions have been increasing recently. Most previous studies exploit cross-lingual pre-trained models (PTMs) for multi-lingual knowledge retrieval directly, while some others also leverage the continual pre-training before fine-tuning PTMs on the downstream tasks. However, no matter which schema is used, the previous work ignores to inform PTMs of some features of the downstream task, i.e. train their PTMs without providing any signals related to SR. To this end, in this work, we propose an Alternative Cross-lingual PTM for SR via code-switching. We are the first to utilize the code-switching approach for cross-lingual SR. Besides, we introduce the novel code-switched continual pre-training instead of directly using the PTMs on the SR tasks. The experimental results show that our proposed approach consistently outperforms the previous SOTA methods on SR and semantic textual similarity (STS) tasks with three business corpora and four open datasets in 20+ languages.


title: AI-Powered Reminders for Collaborative Tasks: Experiences and Futures

abstract: Email continues to serve as a central medium for managing collaborations. While unstructured email messaging is lightweight and conducive to coordination, it is easy to overlook commitments and requests for collaborations that are embedded in the text of free-flowing communications. Twenty-one years ago, Bellotti et al. proposed TaskMaster with the goal of redesigning the email interface to have explicit task management capabilities. Recently, AI-based task recognition and reminder services have been introduced in major email systems as one approach to managing asynchronous collaborations. While these services have been provided to millions of people around the world, there is little understanding of how people interact with and benefit from them. We explore knowledge workers' experiences with Microsoft's Viva Daily Briefing Email to better understand how AI-powered reminders can support asynchronous collaborations. Through semi-structured interviews and surveys, we shed light on how AI-powered reminders are incorporated into workflows to support asynchronous collaborations. We identify what knowledge workers prefer AI-powered reminders to remind them about and how they would like to interact with these reminders. Using mixed methods and a self-assessment methodology, we investigate the relationship between information workers' work styles and the perceived value of the Viva Daily Briefing Email to identify users who are more likely to benefit from AI-powered reminders for asynchronous collaborations. We conclude by discussing the experiences and futures of AI-powered reminders for collaborative tasks and asynchronous collaborations.


title: Relativistic and nonrelativistic Landau levels for Dirac fermions in the cosmic string spacetime in the context of rainbow gravity

abstract: In this paper, we study the relativistic and nonrelativistic Landau levels for Dirac fermions in the cosmic string spacetime in the context of rainbow gravity in $(3+1)$-dimensions, where we work with the curved Dirac equation with minimal coupling in cylindrical coordinates. Using the tetrads formalism of General Relativity, we obtain a second-order differential equation. Solving this differential equation, we obtain a generalized Laguerre equation as well as the relativistic Landau levels for the fermion and antifermion, where such energy levels are quantized in terms of the quantum numbers $n$, $m_j$ and $m_s$, and explicitly depends on the rainbow functions $f(\varepsilon)$ and $g(\varepsilon)$, charge parameter $\sigma$, cyclotron frequency $\omega_c$, curvature parameter $\alpha$, and on the square rest energy $m^2_0$ and square $z$-momentum $k^2_z$, respectively. Posteriorly, we study the nonrelativistic limit of the system, where we obtain the nonrelativistic Landau levels. In both cases (relativistic and nonrelativistic), we graphically analyze the behavior of Landau levels for the three rainbow gravity scenarios as a function of the magnetic field $B$ and of the curvature parameter $\alpha$. In addition, we also compared our problem with other works, where we verified that our results generalize several particular cases in the literature.


title: Optimization decision model of vegetable stock and pricing based on TCN-Attention and genetic algorithm

abstract: With the expansion of operational scale of supermarkets in China, the vegetable market has grown considerably. The decision-making related to procurement costs and allocation quantities of vegetables has become a pivotal factor in determining the profitability of supermarkets. This paper analyzes the relationship between pricing and allocation faced by supermarkets in vegetable operations. Optimization algorithms are employed to determine replenishment and pricing strategies. Linear regression is utilized to model the historical data of various products, establishing the relationship between sale prices and sales volumes for 61 products. By integrating historical data on vegetable costs with time information based on the 24 solar terms, a cost prediction model is trained using TCN-Attention. The Topis evaluation model identifies the 32 most market-demanded products. A genetic algorithm is then used to search for the globally optimized vegetable product allocation-pricing decision.


title: Improving Convolutional Neural Networks for Cosmological Fields with Random Permutation

abstract: Convolutional Neural Networks (CNNs) have recently been applied to cosmological fields -- weak lensing mass maps and galaxy maps. However, cosmological maps differ in several ways from the vast majority of images that CNNs have been tested on: they are stochastic, typically low signal-to-noise per pixel, and with correlations on all scales. Further, the cosmology goal is a regression problem aimed at inferring posteriors on parameters that must be unbiased. We explore simple CNN architectures and present a novel approach of regularization and data augmentation to improve its performance for lensing mass maps. We find robust improvement by using a mixture of pooling and shuffling of the pixels in the deep layers. The random permutation regularizes the network in the low signal-to-noise regime and effectively augments the existing data. We use simulation-based inference (SBI) to show that the model outperforms CNN designs in the literature. We find a 30% improvement in the constraints of the $S_8$ parameter for simulated Stage-III surveys, including systematic uncertainties such as intrinsic alignments. We explore various statistical errors corresponding to next-generation surveys and find comparable improvements. We expect that our approach will have applications to other cosmological fields as well, such as galaxy maps or 21-cm maps.


title: A Closer Look at Wav2Vec2 Embeddings for On-Device Single-Channel Speech Enhancement

abstract: Self-supervised learned models have been found to be very effective for certain speech tasks such as automatic speech recognition, speaker identification, keyword spotting and others. While the features are undeniably useful in speech recognition and associated tasks, their utility in speech enhancement systems is yet to be firmly established, and perhaps not properly understood. In this paper, we investigate the uses of SSL representations for single-channel speech enhancement in challenging conditions and find that they add very little value for the enhancement task. Our constraints are designed around on-device real-time speech enhancement -- model is causal, the compute footprint is small. Additionally, we focus on low SNR conditions where such models struggle to provide good enhancement. In order to systematically examine how SSL representations impact performance of such enhancement models, we propose a variety of techniques to utilize these embeddings which include different forms of knowledge-distillation and pre-training.


title: Depth Estimation Algorithm Based on Transformer-Encoder and Feature Fusion

abstract: This research presents a novel depth estimation algorithm based on a Transformer-encoder architecture, tailored for the NYU and KITTI Depth Dataset. This research adopts a transformer model, initially renowned for its success in natural language processing, to capture intricate spatial relationships in visual data for depth estimation tasks. A significant innovation of the research is the integration of a composite loss function that combines Structural Similarity Index Measure (SSIM) with Mean Squared Error (MSE). This combined loss function is designed to ensure the structural integrity of the predicted depth maps relative to the original images (via SSIM) while minimizing pixel-wise estimation errors (via MSE). This research approach addresses the challenges of over-smoothing often seen in MSE-based losses and enhances the model's ability to predict depth maps that are not only accurate but also maintain structural coherence with the input images. Through rigorous training and evaluation using the NYU Depth Dataset, the model demonstrates superior performance, marking a significant advancement in single-image depth estimation, particularly in complex indoor and traffic environments.


title: eXponential FAmily Dynamical Systems (XFADS): Large-scale nonlinear Gaussian state-space modeling

abstract: State-space graphical models and the variational autoencoder framework provide a principled apparatus for learning dynamical systems from data. State-of-the-art probabilistic approaches are often able to scale to large problems at the cost of flexibility of the variational posterior or expressivity of the dynamics model. However, those consolidations can be detrimental if the ultimate goal is to learn a generative model capable of explaining the spatiotemporal structure of the data and making accurate forecasts. We introduce a low-rank structured variational autoencoding framework for nonlinear Gaussian state-space graphical models capable of capturing dense covariance structures that are important for learning dynamical systems with predictive capabilities. Our inference algorithm exploits the covariance structures that arise naturally from sample based approximate Gaussian message passing and low-rank amortized posterior updates -- effectively performing approximate variational smoothing with time complexity scaling linearly in the state dimensionality. In comparisons with other deep state-space model architectures our approach consistently demonstrates the ability to learn a more predictive generative model. Furthermore, when applied to neural physiological recordings, our approach is able to learn a dynamical system capable of forecasting population spiking and behavioral correlates from a small portion of single trials.


title: Rotational surfaces in a normed 3-space whose principal curvatures satisfy a linear relation

abstract: We classify rotational surfaces in a normed 3-space with rotationally symmetric norm whose principal curvatures satisfy a linear relation.


title: Quantity Matters: Towards Assessing and Mitigating Number Hallucination in Large Vision-Language Models

abstract: Large-scale vision-language models have demonstrated impressive skill in handling tasks that involve both areas. Nevertheless, these models frequently experience significant issues with generating inaccurate information, which is hallucination. In this study, we concentrate on a specific type of hallucination-number hallucination, referring to models incorrectly identifying the number of certain objects in pictures. We perform quantitative evaluations regarding number hallucination, showing it to be critical in major open-source large vision-language models. Furthermore, we utilizes two related tasks to conduct an in-depth analysis of number hallucination, revealing the severe inner and outer inconsistency among all tasks. Based on this examination, we devise a training approach aimed at improving consistency to reduce number hallucinations, which leads to an 8% enhancement in performance over direct finetuning methods. Our code and dataset will be released to the community.


title: A Novel Dynamic Light-Section 3D Reconstruction Method for Wide-Range Sensing

abstract: Existing galvanometer-based laser scanning systems are challenging to apply in multi-scale 3D reconstruction because of the difficulty in achieving a balance between high reconstruction accuracy and a wide reconstruction range. This paper presents a novel method that synchronizes laser scanning by switching the field-of-view (FOV) of a camera using multi-galvanometers. In addition to the advanced hardware setup, we establish a comprehensive mathematical model of the system by modeling dynamic camera, dynamic laser, and their combined interaction. We then propose a high-precision and flexible calibration method by constructing an error model and minimizing the objective function. Finally, we evaluate the performance of the proposed system by scanning standard components. The evaluation results demonstrate that the accuracy of the proposed 3D reconstruction system achieves 0.3 mm when the measurement range is extended to 1100 mm $\times$ 1300 mm $\times$ 650 mm. With the same reconstruction accuracy, the reconstruction range is expanded by a factor of 25, indicating that the proposed method simultaneously allows for high-precision and wide-range 3D reconstruction in industrial applications.


title: Directional emission of a readout resonator for qubit measurement

abstract: We propose and demonstrate transmission-based dispersive readout of a superconducting qubit using an all-pass resonator, which preferentially emits readout photons toward the output. This is in contrast to typical readout schemes, which intentionally mismatch the feedline at one end so that the readout signal preferentially decays toward the output. We show that this intentional mismatch creates scaling challenges, including larger spread of effective resonator linewidths due to non-ideal impedance environments and added infrastructure for impedance matching. A future architecture using multiplexed all-pass readout resonators would avoid the need for intentional mismatch and potentially improve the scaling prospects of quantum computers. As a proof-of-concept demonstration of "all-pass readout," we design and fabricate an all-pass readout resonator that demonstrates insertion loss below 1.17 dB at the readout frequency and a maximum insertion loss of 1.53 dB across its full bandwidth for the lowest three states of a transmon qubit. We demonstrate qubit readout with an average single-shot fidelity of 98.1% in 600 ns; to assess the effect of larger dispersive shift, we implement a shelving protocol and achieve a fidelity of 99.0% in 300 ns.


title: Fault-tolerant Quantum Error Correction Using a Linear Array of Emitters

abstract: We propose a fault-tolerant quantum error correction architecture consisting of a linear array of emitters and delay lines. In our scheme, a resource state for fault-tolerant quantum computation is generated by letting the emitters interact with a stream of photons and their neighboring emitters. In the absence of delay line errors, our schemes have thresholds ranging between 0.32% and 0.39% against the standard circuit-level depolarizing error model. Depending on the number of emitters n_e, we study the effect of delay line errors in two regimes: when n_e is a small constant of order unity and when n_e scales with the code distance. Between these two regimes, the logical error rate steadily decreases as n_e increases, from an exponential decay in eta^{-1/2} to an exponential decay in eta^{-1}. We also carry out a detailed study of the break-even point and the fault-tolerance overhead. These studies suggest that the multi-emitter architecture, using the state-of-the-art delay lines, can be used to demonstrate error suppression, assuming other sources of errors are sufficiently small.


title: Single-Beam Velocimetry with Dual Frequency Comb Absorption Spectroscopy

abstract: Laser absorption Doppler velocimeters use a crossed-beam configuration to cancel error due to laser frequency drift and absorption model uncertainty. This configuration complicates the spatial interpretation of the measurement since the two beams sample different volumes of gas. Here, we achieve single-beam velocimetry with a portable dual comb spectrometer (DCS) with high frequency accuracy and stability enabled by GPS-referencing, and a new high-temperature water vapor absorption database. We measure the inlet flow in a supersonic ramjet engine and demonstrate single-beam measurements that are on average within 19 m/s of concurrent crossed-beam measurements. We estimate that the DCS and the new database contribute 1.6 and 13 m/s to this difference respectively.


title: Spontaneous chiral symmetry breaking and mass gap of QCD in finite volume

abstract: We present the lattice QCD simulation with the 2+1+1 flavor full QCD ensembles using near-physical quark masses and different spatial sizes $L$, at $a\sim$ 0.055 fm. The results suggest that spontaneous chiral symmetry breaking is effectively restored at $L\le 1.0$ fm, while the gap between the nucleon and pion masses remains.


title: Propagation of high peaks for the space-time fractional stochastic partial differential equations

abstract: We study the space-time nonlinear fractional stochastic heat equation driven by a space-time white noise, \begin{align*} \partial_t^\beta u(t,x)=-(-\Delta)^{\alpha/2}u(t,x)+I_t^{1-\beta}\Big[\sigma(u(t,x))\dot{W}(t,x)\Big],\ \ t>0, \ x\in \mathbb{R} , \end{align*} where $\sigma:\mathbb{R}\rightarrow\mathbb{R}$ is a globally Lipschitz function and the initial condition is a measure on $\mathbb{R}.$ Under some growth conditions on $\sigma,$ we derive two important properties about the moments of the solution: (i) For $p\geq 2,$ the $p^{\text{th}}$ absolute moment of the solution to the equation above grows exponentially with time. (ii) Moreover, the distances to the origin of the farthest high peaks of these moments grow exactly exponentially with time. Our results provide an extension of the work of Chen and Dalang (Stoch PDE: Anal Comp (2015) 3:360-397) to a time-fractional setting. We also show that condition (i) holds when we study the same equation for $x\in\mathbb{R}^d.$


title: Temperature, Pressure, Velocity, and Water Vapor Mole Fraction Profiles in a Ramjet Combustor using Dual Frequency Comb Spectroscopy and a High Temperature Absorption Database

abstract: Accurate diagnostics of the combustor region of ramjet engines can improve engine design and create benchmarks for computational fluid dynamics models. Previous works demonstrate that dual frequency comb spectroscopy can provide low uncertainty diagnostics of multiple flow parameters in the non-combusting regions of ramjets. However, the high temperatures present in the combustor present a challenge for broadband spectroscopic absorption models that are used to interpret measurements in these regions. Here, we utilize a new water vapor absorption database created for high temperature water-air mixtures to fit spectra measured in a ground-test ramjet engine with a broadband near-infrared dual comb absorption spectrometer. We extract 2D profiles of pressure, temperature, water mole fraction, and velocity using this new database. We demonstrate that the new database provides the lowest fit residuals compared to other water vapor absorption databases. We compare computational fluid dynamics simulations of the combustor with the measured data to demonstrate that the simulations overpredict heat release and water vapor production.


title: SA-MixNet: Structure-aware Mixup and Invariance Learning for Scribble-supervised Road Extraction in Remote Sensing Images

abstract: Mainstreamed weakly supervised road extractors rely on highly confident pseudo-labels propagated from scribbles, and their performance often degrades gradually as the image scenes tend various. We argue that such degradation is due to the poor model's invariance to scenes with different complexities, whereas existing solutions to this problem are commonly based on crafted priors that cannot be derived from scribbles. To eliminate the reliance on such priors, we propose a novel Structure-aware Mixup and Invariance Learning framework (SA-MixNet) for weakly supervised road extraction that improves the model invariance in a data-driven manner. Specifically, we design a structure-aware Mixup scheme to paste road regions from one image onto another for creating an image scene with increased complexity while preserving the road's structural integrity. Then an invariance regularization is imposed on the predictions of constructed and origin images to minimize their conflicts, which thus forces the model to behave consistently on various scenes. Moreover, a discriminator-based regularization is designed for enhancing the connectivity meanwhile preserving the structure of roads. Combining these designs, our framework demonstrates superior performance on the DeepGlobe, Wuhan, and Massachusetts datasets outperforming the state-of-the-art techniques by 1.47%, 2.12%, 4.09% respectively in IoU metrics, and showing its potential of plug-and-play. The code will be made publicly available.


title: Automatic Question-Answer Generation for Long-Tail Knowledge

abstract: Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties in learning about uncommon long-tail knowledge (tail entities). Since manually constructing QA datasets demands substantial human resources, the types of existing QA datasets are limited, leaving us with a scarcity of datasets to study the performance of LLMs on tail entities. In this paper, we propose an automatic approach to generate specialized QA datasets for tail entities and present the associated research challenges. We conduct extensive experiments by employing pretrained LLMs on our newly generated long-tail QA datasets, comparing their performance with and without external resources including Wikipedia and Wikidata knowledge graphs.


title: Postharvest litchi (Litchi chinensis Sonn.) quality preservation by alginate oligosaccharides

abstract: This study investigates the efficacy of alginate oligosaccharides, derived from a novel alginate lyase expressed in E. coli (Pet21a-alginate lyase), in preserving the postharvest quality of litchi (Litchi chinensis Sonn.) fruits. The alginate lyase, characterized by Huang et al. (2013), was employed to produce AOS through enzymatic degradation of alginate. The resulting oligosaccharides were applied to litchi fruits harvested from Guangzhou Zengcheng to evaluate their impact on various quality parameters under controlled storage conditions. The study focused on measuring the effects of alginate oligosaccharide treatment on the fruits' color retention, water loss rate, hardness, and susceptibility to mold infection, under a set relative humidity and temperature. Results demonstrated significant improvements in the treated fruits, with enhanced color retention, reduced water loss, maintained hardness, and lower rates of mold infection compared to untreated controls. These findings suggest that AOS offer a promising natural alternative for extending the shelf life and maintaining the quality of litchi fruits postharvest.


title: On the Compressibility of Quantized Large Language Models

abstract: Deploying Large Language Models (LLMs) on edge or mobile devices offers significant benefits, such as enhanced data privacy and real-time processing capabilities. However, it also faces critical challenges due to the substantial memory requirement of LLMs. Quantization is an effective way of reducing the model size while maintaining good performance. However, even after quantization, LLMs may still be too big to fit entirely into the limited memory of edge or mobile devices and have to be partially loaded from the storage to complete the inference. In this case, the I/O latency of model loading becomes the bottleneck of the LLM inference latency. In this work, we take a preliminary step of studying applying data compression techniques to reduce data movement and thus speed up the inference of quantized LLM on memory-constrained devices. In particular, we discussed the compressibility of quantized LLMs, the trade-off between the compressibility and performance of quantized LLMs, and opportunities to optimize both of them jointly.


title: Continuously and widely tunable frequency-stabilized laser based on an optical frequency comb

abstract: Continuously and widely tunable lasers actively stabilized on a frequency reference are broadly employed in atomic, molecular and optical (AMO) physics. The frequency-stabilized optical frequency comb (OFC) provides a novel optical frequency reference with a broadband spectrum that meets the requirement of laser frequency stabilization. Therefore, we demonstrate a frequency-stabilized and precisely tunable laser system based on it. In this scheme, the laser frequency locked to the OFC is driven to jump over the ambiguity zones, which blocks the wide tuning of the locked laser, and tuned until the mode hopping happens with the always-activated feedback loop. Meanwhile, we compensate the gap of the frequency jump with a synchronized acoustic optical modulator to ensure the continuity. This scheme is applied to an external cavity diode laser (ECDL) and we achieve tuning at a rate of about 7 GHz/s with some readily available commercial electronics. Furthermore, we tune the frequency-stabilized laser only with the feedback of diode current and its average tuning speed can exceed 100 GHz/s. Due to the resource-efficient configuration and the simplicity of completion, this scheme can be referenced and find wide applications in AMO experiments.


title: Minimax-Regret Sample Selection in Randomized Experiments

abstract: Randomized controlled trials are often run in settings with many subpopulations that may have differential benefits from the treatment being evaluated. We consider the problem of sample selection, i.e., whom to enroll in a randomized trial, such as to optimize welfare in a heterogeneous population. We formalize this problem within the minimax-regret framework, and derive optimal sample-selection schemes under a variety of conditions. Using data from a COVID-19 vaccine trial, we also highlight how different objectives and decision rules can lead to meaningfully different guidance regarding optimal sample allocation.


title: A Comprehensive Survey of Federated Transfer Learning: Challenges, Methods and Applications

abstract: Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often involves multiple participants and requires the third party to aggregate global information to guide the update of the target participant. Therefore, many FL methods do not work well due to the training and test data of each participant may not be sampled from the same feature space and the same underlying distribution. Meanwhile, the differences in their local devices (system heterogeneity), the continuous influx of online data (incremental data), and labeled data scarcity may further influence the performance of these methods. To solve this problem, federated transfer learning (FTL), which integrates transfer learning (TL) into FL, has attracted the attention of numerous researchers. However, since FL enables a continuous share of knowledge among participants with each communication round while not allowing local data to be accessed by other participants, FTL faces many unique challenges that are not present in TL. In this survey, we focus on categorizing and reviewing the current progress on federated transfer learning, and outlining corresponding solutions and applications. Furthermore, the common setting of FTL scenarios, available datasets, and significant related research are summarized in this survey.


title: Wong-Zakai approximations and support theorems for SDEs under Lyapunov conditions

abstract: In this paper, we establish the Stroock-Varadhan type support theorems for stochastic differential equations (SDEs) under Lyapunov conditions, which significantly improve the existing results in the literature where the coefficients of the SDEs are required to be globally Lipschitz and of linear growth. Our conditions are very mild to include many important models, e.g. Threshold Ornstein-Ulenbeck process, Stochastic SIR model, Stochastic Lotka-Volterra systems, Stochastic Duffing-van der Pol oscillator model, which have polynomial the coefficients. To obtain the support theorem, we prove a new Wong-Zakai approximation problem, which is of independent interest.


title: Fusion of Gaussian Processes Predictions with Monte Carlo Sampling

abstract: In science and engineering, we often work with models designed for accurate prediction of variables of interest. Recognizing that these models are approximations of reality, it becomes desirable to apply multiple models to the same data and integrate their outcomes. In this paper, we operate within the Bayesian paradigm, relying on Gaussian processes as our models. These models generate predictive probability density functions (pdfs), and the objective is to integrate them systematically, employing both linear and log-linear pooling. We introduce novel approaches for log-linear pooling, determining input-dependent weights for the predictive pdfs of the Gaussian processes. The aggregation of the pdfs is realized through Monte Carlo sampling, drawing samples of weights from their posterior. The performance of these methods, as well as those based on linear pooling, is demonstrated using a synthetic dataset.


title: Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering

abstract: Knowledge Graph Question Answering (KGQA) methods seek to answer Natural Language questions using the relational information stored in Knowledge Graphs (KGs). With the recent advancements of Large Language Models (LLMs) and their remarkable reasoning abilities, there is a growing trend to leverage them for KGQA. However, existing methodologies have only focused on answering factual questions, e.g., "In which city was Silvio Berlusconi's first wife born?", leaving questions involving commonsense reasoning that real-world users may pose more often, e.g., "Do I need separate visas to see the Venus of Willendorf and attend the Olympics this summer?" unaddressed. In this work, we first observe that existing LLM-based methods for KGQA struggle with hallucination on such questions, especially on queries targeting long-tail entities (e.g., non-mainstream and recent entities), thus hindering their applicability in real-world applications especially since their reasoning processes are not easily verifiable. In response, we propose Right for Right Reasons (R3), a commonsense KGQA methodology that allows for a verifiable reasoning procedure by axiomatically surfacing intrinsic commonsense knowledge of LLMs and grounding every factual reasoning step on KG triples. Through experimental evaluations across three different tasks--question answering, claim verification, and preference matching--our findings showcase R3 as a superior approach, outperforming existing methodologies and notably reducing instances of hallucination and reasoning errors.


title: Planar two-region multi-partite maximally entangled states

abstract: In entanglement theory, there are different methods to consider one state being more entangled than another. The "maximally" entangled states in a multipartite system can be defined from an axiomatic perspective. According to different criteria for selection, there are many specific types of quantum maximally entangled states, such as absolutely maximally entangled state, planar maximally entangled state and so on. In this paper we propose a new type of maximally entangled states, the planar two-region multipartite maximally entangled state. The requirement condition of this maximally entangled state is weak than that of the absolutely maximally entangled state and different from that of the planar maximally entangled state. We show that there are the two-region four-partite maximally entangled states in 4-qubit and 7-qubit planar systems, although there is no absolutely maximally entangled state in these systems. It is proved that there are the planar two-region four-partite maximally entangled states in both even particle quantum systems and odd particle quantum systems. Additionally, based on some planar two-region four-partite maximally entangled states, the new planar two-region four-partite maximally entangled states are generated. We also provide some important examples of the planar two-region multi-partite maximally entangled states.


title: The incompatibility of quantum channels in general probabilistic theories

abstract: In quantum theory, there exist sets of operations that cannot be performed simultaneously. These sets of operations are referred to as incompatible. While this definition of incompatibility extends to general probabilistic theories, the dependency of the set of compatible sets on the definition of composite systems has not been thoroughly investigated. In the context of quantum channels, compatibility is defined using the tensor product of Hilbert spaces, employing the usual composite system. However, in the context of general probabilistic theories, composite systems are not uniquely determined, and the set of states can range from min tensor to max tensor, forming various convex sets. In this paper, in addition to quantum compatibility using the usual composite system, we introduce min-tensor-compatibility using the min-tensor on the composite system of effect spaces and investigate their relationship using noisy identity channels on qubits. As a result, we found that the set of min-tensor-compatible channel pairs is strictly broader than the set of quantum-compatible channel pairs. Furthermore, we introduce the concept of almost quantum compatible channel pairs from an operational perspective. This concept corresponds to cases where the correlation functions appearing in the verification of compatibility can be realized through a channel and local reinterpretation of effects. We demonstrate that the set of all almost quantum compatible channel pairs is strictly narrower than the set of all min-tensor-compatible channel pairs.


title: Star-forming and Quiescent Central Galaxies Cluster Similarly: Implications for the Galaxy-Halo Connection

abstract: We measure the clustering of low-redshift SDSS galaxies as a function of stellar mass ($10.0<\log(M_*/M_\odot)<11.5$) and specific star formation rate (sSFR) and compare the results to models of the galaxy--halo connection. We find that the auto-correlation functions of central galaxies exhibit little dependence on sSFR, with the well-known stronger clustering of quiescent galaxies mainly attributable to satellites. Because halo assembly history is known to affect distinct halo clustering, this result implies that there is little net correlation between halo assembly history and central galaxy sSFR. However, cross-correlations with satellites are stronger for quiescent centrals than star-forming centrals, consistent with quiescent centrals having more satellites in their haloes at fixed $M_*$, as found in SDSS group catalogues. We model the galaxy--halo connection in an $N$-body simulation by assigning sSFRs to central galaxies in three different ways. Two of the models depend on halo assembly history (being based on halo accretion rate or concentration), while the third is independent of halo assembly history (being based on peak halo circular velocity, $V_\text{peak}$, a proxy for halo mass). All three models replicate the observed auto-correlations of central galaxies, while only the $V_\text{peak}$ model reproduces the observed cross-correlations with satellites. This further suggests that the effects of halo assembly history may not be easily seen in auto-correlations of centrals and implies that a more complete understanding of central galaxy clustering may require more than auto-correlations of centrals alone. Additionally, the good agreement with the $V_\text{peak}$ model supports the idea that quiescent galaxies reside in more massive haloes than star-forming galaxies at fixed $M_*$.


title: Successful Transmission Probability and SIR Meta Distribution Analysis for Multi-Antenna Cache-Enabled Networks with Interference Nulling

abstract: This paper investigates a multi-antenna cache-enabled network with interference nulling (IN) employed at base stations. Two IN schemes, namely, the fixed IN scheme and the flexible IN scheme are considered to improve the received signal-to-interference ratio (SIR) at users. To thoroughly explore the effects of the caching parameter and the IN parameters on the network performance, we focus on the analysis of not only the successful transmission probability (STP) but the SIR meta distribution. For each IN scheme, the expression for the STP is derived and an approximated expression for the SIR meta distribution is also obtained by deriving the first and second moments of an upper bound of the link reliability and utilizing the beta distribution. With this analytical framework, we compare the performance of these two IN schemes and gain some useful system design guidelines from the perspectives of the STP and the SIR meta distribution by numerical simulations.


title: CR-LT-KGQA: A Knowledge Graph Question Answering Dataset Requiring Commonsense Reasoning and Long-Tail Knowledge

abstract: Knowledge graph question answering (KGQA) is a well-established field that seeks to provide factual answers to natural language (NL) questions by leveraging knowledge graphs (KGs). However, existing KGQA datasets suffer from two significant limitations: (1) no existing KGQA dataset requires commonsense reasoning to arrive at an answer and (2) existing KGQA datasets focus on popular entities for which large language models (LLMs) can directly answer without hallucinating and without leveraging the KG. In this work, we seek a novel KGQA dataset that supports commonsense reasoning and focuses on long-tail entities (e.g., non-mainstream and recent entities) where LLMs frequently hallucinate, and thus create the need for novel methodologies that leverage the KG for factual and attributable commonsense inference. We create a novel Commonsense Reasoning (CR) and Long-Tail (LT) KGQA dataset with two subtasks -- question answering and claim verification -- that address both limitations (1) and (2). We construct CR-LT-KGQA by building extensions to existing reasoning datasets StrategyQA and CREAK over Wikidata. While existing KGQA methods are not applicable due to their lack of commonsense inference support, baseline evaluation of LLMs on CR-LT KGQA demonstrate a high rate of hallucination. Thus, CR-LT KGQA poses significant challenges for hallucination-prone LLMs, hence paving the way for future commonsense KGQA research to provide accurate and factual answers for long-tail entities in the era of LLMs.


title: Entropy of cluster DT transformations and the finite-tame-wild trichotomy of acyclic quivers

abstract: The cluster algebra associated with an acyclic quiver has a special mutation loop $\tau$, called the cluster Donaldson--Thomas (DT) transformation, related to the Auslander--Reiten translation. In this paper, we characterize the finite-tame-wild trichotomy for acyclic quivers by the sign stability of $\tau$ introduced in [IK21] and its cluster stretch factor. As an application, we compute several kinds of entropies of $\tau$ and other mutation loops. In particular, we show that the algebraic and categorical entropies of $\tau$ are commonly given by the logarithm of the spectral radius of the Coxeter matrix associated with the quiver, and that any mutation loop of finite or tame acyclic quivers have zero algebraic entropy.


title: Phase space analysis of sign-shifting interacting dark energy models

abstract: The theory of non-gravitational interaction between a pressure-less dark matter (DM) and dark energy (DE) is a phenomenologically rich cosmological domain which has received magnificent attention in the community. In the present article we have considered some interacting scenarios with some novel features: the interaction functions do not depend on the external parameters of the universe, rather, they depend on the intrinsic nature of the dark components; the assumption of unidirectional flow of energy between DM and DE has been extended by allowing the possibility of bidirectional energy flow characterized by some sign shifting interaction functions; and the DE equation of state has been considered to be either constant or dynamical in nature. These altogether add new ingredients in this context, and, we performed the phase space analysis of each interacting scenario in order to understand their global behaviour. According to the existing records in the literature, this combined picture has not been reported elsewhere. From the analyses, we observed that the DE equation of state as well as the coupling parameter(s) of the interaction models can significantly affect the nature of the critical points. It has been found that within these proposed sign shifting interacting scenarios, it is possible to obtain stable late time attractors which may act as global attractors corresponding to an accelerating expansion of the universe. The overall outcomes of this study clearly highlight that the sign shifting interaction functions are quite appealing in the context of cosmological dynamics and they deserve further attention.


title: Unification of energy concepts in generalised phase space theories

abstract: We consider how to describe Hamiltonian mechanics in generalised probabilistic theories with the states represented as quasi-probability distributions. We give general operational definitions of energy-related concepts. We define generalised energy eigenstates as the purest stationary states. Planck's constant plays two different roles in the framework: the phase space volume taken up by a pure state and a dynamical factor. The Hamiltonian is a linear combination of generalised energy eigenstates. This allows for a generalised Liouville time-evolution equation that applies to quantum and classical Hamiltonian mechanics and more. The approach enables a unification of quantum and classical energy concepts and a route to discussing energy in a wider set of theories.


title: Noncentrosymmetric Nowotny Chimney Ladder Ferromagnet Cr4Ge7 with a High Curie Temperature of ~ 207 K

abstract: Noncentrosymmetric magnets usually host intriguing magnetic interactions inherent the crystal structure with broken inversion symmetry, which can give rise to rich magnetic behaviors. We report herein the high-pressure synthesis, crystal structure, magnetizations and magnetic structure of a so-called Nowotny chimney ladder compound Cr4Ge7. Our analysis on the powder neutron diffraction data revises the crystal structure as a noncentrosymmetric space group (P-4c2, No.116). It exhibits two magnetic orders within the temperature range of 2 - 400 K. The first order at ~ 207 K associated with a small magnetic moment of ~ 0.75 miuB is assigned to a commensurate ferromagnetic structure with a propagation vector k = (0, 0, 0). The weak itinerant ferromagnet nature should be caused by the complex Cr spin orders from different Wyckoff positions. The second order at ~ 18 K is assumed to arise from a competition between the Dzyaloshinskii-Moria and Heisenberg interactions. The results provide an excellent platform for study on intricate interactions between various magnetic exchanges as well as for the exploration of high temperature exotic magnetic properties which host potential applications in next-generation spintronics.


title: Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks

abstract: Recent years have witnessed the great success of graph pre-training for graph representation learning. With hundreds of graph pre-training tasks proposed, integrating knowledge acquired from multiple pre-training tasks has become a popular research topic. In this paper, we identify two important collaborative processes for this topic: (1) select: how to select an optimal task combination from a given task pool based on their compatibility, and (2) weigh: how to weigh the selected tasks based on their importance. While there currently has been a lot of work focused on weighing, comparatively little effort has been devoted to selecting. This paper proposes a novel instance-level framework for integrating multiple graph pre-training tasks, Weigh And Select (WAS), where the two collaborative processes, weighing and selecting, are combined by decoupled siamese networks. Specifically, it first adaptively learns an optimal combination of tasks for each instance from a given task pool, based on which a customized instance-level task weighing strategy is learned. Extensive experiments on 16 graph datasets across node-level and graph-level downstream tasks have demonstrated that by combining a few simple but classical tasks, WAS can achieve comparable performance to other leading counterparts. The code is available at https://github.com/TianyuFan0504/WAS.


title: Dynamical stability of new wormhole solutions via cold dark matter and solitonic quantum wave halos in $f(\mathcal{R},\mathcal{L}_m)$ gravity

abstract: This current analysis offers novel wormhole solutions in the background of newly developed extended $f(\mathcal{R},\mathcal{L}_m)$ gravity. We use an anisotropic matter source and a particular type of energy density demonstrating cold dark matter halo and quantum wave dark matter halo to calculate two different wormhole solutions. The properties of the exotic matter within the wormhole geometry and the matter contents via energy conditions are studied in detail, both analytically and graphically, by showing valid and invalid regions. The calculated shape functions of wormhole geometry satisfy the required conditions in both cases. Further, we investigate the stability of the shell around wormhole structures by considering black hole solutions in the framework of cold dark matter halo and quantum wave dark matter by assuming matter contents located at the shell follow the phantom-like equations of state. Then, for quintessence and phantom energy type equations of state, the choice of cold dark matter halo has maximum stability at lower equilibrium shell radii and declines as the radius rises. More petite wormhole throats have an unstable configuration for the dark energy matter content, while higher wormhole throat radius has the lowest stability. For the choice of quantum wave dark matter, the shell around the wormhole structure is unstable for both quintessence and phantom energy, while dark energy shows a stable configuration for smaller values of wormhole throat.


title: Energy fluctuations of a Brownian particle freely moving in a liquid

abstract: We study the statistical properties of the variation of the kinetic energy of a spherical Brownian particle that freely moves in an incompressible fluid at constant temperature. Based on the underdamped version of the generalized Langevin equation that includes the inertia of both the particle and the displaced fluid, we derive an analytical expression for the probability density function of such a kinetic energy variation during an arbitrary time interval, which exactly amounts to the energy exchanged with the fluid in absence of external forces. We also determine all the moments of this probability distribution, which can be fully expressed in terms of a function that is proportional to the velocity autocorrelation function of the particle. The derived expressions are verified by means of numerical simulations of the stochastic motion of a particle in a viscous liquid with hydrodynamic backflow for representative values of the time-scales of the system. Furthermore, we also investigate the effect of viscoelasticity on the statistics of the kinetic energy variation of the particle, which reveals the existence of three distinct regimes of the energy exchange process depending on the values of the viscoelastic parameters of the fluid.


title: Greedy selection of optimal location of sensors for uncertainty reduction in seismic moment tensor inversion

abstract: We address an optimal sensor placement problem through Bayesian experimental design for seismic full waveform inversion for the recovery of the associated moment tensor. The objective is that of optimally choosing the location of the sensors (stations) from which to collect the observed data. The Shannon expected information gain is used as the objective function to search for the optimal network of sensors. A closed form for such objective is available due to the linear structure of the forward problem, as well as the Gaussian modeling of the observational errors and prior distribution. The resulting problem being inherently combinatorial, a greedy algorithm is deployed to sequentially select the sensor locations that form the best network for learning the moment tensor. Numerical results are presented and analyzed under several instances of the problem, including: use of full three-dimensional velocity-models, cases in which the earthquake-source location is unknown, as well as moment tensor inversion under model misspecification


title: What Is Missing in Multilingual Visual Reasoning and How to Fix It

abstract: NLP models today strive for supporting multiple languages and modalities, improving accessibility for diverse users. In this paper, we evaluate their multilingual, multimodal capabilities by testing on a visual reasoning task. We observe that proprietary systems like GPT-4V obtain the best performance on this task now, but open models lag in comparison. Surprisingly, GPT-4V exhibits similar performance between English and other languages, indicating the potential for equitable system development across languages. Our analysis on model failures reveals three key aspects that make this task challenging: multilinguality, complex reasoning, and multimodality. To address these challenges, we propose three targeted interventions including a translate-test approach to tackle multilinguality, a visual programming approach to break down complex reasoning, and a novel method that leverages image captioning to address multimodality. Our interventions achieve the best open performance on this task in a zero-shot setting, boosting open model LLaVA by 13.4%, while also minorly improving GPT-4V's performance.


title: Constraining study of charged gravastars solutions in symmetric teleparallel gravity

abstract: This study explores the effect of charge on a special astronomical object known as a gravastar, which is viewed as an alternative to a black hole. Based on the conjecture put out by Mazur and Mottola in general relativity, the study primarily focuses on the consequences of $f(Q)$ gravity. The internal domain, the intermediate shell, and the external domain are the three separate sections that make up a gravastar. Using a particular $f(Q)$ gravity model that includes conformal Killing vectors to analyze these areas, we discover that the inner domain shows a repulsive force on the spherical shell since it is assumed that pressure is equivalent to negative energy density. The intermediate shell is made up of ultrarelativistic plasma and pressure, which is proportional to energy density and balances the repulsive force from the interior domain. For exterior region, we use two appraoches as first we calculate the vacuum exact solution and secondly considered as the Reissner-Nordstr\"om metric. Then, we match these spacetimes through junction condition and explore the stability constraints for both cases. Our results show that charged gravastar solutions with non-singular physical parameters including length, energy, entropy, and equation of state parameter are physically realistic.


title: \textit{Ab initio} calculations of photocurrent in solids based on Wannier function

abstract: We present a general \textit{ab initio} method based on Wannier function for simulating the photocurrent in solids. The method is widely applicable to charge/spin DC and AC photocurrent at any perturbation levels in both semiconductors and metals for both linearly and circularly polarized light. This is because the method is theoretically complete (within relaxation time approximation), that is to say, it includes all intra-band, inter-band and their cross terms. Specifically for the second-order DC photocurrent, it includes all of the following contributions - shift current, (magnetic) injection current, Berry curvature dipole, gyration current and Fermi surface ones, instead of only a part of them as in most previous \textit{ab initio} methods. It is also free from the degeneracy issue, i.e., applicable to arbitrary band structures with arbitrary numbers of degenerate bands. We apply the method to various semiconductors and metals, including GaAs, graphene-hBN heterostructure, monolayer WS$_{2}$, a 2D ferroelectric material - monolayer GeS, bilayer anti-ferromagnetic MnBi$_{2}$Te$_{4}$ and topological Weyl semimetal RhSi to simulate their charge and/or spin, DC and/or AC photocurrent. Our theoretical results are in good agreement with previous theoretical works. Our method provides a universal computational tool for reliable and accurate predictions of abundant weak-field photocurrent phenomena in disparate materials.


title: Region-Transformer: Self-Attention Region Based Class-Agnostic Point Cloud Segmentation

abstract: Point cloud segmentation, which helps us understand the environment of specific structures and objects, can be performed in class-specific and class-agnostic ways. We propose a novel region-based transformer model called Region-Transformer for performing class-agnostic point cloud segmentation. The model utilizes a region-growth approach and self-attention mechanism to iteratively expand or contract a region by adding or removing points. It is trained on simulated point clouds with instance labels only, avoiding semantic labels. Attention-based networks have succeeded in many previous methods of performing point cloud segmentation. However, a region-growth approach with attention-based networks has yet to be used to explore its performance gain. To our knowledge, we are the first to use a self-attention mechanism in a region-growth approach. With the introduction of self-attention to region-growth that can utilize local contextual information of neighborhood points, our experiments demonstrate that the Region-Transformer model outperforms previous class-agnostic and class-specific methods on indoor datasets regarding clustering metrics. The model generalizes well to large-scale scenes. Key advantages include capturing long-range dependencies through self-attention, avoiding the need for semantic labels during training, and applicability to a variable number of objects. The Region-Transformer model represents a promising approach for flexible point cloud segmentation with applications in robotics, digital twinning, and autonomous vehicles.


title: The truncated moment problem on reducible cubic curves I: Parabolic and Circular type relations

abstract: In this article we study the bivariate truncated moment problem (TMP) of degree $2k$ on reducible cubic curves. First we show that every such TMP is equivalent after applying an affine linear transformation to one of 8 canonical forms of the curve. The case of the union of three parallel lines was solved in 2022 by the second author, while the degree 6 cases in 2017 by the first author. Second we characterize in terms of concrete numerical conditions the existence of the solution to the TMP on two of the remaining cases concretely, i.e., a union of a line and a circle $y(ay+x^2+y^2)=0, a\in \mathbb{R}\setminus \{0\}$, and a union of a line and a parabola $y(x-y^2)=0$. In both cases we also determine the number of atoms in a minimal representing measure.


title: Observation and Modeling of the circular polarization of the Cr I magnetic field induced transition at 533.03 nm

abstract: We study the circular polarization of the magnetic field induced transition (MIT) between the $3d^5(^6S)4d\ ^7D_2$ and $3d^5(^6S)4p\ ^7P_4^\circ$ states of \ion{Cr}{1} at 533.03~nm (wavelength in air). The fractional circular polarization $V/I$ of this spectral line resulting from the solution of the radiation transfer problem in a sunspot model permeated by a homogeneous magnetic field of 3~kG shows amplitudes of about $2\%$. Spectro-polarimetric observations of two sunspots were obtained with the Zurich Imaging Polarimeter-3 at the Istituto ricerche solari Aldo e Cele Dacc\`o (IRSOL) observatory observatory in Locarno, Switzerland. The observed $V/I$ profiles show approximately anti-symmetrical shapes with an amplitude of around $0.1\%$ and $0.2\%$ for the two sunspots. The center of this profile coincides with the wavelengths predicted for the above-mentioned MIT. We apply an inversion code to the spectro-polarimetric data of the \ion{Cr}{1} permitted lines at 532.91 and 532.98~nm, as well as to the MIT line at 533.03~nm, to infer a stratification of the emitting atmosphere. We compare the $V/I$ profiles synthesized in the inferred atmosphere models with the observations, showing that the observed signal likely corresponds to the MIT line.


title: Barrier Functions Inspired Reward Shaping for Reinforcement Learning

abstract: Reinforcement Learning (RL) has progressed from simple control tasks to complex real-world challenges with large state spaces. While RL excels in these tasks, training time remains a limitation. Reward shaping is a popular solution, but existing methods often rely on value functions, which face scalability issues. This paper presents a novel safety-oriented reward-shaping framework inspired by barrier functions, offering simplicity and ease of implementation across various environments and tasks. To evaluate the effectiveness of the proposed reward formulations, we conduct simulation experiments on CartPole, Ant, and Humanoid environments, along with real-world deployment on the Unitree Go1 quadruped robot. Our results demonstrate that our method leads to 1.4-2.8 times faster convergence and as low as 50-60% actuation effort compared to the vanilla reward. In a sim-to-real experiment with the Go1 robot, we demonstrated better control and dynamics of the bot with our reward framework.


title: OVEL: Large Language Model as Memory Manager for Online Video Entity Linking

abstract: In recent years, multi-modal entity linking (MEL) has garnered increasing attention in the research community due to its significance in numerous multi-modal applications. Video, as a popular means of information transmission, has become prevalent in people's daily lives. However, most existing MEL methods primarily focus on linking textual and visual mentions or offline videos's mentions to entities in multi-modal knowledge bases, with limited efforts devoted to linking mentions within online video content. In this paper, we propose a task called Online Video Entity Linking OVEL, aiming to establish connections between mentions in online videos and a knowledge base with high accuracy and timeliness. To facilitate the research works of OVEL, we specifically concentrate on live delivery scenarios and construct a live delivery entity linking dataset called LIVE. Besides, we propose an evaluation metric that considers timelessness, robustness, and accuracy. Furthermore, to effectively handle OVEL task, we leverage a memory block managed by a Large Language Model and retrieve entity candidates from the knowledge base to augment LLM performance on memory management. The experimental results prove the effectiveness and efficiency of our method.


title: LUM-ViT: Learnable Under-sampling Mask Vision Transformer for Bandwidth Limited Optical Signal Acquisition

abstract: Bandwidth constraints during signal acquisition frequently impede real-time detection applications. Hyperspectral data is a notable example, whose vast volume compromises real-time hyperspectral detection. To tackle this hurdle, we introduce a novel approach leveraging pre-acquisition modulation to reduce the acquisition volume. This modulation process is governed by a deep learning model, utilizing prior information. Central to our approach is LUM-ViT, a Vision Transformer variant. Uniquely, LUM-ViT incorporates a learnable under-sampling mask tailored for pre-acquisition modulation. To further optimize for optical calculations, we propose a kernel-level weight binarization technique and a three-stage fine-tuning strategy. Our evaluations reveal that, by sampling a mere 10% of the original image pixels, LUM-ViT maintains the accuracy loss within 1.8% on the ImageNet classification task. The method sustains near-original accuracy when implemented on real-world optical hardware, demonstrating its practicality. Code will be available at https://github.com/MaxLLF/LUM-ViT.


title: Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older Adults

abstract: Music-based reminiscence has the potential to positively impact the psychological well-being of older adults. However, the aging process and physiological changes, such as memory decline and limited verbal communication, may impede the ability of older adults to recall their memories and life experiences. Given the advanced capabilities of generative artificial intelligence (AI) systems, such as generated conversations and images, and their potential to facilitate the reminiscing process, this study aims to explore the design of generative AI to support music-based reminiscence in older adults. This study follows a user-centered design approach incorporating various stages, including detailed interviews with two social workers and two design workshops (involving ten older adults). Our work contributes to an in-depth understanding of older adults' attitudes toward utilizing generative AI for supporting music-based reminiscence and identifies concrete design considerations for the future design of generative AI to enhance the reminiscence experience of older adults.


title: Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapes

abstract: Neural implicit representation of geometric shapes has witnessed considerable advancements in recent years. However, common distance field based implicit representations, specifically signed distance field (SDF) for watertight shapes or unsigned distance field (UDF) for arbitrary shapes, routinely suffer from degradation of reconstruction accuracy when converting to explicit surface points and meshes. In this paper, we introduce a novel neural implicit representation based on unsigned orthogonal distance fields (UODFs). In UODFs, the minimal unsigned distance from any spatial point to the shape surface is defined solely in one orthogonal direction, contrasting with the multi-directional determination made by SDF and UDF. Consequently, every point in the 3D UODFs can directly access its closest surface points along three orthogonal directions. This distinctive feature leverages the accurate reconstruction of surface points without interpolation errors. We verify the effectiveness of UODFs through a range of reconstruction examples, extending from simple watertight or non-watertight shapes to complex shapes that include hollows, internal or assembling structures.


title: Phonon-pair-driven Ferroelectricity Causes Costless Domain-walls and Bulk-boundary Duality

abstract: Ferroelectric domain walls, recognized as distinct from the bulk in terms of symmetry, structure, and electronic properties, host exotic phenomena including conductive walls, ferroelectric vortices, novel topologies, and negative capacitance. Contrary to conventional understanding, our study reveals that the structure of domain walls in HfO2 closely resembles its bulk. First, our first-principles simulations unveil that the robust ferroelectricity is supported by bosonic pairing of all the anionic phonons in bulk HfO2. Strikingly, the paired phonons strongly bond with each other and successfully reach the center of the domain wall without losing their integrity and produce bulk-like domain walls. We then confirmed preservation of the bulk phonon displacements and consequently full revival of the bulk structure at domain walls via aberration-corrected STEM. The newly found duality between the bulk and the domain wall sheds light on previously enigmatic properties such as zero-energy domain walls, perfect Ising-type polar ordering, and exceptionally robust ferroelectricity at the sub-nm scales. The phonon-pairing discovered here is robust against physical boundaries such as domain walls and enables zero momentum and zero-energy cost local ferroelectric switching. This phenomenon demonstrated in Si-compatible ferroelectrics provides a novel technological platform where data storage on domain walls is as feasible as that within the domains, thereby expanding the potential for high-density data storage and advanced ferroelectric applications.


title: An analytical approximation of the evolution of the primordial curvature perturbation in the ultraslow-roll inflation

abstract: Cosmic inflation can enter an ultraslow-roll (USR) stage, if there is a plateau on the inflaton potential. During this stage, the primordial curvature perturbation ${\mathcal R}_k$ and its power spectrum ${\mathcal P}_{\mathcal R}$ can be remarkably enhanced on small scales. In this work, an analytical approximation is provided to systematically study the evolution of ${\mathcal R}_k$ in the USR inflation. We first discuss the asymptotic solutions of the moduli and arguments of ${\mathcal R}_k$ and its time derivative ${\mathcal R}_{k,N}$ on the sub- and super-horizon scales separately and find that all these solutions have simple exponential forms. Then, ${\mathcal R}_k$ on five typical scales are investigated in order. Our analytical approximation predicts that ${\mathcal R}_k$ first revolves around the origin in the complex plane, but if it crosses the horizon around the start of the USR stage, there appears a subsequent linear evolution towards or away from the origin. This behavior naturally explains the shape of ${\mathcal P}_{\mathcal R}$ from the sharp dip to the peak and matches the numerical results perfectly. Moreover, the minimum of ${\mathcal P}_{\mathcal R}$ is exactly proved to be nonvanishing. Our analytical approximation will help the model building in primordial black hole and gravitational wave physics.


title: Asyn2F: An Asynchronous Federated Learning Framework with Bidirectional Model Aggregation

abstract: In federated learning, the models can be trained synchronously or asynchronously. Many research works have focused on developing an aggregation method for the server to aggregate multiple local models into the global model with improved performance. They ignore the heterogeneity of the training workers, which causes the delay in the training of the local models, leading to the obsolete information issue. In this paper, we design and develop Asyn2F, an Asynchronous Federated learning Framework with bidirectional model aggregation. By bidirectional model aggregation, Asyn2F, on one hand, allows the server to asynchronously aggregate multiple local models and results in a new global model. On the other hand, it allows the training workers to aggregate the new version of the global model into the local model, which is being trained even in the middle of a training epoch. We develop Asyn2F considering the practical implementation requirements such as using cloud services for model storage and message queuing protocols for communications. Extensive experiments with different datasets show that the models trained by Asyn2F achieve higher performance compared to the state-of-the-art techniques. The experiments also demonstrate the effectiveness, practicality, and scalability of Asyn2F, making it ready for deployment in real scenarios.


title: A Simple-but-effective Baseline for Training-free Class-Agnostic Counting

abstract: Class-Agnostic Counting (CAC) seeks to accurately count objects in a given image with only a few reference examples. While previous methods achieving this relied on additional training, recent efforts have shown that it's possible to accomplish this without training by utilizing pre-existing foundation models, particularly the Segment Anything Model (SAM), for counting via instance-level segmentation. Although promising, current training-free methods still lag behind their training-based counterparts in terms of performance. In this research, we present a straightforward training-free solution that effectively bridges this performance gap, serving as a strong baseline. The primary contribution of our work lies in the discovery of four key technologies that can enhance performance. Specifically, we suggest employing a superpixel algorithm to generate more precise initial point prompts, utilizing an image encoder with richer semantic knowledge to replace the SAM encoder for representing candidate objects, and adopting a multiscale mechanism and a transductive prototype scheme to update the representation of reference examples. By combining these four technologies, our approach achieves significant improvements over existing training-free methods and delivers performance on par with training-based ones.


title: Spectrum Broadcast Structures from von Neumann type interaction Hamiltonians

abstract: In this paper, we contribute to the mathematical foundations of the recently established theory of Spectrum Broadcast Structures (SBS). These are multipartite quantum states, encoding an operational notion of objectivity and exhibiting a more advanced form of decoherence. We study SBS in the case of a central system interacting with N environments via the von Neumann-type measurement interactions, ubiquitous in the theory of open quantum systems. We state and prove a novel sufficient condition for SBS to arise dynamically for finite-dimensional systems. The condition is based on the Gram-Schmidt orthogonalization rather than on the Knill-Barnum error estimation used before.


title: The Implicit Bias of Heterogeneity towards Invariance and Causality

abstract: It is observed empirically that the large language models (LLM), trained with a variant of regression loss using numerous corpus from the Internet, can unveil causal associations to some extent. This is contrary to the traditional wisdom that ``association is not causation'' and the paradigm of traditional causal inference in which prior causal knowledge should be carefully incorporated into the design of methods. It is a mystery why causality, in a higher layer of understanding, can emerge from the regression task that pursues associations. In this paper, we claim the emergence of causality from association-oriented training can be attributed to the coupling effects from the heterogeneity of the source data, stochasticity of training algorithms, and over-parameterization of the learning models. We illustrate such an intuition using a simple but insightful model that learns invariance, a quasi-causality, using regression loss. To be specific, we consider multi-environment low-rank matrix sensing problems where the unknown r-rank ground-truth d*d matrices diverge across the environments but contain a lower-rank invariant, causal part. In this case, running pooled gradient descent will result in biased solutions that only learn associations in general. We show that running large-batch Stochastic Gradient Descent, whose each batch being linear measurement samples randomly selected from a certain environment, can successfully drive the solution towards the invariant, causal solution under certain conditions. This step is related to the relatively strong heterogeneity of the environments, the large step size and noises in the optimization algorithm, and the over-parameterization of the model. In summary, we unveil another implicit bias that is a result of the symbiosis between the heterogeneity of data and modern algorithms, which is, to the best of our knowledge, first in the literature.


title: Predicting the Unpredictable under Subjective Expected Utility

abstract: We consider a decision maker who is unaware of objects to be sampled and thus cannot form beliefs about the occurrence of particular objects. Ex ante she can form beliefs about the occurrence of novelty and the frequencies of yet to be known objects. Conditional on any sampled objects, she can also form beliefs about the next object being novel or being one of the previously sampled objects. We characterize behaviorally such beliefs under subjective expected utility. In doing so, we relate "reverse" Bayesianism, a central property in the literature on decision making under growing awareness, with exchangeable random partitions, the central property in the literature on the discovery of species problem and mutations in statistics, combinatorial probability theory, and population genetics. Partition exchangeable beliefs do not necessarily satisfy "reverse" Bayesianism. Yet, the most prominent models of exchangeable random partitions, the model by De Morgan (1838), the one parameter model of Ewens (1972), and the two parameter model of Pitman (1995) and Zabell (1997), do satisfy "reverse" Bayesianism.


title: MovieLLM: Enhancing Long Video Understanding with AI-Generated Movies

abstract: Development of multimodal models has marked a significant step forward in how machines understand videos. These models have shown promise in analyzing short video clips. However, when it comes to longer formats like movies, they often fall short. The main hurdles are the lack of high-quality, diverse video data and the intensive work required to collect or annotate such data. In face of these challenges, we propose MovieLLM, a novel framework designed to synthesize consistent and high-quality video data for instruction tuning. The pipeline is carefully designed to control the style of videos by improving textual inversion technique with powerful text generation capability of GPT-4. As the first framework to do such thing, our approach stands out for its flexibility and scalability, empowering users to create customized movies with only one description. This makes it a superior alternative to traditional data collection methods. Our extensive experiments validate that the data produced by MovieLLM significantly improves the performance of multimodal models in understanding complex video narratives, overcoming the limitations of existing datasets regarding scarcity and bias.


title: Collective Certified Robustness against Graph Injection Attacks

abstract: We investigate certified robustness for GNNs under graph injection attacks. Existing research only provides sample-wise certificates by verifying each node independently, leading to very limited certifying performance. In this paper, we present the first collective certificate, which certifies a set of target nodes simultaneously. To achieve it, we formulate the problem as a binary integer quadratic constrained linear programming (BQCLP). We further develop a customized linearization technique that allows us to relax the BQCLP into linear programming (LP) that can be efficiently solved. Through comprehensive experiments, we demonstrate that our collective certification scheme significantly improves certification performance with minimal computational overhead. For instance, by solving the LP within 1 minute on the Citeseer dataset, we achieve a significant increase in the certified ratio from 0.0% to 81.2% when the injected node number is 5% of the graph size. Our step marks a crucial step towards making provable defense more practical.


title: Maximal $L_1$-regularity for the compressible Navier-Stokes equations

abstract: In this paper, we consider the compressible Stokes equations with non-slip boundary conditions in the half space $\mathbb{R}^N_{+}$, which is a linearized system of the Navier-Stokes equations describing compressible viscous fluid motion. We prove the generation of a continous analytic semigroup associated with this compressible Stokes system with non-slip boundary conditions in the half space $\mathbb{R}^N_{+}$ and its $L_1$ in time maximal regularity. We choose the Besov space $\mathcal{H}^s_{q,r} = B^{s+1}_{q,r}(\mathbb{R}^N_{+})\times B^s_{q,r}(\mathbb{R}^N_{+})^N$ as an underlying space for the fluid domain, where $1 < q < \infty$, $1\leq r < \infty$, and $-1+1/q < s < 1/q$. Then, we prove the generation of a continuous analytic semigroup $\{T(t)\}_{t\geq 0}$ on $\mathcal{H}^s_{q,r}$. Moreover, $\{T(t)\}_{t\geq 0}$ admits the $L_1$ in time maximal regularity on $\mathcal{H}^s_{q,1}(\mathbb{R}^N_{+})$. Namely, we have $$\int_0^\infty e^{-\gamma t} \|T(t)(\rho_0, \mathbf{u}_0)\|_{B^{s+1}_{q,1}(\mathbb{R}^N_{+})\times B^{s+2}_{q,1}(\mathbb{R}^N_{+})}\,d t \leq C\|(\rho_0, \mathbf{u}_0)\|_{\mathcal{H}^s_{q,1}(\mathbb{R}^N_{+})}$$ for any $(\rho_0, \mathbf{u}_0) \in \mathcal{H}^s_{q,1}(\mathbb{R}^N_{+})$. Our approach is to prove the existence of the resolvent in $\mathcal{H}^s_{q,1}$ and some new estimates for the resolvent by using $B^{s+1}_{q,1}(\mathbb{R}^N_{+}) \times B^{s\pm\sigma}_{q,1}(\mathbb{R}^N_{+})$ norms for some small $\sigma > 0$ satisfying the condition $-1+1/q < s-\sigma < s < s+\sigma < 1/q$.


title: CRPWarner: Warning the Risk of Contract-related Rug Pull in DeFi Smart Contracts

abstract: In recent years, Decentralized Finance (DeFi) grows rapidly due to the development of blockchain technology and smart contracts. As of March 2023, the estimated global cryptocurrency market cap has reached approximately $949 billion. However, security incidents continue to plague the DeFi ecosystem, and one of the most notorious examples is the ``Rug Pull" scam. This type of cryptocurrency scam occurs when the developer of a particular token project intentionally abandons the project and disappears with investors' funds. Despite it only emerging in recent years, Rug Pull events have already caused significant financial losses. In this work, we manually collected and analyzed 103 real-world rug pull events, categorizing them based on their scam methods. Two primary categories were identified: Contract-related Rug Pull (through malicious functions in smart contracts) and Transaction-related Rug Pull (through cryptocurrency trading without utilizing malicious functions). Based on the analysis of rug pull events, we propose CRPWarner (short for Contract-related Rug Pull Risk Warner) to identify malicious functions in smart contracts and issue warnings regarding potential rug pulls. We evaluated CRPWarner on 69 open-source smart contracts related to rug pull events and achieved a 91.8% precision, 85.9% recall and 88.7% F1-score. Additionally, when evaluating CRPWarner on 13,484 real token contracts on Ethereum, it successfully detected 4168 smart contracts with malicious functions, including zero-day examples. The precision of large-scale experiment reach 84.9%.


title: Introduction to Algogens

abstract: This book introduces the concept of Algogens, a promising integration of generative AI with traditional algorithms aimed at improving problem-solving techniques across various fields. It provides an accessible overview of how Algogens combine AI's innovative potential with algorithms' reliability to tackle complex challenges more effectively than either could alone. The text explores the basics of Algogens, their development, applications, and advantages, such as better adaptability and efficiency. Through examples and case studies, readers will learn about Algogens' practical uses today and their potential for future cybersecurity, healthcare, and environmental science innovation. Acknowledging new technologies' challenges and ethical considerations, the book offers a balanced look at the prospects and obstacles facing Algogens. It invites a broad audience, including experts and newcomers, to engage with the topic and consider Algogens' role in advancing our problem-solving capabilities. This work is presented as a starting point for anyone interested in the intersection of AI and algorithms, encouraging further exploration and discussion on this emerging field. It aims to spark curiosity and contribute to the ongoing conversation about how technology can evolve to meet the complex demands of the AI era.


title: Logit Standardization in Knowledge Distillation

abstract: Knowledge distillation involves transferring soft labels from a teacher to a student using a shared temperature-based softmax function. However, the assumption of a shared temperature between teacher and student implies a mandatory exact match between their logits in terms of logit range and variance. This side-effect limits the performance of student, considering the capacity discrepancy between them and the finding that the innate logit relations of teacher are sufficient for student to learn. To address this issue, we propose setting the temperature as the weighted standard deviation of logit and performing a plug-and-play Z-score pre-process of logit standardization before applying softmax and Kullback-Leibler divergence. Our pre-process enables student to focus on essential logit relations from teacher rather than requiring a magnitude match, and can improve the performance of existing logit-based distillation methods. We also show a typical case where the conventional setting of sharing temperature between teacher and student cannot reliably yield the authentic distillation evaluation; nonetheless, this challenge is successfully alleviated by our Z-score. We extensively evaluate our method for various student and teacher models on CIFAR-100 and ImageNet, showing its significant superiority. The vanilla knowledge distillation powered by our pre-process can achieve favorable performance against state-of-the-art methods, and other distillation variants can obtain considerable gain with the assistance of our pre-process.


title: Localization matters too: How localization error affects UAV flight

abstract: The maximum safe flight speed of a Unmanned Aerial Vehicle (UAV) is an important indicator for measuring its efficiency in completing various tasks. This indicator is influenced by numerous parameters such as UAV localization error, perception range, and system latency. However, in terms of localization errors, although there have been many studies dedicated to improving the localization capability of UAVs, there is a lack of quantitative research on their impact on speed. In this work, we model the relationship between various parameters of the UAV and its maximum flight speed. We consider a scenario similar to navigating through dense forests, where the UAV needs to quickly avoid obstacles directly ahead and swiftly reorient after avoidance. Based on this scenario, we studied how parameters such as localization error affect the maximum safe speed during UAV flight, as well as the coupling relationships between these parameters. Furthermore, we validated our model in a simulation environment, and the results showed that the predicted maximum safe speed had an error of less than 20% compared to the test speed. In high-density situations, localization error has a significant impact on the UAV's maximum safe flight speed. This model can help designers utilize more suitable software and hardware to construct a UAV system.


title: Kubernetes in Action: Exploring the Performance of Kubernetes Distributions in the Cloud

abstract: Kubernetes has emerged as a leading open-source platform for container orchestration, allowing organizations to efficiently manage and deploy containerized applications at scale. This paper investigates the performance of four Kubernetes distributions, namely Kubeadm, K3s, MicroK8s, and K0s when running OpenFaaS as a containerized service on a cluster of computing nodes on CloudLab. For this purpose, experiments are conducted to examine the performance of two virtualization modes, namely HVM and PV, supported by Xen as the underlying hypervisor. Moreover, two container runtimes that are integrated with Kubernetes, namely Docker, and Containerd, are examined to assess their performance on both disk-intensive and CPU-intensive workloads. After determining the appropriate underlying Xen mode and container runtime, the Kubernetes distributions are set up and their performance is measured using various metrics, such as request rate, CPU utilization, and scaling behavior.


title: On Diffusion Process in SE(3)-invariant Space

abstract: Sampling viable 3D structures (e.g., molecules and point clouds) with SE(3)-invariance using diffusion-based models proved promising in a variety of real-world applications, wherein SE(3)-invariant properties can be naturally characterized by the inter-point distance manifold. However, due to the non-trivial geometry, we still lack a comprehensive understanding of the diffusion mechanism within such SE(3)-invariant space. This study addresses this gap by mathematically delineating the diffusion mechanism under SE(3)-invariance, via zooming into the interaction behavior between coordinates and the inter-point distance manifold through the lens of differential geometry. Upon this analysis, we propose accurate and projection-free diffusion SDE and ODE accordingly. Such formulations enable enhancing the performance and the speed of generation pathways; meanwhile offering valuable insights into other systems incorporating SE(3)-invariance.


title: Image2Sentence based Asymmetrical Zero-shot Composed Image Retrieval

abstract: The task of composed image retrieval (CIR) aims to retrieve images based on the query image and the text describing the users' intent. Existing methods have made great progress with the advanced large vision-language (VL) model in CIR task, however, they generally suffer from two main issues: lack of labeled triplets for model training and difficulty of deployment on resource-restricted environments when deploying the large vision-language model. To tackle the above problems, we propose Image2Sentence based Asymmetric zero-shot composed image retrieval (ISA), which takes advantage of the VL model and only relies on unlabeled images for composition learning. In the framework, we propose a new adaptive token learner that maps an image to a sentence in the word embedding space of VL model. The sentence adaptively captures discriminative visual information and is further integrated with the text modifier. An asymmetric structure is devised for flexible deployment, in which the lightweight model is adopted for the query side while the large VL model is deployed on the gallery side. The global contrastive distillation and the local alignment regularization are adopted for the alignment between the light model and the VL model for CIR task. Our experiments demonstrate that the proposed ISA could better cope with the real retrieval scenarios and further improve retrieval accuracy and efficiency.


title: Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledge

abstract: Large language models (LLMs) memorize a vast amount of factual knowledge, exhibiting strong performance across diverse tasks and domains. However, it has been observed that the performance diminishes when dealing with less-popular or low-frequency concepts and entities, for example in domain specific applications. The two prominent approaches to enhance the performance of LLMs on low-frequent topics are: Retrieval Augmented Generation (RAG) and fine-tuning (FT) over synthetic data. This paper explores and evaluates the impact of RAG and FT on customizing LLMs in handling low-frequency entities on question answering task. Our findings indicate that FT significantly boosts the performance across entities of varying popularity, especially in the most and least popular groups, while RAG surpasses other methods. Additionally, the success of both RAG and FT approaches is amplified by advancements in retrieval and data augmentation techniques. We release our data and code at https://github.com/informagi/RAGvsFT.