title: Wettability-dependent dissolution dynamics of oxygen bubbles on Ti64 substrates

abstract: In this study, the dissolution of a single oxygen bubble on a solid surface, here Titianium alloy Ti64, in ultrapure water with different oxygen undersaturation levels is investigated. For that purpose, a combination of shadowgraph technique and planar laser-induced fluorescence is used to measure simultaneously the changes in bubble geometry and in the dissolved oxygen concentration around the bubble. Two different wettabilities of the Ti64 surface are adjusted by using plasma-enhanced chemical vapour deposition. The dissolution process on the solid surface involves two distinct phases, namely bouncing of the oxygen bubble at the Ti64 surface and the subsequent dissolution of the bubble, primarily by diffusion. By investigating the features of oxygen bubbles bouncing, it was found that the boundary layer of dissolved oxygen surrounding the bubble surface is redistributed by the vortices emerging during bouncing. This establishes the initial conditions for the subsequent second dissolution phase of the oxygen bubbles on the Ti64 surfaces. In this phase, the mass transfer of O2 proceeds non-homogenously across the bubble surface, leading to an oxygen accumulation close to the Ti64 surface. We further show that the main factor influencing the differences in the dynamics of O2 bubble dissolution is the variation in the surface area of the bubbles available for mass transfer, which is determined by the substrate wettability. As a result, dissolution proceeds faster at the hydrophilic Ti64 surface due to the smaller contact angle, which provokes a larger surface area.


title: Multimodal Emotion Recognition by Fusing Video Semantic in MOOC Learning Scenarios

abstract: In the Massive Open Online Courses (MOOC) learning scenario, the semantic information of instructional videos has a crucial impact on learners' emotional state. Learners mainly acquire knowledge by watching instructional videos, and the semantic information in the videos directly affects learners' emotional states. However, few studies have paid attention to the potential influence of the semantic information of instructional videos on learners' emotional states. To deeply explore the impact of video semantic information on learners' emotions, this paper innovatively proposes a multimodal emotion recognition method by fusing video semantic information and physiological signals. We generate video descriptions through a pre-trained large language model (LLM) to obtain high-level semantic information about instructional videos. Using the cross-attention mechanism for modal interaction, the semantic information is fused with the eye movement and PhotoPlethysmoGraphy (PPG) signals to obtain the features containing the critical information of the three modes. The accurate recognition of learners' emotional states is realized through the emotion classifier. The experimental results show that our method has significantly improved emotion recognition performance, providing a new perspective and efficient method for emotion recognition research in MOOC learning scenarios. The method proposed in this paper not only contributes to a deeper understanding of the impact of instructional videos on learners' emotional states but also provides a beneficial reference for future research on emotion recognition in MOOC learning scenarios.


title: Hook length biases in ordinary and $t$-regular partitions

abstract: In this article, we study hook lengths of ordinary partitions and $t$-regular partitions. We establish hook length biases for the ordinary partitions and motivated by them we find a few interesting hook length biases in $2$-regular partitions. For a positive integer $k$, let $p_{(k)}(n)$ denote the number of hooks of length $k$ in all the partitions of $n$. We prove that $p_{(k)}(n)\geq p_{(k+1)}(n)$ for all $n\geq0$ and $n\ne k+1$; and $p_{(k)}(k+1)- p_{(k+1)}(k+1)=-1$ for $k\geq 2$. For integers $t\geq2$ and $k\geq1$, let $b_{t,k}(n)$ denote the number of hooks of length $k$ in all the $t$-regular partitions of $n$. We find generating functions of $b_{t,k}(n)$ for certain values of $t$ and $k$. Exploring hook length biases for $b_{t,k}(n)$, we observe that in certain cases biases are opposite to the biases for ordinary partitions. We prove that $b_{2,2}(n)\geq b_{2,1}(n)$ for all $n>4$, whereas $b_{2,2}(n)\geq b_{2,3}(n)$ for all $n\geq 0$. We also propose some conjectures on biases among $b_{t,k}(n)$.


title: Extremal triangle-free graphs with chromatic number at least four

abstract: Let $G$ be an $n$-vertex triangle-free graph. The celebrated Mantel's theorem showed that $e(G)\leq \lfloor\frac{n^2}{4}\rfloor$. In 1962, Erd\H{o}s (together with Gallai), and independently Andr\'{a}sfai, proved that if $G$ is non-bipartite then $e(G)\leq \lfloor\frac{(n-1)^2}{4}\rfloor+1$. In this paper, we extend this result and show that if $G$ has chromatic number at least four and $n\geq 150$, then $e(G)\leq \lfloor\frac{(n-3)^2}{4}\rfloor+5$. The blow-up of Gr\"{o}tzsch graph shows that this bound is best possible.


title: Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognition

abstract: Skeleton-based zero-shot action recognition aims to recognize unknown human actions based on the learned priors of the known skeleton-based actions and a semantic descriptor space shared by both known and unknown categories. However, previous works focus on establishing the bridges between the known skeleton representation space and semantic descriptions space at the coarse-grained level for recognizing unknown action categories, ignoring the fine-grained alignment of these two spaces, resulting in suboptimal performance in distinguishing high-similarity action categories. To address these challenges, we propose a novel method via Side information and dual-prompts learning for skeleton-based zero-shot action recognition (STAR) at the fine-grained level. Specifically, 1) we decompose the skeleton into several parts based on its topology structure and introduce the side information concerning multi-part descriptions of human body movements for alignment between the skeleton and the semantic space at the fine-grained level; 2) we design the visual-attribute and semantic-part prompts to improve the intra-class compactness within the skeleton space and inter-class separability within the semantic space, respectively, to distinguish the high-similarity actions. Extensive experiments show that our method achieves state-of-the-art performance in ZSL and GZSL settings on NTU RGB+D, NTU RGB+D 120, and PKU-MMD datasets.


title: Approximation of non-linear SPDEs with additive noise via weighted interacting particles systems: the stochastic McKean-Vlasov equation

abstract: This paper is devoted to the problem of approximating non-linear Stochastic Partial Differential Equations (SPDEs) via interacting particle systems. In particular, we consider the Stochastic McKean-Vlasov equation, which is the McKean-Vlasov (MKV) PDE, perturbed by additive trace class noise. As is well-known, the MKV PDE can be obtained as mean field limit of the empirical measure of a stochastic system of interacting particles, where particles are subject to independent sources of noise. There is now a natural question, which is the one we consider and answer in this paper: can we obtain the SMKV equation, i.e. additive perturbations of the MKV PDE, as limit of interacting particle systems? It turns out that, in order to obtain the SMKV equation, one needs to study weighted empirical measures of particles, where the particles evolve according to a system of SDEs with independent noise, while the weights are time evolving and subject to common noise. The work of this manuscript therefore complements and contributes to various streams of literature, in particular: i) much attention in the community is currently devoted to obtaining SPDEs as scaling limits of appropriate dynamics; this paper contributes to a complementary stream, which is devoted to obtaining representations of SPDE through limits of empirical measures of interacting particle systems; ii) since the literature on limits of weighted empirical measures is often constrained to the case of static (random or deterministic) weights, this paper contributes to further expanding this line of research to the case of time-evolving weights.


title: Generalized Pitaevskii relation between rectifying and linear responses: its application to reciprocal magnetization induction

abstract: Nonlinear optics has regained attention in recent years, especially in the context of optospintronics and topological materials. Nonlinear responses involved in various degrees of freedom manifest their intricacy more pronounced than linear responses. However, for a certain class of nonlinear responses, a connection can be established with linear-response coefficients, enabling the exploration of diverse nonlinear-response functionality in terms of the linear-response counterpart. Our study quantum-mechanically elucidates the relation between such nonlinear and linear responses we call the Pitevskii relation and identifies the condition for the relation to hold. Following the obtained general formulation, we systematically identify the Pitaevskii relations such as the inverse magnetoelectric effect and inverse natural optical activity unique to systems manifesting the space-inversion-symmetry breaking. These results provide a systematic understanding of intricate nonlinear responses and may offer further implications to ultrafast spintronics.


title: Low-energy spin dynamics in a Kitaev material Na3Ni2BiO6 investigated by NMR

abstract: We performed 23Na NMR and magnetization measurements on an S = 1, quasi-2D honeycomb lattice antiferromagnet Na3Ni2BiO6. A large positive Curie-Weiss constant of 22.9 K is observed. The NMR spectra at low fields are consistent with a "zigzag" magnetic order, indicating a large easy-axis anisotropy. With field applied along the c* axis, the NMR spectra confirm the existence of a 1/3-magnetization plateau phase between 5.1 T and 7.1 T. The transition from the zigzag order to the 1/3-magnetization plateau phase is also found to be a first-order type. A monotonic decrease of the spin gap is revealed in the 1/3-magnetization plateau phase, which reaches zero at a quantum critical field Hc = 8.35 T before entering the fully polarized phase. These data suggest the existence of exchange frustration in the system along with strong ferromagnetic interactions, hosting the possibility for Kitaev physics. Besides, well below the ordered phase, the 1/T1 at high fields shows either a level off or an enhancement upon cooling below 3 K, which suggests the existence of low-energy fluctuations.


title: Neural Fault Injection: Generating Software Faults from Natural Language

abstract: Traditional software fault injection methods, while foundational, face limitations in adequately representing real-world faults, offering customization, and requiring significant manual effort and expertise. This paper introduces a novel methodology that harnesses the capabilities of Large Language Models (LLMs) augmented with Reinforcement Learning from Human Feedback (RLHF) to overcome these challenges. The usage of RLHF emphasizes an iterative refinement process, allowing testers to provide feedback on generated faults, which is then used to enhance the LLM's fault generation capabilities, ensuring the generation of fault scenarios that closely mirror actual operational risks. This innovative methodology aims to significantly reduce the manual effort involved in crafting fault scenarios as it allows testers to focus on higher-level testing strategies, hence paving the way to new possibilities for enhancing the dependability of software systems.


title: The Ideal Glass and the Ideal Disk Packing in Two Dimensions

abstract: The ideal glass, a disordered system of particles with zero configurational entropy, cannot be realized through thermal processes. Nevertheless, we present a method for constructing ideal jammed packings of soft spheres, and thus the zero temperature ideal glass, in two dimensions. In line with the predicted properties, these critically jammed packings have high bulk and shear moduli as well as an anomalously high density. While the absence of pressure scaling in the shear moduli of crystalline materials is often attributed to the ordered nature of the particles, we show for the first time that disordered ideal packings also have this feature. We also find that the density of states avoids the low frequency power law scaling famously found in most amorphous materials. Finally, these configurations display hyperuniformity. In addition to resolving a long-standing mystery, this methodology represents a valuable shortcut in the generation of well-equilibrated glassy systems. The creation of such an ideal packing makes possible a complete exploration and explanation of two dimensional jammed and glassy systems.


title: Characterizing the Influence of Topology on Graph Learning Tasks

abstract: Graph neural networks (GNN) have achieved remarkable success in a wide range of tasks by encoding features combined with topology to create effective representations. However, the fundamental problem of understanding and analyzing how graph topology influences the performance of learning models on downstream tasks has not yet been well understood. In this paper, we propose a metric, TopoInf, which characterizes the influence of graph topology by measuring the level of compatibility between the topological information of graph data and downstream task objectives. We provide analysis based on the decoupled GNNs on the contextual stochastic block model to demonstrate the effectiveness of the metric. Through extensive experiments, we demonstrate that TopoInf is an effective metric for measuring topological influence on corresponding tasks and can be further leveraged to enhance graph learning.


title: Adaptive Fair Representation Learning for Personalized Fairness in Recommendations via Information Alignment

abstract: Personalized fairness in recommendations has been attracting increasing attention from researchers. The existing works often treat a fairness requirement, represented as a collection of sensitive attributes, as a hyper-parameter, and pursue extreme fairness by completely removing information of sensitive attributes from the learned fair embedding, which suffer from two challenges: huge training cost incurred by the explosion of attribute combinations, and the suboptimal trade-off between fairness and accuracy. In this paper, we propose a novel Adaptive Fair Representation Learning (AFRL) model, which achieves a real personalized fairness due to its advantage of training only one model to adaptively serve different fairness requirements during inference phase. Particularly, AFRL treats fairness requirements as inputs and can learn an attribute-specific embedding for each attribute from the unfair user embedding, which endows AFRL with the adaptability during inference phase to determine the non-sensitive attributes under the guidance of the user's unique fairness requirement. To achieve a better trade-off between fairness and accuracy in recommendations, AFRL conducts a novel Information Alignment to exactly preserve discriminative information of non-sensitive attributes and incorporate a debiased collaborative embedding into the fair embedding to capture attribute-independent collaborative signals, without loss of fairness. Finally, the extensive experiments conducted on real datasets together with the sound theoretical analysis demonstrate the superiority of AFRL.


title: PillarTrack: Redesigning Pillar-based Transformer Network for Single Object Tracking on Point Clouds

abstract: LiDAR-based 3D single object tracking (3D SOT) is a critical issue in robotics and autonomous driving. It aims to obtain accurate 3D BBox from the search area based on similarity or motion. However, existing 3D SOT methods usually follow the point-based pipeline, where the sampling operation inevitably leads to redundant or lost information, resulting in unexpected performance. To address these issues, we propose PillarTrack, a pillar-based 3D single object tracking framework. Firstly, we transform sparse point clouds into dense pillars to preserve the local and global geometrics. Secondly, we introduce a Pyramid-type Encoding Pillar Feature Encoder (PE-PFE) design to help the feature representation of each pillar. Thirdly, we present an efficient Transformer-based backbone from the perspective of modality differences. Finally, we construct our PillarTrack tracker based above designs. Extensive experiments on the KITTI and nuScenes dataset demonstrate the superiority of our proposed method. Notably, our method achieves state-of-the-art performance on the KITTI and nuScenes dataset and enables real-time tracking speed. We hope our work could encourage the community to rethink existing 3D SOT tracker designs.We will open source our code to the research community in https://github.com/StiphyJay/PillarTrack.


title: Multifractal Dimension Spectrum Analysis for Nuclear Density Distribution

abstract: We present an integral density method for calculating the multifractal dimension spectrum for the nucleon distribution in atomic nuclei. This method is then applied to analyze the non-uniformity of the density distribution in several typical types of nuclear matter distributions, including the Woods-Saxon distribution, the halo structure and the tetrahedral $\alpha$ clustering. The subsequent discussion provides a comprehensive and detailed exploration of the results obtained. The multifractal dimension spectrum shows remarkable sensitivity to the density distribution, establishing it as an effective tool for studying the distribution of nucleons in nuclear multibody systems.


title: Emission-line galaxies at $z\sim1$ from near-IR HST Slitless Spectroscopy: metallicities, star formation rates and redshift confirmations from VLT/FORS2 spectroscopy

abstract: We follow up emission line galaxies identified through the near-infrared slitless HST/WFC3 WISP survey with VLT/FORS2 optical spectroscopy. Over 4 WISP fields, we targetted 85 of 138 line emission objects at $0.4<z<2$ identified in WFC3 spectroscopy. Half the galaxies are fainter than $H_{AB}=24$mag, and would not have been included in many well-known surveys based on broad-band magnitude selection. We confirm 95% of the initial WFC3 grism redshifts in the 38 cases where we detect lines in FORS2 spectroscopy. However, for targets which exhibited a single emission line in WFC3, up to 65% at $z<1.28$ did not have expected emission lines detected in FORS2 and hence may be spurious (although this false-detection rate improves to 33% using the latest public WISP emission line catalogue). From the Balmer decrement the extinction of the WISP galaxies is consistent with $A($H$\alpha)=1$mag. From SED fits to multi-band photometry including Spitzer $3.6\mu$m, we find a median stellar mass of $\log_{10}(M/M_{\odot})=8.94$. Our emission-line-selected galaxies tend to lie above the star-forming main sequence (i.e. higher specific star formation rates). Using [OIII], [OII] and H$\beta$ lines to derive gas-phase metallicities, we find typically sub-solar metallicities, decreasing with redshift. Our WISP galaxies lie below the $z=0$ mass-metallicity relation, and galaxies with higher star formation rates tend to have lower metallicity. Finally, we find a strong evolution with redshift of the H$\alpha$ rest-frame equivalent width, $EW_0($H$\alpha)\propto (1+z)^{1.85\pm0.24}$ with higher $EW_0$ galaxies having larger [OIII]/H$\beta$ and O32 ratios on average, suggesting lower metallicity or higher ionisation parameter in these extreme emission line galaxies.


title: Interactive Prompt Debugging with Sequence Salience

abstract: We present Sequence Salience, a visual tool for interactive prompt debugging with input salience methods. Sequence Salience builds on widely used salience methods for text classification and single-token prediction, and extends this to a system tailored for debugging complex LLM prompts. Our system is well-suited for long texts, and expands on previous work by 1) providing controllable aggregation of token-level salience to the word, sentence, or paragraph level, making salience over long inputs tractable; and 2) supporting rapid iteration where practitioners can act on salience results, refine prompts, and run salience on the new output. We include case studies showing how Sequence Salience can help practitioners work with several complex prompting strategies, including few-shot, chain-of-thought, and constitutional principles. Sequence Salience is built on the Learning Interpretability Tool, an open-source platform for ML model visualizations, and code, notebooks, and tutorials are available at http://goo.gle/sequence-salience.


title: Can Large Language Models Assess Serendipity in Recommender Systems?

abstract: Serendipity-oriented recommender systems aim to counteract over-specialization in user preferences. However, evaluating a user's serendipitous response towards a recommended item can be challenging because of its emotional nature. In this study, we address this issue by leveraging the rich knowledge of large language models (LLMs), which can perform a variety of tasks. First, this study explored the alignment between serendipitous evaluations made by LLMs and those made by humans. In this investigation, a binary classification task was given to the LLMs to predict whether a user would find the recommended item serendipitously. The predictive performances of three LLMs on a benchmark dataset in which humans assigned the ground truth of serendipitous items were measured. The experimental findings reveal that LLM-based assessment methods did not have a very high agreement rate with human assessments. However, they performed as well as or better than the baseline methods. Further validation results indicate that the number of user rating histories provided to LLM prompts should be carefully chosen to avoid both insufficient and excessive inputs and that the output of LLMs that show high classification performance is difficult to interpret.


title: Exact bounds for the sum of the inverse-power of element orders in non-cyclic finite groups

abstract: Given a finite group $G$ of order $n.$ Denote the sum of the inverse-power of element orders in $G$ by $m(G).$ Let $\mathbb{Z}_n$ be the cyclic group of order $n.$ Suppose $G$ is a non-cyclic group of order $n$ then we show that $m(G)\geq \frac{5}{4}m(\mathbb{Z}_n).$ Our result improves the inequality $m(G)>m(\mathbb{Z}_n)$ obtained by Baniasad Azad, M., and Khorsravi B. Moreover, this bound is best as for $n=4l, l$ odd, there exists a group $G$ of order $n$ satisfying $m(G)=\frac{5}{4}m(\mathbb{Z}_n)$. Moreover, we will establish that $\frac{1}{q-1}m(G)< m(\mathbb{Z}_n)\leq \frac{4}{5}m(G),$ where $G$ is a non-cyclic group of odd order.


title: Leveraging Data Augmentation for Process Information Extraction

abstract: Business Process Modeling projects often require formal process models as a central component. High costs associated with the creation of such formal process models motivated many different fields of research aimed at automated generation of process models from readily available data. These include process mining on event logs, and generating business process models from natural language texts. Research in the latter field is regularly faced with the problem of limited data availability, hindering both evaluation and development of new techniques, especially learning-based ones. To overcome this data scarcity issue, in this paper we investigate the application of data augmentation for natural language text data. Data augmentation methods are well established in machine learning for creating new, synthetic data without human assistance. We find that many of these methods are applicable to the task of business process information extraction, improving the accuracy of extraction. Our study shows, that data augmentation is an important component in enabling machine learning methods for the task of business process model generation from natural language text, where currently mostly rule-based systems are still state of the art. Simple data augmentation techniques improved the $F_1$ score of mention extraction by 2.9 percentage points, and the $F_1$ of relation extraction by $4.5$. To better understand how data augmentation alters human annotated texts, we analyze the resulting text, visualizing and discussing the properties of augmented textual data. We make all code and experiments results publicly available.


title: Generating Counterfactual Explanations Using Cardinality Constraints

abstract: Providing explanations about how machine learning algorithms work and/or make particular predictions is one of the main tools that can be used to improve their trusworthiness, fairness and robustness. Among the most intuitive type of explanations are counterfactuals, which are examples that differ from a given point only in the prediction target and some set of features, presenting which features need to be changed in the original example to flip the prediction for that example. However, such counterfactuals can have many different features than the original example, making their interpretation difficult. In this paper, we propose to explicitly add a cardinality constraint to counterfactual generation limiting how many features can be different from the original example, thus providing more interpretable and easily understantable counterfactuals.


title: Best Practices and Lessons Learned on Synthetic Data for Language Models

abstract: The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution by generating artificial data that mimics real-world patterns. This paper provides an overview of synthetic data research, discussing its applications, challenges, and future directions. We present empirical evidence from prior art to demonstrate its effectiveness and highlight the importance of ensuring its factuality, fidelity, and unbiasedness. We emphasize the need for responsible use of synthetic data to build more powerful, inclusive, and trustworthy language models.


title: Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning through Object Exchange

abstract: In the realm of point cloud scene understanding, particularly in indoor scenes, objects are arranged following human habits, resulting in objects of certain semantics being closely positioned and displaying notable inter-object correlations. This can create a tendency for neural networks to exploit these strong dependencies, bypassing the individual object patterns. To address this challenge, we introduce a novel self-supervised learning (SSL) strategy. Our approach leverages both object patterns and contextual cues to produce robust features. It begins with the formulation of an object-exchanging strategy, where pairs of objects with comparable sizes are exchanged across different scenes, effectively disentangling the strong contextual dependencies. Subsequently, we introduce a context-aware feature learning strategy, which encodes object patterns without relying on their specific context by aggregating object features across various scenes. Our extensive experiments demonstrate the superiority of our method over existing SSL techniques, further showing its better robustness to environmental changes. Moreover, we showcase the applicability of our approach by transferring pre-trained models to diverse point cloud datasets.


title: Model Predictive Trajectory Planning for Human-Robot Handovers

abstract: This work develops a novel trajectory planner for human-robot handovers. The handover requirements can naturally be handled by a path-following-based model predictive controller, where the path progress serves as a progress measure of the handover. Moreover, the deviations from the path are used to follow human motion by adapting the path deviation bounds with a handover location prediction. A Gaussian process regression model, which is trained on known handover trajectories, is employed for this prediction. Experiments with a collaborative 7-DoF robotic manipulator show the effectiveness and versatility of the proposed approach.


title: Flexible Control of Chiral Superconductivity in Optically Driven Nodal Point Superconductors with Antiferromagnetism

abstract: Recent studies have attracted widespread attention on magnet-superconductor hybrid systems with emergent topological superconductivity. Here, we present the Floquet engineering of realistic two-dimensional topological nodal-point superconductors that are composed of antiferromagnetic monolayers in proximity to an s-wave superconductor. We show that Floquet chiral topological superconductivity arises naturally due to light-induced breaking of the effective time-reversal symmetry. More strikingly, we find that the Floquet chiral topological superconducting phases can be flexibly controlled by irradiating elliptically polarized light, with the photon-dressed quasi-energy spectrum carrying different Chern numbers. Such optically switchable topological transition is attributed to the simultaneous creations (or annihilations) of valley pairs. Our findings provide a feasible approach for achieving the Floquet chiral topological superconductivity with flexible tunability, which would draw extensive attention in experiments.


title: Learning to Classify New Foods Incrementally Via Compressed Exemplars

abstract: Food image classification systems play a crucial role in health monitoring and diet tracking through image-based dietary assessment techniques. However, existing food recognition systems rely on static datasets characterized by a pre-defined fixed number of food classes. This contrasts drastically with the reality of food consumption, which features constantly changing data. Therefore, food image classification systems should adapt to and manage data that continuously evolves. This is where continual learning plays an important role. A challenge in continual learning is catastrophic forgetting, where ML models tend to discard old knowledge upon learning new information. While memory-replay algorithms have shown promise in mitigating this problem by storing old data as exemplars, they are hampered by the limited capacity of memory buffers, leading to an imbalance between new and previously learned data. To address this, our work explores the use of neural image compression to extend buffer size and enhance data diversity. We introduced the concept of continuously learning a neural compression model to adaptively improve the quality of compressed data and optimize the bitrates per pixel (bpp) to store more exemplars. Our extensive experiments, including evaluations on food-specific datasets including Food-101 and VFN-74, as well as the general dataset ImageNet-100, demonstrate improvements in classification accuracy. This progress is pivotal in advancing more realistic food recognition systems that are capable of adapting to continually evolving data. Moreover, the principles and methodologies we've developed hold promise for broader applications, extending their benefits to other domains of continual machine learning systems.


title: An advanced 1D physics-based model for PEM hydrogen fuel cells with enhanced overvoltage prediction

abstract: A one-dimensional, dynamic, two-phase, isothermal and finite-difference model of proton exchange membrane fuel cell (PEMFC) systems has been developed. It is distinct from most existing models which are either fast but imprecise, such as lumped-parameter models, or detailed but computationally intensive, such as computational fluid dynamics models. This model, partially validated using experimental polarisation curves, provides a comprehensive description of cell internal states while maintaining a low computational burden. Additionally, a new physical quantity, named the limit liquid water saturation coefficient ($s_{lim}$), is introduced in the overvoltage calculation equation. This quantity replaces the limit current density coefficient ($i_{lim}$) and establishes a connection between the voltage drop at high current densities, the amount of liquid water present in the catalyst layers of the cell, and the operating conditions. At high current densities, a significant amount of liquid water is generated, which limits the accessibility of reactants to certain triple point zones within the catalyst layers by covering them. This, in turn, increases overpotential. It has also been observed that $s_{lim}$ is influenced, at minimum, by the gas pressure imposed by the operator.


title: Multiparameter cascaded quantum interferometer

abstract: We theoretically propose a multiparameter cascaded quantum interferometer in which a two-input and two-output setup is obtained by concatenating 50:50 beam splitters with n independent and adjustable time delays. A general method for deriving the coincidence probability of such an interferometer is given based on the linear transformation of the matrix of beam splitters. As examples, we analyze the interference characteristics of one-, two- and three-parameter cascaded quantum interferometers with different frequency correlations and input states. Some typical interferograms of such interferometers are provided to reveal more rich and complicated two-photon interference phenomena. In principle, arbitrary two-input and two-output experimental setups can be designed with the proposal. This work offers a toolbox for designing versatile quantum interferometers and provides a convenient method for deriving the coincidence probabilities involved. Potential applications can be found in the complete spectral characterization of two-photon states, multiparameter estimation, and quantum metrology.


title: Dynamic Suffix Array in Optimal Compressed Space

abstract: Big data, encompassing extensive datasets, has seen rapid expansion, notably with a considerable portion being textual data, including strings and texts. Simple compression methods and standard data structures prove inadequate for processing these datasets, as they require decompression for usage or consume extensive memory resources. Consequently, this motivation has led to the development of compressed data structures that support various queries for a given string, typically operating in polylogarithmic time and utilizing compressed space proportional to the string's length. Notably, the suffix array (SA) query is a critical component in implementing a suffix tree, which has a broad spectrum of applications. A line of research has been conducted on (especially, static) compressed data structures that support the SA query. A common finding from most of the studies is the suboptimal space efficiency of existing compressed data structures. Kociumaka, Navarro, and Prezza have made a significant contribution by introducing an asymptotically minimal space requirement, $O\left(\delta \log\frac{n\log\sigma}{\delta\log n} \log n \right)$ bits, sufficient to represent any string of length $n$, with an alphabet size of $\sigma$, and substring complexity $\delta$, serving as a measure of repetitiveness. The space is referred to as $\delta$-optimal space. More recently, Kempa and Kociumaka presented $\delta$-SA, a compressed data structure supporting SA queries in $\delta$-optimal space. However, the data structures introduced thus far are static. We present the first dynamic compressed data structure that supports the SA query and update in polylogarithmic time and $\delta$-optimal space. More precisely, it can answer SA queries and perform updates in $O(\log^7 n)$ and expected $O(\log^8 n)$ time, respectively, using an expected $\delta$-optimal space.


title: Generative Probabilistic Planning for Optimizing Supply Chain Networks

abstract: Supply chain networks in enterprises are typically composed of complex topological graphs involving various types of nodes and edges, accommodating numerous products with considerable demand and supply variability. However, as supply chain networks expand in size and complexity, traditional supply chain planning methods (e.g., those found in heuristic rule-based and operations research-based systems) tend to become locally optimal or lack computational scalability, resulting in substantial imbalances between supply and demand across nodes in the network. This paper introduces a novel Generative AI technique, which we call Generative Probabilistic Planning (GPP). GPP generates dynamic supply action plans that are globally optimized across all network nodes over the time horizon for changing objectives like maximizing profits or service levels, factoring in time-varying probabilistic demand, lead time, and production conditions. GPP leverages attention-based graph neural networks (GNN), offline deep reinforcement learning (Offline RL), and policy simulations to train generative policy models and create optimal plans through probabilistic simulations, effectively accounting for various uncertainties. Our experiments using historical data from a global consumer goods company with complex supply chain networks demonstrate that GPP accomplishes objective-adaptable, probabilistically resilient, and dynamic planning for supply chain networks, leading to significant improvements in performance and profitability for enterprises. Our work plays a pivotal role in shaping the trajectory of AI adoption within the supply chain domain.


title: Numerical investigation of the quantum inverse algorithm on small molecules

abstract: We evaluate the accuracy of the quantum inverse (Q-Inv) algorithm in which the multiplication of $\hat{H}^{-k}$ to the reference wavefunction is replaced by the Fourier Transformed multiplication of $e^{-i\lambda \hat{H}}$, as a function of the integration parameters ($\lambda$) and the power $k$ for various systems, including H$_2$, LiH, BeH$_2$ and the notorious H$_4$ molecule at single point. We further consider the possibility of employing the Gaussian-quadrature rule as an alternate integration method and compared it to the results employing trapezoidal integration. The Q-Inv algorithm is compared to the inverse iteration method using the $\hat{H}^{-1}$ inverse (I-Iter) and the exact inverse by lower-upper decomposition (LU). Energy values are evaluated as the expectation values of the Hamiltonian. Results suggest that the Q-Inv method provides lower energy results than the I-Iter method up to a certain $k$, after which the energy increases due to errors in the numerical integration that are dependent of the integration interval. A combined Gaussian-quadrature and trapezoidal integration method proved to be more effective at reaching convergence while decreasing the number of operations. For systems like H$_4$, in which the Q-Inv can not reach the expected error threshold, we propose a combination of Q-Inv and I-Iter methods to further decrease the error with $k$ at lower computational cost. Finally, we summarize the recommended procedure when treating unknown systems.


title: Three-loop renormalization of the quantum action for a five-dimensional scalar cubic model with the usage of the background field method and a cutoff regularization

abstract: The paper studies the quantum action for the five-dimensional real $\phi^3$-theory in the case of a general formulation using the background field method. The three-loop renormalization is performed with the usage of a cutoff regularization in the coordinate representation. The explicit form of the first three coefficients for the renormalization constants is presented. The absence of non-local singular contributions and partial results for the fourth correction are discussed.


title: Generalization Gap in Data Augmentation: Insights from Illumination

abstract: In the field of computer vision, data augmentation is widely used to enrich the feature complexity of training datasets with deep learning techniques. However, regarding the generalization capabilities of models, the difference in artificial features generated by data augmentation and natural visual features has not been fully revealed. This study focuses on the visual representation variable 'illumination', by simulating its distribution degradation and examining how data augmentation techniques enhance model performance on a classification task. Our goal is to investigate the differences in generalization between models trained with augmented data and those trained under real-world illumination conditions. Results indicate that after undergoing various data augmentation methods, model performance has been significantly improved. Yet, a noticeable generalization gap still exists after utilizing various data augmentation methods, emphasizing the critical role of feature diversity in the training set for enhancing model generalization.


title: Stability in Phase Retrieval: Characterizing Condition Numbers and the Optimal Vector Set

abstract: In this paper, we primarily focus on analyzing the stability property of phase retrieval by examining the bi-Lipschitz property of the map $\Phi_{\boldsymbol{A}}(\boldsymbol{x})=|\boldsymbol{A}\boldsymbol{x}|\in \mathbb{R}_+^m$, where $\boldsymbol{x}\in \mathbb{H}^d$ and $\boldsymbol{A}\in \mathbb{H}^{m\times d}$ is the measurement matrix for $\mathbb{H}\in\{\mathbb{R},\mathbb{C}\}$. We define the condition number $\beta_{\boldsymbol{A}}=\frac{U_{\boldsymbol{A}}}{L_{\boldsymbol{A}}}$, where $L_{\boldsymbol{A}}$ and $U_{\boldsymbol{A}}$ represent the optimal lower and upper Lipschitz constants, respectively. We establish the first universal lower bound on $\beta_{\boldsymbol{A}}$ by demonstrating that for any ${\boldsymbol{A}}\in\mathbb{H}^{m\times d}$, \begin{equation*} \beta_{\boldsymbol{A}}\geq \beta_0^{\mathbb{H}}=\begin{cases} \sqrt{\frac{\pi}{\pi-2}}\,\,\approx\,\, 1.659 & \text{if $\mathbb{H}=\mathbb{R}$,}\\ \sqrt{\frac{4}{4-\pi}}\,\,\approx\,\, 2.159 & \text{if $\mathbb{H}=\mathbb{C}$.} \end{cases} \end{equation*} We prove that the condition number of a standard Gaussian matrix in $\mathbb{H}^{m\times d}$ asymptotically matches the lower bound $\beta_0^{\mathbb{H}}$ for both real and complex cases. This result indicates that the constant lower bound $\beta_0^{\mathbb{H}}$ is asymptotically tight, holding true for both the real and complex scenarios. As an application of this result, we utilize it to investigate the performance of quadratic models for phase retrieval. Lastly, we establish that for any odd integer $m\geq 3$, the harmonic frame $\boldsymbol{A}\in \mathbb{R}^{m\times 2}$ possesses the minimum condition number among all $\boldsymbol{A}\in \mathbb{R}^{m\times 2}$. We are confident that these findings carry substantial implications for enhancing our understanding of phase retrieval.


title: Parameterized Complexity of Submodular Minimization under Uncertainty

abstract: This paper studies the computational complexity of a robust variant of a two-stage submodular minimization problem that we call Robust Submodular Minimizer. In this problem, we are given $k$ submodular functions $f_1,\dots,f_k$ over a set family $2^V$, which represent $k$ possible scenarios in the future when we will need to find an optimal solution for one of these scenarios, i.e., a minimizer for one of the functions. The present task is to find a set $X \subseteq V$ that is close to some optimal solution for each $f_i$ in the sense that some minimizer of $f_i$ can be obtained from $X$ by adding/removing at most $d$ elements for a given integer $d$. The main contribution of this paper is to provide a complete computational map of this problem with respect to parameters $k$ and $d$, which reveals a tight complexity threshold for both parameters: (1) Robust Submodular Minimizer can be solved in polynomial time when $k \leq 2$, but is NP-hard if $k$ is a constant with $k \geq 3$. (2) Robust Submodular Minimizer can be solved in polynomial time when $d=0$, but is NP-hard if $d$ is a constant with $d \geq 1$. (3) Robust Submodular Minimizer is fixed-parameter tractable when parameterized by $(k,d)$. We also show that if some submodular function $f_i$ has a polynomial number of minimizers, then the problem becomes fixed-parameter tractable when parameterized by $d$. We remark that all our hardness results hold even if each submodular function is given by a cut function of a directed graph.


title: Efficient sEMG-based Cross-Subject Joint Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network

abstract: Surface electromyography (sEMG) has demonstrated significant potential in simultaneous and proportional control (SPC). However, existing algorithms for predicting joint angles based on sEMG often suffer from high inference costs or are limited to specific subjects rather than cross-subject scenarios. To address these challenges, we introduced a hierarchical Spiking Attentional Feature Decomposition Network (SAFE-Net). This network initially compresses sEMG signals into neural spiking forms using a Spiking Sparse Attention Encoder (SSAE). Subsequently, the compressed features are decomposed into kinematic and biological features through a Spiking Attentional Feature Decomposition (SAFD) module. Finally, the kinematic and biological features are used to predict joint angles and identify subject identities, respectively. Our validation on two datasets (SIAT-DB1 and SIAT-DB2) and comparison with two existing methods, Informer and Spikformer, demonstrate that SSAE achieves significant power consumption savings of 39.1% and 37.5% respectively over them in terms of inference costs. Furthermore, SAFE-Net surpasses Informer and Spikformer in recognition accuracy on both datasets. This study underscores the potential of SAFE-Net to advance the field of SPC in lower limb rehabilitation exoskeleton robots.


title: Remembering Transformer for Continual Learning

abstract: Neural networks encounter the challenge of Catastrophic Forgetting (CF) in continual learning, where new task learning interferes with previously learned knowledge. Existing data fine-tuning and regularization methods necessitate task identity information during inference and cannot eliminate interference among different tasks, while soft parameter sharing approaches encounter the problem of an increasing model parameter size. To tackle these challenges, we propose the Remembering Transformer, inspired by the brain's Complementary Learning Systems (CLS). Remembering Transformer employs a mixture-of-adapters architecture and a generative model-based novelty detection mechanism in a pretrained Transformer to alleviate CF. Remembering Transformer dynamically routes task data to the most relevant adapter with enhanced parameter efficiency based on knowledge distillation. We conducted extensive experiments, including ablation studies on the novelty detection mechanism and model capacity of the mixture-of-adapters, in a broad range of class-incremental split tasks and permutation tasks. Our approach demonstrated SOTA performance surpassing the second-best method by 15.90% in the split tasks, reducing the memory footprint from 11.18M to 0.22M in the five splits CIFAR10 task.


title: LATTE: Low-Precision Approximate Attention with Head-wise Trainable Threshold for Efficient Transformer

abstract: With the rise of Transformer models in NLP and CV domain, Multi-Head Attention has been proven to be a game-changer. However, its expensive computation poses challenges to the model throughput and efficiency, especially for the long sequence tasks. Exploiting the sparsity in attention has been proven to be an effective way to reduce computation. Nevertheless, prior works do not consider the various distributions among different heads and lack a systematic method to determine the threshold. To address these challenges, we propose Low-Precision Approximate Attention with Head-wise Trainable Threshold for Efficient Transformer (LATTE). LATTE employs a headwise threshold-based filter with the low-precision dot product and computation reuse mechanism to reduce the computation of MHA. Moreover, the trainable threshold is introduced to provide a systematic method for adjusting the thresholds and enable end-to-end optimization. Experimental results indicate LATTE can smoothly adapt to both NLP and CV tasks, offering significant computation savings with only a minor compromise in performance. Also, the trainable threshold is shown to be essential for the leverage between the performance and the computation. As a result, LATTE filters up to 85.16% keys with only a 0.87% accuracy drop in the CV task and 89.91% keys with a 0.86 perplexity increase in the NLP task.


title: PromptSync: Bridging Domain Gaps in Vision-Language Models through Class-Aware Prototype Alignment and Discrimination

abstract: The potential for zero-shot generalization in vision-language (V-L) models such as CLIP has spurred their widespread adoption in addressing numerous downstream tasks. Previous methods have employed test-time prompt tuning to adapt the model to unseen domains, but they overlooked the issue of imbalanced class distributions. In this study, we explicitly address this problem by employing class-aware prototype alignment weighted by mean class probabilities obtained for the test sample and filtered augmented views. Additionally, we ensure that the class probabilities are as accurate as possible by performing prototype discrimination using contrastive learning. The combination of alignment and discriminative loss serves as a geometric regularizer, preventing the prompt representation from collapsing onto a single class and effectively bridging the distribution gap between the source and test domains. Our method, named PromptSync, synchronizes the prompts for each test sample on both the text and vision branches of the V-L model. In empirical evaluations on the domain generalization benchmark, our method outperforms previous best methods by 2.33% in overall performance, by 1% in base-to-novel generalization, and by 2.84% in cross-dataset transfer tasks.


title: Advancements in Secondary and Backscattered Electron Energy Spectra and Yields Analysis: from Theory to Applications

abstract: Over the past decade, experimental microscopy and spectroscopy have made significant progress in the study of the morphological, optical, electronic and transport properties of materials. These developments include higher spatial resolution, shorter acquisition times, more efficient monochromators and electron analysers, improved contrast imaging and advancements in sample preparation techniques. These advances have driven the need for more accurate theoretical descriptions and predictions of material properties. Computer simulations based on first principles and Monte Carlo methods have emerged as a rapidly growing field for modeling the interaction of charged particles, such as electron, proton and ion beams, with various systems, such as slabs, nanostructures and crystals. This report delves into the theoretical and computational approaches to modeling the physico-chemical mechanisms that occur when charged beams interact with a medium. These mechanisms encompass single and collective electronic excitation, ionization of the target atoms and the generation of a secondary electron cascade that deposits energy into the irradiated material. We show that the combined application of ab initio methods, which are able to model the dynamics of interacting many-fermion systems, and Monte Carlo methods, which capture statistical fluctuations in energy loss mechanisms by random sampling, proves to be an optimal strategy for the accurate description of charge transport in solids. This joint quantitative approach enables the theoretical interpretation of excitation, loss and secondary electron spectra, the analysis of the chemical composition and dielectric properties of solids and contributes to our understanding of irradiation-induced damage in materials, including those of biological significance.


title: Thermodynamics of black holes featuring primary scalar hair

abstract: In this work, we embark on the thermodynamic investigation concerning a family of primary charged black holes within the context of shift and parity symmetric Beyond Horndeski gravity. Employing the Euclidean approach, we derive the functional expression for the free energy and derive the first thermodynamic law, offering a methodology to address the challenge of extracting the thermal quantities in shift-symmetric scalar tensor theories characterized by linear time dependence in the scalar field. Following the formal analysis, we provide some illustrative examples focusing on the thermal evaporation of these fascinating objects.


title: GNN-based Probabilistic Supply and Inventory Predictions in Supply Chain Networks

abstract: Successful supply chain optimization must mitigate imbalances between supply and demand over time. While accurate demand prediction is essential for supply planning, it alone does not suffice. The key to successful supply planning for optimal and viable execution lies in maximizing predictability for both demand and supply throughout an execution horizon. Therefore, enhancing the accuracy of supply predictions is imperative to create an attainable supply plan that matches demand without overstocking or understocking. However, in complex supply chain networks with numerous nodes and edges, accurate supply predictions are challenging due to dynamic node interactions, cascading supply delays, resource availability, production and logistic capabilities. Consequently, supply executions often deviate from their initial plans. To address this, we present the Graph-based Supply Prediction (GSP) probabilistic model. Our attention-based graph neural network (GNN) model predicts supplies, inventory, and imbalances using graph-structured historical data, demand forecasting, and original supply plan inputs. The experiments, conducted using historical data from a global consumer goods company's large-scale supply chain, demonstrate that GSP significantly improves supply and inventory prediction accuracy, potentially offering supply plan corrections to optimize executions.


title: Photon Counting Interferometry to Detect Geontropic Space-Time Fluctuations with GQuEST

abstract: The GQuEST (Gravity from the Quantum Entanglement of Space-Time) experiment uses tabletop-scale Michelson laser interferometers to probe for fluctuations in space-time. We present an interferometer design featuring a novel photon counting readout method that provides unprecedented sensitivity, as it is not subject to the interferometric standard quantum limit. We evaluate the potential of this design to measure space-time fluctuations motivated by recent `geontropic' quantum gravity models. The accelerated accrual of statistical power offered by the photon counting readout enables GQuEST to detect the predicted quantum gravity phenomena within measurement times at least 100 times shorter than equivalent conventional interferometers. The GQuEST design thus enables a fast and sensitive search for signatures of quantum gravity in a laboratory-scale experiment.

categories: gr-qc astro-ph.IM physics.ins-det quant-ph


title: Enhancing Policy Gradient with the Polyak Step-Size Adaption

abstract: Policy gradient is a widely utilized and foundational algorithm in the field of reinforcement learning (RL). Renowned for its convergence guarantees and stability compared to other RL algorithms, its practical application is often hindered by sensitivity to hyper-parameters, particularly the step-size. In this paper, we introduce the integration of the Polyak step-size in RL, which automatically adjusts the step-size without prior knowledge. To adapt this method to RL settings, we address several issues, including unknown f* in the Polyak step-size. Additionally, we showcase the performance of the Polyak step-size in RL through experiments, demonstrating faster convergence and the attainment of more stable policies.


title: On the convergence analysis of one-shot inversion methods

abstract: When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same time on the inverse problem unknown and on the forward and adjoint problem solutions yields the concept of one-shot inversion methods. We are especially interested in the case where the inner iterations for the direct and adjoint problems are incomplete, that is, stopped before achieving a high accuracy on their solutions. Here, we focus on general linear inverse problems and generic fixed-point iterations for the associated forward problem. We analyze variants of the so-called multi-step one-shot methods, in particular semi-implicit schemes with a regularization parameter. We establish sufficient conditions on the descent step for convergence, by studying the eigenvalues of the block matrix of the coupled iterations. Several numerical experiments are provided to illustrate the convergence of these methods in comparison with the classical gradient descent, where the forward and adjoint problems are solved exactly by a direct solver instead. We observe that very few inner iterations are enough to guarantee good convergence of the inversion algorithm, even in the presence of noisy data.


title: Security Modelling for Cyber-Physical Systems: A Systematic Literature Review

abstract: Cyber-physical systems (CPS) are at the intersection of digital technology and engineering domains, rendering them high-value targets of sophisticated and well-funded cybersecurity threat actors. Prominent cybersecurity attacks on CPS have brought attention to the vulnerability of these systems, and the soft underbelly of critical infrastructure reliant on CPS. Security modelling for CPS is an important mechanism to systematically identify and assess vulnerabilities, threats, and risks throughout system lifecycles, and to ultimately ensure system resilience, safety, and reliability. This literature review delves into state-of-the-art research in CPS security modelling, encompassing both threat and attack modelling. While these terms are sometimes used interchangeably, they are different concepts. This article elaborates on the differences between threat and attack modelling, examining their implications for CPS security. A systematic search yielded 428 articles, from which 15 were selected and categorised into three clusters: those focused on threat modelling methods, attack modelling methods, and literature reviews. Specifically, we sought to examine what security modelling methods exist today, and how they address real-world cybersecurity threats and CPS-specific attacker capabilities throughout the lifecycle of CPS, which typically span longer durations compared to traditional IT systems. This article also highlights several limitations in existing research, wherein security models adopt simplistic approaches that do not adequately consider the dynamic, multi-layer, multi-path, and multi-agent characteristics of real-world cyber-physical attacks.


title: The morphology of cell spheroids in simple shear flow

abstract: Cell spheroids are a widely used model to investigate cell-cell and cell-matrix interactions in a 3D microenvironment in vitro. Most research on cell spheroids has been focused on their response to various stimuli under static conditions. Recently, the effect of flow on cell spheroids has been investigated in the context of tumor invasion in interstitial space. In particular, microfluidic perfusion of cell spheroids embedded in a collagen matrix has been shown to modulate cell-cell adhesion and to represent a possible mechanism promoting tumor invasion by interstitial flow. However, studies on the effects of well-defined flow fields on cell spheroids are lacking in the literature. Here, we apply simple shear flow to cell spheroids in a parallel plate apparatus while observing their morphology by optical microscopy. By using image analysis techniques, we show that cell spheroids rotate under flow as rigid particles. As time goes on, cells from the outer layer detach from the sheared cell spheroids and are carried away by the flow. Hence, the size of cell spheroids declines with time at a rate increasing with the external shear stress, which can be used to estimate cell-cell adhesion. The technique proposed in this work allows one to correlate flow-induced effects with microscopy imaging of cell spheroids in a well-established shear flow field, thus providing a method to obtain quantitative results which are relevant in the general field of mechanobiology.


title: Seashell-inspired polarization-sensitive tonotopic metasensor

abstract: Bioinspiration has widely been demonstrated to be a powerful approach for the design of innovative structures and devices. Recently, this concept has been extended to the field of elasticity, dynamics, and metamaterials. In this paper, we propose a seashell-inspired metasensor that can simultaneously perform spatial frequency mapping and act as a polarizer. The structure emerges from a universal parametric design that encompasses diverse spiral geometries with varying circular cross sections and curvature radii, all leading to tonotopic behavior. Adoption of an optimization process leads to a planar geometry that enables us to simultaneously achieve tonotopy for orthogonally polarized modes, leading to the possibility to control polarization as well as the spatial distribution of frequency maxima along the spiral axis. We demonstrate the versatility of the device and discuss the possible applications in the field of acoustics and sensing.


title: Promoting collective cooperation through temporal interactions

abstract: Collective cooperation drives the dynamics of many natural, social, and economic phenomena, making understanding the evolution of cooperation with evolutionary game theory a central question of modern science. Although human interactions are best described as complex networks, current explorations are limited to static networks where interactions represented by network links are permanent and do not change over time. In reality, human activities often involve temporal interactions, where links are impermanent, and understanding the evolution of cooperation on such ubiquitous temporal networks is an open question. Here, we present a general framework for systematically analyzing how collective cooperation evolves on any temporal network, which unifies the study of evolutionary game dynamics with dynamic and static interactions. We show that the emergence of cooperation is facilitated by a simple rule of thumb: hubs (individuals with many social ties) should be temporally deprioritized in interactions. We further provide a quantitative metric capturing the priority of hubs, which we utilize to orchestrate the ordering of interactions to best promote cooperation on empirical temporal networks. Our findings unveil the fundamental advantages conferred by temporal interactions for promoting collective cooperation, which transcends the specific insights gleaned from studying traditional static snapshots.


title: Existence results for problems involving non local operator with an asymmetric weight and with a critical nonlinearity

abstract: Recently, a great attention has been focused on the study of fractional and non-local operators of elliptic type, both for the pure mathematical research and in view of concrete real-world applications. We consider the following non local problem on $\mathbb{H}_0^s(\Omega) \subset L^{q_s}(\Omega)$, with $q_s :=\frac{2n}{n-2s}$, $s\in ]0, 1[$ and $n\geq 3$ \begin{equation}\int_{\mathbb{R}^n}p(x) \bigg(\int_{\mathbb{R}^n}\frac{|u(x)-u(y)|^2}{|x-y|^{n+2s}}dy\bigg)dx-\lambda \int_\Omega |u(x)|^q dx, \qquad(1)\end{equation} where $\Omega$ is a bounded domain in $\mathbb{R}^n, p :\mathbb{R}^n \to \mathbb{R}$ is a given positive weight presenting a global minimum $p_0 >0$ at $a \in \Omega$ and $\lambda$ is a real constant. In this work we show that for $q=2$ the infimum of (1) over the set $\{u\in \mathbb{H}_0^s(\Omega), ||u||_{L^{q_s}(\Omega)}=1\}$ does exist for some $k, s, \lambda$ and $n$ and for $q\geq 2$ we study non ground state solutions using the Mountain Pass Theorem.


title: Bayesian Federated Model Compression for Communication and Computation Efficiency

abstract: In this paper, we investigate Bayesian model compression in federated learning (FL) to construct sparse models that can achieve both communication and computation efficiencies. We propose a decentralized Turbo variational Bayesian inference (D-Turbo-VBI) FL framework where we firstly propose a hierarchical sparse prior to promote a clustered sparse structure in the weight matrix. Then, by carefully integrating message passing and VBI with a decentralized turbo framework, we propose the D-Turbo-VBI algorithm which can (i) reduce both upstream and downstream communication overhead during federated training, and (ii) reduce the computational complexity during local inference. Additionally, we establish the convergence property for thr proposed D-Turbo-VBI algorithm. Simulation results show the significant gain of our proposed algorithm over the baselines in reducing communication overhead during federated training and computational complexity of final model.


title: IITP-VDLand: A Comprehensive Dataset on Decentraland Parcels

abstract: This paper presents IITP-VDLand, a comprehensive dataset of Decentraland parcels sourced from diverse platforms. Unlike existing datasets which have limited attributes and records, IITP-VDLand offers a rich array of attributes, encompassing parcel characteristics, trading history, past activities, transactions, and social media interactions. Alongside, we introduce a key attribute in the dataset, namely Rarity score, which measures the uniqueness of each parcel within the virtual world. Addressing the significant challenge posed by the dispersed nature of this data across various sources, we employ a systematic approach, utilizing both available APIs and custom scripts, to gather it. Subsequently, we meticulously curate and organize the information into four distinct segments: (1) Characteristics Data-Fragment, (2) OpenSea Trading History Data-Fragment, (3) Ethereum Activity Transactions Data-Fragment, and (4) Social Media Data-Fragment. We envisage that this dataset would serve as a robust resource for training machine- and deep-learning models specifically designed to address real-world challenges within the domain of Decentraland parcels. The performance benchmarking of more than 20 state-of-the-art price prediction models on our dataset yields promising results, achieving a maximum R2 score of 0.8251 and an accuracy of 74.23% in case of Extra Trees Regressor and Classifier. The key findings reveal that the ensemble models performs better than both deep learning and linear models for our dataset. We observe a significant impact of coordinates, geographical proximity, rarity score, and few other economic indicators on the prediction of parcel prices.


title: Realizing Laser-driven Deuteron Acceleration with Low Energy Spread via In-situ D$_2$O-deposited Target

abstract: Generation of quasi-monoenergetic ion pulse by laser-driven acceleration is one of the hot topics in laser plasma physics. In this study, we present a new method for the \textit{In-situ} deposition of an ultra-thin D$_2$O layer on the surface of an aluminum foil target utilizing a spherical D$_2$O capsule. Employing a 10$^{19}$ W/cm$^2$ laser, we achieve the acceleration of 10.8 MeV deuterons with an energy spread of $\Delta$E/E = 4.6% in the most favorable shot. The energy spread depends on the exposure time of the D$_2$O capsule in the vacuum chamber. This method has the potential to extend its applicability to other ion species.


title: Free boundary regularity for the inhomogeneous one-phase Stefan problem

abstract: In this paper, we prove that flat free boundaries of solutions to inhomogeneous one-phase Stefan problem are $C^{1,\alpha}$.


title: EKF-SINDy: Empowering the extended Kalman filter with sparse identification of nonlinear dynamics

abstract: Observed data from a dynamic system can be assimilated into a predictive model by means of Kalman filters. Nonlinear extensions of the Kalman filter, such as the Extended Kalman Filter (EKF), are required to enable the joint estimation of (possibly nonlinear) system dynamics and of input parameters. To construct the evolution model used in the prediction phase of the EKF, we propose to rely on the Sparse Identification of Nonlinear Dynamics (SINDy). The numerical integration of a SINDy model leads to great computational savings compared to alternate strategies based on, e.g., finite elements. Indeed, SINDy allows for the immediate definition of the Jacobian matrices required by the EKF to identify system dynamics and properties, a derivation that is usually extremely involved with physical models. As a result, combining the EKF with SINDy provides a computationally efficient, easy-to-apply approach for the identification of nonlinear systems, capable of robust operation even outside the range of training of SINDy. To demonstrate the potential of the approach, we address the identification of a linear non-autonomous system consisting of a shear building model excited by real seismograms, and the identification of a partially observed nonlinear system. The challenge arising from applying SINDy when the system state is not accessible has been relieved by means of time-delay embedding. The great accuracy and the small uncertainty associated with the state identification, where the state has been augmented to include system properties, underscores the great potential of the proposed strategy, paving the way for the development of predictive digital twins in different fields.


title: How is Visual Attention Influenced by Text Guidance? Database and Model

abstract: The analysis and prediction of visual attention have long been crucial tasks in the fields of computer vision and image processing. In practical applications, images are generally accompanied by various text descriptions, however, few studies have explored the influence of text descriptions on visual attention, let alone developed visual saliency prediction models considering text guidance. In this paper, we conduct a comprehensive study on text-guided image saliency (TIS) from both subjective and objective perspectives. Specifically, we construct a TIS database named SJTU-TIS, which includes 1200 text-image pairs and the corresponding collected eye-tracking data. Based on the established SJTU-TIS database, we analyze the influence of various text descriptions on visual attention. Then, to facilitate the development of saliency prediction models considering text influence, we construct a benchmark for the established SJTU-TIS database using state-of-the-art saliency models. Finally, considering the effect of text descriptions on visual attention, while most existing saliency models ignore this impact, we further propose a text-guided saliency (TGSal) prediction model, which extracts and integrates both image features and text features to predict the image saliency under various text-description conditions. Our proposed model significantly outperforms the state-of-the-art saliency models on both the SJTU-TIS database and the pure image saliency databases in terms of various evaluation metrics. The SJTU-TIS database and the code of the proposed TGSal model will be released at: https://github.com/IntMeGroup/TGSal.


title: Reduced-dimensional modelling for nonlinear convection-dominated flow in cylindric domains

abstract: The aim of the paper is to construct and justify asymptotic approximations for solutions to quasilinear convection-diffusion problems with a predominance of nonlinear convective flow in a thin cylinder, where an inhomogeneous nonlinear Robin-type boundary condition involving convective and diffusive fluxes is imposed on the lateral surface. The limit problem for vanishing diffusion and the cylinder shrinking to an interval is a nonlinear first-order conservation law. For a time span that allows for a classical solution of this limit problem corresponding uniform pointwise and energy estimates are proven. They provide precise model error estimates with respect to the small parameter that controls the double viscosity-geometric limit. In addition, other problems with more higher P\'eclet numbers are also considered.


title: Impact of Training Instance Selection on Automated Algorithm Selection Models for Numerical Black-box Optimization

abstract: The recently proposed MA-BBOB function generator provides a way to create numerical black-box benchmark problems based on the well-established BBOB suite. Initial studies on this generator highlighted its ability to smoothly transition between the component functions, both from a low-level landscape feature perspective, as well as with regard to algorithm performance. This suggests that MA-BBOB-generated functions can be an ideal testbed for automated machine learning methods, such as automated algorithm selection (AAS). In this paper, we generate 11800 functions in dimensions $d=2$ and $d=5$, respectively, and analyze the potential gains from AAS by studying performance complementarity within a set of eight algorithms. We combine this performance data with exploratory landscape features to create an AAS pipeline that we use to investigate how to efficiently select training sets within this space. We show that simply using the BBOB component functions for training yields poor test performance, while the ranking between uniformly chosen and diversity-based training sets strongly depends on the distribution of the test set.


title: Second register production on the clarinet: nonlinear losses in the register hole as the decisive physical phenomenon

abstract: This study investigates the role of localized nonlinear losses in the register hole on the production of second-register notes. First, an experiment is conducted to study the ability of a register hole to produce second register. A cylindrical tube is drilled with holes of increasing diameter. Five are at the same level as the register hole of a B-flat clarinet, and five are at the same level as the thumb hole. Participant clarinetists are then asked to play with constant control parameters. At the beginning of each measurement, all holes are closed. The operator then opens randomly one of the ten holes.The resulting register is noted. The experiment is replicated numerically by time integration of two different models. The first is the state-of-the-art model based on the modal decomposition of the input impedance of the resonator. The second accounts for localized nonlinear losses in the register hole, through the model from Dalmont and Nederveen (2002). These losses are handled through a variable modal coefficients method. For the first model, simulations never produce second register, for any of the open holes. For the second, the proportion of second-register production is close to the experiment for upstream holes, but remains at zero for downstream holes.


title: Poisson imbedding meets the Clark-Ocone formula

abstract: In this paper we develop a representation formula of Clark-Ocone type for any integrable Poisson functionals, which extends the Poisson imbedding for point processes. This representation formula differs from the classical Clark-Ocone formula on three accounts. First the representation holds with respect to the Poisson measure instead of the compensated one; second the representation holds true in L1 and not in L2; and finally contrary to the classical Clark-Ocone formula the integrand is defined as a pathwise operator and not as a L2-limiting object. We make use of Malliavin's calculus and of the pseudo-chaotic decomposition with uncompensated iteraded integrals to establish this Pseudo-Clark-Ocone representation formula and to characterize the integrand, which turns out to be a predictable integrable process.


title: Exclusive four pion photoproduction in ultraperipheral Pb-Pb collisions at $\sqrt{s_{\rm NN}} = 5.02$ TeV

abstract: The intense photon fluxes from relativistic nuclei provide an opportunity to study photonuclear interactions in ultraperipheral collisions. The measurement of coherently photoproduced $\pi^+\pi^-\pi^+\pi^-$ final states in ultraperipheral Pb-Pb collisions at $\sqrt{s_{\mathrm{NN}}}=5.02$ TeV is presented for the first time. The cross section, d$\sigma$/d$y$, times the branching ratio ($\rho\rightarrow \pi^+ \pi^+ \pi^- \pi^-$) is found to be $47.8\pm2.3~\rm{(stat.)}\pm7.7~\rm{(syst.)}$ mb in the rapidity interval $|y| < 0.5$. The invariant mass distribution is not well described with a single Breit-Wigner resonance. The production of two interfering resonances, $\rho(1450)$ and $\rho(1700)$, provides a good description of the data. The values of the masses ($m$) and widths ($\Gamma$) of the resonances extracted from the fit are $m_{1}=1385\pm14~\rm{(stat.)}\pm3~\rm{(syst.)}$ MeV/$c^2$, $\Gamma_{1}=431\pm36~\rm{(stat.)}\pm82~\rm{(syst.)}$ MeV/$c^2$, $m_{2}=1663\pm13~\rm{(stat.)}\pm22~\rm{(syst.)}$ MeV/$c^2$ and $\Gamma_{2}=357 \pm31~\rm{(stat.)}\pm49~\rm{(syst.)}$ MeV/$c^2$, respectively. The measured cross sections times the branching ratios are compared to recent theoretical predictions.


title: Content-Adaptive Non-Local Convolution for Remote Sensing Pansharpening

abstract: Currently, machine learning-based methods for remote sensing pansharpening have progressed rapidly. However, existing pansharpening methods often do not fully exploit differentiating regional information in non-local spaces, thereby limiting the effectiveness of the methods and resulting in redundant learning parameters. In this paper, we introduce a so-called content-adaptive non-local convolution (CANConv), a novel method tailored for remote sensing image pansharpening. Specifically, CANConv employs adaptive convolution, ensuring spatial adaptability, and incorporates non-local self-similarity through the similarity relationship partition (SRP) and the partition-wise adaptive convolution (PWAC) sub-modules. Furthermore, we also propose a corresponding network architecture, called CANNet, which mainly utilizes the multi-scale self-similarity. Extensive experiments demonstrate the superior performance of CANConv, compared with recent promising fusion methods. Besides, we substantiate the method's effectiveness through visualization, ablation experiments, and comparison with existing methods on multiple test sets. The source code is publicly available at https://github.com/duanyll/CANConv.


title: From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples

abstract: We analyze how well pre-trained large language models (e.g., Llama2, GPT-4, Claude 3, etc) can do linear and non-linear regression when given in-context examples, without any additional training or gradient updates. Our findings reveal that several large language models (e.g., GPT-4, Claude 3) are able to perform regression tasks with a performance rivaling (or even outperforming) that of traditional supervised methods such as Random Forest, Bagging, or Gradient Boosting. For example, on the challenging Friedman #2 regression dataset, Claude 3 outperforms many supervised methods such as AdaBoost, SVM, Random Forest, KNN, or Gradient Boosting. We then investigate how well the performance of large language models scales with the number of in-context exemplars. We borrow from the notion of regret from online learning and empirically show that LLMs are capable of obtaining a sub-linear regret.


title: Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversion

abstract: Accurate and dense depth estimation with stereo cameras and LiDAR is an important task for automatic driving and robotic perception. While sparse hints from LiDAR points have improved cost aggregation in stereo matching, their effectiveness is limited by the low density and non-uniform distribution. To address this issue, we propose a novel stereo-LiDAR depth estimation network with Semi-Dense hint Guidance, named SDG-Depth. Our network includes a deformable propagation module for generating a semi-dense hint map and a confidence map by propagating sparse hints using a learned deformable window. These maps then guide cost aggregation in stereo matching. To reduce the triangulation error in depth recovery from disparity, especially in distant regions, we introduce a disparity-depth conversion module. Our method is both accurate and efficient. The experimental results on benchmark tests show its superior performance. Our code is available at https://github.com/SJTU-ViSYS/SDG-Depth.


title: Decomposing Label Space, Format and Discrimination: Rethinking How LLMs Respond and Solve Tasks via In-Context Learning

abstract: In-context Learning (ICL) has emerged as a powerful capability alongside the development of scaled-up large language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without updating millions of parameters. However, the precise contributions of demonstrations towards improving end-task performance have not been thoroughly investigated in recent analytical studies. In this paper, we empirically decompose the overall performance of ICL into three dimensions, label space, format, and discrimination, and we evaluate four general-purpose LLMs across a diverse range of tasks. Counter-intuitively, we find that the demonstrations have a marginal impact on provoking discriminative knowledge of language models. However, ICL exhibits significant efficacy in regulating the label space and format which helps LLMs to respond in desired label words. We then demonstrate this ability functions similar to detailed instructions for LLMs to follow. We additionally provide an in-depth analysis of the mechanism of retrieval helping with ICL and find that retrieving the most semantically similar examples notably boosts model's discriminative capability.


title: Leveraging Eclipse MOSAIC for Modeling and Analyzing Ride-Hailing Services

abstract: Ride-hailing services enjoy a large popularity in the sector of individualized mobility. Due to broad availability, ease of use, and competitive pricing strategies, these services have established themselves throughout the last decades. With the increased popularity, ride-hailing providers aimed to consistently improve the efficiency of their services, leading to the inception of novel research questions. Many of which can be effectively tackled using simulation. In this paper, we present such a simulation-based approach using Eclipse MOSAIC in-hand with a large-scale traffic scenario of Berlin. We analyze real-world logbook data including detailed shifts of drivers and discuss how to integrate them with the simulation scenario. Moreover, we present extensions to MOSAIC required for the modeling of the ride-hailing services, utilizing the powerful Application Simulator. Accordingly, as the primary result of this paper, we managed to extend the Eclipse MOSAIC framework to be able to answer research questions in the domain of ride-hailing and ride-sharing. Additionally, in an initial exemplary study, we analyze the traffic and environmental impacts of different, yet basic, rebalancing strategies, finding non-negligible differences in mileages and pollutant emissions. We, furthermore, applied our findings to the entire ride-hailing fleet in the city of Berlin for one year, showcasing the impacts different rebalancing strategies could have on environment and general traffic. To our knowledge, the consideration of environmental factors on a city-wide scale is a novel contribution of this paper, not addressed in previous research.


title: DeVAIC: A Tool for Security Assessment of AI-generated Code

abstract: Context: AI code generators are revolutionizing code writing and software development, but their training on large datasets, including potentially untrusted source code, raises security concerns. Furthermore, these generators can produce incomplete code snippets that are challenging to evaluate using current solutions. Objective: This research work introduces DeVAIC (Detection of Vulnerabilities in AI-generated Code), a tool to evaluate the security of AI-generated Python code, which overcomes the challenge of examining incomplete code. Method: We followed a methodological approach that involved gathering vulnerable samples, extracting implementation patterns, and creating regular expressions to develop the proposed tool. The implementation of DeVAIC includes a set of detection rules based on regular expressions that cover 35 Common Weakness Enumerations (CWEs) falling under the OWASP Top 10 vulnerability categories. Results: We utilized four popular AI models to generate Python code, which we then used as a foundation to evaluate the effectiveness of our tool. DeVAIC demonstrated a statistically significant difference in its ability to detect security vulnerabilities compared to the state-of-the-art solutions, showing an F1 Score and Accuracy of 94% while maintaining a low computational cost of 0.14 seconds per code snippet, on average. Conclusions: The proposed tool provides a lightweight and efficient solution for vulnerability detection even on incomplete code.


title: Comments as Natural Logic Pivots: Improve Code Generation via Comment Perspective

abstract: Code generation aims to understand the problem description and generate corresponding code snippets, where existing works generally decompose such complex tasks into intermediate steps by prompting strategies, such as Chain-of-Thought and its variants. While these studies have achieved some success, their effectiveness is highly dependent on the capabilities of advanced Large Language Models (LLMs) such as GPT-4, particularly in terms of API calls, which significantly limits their practical applicability. Consequently, how to enhance the code generation capabilities of small and medium-scale code LLMs without significantly increasing training costs is an appealing challenge. In this paper, we suggest that code comments are the natural logic pivot between natural language and code language and propose using comments to boost the code generation ability of code LLMs. Concretely, we propose MANGO (comMents As Natural loGic pivOts), including a comment contrastive training strategy and a corresponding logical comment decoding strategy. Experiments are performed on HumanEval and MBPP, utilizing StarCoder and WizardCoder as backbone models, and encompassing model parameter sizes between 3B and 7B. The results indicate that MANGO significantly improves the code pass rate based on the strong baselines. Meanwhile, the robustness of the logical comment decoding strategy is notably higher than the Chain-of-thoughts prompting. The code is publicly available at \url{https://github.com/pppa2019/Mango}.


title: On the Borisov-Gunnells relations for products of Eisenstein series

abstract: Borisov and Gunnells have proved that certain linear combinations of products of Eisenstein series are Eisenstein series themselves, in analogy with the Manin 3-term relations for modular symbols. We devise a new method to determine and prove such relations, by differentiating with respect to the parameters of the Eisenstein series.


title: Event-Enhanced Snapshot Compressive Videography at 10K FPS

abstract: Video snapshot compressive imaging (SCI) encodes the target dynamic scene compactly into a snapshot and reconstructs its high-speed frame sequence afterward, greatly reducing the required data footprint and transmission bandwidth as well as enabling high-speed imaging with a low frame rate intensity camera. In implementation, high-speed dynamics are encoded via temporally varying patterns, and only frames at corresponding temporal intervals can be reconstructed, while the dynamics occurring between consecutive frames are lost. To unlock the potential of conventional snapshot compressive videography, we propose a novel hybrid "intensity+event" imaging scheme by incorporating an event camera into a video SCI setup. Our proposed system consists of a dual-path optical setup to record the coded intensity measurement and intermediate event signals simultaneously, which is compact and photon-efficient by collecting the half photons discarded in conventional video SCI. Correspondingly, we developed a dual-branch Transformer utilizing the reciprocal relationship between two data modes to decode dense video frames. Extensive experiments on both simulated and real-captured data demonstrate our superiority to state-of-the-art video SCI and video frame interpolation (VFI) methods. Benefiting from the new hybrid design leveraging both intrinsic redundancy in videos and the unique feature of event cameras, we achieve high-quality videography at 0.1ms time intervals with a low-cost CMOS image sensor working at 24 FPS.


title: Correspondence Research of the Most Probable Transition Paths between a Stochastic Interacting Particle System and its Mean Field Limit System

abstract: This paper derived the indirect approximation theorem of the most probable transition pathway of a stochastic interacting particle system in the mean field sense. This paper studied the problem of indirect approximation of the most probable transition pathway of an interacting particle system (i.e., a high-dimensional stochastic dynamic system) and its mean field limit equation (McKean-Vlasov stochastic differential equation). This study is based on the Onsager-Machlup action functional, reformulated the problem as an optimal control problem. With the stochastic Pontryagin's Maximum Principle, this paper completed the derivation. This paper proved the existence and uniqueness theorem of the solution to the mean field optimal control problem of McKean-Vlasov stochastic differential equations, and also established a system of equations satisfying the control parameters $\theta^{*}$ and $\theta^{N}$ respectively. There are few studies on the most probable transition pathways of stochastic interacting particle systems, it is still a great challenge to solve the most probable transition pathways directly or to approximate it with the mean field limit system. Therefore, this paper first gave the proof of correspondence between the core equation of Pontryagin's Maximum Principle, that is, Hamiltonian extreme condition equation. That is to say, this correspondence indirectly explain the correspondence between the most probable transition pathways of stochastic interacting particle systems and the mean field systems.


title: SFSORT: Scene Features-based Simple Online Real-Time Tracker

abstract: This paper introduces SFSORT, the world's fastest multi-object tracking system based on experiments conducted on MOT Challenge datasets. To achieve an accurate and computationally efficient tracker, this paper employs a tracking-by-detection method, following the online real-time tracking approach established in prior literature. By introducing a novel cost function called the Bounding Box Similarity Index, this work eliminates the Kalman Filter, leading to reduced computational requirements. Additionally, this paper demonstrates the impact of scene features on enhancing object-track association and improving track post-processing. Using a 2.2 GHz Intel Xeon CPU, the proposed method achieves an HOTA of 61.7\% with a processing speed of 2242 Hz on the MOT17 dataset and an HOTA of 60.9\% with a processing speed of 304 Hz on the MOT20 dataset. The tracker's source code, fine-tuned object detection model, and tutorials are available at \url{https://github.com/gitmehrdad/SFSORT}.


title: CAT: Contrastive Adapter Training for Personalized Image Generation

abstract: The emergence of various adapters, including Low-Rank Adaptation (LoRA) applied from the field of natural language processing, has allowed diffusion models to personalize image generation at a low cost. However, due to the various challenges including limited datasets and shortage of regularization and computation resources, adapter training often results in unsatisfactory outcomes, leading to the corruption of the backbone model's prior knowledge. One of the well known phenomena is the loss of diversity in object generation, especially within the same class which leads to generating almost identical objects with minor variations. This poses challenges in generation capabilities. To solve this issue, we present Contrastive Adapter Training (CAT), a simple yet effective strategy to enhance adapter training through the application of CAT loss. Our approach facilitates the preservation of the base model's original knowledge when the model initiates adapters. Furthermore, we introduce the Knowledge Preservation Score (KPS) to evaluate CAT's ability to keep the former information. We qualitatively and quantitatively compare CAT's improvement. Finally, we mention the possibility of CAT in the aspects of multi-concept adapter and optimization.


title: X-ray polarimetric features of Gamma-ray Bursts across varied redshifts and hints for Axion-Like-Particles

abstract: Polarimetric features during the prompt phase of Gamma-ray Bursts (GRBs) have been essential for elucidating the debated emission mechanisms and gaining insight into the inner structure of GRBs. However, the potential impact of photon-Axion-Like-Particle (ALP) mixing in extragalactic magnetic fields, leading to significant modifications to the initial polarization state, has been overlooked in discussions concerning prompt phase constraints. In this work, we first examine the statistical characteristics of linear polarization degree ($\Pi_{L}$) in GRBs, by utilizing data from polarimetric missions focusing on sub-MeV emissions. Our analysis, conducted with a restricted sample of GRBs spanning various redshifts, reveals a diverse distribution of $\Pi_{L}$, which currently shows no correlation with the GRBs' spectral parameters or properties of candidate host galaxies. We then explore alternations to the initial $\Pi_{L}$ due to photon-ALP mixing within a domain-like structure of the intergalactic magnetic field (${\bf B}_{\rm IGM} $). With the existence of ALPs with $m_{a}$$~$$\lesssim$$~$$10^{-14}$$~$eV and $g_{a\gamma}~$$\simeq$$~0.5\times10^{-11}$, the mixing leads to a decrease in the polarization degree of initially fully linearly polarized photons, while it induces a certain degree of polarization to initially unpolarized photons. To ensure that the effect of mixing is small enough to be negligible, the mixing term $\Delta_{a\gamma} \equiv 1/2\ g_{a\gamma} {\bf B}_{\rm IGM}$ should be less than $1.5\times 10^{-4}$ Mpc$^{-1}$. Currently, the number of GRBs with both sub-MeV polarization measurement and redshift confirmation remains very limited. Certification of redshift for GRBs with low $\Pi_{L}$ would further constrain the parameter space of ALPs or provide an independent means to determine the upper limit on ${\bf B}_{\rm IGM}$.


title: Attention-Aware Laparoscopic Image Desmoking Network with Lightness Embedding and Hybrid Guided Embedding

abstract: This paper presents a novel method of smoke removal from the laparoscopic images. Due to the heterogeneous nature of surgical smoke, a two-stage network is proposed to estimate the smoke distribution and reconstruct a clear, smoke-free surgical scene. The utilization of the lightness channel plays a pivotal role in providing vital information pertaining to smoke density. The reconstruction of smoke-free image is guided by a hybrid embedding, which combines the estimated smoke mask with the initial image. Experimental results demonstrate that the proposed method boasts a Peak Signal to Noise Ratio that is $2.79\%$ higher than the state-of-the-art methods, while also exhibits a remarkable $38.2\%$ reduction in run-time. Overall, the proposed method offers comparable or even superior performance in terms of both smoke removal quality and computational efficiency when compared to existing state-of-the-art methods. This work will be publicly available on http://homepage.hit.edu.cn/wpgao


title: Towards Secure and Reliable Heterogeneous Real-time Telemetry Communication in Autonomous UAV Swarms

abstract: In the era of cutting-edge autonomous systems, Unmanned Aerial Vehicles (UAVs) are becoming an essential part of the solutions for numerous complex challenges. This paper evaluates UAV peer-to-peer telemetry communication, highlighting its security vulnerabilities and explores a transition to a het-erogeneous multi-hop mesh all-to-all communication architecture to increase inter-swarm connectivity and reliability. Additionally, we suggest a symmetric key agreement and data encryption mechanism implementation for inter - swarm communication, to ensure data integrity and confidentiality without compromising performance.


title: Statistical Independence and the Brockwell Transform -- From an Integral Equation Perspective

abstract: Statistical independence is a notion ubiquitous in various fields such as in statistics, probability, number theory and physics. We establish the stability of independence for any pair of random variables by their corresponding Brockwell transforms (Brockwell, 2007) beyond the non-atomic condition that is naturally imposed on their distributions, thereby generalizing the proposition originated by Cai et al. (2022). A central novelty in our work is to formulate the problem as a possibly new type of mathematical inverse problem, which aims to claim that an integral equation has a unique solution in terms of its stochastic kernel -- not under-determined contrary to the usual cases, and also to design a recursive constructive scheme, combined with the property of the quantile function, that solves the aforementioned integral equation in an iterative manner.