title: Application of Machine Learning Method to Model-Based Library Approach to Critical Dimension Measurement by CD-SEM

abstract: The model-based library (MBL) method has already been established for the accurate measurement of critical dimension (CD) of semiconductor linewidth from a critical dimension scanning electron microscope (CD-SEM) image. In this work the MBL method has been further investigated by combing the CD-SEM image simulation with a neural network algorithm. The secondary electron linescan profiles were calculated at first by a Monte Carlo simulation method, enabling to obtain the dependence of linescan profiles on the selected values of various geometrical parameters (e.g., top CD, sidewall angle and height) for Si and Au trapezoidal line structures. The machine learning methods have then been applied to predicate the linescan profiles from a randomly selected training set of the calculated profiles. The predicted results agree very well with the calculated profiles with the standard deviation of 0.1% and 6% for the relative error distributions of Si and Au line structures, respectively. This result shows that the machine learning methods can be practically applied to the MBL method for the purpose of reducing the library size, accelerating the construction of the MBL database and enriching the content of an available MBL database.


title: Effective Backdoor Mitigation Depends on the Pre-training Objective

abstract: Despite the advanced capabilities of contemporary machine learning (ML) models, they remain vulnerable to adversarial and backdoor attacks. This vulnerability is particularly concerning in real-world deployments, where compromised models may exhibit unpredictable behavior in critical scenarios. Such risks are heightened by the prevalent practice of collecting massive, internet-sourced datasets for pre-training multimodal models, as these datasets may harbor backdoors. Various techniques have been proposed to mitigate the effects of backdooring in these models such as CleanCLIP which is the current state-of-the-art approach. In this work, we demonstrate that the efficacy of CleanCLIP in mitigating backdoors is highly dependent on the particular objective used during model pre-training. We observe that stronger pre-training objectives correlate with harder to remove backdoors behaviors. We show this by training multimodal models on two large datasets consisting of 3 million (CC3M) and 6 million (CC6M) datapoints, under various pre-training objectives, followed by poison removal using CleanCLIP. We find that CleanCLIP is ineffective when stronger pre-training objectives are used, even with extensive hyperparameter tuning. Our findings underscore critical considerations for ML practitioners who pre-train models using large-scale web-curated data and are concerned about potential backdoor threats. Notably, our results suggest that simpler pre-training objectives are more amenable to effective backdoor removal. This insight is pivotal for practitioners seeking to balance the trade-offs between using stronger pre-training objectives and security against backdoor attacks.


title: Vector-Quantized Prompt Learning for Paraphrase Generation

abstract: Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for paraphrase generation still lags behind largely due to the challenges in addressing the complex conflicts between expression diversity and semantic preservation. This paper proposes to generate diverse and high-quality paraphrases by exploiting the pre-trained models with instance-dependent prompts. To learn generalizable prompts, we assume that the number of abstract transforming patterns of paraphrase generation (governed by prompts) is finite and usually not large. Therefore, we present vector-quantized prompts as the cues to control the generation of pre-trained models. Extensive experiments demonstrate that the proposed method achieves new state-of-art results on three benchmark datasets, including Quora, Wikianswers, and MSCOCO. We will release all the code upon acceptance.


title: An exact solution for the magnetic diffusion problem with a step-function resistivity model

abstract: In the magnetic diffusion problem, a magnetic diffusion equation is coupled by an Ohmic heating energy equation. The Ohmic heating can make the magnetic diffusion coefficient (i. e., the resistivity) vary violently, and make the diffusion a highly nonlinear process. For this reason, the problem is normally very hard to be solved analytically. In this article, under the condition of a step-function resistivity and a constant boundary magnetic field, we successfully derived an exact solution for this nonlinear problem, which should be an interesting thing in the area of partial differential equations. What's more, the solution could serve as a valuable benchmark example for testing simulation methods of the magnetic diffusion problem.


title: Programmable high-dimensional Hamiltonian in a photonic waveguide array

abstract: Waveguide lattices offer a compact and stable platform for a range of applications, including quantum walks, topological effects, condensed matter system simulation, and classical and quantum information processing. In such lattices, the Hamiltonian's hopping and on-site terms determine the optical evolution, which can be engineered using waveguide spacing and refractive index profile. While waveguide lattices have been realized in various photonic platforms, these devices have always been static and designed for specific applications. We present a programmable waveguide array in which the Hamiltonian terms can be electro-optically tuned to implement various Hamiltonian continuous-time evolutions on a single device. We used a single array with 11 waveguides in lithium niobate, controlled via 22 electrodes, to perform a range of experiments that realized the Su-Schriffer-Heeger model, the Aubrey-Andre model, and Anderson localization, which is equivalent to over 2500 static devices. Our architecture's micron-scale local electric fields independently control waveguide coupling coefficients and effective indices, which overcomes cross-talk limitations of thermo-optic phase shifters in other platforms such as silicon, silicon-nitride, and silica. Electro-optic control allows for ultra-fast and more precise reconfigurability with lower power consumption, and with quantum input states, our platform can enable the study of multiple condensed matter quantum dynamics with a single device.


title: On the Number of $A$-mappings with Remainder

abstract: Mappings of a finite set into itself with restriction on the cycle lengths are considered (the so-called A-mappings). Asymptotics is given for the number of these mappings with a power-law reduction of the remainder.


title: A note on Galois groups of linearized polynomials

abstract: Let $L(X)$ be a monic $q$-linearized polynomial over $F_q$ of degree $q^n$, where $n$ is an odd prime. Recently Gow and McGuire showed that the Galois group of $L(X)/X-t$ over the field of rational functions $F_q(t)$ is $GL_n(q)$ unless $L(X)=X^{q^n}$. The case of even $q$ remained open, but it was conjectured that the result holds too and partial results were given. In this note we settle this conjecture. In fact we use Hensel's Lemma to give a unified proof for all prime powers $q$.


title: Imaging a Semi-Analytical Jet model Generated by 3D GRMHD Simulation

abstract: Employing 3D GRMHD simulation, we study the images of a geometrically thin jet, whose emissions concentrate on its surface, for accretion system surrounding a central spinning BH. By introducing a strong magnetic field, we observe three phases of BH accretion evolution: (a) initially, both the accretion rate and the magnetic flux on the horizon gradually increase; (b) at an intermediate stage, the magnetic flux approximately reaches saturation, and a jet forms via the Blandford-Znajek (BZ) mechanism; (c) ultimately, the entire system achieves a dynamic equilibrium, and a magnetically arrested disk (MAD) forms. We carefully study the jet images during the saturation and MAD regimes at various frequencies and from different observational angles. We reveal the presence of U-shaped brighter lines near the jet surface boundaries, which can be attributed to the photons whose trajectories skim over the jet surface. The existence of these brighter lines is a unique feature of a geometrically thin jet. Moreover, we notice that the jet images are relatively insensitive to the observed frequencies of interest. Additionally, we observe that the time-averaged images for the highly oscillating MAD regime show only slight differences from those of the saturation regime.


title: Identification of morphological fingerprint in perinatal brains using quasi-conformal mapping and contrastive learning

abstract: The morphological fingerprint in the brain is capable of identifying the uniqueness of an individual. However, whether such individual patterns are present in perinatal brains, and which morphological attributes or cortical regions better characterize the individual differences of ne-onates remain unclear. In this study, we proposed a deep learning framework that projected three-dimensional spherical meshes of three morphological features (i.e., cortical thickness, mean curvature, and sulcal depth) onto two-dimensional planes through quasi-conformal mapping, and employed the ResNet18 and contrastive learning for individual identification. We used the cross-sectional structural MRI data of 682 infants, incorporating with data augmentation, to train the model and fine-tuned the parameters based on 60 infants who had longitudinal scans. The model was validated on 30 longitudinal scanned infant data, and remarkable Top1 and Top5 accuracies of 71.37% and 84.10% were achieved, respectively. The sensorimotor and visual cortices were recognized as the most contributive regions in individual identification. Moreover, the folding morphology demonstrated greater discriminative capability than the cortical thickness, which could serve as the morphological fingerprint in perinatal brains. These findings provided evidence for the emergence of morphological fingerprints in the brain at the beginning of the third trimester, which may hold promising implications for understanding the formation of in-dividual uniqueness in the brain during early development.


title: Anomalous hot electron generation from two-plasmon decay instability driven by broadband laser pulses with intensity modulations

abstract: We investigate the hot electrons generated from two-plasmon decay (TPD) instability driven by laser pulses with intensity modulated by a frequency $\Delta \omega_m$. Our primary focus lies on scenarios where $\Delta \omega_m$ is on the same order of the TPD growth rate $ \gamma_0$ ( $\Delta \omega_m \sim \gamma_0$), corresponding to moderate laser frequency bandwidths for TPD mitigation. With $\Delta \omega_m$ conveniently modeled by a basic two-color scheme of the laser wave fields in fully-kinetic particle-in-cell simulations, we demonstrate that the energies of TPD modes and hot electrons exhibit intermittent evolution at the frequency $\Delta \omega_m$, particularly when $\Delta \omega_m \sim \gamma_0$. With the dynamic TPD behavior, the overall ratio of hot electron energy to the incident laser energy, $f_{hot}$, changes significantly with $\Delta \omega_m$. While $f_{hot}$ drops notably with increasing $\Delta \omega_m$ at large $\Delta \omega_m$ limit as expected, it goes anomalously beyond the hot electron energy ratio for a single-frequency incident laser pulse with the same average intensity when $\Delta \omega_m$ falls below a specific threshold frequency $\Delta \omega_c$. We find this threshold frequency primarily depends on $\gamma_0$ and the collisional damping rate of plasma waves, with relatively lower sensitivity to the density scale length. We develop a scaling model characterizing the relation of $\Delta \omega_c$ and laser plasma conditions, enabling the potential extention of our findings to more complex and realistic scenarios.


title: Multi-Scale Sub-Band Constant-Q Transform Discriminator for High-Fidelity Vocoder

abstract: Generative Adversarial Network (GAN) based vocoders are superior in inference speed and synthesis quality when reconstructing an audible waveform from an acoustic representation. This study focuses on improving the discriminator to promote GAN-based vocoders. Most existing time-frequency-representation-based discriminators are rooted in Short-Time Fourier Transform (STFT), whose time-frequency resolution in a spectrogram is fixed, making it incompatible with signals like singing voices that require flexible attention for different frequency bands. Motivated by that, our study utilizes the Constant-Q Transform (CQT), which owns dynamic resolution among frequencies, contributing to a better modeling ability in pitch accuracy and harmonic tracking. Specifically, we propose a Multi-Scale Sub-Band CQT (MS-SB-CQT) Discriminator, which operates on the CQT spectrogram at multiple scales and performs sub-band processing according to different octaves. Experiments conducted on both speech and singing voices confirm the effectiveness of our proposed method. Moreover, we also verified that the CQT-based and the STFT-based discriminators could be complementary under joint training. Specifically, enhanced by the proposed MS-SB-CQT and the existing MS-STFT Discriminators, the MOS of HiFi-GAN can be boosted from 3.27 to 3.87 for seen singers and from 3.40 to 3.78 for unseen singers.


title: Monge-Amp\`ere type equation on compact Hermitian manifolds

abstract: Given a cohomology $(1,1)$-class $\{\beta\}$ of compact Hermitian manifold $(X,\omega)$ possessing a bounded potential and fixed a model potential $\phi$, motivated by Darvas-Di Nezza-Lu and Li-Wang-Zhou's work, we show that degenerate complex Monge-Amp\`ere equation $(\beta+dd^c \varphi)^n=e^{\lambda \varphi}\mu$ has a unique solution in the relative full mass class $\mathcal{E}(X,\beta,\phi)$, where $\mu$ is a non-pluripolar measure on $X$ and $\lambda\geq0$ is a fixed constant. As an application, we give an explicit description of Lelong numbers of elements in $\mathcal{E}(X,\beta,\phi)$ which generalized a theorem of Darvas-Di Nezza-Lu in the Hermitian context.


title: Nonequilibrium hyperuniform states in active turbulence

abstract: We demonstrate that the complex spatiotemporal structure in active fluids can feature characteristics of hyperuniformity. Using a hydrodynamic model, we show that the transition from hyperuniformity to non-hyperuniformity and anti-hyperuniformity depends on the strength of active forcing and can be related to features of active turbulence without and with scaling characteristics of inertial turbulence. Combined with identified signatures of Levy walks and non-universal diffusion in these systems, this allows for a biological interpretation and the speculation of non-equilibrium hyperuniform states in active fluids as optimal states with respect to robustness and strategies of evasion and foraging.


title: Point Cloud Pre-training with Diffusion Models

abstract: Pre-training a model and then fine-tuning it on downstream tasks has demonstrated significant success in the 2D image and NLP domains. However, due to the unordered and non-uniform density characteristics of point clouds, it is non-trivial to explore the prior knowledge of point clouds and pre-train a point cloud backbone. In this paper, we propose a novel pre-training method called Point cloud Diffusion pre-training (PointDif). We consider the point cloud pre-training task as a conditional point-to-point generation problem and introduce a conditional point generator. This generator aggregates the features extracted by the backbone and employs them as the condition to guide the point-to-point recovery from the noisy point cloud, thereby assisting the backbone in capturing both local and global geometric priors as well as the global point density distribution of the object. We also present a recurrent uniform sampling optimization strategy, which enables the model to uniformly recover from various noise levels and learn from balanced supervision. Our PointDif achieves substantial improvement across various real-world datasets for diverse downstream tasks such as classification, segmentation and detection. Specifically, PointDif attains 70.0% mIoU on S3DIS Area 5 for the segmentation task and achieves an average improvement of 2.4% on ScanObjectNN for the classification task compared to TAP. Furthermore, our pre-training framework can be flexibly applied to diverse point cloud backbones and bring considerable gains.


title: Repetition factorization of automatic sequences

abstract: Following Inoue et al., we define a word to be a repetition if it is a (fractional) power of exponent at least 2. A word has a repetition factorization if it is the product of repetitions. We study repetition factorizations in several (generalized) automatic sequences, including the infinite Fibonacci word, the Thue-Morse word, paperfolding words, and the Rudin-Shapiro sequence.


title: Self-Amplification-Assisted Highly Efficient Integrated Laser

abstract: Light source is indispensable component in on-chip system. Compared with hybrid or heterogeneous integrated laser, monolithically integrated laser is more suitable for high density photonic integrated circuit (PIC) since the capability of large-scale manufacturing, lower active-passive coupling loss and less test complexity. Recent years have seen the spark of researches on rare-earth ion doped thin film lithium niobate (REI:TFLN), demonstrations have been made both in classical and quantum chips. However, low output power and limited quantum emitting efficiency hinder the application of the chip-scale laser source based on REI:TFLN. Here a highly efficient integrated laser assisted by cascaded amplifiers is proposed and experimentally prepared on Erbium-doped TFLN. A slope efficiency of 0.43% and a linewidth of 47.86 kHz are obtained. The maximum integrated laser power is 7.989 {\mu}W. Our results show a viable solution to improve efficiency by self-amplification without changing the intrinsic quantum emitting efficiency of the material, and our design has potential application in incorporating with functional devices such as optical communications, integrated quantum memory and quantum emission.


title: Precision spectrophotometry for PNLF distances: the case of NGC 300

abstract: The Multi-Unit Spectroscopic Explorer (MUSE) has enabled a renaissance of the planetary nebula luminosity function (PNLF) as a standard candle. In the case of NGC 300, we learned that the precise spectrophotometry of MUSE was crucial to obtain an accurate PNLF distance. We present the advantage of the integral field spectrograph compared to the slit spectrograph in delivering precise spectrophotometry by simulating a slit observation on integral field spectroscopy data. We also discuss the possible systematic shift in measuring the PNLF distance using the least-square method, especially when the PNLF cutoff is affected by small number statistics.


title: Selective Inference for Changepoint detection by Recurrent Neural Network

abstract: In this study, we investigate the quantification of the statistical reliability of detected change points (CPs) in time series using a Recurrent Neural Network (RNN). Thanks to its flexibility, RNN holds the potential to effectively identify CPs in time series characterized by complex dynamics. However, there is an increased risk of erroneously detecting random noise fluctuations as CPs. The primary goal of this study is to rigorously control the risk of false detections by providing theoretically valid p-values to the CPs detected by RNN. To achieve this, we introduce a novel method based on the framework of Selective Inference (SI). SI enables valid inferences by conditioning on the event of hypothesis selection, thus mitigating selection bias. In this study, we apply SI framework to RNN-based CP detection, where characterizing the complex process of RNN selecting CPs is our main technical challenge. We demonstrate the validity and effectiveness of the proposed method through artificial and real data experiments.


title: A Finitary Adjoint Functor Theorem

abstract: Graduated locally finitely presentable categories are introduced, examples include categories of sets, vector spaces, posets, presheaves and Boolean algebras. A finitary functor between graduated locally finitely presentable categories is proved to be a right adjoint if and only if it preserves countable limits. For endofunctors on vector spaces or pointed sets even countable products are sufficient. Surprisingly, for set functors there is a single exception of a (trivial) finitary functor preserving countable products but not countable limits.


title: Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domains

abstract: High-risk domains pose unique challenges that require language models to provide accurate and safe responses. Despite the great success of large language models (LLMs), such as ChatGPT and its variants, their performance in high-risk domains remains unclear. Our study delves into an in-depth analysis of the performance of instruction-tuned LLMs, focusing on factual accuracy and safety adherence. To comprehensively assess the capabilities of LLMs, we conduct experiments on six NLP datasets including question answering and summarization tasks within two high-risk domains: legal and medical. Further qualitative analysis highlights the existing limitations inherent in current LLMs when evaluating in high-risk domains. This underscores the essential nature of not only improving LLM capabilities but also prioritizing the refinement of domain-specific metrics, and embracing a more human-centric approach to enhance safety and factual reliability. Our findings advance the field toward the concerns of properly evaluating LLMs in high-risk domains, aiming to steer the adaptability of LLMs in fulfilling societal obligations and aligning with forthcoming regulations, such as the EU AI Act.


title: Improved determination of the oscillator parameters in nuclei

abstract: The oscillator parameter in nuclei is refitted to reproduce the available charge radius data. As an important improvement, we include the Coulomb term evaluated within the assumption of a uniformly charged sphere, and take into account the symmetry effect induced by the difference between N and Z numbers in a straightforward manner using the conventional parameterization. The Coulomb interaction has repulsive effect, causing the wave functions to extend further toward the nucleus exterior, resulting in an effectively larger oscillator length parameter. The symmetry effect is attractive for protons in neutron-rich nuclei and for neutrons in proton-rich nuclei, and repulsive for the other cases. Therefore, three distinct oscillator parameters are determined: one for protons, one for neutrons, and one isospin-invariant version, which is obtained by subtracting the Coulomb and symmetry contributions. Additionally, we explore the direct fit of the harmonic oscillator wave functions to the eigenfunctions of the Hartree-Fock mean field using the Skyrme interaction. Generally, this method agrees well with the others for light nuclei, typically up to $^{40}$Ca. Beyond this nucleus, however, the results begin to diverge over the orbits chosen for the fit. Only the parameters values obtained for the last occupied states agree remarkably well with the conventional ones throughout the mass range under consideration.


title: Hide Your Model: A Parameter Transmission-free Federated Recommender System

abstract: With the growing concerns regarding user data privacy, Federated Recommender System (FedRec) has garnered significant attention recently due to its privacy-preserving capabilities. Existing FedRecs generally adhere to a learning protocol in which a central server shares a global recommendation model with clients, and participants achieve collaborative learning by frequently communicating the model's public parameters. Nevertheless, this learning framework has two drawbacks that limit its practical usability: (1) It necessitates a global-sharing recommendation model; however, in real-world scenarios, information related to the recommender model, including its algorithm and parameters, constitutes the platforms' intellectual property. Hence, service providers are unlikely to release such information actively. (2) The communication costs of model parameter transmission are expensive since the model parameters are usually high-dimensional matrices. With the model size increasing, the communication burden will be the bottleneck for such traditional FedRecs. Given the above limitations, this paper introduces a novel parameter transmission-free federated recommendation framework that balances the protection between users' data privacy and platforms' model privacy, namely PTF-FedRec. Specifically, participants in PTF-FedRec collaboratively exchange knowledge by sharing their predictions within a privacy-preserving mechanism. Through this way, the central server can learn a recommender model without disclosing its model parameters or accessing clients' raw data, preserving both the server's model privacy and users' data privacy. Besides, since clients and the central server only need to communicate prediction scores which are just a few real numbers, the overhead is significantly reduced compared to traditional FedRecs. The code is available at\url{https://github.com/hi-weiyuan/PTF-FedRec}.


title: Completeness of Riemannian metrics: an application to the control of constrained mechanical systems

abstract: We introduce a mathematical technique based on modifying a given Riemannian metric and we investigate its applicability to controlling and stabilizing constrained mechanical systems. In essence our result is based on the construction of a complete Riemannian metric in the modified space where the constraint is included. In particular this can be applied to the controlled Lagrangians technique Bloch et al. [2000b, 2001] modifying its metric to additionally cover mechanical systems with configuration constraints via control. The technique used consists of approximating incomplete Riemannian metrics by complete ones, modifying the evolution near a boundary and finding a controller satisfying a given design criterion.


title: UWB Radar SLAM: an Anchorless Approach in Vision Denied Indoor Environments

abstract: LiDAR and cameras are frequently used as sensors for simultaneous localization and mapping (SLAM). However, these sensors are prone to failure under low visibility (e.g. smoke) or places with reflective surfaces (e.g. mirrors). On the other hand, electromagnetic waves exhibit better penetration properties when the wavelength increases, thus are not affected by low visibility. Hence, this paper presents ultra-wideband (UWB) radar as an alternative to the existing sensors. UWB is generally known to be used in anchor-tag SLAM systems. One or more anchors are installed in the environment and the tags are attached to the robots. Although this method performs well under low visibility, modifying the existing infrastructure is not always feasible. UWB has also been used in peer-to-peer ranging collaborative SLAM systems. However, this requires more than a single robot and does not include mapping in the mentioned environment like smoke. Therefore, the presented approach in this paper solely depends on the UWB transceivers mounted on-board. In addition, an extended Kalman filter (EKF) SLAM is used to solve the SLAM problem at the back-end. Experiments were conducted and demonstrated that the proposed UWB-based radar SLAM is able to map natural point landmarks inside an indoor environment while improving robot localization.


title: Segmentation of diagnostic tissue compartments on whole slide images with renal thrombotic microangiopathies (TMAs)

abstract: The thrombotic microangiopathies (TMAs) manifest in renal biopsy histology with a broad spectrum of acute and chronic findings. Precise diagnostic criteria for a renal biopsy diagnosis of TMA are missing. As a first step towards a machine learning- and computer vision-based analysis of wholes slide images from renal biopsies, we trained a segmentation model for the decisive diagnostic kidney tissue compartments artery, arteriole, glomerulus on a set of whole slide images from renal biopsies with TMAs and Mimickers (distinct diseases with a similar nephropathological appearance as TMA like severe benign nephrosclerosis, various vasculitides, Bevacizumab-plug glomerulopathy, arteriolar light chain deposition disease). Our segmentation model combines a U-Net-based tissue detection with a Shifted windows-transformer architecture to reach excellent segmentation results for even the most severely altered glomeruli, arterioles and arteries, even on unseen staining domains from a different nephropathology lab. With accurate automatic segmentation of the decisive renal biopsy compartments in human renal vasculopathies, we have laid the foundation for large-scale compartment-specific machine learning and computer vision analysis of renal biopsy repositories with TMAs.


title: Leveraging Neural Networks with Attention Mechanism for High-Order Accuracy in Charge Density in Particle-in-Cell Simulation

abstract: In this research, we introduce an innovative three-network architecture that comprises an encoder-decoder framework with an attention mechanism. The architecture comprises a 1st-order-pre-trainer, a 2nd-order-improver, and a discriminator network, designed to boost the order accuracy of charge density in Particle-In-Cell (PIC) simulations. We acquire our training data from our self-developed 3-D PIC code, JefiPIC. The training procedure starts with the 1st-order-pre-trainer, which is trained on a large dataset to predict charge densities based on the provided article positions. Subsequently, we fine-tune the 1st-order-pre-trainer, whose predictions then serve as inputs to the 2nd-order-improver. Meanwhile, we train the 2nd-order-improver and discriminator network using a smaller volume of 2nd-order data, thereby achieving to generate charge density with 2nd-order accuracy. In the concluding phase, we replace JefiPIC's conventional particle interpolation process with our trained neural network. Our results demonstrate that the neural network-enhanced PIC simulation can effectively simulate plasmas with 2 nd-order accuracy. This highlights the advantage of our proposed neural network: it can achieve higher-accuracy data with fewer real labels.


title: A limit theorem of nonlinear filtering for multiscale McKean-Vlasov stochastic systems

abstract: The work concerns about multiscale McKean-Vlasov stochastic systems. First of all, we prove an average principle for these systems in the $L^2$ sense. Moreover, a convergence rate is presented. Then we define the nonlinear filtering of these systems and establish a limit theorem about nonlinear filtering of them in the $L^2$ sense.


title: Active Surface with Passive Omni-Directional Adaptation of Soft Polyhedral Fingers for In-Hand Manipulation

abstract: Track systems effectively distribute loads, augmenting traction and maneuverability on unstable terrains, leveraging their expansive contact areas. This tracked locomotion capability also aids in hand manipulation of not only regular objects but also irregular objects. In this study, we present the design of a soft robotic finger with an active surface on an omni-adaptive network structure, which can be easily installed on existing grippers and achieve stability and dexterity for in-hand manipulation. The system's active surfaces initially transfer the object from the fingertip segment with less compliance to the middle segment of the finger with superior adaptability. Despite the omni-directional deformation of the finger, in-hand manipulation can still be executed with controlled active surfaces. We characterized the soft finger's stiffness distribution and simplified models to assess the feasibility of repositioning and reorienting a grasped object. A set of experiments on in-hand manipulation was performed with the proposed fingers, demonstrating the dexterity and robustness of the strategy.


title: Eliminating Domain Bias for Federated Learning in Representation Space

abstract: Recently, federated learning (FL) is popular for its privacy-preserving and collaborative learning abilities. However, under statistically heterogeneous scenarios, we observe that biased data domains on clients cause a representation bias phenomenon and further degenerate generic representations during local training, i.e., the representation degeneration phenomenon. To address these issues, we propose a general framework Domain Bias Eliminator (DBE) for FL. Our theoretical analysis reveals that DBE can promote bi-directional knowledge transfer between server and client, as it reduces the domain discrepancy between server and client in representation space. Besides, extensive experiments on four datasets show that DBE can greatly improve existing FL methods in both generalization and personalization abilities. The DBE-equipped FL method can outperform ten state-of-the-art personalized FL methods by a large margin. Our code is public at https://github.com/TsingZ0/DBE.


title: Distributed Consensus of Heterogeneous Multi-Agent Systems Based on Feedforward Control

abstract: This paper studies the consensus problem of heterogeneous multi-agent systems by the feedforward control and linear quadratic (LQ) optimal control theory. Different from the existing consensus control algorithms, which require to design an additional distributed observer for estimating the leader's information and to solve a set of regulator equations. In this paper, by designing a distributed feedforward controller, a non-standard neighbor error system is transformed into a standard linear system, and then an optimal consensus controller is designed by minimizing a combined state error with neighbour agents. The proposed optimal controller is obtained by solving Riccati equations, and it is shown that the corresponding cost function under the proposed distributed controllers is asymptotically optimal. The proposed consensus algorithm can be directly applicable to solve the consensus problem of homogeneous systems. Simulation example indicates the effectiveness of the proposed scheme and a much faster convergence speed than the existing algorithm.


title: Incorporating granularity bias as the margin into contrastive loss for video captioning

abstract: Video captioning models easily suffer from long-tail distribution of phrases, which makes captioning models prone to generate vague sentences instead of accurate ones. However, existing debiasing strategies tend to export external knowledge to build dependency trees of words or refine frequency distribution by complex losses and extra input features, which lack interpretability and are hard to train. To mitigate the impact of granularity bias on the model, we introduced a statistical-based bias extractor. This extractor quantifies the information content within sentences and videos, providing an estimate of the likelihood that a video-sentence pair is affected by granularity bias. Furthermore, with the growing trend of integrating contrastive learning methods into video captioning tasks, we use a bidirectional triplet loss to get more negative samples in a batch. Subsequently, we incorporate the margin score into the contrastive learning loss, establishing distinct training objectives for head and tail sentences. This approach facilitates the model's training effectiveness on tail samples. Our simple yet effective loss, incorporating Granularity bias, is referred to as the Margin-Contrastive Loss (GMC Loss). The proposed model demonstrates state-of-the-art performance on MSRVTT with a CIDEr of 57.17, and MSVD, where CIDEr reaches up to 138.68.


title: On Moebius maps which are characterised by the configuration ot their dual maps

abstract: Here we consider piecewise fractional linear maps with three branches. The paper presents a study of invariant measures with densities which can be written as infinite series. These series either have infinitely many poles or they sum up to a function with just one pole.


title: Adaptive time delay based control of non-collocated oscillatory systems

abstract: Time delay based control, recently proposed for non-collocated fourth-order systems, has several advantages over an observer-based state-feedback compensation of the low-damped oscillations in output. In this paper, we discuss a practical infeasibility of such observer-based approach and bring forward application of the time delay based controller, which is simple in both the structure and design. Moreover, robust estimation of the output oscillation frequency is used and extended by a bias canceling. The latter is required for positioning the oscillatory passive loads. This way, an adaptive version of time delay-based control is realized that does not require prior knowledge of the mass and stiffness parameters. The results are demonstrated on the oscillatory experimental setup with constraints in the operation range and control value.


title: Energy scattering for the unsteady damped nonlinear Schrodinger equation

abstract: We investigate the large time behavior of the solutions to the nonlinear focusing Schr\"odinger equation with a time-dependent damping in the energy sub-critical regime. Under non classical assumptions on the unsteady damping term, we prove some scattering results in the energy space.


title: Multi-task Planar Reconstruction with Feature Warping Guidance

abstract: Piece-wise planar 3D reconstruction simultaneously segments plane instances and recovers their 3D plane parameters from an image, which is particularly useful for indoor or man-made environments. Efficient reconstruction of 3D planes coupled with semantic predictions offers advantages for a wide range of applications requiring scene understanding and concurrent spatial mapping. However, most existing planar reconstruction models either neglect semantic predictions or do not run efficiently enough for real-time applications. We introduce SOLOPlanes, a real-time planar reconstruction model based on a modified instance segmentation architecture which simultaneously predicts semantics for each plane instance, along with plane parameters and piece-wise plane instance masks. We achieve an improvement in instance mask segmentation by including multi-view guidance for plane predictions in the training process. This cross-task improvement, training for plane prediction but improving the mask segmentation, is due to the nature of feature sharing in multi-task learning. Our model simultaneously predicts semantics using single images at inference time, while achieving real-time predictions at 43 FPS.


title: Active Queue Management with Data-Driven Delay Violation Probability Predictors

abstract: The increasing demand for latency-sensitive applications has necessitated the development of sophisticated algorithms that efficiently manage packets with end-to-end delay targets traversing the networked infrastructure. Network components must consider minimizing the packets' end-to-end delay violation probabilities (DVP) as a guiding principle throughout the transmission path to ensure timely deliveries. Active queue management (AQM) schemes are commonly used to mitigate congestion by dropping packets and controlling queuing delay. Today's established AQM schemes are threshold-driven, identifying congestion and trigger packet dropping using a predefined criteria which is unaware of packets' DVPs. In this work, we propose a novel framework, Delta, that combines end-to-end delay characterization with AQM for minimizing DVP. In a queuing theoretic environment, we show that such a policy is feasible by utilizing a data-driven approach to predict the queued packets' DVPs. That enables Delta AQM to effectively handle links with arbitrary stationary service time processes. The implementation is described in detail, and its performance is evaluated and compared with state of the art AQM algorithms. Our results show the Delta outperforms current AQM schemes substantially, in particular in scenarios where high reliability, i.e. high quantiles of the tail latency distribution, are of interest.


title: Neural Network Based Approach to Recognition of Meteor Tracks in the Mini-EUSO Telescope Data

abstract: Mini-EUSO is a wide-angle fluorescence telescope that registers ultraviolet (UV) radiation in the nocturnal atmosphere of Earth from the International Space Station. Meteors are among multiple phenomena that manifest themselves not only in the visible range but also in the UV. We present two simple artificial neural networks that allow for recognizing meteor signals in the Mini-EUSO data with high accuracy in terms of a binary classification problem. We expect that similar architectures can be effectively used for signal recognition in other fluorescence telescopes, regardless of the nature of the signal. Due to their simplicity, the networks can be implemented in onboard electronics of future orbital or balloon experiments.


title: Matrix regularization for gauge theories

abstract: We consider how gauge theories can be described by matrix models. Conventional matrix regularization is defined for scalar functions and is not applicable to gauge fields, which are connections of fiber bundles. We clarify how the degrees of freedom of gauge fields are related to the matrix degrees of freedom, by formulating the Seiberg-Witten map between them.


title: Temporal Volatility Surface Projection: Parametric Surface Projection Method for Derivatives Portfolio Risk Management

abstract: This study delves into the intricate realm of risk evaluation within the domain of specific financial derivatives, notably options. Unlike other financial instruments, like bonds, options are susceptible to broader risks. A distinctive trait characterizing this category of instruments is their non-linear price behavior relative to their pricing parameters. Consequently, evaluating the risk of these securities is notably more intricate when juxtaposed with analogous scenarios involving fixed-income instruments, such as debt securities. A paramount facet in options risk assessment is the inherent uncertainty stemming from first-order fluctuations in the underlying asset's volatility. The dynamic patterns of volatility fluctuations manifest striking resemblances to the interest rate risk associated with zero-coupon bonds. However, it is imperative to bestow heightened attention on this risk category due to its dependence on a more extensive array of variables and the temporal variability inherent in these variables. This study scrutinizes the methodological approach to risk assessment by leveraging the implied volatility surface as a foundational component, thereby diverging from the reliance on a singular estimate of the underlying asset's volatility.


title: SAME++: A Self-supervised Anatomical eMbeddings Enhanced medical image registration framework using stable sampling and regularized transformation

abstract: Image registration is a fundamental medical image analysis task. Ideally, registration should focus on aligning semantically corresponding voxels, i.e., the same anatomical locations. However, existing methods often optimize similarity measures computed directly on intensities or on hand-crafted features, which lack anatomical semantic information. These similarity measures may lead to sub-optimal solutions where large deformations, complex anatomical differences, or cross-modality imagery exist. In this work, we introduce a fast and accurate method for unsupervised 3D medical image registration building on top of a Self-supervised Anatomical eMbedding (SAM) algorithm, which is capable of computing dense anatomical correspondences between two images at the voxel level. We name our approach SAM-Enhanced registration (SAME++), which decomposes image registration into four steps: affine transformation, coarse deformation, deep non-parametric transformation, and instance optimization. Using SAM embeddings, we enhance these steps by finding more coherent correspondence and providing features with better semantic guidance. We extensively evaluated SAME++ using more than 50 labeled organs on three challenging inter-subject registration tasks of different body parts. As a complete registration framework, SAME++ markedly outperforms leading methods by $4.2\%$ - $8.2\%$ in terms of Dice score while being orders of magnitude faster than numerical optimization-based methods. Code is available at \url{https://github.com/alibaba-damo-academy/same}.


title: Reconstruction of a Long-term spatially Contiguous Solar-Induced Fluorescence (LCSIF) over 1982-2022

abstract: Satellite-observed solar-induced chlorophyll fluorescence (SIF) is a powerful proxy for diagnosing the photosynthetic characteristics of terrestrial ecosystems. Despite the increasing spatial and temporal resolutions of these satellite retrievals, records of SIF are primarily limited to the recent decade, impeding their application in detecting long-term dynamics of ecosystem function and structure. In this study, we leverage the two surface reflectance bands (red and near-infrared) available both from Advanced Very High-Resolution Radiometer (AVHRR, 1982-2022) and MODerate-resolution Imaging Spectroradiometer (MODIS, 2001-2022). Importantly, we calibrate and orbit-correct the AVHRR bands against their MODIS counterparts during their overlapping period. Using the long-term bias-corrected reflectance data, a neural network is then built to reproduce the Orbiting Carbon Observatory-2 SIF using AVHRR and MODIS, and used to map SIF globally over the entire 1982-2022 period. Compared with the previous MODIS-based CSIF product relying on four reflectance bands, our two-band-based product has similar skill but can be advantageously extended to the bias-corrected AVHRR period. Further comparison with three widely used vegetation indices (NDVI, kNDVI, NIRv; all based empirically on red and near-infrared bands) shows a higher or comparable correlation of LCSIF with satellite SIF and site-level GPP estimates across vegetation types, ensuring a greater capacity of LCSIF for representing terrestrial photosynthesis. Globally, LCSIF-AVHRR shows an accelerating upward trend since 1982, with an average rate of 0.0025 mW m-2 nm-1 sr-1 per decade during 1982-2000 and 0.0038 mW m-2 nm-1 sr-1 per decade during 2001-2022. Our LCSIF data provide opportunities to better understand the long-term dynamics of ecosystem photosynthesis and their underlying driving processes.


title: The Performance Analysis of Spectrum Sharing between UAV enabled Wireless Mesh Networks and Ground Networks

abstract: Unmanned aerial vehicle (UAV) has the advantages of large coverage and flexibility, which could be applied in disaster management to provide wireless services to the rescuers and victims. When UAVs forms an aerial mesh network, line-of-sight (LoS) air-to-air (A2A) communications have long transmission distance, which extends the coverage of multiple UAVs. However, the capacity of UAV is constrained due to the multiple hop transmissions in aerial mesh networks. In this paper, spectrum sharing between UAV enabled wireless mesh networks and ground networks is studied to improve the capacity of UAV networks. Considering two-dimensional (2D) and three-dimensional (3D) homogeneous Poisson point process (PPP) modeling for the distribution of UAVs within a vertical range {\Delta}h, stochastic geometry is applied to analyze the impact of the height of UAVs, the transmit power of UAVs, the density of UAVs and the vertical range, etc., on the coverage probability of ground network user and UAV network user. Besides, performance improvement of spectrum sharing with directional antenna is verified. With the object function of maximizing the transmission capacity, the optimal altitude of UAVs is obtained. This paper provides a theoretical guideline for the spectrum sharing of UAV enabled wireless mesh networks, which may contribute significant value to the study of spectrum sharing mechanisms for UAV enabled wireless mesh networks.


title: Topological complexity of monotone symplectic manifolds

abstract: We study Farber's topological complexity for monotone symplectic manifolds. More precisely, we estimate the topological complexity of 4-dimensional spherically monotone manifolds whose Kodaira dimension is not $-\infty$.


title: View it like a radiologist: Shifted windows for deep learning augmentation of CT images

abstract: Deep learning has the potential to revolutionize medical practice by automating and performing important tasks like detecting and delineating the size and locations of cancers in medical images. However, most deep learning models rely on augmentation techniques that treat medical images as natural images. For contrast-enhanced Computed Tomography (CT) images in particular, the signals producing the voxel intensities have physical meaning, which is lost during preprocessing and augmentation when treating such images as natural images. To address this, we propose a novel preprocessing and intensity augmentation scheme inspired by how radiologists leverage multiple viewing windows when evaluating CT images. Our proposed method, window shifting, randomly places the viewing windows around the region of interest during training. This approach improves liver lesion segmentation performance and robustness on images with poorly timed contrast agent. Our method outperforms classical intensity augmentations as well as the intensity augmentation pipeline of the popular nn-UNet on multiple datasets.


title: Precise QCD predictions for W-boson production in association with a charm jet

abstract: The production of a $W$-boson with a charm quark jet provides a highly sensitive probe of the strange quark distribution in the proton. Employing a novel flavour dressing procedure to define charm quark jets, we compute $W$+charm-jet production up to next-to-next-to-leading order (NNLO) in QCD. We study the perturbative stability of production cross sections with same-sign and opposite-sign charge combinations for the $W$ boson and the charm jet. A detailed breakdown according to different partonic initial states allows us to identify particularly suitable observables for the study of the quark parton distributions of different flavours.


title: Model-free Reinforcement Learning for ${H_{2}/H_{\infty}}$ Control of Stochastic Discrete-time Systems

abstract: This paper proposes a reinforcement learning (RL) algorithm for infinite horizon $\rm {H_{2}/H_{\infty}}$ problem in a class of stochastic discrete-time systems, rather than using a set of coupled generalized algebraic Riccati equations (GAREs). The algorithm is able to learn the optimal control policy for the system even when its parameters are unknown. Additionally, the paper explores the effect of detection noise as well as the convergence of the algorithm, and shows that the control policy is admissible after a finite number of iterations. The algorithm is also able to handle multi-objective control problems within stochastic fields. Finally, the algorithm is applied to the F-16 aircraft autopilot with multiplicative noise.


title: Coordinate-Aware Modulation for Neural Fields

abstract: Neural fields, mapping low-dimensional input coordinates to corresponding signals, have shown promising results in representing various signals. Numerous methodologies have been proposed, and techniques employing MLPs and grid representations have achieved substantial success. MLPs allow compact and high expressibility, yet often suffer from spectral bias and slow convergence speed. On the other hand, methods using grids are free from spectral bias and achieve fast training speed, however, at the expense of high spatial complexity. In this work, we propose a novel way for exploiting both MLPs and grid representations in neural fields. Unlike the prevalent methods that combine them sequentially (extract features from the grids first and feed them to the MLP), we inject spectral bias-free grid representations into the intermediate features in the MLP. More specifically, we suggest a Coordinate-Aware Modulation (CAM), which modulates the intermediate features using scale and shift parameters extracted from the grid representations. This can maintain the strengths of MLPs while mitigating any remaining potential biases, facilitating the rapid learning of high-frequency components. In addition, we empirically found that the feature normalizations, which have not been successful in neural filed literature, proved to be effective when applied in conjunction with the proposed CAM. Experimental results demonstrate that CAM enhances the performance of neural representation and improves learning stability across a range of signals. Especially in the novel view synthesis task, we achieved state-of-the-art performance with the least number of parameters and fast training speed for dynamic scenes and the best performance under 1MB memory for static scenes. CAM also outperforms the best-performing video compression methods using neural fields by a large margin.


title: Exploring Causal Learning through Graph Neural Networks: An In-depth Review

abstract: In machine learning, exploring data correlations to predict outcomes is a fundamental task. Recognizing causal relationships embedded within data is pivotal for a comprehensive understanding of system dynamics, the significance of which is paramount in data-driven decision-making processes. Beyond traditional methods, there has been a surge in the use of graph neural networks (GNNs) for causal learning, given their capabilities as universal data approximators. Thus, a thorough review of the advancements in causal learning using GNNs is both relevant and timely. To structure this review, we introduce a novel taxonomy that encompasses various state-of-the-art GNN methods employed in studying causality. GNNs are further categorized based on their applications in the causality domain. We further provide an exhaustive compilation of datasets integral to causal learning with GNNs to serve as a resource for practical study. This review also touches upon the application of causal learning across diverse sectors. We conclude the review with insights into potential challenges and promising avenues for future exploration in this rapidly evolving field of machine learning.


title: Gohberg-Semencul Estimation of Toeplitz Structured Covariance Matrices and Their Inverses

abstract: When only few data samples are accessible, utilizing structural prior knowledge is essential for estimating covariance matrices and their inverses. One prominent example is knowing the covariance matrix to be Toeplitz structured, which occurs when dealing with wide sense stationary (WSS) processes. This work introduces a novel class of positive definiteness ensuring likelihood-based estimators for Toeplitz structured covariance matrices (CMs) and their inverses. In order to accomplish this, we derive positive definiteness enforcing constraint sets for the Gohberg-Semencul (GS) parameterization of inverse symmetric Toeplitz matrices. Motivated by the relationship between the GS parameterization and autoregressive (AR) processes, we propose hyperparameter tuning techniques, which enable our estimators to combine advantages from state-of-the-art likelihood and non-parametric estimators. Moreover, we present a computationally cheap closed-form estimator, which is derived by maximizing an approximate likelihood. Due to the ensured positive definiteness, our estimators perform well for both the estimation of the CM and the inverse covariance matrix (ICM). Extensive simulation results validate the proposed estimators' efficacy for several standard Toeplitz structured CMs commonly employed in a wide range of applications.


title: Our Dark Matter Stopping in the Earth

abstract: We have worked for some time on a model for dark matter, in which dark matter consists of small bubbles of a new speculated type of vacuum, which are pumped up by some ordinary matter such as diamond, so as to resist the pressure of the domain wall separating the two vacua. Here we put forward thoughts on, how such macroscopic pearls would have their surrounding dust cleaned off passing through the atmosphere and the Earth, and what their distribution would be as a function of the depth of their stopping point and the distribution of the radiation emitted from them. In our model we assume that they radiate 3.5 keV electrons and photons, after having been excited during their passage into the Earth. The purpose of such an estimation of the radiation distribution is to explain the truly mysterious fact that, among all the underground experiments seeking dark matter colliding with the Earth material, only the DAMA-LIBRA experiment has seen any evidence of dark matter. This is an experiment based on solid NaI scintillators and is rather deep at 1400 m. It is our point that we can arrange the main radiation to appear in the relatively deep DAMA- LIBRA site, and explain that the dark matter pearls cannot stop in a fluid, such as xenon in the xenon based experiments.


title: Every latin hypercube of order 5 has transversals

abstract: We prove that for all n>1 every latin n-dimensional cube of order 5 has transversals. We find all 123 paratopy classes of layer-latin cubes of order 5 with no transversals. For each $n\geq 3$ and $q\geq 3$ we construct a (2q-2)-layer latin n-dimensional cuboid with no transversals. Moreover, we find all paratopy classes of nonextendible and noncompletable latin cuboids of order 5.


title: On the integration of Ito equations with a random or a W-symmetry

abstract: Symmetries can be used to integrate scalar Ito equation -- or reduce systems of such equations -- by the Kozlov substitution, i.e. passing to symmetry adapted coordinates. While the theory is well established for so called deterministic standard symmetries (the class originally studied by Kozlov), some points need clarification for so called random standard symmetries and W-symmetries. This paper is devoted to such clarification; in particular we note that the theory naturally calls, for these classes of symmetries, to also consider generalized Ito equations; and that while Kozlov theory is extended substantially unharmed for random standard symmetries, W-symmetries should be handled with great care, and cannot be used towards integration of stochastic equations, albeit they have different uses.


title: ANCs of the bound states of $^{16}$O deduced from elastic $\alpha$-$^{12}$C scattering data

abstract: Asymptotic normalization coefficients (ANCs) of the $0_1^+$, $0_2^+$, $1_1^-$, $2_1^+$, $3_1^-$ ($l_{i th}^\pi$) bound states of $^{16}$O are deduced from the phase shift data of elastic $\alpha$-$^{12}$C scattering at low energies. $S$ matrices of elastic $\alpha$-$^{12}$C scattering are constructed within cluster effective field theory (EFT), in which both bound and resonant states of $^{16}$O are considered. Parameters in the $S$ matrices are fitted to the precise phase shift data below the $p$-$^{15}$N breakup energy for the partial waves of $l=0,1,2,3,4,5,6$, and the ANCs are calculated by using the wave function normalization factors of $^{16}$O propagators for $l=0,1,2,3$. We review the values of ANCs, which are compared with other results in the literature, and discuss uncertainties of the ANCs obtained from the elastic $\alpha$-$^{12}$C scattering data in cluster EFT.


title: Satellite-based feature extraction and multivariate time-series prediction of biotoxin contamination in shellfish

abstract: Shellfish production constitutes an important sector for the economy of many Portuguese coastal regions, yet the challenge of shellfish biotoxin contamination poses both public health concerns and significant economic risks. Thus, predicting shellfish contamination levels holds great potential for enhancing production management and safeguarding public health. In our study, we utilize a dataset with years of Sentinel-3 satellite imagery for marine surveillance, along with shellfish biotoxin contamination data from various production areas along Portugal's western coastline, collected by Portuguese official control. Our goal is to evaluate the integration of satellite data in forecasting models for predicting toxin concentrations in shellfish given forecasting horizons up to four weeks, which implies extracting a small set of useful features and assessing their impact on the predictive models. We framed this challenge as a time-series forecasting problem, leveraging historical contamination levels and satellite images for designated areas. While contamination measurements occurred weekly, satellite images were accessible multiple times per week. Unsupervised feature extraction was performed using autoencoders able to handle non-valid pixels caused by factors like cloud cover, land, or anomalies. Finally, several Artificial Neural Networks models were applied to compare univariate (contamination only) and multivariate (contamination and satellite data) time-series forecasting. Our findings show that incorporating these features enhances predictions, especially beyond one week in lagoon production areas (RIAV) and for the 1-week and 2-week horizons in the L5B area (oceanic). The methodology shows the feasibility of integrating information from a high-dimensional data source like remote sensing without compromising the model's predictive ability.


title: A Deep-learning Real-time Bias Correction Method for Significant Wave Height Forecasts in the Western North Pacific

abstract: Significant wave height is one of the most important parameters characterizing ocean waves, and accurate numerical ocean wave forecasting is crucial for coastal protection and shipping. However, due to the randomness and nonlinearity of the wind fields that generate ocean waves and the complex interaction between wave and wind fields, current forecasts of numerical ocean waves have biases. In this study, a spatiotemporal deep-learning method was employed to correct gridded SWH forecasts from the ECMWF-IFS. This method was built on the trajectory gated recurrent unit deep neural network,and it conducts real-time rolling correction for the 0-240h SWH forecasts from ECMWF-IFS. The correction model is co-driven by wave and wind fields, providing better results than those based on wave fields alone. A novel pixel-switch loss function was developed. The pixel-switch loss function can dynamically fine-tune the pre-trained correction model, focusing on pixels with large biases in SWH forecasts. According to the seasonal characteristics of SWH, four correction models were constructed separately, for spring, summer, autumn, and winter. The experimental results show that, compared with the original ECMWF SWH predictions, the correction was most effective in spring, when the mean absolute error decreased by 12.972~46.237%. Although winter had the worst performance, the mean absolute error decreased by 13.794~38.953%. The corrected results improved the original ECMWF SWH forecasts under both normal and extreme weather conditions, indicating that our SWH correction model is robust and generalizable.


title: Counting relatively prime pairs of palindromes

abstract: For a given base $g\ge2$, a positive integer is called a palindrome if its base $g$ expansion reads the same backwards as forwards. In this paper, we give an asymptotic formula for the number of relatively prime pairs of palindromes of a fixed odd length and of any base $g\ge2$, which solves an open problem proposed by Banks and Shparlinski (2005).


title: Enumerating Error Bounded Polytime Algorithms Through Arithmetical Theories

abstract: We consider a minimal extension of the language of arithmetic, such that the bounded formulas provably total in a suitably-defined theory \`a la Buss (expressed in this new language) precisely capture polytime random functions. Then, we provide two new characterizations of the semantic class BPP obtained by internalizing the error-bound check within a logical system: the first relies on measure-sensitive quantifiers, while the second is based on standard first-order quantification. This leads us to introduce a family of effectively enumerable subclasses of BPP, called BPP_T and consisting of languages captured by those probabilistic Turing machines whose underlying error can be proved bounded in the theory T. As a paradigmatic example of this approach, we establish that polynomial identity testing is in BPP_T where T=$\mathrm{I}\Delta_0+\mathrm{Exp}$ is a well-studied theory based on bounded induction.


title: Combining chromomagnetic and four-fermion operators with leading SMEFT operators for $gg\to hh$ at NLO QCD

abstract: We present the calculation of the contribtuions from the chromomagnetic and four-top-quark-operators within Standard Model Effective Field Theory (SMEFT) to Higgs boson pair production in gluon fusion, combined with full NLO QCD corrections. We study the effects of these operators on the total cross section and the invariant mass distribution of the Higgs-boson pair, at $\sqrt{s}=13.6$ TeV. These subleading operators are implemented in the generator ggHH_SMEFT, in the same Powheg-Box-V2 framework as the leading operators, such that their effects can be easily studied in a unified setup.


title: Spectrum Sharing between UAV-based Wireless Mesh Networks and Ground Networks

abstract: The unmanned aerial vehicle (UAV)-based wireless mesh networks can economically provide wireless services for the areas with disasters. However, the capacity of air-to-air communications is limited due to the multi-hop transmissions. In this paper, the spectrum sharing between UAV-based wireless mesh networks and ground networks is studied to improve the capacity of the UAV networks. Considering the distribution of UAVs as a three-dimensional (3D) homogeneous Poisson point process (PPP) within a vertical range, the stochastic geometry is applied to analyze the impact of the height of UAVs, the transmit power of UAVs, the density of UAVs and the vertical range, etc., on the coverage probability of ground network user and UAV network user, respectively. The optimal height of UAVs is numerically achieved in maximizing the capacity of UAV networks with the constraint of the coverage probability of ground network user. This paper provides a basic guideline for the deployment of UAV-based wireless mesh networks.


title: A Survey Examining Neuromorphic Architecture in Space and Challenges from Radiation

abstract: Inspired by the human brain's structure and function, neuromorphic computing has emerged as a promising approach for developing energy-efficient and powerful computing systems. Neuromorphic computing offers significant processing speed and power consumption advantages in aerospace applications. These two factors are crucial for real-time data analysis and decision-making. However, the harsh space environment, particularly with the presence of radiation, poses significant challenges to the reliability and performance of these computing systems. This paper comprehensively surveys the integration of radiation-resistant neuromorphic computing systems in aerospace applications. We explore the challenges posed by space radiation, review existing solutions and developments, present case studies of neuromorphic computing systems used in space applications, discuss future directions, and discuss the potential benefits of this technology in future space missions.


title: Guiding principles for the design of a chemical vapor deposition process for highly crystalline transition metal dichalcogenides

abstract: Two-dimensional transition metal dichalcogenides (TMDs) for advanced logic transistor technologies are deposited by various modifications of the chemical vapor deposition (CVD) method using a wide variety of precursors. Being a major electrical performance limiter, the TMD crystal grain size strongly differs between the various CVD precursor chemistries from nano- to millimeter-sized crystals. However, it remains unclear how the CVD precursor chemistry affects the nucleation density and resulting TMD crystal grain size. This work postulates guiding principles to design a CVD process for highly crystalline TMD deposition using a quantitative analytical model benchmarked against literature. The TMD nucleation density reduces favorably under low supersaturation conditions, where the metal precursor sorption on the starting surface is reversible and the corresponding metal precursor desorption rate exceeds the overall deposition rate. Such reversible precursor adsorption guarantees efficient long-range gas-phase lateral diffusion of precursor species in addition to short-range surface diffusion, which vitally increases crystal grain size. As such, the proposed model explains the large spread in experimentally observed TMD nucleation densities and crystal grain sizes for state-of-the-art CVD chemistries. Ultimately, it empowers the reader to interpret and modulate precursor adsorption and diffusion reactions through designing CVD precursor chemistries compatible with temperature sensitive application schemes.


title: A composite ansatz for the calculation of dynamical structure factor

abstract: We propose an ansatz without adjustable parameters for the calculation of dynamical structure factor. The ansatz combines quasi-particle Green's function, especially the contribution from the renormalization factor, and the exchange-correlation kernel from time-dependent density functional theory together, verified for typical metals and semiconductors from plasmon excitation regime to Compton scattering regime. It has the capability to reconcile both small-angle and large-angle x-ray scattering (IXS) signals with much improved accuracy, which can be used, as the theoretical base model, in inversely inferring electronic structures of condensed matter from IXS experimental signals directly. It may also used to diagnose thermal parameters, such as temperature and density, of dense plasmas in x-ray Thomson scattering experiments.


title: A comparison of compact, presumably young with extended, evolved radio active galactic nuclei

abstract: Radio sources with peaked spectra (peaked spectrum sources, PSS) and compact symmetric objects (CSO) are powerful, compact, and presumably young AGNs and therefore particularly suitable to study aspects of the AGN-host connection. We use a statistical approach to compare a PSS-CSO sample with a matching comparison sample of extended sources (ECS). We find significant differences between the two samples. In particular, we find that the ECS sample has a higher proportion of passive galaxies with a lower star formation activity. This applies to both sub-samples of QSOs or radio galaxies as well as to the entire sample. The star formation rates of the PSS-CSO host galaxies are typically in the range 0 to 5 M_sun/yr and the stellar masses are in the range 3x10^11 to 10^12 M_sun. Secondly, in agreement with previous results, we find a remarkably high proportion of PSS-CSO host galaxies with merger signatures. The merger fraction of the PSS-CSO sample is 0.61, which is significantly higher than that of the comparison sample (0.15). We suggest that this difference can be explained by assuming that the majority of the PSSs and CSOs cannot evolve to extended radio sources and are therefore not represented in our comparison sample.


title: Adapter is All You Need for Tuning Visual Tasks

abstract: Pre-training & fine-tuning can enhance the transferring efficiency and performance in visual tasks. Recent delta-tuning methods provide more options for visual classification tasks. Despite their success, existing visual delta-tuning art fails to exceed the upper limit of full fine-tuning on challenging tasks like instance segmentation and semantic segmentation. To find a competitive alternative to full fine-tuning, we propose the Multi-cognitive Visual Adapter (Mona) tuning, a novel adapter-based tuning method. First, we introduce multiple vision-friendly filters into the adapter to enhance its ability to process visual signals, while previous methods mainly rely on language-friendly linear filters. Second, we add the scaled normalization layer in the adapter to regulate the distribution of input features for visual filters. To fully demonstrate the practicality and generality of Mona, we conduct experiments on multiple representative visual tasks, including instance segmentation on COCO, semantic segmentation on ADE20K, object detection on Pascal VOC, and image classification on several common datasets. Exciting results illustrate that Mona surpasses full fine-tuning on all these tasks and is the only delta-tuning method outperforming full fine-tuning on instance segmentation and semantic segmentation tasks. For example, Mona achieves a 1% performance gain on the COCO dataset compared to full fine-tuning. Comprehensive results suggest that Mona-tuning is more suitable for retaining and utilizing the capabilities of pre-trained models than full fine-tuning. The code will be released at https://github.com/Leiyi-Hu/mona.


title: VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learning

abstract: Salient object detection (SOD) and camouflaged object detection (COD) are related yet distinct binary mapping tasks. These tasks involve multiple modalities, sharing commonalities and unique cues. Existing research often employs intricate task-specific specialist models, potentially leading to redundancy and suboptimal results. We introduce VSCode, a generalist model with novel 2D prompt learning, to jointly address four SOD tasks and three COD tasks. We utilize VST as the foundation model and introduce 2D prompts within the encoder-decoder architecture to learn domain and task-specific knowledge on two separate dimensions. A prompt discrimination loss helps disentangle peculiarities to benefit model optimization. VSCode outperforms state-of-the-art methods across six tasks on 26 datasets and exhibits zero-shot generalization to unseen tasks by combining 2D prompts, such as RGB-D COD. Source code has been available at https://github.com/Sssssuperior/VSCode.


title: False Discovery Rate Controlling Procedures with BLOSUM62 substitution matrix and their application to HIV Data

abstract: Identifying significant sites in sequence data and analogous data is of fundamental importance in many biological fields. Fisher's exact test is a popular technique, however this approach to sparse count data is not appropriate due to conservative decisions. Since count data in HIV data are typically very sparse, it is crucial to use additional information to statistical models to improve testing power. In order to develop new approaches to incorporate biological information in the false discovery controlling procedure, we propose two models: one based on the empirical Bayes model under independence of amino acids and the other uses pairwise associations of amino acids based on Markov random field with on the BLOSUM62 substitution matrix. We apply the proposed methods to HIV data and identify significant sites incorporating BLOSUM62 matrix while the traditional method based on Fisher's test does not discover any site. These newly developed methods have the potential to handle many biological problems in the studies of vaccine and drug trials and phenotype studies.


title: Inequalities and asymptotics for hook numbers in restricted partitions

abstract: In this paper, we consider the asymptotic properties of hook numbers of partitions in restricted classes. More specifically, we compare the frequency with which partitions into odd parts and partitions into distinct parts have hook numbers equal to $h \geq 1$ by deriving an asymptotic formula for the total number of hooks equal to $h$ that appear among partitions into odd and distinct parts, respectively. We use these asymptotic formulas to prove a recent conjecture of the first author and collaborators that for $h \geq 2$ and $n \gg 0$, partitions into odd parts have, on average, more hooks equal to $h$ than do partitions into distinct parts. We also use our asymptotics to prove certain probabilistic statements about how hooks distribute in the rows of partitions.


title: Circuit realisation of a two-orbital non-Hermitian tight-binding chain

abstract: We examine a non-Hermitian (NH) tight-binding system comprising of two orbitals per unit cell and their electrical circuit analogues. We distinguish the PT-symmetric and non-PT symmetric cases characterised by non-reciprocal nearest neighbour couplings and onsite gain/loss terms, respectively. The localisation of the edge modes or the emergence of the topological properties are determined via the maximum inverse participation ratio, which has distinct dependencies on the parameters that define the Hamiltonian. None of the above scenarios exhibits the non-Hermitian skin effect. We investigate the boundary modes corresponding to the topological phases in a suitably designed electrical circuit by analyzing the two-port impedance and retrieve the admittance band structure of the circuit via imposing periodic boundary conditions. The obtained results are benchmarked against the Hermitian version of the two-orbital model to compare and discriminate against those obtained for the NH variants.


title: Exact solution and projection filters for open quantum systems subject to imperfect measurements

abstract: In this paper, we consider an open quantum system undergoing imperfect and indirect measurement. For quantum non-demolition (QND) measurement, we show that the system evolves on an appropriately chosen manifold and we express the exact solution of the quantum filter equation in terms of the solution of a lower dimensional stochastic differential equation. In order to further reduce the dimension of the system under study, we consider the projection on the lower dimensional manifold originally introduced in [1] for the case of perfect measurements. An error analysis is performed to evaluate the precision of this approximate quantum filter, focusing on the case of QND measurement. Simulations suggest the efficiency of the proposed quantum projection filter, even in presence of a stabilizing feedback control which depends on the projection filter.


title: E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation

abstract: Achieving empathy is a crucial step toward humanized dialogue systems. Current approaches for empathetic dialogue generation mainly perceive an emotional label to generate an empathetic response conditioned on it, which simply treat emotions independently, but ignore the intrinsic emotion correlation in dialogues, resulting in inaccurate emotion perception and unsuitable response generation. In this paper, we propose a novel emotion correlation enhanced empathetic dialogue generation framework, which comprehensively realizes emotion correlation learning, utilization, and supervising. Specifically, a multi-resolution emotion graph is devised to capture context-based emotion interactions from different resolutions, further modeling emotion correlation. Then we propose an emotion correlation enhanced decoder, with a novel correlation-aware aggregation and soft/hard strategy, respectively improving the emotion perception and response generation. Experimental results on the benchmark dataset demonstrate the superiority of our model in both empathetic perception and expression.


title: Capacity and Delay of Unmanned Aerial Vehicle Networks with Mobility

abstract: Unmanned aerial vehicles (UAVs) are widely exploited in environment monitoring, search-and-rescue, etc. However, the mobility and short flight duration of UAVs bring challenges for UAV networking. In this paper, we study the UAV networks with n UAVs acting as aerial sensors. UAVs generally have short flight duration and need to frequently get energy replenishment from the control station. Hence the returning UAVs bring the data of the UAVs along the returning paths to the control station with a store-carry-and-forward (SCF) mode. A critical range for the distance between the UAV and the control station is discovered. Within the critical range, the per-node capacity of the SCF mode is O(n/log n) times higher than that of the multi-hop mode. However, the per-node capacity of the SCF mode outside the critical range decreases with the distance between the UAV and the control station. To eliminate the critical range, a mobility control scheme is proposed such that the capacity scaling laws of the SCF mode are the same for all UAVs, which improves the capacity performance of UAV networks. Moreover, the delay of the SCF mode is derived. The impact of the size of the entire region, the velocity of UAVs, the number of UAVs and the flight duration of UAVs on the delay of SCF mode is analyzed. This paper reveals that the mobility and short flight duration of UAVs have beneficial effects on the performance of UAV networks, which may motivate the study of SCF schemes for UAV networks.


title: Rings With $u^n-1$ Nilpotent For Each Unit $u$

abstract: We continue the study in-depth of the so-called $n$-UU rings for any $n\geq 1$, that were defined by the first-named author in Toyama Math. J. (2017) as those rings $R$ for which $u^n-1$ is always a nilpotent for every unit $u\in R$. Specifically, for any $n\geq 2$, we prove that a ring is strongly $n$-nil-clean if, and only if, it is simultaneously strongly $\pi$-regular and an $(n-1)$-UU ring. This somewhat extends results due to Diesl in J. Algebra (2013), Abyzov in Sib. Math. J. (2019) and Cui-Danchev in J. Algebra Appl. (2020). Moreover, our results somewhat improves the ones obtained by Ko$\c{s}$an et al. in Hacettepe J. Math. Stat. (2020).


title: Universal role of curvature in vacuum entanglement

abstract: We highlight some universal features concerning the role of spacetime curvature in the entanglement induced between quantum probes coupled to a quantum field in a suitable vacuum state. The probes are initially causally disconnected and non-entangled. We explore the parameter space $\{{\omega}, d_0, \boldsymbol{v}_0\}$ spanned by the energy gap $\omega$ of the detectors, and the initial values of separation distance $d_0$ and relative velocity $\boldsymbol{v}_0$, both covariantly defined in arbitrary curved spacetime. We also obtain numerical results in de Sitter spacetimes and use these to explore strong curvature regime, while also corroborating our perturbative results in arbitrary curved spacetime. Our analysis shows that curvature can induce entanglement features in certain regions of the above parameter space, in a manner which facilitates using entanglement as a probe of spacetime curvature.


title: Careful Synchronization of One-Cluster Automata

abstract: In this paper we investigate careful synchronization of one-cluster partial automata. First we prove that in general case the shortest carefully synchronizing word for such automata is of length $2^\frac{n}{2} + 1$, where $n$ is the number of states of an automaton. Additionally we prove that checking whether a given one-cluster partial automaton is carefully synchronizing is NP-hard even in the case of binary alphabet.


title: The Imprimitivity Fell Bundle

abstract: Given a full right-Hilbert C*-module $\mathbf{X}$ over a C*-algebra $A$, the set $\mathbb{K}_{A}(\mathbf{X})$ of $A$-compact operators on $\mathbf{X}$ is the (up to isomorphism) unique C*-algebra that is strongly Morita equivalent to the coefficient algebra $A$ via $\mathbf{X}$. As bimodule, $\mathbb{K}_{A}(\mathbf{X})$ can also be thought of as the balanced tensor product $\mathbf{X}\otimes_{A} \mathbf{X}^{\mathrm{op}}$, and so the latter naturally becomes a C*-algebra. We generalize both of these facts to the world of Fell bundles over groupoids: Suppose $\mathscr{B}$ is a Fell bundle over a groupoid $\mathcal{H}$ and $\mathscr{M}$ an upper semi-continuous Banach bundle over a principal right $\mathcal{H}$-space $X$. If $\mathscr{M}$ carries a right-action of $\mathscr{B}$ and a sufficiently nice $\mathscr{B}$-valued inner product, then its imprimitivity Fell bundle $\mathbb{K}_{\mathscr{B}}(\mathscr{M})=\mathscr{M}\otimes_{\mathscr{B}} \mathscr{M}^{\mathrm{op}}$ is a Fell bundle over the imprimitivity groupoid of $X$, and it is the unique Fell bundle that is equivalent to $\mathscr{B}$ via $\mathscr{M}$. We show that $\mathbb{K}_{\mathscr{B}}(\mathscr{M})$ generalizes the 'higher order' compact operators of Abadie and Ferraro in the case of saturated bundles over groups, and that the theorem recovers results such as Kumjian's Stabilization trick.


title: Occlusion Sensitivity Analysis with Augmentation Subspace Perturbation in Deep Feature Space

abstract: Deep Learning of neural networks has gained prominence in multiple life-critical applications like medical diagnoses and autonomous vehicle accident investigations. However, concerns about model transparency and biases persist. Explainable methods are viewed as the solution to address these challenges. In this study, we introduce the Occlusion Sensitivity Analysis with Deep Feature Augmentation Subspace (OSA-DAS), a novel perturbation-based interpretability approach for computer vision. While traditional perturbation methods make only use of occlusions to explain the model predictions, OSA-DAS extends standard occlusion sensitivity analysis by enabling the integration with diverse image augmentations. Distinctly, our method utilizes the output vector of a DNN to build low-dimensional subspaces within the deep feature vector space, offering a more precise explanation of the model prediction. The structural similarity between these subspaces encompasses the influence of diverse augmentations and occlusions. We test extensively on the ImageNet-1k, and our class- and model-agnostic approach outperforms commonly used interpreters, setting it apart in the realm of explainable AI.


title: Offensive Language Identification in Transliterated and Code-Mixed Bangla

abstract: Identifying offensive content in social media is vital for creating safe online communities. Several recent studies have addressed this problem by creating datasets for various languages. In this paper, we explore offensive language identification in texts with transliterations and code-mixing, linguistic phenomena common in multilingual societies, and a known challenge for NLP systems. We introduce TB-OLID, a transliterated Bangla offensive language dataset containing 5,000 manually annotated comments. We train and fine-tune machine learning models on TB-OLID, and we evaluate their results on this dataset. Our results show that English pre-trained transformer-based models, such as fBERT and HateBERT achieve the best performance on this dataset.


title: A Comparative Study of Watering Hole Attack Detection Using Supervised Neural Network

abstract: The state of security demands innovative solutions to defend against targeted attacks due to the growing sophistication of cyber threats. This study explores the nefarious tactic known as "watering hole attacks using supervised neural networks to detect and prevent these attacks. The neural network identifies patterns in website behavior and network traffic associated with such attacks. Testing on a dataset of confirmed attacks shows a 99% detection rate with a mere 0.1% false positive rate, demonstrating the model's effectiveness. In terms of prevention, the model successfully stops 95% of attacks, providing robust user protection. The study also suggests mitigation strategies, including web filtering solutions, user education, and security controls. Overall, this research presents a promising solution for countering watering hole attacks, offering strong detection, prevention, and mitigation strategies.


title: Moment-Type Estimators for the Dirichlet and the Multivariate Gamma Distributions

abstract: This study presents new closed-form estimators for the Dirichlet and the Multivariate Gamma distribution families, whose maximum likelihood estimator cannot be explicitly derived. The methodology builds upon the score-adjusted estimators for the Beta and Gamma distributions, extending their applicability to the Dirichlet and Multivariate Gamma distributions. Expressions for the asymptotic variance-covariance matrices are provided, demonstrating the superior performance of score-adjusted estimators over the traditional moment ones. Leveraging well-established connections between Dirichlet and Multivariate Gamma distributions, a novel class of estimators for the latter is introduced, referred to as "Dirichlet-based moment-type estimators". The general asymptotic variance-covariance matrix form for this estimator class is derived. To facilitate the application of these innovative estimators, an R package called estimators is developed and made publicly available.


title: Impact craters formed by spinning granular projectiles

abstract: Craters formed by the impact of agglomerated materials are commonly observed in nature, such as asteroids colliding with planets and moons. In this paper, we investigate how the projectile spin and cohesion lead to different crater shapes. For that, we carried out DEM (discrete element method) computations of spinning granular projectiles impacting onto cohesionless grains, for different bonding stresses, initial spins and initial heights. We found that, as the bonding stresses decrease and the initial spin increases, the projectile's grains spread farther from the collision point, and, in consequence, the crater shape becomes flatter, with peaks around the rim and in the center of craters. Our results shed light on the dispersion of the projectile's material and the different shapes of craters found on Earth and other planetary environments.


title: Double-Flow-based Steganography without Embedding for Image-to-Image Hiding

abstract: As an emerging concept, steganography without embedding (SWE) hides a secret message without directly embedding it into a cover. Thus, SWE has the unique advantage of being immune to typical steganalysis methods and can better protect the secret message from being exposed. However, existing SWE methods are generally criticized for their poor payload capacity and low fidelity of recovered secret messages. In this paper, we propose a novel steganography-without-embedding technique, named DF-SWE, which addresses the aforementioned drawbacks and produces diverse and natural stego images. Specifically, DF-SWE employs a reversible circulation of double flow to build a reversible bijective transformation between the secret image and the generated stego image. Hence, it provides a way to directly generate stego images from secret images without a cover image. Besides leveraging the invertible property, DF-SWE can invert a secret image from a generated stego image in a nearly lossless manner and increases the fidelity of extracted secret images. To the best of our knowledge, DF-SWE is the first SWE method that can hide large images and multiple images into one image with the same size, significantly enhancing the payload capacity. According to the experimental results, the payload capacity of DF-SWE achieves 24-72 BPP is 8000-16000 times compared to its competitors while producing diverse images to minimize the exposure risk. Importantly, DF-SWE can be applied in the steganography of secret images in various domains without requiring training data from the corresponding domains. This domain-agnostic property suggests that DF-SWE can 1) be applied to hiding private data and 2) be deployed in resource-limited systems.


title: Mathematical Modelling and a Numerical Solution for High Precision Satellite Ephemeris Determination

abstract: In this paper, we develop a high-precision satellite orbit determination model for satellites orbiting the Earth. Solving this model entails numerically integrating the differential equation of motion governing a two-body system, employing Fehlberg's formulation and the Runge-Kutta class of embedded integrators with adaptive stepsize control. Relevant primary perturbing forces included in this mathematical model are the full force gravitational field model, Earth's atmospheric drag, third body gravitational effects and solar radiation pressure. Development of the high-precision model required accounting for the perturbing influences of Earth radiation pressure, Earth tides and relativistic effects. The model is then implemented to obtain a high-fidelity Earth orbiting satellite propagator, namely the Satellite Ephemeris Determiner (SED), which is comparable to the popular High Precision Orbit Propagator (HPOP). The architecture of SED, the methodology employed, and the numerical results obtained are presented.


title: nlpBDpatriots at BLP-2023 Task 1: A Two-Step Classification for Violence Inciting Text Detection in Bangla

abstract: In this paper, we discuss the nlpBDpatriots entry to the shared task on Violence Inciting Text Detection (VITD) organized as part of the first workshop on Bangla Language Processing (BLP) co-located with EMNLP. The aim of this task is to identify and classify the violent threats, that provoke further unlawful violent acts. Our best-performing approach for the task is two-step classification using back translation and multilinguality which ranked 6th out of 27 teams with a macro F1 score of 0.74.


title: Tuning-free Quasi-stiffness Control Framework of a Powered Transfemoral Prosthesis for Task-adaptive Walking

abstract: Impedance-based control represents a prevalent strategy in the development of powered transfemoral prostheses. However, creating a task-adaptive, tuning-free controller that effectively generalizes across diverse locomotion modes and terrain conditions continues to be a significant challenge. This letter proposes a tuning-free and task-adaptive quasi-stiffness control framework for powered prostheses that generalizes across various walking tasks, including the torque-angle relationship reconstruction part and the quasi-stiffness controller design part. A Gaussian Process Regression (GPR) model is introduced to predict the target features of the human joint angle and torque in a new task. Subsequently, a Kernelized Movement Primitives (KMP) is employed to reconstruct the torque-angle relationship of the new task from multiple human reference trajectories and estimated target features. Based on the torque-angle relationship of the new task, a quasi-stiffness control approach is designed for a powered prosthesis. Finally, the proposed framework is validated through practical examples, including varying speeds and inclines walking tasks. Notably, the proposed framework not only aligns with but frequently surpasses the performance of a benchmark finite state machine impedance controller (FSMIC) without necessitating manual impedance tuning and has the potential to expand to variable walking tasks in daily life for the transfemoral amputees.


title: Robust and Efficient Semi-supervised Learning for Ising Model

abstract: In biomedical studies, it is often desirable to characterize the interactive mode of multiple disease outcomes beyond their marginal risk. Ising model is one of the most popular choices serving for this purpose. Nevertheless, learning efficiency of Ising models can be impeded by the scarcity of accurate disease labels, which is a prominent problem in contemporary studies driven by electronic health records (EHR). Semi-supervised learning (SSL) leverages the large unlabeled sample with auxiliary EHR features to assist the learning with labeled data only and is a potential solution to this issue. In this paper, we develop a novel SSL method for efficient inference of Ising model. Our method first models the outcomes against the auxiliary features, then uses it to project the score function of the supervised estimator onto the EHR features, and incorporates the unlabeled sample to augment the supervised estimator for variance reduction without introducing bias. For the key step of conditional modeling, we propose strategies that can effectively leverage the auxiliary EHR information while maintaining moderate model complexity. In addition, we introduce approaches including intrinsic efficient updates and ensemble, to overcome the potential misspecification of the conditional model that may cause efficiency loss. Our method is justified by asymptotic theory and shown to outperform existing SSL methods through simulation studies. We also illustrate its utility in a real example about several key phenotypes related to frequent ICU admission on MIMIC-III data set.


title: nlpBDpatriots at BLP-2023 Task 2: A Transfer Learning Approach to Bangla Sentiment Analysis

abstract: In this paper, we discuss the nlpBDpatriots entry to the shared task on Sentiment Analysis of Bangla Social Media Posts organized at the first workshop on Bangla Language Processing (BLP) co-located with EMNLP. The main objective of this task is to identify the polarity of social media content using a Bangla dataset annotated with positive, neutral, and negative labels provided by the shared task organizers. Our best system for this task is a transfer learning approach with data augmentation which achieved a micro F1 score of 0.71. Our best system ranked 12th among 30 teams that participated in the competition.


title: Agent as Cerebrum, Controller as Cerebellum: Implementing an Embodied LMM-based Agent on Drones

abstract: In this study, we present a novel paradigm for industrial robotic embodied agents, encapsulating an 'agent as cerebrum, controller as cerebellum' architecture. Our approach harnesses the power of Large Multimodal Models (LMMs) within an agent framework known as AeroAgent, tailored for drone technology in industrial settings. To facilitate seamless integration with robotic systems, we introduce ROSchain, a bespoke linkage framework connecting LMM-based agents to the Robot Operating System (ROS). We report findings from extensive empirical research, including simulated experiments on the Airgen and real-world case study, particularly in individual search and rescue operations. The results demonstrate AeroAgent's superior performance in comparison to existing Deep Reinforcement Learning (DRL)-based agents, highlighting the advantages of the embodied LMM in complex, real-world scenarios.