title: Pain Analysis using Adaptive Hierarchical Spatiotemporal Dynamic Imaging

abstract: Automatic pain intensity estimation plays a pivotal role in healthcare and medical fields. While many methods have been developed to gauge human pain using behavioral or physiological indicators, facial expressions have emerged as a prominent tool for this purpose. Nevertheless, the dependence on labeled data for these techniques often renders them expensive and time-consuming. To tackle this, we introduce the Adaptive Hierarchical Spatio-temporal Dynamic Image (AHDI) technique. AHDI encodes spatiotemporal changes in facial videos into a singular RGB image, permitting the application of simpler 2D deep models for video representation. Within this framework, we employ a residual network to derive generalized facial representations. These representations are optimized for two tasks: estimating pain intensity and differentiating between genuine and simulated pain expressions. For the former, a regression model is trained using the extracted representations, while for the latter, a binary classifier identifies genuine versus feigned pain displays. Testing our method on two widely-used pain datasets, we observed encouraging results for both tasks. On the UNBC database, we achieved an MSE of 0.27 outperforming the SOTA which had an MSE of 0.40. On the BioVid dataset, our model achieved an accuracy of 89.76%, which is an improvement of 5.37% over the SOTA accuracy. Most notably, for distinguishing genuine from simulated pain, our accuracy stands at 94.03%, marking a substantial improvement of 8.98%. Our methodology not only minimizes the need for extensive labeled data but also augments the precision of pain evaluations, facilitating superior pain management.


title: Ibukiyama correspondences on automorphic forms on $\operatorname{Mp}_4(\mathbb{A}_\mathbb{Q})$ and $\operatorname{SO}_5(\mathbb{A}_\mathbb{Q})$ generating large discrete series representations at the real place

abstract: In our previous paper we gave proofs of Ibukiyama's correspondences on holomorphic Siegel modular forms of degree 2 of half-integral weight and integral weight. In this paper, we formulate and prove similar correspondences on automorphic forms on $\operatorname{Mp}_4(\mathbb{A}_\mathbb{Q})$ or $\operatorname{SO}_5(\mathbb{A}_\mathbb{Q})$ generating large discrete series representations at the real components. In addition, we show that the correspondences can be described in terms of local theta correspondences.


title: Variational quantum algorithm-preserving feasible space for solving the uncapacitated facility location problem

abstract: The Quantum Alternating Operator Ansatz (QAOA+) is one of the Variational Quantum Algorithm (VQA) specifically developed to tackle combinatorial optimization problems by exploring the feasible space in search of a target solution. For constrained optimization problems with unconstrained variables, which we call Unconstrained-Variables Problems (UVPs), the mixed operators in the QAOA+ circuit are applied to the constrained variables, while the single-qubit rotating gates $R_X$ operate on the unconstrained variables. The expressibility of this circuit is limited by the shortage of two-qubit gates and the parameter sharing in the $R_X$, which consequently impacts the performance of QAOA+ for solving UVPs. Therefore, it is crucial to develop a suitable ansatz for UVPs. In this paper, we propose the Variational Quantum Algorithm-Preserving Feasible Space (VQA-PFS) ansatz, exemplified by the Uncapacitated Facility Location Problem (UFLP), that applies mixed operators on constrained variables while employing Hardware-Efficient Ansatz (HEA) on unconstrained variables. The numerical results demonstrate that VQA-PFS significantly enhances the success probability and exhibits faster convergence compared to QAOA+, Quantum Approximation Optimization Algorithm (QAOA), and HEA. Furthermore, VQA-PFS reduces the circuit depth dramatically in comparison to QAOA+ and QAOA. Our algorithm is general and instructive in tackling UVPs.


title: Nonlinear Expectation Inference for Direct Uncertainty Quantification of Nonlinear Inverse Problems

abstract: Most existing inference methods for the uncertainty quantification of nonlinear inverse problems need repetitive runs of the forward model which is computationally expensive for high-dimensional problems, where the forward model is expensive and the inference need more iterations. These methods are generally based on the Bayes' rule and implicitly assume that the probability distribution is unique, which is not the case for scenarios with Knightian uncertainty. In the current study, we assume that the probability distribution is uncertain, and establish a new inference method based on the nonlinear expectation theory for 'direct' uncertainty quantification of nonlinear inverse problems. The uncertainty of random parameters is quantified using the sublinear expectation defined as the limits of an ensemble of linear expectations estimated on samples. Given noisy observed data, the posterior sublinear expectation is computed using posterior linear expectations with highest likelihoods. In contrary to iterative inference methods, the new nonlinear expectation inference method only needs forward model runs on the prior samples, while subsequent evaluations of linear and sublinear expectations requires no forward model runs, thus quantifying uncertainty directly which is more efficient than iterative inference methods. The new method is analysed and validated using 2D and 3D test cases of transient Darcy flows.


title: Safety Alignment in NLP Tasks: Weakly Aligned Summarization as an In-Context Attack

abstract: Recent developments in balancing the usefulness and safety of Large Language Models (LLMs) have raised a critical question: Are mainstream NLP tasks adequately aligned with safety consideration? Our study, focusing on safety-sensitive documents obtained through adversarial attacks, reveals significant disparities in the safety alignment of various NLP tasks. For instance, LLMs can effectively summarize malicious long documents but often refuse to translate them. This discrepancy highlights a previously unidentified vulnerability: attacks exploiting tasks with weaker safety alignment, like summarization, can potentially compromise the integrity of tasks traditionally deemed more robust, such as translation and question-answering (QA). Moreover, the concurrent use of multiple NLP tasks with lesser safety alignment increases the risk of LLMs inadvertently processing harmful content. We demonstrate these vulnerabilities in various safety-aligned LLMs, particularly Llama2 models, Gemini and GPT-4, indicating an urgent need for strengthening safety alignments across a broad spectrum of NLP tasks.


title: Facial Emotion Recognition in VR Games

abstract: Emotion detection is a crucial component of Games User Research (GUR), as it allows game developers to gain insights into players' emotional experiences and tailor their games accordingly. However, detecting emotions in Virtual Reality (VR) games is challenging due to the Head-Mounted Display (HMD) that covers the top part of the player's face, namely, their eyes and eyebrows, which provide crucial information for recognizing the impression. To tackle this we used a Convolutional Neural Network (CNN) to train a model to predict emotions in full-face images where the eyes and eyebrows are covered. We used the FER2013 dataset, which we modified to cover eyes and eyebrows in images. The model in these images can accurately recognize seven different emotions which are anger, happiness, disgust, fear, impartiality, sadness and surprise. We assessed the model's performance by testing it on two VR games and using it to detect players' emotions. We collected self-reported emotion data from the players after the gameplay sessions. We analyzed the data collected from our experiment to understand which emotions players experience during the gameplay. We found that our approach has the potential to enhance gameplay analysis by enabling the detection of players' emotions in VR games, which can help game developers create more engaging and immersive game experiences.


title: Content-Localization based Neural Machine Translation for Informal Dialectal Arabic: Spanish/French to Levantine/Gulf Arabic

abstract: Resources in high-resource languages have not been efficiently exploited in low-resource languages to solve language-dependent research problems. Spanish and French are considered high resource languages in which an adequate level of data resources for informal online social behavior modeling, is observed. However, a machine translation system to access those data resources and transfer their context and tone to a low-resource language like dialectal Arabic, does not exist. In response, we propose a framework that localizes contents of high-resource languages to a low-resource language/dialects by utilizing AI power. To the best of our knowledge, we are the first work to provide a parallel translation dataset from/to informal Spanish and French to/from informal Arabic dialects. Using this, we aim to enrich the under-resource-status dialectal Arabic and fast-track the research of diverse online social behaviors within and across smart cities in different geo-regions. The experimental results have illustrated the capability of our proposed solution in exploiting the resources between high and low resource languages and dialects. Not only this, but it has also been proven that ignoring dialects within the same language could lead to misleading analysis of online social behavior.


title: WE economy: Potential of mutual aid distribution based on moral responsibility and risk vulnerability

abstract: Reducing wealth inequality and disparity is a global challenge. The economic system is mainly divided into (1) gift and reciprocity, (2) power and redistribution, (3) market exchange, and (4) mutual aid without reciprocal obligations. The current inequality stems from a capitalist economy consisting of (2) and (3). To sublimate (1), which is the human economy, to (4), the concept of a "mixbiotic society" has been proposed in the philosophical realm. This is a society in which free and diverse individuals, "I," mix with each other, recognize their respective "fundamental incapability" and sublimate them into "WE" solidarity. The economy in this society must have moral responsibility as a coadventurer and consideration for vulnerability to risk. Therefore, I focus on two factors of mind perception: moral responsibility and risk vulnerability, and propose a novel model of wealth distribution following an econophysical approach. Specifically, I developed a joint-venture model, a redistribution model in the joint-venture model, and a "WE economy" model. A simulation comparison of a combination of the joint ventures and redistribution with the WE economies reveals that WE economies are effective in reducing inequality and resilient in normalizing wealth distribution as advantages, and susceptible to free riders as disadvantages. However, this disadvantage can be compensated for by fostering consensus and fellowship, and by complementing it with joint ventures. This study essentially presents the effectiveness of moral responsibility, the complementarity between the WE economy and the joint economy, and the direction of the economy toward reducing inequality. Future challenges are to develop the WE economy model based on real economic analysis and psychology, as well as to promote WE economy fieldwork for worker coops and platform cooperatives to realize a desirable mixbiotic society.


title: Blockchain-Based Security Architecture for Unmanned Aerial Vehicles in B5G/6G Services and Beyond: A Comprehensive Approach

abstract: Unmanned Aerial Vehicles (UAVs), previously favored by enthusiasts, have evolved into indispensable tools for effectively managing disasters and responding to emergencies. For example, one of their most critical applications is to provide seamless wireless communication services in remote rural areas. Thus, it is substantial to identify and consider the different security challenges in the research and development associated with advanced UAV-based B5G/6G architectures. Following this requirement, the present study thoroughly examines the security considerations about UAVs in relation to the architectural framework of the 5G/6G system, the technologies that facilitate its operation, and the concerns surrounding privacy. It exhibits security integration at all the protocol stack layers and analyzes the existing mechanisms to secure UAV-based B5G/6G communications and its energy and power optimization factors. Last, this article also summarizes modern technological trends for establishing security and protecting UAV-based systems, along with the open challenges and strategies for future research work.


title: Interacting Floquet topological magnons in laser-irradiated Heisenberg honeycomb ferromagnets

abstract: When a Heisenberg honeycomb ferromagnet is irradiated by high frequency circularly polarized light, the underlying uncharged magnons acquire a time dependent Aharonov Casher phase, which makes it a Floquet topological magnon insulator. In this context, we investigate the many body interaction effects of Floquet magnons in laser irradiated Heisenberg honeycomb ferromagnets with ocontaining Dzyaloshinskii Moriya interaction under the application of circularly polarized off resonant light. We demonstrate that the quantum ferromagnet systems periodically laser driven exhibits temperature driven topological phase transitions due to Floquet magnon magnon interactions. The thermal Hall effect of Floquet magnons serves as a prominent signature for detecting these many body effects near the critical point, enabling experimental investigation into this phenomenon. Our study complements the lack of previous theoretical works that the topological phase transition of the Floquet magnon under the linear spin wave approximation is only tunable by the light field. Our study presents a novel approach for constructing Floquet topological phases in periodically driven quantum magnet systems that goes beyond the limitations of the linear spin wave theory. We provide numerical results based on the well known van der Waals quantum magnet CrX3 (X=F, Cl, Br, and I), calling for experimental implementation.


title: The Quillen-Lichtenbaum dimension of complex varieties

abstract: The Quillen-Lichtenbaum conjecture for smooth complex varieties states that algebraic and topological K-theory with finite coefficients become isomorphic in high degrees. We define the "Quillen-Lichtenbaum dimension" of a variety in terms of the point where this happens, show that it is surprisingly computable, and analyze many examples. It gives an obstruction to rationality, but one that turns out to be weaker than unramified cohomology and some related birational invariants defined by Colliot-Th\'el\`ene and Voisin using Bloch-Ogus theory. Because it is compatible with semi-orthogonal decompositions, however, it allows us to prove some new cases of the integral Hodge conjecture using homological projective duality, and to compute the higher algebraic K-theory of the Kuznetsov components of the derived categories of some Fano varieties.


title: Kondo coherence versus superradiance in THz radiation-driven heavy-fermion systems

abstract: In strongly correlated systems such as heavy-fermion materials, the coherent superposition of localized and mobile spin states leads to the formation of Kondo resonant states, which on a dense, periodic array of Kondo ions develop lattice coherence. Characteristically, these quantum-coherent superposition states respond to a terahertz (THz) excitation by a delayed THz pulse on the scale of the material's Kondo energy scale and, hence, independent of the pump-light intensity. However, delayed response is also typical for superradiance in an ensemble of excited atoms. In this case, quantum coherence is established by the coupling to an external, electromagnetic mode and, hence, dependent on the pump-light intensity. In the present work, we investigate the physical origin of the delayed pulse, i.e., inherent, correlation-induced versus light-induced coherence, in the prototypical heavy-fermion compound CeCu_5.9Au_0.1. We study the delay, duration and amplitude of the THz pulse at various temperatures in dependence on the electric-field strength of the incident THz excitation, ranging from 0.3 to 15.2 kV/cm. We observe a robust delayed response at approximately 6 ps with an amplitude proportional to the amplitude of the incident THz wave. This is consistent with theoretical expectation for the Kondo-like coherence and thus provides compelling evidence for the dominance of condensed-matter versus optical coherence in the heavy-fermion compound.


title: Predictive variational autoencoder for learning robust representations of time-series data

abstract: Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in the data rather than true underlying features, rendering such representations unsuitable for scientific interpretation. Existing solutions to this problem involve introducing additional measured variables or data augmentations specific to a particular data type. We propose a VAE architecture that predicts the next point in time and show that it mitigates the learning of spurious features. In addition, we introduce a model selection metric based on smoothness over time in the latent space. We show that together these two constraints on VAEs to be smooth over time produce robust latent representations and faithfully recover latent factors on synthetic datasets.


title: Developing Parameter-Reduction Methods on a Biophysical Model of Auditory Hair Cells

abstract: Biophysical models describing complex, cellular phenomena typically include systems of nonlinear differential equations with many free parameters. While experimental measurements can fix some parameters, those describing internal cellular processes frequently remain inaccessible. Hence, a proliferation of free parameters risks overfitting the data, limiting the model's predictive power. In this study, we develop robust methods, applying statistical analysis and dynamical-systems theory, to reduce a biophysical model's complexity. We demonstrate our techniques on an elaborate computational model designed to describe active, mechanical motility of auditory hair cells. Specifically, we use two statistical measures, the total-effect and PAWN indices, to rank each free parameter by its influence on selected, core properties of the model. With the resulting ranking, we fix most of the less influential parameters, yielding a low-parameter model with optimal predictive power. We validate the theoretical model with experimental recordings of active hair-bundle motility, specifically by using Akaike and Bayesian information criteria after obtaining maximum-likelihood fits. As a result, we determine the system's most influential parameters, which illuminate its key biophysical elements of the cell's overall features. While we demonstrated our techniques on a concrete example, they provide a general framework, applicable to other biophysical systems.


title: Toward Real Text Manipulation Detection: New Dataset and New Solution

abstract: With the surge in realistic text tampering, detecting fraudulent text in images has gained prominence for maintaining information security. However, the high costs associated with professional text manipulation and annotation limit the availability of real-world datasets, with most relying on synthetic tampering, which inadequately replicates real-world tampering attributes. To address this issue, we present the Real Text Manipulation (RTM) dataset, encompassing 14,250 text images, which include 5,986 manually and 5,258 automatically tampered images, created using a variety of techniques, alongside 3,006 unaltered text images for evaluating solution stability. Our evaluations indicate that existing methods falter in text forgery detection on the RTM dataset. We propose a robust baseline solution featuring a Consistency-aware Aggregation Hub and a Gated Cross Neighborhood-attention Fusion module for efficient multi-modal information fusion, supplemented by a Tampered-Authentic Contrastive Learning module during training, enriching feature representation distinction. This framework, extendable to other dual-stream architectures, demonstrated notable localization performance improvements of 7.33% and 6.38% on manual and overall manipulations, respectively. Our contributions aim to propel advancements in real-world text tampering detection. Code and dataset will be made available at https://github.com/DrLuo/RTM


title: Time-Scaling, Ergodicity and Covariance Decay of Interacting Particle Systems

abstract: The main focus of this article is the study of ergodicity of Interacting Particle Systems (IPS). We present a simple time-scaling lemma showing that rescaling time is equivalent to taking the convex combination of the transition matrix of the IPS with the identity. As a consequence, the ergodic properties of IPS are invariant under this transformation. Surprisingly, this almost trivial observation has non-trivial implications. It allows us to extend any result that does not respect this invariance. We give three examples: First, we extend results about monotone IPS including an ergodicity criterion by Gray, and second, we extend results by Griffeath about additive and cancellative IPS. Finally, deduce a new criterion for the decay of correlation for IPS using a straightforward induction method and apply the time-scaling lemma to that as well.


title: A Comparison of Interfaces for Learning How to Play a Mixed Reality Handpan

abstract: In the realm of music therapy, Virtual Reality (VR) has a long-standing history of enriching human experiences through immersive applications, spanning entertainment games, serious games, and professional training in various fields. However, the untapped potential lies in using VR games to support mindfulness through music. We present a new approach utilizing a virtual environment to facilitate learning how to play the handpan -- an instrument in the shape of a spherical dish with harmonically tuned notes used commonly in the sound healing practice of mindfulness. In a preliminary study, we compared six interfaces, where the highlighted path interface performed best. However, participants expressed preference for the standard interface inspired by rhythm games like Guitar Hero.


title: Can a Transformer Represent a Kalman Filter?

abstract: Transformers are a class of autoregressive deep learning architectures which have recently achieved state-of-the-art performance in various vision, language, and robotics tasks. We revisit the problem of Kalman Filtering in linear dynamical systems and show that Transformers can approximate the Kalman Filter in a strong sense. Specifically, for any observable LTI system we construct an explicit causally-masked Transformer which implements the Kalman Filter, up to a small additive error which is bounded uniformly in time; we call our construction the Transformer Filter. Our construction is based on a two-step reduction. We first show that a softmax self-attention block can exactly represent a Nadaraya-Watson kernel smoothing estimator with a Gaussian kernel. We then show that this estimator closely approximates the Kalman Filter. We also investigate how the Transformer Filter can be used for measurement-feedback control and prove that the resulting nonlinear controllers closely approximate the performance of standard optimal control policies such as the LQG controller.


title: The Lipschitz type of the Geometric Directional Bundle

abstract: In this paper we investigate the behaviour of the geometric directional bundles, associated to arbitrary subsets in R^n, under bi-Lipschitz homeomorphisms, and give conditions under which their bi-Lipschitz type is preserved. The most general sets we consider satisfy the sequence selection property (SSP) and, consequently, we investigate the behaviour of such sets under bi-Lipschitz homeomorphisms as well. In particular, we show that the bi-Lipschitz images of a subanalytic sets generically satisfy the (SSP) property.


title: Visually quantifying single-qubit quantum memory

abstract: To store quantum information, quantum memory plays a central intermediate ingredient in a network. The minimal criterion for a reliable quantum memory is the maintenance of the entangled state, which can be described by the non-entanglement-breaking (non-EB) channel. In this work, we show that all single-qubit quantum memory can be quantified without trusting input state generation. In other words, we provide a semi-device-independent approach to quantify all single-qubit quantum memory. More specifically, we apply the concept of the two-qubit quantum steering ellipsoids to a single-qubit quantum channel and define the channel ellipsoids. An ellipsoid can be constructed by visualizing finite output states within the Bloch sphere. Since the Choi-Jamio{\l}kowski state of a channel can all be reconstructed from geometric data of the channel ellipsoid, a reliable quantum memory can be detected. Finally, we visually quantify the single-qubit quantum memory by observing the volume of the channel ellipsoid.


title: Benchmarking Deep Learning Classifiers for SAR Automatic Target Recognition

abstract: Synthetic Aperture Radar SAR Automatic Target Recognition ATR is a key technique of remote-sensing image recognition which can be supported by deep neural networks The existing works of SAR ATR mostly focus on improving the accuracy of the target recognition while ignoring the systems performance in terms of speed and storage which is critical to real-world applications of SAR ATR For decision-makers aiming to identify a proper deep learning model to deploy in a SAR ATR system it is important to understand the performance of different candidate deep learning models and determine the best model accordingly This paper comprehensively benchmarks several advanced deep learning models for SAR ATR with multiple distinct SAR imagery datasets Specifically we train and test five SAR image classifiers based on Residual Neural Networks ResNet18 ResNet34 ResNet50 Graph Neural Network GNN and Vision Transformer for Small-Sized Datasets (SS-ViT) We select three datasets MSTAR GBSAR and SynthWakeSAR that offer heterogeneity We evaluate and compare the five classifiers concerning their classification accuracy runtime performance in terms of inference throughput and analytical performance in terms of number of parameters number of layers model size and number of operations Experimental results show that the GNN classifier outperforms with respect to throughput and latency However it is also shown that no clear model winner emerges from all of our chosen metrics and a one model rules all case is doubtful in the domain of SAR ATR


title: Humans vs Large Language Models: Judgmental Forecasting in an Era of Advanced AI

abstract: This study investigates the forecasting accuracy of human experts versus Large Language Models (LLMs) in the retail sector, particularly during standard and promotional sales periods. Utilizing a controlled experimental setup with 123 human forecasters and five LLMs, including ChatGPT4, ChatGPT3.5, Bard, Bing, and Llama2, we evaluated forecasting precision through Mean Absolute Percentage Error. Our analysis centered on the effect of the following factors on forecasters performance: the supporting statistical model (baseline and advanced), whether the product was on promotion, and the nature of external impact. The findings indicate that LLMs do not consistently outperform humans in forecasting accuracy and that advanced statistical forecasting models do not uniformly enhance the performance of either human forecasters or LLMs. Both human and LLM forecasters exhibited increased forecasting errors, particularly during promotional periods and under the influence of positive external impacts. Our findings call for careful consideration when integrating LLMs into practical forecasting processes.


title: AI Control: Improving Safety Despite Intentional Subversion

abstract: As large language models (LLMs) become more powerful and are deployed more autonomously, it will be increasingly important to prevent them from causing harmful outcomes. Researchers have investigated a variety of safety techniques for this purpose, e.g. using models to review the outputs of other models, or red-teaming techniques to surface subtle failure modes. However, researchers have not evaluated whether such techniques still ensure safety if the model is itself intentionally trying to subvert them. In this paper, we develop and evaluate pipelines of safety techniques ("protocols") that are robust to intentional subversion. We investigate a scenario in which we want to solve a sequence of programming problems, using access to a powerful but untrusted model (in our case, GPT-4), access to a less powerful trusted model (in our case, GPT-3.5), and limited access to high-quality trusted labor. We investigate protocols that aim to never submit solutions containing backdoors, which we operationalize here as logical errors that are not caught by test cases. We investigate a range of protocols and test each against strategies that the untrusted model could use to subvert them. One protocol is what we call trusted editing. This protocol first asks GPT-4 to write code, and then asks GPT-3.5 to rate the suspiciousness of that code. If the code is below some suspiciousness threshold, it is submitted. Otherwise, GPT-3.5 edits the solution to remove parts that seem suspicious and then submits the edited code. Another protocol is untrusted monitoring. This protocol asks GPT-4 to write code, and then asks another instance of GPT-4 whether the code is backdoored, using various techniques to prevent the GPT-4 instances from colluding. These protocols improve substantially on simple baselines.


title: Notes on semisimple tensor categories of rank two

abstract: In this paper, we show that there are infinitely many semisimple tensor (or monoidal) categories of rank two over an algebraically closed field $\mathbb F$.


title: Qubits as Hypermatrices and Entanglement

abstract: In this paper, we represent $n$-qubits as hypermatrices and consider various applications to quantum entanglement. In particular, we use the higher-order singular value decomposition of hypermatrices to prove that the $\pi$-transpose is an LU invariant. Additionally, through our construction we show that the matrix representation of the combinatorial hyperdeterminant of $2n$-qubits can be expressed as a product of the second Pauli matrix, allowing us to derive a formula for the combinatorial hyperdeterminant of $2n$-qubits in terms of the $n$-tangle.


title: A transport-like approach to turbulence-mediated magnetic reconnection

abstract: A transport-like framework for the study of magnetic reconnection mediated by self-driven turbulence is proposed, based on timescale separation between the reconnection time and the characteristic timescale of the turbulent fluctuations which arise in the reconnection layer. We argue that the mean fields remain on MHD scales even in collisionless cases. These observations provide theoretical justification for an efficient computational approach to this problem, which we discuss.


title: WaterHE-NeRF: Water-ray Tracing Neural Radiance Fields for Underwater Scene Reconstruction

abstract: Neural Radiance Field (NeRF) technology demonstrates immense potential in novel viewpoint synthesis tasks, due to its physics-based volumetric rendering process, which is particularly promising in underwater scenes. Addressing the limitations of existing underwater NeRF methods in handling light attenuation caused by the water medium and the lack of real Ground Truth (GT) supervision, this study proposes WaterHE-NeRF. We develop a new water-ray tracing field by Retinex theory that precisely encodes color, density, and illuminance attenuation in three-dimensional space. WaterHE-NeRF, through its illuminance attenuation mechanism, generates both degraded and clear multi-view images and optimizes image restoration by combining reconstruction loss with Wasserstein distance. Additionally, the use of histogram equalization (HE) as pseudo-GT enhances the network's accuracy in preserving original details and color distribution. Extensive experiments on real underwater datasets and synthetic datasets validate the effectiveness of WaterHE-NeRF. Our code will be made publicly available.


title: MaTe3D: Mask-guided Text-based 3D-aware Portrait Editing

abstract: 3D-aware portrait editing has a wide range of applications in multiple fields. However, current approaches are limited due that they can only perform mask-guided or text-based editing. Even by fusing the two procedures into a model, the editing quality and stability cannot be ensured. To address this limitation, we propose \textbf{MaTe3D}: mask-guided text-based 3D-aware portrait editing. In this framework, first, we introduce a new SDF-based 3D generator which learns local and global representations with proposed SDF and density consistency losses. This enhances masked-based editing in local areas; second, we present a novel distillation strategy: Conditional Distillation on Geometry and Texture (CDGT). Compared to exiting distillation strategies, it mitigates visual ambiguity and avoids mismatch between texture and geometry, thereby producing stable texture and convincing geometry while editing. Additionally, we create the CatMask-HQ dataset, a large-scale high-resolution cat face annotation for exploration of model generalization and expansion. We perform expensive experiments on both the FFHQ and CatMask-HQ datasets to demonstrate the editing quality and stability of the proposed method. Our method faithfully generates a 3D-aware edited face image based on a modified mask and a text prompt. Our code and models will be publicly released.


title: Unsupervised learning in the metric space of jets

abstract: In the first part of this work, we demonstrate how the metric space structure induced by the energy mover's distance can be leveraged for the unsupervised tagging of jets according to their progenitor. Namely, we focus on the task of tagging jets initiated by a top quark from a background of jets initiated by light quarks and gluons. By examining the local neighborhood structure of this metric space, we find that the jets of each class populate the landscape in differing densities. This characteristic can be exploited to accurately cluster jets according to their densities through unsupervised clustering algorithms, such as DBSCAN. In the second part of this work, we modify the metric space by reducing the global notion of connectivity down to a local one and, in the process of doing so, modify our distance metric to be that corresponding to geodesics on an underlying graph. We demonstrate how this modification induces regions of both positive and negative values of curvature, which are then exacerbated through a Ricci flow algorithm. Differences in the curvatures averaged over local patches of the new graph metric space then lead to a flow which separates the signal top jets from the background in a fashion that is completely agnostic to any pre-determined jet labels.


title: A novel paradigm for solving PDEs: multi scale neural computing

abstract: Numerical simulation is dominant in solving partial difference equations (PDEs), but balancing fine-grained grids with low computational costs is challenging. Recently, solving PDEs with neural networks (NNs) has gained interest, yet cost-effectiveness and high accuracy remains a challenge. This work introduces a novel paradigm for solving PDEs, called multi scale neural computing (MSNC), considering spectral bias of NNs and local approximation properties in the finite difference method (FDM). The MSNC decomposes the solution with a NN for efficient capture of global scale and the FDM for detailed description of local scale, aiming to balance costs and accuracy. Demonstrated advantages include higher accuracy (10 times for 1D PDEs, 20 times for 2D PDEs) and lower costs (4 times for 1D PDEs, 16 times for 2D PDEs) than the standard FDM. The MSNC also exhibits stable convergence and rigorous boundary condition satisfaction, showcasing the potential for hybrid of NN and numerical method.


title: READ-PVLA: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modeling

abstract: Fully fine-tuning pretrained large-scale transformer models has become a popular paradigm for video-language modeling tasks, such as temporal language grounding and video-language summarization. With a growing number of tasks and limited training data, such full fine-tuning approach leads to costly model storage and unstable training. To overcome these shortcomings, we introduce lightweight adapters to the pre-trained model and only update them at fine-tuning time. However, existing adapters fail to capture intrinsic temporal relations among video frames or textual words. Moreover, they neglect the preservation of critical task-related information that flows from the raw video-language input into the adapter's low-dimensional space. To address these issues, we first propose a novel REcurrent ADapter (READ) that employs recurrent computation to enable temporal modeling capability. Second, we propose Partial Video-Language Alignment (PVLA) objective via the use of partial optimal transport to maintain task-related information flowing into our READ modules. We validate our READ-PVLA framework through extensive experiments where READ-PVLA significantly outperforms all existing fine-tuning strategies on multiple low-resource temporal language grounding and video-language summarization benchmarks.


title: Feature Norm Regularized Federated Learning: Transforming Skewed Distributions into Global Insights

abstract: In the field of federated learning, addressing non-independent and identically distributed (non-i.i.d.) data remains a quintessential challenge for improving global model performance. This work introduces the Feature Norm Regularized Federated Learning (FNR-FL) algorithm, which uniquely incorporates class average feature norms to enhance model accuracy and convergence in non-i.i.d. scenarios. Our comprehensive analysis reveals that FNR-FL not only accelerates convergence but also significantly surpasses other contemporary federated learning algorithms in test accuracy, particularly under feature distribution skew scenarios. The novel modular design of FNR-FL facilitates seamless integration with existing federated learning frameworks, reinforcing its adaptability and potential for widespread application. We substantiate our claims through rigorous empirical evaluations, demonstrating FNR-FL's exceptional performance across various skewed data distributions. Relative to FedAvg, FNR-FL exhibits a substantial 66.24\% improvement in accuracy and a significant 11.40\% reduction in training time, underscoring its enhanced effectiveness and efficiency.


title: On the QCD critical point, Lee-Yang edge singularities and Pade resummations

abstract: We analyze the trajectory of the Lee-Yang edge singularities of the QCD equation of state in the complex baryon chemical potential ($\mu_B$) plane for different values of the temperature by using the recent lattice results for the Taylor expansion coefficients up to eighth order in $\mu_B$ and various resummation techniques that blend in Pade expansions and conformal maps. By extrapolating from this information, we estimate for the location of the QCD critical point, $ T_c \approx 100$ MeV, $\mu_c \approx 580$ MeV. We also estimate the crossover slope at the critical point to be $\alpha_1 \approx 9^\circ$ and further constrain the non-universal mapping parameters between the three dimensional Ising model and QCD equations of state.


title: Simple Reciprocal Electric Circuit Exhibiting Exceptional Point of Degeneracy

abstract: An exceptional point of degeneracy (EPD) occurs when both the eigenvalues and the corresponding eigenvectors of a square matrix coincide and the matrix has a nontrivial Jordan block structure. It is not easy to achieve an EPD exactly. In our prior studies, we synthesized simple conservative (lossless) circuits with evolution matrices featuring EPDs by using two LC loops coupled by a gyrator. In this paper, we advance even a simpler circuit with an EPD consisting of only two LC loops with one capacitor shared. Consequently, this circuit involves only four elements and it is perfectly reciprocal. The shared capacitance and parallel inductance are negative with values determined by explicit formulas which lead to EPD. This circuit can have the same Jordan canonical form as the nonreciprocal circuit we introduced before. This implies that the Jordan canonical form does not necessarily manifest systems' nonreciprocity. It is natural to ask how nonreciprocity is manifested in the system's spectral data. Our analysis of this issue shows that nonreciprocity is manifested explicitly in: (i) the circuit Lagrangian and (ii) the breakdown of certain symmetries in the set of eigenmodes. All our significant theoretical findings were thoroughly tested and confirmed by extensive numerical simulations using commercial circuit simulator software.


title: Re-understanding of the deformation potential constant in the single crystal silicon

abstract: The mobility formula based on deformation potential (DP) theory is of great importance in semiconductor physics. However, the related calculations for the DP constant are controversial. It is necessary to redo in-depth and comprehensive research on the mobility of single crystal silicon and the related parameters such as the effective mass and the DP constant. In this work the conductivity effective mass is redefined and a method based on the first principles is presented to evaluate the correction of the DP constant. It is found that the effective mass is closer to experimental data and the correction of the DP is a negligible value of about 0.3 eV. Using these parameters, we obtain the mobilities of the single crystal silicon in reasonable agreement with the experimental values. Our method can be effectively applied to the prediction for the mobility in bulk materials.


title: IA2U: A Transfer Plugin with Multi-Prior for In-Air Model to Underwater

abstract: In underwater environments, variations in suspended particle concentration and turbidity cause severe image degradation, posing significant challenges to image enhancement (IE) and object detection (OD) tasks. Currently, in-air image enhancement and detection methods have made notable progress, but their application in underwater conditions is limited due to the complexity and variability of these environments. Fine-tuning in-air models saves high overhead and has more optional reference work than building an underwater model from scratch. To address these issues, we design a transfer plugin with multiple priors for converting in-air models to underwater applications, named IA2U. IA2U enables efficient application in underwater scenarios, thereby improving performance in Underwater IE and OD. IA2U integrates three types of underwater priors: the water type prior that characterizes the degree of image degradation, such as color and visibility; the degradation prior, focusing on differences in details and textures; and the sample prior, considering the environmental conditions at the time of capture and the characteristics of the photographed object. Utilizing a Transformer-like structure, IA2U employs these priors as query conditions and a joint task loss function to achieve hierarchical enhancement of task-level underwater image features, therefore considering the requirements of two different tasks, IE and OD. Experimental results show that IA2U combined with an in-air model can achieve superior performance in underwater image enhancement and object detection tasks. The code will be made publicly available.


title: Robotics Applications in Neurology: A Review of Recent Advancements and Future Directions

abstract: Robotic technology has the potential to revolutionize the field of neurology by providing new methods for diagnosis, treatment, and rehabilitation of neurological disorders. In recent years, there has been an increasing interest in the development of robotics applications for neurology, driven by advances in sensing, actuation, and control systems. This review paper provides a comprehensive overview of the recent advancements in robotics technology for neurology, with a focus on three main areas: diagnosis, treatment, and rehabilitation. In the area of diagnosis, robotics has been used for developing new imaging techniques and tools for more accurate and non-invasive mapping of brain structures and functions. For treatment, robotics has been used for developing minimally invasive surgical procedures, including stereotactic and endoscopic approaches, as well as for the delivery of therapeutic agents to specific targets in the brain. In rehabilitation, robotics has been used for developing assistive devices and platforms for motor and cognitive training of patients with neurological disorders. The paper also discusses the challenges and limitations of current robotics technology for neurology, including the need for more reliable and precise sensing and actuation systems, the development of better control algorithms, and the ethical implications of robotic interventions in the human brain. Finally, the paper outlines future directions and opportunities for robotics applications in neurology, including the integration of robotics with other emerging technologies, such as neuroprosthetics, artificial intelligence, and virtual reality. Overall, this review highlights the potential of robotics technology to transform the field of neurology and improve the lives of patients with neurological disorders.


title: Online Saddle Point Problem and Online Convex-Concave Optimization

abstract: Centered around solving the Online Saddle Point problem, this paper introduces the Online Convex-Concave Optimization (OCCO) framework, which involves a sequence of two-player time-varying convex-concave games. We propose the generalized duality gap (Dual-Gap) as the performance metric and establish the parallel relationship between OCCO with Dual-Gap and Online Convex Optimization (OCO) with regret. To demonstrate the natural extension of OCCO from OCO, we develop two algorithms, the implicit online mirror descent-ascent and its optimistic variant. Analysis reveals that their duality gaps share similar expression forms with the corresponding dynamic regrets arising from implicit updates in OCO. Empirical results further substantiate the effectiveness of our algorithms. Simultaneously, we unveil that the dynamic Nash equilibrium regret, which was initially introduced in a recent paper, has inherent defects.


title: PatchMorph: A Stochastic Deep Learning Approach for Unsupervised 3D Brain Image Registration with Small Patches

abstract: We introduce "PatchMorph," an new stochastic deep learning algorithm tailored for unsupervised 3D brain image registration. Unlike other methods, our method uses compact patches of a constant small size to derive solutions that can combine global transformations with local deformations. This approach minimizes the memory footprint of the GPU during training, but also enables us to operate on numerous amounts of randomly overlapping small patches during inference to mitigate image and patch boundary problems. PatchMorph adeptly handles world coordinate transformations between two input images, accommodating variances in attributes such as spacing, array sizes, and orientations. The spatial resolution of patches transitions from coarse to fine, addressing both global and local attributes essential for aligning the images. Each patch offers a unique perspective, together converging towards a comprehensive solution. Experiments on human T1 MRI brain images and marmoset brain images from serial 2-photon tomography affirm PatchMorph's superior performance.


title: Chemical differences among collapsing low-mass protostellar cores

abstract: Organic features lead to two distinct types of Class 0/I low-mass protostars: hot corino sources, and warm carbon-chain chemistry (WCCC) sources. Some observations suggest that the chemical variations between WCCC sources and hot corino sources are associated with local environments, as well as the luminosity of protostars. We conducted gas-grain chemical simulation in collapsing protostellar cores, and found that the fiducial model predicts abundant carbon-chain molecules and COMs, and reproduces WCCC and hot corino chemistry in the hybrid source L483. By changing values of some physical parameters, including the visual extinction of ambient clouds ($A_{\rm V}^{\rm amb}$), the cosmic-ray ionization rate ($\zeta$), the maximum temperature during the warm-up phase ($T_{\rm max}$), and the contraction timescale of protostars ($t_{\rm cont}$), we found that UV photons and cosmic rays can boost WCCC features by accelerating the dissociation of CO and CH$_4$ molecules. On the other hand, UV photons can weaken the hot corino chemistry by photodissociation reactions, while the dependence of hot corino chemistry on cosmic rays is relatively complex. The $T_{\rm max}$ does not affect WCCC features, while it can influence hot corino chemistry by changing the effective duration of two-body surface reactions for most COMs. The long $t_{\rm cont}$ can boost WCCC and hot corino chemistry, by prolonging the effective duration of WCCC reactions in the gas phase and surface formation reactions for COMs, respectively. Subsequently, we ran a model with different physical parameters to reproduce scarce COMs in prototypical WCCC sources. The scarcity of COMs in prototypical WCCC sources can be explained by insufficient dust temperature in the inner envelopes to activate hot corino chemistry. Meanwhile, the High $\zeta$ and the long $t_{\rm cont}$ favors the explanation for scarce COMs in these sources.


title: Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignment

abstract: We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting remote-sensing images and language. Specifically, we train an image encoder for remote sensing images to align with the image encoder of CLIP using a large amount of paired internet and satellite images. Our unsupervised approach enables the training of a first-of-its-kind large-scale vision language model (VLM) for remote sensing images at two different resolutions. We show that these VLMs enable zero-shot, open-vocabulary image classification, retrieval, segmentation and visual question answering for satellite images. On each of these tasks, our VLM trained without textual annotations outperforms existing VLMs trained with supervision, with gains of up to 20% for classification and 80% for segmentation.


title: Fast as Potoroo: Radio Continuum Detection of a Bow-Shock Pulsar Wind Nebula Powered by Pulsar J1638-4713

abstract: We report the discovery of a bow-shock pulsar wind nebula (PWN), named Potoroo, and the detection of a young pulsar J1638-4713 that powers the nebula. We present a radio continuum study of the PWN based on 20-cm observations obtained from the Australian Square Kilometre Array Pathfinder (ASKAP) and MeerKAT. PSR J1638-4713 was identified using Parkes radio telescope observations at frequencies above 3 GHz. The pulsar has the second-highest dispersion measure of all known radio pulsars (1553 pc/cm^3), a spin period of 65.74 ms and a spin-down luminosity of 6.1x10^36 erg/s. The PWN has a cometary morphology and one of the greatest projected lengths among all the observed pulsar radio tails, measuring over 21 pc for an assumed distance of 10 kpc. The remarkably long tail and atypically steep radio spectral index are attributed to the interplay of a supernova reverse shock and the PWN. The originating supernova remnant is not known so far. We estimated the pulsar kick velocity to be in the range of 1000-2000 km/s for ages between 23 and 10 kyr. The X-ray counterpart found in Chandra data, CXOU J163802.6-471358, shows the same tail morphology as the radio source but is shorter by a factor of 10. The peak of the X-ray emission is offset from the peak of the radio total intensity (Stokes I) emission by approximately 4.7", but coincides well with circularly polarised (Stokes V) emission. No infrared counterpart was found.


title: Strictly Monotone Brouwer Trees for Well-founded Recursion Over Multiple Arguments

abstract: Ordinals can help prove termination for dependently typed programs. Brouwer trees are a particular ordinal notation that make it very easy to assign sizes to higher order data structures. They extend natural numbers with a limit constructor, so a function's size can be the supremum of the sizes of values from its image. These can then be used to define well-founded recursion: any recursive calls are allowed so long as they are on values whose sizes are strictly smaller than the current size. Unfortunately, Brouwer trees are not algebraically well-behaved. They can be characterized equationally as a join-semilattice, where the join takes the maximum of two trees. However, it does not interact well with the successor constructor, so it does not interact properly with the strict ordering used in well-founded recursion. We present Strictly Monotone Brouwer trees (SMB-trees), a refinement of Brouwer trees that are algebraically well-behaved. SMB-trees are built using functions with the same signatures as Brouwer tree constructors, and they satisfy all Brouwer tree inequalities. However, their join operator distributes over the successor, making them suited for well-founded recursion or equational reasoning. We show how, using dependent pairs and careful definitions, an ill-behaved definition can be turned into a well-behaved one, with light axiomatic requirements. We implement a recursively-defined maximum operator for Brouwer trees that matches on successors and handles them specifically. Then, we define SMB-trees as the subset of Brouwer trees for which the recursive maximum computes a least upper bound. Finally, we show that every Brouwer tree can be transformed into a corresponding SMB-tree by joining it with itself an infinite number of times. All definitions and theorems are implemented in Agda.


title: Enhanced ionic conductivity through crystallization of glass-Li$_3$PS$_4$ by machine learning molecular dynamics simulations

abstract: Understanding the atomistic mechanism of ion conduction in solid electrolytes is critical for the advancement of all-solid-state batteries. Glass-ceramics, which undergo crystallization from a glass state, frequently exhibit unique properties including enhanced ionic conductivities compared to both the original crystalline and glass forms. Despite these distinctive features, specific details regarding the behavior of ion conduction in glass-ceramics, particularly concerning conduction pathways, remain elusive. In this study, we demonstrate the crystallization process of glass-Li$_3$PS$_4$ through molecular dynamics simulations employing machine learning interatomic potentials constructed from first principles calculation data. Our analyses of Li conduction using the obtained partially crystallized structures reveal that the diffusion barriers of Li decrease as the crystallinity in Li$_3$PS$_4$ glass-ceramics increases. Furthermore, Li displacements predominantly occur in the precipitated crystalline portion, suggesting that percolation conduction plays a significant role in enhanced Li conduction. These findings provide valuable insights for the future utilization of glass-ceramic materials.


title: Ground Calibration Result of the Lobster Eye Imager for Astronomy

abstract: We report on results of the on-ground X-ray calibration of the Lobster Eye Imager for Astronomy (LEIA), an experimental space wide-field (18.6*18.6 square degrees) X-ray telescope built from novel lobster eye mirco-pore optics. LEIA was successfully launched on July 27, 2022 onboard the SATech-01 satellite. To achieve full characterisation of its performance before launch, a series of tests and calibrations have been carried out at different levels of devices, assemblies and the complete module. In this paper, we present the results of the end-to-end calibration campaign of the complete module carried out at the 100-m X-ray Test Facility at IHEP. The PSF, effective area and energy response of the detectors were measured in a wide range of incident directions at several X-ray line energies. The distributions of the PSF and effective areas are roughly uniform across the FoV, in large agreement with the prediction of lobster-eye optics. The mild variations and deviations from the prediction of idealized lobster-eye optics can be understood to be caused by the imperfect shapes and alignment of the micro-pores as well as the obscuration by the supporting frames, which can be well reproduced by MC simulations. The spatial resolution of LEIA defined by the FWHM of the focal spot ranges from 4-8 arcmin with a median of 5.7. The measured effective areas are in range of 2-3 $cm^2$ at ~1.25 keV across the entire FoV, and its dependence on photon energy is in large agreement with simulations. The gains of the CMOS sensors are in range of 6.5-6.9 eV/DN, and the energy resolutions in the range of ~120-140 eV at 1.25 keV and ~170-190 eV at 4.5 keV. These results have been ingested into the calibration database and applied to the analysis of the scientific data acquired by LEIA. This work paves the way for the calibration of the Wide-field X-Ray Telescope modules of the Einstein Probe mission.


title: Towards Enhanced Human Activity Recognition through Natural Language Generation and Pose Estimation

abstract: Vision-based human activity recognition (HAR) has made substantial progress in recognizing predefined gestures but lacks adaptability for emerging activities. This paper introduces a paradigm shift by harnessing generative modeling and large language models (LLMs) to enhance vision-based HAR. We propose utilizing LLMs to generate descriptive textual representations of activities using pose keypoints as an intermediate representation. Incorporating pose keypoints adds contextual depth to the recognition process, allowing for sequences of vectors resembling text chunks, compatible with LLMs. This innovative fusion of computer vision and natural language processing holds significant potential for revolutionizing activity recognition. A proof of concept study on a Kinetics700 dataset subset validates the approach's efficacy, highlighting improved accuracy and interpretability. Future implications encompass enhanced accuracy, novel research avenues, model generalization, and ethical considerations for transparency. This framework has real-world applications, including personalized gym workout feedback and nuanced sports training insights. By connecting visual cues to interpretable textual descriptions, the proposed framework advances HAR accuracy and applicability, shaping the landscape of pervasive computing and activity recognition research. As this approach evolves, it promises a more insightful understanding of human activities across diverse contexts, marking a significant step towards a better world.


title: How Much Data is Needed for Channel Knowledge Map Construction?

abstract: Channel knowledge map (CKM) has been recently proposed to enable environment-aware communications by utilizing historical or simulation generated wireless channel data. This paper studies the construction of one particular type of CKM, namely channel gain map (CGM), by using a finite number of measurements or simulation-generated data, with model-based spatial channel prediction. We try to answer the following question: How much data is sufficient for CKM construction? To this end, we first derive the average mean square error (AMSE) of the channel gain prediction as a function of the sample density of data collection for offline CGM construction, as well as the number of data points used for online spatial channel gain prediction. To model the spatial variation of the wireless environment even within each cell, we divide the CGM into subregions and estimate the channel parameters from the local data within each subregion. The parameter estimation error and the channel prediction error based on estimated channel parameters are derived as functions of the number of data points within the subregion. The analytical results provide useful guide for CGM construction and utilization by determining the required spatial sample density for offline data collection and number of data points to be used for online channel prediction, so that the desired level of channel prediction accuracy is guaranteed.


title: Admissible subcategories of noncommutative curves

abstract: We study admissible subcategories of the derived categories of smooth noncommutative curves as classified by Reiten-van den Bergh. We prove phantom subcategories do not exist in these derived categories and we obtain a complete classification of the admissible subcategories of the bounded derived category of representations of an acyclic quiver.


title: Hallucination Augmented Contrastive Learning for Multimodal Large Language Model

abstract: Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend to generate erroneous or fabricated information. In this paper, we address hallucinations in MLLMs from a novel perspective of representation learning. We first analyzed the representation distribution of textual and visual tokens in MLLM, revealing two important findings: 1) there is a significant gap between textual and visual representations, indicating unsatisfactory cross-modal representation alignment; 2) representations of texts that contain and do not contain hallucinations are entangled, making it challenging to distinguish them. These two observations inspire us with a simple yet effective method to mitigate hallucinations. Specifically, we introduce contrastive learning into MLLMs and use text with hallucination as hard negative examples, naturally bringing representations of non-hallucinative text and visual samples closer while pushing way representations of non-hallucinating and hallucinative text. We evaluate our method quantitatively and qualitatively, showing its effectiveness in reducing hallucination occurrences and improving performance across multiple benchmarks. On the MMhal-Bench benchmark, our method obtains a 34.66% /29.5% improvement over the baseline MiniGPT-4/LLaVA. Our code is available on https://github.com/X-PLUG/mPLUG-HalOwl/tree/main/hacl.


title: Channel Estimation for Movable Antenna Communication Systems: A Framework Based on Compressed Sensing

abstract: Movable antenna (MA) is a new technology with great potential to improve communication performance by enabling local movement of antennas for pursuing better channel conditions. In particular, the acquisition of complete channel state information (CSI) between the transmitter (Tx) and receiver (Rx) regions is an essential problem for MA systems to reap performance gains. In this paper, we propose a general channel estimation framework for MA systems by exploiting the multi-path field response channel structure. Specifically, the angles of departure (AoDs), angles of arrival (AoAs), and complex coefficients of the multi-path components (MPCs) are jointly estimated by employing the compressed sensing method, based on multiple channel measurements at designated positions of the Tx-MA and Rx-MA. Under this framework, the Tx-MA and Rx-MA measurement positions fundamentally determine the measurement matrix for compressed sensing, of which the mutual coherence is analyzed from the perspective of Fourier transform. Moreover, two criteria for MA measurement positions are provided to guarantee the successful recovery of MPCs. Then, we propose several MA measurement position setups and compare their performance. Finally, comprehensive simulation results show that the proposed framework is able to estimate the complete CSI between the Tx and Rx regions with a high accuracy.


title: Engineering Moir\'e Meta-crystals with Conventional Photonic and Phononic Structures

abstract: Recent discoveries on Mott insulating and unconventional superconducting states in twisted bilayer graphene with Moir\'e superlattices have reshaped the landscape of ''twistronics'' and paved the way for developing high-temperature superconductors and new devices for quantum computing and sensing. Meanwhile, artificially structured photonic and phononic metamaterials/crystals (or meta-crystals) have become a fertile playground for emulating quantum-mechanical features of condensed matter systems, revealing new routes for robust control of classical waves. Drawing inspiration from the success of twisted bilayer graphene, this perspective casts an overarching framework of the emerging Moir\'e photonic and phononic meta-crystals that promise novel classical-wave devices. We begin with the fundamentals of Moir\'e superlattices, before highlighting recent works that exploit twist angle and interlayer coupling as new ingredients to engineer and tailor the band structures and effective material properties of photonic and phononic meta-crystals. We finally discuss future directions and promises of this emerging area in materials science and wave physics.


title: CCM: Adding Conditional Controls to Text-to-Image Consistency Models

abstract: Consistency Models (CMs) have showed a promise in creating visual content efficiently and with high quality. However, the way to add new conditional controls to the pretrained CMs has not been explored. In this technical report, we consider alternative strategies for adding ControlNet-like conditional control to CMs and present three significant findings. 1) ControlNet trained for diffusion models (DMs) can be directly applied to CMs for high-level semantic controls but struggles with low-level detail and realism control. 2) CMs serve as an independent class of generative models, based on which ControlNet can be trained from scratch using Consistency Training proposed by Song et al. 3) A lightweight adapter can be jointly optimized under multiple conditions through Consistency Training, allowing for the swift transfer of DMs-based ControlNet to CMs. We study these three solutions across various conditional controls, including edge, depth, human pose, low-resolution image and masked image with text-to-image latent consistency models.


title: A Data-Driven Approach for Parameterizing Submesoscale Vertical Buoyancy Fluxes in the Ocean Mixed Layer

abstract: The parameterizations of submesoscale ($<10$km) ocean surface flows are critical in capturing the subgrid effects of vertical fluxes in the ocean mixed layer, yet they struggle to infer the full-complexity of these fluxes in relation to the large scale variables that help set them. In this work, we present a data-driven approach for the submesoscale parameterization, utilizing information from the high-resolution submesoscale-permitting MITgcm-LLC4320 simulation (LLC4320). The new parameterization is given by a Convolutional Neural Network (CNN) trained to infer the subgrid mixed layer vertical buoyancy fluxes as a function of relevant large scale variables. In contrast to previous physics-based approaches, such as the Mixed Layer Eddy (MLE) parameterization, here the CNN infers vertical fluxes that are directly computed from the LLC4320 data, where the submesoscales are resolved down to a resolution of approximately 2km. The CNN has significantly high skill compared with the MLE parameterization, which we demonstrate over a wide range of dynamical regimes and resolutions. We find that the improved skill can be attributed to learned physical relationships between submesoscale fluxes and the large scale strain field, currently missing from submesoscale parameterizations in General Circulation Models.


title: Anytime Approximate Formal Feature Attribution

abstract: Widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models on the one hand and a number of crucial issues pertaining to them warrant the need for explainable artificial intelligence (XAI). A key explainability question is: given this decision was made, what are the input features which contributed to the decision? Although a range of XAI approaches exist to tackle this problem, most of them have significant limitations. Heuristic XAI approaches suffer from the lack of quality guarantees, and often try to approximate Shapley values, which is not the same as explaining which features contribute to a decision. A recent alternative is so-called formal feature attribution (FFA), which defines feature importance as the fraction of formal abductive explanations (AXp's) containing the given feature. This measures feature importance from the view of formally reasoning about the model's behavior. It is challenging to compute FFA using its definition because that involves counting AXp's, although one can approximate it. Based on these results, this paper makes several contributions. First, it gives compelling evidence that computing FFA is intractable, even if the set of contrastive formal explanations (CXp's) is provided, by proving that the problem is #P-hard. Second, by using the duality between AXp's and CXp's, it proposes an efficient heuristic to switch from CXp enumeration to AXp enumeration on-the-fly resulting in an adaptive explanation enumeration algorithm effectively approximating FFA in an anytime fashion. Finally, experimental results obtained on a range of widely used datasets demonstrate the effectiveness of the proposed FFA approximation approach in terms of the error of FFA approximation as well as the number of explanations computed and their diversity given a fixed time limit.


title: SM70: A Large Language Model for Medical Devices

abstract: We are introducing SM70, a 70 billion-parameter Large Language Model that is specifically designed for SpassMed's medical devices under the brand name 'JEE1' (pronounced as G1 and means 'Life'). This large language model provides more accurate and safe responses to medical-domain questions. To fine-tune SM70, we used around 800K data entries from the publicly available dataset MedAlpaca. The Llama2 70B open-sourced model served as the foundation for SM70, and we employed the QLoRA technique for fine-tuning. The evaluation is conducted across three benchmark datasets - MEDQA - USMLE, PUBMEDQA, and USMLE - each representing a unique aspect of medical knowledge and reasoning. The performance of SM70 is contrasted with other notable LLMs, including Llama2 70B, Clinical Camel 70 (CC70), GPT 3.5, GPT 4, and Med-Palm, to provide a comparative understanding of its capabilities within the medical domain. Our results indicate that SM70 outperforms several established models in these datasets, showcasing its proficiency in handling a range of medical queries, from fact-based questions derived from PubMed abstracts to complex clinical decision-making scenarios. The robust performance of SM70, particularly in the USMLE and PUBMEDQA datasets, suggests its potential as an effective tool in clinical decision support and medical information retrieval. Despite its promising results, the paper also acknowledges the areas where SM70 lags behind the most advanced model, GPT 4, thereby highlighting the need for further development, especially in tasks demanding extensive medical knowledge and intricate reasoning.


title: Arbitrary Ground State Observables from Quantum Computed Moments

abstract: The determination of ground state properties of quantum systems is a fundamental problem in physics and chemistry, and is considered a key application of quantum computers. A common approach is to prepare a trial ground state on the quantum computer and measure observables such as energy, but this is often limited by hardware constraints that prevent an accurate description of the target ground state. The quantum computed moments (QCM) method has proven to be remarkably useful in estimating the ground state energy of a system by computing Hamiltonian moments with respect to a suboptimal or noisy trial state. In this paper, we extend the QCM method to estimate arbitrary ground state observables of quantum systems. We present preliminary results of using QCM to determine the ground state magnetisation and spin-spin correlations of the Heisenberg model in its various forms. Our findings validate the well-established advantage of QCM over existing methods in handling suboptimal trial states and noise, extend its applicability to the estimation of more general ground state properties, and demonstrate its practical potential for solving a wide range of problems on near-term quantum hardware.


title: Network-Aware Asynchronous Distributed ADMM Algorithm for Peer-to-Peer Energy Trading

abstract: The increasing uptake of distributed energy resources (DERs) in smart home prosumers calls for distributed energy management strategies, and the advances in information and communications technology enable peer-to-peer (P2P) energy trading and transactive energy management. Many works attempted to solve the transactive energy management problem using distributed optimization to preserve the privacy of DERs' operations. But such distributed optimization requires information exchange among prosumers, often via synchronous communications, which can be unrealistic in practice. This paper addresses a transactive energy trading problem for multiple smart home prosumers with rooftop solar, battery storage, and controllable load, such as heating, ventilation, and air-conditioning (HVAC) units, considering practical communication conditions. We formulate a network-aware energy trading optimization problem, in which a local network operator manages the network constraints supporting bidirectional energy flows. We develop an asynchronous distributed alternating direction method of multipliers (ADMM) algorithm to solve the problem under asynchronous communications, allowing communication delay and indicating a higher potential for real-world applications. We validate our design by simulations using real-world data. The results demonstrate the convergence of our developed asynchronous distributed ADMM algorithm and show that energy trading reduces the energy cost for smart home prosumers.


title: Bulk Photovoltaic Effects in Helimagnets

abstract: The bulk photovoltaic (BPV) effect that converts light into electric current is highly sensitive to the system symmetry and its electronic Bloch wavefunction. To create a sizable net electric current, it is necessary to break the centrosymmetry P in its host material. While prior studies mainly focus on P-broken nonmagnetic (time reversal T-reserved) and collinear antiferromagnetic PT systems, here we adopt magnetic group theory to scrutinize how helical spin polarization breaks P that is otherwise kept in its crystalline geometry. Such spin helix widely exists in intrinsic multiferroics and magnon excitation in collinear magnets. We demonstrate that magnetic symmetries are determined by spin spiral configurations, helical propagation wavevectors, magnetic chirality, and spin winding angles at the home site, offering effective and versatile manipulation of BPV generation in helimagnets. This is illustrated by tight-binding model calculations. Furthermore, we apply our theory to monolayer NiI2, a realistic showcase for helimagnetic material. Our first-principles calculations show that it could host observable direction-dependent BPV current, which could serve as a photoelectric probe to track the subtle magnetic configurations and potential multiferroic nature. This work reveals the fundamental mechanism of the interplay between spin spiral order and nonlinear optics process.


title: CLASS-M: Adaptive stain separation-based contrastive learning with pseudo-labeling for histopathological image classification

abstract: Histopathological image classification is an important task in medical image analysis. Recent approaches generally rely on weakly supervised learning due to the ease of acquiring case-level labels from pathology reports. However, patch-level classification is preferable in applications where only a limited number of cases are available or when local prediction accuracy is critical. On the other hand, acquiring extensive datasets with localized labels for training is not feasible. In this paper, we propose a semi-supervised patch-level histopathological image classification model, named CLASS-M, that does not require extensively labeled datasets. CLASS-M is formed by two main parts: a contrastive learning module that uses separated Hematoxylin and Eosin images generated through an adaptive stain separation process, and a module with pseudo-labels using MixUp. We compare our model with other state-of-the-art models on two clear cell renal cell carcinoma datasets. We demonstrate that our CLASS-M model has the best performance on both datasets. Our code is available at github.com/BzhangURU/Paper_CLASS-M/tree/main


title: On the notion of Hallucinations from the lens of Bias and Validity in Synthetic CXR Images

abstract: Medical imaging has revolutionized disease diagnosis, yet the potential is hampered by limited access to diverse and privacy-conscious datasets. Open-source medical datasets, while valuable, suffer from data quality and clinical information disparities. Generative models, such as diffusion models, aim to mitigate these challenges. At Stanford, researchers explored the utility of a fine-tuned Stable Diffusion model (RoentGen) for medical imaging data augmentation. Our work examines specific considerations to expand the Stanford research question, Could Stable Diffusion Solve a Gap in Medical Imaging Data? from the lens of bias and validity of the generated outcomes. We leveraged RoentGen to produce synthetic Chest-XRay (CXR) images and conducted assessments on bias, validity, and hallucinations. Diagnostic accuracy was evaluated by a disease classifier, while a COVID classifier uncovered latent hallucinations. The bias analysis unveiled disparities in classification performance among various subgroups, with a pronounced impact on the Female Hispanic subgroup. Furthermore, incorporating race and gender into input prompts exacerbated fairness issues in the generated images. The quality of synthetic images exhibited variability, particularly in certain disease classes, where there was more significant uncertainty compared to the original images. Additionally, we observed latent hallucinations, with approximately 42% of the images incorrectly indicating COVID, hinting at the presence of hallucinatory elements. These identifications provide new research directions towards interpretability of synthetic CXR images, for further understanding of associated risks and patient safety in medical applications.


title: SPFNO: Spectral operator learning for PDEs with Dirichlet and Neumann boundary conditions

abstract: Neural operators have been validated as promising deep surrogate models for solving partial differential equations (PDEs). Despite the critical role of boundary conditions in PDEs, however, only a limited number of neural operators robustly enforce these conditions. In this paper we introduce semi-periodic Fourier neural operator (SPFNO), a novel spectral operator learning method, to learn the target operators of PDEs with non-periodic BCs. This method extends our previous work (arXiv:2206.12698), which showed significant improvements by employing enhanced neural operators that precisely satisfy the boundary conditions. However, the previous work is associated with Gaussian grids, restricting comprehensive comparisons across most public datasets. Additionally, we present numerical results for various PDEs such as the viscous Burgers' equation, Darcy flow, incompressible pipe flow, and coupled reactiondiffusion equations. These results demonstrate the computational efficiency, resolution invariant property, and BC-satisfaction behavior of proposed model. An accuracy improvement of approximately 1.7X-4.7X over the non-BC-satisfying baselines is also achieved. Furthermore, our studies on SOL underscore the significance of satisfying BCs as a criterion for deep surrogate models of PDEs.


title: Linear independence of series related to the Thue--Morse sequence along powers

abstract: The Thue--Morse sequence $\{t(n)\}_{n\geqslant 1}$ is the indicator function of the parity of the number of ones in the binary expansion of positive integers $n$, where $t(n)=1$ (resp. $=0$) if the binary expansion of $n$ has an odd (resp. even) number of ones. In this paper, we generalize a recent result of E.~Miyanohara by showing that, for a fixed Pisot or Salem number $\beta>\sqrt{\varphi}=1.272019649\ldots$, the set of the numbers $$ 1,\quad \sum_{n\geqslant 1}\frac{t(n)}{\beta^{n}},\quad \sum_{n\geqslant 1}\frac{t(n^2)}{\beta^{n}},\quad \dots, \quad \sum_{n\geqslant 1}\frac{t(n^k)}{\beta^{n}},\quad \dots $$ is linearly independent over the field $\mathbb{Q}(\beta)$, where $\varphi:=(1+\sqrt{5})/2$ is the golden ratio. Our result implies that for any $k\geqslant 1$ and for any $a_1,a_2,\ldots,a_k\in\mathbb{Q}(\beta)$, not all zero, the sequence \{$a_1t(n)+a_2t(n^2)+\cdots+a_kt(n^k)\}_{n\geqslant 1}$ cannot be eventually periodic.


title: Residual Stress-Driven Non-Euclidean Morphing in Origami Structures

abstract: Non-Euclidean surfaces are ubiquitous in numerous engineering fields, such as automotive, aerospace, and biomedical engineering domains. Morphing origami has numerous potential engineering applications, including soft robots, mechanical metamaterials, antennas, aerospace structures, and biomedical devices, owing to its intrinsic morphing features from two-dimensional (2D) planes to three-dimensional (3D) surfaces. However, the current one-dimensional (1D) hinge deformation-driven transformation of foldable origami with rigid or slightly deformable panels cannot achieve a 3D complex and large curvilinear morphing. Moreover, most active origami structures use thin hinges with soft materials on their creases, thus resulting in a lower load capability. This study proposes a novel origami morphing method that demonstrates large free-form surface morphing, e.g., Euclidean to non-Euclidean surface morphing with shape-locking. We embedded tensorial anisotropic stress in origami panels during the extrusion-based 3D printing of shape memory polymers. The extrusion-based 3D printing of isotropic shape memory polymers can produce tensorial anisotropic stress in origami panels during fabrication, which can realize large non-Euclidean surface morphing with multiple deformation modes. The connecting topology of the origami unit cells influences the global morphing behavior owing to the interaction of the deformation of adjacent panels. Non-Euclidean morphing integrated with four-dimensional (4D) printing can provide multimodal shape locking at material and structural levels. The non-Euclidean surface morphing caused by tensorial residual stress in the panel during 3D printing expands the design space of origami and kirigami structures.


title: Robust Target Detection of Intelligent Integrated Optical Camera and mmWave Radar System

abstract: Target detection is pivotal for modern urban computing applications. While image-based techniques are widely adopted, they falter under challenging environmental conditions such as adverse weather, poor lighting, and occlusion. To improve the target detection performance under complex real-world scenarios, this paper proposes an intelligent integrated optical camera and millimeter-wave (mmWave) radar system. Utilizing both physical knowledge and data-driven methods, a long-term robust radar-camera fusion algorithm is proposed to solve the heterogeneous data fusion problem for detection improvement. For the occlusion scenarios, the proposed algorithm can effectively detect occluded targets with the help of memory through performing long-term detection. For dark scenarios with low-light conditions, the proposed algorithm can effectively mark the target in the dark picture as well as provide rough stickman imaging. The above two innovative functions of the hybrid optical camera and mmWave radar system are tested in real-world scenarios. The results demonstrate the robustness and significant enhancement in the target detection performance of our integrated system.


title: Coherent control of two Jaynes-Cummings cavities

abstract: In this work, we uncover new features on the study of a two-level atom interacting with one of two cavities in a coherent superposition. The James-Cummings model is used to describe the atom-field interaction and to study the effects of quantum indefiniteness on such an interaction. We show that coherent control of the two cavities in an undefined manner allows novel possibilities to manipulate the atomic dynamics on demand which are not achievable in the conventional way. In addition, it is shown that the coherent control of the atom creates highly entangled states of the cavity fields taking a Bell-like or Schr\"odinger-cat-like state form. Our results are a step forward to understand and harness quantum systems in a coherent control, and open a new research avenue in the study of atom-field interaction exploiting quantum indefiniteness.


title: Ergodic Secrecy Rate Analysis for LEO Satellite Downlink Networks

abstract: Satellite networks are recognized as an effective solution to ensure seamless connectivity worldwide, catering to a diverse range of applications. However, the broad coverage and broadcasting nature of satellite networks also expose them to security challenges. Despite these challenges, there is a lack of analytical understanding addressing the secrecy performance of these networks. This paper presents a secrecy rate analysis for downlink low Earth orbit (LEO) satellite networks by modeling the spatial distribution of satellites, users, and potential eavesdroppers as homogeneous Poisson point processes on concentric spheres. Specifically, we provide an analytical expression for the ergodic secrecy rate of a typical downlink user in terms of the satellite network parameters, fading parameters, and path-loss exponent. Simulation results show the exactness of the provided expressions and we find that optimal satellite altitude increases with eavesdropper density.


title: Automatic extraction of cause-effect-relations from requirements artifacts

abstract: Background: The detection and extraction of causality from natural language sentences have shown great potential in various fields of application. The field of requirements engineering is eligible for multiple reasons: (1) requirements artifacts are primarily written in natural language, (2) causal sentences convey essential context about the subject of requirements, and (3) extracted and formalized causality relations are usable for a (semi-)automatic translation into further artifacts, such as test cases. Objective: We aim at understanding the value of interactive causality extraction based on syntactic criteria for the context of requirements engineering. Method: We developed a prototype of a system for automatic causality extraction and evaluate it by applying it to a set of publicly available requirements artifacts, determining whether the automatic extraction reduces the manual effort of requirements formalization. Result: During the evaluation we analyzed 4457 natural language sentences from 18 requirements documents, 558 of which were causal (12.52%). The best evaluation of a requirements document provided an automatic extraction of 48.57% cause-effect graphs on average, which demonstrates the feasibility of the approach. Limitation: The feasibility of the approach has been proven in theory but lacks exploration of being scaled up for practical use. Evaluating the applicability of the automatic causality extraction for a requirements engineer is left for future research. Conclusion: A syntactic approach for causality extraction is viable for the context of requirements engineering and can aid a pipeline towards an automatic generation of further artifacts from requirements artifacts.


title: A new lightweight additive homomorphic encryption algorithm

abstract: This article describes a lightweight additive homomorphic algorithm with the same encryption and decryption keys. Compared to standard additive homomorphic algorithms like Paillier, this algorithm reduces the computational cost of encryption and decryption from modular exponentiation to modular multiplication, and reduces the computational cost of ciphertext addition from modular multiplication to modular addition. This algorithm is based on a new mathematical problem: in two division operations, whether it is possible to infer the remainder or divisor based on the dividend when two remainders are related. Currently, it is not obvious how to break this problem, but further exploration is needed to determine if it is sufficiently difficult. In addition to this mathematical problem, we have also designed two interesting mathematical structures for decryption, which are used in the two algorithms mentioned in the main text. It is possible that the decryption structure of Algorithm 2 introduces new security vulnerabilities, but we have not investigated this issue thoroughly.


title: MWSIS: Multimodal Weakly Supervised Instance Segmentation with 2D Box Annotations for Autonomous Driving

abstract: Instance segmentation is a fundamental research in computer vision, especially in autonomous driving. However, manual mask annotation for instance segmentation is quite time-consuming and costly. To address this problem, some prior works attempt to apply weakly supervised manner by exploring 2D or 3D boxes. However, no one has ever successfully segmented 2D and 3D instances simultaneously by only using 2D box annotations, which could further reduce the annotation cost by an order of magnitude. Thus, we propose a novel framework called Multimodal Weakly Supervised Instance Segmentation (MWSIS), which incorporates various fine-grained label generation and correction modules for both 2D and 3D modalities to improve the quality of pseudo labels, along with a new multimodal cross-supervision approach, named Consistency Sparse Cross-modal Supervision (CSCS), to reduce the inconsistency of multimodal predictions by response distillation. Particularly, transferring the 3D backbone to downstream tasks not only improves the performance of the 3D detectors, but also outperforms fully supervised instance segmentation with only 5% fully supervised annotations. On the Waymo dataset, the proposed framework demonstrates significant improvements over the baseline, especially achieving 2.59% mAP and 12.75% mAP increases for 2D and 3D instance segmentation tasks, respectively. The code is available at https://github.com/jiangxb98/mwsis-plugin.


title: Task-Agnostic Privacy-Preserving Representation Learning for Federated Learning Against Attribute Inference Attacks

abstract: Federated learning (FL) has been widely studied recently due to its property to collaboratively train data from different devices without sharing the raw data. Nevertheless, recent studies show that an adversary can still be possible to infer private information about devices' data, e.g., sensitive attributes such as income, race, and sexual orientation. To mitigate the attribute inference attacks, various existing privacy-preserving FL methods can be adopted/adapted. However, all these existing methods have key limitations: they need to know the FL task in advance, or have intolerable computational overheads or utility losses, or do not have provable privacy guarantees. We address these issues and design a task-agnostic privacy-preserving presentation learning method for FL ({\bf TAPPFL}) against attribute inference attacks. TAPPFL is formulated via information theory. Specifically, TAPPFL has two mutual information goals, where one goal learns task-agnostic data representations that contain the least information about the private attribute in each device's data, and the other goal ensures the learnt data representations include as much information as possible about the device data to maintain FL utility. We also derive privacy guarantees of TAPPFL against worst-case attribute inference attacks, as well as the inherent tradeoff between utility preservation and privacy protection. Extensive results on multiple datasets and applications validate the effectiveness of TAPPFL to protect data privacy, maintain the FL utility, and be efficient as well. Experimental results also show that TAPPFL outperforms the existing defenses\footnote{Source code and full version: \url{https://github.com/TAPPFL}}.


title: AI-based Wildfire Prevention, Detection and Suppression System

abstract: Wildfires pose a serious threat to the environment of the world. The global wildfire season length has increased by 19% and severe wildfires have besieged nations around the world. Every year, forests are burned by wildfires, causing vast amounts of carbon dioxide to be released into the atmosphere, contributing to climate change. There is a need for a system which prevents, detects, and suppresses wildfires. The AI based Wildfire Prevention, Detection and Suppression System (WPDSS) is a novel, fully automated, end to end, AI based solution to effectively predict hotspots and detect wildfires, deploy drones to spray fire retardant, preventing and suppressing wildfires. WPDSS consists of four steps. 1. Preprocessing: WPDSS loads real time satellite data from NASA and meteorological data from NOAA of vegetation, temperature, precipitation, wind, soil moisture, and land cover for prevention. For detection, it loads the real time data of Land Cover, Humidity, Temperature, Vegetation, Burned Area Index, Ozone, and CO2. It uses the process of masking to eliminate not hotspots and not wildfires such as water bodies, and rainfall. 2. Learning: The AI model consists of a random forest classifier, which is trained using a labeled dataset of hotspots and wildfires and not hotspots and not wildfires. 3. Identification of hotspots and wildfires: WPDSS runs the real time data through the model to automatically identify hotspots and wildfires. 4. Drone deployment: The drone flies to the identified hotspot or wildfire location. WPDSS attained a 98.6% accuracy in identifying hotspots and a 98.7% accuracy in detecting wildfires. WPDSS will reduce the impacts of climate change, protect ecosystems and biodiversity, avert huge economic losses, and save human lives. The power of WPDSS developed can be applied to any location globally to prevent and suppress wildfires, reducing climate change.


title: Attacking the Loop: Adversarial Attacks on Graph-based Loop Closure Detection

abstract: With the advancement in robotics, it is becoming increasingly common for large factories and warehouses to incorporate visual SLAM (vSLAM) enabled automated robots that operate closely next to humans. This makes any adversarial attacks on vSLAM components potentially detrimental to humans working alongside them. Loop Closure Detection (LCD) is a crucial component in vSLAM that minimizes the accumulation of drift in mapping, since even a small drift can accumulate into a significant drift over time. A prior work by Kim et al., SymbioLCD2, unified visual features and semantic objects into a single graph structure for finding loop closure candidates. While this provided a performance improvement over visual feature-based LCD, it also created a single point of vulnerability for potential graph-based adversarial attacks. Unlike previously reported visual-patch based attacks, small graph perturbations are far more challenging to detect, making them a more significant threat. In this paper, we present Adversarial-LCD, a novel black-box evasion attack framework that employs an eigencentrality-based perturbation method and an SVM-RBF surrogate model with a Weisfeiler-Lehman feature extractor for attacking graph-based LCD. Our evaluation shows that the attack performance of Adversarial-LCD with the SVM-RBF surrogate model was superior to that of other machine learning surrogate algorithms, including SVM-linear, SVM-polynomial, and Bayesian classifier, demonstrating the effectiveness of our attack framework. Furthermore, we show that our eigencentrality-based perturbation method outperforms other algorithms, such as Random-walk and Shortest-path, highlighting the efficiency of Adversarial-LCD's perturbation selection method.


title: Between the cosmic-ray `knee' and the `ankle': Contribution from star clusters

abstract: We show that massive young star clusters may be possible candidates that can accelerate Galactic cosmic rays (CRs) in the range of $10^7\hbox{--}10^9$ GeV (between the `knee' and `ankle'). Various plausible scenarios such as acceleration at the wind termination shock (WTS), supernova shocks inside these young star clusters, etc. have been proposed,since it is difficult to accelerate particles up to the $10^7\hbox{--}10^9$ GeV range in the standard paradigm of CR acceleration in supernova remnants. We consider a model for the production of different nuclei in CRs from massive stellar winds using the observed distribution of young star clusters in the Galactic plane. We present a detailed calculation of CR transport in the Galaxy, taking into account the effect of diffusion, interaction losses during propagation, and particle re-acceleration by old supernova remnants to determine the all-particle CR spectrum. Using the maximum energy estimate from the Hillas criterion, we argue that a young massive star cluster can accelerate protons up to a few tens of PeV. Upon comparison with the observed data, our model requires a CR source spectrum with an exponential cutoff of $5\times 10^7 Z$ GeV ($50\,Z$~PeV) from these clusters together with a cosmic-ray injection fraction of $\sim 5\%$ of the wind kinetic energy. We discuss the possibility of achieving these requirements in star clusters, and the associated uncertainties, in the context of considering star clusters as the natural accelerator of the `second component' of Galactic cosmic rays.