title: On the validity of the rotating wave approximation for coupled harmonic oscillators

abstract: In this work we study the validity of the rotating wave approximation of an ideal system composed of two harmonic oscillators evolving with a quadratic Hamiltonian and arbitrarily strong interaction. We solve the dynamics analytically by employing tools from symplectic geometry. We focus on systems with initial Gaussian states and quantify exactly the deviation between the state obtained through the rotating approximation and the state obtained through the full evolution, therefore providing an answer for all values of the coupling. We find that the squeezing present in the full Hamiltonian and in the initial state governs the deviation from the approximated evolution. Furthermore, we also show that the rotating wave approximation is recovered for resonant frequencies and vanishing coupling to frequency ratio. Finally, we give a general proof of the rotating wave approximation and estimate its convergence on Fock states. Applications and potential physical implementations are also discussed.


title: Topological analysis and experimental control of transformations of domain walls in magnetic cylindrical nanowires

abstract: Topology is a powerful tool for categorizing magnetization textures, highlighting specific features in both 2D systems, such as thin films or curved surfaces, and in 3D bulk systems. In the emerging field of 3D nanomagnetism within confined geometries, the contributions from both volume and surface must be considered, requiring appropriate topological analysis to obtain a complete view of the system. Here, we consider domain walls in cylindrical magnetic nanowires to illustrate the use of topological invariants. We begin with micromagnetic simulations of domain wall transformation under the stimulus of an \OErsted field, tracking bulk and surface topological signatures, and analyzing the interplay between multiple micromagnetic objects. For instance, the extensive analysis allowed us to highlight mechanisms of domain wall type conversion from topologically non-trivial to trivial states, a phenomenon disregarded in previous studies. Additionally, we provide experimental evidence of the transient states predicted to occur during the dynamical process.


title: Optimal Exploration Strategy for Regret Minimization in Unconstrained Scalar Optimization Problems

abstract: We study the problem of determining the optimal exploration strategy in an unconstrained scalar optimization problem depending on an unknown parameter to be learned from online collected noisy data. An optimal trade-off between exploration and exploitation is crucial for effective optimization under uncertainties, and to achieve this we consider a cumulative regret minimization approach over a finite horizon, with each time instant in the horizon characterized by a stochastic exploration signal, whose variance has to be designed. In this setting, under an idealized assumption on an appropriately defined information function associated with the excitation, we are able to show that the optimal exploration strategy is either to use no exploration at all (called lazy exploration) or adding an exploration excitation only at the first time instant of the horizon (called immediate exploration). A quadratic numerical example is used to illustrate the results.


title: Enhanced Imaging of Electronic Hot Spots Using Quantum Squeezed Light

abstract: Detecting electronic hot spots is important for understanding the heat dissipation and thermal management of electronic and semiconductor devices. Optical thermoreflective imaging is being used to perform precise temporal and spatial imaging of heat on wires and semiconductor materials. We apply quantum squeezed light to perform thermoreflective imaging on micro-wires, surpassing the shot-noise limit of classical approaches. We obtain a far-field temperature sensing accuracy of 42 mK after 50 ms of averaging and show that a $256\times256$ pixel image can be constructed with such sensitivity in 10 minutes. We can further obtain single-shot temperature sensing of 1.6 K after only 10 $\mathrm{\mu s}$ of averaging enabling dynamical study of heat dissipation. Not only do the quantum images provide accurate spatio-temporal information about heat distribution, but the measure of quantum correlation provides additional information, inaccessible by classical techniques, that can lead to a better understanding of the dynamics. We apply the technique to both Al and Nb microwires and discuss the applications of the technique in studying electron dynamics at low temperatures.


title: Manipulating carbon related spin defects in boron nitride by changing the MOCVD growth temperature

abstract: A common solution for precise magnetic field sensing is to employ spin-active defects in semiconductors, with the NV center in diamond as prominent example. However, the three-dimensional nature of diamond limits the obtainable proximity of the defect to the sample. Two-dimensional boron nitride, which can host spin-active defects, can be used to overcome those limitations. In this work, we study spin properties of sp2-bonded boron nitride layers grown using Metal Organic Chemical Vapor Deposition at temperatures ranging from 700 $^\circ$C to 1200 $^\circ$C. With Electron Spin Resonance (ESR) we show that our layers exhibit spin properties, which we ascribe to carbon related defects. Supported by photoluminescence and Fourier-transform infrared spectroscopy, we distinguish three different regimes: (i) growth at low temperatures with no ESR signal, (ii) growth at intermediate temperatures with a strong ESR signal and a large number of spin defects, (iii) growth at high temperatures with a weaker ESR signal and a lower number of spin defects. The observed effects can be further enhanced by an additional annealing step. Our studies demonstrate wafer-scale boron nitride that intrinsically hosts spin defects without any ion or neutron irradiation, which may be employed in spin memories or magnetic field detectors.


title: Exciton-activated effective phonon magnetic moment in monolayer MoS2

abstract: Optical excitation of chiral phonons plays a vital role in studying the phonon-driven magnetic phenomena in solids. Transition metal dichalcogenides host chiral phonons at high symmetry points of the Brillouin zone, providing an ideal platform to explore the interplay between chiral phonons and valley degree of freedom. Here, we investigate the helicity-resolved magneto-Raman response of monolayer MoS2 and identify a doubly degenerate Brillouin-zone-center chiral phonon mode at ~270 cm-1. Our wavelength- and temperature-dependent measurements show that this chiral phonon is activated through the resonant excitation of A exciton. Under an out-of-plane magnetic field, the chiral phonon exhibits giant Zeeman splitting, which corresponds to an effective magnetic moment of ~2.5mu_B. Moreover, we carry out theoretical calculations based on the morphic effects in nonmagnetic crystals, which reproduce the linear Zeeman splitting and Raman cross-section of the chiral phonon. Our study provides important insights into lifting the chiral phonon degeneracy in an achiral covalent material, paving a new route to excite and control chiral phonons.


title: Crossover from relativistic to non-relativistic net magnetization for MnTe altermagnet candidate

abstract: We experimentally study magnetization reversal curves for MnTe single crystals, which is the altermagnetic candidate. Above 85~K temperature, we confirm the antiferromagnetic behavior of magnetization $M$, which is known for $\alpha$--MnTe. Below 85~K, we observe anomalous low-field magnetization behavior, which is accompanied by the sophisticated $M(\alpha)$ angle dependence with beating pattern as the interplay between $M(\alpha)$ maxima and minima: in low fields, $M(\alpha)$ shows ferromagnetic-like 180$^\circ$ periodicity, while at high magnetic fields, the periodicity is changed to the 90$^\circ$ one. This angle dependence is the most striking result of our experiment, while it can not be expected for standard magnetic systems. In contrast, in altermagnets, symmetry allows ferromagnetic behavior only due to the spin-orbit coupling. Thus, we claim that our experiment shows the effect of weak spin-orbit coupling in MnTe, with crossover from relativistic to non-relativistic net magnetization, and, therefore, we experimentally confirm altermagnetism in MnTe.


title: Admissibility of C*-Covers for Operator Algebra Dynamical Systems

abstract: We characterize when a C*-cover admits a C*-dynamical extension of dynamics on an operator algebra in terms of the boundary ideal structure for the operator algebra in its maximal representation and show that the C*-covers that admit such an extension form a complete lattice. We study dynamical systems arising from groups acting via inner automorphisms in a C*-cover and produce an example of a C*-cover that admits no extension of dynamics on a finite-dimensional non-self-adjoint operator algebra. We construct a partial action on a class of C*-covers that recovers the crossed product of an operator algebra as a subalgebra of the partial crossed product, even when the C*-cover admits no dynamical extension.


title: Low-Regularity Solutions of the Nonlinear Schr\"odinger Equation on the Spatial Quarter-Plane

abstract: The Hadamard well-posedness of the nonlinear Schr\"odinger equation with power nonlinearity formulated on the spatial quarter-plane is established in a low-regularity setting with Sobolev initial data and Dirichlet boundary data in appropriate Bourgain-type spaces. As both of the spatial variables are restricted to the half-line, a different approach is needed than the one previously used for the well-posedness of other initial-boundary value problems. In particular, now the solution of the forced linear initial-boundary problem is estimated \textit{directly}, both in Sobolev spaces and in Strichartz-type spaces, i.e. without a linear decomposition that would require estimates for the associated homogeneous and nonhomogeneous initial value problems. In the process of deriving the linear estimates, the function spaces for the boundary data are identified as the intersections of certain modified Bourgain-type spaces that involve spatial half-line Fourier transforms instead of the usual whole-line Fourier transform found in the definition of the standard Bourgain space associated with the one-dimensional initial value problem. The fact that the quarter-plane has a corner at the origin poses an additional challenge, as it requires one to expand the validity of certain Sobolev extension results to the case of a domain with a non-smooth (Lipschitz) and non-compact boundary.


title: Multi-Review Fusion-in-Context

abstract: Grounded text generation, encompassing tasks such as long-form question-answering and summarization, necessitates both content selection and content consolidation. Current end-to-end methods are difficult to control and interpret due to their opaqueness. Accordingly, recent works have proposed a modular approach, with separate components for each step. Specifically, we focus on the second subtask, of generating coherent text given pre-selected content in a multi-document setting. Concretely, we formalize Fusion-in-Context (FiC) as a standalone task, whose input consists of source texts with highlighted spans of targeted content. A model then needs to generate a coherent passage that includes all and only the target information. Our work includes the development of a curated dataset of 1000 instances in the reviews domain, alongside a novel evaluation framework for assessing the faithfulness and coverage of highlights, which strongly correlate to human judgment. Several baseline models exhibit promising outcomes and provide insightful analyses. This study lays the groundwork for further exploration of modular text generation in the multi-document setting, offering potential improvements in the quality and reliability of generated content. Our benchmark, FuseReviews, including the dataset, evaluation framework, and designated leaderboard, can be found at https://fusereviews.github.io/.


title: Universal Cold RNA Phase Transitions

abstract: RNA's diversity of structures and functions impacts all life forms since primordia. We use calorimetric force spectroscopy to investigate RNA folding landscapes in previously unexplored low-temperature conditions. We find that Watson-Crick RNA hairpins, the most basic secondary structure elements, undergo a glass-like transition below $\mathbf{T_G\sim 20 ^{\circ}}$C where the heat capacity abruptly changes and the RNA folds into a diversity of misfolded structures. We hypothesize that an altered RNA biochemistry, determined by sequence-independent ribose-water interactions, outweighs sequence-dependent base pairing. The ubiquitous ribose-water interactions lead to universal RNA phase transitions below $\mathbf{T_G}$, such as maximum stability at $\mathbf{T_S\sim 5 ^{\circ}}$C where water density is maximum, and cold denaturation at $\mathbf{T_C\sim-50^{\circ}}$C. RNA cold biochemistry may have a profound impact on RNA function and evolution.

categories: q-bio.BM physics.bio-ph q-bio.QM stat.ME


title: Fully automated workflow for the design of patient-specific orthopaedic implants: application to total knee arthroplasty

abstract: Arthroplasty is commonly performed to treat joint osteoarthritis, reducing pain and improving mobility. While arthroplasty has known several technical improvements, a significant share of patients are still unsatisfied with their surgery. Personalised arthroplasty improves surgical outcomes however current solutions require delays, making it difficult to integrate in clinical routine. We propose a fully automated workflow to design patient-specific implants, presented for total knee arthroplasty, the most widely performed arthroplasty in the world nowadays. The proposed pipeline first uses artificial neural networks to segment the proximal and distal extremities of the femur and tibia. Then the full bones are reconstructed using augmented statistical shape models, combining shape and landmarks information. Finally, 77 morphological parameters are computed to design patient-specific implants. The developed workflow has been trained using 91 CT scans of lower limb and evaluated on 41 CT scans manually segmented, in terms of accuracy and execution time. The workflow accuracy was $0.4\pm0.2mm$ for the segmentation, $1.2\pm0.4mm$ for the full bones reconstruction, and $2.8\pm2.2mm$ for the anatomical landmarks determination. The custom implants fitted the patients' anatomy with $0.6\pm0.2mm$ accuracy. The whole process from segmentation to implants' design lasted about 5 minutes. The proposed workflow allows for a fast and reliable personalisation of knee implants, directly from the patient CT image without requiring any manual intervention. It establishes a patient-specific pre-operative planning for TKA in a very short time making it easily available for all patients. Combined with efficient implant manufacturing techniques, this solution could help answer the growing number of arthroplasties while reducing complications and improving the patients' satisfaction.


title: An alternative approach to baryon masses in the $1/N_c$ expansion of QCD

abstract: The baryon mass operator is studied within a combined expansion in $1/N_c$ and perturbative $SU(3)$ flavor symmetry breaking, where $N_c$ denotes the number of quark charges. Flavor projection operators are used to classify the baryon operators involved in the expansion, which fall into the flavor representations $1$, $8$, $10+\overline{10}$, $27$, $35+\overline{35}$ and $64$. This approach allows one to incorporate up to third-order flavor symmetry breaking in the baryon mass operator in a rigorous and systematic way. Previous work on the subject is considered to validate the approach. A fit to data is performed to evaluate the free parameters in the theory and to produce some numerical values of baryon masses. Results are consistent and reaffirm the striking success of the $1/N_c$ expansion.


title: Spatial covariant gravity with two degrees of freedom in the presence of an auxiliary scalar field: perturbation analysis

abstract: We investigate a class of gravity theories respecting only spatial covariance, termed spatially covariant gravity, in the presence of an auxiliary scalar field. We examine the conditions on the Lagrangian required to eliminate scalar degrees of freedom, allowing only two tensorial degrees of freedom to propagate. Instead of strict constraint analysis, in this work, we employ the perturbation method and focus on the necessary conditions to evade the scalar mode at linear order in perturbations around a cosmological background. Starting from a general action and solving the auxiliary perturbation variables in terms of the would-be dynamical scalar mode, we derive the condition to remove its kinetic term, thus ensuring that no scalar mode propagates. As an application of the general condition, we study a polynomial-type Lagrangian as a concrete example, in which all the monomials are spatially covariant scalars containing two derivatives. We find that the auxiliary scalar field plays a nontrivial role, and new terms in the Lagrangian are allowed. Our analysis sheds light on constructing gravity theories with two degrees of freedom in the extended framework of spatially covariant gravity.


title: Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observation

abstract: The development of foundation models has revolutionized our ability to interpret the Earth's surface using satellite observational data. Traditional models have been siloed, tailored to specific sensors or data types like optical, radar, and hyperspectral, each with its own unique characteristics. This specialization hinders the potential for a holistic analysis that could benefit from the combined strengths of these diverse data sources. Our novel approach introduces the Dynamic One-For-All (DOFA) model, leveraging the concept of neural plasticity in brain science to integrate various data modalities into a single framework adaptively. This dynamic hypernetwork, adjusting to different wavelengths, enables a single versatile Transformer jointly trained on data from five sensors to excel across 12 distinct Earth observation tasks, including sensors never seen during pretraining. DOFA's innovative design offers a promising leap towards more accurate, efficient, and unified Earth observation analysis, showcasing remarkable adaptability and performance in harnessing the potential of multimodal Earth observation data.


title: Duality and Heat flow

abstract: We reveal the relation between the Legendre transform of convex functions and heat flow evolution, and how it applies to the functional Blaschke-Santalo inequality. We also describe local maximizers in this inequality.


title: Simulation of radio signals from cosmic-ray cascades in air and ice as observed by in-ice Askaryan radio detectors

abstract: A new generation of neutrino observatories, including RNO-G and RET, will search for PeV-EeV neutrinos interacting in the ice by detecting radio pulses. Extended air showers propagating into the ice will form an important background and could be a valuable calibration signal. We present results from a Monte-Carlo simulation framework developed to fully simulate radio emission from cosmic-ray particle cascades as observed by in-ice radio detectors in the polar regions. The framework involves a modified version of CoREAS (a module of CORSIKA 7) to simulate in-air radio emission and a GEANT4-based framework for simulating in-ice radio emission from cosmic-ray showers as observed by in-ice antennas. The particles that reach the surface of the polar ice sheet at the end of the CORSIKA 7 simulation are injected into the GEANT4-based shower simulation code that takes the particles and propagates them further into the ice sheet, using an exponential density profile for the ice. The framework takes into account curved ray paths caused by the exponential refractive index profiles of air and ice. We present the framework and discuss some key features of the radio signal and radio shower footprint for in-ice observers.


title: Scaling limit of fluctuations for high contrast stochastic homogenization of the Helmholtz equation: second order moments

abstract: This work is concerned with the high contrast stochastic homogenization of the Helmholtz equation. Our goal is to characterize the second order moments of the scaling limit of the fluctuations of the wavefield. We show that these moments are those of a random wavefield solution to a homogenized Helmholtz equation with a white noise source term and obtain expressions for its variance. Two factors contribute to the white noise: fluctuations in the inverse permittivity of the high contrast inhomogeneities, and fluctuations in their size. This problem is motivated by wave propagation in sea ice, which is a random compositive of ice and pockets of air and brine. The analysis hinges on three ingredients: a covariance formula due to Chatterjee for functions of independent random variables; small-volume expansions to quantify the fluctuations due to one inclusion; and the standard two-scale expansions for stochastic homogenization.


title: SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series

abstract: Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks, including low inductive bias and quadratic complexity concerning input sequence length. State Space Models (SSMs) like S4 and others (Hippo, Global Convolutions, liquid S4, LRU, Mega, and Mamba), have emerged to address the above issues to help handle longer sequence lengths. Mamba, while being the state-of-the-art SSM, has a stability issue when scaled to large networks for computer vision datasets. We propose SiMBA, a new architecture that introduces Einstein FFT (EinFFT) for channel modeling by specific eigenvalue computations and uses the Mamba block for sequence modeling. Extensive performance studies across image and time-series benchmarks demonstrate that SiMBA outperforms existing SSMs, bridging the performance gap with state-of-the-art transformers. Notably, SiMBA establishes itself as the new state-of-the-art SSM on ImageNet and transfer learning benchmarks such as Stanford Car and Flower as well as task learning benchmarks as well as seven time series benchmark datasets. The project page is available on this website ~\url{https://github.com/badripatro/Simba}.


title: Learning Topological Representations for Deep Image Understanding

abstract: In many scenarios, especially biomedical applications, the correct delineation of complex fine-scaled structures such as neurons, tissues, and vessels is critical for downstream analysis. Despite the strong predictive power of deep learning methods, they do not provide a satisfactory representation of these structures, thus creating significant barriers in scalable annotation and downstream analysis. In this dissertation, we tackle such challenges by proposing novel representations of these topological structures in a deep learning framework. We leverage the mathematical tools from topological data analysis, i.e., persistent homology and discrete Morse theory, to develop principled methods for better segmentation and uncertainty estimation, which will become powerful tools for scalable annotation.


title: CoLLEGe: Concept Embedding Generation for Large Language Models

abstract: Current language models are unable to quickly learn new concepts on the fly, often requiring a more involved finetuning process to learn robustly. Prompting in-context is not robust to context distractions, and often fails to confer much information about the new concepts. Classic methods for few-shot word learning in NLP, relying on global word vectors, are less applicable to large language models. In this paper, we introduce a novel approach named CoLLEGe (Concept Learning with Language Embedding Generation) to modernize few-shot concept learning. CoLLEGe is a meta-learning framework capable of generating flexible embeddings for new concepts using a small number of example sentences or definitions. Our primary meta-learning objective is simply to facilitate a language model to make next word predictions in forthcoming sentences, making it compatible with language model pretraining. We design a series of tasks to test new concept learning in challenging real-world scenarios, including new word acquisition, definition inference, and verbal reasoning, and demonstrate that our method succeeds in each setting without task-specific training.


title: Cascading Blackout Severity Prediction with Statistically-Augmented Graph Neural Networks

abstract: Higher variability in grid conditions, resulting from growing renewable penetration and increased incidence of extreme weather events, has increased the difficulty of screening for scenarios that may lead to catastrophic cascading failures. Traditional power-flow-based tools for assessing cascading blackout risk are too slow to properly explore the space of possible failures and load/generation patterns. We add to the growing literature of faster graph-neural-network (GNN)-based techniques, developing two novel techniques for the estimation of blackout magnitude from initial grid conditions. First we propose several methods for employing an initial classification step to filter out safe "non blackout" scenarios prior to magnitude estimation. Second, using insights from the statistical properties of cascading blackouts, we propose a method for facilitating non-local message passing in our GNN models. We validate these two approaches on a large simulated dataset, and show the potential of both to increase blackout size estimation performance.


title: Towards Knowledge-Grounded Natural Language Understanding and Generation

abstract: This thesis investigates how natural language understanding and generation with transformer models can benefit from grounding the models with knowledge representations and addresses the following key research questions: (i) Can knowledge of entities extend its benefits beyond entity-centric tasks, such as entity linking? (ii) How can we faithfully and effectively extract such structured knowledge from raw text, especially noisy web text? (iii) How do other types of knowledge, beyond structured knowledge, contribute to improving NLP tasks? Studies in this thesis find that incorporating relevant and up-to-date knowledge of entities benefits fake news detection, and entity-focused code-switching significantly enhances zero-shot cross-lingual transfer on entity-centric tasks. In terms of effective and faithful approaches to extracting structured knowledge, it is observed that integrating negative examples and training with entity planning significantly improves performance. Additionally, it is established that other general forms of knowledge, such as parametric and distilled knowledge, enhance multimodal and multilingual knowledge-intensive tasks. This research shows the tangible benefits of diverse knowledge integration and motivates further exploration in this direction.


title: A Transfer Attack to Image Watermarks

abstract: Watermark has been widely deployed by industry to detect AI-generated images. The robustness of such watermark-based detector against evasion attacks in the white-box and black-box settings is well understood in the literature. However, the robustness in the no-box setting is much less understood. In particular, multiple studies claimed that image watermark is robust in such setting. In this work, we propose a new transfer evasion attack to image watermark in the no-box setting. Our transfer attack adds a perturbation to a watermarked image to evade multiple surrogate watermarking models trained by the attacker itself, and the perturbed watermarked image also evades the target watermarking model. Our major contribution is to show that, both theoretically and empirically, watermark-based AI-generated image detector is not robust to evasion attacks even if the attacker does not have access to the watermarking model nor the detection API.


title: Fourier Transform-based Estimators for Data Sketches

abstract: In this paper we consider the problem of estimating the $f$-moment ($\sum_{v\in [n]} (f(\mathbf{x}(v))-f(0))$) of a dynamic vector $\mathbf{x}\in \mathbb{G}^n$ over some abelian group $(\mathbb{G},+)$, where the $\|f\|_\infty$ norm is bounded. We propose a simple sketch and new estimation framework based on the \emph{Fourier transform} of $f$. I.e., we decompose $f$ into a linear combination of homomorphisms $f_1,f_2,\ldots$ from $(\mathbb{G},+)$ to $(\mathbb{C},\times)$, estimate the $f_k$-moment for each $f_k$, and synthesize them to obtain an estimate of the $f$-moment. Our estimators are asymptotically unbiased and have variance asymptotic to $\|\mathbf{x}\|_0^2 (\|f\|_\infty^2 m^{-1} + \|\hat{f}\|_1^2 m^{-2})$, where the size of the sketch is $O(m\log n\log|\mathbb{G}|)$ bits. When $\mathbb{G}=\mathbb{Z}$ this problem can also be solved using off-the-shelf $\ell_0$-samplers with space $O(m\log^2 n)$ bits, which does not obviously generalize to finite groups. As a concrete benchmark, we extend Ganguly, Garofalakis, and Rastogi's singleton-detector-based sampler to work over $\mathbb{G}$ using $O(m\log n\log|\mathbb{G}|\log(m\log n))$ bits. We give some experimental evidence that the Fourier-based estimation framework is significantly more accurate than sampling-based approaches at the same memory footprint.


title: Energy-dependent Boosted Dark Matter from Diffuse Supernova Neutrino Background

abstract: Diffuse neutrinos from past supernovae in the Universe present us with a unique opportunity to test dark matter (DM) interactions. These neutrinos can scatter and boost the DM particles in the Milky Way halo to relativistic energies allowing us to detect them in terrestrial laboratories. Focusing on generic models of DM-neutrino and electron interactions, mediated by a vector or a scalar boson, we implement energy-dependent scattering cross-sections and perform detailed numerical analysis of DM attenuation due to electron scattering in-medium while propagating towards terrestrial experiments. We set new limits on DM-neutrino and electron interactions for DM with masses in the range $\sim (0.1, 10^4)~$MeV, using recent data from XENONnT, LUX-ZEPLIN, and PandaX-4T direct detection experiments. We demonstrate that consideration of energy-dependent cross-sections for DM interactions can significantly affect constraints previously derived under the assumption of constant cross-sections, modifying them by multiple orders of magnitude.


title: Closing the Information Gap in Unidentified Anomalous Phenomena (UAP) Studies

abstract: Unidentified Anomalous Phenomena (UAP), also known as Unidentified Flying Objects (UFOs), has shifted from being a stigmatized topic on the fringes of scientific inquiry to a legitimate subject of scientific interest with a need for high quality, curated data, and rigorous scientific investigation. This paper presents a preliminary scoping review and analysis of scholarly literature related to UAP from 1967 until 2023, exploring a diverse range of research areas across disciplines to illustrate scholarly discourse about the topic. The paper focuses on characterizing papers published in recent years and notes that Library & Information Science is unrepresented in the current UAP literature. The paper also discusses how researchers across the iFields can contribute to UAP studies through inherent expertise such as data curation and data science as well as information behavior and information literacy, among others. The paper concludes by emphasizing that UAP Studies offer a rich intellectual realm for information science research, with the iFields well positioned to play a crucial role in supporting and engaging in the study of UAP.


title: OceanPlan: Hierarchical Planning and Replanning for Natural Language AUV Piloting in Large-scale Unexplored Ocean Environments

abstract: We develop a hierarchical LLM-task-motion planning and replanning framework to efficiently ground an abstracted human command into tangible Autonomous Underwater Vehicle (AUV) control through enhanced representations of the world. We also incorporate a holistic replanner to provide real-world feedback with all planners for robust AUV operation. While there has been extensive research in bridging the gap between LLMs and robotic missions, they are unable to guarantee success of AUV applications in the vast and unknown ocean environment. To tackle specific challenges in marine robotics, we design a hierarchical planner to compose executable motion plans, which achieves planning efficiency and solution quality by decomposing long-horizon missions into sub-tasks. At the same time, real-time data stream is obtained by a replanner to address environmental uncertainties during plan execution. Experiments validate that our proposed framework delivers successful AUV performance of long-duration missions through natural language piloting.


title: Augmented Reality based Simulated Data (ARSim) with multi-view consistency for AV perception networks

abstract: Detecting a diverse range of objects under various driving scenarios is essential for the effectiveness of autonomous driving systems. However, the real-world data collected often lacks the necessary diversity presenting a long-tail distribution. Although synthetic data has been utilized to overcome this issue by generating virtual scenes, it faces hurdles such as a significant domain gap and the substantial efforts required from 3D artists to create realistic environments. To overcome these challenges, we present ARSim, a fully automated, comprehensive, modular framework designed to enhance real multi-view image data with 3D synthetic objects of interest. The proposed method integrates domain adaptation and randomization strategies to address covariate shift between real and simulated data by inferring essential domain attributes from real data and employing simulation-based randomization for other attributes. We construct a simplified virtual scene using real data and strategically place 3D synthetic assets within it. Illumination is achieved by estimating light distribution from multiple images capturing the surroundings of the vehicle. Camera parameters from real data are employed to render synthetic assets in each frame. The resulting augmented multi-view consistent dataset is used to train a multi-camera perception network for autonomous vehicles. Experimental results on various AV perception tasks demonstrate the superior performance of networks trained on the augmented dataset.


title: Can large language models explore in-context?

abstract: We investigate the extent to which contemporary Large Language Models (LLMs) can engage in exploration, a core capability in reinforcement learning and decision making. We focus on native performance of existing LLMs, without training interventions. We deploy LLMs as agents in simple multi-armed bandit environments, specifying the environment description and interaction history entirely in-context, i.e., within the LLM prompt. We experiment with GPT-3.5, GPT-4, and Llama2, using a variety of prompt designs, and find that the models do not robustly engage in exploration without substantial interventions: i) Across all of our experiments, only one configuration resulted in satisfactory exploratory behavior: GPT-4 with chain-of-thought reasoning and an externally summarized interaction history, presented as sufficient statistics; ii) All other configurations did not result in robust exploratory behavior, including those with chain-of-thought reasoning but unsummarized history. Although these findings can be interpreted positively, they suggest that external summarization -- which may not be possible in more complex settings -- is important for obtaining desirable behavior from LLM agents. We conclude that non-trivial algorithmic interventions, such as fine-tuning or dataset curation, may be required to empower LLM-based decision making agents in complex settings.


title: Machine learning-based compression of quantum many body physics: PCA and autoencoder representation of the vertex function

abstract: Characterizing complex many-body phases of matter has been a central question in quantum physics for decades. Numerical methods built around approximations of the renormalization group (RG) flow equations have offered reliable and systematically improvable answers to the initial question -- what simple physics drives quantum order and disorder? The flow equations are a very high dimensional set of coupled nonlinear equations whose solution is the two particle vertex function, a function of three continuous momenta that describes particle-particle scattering and encodes much of the low energy physics including whether the system exhibits various forms of long ranged order. In this work, we take a simple and interpretable data-driven approach to the open question of compressing the two-particle vertex. We use PCA and an autoencoder neural network to derive compact, low-dimensional representations of underlying physics for the case of interacting fermions on a lattice. We quantify errors in the representations by multiple metrics and show that a simple linear PCA offers more physical insight and better out-of-distribution (zero-shot) generalization than the nominally more expressive nonlinear models. Even with a modest number of principal components (10 - 20), we find excellent reconstruction of vertex functions across the phase diagram. This result suggests that many other many-body functions may be similarly compressible, potentially allowing for efficient computation of observables. Finally, we identify principal component subspaces that are shared between known phases, offering new physical insight.


title: Can the NANOGrav observations constrain the geometry of the universe?

abstract: The theory of inflation provides an elegant explanation for the nearly flat universe observed today, which represents one of the pillars of the standard cosmological model. However, recent studies have reported some deviations from a flat geometry, arguing that a closed universe would be instead favored by observations. Given its central role played in the cosmological context, this paper revisits the issue of spatial curvature in light of the stochastic gravitational wave background signal recently detected by the NANOGrav collaboration. For this purpose, we investigate the primordial gravitational waves generated during inflation and their propagation in the post-inflationary universe. We propose a new parametrization of the gravitational wave power spectrum, taking into account spatial curvature, the tensor-to-scalar ratio and the spectral index of tensor perturbations. Therefore, we compare the theoretical predictions with NANOGrav data to possibly constrain the geometry of the universe. We find that the choice of the priors has a significant effect on the computed posterior distributions. In particular, using flat uniform priors results in $\Omega_{\mathcal{K},0}= 0.00 \pm 0.67$ at the 68\% confidence level. On the other hand, imposing a Planck prior, we obtain $\Omega_{\mathcal{K},0}= -0.05 \pm 0.17$ at the 68\% confidence level. This result aligns with the analysis of the cosmic microwave background radiation, and no deviations from a flat universe are found.


title: Enhancing Testing at Meta with Rich-State Simulated Populations

abstract: This paper reports the results of the deployment of Rich-State Simulated Populations at Meta for both automated and manual testing. We use simulated users (aka test users) to mimic user interactions and acquire state in much the same way that real user accounts acquire state. For automated testing, we present empirical results from deployment on the Facebook, Messenger, and Instagram apps for iOS and Android Platforms. These apps consist of tens of millions of lines of code, communicating with hundreds of millions of lines of backend code, and are used by over 2 billion people every day. Our results reveal that rich state increases average code coverage by 38\%, and endpoint coverage by 61\%. More importantly, it also yields an average increase of 115\% in the faults found by automated testing. The rich-state test user populations are also deployed in a (continually evolving) Test Universe; a web-enabled simulation platform for privacy-safe manual testing, which has been used by over 21,000 Meta engineers since its deployment in November 2022.


title: Might Normal Nuclear Matter be Quarkyonic?

abstract: The possibility that nuclear matter might be Quarkyonic is considered. Quarkyonic matter is high baryon density matter that is confined but can be approximately thought of as a filled Fermi sea of quarks surrounded by a shell of nucleons. Here, nuclear matter is described by the IdylliQ sigma model for Quarkyonic matter, generalizing the non-interacting IdylliQ model [Y. Fujimoto et al., Phys. Rev. Lett. 132, 112701 (2024) [arXiv:2306.04304]] to include interactions with a sigma meson and a pion. When such interactions are included, we find that isospin-symmetric nuclear matter binds, with acceptable values of the compressibility and other parameters for nuclear matter at saturation. The energy per nucleon and sound velocity of such matter is computed, and the isospin dependence is determined. Nuclear matter is formed at a density close to but slightly above the density at which Quarkyonic matter forms. Quarkyonic matter predicts a strong depletion of nucleons in normal nuclear matter at low momentum. Such a depletion for nucleon momenta $k \lesssim 120$ MeV is shown to be consistent with electron scattering data.


title: A Modular, End-to-End Next-Generation Network Testbed: Towards a Fully Automated Network Management Platform

abstract: Experimentation in practical, end-to-end (E2E) next-generation networks deployments is becoming increasingly prevalent and significant in the realm of modern networking and wireless communications research. The prevalence of fifth-generation technology (5G) testbeds and the emergence of developing networks systems, for the purposes of research and testing, focus on the capabilities and features of analytics, intelligence, and automated management using novel testbed designs and architectures, ranging from simple simulations and setups to complex networking systems; however, with the ever-demanding application requirements for modern and future networks, 5G-and-beyond (denoted as 5G+) testbed experimentation can be useful in assessing the creation of large-scale network infrastructures that are capable of supporting E2E virtualized mobile network services. To this end, this paper presents a functional, modular E2E 5G+ system, complete with the integration of a Radio Access Network (RAN) and handling the connection of User Equipment (UE) in real-world scenarios. As well, this paper assesses and evaluates the effectiveness of emulating full network functionalities and capabilities, including a complete description of user-plane data, from UE registrations to communications sequences, and leads to the presentation of a future outlook in powering new experimentation for 6G and next-generation networks.


title: InternVideo2: Scaling Video Foundation Models for Multimodal Video Understanding

abstract: We introduce InternVideo2, a new video foundation model (ViFM) that achieves the state-of-the-art performance in action recognition, video-text tasks, and video-centric dialogue. Our approach employs a progressive training paradigm that unifies the different self- or weakly-supervised learning frameworks of masked video token reconstruction, cross-modal contrastive learning, and next token prediction. Different training stages would guide our model to capture different levels of structure and semantic information through different pretext tasks. At the data level, we prioritize the spatiotemporal consistency by semantically segmenting videos and generating video-audio-speech captions. This improves the alignment between video and text. We scale both data and model size for our InternVideo2. Through extensive experiments, we validate our designs and demonstrate the state-of-the-art performance on over 60 video and audio tasks. Notably, our model outperforms others on various video-related captioning, dialogue, and long video understanding benchmarks, highlighting its ability to reason and comprehend long temporal contexts. Code and models are available at https://github.com/OpenGVLab/InternVideo2/.


title: Long-CLIP: Unlocking the Long-Text Capability of CLIP

abstract: Contrastive Language-Image Pre-training (CLIP) has been the cornerstone for zero-shot classification, text-image retrieval, and text-image generation by aligning image and text modalities. Despite its widespread adoption, a significant limitation of CLIP lies in the inadequate length of text input. The length of the text token is restricted to 77, and an empirical study shows the actual effective length is even less than 20. This prevents CLIP from handling detailed descriptions, limiting its applications for image retrieval and text-to-image generation with extensive prerequisites. To this end, we propose Long-CLIP as a plug-and-play alternative to CLIP that supports long-text input, retains or even surpasses its zero-shot generalizability, and aligns the CLIP latent space, making it readily replace CLIP without any further adaptation in downstream frameworks. Nevertheless, achieving this goal is far from straightforward, as simplistic fine-tuning can result in a significant degradation of CLIP's performance. Moreover, substituting the text encoder with a language model supporting longer contexts necessitates pretraining with vast amounts of data, incurring significant expenses. Accordingly, Long-CLIP introduces an efficient fine-tuning solution on CLIP with two novel strategies designed to maintain the original capabilities, including (1) a knowledge-preserved stretching of positional embedding and (2) a primary component matching of CLIP features. With leveraging just one million extra long text-image pairs, Long-CLIP has shown the superiority to CLIP for about 20% in long caption text-image retrieval and 6% in traditional text-image retrieval tasks, e.g., COCO and Flickr30k. Furthermore, Long-CLIP offers enhanced capabilities for generating images from detailed text descriptions by replacing CLIP in a plug-and-play manner.


title: Time-efficient, high-resolution 3T whole-brain relaxometry using Cartesian 3D MR-STAT with CSF suppression

abstract: Purpose: Current 3D Magnetic Resonance Spin TomogrAphy in Time-domain (MR-STAT) protocols use transient-state, gradient-spoiled gradient-echo sequences that are prone to cerebrospinal fluid (CSF) pulsation artifacts when applied to the brain. This study aims at developing a 3D MR-STAT protocol for whole-brain relaxometry that overcomes the challenges posed by CSF-induced ghosting artifacts. Method: We optimized the flip-angle train within the Cartesian 3D MR-STAT framework to achieve two objectives: (1) minimization of the noise level in the reconstructed quantitative maps, and (2) reduction of the CSF-to-white-matter signal ratio to suppress CSF signal and the associated pulsation artifacts. The optimized new sequence was tested on a gel/water-phantom to evaluate the accuracy of the quantitative maps, and on healthy volunteers to explore the effectiveness of the CSF artifact suppression and robustness of the new protocol. Results: A new optimized sequence with both high parameter encoding capability and low CSF intensity was proposed and initially validated in the gel/water-phantom experiment. From in-vivo experiments with five volunteers, the proposed CSF-suppressed sequence shows no CSF ghosting artifacts and overall greatly improved image quality for all quantitative maps compared to the baseline sequence. Statistical analysis indicated low inter-subject and inter-scan variability for quantitative parameters in gray matter and white matter (1.6%-2.4% for T1 and 2.0%-4.6% for T2), demonstrating the robustness of the new sequence. Conclusion: We presented a new 3D MR-STAT sequence with CSF suppression that effectively eliminates CSF pulsation artifacts. The new sequence ensures consistently high-quality, 1mm^3 whole-brain relaxometry within a rapid 5.5-minute scan time.


title: Control Designs for Critical-Continegency Responsible Grid-Following Inverters and Seamless Transitions To and From Grid-Forming Modes

abstract: This article introduces two control frameworks: one for Grid-Following (GFL) inverters aiding Grid-Forming (GFM) inverters in voltage regulation during large contingency events and optimizing power transactions under normal conditions; and another for seamless transitions between grid-tied and grid-isolated setups, managing voltage transient characteristics. In microgrids, GFM inverters regulate voltage, while GFL inverters handle power transactions. The proposed GFL control detects abrupt load/generation changes, adjusting power transactions using local storage to support GFM inverters during contingencies. Additionally, a transition control ensures smooth GFL-GFM shifts, reducing power and voltage fluctuations. Simulation results validate improved voltage regulation during contingencies and enhanced power tracking during slow changes, alongside minimized transient overshoot.


title: Localization for quasi-one-dimensional Dirac operators

abstract: We consider a random family of Dirac operators on $N$ parallel real lines, modelling for example a graphene nanoribbon. We establish a localization criterion involving properties on the group generated by transfer matrices. In particular, we consider not only the case where this group is the symplectic group but also a strict subgroup of it. We establish under quite general hypotheses that the sum of the Lyapunov exponents and the integrated density of states are H\"older continuous. Moreover, for a set of concrete cases where the potentials are on Pauli matrices, we compute the transfer matrices and prove either localization or delocalization, depending on the potential and on the parity of $N$.


title: DragAPart: Learning a Part-Level Motion Prior for Articulated Objects

abstract: We introduce DragAPart, a method that, given an image and a set of drags as input, can generate a new image of the same object in a new state, compatible with the action of the drags. Differently from prior works that focused on repositioning objects, DragAPart predicts part-level interactions, such as opening and closing a drawer. We study this problem as a proxy for learning a generalist motion model, not restricted to a specific kinematic structure or object category. To this end, we start from a pre-trained image generator and fine-tune it on a new synthetic dataset, Drag-a-Move, which we introduce. Combined with a new encoding for the drags and dataset randomization, the new model generalizes well to real images and different categories. Compared to prior motion-controlled generators, we demonstrate much better part-level motion understanding.


title: ThemeStation: Generating Theme-Aware 3D Assets from Few Exemplars

abstract: Real-world applications often require a large gallery of 3D assets that share a consistent theme. While remarkable advances have been made in general 3D content creation from text or image, synthesizing customized 3D assets following the shared theme of input 3D exemplars remains an open and challenging problem. In this work, we present ThemeStation, a novel approach for theme-aware 3D-to-3D generation. ThemeStation synthesizes customized 3D assets based on given few exemplars with two goals: 1) unity for generating 3D assets that thematically align with the given exemplars and 2) diversity for generating 3D assets with a high degree of variations. To this end, we design a two-stage framework that draws a concept image first, followed by a reference-informed 3D modeling stage. We propose a novel dual score distillation (DSD) loss to jointly leverage priors from both the input exemplars and the synthesized concept image. Extensive experiments and user studies confirm that ThemeStation surpasses prior works in producing diverse theme-aware 3D models with impressive quality. ThemeStation also enables various applications such as controllable 3D-to-3D generation.


title: Unifying area and unit-level small area estimation through calibration

abstract: When estimating area means, direct estimators based on area-specific data, are usually consistent under the sampling design without model assumptions. However, they are inefficient if the area sample size is small. In small area estimation, model assumptions linking the areas are used to "borrow strength" from other areas. The basic area-level model provides design-consistent estimators but error variances are assumed to be known. In practice, they are estimated with the (scarce) area-specific data. These estimators are inefficient, and their error is not accounted for in the associated mean squared error estimators. Unit-level models do not require to know the error variances but do not account for the survey design. Here we describe a unified estimator of an area mean that may be obtained both from an area-level model or a unit-level model and based on consistent estimators of the model error variances as the number of areas increases. We propose bootstrap mean squared error estimators that account for the uncertainty due to the estimation of the error variances. We show a better performance of the new small area estimators and our bootstrap estimators of the mean squared error. We apply the results to education data from Colombia.


title: LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis

abstract: Recent text-to-3D generation approaches produce impressive 3D results but require time-consuming optimization that can take up to an hour per prompt. Amortized methods like ATT3D optimize multiple prompts simultaneously to improve efficiency, enabling fast text-to-3D synthesis. However, they cannot capture high-frequency geometry and texture details and struggle to scale to large prompt sets, so they generalize poorly. We introduce LATTE3D, addressing these limitations to achieve fast, high-quality generation on a significantly larger prompt set. Key to our method is 1) building a scalable architecture and 2) leveraging 3D data during optimization through 3D-aware diffusion priors, shape regularization, and model initialization to achieve robustness to diverse and complex training prompts. LATTE3D amortizes both neural field and textured surface generation to produce highly detailed textured meshes in a single forward pass. LATTE3D generates 3D objects in 400ms, and can be further enhanced with fast test-time optimization.


title: Magnetic, charge, and bond order in the two-dimensional Su-Schrieffer-Heeger-Holstein model

abstract: Most nonperturbative numerical studies of electron-phonon interactions focus on model Hamiltonians where the electrons interact with a phonon branch via a single type of microscopic mechanism. Two commonly explored couplings in this context are the Holstein and Su-Schrieffer-Heeger (SSH) interactions, which describe phonons modulating the on-site energy and intersite electron hopping, respectively. Many materials, however, have multiple phonon branches that can each interact with electronic degrees of freedom in different ways. We present here a determinant quantum Monte Carlo study of the half-filled two-dimensional (bond) SSH-Holstein Hamiltonian, where electrons couple to different phonon branches via either the Holstein or SSH mechanism. We map the model's phase diagram and determine the nature of the transitions between charge-density wave, bond order wave, and antiferromagnetic order.


title: Production of dark sector particles via resonant positron annihilation on atomic electrons

abstract: Resonant positron annihilation on atomic electrons provides a powerful method to search for light new particles coupled to $e^+e^-$. Reliable estimates of production rates require a detailed characterization of electron momentum distributions. We describe a general method that harnesses the target material Compton profile to properly include electron velocity effects in resonant annihilation cross-sections. We additionally find that high $Z$ atoms can efficiently act as particle physics accelerators, providing a density of relativistic electrons that allows to extend by several times the experimental mass reach.


title: LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models

abstract: Large Multimodal Models (LMMs) have shown significant visual reasoning capabilities by connecting a visual encoder and a large language model. LMMs typically take in a fixed and large amount of visual tokens, such as the penultimate layer features in the CLIP visual encoder, as the prefix content. Recent LMMs incorporate more complex visual inputs, such as high-resolution images and videos, which further increases the number of visual tokens significantly. However, due to the inherent design of the Transformer architecture, the computational costs of these models tend to increase quadratically with the number of input tokens. To tackle this problem, we explore a token reduction mechanism that identifies significant spatial redundancy among visual tokens. In response, we propose PruMerge, a novel adaptive visual token reduction strategy that significantly reduces the number of visual tokens without compromising the performance of LMMs. Specifically, to metric the importance of each token, we exploit the sparsity observed in the visual encoder, characterized by the sparse distribution of attention scores between the class token and visual tokens. This sparsity enables us to dynamically select the most crucial visual tokens to retain. Subsequently, we cluster the selected (unpruned) tokens based on their key similarity and merge them with the unpruned tokens, effectively supplementing and enhancing their informational content. Empirically, when applied to LLaVA-1.5, our approach can compress the visual tokens by 14 times on average, and achieve comparable performance across diverse visual question-answering and reasoning tasks. Code and checkpoints are at https://llava-prumerge.github.io/.


title: DiffusionMTL: Learning Multi-Task Denoising Diffusion Model from Partially Annotated Data

abstract: Recently, there has been an increased interest in the practical problem of learning multiple dense scene understanding tasks from partially annotated data, where each training sample is only labeled for a subset of the tasks. The missing of task labels in training leads to low-quality and noisy predictions, as can be observed from state-of-the-art methods. To tackle this issue, we reformulate the partially-labeled multi-task dense prediction as a pixel-level denoising problem, and propose a novel multi-task denoising diffusion framework coined as DiffusionMTL. It designs a joint diffusion and denoising paradigm to model a potential noisy distribution in the task prediction or feature maps and generate rectified outputs for different tasks. To exploit multi-task consistency in denoising, we further introduce a Multi-Task Conditioning strategy, which can implicitly utilize the complementary nature of the tasks to help learn the unlabeled tasks, leading to an improvement in the denoising performance of the different tasks. Extensive quantitative and qualitative experiments demonstrate that the proposed multi-task denoising diffusion model can significantly improve multi-task prediction maps, and outperform the state-of-the-art methods on three challenging multi-task benchmarks, under two different partial-labeling evaluation settings. The code is available at https://prismformore.github.io/diffusionmtl/.


title: Reconfigurable Intelligent Surface Constructing 6G Near-Field Networks

abstract: Near-field propagation, particularly that enabled by reconfigurable intelligent surfaces (RIS), has emerged as a promising research topic in recent years. However, a comprehensive literature review on RIS-based near-field technologies is still lacking. This article aims to fill this gap by providing a brief overview of near-field concepts and a systematic survey of the state-of-the-art RIS-based near-field technologies. The focus is on three key aspects: the construction of ubiquitous near-field wireless propagation environments using RIS, the enabling of new near-field paradigms for 6G networks through RIS, and the challenges faced by RIS-based near-field technologies. This technical review intends to facilitate the development and innovation of RIS-based near-field technologies.


title: CapsF: Capsule Fusion for Extracting psychiatric stressors for suicide from twitter

abstract: Along with factors such as cancer, blood pressure, street accidents and stroke, suicide has been one of Iran main causes of death. One of the main reasons for suicide is psychological stressors. Identifying psychological stressors in an at risk population can help in the early prevention of suicidal and suicidal behaviours. In recent years, the widespread popularity and flow of real time information sharing of social media have allowed for potential early intervention in large scale and even small scale populations. However, some automated approaches to extract psychiatric stressors from Twitter have been presented, but most of this research has been for non Persian languages. This study aims to investigate the techniques of detecting psychological stress related to suicide from Persian tweets using learning based methods. The proposed capsule based approach achieved a binary classification accuracy of 0.83.


title: Radon mitigation by soil depressurisation case study: radon concentration and pressure field extension monitoring in a pilot house in Spain

abstract: A one-year monitoring study was conducted in a pilot house with high radon levels to investigate the ability and efficiency of radon mitigation by soil depressurisation (SD) both active and passive. The study included monitoring of radon concentration, pressure field extension (pfe) under the slab and some atmospheric parameters for different testing phases. Periods in which the house remained closed to foster radon accumulation were alternated with phases of active and passive soil depressurisation under different conditions. The behaviour of the radon concentration in the pilot house was analysed along with the influence of atmospheric variables, significant correlations were found for the radon concentration with atmospheric pressure, outdoor temperature and wind. From the pfe analysis it was proven that the pressure drop with distance from the suction point of the SD system is proportional to the depressurisation generated. It was found also that the permeability characterisation of the pilot house agrees with the literature about granular fill materials characterisation for radon SD systems across Europe. Radon reductions in excess of 85% were achieved for the different testing phases in all cases. Finally, from the results it was stated that a fan power of 23 W is sufficient to ensure radon reductions over 85% for dwellings with similar aggregate layer and soil permeability.


title: Detection of Opioid Users from Reddit Posts via an Attention-based Bidirectional Recurrent Neural Network

abstract: The opioid epidemic, referring to the growing hospitalizations and deaths because of overdose of opioid usage and addiction, has become a severe health problem in the United States. Many strategies have been developed by the federal and local governments and health communities to combat this crisis. Among them, improving our understanding of the epidemic through better health surveillance is one of the top priorities. In addition to direct testing, machine learning approaches may also allow us to detect opioid users by analyzing data from social media because many opioid users may choose not to do the tests but may share their experiences on social media anonymously. In this paper, we take advantage of recent advances in machine learning, collect and analyze user posts from a popular social network Reddit with the goal to identify opioid users. Posts from more than 1,000 users who have posted on three sub-reddits over a period of one month have been collected. In addition to the ones that contain keywords such as opioid, opiate, or heroin, we have also collected posts that contain slang words of opioid such as black or chocolate. We apply an attention-based bidirectional long short memory model to identify opioid users. Experimental results show that the approaches significantly outperform competitive algorithms in terms of F1-score. Furthermore, the model allows us to extract most informative words, such as opiate, opioid, and black, from posts via the attention layer, which provides more insights on how the machine learning algorithm works in distinguishing drug users from non-drug users.


title: "Model Cards for Model Reporting" in 2024: Reclassifying Category of Ethical Considerations in Terms of Trustworthiness and Risk Management

abstract: In 2019, the paper entitled "Model Cards for Model Reporting" introduced a new tool for documenting model performance and encouraged the practice of transparent reporting for a defined list of categories. One of the categories detailed in that paper is ethical considerations, which includes the subcategories of data, human life, mitigations, risks and harms, and use cases. We propose to reclassify this category in the original model card due to the recent maturing of the field known as trustworthy AI, a term which analyzes whether the algorithmic properties of the model indicate that the AI system is deserving of trust from its stakeholders. In our examination of trustworthy AI, we highlight three respected organizations - the European Commission's High-Level Expert Group on AI, the OECD, and the U.S.-based NIST - that have written guidelines on various aspects of trustworthy AI. These recent publications converge on numerous characteristics of the term, including accountability, explainability, fairness, privacy, reliability, robustness, safety, security, and transparency, while recognizing that the implementation of trustworthy AI varies by context. Our reclassification of the original model-card category known as ethical considerations involves a two-step process: 1) adding a new category known as trustworthiness, where the subcategories will be derived from the discussion of trustworthy AI in our paper, and 2) maintaining the subcategories of ethical considerations under a renamed category known as risk environment and risk management, a title which we believe better captures today's understanding of the essence of these topics. We hope that this reclassification will further the goals of the original paper and continue to prompt those releasing trained models to accompany these models with documentation that will assist in the evaluation of their algorithmic properties.


title: An IoT system for a smart campus: Challenges and solutions illustrated over several real-world use cases

abstract: This article discusses the development of an IoT system for monitoring and controlling various devices and systems from different vendors. The authors considered key challenges in IoT projects, such as interoperability and integration, scalability, and data storage, processing, and visualization, during the design and deployment phases. In addition to these general challenges, the authors also delve into the specific integration challenges they encountered. Various devices and systems were integrated into the system and five real-world scenarios in a university campus environment are used to illustrate the challenges encountered. The scenarios involve monitoring various aspects of a university campus environment, including air quality, environmental parameters, energy efficiency, solar photovoltaic energy, and energy consumption. The authors analyzed data and CPU usage to ensure that the system could handle the large amount of data generated by the devices. The platform developed uses open source projects such as Home Assistant, InfluxDB, Grafana, and Node-RED. All developments have been published as open source in public repositories. In conclusion, this work highlights the potential and feasibility of IoT systems in various real-world applications, the importance of considering key challenges in IoT projects during the design and deployment phases, and the specific integration challenges that may be encountered.


title: I would love this to be like an assistant, not the teacher: a voice of the customer perspective of what distance learning students want from an Artificial Intelligence Digital Assistant

abstract: With the release of Generative AI systems such as ChatGPT, an increasing interest in using Artificial Intelligence (AI) has been observed across domains, including higher education. While emerging statistics show the popularity of using AI amongst undergraduate students, little is yet known about students' perceptions regarding AI including self-reported benefits and concerns from their actual usage, in particular in distance learning contexts. Using a two-step, mixed-methods approach, we examined the perceptions of ten online and distance learning students from diverse disciplines regarding the design of a hypothetical AI Digital Assistant (AIDA). In the first step, we captured students' perceptions via interviews, while the second step supported the triangulation of data by enabling students to share, compare, and contrast perceptions with those of peers. All participants agreed on the usefulness of such an AI tool while studying and reported benefits from using it for real-time assistance and query resolution, support for academic tasks, personalisation and accessibility, together with emotional and social support. Students' concerns related to the ethical and social implications of implementing AIDA, data privacy and data use, operational challenges, academic integrity and misuse, and the future of education. Implications for the design of AI-tailored systems are also discussed.


title: Regulating Large Language Models: A Roundtable Report

abstract: On July 20, 2023, a group of 27 scholars and digital rights advocates with expertise in law, computer science, political science, and other disciplines gathered for the Large Language Models, Law and Policy Roundtable, co-hosted by the NYU School of Law's Information Law Institute and the Center for Democracy & Technology. The roundtable convened to discuss how law and policy can help address some of the larger societal problems posed by large language models (LLMs). The discussion focused on three policy topic areas in particular: 1. Truthfulness: What risks do LLMs pose in terms of generating mis- and disinformation? How can these risks be mitigated from a technical and/or regulatory perspective? 2. Privacy: What are the biggest privacy risks involved in the creation, deployment, and use of LLMs? How can these risks be mitigated from a technical and/or regulatory perspective? 3. Market concentration: What threats do LLMs pose concerning market/power concentration? How can these risks be mitigated from a technical and/or regulatory perspective? In this paper, we provide a detailed summary of the day's proceedings. We first recap what we deem to be the most important contributions made during the issue framing discussions. We then provide a list of potential legal and regulatory interventions generated during the brainstorming discussions.


title: An International and Multidisciplinary Teaching Experience with Real Industrial Team Project Development

abstract: This paper presents the design, objectives, experiences, and results of an international cooperation project funded by the European Commission in the context of the Erasmus Intensive Programme (IP, for short) designed to improve students' curricula. An IP is a short programme of study (minimum 2 weeks) that brings together university students and staff from at least three countries in order to encourage efficient and multinational teaching of specialist topics, which might otherwise not be taught at all. This project lasted for 6 years, covering two different editions, each one with three year duration. This project lasted for 6 years, covering two different editions, each one with three year duration. The first edition, named SAVRO (Simulation and Virtual Reality in Robotics for Industrial Assembly Processes) was held in the period 2008-2010, with the participation of three Universities, namely the Universitat Politecnica de Valencia (Spain), acting as IP coordinator, the Technische Universitat Kaiserslautern (Germany), and the Universita degli Studi di Salerno (Italy). The Universite de Reims Champagne-Ardenne (France) participated as a new partner in the subsequent edition (2011-2013) of the IP, renamed as HUMAIN (Human-Machine Interaction). Both editions of the teaching project were characterized by the same objectives and organizational aspects, aiming to provide educational initiatives based on active teaching through collaborative works between international institutions, involving industrial partners too. The aim of the paper is to illustrate the best practices that characterized the organization of our experience as well as to present some general recommendations and suggestions on how to devise computing academic curricula.


title: ChatGPT in Linear Algebra: Strides Forward, Steps to Go

abstract: As soon as a new technology emerges, the education community explores its affordances and the possibilities to apply it in education. In this paper, we analyze sessions with ChatGPT around topics in basic Linear Algebra. We reflect the process undertaken by the ChatGPT along the recent year in our area of interest, emphasising the vast improvement that has been done in grappling with Linear Algebra problems. In particular, the question whether this software can be a teaching assistant or even somehow replace the human teacher, is addressed. As of the time this paper is written, the answer is generally negative. For the small part where the answer can be positive, some reflections about an original instrumental genesis are given. Communication with the software gives the impression to talk to a human, and sometimes the question is whether the software understands the question or not. Therefore, the reader's attention is drawn to the fact that ChatGPT works on a statistical basis and not according to reflection and understanding.


title: Efficient Weighting Schemes for Auditing Instant-Runoff Voting Elections

abstract: Various risk-limiting audit (RLA) methods have been developed for instant-runoff voting (IRV) elections. A recent method, AWAIRE, is the first efficient approach that can take advantage of but does not require cast vote records (CVRs). AWAIRE involves adaptively weighted averages of test statistics, essentially "learning" an effective set of hypotheses to test. However, the initial paper on AWAIRE only examined a few weighting schemes and parameter settings. We explore schemes and settings more extensively, to identify and recommend efficient choices for practice. We focus on the case where CVRs are not available, assessing performance using simulations based on real election data. The most effective schemes are often those that place most or all of the weight on the apparent "best" hypotheses based on already seen data. Conversely, the optimal tuning parameters tended to vary based on the election margin. Nonetheless, we quantify the performance trade-offs for different choices across varying election margins, aiding in selecting the most desirable trade-off if a default option is needed. A limitation of the current AWAIRE implementation is its restriction to a small number of candidates -- up to six in previous implementations. One path to a more computationally efficient implementation would be to use lazy evaluation and avoid considering all possible hypotheses. Our findings suggest that such an approach could be done without substantially compromising statistical performance.


title: Large Language Model for Mental Health: A Systematic Review

abstract: Large language models (LLMs) have attracted significant attention for potential applications in digital health, while their application in mental health is subject to ongoing debate. This systematic review aims to evaluate the usage of LLMs in mental health, focusing on their strengths and limitations in early screening, digital interventions, and clinical applications. Adhering to PRISMA guidelines, we searched PubMed, IEEE Xplore, Scopus, and the JMIR using keywords: 'mental health OR mental illness OR mental disorder OR psychiatry' AND 'large language models'. We included articles published between January 1, 2017, and December 31, 2023, excluding non-English articles. 30 articles were evaluated, which included research on mental illness and suicidal ideation detection through text (n=12), usage of LLMs for mental health conversational agents (CAs) (n=5), and other applications and evaluations of LLMs in mental health (n=13). LLMs exhibit substantial effectiveness in detecting mental health issues and providing accessible, de-stigmatized eHealth services. However, the current risks associated with the clinical use might surpass their benefits. The study identifies several significant issues: the lack of multilingual datasets annotated by experts, concerns about the accuracy and reliability of the content generated, challenges in interpretability due to the 'black box' nature of LLMs, and persistent ethical dilemmas. These include the lack of a clear ethical framework, concerns about data privacy, and the potential for over-reliance on LLMs by both therapists and patients, which could compromise traditional medical practice. Despite these issues, the rapid development of LLMs underscores their potential as new clinical aids, emphasizing the need for continued research and development in this area.


title: This Class Isn't Designed For Me: Recognizing Ableist Trends In Design Education, And Redesigning For An Inclusive And Sustainable Future

abstract: Traditional and currently-prevalent pedagogies of design perpetuate ableist and exclusionary notions of what it means to be a designer. In this paper, we trace such historically exclusionary norms of design education, and highlight modern-day instances from our own experiences as design educators in such epistemologies. Towards imagining a more inclusive and sustainable future of design education, we present three case studies from our own experience as design educators in redesigning course experiences for blind and low-vision (BLV), deaf and hard-of-hearing (DHH) students, and students with other disabilities. In documenting successful and unsuccessful practices, we imagine what a pedagogy of care in design education would look like.


title: AI Ethics and Governance in Practice: An Introduction

abstract: AI systems may have transformative and long-term effects on individuals and society. To manage these impacts responsibly and direct the development of AI systems toward optimal public benefit, considerations of AI ethics and governance must be a first priority. In this workbook, we introduce and describe our PBG Framework, a multi-tiered governance model that enables project teams to integrate ethical values and practical principles into their innovation practices and to have clear mechanisms for demonstrating and documenting this.


title: AI Sustainability in Practice Part Two: Sustainability Throughout the AI Workflow

abstract: The sustainability of AI systems depends on the capacity of project teams to proceed with a continuous sensitivity to their potential real-world impacts and transformative effects. Stakeholder Impact Assessments (SIAs) are governance mechanisms that enable this kind of responsiveness. They are tools that create a procedure for, and a means of documenting, the collaborative evaluation and reflective anticipation of the possible harms and benefits of AI innovation projects. SIAs are not one-off governance actions. They require project teams to pay continuous attention to the dynamic and changing character of AI production and use and to the shifting conditions of the real-world environments in which AI technologies are embedded. This workbook is part two of two workbooks on AI Sustainability. It provides a template of the SIA and activities that allow a deeper dive into crucial parts of it. It discusses methods for weighing values and considering trade-offs during the SIA. And, it highlights the need to treat the SIA as an end-to-end process of responsive evaluation and re-assessment.


title: Predicting Parkinson's disease trajectory using clinical and functional MRI features: a reproduction and replication study

abstract: Parkinson's disease (PD) is a common neurodegenerative disorder with a poorly understood physiopathology and no established biomarkers for the diagnosis of early stages and for prediction of disease progression. Several neuroimaging biomarkers have been studied recently, but these are susceptible to several sources of variability. In this context, an evaluation of the robustness of such biomarkers is essential. This study is part of a larger project investigating the replicability of potential neuroimaging biomarkers of PD. Here, we attempt to reproduce (same data, same method) and replicate (different data or method) the models described in Nguyen et al., 2021 to predict individual's PD current state and progression using demographic, clinical and neuroimaging features (fALFF and ReHo extracted from resting-state fMRI). We use the Parkinson's Progression Markers Initiative dataset (PPMI, ppmi-info.org), as in Nguyen et al.,2021 and aim to reproduce the original cohort, imaging features and machine learning models as closely as possible using the information available in the paper and the code. We also investigated methodological variations in cohort selection, feature extraction pipelines and sets of input features. The success of the reproduction was assessed using different criteria. Notably, we obtained significantly better than chance performance using the analysis pipeline closest to that in the original study (R2 > 0), which is consistent with its findings. The challenges encountered while reproducing and replicating the original work are likely explained by the complexity of neuroimaging studies, in particular in clinical settings. We provide recommendations to further facilitate the reproducibility of such studies in the future.


title: Research on the evolution of smart meter technology

abstract: Smart meter is not only a device used to measure the amount of electricity, but also a core component of the smart grid, realizing the efficient monitoring, prediction and management of power use. With an insight into the evolution of smart meter technology, I realized that this change didn't happen overnight. It has undergone a long journey from the initial mechanical electricity meters to the electronic electricity meters, and now to the highly intelligent electricity meters. Technological breakthroughs at each stage have laid the foundation for the final form of smart meters. In the era of mechanical watt-hour meters, the measurement of electric energy mainly depends on the rotation and counting of mechanical structures. The accuracy and stability of this method are affected by mechanical wear, environmental interference and other factors, and it is difficult to meet the increasing demand for power management. With the rapid development of electronic technology, the electronic electricity meter came into being. It uses electronic technology to sample and process the current and voltage, which greatly improves the accuracy and stability of the measurement. At the same time, the electronic electricity meter also has the function of remote meter reading and data processing, which has brought great convenience to the power management. However, there still have some limitations, such as the complexity of data processing and the limitation of communication capacity. It is these challenges that drive the creation of smart power meters. smart meters combine advanced technologies such as the Internet of Things, big data and cloud computing to realize the real-time monitoring, analysis and prediction of the use of power.


title: X-AMR Annotation Tool

abstract: This paper presents a novel Cross-document Abstract Meaning Representation (X-AMR) annotation tool designed for annotating key corpus-level event semantics. Leveraging machine assistance through the Prodigy Annotation Tool, we enhance the user experience, ensuring ease and efficiency in the annotation process. Through empirical analyses, we demonstrate the effectiveness of our tool in augmenting an existing event corpus, highlighting its advantages when integrated with GPT-4. Code and annotations: https://github.com/ahmeshaf/gpt_coref


title: Multi-modal Heart Failure Risk Estimation based on Short ECG and Sampled Long-Term HRV

abstract: Cardiovascular diseases, including Heart Failure (HF), remain a leading global cause of mortality, often evading early detection. In this context, accessible and effective risk assessment is indispensable. Traditional approaches rely on resource-intensive diagnostic tests, typically administered after the onset of symptoms. The widespread availability of electrocardiogram (ECG) technology and the power of Machine Learning are emerging as viable alternatives within smart healthcare. In this paper, we propose several multi-modal approaches that combine 30-second ECG recordings and approximate long-term Heart Rate Variability (HRV) data to estimate the risk of HF hospitalization. We introduce two survival models: an XGBoost model with Accelerated Failure Time (AFT) incorporating comprehensive ECG features and a ResNet model that learns from the raw ECG. We extend these with our novel long-term HRVs extracted from the combination of ultra-short-term beat-to-beat measurements taken over the day. To capture their temporal dynamics, we propose a survival model comprising ResNet and Transformer architectures (TFM-ResNet). Our experiments demonstrate high model performance for HF risk assessment with a concordance index of 0.8537 compared to 14 survival models and competitive discrimination power on various external ECG datasets. After transferability tests with Apple Watch data, our approach implemented in the myHeartScore App offers cost-effective and highly accessible HF risk assessment, contributing to its prevention and management.


title: Coupled generator decomposition for fusion of electro- and magnetoencephalography data

abstract: Data fusion modeling can identify common features across diverse data sources while accounting for source-specific variability. Here we introduce the concept of a \textit{coupled generator decomposition} and demonstrate how it generalizes sparse principal component analysis (SPCA) for data fusion. Leveraging data from a multisubject, multimodal (electro- and magnetoencephalography (EEG and MEG)) neuroimaging experiment, we demonstrate the efficacy of the framework in identifying common features in response to face perception stimuli, while accommodating modality- and subject-specific variability. Through split-half cross-validation of EEG/MEG trials, we investigate the optimal model order and regularization strengths for models of varying complexity, comparing these to a group-level model assuming shared brain responses to stimuli. Our findings reveal altered $\sim170ms$ fusiform face area activation for scrambled faces, as opposed to real faces, particularly evident in the multimodal, multisubject model. Model parameters were inferred using stochastic optimization in PyTorch, demonstrating comparable performance to conventional quadratic programming inference for SPCA but with considerably faster execution. We provide an easily accessible toolbox for coupled generator decomposition that includes data fusion for SPCA, archetypal analysis and directional archetypal analysis. Overall, our approach offers a promising new avenue for data fusion.


title: Secure and Energy-efficient Unmanned Aerial Vehicle-enabled Visible Light Communication via A Multi-objective Optimization Approach

abstract: In this research, a unique approach to provide communication service for terrestrial receivers via using unmanned aerial vehicle-enabled visible light communication is investigated. Specifically, we take into account a unmanned aerial vehicle-enabled visible light communication scenario with multiplex transmitters, multiplex receivers, and a single eavesdropper, each of which is equipped with a single photodetector. Then, a unmanned aerial vehicle deployment multi-objective optimization problem is formulated to simultaneously make the optical power received by receiving surface more uniform, minimize the amount of information collected by a eavesdropper, and minimize the energy consumption of unmanned aerial vehicles, while the locations and transmission power of unmanned aerial vehicles are simultaneously optimized under certain constraints. Since the formulated unmanned aerial vehicle deployment multi-objective optimization problem is complex and nonlinear, it is challenging to be tackled by using conventional methods. For the purpose of solving the problem, a multi-objective evolutionary algorithm based on decomposition with chaos initiation and crossover mutation is proposed. Simulation outcomes show that the proposed approach is superior to other approaches, and is efficient at improving the security and energy efficiency of visible light communication system.


title: UAV Deployment Optimization in UAV-assisted Wireless Communications

abstract: Due to the fact that the locations of base stations (BSs) cannot be changed after they are installed, it is very difficult to communicate directly with remote user equipment (UE), which will directly affect the lifespan of the system. Unmanned aerial vehicles (UAVs) offer a hopeful solution as mobile relays for fifth-generation wireless communications due to the flexible and cost-effective deployment. However, with the limited onboard energy of UAV and slow progress in energy storage technology, it is a key challenge to achieve the energy-efficient communication. Therefore, in this article, we study a wireless communication network using a UAV as a high-altitude relay, and formulate a UAV relay deployment optimization problem (URDOP) to minimize the energy consumption of system by optimizing the deployment of UAV, including the locations and number of UAV hover points. Since the formulated URDOP is a mixed-integer programming problem, it presents a significant challenge for conventional gradient-based approaches. To this end, we propose a self-adaptive differential evolution with a variable population size (SaDEVPS) algorithm to solve the formulated URDOP. The performance of proposed SaDEVPS is verified through simulations, and the results show that it can successfully decrease the energy consumption of system when compared to other benchmark algorithms across multiple instances.


title: Towards Measuring and Modeling "Culture" in LLMs: A Survey

abstract: We present a survey of more than 90 recent papers that aim to study cultural representation and inclusion in large language models (LLMs). We observe that none of the studies explicitly define "culture, which is a complex, multifaceted concept; instead, they probe the models on some specially designed datasets which represent certain aspects of "culture". We call these aspects the proxies of culture, and organize them across two dimensions of demographic and semantic proxies. We also categorize the probing methods employed. Our analysis indicates that only certain aspects of ``culture,'' such as values and objectives, have been studied, leaving several other interesting and important facets, especially the multitude of semantic domains (Thompson et al., 2020) and aboutness (Hershcovich et al., 2022), unexplored. Two other crucial gaps are the lack of robustness of probing techniques and situated studies on the impact of cultural mis- and under-representation in LLM-based applications.


title: Playing With Neuroscience: Past, Present and Future of Neuroimaging and Games

abstract: Videogames have been a catalyst for advances in many research fields, such as artificial intelligence, human-computer interaction or virtual reality. Over the years, research in fields such as artificial intelligence has enabled the design of new types of games, while games have often served as a powerful tool for testing and simulation. Can this also happen with neuroscience? What is the current relationship between neuroscience and games research? what can we expect from the future? In this article, we'll try to answer these questions, analysing the current state-of-the-art at the crossroads between neuroscience and games and envisioning future directions.


title: Investigating radioactivity in soil samples from neutral and vegetation land of Punjab/India

abstract: In this work, radioactivity investigations of soil samples from neutral and agricultural sites in Punjab/India have been carried out to study the impact of land use patterns. The analysis of radiological, mineralogical, physicochemical, and morphological attributes of soil samples has been performed employing state-of-the-art techniques. The mean activity concentration of 238U, 232Th, 40K, 235U, and 137Cs, measured using a carbon-loaded p-type HPGe detector, in neutral land was observed as 58.03, 83.95, 445.18, 2.83, and 1.16Bq kg-1, respectively. However, in vegetation land, it was found to be 40.07, 64.68, 596.74, 2.26 and 2.11Bq kg-1, respectively. In the detailed activity analysis, radium equivalent (Raeq) radioactivity is found to be in the safe prescribed limit of 370Bq kg-1 for all investigated soil samples. However, the dosimetric investigations revealed that the outdoor absorbed gamma dose rate (96.08nGy h-1) and consequent annual effective dose rate (0.12mSv y-1) for neutral land, and the gamma dose rate (82.46nGy h-1) and subsequent annual effective dose rate (0.10mSv y-1) for vegetation land marginally exceeded the global average. The surface morphology of neutral land favored more compactness, while agricultural land favored high porosity. Various heavy metals of health concern, namely As, Cd, Co, Cr, Cu, Hg, Pb, Se, and Zn, were also evaluated in all soil samples using Inductively Coupled Plasma-Mass Spectroscopy (ICP-MS). Pollution Load Index (PLI) and Ecological Risk Index (RI) revealed that vegetation land was more anthropogenically contaminated than neutral land, with maximum contamination from Hg and As.


title: Physics-informed and Unsupervised Riemannian Domain Adaptation for Machine Learning on Heterogeneous EEG Datasets

abstract: Combining electroencephalogram (EEG) datasets for supervised machine learning (ML) is challenging due to session, subject, and device variability. ML algorithms typically require identical features at train and test time, complicating analysis due to varying sensor numbers and positions across datasets. Simple channel selection discards valuable data, leading to poorer performance, especially with datasets sharing few channels. To address this, we propose an unsupervised approach leveraging EEG signal physics. We map EEG channels to fixed positions using field interpolation, facilitating source-free domain adaptation. Leveraging Riemannian geometry classification pipelines and transfer learning steps, our method demonstrates robust performance in brain-computer interface (BCI) tasks and potential biomarker applications. Comparative analysis against a statistical-based approach known as Dimensionality Transcending, a signal-based imputation called ComImp, source-dependent methods, as well as common channel selection and spherical spline interpolation, was conducted with leave-one-dataset-out validation on six public BCI datasets for a right-hand/left-hand classification task. Numerical experiments show that in the presence of few shared channels in train and test, the field interpolation consistently outperforms other methods, demonstrating enhanced classification performance across all datasets. When more channels are shared, field interpolation was found to be competitive with other methods and faster to compute than source-dependent methods.


title: Fuzzy hyperparameters update in a second order optimization

abstract: This research will present a hybrid approach to accelerate convergence in a second order optimization. An online finite difference approximation of the diagonal Hessian matrix will be introduced, along with fuzzy inferencing of several hyperparameters. Competitive results have been achieved


title: Enhancing Automatic Modulation Recognition for IoT Applications Using Transformers

abstract: Automatic modulation recognition (AMR) is vital for accurately identifying modulation types within incoming signals, a critical task for optimizing operations within edge devices in IoT ecosystems. This paper presents an innovative approach that leverages Transformer networks, initially designed for natural language processing, to address the challenges of efficient AMR. Our transformer network architecture is designed with the mindset of real-time edge computing on IoT devices. Four tokenization techniques are proposed and explored for creating proper embeddings of RF signals, specifically focusing on overcoming the limitations related to the model size often encountered in IoT scenarios. Extensive experiments reveal that our proposed method outperformed advanced deep learning techniques, achieving the highest recognition accuracy. Notably, our model achieves an accuracy of 65.75 on the RML2016 and 65.80 on the CSPB.ML.2018+ dataset.