title: $\zeta$-QVAE: A Quantum Variational Autoencoder utilizing Regularized Mixed-state Latent Representations

abstract: A major challenge in near-term quantum computing is its application to large real-world datasets due to scarce quantum hardware resources. One approach to enabling tractable quantum models for such datasets involves compressing the original data to manageable dimensions while still representing essential information for downstream analysis. In classical machine learning, variational autoencoders (VAEs) facilitate efficient data compression, representation learning for subsequent tasks, and novel data generation. However, no model has been proposed that exactly captures all of these features for direct application to quantum data on quantum computers. Some existing quantum models for data compression lack regularization of latent representations, thus preventing direct use for generation and control of generalization. Others are hybrid models with only some internal quantum components, impeding direct training on quantum data. To bridge this gap, we present a fully quantum framework, $\zeta$-QVAE, which encompasses all the capabilities of classical VAEs and can be directly applied for both classical and quantum data compression. Our model utilizes regularized mixed states to attain optimal latent representations. It accommodates various divergences for reconstruction and regularization. Furthermore, by accommodating mixed states at every stage, it can utilize the full-data density matrix and allow for a "global" training objective. Doing so, in turn, makes efficient optimization possible and has potential implications for private and federated learning. In addition to exploring the theoretical properties of $\zeta$-QVAE, we demonstrate its performance on representative genomics and synthetic data. Our results consistently indicate that $\zeta$-QVAE exhibits similar or better performance compared to matched classical models.


title: Scaling on-chip photonic neural processors using arbitrarily programmable wave propagation

abstract: On-chip photonic processors for neural networks have potential benefits in both speed and energy efficiency but have not yet reached the scale at which they can outperform electronic processors. The dominant paradigm for designing on-chip photonics is to make networks of relatively bulky discrete components connected by one-dimensional waveguides. A far more compact alternative is to avoid explicitly defining any components and instead sculpt the continuous substrate of the photonic processor to directly perform the computation using waves freely propagating in two dimensions. We propose and demonstrate a device whose refractive index as a function of space, $n(x,z)$, can be rapidly reprogrammed, allowing arbitrary control over the wave propagation in the device. Our device, a 2D-programmable waveguide, combines photoconductive gain with the electro-optic effect to achieve massively parallel modulation of the refractive index of a slab waveguide, with an index modulation depth of $10^{-3}$ and approximately $10^4$ programmable degrees of freedom. We used a prototype device with a functional area of $12\,\text{mm}^2$ to perform neural-network inference with up to 49-dimensional input vectors in a single pass, achieving 96% accuracy on vowel classification and 86% accuracy on $7 \times 7$-pixel MNIST handwritten-digit classification. This is a scale beyond that of previous photonic chips relying on discrete components, illustrating the benefit of the continuous-waves paradigm. In principle, with large enough chip area, the reprogrammability of the device's refractive index distribution enables the reconfigurable realization of any passive, linear photonic circuit or device. This promises the development of more compact and versatile photonic systems for a wide range of applications, including optical processing, smart sensing, spectroscopy, and optical communications.


title: An Eye Gaze Heatmap Analysis of Uncertainty Head-Up Display Designs for Conditional Automated Driving

abstract: This paper reports results from a high-fidelity driving simulator study (N=215) about a head-up display (HUD) that conveys a conditional automated vehicle's dynamic "uncertainty" about the current situation while fallback drivers watch entertaining videos. We compared (between-group) three design interventions: display (a bar visualisation of uncertainty close to the video), interruption (interrupting the video during uncertain situations), and combination (a combination of both), against a baseline (video-only). We visualised eye-tracking data to conduct a heatmap analysis of the four groups' gaze behaviour over time. We found interruptions initiated a phase during which participants interleaved their attention between monitoring and entertainment. This improved monitoring behaviour was more pronounced in combination compared to interruption, suggesting pre-warning interruptions have positive effects. The same addition had negative effects without interruptions (comparing baseline & display). Intermittent interruptions may have safety benefits over placing additional peripheral displays without compromising usability.


title: Multiplexed quantum repeaters with hot multimode alkali-noble gas memories

abstract: We propose a non-cryogenic optical quantum memory for noble-gas nuclear spins based on the Atomic Frequency Comb (AFC) protocol. Owing to the hours-long coherence lifetimes of the noble-gas spins and the large bandwidth provided by the AFC independently of the optical depth, we estimate a time-bandwidth product of up to $9.7 \times 10^{15}$ for a realistic experimental configuration. Leveraging on this long-lived multimode memory, we propose a ground-based quantum repeater that enables entanglement distribution over distances up to $2300 \ \mathrm{km}$ with only $8$ elementary links. Finally, we discuss how these quantum memories can enhance rates in space-based quantum communication.


title: Evaluating Very Long-Term Conversational Memory of LLM Agents

abstract: Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented generation (RAG) techniques, their efficacy in very long-term dialogues remains unexplored. To address this research gap, we introduce a machine-human pipeline to generate high-quality, very long-term dialogues by leveraging LLM-based agent architectures and grounding their dialogues on personas and temporal event graphs. Moreover, we equip each agent with the capability of sharing and reacting to images. The generated conversations are verified and edited by human annotators for long-range consistency and grounding to the event graphs. Using this pipeline, we collect LoCoMo, a dataset of very long-term conversations, each encompassing 300 turns and 9K tokens on avg., over up to 35 sessions. Based on LoCoMo, we present a comprehensive evaluation benchmark to measure long-term memory in models, encompassing question answering, event summarization, and multi-modal dialogue generation tasks. Our experimental results indicate that LLMs exhibit challenges in understanding lengthy conversations and comprehending long-range temporal and causal dynamics within dialogues. Employing strategies like long-context LLMs or RAG can offer improvements but these models still substantially lag behind human performance.


title: Increasing the Diversity of Investment Portfolio with Integration of Gamified Components in the FinTech Applications Lifecycle

abstract: Gamification has the potential to make significant contributions to financial product delivery, Fintech services, and inclusive growth. The integration of gamification into FinTech applications has shown a positive correlation with the social impact theory. Utilizing gamification in a sustainable and effective manner can be crucial for long-term prospects in the FinTech industry. Therefore, it is essential to develop efficient and modern financial software that improves the customer experience. The current literature aims to contribute to this area by highlighting the relationship between interrelated theories and the key factors to consider when designing a gamified element. This study aims to explore the effects of gamification on altering user intention and its significant influence on customer value propositions.


title: Prismatic $F$-Gauges and Fontaine--Laffaille modules

abstract: Let $k$ be a perfect field of characteristic $p$ and $W(k)$ its ring of Witt vectors. We construct an equivalence of categories between the full subcategory of the derived category of quasi-coherent sheaves on the syntomification of $W(k)$ spanned by objects whose Hodge-Tate weights are between $[0,p-2]$ and an appropriate derived category of Fontaine-Laffaille modules.


title: Robustly Learning Single-Index Models via Alignment Sharpness

abstract: We study the problem of learning Single-Index Models under the $L_2^2$ loss in the agnostic model. We give an efficient learning algorithm, achieving a constant factor approximation to the optimal loss, that succeeds under a range of distributions (including log-concave distributions) and a broad class of monotone and Lipschitz link functions. This is the first efficient constant factor approximate agnostic learner, even for Gaussian data and for any nontrivial class of link functions. Prior work for the case of unknown link function either works in the realizable setting or does not attain constant factor approximation. The main technical ingredient enabling our algorithm and analysis is a novel notion of a local error bound in optimization that we term alignment sharpness and that may be of broader interest.

categories: cs.LG cs.DS math.OC math.ST stat.ML stat.TH


title: Reducing leakage of single-qubit gates for superconducting quantum processors using analytical control pulse envelopes

abstract: Improving the speed and fidelity of quantum logic gates is essential to reach quantum advantage with future quantum computers. However, fast logic gates lead to increased leakage errors in superconducting quantum processors based on qubits with low anharmonicity, such as transmons. To reduce leakage errors, we propose and experimentally demonstrate two new analytical methods, Fourier ansatz spectrum tuning derivative removal by adiabatic gate (FAST DRAG) and higher-derivative (HD) DRAG, both of which enable shaping single-qubit control pulses in the frequency domain to achieve stronger suppression of leakage transitions compared to previously demonstrated pulse shapes. Using the new methods to suppress the $ef$-transition of a transmon qubit with an anharmonicity of -212 MHz, we implement $R_X(\pi/2)$-gates with a leakage error below $3.0 \times 10^{-5}$ down to a gate duration of 6.25 ns, which corresponds to a 20-fold reduction in leakage compared to a conventional Cosine DRAG pulse. Employing the FAST DRAG method, we further achieve an error per gate of $(1.56 \pm 0.07)\times 10^{-4}$ at a 7.9-ns gate duration, outperforming conventional pulse shapes both in terms of error and gate speed. Furthermore, we study error-amplifying measurements for the characterization of temporal microwave control pulse distortions, and demonstrate that non-Markovian coherent errors caused by such distortions may be a significant source of error for sub-10-ns single-qubit gates unless corrected using predistortion.


title: ADL4D: Towards A Contextually Rich Dataset for 4D Activities of Daily Living

abstract: Hand-Object Interactions (HOIs) are conditioned on spatial and temporal contexts like surrounding objects, previous actions, and future intents (for example, grasping and handover actions vary greatly based on objects proximity and trajectory obstruction). However, existing datasets for 4D HOI (3D HOI over time) are limited to one subject interacting with one object only. This restricts the generalization of learning-based HOI methods trained on those datasets. We introduce ADL4D, a dataset of up to two subjects interacting with different sets of objects performing Activities of Daily Living (ADL) like breakfast or lunch preparation activities. The transition between multiple objects to complete a certain task over time introduces a unique context lacking in existing datasets. Our dataset consists of 75 sequences with a total of 1.1M RGB-D frames, hand and object poses, and per-hand fine-grained action annotations. We develop an automatic system for multi-view multi-hand 3D pose annotation capable of tracking hand poses over time. We integrate and test it against publicly available datasets. Finally, we evaluate our dataset on the tasks of Hand Mesh Recovery (HMR) and Hand Action Segmentation (HAS).


title: Towards Optimal Learning of Language Models

abstract: This work studies the general principles of improving the learning of language models (LMs), which aims at reducing the necessary training steps for achieving superior performance. Specifically, we present a theory for the optimal learning of LMs. We first propose an objective that optimizes LM learning by maximizing the data compression ratio in an "LM-training-as-lossless-compression" view. Then, we derive a theorem, named Learning Law, to reveal the properties of the dynamics in the optimal learning process under our objective. The theorem is then validated by experiments on a linear classification and a real-world language modeling task. Finally, we empirically verify that the optimal learning of LMs essentially stems from the improvement of the coefficients in the scaling law of LMs, indicating great promise and significance for designing practical learning acceleration methods. Our code can be found at https://aka.ms/LearningLaw.


title: Learning to Program Variational Quantum Circuits with Fast Weights

abstract: Quantum Machine Learning (QML) has surfaced as a pioneering framework addressing sequential control tasks and time-series modeling. It has demonstrated empirical quantum advantages notably within domains such as Reinforcement Learning (RL) and time-series prediction. A significant advancement lies in Quantum Recurrent Neural Networks (QRNNs), specifically tailored for memory-intensive tasks encompassing partially observable environments and non-linear time-series prediction. Nevertheless, QRNN-based models encounter challenges, notably prolonged training duration stemming from the necessity to compute quantum gradients using backpropagation-through-time (BPTT). This predicament exacerbates when executing the complete model on quantum devices, primarily due to the substantial demand for circuit evaluation arising from the parameter-shift rule. This paper introduces the Quantum Fast Weight Programmers (QFWP) as a solution to the temporal or sequential learning challenge. The QFWP leverages a classical neural network (referred to as the 'slow programmer') functioning as a quantum programmer to swiftly modify the parameters of a variational quantum circuit (termed the 'fast programmer'). Instead of completely overwriting the fast programmer at each time-step, the slow programmer generates parameter changes or updates for the quantum circuit parameters. This approach enables the fast programmer to incorporate past observations or information. Notably, the proposed QFWP model achieves learning of temporal dependencies without necessitating the use of quantum recurrent neural networks. Numerical simulations conducted in this study showcase the efficacy of the proposed QFWP model in both time-series prediction and RL tasks. The model exhibits performance levels either comparable to or surpassing those achieved by QLSTM-based models.


title: Quantum Circuit Discovery for Fault-Tolerant Logical State Preparation with Reinforcement Learning

abstract: The realization of large-scale quantum computers requires not only quantum error correction (QEC) but also fault-tolerant operations to handle errors that propagate into harmful errors. Recently, flag-based protocols have been introduced that use ancillary qubits to flag harmful errors. However, there is no clear recipe for finding a fault-tolerant quantum circuit with flag-based protocols, especially when we consider hardware constraints, such as qubit connectivity and available gate set. In this work, we propose and explore reinforcement learning (RL) to automatically discover compact and hardware-adapted fault-tolerant quantum circuits. We show that in the task of fault-tolerant logical state preparation, RL discovers circuits with fewer gates and ancillary qubits than published results without and with hardware constraints of up to 15 physical qubits. Furthermore, RL allows for straightforward exploration of different qubit connectivities and the use of transfer learning to accelerate the discovery. More generally, our work opens the door towards the use of RL for the discovery of fault-tolerant quantum circuits for addressing tasks beyond state preparation, including magic state preparation, logical gate synthesis, or syndrome measurement.


title: Massive Activations in Large Language Models

abstract: We observe an empirical phenomenon in Large Language Models (LLMs) -- very few activations exhibit significantly larger values than others (e.g., 100,000 times larger). We call them massive activations. First, we demonstrate the widespread existence of massive activations across various LLMs and characterize their locations. Second, we find their values largely stay constant regardless of the input, and they function as indispensable bias terms in LLMs. Third, these massive activations lead to the concentration of attention probabilities to their corresponding tokens, and further, implicit bias terms in the self-attention output. Last, we also study massive activations in Vision Transformers.


title: Reducing Unnecessary Alerts in Pedestrian Protection Systems Based on P2V Communications

abstract: There are different proposals in the literature on how to protect pedestrians using warning systems to alert drivers of their presence. They can be based on onboard perception systems or wireless communications. The evaluation of these systems has been focused on testing their ability to detect pedestrians. A problem that has received much less attention is the possibility of generating too many alerts in the warning systems. In this paper, we propose and analyze four different algorithms to take the decision on generating alerts in a warning system that is based on direct wireless communications between vehicles and pedestrians. With the algorithms, we explore different strategies to reduce unnecessary alerts. The feasibility of the implementation of the algorithms was evaluated with a deployment using real equipment, and tests were carried out to verify their behavior in real scenarios. The ability of each algorithm to reduce unnecessary alerts was evaluated with realistic simulations in an urban scenario, using a traffic simulator with vehicular and pedestrian flows. The results show the importance of tackling the problem of driver overload in warning systems, and that it is not straightforward to predict the load of alerts generated by an algorithm in a large-scale deployment, in which there are multiple interactions between vehicles and pedestrians.


title: The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

abstract: Recent research, such as BitNet, is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single parameter (or weight) of the LLM is ternary {-1, 0, 1}. It matches the full-precision (i.e., FP16 or BF16) Transformer LLM with the same model size and training tokens in terms of both perplexity and end-task performance, while being significantly more cost-effective in terms of latency, memory, throughput, and energy consumption. More profoundly, the 1.58-bit LLM defines a new scaling law and recipe for training new generations of LLMs that are both high-performance and cost-effective. Furthermore, it enables a new computation paradigm and opens the door for designing specific hardware optimized for 1-bit LLMs.


title: On an abrasion motivated fractal model

abstract: In this paper, we consider a fractal model motivated by the abrasion of convex polyhedra, where the abrasion is realised by chipping small neighbourhoods of vertices. We study the upper box-counting dimension of the limiting object after infinitely many chipping.


title: ShapeLLM: Universal 3D Object Understanding for Embodied Interaction

abstract: This paper presents ShapeLLM, the first 3D Multimodal Large Language Model (LLM) designed for embodied interaction, exploring a universal 3D object understanding with 3D point clouds and languages. ShapeLLM is built upon an improved 3D encoder by extending ReCon to ReCon++ that benefits from multi-view image distillation for enhanced geometry understanding. By utilizing ReCon++ as the 3D point cloud input encoder for LLMs, ShapeLLM is trained on constructed instruction-following data and tested on our newly human-curated evaluation benchmark, 3D MM-Vet. ReCon++ and ShapeLLM achieve state-of-the-art performance in 3D geometry understanding and language-unified 3D interaction tasks, such as embodied visual grounding.


title: Opening Cabinets and Drawers in the Real World using a Commodity Mobile Manipulator

abstract: Pulling open cabinets and drawers presents many difficult technical challenges in perception (inferring articulation parameters for objects from onboard sensors), planning (producing motion plans that conform to tight task constraints), and control (making and maintaining contact while applying forces on the environment). In this work, we build an end-to-end system that enables a commodity mobile manipulator (Stretch RE2) to pull open cabinets and drawers in diverse previously unseen real world environments. We conduct 4 days of real world testing of this system spanning 31 different objects from across 13 different real world environments. Our system achieves a success rate of 61% on opening novel cabinets and drawers in unseen environments zero-shot. An analysis of the failure modes suggests that errors in perception are the most significant challenge for our system. We will open source code and models for others to replicate and build upon our system.


title: Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learning

abstract: A common failure mode for policies trained with imitation is compounding execution errors at test time. When the learned policy encounters states that are not present in the expert demonstrations, the policy fails, leading to degenerate behavior. The Dataset Aggregation, or DAgger approach to this problem simply collects more data to cover these failure states. However, in practice, this is often prohibitively expensive. In this work, we propose Diffusion Meets DAgger (DMD), a method to reap the benefits of DAgger without the cost for eye-in-hand imitation learning problems. Instead of collecting new samples to cover out-of-distribution states, DMD uses recent advances in diffusion models to synthesize these samples. This leads to robust performance from few demonstrations. We compare DMD against behavior cloning baseline across four tasks: pushing, stacking, pouring, and shirt hanging. In pushing, DMD achieves 80% success rate with as few as 8 expert demonstrations, where naive behavior cloning reaches only 20%. In stacking, DMD succeeds on average 92% of the time across 5 cups, versus 40% for BC. When pouring coffee beans, DMD transfers to another cup successfully 80% of the time. Finally, DMD attains 90% success rate for hanging shirt on a clothing rack.


title: Factors that Affect Personalization of Robots for Older Adults

abstract: We introduce a taxonomy of important factors to consider when designing interactions with an assistive robot in a senior living facility. These factors are derived from our reflection on two field studies and are grouped into the following high-level categories: primary user (residents), care partners, robot, facility and external circumstances. We outline how multiple factors in these categories impact different aspects of personalization, such as adjusting interactions based on the unique needs of a resident or modifying alerts about the robot's status for different care partners. This preliminary taxonomy serves as a framework for considering how to deploy personalized assistive robots in the complex caregiving ecosystem.


title: The Strominger System and Flows by the Ricci Tensor

abstract: This is a survey on the Strominger system and a geometric flow known as the anomaly flow. We will discuss various aspects of non-K\"ahler geometry on Calabi-Yau threefolds. Along the way, we discuss balanced metrics and balanced classes, the Aeppli cohomology class associated to a solution to the Strominger system, the equations of motion of heterotic supergravity, and a version of Ricci flow in this special geometry.


title: Utilizing Machine Learning for Signal Classification and Noise Reduction in Amateur Radio

abstract: In the realm of amateur radio, the effective classification of signals and the mitigation of noise play crucial roles in ensuring reliable communication. Traditional methods for signal classification and noise reduction often rely on manual intervention and predefined thresholds, which can be labor-intensive and less adaptable to dynamic radio environments. In this paper, we explore the application of machine learning techniques for signal classification and noise reduction in amateur radio operations. We investigate the feasibility and effectiveness of employing supervised and unsupervised learning algorithms to automatically differentiate between desired signals and unwanted interference, as well as to reduce the impact of noise on received transmissions. Experimental results demonstrate the potential of machine learning approaches to enhance the efficiency and robustness of amateur radio communication systems, paving the way for more intelligent and adaptive radio solutions in the amateur radio community.


title: EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputs

abstract: Self-supervised approaches for electroencephalography (EEG) representation learning face three specific challenges inherent to EEG data: (1) The low signal-to-noise ratio which challenges the quality of the representation learned, (2) The wide range of amplitudes from very small to relatively large due to factors such as the inter-subject variability, risks the models to be dominated by higher amplitude ranges, and (3) The absence of explicit segmentation in the continuous-valued sequences which can result in less informative representations. To address these challenges, we introduce \textit{EEG2Rep}, a self-prediction approach for self-supervised representation learning from EEG. Two core novel components of EEG2Rep are as follows: 1) Instead of learning to predict the masked input from raw EEG, EEG2Rep learns to predict masked input in latent representation space, and 2) Instead of conventional masking methods, EEG2Rep uses a new semantic subsequence preserving (SSP) method which provides informative masked inputs to guide EEG2Rep to generate rich semantic representations. In experiments on 6 diverse EEG tasks with subject variability, EEG2Rep significantly outperforms state-of-the-art methods. We show that our semantic subsequence preserving improves the existing masking methods in self-prediction literature and find that preserving 50\% of EEG recordings will result in the most accurate results on all 6 tasks on average. Finally, we show that EEG2Rep is robust to noise addressing a significant challenge that exists in EEG data. Models and code are available at:\url{https://github.com/Navidfoumani/EEG2Rep}


title: SINR-Aware Deep Reinforcement Learning for Distributed Dynamic Channel Allocation in Cognitive Interference Networks

abstract: We consider the problem of dynamic channel allocation (DCA) in cognitive communication networks with the goal of maximizing a global signal-to-interference-plus-noise ratio (SINR) measure under a specified target quality of service (QoS)-SINR for each network. The shared bandwidth is partitioned into K channels with frequency separation. In contrast to the majority of existing studies that assume perfect orthogonality or a one- to-one user-channel allocation mapping, this paper focuses on real-world systems experiencing inter-carrier interference (ICI) and channel reuse by multiple large-scale networks. This realistic scenario significantly increases the problem dimension, rendering existing algorithms inefficient. We propose a novel multi-agent reinforcement learning (RL) framework for distributed DCA, named Channel Allocation RL To Overlapped Networks (CARLTON). The CARLTON framework is based on the Centralized Training with Decentralized Execution (CTDE) paradigm, utilizing the DeepMellow value-based RL algorithm. To ensure robust performance in the interference-laden environment we address, CARLTON employs a low-dimensional representation of observations, generating a QoS-type measure while maximizing a global SINR measure and ensuring the target QoS-SINR for each network. Our results demonstrate exceptional performance and robust generalization, showcasing superior efficiency compared to alternative state-of-the-art methods, while achieving a marginally diminished performance relative to a fully centralized approach.


title: A paper-based multiplexed serological test to monitor immunity against SARS-CoV-2 using machine learning

abstract: The rapid spread of SARS-CoV-2 caused the COVID-19 pandemic and accelerated vaccine development to prevent the spread of the virus and control the disease. Given the sustained high infectivity and evolution of SARS-CoV-2, there is an ongoing interest in developing COVID-19 serology tests to monitor population-level immunity. To address this critical need, we designed a paper-based multiplexed vertical flow assay (xVFA) using five structural proteins of SARS-CoV-2, detecting IgG and IgM antibodies to monitor changes in COVID-19 immunity levels. Our platform not only tracked longitudinal immunity levels but also categorized COVID-19 immunity into three groups: protected, unprotected, and infected, based on the levels of IgG and IgM antibodies. We operated two xVFAs in parallel to detect IgG and IgM antibodies using a total of 40 uL of human serum sample in <20 min per test. After the assay, images of the paper-based sensor panel were captured using a mobile phone-based custom-designed optical reader and then processed by a neural network-based serodiagnostic algorithm. The trained serodiagnostic algorithm was blindly tested with serum samples collected before and after vaccination or infection, achieving an accuracy of 89.5%. The competitive performance of the xVFA, along with its portability, cost-effectiveness, and rapid operation, makes it a promising computational point-of-care (POC) serology test for monitoring COVID-19 immunity, aiding in timely decisions on the administration of booster vaccines and general public health policies to protect vulnerable populations.


title: WhaleNet: a Novel Deep Learning Architecture for Marine Mammals Vocalizations on Watkins Marine Mammal Sound Database

abstract: Marine mammal communication is a complex field, hindered by the diversity of vocalizations and environmental factors. The Watkins Marine Mammal Sound Database (WMMD) constitutes a comprehensive labeled dataset employed in machine learning applications. Nevertheless, the methodologies for data preparation, preprocessing, and classification documented in the literature exhibit considerable variability and are typically not applied to the dataset in its entirety. This study initially undertakes a concise review of the state-of-the-art benchmarks pertaining to the dataset, with a particular focus on clarifying data preparation and preprocessing techniques. Subsequently, we explore the utilization of the Wavelet Scattering Transform (WST) and Mel spectrogram as preprocessing mechanisms for feature extraction. In this paper, we introduce \textbf{WhaleNet} (Wavelet Highly Adaptive Learning Ensemble Network), a sophisticated deep ensemble architecture for the classification of marine mammal vocalizations, leveraging both WST and Mel spectrogram for enhanced feature discrimination. By integrating the insights derived from WST and Mel representations, we achieved an improvement in classification accuracy by $8-10\%$ over existing architectures, corresponding to a classification accuracy of $97.61\%$.


title: A New Architecture for Energy Efficient Fault Detection Using Energy Harvesters

abstract: The current battery-powered fault detection system for vibration monitoring has a rather limited lifetime. This is because the high-frequency sampling (typically tens of kilo-Hertz) required for vibration monitoring results in high energy consumption in both the analog-to-digital (ADC) converter and wireless transmissions. This paper proposes a new fault detection architecture that can significantly reduce the energy consumption of the ADC and wireless transmission. Our inspiration for the new architecture is based on the observation that the many tens of thousand of data samples collected for fault detection are ultimately transformed into a small number of features. If we can generate these features directly without high frequency sampling, then we can avoid the the energy cost for ADC and wireless transmissions. We propose to use piezoelectric energy harvesters (which can be designed to have different frequency responses) and integrators to obtain these features in an energy-efficient manner. By using a publicly available data set for ball bearing fault detection (which was originally sampled at 51.2kHz) and piezoelectric energy harvester models, we can produce features, which when sampled at 0.33Hz, give a fault detection accuracy of 89% while reducing the sampling requirement by 4 orders-of-magnitude.


title: FSK Demodulation and Bit String Extraction: A Python-Centric Approach in SDR Systems

abstract: Frequency Shift Keying (FSK) modulation is widely utilized in various communication systems for data transmission due to its simplicity and robustness. In this paper, we present a Python-centric approach for demodulating FSK signals and extracting bit strings in Software Defined Radio (SDR) systems. Leveraging the flexibility and power of Python programming language along with SDR platforms, we explore the intricacies of FSK demodulation techniques and efficient bit string extraction methods. Our approach focuses on real-time processing capabilities, enabling rapid decoding of FSK signals with minimal latency. We discuss the implementation details, performance considerations, and optimization strategies, highlighting the advantages and challenges of utilizing Python in SDR applications. Furthermore, we demonstrate the effectiveness of our approach through experimental results and comparisons with existing methods. This paper serves as a comprehensive guide for researchers and practitioners interested in implementing FSK demodulation and bit string extraction algorithms using Python within the context of SDR systems.


title: Dynamic Anchor Selection and Real-Time Pose Prediction for Ultra-wideband Tagless Gate

abstract: Ultra-wideband (UWB) is emerging as a promising solution that can realize proximity services, such as UWB tagless gate (UTG), thanks to centimeter-level localization accuracy based on two different ranging methods such as downlink time-difference of arrival (DL-TDoA) and double-sided two-way ranging (DS-TWR). The UTG is a UWB-based proximity service that provides a seamless gate pass system without requiring real-time mobile device (MD) tapping. The location of MD is calculated using DL-TDoA, and the MD communicates with the nearest UTG using DS-TWR to open the gate. Therefore, the knowledge about the exact location of MD is the main challenge of UTG, and hence we provide the solutions for both DL-TDoA and DS-TWR. In this paper, we propose dynamic anchor selection for extremely accurate DL-TDoA localization and pose prediction for DS-TWR, called DynaPose. The pose is defined as the actual location of MD on the human body, which affects the localization accuracy. DynaPose is based on line-of-sight (LOS) and non-LOS (NLOS) classification using deep learning for anchor selection and pose prediction. Deep learning models use the UWB channel impulse response and the inertial measurement unit embedded in the smartphone. DynaPose is implemented on Samsung Galaxy Note20 Ultra and Qorvo UWB board to show the feasibility and applicability. DynaPose achieves a LOS/NLOS classification accuracy of 0.984, 62% higher DL-TDoA localization accuracy, and ultimately detects four different poses with an accuracy of 0.961 in real-time.


title: Assessing the importance of long-range correlations for deep-learning-based sleep staging

abstract: This study aims to elucidate the significance of long-range correlations for deep-learning-based sleep staging. It is centered around S4Sleep(TS), a recently proposed model for automated sleep staging. This model utilizes electroencephalography (EEG) as raw time series input and relies on structured state space sequence (S4) models as essential model component. Although the model already surpasses state-of-the-art methods for a moderate number of 15 input epochs, recent literature results suggest potential benefits from incorporating very long correlations spanning hundreds of input epochs. In this submission, we explore the possibility of achieving further enhancements by systematically scaling up the model's input size, anticipating potential improvements in prediction accuracy. In contrast to findings in literature, our results demonstrate that augmenting the input size does not yield a significant enhancement in the performance of S4Sleep(TS). These findings, coupled with the distinctive ability of S4 models to capture long-range dependencies in time series data, cast doubt on the diagnostic relevance of very long-range interactions for sleep staging.


title: Constraint Latent Space Matters: An Anti-anomalous Waveform Transformation Solution from Photoplethysmography to Arterial Blood Pressure

abstract: Arterial blood pressure (ABP) holds substantial promise for proactive cardiovascular health management. Notwithstanding its potential, the invasive nature of ABP measurements confines their utility primarily to clinical environments, limiting their applicability for continuous monitoring beyond medical facilities. The conversion of photoplethysmography (PPG) signals into ABP equivalents has garnered significant attention due to its potential in revolutionizing cardiovascular disease management. Recent strides in PPG-to-ABP prediction encompass the integration of generative and discriminative models. Despite these advances, the efficacy of these models is curtailed by the latent space shift predicament, stemming from alterations in PPG data distribution across disparate hardware and individuals, potentially leading to distorted ABP waveforms. To tackle this problem, we present an innovative solution named the Latent Space Constraint Transformer (LSCT), leveraging a quantized codebook to yield robust latent spaces by employing multiple discretizing bases. To facilitate improved reconstruction, the Correlation-boosted Attention Module (CAM) is introduced to systematically query pertinent bases on a global scale. Furthermore, to enhance expressive capacity, we propose the Multi-Spectrum Enhancement Knowledge (MSEK), which fosters local information flow within the channels of latent code and provides additional embedding for reconstruction. Through comprehensive experimentation on both publicly available datasets and a private downstream task dataset, the proposed approach demonstrates noteworthy performance enhancements compared to existing methods. Extensive ablation studies further substantiate the effectiveness of each introduced module.


title: Optimized Current Density Reconstruction from Widefield Quantum Diamond Magnetic Field Maps

abstract: Quantum Diamond Microscopy using Nitrogen-Vacancy (NV) defects in diamond crystals has enabled the magnetic field imaging of a wide variety of nanoscale current profiles. Intimately linked with the imaging process is the problem of reconstructing the current density, which provides critical insight into the structure under study. This manifests as a non-trivial inverse problem of current reconstruction from noisy data, typically conducted via Fourier-based approaches. Learning algorithms and Bayesian methods have been proposed as novel alternatives for inference-based reconstructions. We study the applicability of Fourier-based and Bayesian methods for reconstructing two-dimensional current density maps from magnetic field images obtained from NV imaging. We discuss extensive numerical simulations to elucidate the performance of the reconstruction algorithms in various parameter regimes, and further validate our analysis via performing reconstructions on experimental data. Finally, we examine parameter regimes that favor specific reconstruction algorithms and provide an empirical approach for selecting regularization in Bayesian methods.


title: Geometrothermodynamic description of magnetic materials

abstract: We perform a statistical and geometrothermodynamic analysis of three different models of magnetic materials, namely, the translational free model, the spin model, and the mean-field model. First, we derive the fundamental equation for each model, which is then used as input to compute the metrics of the corresponding equilibrium spaces. Analyzing the corresponding geometrothermodynamic curvatures, we conclude that they can be used to describe thermodynamic interaction, stability conditions, and the phase transition structure of the modeled substances. In all the cases, we reproduce their well-known behavior close to the Curie temperature. Moreover, in the case of the model with spin, we found a curvature singularity which corresponds to a novel transition, where a particular response function diverges, indicating the presence of second order phase transition, according to Ehrenfest classification.


title: BagStacking: An Integrated Ensemble Learning Approach for Freezing of Gait Detection in Parkinson's Disease

abstract: This paper introduces BagStacking, a novel ensemble learning method designed to enhance the detection of Freezing of Gait (FOG) in Parkinson's Disease (PD) by using a lower-back sensor to track acceleration. Building on the principles of bagging and stacking, BagStacking aims to achieve the variance reduction benefit of bagging's bootstrap sampling while also learning sophisticated blending through stacking. The method involves training a set of base models on bootstrap samples from the training data, followed by a meta-learner trained on the base model outputs and true labels to find an optimal aggregation scheme. The experimental evaluation demonstrates significant improvements over other state-of-the-art machine learning methods on the validation set. Specifically, BagStacking achieved a MAP score of 0.306, outperforming LightGBM (0.234) and classic Stacking (0.286). Additionally, the run-time of BagStacking was measured at 3828 seconds, illustrating an efficient approach compared to Regular Stacking's 8350 seconds. BagStacking presents a promising direction for handling the inherent variability in FOG detection data, offering a robust and scalable solution to improve patient care in PD.


title: Impact of dark matter galactic halo models on wormhole geometry within $f(Q,T)$ gravity

abstract: This study investigates the possible existence of wormhole solutions with dark matter galactic halo profiles in the background of $f(Q,T)$ gravity. The primary focus of the current study is to find the significance of dark matter (DM) in the search for traversable wormhole solutions within galactic halos. Various dark matter profiles, such as Universal Rotation Curves (URC), Navarro-Frenk-White (NFW) model-I, and NFW model-II, are examined within two different $f(Q,T)$ models. The DM halo density profiles generate appropriate shape functions under the linear model that satisfy all the essential conditions for presenting the wormhole geometries. Apart from that, we take into account an embedded wormhole-specific shape function to inspect DM profiles under the non-linear model. We noticed that the null energy conditions are violated by the obtained solution from each model, which confirms that the DM support wormholes to sustain in the galactic halo. The findings reveal that the solutions obtained for different density profiles of dark matter halos within generalized symmetric teleparallel gravity demonstrate viability.


title: ByteComposer: a Human-like Melody Composition Method based on Language Model Agent

abstract: Large Language Models (LLM) have shown encouraging progress in multimodal understanding and generation tasks. However, how to design a human-aligned and interpretable melody composition system is still under-explored. To solve this problem, we propose ByteComposer, an agent framework emulating a human's creative pipeline in four separate steps : "Conception Analysis - Draft Composition - Self-Evaluation and Modification - Aesthetic Selection". This framework seamlessly blends the interactive and knowledge-understanding features of LLMs with existing symbolic music generation models, thereby achieving a melody composition agent comparable to human creators. We conduct extensive experiments on GPT4 and several open-source large language models, which substantiate our framework's effectiveness. Furthermore, professional music composers were engaged in multi-dimensional evaluations, the final results demonstrated that across various facets of music composition, ByteComposer agent attains the level of a novice melody composer.


title: Stepwise Self-Consistent Mathematical Reasoning with Large Language Models

abstract: Using Large Language Models for complex mathematical reasoning is difficult, primarily due to the complexity of multi-step reasoning. The main challenges of this process include (1) selecting critical intermediate results to advance the procedure, and (2) limited exploration of potential solutions. To address these issues, we introduce a novel algorithm, namely Stepwise Self-Consistent Chain-of-Thought (SSC-CoT). SSC-CoT employs a strategy of selecting intermediate steps based on the intersection of various reasoning chains. Additionally, SSC-CoT enables the model to discover critical intermediate steps by querying a knowledge graph comprising relevant domain knowledge. To validate SSC-CoT, we present a new dataset, TriMaster100, tailored for complex trigonometry problems. This dataset contains 100 questions, with each solution broken down into scored intermediate steps, facilitating a comprehensive evaluation of the mathematical reasoning process. On TriMaster100, SSC-CoT triples the effectiveness of the state-of-the-art methods. Furthermore, we benchmark SSC-CoT on the widely recognized complex mathematical question dataset, MATH level 5, and it surpasses the second-best method by 7.2% in accuracy. Code and the TriMaster100 dataset can be found at: https://github.com/zhao-zilong/ssc-cot.


title: Electromagnetic signal propagation through lossy media via surface electromagnetic waves

abstract: A theory of surface electromagnetic waves in gradient media exhibiting arbitrary surface gradients of dielectric permittivity and magnetic permeability has been developed. Novel low-loss propagating surface wave solutions have been found in the gradient media in which both dielectric permittivity and magnetic permeability are dominated by their imaginary parts. Several examples of gradient geometries in which the surface wave problem may be solved analytically have been found. Examples of practically useful surface wave geometries spanning from radio communication underwater to UV nanophotonics have been demonstrated.


title: Multimodal Sleep Apnea Detection with Missing or Noisy Modalities

abstract: Polysomnography (PSG) is a type of sleep study that records multimodal physiological signals and is widely used for purposes such as sleep staging and respiratory event detection. Conventional machine learning methods assume that each sleep study is associated with a fixed set of observed modalities and that all modalities are available for each sample. However, noisy and missing modalities are a common issue in real-world clinical settings. In this study, we propose a comprehensive pipeline aiming to compensate for the missing or noisy modalities when performing sleep apnea detection. Unlike other existing studies, our proposed model works with any combination of available modalities. Our experiments show that the proposed model outperforms other state-of-the-art approaches in sleep apnea detection using various subsets of available data and different levels of noise, and maintains its high performance (AUROC>0.9) even in the presence of high levels of noise or missingness. This is especially relevant in settings where the level of noise and missingness is high (such as pediatric or outside-of-clinic scenarios).


title: Reference frame dependence of the periodically oscillating Coulomb field in the Proca theory

abstract: The Proca theory of the real massive vector field admits non-equilibrium solutions, where the asymptotic dynamics of the electric field is dominated by the periodically oscillating Coulomb component. We discuss how such field configurations are seen in different reference frames, where we find an intriguing spatial pattern of the vector field and the electromagnetic field associated with it. Our studies are carried out in the framework of the classical Proca theory.


title: EEG classifier cross-task transfer to avoid training sessions in robot-assisted rehabilitation

abstract: Background: For an individualized support of patients during rehabilitation, learning of individual machine learning models from the human electroencephalogram (EEG) is required. Our approach allows labeled training data to be recorded without the need for a specific training session. For this, the planned exoskeleton-assisted rehabilitation enables bilateral mirror therapy, in which movement intentions can be inferred from the activity of the unaffected arm. During this therapy, labeled EEG data can be collected to enable movement predictions of only the affected arm of a patient. Methods: A study was conducted with 8 healthy subjects and the performance of the classifier transfer approach was evaluated. Each subject performed 3 runs of 40 self-intended unilateral and bilateral reaching movements toward a target while EEG data was recorded from 64 channels. A support vector machine (SVM) classifier was trained under both movement conditions to make predictions for the same type of movement. Furthermore, the classifier was evaluated to predict unilateral movements by only beeing trained on the data of the bilateral movement condition. Results: The results show that the performance of the classifier trained on selected EEG channels evoked by bilateral movement intentions is not significantly reduced compared to a classifier trained directly on EEG data including unilateral movement intentions. Moreover, the results show that our approach also works with only 8 or even 4 channels. Conclusion: It was shown that the proposed classifier transfer approach enables motion prediction without explicit collection of training data. Since the approach can be applied even with a small number of EEG channels, this speaks for the feasibility of the approach in real therapy sessions with patients and motivates further investigations with stroke patients.


title: Label Informed Contrastive Pretraining for Node Importance Estimation on Knowledge Graphs

abstract: Node Importance Estimation (NIE) is a task of inferring importance scores of the nodes in a graph. Due to the availability of richer data and knowledge, recent research interests of NIE have been dedicating to knowledge graphs for predicting future or missing node importance scores. Existing state-of-the-art NIE methods train the model by available labels, and they consider every interested node equally before training. However, the nodes with higher importance often require or receive more attention in real-world scenarios, e.g., people may care more about the movies or webpages with higher importance. To this end, we introduce Label Informed ContrAstive Pretraining (LICAP) to the NIE problem for being better aware of the nodes with high importance scores. Specifically, LICAP is a novel type of contrastive learning framework that aims to fully utilize the continuous labels to generate contrastive samples for pretraining embeddings. Considering the NIE problem, LICAP adopts a novel sampling strategy called top nodes preferred hierarchical sampling to first group all interested nodes into a top bin and a non-top bin based on node importance scores, and then divide the nodes within top bin into several finer bins also based on the scores. The contrastive samples are generated from those bins, and are then used to pretrain node embeddings of knowledge graphs via a newly proposed Predicate-aware Graph Attention Networks (PreGAT), so as to better separate the top nodes from non-top nodes, and distinguish the top nodes within top bin by keeping the relative order among finer bins. Extensive experiments demonstrate that the LICAP pretrained embeddings can further boost the performance of existing NIE methods and achieve the new state-of-the-art performance regarding both regression and ranking metrics. The source code for reproducibility is available at https://github.com/zhangtia16/LICAP


title: EGNN-C+: Interpretable Evolving Granular Neural Network and Application in Classification of Weakly-Supervised EEG Data Streams

abstract: We introduce a modified incremental learning algorithm for evolving Granular Neural Network Classifiers (eGNN-C+). We use double-boundary hyper-boxes to represent granules, and customize the adaptation procedures to enhance the robustness of outer boxes for data coverage and noise suppression, while ensuring that inner boxes remain flexible to capture drifts. The classifier evolves from scratch, incorporates new classes on the fly, and performs local incremental feature weighting. As an application, we focus on the classification of emotion-related patterns within electroencephalogram (EEG) signals. Emotion recognition is crucial for enhancing the realism and interactivity of computer systems. We extract features from the Fourier spectrum of EEG signals obtained from 28 individuals engaged in playing computer games -- a public dataset. Each game elicits a different predominant emotion: boredom, calmness, horror, or joy. We analyze individual electrodes, time window lengths, and frequency bands to assess the accuracy and interpretability of resulting user-independent neural models. The findings indicate that both brain hemispheres assist classification, especially electrodes on the temporal (T8) and parietal (P7) areas, alongside contributions from frontal and occipital electrodes. While patterns may manifest in any band, the Alpha (8-13Hz), Delta (1-4Hz), and Theta (4-8Hz) bands, in this order, exhibited higher correspondence with the emotion classes. The eGNN-C+ demonstrates effectiveness in learning EEG data. It achieves an accuracy of 81.7% and a 0.0029 II interpretability using 10-second time windows, even in face of a highly-stochastic time-varying 4-class classification problem.


title: A Surprising Failure? Multimodal LLMs and the NLVR Challenge

abstract: This study evaluates three state-of-the-art MLLMs -- GPT-4V, Gemini Pro, and the open-source model IDEFICS -- on the compositional natural language vision reasoning task NLVR. Given a human-written sentence paired with a synthetic image, this task requires the model to determine the truth value of the sentence with respect to the image. Despite the strong performance demonstrated by these models, we observe they perform poorly on NLVR, which was constructed to require compositional and spatial reasoning, and to be robust for semantic and systematic biases.


title: Randomized Algorithms for Solving Singular Value Decomposition Problems with Matlab Toolbox

abstract: This thesis gives an overview of the state-of-the-art randomized linear algebra algorithms for singular value decomposition (SVD), including the presentation of existing pseudo-codes and theoretical error analysis. Our main focus is on presenting numerical experiments illustrating image restoration using various randomized singular value decomposition (RSVD) methods; theoretical error bounds, computed errors, and canonical angles analysis for these RSVD algorithms. This thesis also comes with a newly developed Matlab toolbox that contains implementations and test examples for some of the state-of-the-art randomized numerical linear algebra algorithms.


title: Stochastic homogenization of quasiconvex degenerate viscous HJ equations in 1d

abstract: We prove homogenization for degenerate viscous Hamilton-Jacobi equations in dimension one in stationary ergodic environments with a quasiconvex and superlinear Hamiltonian of fairly general type. We furthermore show that the effective Hamiltonian is quasiconvex. This latter result is new even in the periodic setting, despite homogenization has been known for quite some time.


title: An Allosteric Model for the Influence of $\text{H}^+$ and $\text{CO}_2$ on Oxygen-Hemoglobin Binding

abstract: In the physiology of oxygen-hemoglobin binding, an important role is played by the influence of $\text{H}^+$ and $\text{CO}_2$ on the affinity of hemoglobin for $\text{O}_2$. Here we extend the allosteric model of hemoglobin to include these effects. We assume purely allosteric modulation, i.e., that the modulatory effects of $\text{H}^+$ and $\text{CO}_2$ on oxygen binding occur only because of their influence on the T $\leftrightarrow$ R transition, in which all four subunits of the hemoglobin molecule participate simultaneously. We assume, moreover, that these modulatory influences occur only through the interaction of $\text{H}^+$ and $\text{CO}_2$ with the amino group at the N-terminal of each of the four polypeptide chains of the hemoglobin molecule. We fit the model to experimental data and obtain reasonable agreement with the observed shifts in oxygen-hemoglobin binding that occur when the concentrations of $\text{H}^+$ and $\text{CO}_2$ are changed.


title: Neural Radiance Fields in Medical Imaging: Challenges and Next Steps

abstract: Neural Radiance Fields (NeRF), as a pioneering technique in computer vision, offer great potential to revolutionize medical imaging by synthesizing three-dimensional representations from the projected two-dimensional image data. However, they face unique challenges when applied to medical applications. This paper presents a comprehensive examination of applications of NeRFs in medical imaging, highlighting four imminent challenges, including fundamental imaging principles, inner structure requirement, object boundary definition, and color density significance. We discuss current methods on different organs and discuss related limitations. We also review several datasets and evaluation metrics and propose several promising directions for future research.


title: Scaling Behavior of Fractional Growth Processes

abstract: An exact solution is introduced for one dimensional space-fractional Edwards-Wilkinson equation. It is shown that the roughness obeys the Family-Viscek dynamic scaling form and the scaling exponents is derived. It is seen that the scaling exponents are different from those coming from ordinary Edwards-Wilkinson equation and depend on the fractional order. Scaling exponents in the presence of correlated noise is also obtained.


title: A Revisit to Classical and Quantum aspects of Raychaudhuri equation and possible resolution of Singularity

abstract: In this review, we provide a concrete overview of the Raychaudhuri equation, Focusing theorem and Convergence conditions in a plethora of backgrounds and discuss the consequences. We also present various classical and quantum approaches suggested in the literature that could potentially mitigate the initial big-bang singularity and the black-hole singularity.


title: Raychaudhuri equation and the dynamics of cosmic evolution

abstract: The paper deals with the Raychaudhuri equation (RE) which is a non-linear ordinary differential equation in $\Theta$, the expansion scalar corresponding to a geodesic flow. Focusing theorem which follows as a consequence of the RE has been restated in terms of the cosmic parameter $q$ (deceleration parameter) both for Einstein gravity and for modified gravity theories. Measurable quantities namely the luminosity distance and density parameter are shown to have an upper bound using the Raychaudhuri scalar. An analogy between geometric and cosmological RE has been made. Subsequently, to find the solution of the non-linear RE a transformation of variable related to the metric scalar of the hyper-surface has been identified which converts the former to a second order differential equation. Finally, the first integral of this second order differential equation gives the entire picture of the dynamics of cosmic evolution.


title: Generative AI and Copyright: A Dynamic Perspective

abstract: The rapid advancement of generative AI is poised to disrupt the creative industry. Amidst the immense excitement for this new technology, its future development and applications in the creative industry hinge crucially upon two copyright issues: 1) the compensation to creators whose content has been used to train generative AI models (the fair use standard); and 2) the eligibility of AI-generated content for copyright protection (AI-copyrightability). While both issues have ignited heated debates among academics and practitioners, most analysis has focused on their challenges posed to existing copyright doctrines. In this paper, we aim to better understand the economic implications of these two regulatory issues and their interactions. By constructing a dynamic model with endogenous content creation and AI model development, we unravel the impacts of the fair use standard and AI-copyrightability on AI development, AI company profit, creators income, and consumer welfare, and how these impacts are influenced by various economic and operational factors. For example, while generous fair use (use data for AI training without compensating the creator) benefits all parties when abundant training data exists, it can hurt creators and consumers when such data is scarce. Similarly, stronger AI-copyrightability (AI content enjoys more copyright protection) could hinder AI development and reduce social welfare. Our analysis also highlights the complex interplay between these two copyright issues. For instance, when existing training data is scarce, generous fair use may be preferred only when AI-copyrightability is weak. Our findings underscore the need for policymakers to embrace a dynamic, context-specific approach in making regulatory decisions and provide insights for business leaders navigating the complexities of the global regulatory environment.


title: Time Series Analysis in Compressor-Based Machines: A Survey

abstract: In both industrial and residential contexts, compressor-based machines, such as refrigerators, HVAC systems, heat pumps and chillers, are essential to fulfil production and consumers' needs. The diffusion of sensors and IoT connectivity supports the development of monitoring systems that can detect and predict faults, identify behavioural shifts and forecast the operational status of machines and their components. The focus of this paper is to survey the recent research on such tasks as FD, FP, Forecasting and CPD applied to multivariate time series characterizing the operations of compressor-based machines. These tasks play a critical role in improving the efficiency and longevity of machines by minimizing downtime and maintenance costs and improving the energy efficiency. Specifically, FD detects and diagnoses faults, FP predicts such occurrences, forecasting anticipates the future value of characteristic variables of machines and CPD identifies significant variations in the behaviour of the appliances, such as a change in the working regime. We identify and classify the approaches to the tasks mentioned above, compare the algorithms employed, highlight the gaps in the current status of the art and discuss the most promising future research directions in the field.


title: Higher Auslander-Gorenstein Algebras And Gabriel Topologies

abstract: This paper is devoted to study the relationship between two important notions in ring theory, category theory, and representation theory of Artin algebras; namely, Gabriel topologies and higher Auslander(-Gorenstein) algebras. It is well-known that the class of all torsionless modules over a higher Auslander(-Gorenstein) algebra is a torsion-free class of a hereditary torsion theory that is cogenerated by its injective envelope and so by Gabriel-Maranda correspondence we can define a Gabriel topology on it. We show that higher Auslander(-Gorenstein) algebras can be characterized by this Gabriel topology. This characterization can be considered as a higher version of the Auslander-Buchsbaum-Serre theorem that is considered as one of the most important achievements of the use of homological algebra in the theory of commutative rings. Among some applications, the results also reveal a relation between the projective dimension of a module and the projective dimensions of the annihilator ideals of its objects over higher Auslander algebras.


title: Predicting machine failures from multivariate time series: an industrial case study

abstract: Non-neural Machine Learning (ML) and Deep Learning (DL) models are often used to predict system failures in the context of industrial maintenance. However, only a few researches jointly assess the effect of varying the amount of past data used to make a prediction and the extension in the future of the forecast. This study evaluates the impact of the size of the reading window and of the prediction window on the performances of models trained to forecast failures in three data sets concerning the operation of (1) an industrial wrapping machine working in discrete sessions, (2) an industrial blood refrigerator working continuously, and (3) a nitrogen generator working continuously. The problem is formulated as a binary classification task that assigns the positive label to the prediction window based on the probability of a failure to occur in such an interval. Six algorithms (logistic regression, random forest, support vector machine, LSTM, ConvLSTM, and Transformers) are compared using multivariate telemetry time series. The results indicate that, in the considered scenarios, the dimension of the prediction windows plays a crucial role and highlight the effectiveness of DL approaches at classifying data with diverse time-dependent patterns preceding a failure and the effectiveness of ML approaches at classifying similar and repetitive patterns preceding a failure.


title: Graph Neural Networks and Arithmetic Circuits

abstract: We characterize the computational power of neural networks that follow the graph neural network (GNN) architecture, not restricted to aggregate-combine GNNs or other particular types. We establish an exact correspondence between the expressivity of GNNs using diverse activation functions and arithmetic circuits over real numbers. In our results the activation function of the network becomes a gate type in the circuit. Our result holds for families of constant depth circuits and networks, both uniformly and non-uniformly, for all common activation functions.


title: Material Microstructure Design Using VAE-Regression with Multimodal Prior

abstract: We propose a variational autoencoder (VAE)-based model for building forward and inverse structure-property linkages, a problem of paramount importance in computational materials science. Our model systematically combines VAE with regression, linking the two models through a two-level prior conditioned on the regression variables. The regression loss is optimized jointly with the reconstruction loss of the variational autoencoder, learning microstructure features relevant for property prediction and reconstruction. The resultant model can be used for both forward and inverse prediction i.e., for predicting the properties of a given microstructure as well as for predicting the microstructure required to obtain given properties. Since the inverse problem is ill-posed (one-to-many), we derive the objective function using a multi-modal Gaussian mixture prior enabling the model to infer multiple microstructures for a target set of properties. We show that for forward prediction, our model is as accurate as state-of-the-art forward-only models. Additionally, our method enables direct inverse inference. We show that the microstructures inferred using our model achieve desired properties reasonably accurately, avoiding the need for expensive optimization loops.


title: Exploring Gene Regulatory Interaction Networks and predicting therapeutic molecules for Hypopharyngeal Cancer and EGFR-mutated lung adenocarcinoma

abstract: With the advent of Information technology, the Bioinformatics research field is becoming increasingly attractive to researchers and academicians. The recent development of various Bioinformatics toolkits has facilitated the rapid processing and analysis of vast quantities of biological data for human perception. Most studies focus on locating two connected diseases and making some observations to construct diverse gene regulatory interaction networks, a forerunner to general drug design for curing illness. For instance, Hypopharyngeal cancer is a disease that is associated with EGFR-mutated lung adenocarcinoma. In this study, we select EGFR-mutated lung adenocarcinoma and Hypopharyngeal cancer by finding the Lung metastases in hypopharyngeal cancer. To conduct this study, we collect Mircorarray datasets from GEO (Gene Expression Omnibus), an online database controlled by NCBI. Differentially expressed genes, common genes, and hub genes between the selected two diseases are detected for the succeeding move. Our research findings have suggested common therapeutic molecules for the selected diseases based on 10 hub genes with the highest interactions according to the degree topology method and the maximum clique centrality (MCC). Our suggested therapeutic molecules will be fruitful for patients with those two diseases simultaneously.


title: AN An ica-ensemble learning approach for prediction of uwb nlos signals data classification

abstract: Trapped human detection in search and rescue (SAR) scenarios poses a significant challenge in pervasive computing. This study addresses this issue by leveraging machine learning techniques, given their high accuracy. However, accurate identification of trapped individuals is hindered by the curse of dimensionality and noisy data. Particularly in non-line-of-sight (NLOS) situations during catastrophic events, the curse of dimensionality may lead to blind spots due to noise and uncorrelated values in detections. This research focuses on harmonizing information through wireless communication and identifying individuals in NLOS scenarios using ultra-wideband (UWB) radar signals. Employing independent component analysis (ICA) for feature extraction, the study evaluates classification performance using ensemble algorithms on both static and dynamic datasets. The experimental results demonstrate categorization accuracies of 88.37% for static data and 87.20% for dynamic data, highlighting the effectiveness of the proposed approach. Finally, this work can help scientists and engineers make instant decisions during SAR operations.


title: Event Detection for Non-intrusive Load Monitoring using Tukey s Fences

abstract: The primary objective of non-intrusive load monitoring (NILM) techniques is to monitor and track power consumption within residential buildings. This is achieved by approximating the consumption of each individual appliance from the aggregate energy measurements. Event-based NILM solutions are generally more accurate than other methods. Our paper introduces a novel event detection algorithm called Tukey's Fences-based event detector (TFED). This algorithm uses the fast Fourier transform in conjunction with the Tukey fences rule to detect variations in the aggregated current signal. The primary benefit of TFED is its superior ability to accurately pinpoint the start times of events, as demonstrated through simulations. Our findings reveal that the proposed algorithm boasts an impressive 99% accuracy rate, surpassing the accuracy of other recent works in the literature such as the Cepstrum and $\chi ^2$ GOF statistic-based analyses, which only achieved 98% accuracy.


title: BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuning

abstract: Recent research trends in computational biology have increasingly focused on integrating text and bio-entity modeling, especially in the context of molecules and proteins. However, previous efforts like BioT5 faced challenges in generalizing across diverse tasks and lacked a nuanced understanding of molecular structures, particularly in their textual representations (e.g., IUPAC). This paper introduces BioT5+, an extension of the BioT5 framework, tailored to enhance biological research and drug discovery. BioT5+ incorporates several novel features: integration of IUPAC names for molecular understanding, inclusion of extensive bio-text and molecule data from sources like bioRxiv and PubChem, the multi-task instruction tuning for generality across tasks, and a numerical tokenization technique for improved processing of numerical data. These enhancements allow BioT5+ to bridge the gap between molecular representations and their textual descriptions, providing a more holistic understanding of biological entities, and largely improving the grounded reasoning of bio-text and bio-sequences. The model is pre-trained and fine-tuned with a large number of experiments, including \emph{3 types of problems (classification, regression, generation), 15 kinds of tasks, and 21 total benchmark datasets}, demonstrating the remarkable performance and state-of-the-art results in most cases. BioT5+ stands out for its ability to capture intricate relationships in biological data, thereby contributing significantly to bioinformatics and computational biology. Our code is available at \url{https://github.com/QizhiPei/BioT5}.


title: TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space

abstract: Large Language Models (LLMs) sometimes suffer from producing hallucinations, especially LLMs may generate untruthful responses despite knowing the correct knowledge. Activating the truthfulness within LLM is the key to fully unlocking LLM's knowledge potential. In this paper, we propose TruthX, an inference-time intervention method to activate the truthfulness of LLM by identifying and editing the features within LLM's internal representations that govern the truthfulness. TruthX employs an auto-encoder to map LLM's representations into semantic and truthful latent spaces respectively, and applies contrastive learning to identify a truthful editing direction within the truthful space. During inference, by editing LLM's internal representations in truthful space, TruthX effectively enhances the truthfulness of LLM. Experiments show that TruthX improves the truthfulness of 13 advanced LLMs by an average of 20% on TruthfulQA benchmark. Further analyses suggest that TruthX can control LLM to produce truthful or hallucinatory responses via editing only one vector in LLM's internal representations.


title: DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation

abstract: Training deep neural networks typically involves substantial computational costs during both forward and backward propagation. The conventional layer dropping techniques drop certain layers during training for reducing the computations burden. However, dropping layers during forward propagation adversely affects the training process by degrading accuracy. In this paper, we propose Dropping Backward Propagation (DropBP), a novel approach designed to reduce computational costs while maintaining accuracy. DropBP randomly drops layers during the backward propagation, which does not deviate forward propagation. Moreover, DropBP calculates the sensitivity of each layer to assign appropriate drop rate, thereby stabilizing the training process. DropBP is designed to enhance the efficiency of the training process with backpropagation, thereby enabling the acceleration of both full fine-tuning and parameter-efficient fine-tuning using backpropagation. Specifically, utilizing DropBP in QLoRA reduces training time by 44%, increases the convergence speed to the identical loss level by 1.5$\times$, and enables training with a 6.2$\times$ larger sequence length on a single NVIDIA-A100 80GiB GPU in LLaMA2-70B. The code is available at https://github.com/WooSunghyeon/dropbp.


title: String Shooter's overall shape in ambient air

abstract: In this article, we study the behaviour of a looped string launched in ambient air using motorised wheels. We show that the loop, once it reaches its stationary state, is either in the pulley or the air-lifted state. The transition between these two distinct states occurs at the so-called takeoff speed. We prove that this speed differs from one string to another based on its characteristics. However, it is independent from the loop's length and its initial launch angle. This speed indeed corresponds to the threshold where air drag starts compensating for the weight of the string.


title: Comment on "Source of black bounces in Rastall gravity''

abstract: In Atazadeh and Hadi (JCAP \textbf{01}, 067 (2024)), the authors proposed that black bounce solutions, such as the Simpson-Visser and the Bardeen-type spacetimes, can be obtained from Rastall gravity. To achieve these spacetimes, the authors consider the presence of a phantom scalar field with nonlinear electrodynamics. However, in this comment, we obtained different electromagnetic Lagrangians from the original work. The most problematic issue is not the incorrect expression of the electromagnetic Lagrangian itself. We show that the method obtains electromagnetic functions that are inconsistent. To obtain the black bounce spacetimes as solutions of Rastall gravity, it is necessary to consider an isotropic fluid, combined with the nonlinear electrodynamics and the phantom scalar field.


title: Is the Page-time paradox paradoxical?

abstract: I discuss how five reasonably sounding assumptions lead to a dilemma -- the Page-time paradox -- , which appears to challenge a conventional statistical mechanical underpinning of black hole thermodynamics. By inspecting the conceptual subtleties behind each hypothesis, I list questions that require clarification before the puzzle can be deemed paradoxical. I devote particular attention to using thermodynamic arguments for a system that never reaches equilibrium. As a proof of concept, I show that the paradox is absent in a modified setting that admits an equilibrium thermodynamics formulation.


title: Physics-Informed Machine Learning for the Inverse Design of Wave Scattering Clusters

abstract: Clusters of wave-scattering oscillators offer the ability to passively control wave energy in elastic continua. However, designing such clusters to achieve a desired wave energy pattern is a highly nontrivial task. While the forward scattering problem may be readily analyzed, the inverse problem is very challenging as it is ill-posed, high-dimensional, and known to admit non-unique solutions. Therefore, the inverse design of multiple scattering fields and remote sensing of scattering elements remains a topic of great interest. Motivated by recent advances in physics-informed machine learning, we develop a deep neural network that is capable of predicting the locations of scatterers by evaluating the patterns of a target wavefield. We present a modeling and training formulation to optimize the multi-functional nature of our network in the context of inverse design, remote sensing, and wavefield engineering. Namely, we develop a multi-stage training routine with customized physics-based loss functions to optimize models to detect the locations of scatterers and predict cluster configurations that are physically consistent with the target wavefield. We demonstrate the efficacy of our model as a remote sensing and inverse design tool for three scattering problem types, and we subsequently applicability for designing clusters that direct waves along preferred paths or localize wave energy. Hence, we present an effective model for multiple scattering inverse design which may have diverse applications such as wavefield imaging or passive wave energy control.


title: Gradient Properties of Perturbative Multiscalar RG Flows to Six Loops

abstract: The gradient property of the renormalisation group (RG) flow of multiscalar theories is examined perturbatively in $d=4$ and $d=4-\varepsilon$ dimensions. Such theories undergo RG flows in the space of quartic couplings $\lambda^I$. Starting at five loops, the relevant vector field that determines the physical RG flow is not the beta function traditionally computed in a minimal subtraction scheme in dimensional regularisation, but a suitable modification of it, the $B$ function. It is found that up to five loops the $B$ vector field is gradient, i.e. $B^I=G^{IJ}\partial A / \partial\lambda^J$ with $A$ a scalar and $G_{IJ}$ a rank-two symmetric tensor of the couplings. Up to five loops the beta function is also gradient, but it fails to be so at six loops. The conditions under which the $B$ function (and hence the RG flow) is gradient at six loops are specified, but their verification rests on a separate six-loop computation that remains to be performed.


title: scida: scalable analysis for scientific big data

abstract: scida is a Python package for reading and analyzing large scientific data sets with support for various cosmological and galaxy formation simulations out-of-the-box. Data access is provided through a hierarchical dictionary-like data structure after a simple load() function. Using the dask library for scalable, parallel and out-of-core computation, all computation requests from a user session are first collected in a task graph. Arbitrary custom analysis, as well as all available dask (array) operations, can be performed. The subsequent computation is executed only upon request, on a target resource (e.g. a HPC cluster).


title: The FLAMINGO simulation view of cluster progenitors observed in the epoch of reionization with JWST

abstract: Motivated by the recent JWST discovery of galaxy overdensities during the Epoch of Reionzation, we examine the physical properties of high-$z$ protoclusters and their evolution using the FLAMINGO simulation suite. We investigate the impact of the apertures used to define protoclusters, because the heterogeneous apertures used in the literature have limited our understanding of the population. Our results are insensitive to the uncertainties of the subgrid models at a given resolution, whereas further investigation into the dependence on numerical resolution is needed. When considering galaxies more massive than $M_\ast\,{\simeq}\,10^8\,{\rm M_\odot}$, the FLAMINGO simulations predict a dominant contribution from progenitors similar to those of the Coma cluster to the cosmic star-formation rate density during the reionization epoch. Our results indicate the onset of suppression of star formation in the protocluster environments as early as $z\,{\simeq}\,5$. The galaxy number density profiles are similar to NFW at $z\,{\lesssim}\,1$ while showing a steeper slope at earlier times before the formation of the core. Different from most previous simulations, the predicted star-formation history for individual protoclusters is in good agreement with observations. We demonstrate that, depending on the aperture, the integrated physical properties including the total (dark matter and baryonic) mass can be biased by a factor of 2 to 5 at $z\,{=}\,5.5$--$7$, and by an order of magnitude at $z\,{\lesssim}\,4$. This correction suffices to remove the ${\simeq}\,3\,\sigma$ tensions with the number density of structures found in recent JWST observations.


title: An Axion Pulsarscope

abstract: Electromagnetic fields surrounding pulsars may source coherent ultralight axion signals at the known rotational frequencies of the neutron stars, which can be detected by laboratory experiments (e.g., pulsarscopes). As a promising case study, we model axion emission from the well-studied Crab pulsar, which would yield a prominent signal at $f \approx 29.6$ Hz regardless of whether the axion contributes to the dark matter abundance. We estimate the relevant sensitivity of future axion dark matter detection experiments such as DMRadio-GUT, Dark SRF, and CASPEr, assuming different magnetosphere models to bracket the uncertainty in astrophysical modeling. For example, depending on final experimental parameters, the Dark SRF experiment could probe axions with any mass $m_a \ll 10^{-13}$ eV down to $g_{a\gamma\gamma} \sim 3 \times 10^{-13}$ GeV$^{-1}$ with one year of data and assuming the vacuum magnetosphere model. These projected sensitivities may be degraded depending on the extent to which the magnetosphere is screened by charge-filled plasma. The promise of pulsar-sourced axions as a clean target for direct detection experiments motivates dedicated simulations of axion production in pulsar magnetospheres.


title: Flavor-Violating ALPs, Electron g-2, and the Electron-Ion Collider

abstract: We revisit the possibility that light axion-like particles (ALPs) with lepton flavor violating couplings could give significant contributions to the electron's anomalous magnetic moment $g_e-2$. Unlike flavor diagonal lepton-ALP couplings, which are exclusively axial, lepton flavor violating couplings can have arbitrary chirality. Focusing on the $e$-$\tau$ ALP coupling, we find that the size of the contribution to $g_e-2$ depends strongly on the chirality of the coupling. A significant part of the parameter space for which such a coupling can explain experimental anomalies in $g_e-2$ can be probed at the Electron-Ion Collider, which is uniquely sensitive to the chirality of the coupling using the polarization of the electron beam.


title: Galaxy cluster virial-shock sources in eROSITA catalogs

abstract: Following the recent identification of discrete ROSAT and radio sources associated with the virial shocks of MCXC clusters and groups, we examine if the early eROSITA-DE data release (EDR) shows virial-shock X-ray sources within its $140$ deg$^2$ field. EDR catalog sources are stacked and radially binned around EDR catalog clusters and groups. The properties of the excess virial-shock sources are inferred statistically by comparing the virial-shock region to the field. An excess of X-ray sources is found narrowly localized at the $2.0<r/R_{500}<2.25$ normalized radii, just inside the anticipated virial shocks, of the resolved 532 clusters, for samples of both extended ($3\sigma$ for 534 sources) or bright ($3.5\sigma$ for 5820 sources; $4\sigma$ excluding the low cluster-mass quartile) sources. The excess sources are on average extended ($\sim 100$ kpc), luminous ($L_X\simeq 10^{43-44}$ erg s$^{-1}$), and hot ($\sim$keV), consistent with infalling gaseous halos crossing the virial shock. The results agree with the stacked ROSAT-MCXC signal, showing the higher $L_X$ anticipated at EDR redshifts and a possible dependence upon host mass. Localized virial-shock spikes in the distributions of discrete radio, X-ray, and probably also $\gamma$-ray sources are new powerful probes of accretion from the cosmic web, with strong constraints anticipated with future all-sky catalogs such as by eROSITA.


title: Breakdown of Hawking Evaporation opens new Mass Window for Primordial Black Holes as Dark Matter Candidate

abstract: The energy injection through Hawking evaporation has been used to put strong constraints on primordial black holes as a dark matter candidate at masses below $10^{17}\,\rm{g}$. However, Hawking's semiclassical approximation breaks down at latest after half-decay. Beyond this point, the evaporation could be significantly suppressed as was shown in recent work. In this study, we review existing cosmological and astrophysical bounds on primordial black holes taking this effect into account. We show that the constraints disappear completely for a reasonable range of parameters, which opens a new window below $10^{10}\,\rm{g}$ for light primordial black holes as a dark matter candidate.

categories: astro-ph.CO astro-ph.HE gr-qc hep-ph hep-th


title: Quantum spin glasses and Sachdev-Ye-Kitaev models

abstract: A brief survey of some random quantum models with infinite-range couplings is presented. Insights from such models have led to advances in the quantum theory of charged black holes in spatial dimensions $d \geq 3$, and to a universal theory of strange metals in correlated electron materials in $d=2$; these are also briefly reviewed.


title: Particle detectors under chronological hazard

abstract: We analyze how the presence of closed timelike curves (CTCs) characterizing a time machine can be discerned by placing a local particle detector in a region of spacetime which is causally disconnected from the CTCs. Our study shows that not only can the detector tell if there are CTCs, but also that the detector can separate topological from geometrical information and distinguish periodic spacetimes without CTCs (like the Einstein cylinder), curvature, and spacetimes with topological identifications that enable time-machines.


title: Prediction-Powered Ranking of Large Language Models

abstract: Large language models are often ranked according to their level of alignment with human preferences -- a model is better than other models if its outputs are more frequently preferred by humans. One of the popular ways to elicit human preferences utilizes pairwise comparisons between the outputs provided by different models to the same inputs. However, since gathering pairwise comparisons by humans is costly and time-consuming, it has become a common practice to gather pairwise comparisons by a strong large language model -- a model strongly aligned with human preferences. Surprisingly, practitioners cannot currently measure the uncertainty that any mismatch between human and model preferences may introduce in the constructed rankings. In this work, we develop a statistical framework to bridge this gap. Given a (small) set of pairwise comparisons by humans and a large set of pairwise comparisons by a model, our framework provides a rank-set -- a set of possible ranking positions -- for each of the models under comparison. Moreover, it guarantees that, with a probability greater than or equal to a user-specified value, the rank-sets cover the true ranking consistent with the distribution of human pairwise preferences asymptotically. Using pairwise comparisons made by humans in the LMSYS Chatbot Arena platform and pairwise comparisons made by three strong large language models, we empirically demonstrate the effectivity of our framework and show that the rank-sets constructed using only pairwise comparisons by the strong large language models are often inconsistent with (the distribution of) human pairwise preferences.


title: Residual entropy from temperature incremental Monte Carlo method

abstract: Residual entropy, indicative of the degrees of freedom in a system at absolute zero, is a cornerstone for understanding quantum and classical ground states. Despite its critical role in elucidating low-temperature phenomena and ground state degeneracy, accurately quantifying residual entropy remains a formidable challenge due to significant computational hurdles. In this Letter, we introduce the Temperature Incremental Monte Carlo (TIMC) method, our novel solution crafted to surmount these challenges. The TIMC method incrementally calculates the partition function ratio of neighboring temperatures within Monte Carlo simulations, enabling precise entropy calculations and providing insights into a spectrum of other temperature-dependent observables in a single computational sweep of temperatures. We have rigorously applied TIMC to a variety of complex systems, such as the frustrated antiferromagnetic Ising model on both C60 and 2D triangular lattices, the Newman-Moore spin glass model, and a 2D quantum transverse field Ising model. Notably, our method surmounts the traditional obstacles encountered in partition function measurements when mapping $d$-dimensional quantum models to $d+1$-dimensional classical counterparts. The TIMC method's finesse in detailing entropy across the entire temperature range enriches our comprehension of critical phenomena in condensed matter physics. This includes insights into spin glasses, phases exhibiting spontaneous symmetry breaking, topological states of matter and fracton phases. Our approach not only advances the methodology for probing the entropic landscape of such systems but also paves the way for exploring their broader thermodynamic and quantum mechanical properties.


title: The X-ray enhancements of radio-loud quasars at high redshift: New results at $z = 4\text{ -- }7$

abstract: Highly radio-loud quasars (HRLQs; $\log R>2.5$) at $z\gtrsim 4$ show apparent enhanced X-ray emission compared to matched HRLQs at lower redshifts, perhaps due to a redshift-dependent fractional contribution to the X-ray luminosity from inverse-Compton scattering of cosmic microwave background photons (IC/CMB). Using new {\it Chandra} observations and archival X-ray data, we investigate this phenomenon with an optically flux-limited sample of 41 HRLQs at $z = 4$--5.5 all with sensitive X-ray coverage, the largest sample utilized to date by a wide margin. X-ray enhancements are assessed using X-ray-to-optical flux ratios and spectral energy distributions. We confirm the presence of X-ray enhancements at a 4.9--5.3$\sigma$ significance level, finding that the median factor of enhancement is $\approx 1.8$ at our sample median redshift of $z\approx 4.4$. Under a fractional IC/CMB model, the expected enhancement at lower redshifts is modest; e.g., $\approx 4$% at $z\approx 1.5$. We also investigate a sample of seven radio-loud quasars (RLQs; $\log R>1$) at even higher redshifts of $z=5.6$--6.8, using new and archival X-ray data. These RLQs also show evidence for X-ray enhancements by a median factor of $\approx 2.7$ at a 3.7--4.9$\sigma$ significance level. The X-ray spectral and other properties of these $z=5.6$--6.8 RLQs, however, pose challenges for a straightforward fractional IC/CMB interpretation of their enhancements.


title: The evolution of the SFR and Sigma-SFR of galaxies in cosmic morning (4 < z < 10)

abstract: The galaxy integrated star-formation rate (SFR) surface density ($\Sigma_{\rm SFR}$) has been proposed as a valuable diagnostic of the mass accumulation in galaxies as being more tightly related to the physics of star-formation (SF) and stellar feedback than other SF indicators. In this paper, we assemble a statistical sample of 230 galaxies observed with JWST in the GLASS and CEERS spectroscopic surveys to estimate Balmer line based dust attenuations and SFRs, and UV rest-frame effective radii. We study the evolution of galaxy SFR and $\Sigma_{\rm SFR}$ in the first 1.5 Billion years of our Universe, finding that $\Sigma_{\rm SFR}$ is mildly increasing with redshift with a linear slope of $0.16 \pm 0.06$. We also explore the dependence of SFR and $\Sigma_{\rm SFR}$ on stellar mass, showing that a SF 'Main-Sequence' and a $\Sigma_{\rm SFR}$ `Main-Sequence' are in place out to z=10, with a similar slope compared to the same relations at lower redshifts. We find that the specific SFR (sSFR) and $\Sigma_{\rm SFR}$ are correlated with the [OIII]5007/[OII]3727 ratio and with indirect estimates of the escape fraction of Lyman continuum photons, hence they likely play an important role in the evolution of ionization conditions and in the escape of ionizing radiation. We also search for spectral outflow signatures in a subset of galaxies observed at high resolution, finding an outflow incidence of $2/11$ ($=20\%^{32\%}_{9\%}$) at $z<6$, but no evidence at $z>6$ ($<26\%$). Finally, we find a positive correlation between A$_V$ and $\Sigma_{\rm SFR}$, and a flat trend as a function of sSFR, indicating that there is no evidence of a drop of A$_V$ in extremely star-forming galaxies between z=4 and 10. This might be at odds with a dust-clearing outflow scenario, which might instead take place at redshifts $z\geq 10$, as suggested by some theoretical models.


title: DUVET: sub-kiloparsec resolved star formation driven outflows in a sample of local starbursting disk galaxies

abstract: We measure resolved (kiloparsec-scale) outflow properties in a sample of 10 starburst galaxies from the DUVET sample, using Keck/KCWI observations of H$\beta$ and [OIII]~$\lambda$5007. We measure $\sim450$ lines-of-sight that contain outflows, and use these to study scaling relationships of outflow velocity ($v_{\rm out}$), mass-loading factor ($\eta$; mass outflow rate per SFR) and mass flux ($\dot{\Sigma}_{\rm out}$; mass outflow rate per area) with co-located SFR surface density ($\Sigma_{\rm SFR}$) and stellar mass surface density ($\Sigma_{\ast}$). We find strong, positive correlations of $\dot{\Sigma}_{\rm out} \propto \Sigma_{\rm SFR}^{1.2}$ and $\dot{\Sigma}_{\rm out} \propto \Sigma_{\ast}^{1.7}$. We also find shallow correlations between $v_{\rm out}$ and both $\Sigma_{\rm SFR}$ and $\Sigma_{\ast}$. Our resolved observations do not suggest a threshold in outflows with $\Sigma_{\rm SFR}$, but rather we find that the local specific SFR ($\Sigma_{\rm SFR}/\Sigma_\ast$) is a better predictor of where outflows are detected. We find that outflows are very common above $\Sigma_{\rm SFR}/\Sigma_\ast\gtrsim 0.1$~Gyr$^{-1}$ and rare below this value. We argue that our results are consistent with a picture in which outflows are driven by supernovae, and require more significant injected energy in higher mass surface density environments to overcome local gravity. The correlations we present here provide a statistically robust, direct comparison for simulations and higher redshift results from JWST.