title: Conformalized Late Fusion Multi-View Learning

abstract: Uncertainty quantification for multi-view learning is motivated by the increasing use of multi-view data in scientific problems. A common variant of multi-view learning is late fusion: train separate predictors on individual views and combine them after single-view predictions are available. Existing methods for uncertainty quantification for late fusion often rely on undesirable distributional assumptions for validity. Conformal prediction is one approach that avoids such distributional assumptions. However, naively applying conformal prediction to late-stage fusion pipelines often produces overly conservative and uninformative prediction regions, limiting its downstream utility. We propose a novel methodology, Multi-View Conformal Prediction (MVCP), where conformal prediction is instead performed separately on the single-view predictors and only fused subsequently. Our framework extends the standard scalar formulation of a score function to a multivariate score that produces more efficient downstream prediction regions in both classification and regression settings. We then demonstrate that such improvements can be realized in methods built atop conformalized regressors, specifically in robust predict-then-optimize pipelines.


title: AutoManual: Generating Instruction Manuals by LLM Agents via Interactive Environmental Learning

abstract: Large Language Models (LLM) based agents have shown promise in autonomously completing tasks across various domains, e.g., robotics, games, and web navigation. However, these agents typically require elaborate design and expert prompts to solve tasks in specific domains, which limits their adaptability. We introduce AutoManual, a framework enabling LLM agents to autonomously build their understanding through interaction and adapt to new environments. AutoManual categorizes environmental knowledge into diverse rules and optimizes them in an online fashion by two agents: 1) The Planner codes actionable plans based on current rules for interacting with the environment. 2) The Builder updates the rules through a well-structured rule system that facilitates online rule management and essential detail retention. To mitigate hallucinations in managing rules, we introduce \textit{case-conditioned prompting} strategy for the Builder. Finally, the Formulator agent compiles these rules into a comprehensive manual. The self-generated manual can not only improve the adaptability but also guide the planning of smaller LLMs while being human-readable. Given only one simple demonstration, AutoManual significantly improves task success rates, achieving 97.4\% with GPT-4-turbo and 86.2\% with GPT-3.5-turbo on ALFWorld benchmark tasks. The source code will be available soon.


title: Combining Radiomics and Machine Learning Approaches for Objective ASD Diagnosis: Verifying White Matter Associations with ASD

abstract: Autism Spectrum Disorder is a condition characterized by a typical brain development leading to impairments in social skills, communication abilities, repetitive behaviors, and sensory processing. There have been many studies combining brain MRI images with machine learning algorithms to achieve objective diagnosis of autism, but the correlation between white matter and autism has not been fully utilized. To address this gap, we develop a computer-aided diagnostic model focusing on white matter regions in brain MRI by employing radiomics and machine learning methods. This study introduced a MultiUNet model for segmenting white matter, leveraging the UNet architecture and utilizing manually segmented MRI images as the training data. Subsequently, we extracted white matter features using the Pyradiomics toolkit and applied different machine learning models such as Support Vector Machine, Random Forest, Logistic Regression, and K-Nearest Neighbors to predict autism. The prediction sets all exceeded 80% accuracy. Additionally, we employed Convolutional Neural Network to analyze segmented white matter images, achieving a prediction accuracy of 86.84%. Notably, Support Vector Machine demonstrated the highest prediction accuracy at 89.47%. These findings not only underscore the efficacy of the models but also establish a link between white matter abnormalities and autism. Our study contributes to a comprehensive evaluation of various diagnostic models for autism and introduces a computer-aided diagnostic algorithm for early and objective autism diagnosis based on MRI white matter regions.


title: On the fundamental theorem of submanifold theory and isometric immersions with supercritical low regularity

abstract: A fundamental result in global analysis and nonlinear elasticity asserts that given a solution $\mathfrak{S}$ to the Gauss--Codazzi--Ricci equations over a simply-connected closed manifold $(\mathcal{M}^n,g)$, one may find an isometric immersion $\iota$ of $(\mathcal{M}^n,g)$ into the Euclidean space $\mathbb{R}^{n+k}$ whose extrinsic geometry coincides with $\mathfrak{S}$. Here the dimension $n$ and the codimension $k$ are arbitrary. Abundant literature has been devoted to relaxing the regularity assumptions on $\mathfrak{S}$ and $\iota$. The best result up to date is $\mathfrak{S} \in L^p$ and $\iota \in W^{2,p}$ for $p>n \geq 3$ or $p=n=2$. In this paper, we extend the above result to $\iota \in \mathcal{X}$ whose topology is strictly weaker than $W^{2,n}$ for $n \geq 3$. Indeed, $\mathcal{X}$ is the weak Morrey space $L^{p, n-p}_{2,w}$ with arbitrary $p \in ]2,n]$. This appears to be first supercritical result in the literature on the existence of isometric immersions with low regularity, given the solubility of the Gauss--Codazzi--Ricci equations. Our proof essentially utilises the theory of Uhlenbeck gauges -- in particular, Rivi\`{e}re--Struwe's work [Partial regularity for harmonic maps and related problems, Comm. Pure Appl. Math. 61 (2008)] on harmonic maps in arbitrary dimensions and codimensions -- and compensated compactness.


title: Conformal Robust Control of Linear Systems

abstract: End-to-end engineering design pipelines, in which designs are evaluated using concurrently defined optimal controllers, are becoming increasingly common in practice. To discover designs that perform well even under the misspecification of system dynamics, such end-to-end pipelines have now begun evaluating designs with a robust control objective in place of the nominal optimal control setup. Current approaches of specifying such robust control subproblems, however, rely on hand specification of perturbations anticipated to be present upon deployment or margin methods that ignore problem structure, resulting in a lack of theoretical guarantees and overly conservative empirical performance. We, instead, propose a novel methodology for LQR systems that leverages conformal prediction to specify such uncertainty regions in a data-driven fashion. Such regions have distribution-free coverage guarantees on the true system dynamics, in turn allowing for a probabilistic characterization of the regret of the resulting robust controller. We then demonstrate that such a controller can be efficiently produced via a novel policy gradient method that has convergence guarantees. We finally demonstrate the superior empirical performance of our method over alternate robust control specifications in a collection of engineering control systems, specifically for airfoils and a load-positioning system.


title: Geometric quantization and unitary highest weight Harish-Chandra supermodules

abstract: Geometric quantization transforms a symplectic manifold with Lie group action to a unitary representation. In this article, we extend geometric quantization to the super setting. We consider real forms of contragredient Lie supergroups with compact Cartan subgroups, and study their actions on some pseudo-K\"ahler supermanifolds. We construct their unitary representations in terms of sections of some line bundles. These unitary representations contain highest weight Harish-Chandra supermodules, whose occurrences depend on the image of the moment map. As a result, we construct a Gelfand model of highest weight Harish-Chandra supermodules. We also perform symplectic reduction, and show that quantization commutes with reduction.


title: 2-torsion in instanton Floer homology

abstract: This paper studies the existence of $2$-torsion in instanton Floer homology with $\mathbb{Z}$ coefficients for closed $3$-manifolds and singular knots. First, we show that the non-existence of $2$-torsion in the framed instanton Floer homology $I^\sharp(S_n^3(K);\mathbb{Z})$ of any nonzero integral $n$-surgery along a knot $K$ in $S^3$ would imply that $K$ is fibered. Also, we show that $I^\sharp(S_{r}^3(K);\mathbb{Z})$ for any nontrivial $K$ with $r=1,1/2,1/4$ always has $2$-torsion. These two results indicate that the existence of $2$-torsion is expected to be a generic phenomenon for Dehn surgeries along knots. Second, we show that for genus-one knots with nontrivial Alexander polynomials and for unknotting-number-one knots, the unreduced singular instanton knot homology $I^\sharp(S^3,K;\mathbb{Z})$ always has $2$-torsion. Finally, some crucial lemmas that help us demonstrate the existence of $2$-torsion are motivated by analogous results in Heegaard Floer theory, which may be of independent interest. In particular, we show that, for a knot $K$ in $S^3$, if there is a nonzero rational number $r$ such that the dual knot $\widetilde{K}_r$ inside $S^3_r(K)$ is Floer simple, then $S^3_r(K)$ must be an L-space and $K$ must be an L-space knot.


title: On the dispersability of graph bundles over cycles

abstract: In this paper, the dispersability of the Cartesian graph bundle over two cycles is completely solved. We show the Cartesian graph bundle $G$ over two cycles is dispersable if $G$ is bipartite; otherwise, $G$ is nearly dispersable.


title: Transfer learning in predicting quantum many-body dynamics: from physical observables to entanglement entropy

abstract: Deep neural networks have demonstrated remarkable efficacy in extracting meaningful representations from complex datasets. This has propelled representation learning as a compelling area of research across diverse fields. One interesting open question is how beneficial representation learning can be for quantum many-body physics, with its notouriosly high-dimensional state space. In this work, we showcase the capacity of a neural network that was trained on a subset of physical observables of a many-body system to partially acquire an implicit representation of the wave function. We illustrate this by demonstrating the effectiveness of reusing the representation learned by the neural network to enhance the learning process of another quantity derived from the quantum state. In particular, we focus on how the pre-trained neural network can enhance the learning of entanglement entropy. This is of particular interest as directly measuring the entanglement in a many-body system is very challenging, while a subset of physical observables can be easily measured in experiments. We show the pre-trained neural network learns the dynamics of entropy with fewer resources and higher precision in comparison with direct training on the entanglement entropy.


title: GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithms

abstract: The Adam optimization method has achieved remarkable success in addressing contemporary challenges in stochastic optimization. This method falls within the realm of adaptive sub-gradient techniques, yet the underlying geometric principles guiding its performance have remained shrouded in mystery, and have long confounded researchers. In this paper, we introduce GeoAdaLer (Geometric Adaptive Learner), a novel adaptive learning method for stochastic gradient descent optimization, which draws from the geometric properties of the optimization landscape. Beyond emerging as a formidable contender, the proposed method extends the concept of adaptive learning by introducing a geometrically inclined approach that enhances the interpretability and effectiveness in complex optimization scenarios


title: HetHub: A Heterogeneous distributed hybrid training system for large-scale models

abstract: The development of large-scale models relies on a vast number of computing resources. For example, the GPT-4 model (1.8 trillion parameters) requires 25000 A100 GPUs for its training. It is a challenge to build a large-scale cluster with a type of GPU-accelerator. Using multiple types of GPU-accelerators to construct a cluster is an effective way to solve the problem of insufficient homogeneous GPU-accelerators. However, the existing distributed training systems for large-scale models only support homogeneous GPU-accelerators, not heterogeneous GPU-accelerators. To address the problem, this paper proposes a distributed training system with hybrid parallelism support on heterogeneous GPU-accelerators for large-scale models. It introduces a distributed unified communicator to realize the communication between heterogeneous GPU-accelerators, a distributed performance predictor, and an automatic hybrid parallel module to develop and train models efficiently with heterogeneous GPU-accelerators. Compared to the distributed training system with homogeneous GPU-accelerators, our system can support six different combinations of heterogeneous GPU-accelerators and the optimal performance of heterogeneous GPU-accelerators has achieved at least 90% of the theoretical upper bound performance of homogeneous GPU-accelerators.


title: From Single to Multi-Functional RIS: Architecture, Key Technologies, Challenges, and Applications

abstract: Although reconfigurable intelligent surfaces (RISs) have demonstrated the potential to boost network capacity and expand coverage by adjusting their electromagnetic properties, existing RIS architectures have certain limitations, such as double-fading attenuation and restricted half-space coverage. In this article, we delve into the progressive development from single to multi-functional RIS (MF-RIS) that enables simultaneous signal amplification, reflection, and refraction. We begin by detailing the hardware design and signal model that distinguish MF-RIS from traditional RISs. Subsequently, we introduce the key technologies underpinning MF-RIS-aided communications, along with the fundamental issues and challenges inherent to its deployment. We then outline the promising applications of MFRIS in the realm of communication, sensing, and computation systems, highlighting its transformative impact on these domains. Lastly, we present simulation results to demonstrate the superiority of MF-RIS in enhancing network performance in terms of spectral efficiency.


title: USD: Unsupervised Soft Contrastive Learning for Fault Detection in Multivariate Time Series

abstract: Unsupervised fault detection in multivariate time series is critical for maintaining the integrity and efficiency of complex systems, with current methodologies largely focusing on statistical and machine learning techniques. However, these approaches often rest on the assumption that data distributions conform to Gaussian models, overlooking the diversity of patterns that can manifest in both normal and abnormal states, thereby diminishing discriminative performance. Our innovation addresses this limitation by introducing a combination of data augmentation and soft contrastive learning, specifically designed to capture the multifaceted nature of state behaviors more accurately. The data augmentation process enriches the dataset with varied representations of normal states, while soft contrastive learning fine-tunes the model's sensitivity to the subtle differences between normal and abnormal patterns, enabling it to recognize a broader spectrum of anomalies. This dual strategy significantly boosts the model's ability to distinguish between normal and abnormal states, leading to a marked improvement in fault detection performance across multiple datasets and settings, thereby setting a new benchmark for unsupervised fault detection in complex systems. The code of our method is available at \url{https://github.com/zangzelin/code_USD.git}.


title: Front-propagation Algorithm: Explainable AI Technique for Extracting Linear Function Approximations from Neural Networks

abstract: This paper introduces the front-propagation algorithm, a novel eXplainable AI (XAI) technique designed to elucidate the decision-making logic of deep neural networks. Unlike other popular explainability algorithms such as Integrated Gradients or Shapley Values, the proposed algorithm is able to extract an accurate and consistent linear function explanation of the network in a single forward pass of the trained model. This nuance sets apart the time complexity of the front-propagation as it could be running real-time and in parallel with deployed models. We packaged this algorithm in a software called $\texttt{front-prop}$ and we demonstrate its efficacy in providing accurate linear functions with three different neural network architectures trained on publicly available benchmark datasets.


title: Enhancing Consistency-Based Image Generation via Adversarialy-Trained Classification and Energy-Based Discrimination

abstract: The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data, while maintaining a (relatively) simpler training. Consistency models enable a fast one- or few-step generation, but they typically fall somewhat short in sample quality when compared to their diffusion origins. In this work we propose a novel and highly effective technique for post-processing Consistency-based generated images, enhancing their perceptual quality. Our approach utilizes a joint classifier-discriminator model, in which both portions are trained adversarially. While the classifier aims to grade an image based on its assignment to a designated class, the discriminator portion of the very same network leverages the softmax values to assess the proximity of the input image to the targeted data manifold, thereby serving as an Energy-based Model. By employing example-specific projected gradient iterations under the guidance of this joint machine, we refine synthesized images and achieve an improved FID scores on the ImageNet 64x64 dataset for both Consistency-Training and Consistency-Distillation techniques.


title: Gain sensitivity of the Mach-Zehnder interferometer by photon subtraction strategy

abstract: We study sensitivity of phase estimation of Mach-Zehnder (MZ) interferometer with original two-mode squeezed vacuum (TMSV) state. At the initial stage, the TMSV state is converted into two single-mode squeezed vacuum (SMSV) states, from each of which photons are subtracted by measurement by photon-number resolving (PNR) detector in auxiliary modes. New measurement-induced continuous variable (CV) states of a certain parity can already demonstrate gain sensitivity more than 20 dB in relation to the initial SMSV states at the output from the MZ interferometer and follow to Heisenberg scaling in the case of subtracting a large number of photons in the measuring channels for practical values of the SMSV squeezing 5 dB>. Using only one measurement-induced CV state of a certain parity together with the SMSV state shows an increase in sensitivity of no more than 11 dB. We show that the sensitivity of the phase estimation obtained by measuring the intensity difference of two measurement-induced CV states in two arms of the MZ interferometer can surpass quantum Cramer-Rao (QCR) boundary of the original two SMSV states just in the practical range of input squeezing 5 dB>. In general, the strategy with preliminary subtraction of photons from two SMSV enables greatly enhance the sensitivity of the MZ interferometer in the practical case of small values of squeezing.


title: Layer-Aware Analysis of Catastrophic Overfitting: Revealing the Pseudo-Robust Shortcut Dependency

abstract: Catastrophic overfitting (CO) presents a significant challenge in single-step adversarial training (AT), manifesting as highly distorted deep neural networks (DNNs) that are vulnerable to multi-step adversarial attacks. However, the underlying factors that lead to the distortion of decision boundaries remain unclear. In this work, we delve into the specific changes within different DNN layers and discover that during CO, the former layers are more susceptible, experiencing earlier and greater distortion, while the latter layers show relative insensitivity. Our analysis further reveals that this increased sensitivity in former layers stems from the formation of pseudo-robust shortcuts, which alone can impeccably defend against single-step adversarial attacks but bypass genuine-robust learning, resulting in distorted decision boundaries. Eliminating these shortcuts can partially restore robustness in DNNs from the CO state, thereby verifying that dependence on them triggers the occurrence of CO. This understanding motivates us to implement adaptive weight perturbations across different layers to hinder the generation of pseudo-robust shortcuts, consequently mitigating CO. Extensive experiments demonstrate that our proposed method, Layer-Aware Adversarial Weight Perturbation (LAP), can effectively prevent CO and further enhance robustness.


title: Assessing Image Inpainting via Re-Inpainting Self-Consistency Evaluation

abstract: Image inpainting, the task of reconstructing missing segments in corrupted images using available data, faces challenges in ensuring consistency and fidelity, especially under information-scarce conditions. Traditional evaluation methods, heavily dependent on the existence of unmasked reference images, inherently favor certain inpainting outcomes, introducing biases. Addressing this issue, we introduce an innovative evaluation paradigm that utilizes a self-supervised metric based on multiple re-inpainting passes. This approach, diverging from conventional reliance on direct comparisons in pixel or feature space with original images, emphasizes the principle of self-consistency to enable the exploration of various viable inpainting solutions, effectively reducing biases. Our extensive experiments across numerous benchmarks validate the alignment of our evaluation method with human judgment.


title: Application of Artificial Intelligence in Hand Gesture Recognition with Virtual Reality: Survey and Analysis of Hand Gesture Hardware Selection

abstract: The ongoing usage of artificial intelligence technologies in virtual reality has led to a large number of researchers exploring immersive virtual reality interaction. Gesture controllers and head-mounted displays are the primary pieces of hardware used in virtual reality applications. This article analyzes the advantages and disadvantages of various hardware tools as well as possible use cases for hand gesture recognition. Several popular data sets used in data pre-processing and hand gesture detection systems are also summarized. This paper's primary objectives are to evaluate the current state of the art in gesture recognition research and to offer potential routes for future study to guide researchers working on immersive virtual reality interaction. Comparing recent study results and taking into account the state of the development of human-computer interaction technology, a number of potential research directions are highlighted, including the following: input data noise should be filtered, a lightweight network should be designed, tactile feedback should be created, and eye and gesture data should be combined.


title: MindStar: Enhancing Math Reasoning in Pre-trained LLMs at Inference Time

abstract: Although Large Language Models (LLMs) achieve remarkable performance across various tasks, they often struggle with complex reasoning tasks, such as answering mathematical questions. Recent efforts to address this issue have primarily focused on leveraging mathematical datasets through supervised fine-tuning or self-improvement techniques. However, these methods often depend on high-quality datasets that are difficult to prepare, or they require substantial computational resources for fine-tuning. Inspired by findings that LLMs know how to produce the right answer but struggle to select the correct reasoning path, we propose a purely inference-based searching method -- MindStar (M*). This method formulates reasoning tasks as searching problems and proposes two search ideas to identify the optimal reasoning paths. We evaluate the M* framework on both the GSM8K and MATH datasets, comparing its performance with existing open and closed-source LLMs. Our results demonstrate that M* significantly enhances the reasoning abilities of open-source models, such as Llama-2-13B and Mistral-7B, and achieves comparable performance to GPT-3.5 and Grok-1, but with substantially reduced model size and computational costs.


title: Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation

abstract: Collision-free motion is essential for mobile robots. Most approaches to collision-free and efficient navigation with wheeled robots require parameter tuning by experts to obtain good navigation behavior. This study investigates the application of deep reinforcement learning to train a mobile robot for autonomous navigation in a complex environment. The robot utilizes LiDAR sensor data and a deep neural network to generate control signals guiding it toward a specified target while avoiding obstacles. We employ two reinforcement learning algorithms in the Gazebo simulation environment: Deep Deterministic Policy Gradient and proximal policy optimization. The study introduces an enhanced neural network structure in the Proximal Policy Optimization algorithm to boost performance, accompanied by a well-designed reward function to improve algorithm efficacy. Experimental results conducted in both obstacle and obstacle-free environments underscore the effectiveness of the proposed approach. This research significantly contributes to the advancement of autonomous robotics in complex environments through the application of deep reinforcement learning.


title: A GPU-Accelerated Bi-linear ADMM Algorithm for Distributed Sparse Machine Learning

abstract: This paper introduces the Bi-linear consensus Alternating Direction Method of Multipliers (Bi-cADMM), aimed at solving large-scale regularized Sparse Machine Learning (SML) problems defined over a network of computational nodes. Mathematically, these are stated as minimization problems with convex local loss functions over a global decision vector, subject to an explicit $\ell_0$ norm constraint to enforce the desired sparsity. The considered SML problem generalizes different sparse regression and classification models, such as sparse linear and logistic regression, sparse softmax regression, and sparse support vector machines. Bi-cADMM leverages a bi-linear consensus reformulation of the original non-convex SML problem and a hierarchical decomposition strategy that divides the problem into smaller sub-problems amenable to parallel computing. In Bi-cADMM, this decomposition strategy is based on a two-phase approach. Initially, it performs a sample decomposition of the data and distributes local datasets across computational nodes. Subsequently, a delayed feature decomposition of the data is conducted on Graphics Processing Units (GPUs) available to each node. This methodology allows Bi-cADMM to undertake computationally intensive data-centric computations on GPUs, while CPUs handle more cost-effective computations. The proposed algorithm is implemented within an open-source Python package called Parallel Sparse Fitting Toolbox (PsFiT), which is publicly available. Finally, computational experiments demonstrate the efficiency and scalability of our algorithm through numerical benchmarks across various SML problems featuring distributed datasets.


title: Pros and cons of structural chirality measurements and computation of handedness in periodic solids

abstract: We compare the various chirality measures most widely used in the literature to quantify chiral symmetry in extended solids, i.e., the continuous chirality measure, the Hausdorff distance, and the angular momentum. By studying these functions in an algebraically tractable case, we can evaluate their strengths and weaknesses when applied to more complex crystals. Going beyond those classical calculations, we propose a new method to quantify the handedness of a crystal based on a pseudoscalar function, i.e., the helicity. This quantity, borrowed from hydrodynamics, can be computed from the eigenvector carrying the system from the high-symmetry non-chiral phase to the low-symmetry chiral phase. Different model systems like K$_3$NiO$_2$, CsCuCl$_3$ and MgTi$_2$O$_4$ are used as test cases where we show the superior interest of using helicity to quantify chirality together with the handedness distinction.


title: Pion gravitational form factors in the QCD instanton vacuum II

abstract: We revisit the hard QCD contributions to the pion gravitational form factors (GFFs), in terms of the twist-2,3 pion distribution amplitudes (DA), including novel semi-hard contributions from the instantons. The pion DAs are evaluated in the QCD instanton vacuum, and then properly evolved to higher resolution. The results are compared to our recent results from the QCD instanton vacuum, as well as Bethe-Salpeter calculations and recent lattice data. The interpolated hard and soft contributions to the pion D-form-factor, are used to derive the (gravitational) pressure and shear within the pion, with a clear delineation of their range.


title: Complexity of Multiple-Hamiltonicity in Graphs of Bounded Degree

abstract: We study the following generalization of the Hamiltonian cycle problem: Given integers $a,b$ and graph $G$, does there exist a closed walk in $G$ that visits every vertex at least $a$ times and at most $b$ times? Equivalently, does there exist a connected $[2a,2b]$ factor of $2b \cdot G$ with all degrees even? This problem is NP-hard for any constants $1 \leq a \leq b$. However, the graphs produced by known reductions have maximum degree growing linearly in $b$. The case $a = b = 1 $ -- i.e. Hamiltonicity -- remains NP-hard even in $3$-regular graphs; a natural question is whether this is true for other $a$, $b$. In this work, we study which $a, b$ permit polynomial time algorithms and which lead to NP-hardness in graphs with constrained degrees. We give tight characterizations for regular graphs and graphs of bounded max-degree, both directed and undirected.


title: The hierarchies of identities and closed products for multiple complexes

abstract: We consider infinite $\Z_\Z$-index complexes $\mathcal C$ of spaces with elements depending on a number of parameters, complete with respect to a linear associative regular inseparable multilinear product. The existence of nets of vanishing ideals of orders of and powers of differentials is assumed for subspaces of $\mathcal C$-spaces. In the polynomial case of orders and powers of the differentials, we derive the hierarchies of differential identities and closed multiple products. We prove that a set of maximal orders and powers for differentials, differential conditions, together with coherence conditions on indices of a complex $\mathcal C$ elements generate families of multi-graded differential algebras.


title: When simplicity meets effectiveness: Detecting code comments coherence with word embeddings and LSTM

abstract: Code comments play a crucial role in software development, as they provide programmers with practical information, allowing them to understand better the intent and semantics of the underpinning code. Nevertheless, developers tend to leave comments unchanged after updating the code, resulting in a discrepancy between the two artifacts. Such a discrepancy may trigger misunderstanding and confusion among developers, impeding various activities, including code comprehension and maintenance. Thus, it is crucial to identify if, given a code snippet, its corresponding comment is coherent and reflects well the intent behind the code. Unfortunately, existing approaches to this problem, while obtaining an encouraging performance, either rely on heavily pre-trained models, or treat input data as text, neglecting the intrinsic features contained in comments and code, including word order and synonyms. This work presents Co3D as a practical approach to the detection of code comment coherence. We pay attention to internal meaning of words and sequential order of words in text while predicting coherence in code-comment pairs. We deployed a combination of Gensim word2vec encoding and a simple recurrent neural network, a combination of Gensim word2vec encoding and an LSTM model, and CodeBERT. The experimental results show that Co3D obtains a promising prediction performance, thus outperforming well-established baselines. We conclude that depending on the context, using a simple architecture can introduce a satisfying prediction.


title: M$^3$GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generation

abstract: This paper presents M$^3$GPT, an advanced $\textbf{M}$ultimodal, $\textbf{M}$ultitask framework for $\textbf{M}$otion comprehension and generation. M$^3$GPT operates on three fundamental principles. The first focuses on creating a unified representation space for various motion-relevant modalities. We employ discrete vector quantization for multimodal control and generation signals, such as text, music and motion/dance, enabling seamless integration into a large language model (LLM) with a single vocabulary. The second involves modeling model generation directly in the raw motion space. This strategy circumvents the information loss associated with discrete tokenizer, resulting in more detailed and comprehensive model generation. Third, M$^3$GPT learns to model the connections and synergies among various motion-relevant tasks. Text, the most familiar and well-understood modality for LLMs, is utilized as a bridge to establish connections between different motion tasks, facilitating mutual reinforcement. To our knowledge, M$^3$GPT is the first model capable of comprehending and generating motions based on multiple signals. Extensive experiments highlight M$^3$GPT's superior performance across various motion-relevant tasks and its powerful zero-shot generalization capabilities for extremely challenging tasks.


title: A Topological Classification of Finite Chiral Structures using Complete Matchings

abstract: We present the theory and experimental demonstration of a topological classification of finite tight binding Hamiltonians with chiral symmetry. Using the graph-theoretic notion of complete matchings, we show that many chiral tight binding structures can be divided into a number of sections, each of which has independent topological phases. Hence the overall classification is $N\mathbb{Z}_2$, corresponding to $2^N$ distinct phases, where $N$ is the number of sections with a non-trivial $\mathbb{Z}_2$ classification. In our classification, distinct topological phases are separated by exact closures in the energy spectrum of the Hamiltonian, with degenerate pairs of zero energy states. We show that that these zero energy states have an unusual localisation across distinct regions of the structure, determined by the manner in which the sections are connected together. We use this localisation to provide an experimental demonstration of the validity of the classification, through radio frequency measurements on a coaxial cable network which maps onto a tight binding system. The structure we investigate is a cable analogue of an ideal graphene ribbon, which divides into four sections and has a $4\mathbb{Z}_2$ topological classification.


title: Assessing the Role of Communication in Scalable Multi-Core Quantum Architectures

abstract: Multi-core quantum architectures offer a solution to the scalability limitations of traditional monolithic designs. However, dividing the system into multiple chips introduces a critical bottleneck: communication between cores. This paper introduces qcomm, a simulation tool designed to assess the impact of communication on the performance of scalable multi-core quantum architectures. Qcomm allows users to adjust various architectural and physical parameters of the system, and outputs various communication metrics. We use qcomm to perform a preliminary study on how these parameters affect communication performance in a multi-core quantum system.


title: Mechanism Design for LLM Fine-tuning with Multiple Reward Models

abstract: Recent research on fine-tuning large language models (LLMs) through the aggregation of multiple preferences has attracted considerable attention. However, the existing literature predominantly focuses on the empirical performance of aggregation algorithms, while neglecting the underlying motivation for agents to misreport their preferences. In this paper, we formalize this as a multi-parameter mechanism design problem, where an LLM provider designs both training and payment rules to achieve specific objectives and promote the truthful reporting of preferences. Firstly, we claim the necessity of a payment scheme by demonstrating that without payments, truth-telling is a strictly dominated strategy under a wide range of training rules. Then, we introduce the affine maximizer payment scheme for the social welfare maximizing training rules that are widely used in practice, which ensures both dominant-strategy incentive compatibility (DSIC) and individual rationality (IR). Furthermore, we prove that under mild conditions, any other payment rule that also implements these training rules in DSIC can be converted to the affine maximizer payment by adding a factor irrelevant to the agents' own reports. We also show that this mechanism satisfies approximate DSIC when the input of the mechanism is a biased version of the reported preferences, showcasing its robustness in real-world applications.


title: Picturing Ambiguity: A Visual Twist on the Winograd Schema Challenge

abstract: Large Language Models (LLMs) have demonstrated remarkable success in tasks like the Winograd Schema Challenge (WSC), showcasing advanced textual common-sense reasoning. However, applying this reasoning to multimodal domains, where understanding text and images together is essential, remains a substantial challenge. To address this, we introduce WinoVis, a novel dataset specifically designed to probe text-to-image models on pronoun disambiguation within multimodal contexts. Utilizing GPT-4 for prompt generation and Diffusion Attentive Attribution Maps (DAAM) for heatmap analysis, we propose a novel evaluation framework that isolates the models' ability in pronoun disambiguation from other visual processing challenges. Evaluation of successive model versions reveals that, despite incremental advancements, Stable Diffusion 2.0 achieves a precision of 56.7% on WinoVis, only marginally surpassing random guessing. Further error analysis identifies important areas for future research aimed at advancing text-to-image models in their ability to interpret and interact with the complex visual world.


title: Generalized integration operators on analytic tent spaces

abstract: In this paper, the boundedness and compactness of generalized integration operators $T_g^{n,k}$ between different analytic tent spaces in the unit disc are completely characterized.


title: AI-Assisted Detector Design for the EIC (AID(2)E)

abstract: Artificial Intelligence is poised to transform the design of complex, large-scale detectors like the ePIC at the future Electron Ion Collider. Featuring a central detector with additional detecting systems in the far forward and far backward regions, the ePIC experiment incorporates numerous design parameters and objectives, including performance, physics reach, and cost, constrained by mechanical and geometric limits. This project aims to develop a scalable, distributed AI-assisted detector design for the EIC (AID(2)E), employing state-of-the-art multiobjective optimization to tackle complex designs. Supported by the ePIC software stack and using Geant4 simulations, our approach benefits from transparent parameterization and advanced AI features. The workflow leverages the PanDA and iDDS systems, used in major experiments such as ATLAS at CERN LHC, the Rubin Observatory, and sPHENIX at RHIC, to manage the compute intensive demands of ePIC detector simulations. Tailored enhancements to the PanDA system focus on usability, scalability, automation, and monitoring. Ultimately, this project aims to establish a robust design capability, apply a distributed AI-assisted workflow to the ePIC detector, and extend its applications to the design of the second detector (Detector-2) in the EIC, as well as to calibration and alignment tasks. Additionally, we are developing advanced data science tools to efficiently navigate the complex, multidimensional trade-offs identified through this optimization process.


title: Probing electric-dipole-enabled transitions in the excited state of the nitrogen-vacancy center in diamond

abstract: The excited orbitals of color centers typically show stronger electric dipoles, which can serve as a resource for entanglement, emission tuning, or electric field sensing. Here, we use resonant laser excitation to expose strong transition dipoles in the excited state (ES) orbitals of the negatively charged nitrogen vacancy center in diamond. By applying microwave electric fields, we perform strong Rabi driving between ES orbitals, and show that the dressed states can be tuned in frequency and are protected against fluctuations of the transverse electric field. In contrast with previous results, we observe sharp microwave resonances between magnetic states of the ES orbitals, and find that they are broadened due to simultaneous electric dipole driving.


title: ConStat: Performance-Based Contamination Detection in Large Language Models

abstract: Public benchmarks play an essential role in the evaluation of large language models. However, data contamination can lead to inflated performance, rendering them unreliable for model comparison. It is therefore crucial to detect contamination and estimate its impact on measured performance. Unfortunately, existing detection methods can be easily evaded and fail to quantify contamination. To overcome these limitations, we propose a novel definition of contamination as artificially inflated and non-generalizing benchmark performance instead of the inclusion of benchmark samples in the training data. This perspective enables us to detect any model with inflated performance, i.e., performance that does not generalize to rephrased samples, synthetic samples from the same distribution, or different benchmarks for the same task. Based on this insight, we develop ConStat, a statistical method that reliably detects and quantifies contamination by comparing performance between a primary and reference benchmark relative to a set of reference models. We demonstrate the effectiveness of ConStat in an extensive evaluation of diverse model architectures, benchmarks, and contamination scenarios and find high levels of contamination in multiple popular models including Mistral, Llama, Yi, and the top-3 Open LLM Leaderboard models.


title: Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language Models

abstract: As the use of Large Language Models (LLMs) becomes more widespread, understanding their self-evaluation of confidence in generated responses becomes increasingly important as it is integral to the reliability of the output of these models. We introduce the concept of Confidence-Probability Alignment, that connects an LLM's internal confidence, quantified by token probabilities, to the confidence conveyed in the model's response when explicitly asked about its certainty. Using various datasets and prompting techniques that encourage model introspection, we probe the alignment between models' internal and expressed confidence. These techniques encompass using structured evaluation scales to rate confidence, including answer options when prompting, and eliciting the model's confidence level for outputs it does not recognize as its own. Notably, among the models analyzed, OpenAI's GPT-4 showed the strongest confidence-probability alignment, with an average Spearman's $\hat{\rho}$ of 0.42, across a wide range of tasks. Our work contributes to the ongoing efforts to facilitate risk assessment in the application of LLMs and to further our understanding of model trustworthiness.


title: TURNIP: A "Nondeterministic" GPU Runtime with CPU RAM Offload

abstract: An obvious way to alleviate memory difficulties in GPU-based AI computing is via CPU offload, where data are moved between GPU and CPU RAM, so inexpensive CPU RAM is used to increase the amount of storage available. While CPU offload is an obvious idea, it can greatly slow down a computation, due to the relatively slow transfer rate between CPU RAM and GPU RAM. Thus, any system for CPU offload needs to ensure that when such a transfer needs to happen, no computation is blocked waiting for the transfer to finish. One of the key challenges when using CPU offload is that memory transfers introduce nondeterminacy into the system: it is not possible to know before runtime when the transfers will finish, and hence what is the best order of operations to run to ensure there is no blocking. In this paper, we describe TURNIP, which is a system for running AI computations using CPU offload. The key innovation in TURNIP is the compilation of the AI computation into a dependency graph that gives the TURNIP runtime freedom to run operations such as GPU kernel calls in many different orders; at runtime, TURNIP chooses the best order in response to real-time events.


title: Generating clickbait spoilers with an ensemble of large language models

abstract: Clickbait posts are a widespread problem in the webspace. The generation of spoilers, i.e. short texts that neutralize clickbait by providing information that satisfies the curiosity induced by it, is one of the proposed solutions to the problem. Current state-of-the-art methods are based on passage retrieval or question answering approaches and are limited to generating spoilers only in the form of a phrase or a passage. In this work, we propose an ensemble of fine-tuned large language models for clickbait spoiler generation. Our approach is not limited to phrase or passage spoilers, but is also able to generate multipart spoilers that refer to several non-consecutive parts of text. Experimental evaluation demonstrates that the proposed ensemble model outperforms the baselines in terms of BLEU, METEOR and BERTScore metrics.


title: ModelLock: Locking Your Model With a Spell

abstract: This paper presents a novel model protection paradigm ModelLock that locks (destroys) the performance of a model on normal clean data so as to make it unusable or unextractable without the right key. Specifically, we proposed a diffusion-based framework dubbed ModelLock that explores text-guided image editing to transform the training data into unique styles or add new objects in the background. A model finetuned on this edited dataset will be locked and can only be unlocked by the key prompt, i.e., the text prompt used to transform the data. We conduct extensive experiments on both image classification and segmentation tasks, and show that 1) ModelLock can effectively lock the finetuned models without significantly reducing the expected performance, and more importantly, 2) the locked model cannot be easily unlocked without knowing both the key prompt and the diffusion model. Our work opens up a new direction for intellectual property protection of private models.


title: Generation of synthetic data using breast cancer dataset and classification with resnet18

abstract: Since technology is advancing so quickly in the modern era of information, data is becoming an essential resource in many fields. Correct data collection, organization, and analysis make it a potent tool for successful decision-making, process improvement, and success across a wide range of sectors. Synthetic data is required for a number of reasons, including the constraints of real data, the expense of collecting labeled data, and privacy and security problems in specific situations and domains. For a variety of reasons, including security, ethics, legal restrictions, sensitivity and privacy issues, and ethics, synthetic data is a valuable tool, particularly in the health sector. A deep learning model called GAN (Generative Adversarial Networks) has been developed with the intention of generating synthetic data. In this study, the Breast Histopathology dataset was used to generate malignant and negatively labeled synthetic patch images using MSG-GAN (Multi-Scale Gradients for Generative Adversarial Networks), a form of GAN, to aid in cancer identification. After that, the ResNet18 model was used to classify both synthetic and real data via Transfer Learning. Following the investigation, an attempt was made to ascertain whether the synthetic images behaved like the real data or if they are comparable to the original data.


title: LoGAH: Predicting 774-Million-Parameter Transformers using Graph HyperNetworks with 1/100 Parameters

abstract: A good initialization of deep learning models is essential since it can help them converge better and faster. However, pretraining large models is unaffordable for many researchers, which makes a desired prediction for initial parameters more necessary nowadays. Graph HyperNetworks (GHNs), one approach to predicting model parameters, have recently shown strong performance in initializing large vision models. Unfortunately, predicting parameters of very wide networks relies on copying small chunks of parameters multiple times and requires an extremely large number of parameters to support full prediction, which greatly hinders its adoption in practice. To address this limitation, we propose LoGAH (Low-rank GrAph Hypernetworks), a GHN with a low-rank parameter decoder that expands to significantly wider networks without requiring as excessive increase of parameters as in previous attempts. LoGAH allows us to predict the parameters of 774-million large neural networks in a memory-efficient manner. We show that vision and language models (i.e., ViT and GPT-2) initialized with LoGAH achieve better performance than those initialized randomly or using existing hypernetworks. Furthermore, we show promising transfer learning results w.r.t. training LoGAH on small datasets and using the predicted parameters to initialize for larger tasks. We provide the codes in https://github.com/Blackzxy/LoGAH .


title: Generating configurations of increasing lattice size with machine learning and the inverse renormalization group

abstract: We review recent developments of machine learning algorithms pertinent to the inverse renormalization group, which was originally established as a generative numerical method by Ron-Swendsen-Brandt via the implementation of compatible Monte Carlo simulations. Inverse renormalization group methods enable the iterative generation of configurations for increasing lattice size without the critical slowing down effect. We discuss the construction of inverse renormalization group transformations with the use of convolutional neural networks and present applications in models of statistical mechanics, lattice field theory, and disordered systems. We highlight the case of the three-dimensional Edwards-Anderson spin glass, where the inverse renormalization group can be employed to construct configurations for lattice volumes that have not yet been accessed by dedicated supercomputers.

categories: hep-lat cond-mat.dis-nn cond-mat.stat-mech cs.LG


title: Intensity adaptive optics

abstract: Adaptive optics (AO) is a powerful tool used in a wide range of research areas spanning from aerospace to microscopy. To date, AO has largely been applied to optical phase aberration correction, with recent advances extending to include the vectorial properties of light. However, intensity errors widely exist in optical systems, yet their associated correction methods are still very much in their infancy. Here, we propose a new adaptive optics method that is termed intensity adaptive optics (I-AO), which features a dual-feedback loop for intensity aberration correction that addresses both intensity uniformity and the overall intensity. We demonstrate that I-AO can operate in both sensor-based and sensorless regimes and validate its feasibility by quantitatively analysing the quality of the focus of an aberrated optical system. This technique expands the AO toolkit, broadens its scope of application, and opens a new avenue for next-generation AO innovations.


title: An innovative quarkonium model and its applications to fermion-antifermion systems

abstract: Understanding the behavior of quark-antiquark ($q\overline{q}$) pairs holds significant importance in modern physics. Governed by the strong force, these systems demonstrate intricate interactions vital for comprehending particle physics and natural forces. The current study introduces a unique theoretical model utilizing the many-body Dirac equation in an effective position-dependent mass setting (i.e., $m\rightarrow m(r)$). To demonstrate the robustness of our model, we show that by modifying the mass with a Coulomb-like potential, $m(r)=m-\alpha/r$, our results precisely align with the well-established energy eigenvalues for fermion-antifermion pairs interacting through the Coulomb potential, without resorting to any approximation. Subsequently, by selecting adjustments rooted in the Cornell potential, we derive a closed-form energy spectrum for quarkonium systems under the influence of an external magnetic field. Our analysis thoroughly explores the characteristics of quarkonium states with magnetic field effects. We believe that this distinctive model holds the potential to offer vital insights into the dynamics of $q\overline{q}$ pairs, encompassing their interactions and potential applications in particle physics. Moreover, it could extend its utility to various fermion-antifermion systems, such as positronium, relativistic Landau levels for neutral mesons, excitons in monolayer transitional metal dichalcogenides, and Weyl pairs in monolayer graphene sheets.


title: Transparent boundary condition and its high frequency approximation for the Schr\"odinger equation on a rectangular computational domain

abstract: This paper addresses the numerical implementation of the transparent boundary condition (TBC) and its various approximations for the free Schr\"odinger equation on a rectangular computational domain. In particular, we consider the exact TBC and its spatially local approximation under high frequency assumption along with an appropriate corner condition. For the spatial discretization, we use a Legendre-Galerkin spectral method where Lobatto polynomials serve as the basis. Within variational formalism, we first arrive at the time-continuous dynamical system using spatially discrete form of the initial boundary-value problem incorporating the boundary conditions. This dynamical system is then discretized using various time-stepping methods, namely, the backward-differentiation formula of order 1 and 2 (i.e., BDF1 and BDF2, respectively) and the trapezoidal rule (TR) to obtain a fully discrete system. Next, we extend this approach to the novel Pad\'e based implementation of the TBC presented by Yadav and Vaibhav [arXiv:2403.07787(2024)]. Finally, several numerical tests are presented to demonstrate the effectiveness of the boundary maps (incorporating the corner conditions) where we study the stability and convergence behavior empirically.


title: A Simulation Study of Source Routing for Load Balancing in Software-Defined Satellite Networks

abstract: In the next generation network, the satellite network will play a fundamental role, in overcoming the limitation of the terrestrial network. Nonetheless, the satellite-terrestrial network integration presents a number of problems due to the time-variant topology of the first. One of the most important is the routing process of such networks. Many solutions have been proposed in the literature since the 1990s, and in recent years, the development of modern technologies such as Software Defined Networking (SDN) led to new possible approaches to the routing of satellite network. In this paper, a graph-based, source routing algorithm is presented. The algorithm exploits reliability and flexibility of the SDN architecture and the simplicity of source routing to tackle the dynamic topology of the network, providing rerouting solutions when necessary.


title: Charm physics at the Belle and Belle II experiments

abstract: We present recent results on charm physics at the Belle and Belle II experiments, covering measurements of charm lifetimes, branching fractions of the decays of charmed mesons and baryons and the decay asymmetry parameters of two-body decays of charmed baryons, searches for rare and forbidden decays, and measurements of $C\!P$ violating parameters in the four-body decays of charmed mesons and two-body decays of charmed baryons.


title: Nonclassical characteristics in spin-1/2 Heisenberg XYZ model with added DM and KSEA interactions under sinusoidal magnetic field: Hierarchy of quantum resources

abstract: We investigate the behavior of various measures of quantum coherence and quantum correlation in the spin-1/2 Heisenberg XYZ model with added Dzyaloshinsky-Moriya (DM) and Kaplan--Shekhtman--Entin-Wohlman--Aharony (KSEA) interactions at a thermal regime described by a Gibbs density operator. We aim to understand the restricted hierarchical classification of different quantum resources, where quantum coherence $\supseteq$ quantum discord $\supseteq$ quantum entanglement $\supseteq$ quantum steering $\supseteq$ Bell nonlocality. In order to enhance quantum coherence, quantum correlation, and fidelity of teleportation, our analysis encompasses the effects of independently provided sinusoidal magnetic field control as well as DM and KSEA interactions on the considered system. The results reveal that enhancing the entanglement or quantum correlation of the channel does not always guarantee successful teleportation or even an improvement in teleportation fidelity. Thus, the relationship between teleportation fidelity and the channel's underlying quantum properties is intricate. Our study provides valuable insights into the complex interplay of quantum coherence and correlation hierarchy, offering potential applications for quantum communication and information processing technologies.


title: Comparative Analysis of Open-Source Language Models in Summarizing Medical Text Data

abstract: Unstructured text in medical notes and dialogues contains rich information. Recent advancements in Large Language Models (LLMs) have demonstrated superior performance in question answering and summarization tasks on unstructured text data, outperforming traditional text analysis approaches. However, there is a lack of scientific studies in the literature that methodically evaluate and report on the performance of different LLMs, specifically for domain-specific data such as medical chart notes. We propose an evaluation approach to analyze the performance of open-source LLMs such as Llama2 and Mistral for medical summarization tasks, using GPT-4 as an assessor. Our innovative approach to quantitative evaluation of LLMs can enable quality control, support the selection of effective LLMs for specific tasks, and advance knowledge discovery in digital health.


title: Neural Network-Based Tracking and 3D Reconstruction of Baseball Pitch Trajectories from Single-View 2D Video

abstract: In this paper, we present a neural network-based approach for tracking and reconstructing the trajectories of baseball pitches from 2D video footage to 3D coordinates. We utilize OpenCV's CSRT algorithm to accurately track the baseball and fixed reference points in 2D video frames. These tracked pixel coordinates are then used as input features for our neural network model, which comprises multiple fully connected layers to map the 2D coordinates to 3D space. The model is trained on a dataset of labeled trajectories using a mean squared error loss function and the Adam optimizer, optimizing the network to minimize prediction errors. Our experimental results demonstrate that this approach achieves high accuracy in reconstructing 3D trajectories from 2D inputs. This method shows great potential for applications in sports analysis, coaching, and enhancing the accuracy of trajectory predictions in various sports.


title: LUCIE: A Lightweight Uncoupled ClImate Emulator with long-term stability and physical consistency for O(1000)-member ensembles

abstract: We present LUCIE, a $1000$- member ensemble data-driven atmospheric emulator that remains stable during autoregressive inference for thousands of years without a drifting climatology. LUCIE has been trained on $9.5$ years of coarse-resolution ERA5 data with $4$ prognostic variables on a single A100 GPU for $2.4$ h. Owing to the cheap computational cost of inference, $1000$ model ensembles are executed for $5$ years to compute an uncertainty-quantified climatology for the prognostic variables that closely match the climatology obtained from ERA5. Unlike all the other state-of-the-art AI weather models, LUCIE is neither unstable nor does it produce hallucinations that result in unphysical drift of the emulated climate. Furthermore, LUCIE \textbf{does not impose} ``true" sea-surface temperature (SST) from a coupled numerical model to enforce the annual cycle in temperature. We demonstrate the long-term climatology obtained from LUCIE as well as subseasonal-to-seasonal scale prediction skills on the prognostic variables. We also demonstrate a $20$-year emulation with LUCIE here: https://drive.google.com/file/d/1mRmhx9RRGiF3uGo_mRQK8RpwQatrCiMn/view


title: Fast Emulation and Modular Calibration for Simulators with Functional Response

abstract: Scalable surrogate models enable efficient emulation of computer models (or simulators), particularly when dealing with large ensembles of runs. While Gaussian Process (GP) models are commonly employed for emulation, they face limitations in scaling to truly large datasets. Furthermore, when dealing with dense functional output, such as spatial or time-series data, additional complexities arise, requiring careful handling to ensure fast emulation. This work presents a highly scalable emulator for functional data, building upon the works of Kennedy and O'Hagan (2001) and Higdon et al. (2008), while incorporating the local approximate Gaussian Process framework proposed by Gramacy and Apley (2015). The emulator utilizes global GP lengthscale parameter estimates to scale the input space, leading to a substantial improvement in prediction speed. We demonstrate that our fast approximation-based emulator can serve as a viable alternative to the methods outlined in Higdon et al. (2008) for functional response, while drastically reducing computational costs. The proposed emulator is applied to quickly calibrate the multiphysics continuum hydrodynamics simulator FLAG with a large ensemble of 20000 runs. The methods presented are implemented in the R package FlaGP.


title: Forward modeling fluctuations in the DESI LRGs target sample using image simulations

abstract: We use the forward modeling pipeline, Obiwan, to study the imaging systematics of the Luminous Red Galaxies (LRGs) targeted by the Dark Energy Spectroscopic Instrument (DESI). We update the Obiwan pipeline, which had previously been developed to simulate the optical images used to target DESI data, to further simulate WISE images in the infrared. This addition makes it possible to simulate the DESI LRGs sample, which utilizes WISE data in the target selection. Deep DESI imaging data combined with a method to account for biases in their shapes is used to define a truth sample of potential LRG targets. We simulate a total of 15 million galaxies to obtain a simulated LRG sample (Obiwan LRGs) that predicts the variations in target density due to imaging properties. We find that the simulations predict the trends with depth observed in the data, including how they depend on the intrinsic brightness of the galaxies. We observe that faint LRGs are the main contributing power of the imaging systematics trend induced by depth. We also find significant trends in the data against Galactic extinction that are not predicted by Obiwan. These trends depend strongly on the particular map of Galactic extinction chosen to test against, implying Large-Scale Structure systematic contamination (e.g. Cosmic-Infrared Background) in the Galactic extinction maps is a likely root cause. We additionally observe that the DESI LRGs sample exhibits a complex dependency on a combination of seeing, depth, and intrinsic galaxy brightness, which is not replicated by Obiwan, suggesting discrepancies between the current simulation settings and the actual observations. The detailed findings we present should be used to guide any observational systematics mitigation treatment for the clustering of the DESI LRG sample.


title: Dirac fermions with electric dipole moment and position-dependent mass in the presence of a magnetic field generated by magnetic monopoles

abstract: In this paper, we determine the bound-state solutions for Dirac fermions with electric dipole moment (EDM) and position-dependent mass (PDM) in the presence of a radial magnetic field generated by magnetic monopoles. To achieve this, we work with the (2+1)-dimensional (DE) Dirac equation with nonminimal coupling in polar coordinates. Posteriorly, we obtain a second-order differential equation via quadratic DE (simplified by a similarity transformation). Solving this differential equation through a change of variable and the asymptotic behavior, we obtain a generalized Laguerre equation. From this, we obtain the bound-state solutions of the system, given by the two-component Dirac spinor and by the relativistic energy spectrum. So, we note that such spinor is written in terms of the generalized Laguerre polynomials, and such spectrum (for a fermion and an antifermion) is quantized in terms of the radial and total magnetic quantum numbers $n$ and $m_j$, and explicitly depends on the EDM $d$, PDM parameter $\kappa$, magnetic charge density $\lambda_m$, and on the spinorial parameter $s$. In particular, the quantization is a direct result of the existence of $\kappa$ (i.e., $\kappa$ acts as a kind of ``external field or potential''). Besides, we discuss in detail the characteristics of the spectrum as well as graphically analyze the behavior of the spectrum as a function of $\kappa$ and $\lambda_m$ for three different values of $n$ (ground state and the first two excited states).


title: Active Learning for Finely-Categorized Image-Text Retrieval by Selecting Hard Negative Unpaired Samples

abstract: Securing a sufficient amount of paired data is important to train an image-text retrieval (ITR) model, but collecting paired data is very expensive. To address this issue, in this paper, we propose an active learning algorithm for ITR that can collect paired data cost-efficiently. Previous studies assume that image-text pairs are given and their category labels are asked to the annotator. However, in the recent ITR studies, the importance of category label is decreased since a retrieval model can be trained with only image-text pairs. For this reason, we set up an active learning scenario where unpaired images (or texts) are given and the annotator provides corresponding texts (or images) to make paired data. The key idea of the proposed AL algorithm is to select unpaired images (or texts) that can be hard negative samples for existing texts (or images). To this end, we introduce a novel scoring function to choose hard negative samples. We validate the effectiveness of the proposed method on Flickr30K and MS-COCO datasets.


title: Conformal currents and the entropy of negatively curved three-manifolds

abstract: In this paper, we describe the intersection between geodesic and conformal currents on closed hyperbolic three-manifolds. We use this to prove some sharp bounds which involve the Liouville entropy of a negatively curved metric, the minimal surface entropy, and the area ratio. Using these ideas we also give a new proof of the Mostow Rigidity Theorem in the three-dimensional case.


title: Extended spin relaxation times of optically addressed telecom defects in silicon carbide

abstract: Optically interfaced solid-state defects are promising candidates for quantum communication technologies. The ideal defect system would feature bright telecom emission, long-lived spin states, and a scalable material platform, simultaneously. Here, we employ one such system, vanadium (V4+) in silicon carbide (SiC), to establish a potential telecom spin-photon interface within a mature semiconductor host. This demonstration of efficient optical spin polarization and readout facilitates all optical measurements of temperature-dependent spin relaxation times (T1). With this technique, we lower the temperature from about 2K to 100 mK to observe a remarkable four-orders-of-magnitude increase in spin T1 from all measured sites, with site-specific values ranging from 57 ms to above 27 s. Furthermore, we identify the underlying relaxation mechanisms, which involve a two-phonon Orbach process, indicating the opportunity for strain-tuning to enable qubit operation at higher temperatures. These results position V4+ in SiC as a prime candidate for scalable quantum nodes in future quantum networks.


title: Federated Unsupervised Domain Generalization using Global and Local Alignment of Gradients

abstract: We address the problem of federated domain generalization in an unsupervised setting for the first time. We first theoretically establish a connection between domain shift and alignment of gradients in unsupervised federated learning and show that aligning the gradients at both client and server levels can facilitate the generalization of the model to new (target) domains. Building on this insight, we propose a novel method named FedGaLA, which performs gradient alignment at the client level to encourage clients to learn domain-invariant features, as well as global gradient alignment at the server to obtain a more generalized aggregated model. To empirically evaluate our method, we perform various experiments on four commonly used multi-domain datasets, PACS, OfficeHome, DomainNet, and TerraInc. The results demonstrate the effectiveness of our method which outperforms comparable baselines. Ablation and sensitivity studies demonstrate the impact of different components and parameters in our approach. The source code will be available online upon publication.


title: Efficiently Parameterized Neural Metriplectic Systems

abstract: Metriplectic systems are learned from data in a way that scales quadratically in both the size of the state and the rank of the metriplectic data. Besides being provably energy conserving and entropy stable, the proposed approach comes with approximation results demonstrating its ability to accurately learn metriplectic dynamics from data as well as an error estimate indicating its potential for generalization to unseen timescales when approximation error is low. Examples are provided which illustrate performance in the presence of both full state information as well as when entropic variables are unknown, confirming that the proposed approach exhibits superior accuracy and scalability without compromising on model expressivity.


title: Magnetic field effect on hadron yield ratios and fluctuations in hadron resonance gas

abstract: We study the influence of an external magnetic field on hadron yields and fluctuations in a hadron resonance gas by performing calculations within an updated version of the open-source Thermal-FIST package. The presence of the magnetic field has a sizable influence on certain hadron yield ratios. Most notably, it leads to enhanced $ p/pi$ and suppressed $n/p$ ratios, which may serve as a magnetometer in heavy-ion collisions. By attributing the centrality dependence of the $p/\pi$ ratio in Pb-Pb collisions at 5.02 TeV measured by the ALICE Collaboration entirely to the magnetic field, we estimate its maximal strength at freeze-out to be $eB \simeq 0.12$~GeV$^2 \simeq 6.3 m_\pi^2$ in peripheral collisions. The magnetic field also enhances various conserved charge susceptibilities, which is qualitatively consistent with recent lattice QCD data and is driven in the HRG model by the increase of hadron densities. However, the variances of hadrons do not show any enhancement when normalized by the means, therefore, measurements of second-order fluctuations in heavy-ion collisions do not appear to offer additional information about the magnetic field relative to mean multiplicities.


title: The strain-stress relationships for coherent in-plane strain in heterostructures with monoclinic crystal systems: $\beta$-(Al$_x$Ga$_{1-x}$)$_2$O$_3$ on $(h0l)$ $\beta$-Ga$_2$O$_3$ as example

abstract: In this work we derive the state of strain or stress under symmetry conserving conditions in pseudomorphic lattices with monoclinic symmetry. We compare surface vectors across the template epitaxial layer interface and impose conditions of a stress free epitaxial layer. As a result, we demonstrate the existence, in theory, of exactly three possible unit cells which can establish onto a given template. We demonstrate this approach for a class of templates with $(h0l)$ planes and $\beta$-(Al$_x$Ga$_{1-x}$)$_2$O$_3$ on $(h0l)$ $\beta$-Ga$_2$O$_3$. We discuss the effects of composition $x$ and surface orientation onto the formation of three elastically stable unit cells, their strain and stress tensors, unit cell axes, unit cell volumes, lattice spacing, elastic potential energies, and stress free directions. The previous paradigm for epitaxial layer growth where the stress free direction is always perpendicular to the growing surface is not generally valid for low symmetry materials. In the example here, we find two possible competing domains with stress free direction oblique to the surface of the template for almost all planes $(h0l)$. We calculate the band-to-band transitions for $\beta$-(Al$_{0.1}$Ga$_{0.9}$)$_2$O$_3$ on $(h0l)$ $\beta$-Ga$_2$O$_3$ using the composition dependent deformation parameters and elastic coefficients reported prevoiously [Korlacki~\textit{et al.} Phys. Rev. Appl.~\textbf{18}, 064019 (2022)].


title: n-th Root Optimal Rational Approximants to Functions with Polar Singular Set

abstract: Let $ D $ be a bounded Jordan domain and $ A $ be its complement on the Riemann sphere. We investigate the $ n $-th root asymptotic behavior in $ D $ of best rational approximants, in the uniform norm on $ A $, to functions holomorphic on $ A $ having a multi-valued continuation to quasi every point of $ D $ with finitely many branches. More precisely, we study weak$^*$ convergence of the normalized counting measures of the poles of such approximants as well as their convergence in capacity. We place best rational approximants into a larger class of $ n $-th root optimal meromorphic approximants, whose behavior we investigate using potential-theory on certain compact bordered Riemann surfaces.


title: Mitigation of self-generated RFI using ASKAP's phased array feeds

abstract: This paper presents the effects of radio frequency interference (RFI) mitigation on a radio telescope's sensitivity and beam pattern. It specifically explores the impact of subspace-projection mitigation on the phased array feed (PAF) beams of the Australian SKA Pathfinder (ASKAP) telescope. The goal is to demonstrate ASKAP's ability to make science observations during active RFI mitigation. The target interfering signal is a self-generated clock signal from the digital receivers of ASKAP's PAFs. This signal is stationary, so we apply the mitigation projection to the beamformer weights at the beginning of the observation and hold them fixed. We suppressed the unwanted narrowband signal by 31dB, to the noise floor of an 880s integration on one antenna, with a typical degradation in sensitivity of just 1.5%. Sensitivity degradation over the whole 36 antenna array of 3.1% was then measured via interferometric assessment of system equivalent flux density (SEFD). These measurements are in line with theoretical calculation of noise increase using the correlation of the beam weights and RFI spatial signature. Further, degradation to the main beam's gain is 0.4% on average at the half-power point, with no significant change to the gain in the first sidelobe and no variation during extended observations; also consistent with our modelling. In summary, we present the first demonstration of mitigation via spatial nulling with PAFs on a large aperture synthesis array telescope and assess impact on sensitivity and beam shape via SEFD and holography measurements. The mitigation introduces smaller changes to sensitivity than intrinsic sensitivity differences between beams, does not preclude high dynamic range imaging and, in continuum 1MHz mode, recovers an otherwise corrupted holography beam map and usable astronomical source correlations in the RFI-affected channel.


title: An Empirical Exploration of Trust Dynamics in LLM Supply Chains

abstract: With the widespread proliferation of AI systems, trust in AI is an important and timely topic to navigate. Researchers so far have largely employed a myopic view of this relationship. In particular, a limited number of relevant trustors (e.g., end-users) and trustees (i.e., AI systems) have been considered, and empirical explorations have remained in laboratory settings, potentially overlooking factors that impact human-AI relationships in the real world. In this paper, we argue for broadening the scope of studies addressing `trust in AI' by accounting for the complex and dynamic supply chains that AI systems result from. AI supply chains entail various technical artifacts that diverse individuals, organizations, and stakeholders interact with, in a variety of ways. We present insights from an in-situ, empirical study of LLM supply chains. Our work reveals additional types of trustors and trustees and new factors impacting their trust relationships. These relationships were found to be central to the development and adoption of LLMs, but they can also be the terrain for uncalibrated trust and reliance on untrustworthy LLMs. Based on these findings, we discuss the implications for research on `trust in AI'. We highlight new research opportunities and challenges concerning the appropriate study of inter-actor relationships across the supply chain and the development of calibrated trust and meaningful reliance behaviors. We also question the meaning of building trust in the LLM supply chain.


title: Understanding Stakeholders' Perceptions and Needs Across the LLM Supply Chain

abstract: Explainability and transparency of AI systems are undeniably important, leading to several research studies and tools addressing them. Existing works fall short of accounting for the diverse stakeholders of the AI supply chain who may differ in their needs and consideration of the facets of explainability and transparency. In this paper, we argue for the need to revisit the inquiries of these vital constructs in the context of LLMs. To this end, we report on a qualitative study with 71 different stakeholders, where we explore the prevalent perceptions and needs around these concepts. This study not only confirms the importance of exploring the ``who'' in XAI and transparency for LLMs, but also reflects on best practices to do so while surfacing the often forgotten stakeholders and their information needs. Our insights suggest that researchers and practitioners should simultaneously clarify the ``who'' in considerations of explainability and transparency, the ``what'' in the information needs, and ``why'' they are needed to ensure responsible design and development across the LLM supply chain.


title: Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting

abstract: State Space Models (SSMs) have emerged as a potent tool in sequence modeling tasks in recent years. These models approximate continuous systems using a set of basis functions and discretize them to handle input data, making them well-suited for modeling time series data collected at specific frequencies from continuous systems. Despite its potential, the application of SSMs in time series forecasting remains underexplored, with most existing models treating SSMs as a black box for capturing temporal or channel dependencies. To address this gap, this paper proposes a novel theoretical framework termed Dynamic Spectral Operator, offering more intuitive and general guidance on applying SSMs to time series data. Building upon our theory, we introduce Time-SSM, a novel SSM-based foundation model with only one-seventh of the parameters compared to Mamba. Various experiments validate both our theoretical framework and the superior performance of Time-SSM.


title: On the problem of Kakeya

abstract: We discuss a form of a well-known problem of Kakeya for complex polynomials. Let p(z) be a complex polynomial. This problem requires to find disc that contains n zeros of some derivative of p(z), provided that location of several zeros of p(z) is known. We find a disc that contains a zero of (k-1)-th derivative, if we know disc that contains k zeros of p(z). This result can be regarded as an extension of the Grace-Heawood theorem where k=2.


title: Threat Analysis of Industrial Internet of Things Devices

abstract: As part of the Internet of Things, industrial devices are now also connected to cloud services. However, the connection to the Internet increases the risks for Industrial Control Systems. Therefore, a threat analysis is essential for these devices. In this paper, we examine Industrial Internet of Things devices, identify and rank different sources of threats and describe common threats and vulnerabilities. Finally, we recommend a procedure to carry out a threat analysis on these devices.


title: Classical dynamics of the antiferromagnetic Heisenberg $S=1/2$ spin ladder

abstract: We employ a classical limit grounded in SU(4) coherent states to investigate the temperature-dependent dynamical spin structure factor of the $S = 1/2$ ladder consisting of weakly coupled dimers. By comparing the outcomes of this classical approximation with density matrix renormalization group and exact diagonalization calculations in finite size ladders, we demonstrate that the classical dynamics offers an accurate approximation across the entire temperature range when the interdimer coupling is weak and a good approximation in the high temperature regime even when the interdimer coupling is strong. This agreement is achieved after appropriately rescaling the temperature axis and renormalizing expectation values to satisfy a quantum sum rule, following D. Dahlbom et al. [Phys. Rev. B 109, 014427 (2024)]. We anticipate the method will be particularly effective when applied to 2D and 3D lattices composed of weakly-coupled dimers, situations that remain challenging for alternative numerical methods.


title: Search for reactor-produced millicharged particles with Skipper-CCDs at the CONNIE and Atucha-II experiments

abstract: Millicharged particles, proposed by various extensions of the standard model, can be created in pairs by high-energy photons within nuclear reactors and can interact electromagnetically with electrons in matter. Recently, the existence of a plasmon peak in the interaction cross-section with silicon in the eV range was highlighted as a promising approach to enhance low-energy sensitivities. The CONNIE and Atucha-II reactor neutrino experiments utilize Skipper-CCD sensors, which enable the detection of interactions in the eV range. We present world-leading limits on the charge of millicharged particles within a mass range spanning six orders of magnitude, derived through a comprehensive analysis and the combination of data from both experiments.


title: Delayed Gravitational Collapse of Attractive Colloidal Suspensions

abstract: Colloidal gels have strong industrial relevance as they can behave liquid- and solid-like. The latter allows them to support the buoyant weight against gravity. However, the system is intrinsically out-of-equilibrium, which means that the colloids must eventually settle out of the suspension. The process of settling has been captured theoretically, but the presence of a delay time during which the gel appears relatively unaffected by gravity has not. Here, we modify existing frameworks to capture this delay, by treating the gel as a continuum with viscoelastic response that is based on the local bond density. We can solve our model numerically to obtain the evolution of the colloid density profile and recover qualitatively the accumulation of a dense layer on top of the settling gel, as is experimentally observed in depletion gels. This numerical study is complemented by a theoretical analysis that allows us to identify an emergent time and length scale that set the dynamics of the gel. Our model provides a solid foundation for future studies that incorporate hydrodynamic erosion and tackle industrially relevant geometries.


title: Analyzing the Attack Surface and Threats of Industrial Internet of Things Devices

abstract: The growing connectivity of industrial devices as a result of the Internet of Things is increasing the risks to Industrial Control Systems. Since attacks on such devices can also cause damage to people and machines, they must be properly secured. Therefore, a threat analysis is required in order to identify weaknesses and thus mitigate the risk. In this paper, we present a systematic and holistic procedure for analyzing the attack surface and threats of Industrial Internet of Things devices. Our approach is to consider all components including hardware, software and data, assets, threats and attacks throughout the entire product life cycle.


title: The complete Pick property for pairs of kernels and Shimorin's factorization

abstract: Let $(\mathcal{H}_k, \mathcal{H}_{\ell})$ be a pair of Hilbert function spaces with kernels $k, \ell$. In a 2005 paper, Shimorin showed that a certain factorization condition on $(k, \ell)$ yields a commutant lifting theorem for multipliers $\mathcal{H}_k\to\mathcal{H}_{\ell}$, thus unifying and extending previous results due to Ball-Trent-Vinnikov and Volberg-Treil. Our main result is a strong converse to Shimorin's theorem for a large class of holomorphic pairs $(k, \ell),$ which leads to a full characterization of the complete Pick property for such pairs. We also present a short alternative proof of sufficiency for Shimorin's condition. Finally, we establish necessary conditions for abstract pairs $(k, \ell)$ to satisfy the complete Pick property, further generalizing Shimorin's work with proofs that are new even in the single-kernel case $k=\ell.$ Our approach differs from Shimorin's in that we do not work with the Nevanlinna-Pick problem directly; instead, we are able to extract vital information for $(k, \ell)$ through Carath\'eodory-Fej\'er interpolation.


title: An extension of the $\rho$-operator radii

abstract: We define a function on the $C^{\ast}$-algebra of all bounded linear Hilbert space operators, which generalizes the operator radii, and we present some basic properties of this function. Our results extend several results in the literature.


title: On the Definition of Velocity in Discrete-Time, Stochastic Langevin Simulations

abstract: We systematically develop beneficial and practical velocity measures for accurate and efficient statistical simulations of the Langevin equation with direct applications to computational statistical mechanics and molecular dynamics sampling. Recognizing that the existing velocity measures for the most statistically accurate discrete-time Verlet-type algorithms are inconsistent with the simulated configurational coordinate, we seek to create and analyze new velocity companions that both improve existing methods as well as offer practical options for implementation in existing computer codes. The work is based on the set of GJ methods that, of all methods, for all time steps within the stability criteria correctly reproduces the most basic statistical features of a Langevin system; namely correct Boltzmann distribution for harmonic potentials and correct transport in the form of drift and diffusion for linear potentials. Several new accompanying velocities exhibiting correct drift are identified, and we expand on an earlier conclusion that only half-step velocities can exhibit correct, time-step independent Maxwell-Boltzmann distributions. Specific practical and efficient algorithms are given in familiar forms, and these are used to numerically validate the analytically derived expectations.


title: Circuit Implementation and Analysis of a Quantum-Walk Based Search Complement Algorithm

abstract: We propose a modified version of the quantum walk-based search algorithm created by Shenvi, Kempe and Whaley, also known as the SKW algorithm. In our version of the algorithm, we modified the evolution operator of the system so that it is composed by the product of the shift operator associated to the $2^n$-complete graph with self-loops and a perturbed coin operator based on the Hadamard operator that works as an oracle for the search. The modified evolution operator leads the opposite behavior as in the original algorithm, that is, the probability to measure the target state is reduced. We call this new behavior the $\textit{search complement}$. Taking a multigraph and matrix approach, we were able to explain that the new algorithm decreases the probability of the target state given that there are less paths that lead towards the node that is associated to the target state in a Unitary Coined Discrete-Time Quantum Walk. The search complement algorithm was executed experimentally on IBM quantum processor $\textit{ibmq_manila}$ obtaining statistical distances $\ell_1\leq 0.0895$ when decreasing the probability of one state out of four.


title: Discharge mitigation methods in MPGD-based detectors

abstract: This work reviews various methods used to minimize the probability of discharge occurrence in MPGDs or to mitigate the effect of spark discharges on the detector system. These include techniques that can reduce the probability that the fundamental discharge limits of MPGD structures are reached during detector operation, methods based on the HV scheme optimisation, or the implementation of resistive electrodes to enhance local discharge quenching capabilities in an amplification structure. In addition, design optimization and quality control methods to ensure stable, long-term operation of an MPGD-based detector, are considered.


title: Localization of $q$-form field on squared curvature gravity domain wall brane coupling with gravity and background scalar

abstract: In this paper, we investigate a $q$-form field, represented as $\displaystyle X_{M_1M_2...M_q}$, where $\displaystyle q$ indicates the number of indices, with special cases $\displaystyle q = 0, 1, 2$ corresponding to the scalar fields, vector fields, and Kalb-Ramond fields, respectively. Unlike the duality observed between scalar and vector fields in four-dimensional spacetime, $q$-form fields in higher dimensions correspond to a wider array of particles. We propose a novel localized Kaluza-Klein decomposition approach for the $q$-form field in a five-dimensional spacetime, considering its coupling with gravity and background scalar fields. This methodology enables the successful localization of the $q$-form field on a domain wall brane, leading to the derivation of zero modes, Schr\"{o}dinger-like equations, and a four-dimensional effective action. Additionally, in order to stand for the coupling of the $q$-form field with gravity and scalar fields of the background spacetime, we propose a new coupling function $F(R,\varphi)$. Our analysis highlights the significance of the parameters $\displaystyle C_2$ and $\displaystyle t$ in the localization process.


title: SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs

abstract: We propose SLoPe, a Double-Pruned Sparse Plus Lazy Low-rank Adapter Pretraining method for LLMs that improves the accuracy of sparse LLMs while accelerating their pretraining and inference and reducing their memory footprint. Sparse pretraining of LLMs reduces the accuracy of the model, to overcome this, prior work uses dense models during fine-tuning. SLoPe improves the accuracy of sparsely pretrained models by adding low-rank adapters in the final 1% iterations of pretraining without adding significant overheads to the model pretraining and inference. In addition, SLoPe uses a double-pruned backward pass formulation that prunes the transposed weight matrix using N:M sparsity structures to enable an accelerated sparse backward pass. SLoPe accelerates the training and inference of models with billions of parameters up to $1.14\times$ and $1.34\times$ respectively (OPT-33B and OPT-66B) while reducing their memory usage by up to $0.77\times$ and $0.51\times$ for training and inference respectively.


title: Low angular momentum general relativistic magnetohydrodynamic accretion flow around rotating black holes with shocks

abstract: We investigate the global structure of general relativistic magneto-hydrodynamic (GRMHD) accretion flows around Kerr black holes containing shock waves, where the disk is threaded by radial and toroidal magnetic fields. We self-consistently solve the GRMHD equations that govern the flow motion inside the disk and for the first time to our knowledge, we obtain the shock-induced global GRMHD accretion solutions around weakly as well as rapidly rotating black holes for a set of fundamental flow parameters, such as energy ($E$), angular momentum ($L$), radial magnetic flux ($\Phi$), and iso-rotation parameter ($F$). We show that shock properties, namely shock radius ($r_{\rm sh}$), compression ratio ($R$) and shock strength ($\Psi$) strongly depends on $E$, $L$, $\Phi$, and $F$. We observe that shock in GRMHD flow continues to exist for wide range of the flow parameters, which allows us to identify the effective domain of parameter space in $L-E$ plane where shock solutions are feasible. Moreover, we examine the modification of the shock parameter space and find that it shifts towards the lower angular momentum values with increasing $\Phi$ and black hole spin ($a_{\rm k}$). Finally, we compute the critical radial magnetic flux ($\Phi^{\rm cri}$) that admits shocks in GRMHD flow and ascertain that $\Phi^{\rm cri}$ is higher (lower) for black hole of spin $a_{\rm k} = 0.99$ ($0.0$) and vice versa.


title: On the damping of power systems during inverter-based blackstart

abstract: The massive deployment of inverter-based generation poses several challenges to system operators but also offers new opportunities. In the context of grid recovery, inverter-based generation is expected to take over new responsibilities, as conventional generation that are blackstart capable are being decommissioned. Inverter-based facilities, being very flexible and controllable, have the ability to contribute during grid restoration, although it is still unclear how to deal with the limited ratings of batteries, PV, etc. and how to address nonlinear effects such as inrush currents or harmonics. In this direction, the requirements of grid-forming inverters to comply with black start capabilities are still to be defined. During the first steps of a grid restoration process the dynamics of the grid largely vary from the grid behaviour under normal operation. In particular, the grid is nearly unloaded and therefore poorly damped. Indeed, overvoltages and resonances are a common concern during the energization of long transmission lines. In this work we analyse the spectral properties of unloaded transmission lines, and describe the impact of voltage controllers on the damping of the system. As a byproduct, this analysis can be leveraged to propose high level requirements for grid-forming devices, in order to provide adequate damping during the early stages of a grid restoration process.


title: A Classifier-Free Incremental Learning Framework for Scalable Medical Image Segmentation

abstract: Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However, this can be impractical due to the evolving nature of imaging technology and patient demographics, as well as labor-intensive data curation, limiting their practical applicability and scalability. To address these challenges, we introduce a novel segmentation paradigm enabling the segmentation of a variable number of classes within a single classifier-free network, featuring an architecture independent of class number. This network is trained using contrastive learning and produces discriminative feature representations that facilitate straightforward interpretation. Additionally, we integrate this strategy into a knowledge distillation-based incremental learning framework, facilitating the gradual assimilation of new information from non-stationary data streams while avoiding catastrophic forgetting. Our approach provides a unified solution for tackling both class- and domain-incremental learning scenarios. We demonstrate the flexibility of our method in handling varying class numbers within a unified network and its capacity for incremental learning. Experimental results on an incompletely annotated, multi-modal, multi-source dataset for medical image segmentation underscore its superiority over state-of-the-art alternative approaches.