title: Faceptor: A Generalist Model for Face Perception

abstract: With the comprehensive research conducted on various face analysis tasks, there is a growing interest among researchers to develop a unified approach to face perception. Existing methods mainly discuss unified representation and training, which lack task extensibility and application efficiency. To tackle this issue, we focus on the unified model structure, exploring a face generalist model. As an intuitive design, Naive Faceptor enables tasks with the same output shape and granularity to share the structural design of the standardized output head, achieving improved task extensibility. Furthermore, Faceptor is proposed to adopt a well-designed single-encoder dual-decoder architecture, allowing task-specific queries to represent new-coming semantics. This design enhances the unification of model structure while improving application efficiency in terms of storage overhead. Additionally, we introduce Layer-Attention into Faceptor, enabling the model to adaptively select features from optimal layers to perform the desired tasks. Through joint training on 13 face perception datasets, Faceptor achieves exceptional performance in facial landmark localization, face parsing, age estimation, expression recognition, binary attribute classification, and face recognition, achieving or surpassing specialized methods in most tasks. Our training framework can also be applied to auxiliary supervised learning, significantly improving performance in data-sparse tasks such as age estimation and expression recognition. The code and models will be made publicly available at https://github.com/lxq1000/Faceptor.


title: Operation of BGO with SiPM readout at dry ice and liquid nitrogen temperatures

abstract: The light yield and decay constant of BGO were measured at both dry ice and liquid nitrogen temperatures using two SiPMs directly coupled to a $6\times6\times6$ cm$^2$ cubic BGO crystal. With the measured light yield (5.2$\pm$0.3 PE/keV at dry ice temperature and 10.5$\pm$0.4 PE/keV at liquid nitrogen temperature) and decay constants, potential applications of BGO in ToF-PET and SPECT were discussed.


title: EquiAV: Leveraging Equivariance for Audio-Visual Contrastive Learning

abstract: Recent advancements in self-supervised audio-visual representation learning have demonstrated its potential to capture rich and comprehensive representations. However, despite the advantages of data augmentation verified in many learning methods, audio-visual learning has struggled to fully harness these benefits, as augmentations can easily disrupt the correspondence between input pairs. To address this limitation, we introduce EquiAV, a novel framework that leverages equivariance for audio-visual contrastive learning. Our approach begins with extending equivariance to audio-visual learning, facilitated by a shared attention-based transformation predictor. It enables the aggregation of features from diverse augmentations into a representative embedding, providing robust supervision. Notably, this is achieved with minimal computational overhead. Extensive ablation studies and qualitative results verify the effectiveness of our method. EquiAV outperforms previous works across various audio-visual benchmarks. The code is available on https://github.com/JongSuk1/EquiAV.


title: Shrinkage for Extreme Partial Least-Squares

abstract: This work focuses on dimension-reduction techniques for modelling conditional extreme values. Specifically, we investigate the idea that extreme values of a response variable can be explained by nonlinear functions derived from linear projections of an input random vector. In this context, the estimation of projection directions is examined, as approached by the Extreme Partial Least Squares (EPLS) method--an adaptation of the original Partial Least Squares (PLS) method tailored to the extreme-value framework. Further, a novel interpretation of EPLS directions as maximum likelihood estimators is introduced, utilizing the von Mises-Fisher distribution applied to hyperballs. The dimension reduction process is enhanced through the Bayesian paradigm, enabling the incorporation of prior information into the projection direction estimation. The maximum a posteriori estimator is derived in two specific cases, elucidating it as a regularization or shrinkage of the EPLS estimator. We also establish its asymptotic behavior as the sample size approaches infinity. A simulation data study is conducted in order to assess the practical utility of our proposed method. This clearly demonstrates its effectiveness even in moderate data problems within high-dimensional settings. Furthermore, we provide an illustrative example of the method's applicability using French farm income data, highlighting its efficacy in real-world scenarios.


title: Is Data All That Matters? The Role of Control Frequency for Learning-Based Sampled-Data Control of Uncertain Systems

abstract: Learning models or control policies from data has become a powerful tool to improve the performance of uncertain systems. While a strong focus has been placed on increasing the amount and quality of data to improve performance, data can never fully eliminate uncertainty, making feedback necessary to ensure stability and performance. We show that the control frequency at which the input is recalculated is a crucial design parameter, yet it has hardly been considered before. We address this gap by combining probabilistic model learning and sampled-data control. We use Gaussian processes (GPs) to learn a continuous-time model and compute a corresponding discrete-time controller. The result is an uncertain sampled-data control system, for which we derive robust stability conditions. We formulate semidefinite programs to compute the minimum control frequency required for stability and to optimize performance. As a result, our approach enables us to study the effect of both control frequency and data on stability and closed-loop performance. We show in numerical simulations of a quadrotor that performance can be improved by increasing either the amount of data or the control frequency, and that we can trade off one for the other. For example, by increasing the control frequency by 33%, we can reduce the number of data points by half while still achieving similar performance.


title: Efficient Convolutional Forward Modeling and Sparse Coding in Multichannel Imaging

abstract: This study considers the Block-Toeplitz structural properties inherent in traditional multichannel forward model matrices, using Full Matrix Capture (FMC) in ultrasonic testing as a case study. We propose an analytical convolutional forward model that transforms reflectivity maps into FMC data. Our findings demonstrate that the convolutional model excels over its matrix-based counterpart in terms of computational efficiency and storage requirements. This accelerated forward modeling approach holds significant potential for various inverse problems, notably enhancing Sparse Signal Recovery (SSR) within the context LASSO regression, which facilitates efficient Convolutional Sparse Coding (CSC) algorithms. Additionally, we explore the integration of Convolutional Neural Networks (CNNs) for the forward model, employing deep unfolding to implement the Learned Block Convolutional ISTA (BC-LISTA).


title: Don't Judge by the Look: Towards Motion Coherent Video Representation

abstract: Current training pipelines in object recognition neglect Hue Jittering when doing data augmentation as it not only brings appearance changes that are detrimental to classification, but also the implementation is inefficient in practice. In this study, we investigate the effect of hue variance in the context of video understanding and find this variance to be beneficial since static appearances are less important in videos that contain motion information. Based on this observation, we propose a data augmentation method for video understanding, named Motion Coherent Augmentation (MCA), that introduces appearance variation in videos and implicitly encourages the model to prioritize motion patterns, rather than static appearances. Concretely, we propose an operation SwapMix to efficiently modify the appearance of video samples, and introduce Variation Alignment (VA) to resolve the distribution shift caused by SwapMix, enforcing the model to learn appearance invariant representations. Comprehensive empirical evaluation across various architectures and different datasets solidly validates the effectiveness and generalization ability of MCA, and the application of VA in other augmentation methods. Code is available at https://github.com/BeSpontaneous/MCA-pytorch.


title: Code Revert Prediction with Graph Neural Networks: A Case Study at J.P. Morgan Chase

abstract: Code revert prediction, a specialized form of software defect detection, aims to forecast or predict the likelihood of code changes being reverted or rolled back in software development. This task is very important in practice because by identifying code changes that are more prone to being reverted, developers and project managers can proactively take measures to prevent issues, improve code quality, and optimize development processes. However, compared to code defect detection, code revert prediction has been rarely studied in previous research. Additionally, many previous methods for code defect detection relied on independent features but ignored relationships between code scripts. Moreover, new challenges are introduced due to constraints in an industry setting such as company regulation, limited features and large-scale codebase. To overcome these limitations, this paper presents a systematic empirical study for code revert prediction that integrates the code import graph with code features. Different strategies to address anomalies and data imbalance have been implemented including graph neural networks with imbalance classification and anomaly detection. We conduct the experiments on real-world code commit data within J.P. Morgan Chase which is extremely imbalanced in order to make a comprehensive comparison of these different approaches for the code revert prediction problem.


title: SkateFormer: Skeletal-Temporal Transformer for Human Action Recognition

abstract: Skeleton-based action recognition, which classifies human actions based on the coordinates of joints and their connectivity within skeleton data, is widely utilized in various scenarios. While Graph Convolutional Networks (GCNs) have been proposed for skeleton data represented as graphs, they suffer from limited receptive fields constrained by joint connectivity. To address this limitation, recent advancements have introduced transformer-based methods. However, capturing correlations between all joints in all frames requires substantial memory resources. To alleviate this, we propose a novel approach called Skeletal-Temporal Transformer (SkateFormer) that partitions joints and frames based on different types of skeletal-temporal relation (Skate-Type) and performs skeletal-temporal self-attention (Skate-MSA) within each partition. We categorize the key skeletal-temporal relations for action recognition into a total of four distinct types. These types combine (i) two skeletal relation types based on physically neighboring and distant joints, and (ii) two temporal relation types based on neighboring and distant frames. Through this partition-specific attention strategy, our SkateFormer can selectively focus on key joints and frames crucial for action recognition in an action-adaptive manner with efficient computation. Extensive experiments on various benchmark datasets validate that our SkateFormer outperforms recent state-of-the-art methods.


title: On STPA for Distributed Development of Safe Autonomous Driving: An Interview Study

abstract: Safety analysis is used to identify hazards and build knowledge during the design phase of safety-relevant functions. This is especially true for complex AI-enabled and software intensive systems such as Autonomous Drive (AD). System-Theoretic Process Analysis (STPA) is a novel method applied in safety-related fields like defense and aerospace, which is also becoming popular in the automotive industry. However, STPA assumes prerequisites that are not fully valid in the automotive system engineering with distributed system development and multi-abstraction design levels. This would inhibit software developers from using STPA to analyze their software as part of a bigger system, resulting in a lack of traceability. This can be seen as a maintainability challenge in continuous development and deployment (DevOps). In this paper, STPA's different guidelines for the automotive industry, e.g. J31887/ISO21448/STPA handbook, are firstly compared to assess their applicability to the distributed development of complex AI-enabled systems like AD. Further, an approach to overcome the challenges of using STPA in a multi-level design context is proposed. By conducting an interview study with automotive industry experts for the development of AD, the challenges are validated and the effectiveness of the proposed approach is evaluated.


title: Trust AI Regulation? Discerning users are vital to build trust and effective AI regulation

abstract: There is general agreement that some form of regulation is necessary both for AI creators to be incentivised to develop trustworthy systems, and for users to actually trust those systems. But there is much debate about what form these regulations should take and how they should be implemented. Most work in this area has been qualitative, and has not been able to make formal predictions. Here, we propose that evolutionary game theory can be used to quantitatively model the dilemmas faced by users, AI creators, and regulators, and provide insights into the possible effects of different regulatory regimes. We show that creating trustworthy AI and user trust requires regulators to be incentivised to regulate effectively. We demonstrate the effectiveness of two mechanisms that can achieve this. The first is where governments can recognise and reward regulators that do a good job. In that case, if the AI system is not too risky for users then some level of trustworthy development and user trust evolves. We then consider an alternative solution, where users can condition their trust decision on the effectiveness of the regulators. This leads to effective regulation, and consequently the development of trustworthy AI and user trust, provided that the cost of implementing regulations is not too high. Our findings highlight the importance of considering the effect of different regulatory regimes from an evolutionary game theoretic perspective.


title: The study of weak decays of doubly charmed baryons within rescattering mechanism

abstract: The doubly charmed baryon $\Xi_{cc}^{++}$ has been observed by LHCb through the non-leptonic decay modes of $\Xi_{cc}^{++}\to\Lambda_{c}^{+}K^{-}\pi^{+}\pi^{+}$ and $\Xi_{c}^{+}\pi^{+}$ in 2017. After that, the experimentalists turn their attention to finding other doubly charmed baryons $\Xi_{cc}^{+}$ and $\Omega_{cc}^{+}$. In this work, we investigate the nonleptonic weak decays of doubly charmed baryons ${\cal B}_{cc}\to{\cal B}_{c}P$, where ${\cal B}_{cc}$ denotes the doubly charmed baryons $(\Xi_{cc}^{++},\Xi_{cc}^{+},\Omega_{cc}^{+})$, ${\cal B}_{c}$ represents the singly charmed baryons $({\cal B}_{\bar{3}},{\cal B}_{6})$ and $P$ is the light pseudoscalar. For these non-leptonic decay modes, their short-distance contributions can be accurately estimated in theoretical calculations. However, dealing with the long-distance contributions for final-state-interaction effects is challenging. To address this, we use the rescattering mechanism to calculate the long-distance contributions and first derive the whole hadronic loop contributions for these two-body nonleptonic decays of doubly charmed baryons. Then the decay widths and branching ratios of the 45 nonleptonic decays of doubly charmed baryon are predicted. Among that, the ratio of the branching ratios ${\cal RB}=\frac{{\cal B}(\Xi_{cc}^{++}\to\Xi_{c}^{\prime+}\pi^{+})}{{\cal B}(\Xi_{cc}^{++}\to\Xi_{c}^{+}\pi^{+})}=1.15\pm0.45$ is consistent with the experimental results within statistical errors.


title: Exploiting Finite Geometries for Better Quantum Advantages in Mermin-Like Games

abstract: Quantum games embody non-intuitive consequences of quantum phenomena, such as entanglement and contextuality. The Mermin-Peres game is a simple example, demonstrating how two players can utilise shared quantum information to win a no - communication game with certainty, where classical players cannot. In this paper we look at the geometric structure behind such classical strategies, and borrow ideas from the geometry of symplectic polar spaces to maximise this quantum advantage. We introduce a new game called the Eloily game with a quantum-classical success gap of $0.2\overline{6}$, larger than that of the Mermin-Peres and doily games. We simulate this game in the IBM Quantum Experience and obtain a success rate of $1$, beating the classical bound of $0.7\overline{3}$ demonstrating the efficiency of the quantum strategy.


title: AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shield Prompting

abstract: With the advent and widespread deployment of Multimodal Large Language Models (MLLMs), the imperative to ensure their safety has become increasingly pronounced. However, with the integration of additional modalities, MLLMs are exposed to new vulnerabilities, rendering them prone to structured-based jailbreak attacks, where semantic content (e.g., "harmful text") has been injected into the images to mislead MLLMs. In this work, we aim to defend against such threats. Specifically, we propose \textbf{Ada}ptive \textbf{Shield} Prompting (\textbf{AdaShield}), which prepends inputs with defense prompts to defend MLLMs against structure-based jailbreak attacks without fine-tuning MLLMs or training additional modules (e.g., post-stage content detector). Initially, we present a manually designed static defense prompt, which thoroughly examines the image and instruction content step by step and specifies response methods to malicious queries. Furthermore, we introduce an adaptive auto-refinement framework, consisting of a target MLLM and a LLM-based defense prompt generator (Defender). These components collaboratively and iteratively communicate to generate a defense prompt. Extensive experiments on the popular structure-based jailbreak attacks and benign datasets show that our methods can consistently improve MLLMs' robustness against structure-based jailbreak attacks without compromising the model's general capabilities evaluated on standard benign tasks. Our code is available at https://github.com/rain305f/AdaShield.


title: Quantum Fourier Transform using Dynamic Circuits

abstract: In dynamic quantum circuits, classical information from mid-circuit measurements is fed forward during circuit execution. This emerging capability of quantum computers confers numerous advantages that can enable more efficient and powerful protocols by drastically reducing the resource requirements for certain core algorithmic primitives. In particular, in the case of the $n$-qubit quantum Fourier transform followed immediately by measurement, the scaling of resource requirements is reduced from $O(n^2)$ two-qubit gates in an all-to-all connectivity in the standard unitary formulation to $O(n)$ mid-circuit measurements in its dynamic counterpart without any connectivity constraints. Here, we demonstrate the advantage of dynamic quantum circuits for the quantum Fourier transform on IBM's superconducting quantum hardware with certified process fidelities of $>50\%$ on up to $16$ qubits and $>1\%$ on up to $37$ qubits, exceeding previous reports across all quantum computing platforms. These results are enabled by our contribution of an efficient method for certifying the process fidelity, as well as of a dynamical decoupling protocol for error suppression during mid-circuit measurements and feed-forward within a dynamic quantum circuit that we call ``feed-forward-compensated dynamical decoupling" (FC-DD). Our results demonstrate the advantages of leveraging dynamic circuits in optimizing the compilation of quantum algorithms.


title: Free groups are $L^2$-subgroup rigid

abstract: In this paper, we introduce the notion of $L^2$-subgroup rigid groups and demonstrate that free groups are $L^2$-subgroup rigid. As a consequence, we establish the equivalence between compressibility, inertness, strong inertness, and $L^2$-independence for a finitely generated subgroup of a free group, confirming a conjecture by Dicks and Ventura as well as the one by Antolin and Jaikin-Zapirain.


title: Leveraging Prototypical Representations for Mitigating Social Bias without Demographic Information

abstract: Mitigating social biases typically requires identifying the social groups associated with each data sample. In this paper, we present DAFair, a novel approach to address social bias in language models. Unlike traditional methods that rely on explicit demographic labels, our approach does not require any such information. Instead, we leverage predefined prototypical demographic texts and incorporate a regularization term during the fine-tuning process to mitigate bias in the model's representations. Our empirical results across two tasks and two models demonstrate the effectiveness of our method compared to previous approaches that do not rely on labeled data. Moreover, with limited demographic-annotated data, our approach outperforms common debiasing approaches.


title: Observation of quantum thermalization restricted to Hilbert space fragments

abstract: Quantum thermalization occurs in a broad class of systems from elementary particles to complex materials. Out-of-equilibrium quantum systems have long been understood to either thermalize or retain memory of their initial states, but not both. Here we achieve the first simultaneous demonstration of thermalization and memory in a quantum system. Using a Rydberg atom array, we observe quantum thermalization restricted to Hilbert space fragments, where the thermalized system retains characteristics of the initial configuration. Intriguingly, states from different subspaces do not thermalize with each other even when they have the same energy. Our work challenges established ideas of quantum thermalization while experimentally resolving the longstanding tension between thermalization and memory. These results may be applied to control entanglement dynamics in quantum processors and quantum sensors.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech physics.atom-ph


title: About Berge-F\"uredi's conjecture on the chromatic index of hypergraphs

abstract: We show that the chromatic index of a hypergraph $\mathcal{H}$ satisfies Berge-F\"uredi conjectured bound $\mathrm{q}(\mathcal{H})\le \Delta([\mathcal{H}]_2)+1$ under certain hypotheses on the antirank $\mathrm{ar}(\mathcal{H})$ or on the maximum degree $\Delta(\mathcal{H})$. This provides sharp information in connection with Erd\H{o}s-Faber-Lov\'asz Conjecture which deals with the coloring of a family of cliques that intersect pairwise in at most one vertex.


title: Efficient tensor networks for control-enhanced quantum metrology

abstract: Optimized quantum control can enhance the performance and noise resilience of quantum metrology. However, the optimization quickly becomes intractable when multiple control operations are applied sequentially. In this work, we propose efficient tensor network algorithms for optimizing strategies of quantum metrology enhanced by a long sequence of control operations. Our approach covers a general and practical scenario where the experimenter applies $N-1$ interleaved control operations between $N$ queries of the channel to estimate and uses no or bounded ancilla. Tailored to different experimental capabilities, these control operations can be generic quantum channels or variational unitary gates. Numerical experiments show that our algorithm has a good performance in optimizing the metrological strategy for as many as $N=100$ queries. In particular, our algorithm identifies a strategy that can outperform the state-of-the-art strategy when $N$ is finite but large.


title: Topological responses from gapped Weyl points in 2D altermagnets

abstract: We study the symmetry requirements for topologically protected spin-polarized Weyl points in 2D altermagnets. The topology is characterized by a quantized $\pi$-Berry phase and the degeneracy is protected by spin-space group symmetries. Gapped phases with finite Chern and/or spin/chirality Chern numbers emerge under different symmetry-breaking mass terms. We investigate the surface and transport properties of these gapped phases using representative electronic tight-binding and magnonic linear spin-wave models. In particular, we calculate the electronic and magnonic Hall currents and discuss implications for experiments.


title: Smallest gaps between eigenvalues of real Gaussian matrices

abstract: We consider an $n\times n$ matrix of independent real Gaussian random variables and determine the asymptotic distribution of the smallest gaps between complex eigenvalues.


title: MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation

abstract: Large Language Models (LLM) have demonstrated their strong ability in the field of machine translation (MT), yet they suffer from high computational cost and latency. Therefore, transferring translation knowledge from giant LLMs to medium-sized machine translation models is a promising research direction. However, traditional knowledge distillation methods do not take the capability of student and teacher models into consideration, therefore repeatedly teaching student models on the knowledge they have learned, and failing to extend to novel contexts and knowledge. In this paper, we propose a framework called MT-Patcher, which transfers knowledge from LLMs to existing MT models in a selective, comprehensive and proactive manner. Considering the current translation ability of student MT models, we only identify and correct their translation errors, instead of distilling the whole translation from the teacher. Leveraging the strong language abilities of LLMs, we instruct LLM teachers to synthesize diverse contexts and anticipate more potential errors for the student. Experiment results on translating both specific language phenomena and general MT benchmarks demonstrate that finetuning the student MT model on about 10% examples can achieve comparable results to the traditional knowledge distillation method, and synthesized potential errors and diverse contexts further improve translation performances on unseen contexts and words.


title: Vortex pattern stabilization in thin films resulting from shear thickening of active suspensions

abstract: The need for structuring on micrometer scales is abundant, for example, in view of phononic applications. We here outline a novel approach based on the phenomenon of active turbulence on the mesoscale. As we demonstrate, a shear-thickening carrier fluid of active microswimmers intrinsically stabilizes regular vortex patterns of otherwise turbulent active suspensions. The fluid self-organizes into a periodically structured nonequilibrium state. Introducing additional passive particles of intermediate size leads to regular spatial organization of these objects. Our approach opens a new path towards functionalization through patterning of thin films and membranes.


title: Physics-Informed Neural Network for Volumetric Sound field Reconstruction of Speech Signals

abstract: Recent developments in acoustic signal processing have seen the integration of deep learning methodologies, alongside the continued prominence of classical wave expansion-based approaches, particularly in sound field reconstruction. Physics-Informed Neural Networks (PINNs) have emerged as a novel framework, bridging the gap between data-driven and model-based techniques for addressing physical phenomena governed by partial differential equations. This paper introduces a PINN-based approach for the recovery of arbitrary volumetric acoustic fields. The network incorporates the wave equation to impose a regularization on signal reconstruction in the time domain. This methodology enables the network to learn the underlying physics of sound propagation and allows for the complete characterization of the sound field based on a limited set of observations. The proposed method's efficacy is validated through experiments involving speech signals in a real-world environment, considering varying numbers of available measurements. Moreover, a comparative analysis is undertaken against state-of-the-art frequency-domain and time-domain reconstruction methods from existing literature, highlighting the increased accuracy across the various measurement configurations.


title: An Extreme Ultra-Compact X-ray Binary in a Globular Cluster: Multi-Wavelength Observations of RZ2109 Explored in a Triple System Framework

abstract: The globular cluster ultraluminous X-ray source, RZ2109, is a complex and unique system which has been detected at X-ray, ultra-violet, and optical wavelengths. Based on almost 20 years of Chandra and XMM-Newton observations, the X-ray luminosity exhibits order-of-magnitude variability, with the peak flux lasting on the order of a few hours. We perform robust time series analysis on the archival X-ray observations and find that this variability is periodic on a timescale of 1.3 $\pm 0.04$ days. The source also demonstrates broad [OIII] 5007 Angstrom emission, which has been observed since 2004, suggesting a white dwarf donor and therefore an ultra-compact X-ray binary. We present new spectra from 2020 and 2022, marking eighteen years of observed [OIII] emission from this source. Meanwhile, we find that the globular cluster counterpart is unusually bright in the NUV/UVW2 band. Finally, we discuss RZ2109 in the context of the eccentric Kozai Lidov mechanism and show that the observed 1.3 day periodicity can be used to place constraints on the tertiary configuration, ranging from 20 minutes (for a 0.1 ${\rm M}_\odot$ companion) to approximately 95 minutes (for a 1 ${\rm M}_\odot$ companion), if the eccentric Kozai Lidov mechanism is at the origin of the periodic variability.


title: Optimizing the Electrical Interface for Large-Scale Color-Center Quantum Processors

abstract: Quantum processors based on color centers in diamond are promising candidates for future large-scale quantum computers thanks to their flexible optical interface, (relatively) high operating temperature, and high-fidelity operation. Similar to other quantum-computing platforms, the electrical interface required to control and read out such qubits may limit both the performance of the whole system and its scalability. To address this challenge, this work analyzes the requirements of the electrical interface and investigates how to efficiently implement the electronic controller in a scalable architecture comprising a large number of identical unit cells. Among the different discussed functionalities, a specific focus is devoted to the generation of the static and dynamic magnetic fields driving the electron and nuclear spins, because of their major impact on fidelity and scalability. Following the derived requirements, different system architectures, such as a qubit frequency-multiplexing scheme, are considered to identify the most power efficient approach, especially in the presence of inhomogeneity of the qubit Larmor frequency across the processor. As a result, a non-frequency-multiplexed, 1-mm$^2$ unit-cell architecture is proposed as the optimal solution, able to address up to one electron-spin qubit and 9 nuclear-spin qubits within a 3-mW average power consumption, thus establishing the baseline for the scalable electrical interface for future large-scale color-center quantum computers.


title: WavCraft: Audio Editing and Generation with Large Language Models

abstract: We introduce WavCraft, a collective system that leverages large language models (LLMs) to connect diverse task-specific models for audio content creation and editing. Specifically, WavCraft describes the content of raw audio materials in natural language and prompts the LLM conditioned on audio descriptions and user requests. WavCraft leverages the in-context learning ability of the LLM to decomposes users' instructions into several tasks and tackle each task collaboratively with the particular module. Through task decomposition along with a set of task-specific models, WavCraft follows the input instruction to create or edit audio content with more details and rationales, facilitating user control. In addition, WavCraft is able to cooperate with users via dialogue interaction and even produce the audio content without explicit user commands. Experiments demonstrate that WavCraft yields a better performance than existing methods, especially when adjusting the local regions of audio clips. Moreover, WavCraft can follow complex instructions to edit and create audio content on the top of input recordings, facilitating audio producers in a broader range of applications. Our implementation and demos are available at this https://github.com/JinhuaLiang/WavCraft.


title: Decay of Correlations via induced Weak Gibbs Markov maps for non-H\"{o}lder observables

abstract: We extend the results of [Ullah, A., Vilarinho, H,.: Statistical properties of dynamical systems via induced weak Gibbs Markov maps. arXiv:2311.17531 (2023)] by considering larger classes of observables. More precisely, we obtain estimates on the decay of correlations, Central Limit Theorem and Large Deviations for dynamical systems having an induced weak Gibbs Markov map, for larger classes of observables with weaker regularity than H\"{o}lder.


title: A general-purpose neural network potential for Ti-Al-Nb alloys towards large-scale molecular dynamics with ab initio accuracy

abstract: High Nb-containing TiAl alloys exhibit exceptional high-temperature strength and room-temperature ductility, making them widely used in hot-section components of automotive and aerospace engines. However, the lack of accurate interatomic interaction potentials for large-scale modeling severely hampers a comprehensive understanding of the failure mechanism of Ti-Al-Nb alloys and the development of strategies to enhance the mechanical properties. Here, we develop a general-purpose machine-learned potential (MLP) for the Ti-Al-Nb ternary system by combining the neural evolution potentials framework with an active learning scheme. The developed MLP, trained on extensive first-principles datasets, demonstrates remarkable accuracy in predicting various lattice and defect properties, as well as high-temperature characteristics such as thermal expansion and melting point for TiAl systems. Notably, this potential can effectively describe the key effect of Nb doping on stacking fault energies and formation energies. Of practical importance is that our MLP enables large-scale molecular dynamics simulations involving tens of millions of atoms with ab initio accuracy, achieving an outstanding balance between computational speed and accuracy. These results pave the way for studying micro-mechanical behaviors in TiAl lamellar structures and developing high-performance TiAl alloys towards applications at elevated temperatures.


title: VisionGPT-3D: A Generalized Multimodal Agent for Enhanced 3D Vision Understanding

abstract: The evolution of text to visual components facilitates people's daily lives, such as generating image, videos from text and identifying the desired elements within the images. Computer vision models involving the multimodal abilities in the previous days are focused on image detection, classification based on well-defined objects. Large language models (LLMs) introduces the transformation from nature language to visual objects, which present the visual layout for text contexts. OpenAI GPT-4 has emerged as the pinnacle in LLMs, while the computer vision (CV) domain boasts a plethora of state-of-the-art (SOTA) models and algorithms to convert 2D images to their 3D representations. However, the mismatching between the algorithms with the problem could lead to undesired results. In response to this challenge, we propose an unified VisionGPT-3D framework to consolidate the state-of-the-art vision models, thereby facilitating the development of vision-oriented AI. VisionGPT-3D provides a versatile multimodal framework building upon the strengths of multimodal foundation models. It seamlessly integrates various SOTA vision models and brings the automation in the selection of SOTA vision models, identifies the suitable 3D mesh creation algorithms corresponding to 2D depth maps analysis, generates optimal results based on diverse multimodal inputs such as text prompts. Keywords: VisionGPT-3D, 3D vision understanding, Multimodal agent


title: Defense via Behavior Attestation against Attacks in Connected and Automated Vehicles based Federated Learning Systems

abstract: The recent application of Federated Learning algorithms in IOT and Wireless vehicular networks have given rise to newer cyber threats in the mobile environment which hitherto were not present in traditional fixed networks. These threats arise due to the intrinsic nature of wireless transmission medium and other inherent characteristics of mobile networks such as high-node mobility and rapidly changing topology. This paper investigates the robustness of Vehicular AttestedFL defense strategies against falsified information attacks by tracking the behavior. We show that the defense strategies are capable of detecting and eliminating malicious nodes in the wireless mobile setting of the future smart road networks.


title: Robust SGLD algorithm for solving non-convex distributionally robust optimisation problems

abstract: In this paper we develop a Stochastic Gradient Langevin Dynamics (SGLD) algorithm tailored for solving a certain class of non-convex distributionally robust optimisation problems. By deriving non-asymptotic convergence bounds, we build an algorithm which for any prescribed accuracy $\varepsilon>0$ outputs an estimator whose expected excess risk is at most $\varepsilon$. As a concrete application, we employ our robust SGLD algorithm to solve the (regularised) distributionally robust Mean-CVaR portfolio optimisation problem using real financial data. We empirically demonstrate that the trading strategy obtained by our robust SGLD algorithm outperforms the trading strategy obtained when solving the corresponding non-robust Mean-CVaR portfolio optimisation problem using, e.g., a classical SGLD algorithm. This highlights the practical relevance of incorporating model uncertainty when optimising portfolios in real financial markets.


title: The affine Artin group of type $\widetilde B_n$ is virtually poly-free

abstract: In this note we prove that the affine Artin group of type $\widetilde B_n$ is virtually poly-free. The proof also gives another solution of the $K(\pi, 1)$ problem for $\widetilde B_n$.


title: Generators of measure-valued jump diffusions and convergence rate of diffusive mean-field models

abstract: The paper has two objectives: proving that the rate of convergence in distribution for mean-field models in CLT regime is $N^{-1/2}$, and obtaining explicit expressions for the infinitesimal generators of two types of measure-valued Markov processes (conditional law of McKean-Vlasov processes, and empirical measures of McKean-Vlasov systems). The proof of the convergence of mean-field system requires the second result about the generators, and both results need to study a notion of differentiability of measure-variable functions know as linear differentiability. Due to the particular framework that is studied, many technical difficulties arise compared to the existing literature. Two of the main problems are the following ones: the CLT regime implies that the limit measure-valued processes are not deterministic, and the empirical measure processes related to McKean-Vlasov equations with jumps are necessarily discontinuous. Both properties make the expressions of the generators more complicated than what is usually considered.


title: Chiral gauge field in fully-spin polarized Weyl semimetal with magnetic domain walls

abstract: Modulation of magnetization in magnetic Weyl semimetals leads to the shift of Weyl points in momentum space, which effectively serves as the chirality-dependent gauge field for the Weyl fermions. Here, we theoretically study such a magnetization-induced chiral gauge field, in a fully spin-polarized Weyl ferromagnet $\rm{Co}_3\rm{Sn}_2\rm{S}_2$. From a tight-binding model of $\rm{Co}_3\rm{Sn}_2\rm{S}_2$ on stacked kagome lattice with magnetism, we calculate the magnetization-dependent evolution of the Weyl points in momentum space, resulting in the chiral gauge field. In the presence of the magnetic domain wall structure, we evaluate the chiral magnetic field arising from the spatial profile of the chiral gauge field. We find that a magnetic domain wall in $\rm{Co}_3\rm{Sn}_2\rm{S}_2$ gives rise to a giant chiral magnetic field for the Weyl fermions, which reaches the order of a few hundred tesla to induce the Landau quantization. Such a giant chiral magnetic field may also influence the novel transport phenomena, such as the charge pumping by the domain wall motion, compatible with the spin-motive force.


title: Mixed Algorithm of SINDy and HAVOK for Measure-Based Analysis of Power System with Inverter-based Resources

abstract: Artificial intelligence and machine learning is enhancing electric grids by offering data analysis tools that can be used to operate the power grid more reliably. However, the complex nonlinear dynamics, particularly when coupled with multi-scale interactions among Inverter-based renewable energy Resources, calls for effective algorithms for power system application. This paper presents affective novel algorithm to detect various nonlinear dynamics, which is built upon: the Sparse Identification of Nonlinear Dynamics method for nonlinear dynamics detection; and Hankel Alternative View of Koopman method for multi-scale decomposition. We show that, by an appropriate integration of the strengths of the two, the mixed algorithm not only can detect the nonlinearity, but also it distinguishes the nonlinearity caused by coupled Inverter-based resources from the more familiar ones caused synchronous generators. This shows that the proposal algorithm can be a promising application of artificial intelligence and machine learning for data measure-based analysis to support operation of power system with integrated renewables.


title: Analyzing and Mitigating (with LLMs) the Security Misconfigurations of Helm Charts from Artifact Hub

abstract: Background: Helm is a package manager that allows defining, installing, and upgrading applications with Kubernetes (K8s), a popular container orchestration platform. A Helm chart is a collection of files describing all dependencies, resources, and parameters required for deploying an application within a K8s cluster. Objective: The goal of this study is to mine and empirically evaluate the security of Helm charts, comparing the performance of existing tools in terms of misconfigurations reported by policies available by default, and measure to what extent LLMs could be used for removing misconfiguration. We also want to investigate whether there are false positives in both the LLM refactorings and the tool outputs. Method: We propose a pipeline to mine Helm charts from Artifact Hub, a popular centralized repository, and analyze them using state-of-the-art open-source tools, such as Checkov and KICS. First, such a pipeline will run several chart analyzers and identify the common and unique misconfigurations reported by each tool. Secondly, it will use LLMs to suggest mitigation for each misconfiguration. Finally, the chart refactoring previously generated will be analyzed again by the same tools to see whether it satisfies the tool's policies. At the same time, we will also perform a manual analysis on a subset of charts to evaluate whether there are false positive misconfigurations from the tool's reporting and in the LLM refactoring.


title: Supermassive Black Hole Winds in X-rays -- SUBWAYS. III. A population study on ultra-fast outflows

abstract: The detection of blue-shifted absorption lines likely associated with ionized Iron K-shell transitions in the X-ray spectra of many Active Galactic Nuclei (AGN) suggests the presence of a highly ionized gas outflowing with mildly relativistic velocities (0.03c-0.6c), named Ultra-Fast Outflow (UFO). Within the SUBWAYS project we characterized these winds starting from a sample of 22 radio-quiet quasars at 0.1 < z < 0.4, and compared the results with similar studies in the literature on samples of 42 local radio-quiet Seyfert galaxies and 14 high redshift radio-quiet quasars. The scope of our work is a statistical study of UFO parameters and incidence, considering key physical properties of the sources, e.g. supermassive black hole (SMBH) mass, bolometric luminosity, accretion rates and Spectral Energy Distribution, with the aim of gaining new insights into the UFO launching mechanisms. We find indications that highly luminous AGN with steeper X-ray/UV ratio, are more likely to host UFO. The presence of UFO is not significantly related to any other AGN property in our sample. These findings suggest that the UFO phenomenon may be transient. Focusing on AGN with UFO, other important results are: (1) faster UFO have larger ionization parameters and column densities; (2) X-ray radiation plays a more crucial role in driving highly ionized winds compared to UV; (3) the correlation between outflow velocity and luminosity is significantly flatter than what expected for radiatively driven winds; (4) more massive BH experience higher wind mass-losses, suppressing accretion of matter onto the BH; (5) the UFO launching radius is positively correlated with the Eddington ratio. Furthermore, our analysis suggest the involvement of multiple launching mechanisms, including radiation pressure and magneto-hydrodynamic processes, rather than pointing to a single, universally applicable mechanism.


title: Logits of API-Protected LLMs Leak Proprietary Information

abstract: The commercialization of large language models (LLMs) has led to the common practice of high-level API-only access to proprietary models. In this work, we show that even with a conservative assumption about the model architecture, it is possible to learn a surprisingly large amount of non-public information about an API-protected LLM from a relatively small number of API queries (e.g., costing under $1,000 for OpenAI's gpt-3.5-turbo). Our findings are centered on one key observation: most modern LLMs suffer from a softmax bottleneck, which restricts the model outputs to a linear subspace of the full output space. We show that this lends itself to a model image or a model signature which unlocks several capabilities with affordable cost: efficiently discovering the LLM's hidden size, obtaining full-vocabulary outputs, detecting and disambiguating different model updates, identifying the source LLM given a single full LLM output, and even estimating the output layer parameters. Our empirical investigations show the effectiveness of our methods, which allow us to estimate the embedding size of OpenAI's gpt-3.5-turbo to be about 4,096. Lastly, we discuss ways that LLM providers can guard against these attacks, as well as how these capabilities can be viewed as a feature (rather than a bug) by allowing for greater transparency and accountability.


title: A general and sharp regularity condition for integro-differential equations with non-dominated measures

abstract: The aim of this work is to present the regularity condition (also known in the literature as structure condition) an integro-differential operator may satisfy in order for the domination principle to hold for (sub-,super-) solutions of polynomial growth. More precisely, the framework presented in Hollender [13], in which power functions are used in order to determine the integrability conditions, is weakened by substituting the power functions with Young functions. The use of Young functions allows for sharp integrability conditions, which are crucial when one deals with limit theorems. As an immediate application, it is considered the case of parabolic Hamilton-Jacobi-Bellman (HJB) operators, for which the regularity condition is satisfied and, consequently, the comparison principle as well. The parabolic HJB operator presented in this work can be associated to second-order (decoupled) forward-backward stochastic differential equations with jumps.


title: RANDAO-based RNG: Last Revealer Attacks in Ethereum 2.0 Randomness and a Potential Solution

abstract: Ethereum 2.0 is a major upgrade to improve its scalability, throughput, and security. In this version, RANDAO is the scheme to randomly select the users who propose, confirm blocks, and get rewards. However, a vulnerability, referred to as the `Last Revealer Attack' (LRA), compromises the randomness of this scheme by introducing bias to the Random Number Generator (RNG) process. This vulnerability is first clarified again in this study. After that, we propose a Shamir's Secret Sharing (SSS)-based RANDAO scheme to mitigate the LRA. Through our analysis, the proposed method can prevent the LRA under favorable network conditions.


title: Competing Interactions in Strongly Driven Multi-Level Systems

abstract: We experimentally study the level mixing, splitting and repulsion of an optically driven atomic multi-level system under two competing interactions. The strength of the optical coupling is increased until it surpasses the atomic hyperfine interaction responsible for mixing the magnetic substates. Due to the multi-level character of the coupled state space, the level shifts exhibit complex behavior reminiscent of the Paschen-Back effect. Our results show that multi-level effects can have significant influence for strong external drive, differing from a simple model of effective non-interacting two-level systems. These results highlight the relevance of imperfections of the light polarization or initial state preparation in strongly optically driven systems.


title: Explorations in Texture Learning

abstract: In this work, we investigate \textit{texture learning}: the identification of textures learned by object classification models, and the extent to which they rely on these textures. We build texture-object associations that uncover new insights about the relationships between texture and object classes in CNNs and find three classes of results: associations that are strong and expected, strong and not expected, and expected but not present. Our analysis demonstrates that investigations in texture learning enable new methods for interpretability and have the potential to uncover unexpected biases.


title: Effect of external characteristics of a virtual human being during the use of a computer-assisted therapy tool

abstract: Identification within media, whether with real or fictional characters, significantly impacts users, shaping their behavior and enriching their social and emotional experiences. Immersive media, like video games, utilize virtual entities such as agents, avatars, or NPCs to connect users with virtual worlds, fostering a heightened sense of immersion and identification. However, challenges arise in visually representing these entities, with design decisions crucial for enhancing user interaction. Recent research highlights the potential of user-defined design, or customization, which goes beyond mere visual resemblance to the user. Understanding how identification with virtual avatars influences user experiences, especially in psychological interventions, is pivotal. In a study exploring this, 22 participants created virtual agents either similar or dissimilar to themselves, which then addressed their dysfunctional thoughts. Results indicate that similarity between users and virtual agents not only boosts identification but also positively impacts emotions and motivation, enhancing interest and enjoyment. This study sheds light on the significance of customization and identification, particularly in computer-assisted therapy tools, underscoring the importance of visual design for optimizing user experiences.


title: Sequential Contracts

abstract: We study the principal-agent setting, where a principal delegates the execution of a costly project to an agent. In the classical model, the agent chooses an action among a set of available actions. Every action is associated with some cost, and leads to a stochastic outcome for the project. The agent's action is hidden from the principal, who only observes the outcome. The principal incentivizes the agent through a payment scheme (a contract) that maps outcomes to payments, with the objective of finding the optimal contract - the contract maximizing the principal's expected utility. In this work, we introduce a sequential variant of the model, capturing many real-life settings, where the agent engages in multiple attempts, incurring the sum of costs of the actions taken and being compensated for the best realized outcome. We study the contract design problem in this new setting. We first observe that the agent's problem - finding the sequential set of actions that maximizes his utility for a given contract - is equivalent to the well-known Pandora's Box problem. With this insight at hand, we provide algorithms and hardness results for the (principal's) contract design problem, under both independent and correlated actions. For independent actions, we show that the optimal linear contract can be computed in polynomial time. Furthermore, this result extends to the optimal arbitrary contract when the number of outcomes is a constant. For correlated actions we find that approximating the optimal contract within any constant ratio is NP-hard.


title: de Leeuw representations of functionals on Lipschitz spaces

abstract: Let $\mathrm{Lip}_0(M)$ be the space of Lipschitz functions on a complete metric space $(M,d)$ that vanish at a point $0\in M$. We investigate its dual $\mathrm{Lip}_0(M)^*$ using the de Leeuw transform, which allows representing each functional on $\mathrm{Lip}_0(M)$ as a (non-unique) measure on $\beta\widetilde{M}$, where $\widetilde{M}$ is the space of pairs $(x,y)\in M\times M$, $x\neq y$. We distinguish a set of points of $\beta\widetilde{M}$ that are "away from infinity", which can be assigned coordinates belonging to the Lipschitz realcompactification $M^{\mathcal{R}}$ of $M$. We define a natural metric $\bar{d}$ on $M^{\mathcal{R}}$ extending $d$ and we show that optimal (i.e. positive and norm-minimal) de Leeuw representations of well-behaved functionals are characterised by $\bar{d}$-cyclical monotonicity of their support, extending known results for functionals in $\mathcal{F}(M)$, the predual of $\mathrm{Lip}_0(M)$. We also extend the Kantorovich-Rubinstein theorem to normal Hausdorff spaces, in particular to $M^{\mathcal{R}}$, and use this to characterise measure-induced and majorisable functionals in $\mathrm{Lip}_0(M)^*$ as those admitting optimal representations with additional finiteness properties. Finally, we use de Leeuw representations to define a natural L-projection of $\mathrm{Lip}_0(M)^*$ onto $\mathcal{F}(M)$ under some conditions on $M$.


title: How do Machine Learning Projects use Continuous Integration Practices? An Empirical Study on GitHub Actions

abstract: Continuous Integration (CI) is a well-established practice in traditional software development, but its nuances in the domain of Machine Learning (ML) projects remain relatively unexplored. Given the distinctive nature of ML development, understanding how CI practices are adopted in this context is crucial for tailoring effective approaches. In this study, we conduct a comprehensive analysis of 185 open-source projects on GitHub (93 ML and 92 non-ML projects). Our investigation comprises both quantitative and qualitative dimensions, aiming to uncover differences in CI adoption between ML and non-ML projects. Our findings indicate that ML projects often require longer build durations, and medium-sized ML projects exhibit lower test coverage compared to non-ML projects. Moreover, small and medium-sized ML projects show a higher prevalence of increasing build duration trends compared to their non-ML counterparts. Additionally, our qualitative analysis illuminates the discussions around CI in both ML and non-ML projects, encompassing themes like CI Build Execution and Status, CI Testing, and CI Infrastructure. These insights shed light on the unique challenges faced by ML projects in adopting CI practices effectively.


title: Breast Cancer Classification Using Gradient Boosting Algorithms Focusing on Reducing the False Negative and SHAP for Explainability

abstract: Cancer is one of the diseases that kill the most women in the world, with breast cancer being responsible for the highest number of cancer cases and consequently deaths. However, it can be prevented by early detection and, consequently, early treatment. Any development for detection or perdition this kind of cancer is important for a better healthy life. Many studies focus on a model with high accuracy in cancer prediction, but sometimes accuracy alone may not always be a reliable metric. This study implies an investigative approach to studying the performance of different machine learning algorithms based on boosting to predict breast cancer focusing on the recall metric. Boosting machine learning algorithms has been proven to be an effective tool for detecting medical diseases. The dataset of the University of California, Irvine (UCI) repository has been utilized to train and test the model classifier that contains their attributes. The main objective of this study is to use state-of-the-art boosting algorithms such as AdaBoost, XGBoost, CatBoost and LightGBM to predict and diagnose breast cancer and to find the most effective metric regarding recall, ROC-AUC, and confusion matrix. Furthermore, our study is the first to use these four boosting algorithms with Optuna, a library for hyperparameter optimization, and the SHAP method to improve the interpretability of our model, which can be used as a support to identify and predict breast cancer. We were able to improve AUC or recall for all the models and reduce the False Negative for AdaBoost and LigthGBM the final AUC were more than 99.41\% for all models.


title: Generalizing Denoising to Non-Equilibrium Structures Improves Equivariant Force Fields

abstract: Understanding the interactions of atoms such as forces in 3D atomistic systems is fundamental to many applications like molecular dynamics and catalyst design. However, simulating these interactions requires compute-intensive ab initio calculations and thus results in limited data for training neural networks. In this paper, we propose to use denoising non-equilibrium structures (DeNS) as an auxiliary task to better leverage training data and improve performance. For training with DeNS, we first corrupt a 3D structure by adding noise to its 3D coordinates and then predict the noise. Different from previous works on denoising, which are limited to equilibrium structures, the proposed method generalizes denoising to a much larger set of non-equilibrium structures. The main difference is that a non-equilibrium structure does not correspond to local energy minima and has non-zero forces, and therefore it can have many possible atomic positions compared to an equilibrium structure. This makes denoising non-equilibrium structures an ill-posed problem since the target of denoising is not uniquely defined. Our key insight is to additionally encode the forces of the original non-equilibrium structure to specify which non-equilibrium structure we are denoising. Concretely, given a corrupted non-equilibrium structure and the forces of the original one, we predict the non-equilibrium structure satisfying the input forces instead of any arbitrary structures. Since DeNS requires encoding forces, DeNS favors equivariant networks, which can easily incorporate forces and other higher-order tensors in node embeddings. We study the effectiveness of training equivariant networks with DeNS on OC20, OC22 and MD17 datasets and demonstrate that DeNS can achieve new state-of-the-art results on OC20 and OC22 and significantly improve training efficiency on MD17.

categories: cs.LG cs.AI physics.chem-ph physics.comp-ph


title: Understanding the Humidity Sensitivity of Sensors with TCAD Simulations

abstract: The breakdown voltage of silicon sensors without special surface is known to be affected by the ambient humidity. To understand the sensor's humidity sensitivity, Synopsys TCAD was used to simulate n-in-p test structures for different effective relative humidity. Photon emission of hot electrons was imaged with a microscope to locate breakdown in the edge-region of the sensor. The Top-Transient Current Technique was used to measure charge transport near the surface in the breakdown region of the sensor. Using the measurements and simulations, the evolution of the electric field, carrier densities and avalanche breakdown in the periphery of p-bulk silicon sensors is presented.


title: WeakSurg: Weakly supervised surgical instrument segmentation using temporal equivariance and semantic continuity

abstract: Weakly supervised surgical instrument segmentation with only instrument presence labels has been rarely explored in surgical domain. To mitigate the highly under-constrained challenges, we extend a two-stage weakly supervised segmentation paradigm with temporal attributes from two perspectives. From a temporal equivariance perspective, we propose a prototype-based temporal equivariance regulation loss to enhance pixel-wise consistency between adjacent features. From a semantic continuity perspective, we propose a class-aware temporal semantic continuity loss to constrain the semantic consistency between a global view of target frame and local non-discriminative regions of adjacent reference frame. To the best of our knowledge, WeakSurg is the first instrument-presence-only weakly supervised segmentation architecture to take temporal information into account for surgical scenarios. Extensive experiments are validated on Cholec80, an open benchmark for phase and instrument recognition. We annotate instance-wise instrument labels with fixed time-steps which are double checked by a clinician with 3-years experience. Our results show that WeakSurg compares favorably with state-of-the-art methods not only on semantic segmentation metrics but also on instance segmentation metrics.


title: "Are You Really Sure?" Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Making

abstract: In AI-assisted decision-making, it is crucial but challenging for humans to achieve appropriate reliance on AI. This paper approaches this problem from a human-centered perspective, "human self-confidence calibration". We begin by proposing an analytical framework to highlight the importance of calibrated human self-confidence. In our first study, we explore the relationship between human self-confidence appropriateness and reliance appropriateness. Then in our second study, We propose three calibration mechanisms and compare their effects on humans' self-confidence and user experience. Subsequently, our third study investigates the effects of self-confidence calibration on AI-assisted decision-making. Results show that calibrating human self-confidence enhances human-AI team performance and encourages more rational reliance on AI (in some aspects) compared to uncalibrated baselines. Finally, we discuss our main findings and provide implications for designing future AI-assisted decision-making interfaces.


title: A targeted radio pulsar survey of redback candidates with MeerKAT

abstract: Redbacks are millisecond pulsar binaries with low mass, irradiated companions. These systems have a rich phenomenology that can be used to probe binary evolution models, pulsar wind physics, and the neutron star mass distribution. A number of high-confidence redback candidates have been identified through searches for variable optical and X-ray sources within the localisation regions of unidentified but pulsar-like Fermi-LAT gamma-ray sources. However, these candidates remain unconfirmed until pulsations are detected. As part of the TRAPUM project, we searched for radio pulsations from six of these redback candidates with MeerKAT. We discovered three new radio millisecond pulsars, PSRs J0838$-$2527, J0955$-$3947 and J2333$-$5526, confirming their redback nature. PSR J0838$-$2827 remained undetected for two years after our discovery despite repeated observations, likely due to evaporated material absorbing the radio emission for long periods of time. While, to our knowledge, this system has not undergone a transition to an accreting state, the disappearance, likely caused by extreme eclipses, illustrates the transient nature of spider pulsars and the heavy selection bias in uncovering their radio population. Radio timing enabled the detection of gamma-ray pulsations from all three pulsars, from which we obtained 15-year timing solutions. All of these sources exhibit complex orbital period variations consistent with gravitational quadrupole moment variations in the companion stars. These timing solutions also constrain the binary mass ratios, allowing us to narrow down the pulsar masses. We find that PSR J2333$-$5526 may have a neutron star mass in excess of 2 M$_{\odot}$.


title: Cloud gap-filling with deep learning for improved grassland monitoring

abstract: Uninterrupted optical image time series are crucial for the timely monitoring of agricultural land changes. However, the continuity of such time series is often disrupted by clouds. In response to this challenge, we propose a deep learning method that integrates cloud-free optical (Sentinel-2) observations and weather-independent (Sentinel-1) Synthetic Aperture Radar (SAR) data, using a combined Convolutional Neural Network (CNN)-Recurrent Neural Network (RNN) architecture to generate continuous Normalized Difference Vegetation Index (NDVI) time series. We emphasize the significance of observation continuity by assessing the impact of the generated time series on the detection of grassland mowing events. We focus on Lithuania, a country characterized by extensive cloud coverage, and compare our approach with alternative interpolation techniques (i.e., linear, Akima, quadratic). Our method surpasses these techniques, with an average MAE of 0.024 and R^2 of 0.92. It not only improves the accuracy of event detection tasks by employing a continuous time series, but also effectively filters out sudden shifts and noise originating from cloudy observations that cloud masks often fail to detect.


title: Testing MOND on small bodies in the remote solar system

abstract: Modified Newtonian dynamics (MOND), which postulates a breakdown of Newton's laws of gravity/dynamics below some critical acceleration threshold, can explain many otherwise puzzling observational phenomena on galactic scales. MOND competes with the hypothesis of dark matter, which successfully explains the cosmic microwave background and large-scale structure. Here we provide the first solar-system test of MOND that probes the sub-critical acceleration regime. Using the Bekenstein-Milgrom AQUAL formulation, we simulate the evolution of myriads of test particles (planetesimals or comets) born in the trans-Neptunian region and scattered by the giant planets over the lifetime of the Sun to heliocentric distances of $10^2$-$10^5$ au. We include the effects of the Galactic tidal field and passing stars. While Newtonian simulations reproduce the distribution of binding energies of long-period and Oort-cloud comets detectable from Earth, MOND-based simulations do not. This conclusion is robust to plausible changes in the migration history of the planets, the migration history of the Sun, the MOND transition function, effects of the Sun's birth cluster, and the fading properties of long-period comets. For the most popular version of AQUAL, characterized by a gradual transition between the Newtonian and MOND regimes, our MOND-based simulations also fail to reproduce the orbital distribution of trans-Neptunian objects in the detached disk (perihelion > 38 au). Our results do not rule out some MOND theories more elaborate than AQUAL, in which non-Newtonian effects are screened on small spatial scales, at small masses, or in external gravitational fields comparable in strength to the critical acceleration.

categories: astro-ph.CO astro-ph.EP astro-ph.GA gr-qc


title: Memoryless concretization relation

abstract: We introduce the concept of memoryless concretization relation (MCR) to describe abstraction within the context of controller synthesis. This relation is a specific instance of alternating simulation relation (ASR), where it is possible to simplify the controller architecture. In the case of ASR, the concretized controller needs to simulate the concurrent evolution of two systems, the original and abstract systems, while for MCR, the designed controllers only need knowledge of the current concrete state. We demonstrate that the distinction between ASR and MCR becomes significant only when a non-deterministic quantizer is involved, such as in cases where the state space discretization consists of overlapping cells. We also show that any abstraction of a system that alternatingly simulates a system can be completed to satisfy MCR at the expense of increasing the non-determinism in the abstraction. We clarify the difference between the MCR and the feedback refinement relation (FRR), showing in particular that the former allows for non-constant controllers within cells. This provides greater flexibility in constructing a practical abstraction, for instance, by reducing non-determinism in the abstraction. Finally, we prove that this relation is not only sufficient, but also necessary, for ensuring the above properties.


title: The K-moduli space of a family of conic bundle threefolds

abstract: We describe the 6-dimensional compact K-moduli space of Fano threefolds in deformation family No 2.18. These Fano threefolds are double covers of $\mathbb P^1\times\mathbb P^2$ branched along smooth $(2,2)$-surfaces, and Cheltsov--Fujita--Kishimoto--Park proved that any smooth Fano threefold in this family is K-stable. A member of family No 2.18 admits the structures of a conic bundle and a quadric surface bundle. We prove that K-polystable limits of these Fano threefolds admit conic bundle structures, but not necessarily del Pezzo fibration structures. We study this K-moduli space via the moduli space of log Fano pairs $(\mathbb P^1\times\mathbb P^2, c R)$ for $c=1/2$ and $R$ a $(2,2)$-divisor, which we construct using wall-crossings. In the case where the divisor is proportional to the anti-canonical divisor, the first author, together with Ascher and Liu, developed a framework for wall crossings in K-moduli and proved that there are only finitely many walls, which occur at rational values of the coefficient $c$. This paper constructs the first example of wall-crossing in K-moduli in the non-proportional setting, and we find a wall at an irrational value of $c$. In particular, we obtain explicit descriptions of the GIT and K-moduli spaces (for $c \leq 1/2$) of these $(2,2)$-divisors. Furthermore, using the conic bundle structure, we study the relationship with the GIT moduli space of plane quartic curves.


title: Cosmologically Consistent Analysis of Gravitational Waves from hidden sectors

abstract: Production of gravitational waves in the early universe is discussed in a cosmologically consistent analysis within a first order phase transition involving a hidden sector feebly coupled with the visible sector. Each sector resides in its own heat bath leading to a potential dependent on two temperatures, and on two fields: one a standard model Higgs and the other a scalar arising from a hidden sector $U(1)$ gauge theory. A synchronous evolution of the hidden and visible sector temperatures is carried out from the reheat temperature down to the electroweak scale.The hydrodynamics of two-field phase transitions, one for the visible and the other for the hidden is discussed, which leads to separate tunneling temperatures, and different sound speeds for the two sectors. Gravitational waves emerging from the two sectors are computed and their imprint on the measured gravitational wave power spectrum vs frequency is analyzed in terms of bubble nucleation signature, i.e., detonation, deflagration, and hybrid. It is shown that the two-field model predicts gravitational waves accessible at several proposed gravitational wave detectors: LISA, DECIGO, BBO, Taiji and their discovery would probe specific regions of the hidden sector parameter space and may also shed light on the nature of bubble nucleation in the early universe. The analysis presented here indicates that the cosmologically preferred models are those where the tunneling in the visible sector precedes the tunneling in the hidden sector and the sound speed $c_s$ lies below its maximum, i.e., $c^2_s<\frac{1}{3}$. It is of interest to investigate if these features are universal and applicable to a wider class of cosmologically consistent models.


title: Less is More: Data Value Estimation for Visual Instruction Tuning

abstract: Visual instruction tuning is the key to building multimodal large language models (MLLMs), which greatly improves the reasoning capabilities of large language models (LLMs) in vision scenario. However, existing MLLMs mostly rely on a mixture of multiple highly diverse visual instruction datasets for training (even more than a million instructions), which may introduce data redundancy. To investigate this issue, we conduct a series of empirical studies, which reveal a significant redundancy within the visual instruction datasets, and show that greatly reducing the amount of several instruction dataset even do not affect the performance. Based on the findings, we propose a new data selection approach TIVE, to eliminate redundancy within visual instruction data. TIVE first estimates the task-level and instance-level value of the visual instructions based on computed gradients. Then, according to the estimated values, TIVE determines the task proportion within the visual instructions, and selects representative instances to compose a smaller visual instruction subset for training. Experiments on LLaVA-1.5 show that our approach using only about 7.5% data can achieve comparable performance as the full-data fine-tuned model across seven benchmarks, even surpassing it on four of the benchmarks. Our code and data will be publicly released.


title: Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction

abstract: Predicting the mean-field Hamiltonian matrix in density functional theory is a fundamental formulation to leverage machine learning for solving molecular science problems. Yet, its applicability is limited by insufficient labeled data for training. In this work, we highlight that Hamiltonian prediction possesses a self-consistency principle, based on which we propose self-consistency training, an exact training method that does not require labeled data. It distinguishes the task from predicting other molecular properties by the following benefits: (1) it enables the model to be trained on a large amount of unlabeled data, hence addresses the data scarcity challenge and enhances generalization; (2) it is more efficient than running DFT to generate labels for supervised training, since it amortizes DFT calculation over a set of queries. We empirically demonstrate the better generalization in data-scarce and out-of-distribution scenarios, and the better efficiency over DFT labeling. These benefits push forward the applicability of Hamiltonian prediction to an ever-larger scale.


title: Characterization of Polarimetric Properties in Various Brain Tumor Types Using Wide-Field Imaging Mueller Polarimetry

abstract: Neuro-oncological surgery is the primary brain cancer treatment, yet it faces challenges with gliomas due to their invasiveness and the need to preserve neurological function. Hence, radical resection is often unfeasible, highlighting the importance of precise tumor margin delineation to prevent neurological deficits and improve prognosis. Imaging Mueller polarimetry, an effective modality in various organ tissues, seems a promising approach for tumor delineation in neurosurgery. To further assess its use, we characterized the polarimetric properties by analysing 45 polarimetric measurements of 27 fresh brain tumor samples, including different tumor types with a strong focus on gliomas. Our study integrates a wide-field imaging Mueller polarimetric system and a novel neuropathology protocol, correlating polarimetric and histological data for accurate tissue identification. An image processing pipeline facilitated the alignment and overlay of polarimetric images and histological masks. Variations in depolarization values were observed for grey and white matter of brain tumor tissue, while differences in linear retardance were seen only within white matter of brain tumor tissue. Notably, we identified pronounced optical axis azimuth randomization within tumor regions. This study lays the foundation for machine learning-based brain tumor segmentation algorithms using polarimetric data, facilitating intraoperative diagnosis and decision making.


title: PreCurious: How Innocent Pre-Trained Language Models Turn into Privacy Traps

abstract: The pre-training and fine-tuning paradigm has demonstrated its effectiveness and has become the standard approach for tailoring language models to various tasks. Currently, community-based platforms offer easy access to various pre-trained models, as anyone can publish without strict validation processes. However, a released pre-trained model can be a privacy trap for fine-tuning datasets if it is carefully designed. In this work, we propose PreCurious framework to reveal the new attack surface where the attacker releases the pre-trained model and gets a black-box access to the final fine-tuned model. PreCurious aims to escalate the general privacy risk of both membership inference and data extraction. The key intuition behind PreCurious is to manipulate the memorization stage of the pre-trained model and guide fine-tuning with a seemingly legitimate configuration. The effectiveness of defending against privacy attacks on a fine-tuned model seems promising, as empirical and theoretical evidence suggests that parameter-efficient and differentially private fine-tuning techniques are invulnerable to privacy attacks. But PreCurious demonstrates the possibility of breaking up invulnerability in a stealthy manner compared to fine-tuning on a benign model. By further leveraging a sanitized dataset, PreCurious can extract originally unexposed secrets under differentially private fine-tuning. Thus, PreCurious raises warnings for users who download pre-trained models from unknown sources, rely solely on tutorials or common-sense defenses, and previously release sanitized datasets even after perfect scrubbing.


title: A perturbative approach to the non-relativistic string spectrum

abstract: In this letter we use a perturbative approach to find the spectrum of non-relativistic strings in the String Newton-Cartan (SNC) AdS$_5\times$S$^5$ spacetime. We perturb the bosonic sector of the action around a BMN-like folded string solution in light-cone gauge. We find strong evidence that the theory is described by a combination of massive and massless free fields in an anti-de Sitter background by showing that interaction terms up to six scalars vanish after field redefinitions.


title: Comments on the quantitative uniqueness of continuation for evolution equations

abstract: We establish near-optimal quantitative uniqueness of continuation for solutions of evolution equations vanishing on the lateral boundary. These results were obtained simply by combining existing observability inequalities and energy estimates.


title: Welcome Your New AI Teammate: On Safety Analysis by Leashing Large Language Models

abstract: DevOps is a necessity in many industries, including the development of Autonomous Vehicles. In those settings, there are iterative activities that reduce the speed of SafetyOps cycles. One of these activities is "Hazard Analysis & Risk Assessment" (HARA), which is an essential step to start the safety requirements specification. As a potential approach to increase the speed of this step in SafetyOps, we have delved into the capabilities of Large Language Models (LLMs). Our objective is to systematically assess their potential for application in the field of safety engineering. To that end, we propose a framework to support a higher degree of automation of HARA with LLMs. Despite our endeavors to automate as much of the process as possible, expert review remains crucial to ensure the validity and correctness of the analysis results, with necessary modifications made accordingly.


title: PaperBot: Learning to Design Real-World Tools Using Paper

abstract: Paper is a cheap, recyclable, and clean material that is often used to make practical tools. Traditional tool design either relies on simulation or physical analysis, which is often inaccurate and time-consuming. In this paper, we propose PaperBot, an approach that directly learns to design and use a tool in the real world using paper without human intervention. We demonstrated the effectiveness and efficiency of PaperBot on two tool design tasks: 1. learning to fold and throw paper airplanes for maximum travel distance 2. learning to cut paper into grippers that exert maximum gripping force. We present a self-supervised learning framework that learns to perform a sequence of folding, cutting, and dynamic manipulation actions in order to optimize the design and use of a tool. We deploy our system to a real-world two-arm robotic system to solve challenging design tasks that involve aerodynamics (paper airplane) and friction (paper gripper) that are impossible to simulate accurately.


title: Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Models

abstract: The deployment of autonomous agents in environments involving human interaction has increasingly raised security concerns. Consequently, understanding the circumstances behind an event becomes critical, requiring the development of capabilities to justify their behaviors to non-expert users. Such explanations are essential in enhancing trustworthiness and safety, acting as a preventive measure against failures, errors, and misunderstandings. Additionally, they contribute to improving communication, bridging the gap between the agent and the user, thereby improving the effectiveness of their interactions. This work presents an accountability and explainability architecture implemented for ROS-based mobile robots. The proposed solution consists of two main components. Firstly, a black box-like element to provide accountability, featuring anti-tampering properties achieved through blockchain technology. Secondly, a component in charge of generating natural language explanations by harnessing the capabilities of Large Language Models (LLMs) over the data contained within the previously mentioned black box. The study evaluates the performance of our solution in three different scenarios, each involving autonomous agent navigation functionalities. This evaluation includes a thorough examination of accountability and explainability metrics, demonstrating the effectiveness of our approach in using accountable data from robot actions to obtain coherent, accurate and understandable explanations, even when facing challenges inherent in the use of autonomous agents in real-world scenarios.


title: Determining stellar accretion rates from $Pa_{\alpha}$ and $Br_{\beta}$ emission lines with JWST NIRSpec

abstract: In this letter we present the first systematic spectroscopic measurements of the Near-InfraRed (NIR) hydrogen recombination lines Paschen alpha ($Pa_{\alpha}$ $\lambda = 1.875 \mu m$) and Brackett beta ($Br_{\beta}$ $\lambda = 2.626 \mu m$), produced by pre-main-sequence (PMS) stars. These stars, consisting of T Tauri and Herbig AeBe stars are located in the massive Galactic star-formation region NGC 3603. The measurements were obtained from JWST NIRSpec, using multi-object spectroscopy (MOS) mode. Utilising existing empirical relations between $L_{acc}$ and $L_{Br_{\gamma}}$, we have used our new measurements to formulate, for the first time, an empirical relationship between the accretion luminosity $L_{acc}$ of the stars, and the line luminosities $L_{line}$ of both $Pa_{\alpha}$ and $Br_{\beta}$. These relationships are: $\log_{10}( \frac{L_{acc}}{L_{\odot}}) = 1.42 (\pm 0.18) \times \log_{10}( \frac{L_{Pa_{\alpha}}}{L_{\odot}}) + 3.33 (\pm 0.42)$ and $\log_{10}( \frac{L_{acc}}{L_{\odot}}) = 1.47 (\pm 0.18) \times \log_{10}( \frac{L_{Br_{\beta}}}{L_{\odot}}) + 4.60 (\pm 0.57)$. These new relationships are key for roughly estimating the accretion rates for large samples of PMS stars with JWST.


title: Non-Hermitian Persistent Current Transport

abstract: Persistent currents circulate continuously without requiring external power sources. Here, we extend their theory to include dissipation within the framework of non-Hermitian quantum Hamiltonians. Using Green's function formalism, we introduce a non-Hermitian Fermi-Dirac distribution and derive an analytical expression for the persistent current that relies solely on the complex spectrum. We apply our formula to two dissipative models supporting persistent currents: ($i$) a phase-biased superconducting-normal-superconducting junction; ($ii$) a normal ring threaded by a magnetic flux. We show that the persistent currents in both systems exhibit no anomalies at any emergent exceptional points, whose signatures are only discernible in the current susceptibility. We validate our findings by exact diagonalization and extend them to account for finite temperatures and interaction effects. Our formalism offers a general framework for computing quantum many-body observables of non-Hermitian systems in equilibrium, with potential extensions to non-equilibrium scenarios.

categories: quant-ph cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el cond-mat.supr-con


title: Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Search

abstract: In many applications, ranging from logistics to engineering, a designer is faced with a sequence of optimization tasks for which the objectives are in the form of black-box functions that are costly to evaluate. For example, the designer may need to tune the hyperparameters of neural network models for different learning tasks over time. Rather than evaluating the objective function for each candidate solution, the designer may have access to approximations of the objective functions, for which higher-fidelity evaluations entail a larger cost. Existing multi-fidelity black-box optimization strategies select candidate solutions and fidelity levels with the goal of maximizing the information accrued about the optimal value or solution for the current task. Assuming that successive optimization tasks are related, this paper introduces a novel information-theoretic acquisition function that balances the need to acquire information about the current task with the goal of collecting information transferable to future tasks. The proposed method includes shared inter-task latent variables, which are transferred across tasks by implementing particle-based variational Bayesian updates. Experimental results across synthetic and real-world examples reveal that the proposed provident acquisition strategy that caters to future tasks can significantly improve the optimization efficiency as soon as a sufficient number of tasks is processed.


title: Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis

abstract: The tremendous hype around autonomous driving is eagerly calling for emerging and novel technologies to support advanced mobility use cases. As car manufactures keep developing SAE level 3+ systems to improve the safety and comfort of passengers, traffic authorities need to establish new procedures to manage the transition from human-driven to fully-autonomous vehicles while providing a feedback-loop mechanism to fine-tune envisioned autonomous systems. Thus, a way to automatically profile autonomous vehicles and differentiate those from human-driven ones is a must. In this paper, we present a fully-fledged framework that monitors active vehicles using camera images and state information in order to determine whether vehicles are autonomous, without requiring any active notification from the vehicles themselves. Essentially, it builds on the cooperation among vehicles, which share their data acquired on the road feeding a machine learning model to identify autonomous cars. We extensively tested our solution and created the NexusStreet dataset, by means of the CARLA simulator, employing an autonomous driving control agent and a steering wheel maneuvered by licensed drivers. Experiments show it is possible to discriminate the two behaviors by analyzing video clips with an accuracy of 80%, which improves up to 93% when the target state information is available. Lastly, we deliberately degraded the state to observe how the framework performs under non-ideal data collection conditions.


title: Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text Transformation

abstract: Multimodal large language models (MLLMs) have shown impressive reasoning abilities, which, however, are also more vulnerable to jailbreak attacks than their LLM predecessors. Although still capable of detecting unsafe responses, we observe that safety mechanisms of the pre-aligned LLMs in MLLMs can be easily bypassed due to the introduction of image features. To construct robust MLLMs, we propose ECSO(Eyes Closed, Safety On), a novel training-free protecting approach that exploits the inherent safety awareness of MLLMs, and generates safer responses via adaptively transforming unsafe images into texts to activate intrinsic safety mechanism of pre-aligned LLMs in MLLMs. Experiments on five state-of-the-art (SoTA) MLLMs demonstrate that our ECSO enhances model safety significantly (e.g., a 37.6% improvement on the MM-SafetyBench (SD+OCR), and 71.3% on VLSafe for the LLaVA-1.5-7B), while consistently maintaining utility results on common MLLM benchmarks. Furthermore, we show that ECSO can be used as a data engine to generate supervised-finetuning (SFT) data for MLLM alignment without extra human intervention.


title: Learning High-Order Control Barrier Functions for Safety-Critical Control with Gaussian Processes

abstract: Control barrier functions (CBFs) have recently introduced a systematic tool to ensure system safety by establishing set invariance. When combined with a nominal control strategy, they form a safety-critical control mechanism. However, the effectiveness of CBFs is closely tied to the system model. In practice, model uncertainty can compromise safety guarantees and may lead to conservative safety constraints, or conversely, allow the system to operate in unsafe regions. In this paper, we use Gaussian processes to mitigate the adverse effects of uncertainty on high-order CBFs (HOCBFs). A properly structured covariance function enables us to convert the chance constraints of HOCBFs into a second-order cone constraint. This results in a convex constrained optimization as a safety filter. We analyze the feasibility of the resulting optimization and provide the necessary and sufficient conditions for feasibility. The effectiveness of the proposed strategy is validated through two numerical results.


title: Scalable Parity Architecture With a Shuttling-Based Spin Qubit Processor

abstract: Motivated by the prospect of a two-dimensional square-lattice geometry for semiconductor spin qubits, we explore the realization of the Parity Architecture with quantum dots (QDs). This is part of the endeavor of developing architectures that advance the utilization of spin qubits for quantum computing while harnessing their advantages, such as their fast timescales -- especially of the nearest-neighbor interaction -- and small size. We present sequences of spin shuttling and quantum gates that implement the Parity Quantum Approximate Optimization Algorithm (QAOA) on a lattice constructed of identical unit cells, where the circuit depth is independent of the problem Hamiltonian and the system size. We further develop an error model, including a general description of the shuttling errors as a function of the probability distribution function of the valley splitting, and estimate the errors during one round of Parity QAOA, which is mainly limited by the valley splitting. Finally, we discuss the possibility of decoding the logical quantum state and of quantum error mitigation. We find that already with near-term spin qubit devices a sufficiently low physical error probability can be expected to reliably perform Parity QAOA with a short depth in a regime where the success probability compares favorably to standard QAOA.


title: Angle estimation using mmWave RSS measurements with enhanced multipath information

abstract: mmWave communication has come up as the unexplored spectrum for 5G services. With new standards for 5G NR positioning, more off-the-shelf platforms and algorithms are needed to perform indoor positioning. An object can be accurately positioned in a room either by using an angle and a delay estimate or two angle estimates or three delay estimates. We propose an algorithm to jointly estimate the angle of arrival (AoA) and angle of departure (AoD), based only on the received signal strength (RSS). We use mm-FLEX, an experimentation platform developed by IMDEA Networks Institute that can perform real-time signal processing for experimental validation of our proposed algorithm. Codebook-based beampatterns are used with a uniquely placed multi-antenna array setup to enhance the reception of multipath components and we obtain an AoA estimate per receiver thereby overcoming the line-of-sight (LoS) limitation of RSS-based localization systems. We further validate the results from measurements by emulating the setup with a simple ray-tracing approach.


title: On the high-temperature expansion of the thermal energy on Einstein cylinders

abstract: Some exact high temperature expansions are derived using a temperature inversion symmetry of the internal energy for conformal scalars and spinors on the Einstein Universe.


title: The NeRFect Match: Exploring NeRF Features for Visual Localization

abstract: In this work, we propose the use of Neural Radiance Fields (NeRF) as a scene representation for visual localization. Recently, NeRF has been employed to enhance pose regression and scene coordinate regression models by augmenting the training database, providing auxiliary supervision through rendered images, or serving as an iterative refinement module. We extend its recognized advantages -- its ability to provide a compact scene representation with realistic appearances and accurate geometry -- by exploring the potential of NeRF's internal features in establishing precise 2D-3D matches for localization. To this end, we conduct a comprehensive examination of NeRF's implicit knowledge, acquired through view synthesis, for matching under various conditions. This includes exploring different matching network architectures, extracting encoder features at multiple layers, and varying training configurations. Significantly, we introduce NeRFMatch, an advanced 2D-3D matching function that capitalizes on the internal knowledge of NeRF learned via view synthesis. Our evaluation of NeRFMatch on standard localization benchmarks, within a structure-based pipeline, sets a new state-of-the-art for localization performance on Cambridge Landmarks.


title: Commutation principles for nonsmooth variational problems on Euclidean Jordan algebras

abstract: The commutation principle proved by Ram\'irez, Seeger, and Sossa (SIAM J Optim 23:687-694, 2013) in the setting of Euclidean Jordan algebras says that for a Fr\'echet differentiable function $\Theta$ and a spectral function $F$, any local minimizer or maximizer $a$ of $\Theta+F$ over a spectral set $\mathcal{E}$ operator commutes with the gradient of $\Theta$ at $a$. In this paper, we improve this commutation principle by allowing $\Theta$ to be nonsmooth with mild regularity assumptions over it. For example, for the case of local minimizer, we show that $a$ operator commutes with some element of the limiting (Mordukhovich) subdifferential of $\Theta$ at $a$ provided that $\Theta$ is subdifferentially regular at $a$ satisfying a qualification condition. For the case of local maximizer, we prove that $a$ operator commutes with each element of the (Fenchel) subdifferential of $\Theta$ at $a$ whenever this subdifferential is nonempty. As an application, we characterize the local optimizers of shifted strictly convex spectral functions and norms over automorphism invariant sets.


title: uaMix-MAE: Efficient Tuning of Pretrained Audio Transformers with Unsupervised Audio Mixtures

abstract: Masked Autoencoders (MAEs) learn rich low-level representations from unlabeled data but require substantial labeled data to effectively adapt to downstream tasks. Conversely, Instance Discrimination (ID) emphasizes high-level semantics, offering a potential solution to alleviate annotation requirements in MAEs. Although combining these two approaches can address downstream tasks with limited labeled data, naively integrating ID into MAEs leads to extended training times and high computational costs. To address this challenge, we introduce uaMix-MAE, an efficient ID tuning strategy that leverages unsupervised audio mixtures. Utilizing contrastive tuning, uaMix-MAE aligns the representations of pretrained MAEs, thereby facilitating effective adaptation to task-specific semantics. To optimize the model with small amounts of unlabeled data, we propose an audio mixing technique that manipulates audio samples in both input and virtual label spaces. Experiments in low/few-shot settings demonstrate that \modelname achieves 4-6% accuracy improvements over various benchmarks when tuned with limited unlabeled data, such as AudioSet-20K. Code is available at https://github.com/PLAN-Lab/uamix-MAE