title: EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languages

abstract: Formal mathematics is the discipline of translating mathematics into a programming language in which any statement can be unequivocally checked by a computer. Mathematicians and computer scientists have spent decades of painstaking formalization efforts developing languages such as Coq, HOL, and Lean. Machine learning research has converged on these formal math corpora and given rise to an assortment of methodologies to aid in interactive and automated theorem proving. However, these papers have primarily focused on one method, for one proof task, in one language. This paper introduces EvoGPT-f: a novel evolutionary framework for the first systematic quantitative analysis of the differential machine learnability of five formal math corpora (Lean 3, Lean 4, Coq, HOL 4, HOL Light) using four tokenization methods (character, word-level, Byte Pair Encoding and StarCoder tokenizer). This paper does not put to rest the question of the "best" or "easiest" language to learn. Rather, this framework and preliminary findings begin to illuminate the differential machine learnability of these languages, offering a foundation to forge more systematic quantitative and qualitative comparative research across communities.


title: Broadband transverse susceptibility in multiferroic Y-type hexaferrite Ba$_{0.5}$Sr$_{1.5}$Co$_2$Fe$_{12}$O${22}$

abstract: Single phase multiferroics in which ordered magnetic and ferroelectricity coexist, are of great interest for new multifunctional devices, and among them Y-type hexaferrites are good candidates. Transverse susceptibility measurements, which have been proved to be a versatile tool to study singular properties of bulk and nanoparticle magnetic systems, have been carried out with a broadband system on polycrystalline Y type hexaferrites with composition Ba$_{0.5}$Sr$_{1.5}$Co$_2$Fe$_{12}$O${22}$, optimal to exhibit multiferroic properties. In the temperature range 80-350 K transverse susceptibility measurements with DC fields up to $\pm$5000 Oe reveal different behaviour depending on the sintering temperature. The thermal evolution of the anisotropy field peak exhibit four regions with different slopes: positive in 80-130 K, negative in 130-200 K, constant in 200-280 K and negative in 280-350 K, which can be considered a signature of spin transitions in this compound.


title: BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation

abstract: Large language models (LLMs) have demonstrated outstanding performance in various tasks, such as text summarization, text question-answering, and etc. While their performance is impressive, the computational footprint due to their vast number of parameters can be prohibitive. Existing solutions such as SparseGPT and Wanda attempt to alleviate this issue through weight pruning. However, their layer-wise approach results in significant perturbation to the model's output and requires meticulous hyperparameter tuning, such as the pruning rate, which can adversely affect overall model performance. To address this, this paper introduces a novel LLM pruning technique dubbed blockwise parameter-efficient sparsity allocation (BESA) by applying a blockwise reconstruction loss. In contrast to the typical layer-wise pruning techniques, BESA is characterized by two distinctive attributes: i) it targets the overall pruning error with respect to individual transformer blocks, and ii) it allocates layer-specific sparsity in a differentiable manner, both of which ensure reduced performance degradation after pruning. Our experiments show that BESA achieves state-of-the-art performance, efficiently pruning LLMs like LLaMA1, and LLaMA2 with 7B to 70B parameters on a single A100 GPU in just five hours. Code is available at https://github.com/OpenGVLab/LLMPrune-BESA.


title: Frequency-Dependent Vibronic Effects in Steady State Energy Transport

abstract: The interplay between electronic and intramolecular high-frequency vibrational degrees of freedom is ubiquitous in natural light-harvesting systems. Recent studies have indicated that an intramolecular vibrational donor-acceptor frequency difference can enhance energy transport. Here, we analyze the extent to which different intramolecular donor-acceptor vibrational frequencies affect excitation energy transport in equilibrium (coherent light excitation) and the more natural nonequilibrium steady state (incoherent light excitation) configurations. It is found that if the Huang-Rhys factors remain constant, the acceptor population increases when the intramolecular vibrational frequency of the acceptor exceeds that of the donor. The increase in the acceptor population due to the vibrational frequency difference is higher for higher values of the Huang-Rhys factors or the vibronic coupling strengths. However, the nonequilibrium steady state results show that the vibrational donor-acceptor frequency difference does not significantly enhance energy transport in the natural scenario of incoherent light excitation and under biologically relevant parameters. Insight about a potential mechanism to optimize energy transfer in the NESS based on increasing the harvesting time at the reaction center is analyzed.


title: Substrate Scope Contrastive Learning: Repurposing Human Bias to Learn Atomic Representations

abstract: Learning molecular representation is a critical step in molecular machine learning that significantly influences modeling success, particularly in data-scarce situations. The concept of broadly pre-training neural networks has advanced fields such as computer vision, natural language processing, and protein engineering. However, similar approaches for small organic molecules have not achieved comparable success. In this work, we introduce a novel pre-training strategy, substrate scope contrastive learning, which learns atomic representations tailored to chemical reactivity. This method considers the grouping of substrates and their yields in published substrate scope tables as a measure of their similarity or dissimilarity in terms of chemical reactivity. We focus on 20,798 aryl halides in the CAS Content Collection spanning thousands of publications to learn a representation of aryl halide reactivity. We validate our pre-training approach through both intuitive visualizations and comparisons to traditional reactivity descriptors and physical organic chemistry principles. The versatility of these embeddings is further evidenced in their application to yield prediction, regioselectivity prediction, and the diverse selection of new substrates. This work not only presents a chemistry-tailored neural network pre-training strategy to learn reactivity-aligned atomic representations, but also marks a first-of-its-kind approach to benefit from the human bias in substrate scope design.


title: Impact of periodic vaccination in SEIRS seasonal model

abstract: We study three different strategies of vaccination in a SEIRS (Susceptible--Exposed--Infected--Recovered--Susceptible) seasonal forced model, which are: ($i$) continuous vaccination; ($ii$) periodic short time localized vaccination and ($iii$) periodic pulsed width campaign. Considering the first strategy, we obtain an expression for the basic reproduction number and infer a minimum vaccination rate necessary to ensure the stability of the disease-free equilibrium (DFE) solution. In the second strategy, the short duration pulses are added to a constant baseline vaccination rate. The pulse is applied according to the seasonal forcing phases. The best outcome is obtained by locating the intensive immunization at inflection of the transmissivity curve. There, a vaccination rate of $44.4\%$ of susceptible individuals is enough to ensure DFE. For the third vaccination proposal, additionally to the amplitude, the pulses have a prolonged time width. We obtain a non-linear relationship between vaccination rates and the duration of the campaign. Our simulations show that the baseline rates, as well as the pulse duration, can substantially improve the vaccination campaign effectiveness. These findings are in agreement with our analytical expression. We show a relationship between the vaccination parameters and the accumulated number of infected individuals, over the years and show the relevance of the immunisation campaign annual reaching for controlling the infection spreading. Regarding the dynamical behaviour of the model, our simulations shows that chaotic and periodic solutions, as well as bi-stable regions, depend on the vaccination parameters range.


title: Submanifolds with boundary and corners in Delzant polytopes associated to affine subspaces

abstract: In the previous paper, we studied the compactification of a complex subtorus given from an affine subspace in $\mathfrak{t}^{n} \cong \mathbb{R}^{n}$ to a toric manifold. If the compactification of the complex subtorus is a smooth complex submanifold in the toric manifold, then we called such submanifold a torus-equivalently embedded toric manifold with respect to the subtorus action determined by the data of the affine subspace. In this paper, we construct certain submanifolds with boundary and corners in a Delzant polytope of the toric manifold from the affine subspaces and show that the conditions for such submanifolds with boundary are equivalent to those for torus-equivalently embedded toric manifolds.


title: Effects of anisotropy in an anisotropic extension of $w$CDM model

abstract: In this paper, we derive observational constraints on an anisotropic $w$CDM model from observational data including Baryonic Acoustic Oscillations (BAOs), Cosmic Chronometer (CC), Big Bang Nucleosynthesis (BBN), Pantheon Plus (PP) compilation of Type Ia supernovae, and SH0ES Cepheid host distance anchors. We find that anisotropy is of the order $10^{-13}$, and its presence in the $w$CDM model reduces $H_0$ tension by $\sim 2\sigma$ and $\sim 1\sigma$ in the analyses with BAO+CC+BBN+PP and BAO+CC+BBN+PPSH0ES data combinations, respectively. In both analyses, the quintessence form of dark energy is favored at 95\% CL.


title: Using text embedding models and vector databases as text classifiers with the example of medical data

abstract: The advent of Large Language Models (LLMs) is promising and has found application in numerous fields, but as it often is with the medical field, the bar is typically quite high [5]. In tandem with LLMs, vector embedding models and vector databases provide a robust way of expressing numerous modes of data that are easily digestible by typical machine learning models. Along with the ease of adding information, knowledge, and data to these vector databases, they provide a compelling reason to apply them in numerous fields where the task of retrieving information is typically done by humans. Researchers at Google have developed a clear alternative model, Med-PaLM [6] specifically designed to match a clinician's level of accuracy when it comes to medical knowledge. When training classifiers, and developing models, it is imperative to maintain factuality and reduce bias [4]. Here, we explore the use of vector databases and embedding models as a means of encoding, and classifying text with the example and application in the field of medicine. We show the robustness of these tools depends heavily on the sparsity of the data presented, and even with low amounts of data in the vector database itself, the vector database does a good job at classifying data [9]. Using various LLMs to generate the medical data, we also understand the limitations of the medical knowledge of these models and encourage further expert medical review of our testing data. By using vector databases to classify a clinician's notes on a patient presented with a certain ailment, we understand the limitations of such methods, but also the promise of their prospective use and with continued testing and experimentation, hope to explore a unique use case of vector databases and embedding models.


title: Artificial Intelligence for Complex Network: Potential, Methodology and Application

abstract: Complex networks pervade various real-world systems, from the natural environment to human societies. The essence of these networks is in their ability to transition and evolve from microscopic disorder-where network topology and node dynamics intertwine-to a macroscopic order characterized by certain collective behaviors. Over the past two decades, complex network science has significantly enhanced our understanding of the statistical mechanics, structures, and dynamics underlying real-world networks. Despite these advancements, there remain considerable challenges in exploring more realistic systems and enhancing practical applications. The emergence of artificial intelligence (AI) technologies, coupled with the abundance of diverse real-world network data, has heralded a new era in complex network science research. This survey aims to systematically address the potential advantages of AI in overcoming the lingering challenges of complex network research. It endeavors to summarize the pivotal research problems and provide an exhaustive review of the corresponding methodologies and applications. Through this comprehensive survey-the first of its kind on AI for complex networks-we expect to provide valuable insights that will drive further research and advancement in this interdisciplinary field.


title: Chaotic attractor reconstruction using small reservoirs -- the influence of topology

abstract: Forecasting timeseries based upon measured data is needed in a wide range of applications and has been the subject of extensive research. A particularly challenging task is the forecasting of timeseries generated by chaotic dynamics. In recent years reservoir computing has been shown to be an effective method of forecasting chaotic dynamics and reconstructing chaotic attractors from data. In this work strides are made toward smaller and lower complexity reservoirs with the goal of improved hardware implementability and more reliable production of adequate surrogate models. We show that a reservoir of uncoupled nodes more reliably produces long term timeseries predictions than complex reservoir topologies. We then link the improved attractor reconstruction of the uncoupled reservoir with smaller spectral radii of the resulting surrogate systems. These results indicate that, the node degree plays an important role in determining whether the desired dynamics will be stable in the autonomous surrogate system which is attained via closed-loop operation of the trained reservoir. In terms of hardware implementability, uncoupled nodes would allow for greater freedom in the hardware architecture because no complex coupling setups are needed and because, for uncoupled nodes, the system response is equivalent for space and time multiplexing.

categories: cs.LG cs.ET math-ph math.MP nlin.CD physics.comp-ph


title: Generative Models are Self-Watermarked: Declaring Model Authentication through Re-Generation

abstract: As machine- and AI-generated content proliferates, protecting the intellectual property of generative models has become imperative, yet verifying data ownership poses formidable challenges, particularly in cases of unauthorized reuse of generated data. The challenge of verifying data ownership is further amplified by using Machine Learning as a Service (MLaaS), which often functions as a black-box system. Our work is dedicated to detecting data reuse from even an individual sample. Traditionally, watermarking has been leveraged to detect AI-generated content. However, unlike watermarking techniques that embed additional information as triggers into models or generated content, potentially compromising output quality, our approach identifies latent fingerprints inherently present within the outputs through re-generation. We propose an explainable verification procedure that attributes data ownership through re-generation, and further amplifies these fingerprints in the generative models through iterative data re-generation. This methodology is theoretically grounded and demonstrates viability and robustness using recent advanced text and image generative models. Our methodology is significant as it goes beyond protecting the intellectual property of APIs and addresses important issues such as the spread of misinformation and academic misconduct. It provides a useful tool to ensure the integrity of sources and authorship, expanding its application in different scenarios where authenticity and ownership verification are essential.


title: Moving load on a floating ice layer

abstract: This manuscript investigates the deformation of ice layers under a moving block, focusing on the theoretical framework and mathematical models that describe the mechanical and thermal properties of ice and its interaction with underlying water. It delves into the formulation of the problem, discussing the assumptions and conditions applied, such as neglecting gravitational forces and considering ice's mechanical properties to be functions of spatial coordinates. The document extensively reviews ice mechanical properties, the application of Lam\'e's equations for an inhomogeneous medium, and the International Equation of State of Seawater to establish a comprehensive model. It further explores linear acoustics in perfect fluids, employing Fourier transform techniques for analytical solutions. The study aims to contribute to our understanding of ice sheet dynamics under moving loads, which is relevant for engineering and environmental studies in cold regions.


title: Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalization

abstract: Vehicle routing problems (VRPs), which can be found in numerous real-world applications, have been an important research topic for several decades. Recently, the neural combinatorial optimization (NCO) approach that leverages a learning-based model to solve VRPs without manual algorithm design has gained substantial attention. However, current NCO methods typically require building one model for each routing problem, which significantly hinders their practical application for real-world industry problems with diverse attributes. In this work, we make the first attempt to tackle the crucial challenge of cross-problem generalization. In particular, we formulate VRPs as different combinations of a set of shared underlying attributes and solve them simultaneously via a single model through attribute composition. In this way, our proposed model can successfully solve VRPs with unseen attribute combinations in a zero-shot generalization manner. Extensive experiments are conducted on eleven VRP variants, benchmark datasets, and industry logistic scenarios. The results show that the unified model demonstrates superior performance in the eleven VRPs, reducing the average gap to around 5% from over 20% in the existing approach and achieving a significant performance boost on benchmark datasets as well as a real-world logistics application. The source code is included in https://github.com/FeiLiu36/MTNCO.


title: Ultrafast excitonic dynamics in DNA: Bridging correlated quantum dynamics and sequence dependence

abstract: After photo-excitation of DNA, the excited electron (in the LUMO) and the remaining hole (in the HOMO) localized on the same DNA base form a bound pair, called the Frenkel exciton, due to their mutual Coulomb interaction. In this study, we demonstrate that a tight-binding (TB) approach, parametrized by ab initio data, allows to correlate relaxation properties, average charge separation, and dipole moments to a large ensemble of double-stranded DNA sequences (all 16,384 possible sequences with 14 nucleobases). This way, we are able to identify a relatively small sub-ensemble of sequences responsible for long-lived excited states, high average charge separation, and high dipole moment. Further analysis shows that these sequences are particularly T-rich. By systematically screening the impact of electron-hole interaction (Coulomb forces), we verify that these correlations are relatively robust against finite-size variations of the interaction parameter, not directly accessible experimentally. This methodology combines simulation methods from quantum physics and physical chemistry with statistical analysis known from genetics and epigenetics, thus representing a powerful bridge to combine information from both fields.


title: The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG)

abstract: Retrieval-augmented generation (RAG) is a powerful technique to facilitate language model with proprietary and private data, where data privacy is a pivotal concern. Whereas extensive research has demonstrated the privacy risks of large language models (LLMs), the RAG technique could potentially reshape the inherent behaviors of LLM generation, posing new privacy issues that are currently under-explored. In this work, we conduct extensive empirical studies with novel attack methods, which demonstrate the vulnerability of RAG systems on leaking the private retrieval database. Despite the new risk brought by RAG on the retrieval data, we further reveal that RAG can mitigate the leakage of the LLMs' training data. Overall, we provide new insights in this paper for privacy protection of retrieval-augmented LLMs, which benefit both LLMs and RAG systems builders. Our code is available at https://github.com/phycholosogy/RAG-privacy.


title: Topological Analysis of Mouse Brain Vasculature via 3D Light-sheet Microscopy Images

abstract: Vascular networks play a crucial role in understanding brain functionalities. Brain integrity and function, neuronal activity and plasticity, which are crucial for learning, are actively modulated by their local environments, specifically vascular networks. With recent developments in high-resolution 3D light-sheet microscopy imaging together with tissue processing techniques, it becomes feasible to obtain and examine large-scale brain vasculature in mice. To establish a structural foundation for functional study, however, we need advanced image analysis and structural modeling methods. Existing works use geometric features such as thickness, tortuosity, etc. However, geometric features cannot fully capture structural characteristics such as the richness of branches, connectivity, etc. In this paper, we study the morphology of brain vasculature through a topological lens. We extract topological features based on the theory of topological data analysis. Comparing of these robust and multi-scale topological structural features across different brain anatomical structures and between normal and obese populations sheds light on their promising future in studying neurological diseases.


title: Field-Aligned Current Structures during the Terrestrial Magnetosphere's Transformation into Alfven Wings and Recovery

abstract: On April 24th, 2023, a CME event caused the solar wind to become sub-Alfvenic, leading to the development of an Alfven Wing configuration in the Earth's Magnetosphere. Alfven Wings have previously been observed as cavities of low flow in Jupiter's magnetosphere, but the observing satellites did not have the ability to directly measure the Alfven Wings' current structures. Through in situ measurements made by the Magnetospheric Multiscale (MMS) spacecraft, the April 24th event provides us with the first direct measurements of current structures during an Alfven Wing configuration. We have found two distinct types of current structures associated with the Alfven Wing transformation as well as the magnetosphere recovery. These structures are observed to be significantly more anti-field-aligned and electron-driven than typical magnetopause currents, indicating the disruptions caused to the magnetosphere current system by the Alfven Wing formation.


title: On Trojan Signatures in Large Language Models of Code

abstract: Trojan signatures, as described by Fields et al. (2021), are noticeable differences in the distribution of the trojaned class parameters (weights) and the non-trojaned class parameters of the trojaned model, that can be used to detect the trojaned model. Fields et al. (2021) found trojan signatures in computer vision classification tasks with image models, such as, Resnet, WideResnet, Densenet, and VGG. In this paper, we investigate such signatures in the classifier layer parameters of large language models of source code. Our results suggest that trojan signatures could not generalize to LLMs of code. We found that trojaned code models are stubborn, even when the models were poisoned under more explicit settings (finetuned with pre-trained weights frozen). We analyzed nine trojaned models for two binary classification tasks: clone and defect detection. To the best of our knowledge, this is the first work to examine weight-based trojan signature revelation techniques for large-language models of code and furthermore to demonstrate that detecting trojans only from the weights in such models is a hard problem.


title: Reliable Conflictive Multi-View Learning

abstract: Multi-view learning aims to combine multiple features to achieve more comprehensive descriptions of data. Most previous works assume that multiple views are strictly aligned. However, real-world multi-view data may contain low-quality conflictive instances, which show conflictive information in different views. Previous methods for this problem mainly focus on eliminating the conflictive data instances by removing them or replacing conflictive views. Nevertheless, real-world applications usually require making decisions for conflictive instances rather than only eliminating them. To solve this, we point out a new Reliable Conflictive Multi-view Learning (RCML) problem, which requires the model to provide decision results and attached reliabilities for conflictive multi-view data. We develop an Evidential Conflictive Multi-view Learning (ECML) method for this problem. ECML first learns view-specific evidence, which could be termed as the amount of support to each category collected from data. Then, we can construct view-specific opinions consisting of decision results and reliability. In the multi-view fusion stage, we propose a conflictive opinion aggregation strategy and theoretically prove this strategy can exactly model the relation of multi-view common and view-specific reliabilities. Experiments performed on 6 datasets verify the effectiveness of ECML.


title: MIM-Reasoner: Learning with Theoretical Guarantees for Multiplex Influence Maximization

abstract: Multiplex influence maximization (MIM) asks us to identify a set of seed users such as to maximize the expected number of influenced users in a multiplex network. MIM has been one of central research topics, especially in nowadays social networking landscape where users participate in multiple online social networks (OSNs) and their influences can propagate among several OSNs simultaneously. Although there exist a couple combinatorial algorithms to MIM, learning-based solutions have been desired due to its generalization ability to heterogeneous networks and their diversified propagation characteristics. In this paper, we introduce MIM-Reasoner, coupling reinforcement learning with probabilistic graphical model, which effectively captures the complex propagation process within and between layers of a given multiplex network, thereby tackling the most challenging problem in MIM. We establish a theoretical guarantee for MIM-Reasoner as well as conduct extensive analyses on both synthetic and real-world datasets to validate our MIM-Reasoner's performance.


title: A priori Estimates for Deep Residual Network in Continuous-time Reinforcement Learning

abstract: Deep reinforcement learning excels in numerous large-scale practical applications. However, existing performance analyses ignores the unique characteristics of continuous-time control problems, is unable to directly estimate the generalization error of the Bellman optimal loss and require a boundedness assumption. Our work focuses on continuous-time control problems and proposes a method that is applicable to all such problems where the transition function satisfies semi-group and Lipschitz properties. Under this method, we can directly analyze the \emph{a priori} generalization error of the Bellman optimal loss. The core of this method lies in two transformations of the loss function. To complete the transformation, we propose a decomposition method for the maximum operator. Additionally, this analysis method does not require a boundedness assumption. Finally, we obtain an \emph{a priori} generalization error without the curse of dimensionality.


title: The time-fractional heat equation driven by fractional time-space white noise

abstract: We give an introduction to the time-fractional stochastic heat equation driven by 1+d-parameter fractional time-space white noise, in the following two cases: (i) With additive noise (ii) With multiplicative noise. The fractional time derivative is interpreted as the Caputo derivative of order $\alpha \in (0,2)$ and we assume that the Hurst coefficient $H=(H_0,H_1,H_2, ...,H_d)$ of the time-space fractional white noise is in $(\tfrac{1}{2},1)^{1+d}$. We find an explicit expression for the unique solution in the sense of distribution of the equation in the additive noise case (i). In the multiplicative case (ii) we show that there is a unique solution in the Hida space $(\mathcal{S})^{*}$ of stochastic distributions and we show that the solution coincides with the solution of an associated fractional stochastic Volterra equation.Then we give an explicit expression for the solution of this Volterra equation. A solution $Y(t,x)$ is called \emph{mild} if $E[Y^2(t,x)] < \infty$ for all $t,x$. For both the additive noise case and the multiplicative noise case we show that if $\alpha \geq 1$ then the solution is mild if $d=1$ or $d=2$, while if $\alpha < 1$ the solution is not mild for any $d$. The paper is partly a survey paper, explaining the concepts and methods behind the results. It is also partly a research paper, in the sense that some results appears to be new.


title: FGBERT: Function-Driven Pre-trained Gene Language Model for Metagenomics

abstract: Metagenomic data, comprising mixed multi-species genomes, are prevalent in diverse environments like oceans and soils, significantly impacting human health and ecological functions. However, current research relies on K-mer representations, limiting the capture of structurally relevant gene contexts. To address these limitations and further our understanding of complex relationships between metagenomic sequences and their functions, we introduce a protein-based gene representation as a context-aware and structure-relevant tokenizer. Our approach includes Masked Gene Modeling (MGM) for gene group-level pre-training, providing insights into inter-gene contextual information, and Triple Enhanced Metagenomic Contrastive Learning (TEM-CL) for gene-level pre-training to model gene sequence-function relationships. MGM and TEM-CL constitute our novel metagenomic language model {\NAME}, pre-trained on 100 million metagenomic sequences. We demonstrate the superiority of our proposed {\NAME} on eight datasets.


title: PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA

abstract: With the rapid scaling of large language models (LLMs), serving numerous low-rank adaptations (LoRAs) concurrently has become increasingly impractical, leading to unaffordable costs and necessitating more parameter-efficient finetuning methods. In this work, we introduce Partially Rotation-enhanced Low-Rank Adaptation (PRoLoRA), an intra-layer sharing mechanism comprising four essential components: broadcast reduction, rotation enhancement, partially-sharing refinement, and rectified initialization strategy. As a superset of LoRA, PRoLoRA retains its advantages, and effectively circumvent the drawbacks of peer parameter-sharing methods with superior model capacity, practical feasibility, and broad applicability. Empirical experiments demonstrate the remarkably higher parameter efficiency of PRoLoRA in both specific parameter budget and performance target scenarios, and its scalability to larger LLMs. Notably, with one time less trainable parameters, PRoLoRA still outperforms LoRA on multiple instruction tuning datasets. Subsequently, an ablation study is conducted to validate the necessity of individual components and highlight the superiority of PRoLoRA over three potential variants. Hopefully, the conspicuously higher parameter efficiency can establish PRoLoRA as a resource-friendly alternative to LoRA.


title: A novel data generation scheme for surrogate modelling with deep operator networks

abstract: Operator-based neural network architectures such as DeepONets have emerged as a promising tool for the surrogate modeling of physical systems. In general, towards operator surrogate modeling, the training data is generated by solving the PDEs using techniques such as Finite Element Method (FEM). The computationally intensive nature of data generation is one of the biggest bottleneck in deploying these surrogate models for practical applications. In this study, we propose a novel methodology to alleviate the computational burden associated with training data generation for DeepONets. Unlike existing literature, the proposed framework for data generation does not use any partial differential equation integration strategy, thereby significantly reducing the computational cost associated with generating training dataset for DeepONet. In the proposed strategy, first, the output field is generated randomly, satisfying the boundary conditions using Gaussian Process Regression (GPR). From the output field, the input source field can be calculated easily using finite difference techniques. The proposed methodology can be extended to other operator learning methods, making the approach widely applicable. To validate the proposed approach, we employ the heat equations as the model problem and develop the surrogate model for numerous boundary value problems.


title: Selective Task offloading for Maximum Inference Accuracy and Energy efficient Real-Time IoT Sensing Systems

abstract: The recent advancements in small-size inference models facilitated AI deployment on the edge. However, the limited resource nature of edge devices poses new challenges especially for real-time applications. Deploying multiple inference models (or a single tunable model) varying in size and therefore accuracy and power consumption, in addition to an edge server inference model, can offer a dynamic system in which the allocation of inference models to inference jobs is performed according to the current resource conditions. Therefore, in this work, we tackle the problem of selectively allocating inference models to jobs or offloading them to the edge server to maximize inference accuracy under time and energy constraints. This problem is shown to be an instance of the unbounded multidimensional knapsack problem which is considered a strongly NP-hard problem. We propose a lightweight hybrid genetic algorithm (LGSTO) to solve this problem. We introduce a termination condition and neighborhood exploration techniques for faster evolution of populations. We compare LGSTO with the Naive and Dynamic programming solutions. In addition to classic genetic algorithms using different reproduction methods including NSGA-II, and finally we compare to other evolutionary methods such as Particle swarm optimization (PSO) and Ant colony optimization (ACO). Experiment results show that LGSTO performed 3 times faster than the fastest comparable schemes while producing schedules with higher average accuracy.


title: Enforcing Temporal Constraints on Generative Agent Behavior with Reactive Synthesis

abstract: The surge in popularity of Large Language Models (LLMs) has opened doors for new approaches to the creation of interactive agents. However, managing the temporal behavior of such agents over the course of an interaction remains challenging. The stateful, long-term horizon and quantitative reasoning required for coherent agent behavior does not fit well into the LLM paradigm. We propose a combination of formal logic-based program synthesis and LLM content generation to create generative agents that adhere to temporal constraints. Our approach uses Temporal Stream Logic (TSL) to generate an automaton that enforces a temporal structure on an agent and leaves the details of each action for a moment in time to an LLM. By using TSL, we are able to augment the generative agent where users have a higher level of guarantees on behavior, better interpretability of the system, and more ability to build agents in a modular way. We evaluate our approach on different tasks involved in creating a coherent interactive agent specialized for various application domains. We found that over all of the tasks, our approach using TSL achieves at least 96% adherence, whereas the pure LLM-based approach demonstrates as low as 14.67% adherence.


title: Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-step

abstract: Large language models (LLMs) are leading significant progress in code generation. Beyond one-pass code generation, recent works further integrate unit tests and program verifiers into LLMs to iteratively refine the generated programs. However, these works consider the generated programs as an indivisible entity, which falls short for LLMs in debugging the programs, especially when the programs contain complex logic flows and data operations. In contrast, when human developers debug programs, they typically set breakpoints and selectively examine runtime execution information. The execution flow and the intermediate variables play a crucial role in the debugging process, yet they are underutilized in the existing literature on code generation. In this study, we introduce Large Language Model Debugger (LDB), a novel debugging framework that enables LLMs to refine their generated programs with the runtime execution information. Specifically, LDB segments the programs into basic blocks and tracks the values of intermediate variables after each block throughout the runtime execution. This allows LLMs to concentrate on simpler code units within the overall execution flow, verify their correctness against the task description block by block, and efficiently pinpoint any potential errors. Experiments demonstrate that LDB consistently enhances the baseline performance by up to 9.8% across the HumanEval, MBPP, and TransCoder benchmarks, archiving new state-of-the-art performance in code debugging for various LLM selections.


title: Diffusion Posterior Proximal Sampling for Image Restoration

abstract: Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements inherited from the unconditional generation paradigm. These strategies initiate the denoising process with pure white noise and incorporate random noise at each generative step, leading to over-smoothed results. In this paper, we introduce a refined paradigm for diffusion-based image restoration. Specifically, we opt for a sample consistent with the measurement identity at each generative step, exploiting the sampling selection as an avenue for output stability and enhancement. Besides, we start the restoration process with an initialization combined with the measurement signal, providing supplementary information to better align the generative process. Extensive experimental results and analyses validate the effectiveness of our proposed approach across diverse image restoration tasks.


title: Lightweight, error-tolerant edge detection using memristor-enabled stochastic logics

abstract: The demand for efficient edge vision has spurred the interest in developing stochastic computing approaches for performing image processing tasks. Memristors with inherent stochasticity readily introduce probability into the computations and thus enable stochastic image processing computations. Here, we present a stochastic computing approach for edge detection, a fundamental image processing technique, facilitated with memristor-enabled stochastic logics. Specifically, we integrate the memristors with logic circuits and harness the stochasticity from the memristors to realize compact stochastic logics for stochastic number encoding and processing. The stochastic numbers, exhibiting well-regulated probabilities and correlations, can be processed to perform logic operations with statistical probabilities. This can facilitate lightweight stochastic edge detection for edge visual scenarios characterized with high-level noise errors. As a practical demonstration, we implement a hardware stochastic Roberts cross operator using the stochastic logics, and prove its exceptional edge detection performance, remarkably, with 95% less computational cost while withstanding 50% bit-flip errors. The results underscore the great potential of our stochastic edge detection approach in developing lightweight, error-tolerant edge vision hardware and systems for autonomous driving, virtual/augmented reality, medical imaging diagnosis, industrial automation, and beyond.


title: Impact of Physical Activity on Quality of Life During Pregnancy: A Causal ML Approach

abstract: The concept of Quality of Life (QoL) refers to a holistic measurement of an individual's well-being, incorporating psychological and social aspects. Pregnant women, especially those with obesity and stress, often experience lower QoL. Physical activity (PA) has shown the potential to enhance the QoL. However, pregnant women who are overweight and obese rarely meet the recommended level of PA. Studies have investigated the relationship between PA and QoL during pregnancy using correlation-based approaches. These methods aim to discover spurious correlations between variables rather than causal relationships. Besides, the existing methods mainly rely on physical activity parameters and neglect the use of different factors such as maternal (medical) history and context data, leading to biased estimates. Furthermore, the estimations lack an understanding of mediators and counterfactual scenarios that might affect them. In this paper, we investigate the causal relationship between being physically active (treatment variable) and the QoL (outcome) during pregnancy and postpartum. To estimate the causal effect, we develop a Causal Machine Learning method, integrating causal discovery and causal inference components. The data for our investigation is derived from a long-term wearable-based health monitoring study focusing on overweight and obese pregnant women. The machine learning (meta-learner) estimation technique is used to estimate the causal effect. Our result shows that performing adequate physical activity during pregnancy and postpartum improves the QoL by units of 7.3 and 3.4 on average in physical health and psychological domains, respectively. In the final step, four refutation analysis techniques are employed to validate our estimation.


title: NeSy is alive and well: A LLM-driven symbolic approach for better code comment data generation and classification

abstract: We present a neuro-symbolic (NeSy) workflow combining a symbolic-based learning technique with a large language model (LLM) agent to generate synthetic data for code comment classification in the C programming language. We also show how generating controlled synthetic data using this workflow fixes some of the notable weaknesses of LLM-based generation and increases the performance of classical machine learning models on the code comment classification task. Our best model, a Neural Network, achieves a Macro-F1 score of 91.412% with an increase of 1.033% after data augmentation.


title: Trustworthy Personalized Bayesian Federated Learning via Posterior Fine-Tune

abstract: Performance degradation owing to data heterogeneity and low output interpretability are the most significant challenges faced by federated learning in practical applications. Personalized federated learning diverges from traditional approaches, as it no longer seeks to train a single model, but instead tailors a unique personalized model for each client. However, previous work focused only on personalization from the perspective of neural network parameters and lack of robustness and interpretability. In this work, we establish a novel framework for personalized federated learning, incorporating Bayesian methodology which enhances the algorithm's ability to quantify uncertainty. Furthermore, we introduce normalizing flow to achieve personalization from the parameter posterior perspective and theoretically analyze the impact of normalizing flow on out-of-distribution (OOD) detection for Bayesian neural networks. Finally, we evaluated our approach on heterogeneous datasets, and the experimental results indicate that the new algorithm not only improves accuracy but also outperforms the baseline significantly in OOD detection due to the reliable output of the Bayesian approach.


title: An Adversarial Robustness Benchmark for Enterprise Network Intrusion Detection

abstract: As cyber-attacks become more sophisticated, improving the robustness of Machine Learning (ML) models must be a priority for enterprises of all sizes. To reliably compare the robustness of different ML models for cyber-attack detection in enterprise computer networks, they must be evaluated in standardized conditions. This work presents a methodical adversarial robustness benchmark of multiple decision tree ensembles with constrained adversarial examples generated from standard datasets. The robustness of regularly and adversarially trained RF, XGB, LGBM, and EBM models was evaluated on the original CICIDS2017 dataset, a corrected version of it designated as NewCICIDS, and the HIKARI dataset, which contains more recent network traffic. NewCICIDS led to models with a better performance, especially XGB and EBM, but RF and LGBM were less robust against the more recent cyber-attacks of HIKARI. Overall, the robustness of the models to adversarial cyber-attack examples was improved without their generalization to regular traffic being affected, enabling a reliable detection of suspicious activity without costly increases of false alarms.


title: PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from the perspective of partial differential equations

abstract: Recent advancements in deep learning have led to the development of various models for long-term multivariate time-series forecasting (LMTF), many of which have shown promising results. Generally, the focus has been on historical-value-based models, which rely on past observations to predict future series. Notably, a new trend has emerged with time-index-based models, offering a more nuanced understanding of the continuous dynamics underlying time series. Unlike these two types of models that aggregate the information of spatial domains or temporal domains, in this paper, we consider multivariate time series as spatiotemporal data regularly sampled from a continuous dynamical system, which can be represented by partial differential equations (PDEs), with the spatial domain being fixed. Building on this perspective, we present PDETime, a novel LMTF model inspired by the principles of Neural PDE solvers, following the encoding-integration-decoding operations. Our extensive experimentation across seven diverse real-world LMTF datasets reveals that PDETime not only adapts effectively to the intrinsic spatiotemporal nature of the data but also sets new benchmarks, achieving state-of-the-art results


title: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers

abstract: The safety alignment of Large Language Models (LLMs) is vulnerable to both manual and automated jailbreak attacks, which adversarially trigger LLMs to output harmful content. However, current methods for jailbreaking LLMs, which nest entire harmful prompts, are not effective at concealing malicious intent and can be easily identified and rejected by well-aligned LLMs. This paper discovers that decomposing a malicious prompt into separated sub-prompts can effectively obscure its underlying malicious intent by presenting it in a fragmented, less detectable form, thereby addressing these limitations. We introduce an automatic prompt \textbf{D}ecomposition and \textbf{R}econstruction framework for jailbreak \textbf{Attack} (DrAttack). DrAttack includes three key components: (a) `Decomposition' of the original prompt into sub-prompts, (b) `Reconstruction' of these sub-prompts implicitly by in-context learning with semantically similar but harmless reassembling demo, and (c) a `Synonym Search' of sub-prompts, aiming to find sub-prompts' synonyms that maintain the original intent while jailbreaking LLMs. An extensive empirical study across multiple open-source and closed-source LLMs demonstrates that, with a significantly reduced number of queries, DrAttack obtains a substantial gain of success rate over prior SOTA prompt-only attackers. Notably, the success rate of 78.0\% on GPT-4 with merely 15 queries surpassed previous art by 33.1\%. The project is available at https://github.com/xirui-li/DrAttack.


title: More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learning

abstract: Trajectory representation learning plays a pivotal role in supporting various downstream tasks. Traditional methods in order to filter the noise in GPS trajectories tend to focus on routing-based methods used to simplify the trajectories. However, this approach ignores the motion details contained in the GPS data, limiting the representation capability of trajectory representation learning. To fill this gap, we propose a novel representation learning framework that Joint GPS and Route Modelling based on self-supervised technology, namely JGRM. We consider GPS trajectory and route as the two modes of a single movement observation and fuse information through inter-modal information interaction. Specifically, we develop two encoders, each tailored to capture representations of route and GPS trajectories respectively. The representations from the two modalities are fed into a shared transformer for inter-modal information interaction. Eventually, we design three self-supervised tasks to train the model. We validate the effectiveness of the proposed method on two real datasets based on extensive experiments. The experimental results demonstrate that JGRM outperforms existing methods in both road segment representation and trajectory representation tasks. Our source code is available at Anonymous Github.


title: Slow electron holes in the Earth's magnetosheath

abstract: We present a statistical analysis of electrostatic solitary waves observed aboard Magnetospheric Multiscale spacecraft in the Earth's magnetosheath. Applying single-spacecraft interferometry to several hundred solitary waves collected in about two minute intervals, we show that almost all of them have the electrostatic potential of positive polarity and propagate quasi-parallel to the local magnetic field with plasma frame velocities of the order of 100 km/s. The solitary waves have typical parallel half-widths from 10 to 100 m that is between 1 and 10 Debye lengths and typical amplitudes of the electrostatic potential from 10 to 200 mV that is between 0.01 and 1\% of local electron temperature. The solitary waves are associated with quasi-Maxwellian ion velocity distribution functions, and their plasma frame velocities are comparable with ion thermal speed and well below electron thermal speed. We argue that the solitary waves of positive polarity are slow electron holes and estimate the time scale of their acceleration, which occurs due to interaction with ions, to be of the order of one second. The observation of slow electron holes indicates that their lifetime was shorter than the acceleration time scale. We argue that multi-spacecraft interferometry applied previously to these solitary waves is not applicable because of their too-short spatial scales. The source of the slow electron holes and the role in electron-ion energy exchange remain to be established.


title: Bayesian Chain Ladder For Cumulative Run-Off Triangle Under Half-Normal Distribution Assumption

abstract: An insurance company is required to prepare a certain amount of money, called reserve, as a mean to pay its policy holders claims in the future. There are several types of reserve, one of them is IBNR reserve, for which the payments are made not in the same calendar year as the events that trigger the claims. Wuthrich and Merz (2015) developed a Bayesian Chain Ladder method for gamma distribution that applies the Bayesian Theory into the usual Chain Ladder Method . In this article, we modify the previous Bayesian Chain Ladder for half-normal distribution, as such distribution is more well suited for lighter tail claims.


title: m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers

abstract: Modular neural architectures are gaining attention for their powerful generalization and efficient adaptation to new domains. However, training these models poses challenges due to optimization difficulties arising from intrinsic sparse connectivity. Leveraging knowledge from monolithic models through techniques like knowledge distillation can facilitate training and enable integration of diverse knowledge. Nevertheless, conventional knowledge distillation approaches are not tailored to modular models and struggle with unique architectures and enormous parameter counts. Motivated by these challenges, we propose module-to-module knowledge distillation (m2mKD) for transferring knowledge between modules. m2mKD combines teacher modules of a pretrained monolithic model and student modules of a modular model with a shared meta model respectively to encourage the student module to mimic the behaviour of the teacher module. We evaluate m2mKD on two modular neural architectures: Neural Attentive Circuits (NACs) and Vision Mixture-of-Experts (V-MoE). Applying m2mKD to NACs yields significant improvements in IID accuracy on Tiny-ImageNet (up to 5.6%) and OOD robustness on Tiny-ImageNet-R (up to 4.2%). Additionally, the V-MoE-Base model trained with m2mKD achieves 3.5% higher accuracy than end-to-end training on ImageNet-1k. Code is available at https://github.com/kamanphoebe/m2mKD.


title: Personalized Federated Instruction Tuning via Neural Architecture Search

abstract: Federated Instruction Tuning (FIT) has shown the ability to achieve collaborative model instruction tuning among massive data owners without sharing private data. However, it still faces two key challenges, i.e., data and resource heterogeneity. Due to the varying data distribution and preferences among data owners, FIT cannot adapt to the personalized data of individual owners. Moreover, clients with superior computational abilities are constrained since they need to maintain the same fine-tuning architecture as the weaker clients. To address these issues, we propose a novel Personalized Federated Instruction Tuning (PerFIT) framework based on architecture search. Specifically, PerFIT allows each client to search for a personalized architecture by expanding the trainable parameter space of the global model followed by pruning the parameters to the original state. This procedure allows personalized instruction fine-tuning within expanded parameter spaces, concurrently preserving the same number of trainable parameters. Furthermore, to release the abilities of heterogeneous computational resources and enhance the performance of personalization on local data, we exploit personalized parameter-wise aggregation. The evaluation with multiple LLMs non-IID scenarios demonstrates that compared to the state-of-the-art FIT methods, our approach can achieve up to a 23% decrease in perplexity.


title: JefiAtten: An Attention Based Neural Network Model for Solving Maxwell's Equations with Charge and Current Sources

abstract: We present JefiAtten, a novel neural network model employing the attention mechanism to solve Maxwell's equations efficiently. JefiAtten uses self-attention and cross-attention modules to understand the interplay between charge density, current density, and electromagnetic fields. Our results indicate that JefiAtten can generalize well to a range of scenarios, maintaining accuracy across various spatial distribution and handling amplitude variations. The model showcases an improvement in computation speed after training, compared to traditional integral methods. The adaptability of the model suggests potential for broader applications in computational physics, with further refinements to enhance its predictive capabilities and computational efficiency. Our work is a testament to the efficacy of integrating attention mechanisms with numerical simulations, marking a step forward in the quest for data-driven solutions to physical phenomena.


title: Sparse2Inverse: Self-supervised inversion of sparse-view CT data

abstract: Sparse-view computed tomography (CT) enables fast and low-dose CT imaging, an essential feature for patient-save medical imaging and rapid non-destructive testing. In sparse-view CT, only a few projection views are acquired, causing standard reconstructions to suffer from severe artifacts and noise. To address these issues, we propose a self-supervised image reconstruction strategy. Specifically, in contrast to the established Noise2Inverse, our proposed training strategy uses a loss function in the projection domain, thereby bypassing the otherwise prescribed nullspace component. We demonstrate the effectiveness of the proposed method in reducing stripe-artifacts and noise, even from highly sparse data.


title: Observational tests of asymptotically flat ${\cal R}^{2}$ spacetimes

abstract: A novel class of Buchdahl-inspired metrics with closed-form expressions was recently obtained based on Buchdahl's seminal work on searching for static, spherically symmetric metrics in ${\cal R}^{2}$ gravity in vacuo. Buchdahl-inspired spacetimes provide an interesting framework for testing predictions of ${\cal R}^{2}$ gravity models against observations. To test these Buchdahl-inspired spacetimes, we consider observational constraints imposed on the deviation parameter, which characterizes the deviation of the asymptotically flat Buchdahl-inspired metric from the Schwarzschild spacetime. We utilize several recent solar system experiments and observations of the S2 star in the Galactic center and the black hole shadow. By calculating the effects of Buchdahl-inspired spacetimes on astronomical observations both within and outside of the solar system, including the deflection angle of light by the Sun, gravitational time delay, perihelion advance, shadow, and geodetic precession, we determine observational constraints on the corresponding deviation parameters by comparing theoretical predictions with the most recent observations. Among these constraints, we find that the tightest one comes from the Cassini mission's measurement of gravitational time delay.


title: A note on solving basic equations over the semiring of functional digraphs

abstract: Endowing the set of functional graphs (FGs) with the sum (disjoint union of graphs) and product (standard direct product on graphs) operations induces on FGs a structure of a commutative semiring $\ring$. The operations on $\ring$ can be naturally extended to the set of univariate polynomials $\ring[X]$ over $\ring$. This paper provides a polynomial time algorithm for deciding if equations of the type $AX=B$ have solutions when $A$ is just a single cycle and $B$ a set of cycles of identical size. We also prove a similar complexity result for some variants of the previous equation.


title: Theoretical Unification of the Fractured Aspects of Information

abstract: The article has as its main objective the identification of fundamental epistemological obstacles in the study of information related to unnecessary methodological assumptions and the demystification of popular beliefs in the fundamental divisions of the aspects of information that can be understood as Bachelardian rupture of epistemological obstacles. These general considerations are preceded by an overview of the motivations for the study of information and the role of the concept of information in the conceptualization of intelligence, complexity, and consciousness justifying the need for a sufficiently general perspective in the study of information, and are followed at the end of the article by a brief exposition of an example of a possible application in the development of the unified theory of information free from unnecessary divisions and claims of superiority of the existing preferences in methodology. The reference to Gaston Bachelard and his ideas of epistemological obstacles and epistemological ruptures seems highly appropriate for the reflection on the development of information study, in particular in the context of obstacles such as the absence of semantics of information, negligence of its structural analysis, separation of its digital and analog forms, and misguided use of mathematics.


title: Minimize Control Inputs for Strong Structural Controllability Using Reinforcement Learning with Graph Neural Network

abstract: Strong structural controllability (SSC) guarantees networked system with linear-invariant dynamics controllable for all numerical realizations of parameters. Current research has established algebraic and graph-theoretic conditions of SSC for zero/nonzero or zero/nonzero/arbitrary structure. One relevant practical problem is how to fully control the system with the minimal number of input signals and identify which nodes must be imposed signals. Previous work shows that this optimization problem is NP-hard and it is difficult to find the solution. To solve this problem, we formulate the graph coloring process as a Markov decision process (MDP) according to the graph-theoretical condition of SSC for both zero/nonzero and zero/nonzero/arbitrary structure. We use Actor-critic method with Directed graph neural network which represents the color information of graph to optimize MDP. Our method is validated in a social influence network with real data and different complex network models. We find that the number of input nodes is determined by the average degree of the network and the input nodes tend to select nodes with low in-degree and avoid high-degree nodes.


title: On the (In)feasibility of ML Backdoor Detection as an Hypothesis Testing Problem

abstract: We introduce a formal statistical definition for the problem of backdoor detection in machine learning systems and use it to analyze the feasibility of such problems, providing evidence for the utility and applicability of our definition. The main contributions of this work are an impossibility result and an achievability result for backdoor detection. We show a no-free-lunch theorem, proving that universal (adversary-unaware) backdoor detection is impossible, except for very small alphabet sizes. Thus, we argue, that backdoor detection methods need to be either explicitly, or implicitly adversary-aware. However, our work does not imply that backdoor detection cannot work in specific scenarios, as evidenced by successful backdoor detection methods in the scientific literature. Furthermore, we connect our definition to the probably approximately correct (PAC) learnability of the out-of-distribution detection problem.


title: The ICASSP 2024 Audio Deep Packet Loss Concealment Challenge

abstract: Audio packet loss concealment is the hiding of gaps in VoIP audio streams caused by network packet loss. With the ICASSP 2024 Audio Deep Packet Loss Concealment Grand Challenge, we build on the success of the previous Audio PLC Challenge held at INTERSPEECH 2022. We evaluate models on an overall harder dataset, and use the new ITU-T P.804 evaluation procedure to more closely evaluate the performance of systems specifically on the PLC task. We evaluate a total of 9 systems, 8 of which satisfy the strict real-time performance requirements of the challenge, using both P.804 and Word Accuracy evaluations.


title: CLAP: Learning Transferable Binary Code Representations with Natural Language Supervision

abstract: Binary code representation learning has shown significant performance in binary analysis tasks. But existing solutions often have poor transferability, particularly in few-shot and zero-shot scenarios where few or no training samples are available for the tasks. To address this problem, we present CLAP (Contrastive Language-Assembly Pre-training), which employs natural language supervision to learn better representations of binary code (i.e., assembly code) and get better transferability. At the core, our approach boosts superior transfer learning capabilities by effectively aligning binary code with their semantics explanations (in natural language), resulting a model able to generate better embeddings for binary code. To enable this alignment training, we then propose an efficient dataset engine that could automatically generate a large and diverse dataset comprising of binary code and corresponding natural language explanations. We have generated 195 million pairs of binary code and explanations and trained a prototype of CLAP. The evaluations of CLAP across various downstream tasks in binary analysis all demonstrate exceptional performance. Notably, without any task-specific training, CLAP is often competitive with a fully supervised baseline, showing excellent transferability. We release our pre-trained model and code at https://github.com/Hustcw/CLAP.


title: LangGPT: Rethinking Structured Reusable Prompt Design Framework for LLMs from the Programming Language

abstract: LLMs have demonstrated commendable performance across diverse domains. Nevertheless, formulating high-quality prompts to effectively instruct LLMs poses a challenge for non-AI experts. Existing research in prompt engineering suggests somewhat fragmented optimization principles and designs empirically dependent prompt optimizers. Unfortunately, these endeavors lack a structured design template, incurring high learning costs and resulting in low reusability. Inspired by structured reusable programming languages, we propose LangGPT, a dual-layer prompt design framework as the programming language for LLMs. LangGPT has an easy-to-learn normative structure and provides an extended structure for migration and reuse. Experiments illustrate that LangGPT significantly enhances the capacity of LLMs to produce responses of superior quality compared to baselines. Moreover, LangGPT has proven effective in guiding LLMs to generate high-quality prompts. We have built a community on LangGPT to facilitate the tuition and sharing of prompt design. We also analyzed the ease of use and reusability of LangGPT through a community user survey.


title: TrustMol: Trustworthy Inverse Molecular Design via Alignment with Molecular Dynamics

abstract: Data-driven generation of molecules with desired properties, also known as inverse molecular design (IMD), has attracted significant attention in recent years. Despite the significant progress in the accuracy and diversity of solutions, existing IMD methods lag behind in terms of trustworthiness. The root issue is that the design process of these methods is increasingly more implicit and indirect, and this process is also isolated from the native forward process (NFP), the ground-truth function that models the molecular dynamics. Following this insight, we propose TrustMol, an IMD method built to be trustworthy. For this purpose, TrustMol relies on a set of technical novelties including a new variational autoencoder network. Moreover, we propose a latent-property pairs acquisition method to effectively navigate the complexities of molecular latent optimization, a process that seems intuitive yet challenging due to the high-frequency and discontinuous nature of molecule space. TrustMol also integrates uncertainty-awareness into molecular latent optimization. These lead to improvements in both explainability and reliability of the IMD process. We validate the trustworthiness of TrustMol through a wide range of experiments.


title: Plasma activated PDMS microstructured pattern with collagen for improved myoblast cell guidance

abstract: We focused on polydimethylsiloxane (PDMS) as a substrate for replication, micropatterning, and construction of biologically active surfaces. The novelty of this study is based on the combina-tion of argon plasma exposure of micropatterned PDMS scaffold, where the plasma served as a strong tool for subsequent grafting of collagen coating and their application as cell growth scaf-folds, where the standard has been significantly exceeded. As part of scaffold design, templates with a patterned microstructure of different dimensions (50 x 50, 50 x 20 and 30 x 30 microns were created by photolithography followed by pattern replication on a PDMS polymer substrate. Subsequently, the prepared microstructured PDMS replicas were coated with a type I collagen layer. The sample preparation was followed by the characterization of material surface properties through various analytical techniques, including scanning electron microscopy (SEM), energy-dispersive X-ray spectroscopy (EDS), and X-ray photoelectron spectroscopy (XPS). To evaluate the biocompatibility of the produced samples, we conducted studies on the interactions between selected polymer replicas with micro- and nanostructures and mammalian cells. Specif-ically, we utilized mouse myoblasts (C2C12) and our results demonstrate that we achieved excellent cell alignment in conjunction with the development of a cytocompatible surface. Consequently, the outcomes of this research contribute to an enhanced comprehension of surface properties and interactions between structured polymers and mammalian cells. The use of periodic microstructures holds the potential for advancing the creation of novel materials and scaffolds in tissue engineering. These materials exhibit exceptional biocompatibility and possess the capacity to promote cell adhesion and growth.


title: PromptSet: A Programmer's Prompting Dataset

abstract: The rise of capabilities expressed by large language models has been quickly followed by the integration of the same complex systems into application level logic. Algorithms, programs, systems, and companies are built around structured prompting to black box models where the majority of the design and implementation lies in capturing and quantifying the `agent mode'. The standard way to shape a closed language model is to prime it for a specific task with a tailored prompt, often initially handwritten by a human. The textual prompts co-evolve with the codebase, taking shape over the course of project life as artifacts which must be reviewed and maintained, just as the traditional code files might be. Unlike traditional code, we find that prompts do not receive effective static testing and linting to prevent runtime issues. In this work, we present a novel dataset called PromptSet, with more than 61,000 unique developer prompts used in open source Python programs. We perform analysis on this dataset and introduce the notion of a static linter for prompts. Released with this publication is a HuggingFace dataset and a Github repository to recreate collection and processing efforts, both under the name \texttt{pisterlabs/promptset}.


title: Avoiding Catastrophic Forgetting in Visual Classification Using Human Concept Formation

abstract: Deep neural networks have excelled in machine learning, particularly in vision tasks, however, they often suffer from catastrophic forgetting when learning new tasks sequentially. In this work, we propose Cobweb4V, a novel visual classification approach that builds on Cobweb, a human like learning system that is inspired by the way humans incrementally learn new concepts over time. In this research, we conduct a comprehensive evaluation, showcasing the proficiency of Cobweb4V in learning visual concepts, requiring less data to achieve effective learning outcomes compared to traditional methods, maintaining stable performance over time, and achieving commendable asymptotic behavior, without catastrophic forgetting effects. These characteristics align with learning strategies in human cognition, positioning Cobweb4V as a promising alternative to neural network approaches.


title: FedReview: A Review Mechanism for Rejecting Poisoned Updates in Federated Learning

abstract: Federated learning has recently emerged as a decentralized approach to learn a high-performance model without access to user data. Despite its effectiveness, federated learning gives malicious users opportunities to manipulate the model by uploading poisoned model updates to the server. In this paper, we propose a review mechanism called FedReview to identify and decline the potential poisoned updates in federated learning. Under our mechanism, the server randomly assigns a subset of clients as reviewers to evaluate the model updates on their training datasets in each round. The reviewers rank the model updates based on the evaluation results and count the number of the updates with relatively low quality as the estimated number of poisoned updates. Based on review reports, the server employs a majority voting mechanism to integrate the rankings and remove the potential poisoned updates in the model aggregation process. Extensive evaluation on multiple datasets demonstrate that FedReview can assist the server to learn a well-performed global model in an adversarial environment.


title: New Prospects for a Causally Local Formulation of Quantum Theory

abstract: It is difficult to extract reliable criteria for causal locality from the limited ingredients found in textbook quantum theory. In the end, Bell humbly warned that his eponymous theorem was based on criteria that "should be viewed with the utmost suspicion." Remarkably, by stepping outside the wave-function paradigm, one can reformulate quantum theory in terms of old-fashioned configuration spaces together with 'unistochastic' laws. These unistochastic laws take the form of directed conditional probabilities, which turn out to provide a hospitable foundation for encoding microphysical causal relationships. This unistochastic reformulation provides quantum theory with a simpler and more transparent axiomatic foundation, plausibly resolves the measurement problem, and deflates various exotic claims about superposition, interference, and entanglement. Making use of this reformulation, this paper introduces a new principle of causal locality that is intended to improve on Bell's criteria, and shows directly that systems that remain at spacelike separation cannot exert causal influences on each other, according to that new principle. These results therefore lead to a general hidden-variables interpretation of quantum theory that is arguably compatible with causal locality.


title: Disentangled 3D Scene Generation with Layout Learning

abstract: We introduce a method to generate 3D scenes that are disentangled into their component objects. This disentanglement is unsupervised, relying only on the knowledge of a large pretrained text-to-image model. Our key insight is that objects can be discovered by finding parts of a 3D scene that, when rearranged spatially, still produce valid configurations of the same scene. Concretely, our method jointly optimizes multiple NeRFs from scratch - each representing its own object - along with a set of layouts that composite these objects into scenes. We then encourage these composited scenes to be in-distribution according to the image generator. We show that despite its simplicity, our approach successfully generates 3D scenes decomposed into individual objects, enabling new capabilities in text-to-3D content creation. For results and an interactive demo, see our project page at https://dave.ml/layoutlearning/


title: Exact Calculations of Coherent Information for Toric Codes under Decoherence: Identifying the Fundamental Error Threshold

abstract: The toric code is a canonical example of a topological error-correcting code. Two logical qubits stored within the toric code are robust against local decoherence, ensuring that these qubits can be faithfully retrieved as long as the error rate remains below a certain threshold. Recent studies have explored such a threshold behavior as an intrinsic information-theoretic transition, independent of the decoding protocol. These studies have shown that information-theoretic metrics, calculated using the Renyi (replica) approximation, demonstrate sharp transitions at a specific error rate. However, an exact analytic expression that avoids using the replica trick has not been shown, and the connection between the transition in information-theoretic capacity and the random bond Ising model (RBIM) has only been indirectly established. In this work, we present the first analytic expression for the coherent information of a decohered toric code, thereby establishing a rigorous connection between the fundamental error threshold and the criticality of the RBIM.


title: Dualities Among Massive, Partially Massless and Shift Symmetric Fields on (A)dS

abstract: We catalog all the electromagnetic-like dualities that exist between free dynamical bosonic fields of arbitrary symmetry type and mass on (anti-) de Sitter space in all dimensions, including dualities among the partially massless and shift symmetric fields. This generalizes to all these field types the well known fact that a massless $p$-form is dual to a massless $(D-p-2)$-form in $D$ spacetime dimensions. In the process, we describe the structure of the Weyl modules (the spaces of local operators linear in the fields and their derivative relations) for all the massive, partially massless and shift symmetric fields.


title: Projected state ensemble of a generic model of many-body quantum chaos

abstract: The projected ensemble is based on the study of the quantum state of a subsystem $A$ conditioned on projective measurements in its complement. Recent studies have observed that a more refined measure of the thermalization of a chaotic quantum system can be defined on the basis of convergence of the projected ensemble to a quantum state design, i.e. a system thermalizes when it becomes indistinguishable, up to the $k$-th moment, from a Haar ensemble of uniformly distributed pure states. Here we consider a random unitary circuit with the brick-wall geometry and analyze its convergence to the Haar ensemble through the frame potential and its mapping to a statistical mechanical problem. This approach allows us to highlight a geometric interpretation of the frame potential based on the existence of a fluctuating membrane, similar to those appearing in the study of entanglement entropies. At large local Hilbert space dimension $q$, we find that all moments converge simultaneously with a time scaling linearly in the size of region $A$, a feature previously observed in dual unitary models. However, based on the geometric interpretation, we argue that the scaling at finite $q$ on the basis of rare membrane fluctuations, finding the logarithmic scaling of design times $t_k = O(\log k)$. Our results are supported with numerical simulations performed at $q=2$.


title: Froggatt-Nielsen Meets the SMEFT

abstract: We study the matching of Froggatt-Nielsen theories of flavour onto the Standard Model Effective Field Theory (SMEFT), upon integrating out a heavy Beyond-the-Standard-Model (BSM) scalar `flavon' whose vacuum expectation value breaks an Abelian flavour symmetry at energies $\Lambda_\text{FN}$ well above the electroweak scale, $\Lambda_\text{FN} > \Lambda_\text{SM}$. We include matching contributions to the infrared $d_\text{SM}=6$ (Warsaw basis) SMEFT sourced from ultraviolet contact terms suppressed up to order $1 / \Lambda_\text{UV}^2$ in the Froggatt-Nielsen Lagrangian, where $\Lambda_\text{UV} > \Lambda_\text{FN}$ is an arbitrary deep-ultraviolet scale where further unspecified BSM particles are dynamical. This includes tree-level (one-loop) ultraviolet diagrams with $d_{\text{FN}}=6$ $(5)$ effective vertices. We first do so with a toy model, but then generalize our findings to arbitrary Frogatt-Nielsen charges. Our results indicate a rich and non-trivial signature of Froggatt-Nielsen theories on the (otherwise) model-independent operators of the SMEFT, and we briefly speculate on extending our analysis to broader classes of BSM flavour models, e.g. non-Abelian and/or gauged theories. We thus take an important step towards determining how to use rapidly developing theoretical and experimental SMEFT technologies to gain unambiguous insight into the SM's longstanding fermion flavour puzzle.


title: Security of hybrid BB84 with heterodyne detection

abstract: Quantum key distribution (QKD) promises everlasting security based on the laws of physics. Most common protocols are grouped into two distinct categories based on the degrees of freedom used to carry information, which can be either discrete or continuous, each presenting unique advantages in either performance, feasibility for near-term implementation, and compatibility with existing telecommunications architectures. Recently, hybrid QKD protocols have been introduced to leverage advantages from both categories. In this work we provide a rigorous security proof for a protocol introduced by Qi in 2021, where information is encoded in discrete variables as in the widespread Bennett Brassard 1984 (BB84) protocol but decoded continuously via heterodyne detection. Security proofs for hybrid protocols inherit the same challenges associated with continuous-variable protocols due to unbounded dimensions. Here we successfully address these challenges by exploiting symmetry. Our approach enables truncation of the Hilbert space with precise control of the approximation errors and lead to a tight, semi-analytical expression for the asymptotic key rate under collective attacks. As concrete examples, we apply our theory to compute the key rates under passive attacks, linear loss, and Gaussian noise.


title: A NIRCam-dark galaxy detected with the MIRI/F1000W filter in the MIDIS/JADES Hubble Ultra Deep Field

abstract: We report the discovery of Cerberus, an extremely red object detected with the MIRI Deep Imaging Survey (MIDIS) observations in the F1000W filter of the Hubble Ultra Deep Field. The object is detected at $S/N\sim6$, with $\mathrm{F1000W}\sim27$ mag, and undetected in the NIRCam data gathered by the JWST Advanced Deep Extragalactic Survey, JADES, fainter than the 30.0-30.5 mag $5\sigma$ detection limits in individual bands, as well as in the MIDIS F560W ultra-deep data ($\sim$29 mag, $5\sigma$). Analyzing the spectral energy distribution built with low-$S/N$ ($<5$) measurements in individual optical-to-mid-infrared filters and higher $S/N$ ($\gtrsim5$) in stacked NIRCam data, we discuss the possible nature of this red NIRCam-dark source using a battery of codes. We discard the possibility of Cerberus being a Solar System body based on the $<0.016$" proper motion in the 1-year apart JADES and MIDIS observations. A sub-stellar Galactic nature is deemed unlikely, given that the Cerberus' relatively flat NIRCam-to-NIRCam and very red NIRCam-to-MIRI flux ratios are not consistent with any brown dwarf model. The extragalactic nature of Cerberus offers 3 possibilities: (1) A $z\sim0.4$ galaxy with strong emission from polycyclic aromatic hydrocarbons; the very low inferred stellar mass, $\mathrm{M}_\star=10^{5-6}$ M$_\odot$, makes this possibility highly improbable. (2) A dusty galaxy at $z\sim4$ with an inferred stellar mass $\mathrm{M}_\star\sim10^{8}$ M$_\odot$. (3) A galaxy with observational properties similar to those of the reddest little red dots discovered around $z\sim7$, but Cerberus lying at $z\sim15$, with the rest-frame optical dominated by emission from a dusty torus or a dusty starburst.


title: The LOFAR-eFEDS survey: The incidence of radio and X-ray AGN and the disk-jet connection

abstract: Radio jets are present in a diverse sample of AGN. However, the mechanisms of jet powering are not fully understood, and it is yet unclear to what extent they obey mass-invariant scaling relations, similar to those found for the triggering and fuelling of X-ray selected AGN. We study the incidence of eROSITA/eFEDS X-ray and LOFAR radio AGN as a function of several stellar mass normalised AGN power indicators. A new sample of radio AGN from the LOFAR-eFEDS survey is defined and we publicly release this catalogue, including host galaxy counterparts from the Legacy Survey DR9, LOFAR radio morphologies and host galaxy properties from the complete, spectroscopic (z<0.4) GAMA09 survey. The fraction of GAMA09 galaxies hosting radio, X-ray and both radio and X-ray AGN are calculated as a function of the specific black hole kinetic ($\lambda_{\rm Jet}$) and radiative ($\lambda_{\rm Edd}$) power. The incidence of eFEDS X-ray AGN as a function of $\lambda_{\rm Edd}$ shows the same mass-invariance as found in past studies. Meanwhile, radio AGN, regardless of their morphology, are more likely to be hosted in more massive galaxies, at all $\lambda_{\rm Jet}$. Across the stellar mass range, the compact radio AGN incidence follows the same power-law distribution, showing that it is not only high mass galaxies that host high power radio AGN and vice versa. On the other hand, the incidence of compact and complex radio AGN is boosted at the highest jet powers, diverging from a simple power-law. Interestingly, this increased incidence cannot be explained by more powerful radio AGN lying in more dense environments which could naturally boost their radio luminosity. Overall, we show that statistical incidence studies are a powerful method to probe disk-jet coupling for different AGN accretion modes, although future work on a more reliable determination of jet power for diverse samples of radio AGN is needed.


title: Probing anyonic statistics via Mach-Zehnder interferometry in quantum computers

abstract: We introduce a synthetic Mach-Zehnder interferometer for digitized quantum computing devices to probe fractional exchange statistics of anyonic excitations that appear in quantum spin liquids. Employing an IonQ quantum computer, we apply this scheme to the toric ladder, a quasi-one-dimensional reduction of the toric code. We observe interference patterns resulting from the movement of `electric' excitations in the presence and absence of `magnetic' ones. We model the noise in IonQ via depolarizing Lindbladian dynamics, and find quantitative agreement with the measurements obtained from the quantum device. The synthetic Mach-Zehnder interferometer can thus also serve as an effective means to probe the coherence length and time scales of multi-qubit noisy quantum devices.


title: An attractive model: simulating fuzzy dark matter with attractive self-interactions

abstract: Fuzzy Dark Matter (FDM) comprised of ultralight ($m \sim 10^{-22}~\rm{eV}$) boson particles has received significant attention as a viable alternative to Cold Dark Matter (CDM), as it approximates CDM on large scales ($\gtrsim 1$ Mpc) while potentially resolving some of its small-scale problems via kiloparsec-scale quantum interference. However, the most basic FDM model, with one free parameter (the boson mass), is subject to a tension: small boson masses yield the desired cores of dwarf galaxies but underpredict structure in the Lyman-$\alpha$ forest, while large boson masses render FDM effectively identical to CDM. This Catch-22 problem may be alleviated by considering an axion-like particle with attractive particle self-interactions. We simulate an idealized FDM halo with self-interactions parameterized by an energy decay constant $f \sim 10^{15}~\rm{GeV}$ related to the axion symmetry-breaking conjectured to solve the strong-CP problem in particle physics. We observe solitons, a hallmark of FDM, condensing within a broader halo envelope, and find that the density profile and soliton mass depend on self-interaction strength. We propose generalized formulae to extend those from previous works to include self-interactions. We also investigate a critical mass threshold predicted for strong interactions at which the soliton collapses into a compact, unresolved state. We find that the collapse happens quickly and its effects are initially contained to the central region of the halo.


title: Excess cataloged X-ray and radio sources at galaxy-cluster virial shocks

abstract: We detect a highly significant excess of X-ray (2RXS) and radio (NVSS, GMRT, VLSSr) catalog sources when stacked around MCXC galaxy clusters and groups, narrowly confined within $\lesssim100\mathrm{\,kpc}$ of the $\sim2.4 R_{500}$ virial shock radius (inferred from continuum stacking), with similar X-ray ($\sim4\sigma$ for $443$ clusters) and radio ($\sim4\sigma$ for $485$ clusters) characteristics ($>5\sigma$ joint). The excess sources show $10-100$ kpc scales, $L_X(0.1-2.4\mbox{ keV})\simeq10^{42-43}\mathrm{\,erg\,s^{-1}}$ or $\nu L_\nu(\nu=1.4\mbox{ GHz}) \simeq 10^{40-41}\mathrm{\,erg\,s^{-1}}$ luminosities, and a preferentially radial radio-polarization. The narrow localization and properties of the excess identify these sources not as AGN, often invoked speculatively for excess X-ray sources at cluster outskirts, but rather as infalling gaseous clumps interacting with the virial shock, probably galactic halos and possibly outflow remnants. The local excess of such discrete, radio-to-$\gamma$-ray sources around an object can probe its virial shock also at high redshifts and sub-cluster scales.


title: $n$-point functions in Conformal Quantum Mechanics: A Momentum Space Odyssey

abstract: In this paper, we study the implications of conformal invariance in momentum space for correlation functions in quantum mechanics. We find that three point functions of arbitrary operators can be written in terms of the $_2 F_1$ hypergeometric function. We then show that generic four-point functions can be expressed in terms of Appell's generalized hypergeometric function $F_2$ with one undetermined parameter that plays the role of the conformal cross ratio in momentum space. We also construct momentum space conformal partial waves, which we compare with the Appell $F_2$ representation. We test our expressions against free theory and DFF model correlators, finding an exact agreement. We then analyze five, six, and all higher point functions. We find, quite remarkably, that $n$-point functions can be expressed in terms of the Lauricella generalized hypergeometric function, $E_A$, with $n-3$ undetermined parameters, which is in one-to-one correspondence with the number of conformal cross ratios. This analysis provides the first instance of a closed form for generic momentum space conformal correlators in contrast to the situation in higher dimensions. Further, we show that the existence of multiple solutions to the momentum space can be attributed to the Fourier transforms of the various possible time orderings. Finally, we extend our analysis to theories with $\mathcal{N}=1,2$ supersymmetry, where we find that the constraints due to the superconformal ward identities are identical to identities involving hypergeometric functions.


title: Eccentric Mergers in AGN Discs: Influence of the Supermassive Black-Hole on Three-body Interactions

abstract: There are indications that stellar-origin black holes (BHs) are efficiently paired up in binary black holes (BBHs) in Active Galactic Nuclei (AGN) disc environments, which can undergo interactions with single BHs in the disc. Such binary-single interactions can potentially lead to an exceptionally high fraction of gravitational-wave mergers with measurable eccentricity in LIGO/Virgo/KAGRA. We here take the next important step in this line of studies, by performing post-Newtonian N-body simulations between migrating BBHs and single BHs set in an AGN disc-like configuration with a consistent inclusion of the central supermassive black hole (SMBH) in the equations of motion. With this setup, we study how the fraction of eccentric mergers varies in terms of the initial size of the BBH semi-major axis relative to the Hill sphere, as well as how it depends on the angle between the BBH and the incoming single BH. We find that the fraction of eccentric mergers is still relatively large, even when the interactions are notably influenced by the gravitational field of the nearby SMBH. However, the fraction as a function of the BBH semi-major axis does not follow a smooth functional shape, but instead shows strongly varying features that originate from the underlying phase-space structure. The phase-space further reveals that many of the eccentric mergers are formed through prompt scatterings. Finally, we present the first analytical solution to how the presence of an SMBH in terms of its Hill sphere affects the probability for forming eccentric BBH mergers through chaotic three-body interactions.


title: Mitigating Errors in DC Magnetometry via Zero-Noise Extrapolation

abstract: Zero-noise extrapolation (ZNE), a technique to estimate quantum circuit expectation values through noise scaling and extrapolation, is well-studied in the context of quantum computing. We examine the applicability of ZNE to the field of quantum sensing. Focusing on the problem of DC magnetometry using the Ramsey protocol, we show that the sensitivity (in the sense of the minimum detectable signal) does not improve upon using ZNE in the slope detection scheme. On the other hand, signals of sufficiently large magnitude can be estimated more accurately. Our results are robust across various noise models and design choices for the ZNE protocols, including both single-qubit and multi-qubit entanglement-based sensing.


title: Effective Potential and Vacuum Stability in the Litim-Sannino Model

abstract: We revisit the scalar potential in the Litim-Sannino model. We compute for the first time the full quantum corrections to the classical potential and show that they significantly ameliorate the stability analysis at the UV fixed point. The quantum effective potential is computed at two-loop order and the numerical precision is further improved using resummations and parameter optimisations. As a result, we find a consistent widening of the UV conformal window across various approximations.


title: The rate of extreme coronal line emitting galaxies in the Sloan Digital Sky Survey and their relation to tidal disruption events

abstract: Strong high-ionization iron coronal lines (CLs) are a rare phenomenon observed in galaxy and quasi-stellar object spectra that are thought to be created as a result of tidal disruption event (TDE) flares. To test whether these CLs are the result of TDE activity, we search for extreme coronal line emitting galaxies (ECLEs) in the Sloan Digital Sky Survey (SDSS), measure their rate, and compare it to TDE rates from the literature. We detect sufficiently strong CLs in 14 objects, doubling the number previously found in SDSS. Using follow-up spectra from the Dark Energy Spectroscopic Instrument and Gemini Multi-Object Spectrograph, Wide-field Infrared Survey Explorer mid-infrared observations, and Liverpool Telescope optical photometry, we find that of the seven new objects, only one evolves in a manner consistent with that of the five previously discovered variable ECLEs. Using this new sample of six variable ECLEs, we calculate the galaxy-normalised rate of ECLEs in SDSS to be $R_\mathrm{G}=2.2~^{+1.3}_{-0.8}~(\mathrm{statistical})~^{+0.0}_{-1.3}~(\mathrm{systematic})\times10^{-5}~\mathrm{galaxy}^{-1}~\mathrm{year}^{-1}$. The mass-normalised rate is $R_\mathrm{M}=1.9~^{+1.1}_{-0.7}~(\mathrm{statistical})~^{+0.0}_{-1.1}~(\mathrm{systematic})\times10^{-16}~\mathrm{M_\odot^{-1}}~\mathrm{year}^{-1}$ and the volumetric rate is $R_\mathrm{V}=6.9~^{+5.6}_{-2.1}~(\mathrm{statistical})~^{+0.0}_{-3.9}~(\mathrm{systematic})\times10^{-8}~\mathrm{Mpc}^{-3}~\mathrm{year}^{-1}$. Our rates are comparable to TDE rates from the literature, supporting the suggestion that the CLs in variable ECLEs are the product of TDEs.


title: Orbital selective order and $\mathbb{Z}_3$ Potts nematicity from a non-Fermi liquid

abstract: Motivated by systems where a high temperature non-Fermi liquid gives way to low temperature $\mathbb{Z}_3$ Potts nematic order, we studied a three-orbital Sachdev-Ye-Kitaev (SYK) model in the large-$N$ limit. In the single-site limit, this model exhibits a spontaneous orbital-selective transition which preserves average particle-hole symmetry, with two orbitals becoming insulators while the third orbital remains a non-Fermi liquid down to zero temperature. We extend this study to lattice models of three-orbital SYK dots, exploring uniform symmetry broken states on the triangular and cubic lattices. At high temperature, these lattice models exhibit an isotropic non-Fermi liquid metal phase. On the three-dimensional (3D) cubic lattice, the low temperature uniform $\mathbb{Z}_3$ nematic state corresponds to an orbital selective layered state which preserves particle-hole symmetry at small hopping and spontaneously breaks the particle-hole symmetry at large hopping. Over a wide range of temperature, the transport in this layered state shows metallic in-plane resistivity but insulating out-of-plane resistivity. On the 2D triangular lattice, the low temperature state with uniform orbital order is also a correlated $\mathbb{Z}_3$ nematic with orbital-selective transport but it remains metallic in both principal directions. We discuss a Landau theory with $\mathbb{Z}_3$ clock terms which captures salient features of the phase diagram and nematic order in all these models. We also present results on the approximate wavevector dependent orbital susceptibility of the isotropic non-Fermi liquid states.