title: Joint inversion of Time-Lapse Surface Gravity and Seismic Data for Monitoring of 3D CO$_2$ Plumes via Deep Learning

abstract: We introduce a fully 3D, deep learning-based approach for the joint inversion of time-lapse surface gravity and seismic data for reconstructing subsurface density and velocity models. The target application of this proposed inversion approach is the prediction of subsurface CO2 plumes as a complementary tool for monitoring CO2 sequestration deployments. Our joint inversion technique outperforms deep learning-based gravity-only and seismic-only inversion models, achieving improved density and velocity reconstruction, accurate segmentation, and higher R-squared coefficients. These results indicate that deep learning-based joint inversion is an effective tool for CO$_2$ storage monitoring. Future work will focus on validating our approach with larger datasets, simulations with other geological storage sites, and ultimately field data.


title: Can neural networks count digit frequency?

abstract: In this research, we aim to compare the performance of different classical machine learning models and neural networks in identifying the frequency of occurrence of each digit in a given number. It has various applications in machine learning and computer vision, e.g. for obtaining the frequency of a target object in a visual scene. We considered this problem as a hybrid of classification and regression tasks. We carefully create our own datasets to observe systematic differences between different methods. We evaluate each of the methods using different metrics across multiple datasets.The metrics of performance used were the root mean squared error and mean absolute error for regression evaluation, and accuracy for classification performance evaluation. We observe that decision trees and random forests overfit to the dataset, due to their inherent bias, and are not able to generalize well. We also observe that the neural networks significantly outperform the classical machine learning models in terms of both the regression and classification metrics for both the 6-digit and 10-digit number datasets. Dataset and code are available on github.


title: Training-free Linear Image Inverses via Flows

abstract: Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model. While recent methods have explored the use of diffusion models, they still require the manual tuning of many hyperparameters for different inverse problems. In this work, we propose a training-free method for solving linear inverse problems by using pretrained flow models, leveraging the simplicity and efficiency of Flow Matching models, using theoretically-justified weighting schemes, and thereby significantly reducing the amount of manual tuning. In particular, we draw inspiration from two main sources: adopting prior gradient correction methods to the flow regime, and a solver scheme based on conditional Optimal Transport paths. As pretrained diffusion models are widely accessible, we also show how to practically adapt diffusion models for our method. Empirically, our approach requires no problem-specific tuning across an extensive suite of noisy linear inverse problems on high-dimensional datasets, ImageNet-64/128 and AFHQ-256, and we observe that our flow-based method for solving inverse problems improves upon closely-related diffusion-based methods in most settings.


title: On-Command Disassembly of Microrobotic Superstructures for Transport and Delivery of Magnetic Micromachines

abstract: Magnetic microrobots have been developed for navigating microscale environments by means of remote magnetic fields. However, limited propulsion speeds at small scales remain an issue in the maneuverability of these devices as magnetic force and torque are proportional to their magnetic volume. Here, we propose a microrobotic superstructure, which, as analogous to a supramolecular system, consists of two or more microrobotic units that are interconnected and organized through a physical (transient) component (a polymeric frame or a thread). Our superstructures consist of microfabricated magnetic helical micromachines interlocked by a magnetic gelatin nanocomposite containing iron oxide nanoparticles (IONPs). While the microhelices enable the motion of the superstructure, the IONPs serve as heating transducers for dissolving the gelatin chassis via magnetic hyperthermia. In a practical demonstration, we showcase the superstructure's motion with a gradient magnetic field in a large channel, the disassembly of the superstructure and release of the helical micromachines by a high-frequency alternating magnetic field, and the corkscrew locomotion of the released helices through a small channel via a rotating magnetic field. This adaptable microrobotic superstructure reacts to different magnetic inputs, which could be used to perform complex delivery procedures within intricate regions of the human body.


title: Impact of global monopole on heavy mesons in hot-dense medium

abstract: This research study is primarily focus on investigating how the topological effects influence the eigenvalue solutions in the presence of a hot-dense medium. To accomplish this, we employ the non-relativistic Schr\"odinger wave equation, taking into consideration both the quantum flux field and an interaction potential. Through this approach, we determine the energy eigenvalues and their corresponding wave functions using the Nikiforov-Uvarov method. Our findings indicate that when we consider both the topological effects and the magnetic flux, $\Phi$, there is a noticeable reduction in the binding energy within the hot-dense medium. Additionally, we analyze the role of the baryonic potential in shaping the binding energy within the $(T, u_b)$ plane. Interestingly, it is evident that the influence of the baryonic potential becomes more pronounced as its values decrease


title: A Fast second-order solver for stiff multifluid dust and gas hydrodynamics

abstract: We present MDIRK: a Multifluid second-order Diagonally-Implicit Runge-Kutta method to study momentum transfer between gas and an arbitrary number ($N$) of dust species. The method integrates the equations of hydrodynamics with an Implicit Explicit (IMEX) scheme and solves the stiff source term in the momentum equation with a diagonally-implicit asymptotically stable Runge-Kutta method (DIRK). In particular, DIRK admits a simple analytical solution that can be evaluated with $\mathcal{O}(N)$ operations, instead of standard matrix inversion, which is $\mathcal{O}(N)^3$. Therefore the analytical solution significantly reduces the computational cost of the multifluid method, making it suitable for studying the dynamics of systems with particle-size distributions. We demonstrate that the method conserves momentum to machine precision and converges to the correct equilibrium solution with constant external acceleration. To validate our numerical method we present a series of simple hydrodynamic tests, including damping of sound waves, dusty shocks, a multi-fluid dusty Jeans instability, and a steady-state gas-dust drift calculation. The simplicity of MDIRK lays the groundwork to build fast high-order asymptotically stable multifluid methods.

categories: physics.comp-ph astro-ph.EP astro-ph.HE astro-ph.IM astro-ph.SR


title: Adaptive Control of an Inverted Pendulum by a Reinforcement Learning-based LQR Method

abstract: Inverted pendulums constitute one of the popular systems for benchmarking control algorithms. Several methods have been proposed for the control of this system, the majority of which rely on the availability of a mathematical model. However, deriving a mathematical model using physical parameters or system identification techniques requires manual effort. Moreover, the designed controllers may perform poorly if system parameters change. To mitigate these problems, recently, some studies used Reinforcement Learning (RL) based approaches for the control of inverted pendulum systems. Unfortunately, these methods suffer from slow convergence and local minimum problems. Moreover, they may require hyperparameter tuning which complicates the design process significantly. To alleviate these problems, the present study proposes an LQR-based RL method for adaptive balancing control of an inverted pendulum. As shown by numerical experiments, the algorithm stabilizes the system very fast without requiring a mathematical model or extensive hyperparameter tuning. In addition, it can adapt to parametric changes online.


title: Extended superposition theorem under power grid topological changes

abstract: Standard superposition theorem has been the basis in the last decades for many power system problems decomposition involving changes in nodal injections, from productions and loads. Its application scope has however been limited to fixed grid topology and breaks as soon as a topology change happens in the grid. For instance, it cannot be applied to compute N-2 power flows simply from N-1 security analysis. Topological changes also become a flexibility used more and more frequently for congestion management. Studying the effect of combinatorial topological changes is hence of interest, but so far very computation intensive. In this paper, we propose an extension of the superposition theorem to varying grid topologies. We demonstrate it under the DC approximation for all topological changes, namely line disconnection and reconnection, bus splitting and merging. We finally apply it to two use cases related to the above mentioned, effectively extending its scope of application.


title: A Brief History of Prompt: Leveraging Language Models. (Through Advanced Prompting)

abstract: This paper presents a comprehensive exploration of the evolution of prompt engineering and generation in the field of natural language processing (NLP). Starting from the early language models and information retrieval systems, we trace the key developments that have shaped prompt engineering over the years. The introduction of attention mechanisms in 2015 revolutionized language understanding, leading to advancements in controllability and context-awareness. Subsequent breakthroughs in reinforcement learning techniques further enhanced prompt engineering, addressing issues like exposure bias and biases in generated text. We examine the significant contributions in 2018 and 2019, focusing on fine-tuning strategies, control codes, and template-based generation. The paper also discusses the growing importance of fairness, human-AI collaboration, and low-resource adaptation. In 2020 and 2021, contextual prompting and transfer learning gained prominence, while 2022 and 2023 witnessed the emergence of advanced techniques like unsupervised pre-training and novel reward shaping. Throughout the paper, we reference specific research studies that exemplify the impact of various developments on prompt engineering. The journey of prompt engineering continues, with ethical considerations being paramount for the responsible and inclusive future of AI systems.


title: Fibonacci Cycles and Fixed Points

abstract: Let $S_b(n)$ denote the sum of the squares of the digits of the positive integer $n$ in base $b\geq2$. It is well-known that the sequence of iterates of $S_b(n)$ terminates in a fixed point or enters a cycle. Let $N=2n-1$, $n\geq2$. It is shown that if $b=F_{N+1}$, then a cycle of $S_b$ exists with initial term $F_{N}=F_{0}.F_{N}$, and terminal element $F_{n}.F_{n-1}$ if $n$ is even, or terminal element $F_{n-1}.F_{n}$ if $n$ is odd. Similarly, Let $N=2n+1$, $n\geq1$. If $b=F_{N-1}$, then a cycle of $S_b$ exists with initial term $F_{N}=F_{2}.F_{N-2}$, and terminal element $F_{n}.F_{n+1}$ if $n$ is even, or terminal element $F_{n+1}.F_{n}$ if $n$ is odd. Furthermore, the cycles also admit extension as an arithmetic sequence of cycles of $S_b$ with base $b=F_{N+1}+F_{N+2}k$ and $b=F_{N-1}+F_{N-2}k$, respectively. Some fixed points of $S_b$ with $b$ a Fibonacci base are shown to exist. Lastly, both cycles and fixed points admit further generalization to Pell polynomials.


title: Facilitating Battery Swapping Services for Freight Trucks with Spatial-Temporal Demand Prediction

abstract: Electrifying heavy-duty trucks offers a substantial opportunity to curtail carbon emissions, advancing toward a carbon-neutral future. However, the inherent challenges of limited battery energy and the sheer weight of heavy-duty trucks lead to reduced mileage and prolonged charging durations. Consequently, battery-swapping services emerge as an attractive solution for these trucks. This paper employs a two-fold approach to investigate the potential and enhance the efficacy of such services. Firstly, spatial-temporal demand prediction models are adopted to predict the traffic patterns for the upcoming hours. Subsequently, the prediction guides an optimization module for efficient battery allocation and deployment. Analyzing the heavy-duty truck data on a highway network spanning over 2,500 miles, our model and analysis underscore the value of prediction/machine learning in facilitating future decision-makings. In particular, we find that the initial phase of implementing battery-swapping services favors mobile battery-swapping stations, but as the system matures, fixed-location stations are preferred.


title: A Nationwide Multi-Location Multi-Resource Stochastic Programming Based Energy Planning Framework

abstract: The global increase in energy consumption and demand has forced many countries to transition into including more diverse energy sources in their electricity market. To efficiently utilize the available fuel resources, all energy sources must be optimized simultaneously. However, the inherent variability in variable renewable energy generators makes deterministic models ineffective. On the other hand, comprehensive stochastic models, including all sources of generation across a nation, can become computationally intractable. This work proposes a comprehensive national energy planning framework from a policymaker's perspective, which is generalizable to any country, region, or any group of countries in energy trade agreements. Given its relative land area and energy consumption globally, the United States is selected as a case study. A two-stage stochastic programming approach is adopted, and a scenario-based Benders decomposition modeling approach is employed to achieve computational efficiency for the large-scale model. Data is obtained from the U.S. Energy Information Administration's online data collection. Scenarios for the uncertain parameters are developed using a k-means clustering algorithm. Various cases are compared from a financial perspective to inform policymaking by identifying implementable cost-reduction strategies. The findings underscore the importance of promoting resource coordination and demonstrate the impact of increasing interchange and renewable energy capacity on overall gains. Moreover, the study highlights the value of stochastic optimization modeling compared to deterministic modeling to make energy planning decisions.


title: The Optimal use of Segmentation for Sampling Calorimeters

abstract: One of the key design choices of any sampling calorimeter is how fine to make the longitudinal and transverse segmentation. To inform this choice, we study the impact of calorimeter segmentation on energy reconstruction. To ensure that the trends are due entirely to hardware and not to a sub-optimal use of segmentation, we deploy deep neural networks to perform the reconstruction. These networks make use of all available information by representing the calorimeter as a point cloud. To demonstrate our approach, we simulate a detector similar to the forward calorimeter system intended for use in the ePIC detector, which will operate at the upcoming Electron Ion Collider. We find that for the energy estimation of isolated charged pion showers, relatively fine longitudinal segmentation is key to achieving an energy resolution that is better than 10% across the full phase space. These results provide a valuable benchmark for ongoing EIC detector optimizations and may also inform future studies involving high-granularity calorimeters in other experiments at various facilities.

categories: physics.ins-det cs.LG hep-ex hep-ph nucl-ex


title: Human Mobility Question Answering (Vision Paper)

abstract: Question answering (QA) systems have attracted much attention from the artificial intelligence community as they can learn to answer questions based on the given knowledge source (e.g., images in visual question answering). However, the research into question answering systems with human mobility data remains unexplored. Mining human mobility data is crucial for various applications such as smart city planning, pandemic management, and personalised recommendation system. In this paper, we aim to tackle this gap and introduce a novel task, that is, human mobility question answering (MobQA). The aim of the task is to let the intelligent system learn from mobility data and answer related questions. This task presents a new paradigm change in mobility prediction research and further facilitates the research of human mobility recommendation systems. To better support this novel research topic, this vision paper also proposes an initial design of the dataset and a potential deep learning model framework for the introduced MobQA task. We hope that this paper will provide novel insights and open new directions in human mobility research and question answering research.


title: What's the Magic Word? A Control Theory of LLM Prompting

abstract: Prompt engineering is crucial for deploying LLMs but is poorly understood mathematically. We formalize LLM systems as a class of discrete stochastic dynamical systems to explore prompt engineering through the lens of control theory. We investigate the reachable set of output token sequences $R_y(\mathbf x_0)$ for which there exists a control input sequence $\mathbf u$ for each $\mathbf y \in R_y(\mathbf x_0)$ that steers the LLM to output $\mathbf y$ from initial state sequence $\mathbf x_0$. We offer analytic analysis on the limitations on the controllability of self-attention in terms of reachable set, where we prove an upper bound on the reachable set of outputs $R_y(\mathbf x_0)$ as a function of the singular values of the parameter matrices. We present complementary empirical analysis on the controllability of a panel of LLMs, including Falcon-7b, Llama-7b, and Falcon-40b. Our results demonstrate a lower bound on the reachable set of outputs $R_y(\mathbf x_0)$ w.r.t. initial state sequences $\mathbf x_0$ sampled from the Wikitext dataset. We find that the correct next Wikitext token following sequence $\mathbf x_0$ is reachable over 97% of the time with prompts of $k\leq 10$ tokens. We also establish that the top 75 most likely next tokens, as estimated by the LLM itself, are reachable at least 85% of the time with prompts of $k\leq 10$ tokens. Intriguingly, short prompt sequences can dramatically alter the likelihood of specific outputs, even making the least likely tokens become the most likely ones. This control-centric analysis of LLMs demonstrates the significant and poorly understood role of input sequences in steering output probabilities, offering a foundational perspective for enhancing language model system capabilities.


title: LoFT: Local Proxy Fine-tuning For Improving Transferability Of Adversarial Attacks Against Large Language Model

abstract: It has been shown that Large Language Model (LLM) alignments can be circumvented by appending specially crafted attack suffixes with harmful queries to elicit harmful responses. To conduct attacks against private target models whose characterization is unknown, public models can be used as proxies to fashion the attack, with successful attacks being transferred from public proxies to private target models. The success rate of attack depends on how closely the proxy model approximates the private model. We hypothesize that for attacks to be transferrable, it is sufficient if the proxy can approximate the target model in the neighborhood of the harmful query. Therefore, in this paper, we propose \emph{Local Fine-Tuning (LoFT)}, \textit{i.e.}, fine-tuning proxy models on similar queries that lie in the lexico-semantic neighborhood of harmful queries to decrease the divergence between the proxy and target models. First, we demonstrate three approaches to prompt private target models to obtain similar queries given harmful queries. Next, we obtain data for local fine-tuning by eliciting responses from target models for the generated similar queries. Then, we optimize attack suffixes to generate attack prompts and evaluate the impact of our local fine-tuning on the attack's success rate. Experiments show that local fine-tuning of proxy models improves attack transferability and increases attack success rate by $39\%$, $7\%$, and $0.5\%$ (absolute) on target models ChatGPT, GPT-4, and Claude respectively.


title: Asymptotic analysis and simulation of mean first passage time for active Brownian particles in 1-D

abstract: Active Brownian particles (ABPs) are a model for nonequilibrium systems in which the constituent particles are self-propelled in addition to their Brownian motion. Compared to the well-studied mean first passage time (MFPT) of passive Brownian particles, the MFPT of ABPs is much less developed. In this paper, we study the MFPT for ABPs in a 1-D domain with absorbing boundary conditions at both ends of the domain. To reveal the effect of swimming on the MFPT, we consider an asymptotic analysis in the weak-swimming or small P\'eclet (Pe) number limit. In particular, analytical expressions for the survival probability and the MFPT are developed up to O(Pe$^2$). We explore the effects of the starting positions and starting orientations on the MFPT. Our analysis shows that if the starting orientations are biased towards one side of the domain, the MFPT as a function of the starting position becomes asymmetric about the center of the domain. The analytical results were confirmed by the numerical solutions of the full PDE model.


title: A Survey on Conflict Detection in IoT-based Smart Homes

abstract: As the adoption of IoT-based smart homes continues to grow, the importance of addressing potential conflicts becomes increasingly vital for ensuring seamless functionality and user satisfaction. In this survey, we introduce a novel conflict taxonomy, complete with formal definitions of each conflict type that may arise within the smart home environment. We design an advanced conflict model to effectively categorize these conflicts, setting the stage for our in-depth review of recent research in the field. By employing our proposed model, we systematically classify conflicts and present a comprehensive overview of cutting-edge conflict detection approaches. This extensive analysis allows us to highlight similarities, clarify significant differences, and uncover prevailing trends in conflict detection techniques. In conclusion, we shed light on open issues and suggest promising avenues for future research to foster accelerated development and deployment of IoT-based smart homes, ultimately enhancing their overall performance and user experience.


title: Fault Trees, Decision Trees, And Binary Decision Diagrams: A Systematic Comparison

abstract: In reliability engineering, we need to understand system dependencies, cause-effect relations, identify critical components, and analyze how they trigger failures. Three prominent graph models commonly used for these purposes are fault trees (FTs), decision trees (DTs), and binary decision diagrams (BDDs). These models are popular because they are easy to interpret, serve as a communication tool between stakeholders of various backgrounds, and support decision-making processes. Moreover, these models help to understand real-world problems by computing reliability metrics, minimum cut sets, logic rules, and displaying dependencies. Nevertheless, it is unclear how these graph models compare. Thus, the goal of this paper is to understand the similarities and differences through a systematic comparison based on their (i) purpose and application, (ii) structural representation, (iii) analysis methods, (iv) construction, and (v) benefits & limitations. Furthermore, we use a running example based on a Container Seal Design to showcase the models in practice. Our results show that, given that FTs, DTs and BDDs have different purposes and application domains, they adopt different structural representations and analysis methodologies that entail a variety of benefits and limitations, the latter can be addressed via conversion methods or extensions. Specific remarks are that BDDs can be considered as a compact representation of binary DTs, since the former allows sub-node sharing, which makes BDDs more efficient at representing logical rules than binary DTs. It is possible to obtain cut sets from BDDs and DTs and construct a FT using the (con/dis)junctive normal form, although this may result in a sub-optimal FT structure.


title: On non-commutative spreadability

abstract: We review some results on spreadable quantum stochastic processes and present the structure of some monoids acting on the index-set of all integers $\mathbb Z$. These semigroups are strictly related to spreadability, as the latter can be directly stated in terms of invariance with respect to their action. We are mainly focused on spreadable, Boolean, monotone, and $q$-deformed processes. In particular, we give a suitable version of the Ryll-Nardzewski Theorem in the aforementioned cases.


title: Investigating Large Language Models' Perception of Emotion Using Appraisal Theory

abstract: Large Language Models (LLM) like ChatGPT have significantly advanced in recent years and are now being used by the general public. As more people interact with these systems, improving our understanding of these black box models is crucial, especially regarding their understanding of human psychological aspects. In this work, we investigate their emotion perception through the lens of appraisal and coping theory using the Stress and Coping Process Questionaire (SCPQ). SCPQ is a validated clinical instrument consisting of multiple stories that evolve over time and differ in key appraisal variables such as controllability and changeability. We applied SCPQ to three recent LLMs from OpenAI, davinci-003, ChatGPT, and GPT-4 and compared the results with predictions from the appraisal theory and human data. The results show that LLMs' responses are similar to humans in terms of dynamics of appraisal and coping, but their responses did not differ along key appraisal dimensions as predicted by the theory and data. The magnitude of their responses is also quite different from humans in several variables. We also found that GPTs can be quite sensitive to instruction and how questions are asked. This work adds to the growing literature evaluating the psychological aspects of LLMs and helps enrich our understanding of the current models.


title: AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models

abstract: The aligned Large Language Models (LLMs) are powerful language understanding and decision-making tools that are created through extensive alignment with human feedback. However, these large models remain susceptible to jailbreak attacks, where adversaries manipulate prompts to elicit malicious outputs that should not be given by aligned LLMs. Investigating jailbreak prompts can lead us to delve into the limitations of LLMs and further guide us to secure them. Unfortunately, existing jailbreak techniques suffer from either (1) scalability issues, where attacks heavily rely on manual crafting of prompts, or (2) stealthiness problems, as attacks depend on token-based algorithms to generate prompts that are often semantically meaningless, making them susceptible to detection through basic perplexity testing. In light of these challenges, we intend to answer this question: Can we develop an approach that can automatically generate stealthy jailbreak prompts? In this paper, we introduce AutoDAN, a novel jailbreak attack against aligned LLMs. AutoDAN can automatically generate stealthy jailbreak prompts by the carefully designed hierarchical genetic algorithm. Extensive evaluations demonstrate that AutoDAN not only automates the process while preserving semantic meaningfulness, but also demonstrates superior attack strength in cross-model transferability, and cross-sample universality compared with the baseline. Moreover, we also compare AutoDAN with perplexity-based defense methods and show that AutoDAN can bypass them effectively.


title: Short text classification with machine learning in the social sciences: The case of climate change on Twitter

abstract: To analyse large numbers of texts, social science researchers are increasingly confronting the challenge of text classification. When manual labeling is not possible and researchers have to find automatized ways to classify texts, computer science provides a useful toolbox of machine-learning methods whose performance remains understudied in the social sciences. In this article, we compare the performance of the most widely used text classifiers by applying them to a typical research scenario in social science research: a relatively small labeled dataset with infrequent occurrence of categories of interest, which is a part of a large unlabeled dataset. As an example case, we look at Twitter communication regarding climate change, a topic of increasing scholarly interest in interdisciplinary social science research. Using a novel dataset including 5,750 tweets from various international organizations regarding the highly ambiguous concept of climate change, we evaluate the performance of methods in automatically classifying tweets based on whether they are about climate change or not. In this context, we highlight two main findings. First, supervised machine-learning methods perform better than state-of-the-art lexicons, in particular as class balance increases. Second, traditional machine-learning methods, such as logistic regression and random forest, perform similarly to sophisticated deep-learning methods, whilst requiring much less training time and computational resources. The results have important implications for the analysis of short texts in social science research.


title: COVID-19 South African Vaccine Hesitancy Models Show Boost in Performance Upon Fine-Tuning on M-pox Tweets

abstract: Very large numbers of M-pox cases have, since the start of May 2022, been reported in non-endemic countries leading many to fear that the M-pox Outbreak would rapidly transition into another pandemic, while the COVID-19 pandemic ravages on. Given the similarities of M-pox with COVID-19, we chose to test the performance of COVID-19 models trained on South African twitter data on a hand-labelled M-pox dataset before and after fine-tuning. More than 20k M-pox-related tweets from South Africa were hand-labelled as being either positive, negative or neutral. After fine-tuning these COVID-19 models on the M-pox dataset, the F1-scores increased by more than 8% falling just short of 70%, but still outperforming state-of-the-art models and well-known classification algorithms. An LDA-based topic modelling procedure was used to compare the miss-classified M-pox tweets of the original COVID-19 RoBERTa model with its fine-tuned version, and from this analysis, we were able to draw conclusions on how to build more sophisticated models.


title: Spherical Position Encoding for Transformers

abstract: Position encoding is the primary mechanism which induces notion of sequential order for input tokens in transformer architectures. Even though this formulation in the original transformer paper has yielded plausible performance for general purpose language understanding and generation, several new frameworks such as Rotary Position Embedding (RoPE) are proposed for further enhancement. In this paper, we introduce the notion of "geotokens" which are input elements for transformer architectures, each representing an information related to a geological location. Unlike the natural language the sequential position is not important for the model but the geographical coordinates are. In order to induce the concept of relative position for such a setting and maintain the proportion between the physical distance and distance on embedding space, we formulate a position encoding mechanism based on RoPE architecture which is adjusted for spherical coordinates.


title: Inclusive Data Representation in Federated Learning: A Novel Approach Integrating Textual and Visual Prompt

abstract: Federated Learning (FL) is often impeded by communication overhead issues. Prompt tuning, as a potential solution, has been introduced to only adjust a few trainable parameters rather than the whole model. However, current single-modality prompt tuning approaches fail to comprehensively portray local clients' data. To overcome this limitation, we present Twin Prompt Federated learning (TPFL), a pioneering solution that integrates both visual and textual modalities, ensuring a more holistic representation of local clients' data characteristics. Furthermore, in order to tackle the data heterogeneity issues, we introduce the Augmented TPFL (ATPFL) employing the contrastive learning to TPFL, which not only enhances the global knowledge acquisition of client models but also fosters the development of robust, compact models. The effectiveness of TPFL and ATPFL is substantiated by our extensive evaluations, consistently showing superior performance compared to all baselines.


title: Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation

abstract: Emotion Recognition in Conversation (ERC) plays an important role in driving the development of human-machine interaction. Emotions can exist in multiple modalities, and multimodal ERC mainly faces two problems: (1) the noise problem in the cross-modal information fusion process, and (2) the prediction problem of less sample emotion labels that are semantically similar but different categories. To address these issues and fully utilize the features of each modality, we adopted the following strategies: first, deep emotion cues extraction was performed on modalities with strong representation ability, and feature filters were designed as multimodal prompt information for modalities with weak representation ability. Then, we designed a Multimodal Prompt Transformer (MPT) to perform cross-modal information fusion. MPT embeds multimodal fusion information into each attention layer of the Transformer, allowing prompt information to participate in encoding textual features and being fused with multi-level textual information to obtain better multimodal fusion features. Finally, we used the Hybrid Contrastive Learning (HCL) strategy to optimize the model's ability to handle labels with few samples. This strategy uses unsupervised contrastive learning to improve the representation ability of multimodal fusion and supervised contrastive learning to mine the information of labels with few samples. Experimental results show that our proposed model outperforms state-of-the-art models in ERC on two benchmark datasets.


title: ProGO: Probabilistic Global Optimizer

abstract: In the field of global optimization, many existing algorithms face challenges posed by non-convex target functions and high computational complexity or unavailability of gradient information. These limitations, exacerbated by sensitivity to initial conditions, often lead to suboptimal solutions or failed convergence. This is true even for Metaheuristic algorithms designed to amalgamate different optimization techniques to improve their efficiency and robustness. To address these challenges, we develop a sequence of multidimensional integration-based methods that we show to converge to the global optima under some mild regularity conditions. Our probabilistic approach does not require the use of gradients and is underpinned by a mathematically rigorous convergence framework anchored in the nuanced properties of nascent optima distribution. In order to alleviate the problem of multidimensional integration, we develop a latent slice sampler that enjoys a geometric rate of convergence in generating samples from the nascent optima distribution, which is used to approximate the global optima. The proposed Probabilistic Global Optimizer (ProGO) provides a scalable unified framework to approximate the global optima of any continuous function defined on a domain of arbitrary dimension. Empirical illustrations of ProGO across a variety of popular non-convex test functions (having finite global optima) reveal that the proposed algorithm outperforms, by order of magnitude, many existing state-of-the-art methods, including gradient-based, zeroth-order gradient-free, and some Bayesian Optimization methods, in term regret value and speed of convergence. It is, however, to be noted that our approach may not be suitable for functions that are expensive to compute.


title: Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning

abstract: We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR methods, of which Principal Components Analysis is a paradigmatic example, each modality is compressed independently, striving to retain as much variation within each modality as possible. In contrast, in SDR, one simultaneously compresses the modalities to maximize the covariation between the reduced descriptions while paying less attention to how much individual variation is preserved. Paradigmatic examples include Partial Least Squares and Canonical Correlations Analysis. Even though these DR methods are a staple of statistics, their relative accuracy and data set size requirements are poorly understood. We introduce a generative linear model to synthesize multimodal data with known variance and covariance structures to examine these questions. We assess the accuracy of the reconstruction of the covariance structures as a function of the number of samples, signal-to-noise ratio, and the number of varying and covarying signals in the data. Using numerical experiments, we demonstrate that linear SDR methods consistently outperform linear IDR methods and yield higher-quality, more succinct reduced-dimensional representations with smaller datasets. Remarkably, regularized CCA can identify low-dimensional weak covarying structures even when the number of samples is much smaller than the dimensionality of the data, which is a regime challenging for all dimensionality reduction methods. Our work corroborates and explains previous observations in the literature that SDR can be more effective in detecting covariation patterns in data. These findings suggest that SDR should be preferred to IDR in real-world data analysis when detecting covariation is more important than preserving variation.


title: Extended Kalman Filter State Estimation for Autonomous Competition Robots

abstract: Autonomous mobile robot competitions judge based on a robot's ability to quickly and accurately navigate the game field. This means accurate localization is crucial for creating an autonomous competition robot. Two common localization methods are odometry and computer vision landmark detection. Odometry provides frequent velocity measurements, while landmark detection provides infrequent position measurements. The state can also be predicted with a physics model. These three types of localization can be "fused" to create a more accurate state estimate using an Extended Kalman Filter (EKF). The EKF is a nonlinear full-state estimator that approximates the state estimate with the lowest covariance error when given the sensor measurements, the model prediction, and their variances. In this paper, we demonstrate the effectiveness of the EKF by implementing it on a 4-wheel mecanum-drive robot simulation. The position and velocity accuracy of fusing together various combinations of these three data sources are compared. We also discuss the assumptions and limitations of an EKF.


title: Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language

abstract: To understand the algorithm that supports the human brain's language representation, previous research has attempted to predict neural responses to linguistic stimuli using embeddings generated by artificial neural networks (ANNs), a process known as neural encoding. However, most of these studies have focused on probing neural representations of Germanic languages, such as English, with unsupervised ANNs. In this paper, we propose to bridge the gap between human brain and supervised ANN representations of the Chinese language. Specifically, we investigate how task tuning influences a pretained Transformer for neural encoding and which tasks lead to the best encoding performances. We generate supervised representations on eight Natural Language Understanding (NLU) tasks using prompt-tuning, a technique that is seldom explored in neural encoding for language. We demonstrate that prompt-tuning yields representations that better predict neural responses to Chinese stimuli than traditional fine-tuning on four tasks. Furthermore, we discover that tasks that require a fine-grained processing of concepts and entities lead to representations that are most predictive of brain activation patterns. Additionally, we reveal that the proportion of tuned parameters highly influences the neural encoding performance of fine-tuned models. Overall, our experimental findings could help us better understand the relationship between supervised artificial and brain language representations.


title: AI-based automated active learning for discovery of hidden dynamic processes: A use case in light microscopy

abstract: In the biomedical environment, experiments assessing dynamic processes are primarily performed by a human acquisition supervisor. Contemporary implementations of such experiments frequently aim to acquire a maximum number of relevant events from sometimes several hundred parallel, non-synchronous processes. Since in some high-throughput experiments, only one or a few instances of a given process can be observed simultaneously, a strategy for planning and executing an efficient acquisition paradigm is essential. To address this problem, we present two new methods in this paper. The first method, Encoded Dynamic Process (EDP), is Artificial Intelligence (AI)-based and represents dynamic processes so as to allow prediction of pseudo-time values from single still images. Second, with Experiment Automation Pipeline for Dynamic Processes (EAPDP), we present a Machine Learning Operations (MLOps)-based pipeline that uses the extracted knowledge from EDP to efficiently schedule acquisition in biomedical experiments for dynamic processes in practice. In a first experiment, we show that the pre-trained State-Of-The- Art (SOTA) object segmentation method Contour Proposal Networks (CPN) works reliably as a module of EAPDP to extract the relevant object for EDP from the acquired three-dimensional image stack.


title: Management strategies for hydropower plants a simple dynamic programming approach

abstract: We use a dynamic programming approach to construct management strategies for a hydropower plant with a dam and a continuously adjustable unit. Along the way, we estimate unknown variables via simple models using historical data and forecasts. Our suggested scheme achieves on average 97.1 % of the theoretical maximum using small computational effort. We also apply our scheme to a Run-of-River hydropower plant and compare the strategies and results to the much more involved PDE-based optimal switching method studied earlier by the authors in (Optimization and Engineering (2021): 1-25); this comparison shows that our simple approach may be preferable if the underlying data is sufficiently rich.


title: Diffusing on Two Levels and Optimizing for Multiple Properties: A Novel Approach to Generating Molecules with Desirable Properties

abstract: In the past decade, Artificial Intelligence driven drug design and discovery has been a hot research topic, where an important branch is molecule generation by generative models, from GAN-based models and VAE-based models to the latest diffusion-based models. However, most existing models pursue only the basic properties like validity and uniqueness of the generated molecules, a few go further to explicitly optimize one single important molecular property (e.g. QED or PlogP), which makes most generated molecules little usefulness in practice. In this paper, we present a novel approach to generating molecules with desirable properties, which expands the diffusion model framework with multiple innovative designs. The novelty is two-fold. On the one hand, considering that the structures of molecules are complex and diverse, and molecular properties are usually determined by some substructures (e.g. pharmacophores), we propose to perform diffusion on two structural levels: molecules and molecular fragments respectively, with which a mixed Gaussian distribution is obtained for the reverse diffusion process. To get desirable molecular fragments, we develop a novel electronic effect based fragmentation method. On the other hand, we introduce two ways to explicitly optimize multiple molecular properties under the diffusion model framework. First, as potential drug molecules must be chemically valid, we optimize molecular validity by an energy-guidance function. Second, since potential drug molecules should be desirable in various properties, we employ a multi-objective mechanism to optimize multiple molecular properties simultaneously. Extensive experiments with two benchmark datasets QM9 and ZINC250k show that the molecules generated by our proposed method have better validity, uniqueness, novelty, Fr\'echet ChemNet Distance (FCD), QED, and PlogP than those generated by current SOTA models.


title: Integration of Fractional Order Black-Scholes Merton with Neural Network

abstract: This study enhances option pricing by presenting unique pricing model fractional order Black-Scholes-Merton (FOBSM) which is based on the Black-Scholes-Merton (BSM) model. The main goal is to improve the precision and authenticity of option pricing, matching them more closely with the financial landscape. The approach integrates the strengths of both the BSM and neural network (NN) with complex diffusion dynamics. This study emphasizes the need to take fractional derivatives into account when analyzing financial market dynamics. Since FOBSM captures memory characteristics in sequential data, it is better at simulating real-world systems than integer-order models. Findings reveals that in complex diffusion dynamics, this hybridization approach in option pricing improves the accuracy of price predictions. the key contribution of this work lies in the development of a novel option pricing model (FOBSM) that leverages fractional calculus and neural networks to enhance accuracy in capturing complex diffusion dynamics and memory effects in financial data.


title: How toxic is antisemitism? Potentials and limitations of automated toxicity scoring for antisemitic online content

abstract: The Perspective API, a popular text toxicity assessment service by Google and Jigsaw, has found wide adoption in several application areas, notably content moderation, monitoring, and social media research. We examine its potentials and limitations for the detection of antisemitic online content that, by definition, falls under the toxicity umbrella term. Using a manually annotated German-language dataset comprising around 3,600 posts from Telegram and Twitter, we explore as how toxic antisemitic texts are rated and how the toxicity scores differ regarding different subforms of antisemitism and the stance expressed in the texts. We show that, on a basic level, Perspective API recognizes antisemitic content as toxic, but shows critical weaknesses with respect to non-explicit forms of antisemitism and texts taking a critical stance towards it. Furthermore, using simple text manipulations, we demonstrate that the use of widespread antisemitic codes can substantially reduce API scores, making it rather easy to bypass content moderation based on the service's results.


title: HartleyMHA: Self-Attention in Frequency Domain for Resolution-Robust and Parameter-Efficient 3D Image Segmentation

abstract: With the introduction of Transformers, different attention-based models have been proposed for image segmentation with promising results. Although self-attention allows capturing of long-range dependencies, it suffers from a quadratic complexity in the image size especially in 3D. To avoid the out-of-memory error during training, input size reduction is usually required for 3D segmentation, but the accuracy can be suboptimal when the trained models are applied on the original image size. To address this limitation, inspired by the Fourier neural operator (FNO), we introduce the HartleyMHA model which is robust to training image resolution with efficient self-attention. FNO is a deep learning framework for learning mappings between functions in partial differential equations, which has the appealing properties of zero-shot super-resolution and global receptive field. We modify the FNO by using the Hartley transform with shared parameters to reduce the model size by orders of magnitude, and this allows us to further apply self-attention in the frequency domain for more expressive high-order feature combination with improved efficiency. When tested on the BraTS'19 dataset, it achieved superior robustness to training image resolution than other tested models with less than 1% of their model parameters.


title: Design Principles for Lifelong Learning AI Accelerators

abstract: Lifelong learning - an agent's ability to learn throughout its lifetime - is a hallmark of biological learning systems and a central challenge for artificial intelligence (AI). The development of lifelong learning algorithms could lead to a range of novel AI applications, but this will also require the development of appropriate hardware accelerators, particularly if the models are to be deployed on edge platforms, which have strict size, weight, and power constraints. Here, we explore the design of lifelong learning AI accelerators that are intended for deployment in untethered environments. We identify key desirable capabilities for lifelong learning accelerators and highlight metrics to evaluate such accelerators. We then discuss current edge AI accelerators and explore the future design of lifelong learning accelerators, considering the role that different emerging technologies could play.


title: Validating transformers for redaction of text from electronic health records in real-world healthcare

abstract: Protecting patient privacy in healthcare records is a top priority, and redaction is a commonly used method for obscuring directly identifiable information in text. Rule-based methods have been widely used, but their precision is often low causing over-redaction of text and frequently not being adaptable enough for non-standardised or unconventional structures of personal health information. Deep learning techniques have emerged as a promising solution, but implementing them in real-world environments poses challenges due to the differences in patient record structure and language across different departments, hospitals, and countries. In this study, we present AnonCAT, a transformer-based model and a blueprint on how deidentification models can be deployed in real-world healthcare. AnonCAT was trained through a process involving manually annotated redactions of real-world documents from three UK hospitals with different electronic health record systems and 3116 documents. The model achieved high performance in all three hospitals with a Recall of 0.99, 0.99 and 0.96. Our findings demonstrate the potential of deep learning techniques for improving the efficiency and accuracy of redaction in global healthcare data and highlight the importance of building workflows which not just use these models but are also able to continually fine-tune and audit the performance of these algorithms to ensure continuing effectiveness in real-world settings. This approach provides a blueprint for the real-world use of de-identifying algorithms through fine-tuning and localisation, the code together with tutorials is available on GitHub (https://github.com/CogStack/MedCAT).


title: Taming Binarized Neural Networks and Mixed-Integer Programs

abstract: There has been a great deal of recent interest in binarized neural networks, especially because of their explainability. At the same time, automatic differentiation algorithms such as backpropagation fail for binarized neural networks, which limits their applicability. By reformulating the problem of training binarized neural networks as a subadditive dual of a mixed-integer program, we show that binarized neural networks admit a tame representation. This, in turn, makes it possible to use the framework of Bolte et al. for implicit differentiation, which offers the possibility for practical implementation of backpropagation in the context of binarized neural networks. This approach could also be used for a broader class of mixed-integer programs, beyond the training of binarized neural networks, as encountered in symbolic approaches to AI and beyond.


title: Hierarchical Multi-Marginal Optimal Transport for Network Alignment

abstract: Finding node correspondence across networks, namely multi-network alignment, is an essential prerequisite for joint learning on multiple networks. Despite great success in aligning networks in pairs, the literature on multi-network alignment is sparse due to the exponentially growing solution space and lack of high-order discrepancy measures. To fill this gap, we propose a hierarchical multi-marginal optimal transport framework named HOT for multi-network alignment. To handle the large solution space, multiple networks are decomposed into smaller aligned clusters via the fused Gromov-Wasserstein (FGW) barycenter. To depict high-order relationships across multiple networks, the FGW distance is generalized to the multi-marginal setting, based on which networks can be aligned jointly. A fast proximal point method is further developed with guaranteed convergence to a local optimum. Extensive experiments and analysis show that our proposed HOT achieves significant improvements over the state-of-the-art in both effectiveness and scalability.


title: Fast Neighborhood Search Heuristics for the Colorful Bin Packing Problem

abstract: The Colorful Bin Packing Problem (CBPP) is a generalization of the Bin Packing Problem (BPP). The CBPP consists of packing a set of items, each with a weight and a color, in bins of limited capacity, minimizing the number of used bins and satisfying the constraint that two items of the same color cannot be packed side by side in the same bin. In this article, we proposed an adaptation of BPP heuristics and new heuristics for the CBPP. Moreover, we propose a set of fast neighborhood search algorithms for CBPP. These neighborhoods are applied in a meta-heuristic approach based on the Variable Neighborhood Search (VNS) and a matheuristic approach that mixes linear programming with the meta-heuristics VNS and Greedy Randomized Adaptive Search (GRASP). The results indicate that our matheuristic is superior to VNS and that both approaches can find near-optimal solutions for a large number instances, even for instances with many items.


title: Effective Slogan Generation with Noise Perturbation

abstract: Slogans play a crucial role in building the brand's identity of the firm. A slogan is expected to reflect firm's vision and brand's value propositions in memorable and likeable ways. Automating the generation of slogans with such characteristics is challenging. Previous studies developted and tested slogan generation with syntactic control and summarization models which are not capable of generating distinctive slogans. We introduce a a novel apporach that leverages pre-trained transformer T5 model with noise perturbation on newly proposed 1:N matching pair dataset. This approach serves as a contributing fator in generting distinctive and coherent slogans. Turthermore, the proposed approach incorporates descriptions about the firm and brand into the generation of slogans. We evaluate generated slogans based on ROUGE1, ROUGEL and Cosine Similarity metrics and also assess them with human subjects in terms of slogan's distinctiveness, coherence, and fluency. The results demonstrate that our approach yields better performance than baseline models and other transformer-based models.


title: Algebraic Enumeration of Polypolyhedra

abstract: Polypolyhedra are edge-transitive compounds of polyhedra. In this paper we use group theory to determine the number of distinct polypolyhedra whose symmetry group is any given finite irreducible Coxeter group. We apply this result in order to enumerate the 3-dimensional polypolyhedra.


title: Reverse Chain: A Generic-Rule for LLMs to Master Multi-API Planning

abstract: While enabling large language models to implement function calling (known as APIs) can greatly enhance the performance of Large Language Models (LLMs), function calling is still a challenging task due to the complicated relations between different APIs, especially in a context-learning setting without fine-tuning. This paper introduces ``Reverse Chain'', a controllable, target-driven approach designed to empower LLMs with the capability to operate external APIs only via prompts. Recognizing that most LLMs have limited tool-use capabilities, Reverse Chain limits LLMs to executing simple tasks, e.g., API Selection and Argument Completion. Furthermore, to manage a controllable multi-function calling, Reverse Chain adopts a generic rule based on a backward reasoning process. This rule determines when to do API selection or Argument completion. To evaluate the multi-tool-use capability of LLMs, we have released a compositional multi-tool task dataset, available at \url{https://anonymous.4open.science/r/reverse-chain-8681}. Extensive numerical experiments validate the remarkable proficiency of Reverse Chain in managing multiple API calls.


title: Demystifying Embedding Spaces using Large Language Models

abstract: Embeddings have become a pivotal means to represent complex, multi-faceted information about entities, concepts, and relationships in a condensed and useful format. Nevertheless, they often preclude direct interpretation. While downstream tasks make use of these compressed representations, meaningful interpretation usually requires visualization using dimensionality reduction or specialized machine learning interpretability methods. This paper addresses the challenge of making such embeddings more interpretable and broadly useful, by employing Large Language Models (LLMs) to directly interact with embeddings -- transforming abstract vectors into understandable narratives. By injecting embeddings into LLMs, we enable querying and exploration of complex embedding data. We demonstrate our approach on a variety of diverse tasks, including: enhancing concept activation vectors (CAVs), communicating novel embedded entities, and decoding user preferences in recommender systems. Our work couples the immense information potential of embeddings with the interpretative power of LLMs.


title: Strong transitivity of a graph

abstract: A vertex partition $\pi = \{V_1, V_2, \ldots, V_k\}$ of $G$ is called a \emph{transitive partition} of size $k$ if $V_i$ dominates $V_j$ for all $1\leq i<j\leq k$. For two disjoint subsets $A$ and $B$ of $V$, we say $A$ \emph{strongly dominates} $B$ if for every vertex $y\in B$, there exists a vertex $x\in A$, such that $xy\in E$ and $deg_G(x)\geq deg_G(y)$. A vertex partition $\pi = \{V_1, V_2, \ldots, V_k\}$ of $G$ is called a \emph{strong transitive partition} of size $k$ if $V_i$ strongly dominates $V_j$ for all $1\leq i<j\leq k$. The \textsc{Maximum Strong Transitivity Problem} is to find a strong transitive partition of a given graph with the maximum number of parts. In this article, we initiate the study of this variation of transitive partition from algorithmic point of view. We show that the decision version of this problem is NP-complete for chordal graphs. On the positive side, we prove that this problem can be solved in linear time for trees and split graphs.


title: Higher-Order DeepTrails: Unified Approach to *Trails

abstract: Analyzing, understanding, and describing human behavior is advantageous in different settings, such as web browsing or traffic navigation. Understanding human behavior naturally helps to improve and optimize the underlying infrastructure or user interfaces. Typically, human navigation is represented by sequences of transitions between states. Previous work suggests to use hypotheses, representing different intuitions about the navigation to analyze these transitions. To mathematically grasp this setting, first-order Markov chains are used to capture the behavior, consequently allowing to apply different kinds of graph comparisons, but comes with the inherent drawback of losing information about higher-order dependencies within the sequences. To this end, we propose to analyze entire sequences using autoregressive language models, as they are traditionally used to model higher-order dependencies in sequences. We show that our approach can be easily adapted to model different settings introduced in previous work, namely HypTrails, MixedTrails and even SubTrails, while at the same time bringing unique advantages: 1. Modeling higher-order dependencies between state transitions, while 2. being able to identify short comings in proposed hypotheses, and 3. naturally introducing a unified approach to model all settings. To show the expressiveness of our approach, we evaluate our approach on different synthetic datasets and conclude with an exemplary analysis of a real-world dataset, examining the behavior of users who interact with voice assistants.


title: Full-scale modal testing of a Hawk T1A aircraft for benchmarking vibration-based methods

abstract: Research developments for structural dynamics in the fields of design, system identification and structural health monitoring (SHM) have dramatically expanded the bounds of what can be learned from measured vibration data. However, significant challenges remain in the tasks of identification, prediction and evaluation of full-scale structures. A significant aid in the roadmap to the application of cutting-edge methods to the demands of in-service engineering structures, is the development of comprehensive benchmark datasets. With the aim of developing a useful and worthwhile benchmark dataset for structural dynamics, an extensive testing campaign is presented here. This recent campaign was performed on a decommissioned BAE system Hawk T1A aircraft at the Laboratory for Verification and Validation (LVV) in Sheffield. The aim of this paper is to present the dataset, providing details on the structure, experimental design, and data acquired. The collected data is made freely and openly available with the intention that it serve as a benchmark dataset for challenges in full-scale structural dynamics. Here, the details pertaining to two test phases (frequency and time domain) are presented. So as to ensure that the presented dataset is able to function as a benchmark, some baseline-level results are additionally presented for the tasks of identification and prediction, using standard approaches. It is envisaged that advanced methodologies will demonstrate superiority by favourable comparison with the results presented here. Finally, some dataset-specific challenges are described, with a view to form a hierarchy of tasks and frame discussion over their relative difficulty.


title: Leveraging Data Geometry to Mitigate CSM in Steganalysis

abstract: In operational scenarios, steganographers use sets of covers from various sensors and processing pipelines that differ significantly from those used by researchers to train steganalysis models. This leads to an inevitable performance gap when dealing with out-of-distribution covers, commonly referred to as Cover Source Mismatch (CSM). In this study, we consider the scenario where test images are processed using the same pipeline. However, knowledge regarding both the labels and the balance between cover and stego is missing. Our objective is to identify a training dataset that allows for maximum generalization to our target. By exploring a grid of processing pipelines fostering CSM, we discovered a geometrical metric based on the chordal distance between subspaces spanned by DCTr features, that exhibits high correlation with operational regret while being not affected by the cover-stego balance. Our contribution lies in the development of a strategy that enables the selection or derivation of customized training datasets, enhancing the overall generalization performance for a given target. Experimental validation highlights that our geometry-based optimization strategy outperforms traditional atomistic methods given reasonable assumptions. Additional resources are available at github.com/RonyAbecidan/LeveragingGeometrytoMitigateCSM.


title: Auto-survey Challenge

abstract: We present a novel platform for evaluating the capability of Large Language Models (LLMs) to autonomously compose and critique survey papers spanning a vast array of disciplines including sciences, humanities, education, and law. Within this framework, AI systems undertake a simulated peer-review mechanism akin to traditional scholarly journals, with human organizers serving in an editorial oversight capacity. Within this framework, we organized a competition for the AutoML conference 2023. Entrants are tasked with presenting stand-alone models adept at authoring articles from designated prompts and subsequently appraising them. Assessment criteria include clarity, reference appropriateness, accountability, and the substantive value of the content. This paper presents the design of the competition, including the implementation baseline submissions and methods of evaluation.


title: Acoustic and linguistic representations for speech continuous emotion recognition in call center conversations

abstract: The goal of our research is to automatically retrieve the satisfaction and the frustration in real-life call-center conversations. This study focuses an industrial application in which the customer satisfaction is continuously tracked down to improve customer services. To compensate the lack of large annotated emotional databases, we explore the use of pre-trained speech representations as a form of transfer learning towards AlloSat corpus. Moreover, several studies have pointed out that emotion can be detected not only in speech but also in facial trait, in biological response or in textual information. In the context of telephone conversations, we can break down the audio information into acoustic and linguistic by using the speech signal and its transcription. Our experiments confirms the large gain in performance obtained with the use of pre-trained features. Surprisingly, we found that the linguistic content is clearly the major contributor for the prediction of satisfaction and best generalizes to unseen data. Our experiments conclude to the definitive advantage of using CamemBERT representations, however the benefit of the fusion of acoustic and linguistic modalities is not as obvious. With models learnt on individual annotations, we found that fusion approaches are more robust to the subjectivity of the annotation task. This study also tackles the problem of performances variability and intends to estimate this variability from different views: weights initialization, confidence intervals and annotation subjectivity. A deep analysis on the linguistic content investigates interpretable factors able to explain the high contribution of the linguistic modality for this task.


title: EMOFM: Ensemble MLP mOdel with Feature-based Mixers for Click-Through Rate Prediction

abstract: Track one of CTI competition is on click-through rate (CTR) prediction. The dataset contains millions of records and each field-wise feature in a record consists of hashed integers for privacy. For this task, the keys of network-based methods might be type-wise feature extraction and information fusion across different fields. Multi-layer perceptrons (MLPs) are able to extract field feature, but could not efficiently fuse features. Motivated by the natural fusion characteristic of cross attention and the efficiency of transformer-based structures, we propose simple plug-in mixers for field/type-wise feature fusion, and thus construct an field&type-wise ensemble model, namely EMOFM (Ensemble MLP mOdel with Feature-based Mixers). In the experiments, the proposed model is evaluated on the dataset, the optimization process is visualized and ablation studies are explored. It is shown that EMOFM outperforms compared baselines. In the end, we discuss on future work. WARNING: The comparison might not be fair enough since the proposed method is designed for this data in particular while compared methods are not. For example, EMOFM especially takes different types of interactions into consideration while others do not. Anyway, we do hope that the ideas inside our method could help other developers/learners/researchers/thinkers and so on.


title: Reward Dropout Improves Control: Bi-objective Perspective on Reinforced LM

abstract: We study the theoretical aspects of Reinforced Language Models (RLMs) from a bi-objective optimization perspective. Specifically, we consider the RLMs as a Pareto optimization problem that maximizes the two conflicting objectives, i.e., reward objective and likelihood objectives, simultaneously. Our main contribution consists of three parts. First, we establish the theoretical foundations of RLM as a Pareto optimization problem by presenting Reward Upper BOund (RUBO) and Pareto optimality. Our theoretical outcomes are supported by not only deductive proofs but also empirical results. Second, we propose Reward Dropout, a simple yet powerful method that guarantees to improve a bi-objective optimization of RLM. Lastly, we demonstrate that the Reward Dropout is consistently effective across five benchmark datasets and four benchmark LLMs, meaning that the Reward Dropout significantly improves the optimization performance of RLMs.


title: Ada-Instruct: Adapting Instruction Generators for Complex Reasoning

abstract: Generating diverse and sophisticated instructions for downstream tasks by Large Language Models (LLMs) is pivotal for advancing the effect. Current approaches leverage closed-source LLMs, employing in-context prompting for instruction generation. However, in this paper, we found that in-context prompting cannot generate complex instructions with length $\ge 100$ for tasks like code completion. To solve this problem, we introduce Ada-Instruct, an adaptive instruction generator developed by fine-tuning open-source LLMs. Our pivotal finding illustrates that fine-tuning open-source LLMs with a mere ten samples generates long instructions that maintain distributional consistency for complex reasoning tasks. We empirically validated Ada-Instruct's efficacy across different applications, including code completion, mathematical reasoning, and commonsense reasoning. The results underscore Ada-Instruct's superiority, evidencing its improvements over its base models, current self-instruct methods, and other state-of-the-art models.


title: Methanol isotopologues as a probe for spatial and temporal variations of the electron-to-proton mass ratio

abstract: We present results on numerical calculations of the sensitivity coefficients, Qmu, of microwave molecular transitions in (13C)H3OH and CH3(18O)H to the hypothetical variation in the fundamental physical constant mu - the electron-to-proton mass ratio. The invariability of mu in time and space is one of the basic assumptions of the Standard Model of particle physics which can be tested at cosmological scales by means of astronomical observations in the Galaxy and external galaxies. Our calculations show that these two methanol isotopologues can be utilized for such tests since their microwave transitions from the frequency interval 1-100 GHz exhibit a large spread in Qmu values which span a range of -109 < Qmu < 78. We show that the thermal emission lines of (13C)H3OH observed in the star-forming region NGC6334I constrain the variability of mu at a level of 3x10^-8 (1{\sigma}), which is in line with the most stringent upper limits obtained previously from observations of methanol (CH3OH) and other molecules in the Galaxy.


title: T-Rep: Representation Learning for Time Series using Time-Embeddings

abstract: Multivariate time series present challenges to standard machine learning techniques, as they are often unlabeled, high dimensional, noisy, and contain missing data. To address this, we propose T-Rep, a self-supervised method to learn time series representations at a timestep granularity. T-Rep learns vector embeddings of time alongside its feature extractor, to extract temporal features such as trend, periodicity, or distribution shifts from the signal. These time-embeddings are leveraged in pretext tasks, to incorporate smooth and fine-grained temporal dependencies in the representations, as well as reinforce robustness to missing data. We evaluate T-Rep on downstream classification, forecasting, and anomaly detection tasks. It is compared to existing self-supervised algorithms for time series, which it outperforms in all three tasks. We test T-Rep in missing data regimes, where it proves more resilient than its counterparts. Finally, we provide latent space visualisation experiments, highlighting the interpretability of the learned representations.


title: Fiber-taper collected emission from NV centers in high-$Q/V$ diamond microdisks

abstract: Fiber-coupled microdisks are a promising platform for enhancing the spontaneous emission from color centers in diamond. The measured cavity-enhanced emission from the microdisk is governed by the effective volume ($V$) of each cavity mode, the cavity quality factor ($Q$), and the coupling between the microdisk and the fiber. Here we observe photoluminescence from an ensemble of nitrogen-vacancy centers into high $Q/V$ microdisk modes, which when combined with coherent spectroscopy of the microdisk modes, allows us to elucidate the relative contributions of these factors. The broad emission spectrum acts as an internal light source facilitating mode identification over several cavity free spectral ranges. Analysis of the fiber-taper collected microdisk emission reveals spectral filtering both by the cavity and the fiber-taper, the latter of which we find preferentially couples to higher-order microdisk modes. Coherent mode spectroscopy is used to measure $Q\sim 1\times10^{5}$ -- the highest reported values for diamond microcavities operating at visible wavelengths. With realistic optimization of the microdisk dimensions, we predict that Purcell factors of $\sim 50$ are within reach.


title: Emergence of Species Scale Black Hole Horizons

abstract: The scale at which quantum gravity becomes manifest, the species scale $\Lambda_s$, has recently been argued to take values parametrically lower than the Planck scale. We use black holes of vanishing horizon area (small black holes) in effective field theories coupled to quantum gravity to shed light on how the three different physical manifestations of the species scale $\Lambda_s$ relate to each other. (i) Near the small black hole core, a scalar field runs to infinite distance in moduli space, a regime in which the Swampland Distance Conjecture predicts a tower of exponentially light states, which lower $\Lambda_s$. (ii) We integrate out modes in the tower and generate via Emergence a set of higher derivative corrections, showing that $\Lambda_s$ is the scale at which such terms become relevant. (iii) Finally, higher derivative terms modify the black hole solution and grant it a non-zero, species scale sized stretched horizon of radius $\Lambda_s^{-1}$, showcasing the species scale as the size of the smallest possible black hole describable in the effective theory. We present explicit 4d examples of small black holes in 4d $\mathcal{N}=2$ supergravity, and the 10d example of type IIA D0-branes. The emergence of the species scale horizon for D0-branes requires a non-trivial interplay of different 8-derivative terms in type IIA and M-theory, providing a highly non-trivial check of our unified description of the different phenomena associated to the species scale.


title: Extracting linear and nonlinear quasinormal modes from black hole merger simulations

abstract: In general relativity, when two black holes merge they produce a rotating (Kerr) black hole remnant. According to perturbation theory, the remnant emits "ringdown" radiation: a superposition of exponentials with characteristic complex frequencies that depend only on the remnant's mass and spin. While the goal of the black hole spectroscopy program is to measure the quasinormal mode frequencies, a knowledge of their amplitudes and phases is equally important to determine which modes are detectable, and possibly to perform additional consistency checks. Unlike the complex frequencies, the amplitudes and phases depend on the properties of the binary progenitors, such as the binary mass ratio and component spins. In this paper we develop a fitting algorithm designed to reliably identify the modes present in numerical simulations and to extract their amplitudes and phases. We apply the algorithm to over 500 binary black hole simulations from the public SXS numerical relativity simulation catalog, and we present fitting formulas for the resulting mode amplitudes and phases as functions of the properties of the progenitors. Crucially, our algorithm allows for the extraction of not only prograde fundamental modes and overtones, but also retrograde modes and second-order modes. We unveil interesting relations for the amplitude ratios of different modes. The fitting code and interactive versions of some of the plots are publicly available. The results presented in this paper can be updated as more and better simulations become available.


title: Generative Diffusion From An Action Principle

abstract: Generative diffusion models synthesize new samples by reversing a diffusive process that converts a given data set to generic noise. This is accomplished by training a neural network to match the gradient of the log of the probability distribution of a given data set, also called the score. By casting reverse diffusion as an optimal control problem, we show that score matching can be derived from an action principle, like the ones commonly used in physics. We use this insight to demonstrate the connection between different classes of diffusion models.


title: A Physical Theory of Two-stage Thermalization

abstract: One indication of thermalization time is subsystem entanglement reaching thermal values. Recent studies on local quantum circuits reveal two exponential stages with decay rates $r_1$ and $r_2$ of the purity before and after thermalization. We provide an entanglement membrane theory interpretation, with $r_1$ corresponding to the domain wall free energy. Circuit geometry can lead to $r_1 < r_2$, producing a ``phantom eigenvalue". Competition between the domain wall and magnon leads to $r_2 < r_1$ when the magnon prevails. However, when the domain wall wins, this mechanism provides a practical approach for measuring entanglement growth through local correlation functions.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech cs.IT math.IT


title: Identifying the possible ex-situ origin of the globular clusters of the Milky Way: A kinematic study

abstract: This is the second paper in a series, which studies the likelihood that some globular clusters (GCs) of the Milky Way (MW) could have originated from a dwarf satellite galaxy (DSG). Using a large suite of three-body simulations we determine the present-day orbital properties of 154 GCs that could have escaped from 41 MW DSGs over the past $8\,\mathrm{Gyrs}$. For the MW we considered two sets of static and dynamic models which account for the sustained growth of the MW since its birth. We focus on the Magellanic Clouds and Sagittarius. We compare the apogalactic distance, eccentricity, and orbital inclination of the MW GCs with those of runaway GCs from DSGs, to constrain their possible ex-situ origin. We observe a positive correlation between a DSG mass and the dispersion of its runaway GCs in the orbital parameter space of ($R_\mathrm{ap}$, $e$). We provide tables of the identified MW GCs and their likely associated progenitors. In total, we find 29 (19%) MW GCs which could be kinematically associated with MW DSGs. We report, for the first time, 6 and 10 new associations with the Large Magellanic Cloud and the Sagittarius, respectively. For the Sagittarius we predict a concentration of runaway GCs at large apogalactic distances of $R_\mathrm{ap}\approx275-375\,\mathrm{kpc}$, $e\approx0.8$, and a relative inclination of $\Delta\theta\approx20^{\circ}$. So far, there has not been any observed GCs with such orbital elements. Complemented with photometric and spectroscopic observations, and cosmological simulations, the findings from the present study could conclusively settle the debate over the in-situ vs. ex-situ origin of the MW GCs.


title: The sine-Gordon model from coupled condensates: a Generalized Hydrodynamics viewpoint

abstract: The sine-Gordon model captures the low-energy effective dynamics of a wealth of one-dimensional quantum systems, stimulating the experimental efforts in building a versatile quantum simulator of this field theory and fueling the parallel development of new theoretical toolkits able to capture far-from-equilibrium settings. In this work, we analyze the realization of sine-Gordon from the interference pattern of two one-dimensional quasicondensates: we argue the emergent field theory is well described by its classical limit and develop its large-scale description based on Generalized Hydrodynamics. We show how, despite sine-Gordon being an integrable field theory, trap-induced inhomogeneities cause instabilities of excitations and provide exact analytical results to capture this effect.

categories: cond-mat.stat-mech cond-mat.quant-gas nlin.SI quant-ph


title: PSJ2107-1611: a new wide-separation, quadruply imaged lensed quasar with flux ratio anomalies

abstract: We report the discovery of PSJ2107-1611, a fold-configuration 4.3"-separation quadruply lensed quasar with a bright lensed arc. It was discovered using a convolutional neural network on Pan-STARRS gri images of pre-selected quasar candidates with multiple nearby Pan-STARRS detections. Spectroscopic follow-up with EFOSC2 on the ESO 3.58m New Technology Telescope reveals the source to be a quasar at z = 2.673, with the blended fold image pair showing deformed broad lines relative to the other images. The flux ratios measured from optical to near-infrared imaging in the Canada-France-Hawaii Telescope Legacy Survey, Pan-STARRS, the Legacy Surveys, and the Vista Hemisphere Survey are inconsistent with a smooth mass model as the fold pair images are about 15 times too faint. Variability, time delay effects, and reddening are ruled out through multiple-epoch imaging and color information. The system is marginally resolved in the radio in the Very Large Array Sky Survey S-band, where it has a 10 mJy detection. The radio flux ratios are compatible with the smooth mass macromodel. This system offers a unique tool for future studies of quasar structure with strong and microlensing. A more detailed analysis of follow-up with JWST/MIRI, VLT/MUSE, VLT/ERIS, and data from the European Very Long Baseline Interferometer will be presented in an upcoming paper.


title: Observable signatures of Hall viscosity in lowest Landau level superfluids

abstract: Hall viscosity is a non-dissipative viscosity occurring in systems with broken time-reversal symmetry, such as quantum Hall phases and $p+ip$ superfluids. Despite Hall viscosity's expected ubiquity and past observations in classical soft matter systems, it has yet to be measured experimentally in any quantum phase of matter. Toward this end, we describe the observable effects of Hall viscosity in a simple family of rotating Bose-Einstein condensates of electrically neutral bosons, in which all of the bosons condense into a single LLL orbital. Such phases are accessible to current cold atom experiments, and we dub them lowest Landau level (LLL) superfluids. We demonstrate that LLL superfluids possess a non-universal Hall viscosity, leading to a range of observable consequences such as rotation of vortex-antivortex dipoles and wave-vector dependent corrections to the speed of sound. Furthermore, using a coherent state path integral approach, we present a microscopic derivation of the Landau-Ginzburg equations of a LLL superfluid, showing explicitly how Hall viscosity enters.

categories: cond-mat.quant-gas cond-mat.mes-hall cond-mat.str-el hep-th


title: URLOST: Unsupervised Representation Learning without Stationarity or Topology

abstract: Unsupervised representation learning has seen tremendous progress but is constrained by its reliance on data modality-specific stationarity and topology, a limitation not found in biological intelligence systems. For instance, human vision processes visual signals derived from irregular and non-stationary sampling lattices yet accurately perceives the geometry of the world. We introduce a novel framework that learns from high-dimensional data lacking stationarity and topology. Our model combines a learnable self-organizing layer, density adjusted spectral clustering, and masked autoencoders. We evaluate its effectiveness on simulated biological vision data, neural recordings from the primary visual cortex, and gene expression datasets. Compared to state-of-the-art unsupervised learning methods like SimCLR and MAE, our model excels at learning meaningful representations across diverse modalities without depending on stationarity or topology. It also outperforms other methods not dependent on these factors, setting a new benchmark in the field. This work represents a step toward unsupervised learning methods that can generalize across diverse high-dimensional data modalities.


title: Correlations between laboratory line lists for FeH, CrH, and NiH and M-star spectra collected with ESPaDOnS and SPIRou

abstract: Molecular bands of metal oxides and hydrides dominate the optical and near-infrared spectra of M dwarfs. High-resolution spectra of these bands have immense potential for determining many properties of these stars, such as effective temperature, surface gravity, elemental abundances, radial velocity, or surface magnetic fields. Techniques are being developed to do this but remain limited by the current availability and accuracy of molecular data and spectral line lists. This paper reports metal monohydride line lists selected from near-infrared and visible laboratory data to show that specific bands in several electronic transitions can be used to identify CrH, NiH, and FeH in M stars and to determine radial velocities from Doppler shifts. The possibility of measuring magnetic fields is also investigated for FeH and CrH. We used systematic cross-correlation analysis between unpolarised spectra from a selection of M stars and state-specific laboratory line lists. These lists were generated from a combination of existing data and new laboratory laser-excitation spectra recorded at Doppler-limited resolution, in zero-field conditions or in magnetic fields up to 0.6 tesla. Results. We show that transitions at visible wavelengths in FeH and NiH, usually neglected in the analysis of the spectra of M-type stars, do in fact contribute to the spectra, and we demonstrate the influence of magnetic sensitivity on selected transitions in CrH and FeH. Although the new line lists focus on transitions recorded at temperatures significantly lower than those of stellar objects, they remain pertinent because they cover some band-head regions of high spectral density. FeH bands can provide a useful supplement to atomic lines for the analysis of high-resolution optical and near-infrared spectra of M dwarfs. We demonstrate the influence of a magnetic field on CrH signatures around 862 nm.


title: UV-continuum $\beta$ slopes of individual $z \sim 2-6$ clumps and their evolution

abstract: We study the ultraviolet (UV) continuum $\beta$ slope of a sample of 166 clumps, individual star-forming regions observed in high redshift galaxies. They are hosted by 67 galaxies with redshift between 2 and 6.2, strongly lensed by the Hubble Frontier Fields cluster of galaxies MACS J0416.1-2403. The $\beta$ slope is sensitive to a variety of physical properties, such as the metallicity, the age of the stellar population, the dust attenuation throughout the galaxy, the stellar initial mass function (IMF), and the star-formation history (SFH). The aim of this study is to compare the $\beta$ values of individual clumps with those measured on the entire galaxy, to investigate possible physical differences between these regions and their hosts. We found a median value of $\beta \sim -2.4$, lower than that of integrated galaxies. This result confirms that clumps are sites of intense star formation, populated by young, massive stars, whose spectrum strongly emits in the UV. This is also consistent with the assumption that the dust extinction at the location of the clumps is lower than the average extinction of the galaxy, or that clumps have a different IMF or SFH. We made use of the correlations, discovered for high-redshift galaxies, of the $\beta$ value with those of redshift and UV magnitude, $M_{UV}$, finding that clumps follow the same relations, extended to much fainter magnitudes ($M_{UV}<-13$). We also find evidence of eight clumps with extremely blue ($\beta \lesssim -2.7$) slopes, which could be the signpost of low-metallicity stars and constrain the emissivity of ionizing photons at high redshift.


title: Exploring chemical enrichment of the intracluster medium with the Line Emission Mapper

abstract: Synthesized in the cores of stars and supernovae, most metals disperse over cosmic scales and are ultimately deposited well outside the gravitational potential of their host galaxies. Since their presence is well visible through their X-ray emission lines in the hot gas pervading galaxy clusters, measuring metal abundances in the intracluster medium (ICM) offers us a unique view of chemical enrichment of the Universe as a whole. Despite extraordinary progress in the field thanks to four decades of X-ray spectroscopy using CCD (and gratings) instruments, understanding the precise stellar origins of the bulk of metals, and when the latter were mixed on Mpc scales, requires an X-ray mission capable of spatial, non-dispersive high resolution spectroscopy covering at least the soft X-ray band over a large field of view. In this White Paper, we demonstrate how the Line Emission Mapper (LEM) probe mission concept will revolutionize our current picture of the ICM enrichment. Specifically, we show that LEM will be able to (i) spatially map the distribution of ten key chemical elements out to the virial radius of a nearby relaxed cluster and (ii) measure metal abundances in serendipitously discovered high-redshift protoclusters. Altogether, these key observables will allow us to constrain the chemical history of the largest gravitationally bound structures of the Universe. They will also solve key questions such as the universality of the initial mass function (IMF) and the initial metallicity of the stellar populations producing these metals, as well as the relative contribution of asymptotic giant branch (AGB) stars, core-collapse, and Type Ia supernovae to enrich the cosmic web over Mpc scales. Concrete observing strategies are also briefly discussed.


title: Signatures of Domain-Wall Confinement in Raman Spectroscopy of Ising Spin Chains

abstract: Mesonic bound states of domain walls can be stabilized in quasi one-dimensional magnetic compounds. Here, we theoretically study the Raman light scattering response of a twisted Kitaev chain with tilted magnetic fields as a minimal model for confinement in $\text{CoNb}_{2}\text{O}_{6}$. By both numerical matrix product states and few-domain wall variational states, we show that confinement-induced bound states directly manifest themselves as sharp peaks in the Raman response. Near quantum criticality the Raman spectrum exhibit the famous E$_{8}$ symmetry. Remarkably, by tuning the polarization of the incident light field, we demonstrate that the Raman response offers new insights into the intrinsic structure of the bound state wavefunction.


title: Robust cosmological inference from non-linear scales with k-th nearest neighbor statistics

abstract: We present the methodology for deriving accurate and reliable cosmological constraints from non-linear scales (<50Mpc/h) with k-th nearest neighbor (kNN) statistics. We detail our methods for choosing robust minimum scale cuts and validating galaxy-halo connection models. Using cross-validation, we identify the galaxy-halo model that ensures both good fits and unbiased predictions across diverse summary statistics. We demonstrate that we can model kNNs effectively down to transverse scales of rp ~ 3Mpc/h and achieve precise and unbiased constraints on the matter density and clustering amplitude, leading to a 2% constraint on sigma_8. Our simulation-based model pipeline is resilient to varied model systematics, spanning simulation codes, halo finding, and cosmology priors. We demonstrate the effectiveness of this approach through an application to the Beyond-2p mock challenge. We propose further explorations to test more complex galaxy-halo connection models and tackle potential observational systematics.


title: Off-shell duality invariance of Schwarzschild perturbation theory

abstract: We explore the duality invariance of the Maxwell and linearized Einstein-Hilbert actions on a non-rotating black hole background. On shell these symmetries are electric-magnetic duality and Chandrasekhar duality, respectively. Off shell they lead to conserved quantities; we demonstrate that one of the consequences of these conservation laws is that even- and odd-parity metric perturbations have equal Love numbers. Along the way we derive an action principle for the Fackerell-Ipser equation and Teukolsky-Starobinsky identities in electromagnetism.


title: ${\rm H{\scriptsize ALO}F{\scriptsize LOW}}$ I: Neural Inference of Halo Mass from Galaxy Photometry and Morphology

abstract: We present ${\rm H{\scriptsize ALO}F{\scriptsize LOW}}$, a new machine learning approach for inferring the mass of host dark matter halos, $M_h$, from the photometry and morphology of galaxies. ${\rm H{\scriptsize ALO}F{\scriptsize LOW}}$ uses simulation-based inference with normalizing flows to conduct rigorous Bayesian inference. It is trained on state-of-the-art synthetic galaxy images from Bottrell et al. (2023; arXiv:2308.14793) that are constructed from the IllustrisTNG hydrodynamic simulation and include realistic effects of the Hyper Suprime-Cam Subaru Strategy Program (HSC-SSP) observations. We design ${\rm H{\scriptsize ALO}F{\scriptsize LOW}}$ to infer $M_h$ and stellar mass, $M_*$, using $grizy$ band magnitudes, morphological properties quantifying characteristic size, concentration, and asymmetry, total measured satellite luminosity, and number of satellites. We demonstrate that ${\rm H{\scriptsize ALO}F{\scriptsize LOW}}$ infers accurate and unbiased posteriors of $M_h$. Furthermore, we quantify the full information content in the photometric observations of galaxies in constraining $M_h$. With magnitudes alone, we infer $M_h$ with $\sigma_{\log M_h} \sim 0.115$ and 0.182 dex for field and group galaxies. Including morphological properties significantly improves the precision of $M_h$ constraints, as does total satellite luminosity: $\sigma_{\log M_h} \sim 0.095$ and 0.132 dex. Compared to the standard approach using the stellar-to-halo mass relation, we improve $M_h$ constraints by $\sim$40\%. In subsequent papers, we will validate and calibrate ${\rm H{\scriptsize ALO}F{\scriptsize LOW}}$ with galaxy-galaxy lensing measurements on real observational data.


title: A multishock scenario for the formation of radio relics

abstract: Radio relics are giant sources of diffuse synchrotron radio emission in the outskirts of galaxy clusters that are associated with shocks in the intracluster medium. Still, the origin of relativistic particles that make up relics is not fully understood. For most relics, diffusive shock acceleration (DSA) of thermal electrons is not efficient enough to explain observed radio fluxes. In this paper, we use a magneto-hydrodynamic simulation of galaxy clusters in combination with Lagrangian tracers to simulate the formation of radio relics. Using a Fokker-Planck solver to compute the energy spectra of relativistic electrons, we determine the synchrotron emission of the relic. We find that re-acceleration of fossil electrons plays a major role in explaining the synchrotron emission of radio relics. Particles that pass through multiple shocks contribute significantly to the overall luminosity of a radio relic and greatly boosts the effective acceleration efficiency. Furthermore, we find that the assumption that the luminosity of a radio relic can be explained with DSA of thermal electrons leads to an overestimate of the acceleration efficiency by a factor of more than $10^3$.