title: Understanding the Dynamics of the Stack Overflow Community through Social Network Analysis and Graph Algorithms

abstract: This thesis conducts a focused literature review on online communities, centering on Stack Overflow, employing social network analysis and graph algorithms. It examines the evolving landscape of health information quality within the digital ecosystem, emphasizing the challenges posed and the multifaceted nature of quality. The significance of online communities, notably Stack Overflow, as hubs for social interaction and knowledge sharing is underscored. Proposing advanced approaches, the thesis introduces an ensemble deep learning model for traffic flow forecasting, an efficient multi-objective optimization method for influence maximization, and a graph convolutional neural network-based approach for link prediction.


title: Neural logic programs and neural nets

abstract: Neural-symbolic integration aims to combine the connectionist subsymbolic with the logical symbolic approach to artificial intelligence. In this paper, we first define the answer set semantics of (boolean) neural nets and then introduce from first principles a class of neural logic programs and show that nets and programs are equivalent.


title: Hyperdimensional Quantum Factorization

abstract: This paper presents a quantum algorithm for efficiently decoding hypervectors, a crucial process in extracting atomic elements from hypervectors - an essential task in Hyperdimensional Computing (HDC) models for interpretable learning and information retrieval. HDC employs high-dimensional vectors and efficient operators to encode and manipulate information, representing complex objects from atomic concepts. When one attempts to decode a hypervector that is the product (binding) of multiple hypervectors, the factorization becomes prohibitively costly with classical optimization-based methods and specialized recurrent networks, an inherent consequence of the binding operation. We propose HDQF, an innovative quantum computing approach, to address this challenge. By exploiting parallels between HDC and quantum computing and capitalizing on quantum algorithms' speedup capabilities, HDQF encodes potential factors as a quantum superposition using qubit states and bipolar vector representation. This yields a quadratic speedup over classical search methods and effectively mitigates Hypervector Factorization capacity issues.


title: Unraveling the Mechanics of Learning-Based Demonstration Selection for In-Context Learning

abstract: Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing more useful exemplars, their underlying mechanisms are opaque, hindering efforts to address limitations such as high training costs and poor generalization across tasks. These methods generally assume the selection process captures similarities between the exemplar and the target instance, however, it remains unknown what kinds of similarities are captured and vital to performing ICL. To dive into this question, we analyze the working mechanisms of the learning-based demonstration selection methods and empirically identify two important factors related to similarity measurement: 1) The ability to integrate different levels of task-agnostic text similarities between the input of exemplars and test cases enhances generalization power across different tasks. 2) Incorporating task-specific labels when measuring the similarities significantly improves the performance on each specific task. We validate these two findings through extensive quantitative and qualitative analyses across ten datasets and various LLMs. Based on our findings, we introduce two effective yet simplified exemplar selection methods catering to task-agnostic and task-specific demands, eliminating the costly LLM inference overhead.


title: Towards Adaptive Neighborhood for Advancing Temporal Interaction Graph Modeling

abstract: Temporal Graph Networks (TGNs) have demonstrated their remarkable performance in modeling temporal interaction graphs. These works can generate temporal node representations by encoding the surrounding neighborhoods for the target node. However, an inherent limitation of existing TGNs is their reliance on fixed, hand-crafted rules for neighborhood encoding, overlooking the necessity for an adaptive and learnable neighborhood that can accommodate both personalization and temporal evolution across different timestamps. In this paper, we aim to enhance existing TGNs by introducing an adaptive neighborhood encoding mechanism. We present SEAN, a flexible plug-and-play model that can be seamlessly integrated with existing TGNs, effectively boosting their performance. To achieve this, we decompose the adaptive neighborhood encoding process into two phases: (i) representative neighbor selection, and (ii) temporal-aware neighborhood information aggregation. Specifically, we propose the Representative Neighbor Selector component, which automatically pinpoints the most important neighbors for the target node. It offers a tailored understanding of each node's unique surrounding context, facilitating personalization. Subsequently, we propose a Temporal-aware Aggregator, which synthesizes neighborhood aggregation by selectively determining the utilization of aggregation routes and decaying the outdated information, allowing our model to adaptively leverage both the contextually significant and current information during aggregation. We conduct extensive experiments by integrating SEAN into three representative TGNs, evaluating their performance on four public datasets and one financial benchmark dataset introduced in this paper. The results demonstrate that SEAN consistently leads to performance improvements across all models, achieving SOTA performance and exceptional robustness.


title: Simultaneous comparisons of the variances of k treatments with that of a control: a Levene-Dunnett type procedure

abstract: There are some global tests for heterogeneity of variance in k-sample one-way layouts, but few consider pairwise comparisons between treatment levels. For experimental designs with a control, comparisons of the variances between the treatment levels and the control are of interest - in analogy to the location parameter with the Dunnett (1955) procedure. Such a many-to-one approach for variances is proposed using the Levene transformation, a kind of residuals. Its properties are characterized with simulation studies and corresponding data examples are evaluated with R code.


title: Development of a Real-Time Simulator Using EMTP-ATP Foreign models for Testing Relays

abstract: This paper reports the PC implementation of a real-time simulator for testing protective relays, based on the widely used EMTP-ATP software. The proposed simulator was implemented using the GNU/Linux OS with a real-time kernel. In order to generate the waveforms corresponding to simulated voltages and currents, a PCI card was used. This card also includes digital I/O interface. Via foreign models programmed in standard C, ATP was recompiled to include waveform generation at each simulation time step and digital I/O. Additionally, an IEC-61850 open source library was used, in order to use Sampled Values and GOOSE protocols. The resulting tool is a real-time simulator that can interact with protective relays by means of HiL tests. The performance of the simulator was analyzed via an interaction with an actual relay.


title: Topographic Visualization of Near-surface Temperatures for Improved Lapse Rate Estimation

abstract: Numerical model forecasts of near-surface temperatures are prone to error. This is because terrain can exert a strong influence on temperature that is not captured in numerical weather models due to spatial resolution limitations. To account for the terrain height difference between the forecast model and reality, temperatures are commonly corrected using a vertical adjustment based on a fixed lapse rate. This, however, ignores the fact that true lapse rates vary from 1.2 K temperature drop per 100 m of ascent to more than 10 K temperature rise over the same vertical distance. In this work, we develop topographic visualization techniques to assess the resulting uncertainties in near-surface temperatures and reveal relationships between those uncertainties, features in the resolved and unresolved topography, and the temperature distribution in the near-surface atmosphere. Our techniques highlight common limitations of the current lapse rate scheme and hint at their topographic dependencies in the context of the prevailing weather conditions. Together with scientists working in postprocessing and downscaling of numerical model output, we use these findings to develop an improved lapse rate scheme. This model adapts to both the topography and the current weather situation. We examine the quality and physical consistency of the new estimates by comparing them with station observations around the world and by including visual representations of radiation-slope interactions.


title: Predicting User Perception of Move Brilliance in Chess

abstract: AI research in chess has been primarily focused on producing stronger agents that can maximize the probability of winning. However, there is another aspect to chess that has largely gone unexamined: its aesthetic appeal. Specifically, there exists a category of chess moves called ``brilliant" moves. These moves are appreciated and admired by players for their high intellectual aesthetics. We demonstrate the first system for classifying chess moves as brilliant. The system uses a neural network, using the output of a chess engine as well as features that describe the shape of the game tree. The system achieves an accuracy of 79% (with 50% base-rate), a PPV of 83%, and an NPV of 75%. We demonstrate that what humans perceive as ``brilliant" moves is not merely the best possible move. We show that a move is more likely to be predicted as brilliant, all things being equal, if a weaker engine considers it lower-quality (for the same rating by a stronger engine). Our system opens the avenues for computer chess engines to (appear to) display human-like brilliance, and, hence, creativity.


title: DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning

abstract: Training corpuses for vision language models (VLMs) typically lack sufficient amounts of decision-centric data. This renders off-the-shelf VLMs sub-optimal for decision-making tasks such as in-the-wild device control through graphical user interfaces (GUIs). While training with static demonstrations has shown some promise, we show that such methods fall short for controlling real GUIs due to their failure to deal with real-world stochasticity and non-stationarity not captured in static observational data. This paper introduces a novel autonomous RL approach, called DigiRL, for training in-the-wild device control agents through fine-tuning a pre-trained VLM in two stages: offline RL to initialize the model, followed by offline-to-online RL. To do this, we build a scalable and parallelizable Android learning environment equipped with a VLM-based evaluator and develop a simple yet effective RL approach for learning in this domain. Our approach runs advantage-weighted RL with advantage estimators enhanced to account for stochasticity along with an automatic curriculum for deriving maximal learning signal. We demonstrate the effectiveness of DigiRL using the Android-in-the-Wild (AitW) dataset, where our 1.3B VLM trained with RL achieves a 49.5% absolute improvement -- from 17.7 to 67.2% success rate -- over supervised fine-tuning with static human demonstration data. These results significantly surpass not only the prior best agents, including AppAgent with GPT-4V (8.3% success rate) and the 17B CogAgent trained with AitW data (38.5%), but also the prior best autonomous RL approach based on filtered behavior cloning (57.8%), thereby establishing a new state-of-the-art for digital agents for in-the-wild device control.


title: A Benchmark for Maximum Cut: Towards Standardization of the Evaluation of Learned Heuristics for Combinatorial Optimization

abstract: Recently, there has been much work on the design of general heuristics for graph-based, combinatorial optimization problems via the incorporation of Graph Neural Networks (GNNs) to learn distribution-specific solution structures.However, there is a lack of consistency in the evaluation of these heuristics, in terms of the baselines and instances chosen, which makes it difficult to assess the relative performance of the algorithms. In this paper, we propose an open-source benchmark suite MaxCut-Bench dedicated to the NP-hard Maximum Cut problem in both its weighted and unweighted variants, based on a careful selection of instances curated from diverse graph datasets. The suite offers a unified interface to various heuristics, both traditional and machine learning-based. Next, we use the benchmark in an attempt to systematically corroborate or reproduce the results of several, popular learning-based approaches, including S2V-DQN [31], ECO-DQN [4], among others, in terms of three dimensions: objective value, generalization, and scalability. Our empirical results show that several of the learned heuristics fail to outperform a naive greedy algorithm, and that only one of them consistently outperforms Tabu Search, a simple, general heuristic based upon local search. Furthermore, we find that the performance of ECO-DQN remains the same or is improved if the GNN is replaced by a simple linear regression on a subset of the features that are related to Tabu Search. Code, data, and pretrained models are available at: \url{https://github.com/ankurnath/MaxCut-Bench}.


title: Towards Better Benchmark Datasets for Inductive Knowledge Graph Completion

abstract: Knowledge Graph Completion (KGC) attempts to predict missing facts in a Knowledge Graph (KG). Recently, there's been an increased focus on designing KGC methods that can excel in the {\it inductive setting}, where a portion or all of the entities and relations seen in inference are unobserved during training. Numerous benchmark datasets have been proposed for inductive KGC, all of which are subsets of existing KGs used for transductive KGC. However, we find that the current procedure for constructing inductive KGC datasets inadvertently creates a shortcut that can be exploited even while disregarding the relational information. Specifically, we observe that the Personalized PageRank (PPR) score can achieve strong or near SOTA performance on most inductive datasets. In this paper, we study the root cause of this problem. Using these insights, we propose an alternative strategy for constructing inductive KGC datasets that helps mitigate the PPR shortcut. We then benchmark multiple popular methods using the newly constructed datasets and analyze their performance. The new benchmark datasets help promote a better understanding of the capabilities and challenges of inductive KGC by removing any shortcuts that obfuscate performance.


title: A Global Solution Algorithm for AC Optimal Power Flow through Linear Constrained Quadratic Programming

abstract: We formulate the Alternating Current Optimal Power Flow Problem (ACOPF) as a Linear Constrained Quadratic Program (LCQP) with many negative eigenvalues ($r$) and linear constraints, making it NP-hard. We propose two algorithms, Feasible Successive Linear Programming (FSLP) and Feasible Branch-and-Bound (FBB), for a global optimal solution. These use optimization strategies like bounded successive linear programming, convex relaxation, initialization, and branch-and-bound to find a globally optimal solution within a predefined $\epsilon$-tolerance. The complexity of FSLP and FBB is $\mathcal{O}\left(N \prod_{i=1}^r\left\lceil\frac{\sqrt{r}(t_u^i-t_l^i)}{2 \sqrt{\epsilon}}\right\rceil\right)$, where $N$ is the complexity of solving subproblems at each FBB node. Variables $t_l$ and $t_u$ are the lower and upper bounds of $t$, respectively, and $-|t|^2$ is the negative quadratic component in the ACOPF objective function. We use penalized semidefinite modeling, convex relaxation, and line search to design a globally feasible branch-and-bound algorithm for the LCQP form of ACOPF, finding an optimal solution within $\epsilon$-tolerance. Initial results show FSLP and FBB can find global optimal solutions for large-scale ACOPF instances, even with large $r$, and outperform other methods in most PG-lib tests.


title: Horizon-wise Learning Paradigm Promotes Gene Splicing Identification

abstract: Identifying gene splicing is a core and significant task confronted in modern collaboration between artificial intelligence and bioinformatics. Past decades have witnessed great efforts on this concern, such as the bio-plausible splicing pattern AT-CG and the famous SpliceAI. In this paper, we propose a novel framework for the task of gene splicing identification, named Horizon-wise Gene Splicing Identification (H-GSI). The proposed H-GSI follows the horizon-wise identification paradigm and comprises four components: the pre-processing procedure transforming string data into tensors, the sliding window technique handling long sequences, the SeqLab model, and the predictor. In contrast to existing studies that process gene information with a truncated fixed-length sequence, H-GSI employs a horizon-wise identification paradigm in which all positions in a sequence are predicted with only one forward computation, improving accuracy and efficiency. The experiments conducted on the real-world Human dataset show that our proposed H-GSI outperforms SpliceAI and achieves the best accuracy of 97.20\%. The source code is available from this link.


title: Model Evaluation and Anomaly Detection in Temporal Complex Networks using Deep Learning Methods

abstract: Modeling complex networks allows us to analyze the characteristics and discover the basic mechanisms governing phenomena such as disease outbreaks, information diffusion, transportation efficiency, social influence, and even human brain function. Consequently, various network generative models (called temporal network models) have been presented to model how the network topologies evolve dynamically over time. Temporal network models face the challenge of results evaluation because common evaluation methods are appropriate only for static networks. This paper proposes an automatic approach based on deep learning to handle this issue. In addition to an evaluation method, the proposed method can also be used for anomaly detection in evolving networks. The proposed method has been evaluated on five different datasets, and the evaluations show that it outperforms the alternative methods based on the error rate measure in different datasets.


title: Magnetic Suppression of Cosmic Rays' Flux in $\boldsymbol{f(R)}$ and $\boldsymbol{f(Q)}$ Theories of Gravity

abstract: We investigate the effects of magnetic diffusion on the spectrum of ultra-high energy cosmic rays (UHECRs) from a cosmological perspective. To this end, we consider two modified theories of gravity (MTGs), namely, the $f(R)$ gravity and a symmetric teleparallel gravity, also known as $f(Q)$ gravity. Utilizing these two MTGs, we calculate the suppression in the flux of UHECRs for a collection of sources. Non-evolution (NE) and cosmic star formation rate (SFR) scenarios have been considered in our calculation of the suppression factor. This study also includes a mixed composition scenario involving the nuclei upto iron (Fe). Furthermore, we provide a parameterization of the suppression factor for the proton and also for the mixed compositions within the $f(R)$ and $f(Q)$ theories, considering both NE and SFR scenarios. The influence of the turbulent magnetic field on the suppression factor is also incorporated in our work. Comparative analysis of all our results with the standard $\Lambda$CDM model reveals significant effects of MTGs on the suppression factor that the $f(R)$ power-law model predicts the lowest suppression factor, while the $f(Q)$ model predicts the highest, and interestingly the results from the standard model fall within the range predicted by these two cosmological models.


title: A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges

abstract: Recent advances in large language models (LLMs) have unlocked novel opportunities for machine learning applications in the financial domain. These models have demonstrated remarkable capabilities in understanding context, processing vast amounts of data, and generating human-preferred contents. In this survey, we explore the application of LLMs on various financial tasks, focusing on their potential to transform traditional practices and drive innovation. We provide a discussion of the progress and advantages of LLMs in financial contexts, analyzing their advanced technologies as well as prospective capabilities in contextual understanding, transfer learning flexibility, complex emotion detection, etc. We then highlight this survey for categorizing the existing literature into key application areas, including linguistic tasks, sentiment analysis, financial time series, financial reasoning, agent-based modeling, and other applications. For each application area, we delve into specific methodologies, such as textual analysis, knowledge-based analysis, forecasting, data augmentation, planning, decision support, and simulations. Furthermore, a comprehensive collection of datasets, model assets, and useful codes associated with mainstream applications are presented as resources for the researchers and practitioners. Finally, we outline the challenges and opportunities for future research, particularly emphasizing a number of distinctive aspects in this field. We hope our work can help facilitate the adoption and further development of LLMs in the financial sector.


title: Pay Attention to Weak Ties: A Heterogeneous Multiplex Representation Learning Framework for Link Prediction

abstract: Graph neural networks (GNNs) can learn effective node representations that significantly improve link prediction accuracy. However, most GNN-based link prediction algorithms are incompetent to predict weak ties connecting different communities. Most link prediction algorithms are designed for networks with only one type of relation between nodes but neglect the fact that many complex systems, including transportation and social networks, consisting of multi-modalities of interactions that correspond to different nature of interactions and dynamics that can be modeled as multiplex network, where different types of relation are represented in different layers. This paper proposes a Multi-Relations-aware Graph Neural Network (MRGNN) framework to learn effective node representations for multiplex networks and make more accurate link predictions, especially for weak ties. Specifically, our model utilizes an intra-layer node-level feature propagation process and an inter-layer representation merge process, which applies a simple yet effective logistic or semantic attention voting mechanism to adaptively aggregate information from different layers. Extensive experiments on four diversified multiplex networks show that MRGNN outperforms the state-of-the-art multiplex link prediction algorithms on overall prediction accuracy, and works pretty well on forecasting weak ties


title: EvIL: Evolution Strategies for Generalisable Imitation Learning

abstract: Often times in imitation learning (IL), the environment we collect expert demonstrations in and the environment we want to deploy our learned policy in aren't exactly the same (e.g. demonstrations collected in simulation but deployment in the real world). Compared to policy-centric approaches to IL like behavioural cloning, reward-centric approaches like inverse reinforcement learning (IRL) often better replicate expert behaviour in new environments. This transfer is usually performed by optimising the recovered reward under the dynamics of the target environment. However, (a) we find that modern deep IL algorithms frequently recover rewards which induce policies far weaker than the expert, even in the same environment the demonstrations were collected in. Furthermore, (b) these rewards are often quite poorly shaped, necessitating extensive environment interaction to optimise effectively. We provide simple and scalable fixes to both of these concerns. For (a), we find that reward model ensembles combined with a slightly different training objective significantly improves re-training and transfer performance. For (b), we propose a novel evolution-strategies based method EvIL to optimise for a reward-shaping term that speeds up re-training in the target environment, closing a gap left open by the classical theory of IRL. On a suite of continuous control tasks, we are able to re-train policies in target (and source) environments more interaction-efficiently than prior work.


title: NovoBench: Benchmarking Deep Learning-based De Novo Peptide Sequencing Methods in Proteomics

abstract: Tandem mass spectrometry has played a pivotal role in advancing proteomics, enabling the high-throughput analysis of protein composition in biological tissues. Many deep learning methods have been developed for \emph{de novo} peptide sequencing task, i.e., predicting the peptide sequence for the observed mass spectrum. However, two key challenges seriously hinder the further advancement of this important task. Firstly, since there is no consensus for the evaluation datasets, the empirical results in different research papers are often not comparable, leading to unfair comparison. Secondly, the current methods are usually limited to amino acid-level or peptide-level precision and recall metrics. In this work, we present the first unified benchmark NovoBench for \emph{de novo} peptide sequencing, which comprises diverse mass spectrum data, integrated models, and comprehensive evaluation metrics. Recent impressive methods, including DeepNovo, PointNovo, Casanovo, InstaNovo, AdaNovo and $\pi$-HelixNovo are integrated into our framework. In addition to amino acid-level and peptide-level precision and recall, we evaluate the models' performance in terms of identifying post-tranlational modifications (PTMs), efficiency and robustness to peptide length, noise peaks and missing fragment ratio, which are important influencing factors while seldom be considered. Leveraging this benchmark, we conduct a large-scale study of current methods, report many insightful findings that open up new possibilities for future development. The benchmark will be open-sourced to facilitate future research and application.


title: Mapping Literary Space: A Social Network from the Timeline of Cultural Events

abstract: This paper applies social network analysis (SNA) to explore the literary networks of St. Petersburg from 1999 to 2019. By analyzing data from the "SPbLitGuide" newsletter, which documents literary events and their participants, we map the connections and collaborations within the literary community. Our approach uses text processing, knowledge extraction, and geographic data to construct a detailed network graph. Using SNA algorithms, we identify key communities and influential figures. The analysis reveals a robust small-world network with strong local clustering and widespread collaboration. These findings provide insights into the structure and dynamics of literary groups in St. Petersburg and provide a foundation for further research in the digital humanities.


title: Research on Trends in Illegal Wildlife Trade based on Comprehensive Growth Dynamic Model

abstract: This paper presents an innovative Comprehensive Growth Dynamic Model (CGDM). CGDM is designed to simulate the temporal evolution of an event, incorporating economic and social factors. CGDM is a regression of logistic regression, power law regression, and Gaussian perturbation term. CGDM is comprised of logistic regression, power law regression, and Gaussian perturbation term. CGDM can effectively forecast the temporal evolution of an event, incorporating economic and social factors. The illicit trade in wildlife has a deleterious impact on the ecological environment. In this paper, we employ CGDM to forecast the trajectory of illegal wildlife trade from 2024 to 2034 in China. The mean square error is utilized as the loss function. The model illuminates the future trajectory of illegal wildlife trade, with a minimum point occurring in 2027 and a maximum point occurring in 2029. The stability of contemporary society can be inferred. CGDM's robust and generalizable nature is also evident.


title: Mixture-of-Subspaces in Low-Rank Adaptation

abstract: In this paper, we introduce a subspace-inspired Low-Rank Adaptation (LoRA) method, which is computationally efficient, easy to implement, and readily applicable to large language, multimodal, and diffusion models. Initially, we equivalently decompose the weights of LoRA into two subspaces, and find that simply mixing them can enhance performance. To study such a phenomenon, we revisit it through a fine-grained subspace lens, showing that such modification is equivalent to employing a fixed mixer to fuse the subspaces. To be more flexible, we jointly learn the mixer with the original LoRA weights, and term the method Mixture-of-Subspaces LoRA (MoSLoRA). MoSLoRA consistently outperforms LoRA on tasks in different modalities, including commonsense reasoning, visual instruction tuning, and subject-driven text-to-image generation, demonstrating its effectiveness and robustness. Codes are available at \href{https://github.com/wutaiqiang/MoSLoRA}{github}.


title: Practical Applications of Unidimensional Optimization Using Octave

abstract: This paper suggests integrating one-dimensional optimization methods to tackle diverse problems, emphasizing their significance in resolving practical issues and applying mathematical principles to real-world contexts. It focuses on employing the Octave programming language, backed by specific examples, to simplify the practical application of mathematical concepts and improve problem-solving abilities. The research aims to assess the effect on students' comprehension of one-dimensional optimization.


title: A Notion of Complexity for Theory of Mind via Discrete World Models

abstract: Theory of Mind (ToM) can be used to assess the capabilities of Large Language Models (LLMs) in complex scenarios where social reasoning is required. While the research community has proposed many ToM benchmarks, their hardness varies greatly, and their complexity is not well defined. This work proposes a framework to measure the complexity of ToM tasks. We quantify a problem's complexity as the number of states necessary to solve it correctly. Our complexity measure also accounts for spurious states of a ToM problem designed to make it apparently harder. We use our method to assess the complexity of five widely adopted ToM benchmarks. On top of this framework, we design a prompting technique that augments the information available to a model with a description of how the environment changes with the agents' interactions. We name this technique Discrete World Models (DWM) and show how it elicits superior performance on ToM tasks.


title: AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology

abstract: Software agents have emerged as promising tools for addressing complex software engineering tasks. However, existing works oversimplify software development workflows by following the waterfall model. Thus, we propose AgileCoder, a multi-agent system that integrates Agile Methodology (AM) into the framework. This system assigns specific AM roles such as Product Manager, Developer, and Tester to different agents, who then collaboratively develop software based on user inputs. AgileCoder enhances development efficiency by organizing work into sprints, focusing on incrementally developing software through sprints. Additionally, we introduce Dynamic Code Graph Generator, a module that creates a Code Dependency Graph dynamically as updates are made to the codebase. This allows agents to better comprehend the codebase, leading to more precise code generation and modifications throughout the software development process. AgileCoder surpasses existing benchmarks, like ChatDev and MetaGPT, establishing a new standard and showcasing the capabilities of multi-agent systems in advanced software engineering environments. Our source code can be found at https://github.com/FSoft-AI4Code/AgileCoder.


title: Big data in economics

abstract: The term of big data was used since 1990s, but it became very popular around 2012. A recent definition of this term says that big data are information assets characterized by high volume, velocity, variety and veracity that need special analytical methods and software technologies to extract value form them. While big data was used at the beginning mostly in information technology field, now it can be found in every area of activity: in governmental decision-making processes, manufacturing, education, healthcare, economics, engineering, natural sciences, sociology. The rise of Internet, mobile phones, social media networks, different types of sensors or satellites provide enormous quantities of data that can have profound effects on economic research. The data revolution that we are facing transformed the way we measure the human behavior and economic activities. Unemployment, consumer price index, population mobility, financial transactions are only few examples of economic phenomena that can be analyzed using big data sources. In this paper we will start with a taxonomy of big data sources and show how these new data sources can be used in empirical analyses and to build economic indicators very fast and with reduced costs.


title: Initial Investigation of Kolmogorov-Arnold Networks (KANs) as Feature Extractors for IMU Based Human Activity Recognition

abstract: In this work, we explore the use of a novel neural network architecture, the Kolmogorov-Arnold Networks (KANs) as feature extractors for sensor-based (specifically IMU) Human Activity Recognition (HAR). Where conventional networks perform a parameterized weighted sum of the inputs at each node and then feed the result into a statically defined nonlinearity, KANs perform non-linear computations represented by B-SPLINES on the edges leading to each node and then just sum up the inputs at the node. Instead of learning weights, the system learns the spline parameters. In the original work, such networks have been shown to be able to more efficiently and exactly learn sophisticated real valued functions e.g. in regression or PDE solution. We hypothesize that such an ability is also advantageous for computing low-level features for IMU-based HAR. To this end, we have implemented KAN as the feature extraction architecture for IMU-based human activity recognition tasks, including four architecture variations. We present an initial performance investigation of the KAN feature extractor on four public HAR datasets. It shows that the KAN-based feature extractor outperforms CNN-based extractors on all datasets while being more parameter efficient.


title: miniCodeProps: a Minimal Benchmark for Proving Code Properties

abstract: Neural networks have shown initial promise in automating mathematical theorem proving in proof assistants such as Lean. The same proof assistants can be used to verify the correctness of code by pairing code with specifications and proofs that the specifications hold. Automating the writing of code, specifications, and proofs could lower the cost of verification, or, ambitiously, enable a machine learning system to output provably correct code. However, it remains unclear whether current neural theorem provers can automatically verify even relatively simple programs. We present miniCodeProps, a benchmark of 177 program specifications in the Lean proof assistant, aimed at the subproblem of automatically generating a proof for a provided program and specification. miniCodeProps contains specifications about simple, self-contained programs (e.g., lists, natural numbers, binary trees) with varied proof difficulty. Despite its simplicity, miniCodeProps is challenging for current LLM-based provers, which succeed in proving about 25 percent of the specifications. We publicly release miniCodeProps as a benchmark for furthering automated theorem proving in the context of formally verified code.


title: Enhanced Elephant Herding Optimization for Large Scale Information Access on Social Media

abstract: In this article, we present a novel information access approach inspired by the information foraging theory (IFT) and elephant herding optimization (EHO). First, we propose a model for information access on social media based on the IFT. We then elaborate an adaptation of the original EHO algorithm to apply it to the information access problem. The combination of the IFT and EHO constitutes a good opportunity to find relevant information on social media. However, when dealing with voluminous data, the performance undergoes a sharp drop. To overcome this issue, we developed an enhanced version of EHO for large scale information access. We introduce new operators to the algorithm, including territories delimitation and clan migration using clustering. To validate our work, we created a dataset of more than 1.4 million tweets, on which we carried out extensive experiments. The outcomes reveal the ability of our approach to find relevant information in an effective and efficient way. They also highlight the advantages of the improved version of EHO over the original algorithm regarding different aspects. Furthermore, we undertook a comparative study with two other metaheuristic-based information foraging approaches, namely ant colony system and particle swarm optimization. Overall, the results are very promising.


title: Interpretable modulated differentiable STFT and physics-informed balanced spectrum metric for freight train wheelset bearing cross-machine transfer fault diagnosis under speed fluctuations

abstract: The service conditions of wheelset bearings has a direct impact on the safe operation of railway heavy haul freight trains as the key components. However, speed fluctuation of the trains and few fault samples are the two main problems that restrict the accuracy of bearing fault diagnosis. Therefore, a cross-machine transfer diagnosis (pyDSN) network coupled with interpretable modulated differentiable short-time Fourier transform (STFT) and physics-informed balanced spectrum quality metric is proposed to learn domain-invariant and discriminative features under time-varying speeds. Firstly, due to insufficiency in extracting extract frequency components of time-varying speed signals using fixed windows, a modulated differentiable STFT (MDSTFT) that is interpretable with STFT-informed theoretical support, is proposed to extract the robust time-frequency spectrum (TFS). During training process, multiple windows with different lengths dynamically change. Also, in addition to the classification metric and domain discrepancy metric, we creatively introduce a third kind of metric, referred to as the physics-informed metric, to enhance transferable TFS. A physics-informed balanced spectrum quality (BSQ) regularization loss is devised to guide an optimization direction for MDSTFT and model. With it, not only can model acquire high-quality TFS, but also a physics-restricted domain adaptation network can be also acquired, making it learn real-world physics knowledge, ultimately diminish the domain discrepancy across different datasets. The experiment is conducted in the scenario of migrating from the laboratory datasets to the freight train dataset, indicating that the hybrid-driven pyDSN outperforms existing methods and has practical value.


title: QoE Maximization for Multiple-UAV-Assisted Multi-Access Edge Computing: An Online Joint Optimization Approach

abstract: In disaster scenarios, conventional terrestrial multi-access edge computing (MEC) paradigms, which rely on fixed infrastructure, may become unavailable due to infrastructure damage. With high-probability line-of-sight (LoS) communication, flexible mobility, and low cost, unmanned aerial vehicle (UAV)-assisted MEC is emerging as a new promising paradigm to provide edge computing services for ground user devices (UDs) in disaster-stricken areas. However, the limited battery capacity, computing resources, and spectrum resources also pose serious challenges for UAV-assisted MEC, which can potentially shorten the service time of UAVs and degrade the quality of experience (QoE) of UDs without an effective control approach. To this end, in this work, we first present a hierarchical architecture of multiple-UAV-assisted MEC networks that enables the coordinated provision of edge computing services by multiple UAVs. Then, we formulate a joint task offloading, resource allocation, and UAV trajectory planning optimization problem (JTRTOP) to maximize the QoE of UDs while considering the energy consumption constraints of UAVs. Since the problem is proven to be a future-dependent and NP-hard problem, we propose a novel online joint task offloading, resource allocation, and UAV trajectory planning approach (OJTRTA) to solve the problem. Specifically, the JTRTOP is first transformed into a per-slot real-time optimization problem (PROP) using the Lyapunov optimization framework. Then, a two-stage optimization method based on game theory and convex optimization is proposed to solve the PROP. Simulation results provide empirical evidence supporting the superior system performance of the proposed OJTRTA in comparison to alternative approaches.


title: Graph Knowledge Distillation to Mixture of Experts

abstract: In terms of accuracy, Graph Neural Networks (GNNs) are the best architectural choice for the node classification task. Their drawback in real-world deployment is the latency that emerges from the neighbourhood processing operation. One solution to the latency issue is to perform knowledge distillation from a trained GNN to a Multi-Layer Perceptron (MLP), where the MLP processes only the features of the node being classified (and possibly some pre-computed structural information). However, the performance of such MLPs in both transductive and inductive settings remains inconsistent for existing knowledge distillation techniques. We propose to address the performance concerns by using a specially-designed student model instead of an MLP. Our model, named Routing-by-Memory (RbM), is a form of Mixture-of-Experts (MoE), with a design that enforces expert specialization. By encouraging each expert to specialize on a certain region on the hidden representation space, we demonstrate experimentally that it is possible to derive considerably more consistent performance across multiple datasets.


title: Job-SDF: A Multi-Granularity Dataset for Job Skill Demand Forecasting and Benchmarking

abstract: In a rapidly evolving job market, skill demand forecasting is crucial as it enables policymakers and businesses to anticipate and adapt to changes, ensuring that workforce skills align with market needs, thereby enhancing productivity and competitiveness. Additionally, by identifying emerging skill requirements, it directs individuals towards relevant training and education opportunities, promoting continuous self-learning and development. However, the absence of comprehensive datasets presents a significant challenge, impeding research and the advancement of this field. To bridge this gap, we present Job-SDF, a dataset designed to train and benchmark job-skill demand forecasting models. Based on 10.35 million public job advertisements collected from major online recruitment platforms in China between 2021 and 2023, this dataset encompasses monthly recruitment demand for 2,324 types of skills across 521 companies. Our dataset uniquely enables evaluating skill demand forecasting models at various granularities, including occupation, company, and regional levels. We benchmark a range of models on this dataset, evaluating their performance in standard scenarios, in predictions focused on lower value ranges, and in the presence of structural breaks, providing new insights for further research. Our code and dataset are publicly accessible via the https://github.com/Job-SDF/benchmark.


title: Rethinking Spatio-Temporal Transformer for Traffic Prediction:Multi-level Multi-view Augmented Learning Framework

abstract: Traffic prediction is a challenging spatio-temporal forecasting problem that involves highly complex spatio-temporal correlations. This paper proposes a Multi-level Multi-view Augmented Spatio-temporal Transformer (LVSTformer) for traffic prediction. The model aims to capture spatial dependencies from three different levels: local geographic, global semantic, and pivotal nodes, along with long- and short-term temporal dependencies. Specifically, we design three spatial augmented views to delve into the spatial information from the perspectives of local, global, and pivotal nodes. By combining three spatial augmented views with three parallel spatial self-attention mechanisms, the model can comprehensively captures spatial dependencies at different levels. We design a gated temporal self-attention mechanism to effectively capture long- and short-term temporal dependencies. Furthermore, a spatio-temporal context broadcasting module is introduced between two spatio-temporal layers to ensure a well-distributed allocation of attention scores, alleviating overfitting and information loss, and enhancing the generalization ability and robustness of the model. A comprehensive set of experiments is conducted on six well-known traffic benchmarks, the experimental results demonstrate that LVSTformer achieves state-of-the-art performance compared to competing baselines, with the maximum improvement reaching up to 4.32%.


title: On the splitting of surfaces in motivic stable homotopy category

abstract: Let $k$ be a field and $X$ be a smooth projective surface over $k$ with a rational point, we discuss the condition of splitting off the top cell for the motivic stable homotopy type of $X$. We also study some outlying examples, such as K3 surfaces.


title: The stellar halo of the Milky Way traced by blue horizontal-branch stars in the Subaru Hyper Suprime-Cam Survey

abstract: We select blue-horizontal branch stars (BHBs) from the internal data release of the Hyper Suprime-Cam Subaru Strategic Program to reveal the global structure of the Milky Way (MW) stellar halo. The data are distributed over $\sim 1,100$~deg$^2$ area in the range of $18.5<g<24.5$~mag, so that candidate BHBs are detectable over a Galactocentric radius of $r \simeq 36-575$~kpc. In order to select most likely BHBs by removing blue straggler stars and other contaminants in a statistically significant manner, we develop and apply an extensive Bayesian method, as described in \citet{Fukushima2019}. Our sample can be fitted to either a single power-law profile with an index of $\alpha=4.11^{+0.18}_{-0.18}$ or a broken power-law profile with an index of $\alpha_{\rm in}=3.90^{+0.24}_{-0.30}$ at $r$ below a broken radius of $r_{\rm b}=184^{+118}_{-66}$ kpc and a very steep slope of $\alpha_{\rm out}=9.1^{+6.8}_{-3.6}$ at $r>r_{\rm b}$; the statistical difference between these fitting profiles is small. Both profiles are found to show prolate shapes having axial ratios of $q=1.47^{+0.30}_{-0.33}$ and $1.56^{+0.34}_{-0.23}$, respectively. We also find a signature of the so-called "splashback radius" for the candidate BHBs, which can reach as large as $r \sim 575$~kpc, although it is still inconclusive owing to rather large distance errors in this faintest end of the sample. Our results suggest that the MW stellar halo consists of the two overlapping components: the {\it in situ} inner halo showing a relatively steep radial density profile and the {\it ex situ} outer halo with a shallower profile, being characteristic of a component formed from accretion of small stellar systems.


title: Explainable assessment of financial experts' credibility by classifying social media forecasts and checking the predictions with actual market data

abstract: Social media include diverse interaction metrics related to user popularity, the most evident example being the number of user followers. The latter has raised concerns about the credibility of the posts by the most popular creators. However, most existing approaches to assess credibility in social media strictly consider this problem a binary classification, often based on a priori information, without checking if actual real-world facts back the users' comments. In addition, they do not provide automatic explanations of their predictions to foster their trustworthiness. In this work, we propose a credibility assessment solution for financial creators in social media that combines Natural Language Processing and Machine Learning. The reputation of the contributors is assessed by automatically classifying their forecasts on asset values by type and verifying these predictions with actual market data to approximate their probability of success. The outcome of this verification is a continuous credibility score instead of a binary result, an entirely novel contribution by this work. Moreover, social media metrics (i.e., user context) are exploited by calculating their correlation with the credibility rankings, providing insights on the interest of the end-users in financial posts and their forecasts (i.e., drop or rise). Finally, the system provides natural language explanations of its decisions based on a model-agnostic analysis of relevant features.


title: DocCGen: Document-based Controlled Code Generation

abstract: Recent developments show that Large Language Models (LLMs) produce state-of-the-art performance on natural language (NL) to code generation for resource-rich general-purpose languages like C++, Java, and Python. However, their practical usage for structured domain-specific languages (DSLs) such as YAML, JSON is limited due to domain-specific schema, grammar, and customizations generally unseen by LLMs during pre-training. Efforts have been made to mitigate this challenge via in-context learning through relevant examples or by fine-tuning. However, it suffers from problems, such as limited DSL samples and prompt sensitivity but enterprises maintain good documentation of the DSLs. Therefore, we propose DocCGen, a framework that can leverage such rich knowledge by breaking the NL-to-Code generation task for structured code languages into a two-step process. First, it detects the correct libraries using the library documentation that best matches the NL query. Then, it utilizes schema rules extracted from the documentation of these libraries to constrain the decoding. We evaluate our framework for two complex structured languages, Ansible YAML and Bash command, consisting of two settings: Out-of-domain (OOD) and In-domain (ID). Our extensive experiments show that DocCGen consistently improves different-sized language models across all six evaluation metrics, reducing syntactic and semantic errors in structured code. We plan to open-source the datasets and code to motivate research in constrained code generation.


title: A Tale of Two Black Holes: Multiband Gravitational-Wave Measurement of Recoil Kicks

abstract: The non-linear dynamics of General Relativity leave their imprint on remnants of black hole mergers in the form of a recoil ``kick''. The kick has profound astrophysical implications across the black hole mass range from stellar to super-massive. However, a robust measurement of the kick for generic binaries from gravitational-wave observations has proved so far to be extremely challenging. In this \emph{letter}, we demonstrate the prospects of measuring black hole kicks through a multiband gravitational-wave network consisting of space mission LISA, the current earth-based detector network and a third-generation detector. For two distinct cases of remnant black hole kick (68 km/s, 1006 km/s) emerging from near identical pre-merger configuration of GW190521 -- the first confirmed intermediate-mass black hole -- we find that the multiband network will recover with 90\% credible level the projection of the kick vector relative to the orbital plane within tens of km/s accuracy. Such precise measurement of the kick offer a new set of multi-messenger follow-ups and unprecedented tests of astrophysical formation channels.


title: REPOEXEC: Evaluate Code Generation with a Repository-Level Executable Benchmark

abstract: The ability of CodeLLMs to generate executable and functionally correct code at the repository-level scale remains largely unexplored. We introduce RepoExec, a novel benchmark for evaluating code generation at the repository-level scale. RepoExec focuses on three main aspects: executability, functional correctness through automated test case generation with high coverage rate, and carefully crafted cross-file contexts to accurately generate code. Our work explores a controlled scenario where developers specify necessary code dependencies, challenging the model to integrate these accurately. Experiments show that while pretrained LLMs outperform instruction-tuned models in correctness, the latter excel in utilizing provided dependencies and demonstrating debugging capabilities. We also introduce a new instruction-tuned dataset that focuses on code dependencies and demonstrate that CodeLLMs fine-tuned on our dataset have a better capability to leverage these dependencies effectively. RepoExec aims to provide a comprehensive evaluation of code functionality and alignment with developer intent, paving the way for more reliable and applicable CodeLLMs in real-world scenarios. The dataset and source code can be found at~\url{https://github.com/FSoft-AI4Code/RepoExec}.


title: FlexCare: Leveraging Cross-Task Synergy for Flexible Multimodal Healthcare Prediction

abstract: Multimodal electronic health record (EHR) data can offer a holistic assessment of a patient's health status, supporting various predictive healthcare tasks. Recently, several studies have embraced the multitask learning approach in the healthcare domain, exploiting the inherent correlations among clinical tasks to predict multiple outcomes simultaneously. However, existing methods necessitate samples to possess complete labels for all tasks, which places heavy demands on the data and restricts the flexibility of the model. Meanwhile, within a multitask framework with multimodal inputs, how to comprehensively consider the information disparity among modalities and among tasks still remains a challenging problem. To tackle these issues, a unified healthcare prediction model, also named by \textbf{FlexCare}, is proposed to flexibly accommodate incomplete multimodal inputs, promoting the adaption to multiple healthcare tasks. The proposed model breaks the conventional paradigm of parallel multitask prediction by decomposing it into a series of asynchronous single-task prediction. Specifically, a task-agnostic multimodal information extraction module is presented to capture decorrelated representations of diverse intra- and inter-modality patterns. Taking full account of the information disparities between different modalities and different tasks, we present a task-guided hierarchical multimodal fusion module that integrates the refined modality-level representations into an individual patient-level representation. Experimental results on multiple tasks from MIMIC-IV/MIMIC-CXR/MIMIC-NOTE datasets demonstrate the effectiveness of the proposed method. Additionally, further analysis underscores the feasibility and potential of employing such a multitask strategy in the healthcare domain. The source code is available at https://github.com/mhxu1998/FlexCare.


title: Long-time asymptotics of noisy SVGD outside the population limit

abstract: Stein Variational Gradient Descent (SVGD) is a widely used sampling algorithm that has been successfully applied in several areas of Machine Learning. SVGD operates by iteratively moving a set of interacting particles (which represent the samples) to approximate the target distribution. Despite recent studies on the complexity of SVGD and its variants, their long-time asymptotic behavior (i.e., after numerous iterations ) is still not understood in the finite number of particles regime. We study the long-time asymptotic behavior of a noisy variant of SVGD. First, we establish that the limit set of noisy SVGD for large is well-defined. We then characterize this limit set, showing that it approaches the target distribution as increases. In particular, noisy SVGD provably avoids the variance collapse observed for SVGD. Our approach involves demonstrating that the trajectories of noisy SVGD closely resemble those described by a McKean-Vlasov process.


title: A Critical Study of What Code-LLMs (Do Not) Learn

abstract: Large Language Models trained on code corpora (code-LLMs) have demonstrated impressive performance in various coding assistance tasks. However, despite their increased size and training dataset, code-LLMs still have limitations such as suggesting codes with syntactic errors, variable misuse etc. Some studies argue that code-LLMs perform well on coding tasks because they use self-attention and hidden representations to encode relations among input tokens. However, previous works have not studied what code properties are not encoded by code-LLMs. In this paper, we conduct a fine-grained analysis of attention maps and hidden representations of code-LLMs. Our study indicates that code-LLMs only encode relations among specific subsets of input tokens. Specifically, by categorizing input tokens into syntactic tokens and identifiers, we found that models encode relations among syntactic tokens and among identifiers, but they fail to encode relations between syntactic tokens and identifiers. We also found that fine-tuned models encode these relations poorly compared to their pre-trained counterparts. Additionally, larger models with billions of parameters encode significantly less information about code than models with only a few hundred million parameters.


title: DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

abstract: We present DeepSeek-Coder-V2, an open-source Mixture-of-Experts (MoE) code language model that achieves performance comparable to GPT4-Turbo in code-specific tasks. Specifically, DeepSeek-Coder-V2 is further pre-trained from an intermediate checkpoint of DeepSeek-V2 with additional 6 trillion tokens. Through this continued pre-training, DeepSeek-Coder-V2 substantially enhances the coding and mathematical reasoning capabilities of DeepSeek-V2, while maintaining comparable performance in general language tasks. Compared to DeepSeek-Coder-33B, DeepSeek-Coder-V2 demonstrates significant advancements in various aspects of code-related tasks, as well as reasoning and general capabilities. Additionally, DeepSeek-Coder-V2 expands its support for programming languages from 86 to 338, while extending the context length from 16K to 128K. In standard benchmark evaluations, DeepSeek-Coder-V2 achieves superior performance compared to closed-source models such as GPT4-Turbo, Claude 3 Opus, and Gemini 1.5 Pro in coding and math benchmarks.


title: Using shadow of black hole to examine the energy exchange between axion matter and rotating black hole

abstract: We find that a \textit{slowly} rotating axion-modified black hole resulting from the backreaction of an axion field on a rotating Kerr black hole can have a \textit{D-shaped} shadow as that for a \textit{highly} counter-rotating Kerr black hole. This attributes to the fact that the energy exchange between the axion matter and the black hole influences the rotation of the black hole, so the black hole angular momentum first decreases to zero and then the black hole starts to rotate to the opposite direction. Further increasing the coupling leads to \textit{``human-face-like" shaped} shadows and new lensing due to the chaotic scattering, which are novel and drastically different from Kerr black hole. Our analysis provides the first counterexample to that slowly rotating black hole has nearly circular shadow.


title: Scaling Efficient Masked Autoencoder Learning on Large Remote Sensing Dataset

abstract: Masked Image Modeling (MIM) has emerged as a pivotal approach for developing foundational visual models in the field of remote sensing (RS). However, current RS datasets are limited in volume and diversity, which significantly constrains the capacity of MIM methods to learn generalizable representations. In this study, we introduce \textbf{RS-4M}, a large-scale dataset designed to enable highly efficient MIM training on RS images. RS-4M comprises 4 million optical images encompassing abundant and fine-grained RS visual tasks, including object-level detection and pixel-level segmentation. Compared to natural images, RS images often contain massive redundant background pixels, which limits the training efficiency of the conventional MIM models. To address this, we propose an efficient MIM method, termed \textbf{SelectiveMAE}, which dynamically encodes and reconstructs a subset of patch tokens selected based on their semantic richness. SelectiveMAE roots in a progressive semantic token selection module, which evolves from reconstructing semantically analogical tokens to encoding complementary semantic dependencies. This approach transforms conventional MIM training into a progressive feature learning process, enabling SelectiveMAE to efficiently learn robust representations of RS images. Extensive experiments show that SelectiveMAE significantly boosts training efficiency by 2.2-2.7 times and enhances the classification, detection, and segmentation performance of the baseline MIM model.The dataset, source code, and trained models will be released.


title: Bridging Design Gaps: A Parametric Data Completion Approach With Graph Guided Diffusion Models

abstract: This study introduces a generative imputation model leveraging graph attention networks and tabular diffusion models for completing missing parametric data in engineering designs. This model functions as an AI design co-pilot, providing multiple design options for incomplete designs, which we demonstrate using the bicycle design CAD dataset. Through comparative evaluations, we demonstrate that our model significantly outperforms existing classical methods, such as MissForest, hotDeck, PPCA, and tabular generative method TabCSDI in both the accuracy and diversity of imputation options. Generative modeling also enables a broader exploration of design possibilities, thereby enhancing design decision-making by allowing engineers to explore a variety of design completions. The graph model combines GNNs with the structural information contained in assembly graphs, enabling the model to understand and predict the complex interdependencies between different design parameters. The graph model helps accurately capture and impute complex parametric interdependencies from an assembly graph, which is key for design problems. By learning from an existing dataset of designs, the imputation capability allows the model to act as an intelligent assistant that autocompletes CAD designs based on user-defined partial parametric design, effectively bridging the gap between ideation and realization. The proposed work provides a pathway to not only facilitate informed design decisions but also promote creative exploration in design.


title: Iterative or Innovative? A Problem-Oriented Perspective for Code Optimization

abstract: Large language models (LLMs) have demonstrated strong capabilities in solving a wide range of programming tasks. However, LLMs have rarely been explored for code optimization. In this paper, we explore code optimization with a focus on performance enhancement, specifically aiming to optimize code for minimal execution time. The recently proposed first PIE dataset for performance optimization constructs program optimization pairs based on iterative submissions from the same programmer for the same problem. However, this approach restricts LLMs to local performance improvements, neglecting global algorithmic innovation. Therefore, we adopt a completely different perspective by reconstructing the optimization pairs into a problem-oriented approach. This allows for the integration of various ingenious ideas from different programmers tackling the same problem. Experimental results demonstrate that adapting LLMs to problem-oriented optimization pairs significantly enhances their optimization capabilities. Meanwhile, we identified performance bottlenecks within the problem-oriented perspective. By employing model merge, we further overcame bottlenecks and ultimately elevated the program optimization ratio ($51.76\%\rightarrow76.65\%$) and speedup ($2.65\times\rightarrow5.09\times$) to new levels.


title: Relations between Newtonian and relativistic cosmology

abstract: We start with the cosmic Friedmann equations, where we adopt a novel perspective rooted in a Lagrangian formulation grounded in Newtonian mechanics and the first law of thermodynamics. Our investigation operates under the assumption that the universe is populated by either a perfect fluid or a scalar field. By elucidating the intricate interplay between the Lagrangian formulation and the cosmic Friedmann equations, we uncover the fundamental principles governing the universe's dynamics within the framework of these elemental constituents. In our concluding endeavor, we embark on the task of harmonizing the classical equations - namely, the conservation, Euler, and Poisson equations - with the principles of General Relativity. This undertaking seeks to extend these foundational equations to encompass the gravitational effects delineated by General Relativity, thus providing a comprehensive framework for understanding the behavior of matter and spacetime in the cosmic context.


title: Using graph neural networks to reconstruct charged pion showers in the CMS High Granularity Calorimeter

abstract: A novel method to reconstruct the energy of hadronic showers in the CMS High Granularity Calorimeter (HGCAL) is presented. The HGCAL is a sampling calorimeter with very fine transverse and longitudinal granularity. The active media are silicon sensors and scintillator tiles readout by SiPMs and the absorbers are a combination of lead and Cu/CuW in the electromagnetic section, and steel in the hadronic section. The shower reconstruction method is based on graph neural networks and it makes use of a dynamic reduction network architecture. It is shown that the algorithm is able to capture and mitigate the main effects that normally hinder the reconstruction of hadronic showers using classical reconstruction methods, by compensating for fluctuations in the multiplicity, energy, and spatial distributions of the shower's constituents. The performance of the algorithm is evaluated using test beam data collected in 2018 prototype of the CMS HGCAL accompanied by a section of the CALICE AHCAL prototype. The capability of the method to mitigate the impact of energy leakage from the calorimeter is also demonstrated.


title: Tracking the perspectives of interacting language models

abstract: Large language models (LLMs) are capable of producing high quality information at unprecedented rates. As these models continue to entrench themselves in society, the content they produce will become increasingly pervasive in databases that are, in turn, incorporated into the pre-training data, fine-tuning data, retrieval data, etc. of other language models. In this paper we formalize the idea of a communication network of LLMs and introduce a method for representing the perspective of individual models within a collection of LLMs. Given these tools we systematically study information diffusion in the communication network of LLMs in various simulated settings.


title: From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline

abstract: The rapid evolution of language models has necessitated the development of more challenging benchmarks. Current static benchmarks often struggle to consistently distinguish between the capabilities of different models and fail to align with real-world user preferences. On the other hand, live crowd-sourced platforms like the Chatbot Arena collect a wide range of natural prompts and user feedback. However, these prompts vary in sophistication and the feedback cannot be applied offline to new models. In order to ensure that benchmarks keep up with the pace of LLM development, we address how one can evaluate benchmarks on their ability to confidently separate models and their alignment with human preference. Under these principles, we developed BenchBuilder, a living benchmark that filters high-quality prompts from live data sources to enable offline evaluation on fresh, challenging prompts. BenchBuilder identifies seven indicators of a high-quality prompt, such as the requirement for domain knowledge, and utilizes an LLM annotator to select a high-quality subset of prompts from various topic clusters. The LLM evaluation process employs an LLM judge to ensure a fully automated, high-quality, and constantly updating benchmark. We apply BenchBuilder on prompts from the Chatbot Arena to create Arena-Hard-Auto v0.1: 500 challenging user prompts from a wide range of tasks. Arena-Hard-Auto v0.1 offers 3x tighter confidence intervals than MT-Bench and achieves a state-of-the-art 89.1% agreement with human preference rankings, all at a cost of only $25 and without human labelers. The BenchBuilder pipeline enhances evaluation benchmarks and provides a valuable tool for developers, enabling them to extract high-quality benchmarks from extensive data with minimal effort.


title: Model-Based Inference and Experimental Design for Interference Using Partial Network Data

abstract: The stable unit treatment value assumption states that the outcome of an individual is not affected by the treatment statuses of others, however in many real world applications, treatments can have an effect on many others beyond the immediately treated. Interference can generically be thought of as mediated through some network structure. In many empirically relevant situations however, complete network data (required to adjust for these spillover effects) are too costly or logistically infeasible to collect. Partially or indirectly observed network data (e.g., subsamples, aggregated relational data (ARD), egocentric sampling, or respondent-driven sampling) reduce the logistical and financial burden of collecting network data, but the statistical properties of treatment effect adjustments from these design strategies are only beginning to be explored. In this paper, we present a framework for the estimation and inference of treatment effect adjustments using partial network data through the lens of structural causal models. We also illustrate procedures to assign treatments using only partial network data, with the goal of either minimizing estimator variance or optimally seeding. We derive single network asymptotic results applicable to a variety of choices for an underlying graph model. We validate our approach using simulated experiments on observed graphs with applications to information diffusion in India and Malawi.


title: Crossfusor: A Cross-Attention Transformer Enhanced Conditional Diffusion Model for Car-Following Trajectory Prediction

abstract: Vehicle trajectory prediction is crucial for advancing autonomous driving and advanced driver assistance systems (ADAS), enhancing road safety and traffic efficiency. While traditional methods have laid foundational work, modern deep learning techniques, particularly transformer-based models and generative approaches, have significantly improved prediction accuracy by capturing complex and non-linear patterns in vehicle motion and traffic interactions. However, these models often overlook the detailed car-following behaviors and inter-vehicle interactions essential for real-world driving scenarios. This study introduces a Cross-Attention Transformer Enhanced Conditional Diffusion Model (Crossfusor) specifically designed for car-following trajectory prediction. Crossfusor integrates detailed inter-vehicular interactions and car-following dynamics into a robust diffusion framework, improving both the accuracy and realism of predicted trajectories. The model leverages a novel temporal feature encoding framework combining GRU, location-based attention mechanisms, and Fourier embedding to capture historical vehicle dynamics. It employs noise scaled by these encoded historical features in the forward diffusion process, and uses a cross-attention transformer to model intricate inter-vehicle dependencies in the reverse denoising process. Experimental results on the NGSIM dataset demonstrate that Crossfusor outperforms state-of-the-art models, particularly in long-term predictions, showcasing its potential for enhancing the predictive capabilities of autonomous driving systems.


title: Clustering functional data with measurement errors: a simulation-based approach

abstract: Clustering analysis of functional data, which comprises observations that evolve continuously over time or space, has gained increasing attention across various scientific disciplines. Practical applications often involve functional data that are contaminated with measurement errors arising from imprecise instruments, sampling errors, or other sources. These errors can significantly distort the inherent data structure, resulting in erroneous clustering outcomes. In this paper, we propose a simulation-based approach designed to mitigate the impact of measurement errors. Our proposed method estimates the distribution of functional measurement errors through repeated measurements. Subsequently, the clustering algorithm is applied to simulated data generated from the conditional distribution of the unobserved true functional data given the observed contaminated functional data, accounting for the adjustments made to rectify measurement errors. We illustrate through simulations show that the proposed method has improved numerical performance than the naive methods that neglect such errors. Our proposed method was applied to a childhood obesity study, giving more reliable clustering results


title: Personalized Federated Knowledge Graph Embedding with Client-Wise Relation Graph

abstract: Federated Knowledge Graph Embedding (FKGE) has recently garnered considerable interest due to its capacity to extract expressive representations from distributed knowledge graphs, while concurrently safeguarding the privacy of individual clients. Existing FKGE methods typically harness the arithmetic mean of entity embeddings from all clients as the global supplementary knowledge, and learn a replica of global consensus entities embeddings for each client. However, these methods usually neglect the inherent semantic disparities among distinct clients. This oversight not only results in the globally shared complementary knowledge being inundated with too much noise when tailored to a specific client, but also instigates a discrepancy between local and global optimization objectives. Consequently, the quality of the learned embeddings is compromised. To address this, we propose Personalized Federated knowledge graph Embedding with client-wise relation Graph (PFedEG), a novel approach that employs a client-wise relation graph to learn personalized embeddings by discerning the semantic relevance of embeddings from other clients. Specifically, PFedEG learns personalized supplementary knowledge for each client by amalgamating entity embedding from its neighboring clients based on their "affinity" on the client-wise relation graph. Each client then conducts personalized embedding learning based on its local triples and personalized supplementary knowledge. We conduct extensive experiments on four benchmark datasets to evaluate our method against state-of-the-art models and results demonstrate the superiority of our method.


title: Transcoders Find Interpretable LLM Feature Circuits

abstract: A key goal in mechanistic interpretability is circuit analysis: finding sparse subgraphs of models corresponding to specific behaviors or capabilities. However, MLP sublayers make fine-grained circuit analysis on transformer-based language models difficult. In particular, interpretable features -- such as those found by sparse autoencoders (SAEs) -- are typically linear combinations of extremely many neurons, each with its own nonlinearity to account for. Circuit analysis in this setting thus either yields intractably large circuits or fails to disentangle local and global behavior. To address this we explore transcoders, which seek to faithfully approximate a densely activating MLP layer with a wider, sparsely-activating MLP layer. We successfully train transcoders on language models with 120M, 410M, and 1.4B parameters, and find them to perform at least on par with SAEs in terms of sparsity, faithfulness, and human-interpretability. We then introduce a novel method for using transcoders to perform weights-based circuit analysis through MLP sublayers. The resulting circuits neatly factorize into input-dependent and input-invariant terms. Finally, we apply transcoders to reverse-engineer unknown circuits in the model, and we obtain novel insights regarding the greater-than circuit in GPT2-small. Our results suggest that transcoders can prove effective in decomposing model computations involving MLPs into interpretable circuits. Code is available at https://github.com/jacobdunefsky/transcoder_circuits.


title: GAugLLM: Improving Graph Contrastive Learning for Text-Attributed Graphs with Large Language Models

abstract: This work studies self-supervised graph learning for text-attributed graphs (TAGs) where nodes are represented by textual attributes. Unlike traditional graph contrastive methods that perturb the numerical feature space and alter the graph's topological structure, we aim to improve view generation through language supervision. This is driven by the prevalence of textual attributes in real applications, which complement graph structures with rich semantic information. However, this presents challenges because of two major reasons. First, text attributes often vary in length and quality, making it difficulty to perturb raw text descriptions without altering their original semantic meanings. Second, although text attributes complement graph structures, they are not inherently well-aligned. To bridge the gap, we introduce GAugLLM, a novel framework for augmenting TAGs. It leverages advanced large language models like Mistral to enhance self-supervised graph learning. Specifically, we introduce a mixture-of-prompt-expert technique to generate augmented node features. This approach adaptively maps multiple prompt experts, each of which modifies raw text attributes using prompt engineering, into numerical feature space. Additionally, we devise a collaborative edge modifier to leverage structural and textual commonalities, enhancing edge augmentation by examining or building connections between nodes. Empirical results across five benchmark datasets spanning various domains underscore our framework's ability to enhance the performance of leading contrastive methods as a plug-in tool. Notably, we observe that the augmented features and graph structure can also enhance the performance of standard generative methods, as well as popular graph neural networks. The open-sourced implementation of our GAugLLM is available at Github.


title: Expedient Assistance and Consequential Misunderstanding: Envisioning an Operationalized Mutual Theory of Mind

abstract: Design fictions allow us to prototype the future. They enable us to interrogate emerging or non-existent technologies and examine their implications. We present three design fictions that probe the potential consequences of operationalizing a mutual theory of mind (MToM) between human users and one (or more) AI agents. We use these fictions to explore many aspects of MToM, including how models of the other party are shaped through interaction, how discrepancies between these models lead to breakdowns, and how models of a human's knowledge and skills enable AI agents to act in their stead. We examine these aspects through two lenses: a utopian lens in which MToM enhances human-human interactions and leads to synergistic human-AI collaborations, and a dystopian lens in which a faulty or misaligned MToM leads to problematic outcomes. Our work provides an aspirational vision for human-centered MToM research while simultaneously warning of the consequences when implemented incorrectly.


title: Analytical approximations closed as desired to special functions

abstract: We present a method for constructing global analytical expressions that approximate a function over its entire range. These approximations not only mirror the original function as accurately as desired, but are purposefully created to possess features that the original function lacks. This is particularly useful for functions that lack closed form and are defined by integrals or infinite series. Replacing these definitions with simple analytical expressions enables in-depth qualitative analysis and replaces the current methods of evaluation. We demonstrate this procedure by providing replacements for a variety of pivotal functions in physics and cosmology including the pressure and density of quantum gas, the one-loop correction in thermal field theory, common polylog functions, and the error function.


title: Wess-Zumino-Witten Interactions of Axions

abstract: We present a consistent derivation of the complete Wess-Zumino-Witten interactions of axions, including the counter-term necessary to guarantee the gauge invariance of the Standard Model. By treating the derivative of the axion field as a background gauge field and incorporating auxiliary chiral rotation phases, we ensure consistency in the axion-interaction Lagrangian. This approach allows us to derive basis-independent physical interactions of axions with gauge bosons and vector mesons. As an example, we explore the interaction of $a$-$\omega$-$\gamma$ to illustrate the potential for searching for axion-like particles at colliders.


title: Refining Galactic primordial black hole evaporation constraints

abstract: We revisit the role of primordial black holes (PBHs) as potential dark matter (DM) candidates, particularly focusing on light asteroid-mass PBHs. These PBHs are expected to emit particles through Hawking evaporation that can generate cosmic rays (CRs), eventually producing other secondary radiations through their propagation in the Milky Way, in addition to prompt emissions. Here, we perform a comprehensive analysis of CR signals resulting from PBH evaporation, incorporating the full CR transport to account for reacceleration and diffusion effects within the Milky Way. In particular, we revisit the $e^\pm$ flux produced by PBHs, using Voyager 1, and study for the first time the diffuse X-ray emission from the up-scattering of Galactic ambient photons due to PBH-produced $e^\pm$ via the inverse Compton effect using XMM-Newton data, as well as the morphological information of the diffuse 511 keV line measured by INTEGRAL/SPI. In doing so, we provide leading constraints on the fraction of DM that can be in form of PBHs in a conservative way, whilst also testing how different assumptions on spin and mass distributions affect our conclusions.


title: Reducing Model Error Using Optimised Galaxy Selection: Weak Lensing Cluster Mass Estimation

abstract: Galaxy clusters are one of the most powerful probes to study extensions of General Relativity and the Standard Cosmological Model. Upcoming surveys like the Vera Rubin Observatory's Legacy Survey of Space and Time are expected to revolutionise the field, by enabling the analysis of cluster samples of unprecedented size and quality. To reach this era of high-precision cluster cosmology, the mitigation of sources of systematic error is crucial. A particularly important challenge is bias in cluster mass measurements induced by inaccurate photometric redshift estimates of source galaxies. This work proposes a method to optimise the source sample selection in cluster weak lensing analyses drawn from wide-field survey lensing catalogs to reduce the bias on reconstructed cluster masses. We use a combinatorial optimisation scheme and methods from variational inference to select galaxies in latent space to produce a probabilistic galaxy source sample catalog for highly accurate cluster mass estimation. We show that our method reduces the critical surface mass density $\Sigma_{\rm crit}$ modelling bias on the 60-70% level, while maintaining up to 90% of galaxies. We highlight that our methodology has applications beyond cluster mass estimation as an approach to jointly combine galaxy selection and model inference under sources of systematics.


title: Excitonic topology and quantum geometry in organic semiconductors

abstract: Excitons drive the optoelectronic properties of organic semiconductors which underpin devices including solar cells and light-emitting diodes. We demonstrate that excitons can exhibit topologically non-trivial states and identify a family of organic semiconductors exhibiting the predicted excitonic topological phases. We also show that the topological phase can be controlled through chemical functionalisation and through the dielectric environment of the material. Appealing to quantum Riemannian geometry, we predict that topologically non-trivial excitons have a lower bound on their centre-of-mass spatial spread, which can significantly exceed the size of a unit cell. The discovery of excitonic topology and excitonic Riemannian geometry in organic materials brings together two mature fields and suggests many new possibilities for a range of future optoelectronic applications.

categories: cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.quant-gas cond-mat.str-el cond-mat.supr-con


title: Solitons with irrational charge in a one-dimensional quantum ferroelectric

abstract: We use analytic (mean-field) and density-matrix renormalization group (DMRG) methods to study a simplified one-dimensional version of the SSH-Holstein model of electron-phonon interactions with one electron per site (half filling) where, as a function of the ratio of the two couplings, three distinct insulating phases arise - a site-centered charge-density-wave (CDW), a bond-centered bond-density-wave (BDW), and an intermediate ferroelectric (inversion-symmetry breaking) phase with coexisting CDW and BDW order. In the intermediate phase our DMRG results establish the existence of point-like soliton excitations with irrational charge (that depends on a ratio of coupling constants) and either spin 1/2 or spin 0, and a surprisingly light effective mass.


title: Intrinsic high-fidelity spin polarization of charged vacancies in hexagonal boron nitride

abstract: The negatively charged boron vacancy ($\mathrm{V}_{\mathrm{B}}^-$) in hexagonal boron nitride (hBN) has garnered significant attention among defects in two-dimensional materials. This owes, in part, to its deterministic generation, well-characterized atomic structure, and optical polarizability at room temperature. We investigate the latter through extensive measurements probing both the ground and excited state polarization dynamics. We develop a semiclassical model based on these measurements that predicts a near-unity degree of spin polarization, surpassing other solid-state spin defects under ambient conditions. Building upon our model, we include the presence of nuclear spin degrees of freedom adjacent to the $\mathrm{V}_{\mathrm{B}}^-$ and perform a comprehensive set of Lindbladian numerics to investigate the hyperfine-induced polarization of the nuclear spins. Our simulations predict a number of important features that emerge as a function of magnetic field which are borne out by experiment.


title: Spatial and Spectral Characterization of the Gravitational-wave Background with the PTA Optimal Statistic

abstract: Pulsar timing arrays (PTAs) have made tremendous progress and are now showing strong evidence for the gravitational-wave background (GWB). Further probing the origin and characteristics of the GWB will require more generalized analysis techniques. Bayesian methods are most often used but can be computationally expensive. On the other hand, frequentist methods, like the PTA Optimal Statistic (OS), are more computationally efficient and can produce results that are complementary to Bayesian methods, allowing for stronger statistical cases to be built from a confluence of different approaches. In this work we expand the capabilities of the OS through a technique we call the Per-Frequency Optimal Statistic (PFOS). The PFOS removes the underlying power-law assumption inherent in previous implementations of the OS, and allows one to estimate the GWB spectrum in a frequency-by-frequency manner. We have also adapted a recent generalization from the OS pipeline into the PFOS, making it capable of accurately characterizing the spectrum in the intermediate and strong GW signal regimes using only a small fraction of the necessary computational resources when compared with fully-correlated Bayesian methods, while also empowering many new types of analyses not possible before. We find that even in the strong GW signal regime, where the GWB dominates over noise in all frequencies, the injected value of the signal lies within the 50th-percentile of the PFOS uncertainty distribution in 41-45% of simulations, remaining 3$\sigma$-consistent with unbiased estimation.


title: Edge Spin fractionalization in one-dimensional spin-$S$ quantum antiferromagnets

abstract: We argue that the anisotropic quantum spin chain with spin $S$ (XXZ$-S$) exhibits exponentially localized fractional $\pm \frac{S}{2}$ edge modes in the gapped antiferromagnetic phase of the model. Moreover, we claim that this phenomenon is very general and exists in any $U(1)$ symmetric spin chain in its gapped antiferromagnetic regime with explicitly or spontaneously broken $\mathbb Z_2$ symmetry. We examine our argument for integrable and non integrable chains. By using the Bethe Ansatz method, we show that $XXZ-\frac{1}{2}$ and a $XXZ-1$ integrable chains have $\pm \frac{S}{2}$ fractionalized edge modes. Employing the density matrix renormalization group technique, we extend this analysis to {\it generic} XXZ-$S$ chains with $S\leq 3$ and demonstrate that these fractional spins emerge as robust quantum observables, substantiated by the observation of a variance of the associated fractional spin operators that is consistent with a vanishing functional form in the thermodynamic limit. Moreover, we find that the edge modes are robust to disorder that couples to the N\'eel order parameter.

categories: cond-mat.str-el cond-mat.stat-mech math-ph math.MP


title: Weyl-invariant Einstein-Cartan gravity: unifying the strong CP and hierarchy puzzles

abstract: We show that the minimal Weyl-invariant Einstein-Cartan gravity in combination with the Standard Model of particle physics contains just one extra scalar degree of freedom (in addition to the graviton and the Standard Model fields) with the properties of an axion-like particle which can solve the strong CP-problem. The smallness of this particle's mass as well as of the cosmological constant is ensured by tiny values of the gauge coupling constants of the local Lorentz group. The tree value of the Higgs boson mass and that of Majorana leptons (if added to the Standard Model to solve the neutrino mass, baryogenesis and dark matter problems) are very small or vanishing, opening the possibility of their computability in terms of the fundamental parameters of the theory due to nonperturbative effects.


title: Linear response theory for cavity QED materials

abstract: We present a rigorous framework for linear response theory in cavity QED materials. Our approach leverages the collective coupling between light and matter, drawing parallels with large-N theories in quantum field theory. We derive closed formulas for various responses of both the cavity and the matter. Our theory is validated by recovering established results for the Dicke model and the Quantum Hall Effect. Additionally, we discover novel excitations in quantum magnets, where the cavity binds magnon pairs into localized states.


title: Constraining modified gravity with weak lensing peaks

abstract: It is well established that maximizing the information extracted from upcoming and ongoing stage-IV weak-lensing surveys requires higher-order summary statistics that complement the standard two-point statistics. In this work, we focus on weak-lensing peak statistics to test two popular modified gravity models, $f(R)$ and nDGP, using the FORGE and BRIDGE weak-lensing simulations, respectively. From these simulations we measure the peak statistics as a function of both cosmological and modified gravity parameters simultaneously. Our findings indicate that the peak abundance is sensitive to the strength of modified gravity, while the peak two-point correlation function is sensitive to the nature of the screening mechanism in a modified gravity model. We combine these simulated statistics with a Gaussian Process Regression emulator and a Gaussian likelihood to generate stage-IV forecast posterior distributions for the modified gravity models. We demonstrate that, in a systematics-free case, peak statistics can constrain $\log_{10}(f_{R0}) = -6$ to 2% precision, and $\log_{10}(H_0 r_c) = 0.5$ to 25% precision. Finally, we find that our weakest models, $\log_{10}(f_{R0})$ < 6.17 and $\log_{10}(H_0 r_c)$ > 1, can be ruled out at the two sigma level with an area of $300 \rm{deg}^2$ and $1000 \rm{deg}^2$, respectively, with the upcoming stage-IV data.


title: Stripping Quantum Decision Diagrams of their Identity

abstract: Classical representations of quantum states and operations as vectors and matrices are plagued by an exponential growth in memory and runtime requirements for increasing system sizes. Based on their use in classical computing, an alternative data structure known as Decision Diagrams (DDs) has been proposed, which, in many cases, provides both a more compact representation and more efficient computation. In the classical realm, decades of research have been conducted on DDs and numerous variations tailored for specific applications exist. However, DDs for quantum computing are just in their infancy and there is still room for tailoring them to this new technology. In particular, existing representations of DDs require extending all operations in a quantum circuit to the full system size through extension by nodes representing identity matrices. In this work, we make an important step forward for quantum DDs by stripping these identity structures from quantum operations. This significantly reduces the number of nodes required to represent them as well as eases the pressure on key building blocks of their implementation. As a result, we obtain a structure that is more natural for quantum computing and significantly speeds up with computations-with a runtime improvement of up to 70x compared to the state-of-the-art.


title: Exploring the fate of primordial discs in Milky Way-sized galaxies with the GigaEris simulation

abstract: Recent observations with JWST and ALMA have unveiled galaxies with regular discs at significantly higher redshifts than previously expected. This appears to be in contrast with constraints on the stellar populations of the Milky Way, suggesting that the bulk of the Galactic thin disc formed after $z=1$, and raises questions about the history, evolution, and survivability of primordial discs. Here, we use GigaEris, a state-of-the-art $N$-body, hydrodynamical, cosmological ``zoom-in'' simulation with a billion particles within the virial radius, to delve into the formation of the early kinematically cold discs (KCDs), defined by their ratio between the mean rotational velocity and the radial velocity dispersion, of a Milky Way-sized galaxy at redshifts $z\gtrsim 4$. Our analysis reveals a primarily inward migration pattern for disc stars formed at $z \gtrsim 6$, turning into a mix of inward and outward migration at later times. Stars migrating outwards undergo minimal kinematic heating, and might be identified as part of the thin disc forming at much later epochs. We find that approximately 76 per cent of all stars formed in the KCD at $z \sim 7$ become part of a pseudo-bulge by $z = 4.4$. This proportion decreases to below 10 per cent for KCD stars formed at $z \lesssim 5$. The inward migration of stars born in our KCDs at $z \gtrsim 4$ deviates from the expected inside-out formation scenario of thin discs at lower redshifts. Our results suggest a novel ``two-phase'' disc formation process, whereby the early disc transforms primarily into the pseudo-bulge within less than a billion years, whereas the present-day disc forms subsequently from higher-angular momentum material accreted at later times.


title: Elaborating Higgs to dimuon decay from gluon fusion by decorrelation and jet substructure

abstract: Discovery of the Higgs boson decay to dimuon is anticipated soon based on the current evidence. Precise categorization of the events without affecting the invariant mass shape is crucial in the analysis. Decorrelation of the invariant mass and the output of discriminators (the score of discriminators) is essential for consistent and precise analysis. In this paper we use distance correlation as the additional loss function to achieve the decorrelation for discriminators and examine various analysis methods. The analyses with and without jet substructure variables are presented. Adding jet substructure variables considerably improves the significance of the Higgs to dimuon signal from gluon fusion.