title: Discrete Neural Algorithmic Reasoning

abstract: Neural algorithmic reasoning aims to capture computations with neural networks via learning the models to imitate the execution of classical algorithms. While common architectures are expressive enough to contain the correct model in the weights space, current neural reasoners are struggling to generalize well on out-of-distribution data. On the other hand, classical computations are not affected by distribution shifts as they can be described as transitions between discrete computational states. In this work, we propose to force neural reasoners to maintain the execution trajectory as a combination of finite predefined states. Trained with supervision on the algorithm's state transitions, such models are able to perfectly align with the original algorithm. To show this, we evaluate our approach on the SALSA-CLRS benchmark, where we get perfect test scores for all tasks. Moreover, the proposed architectural choice allows us to prove the correctness of the learned algorithms for any test data.


title: Criteria for nilpotency of fusion systems

abstract: Let $p$ be an odd prime and let $\mathcal{F}$ be a fusion system over a finite $p$-group $P$. A fusion system $\mathcal{F}$ is said to be nilpotent if $\mathcal{F}=\mathcal{F}_{P}(P)$. In this paper we provide new criteria for saturated fusion systems $\mathcal{F}$ to be nilpotent, which can be viewed as extension of the $p$-nilpotency theorem of Glauberman and Thompson for fusion systems attributed to Kessar and Linckelmann.


title: Towards Distributed and Intelligent Integrated Sensing and Communications for 6G Networks

abstract: This paper introduces the distributed and intelligent integrated sensing and communications (DISAC) concept, a transformative approach for 6G wireless networks that extends the emerging concept of integrated sensing and communications (ISAC). DISAC addresses the limitations of the existing ISAC models and, to overcome them, it introduces two novel foundational functionalities for both sensing and communications: a distributed architecture and a semantic and goal-oriented framework. The distributed architecture enables large-scale and energy-efficient tracking of connected users and objects, leveraging the fusion of heterogeneous sensors. The semantic and goal-oriented intelligent and parsimonious framework, enables the transition from classical data fusion to the composition of semantically selected information, offering new paradigms for the optimization of resource utilization and exceptional multi-modal sensing performance across various use cases. This paper details DISAC's principles, architecture, and potential applications.


title: Neuromorphic Face Analysis: a Survey

abstract: Neuromorphic sensors, also known as event cameras, are a class of imaging devices mimicking the function of biological visual systems. Unlike traditional frame-based cameras, which capture fixed images at discrete intervals, neuromorphic sensors continuously generate events that represent changes in light intensity or motion in the visual field with high temporal resolution and low latency. These properties have proven to be interesting in modeling human faces, both from an effectiveness and a privacy-preserving point of view. Neuromorphic face analysis however is still a raw and unstructured field of research, with several attempts at addressing different tasks with no clear standard or benchmark. This survey paper presents a comprehensive overview of capabilities, challenges and emerging applications in the domain of neuromorphic face analysis, to outline promising directions and open issues. After discussing the fundamental working principles of neuromorphic vision and presenting an in-depth overview of the related research, we explore the current state of available data, standard data representations, emerging challenges, and limitations that require further investigation. This paper aims to highlight the recent process in this evolving field to provide to both experienced and newly come researchers an all-encompassing analysis of the state of the art along with its problems and shortcomings.


title: Reliable long timescale decision-directed channel estimation for OFDM system

abstract: Decision-directed channel estimation (DDCE) is one kind of blind channel estimation method that tracks the channel blindly by an iterative algorithm without relying on the pilots, which can increase the utilization of wireless resource. However, one major problem of DDCE is the performance degradation caused by error accumulation during the tracking process. In this paper, we propose an reliable DDCE (RDDCE) scheme for an OFDM-based communication system in the time-varying deep fading environment. By combining the conventional DDCE and discrete Fourier transform (DFT) channel estimation method, the proposed RDDCE scheme selects the reliable estimated channels on the subcarriers which are less affected by deep fading, and then estimates the channel based on the selected subcarriers by an extended DFT channel estimation where the indices of selected subcarriers are not distributed evenly. Simulation results show that RRDCE can alleviate the performance degradation effectively, track the channel with high accuracy on a long time scale, and has good performance under time-varying and noisy channel conditions.


title: Self-seeding and Multi-intent Self-instructing LLMs for Generating Intent-aware Information-Seeking dialogs

abstract: Identifying user intents in information-seeking dialogs is crucial for a system to meet user's information needs. Intent prediction (IP) is challenging and demands sufficient dialogs with human-labeled intents for training. However, manually annotating intents is resource-intensive. While large language models (LLMs) have been shown to be effective in generating synthetic data, there is no study on using LLMs to generate intent-aware information-seeking dialogs. In this paper, we focus on leveraging LLMs for zero-shot generation of large-scale, open-domain, and intent-aware information-seeking dialogs. We propose SOLID, which has novel self-seeding and multi-intent self-instructing schemes. The former improves the generation quality by using the LLM's own knowledge scope to initiate dialog generation; the latter prompts the LLM to generate utterances sequentially, and mitigates the need for manual prompt design by asking the LLM to autonomously adapt its prompt instruction when generating complex multi-intent utterances. Furthermore, we propose SOLID-RL, which is further trained to generate a dialog in one step on the data generated by SOLID. We propose a length-based quality estimation mechanism to assign varying weights to SOLID-generated dialogs based on their quality during the training process of SOLID-RL. We use SOLID and SOLID-RL to generate more than 300k intent-aware dialogs, surpassing the size of existing datasets. Experiments show that IP methods trained on dialogs generated by SOLID and SOLID-RL achieve better IP quality than ones trained on human-generated dialogs.


title: Non-equilibrium pathways to emergent polar supertextures

abstract: Ultrafast stimuli can stabilize metastable states of matter inaccessible by equilibrium means. Establishing the spatiotemporal link between ultrafast excitation and metastability is crucial to understanding these phenomena. Here, we use single-shot optical-pump, X-ray-probe measurements to provide snapshots of the emergence of a persistent polar vortex supercrystal in a heterostructure that hosts a fine balance between built-in electrostatic and elastic frustrations by design. By perturbing this balance with photoinduced charges, a starting heterogenous mixture of polar phases disorders within a few picoseconds, resulting in a soup state composed of disordered ferroelectric and suppressed vortex orders. On the pico-to-nanosecond timescales, transient labyrinthine fluctuations form in this soup along with a recovering vortex order. On longer timescales, these fluctuations are progressively quenched by dynamical strain modulations, which drive the collective emergence of a single supercrystal phase. Our results, corroborated by dynamical phase-field modeling, reveal how ultrafast excitation of designer systems generates pathways for persistent metastability.


title: Tool-Augmented LLMs as a Universal Interface for IDEs

abstract: Modern-day Integrated Development Environments (IDEs) have come a long way from the early text editing utilities to the complex programs encompassing thousands of functions to help developers. However, with the increasing number of efficiency-enhancing tools incorporated, IDEs gradually became sophisticated software with a steep learning curve. The rise of the Large Language Models (LLMs) capable of both natural language dialogue and code generation leads to a discourse on the obsolescence of the concept of IDE. In this work, we offer a view on the place of the LLMs in the IDEs as the universal interface wrapping the IDE facilities. We envision a model that is able to perform complex actions involving multiple IDE features upon user command, stripping the user experience of the tedious work involved in searching through options and actions. For the practical part of the work, we engage with the works exploring the ability of LLMs to call for external tools to expedite a given task execution. We showcase a proof-of-concept of such a tool.


title: Untangling Strongly and Weakly Interacting Configurations in Many-electron Wave Functions

abstract: Accurate solution of the many-electron problem including correlations remains intractable except for few-electron systems. Describing interacting electrons as a superposition of independent electron configurations results in an apparent combinatorial scaling to achieve an accurate solution. Many approximate approaches for large systems have been introduced, yet controlling and quantifying the error remains a significant hurdle for comparison to experiment. Perturbation calculations are a popular means to estimate neglected energy contributions but give rise to two unanswered questions. How to select a reference state ensuring perturbation corrections will be well-behaved? What is the residual error relative to the exact solution? Conditions to specify these two elusive requisites are given by introducing a partitioning of the electronic configurations into reference and interaction spaces with sampling of neglected configurations using renormalization group ideas. This approach is applied to the molecular (non-relativistic Coulomb) Hamiltonian to identify continuous phase transitions in the energy as a function of the number of configurations. Identification of the minimum number of reference configurations such that the neglected space consists primarily of independent energy contributions is achieved. Balancing the magnitude of the neglected contributions between two calculation enables prediction of accurate physical properties for which calculations would otherwise not be achievable using an expansion consisting of a full set of configurations. Consistent with the use of the molecular Hamiltonian, the analysis is valid for any finite fermion system described by a Hamiltonian consisting of one- and two-body operators.


title: Poisoning Federated Recommender Systems with Fake Users

abstract: Federated recommendation is a prominent use case within federated learning, yet it remains susceptible to various attacks, from user to server-side vulnerabilities. Poisoning attacks are particularly notable among user-side attacks, as participants upload malicious model updates to deceive the global model, often intending to promote or demote specific targeted items. This study investigates strategies for executing promotion attacks in federated recommender systems. Current poisoning attacks on federated recommender systems often rely on additional information, such as the local training data of genuine users or item popularity. However, such information is challenging for the potential attacker to obtain. Thus, there is a need to develop an attack that requires no extra information apart from item embeddings obtained from the server. In this paper, we introduce a novel fake user based poisoning attack named PoisonFRS to promote the attacker-chosen targeted item in federated recommender systems without requiring knowledge about user-item rating data, user attributes, or the aggregation rule used by the server. Extensive experiments on multiple real-world datasets demonstrate that PoisonFRS can effectively promote the attacker-chosen targeted item to a large portion of genuine users and outperform current benchmarks that rely on additional information about the system. We further observe that the model updates from both genuine and fake users are indistinguishable within the latent space.


title: Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attacks

abstract: The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under realistic scenarios. We comprehensively study the robustness of popular machine-generated text detectors under attacks from diverse categories: editing, paraphrasing, prompting, and co-generating. Our attacks assume limited access to the generator LLMs, and we compare the performance of detectors on different attacks under different budget levels. Our experiments reveal that almost none of the existing detectors remain robust under all the attacks, and all detectors exhibit different loopholes. Averaging all detectors, the performance drops by 35% across all attacks. Further, we investigate the reasons behind these defects and propose initial out-of-the-box patches to improve robustness.


title: In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness

abstract: A striking property of transformers is their ability to perform in-context learning (ICL), a machine learning framework in which the learner is presented with a novel context during inference implicitly through some data, and tasked with making a prediction in that context. As such, that learner must adapt to the context without additional training. We explore the role of softmax attention in an ICL setting where each context encodes a regression task. We show that an attention unit learns a window that it uses to implement a nearest-neighbors predictor adapted to the landscape of the pretraining tasks. Specifically, we show that this window widens with decreasing Lipschitzness and increasing label noise in the pretraining tasks. We also show that on low-rank, linear problems, the attention unit learns to project onto the appropriate subspace before inference. Further, we show that this adaptivity relies crucially on the softmax activation and thus cannot be replicated by the linear activation often studied in prior theoretical analyses.


title: Protocols for Observational Studies: An Application to Regression Discontinuity Designs

abstract: In his 2022 IMS Medallion Lecture delivered at the Joint Statistical Meetings, Prof. Dylan S. Small eloquently advocated for the use of protocols in observational studies. We discuss his proposal and, inspired by his ideas, we develop a protocol for the regression discontinuity design.


title: Towards Versatile Graph Learning Approach: from the Perspective of Large Language Models

abstract: Graph-structured data are the commonly used and have wide application scenarios in the real world. For these diverse applications, the vast variety of learning tasks, graph domains, and complex graph learning procedures present challenges for human experts when designing versatile graph learning approaches. Facing these challenges, large language models (LLMs) offer a potential solution due to the extensive knowledge and the human-like intelligence. This paper proposes a novel conceptual prototype for designing versatile graph learning methods with LLMs, with a particular focus on the "where" and "how" perspectives. From the "where" perspective, we summarize four key graph learning procedures, including task definition, graph data feature engineering, model selection and optimization, deployment and serving. We then explore the application scenarios of LLMs in these procedures across a wider spectrum. In the "how" perspective, we align the abilities of LLMs with the requirements of each procedure. Finally, we point out the promising directions that could better leverage the strength of LLMs towards versatile graph learning methods.


title: A quantitative DiPerna-Lions theory and exponential mixing rate for passive scalar transport

abstract: We consider the transport of a passive scalar $f\in\mathbb{R}$ along a divergence-free velocity vector field $u\in\mathbb{R}^d$ on the infinite space $\mathbb{R}^d$. We give a quantitative version of the DiPerna-Lions well-posedness theory for Sobolev vector fields $u \in L_t^1W_x^{1,p}$ when $1<p<\infty$ by giving a uniform decay rate of the DiPerna-Lions commutator. We recover a slightly more general form of the known exponential bound on the mixing rate by a Sobolev vector field $u \in L_t^1W_x^{1,p}$ when $1<p<\infty$.


title: Math goes to Hollywood: Stereotypen in Filmen und Serien dekodieren

abstract: Stereotype Vorstellungen von Mathematik und Mathematiker*innen beeinflussen das Interesse von Jugendlichen an MINT-F\"achern. Daher pl\"adiert dieser Beitrag daf\"ur, popul\"are Filme und erfolgreiche Serien nicht nur im Fremdsprachenunterricht, sondern auch im Mathematikunterricht einzusetzen. Durch die Analyse audiovisueller Medien im Unterricht k\"onnen verzerrte Darstellungen \"uber Mathematiker*innen erkannt, die Gr\"unde daf\"ur benannt und alternative Sichtweisen entwickelt werden. Dies tr\"agt dazu bei, das Bild der Mathematik zu entmystifizieren und den Spa{\ss} an Mathe und Englisch zu f\"ordern. Die Einbindung sozialwissenschaftlicher Themen steigert zudem die Motivation der Sch\"uler*innen.


title: Grothendieck's theory of fibred categories for monoids

abstract: The aim of this paper is to interpret the Grothendieck construction in the monoidal world. That is to say, we restrict the equivalence between fibred categories and pseudo functors to the case of categories having only a single object. On other way of expressing this is to say that we are given a monoid homomorphism. Though only a specialisation, we discover many pleasant results and interpret many things in a new light. We also touch upon the case of finite groups as an example.


title: Quantum Image Denoising with Machine Learning: A Novel Approach to Improve Quantum Image Processing Quality and Reliability

abstract: Quantum Image Processing (QIP) is a field that aims to utilize the benefits of quantum computing for manipulating and analyzing images. However, QIP faces two challenges: the limitation of qubits and the presence of noise in a quantum machine. In this research we propose a novel approach to address the issue of noise in QIP. By training and employing a machine learning model that identifies and corrects the noise in quantum processed images, we can compensate for the noisiness caused by the machine and retrieve a processing result similar to that performed by a classical computer with higher efficiency. The model is trained by learning a dataset consisting of both existing processed images and quantum processed images from open access datasets. This model will be capable of providing us with the confidence level for each pixel and its potential original value. To assess the model's accuracy in compensating for loss and decoherence in QIP, we evaluate it using three metrics: Peak Signal to Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Mean Opinion Score (MOS). Additionally, we discuss the applicability of our model across domains well as its cost effectiveness compared to alternative methods.


title: Computational Kerr-Ellipsometry: Quantifying Broadband Optical Nonreciprocity of Magneto-Optic Materials

abstract: Characterizing the optical response of magneto-optic and magnetic materials usually relies on semi-classical models (e.g. Lorentz oscillator model) involving few parameters or models based on a detailed quantum mechanical description of the underlying response. These models typically involve a few parameters that are estimated via fitting the experimental data to provide a qualitative understanding of the underlying physics. Such a few-parameters fitting approach falls short of accurately capturing all elements of the complex-valued permittivity tensor across a range of wavelengths. Accurate characterization of the permittivity tensor elements across a broad range of wavelengths is invariably imperative for designing optical elements such as isolators, circulators, etc. Here, we propose and demonstrate a ubiquitous and accessible method based on a combination of spectroscopic ellipsometry and spectroscopic Magneto-Optic Kerr Effect (MOKE) measurements coupled with rigorous numerical parameter extraction techniques. To this end, we use the combined MOKE ellipsometry measurements conducted at different angles of incidence with a gradient-descent minimization algorithm to provide the inverse solution to the complete dielectric permittivity tensor. Further, we demonstrate model re-verification to ensure the estimated dielectric permittivity values reliably predict the measured experimental data. Our method is a simplified bench-top counterpart to the otherwise complex measurement systems.


title: Spectral Independence Beyond Uniqueness with. the topological method -- An extended view

abstract: We present novel results for fast mixing of Glauber dynamics using the newly introduced and powerful Spectral Independence method from [Anari, Liu, Oveis-Gharan: FOCS 2020]. We mainly focus on the Hard-core model and the Ising model. We obtain bounds for fast mixing with the parameters expressed in terms of the spectral radius of the adjacency matrix, improving on the seminal work in [Hayes: FOCS 2006]. Furthermore, we go beyond the adjacency matrix and establish -- for the first time -- rapid mixing results for Glauber dynamics expressed in terms of the spectral radius of the Hashimoto non-backtracking matrix of the underlying graph $G$. Working with the non-backtracking spectrum is extremely challenging, but also more desirable. Its eigenvalues are less correlated with the high-degree vertices than those of the adjacency matrix and express more accurately invariants of the graph such as the growth rate. Our results require ``weak normality" from the Hashimoto matrix. This condition is mild and allows us to obtain very interesting bound. We study the pairwise influence matrix ${I}^{\Lambda,\tau}_{G}$ by exploiting the connection between the matrix and the trees of self-avoiding walks, however, we go beyond the standard treatment of the distributional recursions. The common framework that underlies our techniques we call the topological method. Our approach is novel and gives new insights into how to establish Spectral Independence for Gibbs distributions. More importantly, it allows us to derive new -- improved -- rapid mixing bounds for Glauber dynamics on distributions such as the Hard-core model and the Ising model for graphs that the spectral radius is smaller than the maximum degree.


title: Iterative Linear Quadratic Regulator With Variational Equation-Based Discretization

abstract: This paper discusses discretization methods for implementing nonlinear model predictive controllers using Iterative Linear Quadratic Regulator (ILQR). Finite-difference approximations are mostly used to derive a discrete-time state equation from the original continuous-time model. However, the timestep of the discretization is sometimes restricted to be small to suppress the approximation error. In this paper, we propose to use the variational equation for deriving linearizations of the discretized system required in ILQR algorithms, which allows accurate computation regardless of the timestep. Numerical simulations of the swing-up control of an inverted pendulum demonstrate the effectiveness of this method. By the relaxing stringent requirement for the size of the timestep, the use of the variational equation can improve control performance by increasing the number of ILQR iterations possible at each timestep in the realtime computation.


title: Electric field tunable superconductivity with competing orders in near magic-angle twisted bilayer graphene

abstract: Superconductivity (SC) in twisted bilayer graphene (tBLG) has been explored by varying carrier concentrations, twist angles, and screening strength, with the aim of uncovering its origin and possible connections to strong electronic correlations in narrow bands and various resulting broken symmetries. However, the link between the tBLG band structure and the onset of SC and other orders largely remains unclear. In this study, we address this crucial gap by examining in-situ band structure tuning of a near magic-angle ($\theta \approx0.95^0$) tBLG device with displacement field ($D$) and reveal remarkable competition between SC and other broken symmetries. At zero $D$, the device exhibits superconducting signatures without the resistance peak at half-filling, a characteristic signature with a strong electronic correlation. As $D$ increases, the SC is suppressed, accompanied by the appearance of a resistance peak at half-filling. Hall density measurements reveal that at zero $D$, SC arises around the van Hove singularity (vHs) from an isospin or spin-valley unpolarized band. At higher $D$, the suppression of SC coincides with broken isospin symmetry near half-filling with lifted degeneracy ($g_d \sim 2$). Additionally, when SC is suppressed at higher $D$, density waves around the superconducting dome are seen. These findings, with our theoretical calculations, highlight the competition between SC and other orders, and the stabilization of the latter by the electric field enhanced nesting in the band structure of tBLG.


title: Theoretical foundations for programmatic reinforcement learning

abstract: The field of Reinforcement Learning (RL) is concerned with algorithms for learning optimal policies in unknown stochastic environments. Programmatic RL studies representations of policies as programs, meaning involving higher order constructs such as control loops. Despite attracting a lot of attention at the intersection of the machine learning and formal methods communities, very little is known on the theoretical front about programmatic RL: what are good classes of programmatic policies? How large are optimal programmatic policies? How can we learn them? The goal of this paper is to give first answers to these questions, initiating a theoretical study of programmatic RL.


title: Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agents

abstract: Large language models (LLMs) have achieved success in acting as agents, which interact with environments through tools such as search engines. However, LLMs are optimized for language generation instead of tool use during training or alignment, limiting their effectiveness as agents. To resolve this problem, previous work has first collected interaction trajectories between LLMs and environments, using only trajectories that successfully finished the task to fine-tune smaller models, making fine-tuning data scarce and acquiring it both difficult and costly. Discarding failed trajectories also leads to significant wastage of data and resources and limits the possible optimization paths during fine-tuning. In this paper, we argue that unsuccessful trajectories offer valuable insights, and LLMs can learn from these trajectories through appropriate quality control and fine-tuning strategies. By simply adding a prefix or suffix that tells the model whether to generate a successful trajectory during training, we improve model performance by a large margin on mathematical reasoning, multi-hop question answering, and strategic question answering tasks. We further analyze the inference results and find that our method provides a better trade-off between valuable information and errors in unsuccessful trajectories. To our knowledge, we are the first to demonstrate the value of negative trajectories and their application in agent-tunning scenarios. Our findings offer guidance for developing better agent-tuning methods and low-resource data usage techniques.


title: Doubly Robust Inference in Causal Latent Factor Models

abstract: This article introduces a new estimator of average treatment effects under unobserved confounding in modern data-rich environments featuring large numbers of units and outcomes. The proposed estimator is doubly robust, combining outcome imputation, inverse probability weighting, and a novel cross-fitting procedure for matrix completion. We derive finite-sample and asymptotic guarantees, and show that the error of the new estimator converges to a mean-zero Gaussian distribution at a parametric rate. Simulation results demonstrate the practical relevance of the formal properties of the estimators analyzed in this article.


title: Combinatorial Client-Master Multiagent Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing

abstract: Recently, there has been an explosion of mobile applications that perform computationally intensive tasks such as video streaming, data mining, virtual reality, augmented reality, image processing, video processing, face recognition, and online gaming. However, user devices (UDs), such as tablets and smartphones, have a limited ability to perform the computation needs of the tasks. Mobile edge computing (MEC) has emerged as a promising technology to meet the increasing computing demands of UDs. Task offloading in MEC is a strategy that meets the demands of UDs by distributing tasks between UDs and MEC servers. Deep reinforcement learning (DRL) is gaining attention in task-offloading problems because it can adapt to dynamic changes and minimize online computational complexity. However, the various types of continuous and discrete resource constraints on UDs and MEC servers pose challenges to the design of an efficient DRL-based task-offloading strategy. Existing DRL-based task-offloading algorithms focus on the constraints of the UDs, assuming the availability of enough storage resources on the server. Moreover, existing multiagent DRL (MADRL)--based task-offloading algorithms are homogeneous agents and consider homogeneous constraints as a penalty in their reward function. We proposed a novel combinatorial client-master MADRL (CCM\_MADRL) algorithm for task offloading in MEC (CCM\_MADRL\_MEC) that enables UDs to decide their resource requirements and the server to make a combinatorial decision based on the requirements of the UDs. CCM\_MADRL\_MEC is the first MADRL in task offloading to consider server storage capacity in addition to the constraints in the UDs. By taking advantage of the combinatorial action selection, CCM\_MADRL\_MEC has shown superior convergence over existing MADDPG and heuristic algorithms.


title: Model-Free $\mu$-Synthesis: A Nonsmooth Optimization Perspective

abstract: In this paper, we revisit model-free policy search on an important robust control benchmark, namely $\mu$-synthesis. In the general output-feedback setting, there do not exist convex formulations for this problem, and hence global optimality guarantees are not expected. Apkarian (2011) presented a nonconvex nonsmooth policy optimization approach for this problem, and achieved state-of-the-art design results via using subgradient-based policy search algorithms which generate update directions in a model-based manner. Despite the lack of convexity and global optimality guarantees, these subgradient-based policy search methods have led to impressive numerical results in practice. Built upon such a policy optimization persepctive, our paper extends these subgradient-based search methods to a model-free setting. Specifically, we examine the effectiveness of two model-free policy optimization strategies: the model-free non-derivative sampling method and the zeroth-order policy search with uniform smoothing. We performed an extensive numerical study to demonstrate that both methods consistently replicate the design outcomes achieved by their model-based counterparts. Additionally, we provide some theoretical justifications showing that convergence guarantees to stationary points can be established for our model-free $\mu$-synthesis under some assumptions related to the coerciveness of the cost function. Overall, our results demonstrate that derivative-free policy optimization offers a competitive and viable approach for solving general output-feedback $\mu$-synthesis problems in the model-free setting.


title: Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactuals

abstract: Interpretability research aims to bridge the gap between empirical success and our scientific understanding of the inner workings of large language models (LLMs). However, most existing research focuses on analyzing a single mechanism, such as how models copy or recall factual knowledge. In this work, we propose a formulation of competition of mechanisms, which focuses on the interplay of multiple mechanisms instead of individual mechanisms and traces how one of them becomes dominant in the final prediction. We uncover how and where mechanisms compete within LLMs using two interpretability methods: logit inspection and attention modification. Our findings show traces of the mechanisms and their competition across various model components and reveal attention positions that effectively control the strength of certain mechanisms. Code: https://github.com/francescortu/comp-mech. Data: https://huggingface.co/datasets/francescortu/comp-mech.


title: Integrating Pre-Trained Language Model with Physical Layer Communications

abstract: The burgeoning field of on-device AI communication, where devices exchange information directly through embedded foundation models, such as language models (LMs), requires robust, efficient, and generalizable communication frameworks. However, integrating these frameworks with existing wireless systems and effectively managing noise and bit errors pose significant challenges. In this work, we introduce a practical on-device AI communication framework, integrated with physical layer (PHY) communication functions, demonstrated through its performance on a link-level simulator. Our framework incorporates end-to-end training with channel noise to enhance resilience, incorporates vector quantized variational autoencoders (VQ-VAE) for efficient and robust communication, and utilizes pre-trained encoder-decoder transformers for improved generalization capabilities. Simulations, across various communication scenarios, reveal that our framework achieves a 50% reduction in transmission size while demonstrating substantial generalization ability and noise robustness under standardized 3GPP channel models.


title: On the importance of assessing topological convergence in Bayesian phylogenetic inference

abstract: Modern phylogenetics research is often performed within a Bayesian framework, using sampling algorithms such as Markov chain Monte Carlo (MCMC) to approximate the posterior distribution. These algorithms require careful evaluation of the quality of the generated samples. Within the field of phylogenetics, one frequently adopted diagnostic approach is to evaluate the effective sample size (ESS) and to investigate trace graphs of the sampled parameters. A major limitation of these approaches is that they are developed for continuous parameters and therefore incompatible with a crucial parameter in these inferences: the tree topology. Several recent advancements have aimed at extending these diagnostics to topological space. In this short reflection paper, we present a case study illustrating how these topological diagnostics can contain information not found in standard diagnostics, and how decisions regarding which of these diagnostics to compute can impact inferences regarding MCMC convergence and mixing. Given the major importance of detecting convergence and mixing issues in Bayesian phylogenetic analyses, the lack of a unified approach to this problem warrants further action, especially now that additional tools are becoming available to researchers.


title: Dynamic planning in hierarchical active inference

abstract: By dynamic planning, we refer to the ability of the human brain to infer and impose motor trajectories related to cognitive decisions. A recent paradigm, active inference, brings fundamental insights into the adaptation of biological organisms, constantly striving to minimize prediction errors to restrict themselves to life-compatible states. Over the past years, many studies have shown how human and animal behavior could be explained in terms of an active inferential process -- either as discrete decision-making or continuous motor control -- inspiring innovative solutions in robotics and artificial intelligence. Still, the literature lacks a comprehensive outlook on how to effectively plan actions in changing environments. Setting ourselves the goal of modeling tool use, we delve into the topic of dynamic planning in active inference, keeping in mind two crucial aspects of biological goal-directed behavior: the capacity to understand and exploit affordances for object manipulation, and to learn the hierarchical interactions between the self and the environment, including other agents. We start from a simple unit and gradually describe more advanced structures, comparing recently proposed design choices and providing basic examples for each section. This study distances itself from traditional views centered on neural networks and reinforcement learning, and points toward a yet unexplored direction in active inference: hybrid representations in hierarchical models.


title: Credible causal inference beyond toy models

abstract: Causal inference with observational data critically relies on untestable and extra-statistical assumptions that have (sometimes) testable implications. Well-known sets of assumptions that are sufficient to justify the causal interpretation of certain estimators are called identification strategies. These templates for causal analysis, however, do not perfectly map into empirical research practice. Researchers are often left in the disjunctive of either abstracting away from their particular setting to fit in the templates, risking erroneous inferences, or avoiding situations in which the templates cannot be applied, missing valuable opportunities for conducting empirical analysis. In this article, I show how directed acyclic graphs (DAGs) can help researchers to conduct empirical research and assess the quality of evidence without excessively relying on research templates. First, I offer a concise introduction to causal inference frameworks. Then I survey the arguments in the methodological literature in favor of using research templates, while either avoiding or limiting the use of causal graphical models. Third, I discuss the problems with the template model, arguing for a more flexible approach to DAGs that helps illuminating common problems in empirical settings and improving the credibility of causal claims. I demonstrate this approach in a series of worked examples, showing the gap between identification strategies as invoked by researchers and their actual applications. Finally, I conclude highlighting the benefits that routinely incorporating causal graphical models in our scientific discussions would have in terms of transparency, testability, and generativity.


title: Rota--Baxter and averaging operators on racks and rack algebras

abstract: In the present article we define and investigate relative Rota--Baxter operators and relative averaging operators on racks and rack algebras. Also, if B is a Rota--Baxter or averaging operator on a rack X, then we can extend B by linearity to the rack algebra k[X]. On the other side, we have definitions of Rota--Baxter and averaging operators on arbitrary algebra. We find connections between these operators. In particular, we prove that if B : X --> X is an averaging operator on a rack, then its linear extension on a rack algebra k[X] gives an averaging operator.


title: Uniform bounds for bilinear symbols with linear K-quasiconformally embedded singularity

abstract: We prove bounds in the strict local $L^{2}(\mathbb{R}^{d})$ range for trilinear Fourier multiplier forms with a $d$-dimensional singular subspace. Given a fixed parameter $K \ge 1$, we treat multipliers with non-degenerate singularity that are push-forwards by $K$-quasiconformal matrices of suitable symbols. As particular applications, our result recovers the uniform bounds for the one-dimensional bilinear Hilbert transforms in the strict local $L^{2}$ range, and it implies the uniform bounds for two-dimensional bilinear Beurling transforms, which are new, in the same range.


title: TDE-3: An improved prior for optical flow computation in spiking neural networks

abstract: Motion detection is a primary task required for robotic systems to perceive and navigate in their environment. Proposed in the literature bioinspired neuromorphic Time-Difference Encoder (TDE-2) combines event-based sensors and processors with spiking neural networks to provide real-time and energy-efficient motion detection through extracting temporal correlations between two points in space. However, on the algorithmic level, this design leads to loss of direction-selectivity of individual TDEs in textured environments. Here we propose an augmented 3-point TDE (TDE-3) with additional inhibitory input that makes TDE-3 direction-selectivity robust in textured environments. We developed a procedure to train the new TDE-3 using backpropagation through time and surrogate gradients to linearly map input velocities into an output spike count or an Inter-Spike Interval (ISI). Our work is the first instance of training a spiking neuron to have a specific ISI. Using synthetic data we compared training and inference with spike count and ISI with respect to changes in stimuli dynamic range, spatial frequency, and level of noise. ISI turns out to be more robust towards variation in spatial frequency, whereas the spike count is a more reliable training signal in the presence of noise. We performed the first in-depth quantitative investigation of optical flow coding with TDE and compared TDE-2 vs TDE-3 in terms of energy-efficiency and coding precision. Results show that on the network level both detectors show similar precision (20 degree angular error, 88% correlation with ground truth). Yet, due to the more robust direction-selectivity of individual TDEs, TDE-3 based network spike less and hence is more energy-efficient. Reported precision is on par with model-based methods but the spike-based processing of the TDEs provides allows more energy-efficient inference with neuromorphic hardware.


title: Gravity-mediated decoherence

abstract: A small quantum system within the gravitational field of a massive body will be entangled with the quantum degrees of freedom of the latter. Hence, the massive body acts as an environment, and it induces non-unitary dynamics, noise, and decoherence to the quantum system. It is impossible to shield systems on Earth from this gravity-mediated decoherence, which could severely affect all experiments with macroscopic quantum systems. We undertake a first-principles analysis of this effect, by deriving the corresponding open system dynamics. We find that near-future quantum experiments are not affected, but there is a strong decoherence effect at the human scale. The decoherence time for a superposition of two localized states of a human with an one meter separation is of the order of one second.


title: Interpretable Short-Term Load Forecasting via Multi-Scale Temporal Decomposition

abstract: Rapid progress in machine learning and deep learning has enabled a wide range of applications in the electricity load forecasting of power systems, for instance, univariate and multivariate short-term load forecasting. Though the strong capabilities of learning the non-linearity of the load patterns and the high prediction accuracy have been achieved, the interpretability of typical deep learning models for electricity load forecasting is less studied. This paper proposes an interpretable deep learning method, which learns a linear combination of neural networks that each attends to an input time feature. We also proposed a multi-scale time series decomposition method to deal with the complex time patterns. Case studies have been carried out on the Belgium central grid load dataset and the proposed model demonstrated better accuracy compared to the frequently applied baseline model. Specifically, the proposed multi-scale temporal decomposition achieves the best MSE, MAE and RMSE of 0.52, 0.57 and 0.72 respectively. As for interpretability, on one hand, the proposed method displays generalization capability. On the other hand, it can demonstrate not only the feature but also the temporal interpretability compared to other baseline methods. Besides, the global time feature interpretabilities are also obtained. Obtaining global feature interpretabilities allows us to catch the overall patterns, trends, and cyclicality in load data while also revealing the significance of various time-related features in forming the final outputs.


title: Fast Outflows and Luminous He II Emission in Dwarf Galaxies with AGN

abstract: While stellar processes are believed to be the main source of feedback in dwarf galaxies, the accumulating discoveries of AGN in dwarf galaxies over recent years arouse the interest to also consider AGN feedback in them. Fast, AGN-driven outflows, a major mechanism of AGN feedback, have indeed been discovered in dwarf galaxies and may be powerful enough to provide feedback to their dwarf hosts. In this paper, we search for outflows traced by the blueshifted ultraviolet absorption features in three dwarf galaxies with AGN from the sample examined in our previous ground-based study. We confirm outflows traced by blueshifted absorption features in two objects and tentatively detect an outflow in the third object. In one object where the outflow is clearly detected in multiple species, photoionization modeling suggests that this outflow is located $\sim$0.5 kpc from the AGN, implying a galactic-scale impact. This outflow is much faster and possesses higher kinetic energy outflow rate than starburst-driven outflows in sources with similar star formation rates, and is likely energetic enough to provide negative feedback to its host galaxy as predicted by simulations. Much broader ($\sim$4000 km s$^{-1}$) absorption features are also discovered in this object which may have the same origin as that of broad absorption lines in quasars. Additionally, strong He II $\lambda$1640 emission is detected in both objects where the transition falls in the wavelength coverage, and is consistent with an AGN origin. In one of these two objects, blueshifted He II emission line is clearly detected, likely tracing a highly-ionized AGN wind.


title: Specifying and Analyzing Networked and Layered Control Systems Operating on Multiple Clocks

abstract: We consider the problem of reasoning about networked and layered control systems using assume-guarantee specifications. As these systems are formed by the interconnection of components that operate under various clocks, we introduce a new logic, Multiclock Logic (MCL), to be able to express the requirements of components form the point of view of their local clocks. Specifying components locally promotes independent design and component reuse. We carry out a contract-based analysis of a control system implemented via two control algorithms (model predictive control and feedback linearization) running on their own processors and clocks. Then we implement each of the contracts to build a system. The system performs as desired when the requirements derived from our system-level analysis are respected. Violating the constraints required by the contract-based analysis of the system leads to error.


title: Fast-forwarding molecular ground state preparation with optimal control on analog quantum simulators

abstract: We show that optimal control of the electron dynamics is able to prepare molecular ground states, within chemical accuracy, with evolution times approaching the bounds imposed by quantum mechanics. We propose a specific parameterization of the molecular evolution only in terms of interaction already present in the molecular Hamiltonian. Thus, the proposed method solely utilizes quantum simulation routines, retaining their favourable scalings. Due to the intimate relationships between variational quantum algorithms and optimal control we compare, when possible, our results with state-of-the-art methods in literature. We found that the number of parameters needed to reach chemical accuracy and algorithmic scaling are in line with compact adaptive strategies to build variational ansatze. The algorithm, which is also suitable for quantum simulators, is implemented emulating a digital quantum processor (up to 16 qubits) and tested on different molecules and geometries spanning different degrees of electron correlation.


title: Disturbance Ratio for Optimal Multi-Event Classification in Power Distribution Networks

abstract: This paper presents an effective approach to identify power quality events based on IEEE Std 1159-2009 caused by intermittent power sources like those of renewable energy. An efficient characterization of these disturbances is granted by the use of two useful wavelet based indices. For this purpose, a wavelet-based Global Disturbance Ratio index (GDR), defined through its instantaneous precursor (Instantaneous Transient Disturbance index ITD(t)), is used in power distribution networks (PDN) under steady-state and/or transient conditions. An intelligent disturbance classification is done using a Support Vector Machine (SVM) with a minimum input vector based on the GDR index. The effectiveness of the proposed technique is validated using a real-time experimental system with single events and multi-events signals.


title: Hybrid Kerr-electro-optic frequency combs on thin-film lithium niobate

abstract: Optical frequency combs are indispensable links between the optical and microwave domains, enabling a wide range of applications including precision spectroscopy, ultrastable frequency generation, and timekeeping. Chip-scale integration miniaturizes bulk implementations onto photonic chips, offering highly compact, stable, and power-efficient frequency comb sources. State of the art integrated frequency comb sources are based on resonantly-enhanced Kerr effect and, more recently, on electro-optic effect. While the former can routinely reach octave-spanning bandwidths and the latter feature microwave-rate spacings, achieving both in the same material platform has been challenging. Here, we leverage both strong Kerr nonlinearity and efficient electro-optic phase modulation available in the ultralow-loss thin-film lithium niobate photonic platform, to demonstrate a hybrid Kerr-electro-optic frequency comb with stabilized spacing. In our approach, a dissipative Kerr soliton is first generated, and then electro-optic division is used to realize a frequency comb with 2,589 comb lines spaced by 29.308 GHz and spanning 75.9 THz (588 nm) end-to-end. Further, we demonstrate electronic stabilization and control of the soliton spacing, naturally facilitated by our approach. The broadband, microwave-rate comb in this work overcomes the spacing-span tradeoff that exists in all integrated frequency comb sources, and paves the way towards chip-scale solutions for complex tasks such as laser spectroscopy covering multiple bands, micro- and millimeter-wave generation, and massively parallel optical communications.


title: Challenging the Black Box: A Comprehensive Evaluation of Attribution Maps of CNN Applications in Agriculture and Forestry

abstract: In this study, we explore the explainability of neural networks in agriculture and forestry, specifically in fertilizer treatment classification and wood identification. The opaque nature of these models, often considered 'black boxes', is addressed through an extensive evaluation of state-of-the-art Attribution Maps (AMs), also known as class activation maps (CAMs) or saliency maps. Our comprehensive qualitative and quantitative analysis of these AMs uncovers critical practical limitations. Findings reveal that AMs frequently fail to consistently highlight crucial features and often misalign with the features considered important by domain experts. These discrepancies raise substantial questions about the utility of AMs in understanding the decision-making process of neural networks. Our study provides critical insights into the trustworthiness and practicality of AMs within the agriculture and forestry sectors, thus facilitating a better understanding of neural networks in these application areas.


title: Autocorrect for Estonian texts: final report from project EKTB25

abstract: The project was funded in 2021-2023 by the National Programme of Estonian Language Technology. Its main aim was to develop spelling and grammar correction tools for the Estonian language. The main challenge was the very small amount of available error correction data needed for such development. To mitigate this, (1) we annotated more correction data for model training and testing, (2) we tested transfer-learning, i.e. retraining machine learning models created for other tasks, so as not to depend solely on correction data, (3) we compared the developed method and model with alternatives, including large language models. We also developed automatic evaluation, which can calculate the accuracy and yield of corrections by error category, so that the effectiveness of different methods can be compared in detail. There has been a breakthrough in large language models during the project: GPT4, a commercial language model with Estonian-language support, has been created. We took into account the existence of the model when adjusting plans and in the report we present a comparison with the ability of GPT4 to improve the Estonian language text. The final results show that the approach we have developed provides better scores than GPT4 and the result is usable but not entirely reliable yet. The report also contains ideas on how GPT4 and other major language models can be implemented in the future, focusing on open-source solutions. All results of this project are open-data/open-source, with licenses that allow them to be used for purposes including commercial ones.


title: Hole event for random holomorphic sections on compact Riemann surfaces

abstract: Let $X$ be a compact Riemann surface and $\mathcal L$ be a positive line bundle on it. We study the conditional zero expectation of all the holomorphic sections of $\mathcal L^n$ which do not vanish on $D$ for some fixed open subset $D$ of $X$. We prove that as $n$ tends to infinity, the zeros of these sections are equidistributed outside $D$ with respect to a probability measure $\nu$. This gives rise to a surprising forbidden set.


title: Exciton-photocarrier interference in mixed lead-halide-perovskite nanocrystals

abstract: The use of semiconductor nanocrystals in scalable quantum technologies requires characterization of the exciton coherence dynamics in an \emph{ensemble} of electronically isolated crystals in which system-bath interactions are nevertheless strong. In this communication, we identify signatures of Fano-like interference between excitons and photocarriers in the coherent two-dimensional photoluminescence excitation spectral lineshapes of mixed lead-halide perovskite nanocrystals in dilute solution. Specifically, by tuning the femtosecond-pulse spectrum, we show such interference in an intermediate coupling regime, which is evident in the coherent lineshape when simultaneously exciting the exciton and the free-carrier band at higher energy. We conclude that this interference is an intrinsic effect that will be consequential in the quantum dynamics of the system and will thus dictate decoherence dynamics, with consequences in their application in quantum technologies.


title: A Fast Algorithm to Simulate Nonlinear Resistive Networks

abstract: Analog electrical networks have long been investigated as energy-efficient computing platforms for machine learning, leveraging analog physics during inference. More recently, resistor networks have sparked particular interest due to their ability to learn using local rules (such as equilibrium propagation), enabling potentially important energy efficiency gains for training as well. Despite their potential advantage, the simulations of these resistor networks has been a significant bottleneck to assess their scalability, with current methods either being limited to linear networks or relying on realistic, yet slow circuit simulators like SPICE. Assuming ideal circuit elements, we introduce a novel approach for the simulation of nonlinear resistive networks, which we frame as a quadratic programming problem with linear inequality constraints, and which we solve using a fast, exact coordinate descent algorithm. Our simulation methodology significantly outperforms existing SPICE-based simulations, enabling the training of networks up to 327 times larger at speeds 160 times faster, resulting in a 50,000-fold improvement in the ratio of network size to epoch duration. Our approach can foster more rapid progress in the simulations of nonlinear analog electrical networks.


title: Secure quantum imaging with decoy state heralded single photons

abstract: Weak coherent source (WCS) and spontaneous parametric down converted heralded single photon pairs have found applications in quantum key distribution (QKD) and quantum imaging (QI) experiments. Decoy state methods have also been used to enhance the security for QKD and QI. We study quantum secured imaging with the decoy state heralded single photon source (HSPS). The HSPSs superior performance in low photon number regimes makes it an ideal candidate for integrating quantum key distribution protocols to reduce measurement uncertainty and ensure secure QI. Furthermore, our results also infer the influence of the decoy state WCS, due to its higher operating speed than decoy state HSPS, would be effective in conditions that allow higher mean photon numbers for quantum secured imaging.


title: A Multi-Aspect Framework for Counter Narrative Evaluation using Large Language Models

abstract: Counter narratives - informed responses to hate speech contexts designed to refute hateful claims and de-escalate encounters - have emerged as an effective hate speech intervention strategy. While previous work has proposed automatic counter narrative generation methods to aid manual interventions, the evaluation of these approaches remains underdeveloped. Previous automatic metrics for counter narrative evaluation lack alignment with human judgment as they rely on superficial reference comparisons instead of incorporating key aspects of counter narrative quality as evaluation criteria. To address prior evaluation limitations, we propose a novel evaluation framework prompting LLMs to provide scores and feedback for generated counter narrative candidates using 5 defined aspects derived from guidelines from counter narrative specialized NGOs. We found that LLM evaluators achieve strong alignment to human-annotated scores and feedback and outperform alternative metrics, indicating their potential as multi-aspect, reference-free and interpretable evaluators for counter narrative evaluation.


title: MultiCorrupt: A Multi-Modal Robustness Dataset and Benchmark of LiDAR-Camera Fusion for 3D Object Detection

abstract: Multi-modal 3D object detection models for automated driving have demonstrated exceptional performance on computer vision benchmarks like nuScenes. However, their reliance on densely sampled LiDAR point clouds and meticulously calibrated sensor arrays poses challenges for real-world applications. Issues such as sensor misalignment, miscalibration, and disparate sampling frequencies lead to spatial and temporal misalignment in data from LiDAR and cameras. Additionally, the integrity of LiDAR and camera data is often compromised by adverse environmental conditions such as inclement weather, leading to occlusions and noise interference. To address this challenge, we introduce MultiCorrupt, a comprehensive benchmark designed to evaluate the robustness of multi-modal 3D object detectors against ten distinct types of corruptions. We evaluate five state-of-the-art multi-modal detectors on MultiCorrupt and analyze their performance in terms of their resistance ability. Our results show that existing methods exhibit varying degrees of robustness depending on the type of corruption and their fusion strategy. We provide insights into which multi-modal design choices make such models robust against certain perturbations. The dataset generation code and benchmark are open-sourced at https://github.com/ika-rwth-aachen/MultiCorrupt.


title: The boundary of cosmic filaments

abstract: For decades, the boundary of cosmic filaments have been a subject of debate. In this work, we determine the physically-motivated radii of filaments by constructing stacked galaxy number density profiles around the filament spines. We find that the slope of the profile changes with distance to the filament spine, reaching its minimum at approximately 1 Mpc at z = 0 in both state-of-the-art hydrodynamical simulations and observational data. This can be taken as the average value of the filament radius. Furthermore, we note that the average filament radius rapidly decreases from z = 4 to z = 1, and then slightly increases. Moreover, we find that the filament radius depends on the filament length, the distance from connected clusters, and the masses of the clusters. These results suggest a two-phase formation scenario of cosmic filaments. The filaments experience rapid contraction before z = 1, but their density distribution has remained roughly stable since then. The subsequent mass transport along the filaments to the connected clusters is likely to have contributed to the formation of the clusters themselves.


title: Adaptively Learning Memory Incorporating PSO

abstract: Selection of perefect parameters for low-pass filters can sometimes be an expensive problem with no analytical solution or differentiability of cost function. In this paper, we introduce a new PSO-inspired algorithm, that incorporates the positive experiences of the swarm to learn the geometry of the search space,thus obtaining the ability to consistently reach global optimum and is especially suitable for nonsmooth semiconvex functions optimization. We compare it to a set of other algorithms on test functions of choice to prove it's suitability to a certain range of problems, and then apply it to the problem of finding perfect parameters for exponential smoothing algorithm.


title: 3D Point Cloud Compression with Recurrent Neural Network and Image Compression Methods

abstract: Storing and transmitting LiDAR point cloud data is essential for many AV applications, such as training data collection, remote control, cloud services or SLAM. However, due to the sparsity and unordered structure of the data, it is difficult to compress point cloud data to a low volume. Transforming the raw point cloud data into a dense 2D matrix structure is a promising way for applying compression algorithms. We propose a new lossless and calibrated 3D-to-2D transformation which allows compression algorithms to efficiently exploit spatial correlations within the 2D representation. To compress the structured representation, we use common image compression methods and also a self-supervised deep compression approach using a recurrent neural network. We also rearrange the LiDAR's intensity measurements to a dense 2D representation and propose a new metric to evaluate the compression performance of the intensity. Compared to approaches that are based on generic octree point cloud compression or based on raw point cloud data compression, our approach achieves the best quantitative and visual performance. Source code and dataset are available at https://github.com/ika-rwth-aachen/Point-Cloud-Compression.


title: Opening the black box of language acquisition

abstract: Recent advances in large language models using deep learning techniques have renewed interest on how languages can be learned from data. However, it is unclear whether or how these models represent grammatical information from the learned languages. In addition, the models must be pre-trained on large corpora before they can be used. In this work, we propose an alternative, more transparent and cognitively plausible architecture for learning language. Instead of using deep learning, our approach uses a minimal cognitive architecture based on sequence memory and chunking. The learning mechanism is based on the principles of reinforcement learning. We test our architecture on a number of natural-like toy languages. Results show that the model can learn these artificial languages from scratch and extract grammatical information that supports learning. Our study demonstrates the power of this simple architecture and stresses the importance of sequence memory as a key component of the language learning process. Since other animals do not seem to have a faithful sequence memory, this may explain why only humans have developed complex languages.


title: Learning Conditional Invariances through Non-Commutativity

abstract: Invariance learning algorithms that conditionally filter out domain-specific random variables as distractors, do so based only on the data semantics, and not the target domain under evaluation. We show that a provably optimal and sample-efficient way of learning conditional invariances is by relaxing the invariance criterion to be non-commutatively directed towards the target domain. Under domain asymmetry, i.e., when the target domain contains semantically relevant information absent in the source, the risk of the encoder $\varphi^*$ that is optimal on average across domains is strictly lower-bounded by the risk of the target-specific optimal encoder $\Phi^*_\tau$. We prove that non-commutativity steers the optimization towards $\Phi^*_\tau$ instead of $\varphi^*$, bringing the $\mathcal{H}$-divergence between domains down to zero, leading to a stricter bound on the target risk. Both our theory and experiments demonstrate that non-commutative invariance (NCI) can leverage source domain samples to meet the sample complexity needs of learning $\Phi^*_\tau$, surpassing SOTA invariance learning algorithms for domain adaptation, at times by over $2\%$, approaching the performance of an oracle. Implementation is available at https://github.com/abhrac/nci.


title: One Prompt To Rule Them All: LLMs for Opinion Summary Evaluation

abstract: Evaluation of opinion summaries using conventional reference-based metrics rarely provides a holistic evaluation and has been shown to have a relatively low correlation with human judgments. Recent studies suggest using Large Language Models (LLMs) as reference-free metrics for NLG evaluation, however, they remain unexplored for opinion summary evaluation. Moreover, limited opinion summary evaluation datasets inhibit progress. To address this, we release the SUMMEVAL-OP dataset covering 7 dimensions related to the evaluation of opinion summaries: fluency, coherence, relevance, faithfulness, aspect coverage, sentiment consistency, and specificity. We investigate Op-I-Prompt a dimension-independent prompt, and Op-Prompts, a dimension-dependent set of prompts for opinion summary evaluation. Experiments indicate that Op-I-Prompt emerges as a good alternative for evaluating opinion summaries achieving an average Spearman correlation of 0.70 with humans, outperforming all previous approaches. To the best of our knowledge, we are the first to investigate LLMs as evaluators on both closed-source and open-source models in the opinion summarization domain.


title: ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models

abstract: Large vision-language models (LVLMs) have shown premise in a broad range of vision-language tasks with their strong reasoning and generalization capabilities. However, they require considerable computational resources for training and deployment. This study aims to bridge the performance gap between traditional-scale LVLMs and resource-friendly lite versions by adopting high-quality training data. To this end, we propose a comprehensive pipeline for generating a synthetic dataset. The key idea is to leverage strong proprietary models to generate (i) fine-grained image annotations for vision-language alignment and (ii) complex reasoning visual question-answering pairs for visual instruction fine-tuning, yielding 1.3M samples in total. We train a series of lite VLMs on the synthetic dataset and experimental results demonstrate the effectiveness of the proposed scheme, where they achieve competitive performance on 17 benchmarks among 4B LVLMs, and even perform on par with 7B/13B-scale models on various benchmarks. This work highlights the feasibility of adopting high-quality data in crafting more efficient LVLMs. We name our dataset \textit{ALLaVA}, and open-source it to research community for developing better resource-efficient LVLMs for wider usage.


title: Variability-Aware Noise-Induced Dynamic Instability of Ultra-Low-Voltage SRAM Bitcells

abstract: Stability of ultra-low-voltage SRAM bitcells in retention mode is threatened by two types of uncertainty: process variability and intrinsic noise. While variability dominates the failure probability, noise-induced bit flips in weakened bitcells lead to dynamic instability. We study both effects jointly in a unified SPICE simulation framework. Starting from a synthetic representation of process variations introduced in a previous work, we identify the cases of poor noise immunity that require thorough noise analyses. Relying on a rigorous and systematic methodology, we simulate them in the time domain so as to emulate a true data retention operation. Short times to failure, unacceptable for a practical ultra-low-power memory system application, are recorded. The transient bit-flip mechanism is analysed and a dynamic failure criterion involving the unstable point is established. We conclude that, beyond static variability, the dynamic noise inflates defectiveness among SRAM bitcells. We also discuss the limits of existing analytical formulas from the literature, which rely on a linear near-equilibrium approximation of the SRAM dynamics to, inaccurately, predict the mean time to failure.


title: Learning the Topology and Behavior of Discrete Dynamical Systems

abstract: Discrete dynamical systems are commonly used to model the spread of contagions on real-world networks. Under the PAC framework, existing research has studied the problem of learning the behavior of a system, assuming that the underlying network is known. In this work, we focus on a more challenging setting: to learn both the behavior and the underlying topology of a black-box system. We show that, in general, this learning problem is computationally intractable. On the positive side, we present efficient learning methods under the PAC model when the underlying graph of the dynamical system belongs to some classes. Further, we examine a relaxed setting where the topology of an unknown system is partially observed. For this case, we develop an efficient PAC learner to infer the system and establish the sample complexity. Lastly, we present a formal analysis of the expressive power of the hypothesis class of dynamical systems where both the topology and behavior are unknown, using the well-known formalism of the Natarajan dimension. Our results provide a theoretical foundation for learning both the behavior and topology of discrete dynamical systems.


title: Evaluating Efficacy of Model Stealing Attacks and Defenses on Quantum Neural Networks

abstract: Cloud hosting of quantum machine learning (QML) models exposes them to a range of vulnerabilities, the most significant of which is the model stealing attack. In this study, we assess the efficacy of such attacks in the realm of quantum computing. We conducted comprehensive experiments on various datasets with multiple QML model architectures. Our findings revealed that model stealing attacks can produce clone models achieving up to $0.9\times$ and $0.99\times$ clone test accuracy when trained using Top-$1$ and Top-$k$ labels, respectively ($k:$ num\_classes). To defend against these attacks, we leverage the unique properties of current noisy hardware and perturb the victim model outputs and hinder the attacker's training process. In particular, we propose: 1) hardware variation-induced perturbation (HVIP) and 2) hardware and architecture variation-induced perturbation (HAVIP). Although noise and architectural variability can provide up to $\sim16\%$ output obfuscation, our comprehensive analysis revealed that models cloned under noisy conditions tend to be resilient, suffering little to no performance degradation due to such obfuscations. Despite limited success with our defense techniques, this outcome has led to an important discovery: QML models trained on noisy hardwares are naturally resistant to perturbation or obfuscation-based defenses or attacks.


title: Evidence for Episodic Black Hole Growth of Reionization-Era Quasars observed with Magellan/FIRE

abstract: Observations of high-redshift quasars hosting billion solar mass black holes at $z\gtrsim6$ challenge our understanding of early supermassive black hole (SMBH) growth. In this work, we conduct a near-infrared spectroscopic study of $19$ quasars at $6.2\lesssim z\lesssim 7.5$, using the Folded-port InfraRed Echellette (FIRE) instrument on the $6.5$-meter Magellan/Baade Telescope. We estimate the single-epoch masses of the quasars' SMBHs by means of the MgII emission line and find black hole masses of $M_{\text{BH}} \approx(0.2-4.8)\,\times\,10^9\,M_\odot$. Furthermore, we measure the sizes of the quasars' proximity zones, which are regions of enhanced transmitted flux bluewards of the Ly$\alpha\,$ emission line, ionized by the quasars' radiation itself. While it has been shown that the proximity zone sizes correlate with the quasars' lifetimes due to the finite response time of the intergalactic medium to the quasars' radiation, we do not find any correlation between the proximity zone sizes and the black hole mass, which suggests that quasar activity and the concomitant black hole growth are intermittent and episodic.


title: Regularized double shuffle relations of $\mu$-multiple Hurwitz zeta values

abstract: In this paper we consider a family of multiple Hurwitz zeta values with bi-indices parameterized by $\mu$ with $\Ree(\mu)>0$. These values are equipped with both the $\mu$-stuffle product from their series definition and the shuffle product from their integral expressions. We will give a detailed analysis of the two different products and discuss their regularization when the bi-indices are non-admissible. Our main goal is to prove the comparison theorem relating the two ways of regularization, which is an analog of Ihara, Kaneko, and Zagier's celebrated result concerning the regularization of multiple zeta values. We will see that the comparison formula is $\mu$-invariant, that is, it is independent of the parameter $\mu$. As applications, we will first provide a few interesting closed formulas for some multi-fold infinite sums that are closely related to the multiple zeta values of level $N$ studied by Yuan and the second author. We will also derive two sum formulas for $\mu$-double Hurwitz zeta values which generalize the sum formulas for double zeta values and double zeta star values, respectively, and a weighted sum formula which generalizes the weighted sum formulas for both double zeta values and double $T$-values simultaneously. At the end of the paper, we will propose a problem extending that for multiple zeta values first conjectured by Ihara et al.


title: Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning

abstract: Despite vision-language models' (VLMs) remarkable capabilities as versatile visual assistants, two substantial challenges persist within the existing VLM frameworks: (1) lacking task diversity in pretraining and visual instruction tuning, and (2) annotation error and bias in GPT-4 synthesized instruction tuning data. Both challenges lead to issues such as poor generalizability, hallucination, and catastrophic forgetting. To address these challenges, we construct Vision-Flan, the most diverse publicly available visual instruction tuning dataset to date, comprising 187 diverse tasks and 1,664,261 instances sourced from academic datasets, and each task is accompanied by an expert-written instruction. In addition, we propose a two-stage instruction tuning framework, in which VLMs are firstly finetuned on Vision-Flan and further tuned on GPT-4 synthesized data. We find this two-stage tuning framework significantly outperforms the traditional single-stage visual instruction tuning framework and achieves the state-of-the-art performance across a wide range of multi-modal evaluation benchmarks. Finally, we conduct in-depth analyses to understand visual instruction tuning and our findings reveal that: (1) GPT-4 synthesized data does not substantially enhance VLMs' capabilities but rather modulates the model's responses to human-preferred formats; (2) A minimal quantity (e.g., 1,000) of GPT-4 synthesized data can effectively align VLM responses with human-preference; (3) Visual instruction tuning mainly helps large-language models (LLMs) to understand visual features.


title: Stochastic Nonlinear Dynamical Modelling of SRAM Bitcells in Retention Mode

abstract: SRAM bitcells in retention mode behave as autonomous stochastic nonlinear dynamical systems. From observation of variability-aware transient noise simulations, we provide an unidimensional model, fully characterizable by conventional deterministic SPICE simulations, insightfully explaining the mechanism of intrinsic noise-induced bit flips. The proposed model is exploited to, first, explain the reported inaccuracy of existing closed-form near-equilibrium formulas aimed at predicting the mean time to failure and, secondly, to propose a closer estimate attractive in terms of CPU time.


title: On properties of the sets of positively curved Riemannian metrics on generalized Wallach spaces

abstract: Sets related to positively curved invariant Riemannian metrics on generalized Wallach spaces are considered. The problem arises in studying of the evolution of such metrics under the normalized Ricci flow equation. For Riemannian metrics of the Wallach spaces $\operatorname{SU}(3)/T_{\max}$, $\operatorname{Sp(3)}/ \left(\operatorname{Sp(1)}\right)^3$ and $F_4/\operatorname{Spin(8)}$ which admit positive sectional curvature and belong to a given invariant surface $\Sigma$ of the normalized Ricci flow we established that they form a set bounded by three connected and pairwise disjoint regular space curves such that each of them approaches two others asymptotically at infinity. Analogously, for all generalized Wallach spaces the set of Riemannian metrics which belong to $\Sigma$ and admit positive Ricci curvature is bounded by three curves each consisting of two connected components as regular curves. Intersections and asymptotical behaviors of these components were studied as well.


title: Identifying circular orders for blobs in phylogenetic networks

abstract: Interest in the inference of evolutionary networks relating species or populations has grown with the increasing recognition of the importance of hybridization, gene flow and admixture, and the availability of large-scale genomic data. However, what network features may be validly inferred from various data types under different models remains poorly understood. Previous work has largely focused on level-1 networks, in which reticulation events are well separated, and on a general network's tree of blobs, the tree obtained by contracting every blob to a node. An open question is the identifiability of the topology of a blob of unknown level. We consider the identifiability of the circular order in which subnetworks attach to a blob, first proving that this order is well-defined for outer-labeled planar blobs. For this class of blobs, we show that the circular order information from 4-taxon subnetworks identifies the full circular order of the blob. Similarly, the circular order from 3-taxon rooted subnetworks identifies the full circular order of a rooted blob. We then show that subnetwork circular information is identifiable from certain data types and evolutionary models. This provides a general positive result for high-level networks, on the identifiability of the ordering in which taxon blocks attach to blobs in outer-labeled planar networks. Finally, we give examples of blobs with different internal structures which cannot be distinguished under many models and data types.


title: Influence of mechanical compliance of the substrate on the morphology of nanoporous gold thin films

abstract: Nanoporous gold (np-Au) has found use in applications ranging from catalysis to biosensing where pore morphology plays a critical role in performance. While morphology evolution of bulk np-Au has been widely studied, knowledge about its thin film form is limited. This work hypothesizes that mechanical compliance of the thin film substrate can play a critical role in the morphology evolution. Via experimental and finite-element-analysis approaches, we investigate the morphological variation in np-Au thin films deposited on compliant silicone (PDMS) substrates of a range of thicknesses anchored on rigid glass supports and compare those to the morphology of np-Au deposited on glass. More macroscopic (10s to 100s of microns) cracks and discrete islands form in the np-Au films on PDMS compared to glass. Conversely, uniformly-distributed microscopic (100s of nanometers) cracks form in greater numbers in the np-Au films on glass than on PDMS, with the cracks located within the discrete islands. The np-Au films on glass also show larger ligament and pore sizes possibly due to higher residual stresses compared to the np-Au/PDMS films. The effective elastic modulus of the substrate layers decreases with increasing PDMS thickness, resulting in secondary np-Au morphology effects including a reduction in macroscopic crack-to-crack distance, an increase in microscopic crack coverage, and a widening of the microscopic cracks. However, changes in the ligament/pore widths with PDMS thickness are negligible, allowing for independent optimization for cracking. We expect these results to inform the integration of functional np-Au films on compliant substrates into emerging applications, including flexible electronics.


title: Enabling Software Defined Optical Networks

abstract: This paper gives an overview of Software Defined Optical Networks or SDONs and how they can be implemented. It traces the evolution of Optical networks upto GMPLS and traces the idea of SDN and builds upto OpenFlow. The paper explores the need for SDONs and explains what a SDON solution could look like, including the hardware. It also seeks to explain how OpenFlow could be used as a part of this solution to overcome the limitations of GMPLS.


title: Index a Lie Borel Lie Algebra

abstract: We compute the index of a Lie Borel Lie Algbra of a simple Lie algebra.


title: Apollonian carpets and the boundary of the Kahler cone of a hyperkahler manifold

abstract: The ample cone of a compact Kahler $n$-manifold $M$ is the intersection of its Kahler cone and the real subspace generated by integer (1,1)-classes. Its isotropic boundary is the set of all points $\eta$ on its boundary such that $\int_M \eta^n=0$. We are interested in the relation between the shape of the isotropic boundary of the ample cone of a hyperkahler manifold and the dynamics of its holomorphic automorphism group $G$. In this case, the projectivization of the ample cone is realized as an open, locally polyhedral subset in a hyperbolic space $H$. The isotropic boundary $S$ is realized as a subset of the hyperbolic boundary (the absolute) $A$ of $H$, which is naturally identified with a Euclidean sphere. It is clear that the isotropic boundary $S$ contains the limit set of $G$ acting on its ample cone. We prove that, conversely, all irrational points on $S$ belong to the limit set. Using a result of N. Shah about limiting distributions of curves under geodesic flow on hyperbolic manifolds, we prove that every real analytic curve in $S$ is contained in a geodesic sphere in $S$,and in presence of such curves the limit set is the closure of the union of these geodesic spheres. We study the geometry of such fractal sets, called Apollonian carpets, and establish the link between the Apollonian carpet and the structure of the automorphism group.


title: 5G Cellular -- An Energy Efficiency Perspective

abstract: While the 5G technology of cellular communications promises great capacity and coverage to access information anywhere and anytime, it is feared to have huge power consumption. Significant research been has been directed towards solving this problem which exists both on the subscribers side as well as the operators side. There have been efforts like predicting traffic, modifying the physical layer etc. towards making the 5G technology more energy efficient. The aim of this study is to see the technology enablers for 5G from an energy efficiency perspective. Efforts will be made to point out specific areas in 5G cellular where improvements or modifications could make 5G cellular more energy efficient.


title: Grothendieck rings of polytopes and non-archimedean semi-algebraic sets

abstract: Let $\Gamma$ be a divisible subgroup of $(\mathbb{R},+)$. Our central result states that, at the level of Grothendieck groups, the classification of $\Gamma$-rational polyhedra in $\mathbb{R}^n$ up to affine transformations in $\Gamma^n\rtimes \mathrm{GL}_n(\mathbb{Z})$ is equivalent to the classification up to affine transformations in $\Gamma^n\rtimes \mathrm{GL}_n(\mathbb{Q})$. We prove this by giving an explicit description of these Grothendieck groups. This yields, in particular, a positive answer to the basic case of a question by Hrushovski and Kazhdan; all other cases are still open. As a second application, we give a simple description of the kernel of the motivic volume for non-archimedean semi-algebraic sets, which is a key ingredient of Hrushovski and Kazhdan's theory of motivic integration.


title: Why Lift so Heavy? Slimming Large Language Models by Cutting Off the Layers

abstract: Large Language Models (LLMs) possess outstanding capabilities in addressing various natural language processing (NLP) tasks. However, the sheer size of these models poses challenges in terms of storage, training and inference due to the inclusion of billions of parameters through layer stacking. While traditional approaches such as model pruning or distillation offer ways for reducing model size, they often come at the expense of performance retention. In our investigation, we systematically explore the approach of reducing the number of layers in LLMs. Surprisingly, we observe that even with fewer layers, LLMs maintain similar or better performance levels, particularly in prompt-based fine-tuning for text classification tasks. Remarkably, in certain cases, models with a single layer outperform their fully layered counterparts. These findings offer valuable insights for future work aimed at mitigating the size constraints of LLMs while preserving their performance, thereby opening avenues for significantly more efficient use of LLMs.


title: Explaining the Machine Learning Solution of the Ising Model

abstract: As powerful as machine learning (ML) techniques are in solving problems involving data with large dimensionality, explaining the results from the fitted parameters remains a challenging task of utmost importance, especially in physics applications. This work shows how this can be accomplished for the ferromagnetic Ising model, the main target of several ML studies in statistical physics. Here it is demonstrated that the successful unsupervised identification of the phases and order parameter by principal component analysis, a common method in those studies, detects that the magnetization per spin has its greatest variation with the temperature, the actual control parameter of the phase transition. Then, by using a neural network (NN) without hidden layers (the simplest possible) and informed by the symmetry of the Hamiltonian, an explanation is provided for the strategy used in finding the supervised learning solution for the critical temperature of the model's continuous phase transition. This allows the prediction of the minimal extension of the NN to solve the problem when the symmetry is not known, which becomes also explainable. These results pave the way to a physics-informed explainable generalized framework, enabling the extraction of physical laws and principles from the parameters of the models.


title: Can ChatGPT Support Developers? An Empirical Evaluation of Large Language Models for Code Generation

abstract: Large language models (LLMs) have demonstrated notable proficiency in code generation, with numerous prior studies showing their promising capabilities in various development scenarios. However, these studies mainly provide evaluations in research settings, which leaves a significant gap in understanding how effectively LLMs can support developers in real-world. To address this, we conducted an empirical analysis of conversations in DevGPT, a dataset collected from developers' conversations with ChatGPT (captured with the Share Link feature on platforms such as GitHub). Our empirical findings indicate that the current practice of using LLM-generated code is typically limited to either demonstrating high-level concepts or providing examples in documentation, rather than to be used as production-ready code. These findings indicate that there is much future work needed to improve LLMs in code generation before they can be integral parts of modern software development.


title: Eilenberg-Moore Bicategories for Opmonoidal Pseudomonads

abstract: We analyse compatibility between monads and monoidal structures in the two-dimensional setting. We describe sufficient conditions for monoidal structures to lift to the Eilenberg-Moore pseudoalgebras. We then extend these results to braids, syllapses and symmetries. To achieve these results we define the Gray-tensor product of pseudomonads, and examine its interaction with the Eilenberg-Moore construction.


title: Review on Algorithms for dynamical fermions

abstract: This review gives an overview on the research of algorithms for dynamical fermions used in large scale lattice QCD simulations. First a short overview on the state-of-the-art of ensemble generation at the physical point is given. Followed by an overview on necessary steps towards simulation of large lattices with the Hybrid Monte Carlo algorithm. Here, the status of iterative solvers and tuning procedures for numerical integrators within the molecular dynamics are discussed. This is followed by a review on the on-going developments for algorithms, with a focus on methods which are potentially useful to simulate gauge theories at very fine lattice spacings, i.e. well suited to overcome freezing of the topological charge. This includes modification of the HMC algorithm as well as a discussion of algorithms which includes the fermion weight via global correction steps. Parts of the discussions are on the application of generative models via gauge equivariant flows as well as multi-level algorithms.


title: Learning Memory Kernels in Generalized Langevin Equations

abstract: We introduce a novel approach for learning memory kernels in Generalized Langevin Equations. This approach initially utilizes a regularized Prony method to estimate correlation functions from trajectory data, followed by regression over a Sobolev norm-based loss function with RKHS regularization. Our method guarantees improved performance within an exponentially weighted L^2 space, with the kernel estimation error controlled by the error in estimated correlation functions. We demonstrate the superiority of our estimator compared to other regression estimators that rely on L^2 loss functions and also an estimator derived from the inverse Laplace transform, using numerical examples that highlight its consistent advantage across various weight parameter selections. Additionally, we provide examples that include the application of force and drift terms in the equation.


title: Branched covers of twist-roll spun knots

abstract: We prove that the double branched cover of a twist-roll spun knot in $S^4$ is smoothly preserved when four twists are added, and that the double branched cover of a twist-roll spun knot connected sum with a trivial projective plane is preserved after two twists are added. As a consequence, we conclude that a family of homotopy $\mathbb{CP}^2$s recently constructed by Miyazawa are each diffeomorphic to $\mathbb{CP}^2$.


title: Search Engines Post-ChatGPT: How Generative Artificial Intelligence Could Make Search Less Reliable

abstract: In this commentary, we discuss the evolving nature of search engines, as they begin to generate, index, and distribute content created by generative artificial intelligence (GenAI). Our discussion highlights challenges in the early stages of GenAI integration, particularly around factual inconsistencies and biases. We discuss how output from GenAI carries an unwarranted sense of credibility, while decreasing transparency and sourcing ability. Furthermore, search engines are already answering queries with error-laden, generated content, further blurring the provenance of information and impacting the integrity of the information ecosystem. We argue how all these factors could reduce the reliability of search engines. Finally, we summarize some of the active research directions and open questions.


title: Quantitative theory of reflections across quasiconformal polygonal lines

abstract: The paper continues the author's research in the problem of quantitative investigation of basic curvelinear quasiinvariants of quasiconformal curves. It concerns polygons with infinite number of vertices and provides various distortion estimates in terms of intrinsic geometric characteristics of polygons. In particular, this implies the coarse upper and lower estimates for the Grunsky and Teichmuller norms of a conformal map of the disk onto any piecewise $C^{1+}$-smooth bounded quasicircle.


title: GNNavi: Navigating the Information Flow in Large Language Models by Graph Neural Network

abstract: Large Language Models (LLMs) exhibit strong In-Context Learning (ICL) capabilities when prompts with demonstrations are used. However, fine-tuning still remains crucial to further enhance their adaptability. Prompt-based fine-tuning proves to be an effective fine-tuning method in low-data scenarios, but high demands on computing resources limit its practicality. We address this issue by introducing a prompt-based parameter-efficient fine-tuning (PEFT) approach. GNNavi leverages insights into ICL's information flow dynamics, which indicates that label words act in prompts as anchors for information propagation. GNNavi employs a Graph Neural Network (GNN) layer to precisely guide the aggregation and distribution of information flow during the processing of prompts by hardwiring the desired information flow into the GNN. Our experiments on text classification tasks with GPT-2 and Llama2 show GNNavi surpasses standard prompt-based fine-tuning methods in few-shot settings by updating just 0.2% to 0.5% of parameters. We compare GNNavi with prevalent PEFT approaches, such as prefix tuning, LoRA and Adapter in terms of performance and efficiency. Our analysis reveals that GNNavi enhances information flow and ensures a clear aggregation process.


title: A Note on Bias to Complete

abstract: Minimizing social bias strengthens societal bonds, promoting shared understanding and better decision-making. We revisit the definition of bias by discovering new bias types (e.g., societal status) in dynamic environments and describe them relative to context, such as culture, region, time, and personal background. Our framework includes eight hypotheses about bias and a minimizing bias strategy for each assumption as well as five methods as proposed solutions in LLM. The realization of the framework is yet to be completed.


title: MORL-Prompt: An Empirical Analysis of Multi-Objective Reinforcement Learning for Discrete Prompt Optimization

abstract: RL-based techniques can be used to search for prompts that when fed into a target language model maximize a set of user-specified reward functions. However, in many target applications, the natural reward functions are in tension with one another -- for example, content preservation vs. style matching in style transfer tasks. Current techniques focus on maximizing the average of reward functions, which does not necessarily lead to prompts that achieve balance across rewards -- an issue that has been well-studied in the multi-objective and robust optimization literature. In this paper, we adapt several techniques for multi-objective optimization to RL-based discrete prompt optimization -- two that consider volume of the Pareto reward surface, and another that chooses an update direction that benefits all rewards simultaneously. We conduct an empirical analysis of these methods on two NLP tasks: style transfer and machine translation, each using three competing reward functions. Our experiments demonstrate that multi-objective methods that directly optimize volume perform better and achieve a better balance of all rewards than those that attempt to find monotonic update directions.