title: Quantum Chaos in Random Ising Networks

abstract: We report a systematic investigation of universal quantum chaotic signatures in the transverse field Ising model on an Erd\H{o}s-R\'enyi network. This is achieved by studying local spectral measures such as the level spacing and the level velocity statistics. A spectral form factor analysis is also performed as a global measure, probing energy level correlations at arbitrary spectral distances. Our findings show that these measures capture the breakdown of chaotic behavior upon varying the connectivity and strength of the transverse field in various regimes. We demonstrate that the level spacing statistics and the spectral form factor signal this breakdown for sparsely and densely connected networks. The velocity statistics capture the surviving chaotic signatures in the sparse limit. However, these integrable-like regimes extend over a vanishingly small segment in the full range of connectivity.

categories: cond-mat.dis-nn cond-mat.stat-mech nlin.CD quant-ph


title: CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization

abstract: Training large AI models such as deep learning recommendation systems and foundation language (or multi-modal) models costs massive GPUs and computing time. The high training cost has become only affordable to big tech companies, meanwhile also causing increasing concerns about the environmental impact. This paper presents CoMERA, a Computing- and Memory-Efficient training method via Rank-Adaptive tensor optimization. CoMERA achieves end-to-end rank-adaptive tensor-compressed training via a multi-objective optimization formulation, and improves the training to provide both a high compression ratio and excellent accuracy in the training process. Our optimized numerical computation (e.g., optimized tensorized embedding and tensor-vector contractions) and GPU implementation eliminate part of the run-time overhead in the tensorized training on GPU. This leads to, for the first time, $2-3\times$ speedup per training epoch compared with standard training. CoMERA also outperforms the recent GaLore in terms of both memory and computing efficiency. Specifically, CoMERA is $2\times$ faster per training epoch and $9\times$ more memory-efficient than GaLore on a tested six-encoder transformer with single-batch training. With further HPC optimization, CoMERA may significantly reduce the training cost of large language models.


title: Spin-$S\,$ Kitaev-Heisenberg model on the honeycomb lattice: A high-order treatment via the many-body coupled cluster method

abstract: We study the spin-$S$ Kitaev-Heisenberg model on the honeycomb lattice for $S\!=\!1/2$, $1$ and $3/2$, by using the coupled cluster method (CCM) of microscopic quantum many-body theory. This system is one of the earliest extensions of the Kitaev model and is believed to contain two extended spin liquid phases for any value of the spin quantum number $S$. We show that the CCM delivers accurate estimates for the phase boundaries of these spin liquid phases, as well as other transition points in the phase diagram. Moreover, we find evidence of two unexpected narrow phases for $S\!=\!1/2$, one sandwiched between the zigzag and ferromagnetic phases and the other between the N\'eel and the stripy phases. The results establish the CCM as a versatile numerical technique that can capture the strong quantum-mechanical fluctuations that are inherently present in generalized Kitaev models with competing bond-dependent anisotropies.


title: Can Large Language Models Create New Knowledge for Spatial Reasoning Tasks?

abstract: The potential for Large Language Models (LLMs) to generate new information offers a potential step change for research and innovation. This is challenging to assert as it can be difficult to determine what an LLM has previously seen during training, making "newness" difficult to substantiate. In this paper we observe that LLMs are able to perform sophisticated reasoning on problems with a spatial dimension, that they are unlikely to have previously directly encountered. While not perfect, this points to a significant level of understanding that state-of-the-art LLMs can now achieve, supporting the proposition that LLMs are able to yield significant emergent properties. In particular, Claude 3 is found to perform well in this regard.


title: Determining $\alpha_s(m_Z)$ from Thrust with Power Corrections

abstract: We update and extend a previous N$^3$LL$^\prime$+${\cal O}(\alpha_s^3)$ strong coupling determination from thrust data. In particular, we carry out a fit with data fully restricted to the dijet region seeking to minimize the potential impact of power corrections that go beyond dijet configurations. In addition, we parametrize deviations from the dijet power correction in order to add an additional source of uncertainty in the result for $\alpha_s(m_Z)$. We also show that the inclusion of resummation is important to achieve stability with respect to varying the fit region.


title: A high-level comparison of state-of-the-art quantum algorithms for breaking asymmetric cryptography

abstract: We provide a high-level cost comparison between Regev's quantum algorithm with Eker{\aa}-G\"artner's extensions on the one hand, and existing state-of-the-art quantum algorithms for factoring and computing discrete logarithms on the other. This when targeting cryptographically relevant problem instances, and when accounting for the space-saving optimizations of Ragavan and Vaikuntanathan that apply to Regev's algorithm, and optimizations such as windowing that apply to the existing algorithms. Our conclusion is that Regev's algorithm without the space-saving optimizations may achieve a per-run advantage, but not an overall advantage, if non-computational quantum memory is cheap. Regev's algorithm with the space-saving optimizations does not achieve an advantage, since it uses more computational memory, whilst also performing more work, per run and overall, compared to the existing state-of-the-art algorithms. As such, further optimizations are required for it to achieve an advantage for cryptographically relevant problem instances.


title: Multi-purpose robot for rehabilitation of small diameter water pipes

abstract: Rehabilitating cast iron pipes through lining offers several advantages, including increased durability, reduced water leaks, and minimal disruption.This approach presents a cost effective and environmentally friendly solution by sealing cracks and joints, extending the pipeline's lifespan, and reducing water wastage, all while avoiding the need for trench excavation. However, due to the relining process, branch connections are sealed and need to be reestablished. To address the issue of rehabilitating small-diameter water pipes, we have designed a modular robot capable of traversing and working within 200 meter long, 100 mm diameter cast iron pipes. This robot is equipped with perception functions to detect, locate, and characterize the branch connections in cast iron pipes and relocate them after lining, as well as machining functions. A first prototype of this system has been developed and validated on an 8 meter long section, in a laboratory environment.


title: Perception of Knowledge Boundary for Large Language Models through Semi-open-ended Question Answering

abstract: Large Language Models (LLMs) are widely used for knowledge-seeking yet suffer from hallucinations. The knowledge boundary (KB) of an LLM limits its factual understanding, beyond which it may begin to hallucinate. Investigating the perception of LLMs' KB is crucial for detecting hallucinations and LLMs' reliable generation. Current studies perceive LLMs' KB on questions with a concrete answer (close-ended questions) while paying limited attention to semi-open-ended questions (SoeQ) that correspond to many potential answers. Some researchers achieve it by judging whether the question is answerable or not. However, this paradigm is unsuitable for SoeQ, which are usually partially answerable, containing both answerable and ambiguous (unanswerable) answers. Ambiguous answers are essential for knowledge-seeking, but they may go beyond the KB of LLMs. In this paper, we perceive the LLMs' KB with SoeQ by discovering more ambiguous answers. First, we apply an LLM-based approach to construct SoeQ and obtain answers from a target LLM. Unfortunately, the output probabilities of mainstream black-box LLMs are inaccessible to sample for low-probability ambiguous answers. Therefore, we apply an open-sourced auxiliary model to explore ambiguous answers for the target LLM. We calculate the nearest semantic representation for existing answers to estimate their probabilities, with which we reduce the generation probability of high-probability answers to achieve a more effective generation. Finally, we compare the results from the RAG-based evaluation and LLM self-evaluation to categorize four types of ambiguous answers that are beyond the KB of the target LLM. Following our method, we construct a dataset to perceive the KB for GPT-4. We find that GPT-4 performs poorly on SoeQ and is often unaware of its KB. Besides, our auxiliary model, LLaMA-2-13B, is effective in discovering more ambiguous answers.


title: Reliable Trajectory Prediction and Uncertainty Quantification with Conditioned Diffusion Models

abstract: This work introduces the conditioned Vehicle Motion Diffusion (cVMD) model, a novel network architecture for highway trajectory prediction using diffusion models. The proposed model ensures the drivability of the predicted trajectory by integrating non-holonomic motion constraints and physical constraints into the generative prediction module. Central to the architecture of cVMD is its capacity to perform uncertainty quantification, a feature that is crucial in safety-critical applications. By integrating the quantified uncertainty into the prediction process, the cVMD's trajectory prediction performance is improved considerably. The model's performance was evaluated using the publicly available highD dataset. Experiments show that the proposed architecture achieves competitive trajectory prediction accuracy compared to state-of-the-art models, while providing guaranteed drivable trajectories and uncertainty quantification.


title: Emotion Identification for French in Written Texts: Considering their Modes of Expression as a Step Towards Text Complexity Analysis

abstract: The objective of this paper is to predict (A) whether a sentence in a written text expresses an emotion, (B) the mode(s) in which it is expressed, (C) whether it is basic or complex, and (D) its emotional category. One of our major contributions, through a dataset and a model, is to integrate the fact that an emotion can be expressed in different modes: from a direct mode, essentially lexicalized, to a more indirect mode, where emotions will only be suggested, a mode that NLP approaches generally don't take into account. Another originality is that the scope is on written texts, as opposed usual work focusing on conversational (often multi-modal) data. In this context, modes of expression are seen as a factor towards the automatic analysis of complexity in texts. Experiments on French texts show acceptable results compared to the human annotators' agreement, and outperforming results compared to using a large language model with in-context learning (i.e. no fine-tuning).


title: Capsule Network Projectors are Equivariant and Invariant Learners

abstract: Learning invariant representations has been the longstanding approach to self-supervised learning. However, recently progress has been made in preserving equivariant properties in representations, yet do so with highly prescribed architectures. In this work, we propose an invariant-equivariant self-supervised architecture that employs Capsule Networks (CapsNets) which have been shown to capture equivariance with respect to novel viewpoints. We demonstrate that the use of CapsNets in equivariant self-supervised architectures achieves improved downstream performance on equivariant tasks with higher efficiency and fewer network parameters. To accommodate the architectural changes of CapsNets, we introduce a new objective function based on entropy minimisation. This approach, which we name CapsIE (Capsule Invariant Equivariant Network), achieves state-of-the-art performance across all invariant and equivariant downstream tasks on the 3DIEBench dataset, while outperforming supervised baselines. Our results demonstrate the ability of CapsNets to learn complex and generalised representations for large-scale, multi-task datasets compared to previous CapsNet benchmarks. Code is available at https://github.com/AberdeenML/CapsIE.


title: Uniform growth in small cancellation groups

abstract: An open question asks whether every group acting acylindrically on a hyperbolic space has uniform exponential growth. We prove that the class of groups of uniform uniform exponential growth acting acylindrically on a hyperbolic space is closed under taking certain geometric small cancellation quotients. There are two consequences: firstly, there is a finitely generated acylindrically hyperbolic group that has uniform exponential growth but has arbitrarily large torsion balls. Secondly, the uniform uniform exponential growth rate of a classical $C''(\lambda)$-small cancellation group, for sufficiently small $\lambda$, is bounded from below by a universal positive constant. We give a similar result for uniform entropy-cardinality estimates. This yields an explicit upper bound on the isomorphism class of marked $\delta$-hyperbolic $C''(\lambda)$-small cancellation groups of uniformly bounded entropy in terms of $\delta$ and the entropy bound.


title: Evaluation of the Programming Skills of Large Language Models

abstract: The advent of Large Language Models (LLM) has revolutionized the efficiency and speed with which tasks are completed, marking a significant leap in productivity through technological innovation. As these chatbots tackle increasingly complex tasks, the challenge of assessing the quality of their outputs has become paramount. This paper critically examines the output quality of two leading LLMs, OpenAI's ChatGPT and Google's Gemini AI, by comparing the quality of programming code generated in both their free versions. Through the lens of a real-world example coupled with a systematic dataset, we investigate the code quality produced by these LLMs. Given their notable proficiency in code generation, this aspect of chatbot capability presents a particularly compelling area for analysis. Furthermore, the complexity of programming code often escalates to levels where its verification becomes a formidable task, underscoring the importance of our study. This research aims to shed light on the efficacy and reliability of LLMs in generating high-quality programming code, an endeavor that has significant implications for the field of software development and beyond.


title: stl2vec: Semantic and Interpretable Vector Representation of Temporal Logic

abstract: Integrating symbolic knowledge and data-driven learning algorithms is a longstanding challenge in Artificial Intelligence. Despite the recognized importance of this task, a notable gap exists due to the discreteness of symbolic representations and the continuous nature of machine-learning computations. One of the desired bridges between these two worlds would be to define semantically grounded vector representation (feature embedding) of logic formulae, thus enabling to perform continuous learning and optimization in the semantic space of formulae. We tackle this goal for knowledge expressed in Signal Temporal Logic (STL) and devise a method to compute continuous embeddings of formulae with several desirable properties: the embedding (i) is finite-dimensional, (ii) faithfully reflects the semantics of the formulae, (iii) does not require any learning but instead is defined from basic principles, (iv) is interpretable. Another significant contribution lies in demonstrating the efficacy of the approach in two tasks: learning model checking, where we predict the probability of requirements being satisfied in stochastic processes; and integrating the embeddings into a neuro-symbolic framework, to constrain the output of a deep-learning generative model to comply to a given logical specification.


title: Speculating About Multi-user Conversational Interfaces and LLMs: What If Chatting Wasn't So Lonely?

abstract: The advent of LLMs means that CUIs are cool again, but what isn't so cool is that we're doomed to use them alone. The one user, one account, one device paradigm has dominated the design of CUIs and is not going away as new conversational technologies emerge. In this provocation we explore some of the technical, legal, and design difficulties that seem to make multi-user CUIs so difficult to implement. Drawing inspiration from the ways that people manage messy group discussions, such as parliamentary and consensus-based paradigms, we show how LLM-based CUIs might be well suited to bridging the gap. With any luck, this might even result in everyone having to sit through fewer poorly run meetings and agonising group discussions - truly a laudable goal!


title: Explainable Few-shot Knowledge Tracing

abstract: Knowledge tracing (KT), aiming to mine students' mastery of knowledge by their exercise records and predict their performance on future test questions, is a critical task in educational assessment. While researchers achieved tremendous success with the rapid development of deep learning techniques, current knowledge tracing tasks fall into the cracks from real-world teaching scenarios. Relying heavily on extensive student data and solely predicting numerical performances differs from the settings where teachers assess students' knowledge state from limited practices and provide explanatory feedback. To fill this gap, we explore a new task formulation: Explainable Few-shot Knowledge Tracing. By leveraging the powerful reasoning and generation abilities of large language models (LLMs), we then propose a cognition-guided framework that can track the student knowledge from a few student records while providing natural language explanations. Experimental results from three widely used datasets show that LLMs can perform comparable or superior to competitive deep knowledge tracing methods. We also discuss potential directions and call for future improvements in relevant topics.


title: Markovian Flow Matching: Accelerating MCMC with Continuous Normalizing Flows

abstract: Continuous normalizing flows (CNFs) learn the probability path between a reference and a target density by modeling the vector field generating said path using neural networks. Recently, Lipman et al. (2022) introduced a simple and inexpensive method for training CNFs in generative modeling, termed flow matching (FM). In this paper, we re-purpose this method for probabilistic inference by incorporating Markovian sampling methods in evaluating the FM objective and using the learned probability path to improve Monte Carlo sampling. We propose a sequential method, which uses samples from a Markov chain to fix the probability path defining the FM objective. We augment this scheme with an adaptive tempering mechanism that allows the discovery of multiple modes in the target. Under mild assumptions, we establish convergence to a local optimum of the FM objective, discuss improvements in the convergence rate, and illustrate our methods on synthetic and real-world examples.


title: Qualifying and Quantifying the Benefits of Mindfulness Practices for IT Workers

abstract: The well-being and productivity of IT workers are crucial for both individual success and the overall prosperity of the organisations they serve. This study proposes mindfulness to alleviate stress and improve mental well-being for IT workers. During an 8-week program, IT workers learn about mindfulness, coupled with breathing practices. This study investigates the potential effects of these practices by analysing participants' reflections through thematic analysis and daily well-being ratings. The analysis showcased an increase in mental well-being and perceived productivity. It also indicated a change in the participants' perception, which showed increased self-awareness. The study recommends continuing the program in the industry to see its impact on work outputs.


title: Instruction Tuning With Loss Over Instructions

abstract: Instruction tuning plays a crucial role in shaping the outputs of language models (LMs) to desired styles. In this work, we propose a simple yet effective method, Instruction Modelling (IM), which trains LMs by applying a loss function to the instruction and prompt part rather than solely to the output part. Through experiments across 21 diverse benchmarks, we show that, in many scenarios, IM can effectively improve the LM performance on both NLP tasks (e.g., MMLU, TruthfulQA, and HumanEval) and open-ended generation benchmarks (e.g., MT-Bench and AlpacaEval). Remarkably, in the most advantageous case, IM boosts model performance on AlpacaEval 1.0 by over 100%. We identify two key factors influencing the effectiveness of IM: (1) The ratio between instruction length and output length in the training data; and (2) The number of training examples. We observe that IM is especially beneficial when trained on datasets with lengthy instructions paired with brief outputs, or under the Superficial Alignment Hypothesis (SAH) where a small amount of training examples are used for instruction tuning. Further analysis substantiates our hypothesis that the improvement can be attributed to reduced overfitting to instruction tuning datasets. Our work provides practical guidance for instruction tuning LMs, especially in low-resource scenarios.


title: Edge Zeta Functions and Eigenvalues for Buildings of Finite Groups of Lie Type

abstract: We study the edge zeta functions of buildings associated to a finite group of Lie type, and prove that all the edge eigenvalues of these buildings are certain roots of powers of q. This work vastly generalizes the type A case, and generalizes Brouwer's work on oppositeness graph of these buildings.


title: Corrupted sensing quantum state tomography

abstract: The reliable characterization of quantum states as well as any potential noise in various quantum systems is crucial for advancing quantum technologies. In this work we propose the concept of corrupted sensing quantum state tomography which enables the simultaneous reconstruction of quantum states and structured noise with the aid of simple Pauli measurements only. Without additional prior information, we investigate the reliability and robustness of the framework. The power of our algorithm is demonstrated by assuming Gaussian and Poisson sparse noise for low-rank state tomography. In particular, our approach is able to achieve a high quality of the recovery with incomplete sets of measurements and is also suitable for performance improvement of large quantum systems. It is envisaged that the techniques can become a practical tool to greatly reduce the cost and computational effort for quantum tomography in noisy quantum systems.


title: BORA: A Personalized Data Display for Large-scale Experiments

abstract: Given the rapid improvement of the detectors at high-energy physics experiments, the need for real-time data monitoring systems has become imperative. The significance of these systems lies in their ability to display experiment status, steer software and hardware instrumentation, and provide alarms, thus enabling researchers to manage their experiments better. However, researchers typically build most data monitoring systems as standalone in-house solutions that cannot be reused for other experiments or future upgrades. We present BORA (personalized collaBORAtive data display), a lightweight browser-based monitoring system that supports diverse protocols and is built specifically for customizable visualization of complex data, which we standardize via video streaming. We show how absolute positioning layout and visual overlay background can address the diverse data display design requirements. Using the client-server architecture, we enable support for diverse communication protocols, with the server component responsible for parsing the incoming data. We integrate the Jupyter Notebook as part of our ecosystem to address the limitations of the web-based framework, providing a foundation to leverage scripting capabilities and integrate popular AI frameworks. Since video streaming is a core component of our framework, we evaluate viable approaches to streaming protocols like HLS, WebRTC, and MPEG-Websocket. The study explores the implications for our use case, highlighting its potential to transform data visualization and decision-making processes.


title: SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network

abstract: Surface electromyography (sEMG) based gesture recognition offers a natural and intuitive interaction modality for wearable devices. Despite significant advancements in sEMG-based gesture-recognition models, existing methods often suffer from high computational latency and increased energy consumption. Additionally, the inherent instability of sEMG signals, combined with their sensitivity to distribution shifts in real-world settings, compromises model robustness. To tackle these challenges, we propose a novel SpGesture framework based on Spiking Neural Networks, which possesses several unique merits compared with existing methods: (1) Robustness: By utilizing membrane potential as a memory list, we pioneer the introduction of Source-Free Domain Adaptation into SNN for the first time. This enables SpGesture to mitigate the accuracy degradation caused by distribution shifts. (2) High Accuracy: With a novel Spiking Jaccard Attention, SpGesture enhances the SNNs' ability to represent sEMG features, leading to a notable rise in system accuracy. To validate SpGesture's performance, we collected a new sEMG gesture dataset which has different forearm postures, where SpGesture achieved the highest accuracy among the baselines ($89.26\%$). Moreover, the actual deployment on the CPU demonstrated a system latency below 100ms, well within real-time requirements. This impressive performance showcases SpGesture's potential to enhance the applicability of sEMG in real-world scenarios. The code is available at https://anonymous.4open.science/r/SpGesture.


title: Endowing Interpretability for Neural Cognitive Diagnosis by Efficient Kolmogorov-Arnold Networks

abstract: In the realm of intelligent education, cognitive diagnosis plays a crucial role in subsequent recommendation tasks attributed to the revealed students' proficiency in knowledge concepts. Although neural network-based neural cognitive diagnosis models (CDMs) have exhibited significantly better performance than traditional models, neural cognitive diagnosis is criticized for the poor model interpretability due to the multi-layer perception (MLP) employed, even with the monotonicity assumption. Therefore, this paper proposes to empower the interpretability of neural cognitive diagnosis models through efficient kolmogorov-arnold networks (KANs), named KAN2CD, where KANs are designed to enhance interpretability in two manners. Specifically, in the first manner, KANs are directly used to replace the used MLPs in existing neural CDMs; while in the second manner, the student embedding, exercise embedding, and concept embedding are directly processed by several KANs, and then their outputs are further combined and learned in a unified KAN to get final predictions. To overcome the problem of training KANs slowly, we modify the implementation of original KANs to accelerate the training. Experiments on four real-world datasets show that the proposed KA2NCD exhibits better performance than traditional CDMs, and the proposed KA2NCD still has a bit of performance leading even over the existing neural CDMs. More importantly, the learned structures of KANs enable the proposed KA2NCD to hold as good interpretability as traditional CDMs, which is superior to existing neural CDMs. Besides, the training cost of the proposed KA2NCD is competitive to existing models.


title: Verifying Global Two-Safety Properties in Neural Networks with Confidence

abstract: We present the first automated verification technique for confidence-based 2-safety properties, such as global robustness and global fairness, in deep neural networks (DNNs). Our approach combines self-composition to leverage existing reachability analysis techniques and a novel abstraction of the softmax function, which is amenable to automated verification. We characterize and prove the soundness of our static analysis technique. Furthermore, we implement it on top of Marabou, a safety analysis tool for neural networks, conducting a performance evaluation on several publicly available benchmarks for DNN verification.


title: Roots and Logarithms of Multipliers

abstract: By now it is a well-known fact that if $f$ is a multiplier for the Drury-Arveson space $H^2_n$, and if there is a $c>0$ such that $|f(z)|\geq c$ for every $z\in B$, then the reciprocal function 1/f is also a multiplier for $H^2_n$. We show that for such an $f$ and for every $t\in \mathbb{R}$, $f^t$ is also a multiplier for $H^2_n$. We do so by deriving a differentiation formula for $R^m(f^th)$.Moreover, by this formula the same result holds for spaces $H_{m,s}$ of the Besov-Dirichlet type. The same technique also gives us the result that for a non-vanishing multiplier $f$ of $H^2_n$, $log f$ is a multiplier of $H^2_n$ if and only if log $f$ is bounded on $B$.


title: Exact Gauss-Newton Optimization for Training Deep Neural Networks

abstract: We present EGN, a stochastic second-order optimization algorithm that combines the generalized Gauss-Newton (GN) Hessian approximation with low-rank linear algebra to compute the descent direction. Leveraging the Duncan-Guttman matrix identity, the parameter update is obtained by factorizing a matrix which has the size of the mini-batch. This is particularly advantageous for large-scale machine learning problems where the dimension of the neural network parameter vector is several orders of magnitude larger than the batch size. Additionally, we show how improvements such as line search, adaptive regularization, and momentum can be seamlessly added to EGN to further accelerate the algorithm. Moreover, under mild assumptions, we prove that our algorithm converges to an $\epsilon$-stationary point at a linear rate. Finally, our numerical experiments demonstrate that EGN consistently exceeds, or at most matches the generalization performance of well-tuned SGD, Adam, and SGN optimizers across various supervised and reinforcement learning tasks.


title: Representative electricity price profiles for European day-ahead and intraday spot markets

abstract: We propose a method to construct representative price profiles of the day-ahead (DA) and the intraday (ID) electricity spot markets and use this method to provide examples of ready-to-use price data sets. In contrast to common scenario generation approaches, the method is deterministic and relies on a small number of degrees of freedom, with the aim to be well defined and easy to use. We thereby target an enhanced comparability of future research studies on demand-side management and energy cost optimization. We construct the price profiles based on historical time series from the spot markets of interest, e.g., European Power Exchange (EPEX) spot. To this end, we extract key price components from the data while also accounting for known dominant mechanisms in the price variation. Further, the method is able to preserve key statistical features of the historical data (e.g., mean and standard deviation) when constructing the benchmark profile. Finally, our approach ensures comparability of ID and DA price profiles by design, as their cumulative (integral) price can be made identical if needed.


title: Hadronic molecules with four charm or beauty quarks

abstract: We apply the extended local hidden gauge formalism to study the meson-meson interactions with the quark constituents $cc\bar c\bar c$, $cc\bar c\bar b/\bar c\bar c cb$, $cc\bar b\bar b/\bar c\bar c bb$, $bb\bar c\bar b/\bar b\bar b cb$, and $bb\bar b\bar b$, where the exchanged mesons can only be the fully-heavy vector mesons $J/\psi$, $B_c^*$, and $\Upsilon$. We solve the coupled-channel Bethe-Salpeter equation to derive two poles in the $bb\bar c\bar b$ system and two poles in the $cc\bar c\bar b$ system (with four charge-conjugated poles in the $\bar b\bar b cb$ and $\bar c\bar c cb$ systems): one pole existing in the $bb\bar c\bar b$ system corresponds to the sub-threshold bound state when setting the cutoff momentum $\Lambda > 850$ MeV, while it causes the threshold effect with $\Lambda < 850$ MeV; the other pole existing in this system corresponds to the sub-threshold bound state with $\Lambda > 1100$ MeV; the two poles existing in the $cc\bar c\bar b$ system correspond to the sub-threshold bound states only when setting $\Lambda > 1550$ MeV and $\Lambda > 2650$ MeV, making them difficult to be identified as deeply-bound hadronic molecules. We propose to investigate the two poles of the $bb\bar c\bar b$ system in the $\mu^+\mu^-B_c^-$ channel at LHC.


title: Qubit-efficient Variational Quantum Algorithms for Image Segmentation

abstract: Quantum computing is expected to transform a range of computational tasks beyond the reach of classical algorithms. In this work, we examine the application of variational quantum algorithms (VQAs) for unsupervised image segmentation to partition images into separate semantic regions. Specifically, we formulate the task as a graph cut optimization problem and employ two established qubit-efficient VQAs, which we refer to as Parametric Gate Encoding (PGE) and Ancilla Basis Encoding (ABE), to find the optimal segmentation mask. In addition, we propose Adaptive Cost Encoding (ACE), a new approach that leverages the same circuit architecture as ABE but adopts a problem-dependent cost function. We benchmark PGE, ABE and ACE on synthetically generated images, focusing on quality and trainability. ACE shows consistently faster convergence in training the parameterized quantum circuits in comparison to PGE and ABE. Furthermore, we provide a theoretical analysis of the scalability of these approaches against the Quantum Approximate Optimization Algorithm (QAOA), showing a significant cutback in the quantum resources, especially in the number of qubits that logarithmically depends on the number of pixels. The results validate the strengths of ACE, while concurrently highlighting its inherent limitations and challenges. This paves way for further research in quantum-enhanced computer vision.


title: A Unification Between Deep-Learning Vision, Compartmental Dynamical Thermodynamics, and Robotic Manipulation for a Circular Economy

abstract: The shift from a linear to a circular economy has the potential to simultaneously reduce uncertainties of material supplies and waste generation. To date, the development of robotic and, more generally, autonomous systems have been rarely integrated into circular economy implementation strategies. In this review, we merge deep-learning vision, compartmental dynamical thermodynamics, and robotic manipulation into a theoretically-coherent physics-based research framework to lay the foundations of circular flow designs of materials, and hence, to speed-up the transition from linearity to circularity. Then, we discuss opportunities for robotics in circular economy.


title: Gradient Transformation: Towards Efficient and Model-Agnostic Unlearning for Dynamic Graph Neural Networks

abstract: Graph unlearning has emerged as an essential tool for safeguarding user privacy and mitigating the negative impacts of undesirable data. Meanwhile, the advent of dynamic graph neural networks (DGNNs) marks a significant advancement due to their superior capability in learning from dynamic graphs, which encapsulate spatial-temporal variations in diverse real-world applications (e.g., traffic forecasting). With the increasing prevalence of DGNNs, it becomes imperative to investigate the implementation of dynamic graph unlearning. However, current graph unlearning methodologies are designed for GNNs operating on static graphs and exhibit limitations including their serving in a pre-processing manner and impractical resource demands. Furthermore, the adaptation of these methods to DGNNs presents non-trivial challenges, owing to the distinctive nature of dynamic graphs. To this end, we propose an effective, efficient, model-agnostic, and post-processing method to implement DGNN unlearning. Specifically, we first define the unlearning requests and formulate dynamic graph unlearning in the context of continuous-time dynamic graphs. After conducting a role analysis on the unlearning data, the remaining data, and the target DGNN model, we propose a method called Gradient Transformation and a loss function to map the unlearning request to the desired parameter update. Evaluations on six real-world datasets and state-of-the-art DGNN backbones demonstrate its effectiveness (e.g., limited performance drop even obvious improvement) and efficiency (e.g., at most 7.23$\times$ speed-up) outperformance, and potential advantages in handling future unlearning requests (e.g., at most 32.59$\times$ speed-up).


title: Adaptive tempering schedules with approximative intermediate measures for filtering problems

abstract: Data assimilation algorithms integrate prior information from numerical model simulations with observed data. Ensemble-based filters, regarded as state-of-the-art, are widely employed for large-scale estimation tasks in disciplines such as geoscience and meteorology. Despite their inability to produce the true posterior distribution for nonlinear systems, their robustness and capacity for state tracking are noteworthy. In contrast, Particle filters yield the correct distribution in the ensemble limit but require substantially larger ensemble sizes than ensemble-based filters to maintain stability in higher-dimensional spaces. It is essential to transcend traditional Gaussian assumptions to achieve realistic quantification of uncertainties. One approach involves the hybridisation of filters, facilitated by tempering, to harness the complementary strengths of different filters. A new adaptive tempering method is proposed to tune the underlying schedule, aiming to systematically surpass the performance previously achieved. Although promising numerical results for certain filter combinations in toy examples exist in the literature, the tuning of hyperparameters presents a considerable challenge. A deeper understanding of these interactions is crucial for practical applications.


title: Investigating the Common Authorship of Signatures by Off-Line Automatic Signature Verification Without the Use of Reference Signatures

abstract: In automatic signature verification, questioned specimens are usually compared with reference signatures. In writer-dependent schemes, a number of reference signatures are required to build up the individual signer model while a writer-independent system requires a set of reference signatures from several signers to develop the model of the system. This paper addresses the problem of automatic signature verification when no reference signatures are available. The scenario we explore consists of a set of signatures, which could be signed by the same author or by multiple signers. As such, we discuss three methods which estimate automatically the common authorship of a set of off-line signatures. The first method develops a score similarity matrix, worked out with the assistance of duplicated signatures; the second uses a feature-distance matrix for each pair of signatures; and the last method introduces pre-classification based on the complexity of each signature. Publicly available signatures were used in the experiments, which gave encouraging results. As a baseline for the performance obtained by our approaches, we carried out a visual Turing Test where forensic and non-forensic human volunteers, carrying out the same task, performed less well than the automatic schemes.


title: Time-dependent Hamiltonians and Geometry of Operators Generated by Them

abstract: We obtain the complexity geometry associated with the Hamiltonian of a quantum mechanical system, specifically in cases where the Hamiltonian is explicitly time-dependent. Using Nielsen's geometric formulation of circuit complexity, we calculate the bi-invariant cost associated with these time-dependent Hamiltonians by suitably regularising their norms and obtain analytical expressions of the costs for several well-known time-dependent quantum mechanical systems. Specifically, we show that an equivalence exists between the total costs of obtaining an operator through time evolution generated by a unit mass harmonic oscillator whose frequency depends on time, and a harmonic oscillator whose both mass and frequency are functions of time. These results are illustrated with several examples, including a specific smooth quench protocol where the comparison of time variation of the cost with other information theoretic quantities, such as the Shannon entropy, is discussed.


title: Large Language Models for Explainable Decisions in Dynamic Digital Twins

abstract: Dynamic data-driven Digital Twins (DDTs) can enable informed decision-making and provide an optimisation platform for the underlying system. By leveraging principles of Dynamic Data-Driven Applications Systems (DDDAS), DDTs can formulate computational modalities for feedback loops, model updates and decision-making, including autonomous ones. However, understanding autonomous decision-making often requires technical and domain-specific knowledge. This paper explores using large language models (LLMs) to provide an explainability platform for DDTs, generating natural language explanations of the system's decision-making by leveraging domain-specific knowledge bases. A case study from smart agriculture is presented.


title: Experimental investigation of an electronegative cylindrical capacitively coupled geometrically asymmetric plasma discharge with an axisymmetric magnetic field

abstract: In this study, we have investigated the production of negative ions by mixing electronegative oxygen gas with electropositive argon gas in a geometrically asymmetric cylindrical capacitively coupled radio frequency plasma discharge. The plasma parameters such as density (electron, positive and negative ion), negative ion fraction, and electron temperature are investigated for fixed gas pressure and increasing axial magnetic field strength. The axisymmetric magnetic field creates an ExB drift in the azimuthal direction, leading to the confinement of high-energy electrons at the radial edge of the chamber, resulting in decreased species density and negative ion fraction in the plasma bulk. However, the electron temperature increases with the magnetic field. It is concluded that low magnetic fields are better suited for negative ion production in such devices. Furthermore, in addition to the percentage ratio of the two gases, the applied axial magnetic field also plays a vital role in controlling negative ion fraction.


title: GeoFaaS: An Edge-to-Cloud FaaS Platform

abstract: The massive growth of mobile and IoT devices demands geographically distributed computing systems for optimal performance, privacy, and scalability. However, existing edge-to-cloud serverless platforms lack location awareness, resulting in inefficient network usage and increased latency. In this paper, we propose GeoFaaS, a novel edge-to-cloud Function-as-a-Service (FaaS) platform that leverages real-time client location information for transparent request execution on the nearest available FaaS node. If needed, GeoFaaS transparently offloads requests to the cloud when edge resources are overloaded, thus, ensuring consistent execution without user intervention. GeoFaaS has a modular and decentralized architecture: building on the single-node FaaS system tinyFaaS, GeoFaaS works as a stand-alone edge-to-cloud FaaS platform but can also integrate and act as a routing layer for existing FaaS services, e.g., in the cloud. To evaluate our approach, we implemented an open-source proof-of-concept prototype and studied performance and fault-tolerance behavior in experiments.


title: Proving Theorems Recursively

abstract: Recent advances in automated theorem proving leverages language models to explore expanded search spaces by step-by-step proof generation. However, such approaches are usually based on short-sighted heuristics (e.g., log probability or value function scores) that potentially lead to suboptimal or even distracting subgoals, preventing us from finding longer proofs. To address this challenge, we propose POETRY (PrOvE Theorems RecursivelY), which proves theorems in a recursive, level-by-level manner in the Isabelle theorem prover. Unlike previous step-by-step methods, POETRY searches for a verifiable sketch of the proof at each level and focuses on solving the current level's theorem or conjecture. Detailed proofs of intermediate conjectures within the sketch are temporarily replaced by a placeholder tactic called sorry, deferring their proofs to subsequent levels. This approach allows the theorem to be tackled incrementally by outlining the overall theorem at the first level and then solving the intermediate conjectures at deeper levels. Experiments are conducted on the miniF2F and PISA datasets and significant performance gains are observed in our POETRY approach over state-of-the-art methods. POETRY on miniF2F achieves an average proving success rate improvement of 5.1%. Moreover, we observe a substantial increase in the maximum proof length found by POETRY, from 10 to 26.


title: Progress in implementing the kinematical constraint into the small-x JIMWLK evolution equation

abstract: The most complete high-energy evolution of Wilson line operators is described by the set of equations called Balitsky-JIMWLK evolution equations. It is known from the studies of the linear - the BFKL - evolution equation that the leading corrections come from the kinematically enhanced double collinear logarithms. A method for resumming such logarithmic corrections to all orders for the Balitsky-Kovchegov equation is known under the name of kinematical constraint. In this work, we discuss the progress in implementing these corrections into the Langevin formulation of the JIMWLK equation. In particular, we introduce a set of correlation functions which are nonlocal in the rapidity variable. They appear in the construction of the kinematical constraint, however, their behavior with rapidity has not been investigated numerically so far. We derive their large-$N$ evolution equations, solve them numerically, and comment on their implications for the implementation of the full kinematical constraint.


title: VelCrys: Interactive web-based application to compute acoustic wave velocity in crystals and its magnetic corrections

abstract: We present VelCrys, a web-based interactive tool, that allows to perform further post-processing of the elastic tensor in order to compute and plot the group velocity of the acoustic waves for any crystal symmetry. We also implemented the calculation of effective magnetic corrections to the elastic tensor and corresponding fractional change in group velocity under a magnetic field. We apply it to dry sandstone, cubic CoPt and hcp Co to show some of the program features. In the analysis of magnetic corrections, we find complex landscapes of fractional change in group velocity as a function of ray direction, as well as a field dependence consistent with Simon effect.


title: The hydrogen atom perturbed by a 1-dimensional Simple Harmonic Oscillator (1d-SHO) potential

abstract: The hydrogen atom perturbed by a constant 1-dimensional weak quadratic potential $\lambda z^2$ is solved at first-order perturbation theory using the eigenstates of the total angular momentum operator - the coupled basis. Physical applications of this result could be found, for example, in the study of a quadratic Zeeman effect weaker than fine-structure effects, or in a perturbation caused by instantaneous generalised van der Waals interactions.


title: Continuous-time Equilibrium Returns in Markets with Price Impact and Transaction Costs

abstract: We consider an Ito-financial market at which the risky assets' returns are derived endogenously through a market-clearing condition amongst heterogeneous risk-averse investors with quadratic preferences and random endowments. Investors act strategically by taking into account the impact that their orders have on the assets' drift. A frictionless market and an one with quadratic transaction costs are analysed and compared. In the former, we derive the unique Nash equilibrium at which investors' demand processes reveal different hedging needs than their true ones, resulting in a deviation of the Nash equilibrium from its competitive counterpart. Under price impact and transaction costs, we characterize the Nash equilibrium as the (unique) solution of a system of FBSDEs and derive its closed-form expression. We furthermore show that under common risk aversion and absence of noise traders, transaction costs do not change the equilibrium returns. On the contrary, when noise traders are present, the effect of transaction costs on equilibrium returns is amplified due to price impact.


title: Motion-based video compression for resource-constrained camera traps

abstract: Field-captured video allows for detailed studies of spatiotemporal aspects of animal locomotion, decision-making, and environmental interactions. However, despite the affordability of data capture with mass-produced hardware, storage, processing, and transmission overheads pose a significant hurdle to acquiring high-resolution video from field-deployed camera traps. Therefore, efficient compression algorithms are crucial for monitoring with camera traps that have limited access to power, storage, and bandwidth. In this article, we introduce a new motion analysis-based video compression algorithm designed to run on camera trap devices. We implemented and tested this algorithm using a case study of insect-pollinator motion tracking. The algorithm identifies and stores only image regions depicting motion relevant to pollination monitoring, reducing the overall data size by an average of 84% across a diverse set of test datasets while retaining the information necessary for relevant behavioural analysis. The methods outlined in this paper facilitate the broader application of computer vision-enabled, low-powered camera trap devices for remote, in-situ video-based animal motion monitoring.


title: Charged Particles Orbiting a Weakly Magnetized Black Hole Immersed in Quintessential Matter

abstract: A new exact magnetized solution describing a Kiselev black hole immersed in a magnetic field is used for studying the dynamics of charged particles. For a weak magnetic induction, we employ a first-order perturbative approach to analyze the perturbed circular orbits near the minimum of the effective potential. We obtain an approximate solution for the bounded equatorial trajectory subjected to small radial and latitudinal oscillations. The shape of the trajectory localized near the stable circular orbit depends on the relation between the attractive gravitational force and the repulsive quintessence contribution.


title: Schwarzschild metric from Scattering Amplitudes to all orders in $G_N$

abstract: We apply a formulation of Einstein's general relativity with only cubic interactions for deriving the metric of a Schwarzschild black hole to all orders in perturbation theory. This cubic interactions formulation coupled to effective worldline action of a massive point particle allows to derive a recursion relation for the form factors of the off-shell graviton emission current. The unique solution to the recursion relation leads to the Schwarzschild black-hole solution in four dimensions. This provides the first derivation of the black hole metric from a matter source to all orders in perturbation theory from an amplitude approach.


title: Unraveling overoptimism and publication bias in ML-driven science

abstract: Machine Learning (ML) is increasingly used across many disciplines with impressive reported results across many domain areas. However, recent studies suggest that the published performance of ML models are often overoptimistic. Validity concerns are underscored by findings of an inverse relationship between sample size and reported accuracy in published ML models, contrasting with the theory of learning curves where accuracy should improve or remain stable with increasing sample size. This paper investigates factors contributing to overoptimistic accuracy reports in ML-driven science, focusing on data leakage and publication bias. We introduce a novel stochastic model for observed accuracy, integrating parametric learning curves and the aforementioned biases. We then construct an estimator that corrects for these biases in observed data. Theoretical and empirical results show that our framework can estimate the underlying learning curve, providing realistic performance assessments from published results. Applying the model to meta-analyses in ML-driven science, including neuroimaging-based and speech-based classifications of neurological conditions, we find prevalent overoptimism and estimate the inherent limits of ML-based prediction in each domain.


title: A note on composition operators on the bi-disc

abstract: In this note we give a new sufficient condition for the boundedness of the composition operator on the Dirichlet-type space on the disc, via a two dimensional change of variables formula. With the same formula, we characterise the bounded composition operators on the anisotropic Dirichlet-type spaces $\mathfrak{D}_{\vec{a}}(\mathbb{D}^2)$ induced by holomorphic self maps of the bi-disc $\mathbb{D}^2$ of the form $\Phi(z_1,z_2)=(\phi_1(z_1),\phi_2(z_2))$. We also consider the problem of boundedness of composition operators $C_{\Phi}:A^2(\mathbb{D}^2) \to \mathfrak{D}(\mathbb{D}^2)$ for general self maps of the bi-disc, applying some recent results about Carleson measures on the the Dirichlet space of the bi-disc.


title: The interplay between liquid-liquid and ferroelectric phase transitions in supercooled water

abstract: The distinctive characteristics of water, evident in its thermodynamic anomalies, have implications across disciplines from biology to geophysics. Considered a valid hypothesis to rationalize its unique properties, a liquid-liquid phase transition in water's supercooled regime has nowadays been observed in several molecular dynamics simulations and is being actively researched experimentally. Here, we highlight novel and far-reaching implications of water: the interplay between the liquid-liquid and a ferroelectric phase transition. Our results are based on the analysis of extensive molecular dynamics simulations and are explained in the context of a classical density functional theory in mean-field approximation valid for a polar liquid. The theory underpins the potential role of ferroelectricity in promoting the liquid-liquid phase transition. The existence of ferroelectric order in supercooled low-density liquid water is confirmed by the observation in molecular dynamics simulations of collective modes in polarization fluctuations dynamics, traceable to spontaneous breaking of continuous rotational symmetry. Our work opens the door to new experimental investigations of the static and dynamic behavior of water polarization.


title: When predict can also explain: few-shot prediction to select better neural latents

abstract: Latent variable models serve as powerful tools to infer underlying dynamics from observed neural activity. However, due to the absence of ground truth data, prediction benchmarks are often employed as proxies. In this study, we reveal the limitations of the widely-used 'co-smoothing' prediction framework and propose an improved few-shot prediction approach that encourages more accurate latent dynamics. Utilizing a student-teacher setup with Hidden Markov Models, we demonstrate that the high co-smoothing model space can encompass models with arbitrary extraneous dynamics within their latent representations. To address this, we introduce a secondary metric -- a few-shot version of co-smoothing. This involves performing regression from the latent variables to held-out channels in the data using fewer trials. Our results indicate that among models with near-optimal co-smoothing, those with extraneous dynamics underperform in the few-shot co-smoothing compared to 'minimal' models devoid of such dynamics. We also provide analytical insights into the origin of this phenomenon. We further validate our findings on real neural data using two state-of-the-art methods: LFADS and STNDT. In the absence of ground truth, we suggest a proxy measure to quantify extraneous dynamics. By cross-decoding the latent variables of all model pairs with high co-smoothing, we identify models with minimal extraneous dynamics. We find a correlation between few-shot co-smoothing performance and this new measure. In summary, we present a novel prediction metric designed to yield latent variables that more accurately reflect the ground truth, offering a significant improvement for latent dynamics inference.


title: A hybrid systems framework for data-based adaptive control of linear time-varying systems

abstract: We consider the data-driven stabilization of discrete-time linear time-varying systems. The controller is defined as a linear state-feedback law whose gain is adapted to the plant changes through a data-based event-triggering rule. To do so, we monitor the evolution of a data-based Lyapunov function along the solution. When this Lyapunov function does not satisfy a designed desirable condition, an episode is triggered to update the controller gain and the corresponding Lyapunov function using the last collected data. The resulting closed-loop dynamics hence exhibits both physical jumps, due to the system dynamics, and episodic jumps, which naturally leads to a hybrid discrete-time system. We leverage the inherent robustness of the controller and provide general conditions under which various stability notions can be established for the system. Two notable cases where these conditions are satisfied are treated, and numerical results illustrating the relevance of the approach are discussed.


title: Advanced Safety Filter for Smooth Transient Operation of a Battery Energy Storage System

abstract: In this paper, we implement an advanced safety filter to smoothly limit the current of an inverter-based Battery Energy Storage System. The task involves finding suitable Control Barrier Function and Control Lyapunov Function via Sum-of-Squares optimization to certify the system's safety during grid transients. In contrast to the conventional safety filter, the advanced safety filter not only provides a safety certificate but also achieves finite-time convergence to a nominal region. Within this region, the action of the nominal control, i.e. the Enhanced Direct Power Control, remains unaltered by the safety filter. The advanced safety filter is implemented using a Quadratically Constrained Quadratic Program, providing the capability to also encode quadratic input constraints. Finally, we showcase the effectiveness of the implementation through simulations involving a load step at the Point of Common Coupling, and we compare the outcomes with those obtained using a standard vector current controller.


title: Mitigating Quantization Errors Due to Activation Spikes in GLU-Based LLMs

abstract: Modern large language models (LLMs) have established state-of-the-art performance through architectural improvements, but still require significant computational cost for inference. In an effort to reduce the inference cost, post-training quantization (PTQ) has become a popular approach, quantizing weights and activations to lower precision, such as INT8. In this paper, we reveal the challenges of activation quantization in GLU variants, which are widely used in feed-forward network (FFN) of modern LLMs, such as LLaMA family. The problem is that severe local quantization errors, caused by excessive magnitudes of activation in GLU variants, significantly degrade the performance of the quantized LLM. We denote these activations as activation spikes. Our further observations provide a systematic pattern of activation spikes: 1) The activation spikes occur in the FFN of specific layers, particularly in the early and late layers, 2) The activation spikes are dedicated to a couple of tokens, rather than being shared across a sequence. Based on our observations, we propose two empirical methods, Quantization-free Module (QFeM) and Quantization-free Prefix (QFeP), to isolate the activation spikes during quantization. Our extensive experiments validate the effectiveness of the proposed methods for the activation quantization, especially with coarse-grained scheme, of latest LLMs with GLU variants, including LLaMA-2/3, Mistral, Mixtral, SOLAR, and Gemma. In particular, our methods enhance the current alleviation techniques (e.g., SmoothQuant) that fail to control the activation spikes. Code is available at https://github.com/onnoo/activation-spikes.


title: Invariance of Gaussian RKHSs under Koopman operators of stochastic differential equations with constant matrix coefficients

abstract: We consider the Koopman operator semigroup $(K^t)_{t\ge 0}$ associated with stochastic differential equations of the form $dX_t = AX_t\,dt + B\,dW_t$ with constant matrices $A$ and $B$ and Brownian motion $W_t$. We prove that the reproducing kernel Hilbert space $\bH_C$ generated by a Gaussian kernel with a positive definite covariance matrix $C$ is invariant under each Koopman operator $K^t$ if the matrices $A$, $B$, and $C$ satisfy the following Lyapunov-like matrix inequality: $AC^2 + C^2A^\top\le 2BB^\top$. In this course, we prove a characterization concerning the inclusion $\bH_{C_1}\subset\bH_{C_2}$ of Gaussian RKHSs for two positive definite matrices $C_1$ and $C_2$. The question of whether the sufficient Lyapunov-condition is also necessary is left as an open problem.


title: PipeFusion: Displaced Patch Pipeline Parallelism for Inference of Diffusion Transformer Models

abstract: This paper introduces PipeFusion, a novel approach that harnesses multi-GPU parallelism to address the high computational and latency challenges of generating high-resolution images with diffusion transformers (DiT) models. PipeFusion splits images into patches and distributes the network layers across multiple devices. It employs a pipeline parallel manner to orchestrate communication and computations. By leveraging the high similarity between the input from adjacent diffusion steps, PipeFusion eliminates the waiting time in the pipeline by reusing the one-step stale feature maps to provide context for the current step. Our experiments demonstrate that it can generate higher image resolution where existing DiT parallel approaches meet OOM. PipeFusion significantly reduces the required communication bandwidth, enabling DiT inference to be hosted on GPUs connected via PCIe rather than the more costly NVLink infrastructure, which substantially lowers the overall operational expenses for serving DiT models. Our code is publicly available at https://github.com/PipeFusion/PipeFusion.


title: RaFe: Ranking Feedback Improves Query Rewriting for RAG

abstract: As Large Language Models (LLMs) and Retrieval Augmentation Generation (RAG) techniques have evolved, query rewriting has been widely incorporated into the RAG system for downstream tasks like open-domain QA. Many works have attempted to utilize small models with reinforcement learning rather than costly LLMs to improve query rewriting. However, current methods require annotations (e.g., labeled relevant documents or downstream answers) or predesigned rewards for feedback, which lack generalization, and fail to utilize signals tailored for query rewriting. In this paper, we propose ours, a framework for training query rewriting models free of annotations. By leveraging a publicly available reranker, ours~provides feedback aligned well with the rewriting objectives. Experimental results demonstrate that ours~can obtain better performance than baselines.


title: Boosting Robustness by Clipping Gradients in Distributed Learning

abstract: Robust distributed learning consists in achieving good learning performance despite the presence of misbehaving workers. State-of-the-art (SOTA) robust distributed gradient descent (Robust-DGD) methods, relying on robust aggregation, have been proven to be optimal: Their learning error matches the lower bound established under the standard heterogeneity model of $(G, B)$-gradient dissimilarity. The learning guarantee of SOTA Robust-DGD cannot be further improved when model initialization is done arbitrarily. However, we show that it is possible to circumvent the lower bound, and improve the learning performance, when the workers' gradients at model initialization are assumed to be bounded. We prove this by proposing pre-aggregation clipping of workers' gradients, using a novel scheme called adaptive robust clipping (ARC). Incorporating ARC in Robust-DGD provably improves the learning, under the aforementioned assumption on model initialization. The factor of improvement is prominent when the tolerable fraction of misbehaving workers approaches the breakdown point. ARC induces this improvement by constricting the search space, while preserving the robustness property of the original aggregation scheme at the same time. We validate this theoretical finding through exhaustive experiments on benchmark image classification tasks.


title: Discrete Hankel Prolate Spheroidal Wave Functions: Spectral Analysis and Application

abstract: Since the early 1960s, the fields of signal processing, data transmission, channel equalisation, filter design and others have been technologically developed and modernised as a result of the research carried out by D. Slepian and his co-authors H. J Landau and H. O Pollack on the time and band-limited wave system known as discrete and continuous spheroidal waves systems. Our aim in this paper is to introduce new discrete wave sequences called discrete Hankel Prolate spheroidal sequences {\bf DHPSS} and their counterparts in the frequency domain called discrete Hankel Prolate spheroidal wave functions {\bf DHPSWF} as radial parts of different solutions of a discrete multidimensional energy maximization problem similar to the one given by D. Slepian and which will generalize his classical pioneering work. In the meantime, we will ensure that our new family is the eigenfunctions set of a finite rank integral operator defined on $L^2(0,\omega),\,0<\omega<1,$ with an associated kernel given by $\sum_{k=1}^N\phi^{\alpha}_{n}(r)\phi^{\alpha}_{n}(r'),$ where $\phi^{\alpha}_{n}(r)=\frac{\sqrt{2r}J_{\alpha}(s_n^{(\alpha)}r)}{|J_{\alpha+1}(s^{(\alpha)}_n)|},0\leq r\leq 1.$ Here $J_\alpha$ is the Bessel function of the first kind and $(s_n^{(\alpha)})_n$ are the associated positive zeros. In addition, we will extend the various classical results proposed concerning the decay rate and spectral distribution associated with the classical case, then we will finish our work by an application on the Ingham's universal constant which we will specify with an upper bound estimate.


title: X-ray and UV radiation in the planet-forming T-Tauri system PDS 70. Signs of accretion and coronal activity

abstract: Planet formation takes place in protoplanetary discs around young T-Tauri stars. PDS 70 is one of the first confirmed examples of a system where the planets are currently forming in gaps in the disc, and can be directly imaged. One of the main early influences on planet formation is the lifetime of the protoplanetary disk, which is limited by the intense stellar X-ray and UV radiation. Stellar coronal activity and accretion of material onto the star are both potential sources of XUV radiation. Previous \textit{Swift} observations detected UV emission, which were consistent with a low rate of accretion. We present follow up observations with the XMM-Newton observatory, which observed PDS 70 simultaneously in X-ray and UV in order to determine intensity of XUV radiation in the system, and identify if the source is coronal, accretion, or both. We detect a strong source in both X-ray and UV, with an average X-ray 0.2-12 keV luminosity of $1.37\times10^{30}\ \mathrm{erg\ s}^{-1}$, and a possible flare which increased the luminosity to $2.8\times10^{30}\ \mathrm{erg\ s}^{-1}$. The UV flux density is in excess of what would be expected from chromospheric emission, and supports the interpretation that PDS 70 has continuing weak accretion less than $\sim10^{-10}\ \mathrm{M_{\odot}\ yr^{-1}}$. The implications of the detected X-ray and UV radiation are that the disc is likely to be in the final stages of dispersal, and will be completely evaporated in the next million years, bringing an end to the primary planet formation process.


title: High-Level Event Mining: Overview and Future Work

abstract: Process mining traditionally relies on input consisting of low-level events that capture individual activities, such as filling out a form or processing a product. However, many of the complex problems inherent in processes, such as bottlenecks and compliance issues, extend beyond the scope of individual events and process instances. Consider congestion, for instance, it can involve and impact numerous cases, much like how a traffic jam affects many cars simultaneously. High-level event mining seeks to address such phenomena using the regular event data available. This report offers an extensive and comprehensive overview at existing work and challenges encountered when lifting the perspective from individual events and cases to system-level events.


title: LARS-VSA: A Vector Symbolic Architecture For Learning with Abstract Rules

abstract: Human cognition excels at symbolic reasoning, deducing abstract rules from limited samples. This has been explained using symbolic and connectionist approaches, inspiring the development of a neuro-symbolic architecture that combines both paradigms. In parallel, recent studies have proposed the use of a "relational bottleneck" that separates object-level features from abstract rules, allowing learning from limited amounts of data . While powerful, it is vulnerable to the curse of compositionality meaning that object representations with similar features tend to interfere with each other. In this paper, we leverage hyperdimensional computing, which is inherently robust to such interference to build a compositional architecture. We adapt the "relational bottleneck" strategy to a high-dimensional space, incorporating explicit vector binding operations between symbols and relational representations. Additionally, we design a novel high-dimensional attention mechanism that leverages this relational representation. Our system benefits from the low overhead of operations in hyperdimensional space, making it significantly more efficient than the state of the art when evaluated on a variety of test datasets, while maintaining higher or equal accuracy.


title: Combining Denoising Autoencoders with Contrastive Learning to fine-tune Transformer Models

abstract: Recently, using large pretrained Transformer models for transfer learning tasks has evolved to the point where they have become one of the flagship trends in the Natural Language Processing (NLP) community, giving rise to various outlooks such as prompt-based, adapters or combinations with unsupervised approaches, among many others. This work proposes a 3 Phase technique to adjust a base model for a classification task. First, we adapt the model's signal to the data distribution by performing further training with a Denoising Autoencoder (DAE). Second, we adjust the representation space of the output to the corresponding classes by clustering through a Contrastive Learning (CL) method. In addition, we introduce a new data augmentation approach for Supervised Contrastive Learning to correct the unbalanced datasets. Third, we apply fine-tuning to delimit the predefined categories. These different phases provide relevant and complementary knowledge to the model to learn the final task. We supply extensive experimental results on several datasets to demonstrate these claims. Moreover, we include an ablation study and compare the proposed method against other ways of combining these techniques.


title: LoRA-Ensemble: Efficient Uncertainty Modelling for Self-attention Networks

abstract: Numerous crucial tasks in real-world decision-making rely on machine learning algorithms with calibrated uncertainty estimates. However, modern methods often yield overconfident and uncalibrated predictions. Various approaches involve training an ensemble of separate models to quantify the uncertainty related to the model itself, known as epistemic uncertainty. In an explicit implementation, the ensemble approach has high computational cost and high memory requirements. This particular challenge is evident in state-of-the-art neural networks such as transformers, where even a single network is already demanding in terms of compute and memory. Consequently, efforts are made to emulate the ensemble model without actually instantiating separate ensemble members, referred to as implicit ensembling. We introduce LoRA-Ensemble, a parameter-efficient deep ensemble method for self-attention networks, which is based on Low-Rank Adaptation (LoRA). Initially developed for efficient LLM fine-tuning, we extend LoRA to an implicit ensembling approach. By employing a single pre-trained self-attention network with weights shared across all members, we train member-specific low-rank matrices for the attention projections. Our method exhibits superior calibration compared to explicit ensembles and achieves similar or better accuracy across various prediction tasks and datasets.


title: Coherence-enhanced single-qubit thermometry out of equilibrium

abstract: The metrological limits of thermometry operated in nonequilibrium dynamical regimes are analyzed. We consider a finite-dimensional quantum system, employed as a quantum thermometer, in contact with a thermal bath inducing Markovian thermalization dynamics. The quantum thermometer is initialized in a generic quantum state, possibly including quantum coherence w.r.t. the Hamiltonian basis. We prove that the sensitivity of the thermometer, quantified by the quantum Fisher information, is enhanced by the quantum coherence in its initial state. We analytically show this in the specific case of qubit thermometers for which the maximization of the quantum Fisher information occurs at a finite time during the transient of the thermalization dynamics. Such a finite-time sensitivity enhancement can be better than the sensitivity that is achieved asymptotically.


title: Bayesian Adaptive Calibration and Optimal Design

abstract: The process of calibrating computer models of natural phenomena is essential for applications in the physical sciences, where plenty of domain knowledge can be embedded into simulations and then calibrated against real observations. Current machine learning approaches, however, mostly rely on rerunning simulations over a fixed set of designs available in the observed data, potentially neglecting informative correlations across the design space and requiring a large amount of simulations. Instead, we consider the calibration process from the perspective of Bayesian adaptive experimental design and propose a data-efficient algorithm to run maximally informative simulations within a batch-sequential process. At each round, the algorithm jointly estimates the parameters of the posterior distribution and optimal designs by maximising a variational lower bound of the expected information gain. The simulator is modelled as a sample from a Gaussian process, which allows us to correlate simulations and observed data with the unknown calibration parameters. We show the benefits of our method when compared to related approaches across synthetic and real-data problems.


title: Leveraging Natural Load Dynamics with Variable Gear-ratio Actuators

abstract: This paper presents a robotic system where the gear-ratio of an actuator is dynamically changed to either leverage or attenuate the natural load dynamics. Based on this principle, lightweight robotic systems can be made fast and strong; exploiting the natural load dynamics for moving at higher speeds (small reduction ratio), while also able to bear a large load through the attenuation of the load dynamics (large reduction ratio). A model-based control algorithm to automatically select the optimal gear-ratios that minimize the total actuator torques for an arbitrary dynamic state and expected uncertainty level is proposed. Also, a novel 3-DoF robot arm using custom actuators with two discrete gear-ratios is presented. The advantages of gear-shifting dynamically are demonstrated through experiments and simulations. Results show that actively changing the gear-ratio using the proposed control algorithms can lead to an order-of-magnitude reduction of necessary actuator torque and power, and also increase robustness to disturbances.


title: Fully parallel implementation of digital memcomputing on FPGA

abstract: We present a fully parallel digital memcomputing solver implemented on a field-programmable gate array (FPGA) board. For this purpose, we have designed an FPGA code that solves the ordinary differential equations associated with digital memcomputing in parallel. A feature of the code is the use of only integer-type variables and integer constants to enhance optimization. Consequently, each integration step in our solver is executed in 96~ns. This method was utilized for difficult instances of the Boolean satisfiability (SAT) problem close to a phase transition, involving up to about 150 variables. Our results demonstrate that the parallel implementation reduces the scaling exponent by about 1 compared to a sequential C++ code on a standard computer. Additionally, compared to C++ code, we observed a time-to-solution advantage of about three orders of magnitude. Given the limitations of FPGA resources, the current implementation of digital memcomputing will be especially useful for solving compact but challenging problems.


title: On Liouville's Theorem

abstract: In this paper we explore Liouville's theorem on Riemannian cones as defined below. We also study the Strong Liouville Property, that is, the property of a cone having spaces of harmonic functions of a fixed polynomial growth of finite dimension.


title: DuEDL: Dual-Branch Evidential Deep Learning for Scribble-Supervised Medical Image Segmentation

abstract: Despite the recent progress in medical image segmentation with scribble-based annotations, the segmentation results of most models are still not ro-bust and generalizable enough in open environments. Evidential deep learn-ing (EDL) has recently been proposed as a promising solution to model predictive uncertainty and improve the reliability of medical image segmen-tation. However directly applying EDL to scribble-supervised medical im-age segmentation faces a tradeoff between accuracy and reliability. To ad-dress the challenge, we propose a novel framework called Dual-Branch Evi-dential Deep Learning (DuEDL). Firstly, the decoder of the segmentation network is changed to two different branches, and the evidence of the two branches is fused to generate high-quality pseudo-labels. Then the frame-work applies partial evidence loss and two-branch consistent loss for joint training of the model to adapt to the scribble supervision learning. The pro-posed method was tested on two cardiac datasets: ACDC and MSCMRseg. The results show that our method significantly enhances the reliability and generalization ability of the model without sacrificing accuracy, outper-forming state-of-the-art baselines. The code is available at https://github.com/Gardnery/DuEDL.


title: Exploring the use of a Large Language Model for data extraction in systematic reviews: a rapid feasibility study

abstract: This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how to design LLM-based automation tools and how to robustly evaluate their performance. During the 2023 Evidence Synthesis Hackathon we conducted two feasibility studies. Firstly, to automatically extract study characteristics from human clinical, animal, and social science domain studies. We used two studies from each category for prompt-development; and ten for evaluation. Secondly, we used the LLM to predict Participants, Interventions, Controls and Outcomes (PICOs) labelled within 100 abstracts in the EBM-NLP dataset. Overall, results indicated an accuracy of around 80%, with some variability between domains (82% for human clinical, 80% for animal, and 72% for studies of human social sciences). Causal inference methods and study design were the data extraction items with the most errors. In the PICO study, participants and intervention/control showed high accuracy (>80%), outcomes were more challenging. Evaluation was done manually; scoring methods such as BLEU and ROUGE showed limited value. We observed variability in the LLMs predictions and changes in response quality. This paper presents a template for future evaluations of LLMs in the context of data extraction for systematic review automation. Our results show that there might be value in using LLMs, for example as second or third reviewers. However, caution is advised when integrating models such as GPT-4 into tools. Further research on stability and reliability in practical settings is warranted for each type of data that is processed by the LLM.


title: Worldwide Federated Training of Language Models

abstract: The reliance of language model training on massive amounts of computation and vast datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into question practically, legally, and ethically. Federated learning provides a plausible alternative by enabling previously untapped data to be voluntarily gathered from collaborating organizations. However, when scaled globally, federated learning requires collaboration across heterogeneous legal, security, and privacy regimes while accounting for the inherent locality of language data; this further exacerbates the established challenge of federated statistical heterogeneity. We propose a Worldwide Federated Language Model Training~(WorldLM) system based on federations of federations, where each federation has the autonomy to account for factors such as its industry, operating jurisdiction, or competitive environment. WorldLM enables such autonomy in the presence of statistical heterogeneity via partial model localization by allowing sub-federations to attentively aggregate key layers from their constituents. Furthermore, it can adaptively share information across federations via residual layer embeddings. Evaluations of language modeling on naturally heterogeneous datasets show that WorldLM outperforms standard federations by up to $1.91\times$, approaches the personalized performance of fully local models, and maintains these advantages under privacy-enhancing techniques.


title: What can be the limit in the CLT for a field of martingale differences?

abstract: The now classical convergence in distribution theorem for well normalized sums ofstationary martingale increments has been extended to multi-indexed martingaleincrements (see Voln\'{y} (2019) and references in there). In the presentarticle we make progress in the identification of the limit law.In dimension one, as soon as the stationary martingale increments form an ergodic process, the limit law is normal, and it is stillthe case for multi-indexed martingale increments when one of the processes defined by one coordinate of the{\it multidimensional time} is ergodic. In the general case, the limit may be non normal.The dynamical properties of the $\mathbb{Z}^d$-measure preserving action associatedto the stationary random field allows us to give a necessary and sufficient conditionfor the existence of a non-normal limit law, in terms of entropy of some random processes.The identification of a {\it natural} factor on which the $\mathbb{Z}^d$-action is {\it of product type


title: Integration of Hochschild cohomology, derived Picard groups and uniqueness of lifts

abstract: The paper introduces a partial integration map from the first Hochschild cohomology of any cohomologically unital A-infinity category over a field of characteristic zero to its derived Picard group. We discuss useful properties such as injectivity, naturality and the relation with the Baker-Campbell-Hausdorff formula. Based on the image of the integration map we propose a candidate for the identity component of the derived Picard group in the case of finite-dimensional graded algebras. As a first application of the integration map it is shown that the vanishing of its domain is a necessary condition for the uniqueness of lifts of equivalences from the homotopy category to the A-infinity-level. The final part contains applications to derived Picard groups of wrapped and compact Fukaya categories of cotangent bundles and their plumbings and an outlook on applications to derived Picard groups of partially wrapped Fukaya categories after Haiden-Katzarkov-Kontsevich.


title: Adversarial Schr\"odinger Bridge Matching

abstract: The Schr\"odinger Bridge (SB) problem offers a powerful framework for combining optimal transport and diffusion models. A promising recent approach to solve the SB problem is the Iterative Markovian Fitting (IMF) procedure, which alternates between Markovian and reciprocal projections of continuous-time stochastic processes. However, the model built by the IMF procedure has a long inference time due to using many steps of numerical solvers for stochastic differential equations. To address this limitation, we propose a novel Discrete-time IMF (D-IMF) procedure in which learning of stochastic processes is replaced by learning just a few transition probabilities in discrete time. Its great advantage is that in practice it can be naturally implemented using the Denoising Diffusion GAN (DD-GAN), an already well-established adversarial generative modeling technique. We show that our D-IMF procedure can provide the same quality of unpaired domain translation as the IMF, using only several generation steps instead of hundreds.


title: Large-Scale Epitaxial Integration of Single-Crystalline BiSb Topological Insulator on GaAs (111)A

abstract: Topological insulators (TI) are promising materials for future spintronics applications and their epitaxial integration would allow the realization of new hybrid interfaces. As the first materials studied, Bismuth Antimony alloys (Bi1-xSbx) show great potential due to their tuneable electronic band structure and efficient charge-to-spin conversion. Here, we report the growth of Bi1-xSbx thin films on GaAs (111)A substrates following two different protocols. For the conventional epitaxy process, the grown films show excellent crystallinity and twin domains corresponding to an in-plane 180{\textdegree} rotation of the crystalline structure. Domain walls are found to be composition-dependent and have a lower density for Antimony-rich films. For the optimized process, depositing an Antimony bilayer prior to BiSb growth allows achieving single crystallinity of the TI films. The topologically protected surface states are evidenced by ex-situ ARPES measurements for domains-free and conventional films. To the best of our knowledge, this work presents the first large-scale epitaxial integration of single crystalline Bi1-xSbx thin films on industrial substrates.


title: On fractional parabolic systems of vector order

abstract: The paper considers the Cauchy problem for the system of partial differential equations of fractional order $D_t^{\mathcal{B}} {U}(t,x) + \mathbb{A}(D) {U} (t,x)=H(t,x) $. Here $U$ and $H$ are vector-functions, the $m\times m$ matrix of differential operators $\mathbb{A}(D)$ is triangular (elements above or below the diagonal are zero). Operators located on the diagonal are elliptic. The main distinctive feature of this system is that the vector-order $\mathcal{B}$ has different components $\beta_j\in (0,1]$, and $\beta_j$ are not necessarily rational. Sufficient conditions (in some cases they are necessary) on the initial function and the right-hand side of the equation are found to ensure the existence of a classical solution. Note that the existence of a classical solution to systems of fractional differential equations was studied by various authors, but in all these works the fractional order had the same components for each equation: $\beta_j=\beta$, $j=1,...,m$.


title: JointRF: End-to-End Joint Optimization for Dynamic Neural Radiance Field Representation and Compression

abstract: Neural Radiance Field (NeRF) excels in photo-realistically static scenes, inspiring numerous efforts to facilitate volumetric videos. However, rendering dynamic and long-sequence radiance fields remains challenging due to the significant data required to represent volumetric videos. In this paper, we propose a novel end-to-end joint optimization scheme of dynamic NeRF representation and compression, called JointRF, thus achieving significantly improved quality and compression efficiency against the previous methods. Specifically, JointRF employs a compact residual feature grid and a coefficient feature grid to represent the dynamic NeRF. This representation handles large motions without compromising quality while concurrently diminishing temporal redundancy. We also introduce a sequential feature compression subnetwork to further reduce spatial-temporal redundancy. Finally, the representation and compression subnetworks are end-to-end trained combined within the JointRF. Extensive experiments demonstrate that JointRF can achieve superior compression performance across various datasets.


title: Domain-specific augmentations with resolution agnostic self-attention mechanism improves choroid segmentation in optical coherence tomography images

abstract: The choroid is a key vascular layer of the eye, supplying oxygen to the retinal photoreceptors. Non-invasive enhanced depth imaging optical coherence tomography (EDI-OCT) has recently improved access and visualisation of the choroid, making it an exciting frontier for discovering novel vascular biomarkers in ophthalmology and wider systemic health. However, current methods to measure the choroid often require use of multiple, independent semi-automatic and deep learning-based algorithms which are not made open-source. Previously, Choroidalyzer -- an open-source, fully automatic deep learning method trained on 5,600 OCT B-scans from 385 eyes -- was developed to fully segment and quantify the choroid in EDI-OCT images, thus addressing these issues. Using the same dataset, we propose a Robust, Resolution-agnostic and Efficient Attention-based network for CHoroid segmentation (REACH). REACHNet leverages multi-resolution training with domain-specific data augmentation to promote generalisation, and uses a lightweight architecture with resolution-agnostic self-attention which is not only faster than Choroidalyzer's previous network (4 images/s vs. 2.75 images/s on a standard laptop CPU), but has greater performance for segmenting the choroid region, vessels and fovea (Dice coefficient for region 0.9769 vs. 0.9749, vessels 0.8612 vs. 0.8192 and fovea 0.8243 vs. 0.3783) due to its improved hyperparameter configuration and model training pipeline. REACHNet can be used with Choroidalyzer as a drop-in replacement for the original model and will be made available upon publication.


title: Counterexamples to the $p(t)$-adic Littlewood Conjecture Over Small Finite Fields

abstract: In 2004, de Mathan and Teuli\'e stated the $p$-adic Littlewood Conjecture ($p$-$LC$) in analogy with the classical Littlewood Conjecture. Given a field $\mathbb{K}$ and an irreducible polynomial $p(t)$ with coefficients in $\mathbb{K}$, $p$-$LC$ admits a natural analogue over function fields, abbreviated to $p(t)$-$LC$ (and to $t$-$LC$ when $p(t)=t$). In this paper, an explicit counterexample to $p(t)$-$LC$ is found over fields of characteristic 5. Furthermore, it is conjectured that this Laurent series disproves $p(t)$-$LC$ over all fields of characteristic $p\equiv 1 \mod 4$. This fills a gap left by a breakthrough paper from Adiceam, Nesharim and Lunnon (2022) in which they conjecture $t$-$LC$ does not hold over all complementary fields of characteristic $p\equiv 3\mod 4$ and proving this in the case $p=3$. Supported by computational evidence, this provides a complete picture on how $p(t)$-$LC$ is expected to behave over all fields with characteristic not equal to 2. Furthermore, the counterexample to $t$-$LC$ over fields of characteristic 3 found by Adiceam, Nesharim and Lunnon is proven to also hold over fields of characteristic 7 and 11, which provides further evidence to the aforementioned conjecture. Following previous work in this area, these results are achieved by building upon combinatorial arguments and are computer assisted. A new feature of the present work is the development of an efficient algorithm (implemented in Python) that combines the theory of automatic sequences with Diophantine approximation over function fields. This algorithm is expected to be useful for further research around Littlewood-type conjectures over function fields.


title: TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing

abstract: Editing objects within a scene is a critical functionality required across a broad spectrum of applications in computer vision and graphics. As 3D Gaussian Splatting (3DGS) emerges as a frontier in scene representation, the effective modification of 3D Gaussian scenes has become increasingly vital. This process entails accurately retrieve the target objects and subsequently performing modifications based on instructions. Though available in pieces, existing techniques mainly embed sparse semantics into Gaussians for retrieval, and rely on an iterative dataset update paradigm for editing, leading to over-smoothing or inconsistency issues. To this end, this paper proposes a systematic approach, namely TIGER, for coherent text-instructed 3D Gaussian retrieval and editing. In contrast to the top-down language grounding approach for 3D Gaussians, we adopt a bottom-up language aggregation strategy to generate a denser language embedded 3D Gaussians that supports open-vocabulary retrieval. To overcome the over-smoothing and inconsistency issues in editing, we propose a Coherent Score Distillation (CSD) that aggregates a 2D image editing diffusion model and a multi-view diffusion model for score distillation, producing multi-view consistent editing with much finer details. In various experiments, we demonstrate that our TIGER is able to accomplish more consistent and realistic edits than prior work.


title: Cumulant-based approximation for fast and efficient prediction for species distribution

abstract: Species distribution modeling plays an important role in estimating the habitat suitability of species using environmental variables. For this purpose, Maxent and the Poisson point process are popular and powerful methods extensively employed across various ecological and biological sciences. However, the computational speed becomes prohibitively slow when using huge background datasets, which is often the case with fine-resolution data or global-scale estimations. To address this problem, we propose a computationally efficient species distribution model using a cumulant-based approximation (CBA) applied to the loss function of $\gamma$-divergence. Additionally, we introduce a sequential estimating algorithm with an $L_1$ penalty to select important environmental variables closely associated with species distribution. The regularized geometric-mean method, derived from the CBA, demonstrates high computational efficiency and estimation accuracy. Moreover, by applying CBA to Maxent, we establish that Maxent and Fisher linear discriminant analysis are equivalent under a normality assumption. This equivalence leads to an highly efficient computational method for estimating species distribution. The effectiveness of our proposed methods is illustrated through simulation studies and by analyzing data on 226 species from the National Centre for Ecological Analysis and Synthesis and 709 Japanese vascular plant species. The computational efficiency of the proposed methods is significantly improved compared to Maxent, while maintaining comparable estimation accuracy. A R package {\tt CBA} is also prepared to provide all programming codes used in simulation studies and real data analysis.


title: Tighter Privacy Auditing of DP-SGD in the Hidden State Threat Model

abstract: Machine learning models can be trained with formal privacy guarantees via differentially private optimizers such as DP-SGD. In this work, we study such privacy guarantees when the adversary only accesses the final model, i.e., intermediate model updates are not released. In the existing literature, this hidden state threat model exhibits a significant gap between the lower bound provided by empirical privacy auditing and the theoretical upper bound provided by privacy accounting. To challenge this gap, we propose to audit this threat model with adversaries that craft a gradient sequence to maximize the privacy loss of the final model without accessing intermediate models. We demonstrate experimentally how this approach consistently outperforms prior attempts at auditing the hidden state model. When the crafted gradient is inserted at every optimization step, our results imply that releasing only the final model does not amplify privacy, providing a novel negative result. On the other hand, when the crafted gradient is not inserted at every step, we show strong evidence that a privacy amplification phenomenon emerges in the general non-convex setting (albeit weaker than in convex regimes), suggesting that existing privacy upper bounds can be improved.